2024-04-25T17:01:22.100 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-25T17:01:22.101 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673288 --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} --name pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi --verbose -- /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673288/orig.config.yaml 2024-04-25T17:01:22.154 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T17:01:22.248 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673288 branch: wip-pdonnell-testing-20240425.015853-debug description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: pdonnell@redhat.com first_in_suite: false job_id: '7673288' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/quincy ' name: pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240425.015853-debug ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240425.015853-debug sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 owner: scheduled_pdonnell@teuthology priority: 85 repo: https://git.ceph.com/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 1880 sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 sleep_before_teardown: 0 subset: 178/512 suite: fs suite_branch: wip-pdonnell-testing-20240425.015853-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 targets: smithi037.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA4ZNxzWMFLkH2lZwNv5NoQC/ID9tULh/tD6YEqK2RoYMzh3+940S735eupn86z5dFRlmWX5DGothW346w9v7DE= smithi069.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL5Rm0sk/I6/ZYKswEMitkAFFtBNg9gTGJA9UKwOHFmbso0UebSc6bWiPXj1RVpAaiDh5sEz9lCwDJ42J0THqRY= tasks: - install: branch: quincy exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: cephadm_branch: quincy cephadm_git_url: https://github.com/ceph/ceph conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:quincy roleless: true - print: '**** done end installing quincy cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 1 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay true - cephadm.shell: host.a: - ceph fs set cephfs inline_data false - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - ceph-fuse: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: - /cephfs/home/pdonnell/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20240425.015853-debug/qa/suites/fs/upgrade/mds_upgrade_sequence/tasks/3-upgrade-mgr-staggered.yaml meta: {} postmerge: [] variables: fail_fs: false teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-25_10:00:23 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs false || true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-04-25T17:01:22.248 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa; will attempt to use it 2024-04-25T17:01:22.249 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa/tasks 2024-04-25T17:01:22.249 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-25T17:01:22.250 INFO:teuthology.task.internal:Checking packages... 2024-04-25T17:01:22.272 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '994e2f20102a20fa9a27966c14b625cc01884df8' 2024-04-25T17:01:22.272 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T17:01:22.273 INFO:teuthology.packaging:ref: None 2024-04-25T17:01:22.273 INFO:teuthology.packaging:tag: None 2024-04-25T17:01:22.273 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240425.015853-debug 2024-04-25T17:01:22.273 INFO:teuthology.packaging:sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T17:01:22.273 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240425.015853-debug 2024-04-25T17:01:22.522 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3291.g994e2f20 2024-04-25T17:01:22.524 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-25T17:01:22.530 INFO:teuthology.task.internal:no buildpackages task found 2024-04-25T17:01:22.530 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-25T17:01:22.536 INFO:teuthology.task.internal:Saving configuration 2024-04-25T17:01:22.556 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-25T17:01:22.562 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T17:01:22.587 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi037.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673288', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 16:56:28.573002', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA4ZNxzWMFLkH2lZwNv5NoQC/ID9tULh/tD6YEqK2RoYMzh3+940S735eupn86z5dFRlmWX5DGothW346w9v7DE='} 2024-04-25T17:01:22.609 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi069.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673288', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 16:56:28.571356', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL5Rm0sk/I6/ZYKswEMitkAFFtBNg9gTGJA9UKwOHFmbso0UebSc6bWiPXj1RVpAaiDh5sEz9lCwDJ42J0THqRY='} 2024-04-25T17:01:22.609 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-25T17:01:22.615 INFO:teuthology.task.internal:roles: ubuntu@smithi037.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-04-25T17:01:22.616 INFO:teuthology.task.internal:roles: ubuntu@smithi069.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-04-25T17:01:22.616 INFO:teuthology.run_tasks:Running task console_log... 2024-04-25T17:01:22.690 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa14c8550d0>, signals=[15]) 2024-04-25T17:01:22.691 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-25T17:01:22.697 INFO:teuthology.task.internal:Opening connections... 2024-04-25T17:01:22.698 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi037.front.sepia.ceph.com 2024-04-25T17:01:22.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T17:01:22.778 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi069.front.sepia.ceph.com 2024-04-25T17:01:22.779 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T17:01:22.850 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-25T17:01:22.857 DEBUG:teuthology.orchestra.run.smithi037:> uname -m 2024-04-25T17:01:22.875 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64 2024-04-25T17:01:22.875 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release 2024-04-25T17:01:22.932 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="CentOS Stream" 2024-04-25T17:01:22.932 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="9" 2024-04-25T17:01:22.932 INFO:teuthology.orchestra.run.smithi037.stdout:ID="centos" 2024-04-25T17:01:22.933 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="rhel fedora" 2024-04-25T17:01:22.933 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="9" 2024-04-25T17:01:22.933 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el9" 2024-04-25T17:01:22.933 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-25T17:01:22.933 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31" 2024-04-25T17:01:22.933 INFO:teuthology.orchestra.run.smithi037.stdout:LOGO="fedora-logo-icon" 2024-04-25T17:01:22.933 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-25T17:01:22.933 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://centos.org/" 2024-04-25T17:01:22.933 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T17:01:22.933 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-25T17:01:22.933 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T17:01:22.934 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2024-04-25T17:01:22.958 DEBUG:teuthology.orchestra.run.smithi069:> uname -m 2024-04-25T17:01:22.976 INFO:teuthology.orchestra.run.smithi069.stdout:x86_64 2024-04-25T17:01:22.976 DEBUG:teuthology.orchestra.run.smithi069:> cat /etc/os-release 2024-04-25T17:01:23.033 INFO:teuthology.orchestra.run.smithi069.stdout:NAME="CentOS Stream" 2024-04-25T17:01:23.033 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION="9" 2024-04-25T17:01:23.033 INFO:teuthology.orchestra.run.smithi069.stdout:ID="centos" 2024-04-25T17:01:23.033 INFO:teuthology.orchestra.run.smithi069.stdout:ID_LIKE="rhel fedora" 2024-04-25T17:01:23.034 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION_ID="9" 2024-04-25T17:01:23.034 INFO:teuthology.orchestra.run.smithi069.stdout:PLATFORM_ID="platform:el9" 2024-04-25T17:01:23.034 INFO:teuthology.orchestra.run.smithi069.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-25T17:01:23.034 INFO:teuthology.orchestra.run.smithi069.stdout:ANSI_COLOR="0;31" 2024-04-25T17:01:23.034 INFO:teuthology.orchestra.run.smithi069.stdout:LOGO="fedora-logo-icon" 2024-04-25T17:01:23.034 INFO:teuthology.orchestra.run.smithi069.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-25T17:01:23.034 INFO:teuthology.orchestra.run.smithi069.stdout:HOME_URL="https://centos.org/" 2024-04-25T17:01:23.034 INFO:teuthology.orchestra.run.smithi069.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T17:01:23.034 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-25T17:01:23.034 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T17:01:23.034 INFO:teuthology.lock.ops:Updating smithi069.front.sepia.ceph.com on lock server 2024-04-25T17:01:23.058 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-25T17:01:23.067 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-25T17:01:23.074 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-25T17:01:23.074 DEBUG:teuthology.orchestra.run.smithi037:> test '!' -e /home/ubuntu/cephtest 2024-04-25T17:01:23.076 DEBUG:teuthology.orchestra.run.smithi069:> test '!' -e /home/ubuntu/cephtest 2024-04-25T17:01:23.092 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-25T17:01:23.098 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-25T17:01:23.098 DEBUG:teuthology.orchestra.run.smithi037:> test -z $(ls -A /var/lib/ceph) 2024-04-25T17:01:23.134 DEBUG:teuthology.orchestra.run.smithi069:> test -z $(ls -A /var/lib/ceph) 2024-04-25T17:01:23.250 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-25T17:01:23.307 INFO:teuthology.run_tasks:Running task kernel... 2024-04-25T17:01:23.324 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-04-25T17:01:23.324 INFO:teuthology.task.kernel:config {'host.a': {'kdb': True, 'sha1': 'distro'}, 'host.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-04-25T17:01:23.324 DEBUG:teuthology.orchestra.run.smithi037:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T17:01:23.325 DEBUG:teuthology.orchestra.run.smithi069:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T17:01:23.341 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T17:01:23.342 DEBUG:teuthology.orchestra.run.smithi069:> uname -r 2024-04-25T17:01:23.342 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T17:01:23.343 DEBUG:teuthology.orchestra.run.smithi037:> uname -r 2024-04-25T17:01:23.398 INFO:teuthology.orchestra.run.smithi069.stdout:5.14.0-437.el9.x86_64 2024-04-25T17:01:23.399 INFO:teuthology.task.kernel:Running kernel on smithi069: 5.14.0-437.el9.x86_64 2024-04-25T17:01:23.399 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum install -y kernel 2024-04-25T17:01:23.400 INFO:teuthology.orchestra.run.smithi037.stdout:5.14.0-437.el9.x86_64 2024-04-25T17:01:23.400 INFO:teuthology.task.kernel:Running kernel on smithi037: 5.14.0-437.el9.x86_64 2024-04-25T17:01:23.400 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum install -y kernel 2024-04-25T17:01:25.775 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.0 MB 00:00 2024-04-25T17:01:26.050 INFO:teuthology.orchestra.run.smithi069.stdout:CentOS Stream 9 - BaseOS 8.2 MB/s | 8.0 MB 00:00 2024-04-25T17:01:27.685 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - AppStream 25 MB/s | 19 MB 00:00 2024-04-25T17:01:27.910 INFO:teuthology.orchestra.run.smithi069.stdout:CentOS Stream 9 - AppStream 23 MB/s | 19 MB 00:00 2024-04-25T17:01:31.869 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.2 MB 00:00 2024-04-25T17:01:32.227 INFO:teuthology.orchestra.run.smithi069.stdout:CentOS Stream 9 - CRB 8.5 MB/s | 6.2 MB 00:00 2024-04-25T17:01:36.500 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - Extras packages 4.8 kB/s | 16 kB 00:03 2024-04-25T17:01:40.757 INFO:teuthology.orchestra.run.smithi069.stdout:CentOS Stream 9 - Extras packages 2.2 kB/s | 16 kB 00:07 2024-04-25T17:01:49.470 INFO:teuthology.orchestra.run.smithi037.stdout:Extra Packages for Enterprise Linux 1.6 MB/s | 21 MB 00:12 2024-04-25T17:01:51.002 INFO:teuthology.orchestra.run.smithi069.stdout:Extra Packages for Enterprise Linux 2.1 MB/s | 21 MB 00:10 2024-04-25T17:01:54.683 INFO:teuthology.orchestra.run.smithi037.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-04-25T17:01:56.090 INFO:teuthology.orchestra.run.smithi069.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2024-04-25T17:01:56.690 INFO:teuthology.orchestra.run.smithi037.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-25T17:01:56.690 INFO:teuthology.orchestra.run.smithi037.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-25T17:01:56.778 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-04-25T17:01:56.779 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2024-04-25T17:01:56.779 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-04-25T17:01:56.884 DEBUG:teuthology.orchestra.run.smithi037:> echo no | sudo yum reinstall kernel || true 2024-04-25T17:01:57.447 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:00:03 ago on Thu 25 Apr 2024 05:01:54 PM UTC. 2024-04-25T17:01:57.571 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-04-25T17:01:57.583 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-25T17:01:57.583 INFO:teuthology.orchestra.run.smithi037.stdout: Package Architecture Version Repository Size 2024-04-25T17:01:57.583 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-25T17:01:57.583 INFO:teuthology.orchestra.run.smithi037.stdout:Reinstalling: 2024-04-25T17:01:57.583 INFO:teuthology.orchestra.run.smithi037.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T17:01:57.583 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:01:57.583 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-04-25T17:01:57.583 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-25T17:01:57.583 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:01:57.583 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 255 k 2024-04-25T17:01:57.583 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 0 2024-04-25T17:01:57.584 INFO:teuthology.orchestra.run.smithi037.stderr:Operation aborted. 2024-04-25T17:01:57.633 INFO:teuthology.orchestra.run.smithi037.stdout:Is this ok [y/N]: 2024-04-25T17:01:57.634 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum reinstall -y kernel || true 2024-04-25T17:01:57.997 INFO:teuthology.orchestra.run.smithi069.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-25T17:01:57.997 INFO:teuthology.orchestra.run.smithi069.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-25T17:01:58.075 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2024-04-25T17:01:58.079 INFO:teuthology.orchestra.run.smithi069.stdout:Nothing to do. 2024-04-25T17:01:58.079 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2024-04-25T17:01:58.150 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:00:04 ago on Thu 25 Apr 2024 05:01:54 PM UTC. 2024-04-25T17:01:58.188 DEBUG:teuthology.orchestra.run.smithi069:> echo no | sudo yum reinstall kernel || true 2024-04-25T17:01:58.271 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-04-25T17:01:58.271 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-25T17:01:58.271 INFO:teuthology.orchestra.run.smithi037.stdout: Package Architecture Version Repository Size 2024-04-25T17:01:58.271 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-25T17:01:58.271 INFO:teuthology.orchestra.run.smithi037.stdout:Reinstalling: 2024-04-25T17:01:58.272 INFO:teuthology.orchestra.run.smithi037.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T17:01:58.272 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:01:58.272 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-04-25T17:01:58.272 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-25T17:01:58.272 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:01:58.272 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 255 k 2024-04-25T17:01:58.272 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 0 2024-04-25T17:01:58.273 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-04-25T17:01:58.568 INFO:teuthology.orchestra.run.smithi037.stdout:kernel-5.14.0-437.el9.x86_64.rpm 1.9 MB/s | 255 kB 00:00 2024-04-25T17:01:58.569 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-04-25T17:01:58.569 INFO:teuthology.orchestra.run.smithi037.stdout:Total 857 kB/s | 255 kB 00:00 2024-04-25T17:01:58.588 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-04-25T17:01:58.727 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:00:02 ago on Thu 25 Apr 2024 05:01:56 PM UTC. 2024-04-25T17:01:58.759 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-04-25T17:01:58.759 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-04-25T17:01:58.764 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-04-25T17:01:58.765 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-04-25T17:01:58.845 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2024-04-25T17:01:58.863 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-04-25T17:01:58.863 INFO:teuthology.orchestra.run.smithi069.stdout: Package Architecture Version Repository Size 2024-04-25T17:01:58.863 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-04-25T17:01:58.863 INFO:teuthology.orchestra.run.smithi069.stdout:Reinstalling: 2024-04-25T17:01:58.863 INFO:teuthology.orchestra.run.smithi069.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T17:01:58.863 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:01:58.863 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction Summary 2024-04-25T17:01:58.863 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-04-25T17:01:58.863 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:01:58.864 INFO:teuthology.orchestra.run.smithi069.stdout:Total download size: 255 k 2024-04-25T17:01:58.864 INFO:teuthology.orchestra.run.smithi069.stdout:Installed size: 0 2024-04-25T17:01:58.864 INFO:teuthology.orchestra.run.smithi069.stderr:Operation aborted. 2024-04-25T17:01:58.906 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-04-25T17:01:58.916 INFO:teuthology.orchestra.run.smithi069.stdout:Is this ok [y/N]: 2024-04-25T17:01:58.917 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum reinstall -y kernel || true 2024-04-25T17:01:58.995 INFO:teuthology.orchestra.run.smithi037.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T17:01:58.995 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T17:01:59.411 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:00:03 ago on Thu 25 Apr 2024 05:01:56 PM UTC. 2024-04-25T17:01:59.526 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2024-04-25T17:01:59.527 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-04-25T17:01:59.527 INFO:teuthology.orchestra.run.smithi069.stdout: Package Architecture Version Repository Size 2024-04-25T17:01:59.527 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-04-25T17:01:59.527 INFO:teuthology.orchestra.run.smithi069.stdout:Reinstalling: 2024-04-25T17:01:59.527 INFO:teuthology.orchestra.run.smithi069.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T17:01:59.527 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:01:59.527 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction Summary 2024-04-25T17:01:59.527 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-04-25T17:01:59.527 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:01:59.528 INFO:teuthology.orchestra.run.smithi069.stdout:Total download size: 255 k 2024-04-25T17:01:59.528 INFO:teuthology.orchestra.run.smithi069.stdout:Installed size: 0 2024-04-25T17:01:59.528 INFO:teuthology.orchestra.run.smithi069.stdout:Downloading Packages: 2024-04-25T17:01:59.602 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T17:01:59.602 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T17:01:59.876 INFO:teuthology.orchestra.run.smithi069.stdout:kernel-5.14.0-437.el9.x86_64.rpm 1.4 MB/s | 255 kB 00:00 2024-04-25T17:01:59.877 INFO:teuthology.orchestra.run.smithi069.stdout:-------------------------------------------------------------------------------- 2024-04-25T17:01:59.877 INFO:teuthology.orchestra.run.smithi069.stdout:Total 730 kB/s | 255 kB 00:00 2024-04-25T17:01:59.898 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction check 2024-04-25T17:02:00.078 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction check succeeded. 2024-04-25T17:02:00.079 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction test 2024-04-25T17:02:00.083 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction test succeeded. 2024-04-25T17:02:00.084 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction 2024-04-25T17:02:00.248 INFO:teuthology.orchestra.run.smithi069.stdout: Preparing : 1/1 2024-04-25T17:02:00.319 INFO:teuthology.orchestra.run.smithi069.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T17:02:00.319 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T17:02:00.323 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T17:02:00.323 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:02:00.324 INFO:teuthology.orchestra.run.smithi037.stdout:Reinstalled: 2024-04-25T17:02:00.324 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-25T17:02:00.324 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:02:00.324 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-04-25T17:02:00.483 DEBUG:teuthology.orchestra.run.smithi037:> rpm -q kernel | sort -rV | head -n 1 2024-04-25T17:02:00.531 INFO:teuthology.orchestra.run.smithi037.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-25T17:02:00.532 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-25T17:02:00.532 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-25T17:02:00.532 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-04-25T17:02:00.532 DEBUG:teuthology.orchestra.run.smithi037:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-25T17:02:00.567 INFO:teuthology.orchestra.run.smithi037.stdout:ttyS1 2024-04-25T17:02:00.587 DEBUG:teuthology.parallel:result is None 2024-04-25T17:02:01.060 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T17:02:01.060 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T17:02:01.786 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T17:02:01.786 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:02:01.786 INFO:teuthology.orchestra.run.smithi069.stdout:Reinstalled: 2024-04-25T17:02:01.786 INFO:teuthology.orchestra.run.smithi069.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-25T17:02:01.786 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:02:01.786 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2024-04-25T17:02:01.937 DEBUG:teuthology.orchestra.run.smithi069:> rpm -q kernel | sort -rV | head -n 1 2024-04-25T17:02:02.024 INFO:teuthology.orchestra.run.smithi069.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-25T17:02:02.024 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-25T17:02:02.024 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-25T17:02:02.024 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-04-25T17:02:02.024 DEBUG:teuthology.orchestra.run.smithi069:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-25T17:02:02.060 INFO:teuthology.orchestra.run.smithi069.stdout:ttyS1 2024-04-25T17:02:02.085 DEBUG:teuthology.parallel:result is None 2024-04-25T17:02:02.086 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-25T17:02:02.093 INFO:teuthology.task.internal:Creating test directory... 2024-04-25T17:02:02.093 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T17:02:02.095 DEBUG:teuthology.orchestra.run.smithi069:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T17:02:02.140 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-25T17:02:02.147 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-25T17:02:02.170 INFO:teuthology.task.internal:Creating archive directory... 2024-04-25T17:02:02.170 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T17:02:02.172 DEBUG:teuthology.orchestra.run.smithi069:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T17:02:02.208 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-25T17:02:02.215 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-25T17:02:02.216 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T17:02:02.237 DEBUG:teuthology.orchestra.run.smithi069:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T17:02:02.273 INFO:teuthology.orchestra.run.smithi069.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T17:02:02.275 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T17:02:02.282 INFO:teuthology.orchestra.run.smithi069.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T17:02:02.287 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T17:02:02.288 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-25T17:02:02.296 INFO:teuthology.task.internal:Configuring sudo... 2024-04-25T17:02:02.296 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T17:02:02.331 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T17:02:02.357 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-25T17:02:02.366 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-25T17:02:02.366 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T17:02:02.400 DEBUG:teuthology.orchestra.run.smithi069:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T17:02:02.415 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T17:02:02.498 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T17:02:02.560 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T17:02:02.602 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T17:02:02.645 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-25T17:02:02.645 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T17:02:02.710 DEBUG:teuthology.orchestra.run.smithi069:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T17:02:02.753 DEBUG:teuthology.orchestra.run.smithi069:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T17:02:02.803 DEBUG:teuthology.orchestra.run.smithi069:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T17:02:02.886 DEBUG:teuthology.orchestra.run.smithi069:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T17:02:02.927 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-04-25T17:02:02.927 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T17:02:02.990 DEBUG:teuthology.orchestra.run.smithi037:> sudo service rsyslog restart 2024-04-25T17:02:02.992 DEBUG:teuthology.orchestra.run.smithi069:> sudo service rsyslog restart 2024-04-25T17:02:03.033 INFO:teuthology.orchestra.run.smithi037.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T17:02:03.078 INFO:teuthology.orchestra.run.smithi069.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T17:02:03.453 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-25T17:02:03.462 INFO:teuthology.task.internal:Starting timer... 2024-04-25T17:02:03.462 INFO:teuthology.run_tasks:Running task pcp... 2024-04-25T17:02:03.472 INFO:teuthology.run_tasks:Running task selinux... 2024-04-25T17:02:03.480 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-04-25T17:02:03.481 DEBUG:teuthology.orchestra.run.smithi037:> sudo service auditd rotate 2024-04-25T17:02:03.538 INFO:teuthology.orchestra.run.smithi037.stdout:Rotating logs: 2024-04-25T17:02:03.540 DEBUG:teuthology.orchestra.run.smithi069:> sudo service auditd rotate 2024-04-25T17:02:03.582 INFO:teuthology.orchestra.run.smithi069.stdout:Rotating logs: 2024-04-25T17:02:03.583 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-25T17:02:03.584 DEBUG:teuthology.orchestra.run.smithi037:> /usr/sbin/getenforce 2024-04-25T17:02:03.610 INFO:teuthology.orchestra.run.smithi037.stdout:Permissive 2024-04-25T17:02:03.610 DEBUG:teuthology.orchestra.run.smithi069:> /usr/sbin/getenforce 2024-04-25T17:02:03.648 INFO:teuthology.orchestra.run.smithi069.stdout:Permissive 2024-04-25T17:02:03.648 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi037.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi069.front.sepia.ceph.com': 'permissive'} 2024-04-25T17:02:03.649 DEBUG:teuthology.orchestra.run.smithi037:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T17:02:03.677 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T17:02:03.677 DEBUG:teuthology.orchestra.run.smithi069:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T17:02:03.712 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T17:02:03.712 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-25T17:02:03.712 DEBUG:teuthology.orchestra.run.smithi037:> sudo /usr/sbin/setenforce permissive 2024-04-25T17:02:03.742 DEBUG:teuthology.orchestra.run.smithi069:> sudo /usr/sbin/setenforce permissive 2024-04-25T17:02:03.776 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-25T17:02:03.786 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-25T17:02:03.802 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-25T17:02:03.803 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi037.front.sepia.ceph.com,smithi069.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-25T17:05:34.269 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi037.front.sepia.ceph.com'), Remote(name='ubuntu@smithi069.front.sepia.ceph.com')] 2024-04-25T17:05:34.270 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-04-25T17:05:34.271 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T17:05:34.351 DEBUG:teuthology.orchestra.run.smithi037:> true 2024-04-25T17:05:34.437 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-04-25T17:05:34.438 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi069.front.sepia.ceph.com' 2024-04-25T17:05:34.438 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T17:05:34.518 DEBUG:teuthology.orchestra.run.smithi069:> true 2024-04-25T17:05:34.596 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi069.front.sepia.ceph.com' 2024-04-25T17:05:34.597 INFO:teuthology.run_tasks:Running task clock... 2024-04-25T17:05:34.607 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-25T17:05:34.607 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T17:05:34.608 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T17:05:34.610 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T17:05:34.610 DEBUG:teuthology.orchestra.run.smithi069:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T17:05:34.640 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T17:05:34.659 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T17:05:34.663 INFO:teuthology.orchestra.run.smithi069.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T17:05:34.676 INFO:teuthology.orchestra.run.smithi069.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T17:05:34.683 INFO:teuthology.orchestra.run.smithi037.stderr:sudo: ntpd: command not found 2024-04-25T17:05:34.699 INFO:teuthology.orchestra.run.smithi069.stderr:sudo: ntpd: command not found 2024-04-25T17:05:34.709 INFO:teuthology.orchestra.run.smithi069.stdout:506 Cannot talk to daemon 2024-04-25T17:05:34.712 INFO:teuthology.orchestra.run.smithi037.stdout:506 Cannot talk to daemon 2024-04-25T17:05:34.723 INFO:teuthology.orchestra.run.smithi069.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T17:05:34.727 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T17:05:34.736 INFO:teuthology.orchestra.run.smithi069.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T17:05:34.741 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T17:05:34.791 INFO:teuthology.orchestra.run.smithi069.stderr:bash: line 1: ntpq: command not found 2024-04-25T17:05:34.795 INFO:teuthology.orchestra.run.smithi069.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T17:05:34.795 INFO:teuthology.orchestra.run.smithi069.stdout:=============================================================================== 2024-04-25T17:05:34.795 INFO:teuthology.orchestra.run.smithi069.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T17:05:34.795 INFO:teuthology.orchestra.run.smithi069.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T17:05:34.795 INFO:teuthology.orchestra.run.smithi069.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T17:05:34.795 INFO:teuthology.orchestra.run.smithi069.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T17:05:34.811 INFO:teuthology.orchestra.run.smithi037.stderr:bash: line 1: ntpq: command not found 2024-04-25T17:05:34.815 INFO:teuthology.orchestra.run.smithi037.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T17:05:34.815 INFO:teuthology.orchestra.run.smithi037.stdout:=============================================================================== 2024-04-25T17:05:34.815 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T17:05:34.815 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T17:05:34.815 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T17:05:34.816 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T17:05:34.816 INFO:teuthology.run_tasks:Running task install... 2024-04-25T17:05:34.824 DEBUG:teuthology.task.install:project ceph 2024-04-25T17:05:34.824 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'}} 2024-04-25T17:05:34.825 DEBUG:teuthology.task.install:config {'branch': 'quincy', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'} 2024-04-25T17:05:34.825 INFO:teuthology.task.install:Using flavor: default 2024-04-25T17:05:34.830 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-25T17:05:34.830 INFO:teuthology.task.install:extra packages: [] 2024-04-25T17:05:34.830 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8', 'tag': None, 'wait_for_package': False} 2024-04-25T17:05:34.831 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T17:05:34.831 INFO:teuthology.packaging:ref: None 2024-04-25T17:05:34.831 INFO:teuthology.packaging:tag: None 2024-04-25T17:05:34.831 INFO:teuthology.packaging:branch: quincy 2024-04-25T17:05:34.831 INFO:teuthology.packaging:sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T17:05:34.831 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-04-25T17:05:34.833 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8', 'tag': None, 'wait_for_package': False} 2024-04-25T17:05:34.833 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T17:05:34.833 INFO:teuthology.packaging:ref: None 2024-04-25T17:05:34.833 INFO:teuthology.packaging:tag: None 2024-04-25T17:05:34.834 INFO:teuthology.packaging:branch: quincy 2024-04-25T17:05:34.834 INFO:teuthology.packaging:sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T17:05:34.834 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-04-25T17:05:35.069 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/quincy/c61472c83ce76869b0fe076c19ed2f4bcc3fb4af/centos/9/flavors/default/ 2024-04-25T17:05:35.069 INFO:teuthology.task.install.rpm:Package version is 17.2.7-902.gc61472c8 2024-04-25T17:05:35.171 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/quincy/c61472c83ce76869b0fe076c19ed2f4bcc3fb4af/centos/9/flavors/default/ 2024-04-25T17:05:35.172 INFO:teuthology.task.install.rpm:Package version is 17.2.7-902.gc61472c8 2024-04-25T17:05:35.183 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/quincy/c61472c83ce76869b0fe076c19ed2f4bcc3fb4af/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/quincy/c61472c83ce76869b0fe076c19ed2f4bcc3fb4af/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/quincy/c61472c83ce76869b0fe076c19ed2f4bcc3fb4af/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T17:05:35.184 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-04-25T17:05:35.184 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T17:05:35.207 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-25T17:05:35.207 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T17:05:35.207 INFO:teuthology.packaging:ref: None 2024-04-25T17:05:35.207 INFO:teuthology.packaging:tag: None 2024-04-25T17:05:35.207 INFO:teuthology.packaging:branch: quincy 2024-04-25T17:05:35.207 INFO:teuthology.packaging:sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T17:05:35.208 DEBUG:teuthology.orchestra.run.smithi069:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T17:05:35.271 DEBUG:teuthology.orchestra.run.smithi069:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T17:05:35.341 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/quincy/c61472c83ce76869b0fe076c19ed2f4bcc3fb4af/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/quincy/c61472c83ce76869b0fe076c19ed2f4bcc3fb4af/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/quincy/c61472c83ce76869b0fe076c19ed2f4bcc3fb4af/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T17:05:35.342 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-25T17:05:35.342 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T17:05:35.344 DEBUG:teuthology.orchestra.run.smithi069:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T17:05:35.367 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-25T17:05:35.367 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T17:05:35.367 INFO:teuthology.packaging:ref: None 2024-04-25T17:05:35.367 INFO:teuthology.packaging:tag: None 2024-04-25T17:05:35.367 INFO:teuthology.packaging:branch: quincy 2024-04-25T17:05:35.367 INFO:teuthology.packaging:sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T17:05:35.368 DEBUG:teuthology.orchestra.run.smithi037:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T17:05:35.406 INFO:teuthology.orchestra.run.smithi069.stdout:check_obsoletes = 1 2024-04-25T17:05:35.408 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum clean all 2024-04-25T17:05:35.432 DEBUG:teuthology.orchestra.run.smithi037:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T17:05:35.507 DEBUG:teuthology.orchestra.run.smithi037:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T17:05:35.574 INFO:teuthology.orchestra.run.smithi037.stdout:check_obsoletes = 1 2024-04-25T17:05:35.575 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum clean all 2024-04-25T17:05:35.629 INFO:teuthology.orchestra.run.smithi069.stdout:48 files removed 2024-04-25T17:05:35.656 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum -y install ceph-radosgw 2024-04-25T17:05:35.810 INFO:teuthology.orchestra.run.smithi037.stdout:48 files removed 2024-04-25T17:05:35.836 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-radosgw 2024-04-25T17:05:36.416 INFO:teuthology.orchestra.run.smithi069.stdout:ceph packages for x86_64 152 kB/s | 77 kB 00:00 2024-04-25T17:05:36.652 INFO:teuthology.orchestra.run.smithi037.stdout:ceph packages for x86_64 142 kB/s | 77 kB 00:00 2024-04-25T17:05:36.833 INFO:teuthology.orchestra.run.smithi069.stdout:ceph noarch packages 28 kB/s | 11 kB 00:00 2024-04-25T17:05:37.020 INFO:teuthology.orchestra.run.smithi037.stdout:ceph noarch packages 33 kB/s | 11 kB 00:00 2024-04-25T17:05:37.267 INFO:teuthology.orchestra.run.smithi069.stdout:ceph source packages 4.5 kB/s | 1.8 kB 00:00 2024-04-25T17:05:37.387 INFO:teuthology.orchestra.run.smithi037.stdout:ceph source packages 5.4 kB/s | 1.8 kB 00:00 2024-04-25T17:05:38.253 INFO:teuthology.orchestra.run.smithi069.stdout:CentOS Stream 9 - BaseOS 8.4 MB/s | 8.0 MB 00:00 2024-04-25T17:05:38.390 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - BaseOS 8.3 MB/s | 8.0 MB 00:00 2024-04-25T17:05:40.104 INFO:teuthology.orchestra.run.smithi069.stdout:CentOS Stream 9 - AppStream 24 MB/s | 19 MB 00:00 2024-04-25T17:05:40.291 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - AppStream 24 MB/s | 19 MB 00:00 2024-04-25T17:05:44.313 INFO:teuthology.orchestra.run.smithi069.stdout:CentOS Stream 9 - CRB 9.0 MB/s | 6.2 MB 00:00 2024-04-25T17:05:44.859 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - CRB 7.6 MB/s | 6.2 MB 00:00 2024-04-25T17:05:46.003 INFO:teuthology.orchestra.run.smithi069.stdout:CentOS Stream 9 - Extras packages 29 kB/s | 16 kB 00:00 2024-04-25T17:05:46.316 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - Extras packages 61 kB/s | 16 kB 00:00 2024-04-25T17:05:48.183 INFO:teuthology.orchestra.run.smithi037.stdout:Extra Packages for Enterprise Linux 12 MB/s | 21 MB 00:01 2024-04-25T17:05:48.315 INFO:teuthology.orchestra.run.smithi069.stdout:Extra Packages for Enterprise Linux 9.5 MB/s | 21 MB 00:02 2024-04-25T17:05:53.371 INFO:teuthology.orchestra.run.smithi069.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2024-04-25T17:05:53.450 INFO:teuthology.orchestra.run.smithi037.stdout:lab-extras 45 kB/s | 1.7 kB 00:00 2024-04-25T17:05:55.479 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2024-04-25T17:05:55.481 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-04-25T17:05:55.481 INFO:teuthology.orchestra.run.smithi069.stdout: Package Arch Version Repository Size 2024-04-25T17:05:55.481 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-04-25T17:05:55.481 INFO:teuthology.orchestra.run.smithi069.stdout:Installing: 2024-04-25T17:05:55.481 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-radosgw x86_64 2:17.2.7-902.gc61472c8.el9 ceph 14 M 2024-04-25T17:05:55.481 INFO:teuthology.orchestra.run.smithi069.stdout:Upgrading: 2024-04-25T17:05:55.481 INFO:teuthology.orchestra.run.smithi069.stdout: librados2 x86_64 2:17.2.7-902.gc61472c8.el9 ceph 3.1 M 2024-04-25T17:05:55.481 INFO:teuthology.orchestra.run.smithi069.stdout: librbd1 x86_64 2:17.2.7-902.gc61472c8.el9 ceph 2.9 M 2024-04-25T17:05:55.481 INFO:teuthology.orchestra.run.smithi069.stdout:Installing dependencies: 2024-04-25T17:05:55.481 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-base x86_64 2:17.2.7-902.gc61472c8.el9 ceph 5.0 M 2024-04-25T17:05:55.481 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-common x86_64 2:17.2.7-902.gc61472c8.el9 ceph 22 M 2024-04-25T17:05:55.481 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-selinux x86_64 2:17.2.7-902.gc61472c8.el9 ceph 25 k 2024-04-25T17:05:55.482 INFO:teuthology.orchestra.run.smithi069.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-25T17:05:55.482 INFO:teuthology.orchestra.run.smithi069.stdout: libcephfs2 x86_64 2:17.2.7-902.gc61472c8.el9 ceph 637 k 2024-04-25T17:05:55.482 INFO:teuthology.orchestra.run.smithi069.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-25T17:05:55.482 INFO:teuthology.orchestra.run.smithi069.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-25T17:05:55.482 INFO:teuthology.orchestra.run.smithi069.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-25T17:05:55.482 INFO:teuthology.orchestra.run.smithi069.stdout: libradosstriper1 x86_64 2:17.2.7-902.gc61472c8.el9 ceph 457 k 2024-04-25T17:05:55.482 INFO:teuthology.orchestra.run.smithi069.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-25T17:05:55.482 INFO:teuthology.orchestra.run.smithi069.stdout: librgw2 x86_64 2:17.2.7-902.gc61472c8.el9 ceph 4.9 M 2024-04-25T17:05:55.482 INFO:teuthology.orchestra.run.smithi069.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-25T17:05:55.482 INFO:teuthology.orchestra.run.smithi069.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-25T17:05:55.482 INFO:teuthology.orchestra.run.smithi069.stdout: python3-ceph-argparse x86_64 2:17.2.7-902.gc61472c8.el9 ceph 45 k 2024-04-25T17:05:55.482 INFO:teuthology.orchestra.run.smithi069.stdout: python3-ceph-common x86_64 2:17.2.7-902.gc61472c8.el9 ceph 117 k 2024-04-25T17:05:55.482 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cephfs x86_64 2:17.2.7-902.gc61472c8.el9 ceph 156 k 2024-04-25T17:05:55.483 INFO:teuthology.orchestra.run.smithi069.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-25T17:05:55.483 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rados x86_64 2:17.2.7-902.gc61472c8.el9 ceph 320 k 2024-04-25T17:05:55.483 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rbd x86_64 2:17.2.7-902.gc61472c8.el9 ceph 293 k 2024-04-25T17:05:55.483 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rgw x86_64 2:17.2.7-902.gc61472c8.el9 ceph 99 k 2024-04-25T17:05:55.483 INFO:teuthology.orchestra.run.smithi069.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-25T17:05:55.483 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:05:55.483 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction Summary 2024-04-25T17:05:55.483 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-04-25T17:05:55.483 INFO:teuthology.orchestra.run.smithi069.stdout:Install 22 Packages 2024-04-25T17:05:55.483 INFO:teuthology.orchestra.run.smithi069.stdout:Upgrade 2 Packages 2024-04-25T17:05:55.483 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:05:55.484 INFO:teuthology.orchestra.run.smithi069.stdout:Total download size: 58 M 2024-04-25T17:05:55.484 INFO:teuthology.orchestra.run.smithi069.stdout:Downloading Packages: 2024-04-25T17:05:55.680 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-04-25T17:05:55.681 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-25T17:05:55.682 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2024-04-25T17:05:55.682 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-25T17:05:55.682 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-04-25T17:05:55.682 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-radosgw x86_64 2:17.2.7-902.gc61472c8.el9 ceph 14 M 2024-04-25T17:05:55.682 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrading: 2024-04-25T17:05:55.682 INFO:teuthology.orchestra.run.smithi037.stdout: librados2 x86_64 2:17.2.7-902.gc61472c8.el9 ceph 3.1 M 2024-04-25T17:05:55.682 INFO:teuthology.orchestra.run.smithi037.stdout: librbd1 x86_64 2:17.2.7-902.gc61472c8.el9 ceph 2.9 M 2024-04-25T17:05:55.682 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2024-04-25T17:05:55.682 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base x86_64 2:17.2.7-902.gc61472c8.el9 ceph 5.0 M 2024-04-25T17:05:55.682 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common x86_64 2:17.2.7-902.gc61472c8.el9 ceph 22 M 2024-04-25T17:05:55.682 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-selinux x86_64 2:17.2.7-902.gc61472c8.el9 ceph 25 k 2024-04-25T17:05:55.682 INFO:teuthology.orchestra.run.smithi037.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-25T17:05:55.683 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs2 x86_64 2:17.2.7-902.gc61472c8.el9 ceph 637 k 2024-04-25T17:05:55.683 INFO:teuthology.orchestra.run.smithi037.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-25T17:05:55.683 INFO:teuthology.orchestra.run.smithi037.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-25T17:05:55.683 INFO:teuthology.orchestra.run.smithi037.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-25T17:05:55.683 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1 x86_64 2:17.2.7-902.gc61472c8.el9 ceph 457 k 2024-04-25T17:05:55.683 INFO:teuthology.orchestra.run.smithi037.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-25T17:05:55.683 INFO:teuthology.orchestra.run.smithi037.stdout: librgw2 x86_64 2:17.2.7-902.gc61472c8.el9 ceph 4.9 M 2024-04-25T17:05:55.683 INFO:teuthology.orchestra.run.smithi037.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-25T17:05:55.683 INFO:teuthology.orchestra.run.smithi037.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-25T17:05:55.683 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-argparse x86_64 2:17.2.7-902.gc61472c8.el9 ceph 45 k 2024-04-25T17:05:55.683 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-common x86_64 2:17.2.7-902.gc61472c8.el9 ceph 117 k 2024-04-25T17:05:55.683 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cephfs x86_64 2:17.2.7-902.gc61472c8.el9 ceph 156 k 2024-04-25T17:05:55.683 INFO:teuthology.orchestra.run.smithi037.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-25T17:05:55.684 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rados x86_64 2:17.2.7-902.gc61472c8.el9 ceph 320 k 2024-04-25T17:05:55.684 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rbd x86_64 2:17.2.7-902.gc61472c8.el9 ceph 293 k 2024-04-25T17:05:55.684 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rgw x86_64 2:17.2.7-902.gc61472c8.el9 ceph 99 k 2024-04-25T17:05:55.684 INFO:teuthology.orchestra.run.smithi037.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-25T17:05:55.684 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:05:55.684 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-04-25T17:05:55.684 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-25T17:05:55.684 INFO:teuthology.orchestra.run.smithi037.stdout:Install 22 Packages 2024-04-25T17:05:55.684 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrade 2 Packages 2024-04-25T17:05:55.684 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:05:55.685 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 58 M 2024-04-25T17:05:55.685 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-04-25T17:05:57.722 INFO:teuthology.orchestra.run.smithi069.stdout:(1/24): ceph-base-17.2.7-902.gc61472c8.el9.x86_ 3.2 MB/s | 5.0 MB 00:01 2024-04-25T17:05:57.780 INFO:teuthology.orchestra.run.smithi069.stdout:(2/24): ceph-selinux-17.2.7-902.gc61472c8.el9.x 433 kB/s | 25 kB 00:00 2024-04-25T17:05:57.956 INFO:teuthology.orchestra.run.smithi069.stdout:(3/24): libcephfs2-17.2.7-902.gc61472c8.el9.x86 3.6 MB/s | 637 kB 00:00 2024-04-25T17:05:58.098 INFO:teuthology.orchestra.run.smithi069.stdout:(4/24): libradosstriper1-17.2.7-902.gc61472c8.e 3.2 MB/s | 457 kB 00:00 2024-04-25T17:05:58.935 INFO:teuthology.orchestra.run.smithi037.stdout:(1/24): ceph-common-17.2.7-902.gc61472c8.el9.x8 7.5 MB/s | 22 MB 00:02 2024-04-25T17:05:58.985 INFO:teuthology.orchestra.run.smithi037.stdout:(2/24): ceph-selinux-17.2.7-902.gc61472c8.el9.x 508 kB/s | 25 kB 00:00 2024-04-25T17:05:59.006 INFO:teuthology.orchestra.run.smithi069.stdout:(5/24): librgw2-17.2.7-902.gc61472c8.el9.x86_64 5.4 MB/s | 4.9 MB 00:00 2024-04-25T17:05:59.073 INFO:teuthology.orchestra.run.smithi069.stdout:(6/24): python3-ceph-argparse-17.2.7-902.gc6147 679 kB/s | 45 kB 00:00 2024-04-25T17:05:59.085 INFO:teuthology.orchestra.run.smithi037.stdout:(3/24): libcephfs2-17.2.7-902.gc61472c8.el9.x86 6.2 MB/s | 637 kB 00:00 2024-04-25T17:05:59.132 INFO:teuthology.orchestra.run.smithi069.stdout:(7/24): python3-ceph-common-17.2.7-902.gc61472c 2.0 MB/s | 117 kB 00:00 2024-04-25T17:05:59.152 INFO:teuthology.orchestra.run.smithi037.stdout:(4/24): libradosstriper1-17.2.7-902.gc61472c8.e 6.7 MB/s | 457 kB 00:00 2024-04-25T17:05:59.190 INFO:teuthology.orchestra.run.smithi069.stdout:(8/24): python3-cephfs-17.2.7-902.gc61472c8.el9 2.6 MB/s | 156 kB 00:00 2024-04-25T17:05:59.324 INFO:teuthology.orchestra.run.smithi069.stdout:(9/24): python3-rados-17.2.7-902.gc61472c8.el9. 2.3 MB/s | 320 kB 00:00 2024-04-25T17:05:59.407 INFO:teuthology.orchestra.run.smithi069.stdout:(10/24): python3-rbd-17.2.7-902.gc61472c8.el9.x 3.4 MB/s | 293 kB 00:00 2024-04-25T17:05:59.586 INFO:teuthology.orchestra.run.smithi037.stdout:(5/24): librgw2-17.2.7-902.gc61472c8.el9.x86_64 11 MB/s | 4.9 MB 00:00 2024-04-25T17:05:59.625 INFO:teuthology.orchestra.run.smithi069.stdout:(11/24): ceph-common-17.2.7-902.gc61472c8.el9.x 6.5 MB/s | 22 MB 00:03 2024-04-25T17:05:59.636 INFO:teuthology.orchestra.run.smithi037.stdout:(6/24): python3-ceph-argparse-17.2.7-902.gc6147 908 kB/s | 45 kB 00:00 2024-04-25T17:05:59.650 INFO:teuthology.orchestra.run.smithi069.stdout:(12/24): python3-rgw-17.2.7-902.gc61472c8.el9.x 411 kB/s | 99 kB 00:00 2024-04-25T17:05:59.686 INFO:teuthology.orchestra.run.smithi037.stdout:(7/24): python3-ceph-common-17.2.7-902.gc61472c 2.3 MB/s | 117 kB 00:00 2024-04-25T17:05:59.753 INFO:teuthology.orchestra.run.smithi037.stdout:(8/24): ceph-base-17.2.7-902.gc61472c8.el9.x86_ 1.3 MB/s | 5.0 MB 00:03 2024-04-25T17:05:59.767 INFO:teuthology.orchestra.run.smithi069.stdout:(13/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 500 kB/s | 45 kB 00:00 2024-04-25T17:05:59.778 INFO:teuthology.orchestra.run.smithi037.stdout:(9/24): python3-cephfs-17.2.7-902.gc61472c8.el9 1.7 MB/s | 156 kB 00:00 2024-04-25T17:05:59.808 INFO:teuthology.orchestra.run.smithi069.stdout:(14/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 873 kB/s | 160 kB 00:00 2024-04-25T17:05:59.829 INFO:teuthology.orchestra.run.smithi037.stdout:(10/24): python3-rbd-17.2.7-902.gc61472c8.el9.x 5.7 MB/s | 293 kB 00:00 2024-04-25T17:05:59.859 INFO:teuthology.orchestra.run.smithi069.stdout:(15/24): librdkafka-1.6.1-102.el9.x86_64.rpm 7.1 MB/s | 662 kB 00:00 2024-04-25T17:05:59.879 INFO:teuthology.orchestra.run.smithi037.stdout:(11/24): python3-rgw-17.2.7-902.gc61472c8.el9.x 2.0 MB/s | 99 kB 00:00 2024-04-25T17:05:59.892 INFO:teuthology.orchestra.run.smithi069.stdout:(16/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-04-25T17:05:59.912 INFO:teuthology.orchestra.run.smithi037.stdout:(12/24): python3-rados-17.2.7-902.gc61472c8.el9 2.0 MB/s | 320 kB 00:00 2024-04-25T17:05:59.917 INFO:teuthology.orchestra.run.smithi069.stdout:(17/24): python3-prettytable-0.7.2-27.el9.noarc 727 kB/s | 42 kB 00:00 2024-04-25T17:06:00.026 INFO:teuthology.orchestra.run.smithi069.stdout:(18/24): liboath-2.6.7-2.el9.x86_64.rpm 448 kB/s | 49 kB 00:00 2024-04-25T17:06:00.038 INFO:teuthology.orchestra.run.smithi037.stdout:(13/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 362 kB/s | 45 kB 00:00 2024-04-25T17:06:00.063 INFO:teuthology.orchestra.run.smithi037.stdout:(14/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 873 kB/s | 160 kB 00:00 2024-04-25T17:06:00.077 INFO:teuthology.orchestra.run.smithi069.stdout:(19/24): gperftools-libs-2.9.1-2.el9.x86_64.rpm 1.6 MB/s | 309 kB 00:00 2024-04-25T17:06:00.102 INFO:teuthology.orchestra.run.smithi069.stdout:(20/24): libunwind-1.6.2-1.el9.x86_64.rpm 896 kB/s | 67 kB 00:00 2024-04-25T17:06:00.122 INFO:teuthology.orchestra.run.smithi037.stdout:(15/24): librdkafka-1.6.1-102.el9.x86_64.rpm 7.8 MB/s | 662 kB 00:00 2024-04-25T17:06:00.147 INFO:teuthology.orchestra.run.smithi037.stdout:(16/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-04-25T17:06:00.172 INFO:teuthology.orchestra.run.smithi037.stdout:(17/24): python3-prettytable-0.7.2-27.el9.noarc 853 kB/s | 42 kB 00:00 2024-04-25T17:06:00.286 INFO:teuthology.orchestra.run.smithi069.stdout:(21/24): thrift-0.15.0-2.el9.x86_64.rpm 7.6 MB/s | 1.6 MB 00:00 2024-04-25T17:06:00.289 INFO:teuthology.orchestra.run.smithi037.stdout:(18/24): liboath-2.6.7-2.el9.x86_64.rpm 416 kB/s | 49 kB 00:00 2024-04-25T17:06:00.356 INFO:teuthology.orchestra.run.smithi037.stdout:(19/24): gperftools-libs-2.9.1-2.el9.x86_64.rpm 1.4 MB/s | 309 kB 00:00 2024-04-25T17:06:00.381 INFO:teuthology.orchestra.run.smithi037.stdout:(20/24): libunwind-1.6.2-1.el9.x86_64.rpm 734 kB/s | 67 kB 00:00 2024-04-25T17:06:00.444 INFO:teuthology.orchestra.run.smithi069.stdout:(22/24): librados2-17.2.7-902.gc61472c8.el9.x86 9.0 MB/s | 3.1 MB 00:00 2024-04-25T17:06:00.482 INFO:teuthology.orchestra.run.smithi037.stdout:(21/24): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-04-25T17:06:00.586 INFO:teuthology.orchestra.run.smithi069.stdout:(23/24): librbd1-17.2.7-902.gc61472c8.el9.x86_6 9.8 MB/s | 2.9 MB 00:00 2024-04-25T17:06:00.715 INFO:teuthology.orchestra.run.smithi037.stdout:(22/24): librbd1-17.2.7-902.gc61472c8.el9.x86_6 13 MB/s | 2.9 MB 00:00 2024-04-25T17:06:01.540 INFO:teuthology.orchestra.run.smithi037.stdout:(23/24): librados2-17.2.7-902.gc61472c8.el9.x86 2.7 MB/s | 3.1 MB 00:01 2024-04-25T17:06:02.974 INFO:teuthology.orchestra.run.smithi037.stdout:(24/24): ceph-radosgw-17.2.7-902.gc61472c8.el9. 2.0 MB/s | 14 MB 00:07 2024-04-25T17:06:02.979 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-04-25T17:06:02.979 INFO:teuthology.orchestra.run.smithi037.stdout:Total 7.9 MB/s | 58 MB 00:07 2024-04-25T17:06:03.040 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-04-25T17:06:03.078 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-04-25T17:06:03.078 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-04-25T17:06:03.538 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-04-25T17:06:03.539 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-04-25T17:06:03.903 INFO:teuthology.orchestra.run.smithi069.stdout:(24/24): ceph-radosgw-17.2.7-902.gc61472c8.el9. 1.8 MB/s | 14 MB 00:07 2024-04-25T17:06:03.908 INFO:teuthology.orchestra.run.smithi069.stdout:-------------------------------------------------------------------------------- 2024-04-25T17:06:03.908 INFO:teuthology.orchestra.run.smithi069.stdout:Total 6.9 MB/s | 58 MB 00:08 2024-04-25T17:06:03.967 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction check 2024-04-25T17:06:04.001 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction check succeeded. 2024-04-25T17:06:04.001 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction test 2024-04-25T17:06:04.438 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction test succeeded. 2024-04-25T17:06:04.438 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction 2024-04-25T17:06:04.860 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-04-25T17:06:05.211 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-04-25T17:06:05.310 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : librados2-2:17.2.7-902.gc61472c8.el9.x86_64 2/26 2024-04-25T17:06:05.403 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados2-2:17.2.7-902.gc61472c8.el9.x86_64 2/26 2024-04-25T17:06:05.483 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rados-2:17.2.7-902.gc61472c8.el9.x86_64 3/26 2024-04-25T17:06:05.512 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephfs2-2:17.2.7-902.gc61472c8.el9.x86_64 4/26 2024-04-25T17:06:05.592 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephfs2-2:17.2.7-902.gc61472c8.el9.x86_64 4/26 2024-04-25T17:06:05.638 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-04-25T17:06:05.661 INFO:teuthology.orchestra.run.smithi069.stdout: Preparing : 1/1 2024-04-25T17:06:05.666 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-04-25T17:06:06.048 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-04-25T17:06:06.113 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : librados2-2:17.2.7-902.gc61472c8.el9.x86_64 2/26 2024-04-25T17:06:06.124 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-04-25T17:06:06.156 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librgw2-2:17.2.7-902.gc61472c8.el9.x86_64 8/26 2024-04-25T17:06:06.204 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: librados2-2:17.2.7-902.gc61472c8.el9.x86_64 2/26 2024-04-25T17:06:06.283 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-rados-2:17.2.7-902.gc61472c8.el9.x86_64 3/26 2024-04-25T17:06:06.332 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libcephfs2-2:17.2.7-902.gc61472c8.el9.x86_64 4/26 2024-04-25T17:06:06.352 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librgw2-2:17.2.7-902.gc61472c8.el9.x86_64 8/26 2024-04-25T17:06:06.391 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-04-25T17:06:06.419 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libcephfs2-2:17.2.7-902.gc61472c8.el9.x86_64 4/26 2024-04-25T17:06:06.426 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ceph-argparse-2:17.2.7-902.gc61472c8.el9.x 10/26 2024-04-25T17:06:06.463 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cephfs-2:17.2.7-902.gc61472c8.el9.x86_64 11/26 2024-04-25T17:06:06.465 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-04-25T17:06:06.503 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-04-25T17:06:06.527 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rgw-2:17.2.7-902.gc61472c8.el9.x86_64 12/26 2024-04-25T17:06:07.401 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libradosstriper1-2:17.2.7-902.gc61472c8.el9.x86_64 13/26 2024-04-25T17:06:07.401 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libradosstriper1-2:17.2.7-902.gc61472c8.el9.x86_64 13/26 2024-04-25T17:06:07.401 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-04-25T17:06:07.401 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/26 2024-04-25T17:06:07.401 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-04-25T17:06:07.401 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-04-25T17:06:07.401 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : librbd1-2:17.2.7-902.gc61472c8.el9.x86_64 18/26 2024-04-25T17:06:07.401 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librbd1-2:17.2.7-902.gc61472c8.el9.x86_64 18/26 2024-04-25T17:06:07.401 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rbd-2:17.2.7-902.gc61472c8.el9.x86_64 19/26 2024-04-25T17:06:07.402 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ceph-common-2:17.2.7-902.gc61472c8.el9.x86 20/26 2024-04-25T17:06:07.402 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-04-25T17:06:07.402 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : librgw2-2:17.2.7-902.gc61472c8.el9.x86_64 8/26 2024-04-25T17:06:07.402 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: librgw2-2:17.2.7-902.gc61472c8.el9.x86_64 8/26 2024-04-25T17:06:07.402 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-04-25T17:06:07.402 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-ceph-argparse-2:17.2.7-902.gc61472c8.el9.x 10/26 2024-04-25T17:06:07.402 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cephfs-2:17.2.7-902.gc61472c8.el9.x86_64 11/26 2024-04-25T17:06:07.402 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-rgw-2:17.2.7-902.gc61472c8.el9.x86_64 12/26 2024-04-25T17:06:07.402 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libradosstriper1-2:17.2.7-902.gc61472c8.el9.x86_64 13/26 2024-04-25T17:06:07.403 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libradosstriper1-2:17.2.7-902.gc61472c8.el9.x86_64 13/26 2024-04-25T17:06:07.403 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-04-25T17:06:07.403 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/26 2024-04-25T17:06:07.403 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-04-25T17:06:07.673 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-04-25T17:06:07.716 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : librbd1-2:17.2.7-902.gc61472c8.el9.x86_64 18/26 2024-04-25T17:06:07.805 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: librbd1-2:17.2.7-902.gc61472c8.el9.x86_64 18/26 2024-04-25T17:06:07.879 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-rbd-2:17.2.7-902.gc61472c8.el9.x86_64 19/26 2024-04-25T17:06:07.910 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-ceph-common-2:17.2.7-902.gc61472c8.el9.x86 20/26 2024-04-25T17:06:09.928 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-common-2:17.2.7-902.gc61472c8.el9.x86_64 21/26 2024-04-25T17:06:09.963 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-common-2:17.2.7-902.gc61472c8.el9.x86_64 21/26 2024-04-25T17:06:10.372 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-common-2:17.2.7-902.gc61472c8.el9.x86_64 21/26 2024-04-25T17:06:10.415 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-common-2:17.2.7-902.gc61472c8.el9.x86_64 21/26 2024-04-25T17:06:10.501 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-common-2:17.2.7-902.gc61472c8.el9.x86_64 21/26 2024-04-25T17:06:10.550 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-base-2:17.2.7-902.gc61472c8.el9.x86_64 22/26 2024-04-25T17:06:10.651 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-base-2:17.2.7-902.gc61472c8.el9.x86_64 22/26 2024-04-25T17:06:10.651 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-25T17:06:10.651 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-25T17:06:10.651 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:06:10.702 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-selinux-2:17.2.7-902.gc61472c8.el9.x86_64 23/26 2024-04-25T17:06:10.918 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-common-2:17.2.7-902.gc61472c8.el9.x86_64 21/26 2024-04-25T17:06:10.968 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-base-2:17.2.7-902.gc61472c8.el9.x86_64 22/26 2024-04-25T17:06:11.053 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-base-2:17.2.7-902.gc61472c8.el9.x86_64 22/26 2024-04-25T17:06:11.053 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-25T17:06:11.053 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-25T17:06:11.053 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:06:11.086 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-selinux-2:17.2.7-902.gc61472c8.el9.x86_64 23/26 2024-04-25T17:06:20.325 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-selinux-2:17.2.7-902.gc61472c8.el9.x86_64 23/26 2024-04-25T17:06:20.326 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /sys 2024-04-25T17:06:20.326 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /proc 2024-04-25T17:06:20.326 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /mnt 2024-04-25T17:06:20.326 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /var/tmp 2024-04-25T17:06:20.326 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /home 2024-04-25T17:06:20.326 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /root 2024-04-25T17:06:20.326 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /tmp 2024-04-25T17:06:20.326 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:06:20.347 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-selinux-2:17.2.7-902.gc61472c8.el9.x86_64 23/26 2024-04-25T17:06:20.347 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /sys 2024-04-25T17:06:20.347 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /proc 2024-04-25T17:06:20.347 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /mnt 2024-04-25T17:06:20.347 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /var/tmp 2024-04-25T17:06:20.347 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /home 2024-04-25T17:06:20.347 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /root 2024-04-25T17:06:20.347 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /tmp 2024-04-25T17:06:20.347 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:06:21.613 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-radosgw-2:17.2.7-902.gc61472c8.el9.x86_64 24/26 2024-04-25T17:06:21.644 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-radosgw-2:17.2.7-902.gc61472c8.el9.x86_64 24/26 2024-04-25T17:06:21.674 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-902.gc61472c8.el9.x86_64 24/26 2024-04-25T17:06:21.674 INFO:teuthology.orchestra.run.smithi069.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T17:06:21.674 INFO:teuthology.orchestra.run.smithi069.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-25T17:06:21.674 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T17:06:21.674 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T17:06:21.674 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:06:21.676 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-04-25T17:06:21.723 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-902.gc61472c8.el9.x86_64 24/26 2024-04-25T17:06:21.723 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T17:06:21.723 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-25T17:06:21.723 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T17:06:21.723 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T17:06:21.723 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:06:21.724 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-04-25T17:06:21.766 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-04-25T17:06:21.766 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-04-25T17:06:21.830 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-04-25T17:06:21.830 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-04-25T17:06:23.112 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-04-25T17:06:23.112 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-base-2:17.2.7-902.gc61472c8.el9.x86_64 1/26 2024-04-25T17:06:23.113 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-common-2:17.2.7-902.gc61472c8.el9.x86_64 2/26 2024-04-25T17:06:23.113 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-radosgw-2:17.2.7-902.gc61472c8.el9.x86_64 3/26 2024-04-25T17:06:23.113 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-selinux-2:17.2.7-902.gc61472c8.el9.x86_64 4/26 2024-04-25T17:06:23.113 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libcephfs2-2:17.2.7-902.gc61472c8.el9.x86_64 5/26 2024-04-25T17:06:23.113 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libradosstriper1-2:17.2.7-902.gc61472c8.el9.x86_64 6/26 2024-04-25T17:06:23.113 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librgw2-2:17.2.7-902.gc61472c8.el9.x86_64 7/26 2024-04-25T17:06:23.113 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-ceph-argparse-2:17.2.7-902.gc61472c8.el9.x 8/26 2024-04-25T17:06:23.113 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-ceph-common-2:17.2.7-902.gc61472c8.el9.x86 9/26 2024-04-25T17:06:23.113 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cephfs-2:17.2.7-902.gc61472c8.el9.x86_64 10/26 2024-04-25T17:06:23.113 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-rados-2:17.2.7-902.gc61472c8.el9.x86_64 11/26 2024-04-25T17:06:23.113 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-rbd-2:17.2.7-902.gc61472c8.el9.x86_64 12/26 2024-04-25T17:06:23.113 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-rgw-2:17.2.7-902.gc61472c8.el9.x86_64 13/26 2024-04-25T17:06:23.113 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-04-25T17:06:23.114 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-04-25T17:06:23.114 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-04-25T17:06:23.114 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-04-25T17:06:23.114 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-04-25T17:06:23.114 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 19/26 2024-04-25T17:06:23.114 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-04-25T17:06:23.114 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-04-25T17:06:23.114 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-04-25T17:06:23.114 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librados2-2:17.2.7-902.gc61472c8.el9.x86_64 23/26 2024-04-25T17:06:23.114 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-04-25T17:06:23.114 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librbd1-2:17.2.7-902.gc61472c8.el9.x86_64 25/26 2024-04-25T17:06:23.165 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-04-25T17:06:23.165 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-base-2:17.2.7-902.gc61472c8.el9.x86_64 1/26 2024-04-25T17:06:23.165 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-common-2:17.2.7-902.gc61472c8.el9.x86_64 2/26 2024-04-25T17:06:23.165 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-radosgw-2:17.2.7-902.gc61472c8.el9.x86_64 3/26 2024-04-25T17:06:23.165 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-selinux-2:17.2.7-902.gc61472c8.el9.x86_64 4/26 2024-04-25T17:06:23.165 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephfs2-2:17.2.7-902.gc61472c8.el9.x86_64 5/26 2024-04-25T17:06:23.165 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libradosstriper1-2:17.2.7-902.gc61472c8.el9.x86_64 6/26 2024-04-25T17:06:23.165 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librgw2-2:17.2.7-902.gc61472c8.el9.x86_64 7/26 2024-04-25T17:06:23.165 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ceph-argparse-2:17.2.7-902.gc61472c8.el9.x 8/26 2024-04-25T17:06:23.165 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ceph-common-2:17.2.7-902.gc61472c8.el9.x86 9/26 2024-04-25T17:06:23.166 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cephfs-2:17.2.7-902.gc61472c8.el9.x86_64 10/26 2024-04-25T17:06:23.166 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rados-2:17.2.7-902.gc61472c8.el9.x86_64 11/26 2024-04-25T17:06:23.166 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rbd-2:17.2.7-902.gc61472c8.el9.x86_64 12/26 2024-04-25T17:06:23.166 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rgw-2:17.2.7-902.gc61472c8.el9.x86_64 13/26 2024-04-25T17:06:23.166 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-04-25T17:06:23.166 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-04-25T17:06:23.166 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-04-25T17:06:23.166 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-04-25T17:06:23.166 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-04-25T17:06:23.166 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 19/26 2024-04-25T17:06:23.166 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-04-25T17:06:23.167 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-04-25T17:06:23.167 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-04-25T17:06:23.167 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados2-2:17.2.7-902.gc61472c8.el9.x86_64 23/26 2024-04-25T17:06:23.167 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-04-25T17:06:23.167 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librbd1-2:17.2.7-902.gc61472c8.el9.x86_64 25/26 2024-04-25T17:06:23.769 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-04-25T17:06:23.769 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:06:23.769 INFO:teuthology.orchestra.run.smithi069.stdout:Upgraded: 2024-04-25T17:06:23.769 INFO:teuthology.orchestra.run.smithi069.stdout: librados2-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T17:06:23.769 INFO:teuthology.orchestra.run.smithi069.stdout: librbd1-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T17:06:23.769 INFO:teuthology.orchestra.run.smithi069.stdout:Installed: 2024-04-25T17:06:23.769 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-base-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T17:06:23.769 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-common-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T17:06:23.769 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-radosgw-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T17:06:23.769 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-selinux-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T17:06:23.769 INFO:teuthology.orchestra.run.smithi069.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-25T17:06:23.769 INFO:teuthology.orchestra.run.smithi069.stdout: libcephfs2-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T17:06:23.770 INFO:teuthology.orchestra.run.smithi069.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-25T17:06:23.770 INFO:teuthology.orchestra.run.smithi069.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-25T17:06:23.770 INFO:teuthology.orchestra.run.smithi069.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-25T17:06:23.770 INFO:teuthology.orchestra.run.smithi069.stdout: libradosstriper1-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T17:06:23.770 INFO:teuthology.orchestra.run.smithi069.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-25T17:06:23.770 INFO:teuthology.orchestra.run.smithi069.stdout: librgw2-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T17:06:23.770 INFO:teuthology.orchestra.run.smithi069.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-25T17:06:23.770 INFO:teuthology.orchestra.run.smithi069.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-25T17:06:23.770 INFO:teuthology.orchestra.run.smithi069.stdout: python3-ceph-argparse-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T17:06:23.770 INFO:teuthology.orchestra.run.smithi069.stdout: python3-ceph-common-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T17:06:23.770 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cephfs-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T17:06:23.770 INFO:teuthology.orchestra.run.smithi069.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-25T17:06:23.770 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rados-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T17:06:23.771 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rbd-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T17:06:23.771 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rgw-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T17:06:23.771 INFO:teuthology.orchestra.run.smithi069.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-25T17:06:23.771 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:06:23.771 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2024-04-25T17:06:23.810 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-04-25T17:06:23.811 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:06:23.811 INFO:teuthology.orchestra.run.smithi037.stdout:Upgraded: 2024-04-25T17:06:23.811 INFO:teuthology.orchestra.run.smithi037.stdout: librados2-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T17:06:23.811 INFO:teuthology.orchestra.run.smithi037.stdout: librbd1-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T17:06:23.812 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-04-25T17:06:23.812 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T17:06:23.812 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T17:06:23.812 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-radosgw-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T17:06:23.812 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-selinux-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T17:06:23.812 INFO:teuthology.orchestra.run.smithi037.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-25T17:06:23.812 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs2-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T17:06:23.812 INFO:teuthology.orchestra.run.smithi037.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-25T17:06:23.812 INFO:teuthology.orchestra.run.smithi037.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-25T17:06:23.812 INFO:teuthology.orchestra.run.smithi037.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-25T17:06:23.812 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T17:06:23.812 INFO:teuthology.orchestra.run.smithi037.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-25T17:06:23.813 INFO:teuthology.orchestra.run.smithi037.stdout: librgw2-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T17:06:23.813 INFO:teuthology.orchestra.run.smithi037.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-25T17:06:23.813 INFO:teuthology.orchestra.run.smithi037.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-25T17:06:23.813 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-argparse-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T17:06:23.813 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-common-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T17:06:23.813 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cephfs-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T17:06:23.813 INFO:teuthology.orchestra.run.smithi037.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-25T17:06:23.813 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rados-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T17:06:23.813 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rbd-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T17:06:23.813 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rgw-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T17:06:23.813 INFO:teuthology.orchestra.run.smithi037.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-25T17:06:23.813 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:06:23.813 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-04-25T17:06:24.021 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum -y install ceph-test 2024-04-25T17:06:24.071 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-test 2024-04-25T17:06:24.549 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:00:31 ago on Thu 25 Apr 2024 05:05:53 PM UTC. 2024-04-25T17:06:24.626 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:00:31 ago on Thu 25 Apr 2024 05:05:53 PM UTC. 2024-04-25T17:06:24.670 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2024-04-25T17:06:24.670 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-04-25T17:06:24.670 INFO:teuthology.orchestra.run.smithi069.stdout: Package Arch Version Repository Size 2024-04-25T17:06:24.670 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-04-25T17:06:24.671 INFO:teuthology.orchestra.run.smithi069.stdout:Installing: 2024-04-25T17:06:24.671 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-test x86_64 2:17.2.7-902.gc61472c8.el9 ceph 48 M 2024-04-25T17:06:24.671 INFO:teuthology.orchestra.run.smithi069.stdout:Installing dependencies: 2024-04-25T17:06:24.671 INFO:teuthology.orchestra.run.smithi069.stdout: libcephsqlite x86_64 2:17.2.7-902.gc61472c8.el9 ceph 163 k 2024-04-25T17:06:24.671 INFO:teuthology.orchestra.run.smithi069.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-25T17:06:24.671 INFO:teuthology.orchestra.run.smithi069.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-25T17:06:24.671 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:06:24.671 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction Summary 2024-04-25T17:06:24.671 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-04-25T17:06:24.671 INFO:teuthology.orchestra.run.smithi069.stdout:Install 4 Packages 2024-04-25T17:06:24.671 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:06:24.672 INFO:teuthology.orchestra.run.smithi069.stdout:Total download size: 48 M 2024-04-25T17:06:24.672 INFO:teuthology.orchestra.run.smithi069.stdout:Installed size: 192 M 2024-04-25T17:06:24.672 INFO:teuthology.orchestra.run.smithi069.stdout:Downloading Packages: 2024-04-25T17:06:24.754 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-04-25T17:06:24.755 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-25T17:06:24.755 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2024-04-25T17:06:24.755 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-25T17:06:24.755 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-04-25T17:06:24.755 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-test x86_64 2:17.2.7-902.gc61472c8.el9 ceph 48 M 2024-04-25T17:06:24.755 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2024-04-25T17:06:24.755 INFO:teuthology.orchestra.run.smithi037.stdout: libcephsqlite x86_64 2:17.2.7-902.gc61472c8.el9 ceph 163 k 2024-04-25T17:06:24.755 INFO:teuthology.orchestra.run.smithi037.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-25T17:06:24.756 INFO:teuthology.orchestra.run.smithi037.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-25T17:06:24.756 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:06:24.756 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-04-25T17:06:24.756 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-25T17:06:24.756 INFO:teuthology.orchestra.run.smithi037.stdout:Install 4 Packages 2024-04-25T17:06:24.756 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:06:24.756 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 48 M 2024-04-25T17:06:24.756 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 192 M 2024-04-25T17:06:24.757 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-04-25T17:06:25.190 INFO:teuthology.orchestra.run.smithi069.stdout:(1/4): libcephsqlite-17.2.7-902.gc61472c8.el9.x 631 kB/s | 163 kB 00:00 2024-04-25T17:06:25.249 INFO:teuthology.orchestra.run.smithi069.stdout:(2/4): socat-1.7.4.1-5.el9.x86_64.rpm 961 kB/s | 305 kB 00:00 2024-04-25T17:06:25.290 INFO:teuthology.orchestra.run.smithi037.stdout:(1/4): libcephsqlite-17.2.7-902.gc61472c8.el9.x 470 kB/s | 163 kB 00:00 2024-04-25T17:06:25.300 INFO:teuthology.orchestra.run.smithi069.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 586 kB/s | 64 kB 00:00 2024-04-25T17:06:25.325 INFO:teuthology.orchestra.run.smithi037.stdout:(2/4): socat-1.7.4.1-5.el9.x86_64.rpm 797 kB/s | 305 kB 00:00 2024-04-25T17:06:25.365 INFO:teuthology.orchestra.run.smithi037.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 846 kB/s | 64 kB 00:00 2024-04-25T17:06:27.983 INFO:teuthology.orchestra.run.smithi037.stdout:(4/4): ceph-test-17.2.7-902.gc61472c8.el9.x86_6 16 MB/s | 48 MB 00:03 2024-04-25T17:06:27.986 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-04-25T17:06:27.987 INFO:teuthology.orchestra.run.smithi037.stdout:Total 15 MB/s | 48 MB 00:03 2024-04-25T17:06:28.013 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-04-25T17:06:28.035 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-04-25T17:06:28.035 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-04-25T17:06:28.417 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-04-25T17:06:28.417 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-04-25T17:06:28.951 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-04-25T17:06:29.018 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-04-25T17:06:29.058 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/4 2024-04-25T17:06:29.085 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephsqlite-2:17.2.7-902.gc61472c8.el9.x86_64 3/4 2024-04-25T17:06:33.680 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephsqlite-2:17.2.7-902.gc61472c8.el9.x86_64 3/4 2024-04-25T17:06:33.759 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-test-2:17.2.7-902.gc61472c8.el9.x86_64 4/4 2024-04-25T17:06:35.950 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-test-2:17.2.7-902.gc61472c8.el9.x86_64 4/4 2024-04-25T17:06:35.951 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-test-2:17.2.7-902.gc61472c8.el9.x86_64 1/4 2024-04-25T17:06:35.951 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephsqlite-2:17.2.7-902.gc61472c8.el9.x86_64 2/4 2024-04-25T17:06:35.951 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/4 2024-04-25T17:06:36.241 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-04-25T17:06:36.241 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:06:36.241 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-04-25T17:06:36.242 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-test-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T17:06:36.242 INFO:teuthology.orchestra.run.smithi037.stdout: libcephsqlite-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T17:06:36.242 INFO:teuthology.orchestra.run.smithi037.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-25T17:06:36.242 INFO:teuthology.orchestra.run.smithi037.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-25T17:06:36.242 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:06:36.242 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-04-25T17:06:36.524 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph 2024-04-25T17:06:37.053 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:00:44 ago on Thu 25 Apr 2024 05:05:53 PM UTC. 2024-04-25T17:06:37.181 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-04-25T17:06:37.184 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-25T17:06:37.184 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2024-04-25T17:06:37.184 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-25T17:06:37.184 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-04-25T17:06:37.184 INFO:teuthology.orchestra.run.smithi037.stdout: ceph x86_64 2:17.2.7-902.gc61472c8.el9 ceph 6.5 k 2024-04-25T17:06:37.184 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2024-04-25T17:06:37.184 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mds x86_64 2:17.2.7-902.gc61472c8.el9 ceph 2.1 M 2024-04-25T17:06:37.185 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr x86_64 2:17.2.7-902.gc61472c8.el9 ceph 1.4 M 2024-04-25T17:06:37.185 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-modules-core noarch 2:17.2.7-902.gc61472c8.el9 ceph-noarch 240 k 2024-04-25T17:06:37.185 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mon x86_64 2:17.2.7-902.gc61472c8.el9 ceph 3.9 M 2024-04-25T17:06:37.185 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-osd x86_64 2:17.2.7-902.gc61472c8.el9 ceph 15 M 2024-04-25T17:06:37.185 INFO:teuthology.orchestra.run.smithi037.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-25T17:06:37.185 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-25T17:06:37.185 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-25T17:06:37.185 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-25T17:06:37.185 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-25T17:06:37.185 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-25T17:06:37.185 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-25T17:06:37.185 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-25T17:06:37.185 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-25T17:06:37.185 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-25T17:06:37.186 INFO:teuthology.orchestra.run.smithi037.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-25T17:06:37.186 INFO:teuthology.orchestra.run.smithi037.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-25T17:06:37.186 INFO:teuthology.orchestra.run.smithi037.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-25T17:06:37.186 INFO:teuthology.orchestra.run.smithi037.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-25T17:06:37.186 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-25T17:06:37.186 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-25T17:06:37.186 INFO:teuthology.orchestra.run.smithi037.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-25T17:06:37.186 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-25T17:06:37.186 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-25T17:06:37.186 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-25T17:06:37.186 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-25T17:06:37.186 INFO:teuthology.orchestra.run.smithi037.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-25T17:06:37.186 INFO:teuthology.orchestra.run.smithi037.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-25T17:06:37.187 INFO:teuthology.orchestra.run.smithi037.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-25T17:06:37.187 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-25T17:06:37.187 INFO:teuthology.orchestra.run.smithi037.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-25T17:06:37.187 INFO:teuthology.orchestra.run.smithi037.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-25T17:06:37.187 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:06:37.187 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-04-25T17:06:37.187 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-25T17:06:37.187 INFO:teuthology.orchestra.run.smithi037.stdout:Install 33 Packages 2024-04-25T17:06:37.187 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:06:37.188 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 27 M 2024-04-25T17:06:37.188 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 96 M 2024-04-25T17:06:37.188 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-04-25T17:06:37.975 INFO:teuthology.orchestra.run.smithi069.stdout:(4/4): ceph-test-17.2.7-902.gc61472c8.el9.x86_6 3.7 MB/s | 48 MB 00:13 2024-04-25T17:06:37.978 INFO:teuthology.orchestra.run.smithi069.stdout:-------------------------------------------------------------------------------- 2024-04-25T17:06:37.978 INFO:teuthology.orchestra.run.smithi069.stdout:Total 3.6 MB/s | 48 MB 00:13 2024-04-25T17:06:38.003 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction check 2024-04-25T17:06:38.022 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction check succeeded. 2024-04-25T17:06:38.022 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction test 2024-04-25T17:06:38.218 INFO:teuthology.orchestra.run.smithi037.stdout:(1/33): ceph-17.2.7-902.gc61472c8.el9.x86_64.rp 38 kB/s | 6.5 kB 00:00 2024-04-25T17:06:38.382 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction test succeeded. 2024-04-25T17:06:38.382 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction 2024-04-25T17:06:38.568 INFO:teuthology.orchestra.run.smithi037.stdout:(2/33): ceph-mon-17.2.7-902.gc61472c8.el9.x86_6 11 MB/s | 3.9 MB 00:00 2024-04-25T17:06:38.897 INFO:teuthology.orchestra.run.smithi069.stdout: Preparing : 1/1 2024-04-25T17:06:38.967 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-04-25T17:06:38.985 INFO:teuthology.orchestra.run.smithi037.stdout:(3/33): ceph-mds-17.2.7-902.gc61472c8.el9.x86_6 2.2 MB/s | 2.1 MB 00:00 2024-04-25T17:06:39.007 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/4 2024-04-25T17:06:39.035 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libcephsqlite-2:17.2.7-902.gc61472c8.el9.x86_64 3/4 2024-04-25T17:06:39.110 INFO:teuthology.orchestra.run.smithi037.stdout:(4/33): ceph-mgr-modules-core-17.2.7-902.gc6147 1.9 MB/s | 240 kB 00:00 2024-04-25T17:06:39.186 INFO:teuthology.orchestra.run.smithi037.stdout:(5/33): ceph-mgr-17.2.7-902.gc61472c8.el9.x86_6 1.2 MB/s | 1.4 MB 00:01 2024-04-25T17:06:39.361 INFO:teuthology.orchestra.run.smithi037.stdout:(6/33): ceph-osd-17.2.7-902.gc61472c8.el9.x86_6 19 MB/s | 15 MB 00:00 2024-04-25T17:06:39.636 INFO:teuthology.orchestra.run.smithi037.stdout:(7/33): python3-cryptography-36.0.1-4.el9.x86_6 2.7 MB/s | 1.2 MB 00:00 2024-04-25T17:06:39.661 INFO:teuthology.orchestra.run.smithi037.stdout:(8/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 460 kB/s | 253 kB 00:00 2024-04-25T17:06:39.686 INFO:teuthology.orchestra.run.smithi037.stdout:(9/33): python3-ply-3.11-14.el9.noarch.rpm 327 kB/s | 106 kB 00:00 2024-04-25T17:06:39.712 INFO:teuthology.orchestra.run.smithi037.stdout:(10/33): python3-pycparser-2.20-6.el9.noarch.rp 1.8 MB/s | 135 kB 00:00 2024-04-25T17:06:39.737 INFO:teuthology.orchestra.run.smithi037.stdout:(11/33): python3-requests-2.25.1-8.el9.noarch.r 1.6 MB/s | 125 kB 00:00 2024-04-25T17:06:39.779 INFO:teuthology.orchestra.run.smithi037.stdout:(12/33): python3-urllib3-1.26.5-5.el9.noarch.rp 3.1 MB/s | 215 kB 00:00 2024-04-25T17:06:39.804 INFO:teuthology.orchestra.run.smithi037.stdout:(13/33): python3-mako-1.1.4-6.el9.noarch.rpm 1.8 MB/s | 172 kB 00:00 2024-04-25T17:06:39.830 INFO:teuthology.orchestra.run.smithi037.stdout:(14/33): python3-markupsafe-1.1.1-12.el9.x86_64 377 kB/s | 35 kB 00:00 2024-04-25T17:06:39.855 INFO:teuthology.orchestra.run.smithi037.stdout:(15/33): python3-pytz-2021.1-5.el9.noarch.rpm 681 kB/s | 51 kB 00:00 2024-04-25T17:06:39.880 INFO:teuthology.orchestra.run.smithi037.stdout:(16/33): python3-toml-0.10.2-6.el9.noarch.rpm 835 kB/s | 42 kB 00:00 2024-04-25T17:06:39.955 INFO:teuthology.orchestra.run.smithi037.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 347 kB/s | 43 kB 00:00 2024-04-25T17:06:39.997 INFO:teuthology.orchestra.run.smithi037.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 257 kB/s | 11 kB 00:00 2024-04-25T17:06:40.022 INFO:teuthology.orchestra.run.smithi037.stdout:(19/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.0 MB/s | 172 kB 00:00 2024-04-25T17:06:40.048 INFO:teuthology.orchestra.run.smithi037.stdout:(20/33): python3-jaraco-classes-3.2.1-5.el9.noa 352 kB/s | 18 kB 00:00 2024-04-25T17:06:40.073 INFO:teuthology.orchestra.run.smithi037.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 460 kB/s | 23 kB 00:00 2024-04-25T17:06:40.098 INFO:teuthology.orchestra.run.smithi037.stdout:(22/33): python3-cherrypy-18.6.1-2.el9.noarch.r 1.6 MB/s | 358 kB 00:00 2024-04-25T17:06:40.165 INFO:teuthology.orchestra.run.smithi037.stdout:(23/33): python3-jaraco-functools-3.5.0-2.el9.n 166 kB/s | 19 kB 00:00 2024-04-25T17:06:40.190 INFO:teuthology.orchestra.run.smithi037.stdout:(24/33): python3-jaraco-text-3.2.0-6.el9.noarch 168 kB/s | 20 kB 00:00 2024-04-25T17:06:40.216 INFO:teuthology.orchestra.run.smithi037.stdout:(25/33): python3-logutils-0.3.5-21.el9.noarch.r 394 kB/s | 46 kB 00:00 2024-04-25T17:06:40.241 INFO:teuthology.orchestra.run.smithi037.stdout:(26/33): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-04-25T17:06:40.266 INFO:teuthology.orchestra.run.smithi037.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 326 kB/s | 16 kB 00:00 2024-04-25T17:06:40.300 INFO:teuthology.orchestra.run.smithi037.stdout:(28/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.5 MB/s | 90 kB 00:00 2024-04-25T17:06:40.326 INFO:teuthology.orchestra.run.smithi037.stdout:(29/33): python3-tempora-5.0.0-2.el9.noarch.rpm 610 kB/s | 36 kB 00:00 2024-04-25T17:06:40.351 INFO:teuthology.orchestra.run.smithi037.stdout:(30/33): python3-pecan-1.4.2-3.el9.noarch.rpm 1.7 MB/s | 272 kB 00:00 2024-04-25T17:06:40.426 INFO:teuthology.orchestra.run.smithi037.stdout:(31/33): python3-zc-lockfile-2.0-10.el9.noarch. 266 kB/s | 20 kB 00:00 2024-04-25T17:06:40.451 INFO:teuthology.orchestra.run.smithi037.stdout:(32/33): python3-webob-1.8.7-6.el9.noarch.rpm 1.5 MB/s | 230 kB 00:00 2024-04-25T17:06:40.551 INFO:teuthology.orchestra.run.smithi037.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 1.9 MB/s | 427 kB 00:00 2024-04-25T17:06:40.555 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-04-25T17:06:40.555 INFO:teuthology.orchestra.run.smithi037.stdout:Total 8.1 MB/s | 27 MB 00:03 2024-04-25T17:06:40.675 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-04-25T17:06:40.715 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-04-25T17:06:40.715 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-04-25T17:06:40.999 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-04-25T17:06:41.001 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-04-25T17:06:42.270 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-04-25T17:06:42.338 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-04-25T17:06:42.385 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-04-25T17:06:42.404 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-04-25T17:06:42.502 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-04-25T17:06:42.686 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-04-25T17:06:42.740 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-04-25T17:06:42.774 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-04-25T17:06:42.804 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-04-25T17:06:42.840 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-04-25T17:06:42.872 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-04-25T17:06:42.922 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-04-25T17:06:42.965 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-04-25T17:06:42.999 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-04-25T17:06:43.037 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-04-25T17:06:43.124 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-04-25T17:06:43.283 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-04-25T17:06:43.365 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-04-25T17:06:43.416 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 18/33 2024-04-25T17:06:43.430 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libcephsqlite-2:17.2.7-902.gc61472c8.el9.x86_64 3/4 2024-04-25T17:06:43.454 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-04-25T17:06:43.520 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-04-25T17:06:43.585 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-04-25T17:06:43.614 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-test-2:17.2.7-902.gc61472c8.el9.x86_64 4/4 2024-04-25T17:06:43.782 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-04-25T17:06:43.841 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-04-25T17:06:43.922 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-04-25T17:06:44.020 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-04-25T17:06:44.065 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-04-25T17:06:44.187 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-04-25T17:06:44.357 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-902.gc61472c8.el9.n 28/33 2024-04-25T17:06:44.383 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-2:17.2.7-902.gc61472c8.el9.x86_64 29/33 2024-04-25T17:06:44.409 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-2:17.2.7-902.gc61472c8.el9.x86_64 29/33 2024-04-25T17:06:44.409 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T17:06:44.409 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-25T17:06:44.409 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T17:06:44.410 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T17:06:44.410 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:06:45.626 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-test-2:17.2.7-902.gc61472c8.el9.x86_64 4/4 2024-04-25T17:06:45.626 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-test-2:17.2.7-902.gc61472c8.el9.x86_64 1/4 2024-04-25T17:06:45.626 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libcephsqlite-2:17.2.7-902.gc61472c8.el9.x86_64 2/4 2024-04-25T17:06:45.627 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/4 2024-04-25T17:06:45.817 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-osd-2:17.2.7-902.gc61472c8.el9.x86_64 30/33 2024-04-25T17:06:45.845 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-osd-2:17.2.7-902.gc61472c8.el9.x86_64 30/33 2024-04-25T17:06:45.845 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T17:06:45.845 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-25T17:06:45.845 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T17:06:45.845 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T17:06:45.845 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:06:45.892 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-04-25T17:06:45.893 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:06:45.893 INFO:teuthology.orchestra.run.smithi069.stdout:Installed: 2024-04-25T17:06:45.893 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-test-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T17:06:45.893 INFO:teuthology.orchestra.run.smithi069.stdout: libcephsqlite-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T17:06:45.893 INFO:teuthology.orchestra.run.smithi069.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-25T17:06:45.893 INFO:teuthology.orchestra.run.smithi069.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-25T17:06:45.893 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:06:45.893 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2024-04-25T17:06:46.157 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum -y install ceph 2024-04-25T17:06:46.235 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mon-2:17.2.7-902.gc61472c8.el9.x86_64 31/33 2024-04-25T17:06:46.259 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mon-2:17.2.7-902.gc61472c8.el9.x86_64 31/33 2024-04-25T17:06:46.259 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T17:06:46.259 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-25T17:06:46.259 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T17:06:46.259 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T17:06:46.259 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:06:46.469 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mds-2:17.2.7-902.gc61472c8.el9.x86_64 32/33 2024-04-25T17:06:46.493 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mds-2:17.2.7-902.gc61472c8.el9.x86_64 32/33 2024-04-25T17:06:46.493 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T17:06:46.493 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-25T17:06:46.494 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T17:06:46.494 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T17:06:46.494 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:06:46.559 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-2:17.2.7-902.gc61472c8.el9.x86_64 33/33 2024-04-25T17:06:46.671 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:00:53 ago on Thu 25 Apr 2024 05:05:53 PM UTC. 2024-04-25T17:06:46.795 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2024-04-25T17:06:46.797 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-04-25T17:06:46.797 INFO:teuthology.orchestra.run.smithi069.stdout: Package Arch Version Repository Size 2024-04-25T17:06:46.797 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-04-25T17:06:46.797 INFO:teuthology.orchestra.run.smithi069.stdout:Installing: 2024-04-25T17:06:46.797 INFO:teuthology.orchestra.run.smithi069.stdout: ceph x86_64 2:17.2.7-902.gc61472c8.el9 ceph 6.5 k 2024-04-25T17:06:46.797 INFO:teuthology.orchestra.run.smithi069.stdout:Installing dependencies: 2024-04-25T17:06:46.797 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mds x86_64 2:17.2.7-902.gc61472c8.el9 ceph 2.1 M 2024-04-25T17:06:46.798 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr x86_64 2:17.2.7-902.gc61472c8.el9 ceph 1.4 M 2024-04-25T17:06:46.798 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-modules-core noarch 2:17.2.7-902.gc61472c8.el9 ceph-noarch 240 k 2024-04-25T17:06:46.798 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mon x86_64 2:17.2.7-902.gc61472c8.el9 ceph 3.9 M 2024-04-25T17:06:46.798 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-osd x86_64 2:17.2.7-902.gc61472c8.el9 ceph 15 M 2024-04-25T17:06:46.798 INFO:teuthology.orchestra.run.smithi069.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-25T17:06:46.798 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-25T17:06:46.798 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-25T17:06:46.798 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-25T17:06:46.798 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-25T17:06:46.798 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-25T17:06:46.798 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-25T17:06:46.798 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-25T17:06:46.798 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-25T17:06:46.799 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-25T17:06:46.799 INFO:teuthology.orchestra.run.smithi069.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-25T17:06:46.799 INFO:teuthology.orchestra.run.smithi069.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-25T17:06:46.799 INFO:teuthology.orchestra.run.smithi069.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-25T17:06:46.799 INFO:teuthology.orchestra.run.smithi069.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-25T17:06:46.799 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-25T17:06:46.799 INFO:teuthology.orchestra.run.smithi069.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-25T17:06:46.799 INFO:teuthology.orchestra.run.smithi069.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-25T17:06:46.799 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-25T17:06:46.799 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-25T17:06:46.799 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-25T17:06:46.799 INFO:teuthology.orchestra.run.smithi069.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-25T17:06:46.799 INFO:teuthology.orchestra.run.smithi069.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-25T17:06:46.799 INFO:teuthology.orchestra.run.smithi069.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-25T17:06:46.800 INFO:teuthology.orchestra.run.smithi069.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-25T17:06:46.800 INFO:teuthology.orchestra.run.smithi069.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-25T17:06:46.800 INFO:teuthology.orchestra.run.smithi069.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-25T17:06:46.800 INFO:teuthology.orchestra.run.smithi069.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-25T17:06:46.800 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:06:46.800 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction Summary 2024-04-25T17:06:46.800 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-04-25T17:06:46.800 INFO:teuthology.orchestra.run.smithi069.stdout:Install 33 Packages 2024-04-25T17:06:46.800 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:06:46.801 INFO:teuthology.orchestra.run.smithi069.stdout:Total download size: 27 M 2024-04-25T17:06:46.801 INFO:teuthology.orchestra.run.smithi069.stdout:Installed size: 96 M 2024-04-25T17:06:46.801 INFO:teuthology.orchestra.run.smithi069.stdout:Downloading Packages: 2024-04-25T17:06:47.367 INFO:teuthology.orchestra.run.smithi069.stdout:(1/33): ceph-17.2.7-902.gc61472c8.el9.x86_64.rp 29 kB/s | 6.5 kB 00:00 2024-04-25T17:06:47.484 INFO:teuthology.orchestra.run.smithi069.stdout:(2/33): ceph-mgr-17.2.7-902.gc61472c8.el9.x86_6 4.1 MB/s | 1.4 MB 00:00 2024-04-25T17:06:48.142 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-2:17.2.7-902.gc61472c8.el9.x86_64 33/33 2024-04-25T17:06:48.142 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-2:17.2.7-902.gc61472c8.el9.x86_64 1/33 2024-04-25T17:06:48.142 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mds-2:17.2.7-902.gc61472c8.el9.x86_64 2/33 2024-04-25T17:06:48.142 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-2:17.2.7-902.gc61472c8.el9.x86_64 3/33 2024-04-25T17:06:48.143 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mon-2:17.2.7-902.gc61472c8.el9.x86_64 4/33 2024-04-25T17:06:48.143 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-osd-2:17.2.7-902.gc61472c8.el9.x86_64 5/33 2024-04-25T17:06:48.143 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-902.gc61472c8.el9.n 6/33 2024-04-25T17:06:48.143 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-04-25T17:06:48.143 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-04-25T17:06:48.143 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-04-25T17:06:48.143 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-04-25T17:06:48.143 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-04-25T17:06:48.143 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/33 2024-04-25T17:06:48.143 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-04-25T17:06:48.143 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-04-25T17:06:48.143 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-04-25T17:06:48.143 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-04-25T17:06:48.144 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-04-25T17:06:48.144 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-04-25T17:06:48.144 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-04-25T17:06:48.144 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-04-25T17:06:48.144 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-04-25T17:06:48.144 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-04-25T17:06:48.144 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-04-25T17:06:48.144 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-04-25T17:06:48.144 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-04-25T17:06:48.145 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-04-25T17:06:48.145 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-04-25T17:06:48.145 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-04-25T17:06:48.146 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-04-25T17:06:48.146 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-04-25T17:06:48.146 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-04-25T17:06:48.146 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-04-25T17:06:48.218 INFO:teuthology.orchestra.run.smithi069.stdout:(3/33): ceph-osd-17.2.7-902.gc61472c8.el9.x86_6 21 MB/s | 15 MB 00:00 2024-04-25T17:06:48.268 INFO:teuthology.orchestra.run.smithi069.stdout:(4/33): ceph-mgr-modules-core-17.2.7-902.gc6147 4.7 MB/s | 240 kB 00:00 2024-04-25T17:06:48.510 INFO:teuthology.orchestra.run.smithi069.stdout:(5/33): ceph-mds-17.2.7-902.gc61472c8.el9.x86_6 1.5 MB/s | 2.1 MB 00:01 2024-04-25T17:06:48.535 INFO:teuthology.orchestra.run.smithi069.stdout:(6/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 949 kB/s | 253 kB 00:00 2024-04-25T17:06:48.677 INFO:teuthology.orchestra.run.smithi069.stdout:(7/33): python3-cryptography-36.0.1-4.el9.x86_6 7.4 MB/s | 1.2 MB 00:00 2024-04-25T17:06:48.702 INFO:teuthology.orchestra.run.smithi069.stdout:(8/33): python3-ply-3.11-14.el9.noarch.rpm 637 kB/s | 106 kB 00:00 2024-04-25T17:06:48.736 INFO:teuthology.orchestra.run.smithi069.stdout:(9/33): python3-pycparser-2.20-6.el9.noarch.rpm 2.3 MB/s | 135 kB 00:00 2024-04-25T17:06:48.761 INFO:teuthology.orchestra.run.smithi069.stdout:(10/33): python3-requests-2.25.1-8.el9.noarch.r 2.1 MB/s | 125 kB 00:00 2024-04-25T17:06:48.803 INFO:teuthology.orchestra.run.smithi069.stdout:(11/33): python3-urllib3-1.26.5-5.el9.noarch.rp 3.1 MB/s | 215 kB 00:00 2024-04-25T17:06:48.820 INFO:teuthology.orchestra.run.smithi069.stdout:(12/33): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-04-25T17:06:48.862 INFO:teuthology.orchestra.run.smithi069.stdout:(13/33): python3-markupsafe-1.1.1-12.el9.x86_64 595 kB/s | 35 kB 00:00 2024-04-25T17:06:48.887 INFO:teuthology.orchestra.run.smithi069.stdout:(14/33): python3-pytz-2021.1-5.el9.noarch.rpm 763 kB/s | 51 kB 00:00 2024-04-25T17:06:48.912 INFO:teuthology.orchestra.run.smithi069.stdout:(15/33): python3-toml-0.10.2-6.el9.noarch.rpm 829 kB/s | 42 kB 00:00 2024-04-25T17:06:49.046 INFO:teuthology.orchestra.run.smithi069.stdout:(16/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 274 kB/s | 43 kB 00:00 2024-04-25T17:06:49.061 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-04-25T17:06:49.061 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:06:49.061 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-04-25T17:06:49.062 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T17:06:49.062 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mds-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T17:06:49.062 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T17:06:49.062 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-modules-core-2:17.2.7-902.gc61472c8.el9.noarch 2024-04-25T17:06:49.062 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mon-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T17:06:49.062 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-osd-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T17:06:49.062 INFO:teuthology.orchestra.run.smithi037.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-25T17:06:49.062 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-25T17:06:49.062 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-25T17:06:49.062 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-25T17:06:49.063 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-25T17:06:49.063 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-25T17:06:49.063 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-25T17:06:49.063 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-25T17:06:49.063 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-25T17:06:49.063 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-25T17:06:49.063 INFO:teuthology.orchestra.run.smithi037.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-25T17:06:49.063 INFO:teuthology.orchestra.run.smithi037.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-25T17:06:49.063 INFO:teuthology.orchestra.run.smithi037.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-25T17:06:49.063 INFO:teuthology.orchestra.run.smithi037.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-25T17:06:49.063 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-25T17:06:49.063 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ply-3.11-14.el9.noarch 2024-04-25T17:06:49.063 INFO:teuthology.orchestra.run.smithi037.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-25T17:06:49.064 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-25T17:06:49.064 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-25T17:06:49.064 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-25T17:06:49.064 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-25T17:06:49.064 INFO:teuthology.orchestra.run.smithi037.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-25T17:06:49.064 INFO:teuthology.orchestra.run.smithi037.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-25T17:06:49.064 INFO:teuthology.orchestra.run.smithi037.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-25T17:06:49.064 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-25T17:06:49.064 INFO:teuthology.orchestra.run.smithi037.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-25T17:06:49.064 INFO:teuthology.orchestra.run.smithi037.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-25T17:06:49.064 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:06:49.064 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-04-25T17:06:49.113 INFO:teuthology.orchestra.run.smithi069.stdout:(17/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 858 kB/s | 172 kB 00:00 2024-04-25T17:06:49.188 INFO:teuthology.orchestra.run.smithi069.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 143 kB/s | 11 kB 00:00 2024-04-25T17:06:49.282 INFO:teuthology.orchestra.run.smithi069.stdout:(19/33): python3-jaraco-classes-3.2.1-5.el9.noa 192 kB/s | 18 kB 00:00 2024-04-25T17:06:49.372 INFO:teuthology.orchestra.run.smithi069.stdout:(20/33): ceph-mon-17.2.7-902.gc61472c8.el9.x86_ 2.0 MB/s | 3.9 MB 00:02 2024-04-25T17:06:49.397 INFO:teuthology.orchestra.run.smithi069.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 198 kB/s | 23 kB 00:00 2024-04-25T17:06:49.407 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-base 2024-04-25T17:06:49.422 INFO:teuthology.orchestra.run.smithi069.stdout:(22/33): python3-cherrypy-18.6.1-2.el9.noarch.r 952 kB/s | 358 kB 00:00 2024-04-25T17:06:49.448 INFO:teuthology.orchestra.run.smithi069.stdout:(23/33): python3-jaraco-text-3.2.0-6.el9.noarch 391 kB/s | 20 kB 00:00 2024-04-25T17:06:49.473 INFO:teuthology.orchestra.run.smithi069.stdout:(24/33): python3-jaraco-functools-3.5.0-2.el9.n 193 kB/s | 19 kB 00:00 2024-04-25T17:06:49.498 INFO:teuthology.orchestra.run.smithi069.stdout:(25/33): python3-logutils-0.3.5-21.el9.noarch.r 615 kB/s | 46 kB 00:00 2024-04-25T17:06:49.523 INFO:teuthology.orchestra.run.smithi069.stdout:(26/33): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-04-25T17:06:49.566 INFO:teuthology.orchestra.run.smithi069.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 246 kB/s | 16 kB 00:00 2024-04-25T17:06:49.591 INFO:teuthology.orchestra.run.smithi069.stdout:(28/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.3 MB/s | 90 kB 00:00 2024-04-25T17:06:49.633 INFO:teuthology.orchestra.run.smithi069.stdout:(29/33): python3-tempora-5.0.0-2.el9.noarch.rpm 535 kB/s | 36 kB 00:00 2024-04-25T17:06:49.691 INFO:teuthology.orchestra.run.smithi069.stdout:(30/33): python3-pecan-1.4.2-3.el9.noarch.rpm 1.2 MB/s | 272 kB 00:00 2024-04-25T17:06:49.750 INFO:teuthology.orchestra.run.smithi069.stdout:(31/33): python3-webob-1.8.7-6.el9.noarch.rpm 1.4 MB/s | 230 kB 00:00 2024-04-25T17:06:49.775 INFO:teuthology.orchestra.run.smithi069.stdout:(32/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 2.9 MB/s | 427 kB 00:00 2024-04-25T17:06:49.792 INFO:teuthology.orchestra.run.smithi069.stdout:(33/33): python3-zc-lockfile-2.0-10.el9.noarch. 199 kB/s | 20 kB 00:00 2024-04-25T17:06:49.796 INFO:teuthology.orchestra.run.smithi069.stdout:-------------------------------------------------------------------------------- 2024-04-25T17:06:49.796 INFO:teuthology.orchestra.run.smithi069.stdout:Total 9.1 MB/s | 27 MB 00:02 2024-04-25T17:06:49.910 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction check 2024-04-25T17:06:49.946 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction check succeeded. 2024-04-25T17:06:49.946 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction test 2024-04-25T17:06:49.947 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:00:56 ago on Thu 25 Apr 2024 05:05:53 PM UTC. 2024-04-25T17:06:50.028 INFO:teuthology.orchestra.run.smithi037.stdout:Package ceph-base-2:17.2.7-902.gc61472c8.el9.x86_64 is already installed. 2024-04-25T17:06:50.070 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-04-25T17:06:50.071 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2024-04-25T17:06:50.071 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-04-25T17:06:50.138 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install cephadm 2024-04-25T17:06:50.212 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction test succeeded. 2024-04-25T17:06:50.212 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction 2024-04-25T17:06:50.663 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:00:57 ago on Thu 25 Apr 2024 05:05:53 PM UTC. 2024-04-25T17:06:50.786 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-04-25T17:06:50.787 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-25T17:06:50.787 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2024-04-25T17:06:50.787 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-25T17:06:50.787 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-04-25T17:06:50.787 INFO:teuthology.orchestra.run.smithi037.stdout: cephadm noarch 2:17.2.7-902.gc61472c8.el9 ceph-noarch 82 k 2024-04-25T17:06:50.787 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:06:50.787 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-04-25T17:06:50.787 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-25T17:06:50.787 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package 2024-04-25T17:06:50.787 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:06:50.787 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 82 k 2024-04-25T17:06:50.788 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 372 k 2024-04-25T17:06:50.788 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-04-25T17:06:50.992 INFO:teuthology.orchestra.run.smithi037.stdout:cephadm-17.2.7-902.gc61472c8.el9.noarch.rpm 403 kB/s | 82 kB 00:00 2024-04-25T17:06:50.992 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-04-25T17:06:50.992 INFO:teuthology.orchestra.run.smithi037.stdout:Total 400 kB/s | 82 kB 00:00 2024-04-25T17:06:50.992 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-04-25T17:06:50.998 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-04-25T17:06:50.998 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-04-25T17:06:51.000 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-04-25T17:06:51.000 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-04-25T17:06:51.077 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-04-25T17:06:51.356 INFO:teuthology.orchestra.run.smithi069.stdout: Preparing : 1/1 2024-04-25T17:06:51.411 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-04-25T17:06:51.443 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-04-25T17:06:51.485 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-04-25T17:06:51.575 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-04-25T17:06:51.600 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: cephadm-2:17.2.7-902.gc61472c8.el9.noarch 1/1 2024-04-25T17:06:51.654 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-04-25T17:06:51.695 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-04-25T17:06:51.704 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephadm-2:17.2.7-902.gc61472c8.el9.noarch 1/1 2024-04-25T17:06:51.731 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-04-25T17:06:51.761 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-04-25T17:06:51.795 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-04-25T17:06:51.849 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-04-25T17:06:51.885 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-04-25T17:06:51.920 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-04-25T17:06:51.955 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-04-25T17:06:51.993 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-04-25T17:06:52.039 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: cephadm-2:17.2.7-902.gc61472c8.el9.noarch 1/1 2024-04-25T17:06:52.065 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-04-25T17:06:52.202 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-04-25T17:06:52.274 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephadm-2:17.2.7-902.gc61472c8.el9.noarch 1/1 2024-04-25T17:06:52.274 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:06:52.274 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-04-25T17:06:52.275 INFO:teuthology.orchestra.run.smithi037.stdout: cephadm-2:17.2.7-902.gc61472c8.el9.noarch 2024-04-25T17:06:52.275 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:06:52.275 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-04-25T17:06:52.283 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-04-25T17:06:52.337 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 18/33 2024-04-25T17:06:52.375 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-04-25T17:06:52.424 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-04-25T17:06:52.479 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-04-25T17:06:52.497 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-immutable-object-cache 2024-04-25T17:06:52.662 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-04-25T17:06:52.721 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-04-25T17:06:52.790 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-04-25T17:06:52.877 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-04-25T17:06:52.920 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-04-25T17:06:53.033 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:00 ago on Thu 25 Apr 2024 05:05:53 PM UTC. 2024-04-25T17:06:53.033 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-04-25T17:06:53.159 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-04-25T17:06:53.159 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-25T17:06:53.159 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repo Size 2024-04-25T17:06:53.159 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-25T17:06:53.159 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-04-25T17:06:53.159 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-902.gc61472c8.el9 ceph 137 k 2024-04-25T17:06:53.159 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:06:53.160 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-04-25T17:06:53.160 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-25T17:06:53.160 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package 2024-04-25T17:06:53.160 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:06:53.160 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 137 k 2024-04-25T17:06:53.160 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 379 k 2024-04-25T17:06:53.160 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-04-25T17:06:53.190 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-902.gc61472c8.el9.n 28/33 2024-04-25T17:06:53.214 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-2:17.2.7-902.gc61472c8.el9.x86_64 29/33 2024-04-25T17:06:53.239 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mgr-2:17.2.7-902.gc61472c8.el9.x86_64 29/33 2024-04-25T17:06:53.239 INFO:teuthology.orchestra.run.smithi069.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T17:06:53.239 INFO:teuthology.orchestra.run.smithi069.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-25T17:06:53.239 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T17:06:53.239 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T17:06:53.239 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:06:53.673 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-immutable-object-cache-17.2.7-902.gc61472c 268 kB/s | 137 kB 00:00 2024-04-25T17:06:53.674 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-04-25T17:06:53.674 INFO:teuthology.orchestra.run.smithi037.stdout:Total 267 kB/s | 137 kB 00:00 2024-04-25T17:06:53.674 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-04-25T17:06:53.682 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-04-25T17:06:53.683 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-04-25T17:06:53.743 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-04-25T17:06:53.743 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-04-25T17:06:53.894 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-04-25T17:06:53.957 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-902.gc61472c8.e 1/1 2024-04-25T17:06:53.982 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-902.gc61472c8.e 1/1 2024-04-25T17:06:53.982 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T17:06:53.982 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-25T17:06:53.982 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:06:54.548 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-osd-2:17.2.7-902.gc61472c8.el9.x86_64 30/33 2024-04-25T17:06:54.575 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-osd-2:17.2.7-902.gc61472c8.el9.x86_64 30/33 2024-04-25T17:06:54.575 INFO:teuthology.orchestra.run.smithi069.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T17:06:54.575 INFO:teuthology.orchestra.run.smithi069.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-25T17:06:54.575 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T17:06:54.575 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T17:06:54.575 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:06:54.910 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-902.gc61472c8.e 1/1 2024-04-25T17:06:54.910 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:06:54.910 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-04-25T17:06:54.910 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-immutable-object-cache-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T17:06:54.910 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:06:54.911 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-04-25T17:06:54.949 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mon-2:17.2.7-902.gc61472c8.el9.x86_64 31/33 2024-04-25T17:06:54.972 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mon-2:17.2.7-902.gc61472c8.el9.x86_64 31/33 2024-04-25T17:06:54.972 INFO:teuthology.orchestra.run.smithi069.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T17:06:54.972 INFO:teuthology.orchestra.run.smithi069.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-25T17:06:54.973 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T17:06:54.973 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T17:06:54.973 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:06:55.118 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-mgr 2024-04-25T17:06:55.174 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mds-2:17.2.7-902.gc61472c8.el9.x86_64 32/33 2024-04-25T17:06:55.197 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mds-2:17.2.7-902.gc61472c8.el9.x86_64 32/33 2024-04-25T17:06:55.198 INFO:teuthology.orchestra.run.smithi069.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T17:06:55.198 INFO:teuthology.orchestra.run.smithi069.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-25T17:06:55.198 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T17:06:55.198 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T17:06:55.198 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:06:55.262 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-2:17.2.7-902.gc61472c8.el9.x86_64 33/33 2024-04-25T17:06:55.648 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:02 ago on Thu 25 Apr 2024 05:05:53 PM UTC. 2024-04-25T17:06:55.729 INFO:teuthology.orchestra.run.smithi037.stdout:Package ceph-mgr-2:17.2.7-902.gc61472c8.el9.x86_64 is already installed. 2024-04-25T17:06:55.772 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-04-25T17:06:55.773 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2024-04-25T17:06:55.774 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-04-25T17:06:55.842 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-mgr-dashboard 2024-04-25T17:06:56.377 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:03 ago on Thu 25 Apr 2024 05:05:53 PM UTC. 2024-04-25T17:06:56.503 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-04-25T17:06:56.504 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-25T17:06:56.504 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2024-04-25T17:06:56.505 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-25T17:06:56.505 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-04-25T17:06:56.505 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-dashboard noarch 2:17.2.7-902.gc61472c8.el9 ceph-noarch 3.4 M 2024-04-25T17:06:56.505 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2024-04-25T17:06:56.505 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-grafana-dashboards noarch 2:17.2.7-902.gc61472c8.el9 ceph-noarch 24 k 2024-04-25T17:06:56.505 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-prometheus-alerts noarch 2:17.2.7-902.gc61472c8.el9 ceph-noarch 15 k 2024-04-25T17:06:56.505 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-04-25T17:06:56.505 INFO:teuthology.orchestra.run.smithi037.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-25T17:06:56.505 INFO:teuthology.orchestra.run.smithi037.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-25T17:06:56.505 INFO:teuthology.orchestra.run.smithi037.stdout:Installing weak dependencies: 2024-04-25T17:06:56.505 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-04-25T17:06:56.506 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:06:56.506 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-04-25T17:06:56.506 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-25T17:06:56.506 INFO:teuthology.orchestra.run.smithi037.stdout:Install 7 Packages 2024-04-25T17:06:56.506 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:06:56.506 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 3.7 M 2024-04-25T17:06:56.507 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 80 M 2024-04-25T17:06:56.507 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-04-25T17:06:56.747 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-2:17.2.7-902.gc61472c8.el9.x86_64 33/33 2024-04-25T17:06:56.747 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-2:17.2.7-902.gc61472c8.el9.x86_64 1/33 2024-04-25T17:06:56.747 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mds-2:17.2.7-902.gc61472c8.el9.x86_64 2/33 2024-04-25T17:06:56.747 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-2:17.2.7-902.gc61472c8.el9.x86_64 3/33 2024-04-25T17:06:56.747 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mon-2:17.2.7-902.gc61472c8.el9.x86_64 4/33 2024-04-25T17:06:56.747 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-osd-2:17.2.7-902.gc61472c8.el9.x86_64 5/33 2024-04-25T17:06:56.747 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-902.gc61472c8.el9.n 6/33 2024-04-25T17:06:56.748 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-04-25T17:06:56.748 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-04-25T17:06:56.748 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-04-25T17:06:56.748 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-04-25T17:06:56.748 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-04-25T17:06:56.748 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/33 2024-04-25T17:06:56.748 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-04-25T17:06:56.748 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-04-25T17:06:56.748 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-04-25T17:06:56.748 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-04-25T17:06:56.748 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-04-25T17:06:56.748 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-04-25T17:06:56.748 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-04-25T17:06:56.748 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-04-25T17:06:56.749 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-04-25T17:06:56.749 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-04-25T17:06:56.749 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-04-25T17:06:56.749 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-04-25T17:06:56.749 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-04-25T17:06:56.749 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-04-25T17:06:56.749 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-04-25T17:06:56.749 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-04-25T17:06:56.749 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-04-25T17:06:56.749 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-04-25T17:06:56.749 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-04-25T17:06:56.749 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-04-25T17:06:56.819 INFO:teuthology.orchestra.run.smithi037.stdout:(1/7): ceph-grafana-dashboards-17.2.7-902.gc614 111 kB/s | 24 kB 00:00 2024-04-25T17:06:56.952 INFO:teuthology.orchestra.run.smithi037.stdout:(2/7): ceph-prometheus-alerts-17.2.7-902.gc6147 41 kB/s | 15 kB 00:00 2024-04-25T17:06:57.119 INFO:teuthology.orchestra.run.smithi037.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 30 kB/s | 9.0 kB 00:00 2024-04-25T17:06:57.286 INFO:teuthology.orchestra.run.smithi037.stdout:(4/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 186 kB/s | 31 kB 00:00 2024-04-25T17:06:57.328 INFO:teuthology.orchestra.run.smithi037.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 109 kB/s | 41 kB 00:00 2024-04-25T17:06:57.420 INFO:teuthology.orchestra.run.smithi037.stdout:(6/7): ceph-mgr-dashboard-17.2.7-902.gc61472c8. 4.1 MB/s | 3.4 MB 00:00 2024-04-25T17:06:57.631 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-04-25T17:06:57.631 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:06:57.631 INFO:teuthology.orchestra.run.smithi069.stdout:Installed: 2024-04-25T17:06:57.632 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T17:06:57.632 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mds-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T17:06:57.632 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T17:06:57.632 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-modules-core-2:17.2.7-902.gc61472c8.el9.noarch 2024-04-25T17:06:57.632 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mon-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T17:06:57.632 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-osd-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T17:06:57.632 INFO:teuthology.orchestra.run.smithi069.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-25T17:06:57.632 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-25T17:06:57.632 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-25T17:06:57.632 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-25T17:06:57.632 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-25T17:06:57.633 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-25T17:06:57.633 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-25T17:06:57.633 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-25T17:06:57.633 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-25T17:06:57.633 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-25T17:06:57.633 INFO:teuthology.orchestra.run.smithi069.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-25T17:06:57.633 INFO:teuthology.orchestra.run.smithi069.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-25T17:06:57.633 INFO:teuthology.orchestra.run.smithi069.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-25T17:06:57.633 INFO:teuthology.orchestra.run.smithi069.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-25T17:06:57.633 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-25T17:06:57.633 INFO:teuthology.orchestra.run.smithi069.stdout: python3-ply-3.11-14.el9.noarch 2024-04-25T17:06:57.633 INFO:teuthology.orchestra.run.smithi069.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-25T17:06:57.633 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-25T17:06:57.633 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-25T17:06:57.634 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-25T17:06:57.634 INFO:teuthology.orchestra.run.smithi069.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-25T17:06:57.634 INFO:teuthology.orchestra.run.smithi069.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-25T17:06:57.634 INFO:teuthology.orchestra.run.smithi069.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-25T17:06:57.634 INFO:teuthology.orchestra.run.smithi069.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-25T17:06:57.634 INFO:teuthology.orchestra.run.smithi069.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-25T17:06:57.634 INFO:teuthology.orchestra.run.smithi069.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-25T17:06:57.634 INFO:teuthology.orchestra.run.smithi069.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-25T17:06:57.634 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:06:57.634 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2024-04-25T17:06:57.687 INFO:teuthology.orchestra.run.smithi037.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 471 kB/s | 188 kB 00:00 2024-04-25T17:06:57.691 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-04-25T17:06:57.691 INFO:teuthology.orchestra.run.smithi037.stdout:Total 3.1 MB/s | 3.7 MB 00:01 2024-04-25T17:06:57.691 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-04-25T17:06:57.701 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-04-25T17:06:57.701 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-04-25T17:06:57.769 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-04-25T17:06:57.771 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-04-25T17:06:58.001 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum -y install ceph-base 2024-04-25T17:06:58.085 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-04-25T17:06:58.155 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-04-25T17:06:58.190 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-04-25T17:06:58.238 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-04-25T17:06:58.276 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-04-25T17:06:58.305 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-902.gc61472c8.el9.no 5/7 2024-04-25T17:06:58.512 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:01:05 ago on Thu 25 Apr 2024 05:05:53 PM UTC. 2024-04-25T17:06:58.589 INFO:teuthology.orchestra.run.smithi069.stdout:Package ceph-base-2:17.2.7-902.gc61472c8.el9.x86_64 is already installed. 2024-04-25T17:06:58.629 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2024-04-25T17:06:58.630 INFO:teuthology.orchestra.run.smithi069.stdout:Nothing to do. 2024-04-25T17:06:58.630 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2024-04-25T17:06:58.693 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum -y install cephadm 2024-04-25T17:06:59.194 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:01:06 ago on Thu 25 Apr 2024 05:05:53 PM UTC. 2024-04-25T17:06:59.311 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2024-04-25T17:06:59.311 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-04-25T17:06:59.312 INFO:teuthology.orchestra.run.smithi069.stdout: Package Arch Version Repository Size 2024-04-25T17:06:59.312 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-04-25T17:06:59.312 INFO:teuthology.orchestra.run.smithi069.stdout:Installing: 2024-04-25T17:06:59.312 INFO:teuthology.orchestra.run.smithi069.stdout: cephadm noarch 2:17.2.7-902.gc61472c8.el9 ceph-noarch 82 k 2024-04-25T17:06:59.312 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:06:59.312 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction Summary 2024-04-25T17:06:59.312 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-04-25T17:06:59.312 INFO:teuthology.orchestra.run.smithi069.stdout:Install 1 Package 2024-04-25T17:06:59.312 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:06:59.312 INFO:teuthology.orchestra.run.smithi069.stdout:Total download size: 82 k 2024-04-25T17:06:59.312 INFO:teuthology.orchestra.run.smithi069.stdout:Installed size: 372 k 2024-04-25T17:06:59.312 INFO:teuthology.orchestra.run.smithi069.stdout:Downloading Packages: 2024-04-25T17:06:59.366 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-902.gc61472c8.el9.n 6/7 2024-04-25T17:06:59.409 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-902.gc61472c8.el9.noarch 7/7 2024-04-25T17:06:59.723 INFO:teuthology.orchestra.run.smithi069.stdout:cephadm-17.2.7-902.gc61472c8.el9.noarch.rpm 200 kB/s | 82 kB 00:00 2024-04-25T17:06:59.724 INFO:teuthology.orchestra.run.smithi069.stdout:-------------------------------------------------------------------------------- 2024-04-25T17:06:59.724 INFO:teuthology.orchestra.run.smithi069.stdout:Total 199 kB/s | 82 kB 00:00 2024-04-25T17:06:59.724 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction check 2024-04-25T17:06:59.729 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction check succeeded. 2024-04-25T17:06:59.729 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction test 2024-04-25T17:06:59.732 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction test succeeded. 2024-04-25T17:06:59.732 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction 2024-04-25T17:06:59.804 INFO:teuthology.orchestra.run.smithi069.stdout: Preparing : 1/1 2024-04-25T17:07:00.188 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: cephadm-2:17.2.7-902.gc61472c8.el9.noarch 1/1 2024-04-25T17:07:00.292 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : cephadm-2:17.2.7-902.gc61472c8.el9.noarch 1/1 2024-04-25T17:07:00.441 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-902.gc61472c8.el9.noarch 7/7 2024-04-25T17:07:00.441 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-902.gc61472c8.el9.n 1/7 2024-04-25T17:07:00.441 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-902.gc61472c8.el9.noarch 2/7 2024-04-25T17:07:00.441 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-902.gc61472c8.el9.no 3/7 2024-04-25T17:07:00.442 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-04-25T17:07:00.442 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-04-25T17:07:00.442 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-04-25T17:07:00.618 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: cephadm-2:17.2.7-902.gc61472c8.el9.noarch 1/1 2024-04-25T17:07:00.717 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-04-25T17:07:00.717 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:07:00.718 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-04-25T17:07:00.718 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-grafana-dashboards-2:17.2.7-902.gc61472c8.el9.noarch 2024-04-25T17:07:00.718 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-dashboard-2:17.2.7-902.gc61472c8.el9.noarch 2024-04-25T17:07:00.718 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-prometheus-alerts-2:17.2.7-902.gc61472c8.el9.noarch 2024-04-25T17:07:00.718 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-04-25T17:07:00.718 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-04-25T17:07:00.718 INFO:teuthology.orchestra.run.smithi037.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-25T17:07:00.718 INFO:teuthology.orchestra.run.smithi037.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-25T17:07:00.718 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:07:00.718 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-04-25T17:07:00.848 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : cephadm-2:17.2.7-902.gc61472c8.el9.noarch 1/1 2024-04-25T17:07:00.848 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:07:00.849 INFO:teuthology.orchestra.run.smithi069.stdout:Installed: 2024-04-25T17:07:00.849 INFO:teuthology.orchestra.run.smithi069.stdout: cephadm-2:17.2.7-902.gc61472c8.el9.noarch 2024-04-25T17:07:00.849 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:07:00.849 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2024-04-25T17:07:00.908 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-25T17:07:01.033 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum -y install ceph-immutable-object-cache 2024-04-25T17:07:01.443 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:08 ago on Thu 25 Apr 2024 05:05:53 PM UTC. 2024-04-25T17:07:01.545 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:01:08 ago on Thu 25 Apr 2024 05:05:53 PM UTC. 2024-04-25T17:07:01.572 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-04-25T17:07:01.573 INFO:teuthology.orchestra.run.smithi037.stdout:====================================================================================== 2024-04-25T17:07:01.573 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2024-04-25T17:07:01.574 INFO:teuthology.orchestra.run.smithi037.stdout:====================================================================================== 2024-04-25T17:07:01.574 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-04-25T17:07:01.574 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-902.gc61472c8.el9 ceph-noarch 7.4 M 2024-04-25T17:07:01.574 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2024-04-25T17:07:01.574 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-25T17:07:01.574 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-25T17:07:01.574 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-25T17:07:01.574 INFO:teuthology.orchestra.run.smithi037.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-25T17:07:01.574 INFO:teuthology.orchestra.run.smithi037.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-25T17:07:01.574 INFO:teuthology.orchestra.run.smithi037.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-25T17:07:01.574 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-25T17:07:01.574 INFO:teuthology.orchestra.run.smithi037.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-25T17:07:01.574 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-25T17:07:01.574 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-25T17:07:01.575 INFO:teuthology.orchestra.run.smithi037.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-25T17:07:01.575 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:07:01.575 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-04-25T17:07:01.575 INFO:teuthology.orchestra.run.smithi037.stdout:====================================================================================== 2024-04-25T17:07:01.575 INFO:teuthology.orchestra.run.smithi037.stdout:Install 12 Packages 2024-04-25T17:07:01.575 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:07:01.575 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 38 M 2024-04-25T17:07:01.576 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 209 M 2024-04-25T17:07:01.576 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-04-25T17:07:01.665 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2024-04-25T17:07:01.665 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-04-25T17:07:01.665 INFO:teuthology.orchestra.run.smithi069.stdout: Package Arch Version Repo Size 2024-04-25T17:07:01.665 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-04-25T17:07:01.665 INFO:teuthology.orchestra.run.smithi069.stdout:Installing: 2024-04-25T17:07:01.665 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-902.gc61472c8.el9 ceph 137 k 2024-04-25T17:07:01.665 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:07:01.666 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction Summary 2024-04-25T17:07:01.666 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-04-25T17:07:01.666 INFO:teuthology.orchestra.run.smithi069.stdout:Install 1 Package 2024-04-25T17:07:01.666 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:07:01.667 INFO:teuthology.orchestra.run.smithi069.stdout:Total download size: 137 k 2024-04-25T17:07:01.667 INFO:teuthology.orchestra.run.smithi069.stdout:Installed size: 379 k 2024-04-25T17:07:01.667 INFO:teuthology.orchestra.run.smithi069.stdout:Downloading Packages: 2024-04-25T17:07:01.879 INFO:teuthology.orchestra.run.smithi069.stdout:ceph-immutable-object-cache-17.2.7-902.gc61472c 647 kB/s | 137 kB 00:00 2024-04-25T17:07:01.879 INFO:teuthology.orchestra.run.smithi069.stdout:-------------------------------------------------------------------------------- 2024-04-25T17:07:01.880 INFO:teuthology.orchestra.run.smithi069.stdout:Total 642 kB/s | 137 kB 00:00 2024-04-25T17:07:01.880 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction check 2024-04-25T17:07:01.888 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction check succeeded. 2024-04-25T17:07:01.888 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction test 2024-04-25T17:07:01.943 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction test succeeded. 2024-04-25T17:07:01.944 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction 2024-04-25T17:07:02.082 INFO:teuthology.orchestra.run.smithi069.stdout: Preparing : 1/1 2024-04-25T17:07:02.188 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-902.gc61472c8.e 1/1 2024-04-25T17:07:02.212 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-902.gc61472c8.e 1/1 2024-04-25T17:07:02.212 INFO:teuthology.orchestra.run.smithi069.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T17:07:02.213 INFO:teuthology.orchestra.run.smithi069.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-25T17:07:02.213 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:07:02.296 INFO:teuthology.orchestra.run.smithi037.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 606 kB/s | 195 kB 00:00 2024-04-25T17:07:02.421 INFO:teuthology.orchestra.run.smithi037.stdout:(2/12): libgfortran-11.4.1-3.el9.x86_64.rpm 1.8 MB/s | 803 kB 00:00 2024-04-25T17:07:02.446 INFO:teuthology.orchestra.run.smithi037.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 218 kB/s | 33 kB 00:00 2024-04-25T17:07:02.505 INFO:teuthology.orchestra.run.smithi037.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 312 kB/s | 18 kB 00:00 2024-04-25T17:07:02.738 INFO:teuthology.orchestra.run.smithi037.stdout:(5/12): openblas-0.3.21-2.el9.x86_64.rpm 151 kB/s | 35 kB 00:00 2024-04-25T17:07:02.788 INFO:teuthology.orchestra.run.smithi037.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 8.7 MB/s | 3.0 MB 00:00 2024-04-25T17:07:02.922 INFO:teuthology.orchestra.run.smithi037.stdout:(7/12): python3-devel-3.9.18-3.el9.x86_64.rpm 1.8 MB/s | 244 kB 00:00 2024-04-25T17:07:02.989 INFO:teuthology.orchestra.run.smithi037.stdout:(8/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 19 MB/s | 4.7 MB 00:00 2024-04-25T17:07:03.056 INFO:teuthology.orchestra.run.smithi037.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 3.8 MB/s | 250 kB 00:00 2024-04-25T17:07:03.072 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-902.gc61472c8.e 1/1 2024-04-25T17:07:03.072 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:07:03.072 INFO:teuthology.orchestra.run.smithi069.stdout:Installed: 2024-04-25T17:07:03.072 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-immutable-object-cache-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T17:07:03.072 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:07:03.072 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2024-04-25T17:07:03.123 INFO:teuthology.orchestra.run.smithi037.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 26 MB/s | 5.1 MB 00:00 2024-04-25T17:07:03.255 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum -y install ceph-mgr 2024-04-25T17:07:03.490 INFO:teuthology.orchestra.run.smithi037.stdout:(11/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 38 MB/s | 16 MB 00:00 2024-04-25T17:07:03.761 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:01:10 ago on Thu 25 Apr 2024 05:05:53 PM UTC. 2024-04-25T17:07:03.839 INFO:teuthology.orchestra.run.smithi069.stdout:Package ceph-mgr-2:17.2.7-902.gc61472c8.el9.x86_64 is already installed. 2024-04-25T17:07:03.880 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2024-04-25T17:07:03.881 INFO:teuthology.orchestra.run.smithi069.stdout:Nothing to do. 2024-04-25T17:07:03.881 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2024-04-25T17:07:03.962 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum -y install ceph-mgr-dashboard 2024-04-25T17:07:04.472 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:01:11 ago on Thu 25 Apr 2024 05:05:53 PM UTC. 2024-04-25T17:07:04.592 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2024-04-25T17:07:04.593 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-04-25T17:07:04.593 INFO:teuthology.orchestra.run.smithi069.stdout: Package Arch Version Repository Size 2024-04-25T17:07:04.593 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-04-25T17:07:04.593 INFO:teuthology.orchestra.run.smithi069.stdout:Installing: 2024-04-25T17:07:04.593 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-dashboard noarch 2:17.2.7-902.gc61472c8.el9 ceph-noarch 3.4 M 2024-04-25T17:07:04.593 INFO:teuthology.orchestra.run.smithi069.stdout:Installing dependencies: 2024-04-25T17:07:04.593 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-grafana-dashboards noarch 2:17.2.7-902.gc61472c8.el9 ceph-noarch 24 k 2024-04-25T17:07:04.593 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-prometheus-alerts noarch 2:17.2.7-902.gc61472c8.el9 ceph-noarch 15 k 2024-04-25T17:07:04.593 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-04-25T17:07:04.593 INFO:teuthology.orchestra.run.smithi069.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-25T17:07:04.593 INFO:teuthology.orchestra.run.smithi069.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-25T17:07:04.594 INFO:teuthology.orchestra.run.smithi069.stdout:Installing weak dependencies: 2024-04-25T17:07:04.594 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-04-25T17:07:04.594 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:07:04.594 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction Summary 2024-04-25T17:07:04.594 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-04-25T17:07:04.594 INFO:teuthology.orchestra.run.smithi069.stdout:Install 7 Packages 2024-04-25T17:07:04.594 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:07:04.595 INFO:teuthology.orchestra.run.smithi069.stdout:Total download size: 3.7 M 2024-04-25T17:07:04.595 INFO:teuthology.orchestra.run.smithi069.stdout:Installed size: 80 M 2024-04-25T17:07:04.595 INFO:teuthology.orchestra.run.smithi069.stdout:Downloading Packages: 2024-04-25T17:07:04.949 INFO:teuthology.orchestra.run.smithi069.stdout:(1/7): ceph-grafana-dashboards-17.2.7-902.gc614 119 kB/s | 24 kB 00:00 2024-04-25T17:07:04.974 INFO:teuthology.orchestra.run.smithi069.stdout:(2/7): ceph-prometheus-alerts-17.2.7-902.gc6147 63 kB/s | 15 kB 00:00 2024-04-25T17:07:05.041 INFO:teuthology.orchestra.run.smithi069.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 98 kB/s | 9.0 kB 00:00 2024-04-25T17:07:05.066 INFO:teuthology.orchestra.run.smithi069.stdout:(4/7): python3-jwt-2.4.0-1.el9.noarch.rpm 445 kB/s | 41 kB 00:00 2024-04-25T17:07:05.109 INFO:teuthology.orchestra.run.smithi069.stdout:(5/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 457 kB/s | 31 kB 00:00 2024-04-25T17:07:05.158 INFO:teuthology.orchestra.run.smithi069.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 2.0 MB/s | 188 kB 00:00 2024-04-25T17:07:05.550 INFO:teuthology.orchestra.run.smithi069.stdout:(7/7): ceph-mgr-dashboard-17.2.7-902.gc61472c8. 4.2 MB/s | 3.4 MB 00:00 2024-04-25T17:07:05.552 INFO:teuthology.orchestra.run.smithi069.stdout:-------------------------------------------------------------------------------- 2024-04-25T17:07:05.552 INFO:teuthology.orchestra.run.smithi069.stdout:Total 3.8 MB/s | 3.7 MB 00:00 2024-04-25T17:07:05.552 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction check 2024-04-25T17:07:05.560 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction check succeeded. 2024-04-25T17:07:05.561 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction test 2024-04-25T17:07:05.621 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction test succeeded. 2024-04-25T17:07:05.621 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction 2024-04-25T17:07:05.918 INFO:teuthology.orchestra.run.smithi069.stdout: Preparing : 1/1 2024-04-25T17:07:05.993 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-04-25T17:07:06.027 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-04-25T17:07:06.082 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-04-25T17:07:06.122 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-04-25T17:07:06.151 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-902.gc61472c8.el9.no 5/7 2024-04-25T17:07:06.639 INFO:teuthology.orchestra.run.smithi037.stdout:(12/12): ceph-mgr-diskprediction-local-17.2.7-9 1.6 MB/s | 7.4 MB 00:04 2024-04-25T17:07:06.643 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-04-25T17:07:06.643 INFO:teuthology.orchestra.run.smithi037.stdout:Total 7.5 MB/s | 38 MB 00:05 2024-04-25T17:07:07.010 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-04-25T17:07:07.039 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-04-25T17:07:07.039 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-04-25T17:07:07.146 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-902.gc61472c8.el9.n 6/7 2024-04-25T17:07:07.188 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-902.gc61472c8.el9.noarch 7/7 2024-04-25T17:07:07.470 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-04-25T17:07:07.471 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-04-25T17:07:08.254 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-902.gc61472c8.el9.noarch 7/7 2024-04-25T17:07:08.254 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-902.gc61472c8.el9.n 1/7 2024-04-25T17:07:08.254 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-902.gc61472c8.el9.noarch 2/7 2024-04-25T17:07:08.255 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-902.gc61472c8.el9.no 3/7 2024-04-25T17:07:08.255 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-04-25T17:07:08.255 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-04-25T17:07:08.255 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-04-25T17:07:08.262 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-04-25T17:07:08.336 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-04-25T17:07:08.389 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-04-25T17:07:08.502 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-04-25T17:07:08.504 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-04-25T17:07:08.504 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:07:08.505 INFO:teuthology.orchestra.run.smithi069.stdout:Installed: 2024-04-25T17:07:08.505 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-grafana-dashboards-2:17.2.7-902.gc61472c8.el9.noarch 2024-04-25T17:07:08.505 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-dashboard-2:17.2.7-902.gc61472c8.el9.noarch 2024-04-25T17:07:08.505 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-prometheus-alerts-2:17.2.7-902.gc61472c8.el9.noarch 2024-04-25T17:07:08.505 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-04-25T17:07:08.505 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-04-25T17:07:08.505 INFO:teuthology.orchestra.run.smithi069.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-25T17:07:08.505 INFO:teuthology.orchestra.run.smithi069.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-25T17:07:08.505 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:07:08.505 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2024-04-25T17:07:08.540 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-04-25T17:07:08.723 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-25T17:07:08.734 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-25T17:07:08.755 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-25T17:07:08.834 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-04-25T17:07:09.248 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:01:16 ago on Thu 25 Apr 2024 05:05:53 PM UTC. 2024-04-25T17:07:09.364 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2024-04-25T17:07:09.365 INFO:teuthology.orchestra.run.smithi069.stdout:====================================================================================== 2024-04-25T17:07:09.365 INFO:teuthology.orchestra.run.smithi069.stdout: Package Arch Version Repository Size 2024-04-25T17:07:09.365 INFO:teuthology.orchestra.run.smithi069.stdout:====================================================================================== 2024-04-25T17:07:09.365 INFO:teuthology.orchestra.run.smithi069.stdout:Installing: 2024-04-25T17:07:09.365 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-902.gc61472c8.el9 ceph-noarch 7.4 M 2024-04-25T17:07:09.365 INFO:teuthology.orchestra.run.smithi069.stdout:Installing dependencies: 2024-04-25T17:07:09.365 INFO:teuthology.orchestra.run.smithi069.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-25T17:07:09.366 INFO:teuthology.orchestra.run.smithi069.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-25T17:07:09.366 INFO:teuthology.orchestra.run.smithi069.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-25T17:07:09.366 INFO:teuthology.orchestra.run.smithi069.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-25T17:07:09.366 INFO:teuthology.orchestra.run.smithi069.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-25T17:07:09.366 INFO:teuthology.orchestra.run.smithi069.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-25T17:07:09.366 INFO:teuthology.orchestra.run.smithi069.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-25T17:07:09.366 INFO:teuthology.orchestra.run.smithi069.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-25T17:07:09.366 INFO:teuthology.orchestra.run.smithi069.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-25T17:07:09.366 INFO:teuthology.orchestra.run.smithi069.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-25T17:07:09.366 INFO:teuthology.orchestra.run.smithi069.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-25T17:07:09.366 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:07:09.367 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction Summary 2024-04-25T17:07:09.367 INFO:teuthology.orchestra.run.smithi069.stdout:====================================================================================== 2024-04-25T17:07:09.367 INFO:teuthology.orchestra.run.smithi069.stdout:Install 12 Packages 2024-04-25T17:07:09.367 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:07:09.367 INFO:teuthology.orchestra.run.smithi069.stdout:Total download size: 38 M 2024-04-25T17:07:09.368 INFO:teuthology.orchestra.run.smithi069.stdout:Installed size: 209 M 2024-04-25T17:07:09.368 INFO:teuthology.orchestra.run.smithi069.stdout:Downloading Packages: 2024-04-25T17:07:09.519 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-04-25T17:07:09.641 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-04-25T17:07:09.691 INFO:teuthology.orchestra.run.smithi069.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 1.1 MB/s | 195 kB 00:00 2024-04-25T17:07:09.758 INFO:teuthology.orchestra.run.smithi069.stdout:(2/12): libgfortran-11.4.1-3.el9.x86_64.rpm 3.3 MB/s | 803 kB 00:00 2024-04-25T17:07:09.783 INFO:teuthology.orchestra.run.smithi069.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 358 kB/s | 33 kB 00:00 2024-04-25T17:07:09.842 INFO:teuthology.orchestra.run.smithi069.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 313 kB/s | 18 kB 00:00 2024-04-25T17:07:09.901 INFO:teuthology.orchestra.run.smithi069.stdout:(5/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 21 MB/s | 3.0 MB 00:00 2024-04-25T17:07:09.926 INFO:teuthology.orchestra.run.smithi069.stdout:(6/12): openblas-0.3.21-2.el9.x86_64.rpm 430 kB/s | 35 kB 00:00 2024-04-25T17:07:09.976 INFO:teuthology.orchestra.run.smithi069.stdout:(7/12): python3-devel-3.9.18-3.el9.x86_64.rpm 4.9 MB/s | 244 kB 00:00 2024-04-25T17:07:10.077 INFO:teuthology.orchestra.run.smithi069.stdout:(8/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 27 MB/s | 4.7 MB 00:00 2024-04-25T17:07:10.169 INFO:teuthology.orchestra.run.smithi069.stdout:(9/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 27 MB/s | 5.1 MB 00:00 2024-04-25T17:07:10.194 INFO:teuthology.orchestra.run.smithi069.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 2.1 MB/s | 250 kB 00:00 2024-04-25T17:07:10.686 INFO:teuthology.orchestra.run.smithi069.stdout:(11/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 31 MB/s | 16 MB 00:00 2024-04-25T17:07:10.953 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-04-25T17:07:11.736 INFO:teuthology.orchestra.run.smithi069.stdout:(12/12): ceph-mgr-diskprediction-local-17.2.7-9 3.3 MB/s | 7.4 MB 00:02 2024-04-25T17:07:11.738 INFO:teuthology.orchestra.run.smithi069.stdout:-------------------------------------------------------------------------------- 2024-04-25T17:07:11.738 INFO:teuthology.orchestra.run.smithi069.stdout:Total 16 MB/s | 38 MB 00:02 2024-04-25T17:07:12.048 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-04-25T17:07:12.086 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction check 2024-04-25T17:07:12.096 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-902.gc61472 12/12 2024-04-25T17:07:12.114 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction check succeeded. 2024-04-25T17:07:12.114 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction test 2024-04-25T17:07:12.516 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction test succeeded. 2024-04-25T17:07:12.517 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction 2024-04-25T17:07:13.265 INFO:teuthology.orchestra.run.smithi069.stdout: Preparing : 1/1 2024-04-25T17:07:13.332 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-04-25T17:07:13.376 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-04-25T17:07:13.480 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-04-25T17:07:13.510 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-04-25T17:07:13.687 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-25T17:07:13.717 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-25T17:07:13.794 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-04-25T17:07:14.433 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-04-25T17:07:14.548 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-04-25T17:07:14.642 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-902.gc61472 12/12 2024-04-25T17:07:14.642 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-902.gc61472 1/12 2024-04-25T17:07:14.642 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-04-25T17:07:14.642 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-04-25T17:07:14.642 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-04-25T17:07:14.642 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-04-25T17:07:14.643 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-04-25T17:07:14.643 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-04-25T17:07:14.643 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-04-25T17:07:14.643 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-04-25T17:07:14.643 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-04-25T17:07:14.643 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-04-25T17:07:15.005 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-04-25T17:07:15.005 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:07:15.006 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-04-25T17:07:15.006 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-diskprediction-local-2:17.2.7-902.gc61472c8.el9.noarch 2024-04-25T17:07:15.006 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-25T17:07:15.006 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-25T17:07:15.006 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-25T17:07:15.006 INFO:teuthology.orchestra.run.smithi037.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-25T17:07:15.006 INFO:teuthology.orchestra.run.smithi037.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-25T17:07:15.006 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-25T17:07:15.006 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-25T17:07:15.006 INFO:teuthology.orchestra.run.smithi037.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-25T17:07:15.006 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-25T17:07:15.006 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-25T17:07:15.007 INFO:teuthology.orchestra.run.smithi037.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-25T17:07:15.007 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:07:15.007 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-04-25T17:07:15.363 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-mgr-rook 2024-04-25T17:07:15.774 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-04-25T17:07:15.898 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:22 ago on Thu 25 Apr 2024 05:05:53 PM UTC. 2024-04-25T17:07:16.024 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-04-25T17:07:16.025 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-25T17:07:16.025 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2024-04-25T17:07:16.025 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-25T17:07:16.025 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-04-25T17:07:16.025 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-rook noarch 2:17.2.7-902.gc61472c8.el9 ceph-noarch 47 k 2024-04-25T17:07:16.026 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2024-04-25T17:07:16.026 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-25T17:07:16.026 INFO:teuthology.orchestra.run.smithi037.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-25T17:07:16.026 INFO:teuthology.orchestra.run.smithi037.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-25T17:07:16.026 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-25T17:07:16.026 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-25T17:07:16.026 INFO:teuthology.orchestra.run.smithi037.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-25T17:07:16.026 INFO:teuthology.orchestra.run.smithi037.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-25T17:07:16.026 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-25T17:07:16.026 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-25T17:07:16.026 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-25T17:07:16.026 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-25T17:07:16.027 INFO:teuthology.orchestra.run.smithi037.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-25T17:07:16.027 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:07:16.027 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-04-25T17:07:16.027 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-25T17:07:16.027 INFO:teuthology.orchestra.run.smithi037.stdout:Install 13 Packages 2024-04-25T17:07:16.027 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:07:16.027 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 2.2 M 2024-04-25T17:07:16.028 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 26 M 2024-04-25T17:07:16.028 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-04-25T17:07:16.772 INFO:teuthology.orchestra.run.smithi037.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 129 kB/s | 26 kB 00:00 2024-04-25T17:07:16.797 INFO:teuthology.orchestra.run.smithi037.stdout:(2/13): ceph-mgr-rook-17.2.7-902.gc61472c8.el9. 212 kB/s | 47 kB 00:00 2024-04-25T17:07:16.809 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-04-25T17:07:16.839 INFO:teuthology.orchestra.run.smithi037.stdout:(3/13): python3-jsonpointer-2.0-4.el9.noarch.rp 72 kB/s | 19 kB 00:00 2024-04-25T17:07:16.841 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-902.gc61472 12/12 2024-04-25T17:07:17.014 INFO:teuthology.orchestra.run.smithi037.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 917 kB/s | 222 kB 00:00 2024-04-25T17:07:17.048 INFO:teuthology.orchestra.run.smithi037.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 634 kB/s | 159 kB 00:00 2024-04-25T17:07:17.098 INFO:teuthology.orchestra.run.smithi037.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.1 MB/s | 279 kB 00:00 2024-04-25T17:07:17.148 INFO:teuthology.orchestra.run.smithi037.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 401 kB/s | 54 kB 00:00 2024-04-25T17:07:17.399 INFO:teuthology.orchestra.run.smithi037.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 92 kB/s | 32 kB 00:00 2024-04-25T17:07:17.474 INFO:teuthology.orchestra.run.smithi037.stdout:(9/13): python3-google-auth-2.29.0-1.el9.noarch 631 kB/s | 206 kB 00:00 2024-04-25T17:07:17.524 INFO:teuthology.orchestra.run.smithi037.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-04-25T17:07:17.575 INFO:teuthology.orchestra.run.smithi037.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 1.8 MB/s | 90 kB 00:00 2024-04-25T17:07:17.641 INFO:teuthology.orchestra.run.smithi037.stdout:(12/13): python3-certifi-2021.10.8-2.el9.noarch 29 kB/s | 15 kB 00:00 2024-04-25T17:07:18.217 INFO:teuthology.orchestra.run.smithi037.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 1.2 MB/s | 1.0 MB 00:00 2024-04-25T17:07:18.222 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-04-25T17:07:18.222 INFO:teuthology.orchestra.run.smithi037.stdout:Total 1.0 MB/s | 2.2 MB 00:02 2024-04-25T17:07:18.292 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-04-25T17:07:18.309 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-04-25T17:07:18.309 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-04-25T17:07:18.403 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-04-25T17:07:18.403 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-04-25T17:07:18.996 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-04-25T17:07:19.164 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-04-25T17:07:19.220 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-04-25T17:07:19.284 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-04-25T17:07:19.320 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-04-25T17:07:19.333 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-902.gc61472 12/12 2024-04-25T17:07:19.334 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-902.gc61472 1/12 2024-04-25T17:07:19.334 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-04-25T17:07:19.334 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-04-25T17:07:19.334 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-04-25T17:07:19.334 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-04-25T17:07:19.334 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-04-25T17:07:19.334 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-04-25T17:07:19.334 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-04-25T17:07:19.334 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-04-25T17:07:19.334 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-04-25T17:07:19.334 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-04-25T17:07:19.362 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-04-25T17:07:19.458 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-04-25T17:07:19.570 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 7/13 2024-04-25T17:07:19.631 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-04-25T17:07:19.724 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-04-25T17:07:19.725 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:07:19.725 INFO:teuthology.orchestra.run.smithi069.stdout:Installed: 2024-04-25T17:07:19.725 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-diskprediction-local-2:17.2.7-902.gc61472c8.el9.noarch 2024-04-25T17:07:19.725 INFO:teuthology.orchestra.run.smithi069.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-25T17:07:19.725 INFO:teuthology.orchestra.run.smithi069.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-25T17:07:19.725 INFO:teuthology.orchestra.run.smithi069.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-25T17:07:19.725 INFO:teuthology.orchestra.run.smithi069.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-25T17:07:19.725 INFO:teuthology.orchestra.run.smithi069.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-25T17:07:19.725 INFO:teuthology.orchestra.run.smithi069.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-25T17:07:19.725 INFO:teuthology.orchestra.run.smithi069.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-25T17:07:19.725 INFO:teuthology.orchestra.run.smithi069.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-25T17:07:19.725 INFO:teuthology.orchestra.run.smithi069.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-25T17:07:19.725 INFO:teuthology.orchestra.run.smithi069.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-25T17:07:19.725 INFO:teuthology.orchestra.run.smithi069.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-25T17:07:19.726 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:07:19.726 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2024-04-25T17:07:20.124 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum -y install ceph-mgr-rook 2024-04-25T17:07:20.386 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-04-25T17:07:20.435 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-04-25T17:07:20.469 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-04-25T17:07:20.515 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-04-25T17:07:20.538 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-rook-2:17.2.7-902.gc61472c8.el9.noarch 13/13 2024-04-25T17:07:20.640 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:01:27 ago on Thu 25 Apr 2024 05:05:53 PM UTC. 2024-04-25T17:07:20.760 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2024-04-25T17:07:20.761 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-04-25T17:07:20.761 INFO:teuthology.orchestra.run.smithi069.stdout: Package Arch Version Repository Size 2024-04-25T17:07:20.761 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-04-25T17:07:20.761 INFO:teuthology.orchestra.run.smithi069.stdout:Installing: 2024-04-25T17:07:20.761 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-rook noarch 2:17.2.7-902.gc61472c8.el9 ceph-noarch 47 k 2024-04-25T17:07:20.762 INFO:teuthology.orchestra.run.smithi069.stdout:Installing dependencies: 2024-04-25T17:07:20.762 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-25T17:07:20.762 INFO:teuthology.orchestra.run.smithi069.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-25T17:07:20.762 INFO:teuthology.orchestra.run.smithi069.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-25T17:07:20.762 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-25T17:07:20.762 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-25T17:07:20.762 INFO:teuthology.orchestra.run.smithi069.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-25T17:07:20.762 INFO:teuthology.orchestra.run.smithi069.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-25T17:07:20.762 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-25T17:07:20.762 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-25T17:07:20.762 INFO:teuthology.orchestra.run.smithi069.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-25T17:07:20.762 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-25T17:07:20.762 INFO:teuthology.orchestra.run.smithi069.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-25T17:07:20.763 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:07:20.763 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction Summary 2024-04-25T17:07:20.763 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-04-25T17:07:20.763 INFO:teuthology.orchestra.run.smithi069.stdout:Install 13 Packages 2024-04-25T17:07:20.763 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:07:20.763 INFO:teuthology.orchestra.run.smithi069.stdout:Total download size: 2.2 M 2024-04-25T17:07:20.764 INFO:teuthology.orchestra.run.smithi069.stdout:Installed size: 26 M 2024-04-25T17:07:20.764 INFO:teuthology.orchestra.run.smithi069.stdout:Downloading Packages: 2024-04-25T17:07:21.299 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-902.gc61472c8.el9.noarch 13/13 2024-04-25T17:07:21.299 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-rook-2:17.2.7-902.gc61472c8.el9.noarch 1/13 2024-04-25T17:07:21.299 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-04-25T17:07:21.299 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-04-25T17:07:21.299 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-04-25T17:07:21.299 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-04-25T17:07:21.299 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-04-25T17:07:21.299 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-04-25T17:07:21.299 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-04-25T17:07:21.299 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-04-25T17:07:21.299 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 10/13 2024-04-25T17:07:21.300 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-04-25T17:07:21.300 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-04-25T17:07:21.300 INFO:teuthology.orchestra.run.smithi069.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 181 kB/s | 26 kB 00:00 2024-04-25T17:07:21.333 INFO:teuthology.orchestra.run.smithi069.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 109 kB/s | 19 kB 00:00 2024-04-25T17:07:21.383 INFO:teuthology.orchestra.run.smithi069.stdout:(3/13): ceph-mgr-rook-17.2.7-902.gc61472c8.el9. 210 kB/s | 47 kB 00:00 2024-04-25T17:07:21.408 INFO:teuthology.orchestra.run.smithi069.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.0 MB/s | 222 kB 00:00 2024-04-25T17:07:21.433 INFO:teuthology.orchestra.run.smithi069.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.5 MB/s | 159 kB 00:00 2024-04-25T17:07:21.459 INFO:teuthology.orchestra.run.smithi069.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 3.6 MB/s | 279 kB 00:00 2024-04-25T17:07:21.484 INFO:teuthology.orchestra.run.smithi069.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 713 kB/s | 54 kB 00:00 2024-04-25T17:07:21.608 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-04-25T17:07:21.608 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:07:21.608 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-04-25T17:07:21.608 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-rook-2:17.2.7-902.gc61472c8.el9.noarch 2024-04-25T17:07:21.608 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-25T17:07:21.609 INFO:teuthology.orchestra.run.smithi037.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-25T17:07:21.609 INFO:teuthology.orchestra.run.smithi037.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-25T17:07:21.609 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-25T17:07:21.609 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-25T17:07:21.609 INFO:teuthology.orchestra.run.smithi037.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-25T17:07:21.609 INFO:teuthology.orchestra.run.smithi037.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-25T17:07:21.609 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-25T17:07:21.609 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-25T17:07:21.609 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-25T17:07:21.609 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-25T17:07:21.609 INFO:teuthology.orchestra.run.smithi037.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-25T17:07:21.609 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:07:21.609 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-04-25T17:07:21.734 INFO:teuthology.orchestra.run.smithi069.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 107 kB/s | 32 kB 00:00 2024-04-25T17:07:21.768 INFO:teuthology.orchestra.run.smithi069.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 53 kB/s | 15 kB 00:00 2024-04-25T17:07:21.853 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-mgr-cephadm 2024-04-25T17:07:21.918 INFO:teuthology.orchestra.run.smithi069.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 395 kB/s | 59 kB 00:00 2024-04-25T17:07:21.943 INFO:teuthology.orchestra.run.smithi069.stdout:(11/13): python3-google-auth-2.29.0-1.el9.noarc 448 kB/s | 206 kB 00:00 2024-04-25T17:07:22.035 INFO:teuthology.orchestra.run.smithi069.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 767 kB/s | 90 kB 00:00 2024-04-25T17:07:22.068 INFO:teuthology.orchestra.run.smithi069.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 3.1 MB/s | 1.0 MB 00:00 2024-04-25T17:07:22.073 INFO:teuthology.orchestra.run.smithi069.stdout:-------------------------------------------------------------------------------- 2024-04-25T17:07:22.073 INFO:teuthology.orchestra.run.smithi069.stdout:Total 1.7 MB/s | 2.2 MB 00:01 2024-04-25T17:07:22.138 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction check 2024-04-25T17:07:22.150 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction check succeeded. 2024-04-25T17:07:22.150 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction test 2024-04-25T17:07:22.234 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction test succeeded. 2024-04-25T17:07:22.235 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction 2024-04-25T17:07:22.400 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:29 ago on Thu 25 Apr 2024 05:05:53 PM UTC. 2024-04-25T17:07:22.525 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-04-25T17:07:22.526 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-25T17:07:22.526 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2024-04-25T17:07:22.526 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-25T17:07:22.526 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-04-25T17:07:22.527 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-cephadm noarch 2:17.2.7-902.gc61472c8.el9 ceph-noarch 123 k 2024-04-25T17:07:22.527 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2024-04-25T17:07:22.527 INFO:teuthology.orchestra.run.smithi037.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-25T17:07:22.527 INFO:teuthology.orchestra.run.smithi037.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-25T17:07:22.527 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-25T17:07:22.527 INFO:teuthology.orchestra.run.smithi037.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-25T17:07:22.527 INFO:teuthology.orchestra.run.smithi037.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-25T17:07:22.527 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:07:22.527 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-04-25T17:07:22.527 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-25T17:07:22.527 INFO:teuthology.orchestra.run.smithi037.stdout:Install 6 Packages 2024-04-25T17:07:22.527 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:07:22.528 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 7.0 M 2024-04-25T17:07:22.528 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 33 M 2024-04-25T17:07:22.528 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-04-25T17:07:22.800 INFO:teuthology.orchestra.run.smithi069.stdout: Preparing : 1/1 2024-04-25T17:07:22.911 INFO:teuthology.orchestra.run.smithi037.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 1.5 MB/s | 248 kB 00:00 2024-04-25T17:07:22.964 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-04-25T17:07:23.003 INFO:teuthology.orchestra.run.smithi037.stdout:(2/6): ceph-mgr-cephadm-17.2.7-902.gc61472c8.el 476 kB/s | 123 kB 00:00 2024-04-25T17:07:23.019 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-04-25T17:07:23.075 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-04-25T17:07:23.124 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-04-25T17:07:23.237 INFO:teuthology.orchestra.run.smithi037.stdout:(3/6): python3-babel-2.9.1-2.el9.noarch.rpm 12 MB/s | 6.0 MB 00:00 2024-04-25T17:07:23.254 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-04-25T17:07:23.262 INFO:teuthology.orchestra.run.smithi037.stdout:(4/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 1.5 MB/s | 548 kB 00:00 2024-04-25T17:07:23.296 INFO:teuthology.orchestra.run.smithi037.stdout:(5/6): python3-natsort-7.1.1-5.el9.noarch.rpm 198 kB/s | 58 kB 00:00 2024-04-25T17:07:23.321 INFO:teuthology.orchestra.run.smithi037.stdout:(6/6): python3-typing-extensions-4.4.0-2.el9.no 614 kB/s | 51 kB 00:00 2024-04-25T17:07:23.324 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-04-25T17:07:23.324 INFO:teuthology.orchestra.run.smithi037.stdout:Total 8.7 MB/s | 7.0 MB 00:00 2024-04-25T17:07:23.346 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-04-25T17:07:23.400 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-04-25T17:07:23.413 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-04-25T17:07:23.413 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-04-25T17:07:23.466 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 7/13 2024-04-25T17:07:23.516 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-04-25T17:07:23.516 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-04-25T17:07:23.521 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-04-25T17:07:23.829 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-04-25T17:07:23.997 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-04-25T17:07:24.049 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-04-25T17:07:24.230 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-04-25T17:07:24.294 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-04-25T17:07:24.328 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-04-25T17:07:24.373 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-04-25T17:07:24.397 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-rook-2:17.2.7-902.gc61472c8.el9.noarch 13/13 2024-04-25T17:07:24.604 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-04-25T17:07:24.695 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-04-25T17:07:24.758 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-04-25T17:07:24.785 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-902.gc61472c8.el9.noarch 6/6 2024-04-25T17:07:25.022 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-902.gc61472c8.el9.noarch 13/13 2024-04-25T17:07:25.022 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-rook-2:17.2.7-902.gc61472c8.el9.noarch 1/13 2024-04-25T17:07:25.022 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-04-25T17:07:25.022 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-04-25T17:07:25.022 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-04-25T17:07:25.022 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-04-25T17:07:25.023 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-04-25T17:07:25.023 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-04-25T17:07:25.023 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-04-25T17:07:25.023 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-04-25T17:07:25.023 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 10/13 2024-04-25T17:07:25.023 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-04-25T17:07:25.023 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-04-25T17:07:25.327 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-04-25T17:07:25.327 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:07:25.328 INFO:teuthology.orchestra.run.smithi069.stdout:Installed: 2024-04-25T17:07:25.328 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-rook-2:17.2.7-902.gc61472c8.el9.noarch 2024-04-25T17:07:25.328 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-25T17:07:25.328 INFO:teuthology.orchestra.run.smithi069.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-25T17:07:25.328 INFO:teuthology.orchestra.run.smithi069.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-25T17:07:25.328 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-25T17:07:25.328 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-25T17:07:25.328 INFO:teuthology.orchestra.run.smithi069.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-25T17:07:25.328 INFO:teuthology.orchestra.run.smithi069.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-25T17:07:25.328 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-25T17:07:25.328 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-25T17:07:25.328 INFO:teuthology.orchestra.run.smithi069.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-25T17:07:25.328 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-25T17:07:25.328 INFO:teuthology.orchestra.run.smithi069.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-25T17:07:25.329 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:07:25.329 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2024-04-25T17:07:25.548 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum -y install ceph-mgr-cephadm 2024-04-25T17:07:25.563 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-902.gc61472c8.el9.noarch 6/6 2024-04-25T17:07:25.564 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-902.gc61472c8.el9.noarch 1/6 2024-04-25T17:07:25.564 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-04-25T17:07:25.564 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-04-25T17:07:25.564 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-04-25T17:07:25.564 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-04-25T17:07:25.820 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-04-25T17:07:25.820 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:07:25.820 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-04-25T17:07:25.820 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-cephadm-2:17.2.7-902.gc61472c8.el9.noarch 2024-04-25T17:07:25.821 INFO:teuthology.orchestra.run.smithi037.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-25T17:07:25.821 INFO:teuthology.orchestra.run.smithi037.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-25T17:07:25.821 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-25T17:07:25.821 INFO:teuthology.orchestra.run.smithi037.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-25T17:07:25.821 INFO:teuthology.orchestra.run.smithi037.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-25T17:07:25.821 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:07:25.821 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-04-25T17:07:26.065 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:01:33 ago on Thu 25 Apr 2024 05:05:53 PM UTC. 2024-04-25T17:07:26.078 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-fuse 2024-04-25T17:07:26.184 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2024-04-25T17:07:26.184 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-04-25T17:07:26.184 INFO:teuthology.orchestra.run.smithi069.stdout: Package Arch Version Repository Size 2024-04-25T17:07:26.184 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-04-25T17:07:26.185 INFO:teuthology.orchestra.run.smithi069.stdout:Installing: 2024-04-25T17:07:26.185 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-cephadm noarch 2:17.2.7-902.gc61472c8.el9 ceph-noarch 123 k 2024-04-25T17:07:26.185 INFO:teuthology.orchestra.run.smithi069.stdout:Installing dependencies: 2024-04-25T17:07:26.185 INFO:teuthology.orchestra.run.smithi069.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-25T17:07:26.185 INFO:teuthology.orchestra.run.smithi069.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-25T17:07:26.185 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-25T17:07:26.185 INFO:teuthology.orchestra.run.smithi069.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-25T17:07:26.185 INFO:teuthology.orchestra.run.smithi069.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-25T17:07:26.185 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:07:26.185 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction Summary 2024-04-25T17:07:26.185 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-04-25T17:07:26.185 INFO:teuthology.orchestra.run.smithi069.stdout:Install 6 Packages 2024-04-25T17:07:26.185 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:07:26.186 INFO:teuthology.orchestra.run.smithi069.stdout:Total download size: 7.0 M 2024-04-25T17:07:26.186 INFO:teuthology.orchestra.run.smithi069.stdout:Installed size: 33 M 2024-04-25T17:07:26.186 INFO:teuthology.orchestra.run.smithi069.stdout:Downloading Packages: 2024-04-25T17:07:26.608 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:33 ago on Thu 25 Apr 2024 05:05:53 PM UTC. 2024-04-25T17:07:26.678 INFO:teuthology.orchestra.run.smithi069.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 966 kB/s | 248 kB 00:00 2024-04-25T17:07:26.731 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-04-25T17:07:26.732 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-25T17:07:26.732 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2024-04-25T17:07:26.732 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-25T17:07:26.732 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-04-25T17:07:26.732 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-fuse x86_64 2:17.2.7-902.gc61472c8.el9 ceph 814 k 2024-04-25T17:07:26.732 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2024-04-25T17:07:26.732 INFO:teuthology.orchestra.run.smithi037.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-25T17:07:26.732 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:07:26.732 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-04-25T17:07:26.732 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-25T17:07:26.733 INFO:teuthology.orchestra.run.smithi037.stdout:Install 2 Packages 2024-04-25T17:07:26.733 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:07:26.733 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 894 k 2024-04-25T17:07:26.733 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 2.6 M 2024-04-25T17:07:26.733 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-04-25T17:07:26.879 INFO:teuthology.orchestra.run.smithi069.stdout:(2/6): ceph-mgr-cephadm-17.2.7-902.gc61472c8.el 270 kB/s | 123 kB 00:00 2024-04-25T17:07:27.148 INFO:teuthology.orchestra.run.smithi037.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 568 kB/s | 80 kB 00:00 2024-04-25T17:07:27.462 INFO:teuthology.orchestra.run.smithi069.stdout:(3/6): python3-babel-2.9.1-2.el9.noarch.rpm 5.7 MB/s | 6.0 MB 00:01 2024-04-25T17:07:27.487 INFO:teuthology.orchestra.run.smithi069.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 95 kB/s | 58 kB 00:00 2024-04-25T17:07:27.515 INFO:teuthology.orchestra.run.smithi037.stdout:(2/2): ceph-fuse-17.2.7-902.gc61472c8.el9.x86_6 1.6 MB/s | 814 kB 00:00 2024-04-25T17:07:27.516 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-04-25T17:07:27.516 INFO:teuthology.orchestra.run.smithi037.stdout:Total 1.1 MB/s | 894 kB 00:00 2024-04-25T17:07:27.528 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-04-25T17:07:27.551 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-04-25T17:07:27.552 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-04-25T17:07:27.634 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-04-25T17:07:27.634 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-04-25T17:07:27.821 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-04-25T17:07:27.946 INFO:teuthology.orchestra.run.smithi069.stdout:(5/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 433 kB/s | 548 kB 00:01 2024-04-25T17:07:27.967 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-04-25T17:07:28.005 INFO:teuthology.orchestra.run.smithi069.stdout:(6/6): python3-typing-extensions-4.4.0-2.el9.no 94 kB/s | 51 kB 00:00 2024-04-25T17:07:28.009 INFO:teuthology.orchestra.run.smithi069.stdout:-------------------------------------------------------------------------------- 2024-04-25T17:07:28.009 INFO:teuthology.orchestra.run.smithi069.stdout:Total 3.8 MB/s | 7.0 MB 00:01 2024-04-25T17:07:28.034 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-fuse-2:17.2.7-902.gc61472c8.el9.x86_64 2/2 2024-04-25T17:07:28.080 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction check 2024-04-25T17:07:28.092 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction check succeeded. 2024-04-25T17:07:28.092 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction test 2024-04-25T17:07:28.188 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction test succeeded. 2024-04-25T17:07:28.190 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction 2024-04-25T17:07:28.495 INFO:teuthology.orchestra.run.smithi069.stdout: Preparing : 1/1 2024-04-25T17:07:28.650 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-04-25T17:07:28.656 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-fuse-2:17.2.7-902.gc61472c8.el9.x86_64 2/2 2024-04-25T17:07:28.656 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-fuse-2:17.2.7-902.gc61472c8.el9.x86_64 1/2 2024-04-25T17:07:28.706 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-04-25T17:07:28.898 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-04-25T17:07:28.898 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:07:28.899 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-04-25T17:07:28.899 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-fuse-2:17.2.7-902.gc61472c8.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-04-25T17:07:28.899 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:07:28.899 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-04-25T17:07:29.145 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install librados-devel 2024-04-25T17:07:29.224 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-04-25T17:07:29.308 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-04-25T17:07:29.364 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-04-25T17:07:29.393 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-902.gc61472c8.el9.noarch 6/6 2024-04-25T17:07:29.680 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:36 ago on Thu 25 Apr 2024 05:05:53 PM UTC. 2024-04-25T17:07:29.805 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-04-25T17:07:29.806 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-25T17:07:29.806 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repo Size 2024-04-25T17:07:29.806 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-25T17:07:29.806 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-04-25T17:07:29.807 INFO:teuthology.orchestra.run.smithi037.stdout: librados-devel x86_64 2:17.2.7-902.gc61472c8.el9 ceph 126 k 2024-04-25T17:07:29.807 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:07:29.807 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-04-25T17:07:29.807 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-25T17:07:29.807 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package 2024-04-25T17:07:29.807 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:07:29.807 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 126 k 2024-04-25T17:07:29.807 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 448 k 2024-04-25T17:07:29.807 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-04-25T17:07:30.082 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-902.gc61472c8.el9.noarch 6/6 2024-04-25T17:07:30.082 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-902.gc61472c8.el9.noarch 1/6 2024-04-25T17:07:30.082 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-04-25T17:07:30.082 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-04-25T17:07:30.082 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-04-25T17:07:30.082 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-04-25T17:07:30.155 INFO:teuthology.orchestra.run.smithi037.stdout:librados-devel-17.2.7-902.gc61472c8.el9.x86_64. 363 kB/s | 126 kB 00:00 2024-04-25T17:07:30.155 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-04-25T17:07:30.155 INFO:teuthology.orchestra.run.smithi037.stdout:Total 362 kB/s | 126 kB 00:00 2024-04-25T17:07:30.156 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-04-25T17:07:30.161 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-04-25T17:07:30.162 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-04-25T17:07:30.227 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-04-25T17:07:30.228 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-04-25T17:07:30.334 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-04-25T17:07:30.334 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:07:30.335 INFO:teuthology.orchestra.run.smithi069.stdout:Installed: 2024-04-25T17:07:30.335 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-cephadm-2:17.2.7-902.gc61472c8.el9.noarch 2024-04-25T17:07:30.335 INFO:teuthology.orchestra.run.smithi069.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-25T17:07:30.335 INFO:teuthology.orchestra.run.smithi069.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-25T17:07:30.335 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-25T17:07:30.335 INFO:teuthology.orchestra.run.smithi069.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-25T17:07:30.335 INFO:teuthology.orchestra.run.smithi069.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-25T17:07:30.335 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:07:30.335 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2024-04-25T17:07:30.378 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-04-25T17:07:30.478 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librados-devel-2:17.2.7-902.gc61472c8.el9.x86_64 1/1 2024-04-25T17:07:30.583 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum -y install ceph-fuse 2024-04-25T17:07:30.863 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados-devel-2:17.2.7-902.gc61472c8.el9.x86_64 1/1 2024-04-25T17:07:31.088 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:01:38 ago on Thu 25 Apr 2024 05:05:53 PM UTC. 2024-04-25T17:07:31.103 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados-devel-2:17.2.7-902.gc61472c8.el9.x86_64 1/1 2024-04-25T17:07:31.103 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:07:31.103 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-04-25T17:07:31.103 INFO:teuthology.orchestra.run.smithi037.stdout: librados-devel-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T17:07:31.103 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:07:31.103 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-04-25T17:07:31.208 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2024-04-25T17:07:31.208 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-04-25T17:07:31.208 INFO:teuthology.orchestra.run.smithi069.stdout: Package Arch Version Repository Size 2024-04-25T17:07:31.208 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-04-25T17:07:31.208 INFO:teuthology.orchestra.run.smithi069.stdout:Installing: 2024-04-25T17:07:31.208 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-fuse x86_64 2:17.2.7-902.gc61472c8.el9 ceph 814 k 2024-04-25T17:07:31.209 INFO:teuthology.orchestra.run.smithi069.stdout:Installing dependencies: 2024-04-25T17:07:31.209 INFO:teuthology.orchestra.run.smithi069.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-25T17:07:31.209 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:07:31.209 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction Summary 2024-04-25T17:07:31.209 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-04-25T17:07:31.209 INFO:teuthology.orchestra.run.smithi069.stdout:Install 2 Packages 2024-04-25T17:07:31.209 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:07:31.210 INFO:teuthology.orchestra.run.smithi069.stdout:Total download size: 894 k 2024-04-25T17:07:31.210 INFO:teuthology.orchestra.run.smithi069.stdout:Installed size: 2.6 M 2024-04-25T17:07:31.210 INFO:teuthology.orchestra.run.smithi069.stdout:Downloading Packages: 2024-04-25T17:07:31.332 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install libcephfs2 2024-04-25T17:07:31.690 INFO:teuthology.orchestra.run.smithi069.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 401 kB/s | 80 kB 00:00 2024-04-25T17:07:31.798 INFO:teuthology.orchestra.run.smithi069.stdout:(2/2): ceph-fuse-17.2.7-902.gc61472c8.el9.x86_6 2.6 MB/s | 814 kB 00:00 2024-04-25T17:07:31.800 INFO:teuthology.orchestra.run.smithi069.stdout:-------------------------------------------------------------------------------- 2024-04-25T17:07:31.800 INFO:teuthology.orchestra.run.smithi069.stdout:Total 1.5 MB/s | 894 kB 00:00 2024-04-25T17:07:31.811 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction check 2024-04-25T17:07:31.832 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction check succeeded. 2024-04-25T17:07:31.832 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction test 2024-04-25T17:07:31.866 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:38 ago on Thu 25 Apr 2024 05:05:53 PM UTC. 2024-04-25T17:07:31.909 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction test succeeded. 2024-04-25T17:07:31.909 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction 2024-04-25T17:07:31.948 INFO:teuthology.orchestra.run.smithi037.stdout:Package libcephfs2-2:17.2.7-902.gc61472c8.el9.x86_64 is already installed. 2024-04-25T17:07:31.991 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-04-25T17:07:31.992 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2024-04-25T17:07:31.992 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-04-25T17:07:32.054 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install libcephfs-devel 2024-04-25T17:07:32.090 INFO:teuthology.orchestra.run.smithi069.stdout: Preparing : 1/1 2024-04-25T17:07:32.228 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-04-25T17:07:32.296 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-fuse-2:17.2.7-902.gc61472c8.el9.x86_64 2/2 2024-04-25T17:07:32.593 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:39 ago on Thu 25 Apr 2024 05:05:53 PM UTC. 2024-04-25T17:07:32.717 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-04-25T17:07:32.718 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-25T17:07:32.718 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repo Size 2024-04-25T17:07:32.718 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-25T17:07:32.718 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-04-25T17:07:32.718 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs-devel x86_64 2:17.2.7-902.gc61472c8.el9 ceph 25 k 2024-04-25T17:07:32.718 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:07:32.718 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-04-25T17:07:32.718 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-25T17:07:32.718 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package 2024-04-25T17:07:32.718 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:07:32.719 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 25 k 2024-04-25T17:07:32.719 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 110 k 2024-04-25T17:07:32.719 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-04-25T17:07:32.897 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-fuse-2:17.2.7-902.gc61472c8.el9.x86_64 2/2 2024-04-25T17:07:32.897 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-fuse-2:17.2.7-902.gc61472c8.el9.x86_64 1/2 2024-04-25T17:07:32.966 INFO:teuthology.orchestra.run.smithi037.stdout:libcephfs-devel-17.2.7-902.gc61472c8.el9.x86_64 101 kB/s | 25 kB 00:00 2024-04-25T17:07:32.966 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-04-25T17:07:32.967 INFO:teuthology.orchestra.run.smithi037.stdout:Total 100 kB/s | 25 kB 00:00 2024-04-25T17:07:32.967 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-04-25T17:07:32.971 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-04-25T17:07:32.971 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-04-25T17:07:32.972 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-04-25T17:07:32.972 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-04-25T17:07:33.062 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-04-25T17:07:33.135 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-04-25T17:07:33.135 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:07:33.135 INFO:teuthology.orchestra.run.smithi069.stdout:Installed: 2024-04-25T17:07:33.135 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-fuse-2:17.2.7-902.gc61472c8.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-04-25T17:07:33.136 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:07:33.136 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2024-04-25T17:07:33.172 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephfs-devel-2:17.2.7-902.gc61472c8.el9.x86_64 1/1 2024-04-25T17:07:33.438 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum -y install librados-devel 2024-04-25T17:07:33.515 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-902.gc61472c8.el9.x86_64 1/1 2024-04-25T17:07:33.720 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephfs-devel-2:17.2.7-902.gc61472c8.el9.x86_64 1/1 2024-04-25T17:07:33.720 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:07:33.720 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-04-25T17:07:33.721 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs-devel-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T17:07:33.721 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:07:33.721 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-04-25T17:07:33.891 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install librados2 2024-04-25T17:07:33.955 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:01:40 ago on Thu 25 Apr 2024 05:05:53 PM UTC. 2024-04-25T17:07:34.077 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2024-04-25T17:07:34.077 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-04-25T17:07:34.077 INFO:teuthology.orchestra.run.smithi069.stdout: Package Arch Version Repo Size 2024-04-25T17:07:34.078 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-04-25T17:07:34.078 INFO:teuthology.orchestra.run.smithi069.stdout:Installing: 2024-04-25T17:07:34.078 INFO:teuthology.orchestra.run.smithi069.stdout: librados-devel x86_64 2:17.2.7-902.gc61472c8.el9 ceph 126 k 2024-04-25T17:07:34.078 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:07:34.078 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction Summary 2024-04-25T17:07:34.078 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-04-25T17:07:34.078 INFO:teuthology.orchestra.run.smithi069.stdout:Install 1 Package 2024-04-25T17:07:34.078 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:07:34.078 INFO:teuthology.orchestra.run.smithi069.stdout:Total download size: 126 k 2024-04-25T17:07:34.078 INFO:teuthology.orchestra.run.smithi069.stdout:Installed size: 448 k 2024-04-25T17:07:34.078 INFO:teuthology.orchestra.run.smithi069.stdout:Downloading Packages: 2024-04-25T17:07:34.278 INFO:teuthology.orchestra.run.smithi069.stdout:librados-devel-17.2.7-902.gc61472c8.el9.x86_64. 632 kB/s | 126 kB 00:00 2024-04-25T17:07:34.282 INFO:teuthology.orchestra.run.smithi069.stdout:-------------------------------------------------------------------------------- 2024-04-25T17:07:34.282 INFO:teuthology.orchestra.run.smithi069.stdout:Total 627 kB/s | 126 kB 00:00 2024-04-25T17:07:34.282 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction check 2024-04-25T17:07:34.285 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction check succeeded. 2024-04-25T17:07:34.285 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction test 2024-04-25T17:07:34.350 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction test succeeded. 2024-04-25T17:07:34.351 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction 2024-04-25T17:07:34.423 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:41 ago on Thu 25 Apr 2024 05:05:53 PM UTC. 2024-04-25T17:07:34.505 INFO:teuthology.orchestra.run.smithi037.stdout:Package librados2-2:17.2.7-902.gc61472c8.el9.x86_64 is already installed. 2024-04-25T17:07:34.511 INFO:teuthology.orchestra.run.smithi069.stdout: Preparing : 1/1 2024-04-25T17:07:34.547 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-04-25T17:07:34.548 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2024-04-25T17:07:34.548 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-04-25T17:07:34.612 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install librbd1 2024-04-25T17:07:34.635 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : librados-devel-2:17.2.7-902.gc61472c8.el9.x86_64 1/1 2024-04-25T17:07:35.025 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: librados-devel-2:17.2.7-902.gc61472c8.el9.x86_64 1/1 2024-04-25T17:07:35.148 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:42 ago on Thu 25 Apr 2024 05:05:53 PM UTC. 2024-04-25T17:07:35.228 INFO:teuthology.orchestra.run.smithi037.stdout:Package librbd1-2:17.2.7-902.gc61472c8.el9.x86_64 is already installed. 2024-04-25T17:07:35.273 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-04-25T17:07:35.274 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2024-04-25T17:07:35.274 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-04-25T17:07:35.284 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librados-devel-2:17.2.7-902.gc61472c8.el9.x86_64 1/1 2024-04-25T17:07:35.284 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:07:35.285 INFO:teuthology.orchestra.run.smithi069.stdout:Installed: 2024-04-25T17:07:35.285 INFO:teuthology.orchestra.run.smithi069.stdout: librados-devel-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T17:07:35.285 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:07:35.285 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2024-04-25T17:07:35.336 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install python3-rados 2024-04-25T17:07:35.528 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum -y install libcephfs2 2024-04-25T17:07:35.866 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:42 ago on Thu 25 Apr 2024 05:05:53 PM UTC. 2024-04-25T17:07:35.947 INFO:teuthology.orchestra.run.smithi037.stdout:Package python3-rados-2:17.2.7-902.gc61472c8.el9.x86_64 is already installed. 2024-04-25T17:07:35.990 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-04-25T17:07:35.991 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2024-04-25T17:07:35.991 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-04-25T17:07:36.041 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:01:43 ago on Thu 25 Apr 2024 05:05:53 PM UTC. 2024-04-25T17:07:36.053 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install python3-rgw 2024-04-25T17:07:36.120 INFO:teuthology.orchestra.run.smithi069.stdout:Package libcephfs2-2:17.2.7-902.gc61472c8.el9.x86_64 is already installed. 2024-04-25T17:07:36.161 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2024-04-25T17:07:36.162 INFO:teuthology.orchestra.run.smithi069.stdout:Nothing to do. 2024-04-25T17:07:36.162 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2024-04-25T17:07:36.223 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum -y install libcephfs-devel 2024-04-25T17:07:36.588 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:43 ago on Thu 25 Apr 2024 05:05:53 PM UTC. 2024-04-25T17:07:36.670 INFO:teuthology.orchestra.run.smithi037.stdout:Package python3-rgw-2:17.2.7-902.gc61472c8.el9.x86_64 is already installed. 2024-04-25T17:07:36.712 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-04-25T17:07:36.713 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2024-04-25T17:07:36.714 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-04-25T17:07:36.732 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:01:43 ago on Thu 25 Apr 2024 05:05:53 PM UTC. 2024-04-25T17:07:36.775 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install python3-cephfs 2024-04-25T17:07:36.850 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2024-04-25T17:07:36.851 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-04-25T17:07:36.851 INFO:teuthology.orchestra.run.smithi069.stdout: Package Arch Version Repo Size 2024-04-25T17:07:36.851 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-04-25T17:07:36.851 INFO:teuthology.orchestra.run.smithi069.stdout:Installing: 2024-04-25T17:07:36.851 INFO:teuthology.orchestra.run.smithi069.stdout: libcephfs-devel x86_64 2:17.2.7-902.gc61472c8.el9 ceph 25 k 2024-04-25T17:07:36.851 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:07:36.851 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction Summary 2024-04-25T17:07:36.851 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-04-25T17:07:36.852 INFO:teuthology.orchestra.run.smithi069.stdout:Install 1 Package 2024-04-25T17:07:36.852 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:07:36.852 INFO:teuthology.orchestra.run.smithi069.stdout:Total download size: 25 k 2024-04-25T17:07:36.852 INFO:teuthology.orchestra.run.smithi069.stdout:Installed size: 110 k 2024-04-25T17:07:36.852 INFO:teuthology.orchestra.run.smithi069.stdout:Downloading Packages: 2024-04-25T17:07:37.131 INFO:teuthology.orchestra.run.smithi069.stdout:libcephfs-devel-17.2.7-902.gc61472c8.el9.x86_64 90 kB/s | 25 kB 00:00 2024-04-25T17:07:37.132 INFO:teuthology.orchestra.run.smithi069.stdout:-------------------------------------------------------------------------------- 2024-04-25T17:07:37.132 INFO:teuthology.orchestra.run.smithi069.stdout:Total 89 kB/s | 25 kB 00:00 2024-04-25T17:07:37.132 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction check 2024-04-25T17:07:37.135 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction check succeeded. 2024-04-25T17:07:37.135 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction test 2024-04-25T17:07:37.137 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction test succeeded. 2024-04-25T17:07:37.137 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction 2024-04-25T17:07:37.222 INFO:teuthology.orchestra.run.smithi069.stdout: Preparing : 1/1 2024-04-25T17:07:37.307 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:44 ago on Thu 25 Apr 2024 05:05:53 PM UTC. 2024-04-25T17:07:37.326 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libcephfs-devel-2:17.2.7-902.gc61472c8.el9.x86_64 1/1 2024-04-25T17:07:37.388 INFO:teuthology.orchestra.run.smithi037.stdout:Package python3-cephfs-2:17.2.7-902.gc61472c8.el9.x86_64 is already installed. 2024-04-25T17:07:37.430 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-04-25T17:07:37.432 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2024-04-25T17:07:37.432 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-04-25T17:07:37.495 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install python3-rbd 2024-04-25T17:07:37.688 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-902.gc61472c8.el9.x86_64 1/1 2024-04-25T17:07:37.900 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libcephfs-devel-2:17.2.7-902.gc61472c8.el9.x86_64 1/1 2024-04-25T17:07:37.900 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:07:37.900 INFO:teuthology.orchestra.run.smithi069.stdout:Installed: 2024-04-25T17:07:37.900 INFO:teuthology.orchestra.run.smithi069.stdout: libcephfs-devel-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T17:07:37.900 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:07:37.900 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2024-04-25T17:07:38.025 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:45 ago on Thu 25 Apr 2024 05:05:53 PM UTC. 2024-04-25T17:07:38.072 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum -y install librados2 2024-04-25T17:07:38.106 INFO:teuthology.orchestra.run.smithi037.stdout:Package python3-rbd-2:17.2.7-902.gc61472c8.el9.x86_64 is already installed. 2024-04-25T17:07:38.149 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-04-25T17:07:38.150 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2024-04-25T17:07:38.150 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-04-25T17:07:38.217 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install rbd-fuse 2024-04-25T17:07:38.588 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:01:45 ago on Thu 25 Apr 2024 05:05:53 PM UTC. 2024-04-25T17:07:38.668 INFO:teuthology.orchestra.run.smithi069.stdout:Package librados2-2:17.2.7-902.gc61472c8.el9.x86_64 is already installed. 2024-04-25T17:07:38.708 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2024-04-25T17:07:38.709 INFO:teuthology.orchestra.run.smithi069.stdout:Nothing to do. 2024-04-25T17:07:38.709 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2024-04-25T17:07:38.746 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:45 ago on Thu 25 Apr 2024 05:05:53 PM UTC. 2024-04-25T17:07:38.772 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum -y install librbd1 2024-04-25T17:07:38.871 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-04-25T17:07:38.872 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-25T17:07:38.872 INFO:teuthology.orchestra.run.smithi037.stdout: Package Architecture Version Repository Size 2024-04-25T17:07:38.872 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-25T17:07:38.872 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-04-25T17:07:38.872 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-fuse x86_64 2:17.2.7-902.gc61472c8.el9 ceph 82 k 2024-04-25T17:07:38.872 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:07:38.872 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-04-25T17:07:38.873 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-25T17:07:38.873 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package 2024-04-25T17:07:38.873 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:07:38.873 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 82 k 2024-04-25T17:07:38.873 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 222 k 2024-04-25T17:07:38.873 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-04-25T17:07:39.186 INFO:teuthology.orchestra.run.smithi037.stdout:rbd-fuse-17.2.7-902.gc61472c8.el9.x86_64.rpm 262 kB/s | 82 kB 00:00 2024-04-25T17:07:39.186 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-04-25T17:07:39.187 INFO:teuthology.orchestra.run.smithi037.stdout:Total 261 kB/s | 82 kB 00:00 2024-04-25T17:07:39.187 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-04-25T17:07:39.194 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-04-25T17:07:39.195 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-04-25T17:07:39.260 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-04-25T17:07:39.260 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-04-25T17:07:39.284 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:01:46 ago on Thu 25 Apr 2024 05:05:53 PM UTC. 2024-04-25T17:07:39.361 INFO:teuthology.orchestra.run.smithi069.stdout:Package librbd1-2:17.2.7-902.gc61472c8.el9.x86_64 is already installed. 2024-04-25T17:07:39.401 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2024-04-25T17:07:39.402 INFO:teuthology.orchestra.run.smithi069.stdout:Nothing to do. 2024-04-25T17:07:39.402 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2024-04-25T17:07:39.405 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-04-25T17:07:39.472 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum -y install python3-rados 2024-04-25T17:07:40.120 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-fuse-2:17.2.7-902.gc61472c8.el9.x86_64 1/1 2024-04-25T17:07:40.120 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: rbd-fuse-2:17.2.7-902.gc61472c8.el9.x86_64 1/1 2024-04-25T17:07:40.128 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-fuse-2:17.2.7-902.gc61472c8.el9.x86_64 1/1 2024-04-25T17:07:40.128 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:07:40.128 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-04-25T17:07:40.128 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-fuse-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T17:07:40.128 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:07:40.128 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-04-25T17:07:40.397 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install rbd-mirror 2024-04-25T17:07:40.640 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:01:47 ago on Thu 25 Apr 2024 05:05:53 PM UTC. 2024-04-25T17:07:40.723 INFO:teuthology.orchestra.run.smithi069.stdout:Package python3-rados-2:17.2.7-902.gc61472c8.el9.x86_64 is already installed. 2024-04-25T17:07:40.763 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2024-04-25T17:07:40.764 INFO:teuthology.orchestra.run.smithi069.stdout:Nothing to do. 2024-04-25T17:07:40.764 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2024-04-25T17:07:40.832 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum -y install python3-rgw 2024-04-25T17:07:40.939 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:47 ago on Thu 25 Apr 2024 05:05:53 PM UTC. 2024-04-25T17:07:41.065 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-04-25T17:07:41.066 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-25T17:07:41.066 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repo Size 2024-04-25T17:07:41.066 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-25T17:07:41.066 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-04-25T17:07:41.066 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-mirror x86_64 2:17.2.7-902.gc61472c8.el9 ceph 2.9 M 2024-04-25T17:07:41.066 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:07:41.066 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-04-25T17:07:41.066 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-25T17:07:41.066 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package 2024-04-25T17:07:41.066 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:07:41.067 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 2.9 M 2024-04-25T17:07:41.067 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 12 M 2024-04-25T17:07:41.067 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-04-25T17:07:41.341 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:01:48 ago on Thu 25 Apr 2024 05:05:53 PM UTC. 2024-04-25T17:07:41.419 INFO:teuthology.orchestra.run.smithi069.stdout:Package python3-rgw-2:17.2.7-902.gc61472c8.el9.x86_64 is already installed. 2024-04-25T17:07:41.459 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2024-04-25T17:07:41.460 INFO:teuthology.orchestra.run.smithi069.stdout:Nothing to do. 2024-04-25T17:07:41.461 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2024-04-25T17:07:41.524 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum -y install python3-cephfs 2024-04-25T17:07:41.556 INFO:teuthology.orchestra.run.smithi037.stdout:rbd-mirror-17.2.7-902.gc61472c8.el9.x86_64.rpm 6.0 MB/s | 2.9 MB 00:00 2024-04-25T17:07:41.556 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-04-25T17:07:41.557 INFO:teuthology.orchestra.run.smithi037.stdout:Total 6.0 MB/s | 2.9 MB 00:00 2024-04-25T17:07:41.557 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-04-25T17:07:41.567 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-04-25T17:07:41.567 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-04-25T17:07:41.650 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-04-25T17:07:41.650 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-04-25T17:07:42.039 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:01:49 ago on Thu 25 Apr 2024 05:05:53 PM UTC. 2024-04-25T17:07:42.089 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-04-25T17:07:42.117 INFO:teuthology.orchestra.run.smithi069.stdout:Package python3-cephfs-2:17.2.7-902.gc61472c8.el9.x86_64 is already installed. 2024-04-25T17:07:42.157 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2024-04-25T17:07:42.158 INFO:teuthology.orchestra.run.smithi069.stdout:Nothing to do. 2024-04-25T17:07:42.158 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2024-04-25T17:07:42.165 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-mirror-2:17.2.7-902.gc61472c8.el9.x86_64 1/1 2024-04-25T17:07:42.190 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: rbd-mirror-2:17.2.7-902.gc61472c8.el9.x86_64 1/1 2024-04-25T17:07:42.190 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T17:07:42.190 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-25T17:07:42.190 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T17:07:42.190 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T17:07:42.190 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:07:42.221 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum -y install python3-rbd 2024-04-25T17:07:42.730 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:01:49 ago on Thu 25 Apr 2024 05:05:53 PM UTC. 2024-04-25T17:07:42.810 INFO:teuthology.orchestra.run.smithi069.stdout:Package python3-rbd-2:17.2.7-902.gc61472c8.el9.x86_64 is already installed. 2024-04-25T17:07:42.849 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2024-04-25T17:07:42.850 INFO:teuthology.orchestra.run.smithi069.stdout:Nothing to do. 2024-04-25T17:07:42.850 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2024-04-25T17:07:42.914 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum -y install rbd-fuse 2024-04-25T17:07:43.293 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-mirror-2:17.2.7-902.gc61472c8.el9.x86_64 1/1 2024-04-25T17:07:43.293 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:07:43.293 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-04-25T17:07:43.293 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-mirror-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T17:07:43.294 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:07:43.294 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-04-25T17:07:43.423 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:01:50 ago on Thu 25 Apr 2024 05:05:53 PM UTC. 2024-04-25T17:07:43.535 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install rbd-nbd 2024-04-25T17:07:43.542 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2024-04-25T17:07:43.542 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-04-25T17:07:43.542 INFO:teuthology.orchestra.run.smithi069.stdout: Package Architecture Version Repository Size 2024-04-25T17:07:43.542 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-04-25T17:07:43.542 INFO:teuthology.orchestra.run.smithi069.stdout:Installing: 2024-04-25T17:07:43.543 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-fuse x86_64 2:17.2.7-902.gc61472c8.el9 ceph 82 k 2024-04-25T17:07:43.543 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:07:43.543 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction Summary 2024-04-25T17:07:43.543 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-04-25T17:07:43.543 INFO:teuthology.orchestra.run.smithi069.stdout:Install 1 Package 2024-04-25T17:07:43.543 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:07:43.543 INFO:teuthology.orchestra.run.smithi069.stdout:Total download size: 82 k 2024-04-25T17:07:43.543 INFO:teuthology.orchestra.run.smithi069.stdout:Installed size: 222 k 2024-04-25T17:07:43.543 INFO:teuthology.orchestra.run.smithi069.stdout:Downloading Packages: 2024-04-25T17:07:43.859 INFO:teuthology.orchestra.run.smithi069.stdout:rbd-fuse-17.2.7-902.gc61472c8.el9.x86_64.rpm 260 kB/s | 82 kB 00:00 2024-04-25T17:07:43.859 INFO:teuthology.orchestra.run.smithi069.stdout:-------------------------------------------------------------------------------- 2024-04-25T17:07:43.859 INFO:teuthology.orchestra.run.smithi069.stdout:Total 259 kB/s | 82 kB 00:00 2024-04-25T17:07:43.860 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction check 2024-04-25T17:07:43.866 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction check succeeded. 2024-04-25T17:07:43.866 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction test 2024-04-25T17:07:43.929 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction test succeeded. 2024-04-25T17:07:43.929 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction 2024-04-25T17:07:44.066 INFO:teuthology.orchestra.run.smithi069.stdout: Preparing : 1/1 2024-04-25T17:07:44.071 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:51 ago on Thu 25 Apr 2024 05:05:53 PM UTC. 2024-04-25T17:07:44.153 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : rbd-fuse-2:17.2.7-902.gc61472c8.el9.x86_64 1/1 2024-04-25T17:07:44.198 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-04-25T17:07:44.199 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-25T17:07:44.199 INFO:teuthology.orchestra.run.smithi037.stdout: Package Architecture Version Repository Size 2024-04-25T17:07:44.199 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-25T17:07:44.199 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-04-25T17:07:44.199 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-nbd x86_64 2:17.2.7-902.gc61472c8.el9 ceph 165 k 2024-04-25T17:07:44.199 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:07:44.200 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-04-25T17:07:44.200 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-04-25T17:07:44.200 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package 2024-04-25T17:07:44.200 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:07:44.200 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 165 k 2024-04-25T17:07:44.200 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 477 k 2024-04-25T17:07:44.200 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-04-25T17:07:44.435 INFO:teuthology.orchestra.run.smithi037.stdout:rbd-nbd-17.2.7-902.gc61472c8.el9.x86_64.rpm 704 kB/s | 165 kB 00:00 2024-04-25T17:07:44.436 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-04-25T17:07:44.436 INFO:teuthology.orchestra.run.smithi037.stdout:Total 699 kB/s | 165 kB 00:00 2024-04-25T17:07:44.436 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-04-25T17:07:44.445 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-04-25T17:07:44.445 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-04-25T17:07:44.504 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: rbd-fuse-2:17.2.7-902.gc61472c8.el9.x86_64 1/1 2024-04-25T17:07:44.513 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-04-25T17:07:44.513 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-04-25T17:07:44.673 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-04-25T17:07:44.733 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : rbd-fuse-2:17.2.7-902.gc61472c8.el9.x86_64 1/1 2024-04-25T17:07:44.733 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:07:44.733 INFO:teuthology.orchestra.run.smithi069.stdout:Installed: 2024-04-25T17:07:44.733 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-fuse-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T17:07:44.733 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:07:44.734 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2024-04-25T17:07:44.793 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-nbd-2:17.2.7-902.gc61472c8.el9.x86_64 1/1 2024-04-25T17:07:45.013 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum -y install rbd-mirror 2024-04-25T17:07:45.187 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: rbd-nbd-2:17.2.7-902.gc61472c8.el9.x86_64 1/1 2024-04-25T17:07:45.410 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-nbd-2:17.2.7-902.gc61472c8.el9.x86_64 1/1 2024-04-25T17:07:45.411 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:07:45.411 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-04-25T17:07:45.411 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-nbd-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T17:07:45.411 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:07:45.411 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-04-25T17:07:45.533 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:01:52 ago on Thu 25 Apr 2024 05:05:53 PM UTC. 2024-04-25T17:07:45.653 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2024-04-25T17:07:45.654 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-04-25T17:07:45.654 INFO:teuthology.orchestra.run.smithi069.stdout: Package Arch Version Repo Size 2024-04-25T17:07:45.655 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-04-25T17:07:45.655 INFO:teuthology.orchestra.run.smithi069.stdout:Installing: 2024-04-25T17:07:45.655 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-mirror x86_64 2:17.2.7-902.gc61472c8.el9 ceph 2.9 M 2024-04-25T17:07:45.655 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:07:45.655 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction Summary 2024-04-25T17:07:45.655 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-04-25T17:07:45.655 INFO:teuthology.orchestra.run.smithi069.stdout:Install 1 Package 2024-04-25T17:07:45.655 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:07:45.655 INFO:teuthology.orchestra.run.smithi069.stdout:Total download size: 2.9 M 2024-04-25T17:07:45.655 INFO:teuthology.orchestra.run.smithi069.stdout:Installed size: 12 M 2024-04-25T17:07:45.655 INFO:teuthology.orchestra.run.smithi069.stdout:Downloading Packages: 2024-04-25T17:07:45.663 DEBUG:teuthology.parallel:result is None 2024-04-25T17:07:46.394 INFO:teuthology.orchestra.run.smithi069.stdout:rbd-mirror-17.2.7-902.gc61472c8.el9.x86_64.rpm 4.0 MB/s | 2.9 MB 00:00 2024-04-25T17:07:46.395 INFO:teuthology.orchestra.run.smithi069.stdout:-------------------------------------------------------------------------------- 2024-04-25T17:07:46.396 INFO:teuthology.orchestra.run.smithi069.stdout:Total 4.0 MB/s | 2.9 MB 00:00 2024-04-25T17:07:46.396 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction check 2024-04-25T17:07:46.404 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction check succeeded. 2024-04-25T17:07:46.405 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction test 2024-04-25T17:07:46.483 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction test succeeded. 2024-04-25T17:07:46.484 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction 2024-04-25T17:07:46.895 INFO:teuthology.orchestra.run.smithi069.stdout: Preparing : 1/1 2024-04-25T17:07:46.962 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : rbd-mirror-2:17.2.7-902.gc61472c8.el9.x86_64 1/1 2024-04-25T17:07:46.986 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: rbd-mirror-2:17.2.7-902.gc61472c8.el9.x86_64 1/1 2024-04-25T17:07:46.986 INFO:teuthology.orchestra.run.smithi069.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T17:07:46.986 INFO:teuthology.orchestra.run.smithi069.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-25T17:07:46.986 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T17:07:46.986 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T17:07:46.986 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:07:48.093 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : rbd-mirror-2:17.2.7-902.gc61472c8.el9.x86_64 1/1 2024-04-25T17:07:48.093 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:07:48.093 INFO:teuthology.orchestra.run.smithi069.stdout:Installed: 2024-04-25T17:07:48.093 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-mirror-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T17:07:48.093 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:07:48.093 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2024-04-25T17:07:48.330 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum -y install rbd-nbd 2024-04-25T17:07:48.847 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:01:55 ago on Thu 25 Apr 2024 05:05:53 PM UTC. 2024-04-25T17:07:48.971 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2024-04-25T17:07:48.972 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-04-25T17:07:48.972 INFO:teuthology.orchestra.run.smithi069.stdout: Package Architecture Version Repository Size 2024-04-25T17:07:48.972 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-04-25T17:07:48.972 INFO:teuthology.orchestra.run.smithi069.stdout:Installing: 2024-04-25T17:07:48.972 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-nbd x86_64 2:17.2.7-902.gc61472c8.el9 ceph 165 k 2024-04-25T17:07:48.972 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:07:48.972 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction Summary 2024-04-25T17:07:48.973 INFO:teuthology.orchestra.run.smithi069.stdout:================================================================================ 2024-04-25T17:07:48.973 INFO:teuthology.orchestra.run.smithi069.stdout:Install 1 Package 2024-04-25T17:07:48.973 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:07:48.973 INFO:teuthology.orchestra.run.smithi069.stdout:Total download size: 165 k 2024-04-25T17:07:48.973 INFO:teuthology.orchestra.run.smithi069.stdout:Installed size: 477 k 2024-04-25T17:07:48.973 INFO:teuthology.orchestra.run.smithi069.stdout:Downloading Packages: 2024-04-25T17:07:49.208 INFO:teuthology.orchestra.run.smithi069.stdout:rbd-nbd-17.2.7-902.gc61472c8.el9.x86_64.rpm 702 kB/s | 165 kB 00:00 2024-04-25T17:07:49.209 INFO:teuthology.orchestra.run.smithi069.stdout:-------------------------------------------------------------------------------- 2024-04-25T17:07:49.209 INFO:teuthology.orchestra.run.smithi069.stdout:Total 697 kB/s | 165 kB 00:00 2024-04-25T17:07:49.209 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction check 2024-04-25T17:07:49.217 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction check succeeded. 2024-04-25T17:07:49.217 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction test 2024-04-25T17:07:49.278 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction test succeeded. 2024-04-25T17:07:49.279 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction 2024-04-25T17:07:49.435 INFO:teuthology.orchestra.run.smithi069.stdout: Preparing : 1/1 2024-04-25T17:07:49.554 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : rbd-nbd-2:17.2.7-902.gc61472c8.el9.x86_64 1/1 2024-04-25T17:07:49.949 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: rbd-nbd-2:17.2.7-902.gc61472c8.el9.x86_64 1/1 2024-04-25T17:07:50.192 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : rbd-nbd-2:17.2.7-902.gc61472c8.el9.x86_64 1/1 2024-04-25T17:07:50.192 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:07:50.193 INFO:teuthology.orchestra.run.smithi069.stdout:Installed: 2024-04-25T17:07:50.193 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-nbd-2:17.2.7-902.gc61472c8.el9.x86_64 2024-04-25T17:07:50.193 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:07:50.193 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2024-04-25T17:07:50.408 DEBUG:teuthology.parallel:result is None 2024-04-25T17:07:50.409 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T17:07:50.409 INFO:teuthology.packaging:ref: None 2024-04-25T17:07:50.409 INFO:teuthology.packaging:tag: None 2024-04-25T17:07:50.409 INFO:teuthology.packaging:branch: quincy 2024-04-25T17:07:50.409 INFO:teuthology.packaging:sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T17:07:50.409 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-04-25T17:07:50.766 DEBUG:teuthology.orchestra.run.smithi037:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T17:07:50.792 INFO:teuthology.orchestra.run.smithi037.stdout:17.2.7-902.gc61472c8.el9 2024-04-25T17:07:50.793 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-902.gc61472c8.el9 2024-04-25T17:07:50.793 INFO:teuthology.task.install:The correct ceph version 17.2.7-902.gc61472c8 is installed. 2024-04-25T17:07:50.794 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T17:07:50.794 INFO:teuthology.packaging:ref: None 2024-04-25T17:07:50.795 INFO:teuthology.packaging:tag: None 2024-04-25T17:07:50.795 INFO:teuthology.packaging:branch: quincy 2024-04-25T17:07:50.795 INFO:teuthology.packaging:sha1: 994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T17:07:50.795 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-04-25T17:07:51.107 DEBUG:teuthology.orchestra.run.smithi069:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T17:07:51.130 INFO:teuthology.orchestra.run.smithi069.stdout:17.2.7-902.gc61472c8.el9 2024-04-25T17:07:51.131 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-902.gc61472c8.el9 2024-04-25T17:07:51.131 INFO:teuthology.task.install:The correct ceph version 17.2.7-902.gc61472c8 is installed. 2024-04-25T17:07:51.132 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-25T17:07:51.132 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-25T17:07:51.132 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T17:07:51.163 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-04-25T17:07:51.163 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T17:07:51.198 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-25T17:07:51.198 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-25T17:07:51.198 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T17:07:51.231 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T17:07:51.299 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-04-25T17:07:51.299 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T17:07:51.324 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T17:07:51.388 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-25T17:07:51.388 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-25T17:07:51.388 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T17:07:51.417 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T17:07:51.484 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-04-25T17:07:51.484 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T17:07:51.509 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T17:07:51.573 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-25T17:07:51.573 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-25T17:07:51.573 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T17:07:51.600 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T17:07:51.667 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-04-25T17:07:51.667 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T17:07:51.691 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T17:07:51.754 INFO:teuthology.run_tasks:Running task print... 2024-04-25T17:07:51.762 INFO:teuthology.task.print:**** done install task... 2024-04-25T17:07:51.763 INFO:teuthology.run_tasks:Running task cephadm... 2024-04-25T17:07:51.878 INFO:tasks.cephadm:Config: {'cephadm_branch': 'quincy', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}}, 'image': 'quay.ceph.io/ceph-ci/ceph:quincy', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': '994e2f20102a20fa9a27966c14b625cc01884df8'} 2024-04-25T17:07:51.878 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:quincy 2024-04-25T17:07:51.879 INFO:tasks.cephadm:Cluster fsid is 599bb7fc-0326-11ef-bc93-c7b262605968 2024-04-25T17:07:51.879 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-04-25T17:07:51.879 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-04-25T17:07:51.879 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi037': '172.21.15.37', 'mon.smithi069': '172.21.15.69'} 2024-04-25T17:07:51.879 INFO:tasks.cephadm:Normalizing hostnames... 2024-04-25T17:07:51.880 DEBUG:teuthology.orchestra.run.smithi037:> sudo hostname $(hostname -s) 2024-04-25T17:07:51.909 DEBUG:teuthology.orchestra.run.smithi069:> sudo hostname $(hostname -s) 2024-04-25T17:07:51.933 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref quincy)... 2024-04-25T17:07:51.934 DEBUG:teuthology.orchestra.run.smithi037:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-25T17:07:52.278 INFO:teuthology.orchestra.run.smithi037.stdout:-rw-r--r--. 1 ubuntu ubuntu 375153 Apr 25 17:07 /home/ubuntu/cephtest/cephadm 2024-04-25T17:07:52.278 DEBUG:teuthology.orchestra.run.smithi069:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-04-25T17:07:52.511 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r--. 1 ubuntu ubuntu 375153 Apr 25 17:07 /home/ubuntu/cephtest/cephadm 2024-04-25T17:07:52.512 DEBUG:teuthology.orchestra.run.smithi037:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-25T17:07:52.531 DEBUG:teuthology.orchestra.run.smithi069:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-04-25T17:07:52.557 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:quincy on all hosts... 2024-04-25T17:07:52.557 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-04-25T17:07:52.574 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-04-25T17:07:54.106 INFO:teuthology.orchestra.run.smithi037.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-04-25T17:07:54.144 INFO:teuthology.orchestra.run.smithi069.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-04-25T17:08:28.318 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-25T17:08:28.318 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_version": "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)", 2024-04-25T17:08:28.318 INFO:teuthology.orchestra.run.smithi037.stdout: "image_id": "0de407c1b3afb7a571e0cc4b0c826a995ed358d49d5f013ca6bdfad025b55c43", 2024-04-25T17:08:28.318 INFO:teuthology.orchestra.run.smithi037.stdout: "repo_digests": [ 2024-04-25T17:08:28.318 INFO:teuthology.orchestra.run.smithi037.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:27d43f80a23d3545096a7bb490598a6f37852da2940e69e5a8f3e3d7fb58fd17" 2024-04-25T17:08:28.318 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2024-04-25T17:08:28.319 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-25T17:08:28.856 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-04-25T17:08:28.856 INFO:teuthology.orchestra.run.smithi069.stdout: "ceph_version": "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)", 2024-04-25T17:08:28.856 INFO:teuthology.orchestra.run.smithi069.stdout: "image_id": "0de407c1b3afb7a571e0cc4b0c826a995ed358d49d5f013ca6bdfad025b55c43", 2024-04-25T17:08:28.856 INFO:teuthology.orchestra.run.smithi069.stdout: "repo_digests": [ 2024-04-25T17:08:28.856 INFO:teuthology.orchestra.run.smithi069.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:27d43f80a23d3545096a7bb490598a6f37852da2940e69e5a8f3e3d7fb58fd17" 2024-04-25T17:08:28.856 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2024-04-25T17:08:28.856 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-04-25T17:08:28.879 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /etc/ceph 2024-04-25T17:08:28.907 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /etc/ceph 2024-04-25T17:08:28.934 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 777 /etc/ceph 2024-04-25T17:08:28.972 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod 777 /etc/ceph 2024-04-25T17:08:28.998 INFO:tasks.cephadm:Writing seed config... 2024-04-25T17:08:28.999 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-04-25T17:08:28.999 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-04-25T17:08:28.999 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-04-25T17:08:29.000 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-04-25T17:08:29.000 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-04-25T17:08:29.000 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-04-25T17:08:29.000 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-04-25T17:08:29.000 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-04-25T17:08:29.000 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-04-25T17:08:29.000 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-04-25T17:08:29.000 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-04-25T17:08:29.000 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-04-25T17:08:29.000 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-04-25T17:08:29.000 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-04-25T17:08:29.000 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-04-25T17:08:29.000 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-04-25T17:08:29.000 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-04-25T17:08:29.000 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-04-25T17:08:29.000 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-04-25T17:08:29.000 INFO:tasks.cephadm: override: [client] debug client = 20 2024-04-25T17:08:29.001 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-04-25T17:08:29.001 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-04-25T17:08:29.001 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-04-25T17:08:29.001 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-04-25T17:08:29.001 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-04-25T17:08:29.001 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-04-25T17:08:29.001 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-04-25T17:08:29.001 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-04-25T17:08:29.001 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-04-25T17:08:29.001 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-04-25T17:08:29.001 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-04-25T17:08:29.001 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-04-25T17:08:29.001 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-04-25T17:08:29.001 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-04-25T17:08:29.001 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-04-25T17:08:29.001 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-04-25T17:08:29.002 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-04-25T17:08:29.002 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-04-25T17:08:29.002 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-04-25T17:08:29.002 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-04-25T17:08:29.002 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-04-25T17:08:29.002 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-04-25T17:08:29.002 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-25T17:08:29.002 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-04-25T17:08:29.027 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 599bb7fc-0326-11ef-bc93-c7b262605968 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-04-25T17:08:29.027 DEBUG:teuthology.orchestra.run.smithi037:mon.smithi037> sudo journalctl -f -n 0 -u ceph-599bb7fc-0326-11ef-bc93-c7b262605968@mon.smithi037.service 2024-04-25T17:08:29.069 INFO:tasks.cephadm:Bootstrapping... 2024-04-25T17:08:29.069 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy -v bootstrap --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.37 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-04-25T17:08:29.279 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-04-25T17:08:29.279 INFO:teuthology.orchestra.run.smithi037.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:quincy', '-v', 'bootstrap', '--fsid', '599bb7fc-0326-11ef-bc93-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.37', '--skip-admin-label'] 2024-04-25T17:08:29.306 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-25T17:08:29.307 INFO:teuthology.orchestra.run.smithi037.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-04-25T17:08:29.307 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying podman|docker is present... 2024-04-25T17:08:29.332 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-25T17:08:29.333 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying lvm2 is present... 2024-04-25T17:08:29.333 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying time synchronization is in place... 2024-04-25T17:08:29.340 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-25T17:08:29.341 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-25T17:08:29.347 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-25T17:08:29.347 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout inactive 2024-04-25T17:08:29.354 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout enabled 2024-04-25T17:08:29.360 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout active 2024-04-25T17:08:29.360 INFO:teuthology.orchestra.run.smithi037.stdout:Unit chronyd.service is enabled and running 2024-04-25T17:08:29.360 INFO:teuthology.orchestra.run.smithi037.stdout:Repeating the final host check... 2024-04-25T17:08:29.384 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stdout 4.9.4-dev 2024-04-25T17:08:29.384 INFO:teuthology.orchestra.run.smithi037.stdout:podman (/bin/podman) version 4.9.4 is present 2024-04-25T17:08:29.384 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl is present 2024-04-25T17:08:29.384 INFO:teuthology.orchestra.run.smithi037.stdout:lvcreate is present 2024-04-25T17:08:29.391 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-04-25T17:08:29.391 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-04-25T17:08:29.398 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-04-25T17:08:29.398 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout inactive 2024-04-25T17:08:29.404 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout enabled 2024-04-25T17:08:29.411 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout active 2024-04-25T17:08:29.411 INFO:teuthology.orchestra.run.smithi037.stdout:Unit chronyd.service is enabled and running 2024-04-25T17:08:29.411 INFO:teuthology.orchestra.run.smithi037.stdout:Host looks OK 2024-04-25T17:08:29.411 INFO:teuthology.orchestra.run.smithi037.stdout:Cluster fsid: 599bb7fc-0326-11ef-bc93-c7b262605968 2024-04-25T17:08:29.412 INFO:teuthology.orchestra.run.smithi037.stdout:Acquiring lock 140503798105424 on /run/cephadm/599bb7fc-0326-11ef-bc93-c7b262605968.lock 2024-04-25T17:08:29.412 INFO:teuthology.orchestra.run.smithi037.stdout:Lock 140503798105424 acquired on /run/cephadm/599bb7fc-0326-11ef-bc93-c7b262605968.lock 2024-04-25T17:08:29.412 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying IP 172.21.15.37 port 3300 ... 2024-04-25T17:08:29.412 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying IP 172.21.15.37 port 6789 ... 2024-04-25T17:08:29.412 INFO:teuthology.orchestra.run.smithi037.stdout:Base mon IP(s) is [172.21.15.37:3300, 172.21.15.37:6789], mon addrv is [v2:172.21.15.37:3300,v1:172.21.15.37:6789] 2024-04-25T17:08:29.416 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.37 metric 100 2024-04-25T17:08:29.416 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.37 metric 100 2024-04-25T17:08:29.419 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-04-25T17:08:29.419 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 1024 pref medium 2024-04-25T17:08:29.419 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 100 pref medium 2024-04-25T17:08:29.422 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-04-25T17:08:29.422 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-04-25T17:08:29.422 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-25T17:08:29.422 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-04-25T17:08:29.422 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe88:7794/64 scope link noprefixroute 2024-04-25T17:08:29.422 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-04-25T17:08:29.423 INFO:teuthology.orchestra.run.smithi037.stdout:Mon IP `172.21.15.37` is in CIDR network `172.21.0.0/20` 2024-04-25T17:08:29.423 INFO:teuthology.orchestra.run.smithi037.stdout:Mon IP `172.21.15.37` is in CIDR network `172.21.0.0/20` 2024-04-25T17:08:29.423 INFO:teuthology.orchestra.run.smithi037.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-04-25T17:08:29.423 INFO:teuthology.orchestra.run.smithi037.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-04-25T17:08:29.424 INFO:teuthology.orchestra.run.smithi037.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-04-25T17:08:29.859 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stdout 0de407c1b3afb7a571e0cc4b0c826a995ed358d49d5f013ca6bdfad025b55c43 2024-04-25T17:08:29.859 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:quincy... 2024-04-25T17:08:29.860 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stderr Getting image source signatures 2024-04-25T17:08:29.860 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stderr Copying blob sha256:0e2af62137028b073c6ccdb8d4d7e0ccccc475ce5f6e225cb983e90813813045 2024-04-25T17:08:29.860 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stderr Copying blob sha256:3d665f4c032644be9cae748af04bee69f2bfe96cdc3616dabe0ab17899633ab5 2024-04-25T17:08:29.860 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stderr Copying config sha256:0de407c1b3afb7a571e0cc4b0c826a995ed358d49d5f013ca6bdfad025b55c43 2024-04-25T17:08:29.860 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/podman: stderr Writing manifest to image destination 2024-04-25T17:08:30.815 INFO:teuthology.orchestra.run.smithi037.stdout:ceph: stdout ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable) 2024-04-25T17:08:30.815 INFO:teuthology.orchestra.run.smithi037.stdout:Ceph version: ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable) 2024-04-25T17:08:30.815 INFO:teuthology.orchestra.run.smithi037.stdout:Extracting ceph user uid/gid from container image... 2024-04-25T17:08:31.663 INFO:teuthology.orchestra.run.smithi037.stdout:stat: stdout 167 167 2024-04-25T17:08:31.663 INFO:teuthology.orchestra.run.smithi037.stdout:Creating initial keys... 2024-04-25T17:08:32.844 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph-authtool: stdout AQAQjipmClbWARAAjflsmdyRegBeFOU/98vkIw== 2024-04-25T17:08:33.727 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph-authtool: stdout AQARjipmCbYaChAAiont1JJRpyk2OS4pgvoLpA== 2024-04-25T17:08:34.644 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph-authtool: stdout AQASjipmDdYpBBAA8xcK4x+62N/YYdqWtXFDPg== 2024-04-25T17:08:34.645 INFO:teuthology.orchestra.run.smithi037.stdout:Creating initial monmap... 2024-04-25T17:08:35.561 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-25T17:08:35.561 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = octopus 2024-04-25T17:08:35.561 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 599bb7fc-0326-11ef-bc93-c7b262605968 2024-04-25T17:08:35.562 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-25T17:08:35.562 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool for smithi037 [v2:172.21.15.37:3300,v1:172.21.15.37:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-04-25T17:08:35.562 INFO:teuthology.orchestra.run.smithi037.stdout:setting min_mon_release = octopus 2024-04-25T17:08:35.562 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/monmaptool: set fsid to 599bb7fc-0326-11ef-bc93-c7b262605968 2024-04-25T17:08:35.562 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-04-25T17:08:35.562 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:08:35.562 INFO:teuthology.orchestra.run.smithi037.stdout:Creating mon... 2024-04-25T17:08:36.508 INFO:teuthology.orchestra.run.smithi037.stdout:create mon.smithi037 on 2024-04-25T17:08:36.785 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-04-25T17:08:36.929 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-04-25T17:08:37.085 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-599bb7fc-0326-11ef-bc93-c7b262605968.target → /etc/systemd/system/ceph-599bb7fc-0326-11ef-bc93-c7b262605968.target. 2024-04-25T17:08:37.085 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-599bb7fc-0326-11ef-bc93-c7b262605968.target → /etc/systemd/system/ceph-599bb7fc-0326-11ef-bc93-c7b262605968.target. 2024-04-25T17:08:37.265 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-599bb7fc-0326-11ef-bc93-c7b262605968@mon.smithi037 2024-04-25T17:08:37.265 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Failed to reset failed state of unit ceph-599bb7fc-0326-11ef-bc93-c7b262605968@mon.smithi037.service: Unit ceph-599bb7fc-0326-11ef-bc93-c7b262605968@mon.smithi037.service not loaded. 2024-04-25T17:08:37.431 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-599bb7fc-0326-11ef-bc93-c7b262605968.target.wants/ceph-599bb7fc-0326-11ef-bc93-c7b262605968@mon.smithi037.service → /etc/systemd/system/ceph-599bb7fc-0326-11ef-bc93-c7b262605968@.service. 2024-04-25T17:08:37.750 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:37 smithi037 podman[26078]: 2024-04-25 17:08:37.585399452 +0000 UTC m=+0.018949377 image pull 0de407c1b3afb7a571e0cc4b0c826a995ed358d49d5f013ca6bdfad025b55c43 quay.ceph.io/ceph-ci/ceph:quincy 2024-04-25T17:08:37.972 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-25T17:08:37.972 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout disabled 2024-04-25T17:08:37.980 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-25T17:08:37.980 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout inactive 2024-04-25T17:08:37.980 INFO:teuthology.orchestra.run.smithi037.stdout:firewalld.service is not enabled 2024-04-25T17:08:37.980 INFO:teuthology.orchestra.run.smithi037.stdout:Not possible to enable service . firewalld.service is not available 2024-04-25T17:08:37.980 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for mon to start... 2024-04-25T17:08:37.981 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for mon... 2024-04-25T17:08:38.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:37 smithi037 podman[26078]: 2024-04-25 17:08:37.843414695 +0000 UTC m=+0.276964603 container init bea23a10a51ea2052b3e27ac7e9d9cd7fa6457f189d82bcffdfa1a0916605743 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-mon-smithi037, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=quincy-c61472c, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-04-25T17:08:38.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:37 smithi037 podman[26078]: 2024-04-25 17:08:37.846520906 +0000 UTC m=+0.280070812 container start bea23a10a51ea2052b3e27ac7e9d9cd7fa6457f189d82bcffdfa1a0916605743 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-mon-smithi037, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=quincy-c61472c, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-04-25T17:08:38.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:37 smithi037 ceph-mon[26097]: mkfs 599bb7fc-0326-11ef-bc93-c7b262605968 2024-04-25T17:08:38.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:37 smithi037 ceph-mon[26097]: mon.smithi037 is new leader, mons smithi037 in quorum (ranks 0) 2024-04-25T17:08:38.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:37 smithi037 bash[26078]: bea23a10a51ea2052b3e27ac7e9d9cd7fa6457f189d82bcffdfa1a0916605743 2024-04-25T17:08:38.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:37 smithi037 systemd[1]: Started Ceph mon.smithi037 for 599bb7fc-0326-11ef-bc93-c7b262605968. 2024-04-25T17:08:39.076 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout cluster: 2024-04-25T17:08:39.083 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout id: 599bb7fc-0326-11ef-bc93-c7b262605968 2024-04-25T17:08:39.083 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-04-25T17:08:39.083 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-04-25T17:08:39.083 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout services: 2024-04-25T17:08:39.083 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi037 (age 0.645423s) 2024-04-25T17:08:39.083 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-04-25T17:08:39.083 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-04-25T17:08:39.083 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-04-25T17:08:39.083 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout data: 2024-04-25T17:08:39.083 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-04-25T17:08:39.083 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-04-25T17:08:39.083 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-04-25T17:08:39.083 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout pgs: 2024-04-25T17:08:39.084 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-04-25T17:08:39.084 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:38.444+0000 7fac41c39700 1 Processor -- start 2024-04-25T17:08:39.084 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:38.444+0000 7fac41c39700 1 -- start start 2024-04-25T17:08:39.084 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:38.444+0000 7fac41c39700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac3c102880 0x7fac3c102c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:08:39.084 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:38.444+0000 7fac41c39700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac3c1031d0 con 0x7fac3c102880 2024-04-25T17:08:39.084 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:38.445+0000 7fac3b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac3c102880 0x7fac3c102c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:08:39.084 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:38.445+0000 7fac3b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac3c102880 0x7fac3c102c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59210/0 (socket says 172.21.15.37:59210) 2024-04-25T17:08:39.084 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:38.445+0000 7fac3b7fe700 1 -- 172.21.15.37:0/485550276 learned_addr learned my addr 172.21.15.37:0/485550276 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:08:39.084 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:38.445+0000 7fac3b7fe700 1 -- 172.21.15.37:0/485550276 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac3c103310 con 0x7fac3c102880 2024-04-25T17:08:39.084 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:38.445+0000 7fac3b7fe700 1 --2- 172.21.15.37:0/485550276 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac3c102880 0x7fac3c102c90 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fac2c0098e0 tx=0x7fac2c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f19166773bbfcd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:08:39.084 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:38.445+0000 7fac3a7fc700 1 -- 172.21.15.37:0/485550276 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fac2c00b860 con 0x7fac3c102880 2024-04-25T17:08:39.084 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:38.445+0000 7fac3a7fc700 1 -- 172.21.15.37:0/485550276 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac2c00b9c0 con 0x7fac3c102880 2024-04-25T17:08:39.084 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:38.445+0000 7fac3a7fc700 1 -- 172.21.15.37:0/485550276 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fac2c00bc90 con 0x7fac3c102880 2024-04-25T17:08:39.084 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:38.446+0000 7fac41c39700 1 -- 172.21.15.37:0/485550276 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac3c102880 msgr2=0x7fac3c102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:08:39.085 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:38.446+0000 7fac41c39700 1 --2- 172.21.15.37:0/485550276 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac3c102880 0x7fac3c102c90 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fac2c0098e0 tx=0x7fac2c009250 comp rx=0 tx=0).stop 2024-04-25T17:08:39.085 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:38.446+0000 7fac41c39700 1 -- 172.21.15.37:0/485550276 shutdown_connections 2024-04-25T17:08:39.085 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:38.446+0000 7fac41c39700 1 --2- 172.21.15.37:0/485550276 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac3c102880 0x7fac3c102c90 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:08:39.085 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:38.446+0000 7fac41c39700 1 -- 172.21.15.37:0/485550276 >> 172.21.15.37:0/485550276 conn(0x7fac3c0fe060 msgr2=0x7fac3c100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:08:39.085 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:38.446+0000 7fac41c39700 1 -- 172.21.15.37:0/485550276 shutdown_connections 2024-04-25T17:08:39.085 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:38.446+0000 7fac41c39700 1 -- 172.21.15.37:0/485550276 wait complete. 2024-04-25T17:08:39.085 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:38.447+0000 7fac41c39700 1 Processor -- start 2024-04-25T17:08:39.085 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:38.447+0000 7fac41c39700 1 -- start start 2024-04-25T17:08:39.085 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:38.447+0000 7fac41c39700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac3c102880 0x7fac3c110e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:08:39.085 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:38.447+0000 7fac41c39700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac3c1113a0 con 0x7fac3c102880 2024-04-25T17:08:39.085 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:38.447+0000 7fac3b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac3c102880 0x7fac3c110e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:08:39.085 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:38.447+0000 7fac3b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac3c102880 0x7fac3c110e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59214/0 (socket says 172.21.15.37:59214) 2024-04-25T17:08:39.085 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:38.447+0000 7fac3b7fe700 1 -- 172.21.15.37:0/4114574636 learned_addr learned my addr 172.21.15.37:0/4114574636 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:08:39.085 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:38.447+0000 7fac3b7fe700 1 -- 172.21.15.37:0/4114574636 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac2c0094f0 con 0x7fac3c102880 2024-04-25T17:08:39.086 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:38.447+0000 7fac3b7fe700 1 --2- 172.21.15.37:0/4114574636 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac3c102880 0x7fac3c110e60 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fac2c003080 tx=0x7fac2c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:08:39.086 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:38.448+0000 7fac23fff700 1 -- 172.21.15.37:0/4114574636 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fac2c01c5c0 con 0x7fac3c102880 2024-04-25T17:08:39.086 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:38.448+0000 7fac23fff700 1 -- 172.21.15.37:0/4114574636 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac2c01c720 con 0x7fac3c102880 2024-04-25T17:08:39.086 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:38.448+0000 7fac41c39700 1 -- 172.21.15.37:0/4114574636 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac3c1115a0 con 0x7fac3c102880 2024-04-25T17:08:39.086 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:38.448+0000 7fac23fff700 1 -- 172.21.15.37:0/4114574636 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fac2c01ca30 con 0x7fac3c102880 2024-04-25T17:08:39.086 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:38.448+0000 7fac41c39700 1 -- 172.21.15.37:0/4114574636 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac3c111fd0 con 0x7fac3c102880 2024-04-25T17:08:39.086 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:38.448+0000 7fac23fff700 1 -- 172.21.15.37:0/4114574636 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fac2c01cc60 con 0x7fac3c102880 2024-04-25T17:08:39.086 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:38.448+0000 7fac23fff700 1 -- 172.21.15.37:0/4114574636 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fac2c01ac80 con 0x7fac3c102880 2024-04-25T17:08:39.086 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:38.449+0000 7fac41c39700 1 -- 172.21.15.37:0/4114574636 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac3c05f5c0 con 0x7fac3c102880 2024-04-25T17:08:39.086 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:38.451+0000 7fac23fff700 1 -- 172.21.15.37:0/4114574636 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7fac2c01ae40 con 0x7fac3c102880 2024-04-25T17:08:39.086 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:38.526+0000 7fac41c39700 1 -- 172.21.15.37:0/4114574636 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7fac3c112b60 con 0x7fac3c102880 2024-04-25T17:08:39.086 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:38.526+0000 7fac23fff700 1 -- 172.21.15.37:0/4114574636 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7fac2c01a450 con 0x7fac3c102880 2024-04-25T17:08:39.086 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:38.527+0000 7fac41c39700 1 -- 172.21.15.37:0/4114574636 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac3c102880 msgr2=0x7fac3c110e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:08:39.087 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:38.527+0000 7fac41c39700 1 --2- 172.21.15.37:0/4114574636 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac3c102880 0x7fac3c110e60 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fac2c003080 tx=0x7fac2c016000 comp rx=0 tx=0).stop 2024-04-25T17:08:39.087 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:38.527+0000 7fac41c39700 1 -- 172.21.15.37:0/4114574636 shutdown_connections 2024-04-25T17:08:39.087 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:38.527+0000 7fac41c39700 1 --2- 172.21.15.37:0/4114574636 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac3c102880 0x7fac3c110e60 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:08:39.087 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:38.527+0000 7fac41c39700 1 -- 172.21.15.37:0/4114574636 >> 172.21.15.37:0/4114574636 conn(0x7fac3c0fe060 msgr2=0x7fac3c105250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:08:39.087 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:38.527+0000 7fac41c39700 1 -- 172.21.15.37:0/4114574636 shutdown_connections 2024-04-25T17:08:39.087 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:38.527+0000 7fac41c39700 1 -- 172.21.15.37:0/4114574636 wait complete. 2024-04-25T17:08:39.087 INFO:teuthology.orchestra.run.smithi037.stdout:mon is available 2024-04-25T17:08:39.087 INFO:teuthology.orchestra.run.smithi037.stdout:Assimilating anything we can from ceph.conf... 2024-04-25T17:08:39.191 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:38 smithi037 ceph-mon[26097]: mon.smithi037 is new leader, mons smithi037 in quorum (ranks 0) 2024-04-25T17:08:39.191 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:38 smithi037 ceph-mon[26097]: monmap e1: 1 mons at {smithi037=[v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-25T17:08:39.191 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:38 smithi037 ceph-mon[26097]: fsmap 2024-04-25T17:08:39.191 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:38 smithi037 ceph-mon[26097]: osdmap e1: 0 total, 0 up, 0 in 2024-04-25T17:08:39.191 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:38 smithi037 ceph-mon[26097]: mgrmap e1: no daemons active 2024-04-25T17:08:39.191 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:38 smithi037 ceph-mon[26097]: from='client.? 172.21.15.37:0/4114574636' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-04-25T17:08:40.154 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:39 smithi037 ceph-mon[26097]: from='client.? 172.21.15.37:0/4260750355' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-25T17:08:40.155 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:39 smithi037 ceph-mon[26097]: from='client.? 172.21.15.37:0/4260750355' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-04-25T17:08:40.163 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-04-25T17:08:40.164 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout [global] 2024-04-25T17:08:40.164 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout fsid = 599bb7fc-0326-11ef-bc93-c7b262605968 2024-04-25T17:08:40.164 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.37:3300,v1:172.21.15.37:6789] 2024-04-25T17:08:40.164 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-25T17:08:40.164 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-25T17:08:40.164 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-25T17:08:40.164 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-25T17:08:40.164 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-04-25T17:08:40.164 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-25T17:08:40.164 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-25T17:08:40.164 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-04-25T17:08:40.164 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout [osd] 2024-04-25T17:08:40.164 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-04-25T17:08:40.164 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-04-25T17:08:40.164 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-04-25T17:08:40.165 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-25T17:08:40.165 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-25T17:08:40.165 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:39.504+0000 7f54286f5700 1 Processor -- start 2024-04-25T17:08:40.165 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:39.504+0000 7f54286f5700 1 -- start start 2024-04-25T17:08:40.165 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:39.504+0000 7f54286f5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5420076c50 0x7f5420105400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:08:40.165 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:39.504+0000 7f54286f5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5420105940 con 0x7f5420076c50 2024-04-25T17:08:40.165 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:39.505+0000 7f5426491700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5420076c50 0x7f5420105400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:08:40.165 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:39.505+0000 7f5426491700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5420076c50 0x7f5420105400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59226/0 (socket says 172.21.15.37:59226) 2024-04-25T17:08:40.165 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:39.505+0000 7f5426491700 1 -- 172.21.15.37:0/2203265020 learned_addr learned my addr 172.21.15.37:0/2203265020 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:08:40.165 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:39.505+0000 7f5426491700 1 -- 172.21.15.37:0/2203265020 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5420105a80 con 0x7f5420076c50 2024-04-25T17:08:40.165 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:39.505+0000 7f5426491700 1 --2- 172.21.15.37:0/2203265020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5420076c50 0x7f5420105400 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f541c009e50 tx=0x7f541c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4efa30ccdb84414 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:08:40.165 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:39.505+0000 7f542548f700 1 -- 172.21.15.37:0/2203265020 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f541c0092e0 con 0x7f5420076c50 2024-04-25T17:08:40.165 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:39.505+0000 7f542548f700 1 -- 172.21.15.37:0/2203265020 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f541c00ba20 con 0x7f5420076c50 2024-04-25T17:08:40.165 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:39.505+0000 7f542548f700 1 -- 172.21.15.37:0/2203265020 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f541c00bd30 con 0x7f5420076c50 2024-04-25T17:08:40.165 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:39.506+0000 7f54286f5700 1 -- 172.21.15.37:0/2203265020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5420076c50 msgr2=0x7f5420105400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:08:40.165 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:39.506+0000 7f54286f5700 1 --2- 172.21.15.37:0/2203265020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5420076c50 0x7f5420105400 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f541c009e50 tx=0x7f541c009840 comp rx=0 tx=0).stop 2024-04-25T17:08:40.166 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:39.506+0000 7f54286f5700 1 -- 172.21.15.37:0/2203265020 shutdown_connections 2024-04-25T17:08:40.166 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:39.506+0000 7f54286f5700 1 --2- 172.21.15.37:0/2203265020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5420076c50 0x7f5420105400 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:08:40.166 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:39.506+0000 7f54286f5700 1 -- 172.21.15.37:0/2203265020 >> 172.21.15.37:0/2203265020 conn(0x7f54200fcef0 msgr2=0x7f54200ff300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:08:40.166 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:39.506+0000 7f54286f5700 1 -- 172.21.15.37:0/2203265020 shutdown_connections 2024-04-25T17:08:40.166 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:39.506+0000 7f54286f5700 1 -- 172.21.15.37:0/2203265020 wait complete. 2024-04-25T17:08:40.166 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:39.507+0000 7f54286f5700 1 Processor -- start 2024-04-25T17:08:40.166 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:39.507+0000 7f54286f5700 1 -- start start 2024-04-25T17:08:40.166 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:39.507+0000 7f54286f5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5420076c50 0x7f5420110f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:08:40.166 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:39.507+0000 7f54286f5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5420111460 con 0x7f5420076c50 2024-04-25T17:08:40.166 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:39.507+0000 7f5426491700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5420076c50 0x7f5420110f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:08:40.166 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:39.507+0000 7f5426491700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5420076c50 0x7f5420110f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59236/0 (socket says 172.21.15.37:59236) 2024-04-25T17:08:40.166 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:39.507+0000 7f5426491700 1 -- 172.21.15.37:0/4260750355 learned_addr learned my addr 172.21.15.37:0/4260750355 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:08:40.166 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:39.507+0000 7f5426491700 1 -- 172.21.15.37:0/4260750355 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f541c009ae0 con 0x7f5420076c50 2024-04-25T17:08:40.166 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:39.507+0000 7f5426491700 1 --2- 172.21.15.37:0/4260750355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5420076c50 0x7f5420110f20 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f541c003000 tx=0x7f541c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:08:40.167 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:39.507+0000 7f5416ffd700 1 -- 172.21.15.37:0/4260750355 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f541c012b90 con 0x7f5420076c50 2024-04-25T17:08:40.167 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:39.507+0000 7f5416ffd700 1 -- 172.21.15.37:0/4260750355 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f541c012d10 con 0x7f5420076c50 2024-04-25T17:08:40.167 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:39.507+0000 7f54286f5700 1 -- 172.21.15.37:0/4260750355 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5420111660 con 0x7f5420076c50 2024-04-25T17:08:40.167 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:39.508+0000 7f5416ffd700 1 -- 172.21.15.37:0/4260750355 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f541c01e400 con 0x7f5420076c50 2024-04-25T17:08:40.167 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:39.508+0000 7f54286f5700 1 -- 172.21.15.37:0/4260750355 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5420112090 con 0x7f5420076c50 2024-04-25T17:08:40.167 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:39.508+0000 7f5416ffd700 1 -- 172.21.15.37:0/4260750355 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f541c019030 con 0x7f5420076c50 2024-04-25T17:08:40.167 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:39.508+0000 7f5416ffd700 1 -- 172.21.15.37:0/4260750355 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f541c0265f0 con 0x7f5420076c50 2024-04-25T17:08:40.167 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:39.509+0000 7f54286f5700 1 -- 172.21.15.37:0/4260750355 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f542004bed0 con 0x7f5420076c50 2024-04-25T17:08:40.167 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:39.511+0000 7f5416ffd700 1 -- 172.21.15.37:0/4260750355 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7f541c017070 con 0x7f5420076c50 2024-04-25T17:08:40.167 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:39.580+0000 7f54286f5700 1 -- 172.21.15.37:0/4260750355 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f5420105d90 con 0x7f5420076c50 2024-04-25T17:08:40.167 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:39.584+0000 7f5416ffd700 1 -- 172.21.15.37:0/4260750355 <== mon.0 v2:172.21.15.37:3300/0 7 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f541c01ecf0 con 0x7f5420076c50 2024-04-25T17:08:40.167 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:39.584+0000 7f5416ffd700 1 -- 172.21.15.37:0/4260750355 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+429 (secure 0 0 0) 0x7f541c036400 con 0x7f5420076c50 2024-04-25T17:08:40.167 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:39.585+0000 7f54286f5700 1 -- 172.21.15.37:0/4260750355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5420076c50 msgr2=0x7f5420110f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:08:40.167 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:39.585+0000 7f54286f5700 1 --2- 172.21.15.37:0/4260750355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5420076c50 0x7f5420110f20 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f541c003000 tx=0x7f541c017000 comp rx=0 tx=0).stop 2024-04-25T17:08:40.167 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:39.585+0000 7f54286f5700 1 -- 172.21.15.37:0/4260750355 shutdown_connections 2024-04-25T17:08:40.168 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:39.585+0000 7f54286f5700 1 --2- 172.21.15.37:0/4260750355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5420076c50 0x7f5420110f20 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:08:40.168 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:39.585+0000 7f54286f5700 1 -- 172.21.15.37:0/4260750355 >> 172.21.15.37:0/4260750355 conn(0x7f54200fcef0 msgr2=0x7f54200ff280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:08:40.168 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:39.585+0000 7f54286f5700 1 -- 172.21.15.37:0/4260750355 shutdown_connections 2024-04-25T17:08:40.168 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:39.585+0000 7f54286f5700 1 -- 172.21.15.37:0/4260750355 wait complete. 2024-04-25T17:08:40.168 INFO:teuthology.orchestra.run.smithi037.stdout:Generating new minimal ceph.conf... 2024-04-25T17:08:41.222 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:40 smithi037 ceph-mon[26097]: from='client.? 172.21.15.37:0/1850241410' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:08:41.229 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:40.604+0000 7fd6645c0700 1 Processor -- start 2024-04-25T17:08:41.229 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:40.604+0000 7fd6645c0700 1 -- start start 2024-04-25T17:08:41.229 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:40.604+0000 7fd6645c0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd65c102880 0x7fd65c102c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:08:41.230 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:40.604+0000 7fd6645c0700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd65c1031d0 con 0x7fd65c102880 2024-04-25T17:08:41.230 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:40.604+0000 7fd66235c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd65c102880 0x7fd65c102c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:08:41.230 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:40.604+0000 7fd66235c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd65c102880 0x7fd65c102c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59240/0 (socket says 172.21.15.37:59240) 2024-04-25T17:08:41.230 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:40.604+0000 7fd66235c700 1 -- 172.21.15.37:0/1349139284 learned_addr learned my addr 172.21.15.37:0/1349139284 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:08:41.230 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:40.604+0000 7fd66235c700 1 -- 172.21.15.37:0/1349139284 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd65c103310 con 0x7fd65c102880 2024-04-25T17:08:41.230 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:40.605+0000 7fd66235c700 1 --2- 172.21.15.37:0/1349139284 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd65c102880 0x7fd65c102c90 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fd6580098e0 tx=0x7fd658009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=853b5f776505d19a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:08:41.230 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:40.605+0000 7fd66135a700 1 -- 172.21.15.37:0/1349139284 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd65800b860 con 0x7fd65c102880 2024-04-25T17:08:41.230 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:40.605+0000 7fd66135a700 1 -- 172.21.15.37:0/1349139284 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fd65800be50 con 0x7fd65c102880 2024-04-25T17:08:41.230 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:40.605+0000 7fd66135a700 1 -- 172.21.15.37:0/1349139284 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd658010380 con 0x7fd65c102880 2024-04-25T17:08:41.230 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:40.605+0000 7fd6645c0700 1 -- 172.21.15.37:0/1349139284 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd65c102880 msgr2=0x7fd65c102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:08:41.230 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:40.605+0000 7fd6645c0700 1 --2- 172.21.15.37:0/1349139284 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd65c102880 0x7fd65c102c90 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fd6580098e0 tx=0x7fd658009250 comp rx=0 tx=0).stop 2024-04-25T17:08:41.230 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:40.605+0000 7fd6645c0700 1 -- 172.21.15.37:0/1349139284 shutdown_connections 2024-04-25T17:08:41.230 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:40.605+0000 7fd6645c0700 1 --2- 172.21.15.37:0/1349139284 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd65c102880 0x7fd65c102c90 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:08:41.230 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:40.605+0000 7fd6645c0700 1 -- 172.21.15.37:0/1349139284 >> 172.21.15.37:0/1349139284 conn(0x7fd65c0fe060 msgr2=0x7fd65c100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:08:41.230 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:40.606+0000 7fd6645c0700 1 -- 172.21.15.37:0/1349139284 shutdown_connections 2024-04-25T17:08:41.231 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:40.606+0000 7fd6645c0700 1 -- 172.21.15.37:0/1349139284 wait complete. 2024-04-25T17:08:41.231 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:40.606+0000 7fd6645c0700 1 Processor -- start 2024-04-25T17:08:41.231 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:40.606+0000 7fd6645c0700 1 -- start start 2024-04-25T17:08:41.231 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:40.606+0000 7fd6645c0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd65c102880 0x7fd65c078c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:08:41.231 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:40.606+0000 7fd6645c0700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd65c079160 con 0x7fd65c102880 2024-04-25T17:08:41.231 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:40.606+0000 7fd66235c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd65c102880 0x7fd65c078c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:08:41.231 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:40.606+0000 7fd66235c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd65c102880 0x7fd65c078c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59246/0 (socket says 172.21.15.37:59246) 2024-04-25T17:08:41.231 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:40.606+0000 7fd66235c700 1 -- 172.21.15.37:0/1850241410 learned_addr learned my addr 172.21.15.37:0/1850241410 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:08:41.231 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:40.607+0000 7fd66235c700 1 -- 172.21.15.37:0/1850241410 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6580094f0 con 0x7fd65c102880 2024-04-25T17:08:41.231 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:40.607+0000 7fd66235c700 1 --2- 172.21.15.37:0/1850241410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd65c102880 0x7fd65c078c20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd658000c00 tx=0x7fd658009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:08:41.231 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:40.607+0000 7fd652ffd700 1 -- 172.21.15.37:0/1850241410 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd6580107c0 con 0x7fd65c102880 2024-04-25T17:08:41.231 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:40.607+0000 7fd652ffd700 1 -- 172.21.15.37:0/1850241410 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fd658010db0 con 0x7fd65c102880 2024-04-25T17:08:41.231 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:40.607+0000 7fd6645c0700 1 -- 172.21.15.37:0/1850241410 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd65c0771d0 con 0x7fd65c102880 2024-04-25T17:08:41.231 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:40.607+0000 7fd652ffd700 1 -- 172.21.15.37:0/1850241410 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd65801ad00 con 0x7fd65c102880 2024-04-25T17:08:41.231 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:40.607+0000 7fd6645c0700 1 -- 172.21.15.37:0/1850241410 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd65c0776c0 con 0x7fd65c102880 2024-04-25T17:08:41.231 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:40.607+0000 7fd652ffd700 1 -- 172.21.15.37:0/1850241410 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fd658024440 con 0x7fd65c102880 2024-04-25T17:08:41.232 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:40.607+0000 7fd652ffd700 1 -- 172.21.15.37:0/1850241410 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fd658019710 con 0x7fd65c102880 2024-04-25T17:08:41.232 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:40.608+0000 7fd6645c0700 1 -- 172.21.15.37:0/1850241410 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd65c04bed0 con 0x7fd65c102880 2024-04-25T17:08:41.232 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:40.610+0000 7fd652ffd700 1 -- 172.21.15.37:0/1850241410 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7fd65801a530 con 0x7fd65c102880 2024-04-25T17:08:41.232 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:40.680+0000 7fd6645c0700 1 -- 172.21.15.37:0/1850241410 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fd65c077900 con 0x7fd65c102880 2024-04-25T17:08:41.232 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:40.680+0000 7fd652ffd700 1 -- 172.21.15.37:0/1850241410 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7fd658010920 con 0x7fd65c102880 2024-04-25T17:08:41.232 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:40.681+0000 7fd6645c0700 1 -- 172.21.15.37:0/1850241410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd65c102880 msgr2=0x7fd65c078c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:08:41.232 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:40.681+0000 7fd6645c0700 1 --2- 172.21.15.37:0/1850241410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd65c102880 0x7fd65c078c20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd658000c00 tx=0x7fd658009250 comp rx=0 tx=0).stop 2024-04-25T17:08:41.232 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:40.681+0000 7fd6645c0700 1 -- 172.21.15.37:0/1850241410 shutdown_connections 2024-04-25T17:08:41.232 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:40.681+0000 7fd6645c0700 1 --2- 172.21.15.37:0/1850241410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd65c102880 0x7fd65c078c20 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:08:41.232 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:40.681+0000 7fd6645c0700 1 -- 172.21.15.37:0/1850241410 >> 172.21.15.37:0/1850241410 conn(0x7fd65c0fe060 msgr2=0x7fd65c0feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:08:41.232 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:40.681+0000 7fd6645c0700 1 -- 172.21.15.37:0/1850241410 shutdown_connections 2024-04-25T17:08:41.232 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:40.681+0000 7fd6645c0700 1 -- 172.21.15.37:0/1850241410 wait complete. 2024-04-25T17:08:41.232 INFO:teuthology.orchestra.run.smithi037.stdout:Restarting the monitor... 2024-04-25T17:08:41.489 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:41 smithi037 systemd[1]: Stopping Ceph mon.smithi037 for 599bb7fc-0326-11ef-bc93-c7b262605968... 2024-04-25T17:08:41.745 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:41 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-mon-smithi037[26093]: 2024-04-25T17:08:41.500+0000 7fd25d354700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi037 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T17:08:41.745 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:41 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-mon-smithi037[26093]: 2024-04-25T17:08:41.500+0000 7fd25d354700 -1 mon.smithi037@0(leader) e1 *** Got Signal Terminated *** 2024-04-25T17:08:42.066 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:41 smithi037 podman[26342]: 2024-04-25 17:08:41.746732511 +0000 UTC m=+0.346541836 container died bea23a10a51ea2052b3e27ac7e9d9cd7fa6457f189d82bcffdfa1a0916605743 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-mon-smithi037, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=quincy-c61472c, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-04-25T17:08:42.066 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 podman[26342]: 2024-04-25 17:08:42.067402862 +0000 UTC m=+0.667212179 container cleanup bea23a10a51ea2052b3e27ac7e9d9cd7fa6457f189d82bcffdfa1a0916605743 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-mon-smithi037, RELEASE=quincy-c61472c, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-04-25T17:08:42.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 bash[26342]: ceph-599bb7fc-0326-11ef-bc93-c7b262605968-mon-smithi037 2024-04-25T17:08:42.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 podman[26356]: 2024-04-25 17:08:42.276547385 +0000 UTC m=+0.525937575 container remove bea23a10a51ea2052b3e27ac7e9d9cd7fa6457f189d82bcffdfa1a0916605743 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-mon-smithi037, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=quincy-c61472c, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-04-25T17:08:42.820 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 systemd[1]: ceph-599bb7fc-0326-11ef-bc93-c7b262605968@mon.smithi037.service: Deactivated successfully. 2024-04-25T17:08:42.820 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 systemd[1]: Stopped Ceph mon.smithi037 for 599bb7fc-0326-11ef-bc93-c7b262605968. 2024-04-25T17:08:42.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 systemd[1]: Starting Ceph mon.smithi037 for 599bb7fc-0326-11ef-bc93-c7b262605968... 2024-04-25T17:08:42.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 podman[26452]: 2024-04-25 17:08:42.719008243 +0000 UTC m=+0.115112718 container create 5cfadcf8f2e4441b97211566dfaebb19e2bd618f5b66cc2c3fa42383c3ba94f2 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-mon-smithi037, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=quincy-c61472c, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=) 2024-04-25T17:08:42.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 podman[26452]: 2024-04-25 17:08:42.62230282 +0000 UTC m=+0.018407309 image pull 0de407c1b3afb7a571e0cc4b0c826a995ed358d49d5f013ca6bdfad025b55c43 quay.ceph.io/ceph-ci/ceph:quincy 2024-04-25T17:08:43.019 INFO:teuthology.orchestra.run.smithi037.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-04-25T17:08:43.132 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 podman[26452]: 2024-04-25 17:08:42.949002386 +0000 UTC m=+0.345106863 container init 5cfadcf8f2e4441b97211566dfaebb19e2bd618f5b66cc2c3fa42383c3ba94f2 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-mon-smithi037, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-c61472c, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T17:08:43.132 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 podman[26452]: 2024-04-25 17:08:42.951949676 +0000 UTC m=+0.348054144 container start 5cfadcf8f2e4441b97211566dfaebb19e2bd618f5b66cc2c3fa42383c3ba94f2 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-mon-smithi037, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=quincy-c61472c, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T17:08:43.132 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: set uid:gid to 167:167 (ceph:ceph) 2024-04-25T17:08:43.133 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable), process ceph-mon, pid 2 2024-04-25T17:08:43.133 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: pidfile_write: ignore empty --pid-file 2024-04-25T17:08:43.133 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: load: jerasure load: lrc 2024-04-25T17:08:43.133 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: RocksDB version: 6.15.5 2024-04-25T17:08:43.133 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-04-25T17:08:43.133 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Compile date Apr 24 2024 2024-04-25T17:08:43.133 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: DB SUMMARY 2024-04-25T17:08:43.133 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: DB Session ID: F2IXJ2E9KLL3789T91KF 2024-04-25T17:08:43.133 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: CURRENT file: CURRENT 2024-04-25T17:08:43.133 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: IDENTITY file: IDENTITY 2024-04-25T17:08:43.133 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: MANIFEST file: MANIFEST-000009 size: 131 Bytes 2024-04-25T17:08:43.133 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi037/store.db dir, Total Num: 1, files: 000008.sst 2024-04-25T17:08:43.133 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi037/store.db: 000010.log size: 98164 ; 2024-04-25T17:08:43.133 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.error_if_exists: 0 2024-04-25T17:08:43.133 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.create_if_missing: 0 2024-04-25T17:08:43.134 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.paranoid_checks: 1 2024-04-25T17:08:43.134 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-25T17:08:43.134 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.env: 0x56098c23eb00 2024-04-25T17:08:43.134 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.fs: Posix File System 2024-04-25T17:08:43.134 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.info_log: 0x56098cf27620 2024-04-25T17:08:43.134 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.max_file_opening_threads: 16 2024-04-25T17:08:43.134 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.statistics: (nil) 2024-04-25T17:08:43.134 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.use_fsync: 0 2024-04-25T17:08:43.134 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.max_log_file_size: 0 2024-04-25T17:08:43.135 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-25T17:08:43.135 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-25T17:08:43.136 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.keep_log_file_num: 1000 2024-04-25T17:08:43.136 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.recycle_log_file_num: 0 2024-04-25T17:08:43.136 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.allow_fallocate: 1 2024-04-25T17:08:43.136 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.allow_mmap_reads: 0 2024-04-25T17:08:43.136 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.allow_mmap_writes: 0 2024-04-25T17:08:43.136 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.use_direct_reads: 0 2024-04-25T17:08:43.136 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-25T17:08:43.136 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.create_missing_column_families: 0 2024-04-25T17:08:43.136 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.db_log_dir: 2024-04-25T17:08:43.136 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi037/store.db 2024-04-25T17:08:43.136 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-25T17:08:43.136 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-25T17:08:43.136 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-25T17:08:43.136 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-25T17:08:43.137 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-25T17:08:43.137 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-25T17:08:43.137 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.advise_random_on_open: 1 2024-04-25T17:08:43.137 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.db_write_buffer_size: 0 2024-04-25T17:08:43.137 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.write_buffer_manager: 0x56098dc1aa20 2024-04-25T17:08:43.137 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-25T17:08:43.137 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-04-25T17:08:43.137 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-25T17:08:43.137 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-25T17:08:43.137 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.rate_limiter: (nil) 2024-04-25T17:08:43.137 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-25T17:08:43.137 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.wal_recovery_mode: 2 2024-04-25T17:08:43.137 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.enable_thread_tracking: 0 2024-04-25T17:08:43.137 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.enable_pipelined_write: 0 2024-04-25T17:08:43.137 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.unordered_write: 0 2024-04-25T17:08:43.138 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-25T17:08:43.138 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-25T17:08:43.138 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-25T17:08:43.138 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-25T17:08:43.138 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.row_cache: None 2024-04-25T17:08:43.138 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.wal_filter: None 2024-04-25T17:08:43.138 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-25T17:08:43.138 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.allow_ingest_behind: 0 2024-04-25T17:08:43.138 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.preserve_deletes: 0 2024-04-25T17:08:43.138 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.two_write_queues: 0 2024-04-25T17:08:43.138 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.manual_wal_flush: 0 2024-04-25T17:08:43.138 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.atomic_flush: 0 2024-04-25T17:08:43.138 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-25T17:08:43.138 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-25T17:08:43.138 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-25T17:08:43.139 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.log_readahead_size: 0 2024-04-25T17:08:43.139 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-25T17:08:43.139 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.best_efforts_recovery: 0 2024-04-25T17:08:43.139 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-25T17:08:43.139 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-25T17:08:43.139 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.allow_data_in_errors: 0 2024-04-25T17:08:43.139 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.db_host_id: __hostname__ 2024-04-25T17:08:43.139 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.max_background_jobs: 2 2024-04-25T17:08:43.139 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.max_background_compactions: -1 2024-04-25T17:08:43.139 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.max_subcompactions: 1 2024-04-25T17:08:43.139 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-25T17:08:43.139 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-25T17:08:43.139 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-25T17:08:43.139 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.max_total_wal_size: 0 2024-04-25T17:08:43.139 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-25T17:08:43.139 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-25T17:08:43.140 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-25T17:08:43.140 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-25T17:08:43.140 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.max_open_files: -1 2024-04-25T17:08:43.140 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.bytes_per_sync: 0 2024-04-25T17:08:43.140 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-25T17:08:43.140 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-25T17:08:43.140 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.compaction_readahead_size: 0 2024-04-25T17:08:43.140 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.max_background_flushes: -1 2024-04-25T17:08:43.140 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Compression algorithms supported: 2024-04-25T17:08:43.140 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-25T17:08:43.140 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: kZSTD supported: 0 2024-04-25T17:08:43.140 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: kXpressCompression supported: 0 2024-04-25T17:08:43.140 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: kLZ4HCCompression supported: 1 2024-04-25T17:08:43.140 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: kZlibCompression supported: 1 2024-04-25T17:08:43.140 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: kSnappyCompression supported: 1 2024-04-25T17:08:43.140 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: kLZ4Compression supported: 1 2024-04-25T17:08:43.141 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: kBZip2Compression supported: 0 2024-04-25T17:08:43.141 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-25T17:08:43.141 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi037/store.db/MANIFEST-000009 2024-04-25T17:08:43.141 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2024-04-25T17:08:43.141 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-25T17:08:43.141 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.merge_operator: 2024-04-25T17:08:43.141 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.compaction_filter: None 2024-04-25T17:08:43.141 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.compaction_filter_factory: None 2024-04-25T17:08:43.141 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.sst_partitioner_factory: None 2024-04-25T17:08:43.141 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-25T17:08:43.141 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-25T17:08:43.141 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56098cefaf58) 2024-04-25T17:08:43.141 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: cache_index_and_filter_blocks: 1 2024-04-25T17:08:43.141 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-25T17:08:43.141 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-25T17:08:43.142 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: pin_top_level_index_and_filter: 1 2024-04-25T17:08:43.142 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: index_type: 0 2024-04-25T17:08:43.142 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: data_block_index_type: 0 2024-04-25T17:08:43.142 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: index_shortening: 1 2024-04-25T17:08:43.142 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-25T17:08:43.142 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: hash_index_allow_collision: 1 2024-04-25T17:08:43.142 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: checksum: 1 2024-04-25T17:08:43.142 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: no_block_cache: 0 2024-04-25T17:08:43.142 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: block_cache: 0x56098cf2d090 2024-04-25T17:08:43.142 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: block_cache_name: BinnedLRUCache 2024-04-25T17:08:43.142 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: block_cache_options: 2024-04-25T17:08:43.142 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: capacity : 536870912 2024-04-25T17:08:43.142 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: num_shard_bits : 4 2024-04-25T17:08:43.142 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: strict_capacity_limit : 0 2024-04-25T17:08:43.143 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: high_pri_pool_ratio: 0.000 2024-04-25T17:08:43.143 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: block_cache_compressed: (nil) 2024-04-25T17:08:43.143 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: persistent_cache: (nil) 2024-04-25T17:08:43.143 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: block_size: 4096 2024-04-25T17:08:43.143 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: block_size_deviation: 10 2024-04-25T17:08:43.143 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: block_restart_interval: 16 2024-04-25T17:08:43.143 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: index_block_restart_interval: 1 2024-04-25T17:08:43.143 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: metadata_block_size: 4096 2024-04-25T17:08:43.143 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: partition_filters: 0 2024-04-25T17:08:43.143 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: use_delta_encoding: 1 2024-04-25T17:08:43.143 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-04-25T17:08:43.143 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: whole_key_filtering: 1 2024-04-25T17:08:43.143 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: verify_compression: 0 2024-04-25T17:08:43.143 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: read_amp_bytes_per_bit: 0 2024-04-25T17:08:43.143 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: format_version: 4 2024-04-25T17:08:43.143 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: enable_index_compression: 1 2024-04-25T17:08:43.144 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: block_align: 0 2024-04-25T17:08:43.144 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.write_buffer_size: 33554432 2024-04-25T17:08:43.144 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.max_write_buffer_number: 2 2024-04-25T17:08:43.144 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.compression: NoCompression 2024-04-25T17:08:43.144 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.bottommost_compression: Disabled 2024-04-25T17:08:43.144 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.prefix_extractor: nullptr 2024-04-25T17:08:43.144 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-25T17:08:43.144 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.num_levels: 7 2024-04-25T17:08:43.144 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-25T17:08:43.144 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-25T17:08:43.144 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-25T17:08:43.144 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-25T17:08:43.144 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-25T17:08:43.144 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-25T17:08:43.144 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-25T17:08:43.144 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-25T17:08:43.145 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-25T17:08:43.145 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-25T17:08:43.145 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-25T17:08:43.145 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.compression_opts.level: 32767 2024-04-25T17:08:43.145 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.compression_opts.strategy: 0 2024-04-25T17:08:43.145 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-25T17:08:43.145 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-25T17:08:43.145 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-25T17:08:43.145 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.compression_opts.enabled: false 2024-04-25T17:08:43.145 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-25T17:08:43.145 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-25T17:08:43.145 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-25T17:08:43.145 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.target_file_size_base: 67108864 2024-04-25T17:08:43.145 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-25T17:08:43.145 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-25T17:08:43.145 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-25T17:08:43.146 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-25T17:08:43.146 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-25T17:08:43.146 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-25T17:08:43.146 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-25T17:08:43.146 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-25T17:08:43.146 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-25T17:08:43.146 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-25T17:08:43.146 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-25T17:08:43.146 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-25T17:08:43.146 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-25T17:08:43.146 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.arena_block_size: 4194304 2024-04-25T17:08:43.146 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-25T17:08:43.146 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-25T17:08:43.146 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-04-25T17:08:43.146 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.disable_auto_compactions: 0 2024-04-25T17:08:43.147 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-25T17:08:43.147 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-25T17:08:43.147 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-25T17:08:43.147 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-25T17:08:43.147 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-25T17:08:43.147 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-25T17:08:43.147 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-25T17:08:43.147 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-25T17:08:43.147 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-25T17:08:43.147 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-25T17:08:43.147 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.table_properties_collectors: 2024-04-25T17:08:43.147 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.inplace_update_support: 0 2024-04-25T17:08:43.147 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-25T17:08:43.147 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-25T17:08:43.147 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-25T17:08:43.147 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-25T17:08:43.148 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.bloom_locality: 0 2024-04-25T17:08:43.148 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.max_successive_merges: 0 2024-04-25T17:08:43.148 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-25T17:08:43.148 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.paranoid_file_checks: 0 2024-04-25T17:08:43.148 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.force_consistency_checks: 1 2024-04-25T17:08:43.148 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.report_bg_io_stats: 0 2024-04-25T17:08:43.148 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.ttl: 2592000 2024-04-25T17:08:43.148 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-25T17:08:43.148 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.enable_blob_files: false 2024-04-25T17:08:43.148 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.min_blob_size: 0 2024-04-25T17:08:43.148 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.blob_file_size: 268435456 2024-04-25T17:08:43.148 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-25T17:08:43.148 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-25T17:08:43.148 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-25T17:08:43.148 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi037/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 11, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-25T17:08:43.149 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 5 2024-04-25T17:08:43.149 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: [db/version_set.cc:4082] Creating manifest 13 2024-04-25T17:08:43.149 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714064922978640, "job": 1, "event": "recovery_started", "wal_files": [10]} 2024-04-25T17:08:43.149 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #10 mode 2 2024-04-25T17:08:43.149 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-04-25T17:08:43.149 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714064922979598, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 93370, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 91482, "index_size": 248, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13576, "raw_average_key_size": 49, "raw_value_size": 84046, "raw_average_value_size": 307, "num_data_blocks": 11, "num_entries": 273, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1714064922, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "97684591-619d-4f9a-8c31-238ec8e20352", "db_session_id": "F2IXJ2E9KLL3789T91KF"}} 2024-04-25T17:08:43.149 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: [db/version_set.cc:4082] Creating manifest 15 2024-04-25T17:08:43.149 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714064922979968, "job": 1, "event": "recovery_finished"} 2024-04-25T17:08:43.149 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi037/store.db/000010.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-25T17:08:43.149 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x56098cec1180 2024-04-25T17:08:43.149 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: DB pointer 0x56098cf96000 2024-04-25T17:08:43.149 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2024-04-25T17:08:43.149 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-04-25T17:08:43.149 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: ** DB Stats ** 2024-04-25T17:08:43.149 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-25T17:08:43.149 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-25T17:08:43.150 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-25T17:08:43.150 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-25T17:08:43.150 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-25T17:08:43.150 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-04-25T17:08:43.150 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-25T17:08:43.150 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: 2024-04-25T17:08:43.150 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: ** Compaction Stats [default] ** 2024-04-25T17:08:43.150 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-25T17:08:43.150 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-25T17:08:43.150 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: L0 2/0 92.98 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 137.6 0.00 0.00 1 0.001 0 0 2024-04-25T17:08:43.150 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Sum 2/0 92.98 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 137.6 0.00 0.00 1 0.001 0 0 2024-04-25T17:08:43.150 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 137.6 0.00 0.00 1 0.001 0 0 2024-04-25T17:08:43.150 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: 2024-04-25T17:08:43.150 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: ** Compaction Stats [default] ** 2024-04-25T17:08:43.151 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-25T17:08:43.151 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-25T17:08:43.151 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 137.6 0.00 0.00 1 0.001 0 0 2024-04-25T17:08:43.151 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-25T17:08:43.151 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-25T17:08:43.151 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-25T17:08:43.151 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-25T17:08:43.151 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-25T17:08:43.151 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-25T17:08:43.151 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Cumulative compaction: 0.00 GB write, 27.58 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-25T17:08:43.151 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Interval compaction: 0.00 GB write, 27.58 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-25T17:08:43.151 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-25T17:08:43.151 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: 2024-04-25T17:08:43.151 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-25T17:08:43.152 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: 2024-04-25T17:08:43.152 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: ** Compaction Stats [default] ** 2024-04-25T17:08:43.152 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-25T17:08:43.152 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-25T17:08:43.152 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: L0 2/0 92.98 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 137.6 0.00 0.00 1 0.001 0 0 2024-04-25T17:08:43.152 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Sum 2/0 92.98 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 137.6 0.00 0.00 1 0.001 0 0 2024-04-25T17:08:43.152 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-04-25T17:08:43.152 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: 2024-04-25T17:08:43.152 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: ** Compaction Stats [default] ** 2024-04-25T17:08:43.152 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-25T17:08:43.152 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-25T17:08:43.152 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 137.6 0.00 0.00 1 0.001 0 0 2024-04-25T17:08:43.152 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-25T17:08:43.152 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-25T17:08:43.152 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-25T17:08:43.152 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-25T17:08:43.153 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-25T17:08:43.153 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-25T17:08:43.153 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Cumulative compaction: 0.00 GB write, 27.32 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-25T17:08:43.153 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-25T17:08:43.153 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-25T17:08:43.153 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: 2024-04-25T17:08:43.153 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-25T17:08:43.153 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: starting mon.smithi037 rank 0 at public addrs [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] at bind addrs [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi037 fsid 599bb7fc-0326-11ef-bc93-c7b262605968 2024-04-25T17:08:43.153 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: mon.smithi037@-1(???) e1 preinit fsid 599bb7fc-0326-11ef-bc93-c7b262605968 2024-04-25T17:08:43.153 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: mon.smithi037@-1(???).mds e1 new map 2024-04-25T17:08:43.153 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: mon.smithi037@-1(???).mds e1 print_map 2024-04-25T17:08:43.153 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: e1 2024-04-25T17:08:43.153 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-25T17:08:43.153 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T17:08:43.153 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: legacy client fscid: -1 2024-04-25T17:08:43.154 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: 2024-04-25T17:08:43.154 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: No filesystems configured 2024-04-25T17:08:43.154 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: mon.smithi037@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-25T17:08:43.154 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: mon.smithi037@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-25T17:08:43.154 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: mon.smithi037@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-25T17:08:43.154 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: mon.smithi037@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-04-25T17:08:43.154 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:42 smithi037 ceph-mon[26472]: mon.smithi037@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-04-25T17:08:43.154 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:43 smithi037 bash[26452]: 5cfadcf8f2e4441b97211566dfaebb19e2bd618f5b66cc2c3fa42383c3ba94f2 2024-04-25T17:08:43.154 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:43 smithi037 systemd[1]: Started Ceph mon.smithi037 for 599bb7fc-0326-11ef-bc93-c7b262605968. 2024-04-25T17:08:43.154 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:43 smithi037 ceph-mon[26472]: mon.smithi037 is new leader, mons smithi037 in quorum (ranks 0) 2024-04-25T17:08:43.154 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:43 smithi037 ceph-mon[26472]: monmap e1: 1 mons at {smithi037=[v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-25T17:08:43.154 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:43 smithi037 ceph-mon[26472]: fsmap 2024-04-25T17:08:43.154 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:43 smithi037 ceph-mon[26472]: osdmap e1: 0 total, 0 up, 0 in 2024-04-25T17:08:43.154 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:43 smithi037 ceph-mon[26472]: mgrmap e1: no daemons active 2024-04-25T17:08:44.136 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:43.512+0000 7f7e9b6e7700 1 Processor -- start 2024-04-25T17:08:44.137 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:43.512+0000 7f7e9b6e7700 1 -- start start 2024-04-25T17:08:44.137 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:43.512+0000 7f7e9b6e7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e94101740 0x7f7e94101b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:08:44.137 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:43.512+0000 7f7e9b6e7700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e94102090 con 0x7f7e94101740 2024-04-25T17:08:44.137 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:43.513+0000 7f7e99483700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e94101740 0x7f7e94101b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:08:44.137 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:43.513+0000 7f7e99483700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e94101740 0x7f7e94101b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59254/0 (socket says 172.21.15.37:59254) 2024-04-25T17:08:44.137 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:43.513+0000 7f7e99483700 1 -- 172.21.15.37:0/3194355573 learned_addr learned my addr 172.21.15.37:0/3194355573 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:08:44.137 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:43.513+0000 7f7e99483700 1 -- 172.21.15.37:0/3194355573 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e941021d0 con 0x7f7e94101740 2024-04-25T17:08:44.137 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:43.513+0000 7f7e99483700 1 --2- 172.21.15.37:0/3194355573 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e94101740 0x7f7e94101b50 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f7e84009e50 tx=0x7f7e84009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa845be5254cd3f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:08:44.137 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:43.513+0000 7f7e93fff700 1 -- 172.21.15.37:0/3194355573 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7e840092e0 con 0x7f7e94101740 2024-04-25T17:08:44.137 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:43.514+0000 7f7e93fff700 1 -- 172.21.15.37:0/3194355573 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f7e84012430 con 0x7f7e94101740 2024-04-25T17:08:44.137 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:43.514+0000 7f7e93fff700 1 -- 172.21.15.37:0/3194355573 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7e840075c0 con 0x7f7e94101740 2024-04-25T17:08:44.137 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:43.514+0000 7f7e9b6e7700 1 -- 172.21.15.37:0/3194355573 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e94101740 msgr2=0x7f7e94101b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:08:44.137 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:43.514+0000 7f7e9b6e7700 1 --2- 172.21.15.37:0/3194355573 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e94101740 0x7f7e94101b50 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f7e84009e50 tx=0x7f7e84009840 comp rx=0 tx=0).stop 2024-04-25T17:08:44.137 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:43.514+0000 7f7e9b6e7700 1 -- 172.21.15.37:0/3194355573 shutdown_connections 2024-04-25T17:08:44.138 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:43.514+0000 7f7e9b6e7700 1 --2- 172.21.15.37:0/3194355573 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e94101740 0x7f7e94101b50 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:08:44.138 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:43.514+0000 7f7e9b6e7700 1 -- 172.21.15.37:0/3194355573 >> 172.21.15.37:0/3194355573 conn(0x7f7e940fcec0 msgr2=0x7f7e940ff2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:08:44.138 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:43.514+0000 7f7e9b6e7700 1 -- 172.21.15.37:0/3194355573 shutdown_connections 2024-04-25T17:08:44.138 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:43.514+0000 7f7e9b6e7700 1 -- 172.21.15.37:0/3194355573 wait complete. 2024-04-25T17:08:44.138 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:43.515+0000 7f7e9b6e7700 1 Processor -- start 2024-04-25T17:08:44.138 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:43.515+0000 7f7e9b6e7700 1 -- start start 2024-04-25T17:08:44.138 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:43.515+0000 7f7e9b6e7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e94101740 0x7f7e94071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:08:44.138 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:43.515+0000 7f7e9b6e7700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e941142d0 con 0x7f7e94101740 2024-04-25T17:08:44.138 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:43.515+0000 7f7e99483700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e94101740 0x7f7e94071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:08:44.138 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:43.515+0000 7f7e99483700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e94101740 0x7f7e94071210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59270/0 (socket says 172.21.15.37:59270) 2024-04-25T17:08:44.138 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:43.515+0000 7f7e99483700 1 -- 172.21.15.37:0/169516433 learned_addr learned my addr 172.21.15.37:0/169516433 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:08:44.138 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:43.515+0000 7f7e99483700 1 -- 172.21.15.37:0/169516433 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e84009ae0 con 0x7f7e94101740 2024-04-25T17:08:44.138 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:43.515+0000 7f7e99483700 1 --2- 172.21.15.37:0/169516433 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e94101740 0x7f7e94071210 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f7e84009ab0 tx=0x7f7e84009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:08:44.138 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:43.516+0000 7f7e91ffb700 1 -- 172.21.15.37:0/169516433 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7e840092e0 con 0x7f7e94101740 2024-04-25T17:08:44.139 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:43.516+0000 7f7e91ffb700 1 -- 172.21.15.37:0/169516433 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f7e84007d10 con 0x7f7e94101740 2024-04-25T17:08:44.139 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:43.516+0000 7f7e9b6e7700 1 -- 172.21.15.37:0/169516433 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e94114410 con 0x7f7e94101740 2024-04-25T17:08:44.139 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:43.516+0000 7f7e91ffb700 1 -- 172.21.15.37:0/169516433 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7e8401c990 con 0x7f7e94101740 2024-04-25T17:08:44.139 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:43.516+0000 7f7e9b6e7700 1 -- 172.21.15.37:0/169516433 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e94114900 con 0x7f7e94101740 2024-04-25T17:08:44.139 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:43.516+0000 7f7e91ffb700 1 -- 172.21.15.37:0/169516433 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f7e84019070 con 0x7f7e94101740 2024-04-25T17:08:44.139 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:43.516+0000 7f7e91ffb700 1 -- 172.21.15.37:0/169516433 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f7e84025b50 con 0x7f7e94101740 2024-04-25T17:08:44.139 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:43.517+0000 7f7e9b6e7700 1 -- 172.21.15.37:0/169516433 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e9405f5c0 con 0x7f7e94101740 2024-04-25T17:08:44.139 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:43.519+0000 7f7e91ffb700 1 -- 172.21.15.37:0/169516433 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7f7e8402a060 con 0x7f7e94101740 2024-04-25T17:08:44.139 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:43.589+0000 7f7e9b6e7700 1 -- 172.21.15.37:0/169516433 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f7e9404bed0 con 0x7f7e94101740 2024-04-25T17:08:44.139 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:43.591+0000 7f7e91ffb700 1 -- 172.21.15.37:0/169516433 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f7e84020070 con 0x7f7e94101740 2024-04-25T17:08:44.139 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:43.592+0000 7f7e9b6e7700 1 -- 172.21.15.37:0/169516433 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e94101740 msgr2=0x7f7e94071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:08:44.139 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:43.592+0000 7f7e9b6e7700 1 --2- 172.21.15.37:0/169516433 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e94101740 0x7f7e94071210 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f7e84009ab0 tx=0x7f7e84009840 comp rx=0 tx=0).stop 2024-04-25T17:08:44.139 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:43.592+0000 7f7e9b6e7700 1 -- 172.21.15.37:0/169516433 shutdown_connections 2024-04-25T17:08:44.139 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:43.592+0000 7f7e9b6e7700 1 --2- 172.21.15.37:0/169516433 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e94101740 0x7f7e94071210 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:08:44.140 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:43.592+0000 7f7e9b6e7700 1 -- 172.21.15.37:0/169516433 >> 172.21.15.37:0/169516433 conn(0x7f7e940fcec0 msgr2=0x7f7e940fd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:08:44.140 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:43.592+0000 7f7e9b6e7700 1 -- 172.21.15.37:0/169516433 shutdown_connections 2024-04-25T17:08:44.140 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:43.592+0000 7f7e9b6e7700 1 -- 172.21.15.37:0/169516433 wait complete. 2024-04-25T17:08:44.140 INFO:teuthology.orchestra.run.smithi037.stdout:Wrote config to /etc/ceph/ceph.conf 2024-04-25T17:08:44.140 INFO:teuthology.orchestra.run.smithi037.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-04-25T17:08:44.140 INFO:teuthology.orchestra.run.smithi037.stdout:Creating mgr... 2024-04-25T17:08:44.140 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying port 9283 ... 2024-04-25T17:08:44.322 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-599bb7fc-0326-11ef-bc93-c7b262605968@mgr.smithi037.txrgxl 2024-04-25T17:08:44.322 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Failed to reset failed state of unit ceph-599bb7fc-0326-11ef-bc93-c7b262605968@mgr.smithi037.txrgxl.service: Unit ceph-599bb7fc-0326-11ef-bc93-c7b262605968@mgr.smithi037.txrgxl.service not loaded. 2024-04-25T17:08:44.476 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-599bb7fc-0326-11ef-bc93-c7b262605968.target.wants/ceph-599bb7fc-0326-11ef-bc93-c7b262605968@mgr.smithi037.txrgxl.service → /etc/systemd/system/ceph-599bb7fc-0326-11ef-bc93-c7b262605968@.service. 2024-04-25T17:08:44.915 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:44 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/169516433' entity='client.admin' 2024-04-25T17:08:45.031 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-25T17:08:45.031 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout disabled 2024-04-25T17:08:45.040 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-25T17:08:45.040 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout inactive 2024-04-25T17:08:45.040 INFO:teuthology.orchestra.run.smithi037.stdout:firewalld.service is not enabled 2024-04-25T17:08:45.040 INFO:teuthology.orchestra.run.smithi037.stdout:Not possible to enable service . firewalld.service is not available 2024-04-25T17:08:45.050 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-25T17:08:45.050 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout disabled 2024-04-25T17:08:45.059 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-25T17:08:45.059 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout inactive 2024-04-25T17:08:45.059 INFO:teuthology.orchestra.run.smithi037.stdout:firewalld.service is not enabled 2024-04-25T17:08:45.059 INFO:teuthology.orchestra.run.smithi037.stdout:Not possible to open ports <[9283]>. firewalld.service is not available 2024-04-25T17:08:45.059 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for mgr to start... 2024-04-25T17:08:45.059 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for mgr... 2024-04-25T17:08:45.767 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:45 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/307108607' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-25T17:08:46.169 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-04-25T17:08:46.169 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout { 2024-04-25T17:08:46.169 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "fsid": "599bb7fc-0326-11ef-bc93-c7b262605968", 2024-04-25T17:08:46.169 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "health": { 2024-04-25T17:08:46.170 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-25T17:08:46.170 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-25T17:08:46.170 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-25T17:08:46.170 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-04-25T17:08:46.170 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-25T17:08:46.170 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-25T17:08:46.170 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 0 2024-04-25T17:08:46.170 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-04-25T17:08:46.170 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-25T17:08:46.170 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "smithi037" 2024-04-25T17:08:46.170 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-04-25T17:08:46.170 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-04-25T17:08:46.170 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-25T17:08:46.170 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T17:08:46.171 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-04-25T17:08:46.171 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-25T17:08:46.171 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-04-25T17:08:46.171 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-25T17:08:46.171 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T17:08:46.171 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-25T17:08:46.171 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-25T17:08:46.171 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-25T17:08:46.171 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-25T17:08:46.171 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-25T17:08:46.171 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-25T17:08:46.171 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-04-25T17:08:46.171 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-25T17:08:46.171 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-25T17:08:46.172 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-25T17:08:46.172 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-25T17:08:46.172 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-25T17:08:46.172 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-25T17:08:46.172 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-25T17:08:46.172 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-25T17:08:46.172 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-25T17:08:46.172 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-04-25T17:08:46.172 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-25T17:08:46.172 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T17:08:46.172 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-25T17:08:46.172 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-25T17:08:46.172 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-04-25T17:08:46.172 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-25T17:08:46.173 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-25T17:08:46.173 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-25T17:08:46.173 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-25T17:08:46.173 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-25T17:08:46.173 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-25T17:08:46.173 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "restful" 2024-04-25T17:08:46.173 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-04-25T17:08:46.173 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-25T17:08:46.173 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-04-25T17:08:46.173 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-25T17:08:46.173 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T17:08:46.173 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "modified": "2024-04-25T17:08:37.883123+0000", 2024-04-25T17:08:46.173 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-25T17:08:46.173 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-04-25T17:08:46.173 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-25T17:08:46.174 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout } 2024-04-25T17:08:46.174 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:45.452+0000 7f9ddd244700 1 Processor -- start 2024-04-25T17:08:46.174 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:45.452+0000 7f9ddd244700 1 -- start start 2024-04-25T17:08:46.174 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:45.452+0000 7f9ddd244700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dd8102de0 0x7f9dd81031f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:08:46.174 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:45.452+0000 7f9ddd244700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd8103730 con 0x7f9dd8102de0 2024-04-25T17:08:46.174 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:45.453+0000 7f9dd6d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dd8102de0 0x7f9dd81031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:08:46.178 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:45.453+0000 7f9dd6d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dd8102de0 0x7f9dd81031f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59306/0 (socket says 172.21.15.37:59306) 2024-04-25T17:08:46.178 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:45.453+0000 7f9dd6d9d700 1 -- 172.21.15.37:0/4043692523 learned_addr learned my addr 172.21.15.37:0/4043692523 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:08:46.178 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:45.453+0000 7f9dd6d9d700 1 -- 172.21.15.37:0/4043692523 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd8103870 con 0x7f9dd8102de0 2024-04-25T17:08:46.179 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:45.453+0000 7f9dd6d9d700 1 --2- 172.21.15.37:0/4043692523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dd8102de0 0x7f9dd81031f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f9dc80098e0 tx=0x7f9dc8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=495cd6c4b6bdf426 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:08:46.179 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:45.454+0000 7f9dd5d9b700 1 -- 172.21.15.37:0/4043692523 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9dc800b860 con 0x7f9dd8102de0 2024-04-25T17:08:46.179 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:45.454+0000 7f9dd5d9b700 1 -- 172.21.15.37:0/4043692523 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f9dc800be50 con 0x7f9dd8102de0 2024-04-25T17:08:46.179 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:45.454+0000 7f9dd5d9b700 1 -- 172.21.15.37:0/4043692523 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9dc8010380 con 0x7f9dd8102de0 2024-04-25T17:08:46.179 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:45.454+0000 7f9ddd244700 1 -- 172.21.15.37:0/4043692523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dd8102de0 msgr2=0x7f9dd81031f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:08:46.179 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:45.454+0000 7f9ddd244700 1 --2- 172.21.15.37:0/4043692523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dd8102de0 0x7f9dd81031f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f9dc80098e0 tx=0x7f9dc8009250 comp rx=0 tx=0).stop 2024-04-25T17:08:46.179 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:45.454+0000 7f9ddd244700 1 -- 172.21.15.37:0/4043692523 shutdown_connections 2024-04-25T17:08:46.179 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:45.454+0000 7f9ddd244700 1 --2- 172.21.15.37:0/4043692523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dd8102de0 0x7f9dd81031f0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:08:46.179 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:45.454+0000 7f9ddd244700 1 -- 172.21.15.37:0/4043692523 >> 172.21.15.37:0/4043692523 conn(0x7f9dd80fc6b0 msgr2=0x7f9dd80feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:08:46.179 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:45.455+0000 7f9ddd244700 1 -- 172.21.15.37:0/4043692523 shutdown_connections 2024-04-25T17:08:46.179 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:45.455+0000 7f9ddd244700 1 -- 172.21.15.37:0/4043692523 wait complete. 2024-04-25T17:08:46.179 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:45.455+0000 7f9ddd244700 1 Processor -- start 2024-04-25T17:08:46.179 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:45.455+0000 7f9ddd244700 1 -- start start 2024-04-25T17:08:46.180 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:45.455+0000 7f9ddd244700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dd8102de0 0x7f9dd81137a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:08:46.180 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:45.455+0000 7f9ddd244700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd8113ce0 con 0x7f9dd8102de0 2024-04-25T17:08:46.180 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:45.456+0000 7f9dd6d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dd8102de0 0x7f9dd81137a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:08:46.180 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:45.456+0000 7f9dd6d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dd8102de0 0x7f9dd81137a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59322/0 (socket says 172.21.15.37:59322) 2024-04-25T17:08:46.180 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:45.456+0000 7f9dd6d9d700 1 -- 172.21.15.37:0/307108607 learned_addr learned my addr 172.21.15.37:0/307108607 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:08:46.180 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:45.456+0000 7f9dd6d9d700 1 -- 172.21.15.37:0/307108607 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc80094f0 con 0x7f9dd8102de0 2024-04-25T17:08:46.180 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:45.456+0000 7f9dd6d9d700 1 --2- 172.21.15.37:0/307108607 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dd8102de0 0x7f9dd81137a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9dc8000c00 tx=0x7f9dc8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:08:46.180 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:45.456+0000 7f9dbf7fe700 1 -- 172.21.15.37:0/307108607 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9dc80107c0 con 0x7f9dd8102de0 2024-04-25T17:08:46.180 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:45.456+0000 7f9dbf7fe700 1 -- 172.21.15.37:0/307108607 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f9dc8010db0 con 0x7f9dd8102de0 2024-04-25T17:08:46.180 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:45.456+0000 7f9ddd244700 1 -- 172.21.15.37:0/307108607 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dd8113ee0 con 0x7f9dd8102de0 2024-04-25T17:08:46.180 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:45.456+0000 7f9dbf7fe700 1 -- 172.21.15.37:0/307108607 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9dc801ad00 con 0x7f9dd8102de0 2024-04-25T17:08:46.180 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:45.456+0000 7f9ddd244700 1 -- 172.21.15.37:0/307108607 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dd8114a50 con 0x7f9dd8102de0 2024-04-25T17:08:46.180 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:45.457+0000 7f9dbf7fe700 1 -- 172.21.15.37:0/307108607 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f9dc8024440 con 0x7f9dd8102de0 2024-04-25T17:08:46.180 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:45.457+0000 7f9dbf7fe700 1 -- 172.21.15.37:0/307108607 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f9dc8019710 con 0x7f9dd8102de0 2024-04-25T17:08:46.180 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:45.457+0000 7f9ddd244700 1 -- 172.21.15.37:0/307108607 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dd805f5c0 con 0x7f9dd8102de0 2024-04-25T17:08:46.181 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:45.459+0000 7f9dbf7fe700 1 -- 172.21.15.37:0/307108607 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7f9dc8042790 con 0x7f9dd8102de0 2024-04-25T17:08:46.181 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:45.532+0000 7f9ddd244700 1 -- 172.21.15.37:0/307108607 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f9dd8108a80 con 0x7f9dd8102de0 2024-04-25T17:08:46.181 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:45.532+0000 7f9dbf7fe700 1 -- 172.21.15.37:0/307108607 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f9dc8031020 con 0x7f9dd8102de0 2024-04-25T17:08:46.181 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:45.533+0000 7f9ddd244700 1 -- 172.21.15.37:0/307108607 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dd8102de0 msgr2=0x7f9dd81137a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:08:46.181 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:45.533+0000 7f9ddd244700 1 --2- 172.21.15.37:0/307108607 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dd8102de0 0x7f9dd81137a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9dc8000c00 tx=0x7f9dc8009250 comp rx=0 tx=0).stop 2024-04-25T17:08:46.181 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:45.533+0000 7f9ddd244700 1 -- 172.21.15.37:0/307108607 shutdown_connections 2024-04-25T17:08:46.181 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:45.533+0000 7f9ddd244700 1 --2- 172.21.15.37:0/307108607 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dd8102de0 0x7f9dd81137a0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:08:46.181 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:45.533+0000 7f9ddd244700 1 -- 172.21.15.37:0/307108607 >> 172.21.15.37:0/307108607 conn(0x7f9dd80fc6b0 msgr2=0x7f9dd80fd170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:08:46.181 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:45.534+0000 7f9ddd244700 1 -- 172.21.15.37:0/307108607 shutdown_connections 2024-04-25T17:08:46.181 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:45.534+0000 7f9ddd244700 1 -- 172.21.15.37:0/307108607 wait complete. 2024-04-25T17:08:46.181 INFO:teuthology.orchestra.run.smithi037.stdout:mgr not available, waiting (1/15)... 2024-04-25T17:08:49.070 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:48 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/4017764812' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-25T17:08:49.333 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-04-25T17:08:49.333 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout { 2024-04-25T17:08:49.333 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "fsid": "599bb7fc-0326-11ef-bc93-c7b262605968", 2024-04-25T17:08:49.334 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "health": { 2024-04-25T17:08:49.334 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-25T17:08:49.334 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-25T17:08:49.334 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-25T17:08:49.334 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-04-25T17:08:49.334 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-25T17:08:49.334 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-25T17:08:49.335 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 0 2024-04-25T17:08:49.335 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-04-25T17:08:49.335 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-25T17:08:49.335 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "smithi037" 2024-04-25T17:08:49.335 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-04-25T17:08:49.335 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-04-25T17:08:49.335 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-25T17:08:49.335 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T17:08:49.335 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-04-25T17:08:49.336 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-25T17:08:49.336 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-04-25T17:08:49.336 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-25T17:08:49.336 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T17:08:49.336 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-25T17:08:49.336 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-25T17:08:49.336 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-25T17:08:49.344 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-25T17:08:49.344 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-25T17:08:49.344 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-25T17:08:49.344 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-04-25T17:08:49.344 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-25T17:08:49.344 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-25T17:08:49.344 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-25T17:08:49.345 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-25T17:08:49.345 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-25T17:08:49.345 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-25T17:08:49.345 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-25T17:08:49.345 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-25T17:08:49.345 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-25T17:08:49.345 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-04-25T17:08:49.345 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-25T17:08:49.345 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T17:08:49.345 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-25T17:08:49.345 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-25T17:08:49.345 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-04-25T17:08:49.345 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-25T17:08:49.345 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "available": false, 2024-04-25T17:08:49.346 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-25T17:08:49.346 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-25T17:08:49.346 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-25T17:08:49.346 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-25T17:08:49.346 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "restful" 2024-04-25T17:08:49.346 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-04-25T17:08:49.346 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-25T17:08:49.346 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-04-25T17:08:49.346 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-25T17:08:49.346 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T17:08:49.346 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "modified": "2024-04-25T17:08:37.883123+0000", 2024-04-25T17:08:49.346 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-25T17:08:49.346 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-04-25T17:08:49.347 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-25T17:08:49.347 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout } 2024-04-25T17:08:49.347 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:48.582+0000 7f6369c5e700 1 Processor -- start 2024-04-25T17:08:49.347 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:48.582+0000 7f6369c5e700 1 -- start start 2024-04-25T17:08:49.347 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:48.582+0000 7f6369c5e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6364077b40 0x7f6364076140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:08:49.347 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:48.582+0000 7f6369c5e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6364077f50 con 0x7f6364077b40 2024-04-25T17:08:49.347 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:48.583+0000 7f63637fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6364077b40 0x7f6364076140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:08:49.347 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:48.583+0000 7f63637fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6364077b40 0x7f6364076140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56744/0 (socket says 172.21.15.37:56744) 2024-04-25T17:08:49.347 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:48.583+0000 7f63637fe700 1 -- 172.21.15.37:0/326908668 learned_addr learned my addr 172.21.15.37:0/326908668 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:08:49.347 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:48.583+0000 7f63637fe700 1 -- 172.21.15.37:0/326908668 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6364076680 con 0x7f6364077b40 2024-04-25T17:08:49.347 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:48.583+0000 7f63637fe700 1 --2- 172.21.15.37:0/326908668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6364077b40 0x7f6364076140 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f63540098e0 tx=0x7f6354009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2af6046b4f60b74b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:08:49.347 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:48.583+0000 7f63627fc700 1 -- 172.21.15.37:0/326908668 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f635400b860 con 0x7f6364077b40 2024-04-25T17:08:49.347 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:48.583+0000 7f63627fc700 1 -- 172.21.15.37:0/326908668 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f635400be50 con 0x7f6364077b40 2024-04-25T17:08:49.347 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:48.583+0000 7f63627fc700 1 -- 172.21.15.37:0/326908668 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6354010380 con 0x7f6364077b40 2024-04-25T17:08:49.348 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:48.584+0000 7f6369c5e700 1 -- 172.21.15.37:0/326908668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6364077b40 msgr2=0x7f6364076140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:08:49.348 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:48.584+0000 7f6369c5e700 1 --2- 172.21.15.37:0/326908668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6364077b40 0x7f6364076140 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f63540098e0 tx=0x7f6354009250 comp rx=0 tx=0).stop 2024-04-25T17:08:49.348 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:48.584+0000 7f6369c5e700 1 -- 172.21.15.37:0/326908668 shutdown_connections 2024-04-25T17:08:49.348 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:48.584+0000 7f6369c5e700 1 --2- 172.21.15.37:0/326908668 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6364077b40 0x7f6364076140 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:08:49.348 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:48.584+0000 7f6369c5e700 1 -- 172.21.15.37:0/326908668 >> 172.21.15.37:0/326908668 conn(0x7f63640fe060 msgr2=0x7f6364100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:08:49.348 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:48.584+0000 7f6369c5e700 1 -- 172.21.15.37:0/326908668 shutdown_connections 2024-04-25T17:08:49.348 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:48.584+0000 7f6369c5e700 1 -- 172.21.15.37:0/326908668 wait complete. 2024-04-25T17:08:49.348 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:48.585+0000 7f6369c5e700 1 Processor -- start 2024-04-25T17:08:49.348 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:48.585+0000 7f6369c5e700 1 -- start start 2024-04-25T17:08:49.348 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:48.585+0000 7f6369c5e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6364077b40 0x7f6364113890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:08:49.348 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:48.585+0000 7f6369c5e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6364113dd0 con 0x7f6364077b40 2024-04-25T17:08:49.348 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:48.585+0000 7f63637fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6364077b40 0x7f6364113890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:08:49.348 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:48.585+0000 7f63637fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6364077b40 0x7f6364113890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56752/0 (socket says 172.21.15.37:56752) 2024-04-25T17:08:49.348 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:48.585+0000 7f63637fe700 1 -- 172.21.15.37:0/4017764812 learned_addr learned my addr 172.21.15.37:0/4017764812 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:08:49.349 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:48.585+0000 7f63637fe700 1 -- 172.21.15.37:0/4017764812 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63540094f0 con 0x7f6364077b40 2024-04-25T17:08:49.349 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:48.586+0000 7f63637fe700 1 --2- 172.21.15.37:0/4017764812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6364077b40 0x7f6364113890 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6354011bd0 tx=0x7f6354009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:08:49.349 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:48.586+0000 7f634bfff700 1 -- 172.21.15.37:0/4017764812 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f63540107c0 con 0x7f6364077b40 2024-04-25T17:08:49.349 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:48.586+0000 7f634bfff700 1 -- 172.21.15.37:0/4017764812 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f6354010db0 con 0x7f6364077b40 2024-04-25T17:08:49.349 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:48.586+0000 7f6369c5e700 1 -- 172.21.15.37:0/4017764812 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6364113fd0 con 0x7f6364077b40 2024-04-25T17:08:49.349 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:48.586+0000 7f634bfff700 1 -- 172.21.15.37:0/4017764812 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f635401ad00 con 0x7f6364077b40 2024-04-25T17:08:49.349 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:48.586+0000 7f6369c5e700 1 -- 172.21.15.37:0/4017764812 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6364114b40 con 0x7f6364077b40 2024-04-25T17:08:49.349 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:48.586+0000 7f634bfff700 1 -- 172.21.15.37:0/4017764812 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f6354025450 con 0x7f6364077b40 2024-04-25T17:08:49.349 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:48.586+0000 7f634bfff700 1 -- 172.21.15.37:0/4017764812 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f6354019710 con 0x7f6364077b40 2024-04-25T17:08:49.349 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:48.587+0000 7f6369c5e700 1 -- 172.21.15.37:0/4017764812 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f636405f5c0 con 0x7f6364077b40 2024-04-25T17:08:49.349 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:48.590+0000 7f634bfff700 1 -- 172.21.15.37:0/4017764812 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71547 (secure 0 0 0) 0x7f635402a060 con 0x7f6364077b40 2024-04-25T17:08:49.349 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:48.664+0000 7f6369c5e700 1 -- 172.21.15.37:0/4017764812 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f6364108aa0 con 0x7f6364077b40 2024-04-25T17:08:49.349 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:48.664+0000 7f634bfff700 1 -- 172.21.15.37:0/4017764812 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f6354033090 con 0x7f6364077b40 2024-04-25T17:08:49.349 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:48.665+0000 7f6369c5e700 1 -- 172.21.15.37:0/4017764812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6364077b40 msgr2=0x7f6364113890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:08:49.350 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:48.665+0000 7f6369c5e700 1 --2- 172.21.15.37:0/4017764812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6364077b40 0x7f6364113890 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f6354011bd0 tx=0x7f6354009250 comp rx=0 tx=0).stop 2024-04-25T17:08:49.350 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:48.665+0000 7f6369c5e700 1 -- 172.21.15.37:0/4017764812 shutdown_connections 2024-04-25T17:08:49.350 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:48.665+0000 7f6369c5e700 1 --2- 172.21.15.37:0/4017764812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6364077b40 0x7f6364113890 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:08:49.350 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:48.666+0000 7f6369c5e700 1 -- 172.21.15.37:0/4017764812 >> 172.21.15.37:0/4017764812 conn(0x7f63640fe060 msgr2=0x7f63640fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:08:49.350 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:48.666+0000 7f6369c5e700 1 -- 172.21.15.37:0/4017764812 shutdown_connections 2024-04-25T17:08:49.350 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:48.666+0000 7f6369c5e700 1 -- 172.21.15.37:0/4017764812 wait complete. 2024-04-25T17:08:49.350 INFO:teuthology.orchestra.run.smithi037.stdout:mgr not available, waiting (2/15)... 2024-04-25T17:08:52.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:51 smithi037 ceph-mon[26472]: Activating manager daemon smithi037.txrgxl 2024-04-25T17:08:52.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:51 smithi037 ceph-mon[26472]: mgrmap e2: smithi037.txrgxl(active, starting, since 0.00279713s) 2024-04-25T17:08:52.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:51 smithi037 ceph-mon[26472]: from='mgr.14100 172.21.15.37:0/1451565764' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-25T17:08:52.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:51 smithi037 ceph-mon[26472]: from='mgr.14100 172.21.15.37:0/1451565764' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-25T17:08:52.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:51 smithi037 ceph-mon[26472]: from='mgr.14100 172.21.15.37:0/1451565764' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-25T17:08:52.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:51 smithi037 ceph-mon[26472]: from='mgr.14100 172.21.15.37:0/1451565764' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mon metadata", "id": "smithi037"}]: dispatch 2024-04-25T17:08:52.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:51 smithi037 ceph-mon[26472]: from='mgr.14100 172.21.15.37:0/1451565764' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mgr metadata", "who": "smithi037.txrgxl", "id": "smithi037.txrgxl"}]: dispatch 2024-04-25T17:08:52.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:51 smithi037 ceph-mon[26472]: Manager daemon smithi037.txrgxl is now available 2024-04-25T17:08:52.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:51 smithi037 ceph-mon[26472]: from='mgr.14100 172.21.15.37:0/1451565764' entity='mgr.smithi037.txrgxl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi037.txrgxl/mirror_snapshot_schedule"}]: dispatch 2024-04-25T17:08:52.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:51 smithi037 ceph-mon[26472]: from='mgr.14100 172.21.15.37:0/1451565764' entity='mgr.smithi037.txrgxl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi037.txrgxl/trash_purge_schedule"}]: dispatch 2024-04-25T17:08:52.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:51 smithi037 ceph-mon[26472]: from='mgr.14100 172.21.15.37:0/1451565764' entity='mgr.smithi037.txrgxl' 2024-04-25T17:08:52.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:51 smithi037 ceph-mon[26472]: from='mgr.14100 172.21.15.37:0/1451565764' entity='mgr.smithi037.txrgxl' 2024-04-25T17:08:52.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:51 smithi037 ceph-mon[26472]: from='mgr.14100 172.21.15.37:0/1451565764' entity='mgr.smithi037.txrgxl' 2024-04-25T17:08:54.070 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:53 smithi037 ceph-mon[26472]: mgrmap e3: smithi037.txrgxl(active, since 1.00687s) 2024-04-25T17:08:54.820 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:54 smithi037 ceph-mon[26472]: mgrmap e4: smithi037.txrgxl(active, since 2s) 2024-04-25T17:08:54.820 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:08:54 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/3318864593' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-04-25T17:09:00.342 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-04-25T17:09:00.342 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout { 2024-04-25T17:09:00.342 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "fsid": "599bb7fc-0326-11ef-bc93-c7b262605968", 2024-04-25T17:09:00.342 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "health": { 2024-04-25T17:09:00.342 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-04-25T17:09:00.342 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-04-25T17:09:00.342 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-04-25T17:09:00.342 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-04-25T17:09:00.342 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-04-25T17:09:00.342 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-04-25T17:09:00.342 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 0 2024-04-25T17:09:00.342 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-04-25T17:09:00.342 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-04-25T17:09:00.343 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "smithi037" 2024-04-25T17:09:00.343 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-04-25T17:09:00.343 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "quorum_age": 11, 2024-04-25T17:09:00.343 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "monmap": { 2024-04-25T17:09:00.343 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T17:09:00.343 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-04-25T17:09:00.343 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-04-25T17:09:00.343 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-04-25T17:09:00.343 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-04-25T17:09:00.343 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T17:09:00.343 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-04-25T17:09:00.343 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-04-25T17:09:00.343 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-04-25T17:09:00.351 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-04-25T17:09:00.351 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-04-25T17:09:00.351 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-04-25T17:09:00.351 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-04-25T17:09:00.351 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-04-25T17:09:00.352 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-04-25T17:09:00.352 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-04-25T17:09:00.352 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-04-25T17:09:00.352 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-04-25T17:09:00.352 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-04-25T17:09:00.352 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-04-25T17:09:00.352 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-04-25T17:09:00.352 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-04-25T17:09:00.352 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-04-25T17:09:00.352 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-04-25T17:09:00.352 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T17:09:00.352 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-04-25T17:09:00.352 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-04-25T17:09:00.352 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-04-25T17:09:00.352 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-04-25T17:09:00.353 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-25T17:09:00.353 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-04-25T17:09:00.353 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "modules": [ 2024-04-25T17:09:00.353 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "iostat", 2024-04-25T17:09:00.353 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "nfs", 2024-04-25T17:09:00.353 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "restful" 2024-04-25T17:09:00.353 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ], 2024-04-25T17:09:00.353 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-25T17:09:00.353 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-04-25T17:09:00.353 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-04-25T17:09:00.353 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-04-25T17:09:00.353 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "modified": "2024-04-25T17:08:37.883123+0000", 2024-04-25T17:09:00.353 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "services": {} 2024-04-25T17:09:00.353 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout }, 2024-04-25T17:09:00.353 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-04-25T17:09:00.354 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout } 2024-04-25T17:09:00.354 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:54.225+0000 7f67fc7bc700 1 Processor -- start 2024-04-25T17:09:00.354 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:54.225+0000 7f67fc7bc700 1 -- start start 2024-04-25T17:09:00.354 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:54.225+0000 7f67fc7bc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67f4102880 0x7f67f4102c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:00.354 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:54.225+0000 7f67fc7bc700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f41031d0 con 0x7f67f4102880 2024-04-25T17:09:00.354 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:54.225+0000 7f67fa558700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67f4102880 0x7f67f4102c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:00.354 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:54.225+0000 7f67fa558700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67f4102880 0x7f67f4102c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56824/0 (socket says 172.21.15.37:56824) 2024-04-25T17:09:00.354 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:54.225+0000 7f67fa558700 1 -- 172.21.15.37:0/3882235013 learned_addr learned my addr 172.21.15.37:0/3882235013 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:09:00.354 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:54.226+0000 7f67fa558700 1 -- 172.21.15.37:0/3882235013 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f4103310 con 0x7f67f4102880 2024-04-25T17:09:00.354 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:54.226+0000 7f67fa558700 1 --2- 172.21.15.37:0/3882235013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67f4102880 0x7f67f4102c90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f67f00098e0 tx=0x7f67f0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da9d6c8e4011bd6d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:00.354 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:54.226+0000 7f67f9556700 1 -- 172.21.15.37:0/3882235013 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f67f000b860 con 0x7f67f4102880 2024-04-25T17:09:00.354 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:54.226+0000 7f67f9556700 1 -- 172.21.15.37:0/3882235013 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f67f000be50 con 0x7f67f4102880 2024-04-25T17:09:00.354 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:54.226+0000 7f67f9556700 1 -- 172.21.15.37:0/3882235013 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f67f0010380 con 0x7f67f4102880 2024-04-25T17:09:00.354 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:54.226+0000 7f67fc7bc700 1 -- 172.21.15.37:0/3882235013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67f4102880 msgr2=0x7f67f4102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:00.355 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:54.226+0000 7f67fc7bc700 1 --2- 172.21.15.37:0/3882235013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67f4102880 0x7f67f4102c90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f67f00098e0 tx=0x7f67f0009250 comp rx=0 tx=0).stop 2024-04-25T17:09:00.355 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:54.227+0000 7f67fc7bc700 1 -- 172.21.15.37:0/3882235013 shutdown_connections 2024-04-25T17:09:00.355 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:54.227+0000 7f67fc7bc700 1 --2- 172.21.15.37:0/3882235013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67f4102880 0x7f67f4102c90 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:00.355 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:54.227+0000 7f67fc7bc700 1 -- 172.21.15.37:0/3882235013 >> 172.21.15.37:0/3882235013 conn(0x7f67f40fe060 msgr2=0x7f67f4100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:09:00.355 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:54.227+0000 7f67fc7bc700 1 -- 172.21.15.37:0/3882235013 shutdown_connections 2024-04-25T17:09:00.355 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:54.227+0000 7f67fc7bc700 1 -- 172.21.15.37:0/3882235013 wait complete. 2024-04-25T17:09:00.355 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:54.227+0000 7f67fc7bc700 1 Processor -- start 2024-04-25T17:09:00.355 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:54.227+0000 7f67fc7bc700 1 -- start start 2024-04-25T17:09:00.356 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:54.227+0000 7f67fc7bc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67f4102880 0x7f67f4078c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:00.356 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:54.227+0000 7f67fc7bc700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f4079160 con 0x7f67f4102880 2024-04-25T17:09:00.356 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:54.227+0000 7f67fa558700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67f4102880 0x7f67f4078c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:00.356 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:54.227+0000 7f67fa558700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67f4102880 0x7f67f4078c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56838/0 (socket says 172.21.15.37:56838) 2024-04-25T17:09:00.356 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:54.227+0000 7f67fa558700 1 -- 172.21.15.37:0/3318864593 learned_addr learned my addr 172.21.15.37:0/3318864593 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:09:00.356 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:54.228+0000 7f67fa558700 1 -- 172.21.15.37:0/3318864593 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f00094f0 con 0x7f67f4102880 2024-04-25T17:09:00.356 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:54.228+0000 7f67fa558700 1 --2- 172.21.15.37:0/3318864593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67f4102880 0x7f67f4078c20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f67f000b440 tx=0x7f67f0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:00.356 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:54.228+0000 7f67eaffd700 1 -- 172.21.15.37:0/3318864593 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f67f0010760 con 0x7f67f4102880 2024-04-25T17:09:00.356 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:54.228+0000 7f67eaffd700 1 -- 172.21.15.37:0/3318864593 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f67f0010d50 con 0x7f67f4102880 2024-04-25T17:09:00.356 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:54.228+0000 7f67fc7bc700 1 -- 172.21.15.37:0/3318864593 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67f40771d0 con 0x7f67f4102880 2024-04-25T17:09:00.356 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:54.228+0000 7f67eaffd700 1 -- 172.21.15.37:0/3318864593 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f67f001ae20 con 0x7f67f4102880 2024-04-25T17:09:00.356 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:54.228+0000 7f67fc7bc700 1 -- 172.21.15.37:0/3318864593 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67f40776c0 con 0x7f67f4102880 2024-04-25T17:09:00.357 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:54.229+0000 7f67eaffd700 1 -- 172.21.15.37:0/3318864593 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 4) v1 ==== 43365+0+0 (secure 0 0 0) 0x7f67f002e440 con 0x7f67f4102880 2024-04-25T17:09:00.357 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:54.229+0000 7f67fc7bc700 1 -- 172.21.15.37:0/3318864593 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67f404bed0 con 0x7f67f4102880 2024-04-25T17:09:00.357 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:54.229+0000 7f67eaffd700 1 --2- 172.21.15.37:0/3318864593 >> [v2:172.21.15.37:6800/2509847167,v1:172.21.15.37:6801/2509847167] conn(0x7f67e0036850 0x7f67e0038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:00.357 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:54.229+0000 7f67eaffd700 1 -- 172.21.15.37:0/3318864593 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f67f004a700 con 0x7f67f4102880 2024-04-25T17:09:00.357 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:54.229+0000 7f67f9d57700 1 --2- 172.21.15.37:0/3318864593 >> [v2:172.21.15.37:6800/2509847167,v1:172.21.15.37:6801/2509847167] conn(0x7f67e0036850 0x7f67e0038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:00.357 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:54.230+0000 7f67f9d57700 1 --2- 172.21.15.37:0/3318864593 >> [v2:172.21.15.37:6800/2509847167,v1:172.21.15.37:6801/2509847167] conn(0x7f67e0036850 0x7f67e0038d00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f67e4009990 tx=0x7f67e4006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:00.357 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:54.234+0000 7f67eaffd700 1 -- 172.21.15.37:0/3318864593 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f67f0018710 con 0x7f67f4102880 2024-04-25T17:09:00.357 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:54.513+0000 7f67fc7bc700 1 -- 172.21.15.37:0/3318864593 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f67f4104650 con 0x7f67f4102880 2024-04-25T17:09:00.357 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:54.513+0000 7f67eaffd700 1 -- 172.21.15.37:0/3318864593 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f67f002d3a0 con 0x7f67f4102880 2024-04-25T17:09:00.357 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:54.515+0000 7f67fc7bc700 1 -- 172.21.15.37:0/3318864593 >> [v2:172.21.15.37:6800/2509847167,v1:172.21.15.37:6801/2509847167] conn(0x7f67e0036850 msgr2=0x7f67e0038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:00.357 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:54.515+0000 7f67fc7bc700 1 --2- 172.21.15.37:0/3318864593 >> [v2:172.21.15.37:6800/2509847167,v1:172.21.15.37:6801/2509847167] conn(0x7f67e0036850 0x7f67e0038d00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f67e4009990 tx=0x7f67e4006e40 comp rx=0 tx=0).stop 2024-04-25T17:09:00.357 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:54.515+0000 7f67fc7bc700 1 -- 172.21.15.37:0/3318864593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67f4102880 msgr2=0x7f67f4078c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:00.357 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:54.515+0000 7f67fc7bc700 1 --2- 172.21.15.37:0/3318864593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67f4102880 0x7f67f4078c20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f67f000b440 tx=0x7f67f0009250 comp rx=0 tx=0).stop 2024-04-25T17:09:00.357 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:54.515+0000 7f67fc7bc700 1 -- 172.21.15.37:0/3318864593 shutdown_connections 2024-04-25T17:09:00.357 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:54.515+0000 7f67fc7bc700 1 --2- 172.21.15.37:0/3318864593 >> [v2:172.21.15.37:6800/2509847167,v1:172.21.15.37:6801/2509847167] conn(0x7f67e0036850 0x7f67e0038d00 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:00.358 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:54.515+0000 7f67fc7bc700 1 --2- 172.21.15.37:0/3318864593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67f4102880 0x7f67f4078c20 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:00.358 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:54.515+0000 7f67fc7bc700 1 -- 172.21.15.37:0/3318864593 >> 172.21.15.37:0/3318864593 conn(0x7f67f40fe060 msgr2=0x7f67f40feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:09:00.358 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:54.515+0000 7f67fc7bc700 1 -- 172.21.15.37:0/3318864593 shutdown_connections 2024-04-25T17:09:00.358 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:08:54.515+0000 7f67fc7bc700 1 -- 172.21.15.37:0/3318864593 wait complete. 2024-04-25T17:09:00.358 INFO:teuthology.orchestra.run.smithi037.stdout:mgr is available 2024-04-25T17:09:01.389 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:01 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/287616283' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-04-25T17:09:01.640 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-04-25T17:09:01.640 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout [global] 2024-04-25T17:09:01.640 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout fsid = 599bb7fc-0326-11ef-bc93-c7b262605968 2024-04-25T17:09:01.640 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-04-25T17:09:01.640 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-04-25T17:09:01.640 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-04-25T17:09:01.640 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-04-25T17:09:01.640 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-04-25T17:09:01.641 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout [mgr] 2024-04-25T17:09:01.641 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-04-25T17:09:01.641 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 2024-04-25T17:09:01.641 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout [osd] 2024-04-25T17:09:01.641 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-04-25T17:09:01.641 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-04-25T17:09:01.641 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-04-25T17:09:01.641 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-04-25T17:09:01.641 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-04-25T17:09:01.641 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:00.879+0000 7f5ecd685700 1 Processor -- start 2024-04-25T17:09:01.641 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:00.879+0000 7f5ecd685700 1 -- start start 2024-04-25T17:09:01.641 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:00.879+0000 7f5ecd685700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ec8076c10 0x7f5ec8105440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:01.641 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:00.879+0000 7f5ecd685700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec8105980 con 0x7f5ec8076c10 2024-04-25T17:09:01.641 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:00.879+0000 7f5ec6ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ec8076c10 0x7f5ec8105440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:01.642 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:00.879+0000 7f5ec6ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ec8076c10 0x7f5ec8105440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41654/0 (socket says 172.21.15.37:41654) 2024-04-25T17:09:01.642 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:00.879+0000 7f5ec6ffd700 1 -- 172.21.15.37:0/1180420842 learned_addr learned my addr 172.21.15.37:0/1180420842 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:09:01.642 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:00.880+0000 7f5ec6ffd700 1 -- 172.21.15.37:0/1180420842 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec8105ac0 con 0x7f5ec8076c10 2024-04-25T17:09:01.642 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:00.880+0000 7f5ec6ffd700 1 --2- 172.21.15.37:0/1180420842 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ec8076c10 0x7f5ec8105440 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5eb80098e0 tx=0x7f5eb8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ba5a572a18cbeca server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:01.642 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:00.880+0000 7f5ec5ffb700 1 -- 172.21.15.37:0/1180420842 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5eb800b860 con 0x7f5ec8076c10 2024-04-25T17:09:01.642 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:00.880+0000 7f5ec5ffb700 1 -- 172.21.15.37:0/1180420842 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f5eb800be50 con 0x7f5ec8076c10 2024-04-25T17:09:01.642 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:00.880+0000 7f5ec5ffb700 1 -- 172.21.15.37:0/1180420842 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5eb8010380 con 0x7f5ec8076c10 2024-04-25T17:09:01.642 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:00.881+0000 7f5ecd685700 1 -- 172.21.15.37:0/1180420842 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ec8076c10 msgr2=0x7f5ec8105440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:01.642 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:00.881+0000 7f5ecd685700 1 --2- 172.21.15.37:0/1180420842 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ec8076c10 0x7f5ec8105440 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5eb80098e0 tx=0x7f5eb8009250 comp rx=0 tx=0).stop 2024-04-25T17:09:01.642 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:00.881+0000 7f5ecd685700 1 -- 172.21.15.37:0/1180420842 shutdown_connections 2024-04-25T17:09:01.642 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:00.881+0000 7f5ecd685700 1 --2- 172.21.15.37:0/1180420842 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ec8076c10 0x7f5ec8105440 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:01.642 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:00.881+0000 7f5ecd685700 1 -- 172.21.15.37:0/1180420842 >> 172.21.15.37:0/1180420842 conn(0x7f5ec80fcef0 msgr2=0x7f5ec80ff300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:09:01.642 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:00.881+0000 7f5ecd685700 1 -- 172.21.15.37:0/1180420842 shutdown_connections 2024-04-25T17:09:01.642 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:00.881+0000 7f5ecd685700 1 -- 172.21.15.37:0/1180420842 wait complete. 2024-04-25T17:09:01.642 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:00.881+0000 7f5ecd685700 1 Processor -- start 2024-04-25T17:09:01.643 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:00.881+0000 7f5ecd685700 1 -- start start 2024-04-25T17:09:01.643 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:00.882+0000 7f5ecd685700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ec8076c10 0x7f5ec8102d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:01.643 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:00.882+0000 7f5ecd685700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec81032d0 con 0x7f5ec8076c10 2024-04-25T17:09:01.643 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:00.882+0000 7f5ec6ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ec8076c10 0x7f5ec8102d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:01.643 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:00.882+0000 7f5ec6ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ec8076c10 0x7f5ec8102d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41664/0 (socket says 172.21.15.37:41664) 2024-04-25T17:09:01.643 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:00.882+0000 7f5ec6ffd700 1 -- 172.21.15.37:0/287616283 learned_addr learned my addr 172.21.15.37:0/287616283 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:09:01.643 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:00.882+0000 7f5ec6ffd700 1 -- 172.21.15.37:0/287616283 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb80094f0 con 0x7f5ec8076c10 2024-04-25T17:09:01.643 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:00.882+0000 7f5ec6ffd700 1 --2- 172.21.15.37:0/287616283 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ec8076c10 0x7f5ec8102d90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5eb8006b00 tx=0x7f5eb8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:01.643 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:00.882+0000 7f5eaf7fe700 1 -- 172.21.15.37:0/287616283 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5eb80107c0 con 0x7f5ec8076c10 2024-04-25T17:09:01.643 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:00.882+0000 7f5eaf7fe700 1 -- 172.21.15.37:0/287616283 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f5eb8010db0 con 0x7f5ec8076c10 2024-04-25T17:09:01.643 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:00.882+0000 7f5ecd685700 1 -- 172.21.15.37:0/287616283 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ec81013a0 con 0x7f5ec8076c10 2024-04-25T17:09:01.643 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:00.882+0000 7f5eaf7fe700 1 -- 172.21.15.37:0/287616283 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5eb801acf0 con 0x7f5ec8076c10 2024-04-25T17:09:01.643 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:00.883+0000 7f5ecd685700 1 -- 172.21.15.37:0/287616283 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ec8101890 con 0x7f5ec8076c10 2024-04-25T17:09:01.643 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:00.883+0000 7f5eaf7fe700 1 -- 172.21.15.37:0/287616283 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 4) v1 ==== 43365+0+0 (secure 0 0 0) 0x7f5eb80193c0 con 0x7f5ec8076c10 2024-04-25T17:09:01.643 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:00.883+0000 7f5eaf7fe700 1 --2- 172.21.15.37:0/287616283 >> [v2:172.21.15.37:6800/2509847167,v1:172.21.15.37:6801/2509847167] conn(0x7f5eb0036850 0x7f5eb0038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:01.644 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:00.883+0000 7f5eaf7fe700 1 -- 172.21.15.37:0/287616283 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f5eb801a530 con 0x7f5ec8076c10 2024-04-25T17:09:01.644 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:00.884+0000 7f5ec67fc700 1 --2- 172.21.15.37:0/287616283 >> [v2:172.21.15.37:6800/2509847167,v1:172.21.15.37:6801/2509847167] conn(0x7f5eb0036850 0x7f5eb0038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:01.644 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:00.884+0000 7f5ecd685700 1 -- 172.21.15.37:0/287616283 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ec804bed0 con 0x7f5ec8076c10 2024-04-25T17:09:01.644 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:00.884+0000 7f5ec67fc700 1 --2- 172.21.15.37:0/287616283 >> [v2:172.21.15.37:6800/2509847167,v1:172.21.15.37:6801/2509847167] conn(0x7f5eb0036850 0x7f5eb0038d00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc009990 tx=0x7f5ebc006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:01.644 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:00.888+0000 7f5eaf7fe700 1 -- 172.21.15.37:0/287616283 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f5eb8022930 con 0x7f5ec8076c10 2024-04-25T17:09:01.644 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:01.086+0000 7f5ecd685700 1 -- 172.21.15.37:0/287616283 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f5ec8101cf0 con 0x7f5ec8076c10 2024-04-25T17:09:01.644 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:01.086+0000 7f5eaf7fe700 1 -- 172.21.15.37:0/287616283 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7f5eb8049020 con 0x7f5ec8076c10 2024-04-25T17:09:01.644 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:01.088+0000 7f5ecd685700 1 -- 172.21.15.37:0/287616283 >> [v2:172.21.15.37:6800/2509847167,v1:172.21.15.37:6801/2509847167] conn(0x7f5eb0036850 msgr2=0x7f5eb0038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:01.644 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:01.088+0000 7f5ecd685700 1 --2- 172.21.15.37:0/287616283 >> [v2:172.21.15.37:6800/2509847167,v1:172.21.15.37:6801/2509847167] conn(0x7f5eb0036850 0x7f5eb0038d00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc009990 tx=0x7f5ebc006e40 comp rx=0 tx=0).stop 2024-04-25T17:09:01.644 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:01.088+0000 7f5ecd685700 1 -- 172.21.15.37:0/287616283 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ec8076c10 msgr2=0x7f5ec8102d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:01.644 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:01.088+0000 7f5ecd685700 1 --2- 172.21.15.37:0/287616283 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ec8076c10 0x7f5ec8102d90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5eb8006b00 tx=0x7f5eb8009250 comp rx=0 tx=0).stop 2024-04-25T17:09:01.644 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:01.089+0000 7f5ecd685700 1 -- 172.21.15.37:0/287616283 shutdown_connections 2024-04-25T17:09:01.644 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:01.089+0000 7f5ecd685700 1 --2- 172.21.15.37:0/287616283 >> [v2:172.21.15.37:6800/2509847167,v1:172.21.15.37:6801/2509847167] conn(0x7f5eb0036850 0x7f5eb0038d00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:01.644 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:01.089+0000 7f5ecd685700 1 --2- 172.21.15.37:0/287616283 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ec8076c10 0x7f5ec8102d90 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:01.644 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:01.089+0000 7f5ecd685700 1 -- 172.21.15.37:0/287616283 >> 172.21.15.37:0/287616283 conn(0x7f5ec80fcef0 msgr2=0x7f5ec80fd9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:09:01.645 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:01.089+0000 7f5ecd685700 1 -- 172.21.15.37:0/287616283 shutdown_connections 2024-04-25T17:09:01.645 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:01.089+0000 7f5ecd685700 1 -- 172.21.15.37:0/287616283 wait complete. 2024-04-25T17:09:01.645 INFO:teuthology.orchestra.run.smithi037.stdout:Enabling cephadm module... 2024-04-25T17:09:02.570 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:02 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/749189857' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-04-25T17:09:02.903 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:02.058+0000 7feebcee0700 1 Processor -- start 2024-04-25T17:09:02.927 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:02.058+0000 7feebcee0700 1 -- start start 2024-04-25T17:09:02.928 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:02.058+0000 7feebcee0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeb8102880 0x7feeb8102c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:02.928 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:02.058+0000 7feebcee0700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb81031d0 con 0x7feeb8102880 2024-04-25T17:09:02.928 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:02.058+0000 7feeb659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeb8102880 0x7feeb8102c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:02.928 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:02.058+0000 7feeb659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeb8102880 0x7feeb8102c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41674/0 (socket says 172.21.15.37:41674) 2024-04-25T17:09:02.928 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:02.058+0000 7feeb659c700 1 -- 172.21.15.37:0/1548967002 learned_addr learned my addr 172.21.15.37:0/1548967002 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:09:02.928 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:02.059+0000 7feeb659c700 1 -- 172.21.15.37:0/1548967002 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb8103310 con 0x7feeb8102880 2024-04-25T17:09:02.928 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:02.059+0000 7feeb659c700 1 --2- 172.21.15.37:0/1548967002 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeb8102880 0x7feeb8102c90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7feea80098e0 tx=0x7feea8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab56858acd5b3679 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:02.928 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:02.059+0000 7feeb559a700 1 -- 172.21.15.37:0/1548967002 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feea800b860 con 0x7feeb8102880 2024-04-25T17:09:02.928 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:02.059+0000 7feeb559a700 1 -- 172.21.15.37:0/1548967002 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7feea800be50 con 0x7feeb8102880 2024-04-25T17:09:02.928 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:02.059+0000 7feeb559a700 1 -- 172.21.15.37:0/1548967002 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feea8010380 con 0x7feeb8102880 2024-04-25T17:09:02.928 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:02.060+0000 7feebcee0700 1 -- 172.21.15.37:0/1548967002 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeb8102880 msgr2=0x7feeb8102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:02.928 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:02.060+0000 7feebcee0700 1 --2- 172.21.15.37:0/1548967002 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeb8102880 0x7feeb8102c90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7feea80098e0 tx=0x7feea8009250 comp rx=0 tx=0).stop 2024-04-25T17:09:02.928 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:02.060+0000 7feebcee0700 1 -- 172.21.15.37:0/1548967002 shutdown_connections 2024-04-25T17:09:02.929 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:02.060+0000 7feebcee0700 1 --2- 172.21.15.37:0/1548967002 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeb8102880 0x7feeb8102c90 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:02.929 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:02.060+0000 7feebcee0700 1 -- 172.21.15.37:0/1548967002 >> 172.21.15.37:0/1548967002 conn(0x7feeb80fe060 msgr2=0x7feeb8100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:09:02.929 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:02.060+0000 7feebcee0700 1 -- 172.21.15.37:0/1548967002 shutdown_connections 2024-04-25T17:09:02.929 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:02.060+0000 7feebcee0700 1 -- 172.21.15.37:0/1548967002 wait complete. 2024-04-25T17:09:02.929 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:02.060+0000 7feebcee0700 1 Processor -- start 2024-04-25T17:09:02.929 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:02.060+0000 7feebcee0700 1 -- start start 2024-04-25T17:09:02.929 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:02.060+0000 7feebcee0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeb8102880 0x7feeb8078c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:02.929 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:02.060+0000 7feebcee0700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb8079160 con 0x7feeb8102880 2024-04-25T17:09:02.929 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:02.061+0000 7feeb659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeb8102880 0x7feeb8078c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:02.929 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:02.061+0000 7feeb659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeb8102880 0x7feeb8078c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41680/0 (socket says 172.21.15.37:41680) 2024-04-25T17:09:02.929 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:02.061+0000 7feeb659c700 1 -- 172.21.15.37:0/749189857 learned_addr learned my addr 172.21.15.37:0/749189857 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:09:02.929 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:02.061+0000 7feeb659c700 1 -- 172.21.15.37:0/749189857 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea80094f0 con 0x7feeb8102880 2024-04-25T17:09:02.929 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:02.061+0000 7feeb659c700 1 --2- 172.21.15.37:0/749189857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeb8102880 0x7feeb8078c20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7feea800b440 tx=0x7feea8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:02.929 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:02.061+0000 7feea6ffd700 1 -- 172.21.15.37:0/749189857 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feea8010760 con 0x7feeb8102880 2024-04-25T17:09:02.930 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:02.061+0000 7feea6ffd700 1 -- 172.21.15.37:0/749189857 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7feea8010d50 con 0x7feeb8102880 2024-04-25T17:09:02.930 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:02.061+0000 7feebcee0700 1 -- 172.21.15.37:0/749189857 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeb80771d0 con 0x7feeb8102880 2024-04-25T17:09:02.930 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:02.061+0000 7feea6ffd700 1 -- 172.21.15.37:0/749189857 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feea801ae20 con 0x7feeb8102880 2024-04-25T17:09:02.930 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:02.061+0000 7feebcee0700 1 -- 172.21.15.37:0/749189857 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeb80776c0 con 0x7feeb8102880 2024-04-25T17:09:02.930 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:02.062+0000 7feea6ffd700 1 -- 172.21.15.37:0/749189857 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 4) v1 ==== 43365+0+0 (secure 0 0 0) 0x7feea802e440 con 0x7feeb8102880 2024-04-25T17:09:02.930 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:02.062+0000 7feea6ffd700 1 --2- 172.21.15.37:0/749189857 >> [v2:172.21.15.37:6800/2509847167,v1:172.21.15.37:6801/2509847167] conn(0x7feea0036850 0x7feea0038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:02.930 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:02.062+0000 7feea6ffd700 1 -- 172.21.15.37:0/749189857 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7feea804a520 con 0x7feeb8102880 2024-04-25T17:09:02.930 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:02.062+0000 7feeb5d9b700 1 --2- 172.21.15.37:0/749189857 >> [v2:172.21.15.37:6800/2509847167,v1:172.21.15.37:6801/2509847167] conn(0x7feea0036850 0x7feea0038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:02.930 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:02.062+0000 7feebcee0700 1 -- 172.21.15.37:0/749189857 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeb804bed0 con 0x7feeb8102880 2024-04-25T17:09:02.930 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:02.063+0000 7feeb5d9b700 1 --2- 172.21.15.37:0/749189857 >> [v2:172.21.15.37:6800/2509847167,v1:172.21.15.37:6801/2509847167] conn(0x7feea0036850 0x7feea0038d00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7feeac009990 tx=0x7feeac006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:02.930 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:02.067+0000 7feea6ffd700 1 -- 172.21.15.37:0/749189857 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7feea8018940 con 0x7feeb8102880 2024-04-25T17:09:02.930 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:02.316+0000 7feebcee0700 1 -- 172.21.15.37:0/749189857 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7feeb8077b40 con 0x7feeb8102880 2024-04-25T17:09:02.930 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:02.368+0000 7feea6ffd700 1 -- 172.21.15.37:0/749189857 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 5) v1 ==== 43376+0+0 (secure 0 0 0) 0x7feea802ad40 con 0x7feeb8102880 2024-04-25T17:09:02.930 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:02.370+0000 7feea6ffd700 1 -- 172.21.15.37:0/749189857 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7feea802f950 con 0x7feeb8102880 2024-04-25T17:09:02.931 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:02.372+0000 7feebcee0700 1 -- 172.21.15.37:0/749189857 >> [v2:172.21.15.37:6800/2509847167,v1:172.21.15.37:6801/2509847167] conn(0x7feea0036850 msgr2=0x7feea0038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:02.931 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:02.372+0000 7feebcee0700 1 --2- 172.21.15.37:0/749189857 >> [v2:172.21.15.37:6800/2509847167,v1:172.21.15.37:6801/2509847167] conn(0x7feea0036850 0x7feea0038d00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7feeac009990 tx=0x7feeac006e40 comp rx=0 tx=0).stop 2024-04-25T17:09:02.931 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:02.372+0000 7feebcee0700 1 -- 172.21.15.37:0/749189857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeb8102880 msgr2=0x7feeb8078c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:02.931 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:02.372+0000 7feebcee0700 1 --2- 172.21.15.37:0/749189857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeb8102880 0x7feeb8078c20 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7feea800b440 tx=0x7feea8009250 comp rx=0 tx=0).stop 2024-04-25T17:09:02.931 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:02.372+0000 7feebcee0700 1 -- 172.21.15.37:0/749189857 shutdown_connections 2024-04-25T17:09:02.931 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:02.372+0000 7feebcee0700 1 --2- 172.21.15.37:0/749189857 >> [v2:172.21.15.37:6800/2509847167,v1:172.21.15.37:6801/2509847167] conn(0x7feea0036850 0x7feea0038d00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:02.931 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:02.372+0000 7feebcee0700 1 --2- 172.21.15.37:0/749189857 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feeb8102880 0x7feeb8078c20 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:02.931 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:02.372+0000 7feebcee0700 1 -- 172.21.15.37:0/749189857 >> 172.21.15.37:0/749189857 conn(0x7feeb80fe060 msgr2=0x7feeb80feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:09:02.931 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:02.372+0000 7feebcee0700 1 -- 172.21.15.37:0/749189857 shutdown_connections 2024-04-25T17:09:02.931 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:02.372+0000 7feebcee0700 1 -- 172.21.15.37:0/749189857 wait complete. 2024-04-25T17:09:03.629 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:03 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/749189857' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-04-25T17:09:03.629 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:03 smithi037 ceph-mon[26472]: mgrmap e5: smithi037.txrgxl(active, since 10s) 2024-04-25T17:09:04.235 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout { 2024-04-25T17:09:04.235 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-04-25T17:09:04.235 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-25T17:09:04.235 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "active_name": "smithi037.txrgxl", 2024-04-25T17:09:04.235 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-25T17:09:04.235 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout } 2024-04-25T17:09:04.235 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:03.321+0000 7fc57db37700 1 Processor -- start 2024-04-25T17:09:04.235 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:03.321+0000 7fc57db37700 1 -- start start 2024-04-25T17:09:04.236 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:03.321+0000 7fc57db37700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc578102c50 0x7fc578103060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:04.236 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:03.321+0000 7fc57db37700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc578103630 con 0x7fc578102c50 2024-04-25T17:09:04.236 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:03.321+0000 7fc5777fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc578102c50 0x7fc578103060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:04.236 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:03.321+0000 7fc5777fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc578102c50 0x7fc578103060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41710/0 (socket says 172.21.15.37:41710) 2024-04-25T17:09:04.236 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:03.321+0000 7fc5777fe700 1 -- 172.21.15.37:0/736070869 learned_addr learned my addr 172.21.15.37:0/736070869 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:09:04.236 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:03.322+0000 7fc5777fe700 1 -- 172.21.15.37:0/736070869 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc578103770 con 0x7fc578102c50 2024-04-25T17:09:04.236 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:03.322+0000 7fc5777fe700 1 --2- 172.21.15.37:0/736070869 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc578102c50 0x7fc578103060 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc568009e50 tx=0x7fc568009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50f5776b8311e137 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:04.236 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:03.322+0000 7fc5767fc700 1 -- 172.21.15.37:0/736070869 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc5680092e0 con 0x7fc578102c50 2024-04-25T17:09:04.236 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:03.322+0000 7fc5767fc700 1 -- 172.21.15.37:0/736070869 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fc568012430 con 0x7fc578102c50 2024-04-25T17:09:04.236 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:03.322+0000 7fc5767fc700 1 -- 172.21.15.37:0/736070869 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc5680075c0 con 0x7fc578102c50 2024-04-25T17:09:04.236 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:03.323+0000 7fc57db37700 1 -- 172.21.15.37:0/736070869 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc578102c50 msgr2=0x7fc578103060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:04.236 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:03.323+0000 7fc57db37700 1 --2- 172.21.15.37:0/736070869 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc578102c50 0x7fc578103060 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc568009e50 tx=0x7fc568009840 comp rx=0 tx=0).stop 2024-04-25T17:09:04.236 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:03.323+0000 7fc57db37700 1 -- 172.21.15.37:0/736070869 shutdown_connections 2024-04-25T17:09:04.236 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:03.323+0000 7fc57db37700 1 --2- 172.21.15.37:0/736070869 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc578102c50 0x7fc578103060 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:04.237 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:03.323+0000 7fc57db37700 1 -- 172.21.15.37:0/736070869 >> 172.21.15.37:0/736070869 conn(0x7fc5780fc6b0 msgr2=0x7fc5780feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:09:04.237 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:03.323+0000 7fc57db37700 1 -- 172.21.15.37:0/736070869 shutdown_connections 2024-04-25T17:09:04.237 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:03.323+0000 7fc57db37700 1 -- 172.21.15.37:0/736070869 wait complete. 2024-04-25T17:09:04.237 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:03.323+0000 7fc57db37700 1 Processor -- start 2024-04-25T17:09:04.237 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:03.324+0000 7fc57db37700 1 -- start start 2024-04-25T17:09:04.237 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:03.324+0000 7fc57db37700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc578102c50 0x7fc578113800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:04.237 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:03.324+0000 7fc57db37700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc578113d40 con 0x7fc578102c50 2024-04-25T17:09:04.237 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:03.324+0000 7fc5777fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc578102c50 0x7fc578113800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:04.237 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:03.324+0000 7fc5777fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc578102c50 0x7fc578113800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41724/0 (socket says 172.21.15.37:41724) 2024-04-25T17:09:04.237 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:03.324+0000 7fc5777fe700 1 -- 172.21.15.37:0/3902975406 learned_addr learned my addr 172.21.15.37:0/3902975406 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:09:04.237 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:03.324+0000 7fc5777fe700 1 -- 172.21.15.37:0/3902975406 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc568009ae0 con 0x7fc578102c50 2024-04-25T17:09:04.237 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:03.324+0000 7fc5777fe700 1 --2- 172.21.15.37:0/3902975406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc578102c50 0x7fc578113800 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc568009fd0 tx=0x7fc568009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:04.237 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:03.324+0000 7fc56ffff700 1 -- 172.21.15.37:0/3902975406 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc5680092e0 con 0x7fc578102c50 2024-04-25T17:09:04.237 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:03.325+0000 7fc56ffff700 1 -- 172.21.15.37:0/3902975406 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fc568007cc0 con 0x7fc578102c50 2024-04-25T17:09:04.237 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:03.325+0000 7fc57db37700 1 -- 172.21.15.37:0/3902975406 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc578113f40 con 0x7fc578102c50 2024-04-25T17:09:04.238 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:03.325+0000 7fc56ffff700 1 -- 172.21.15.37:0/3902975406 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc56801c9a0 con 0x7fc578102c50 2024-04-25T17:09:04.238 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:03.325+0000 7fc57db37700 1 -- 172.21.15.37:0/3902975406 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc578114ab0 con 0x7fc578102c50 2024-04-25T17:09:04.238 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:03.326+0000 7fc56ffff700 1 -- 172.21.15.37:0/3902975406 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 43376+0+0 (secure 0 0 0) 0x7fc568019070 con 0x7fc578102c50 2024-04-25T17:09:04.238 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:03.326+0000 7fc57db37700 1 -- 172.21.15.37:0/3902975406 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc57805f5c0 con 0x7fc578102c50 2024-04-25T17:09:04.238 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:03.326+0000 7fc56ffff700 1 --2- 172.21.15.37:0/3902975406 >> [v2:172.21.15.37:6800/2509847167,v1:172.21.15.37:6801/2509847167] conn(0x7fc564036850 0x7fc564038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:04.238 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:03.326+0000 7fc56ffff700 1 -- 172.21.15.37:0/3902975406 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fc568049d30 con 0x7fc578102c50 2024-04-25T17:09:04.238 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:03.326+0000 7fc576ffd700 1 -- 172.21.15.37:0/3902975406 >> [v2:172.21.15.37:6800/2509847167,v1:172.21.15.37:6801/2509847167] conn(0x7fc564036850 msgr2=0x7fc564038d00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.37:6800/2509847167 2024-04-25T17:09:04.238 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:03.326+0000 7fc576ffd700 1 --2- 172.21.15.37:0/3902975406 >> [v2:172.21.15.37:6800/2509847167,v1:172.21.15.37:6801/2509847167] conn(0x7fc564036850 0x7fc564038d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T17:09:04.238 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:03.331+0000 7fc56ffff700 1 -- 172.21.15.37:0/3902975406 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fc568019910 con 0x7fc578102c50 2024-04-25T17:09:04.238 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:03.527+0000 7fc576ffd700 1 -- 172.21.15.37:0/3902975406 >> [v2:172.21.15.37:6800/2509847167,v1:172.21.15.37:6801/2509847167] conn(0x7fc564036850 msgr2=0x7fc564038d00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.37:6800/2509847167 2024-04-25T17:09:04.238 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:03.527+0000 7fc576ffd700 1 --2- 172.21.15.37:0/3902975406 >> [v2:172.21.15.37:6800/2509847167,v1:172.21.15.37:6801/2509847167] conn(0x7fc564036850 0x7fc564038d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T17:09:04.238 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:03.629+0000 7fc57db37700 1 -- 172.21.15.37:0/3902975406 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fc578114e30 con 0x7fc578102c50 2024-04-25T17:09:04.238 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:03.633+0000 7fc56ffff700 1 -- 172.21.15.37:0/3902975406 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7fc568020080 con 0x7fc578102c50 2024-04-25T17:09:04.238 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:03.637+0000 7fc57db37700 1 -- 172.21.15.37:0/3902975406 >> [v2:172.21.15.37:6800/2509847167,v1:172.21.15.37:6801/2509847167] conn(0x7fc564036850 msgr2=0x7fc564038d00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T17:09:04.239 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:03.637+0000 7fc57db37700 1 --2- 172.21.15.37:0/3902975406 >> [v2:172.21.15.37:6800/2509847167,v1:172.21.15.37:6801/2509847167] conn(0x7fc564036850 0x7fc564038d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:04.239 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:03.637+0000 7fc57db37700 1 -- 172.21.15.37:0/3902975406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc578102c50 msgr2=0x7fc578113800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:04.239 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:03.637+0000 7fc57db37700 1 --2- 172.21.15.37:0/3902975406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc578102c50 0x7fc578113800 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc568009fd0 tx=0x7fc568009840 comp rx=0 tx=0).stop 2024-04-25T17:09:04.239 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:03.638+0000 7fc57db37700 1 -- 172.21.15.37:0/3902975406 shutdown_connections 2024-04-25T17:09:04.239 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:03.638+0000 7fc57db37700 1 --2- 172.21.15.37:0/3902975406 >> [v2:172.21.15.37:6800/2509847167,v1:172.21.15.37:6801/2509847167] conn(0x7fc564036850 0x7fc564038d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:04.239 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:03.638+0000 7fc57db37700 1 --2- 172.21.15.37:0/3902975406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc578102c50 0x7fc578113800 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:04.239 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:03.638+0000 7fc57db37700 1 -- 172.21.15.37:0/3902975406 >> 172.21.15.37:0/3902975406 conn(0x7fc5780fc6b0 msgr2=0x7fc5780fd1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:09:04.239 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:03.638+0000 7fc57db37700 1 -- 172.21.15.37:0/3902975406 shutdown_connections 2024-04-25T17:09:04.239 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:03.638+0000 7fc57db37700 1 -- 172.21.15.37:0/3902975406 wait complete. 2024-04-25T17:09:04.239 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for the mgr to restart... 2024-04-25T17:09:04.239 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for mgr epoch 5... 2024-04-25T17:09:04.632 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:04 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/3902975406' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-25T17:09:09.504 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:09 smithi037 ceph-mon[26472]: Active manager daemon smithi037.txrgxl restarted 2024-04-25T17:09:09.504 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:09 smithi037 ceph-mon[26472]: Activating manager daemon smithi037.txrgxl 2024-04-25T17:09:09.504 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:09 smithi037 ceph-mon[26472]: osdmap e2: 0 total, 0 up, 0 in 2024-04-25T17:09:09.504 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:09 smithi037 ceph-mon[26472]: mgrmap e6: smithi037.txrgxl(active, starting, since 0.00343295s) 2024-04-25T17:09:09.504 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:09 smithi037 ceph-mon[26472]: from='mgr.14118 172.21.15.37:0/1694910703' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mon metadata", "id": "smithi037"}]: dispatch 2024-04-25T17:09:09.504 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:09 smithi037 ceph-mon[26472]: from='mgr.14118 172.21.15.37:0/1694910703' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mgr metadata", "who": "smithi037.txrgxl", "id": "smithi037.txrgxl"}]: dispatch 2024-04-25T17:09:09.504 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:09 smithi037 ceph-mon[26472]: from='mgr.14118 172.21.15.37:0/1694910703' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-25T17:09:09.504 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:09 smithi037 ceph-mon[26472]: from='mgr.14118 172.21.15.37:0/1694910703' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-25T17:09:09.504 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:09 smithi037 ceph-mon[26472]: from='mgr.14118 172.21.15.37:0/1694910703' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-25T17:09:09.504 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:09 smithi037 ceph-mon[26472]: Manager daemon smithi037.txrgxl is now available 2024-04-25T17:09:09.504 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:09 smithi037 ceph-mon[26472]: from='mgr.14118 172.21.15.37:0/1694910703' entity='mgr.smithi037.txrgxl' 2024-04-25T17:09:09.504 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:09 smithi037 ceph-mon[26472]: from='mgr.14118 172.21.15.37:0/1694910703' entity='mgr.smithi037.txrgxl' 2024-04-25T17:09:09.505 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:09 smithi037 ceph-mon[26472]: from='mgr.14118 172.21.15.37:0/1694910703' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:09:09.505 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:09 smithi037 ceph-mon[26472]: from='mgr.14118 172.21.15.37:0/1694910703' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:09:09.505 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:09 smithi037 ceph-mon[26472]: from='mgr.14118 172.21.15.37:0/1694910703' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:09:09.505 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:09 smithi037 ceph-mon[26472]: from='mgr.14118 172.21.15.37:0/1694910703' entity='mgr.smithi037.txrgxl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi037.txrgxl/mirror_snapshot_schedule"}]: dispatch 2024-04-25T17:09:09.505 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:09 smithi037 ceph-mon[26472]: from='mgr.14118 172.21.15.37:0/1694910703' entity='mgr.smithi037.txrgxl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi037.txrgxl/trash_purge_schedule"}]: dispatch 2024-04-25T17:09:10.407 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:10 smithi037 ceph-mon[26472]: Found migration_current of "None". Setting to last migration. 2024-04-25T17:09:10.407 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:10 smithi037 ceph-mon[26472]: from='mgr.14118 172.21.15.37:0/1694910703' entity='mgr.smithi037.txrgxl' 2024-04-25T17:09:10.408 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:10 smithi037 ceph-mon[26472]: from='mgr.14118 172.21.15.37:0/1694910703' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:09:10.408 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:10 smithi037 ceph-mon[26472]: mgrmap e7: smithi037.txrgxl(active, since 1.00666s) 2024-04-25T17:09:10.645 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout { 2024-04-25T17:09:10.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-04-25T17:09:10.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-25T17:09:10.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout } 2024-04-25T17:09:10.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:04.679+0000 7ff0e85f6700 1 Processor -- start 2024-04-25T17:09:10.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:04.679+0000 7ff0e85f6700 1 -- start start 2024-04-25T17:09:10.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:04.680+0000 7ff0e85f6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0e0078c60 0x7ff0e0077210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:10.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:04.680+0000 7ff0e85f6700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e0079070 con 0x7ff0e0078c60 2024-04-25T17:09:10.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:04.680+0000 7ff0e6392700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0e0078c60 0x7ff0e0077210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:10.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:04.680+0000 7ff0e6392700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0e0078c60 0x7ff0e0077210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41726/0 (socket says 172.21.15.37:41726) 2024-04-25T17:09:10.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:04.680+0000 7ff0e6392700 1 -- 172.21.15.37:0/2687683909 learned_addr learned my addr 172.21.15.37:0/2687683909 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:09:10.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:04.680+0000 7ff0e6392700 1 -- 172.21.15.37:0/2687683909 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e0077750 con 0x7ff0e0078c60 2024-04-25T17:09:10.653 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:04.680+0000 7ff0e6392700 1 --2- 172.21.15.37:0/2687683909 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0e0078c60 0x7ff0e0077210 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc0098e0 tx=0x7ff0dc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bfd59885c0e71f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:10.654 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:04.681+0000 7ff0e5390700 1 -- 172.21.15.37:0/2687683909 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff0dc00b860 con 0x7ff0e0078c60 2024-04-25T17:09:10.654 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:04.681+0000 7ff0e5390700 1 -- 172.21.15.37:0/2687683909 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7ff0dc00be50 con 0x7ff0e0078c60 2024-04-25T17:09:10.654 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:04.681+0000 7ff0e5390700 1 -- 172.21.15.37:0/2687683909 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff0dc010380 con 0x7ff0e0078c60 2024-04-25T17:09:10.654 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:04.681+0000 7ff0e85f6700 1 -- 172.21.15.37:0/2687683909 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0e0078c60 msgr2=0x7ff0e0077210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:10.654 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:04.681+0000 7ff0e85f6700 1 --2- 172.21.15.37:0/2687683909 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0e0078c60 0x7ff0e0077210 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc0098e0 tx=0x7ff0dc009250 comp rx=0 tx=0).stop 2024-04-25T17:09:10.654 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:04.681+0000 7ff0e85f6700 1 -- 172.21.15.37:0/2687683909 shutdown_connections 2024-04-25T17:09:10.654 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:04.681+0000 7ff0e85f6700 1 --2- 172.21.15.37:0/2687683909 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0e0078c60 0x7ff0e0077210 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:10.654 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:04.681+0000 7ff0e85f6700 1 -- 172.21.15.37:0/2687683909 >> 172.21.15.37:0/2687683909 conn(0x7ff0e00fe010 msgr2=0x7ff0e0100420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:09:10.654 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:04.681+0000 7ff0e85f6700 1 -- 172.21.15.37:0/2687683909 shutdown_connections 2024-04-25T17:09:10.654 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:04.681+0000 7ff0e85f6700 1 -- 172.21.15.37:0/2687683909 wait complete. 2024-04-25T17:09:10.654 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:04.682+0000 7ff0e85f6700 1 Processor -- start 2024-04-25T17:09:10.654 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:04.682+0000 7ff0e85f6700 1 -- start start 2024-04-25T17:09:10.654 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:04.682+0000 7ff0e85f6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0e0078c60 0x7ff0e0113810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:10.655 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:04.682+0000 7ff0e85f6700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e0113d50 con 0x7ff0e0078c60 2024-04-25T17:09:10.655 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:04.682+0000 7ff0e6392700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0e0078c60 0x7ff0e0113810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:10.655 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:04.682+0000 7ff0e6392700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0e0078c60 0x7ff0e0113810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41740/0 (socket says 172.21.15.37:41740) 2024-04-25T17:09:10.655 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:04.682+0000 7ff0e6392700 1 -- 172.21.15.37:0/1613909979 learned_addr learned my addr 172.21.15.37:0/1613909979 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:09:10.655 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:04.683+0000 7ff0e6392700 1 -- 172.21.15.37:0/1613909979 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0dc0094f0 con 0x7ff0e0078c60 2024-04-25T17:09:10.655 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:04.683+0000 7ff0e6392700 1 --2- 172.21.15.37:0/1613909979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0e0078c60 0x7ff0e0113810 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc006fd0 tx=0x7ff0dc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:10.655 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:04.683+0000 7ff0d6ffd700 1 -- 172.21.15.37:0/1613909979 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff0dc0107c0 con 0x7ff0e0078c60 2024-04-25T17:09:10.655 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:04.683+0000 7ff0d6ffd700 1 -- 172.21.15.37:0/1613909979 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7ff0dc010db0 con 0x7ff0e0078c60 2024-04-25T17:09:10.655 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:04.683+0000 7ff0e85f6700 1 -- 172.21.15.37:0/1613909979 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0e0113f50 con 0x7ff0e0078c60 2024-04-25T17:09:10.655 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:04.683+0000 7ff0e85f6700 1 -- 172.21.15.37:0/1613909979 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0e0114ac0 con 0x7ff0e0078c60 2024-04-25T17:09:10.655 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:04.684+0000 7ff0d6ffd700 1 -- 172.21.15.37:0/1613909979 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff0dc01ada0 con 0x7ff0e0078c60 2024-04-25T17:09:10.655 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:04.684+0000 7ff0d6ffd700 1 -- 172.21.15.37:0/1613909979 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 43376+0+0 (secure 0 0 0) 0x7ff0dc0194b0 con 0x7ff0e0078c60 2024-04-25T17:09:10.655 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:04.684+0000 7ff0d6ffd700 1 --2- 172.21.15.37:0/1613909979 >> [v2:172.21.15.37:6800/2509847167,v1:172.21.15.37:6801/2509847167] conn(0x7ff0cc036850 0x7ff0cc038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:10.655 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:04.684+0000 7ff0d6ffd700 1 -- 172.21.15.37:0/1613909979 --> [v2:172.21.15.37:6800/2509847167,v1:172.21.15.37:6801/2509847167] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff0cc039410 con 0x7ff0cc036850 2024-04-25T17:09:10.655 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:04.684+0000 7ff0d6ffd700 1 -- 172.21.15.37:0/1613909979 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7ff0dc049d50 con 0x7ff0e0078c60 2024-04-25T17:09:10.656 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:04.684+0000 7ff0e5b91700 1 -- 172.21.15.37:0/1613909979 >> [v2:172.21.15.37:6800/2509847167,v1:172.21.15.37:6801/2509847167] conn(0x7ff0cc036850 msgr2=0x7ff0cc038d00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.37:6800/2509847167 2024-04-25T17:09:10.656 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:04.684+0000 7ff0e5b91700 1 --2- 172.21.15.37:0/1613909979 >> [v2:172.21.15.37:6800/2509847167,v1:172.21.15.37:6801/2509847167] conn(0x7ff0cc036850 0x7ff0cc038d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T17:09:10.656 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:04.885+0000 7ff0e5b91700 1 -- 172.21.15.37:0/1613909979 >> [v2:172.21.15.37:6800/2509847167,v1:172.21.15.37:6801/2509847167] conn(0x7ff0cc036850 msgr2=0x7ff0cc038d00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.37:6800/2509847167 2024-04-25T17:09:10.656 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:04.885+0000 7ff0e5b91700 1 --2- 172.21.15.37:0/1613909979 >> [v2:172.21.15.37:6800/2509847167,v1:172.21.15.37:6801/2509847167] conn(0x7ff0cc036850 0x7ff0cc038d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T17:09:10.656 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:05.286+0000 7ff0e5b91700 1 -- 172.21.15.37:0/1613909979 >> [v2:172.21.15.37:6800/2509847167,v1:172.21.15.37:6801/2509847167] conn(0x7ff0cc036850 msgr2=0x7ff0cc038d00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.37:6800/2509847167 2024-04-25T17:09:10.656 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:05.286+0000 7ff0e5b91700 1 --2- 172.21.15.37:0/1613909979 >> [v2:172.21.15.37:6800/2509847167,v1:172.21.15.37:6801/2509847167] conn(0x7ff0cc036850 0x7ff0cc038d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T17:09:10.656 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:06.087+0000 7ff0e5b91700 1 -- 172.21.15.37:0/1613909979 >> [v2:172.21.15.37:6800/2509847167,v1:172.21.15.37:6801/2509847167] conn(0x7ff0cc036850 msgr2=0x7ff0cc038d00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.37:6800/2509847167 2024-04-25T17:09:10.656 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:06.087+0000 7ff0e5b91700 1 --2- 172.21.15.37:0/1613909979 >> [v2:172.21.15.37:6800/2509847167,v1:172.21.15.37:6801/2509847167] conn(0x7ff0cc036850 0x7ff0cc038d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T17:09:10.656 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:07.688+0000 7ff0e5b91700 1 -- 172.21.15.37:0/1613909979 >> [v2:172.21.15.37:6800/2509847167,v1:172.21.15.37:6801/2509847167] conn(0x7ff0cc036850 msgr2=0x7ff0cc038d00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.37:6800/2509847167 2024-04-25T17:09:10.656 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:07.688+0000 7ff0e5b91700 1 --2- 172.21.15.37:0/1613909979 >> [v2:172.21.15.37:6800/2509847167,v1:172.21.15.37:6801/2509847167] conn(0x7ff0cc036850 0x7ff0cc038d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-25T17:09:10.656 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:09.104+0000 7ff0d6ffd700 1 -- 172.21.15.37:0/1613909979 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mgrmap(e 6) v1 ==== 43143+0+0 (secure 0 0 0) 0x7ff0dc00ed40 con 0x7ff0e0078c60 2024-04-25T17:09:10.656 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:09.104+0000 7ff0d6ffd700 1 -- 172.21.15.37:0/1613909979 >> [v2:172.21.15.37:6800/2509847167,v1:172.21.15.37:6801/2509847167] conn(0x7ff0cc036850 msgr2=0x7ff0cc038d00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T17:09:10.656 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:09.104+0000 7ff0d6ffd700 1 --2- 172.21.15.37:0/1613909979 >> [v2:172.21.15.37:6800/2509847167,v1:172.21.15.37:6801/2509847167] conn(0x7ff0cc036850 0x7ff0cc038d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:10.656 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:10.106+0000 7ff0d6ffd700 1 -- 172.21.15.37:0/1613909979 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 7) v1 ==== 43270+0+0 (secure 0 0 0) 0x7ff0dc01cc00 con 0x7ff0e0078c60 2024-04-25T17:09:10.656 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:10.106+0000 7ff0d6ffd700 1 --2- 172.21.15.37:0/1613909979 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7ff0cc039ff0 0x7ff0cc03c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:10.657 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:10.106+0000 7ff0d6ffd700 1 -- 172.21.15.37:0/1613909979 --> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff0cc039410 con 0x7ff0cc039ff0 2024-04-25T17:09:10.657 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:10.107+0000 7ff0e5b91700 1 --2- 172.21.15.37:0/1613909979 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7ff0cc039ff0 0x7ff0cc03c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:10.657 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:10.108+0000 7ff0e5b91700 1 --2- 172.21.15.37:0/1613909979 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7ff0cc039ff0 0x7ff0cc03c3d0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7ff0d00039d0 tx=0x7ff0d0009350 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:10.657 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:10.108+0000 7ff0d6ffd700 1 -- 172.21.15.37:0/1613909979 <== mgr.14118 v2:172.21.15.37:6800/3653320894 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7ff0cc039410 con 0x7ff0cc039ff0 2024-04-25T17:09:10.657 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:10.114+0000 7ff0e85f6700 1 -- 172.21.15.37:0/1613909979 --> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7ff0e01143e0 con 0x7ff0cc039ff0 2024-04-25T17:09:10.657 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:10.115+0000 7ff0d6ffd700 1 -- 172.21.15.37:0/1613909979 <== mgr.14118 v2:172.21.15.37:6800/3653320894 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7ff0e01143e0 con 0x7ff0cc039ff0 2024-04-25T17:09:10.657 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:10.115+0000 7ff0e85f6700 1 -- 172.21.15.37:0/1613909979 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7ff0cc039ff0 msgr2=0x7ff0cc03c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:10.657 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:10.115+0000 7ff0e85f6700 1 --2- 172.21.15.37:0/1613909979 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7ff0cc039ff0 0x7ff0cc03c3d0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7ff0d00039d0 tx=0x7ff0d0009350 comp rx=0 tx=0).stop 2024-04-25T17:09:10.657 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:10.115+0000 7ff0e85f6700 1 -- 172.21.15.37:0/1613909979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0e0078c60 msgr2=0x7ff0e0113810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:10.657 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:10.115+0000 7ff0e85f6700 1 --2- 172.21.15.37:0/1613909979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0e0078c60 0x7ff0e0113810 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc006fd0 tx=0x7ff0dc009250 comp rx=0 tx=0).stop 2024-04-25T17:09:10.657 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:10.115+0000 7ff0e85f6700 1 -- 172.21.15.37:0/1613909979 shutdown_connections 2024-04-25T17:09:10.657 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:10.115+0000 7ff0e85f6700 1 --2- 172.21.15.37:0/1613909979 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7ff0cc039ff0 0x7ff0cc03c3d0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:10.657 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:10.115+0000 7ff0e85f6700 1 --2- 172.21.15.37:0/1613909979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0e0078c60 0x7ff0e0113810 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:10.657 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:10.115+0000 7ff0e85f6700 1 --2- 172.21.15.37:0/1613909979 >> [v2:172.21.15.37:6800/2509847167,v1:172.21.15.37:6801/2509847167] conn(0x7ff0cc036850 0x7ff0cc038d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:10.657 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:10.115+0000 7ff0e85f6700 1 -- 172.21.15.37:0/1613909979 >> 172.21.15.37:0/1613909979 conn(0x7ff0e00fe010 msgr2=0x7ff0e00fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:09:10.658 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:10.115+0000 7ff0e85f6700 1 -- 172.21.15.37:0/1613909979 shutdown_connections 2024-04-25T17:09:10.658 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:10.115+0000 7ff0e85f6700 1 -- 172.21.15.37:0/1613909979 wait complete. 2024-04-25T17:09:10.658 INFO:teuthology.orchestra.run.smithi037.stdout:mgr epoch 5 is available 2024-04-25T17:09:10.658 INFO:teuthology.orchestra.run.smithi037.stdout:Setting orchestrator backend to cephadm... 2024-04-25T17:09:11.276 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:11 smithi037 ceph-mon[26472]: [25/Apr/2024:17:09:09] ENGINE Bus STARTING 2024-04-25T17:09:11.276 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:11 smithi037 ceph-mon[26472]: [25/Apr/2024:17:09:09] ENGINE Serving on https://172.21.15.37:7150 2024-04-25T17:09:11.277 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:11 smithi037 ceph-mon[26472]: [25/Apr/2024:17:09:09] ENGINE Bus STARTED 2024-04-25T17:09:11.277 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:11 smithi037 ceph-mon[26472]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-25T17:09:11.277 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:11 smithi037 ceph-mon[26472]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-25T17:09:11.789 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:11.054+0000 7f6fc0141700 1 Processor -- start 2024-04-25T17:09:11.789 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:11.055+0000 7f6fc0141700 1 -- start start 2024-04-25T17:09:11.789 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:11.055+0000 7f6fc0141700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fb8076c50 0x7f6fb8105400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:11.789 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:11.055+0000 7f6fc0141700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb8105940 con 0x7f6fb8076c50 2024-04-25T17:09:11.789 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:11.055+0000 7f6fbdedd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fb8076c50 0x7f6fb8105400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:11.789 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:11.055+0000 7f6fbdedd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fb8076c50 0x7f6fb8105400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46708/0 (socket says 172.21.15.37:46708) 2024-04-25T17:09:11.789 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:11.055+0000 7f6fbdedd700 1 -- 172.21.15.37:0/1445210622 learned_addr learned my addr 172.21.15.37:0/1445210622 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:09:11.789 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:11.055+0000 7f6fbdedd700 1 -- 172.21.15.37:0/1445210622 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb8105a80 con 0x7f6fb8076c50 2024-04-25T17:09:11.789 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:11.056+0000 7f6fbdedd700 1 --2- 172.21.15.37:0/1445210622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fb8076c50 0x7f6fb8105400 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6fb40098e0 tx=0x7f6fb4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12c5ed38359ad0be server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:11.790 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:11.056+0000 7f6fbcedb700 1 -- 172.21.15.37:0/1445210622 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6fb400b860 con 0x7f6fb8076c50 2024-04-25T17:09:11.790 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:11.056+0000 7f6fbcedb700 1 -- 172.21.15.37:0/1445210622 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f6fb400be50 con 0x7f6fb8076c50 2024-04-25T17:09:11.790 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:11.056+0000 7f6fbcedb700 1 -- 172.21.15.37:0/1445210622 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6fb4010380 con 0x7f6fb8076c50 2024-04-25T17:09:11.790 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:11.056+0000 7f6fc0141700 1 -- 172.21.15.37:0/1445210622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fb8076c50 msgr2=0x7f6fb8105400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:11.790 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:11.056+0000 7f6fc0141700 1 --2- 172.21.15.37:0/1445210622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fb8076c50 0x7f6fb8105400 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6fb40098e0 tx=0x7f6fb4009250 comp rx=0 tx=0).stop 2024-04-25T17:09:11.790 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:11.056+0000 7f6fc0141700 1 -- 172.21.15.37:0/1445210622 shutdown_connections 2024-04-25T17:09:11.790 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:11.056+0000 7f6fc0141700 1 --2- 172.21.15.37:0/1445210622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fb8076c50 0x7f6fb8105400 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:11.790 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:11.056+0000 7f6fc0141700 1 -- 172.21.15.37:0/1445210622 >> 172.21.15.37:0/1445210622 conn(0x7f6fb80fcef0 msgr2=0x7f6fb80ff300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:09:11.790 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:11.057+0000 7f6fc0141700 1 -- 172.21.15.37:0/1445210622 shutdown_connections 2024-04-25T17:09:11.790 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:11.057+0000 7f6fc0141700 1 -- 172.21.15.37:0/1445210622 wait complete. 2024-04-25T17:09:11.790 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:11.057+0000 7f6fc0141700 1 Processor -- start 2024-04-25T17:09:11.790 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:11.057+0000 7f6fc0141700 1 -- start start 2024-04-25T17:09:11.790 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:11.057+0000 7f6fc0141700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fb8076c50 0x7f6fb8102d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:11.790 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:11.057+0000 7f6fc0141700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fb8103290 con 0x7f6fb8076c50 2024-04-25T17:09:11.791 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:11.057+0000 7f6fbdedd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fb8076c50 0x7f6fb8102d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:11.791 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:11.058+0000 7f6fbdedd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fb8076c50 0x7f6fb8102d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46724/0 (socket says 172.21.15.37:46724) 2024-04-25T17:09:11.791 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:11.058+0000 7f6fbdedd700 1 -- 172.21.15.37:0/2453204666 learned_addr learned my addr 172.21.15.37:0/2453204666 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:09:11.791 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:11.058+0000 7f6fbdedd700 1 -- 172.21.15.37:0/2453204666 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb40094f0 con 0x7f6fb8076c50 2024-04-25T17:09:11.791 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:11.058+0000 7f6fbdedd700 1 --2- 172.21.15.37:0/2453204666 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fb8076c50 0x7f6fb8102d50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6fb4006b00 tx=0x7f6fb4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:11.791 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:11.058+0000 7f6fae7fc700 1 -- 172.21.15.37:0/2453204666 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6fb40107c0 con 0x7f6fb8076c50 2024-04-25T17:09:11.791 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:11.058+0000 7f6fc0141700 1 -- 172.21.15.37:0/2453204666 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fb8101300 con 0x7f6fb8076c50 2024-04-25T17:09:11.791 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:11.058+0000 7f6fae7fc700 1 -- 172.21.15.37:0/2453204666 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f6fb4010db0 con 0x7f6fb8076c50 2024-04-25T17:09:11.791 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:11.058+0000 7f6fae7fc700 1 -- 172.21.15.37:0/2453204666 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6fb401acf0 con 0x7f6fb8076c50 2024-04-25T17:09:11.791 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:11.058+0000 7f6fc0141700 1 -- 172.21.15.37:0/2453204666 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fb81017f0 con 0x7f6fb8076c50 2024-04-25T17:09:11.791 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:11.059+0000 7f6fae7fc700 1 -- 172.21.15.37:0/2453204666 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 7) v1 ==== 43270+0+0 (secure 0 0 0) 0x7f6fb4010920 con 0x7f6fb8076c50 2024-04-25T17:09:11.791 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:11.059+0000 7f6fc0141700 1 -- 172.21.15.37:0/2453204666 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fb804bed0 con 0x7f6fb8076c50 2024-04-25T17:09:11.791 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:11.059+0000 7f6fae7fc700 1 --2- 172.21.15.37:0/2453204666 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f6fa4036720 0x7f6fa4038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:11.791 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:11.059+0000 7f6fae7fc700 1 -- 172.21.15.37:0/2453204666 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f6fb404a490 con 0x7f6fb8076c50 2024-04-25T17:09:11.791 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:11.059+0000 7f6fbd6dc700 1 --2- 172.21.15.37:0/2453204666 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f6fa4036720 0x7f6fa4038bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:11.792 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:11.060+0000 7f6fbd6dc700 1 --2- 172.21.15.37:0/2453204666 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f6fa4036720 0x7f6fa4038bd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8009990 tx=0x7f6fa8006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:11.792 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:11.064+0000 7f6fae7fc700 1 -- 172.21.15.37:0/2453204666 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f6fb401a530 con 0x7f6fb8076c50 2024-04-25T17:09:11.792 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:11.158+0000 7f6fae7fc700 1 -- 172.21.15.37:0/2453204666 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f6fb400ed40 con 0x7f6fb8076c50 2024-04-25T17:09:11.792 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:11.276+0000 7f6fc0141700 1 -- 172.21.15.37:0/2453204666 --> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f6fb8101f00 con 0x7f6fa4036720 2024-04-25T17:09:11.792 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:11.285+0000 7f6fae7fc700 1 -- 172.21.15.37:0/2453204666 <== mgr.14118 v2:172.21.15.37:6800/3653320894 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f6fb8101f00 con 0x7f6fa4036720 2024-04-25T17:09:11.792 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:11.287+0000 7f6fc0141700 1 -- 172.21.15.37:0/2453204666 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f6fa4036720 msgr2=0x7f6fa4038bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:11.792 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:11.287+0000 7f6fc0141700 1 --2- 172.21.15.37:0/2453204666 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f6fa4036720 0x7f6fa4038bd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6fa8009990 tx=0x7f6fa8006e40 comp rx=0 tx=0).stop 2024-04-25T17:09:11.792 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:11.287+0000 7f6fc0141700 1 -- 172.21.15.37:0/2453204666 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fb8076c50 msgr2=0x7f6fb8102d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:11.792 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:11.287+0000 7f6fc0141700 1 --2- 172.21.15.37:0/2453204666 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fb8076c50 0x7f6fb8102d50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6fb4006b00 tx=0x7f6fb4009250 comp rx=0 tx=0).stop 2024-04-25T17:09:11.792 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:11.287+0000 7f6fc0141700 1 -- 172.21.15.37:0/2453204666 shutdown_connections 2024-04-25T17:09:11.792 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:11.287+0000 7f6fc0141700 1 --2- 172.21.15.37:0/2453204666 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f6fa4036720 0x7f6fa4038bd0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:11.792 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:11.287+0000 7f6fc0141700 1 --2- 172.21.15.37:0/2453204666 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6fb8076c50 0x7f6fb8102d50 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:11.792 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:11.287+0000 7f6fc0141700 1 -- 172.21.15.37:0/2453204666 >> 172.21.15.37:0/2453204666 conn(0x7f6fb80fcef0 msgr2=0x7f6fb80fd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:09:11.792 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:11.288+0000 7f6fc0141700 1 -- 172.21.15.37:0/2453204666 shutdown_connections 2024-04-25T17:09:11.792 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:11.288+0000 7f6fc0141700 1 -- 172.21.15.37:0/2453204666 wait complete. 2024-04-25T17:09:12.432 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:12 smithi037 ceph-mon[26472]: mgrmap e8: smithi037.txrgxl(active, since 2s) 2024-04-25T17:09:12.432 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:12 smithi037 ceph-mon[26472]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:09:12.432 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:12 smithi037 ceph-mon[26472]: from='mgr.14118 172.21.15.37:0/1694910703' entity='mgr.smithi037.txrgxl' 2024-04-25T17:09:12.432 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:12 smithi037 ceph-mon[26472]: from='mgr.14118 172.21.15.37:0/1694910703' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:09:12.995 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout value unchanged 2024-04-25T17:09:12.996 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:12.223+0000 7f86b40fa700 1 Processor -- start 2024-04-25T17:09:12.996 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:12.223+0000 7f86b40fa700 1 -- start start 2024-04-25T17:09:12.996 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:12.223+0000 7f86b40fa700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86ac100c90 0x7f86ac1010a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:12.996 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:12.223+0000 7f86b40fa700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86ac1015e0 con 0x7f86ac100c90 2024-04-25T17:09:12.996 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:12.223+0000 7f86b1e96700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86ac100c90 0x7f86ac1010a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:12.996 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:12.223+0000 7f86b1e96700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86ac100c90 0x7f86ac1010a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46730/0 (socket says 172.21.15.37:46730) 2024-04-25T17:09:12.996 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:12.223+0000 7f86b1e96700 1 -- 172.21.15.37:0/1970646708 learned_addr learned my addr 172.21.15.37:0/1970646708 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:09:12.996 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:12.223+0000 7f86b1e96700 1 -- 172.21.15.37:0/1970646708 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86ac101720 con 0x7f86ac100c90 2024-04-25T17:09:12.996 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:12.224+0000 7f86b1e96700 1 --2- 172.21.15.37:0/1970646708 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86ac100c90 0x7f86ac1010a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f86a80098e0 tx=0x7f86a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0bd0346cf530a01 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:12.996 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:12.224+0000 7f86b0e94700 1 -- 172.21.15.37:0/1970646708 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f86a800b860 con 0x7f86ac100c90 2024-04-25T17:09:12.996 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:12.224+0000 7f86b0e94700 1 -- 172.21.15.37:0/1970646708 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f86a800be50 con 0x7f86ac100c90 2024-04-25T17:09:12.996 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:12.224+0000 7f86b0e94700 1 -- 172.21.15.37:0/1970646708 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f86a8010380 con 0x7f86ac100c90 2024-04-25T17:09:12.996 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:12.224+0000 7f86b40fa700 1 -- 172.21.15.37:0/1970646708 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86ac100c90 msgr2=0x7f86ac1010a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:12.997 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:12.224+0000 7f86b40fa700 1 --2- 172.21.15.37:0/1970646708 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86ac100c90 0x7f86ac1010a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f86a80098e0 tx=0x7f86a8009250 comp rx=0 tx=0).stop 2024-04-25T17:09:12.997 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:12.224+0000 7f86b40fa700 1 -- 172.21.15.37:0/1970646708 shutdown_connections 2024-04-25T17:09:12.997 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:12.224+0000 7f86b40fa700 1 --2- 172.21.15.37:0/1970646708 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86ac100c90 0x7f86ac1010a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:12.997 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:12.224+0000 7f86b40fa700 1 -- 172.21.15.37:0/1970646708 >> 172.21.15.37:0/1970646708 conn(0x7f86ac0fc6f0 msgr2=0x7f86ac0feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:09:12.997 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:12.225+0000 7f86b40fa700 1 -- 172.21.15.37:0/1970646708 shutdown_connections 2024-04-25T17:09:12.997 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:12.225+0000 7f86b40fa700 1 -- 172.21.15.37:0/1970646708 wait complete. 2024-04-25T17:09:12.997 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:12.225+0000 7f86b40fa700 1 Processor -- start 2024-04-25T17:09:12.997 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:12.225+0000 7f86b40fa700 1 -- start start 2024-04-25T17:09:12.997 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:12.225+0000 7f86b40fa700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86ac100c90 0x7f86ac1036c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:12.997 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:12.225+0000 7f86b40fa700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86ac103c00 con 0x7f86ac100c90 2024-04-25T17:09:12.997 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:12.225+0000 7f86b1e96700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86ac100c90 0x7f86ac1036c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:12.997 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:12.225+0000 7f86b1e96700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86ac100c90 0x7f86ac1036c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46734/0 (socket says 172.21.15.37:46734) 2024-04-25T17:09:12.997 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:12.225+0000 7f86b1e96700 1 -- 172.21.15.37:0/8114225 learned_addr learned my addr 172.21.15.37:0/8114225 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:09:12.997 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:12.226+0000 7f86b1e96700 1 -- 172.21.15.37:0/8114225 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a80094f0 con 0x7f86ac100c90 2024-04-25T17:09:12.998 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:12.226+0000 7f86b1e96700 1 --2- 172.21.15.37:0/8114225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86ac100c90 0x7f86ac1036c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f86a800b440 tx=0x7f86a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:12.998 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:12.226+0000 7f86a27fc700 1 -- 172.21.15.37:0/8114225 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f86a8010760 con 0x7f86ac100c90 2024-04-25T17:09:12.998 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:12.226+0000 7f86a27fc700 1 -- 172.21.15.37:0/8114225 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f86a8010d50 con 0x7f86ac100c90 2024-04-25T17:09:12.998 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:12.226+0000 7f86a27fc700 1 -- 172.21.15.37:0/8114225 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f86a801ae20 con 0x7f86ac100c90 2024-04-25T17:09:12.998 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:12.226+0000 7f86b40fa700 1 -- 172.21.15.37:0/8114225 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86ac101c70 con 0x7f86ac100c90 2024-04-25T17:09:12.998 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:12.226+0000 7f86b40fa700 1 -- 172.21.15.37:0/8114225 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86ac102160 con 0x7f86ac100c90 2024-04-25T17:09:12.998 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:12.227+0000 7f86a27fc700 1 -- 172.21.15.37:0/8114225 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f86a80108c0 con 0x7f86ac100c90 2024-04-25T17:09:12.998 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:12.227+0000 7f86b40fa700 1 -- 172.21.15.37:0/8114225 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86ac04bed0 con 0x7f86ac100c90 2024-04-25T17:09:12.998 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:12.227+0000 7f86a27fc700 1 --2- 172.21.15.37:0/8114225 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f86980368a0 0x7f8698038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:12.998 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:12.227+0000 7f86a27fc700 1 -- 172.21.15.37:0/8114225 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f86a804a570 con 0x7f86ac100c90 2024-04-25T17:09:12.998 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:12.227+0000 7f86b1695700 1 --2- 172.21.15.37:0/8114225 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f86980368a0 0x7f8698038d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:12.998 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:12.228+0000 7f86b1695700 1 --2- 172.21.15.37:0/8114225 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f86980368a0 0x7f8698038d50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f869c009990 tx=0x7f869c006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:12.998 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:12.232+0000 7f86a27fc700 1 -- 172.21.15.37:0/8114225 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f86a801a430 con 0x7f86ac100c90 2024-04-25T17:09:12.998 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:12.431+0000 7f86b40fa700 1 -- 172.21.15.37:0/8114225 --> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f86ac102870 con 0x7f86980368a0 2024-04-25T17:09:12.999 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:12.432+0000 7f86a27fc700 1 -- 172.21.15.37:0/8114225 <== mgr.14118 v2:172.21.15.37:6800/3653320894 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f86ac102870 con 0x7f86980368a0 2024-04-25T17:09:12.999 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:12.434+0000 7f86b40fa700 1 -- 172.21.15.37:0/8114225 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f86980368a0 msgr2=0x7f8698038d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:12.999 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:12.434+0000 7f86b40fa700 1 --2- 172.21.15.37:0/8114225 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f86980368a0 0x7f8698038d50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f869c009990 tx=0x7f869c006e40 comp rx=0 tx=0).stop 2024-04-25T17:09:12.999 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:12.434+0000 7f86b40fa700 1 -- 172.21.15.37:0/8114225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86ac100c90 msgr2=0x7f86ac1036c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:12.999 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:12.434+0000 7f86b40fa700 1 --2- 172.21.15.37:0/8114225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86ac100c90 0x7f86ac1036c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f86a800b440 tx=0x7f86a8009250 comp rx=0 tx=0).stop 2024-04-25T17:09:12.999 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:12.435+0000 7f86b40fa700 1 -- 172.21.15.37:0/8114225 shutdown_connections 2024-04-25T17:09:12.999 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:12.435+0000 7f86b40fa700 1 --2- 172.21.15.37:0/8114225 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f86980368a0 0x7f8698038d50 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:12.999 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:12.435+0000 7f86b40fa700 1 --2- 172.21.15.37:0/8114225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86ac100c90 0x7f86ac1036c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:12.999 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:12.435+0000 7f86b40fa700 1 -- 172.21.15.37:0/8114225 >> 172.21.15.37:0/8114225 conn(0x7f86ac0fc6f0 msgr2=0x7f86ac0fd180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:09:12.999 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:12.435+0000 7f86b40fa700 1 -- 172.21.15.37:0/8114225 shutdown_connections 2024-04-25T17:09:12.999 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:12.435+0000 7f86b40fa700 1 -- 172.21.15.37:0/8114225 wait complete. 2024-04-25T17:09:12.999 INFO:teuthology.orchestra.run.smithi037.stdout:Generating ssh key... 2024-04-25T17:09:13.570 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:13 smithi037 ceph-mon[26472]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:09:14.393 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:13.409+0000 7f7c86bc1700 1 Processor -- start 2024-04-25T17:09:14.393 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:13.409+0000 7f7c86bc1700 1 -- start start 2024-04-25T17:09:14.393 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:13.409+0000 7f7c86bc1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c80102880 0x7f7c80102c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:14.393 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:13.409+0000 7f7c86bc1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c801031d0 con 0x7f7c80102880 2024-04-25T17:09:14.393 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:13.409+0000 7f7c8495d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c80102880 0x7f7c80102c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:14.394 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:13.409+0000 7f7c8495d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c80102880 0x7f7c80102c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46742/0 (socket says 172.21.15.37:46742) 2024-04-25T17:09:14.394 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:13.409+0000 7f7c8495d700 1 -- 172.21.15.37:0/2475504815 learned_addr learned my addr 172.21.15.37:0/2475504815 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:09:14.394 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:13.410+0000 7f7c8495d700 1 -- 172.21.15.37:0/2475504815 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c80103310 con 0x7f7c80102880 2024-04-25T17:09:14.394 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:13.410+0000 7f7c8495d700 1 --2- 172.21.15.37:0/2475504815 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c80102880 0x7f7c80102c90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7c740098e0 tx=0x7f7c74009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de921f6c1c550fa8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:14.394 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:13.410+0000 7f7c7f7fe700 1 -- 172.21.15.37:0/2475504815 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7c7400b860 con 0x7f7c80102880 2024-04-25T17:09:14.394 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:13.410+0000 7f7c7f7fe700 1 -- 172.21.15.37:0/2475504815 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f7c7400be50 con 0x7f7c80102880 2024-04-25T17:09:14.394 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:13.410+0000 7f7c7f7fe700 1 -- 172.21.15.37:0/2475504815 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7c74010380 con 0x7f7c80102880 2024-04-25T17:09:14.394 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:13.410+0000 7f7c86bc1700 1 -- 172.21.15.37:0/2475504815 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c80102880 msgr2=0x7f7c80102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:14.394 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:13.410+0000 7f7c86bc1700 1 --2- 172.21.15.37:0/2475504815 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c80102880 0x7f7c80102c90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7c740098e0 tx=0x7f7c74009250 comp rx=0 tx=0).stop 2024-04-25T17:09:14.394 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:13.410+0000 7f7c86bc1700 1 -- 172.21.15.37:0/2475504815 shutdown_connections 2024-04-25T17:09:14.394 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:13.410+0000 7f7c86bc1700 1 --2- 172.21.15.37:0/2475504815 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c80102880 0x7f7c80102c90 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:14.394 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:13.410+0000 7f7c86bc1700 1 -- 172.21.15.37:0/2475504815 >> 172.21.15.37:0/2475504815 conn(0x7f7c800fe060 msgr2=0x7f7c80100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:09:14.394 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:13.411+0000 7f7c86bc1700 1 -- 172.21.15.37:0/2475504815 shutdown_connections 2024-04-25T17:09:14.395 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:13.411+0000 7f7c86bc1700 1 -- 172.21.15.37:0/2475504815 wait complete. 2024-04-25T17:09:14.395 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:13.411+0000 7f7c86bc1700 1 Processor -- start 2024-04-25T17:09:14.395 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:13.411+0000 7f7c86bc1700 1 -- start start 2024-04-25T17:09:14.395 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:13.411+0000 7f7c86bc1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c80102880 0x7f7c80078c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:14.395 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:13.412+0000 7f7c86bc1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c80079160 con 0x7f7c80102880 2024-04-25T17:09:14.395 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:13.412+0000 7f7c8495d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c80102880 0x7f7c80078c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:14.395 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:13.412+0000 7f7c8495d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c80102880 0x7f7c80078c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46752/0 (socket says 172.21.15.37:46752) 2024-04-25T17:09:14.395 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:13.412+0000 7f7c8495d700 1 -- 172.21.15.37:0/3768740636 learned_addr learned my addr 172.21.15.37:0/3768740636 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:09:14.395 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:13.412+0000 7f7c8495d700 1 -- 172.21.15.37:0/3768740636 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c740094f0 con 0x7f7c80102880 2024-04-25T17:09:14.395 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:13.412+0000 7f7c8495d700 1 --2- 172.21.15.37:0/3768740636 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c80102880 0x7f7c80078c20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7c74000c00 tx=0x7f7c74009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:14.395 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:13.412+0000 7f7c7d7fa700 1 -- 172.21.15.37:0/3768740636 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7c740107c0 con 0x7f7c80102880 2024-04-25T17:09:14.395 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:13.412+0000 7f7c7d7fa700 1 -- 172.21.15.37:0/3768740636 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f7c74010db0 con 0x7f7c80102880 2024-04-25T17:09:14.395 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:13.412+0000 7f7c7d7fa700 1 -- 172.21.15.37:0/3768740636 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7c7401ad00 con 0x7f7c80102880 2024-04-25T17:09:14.395 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:13.412+0000 7f7c86bc1700 1 -- 172.21.15.37:0/3768740636 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c800771d0 con 0x7f7c80102880 2024-04-25T17:09:14.395 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:13.412+0000 7f7c86bc1700 1 -- 172.21.15.37:0/3768740636 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c800776c0 con 0x7f7c80102880 2024-04-25T17:09:14.396 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:13.413+0000 7f7c7d7fa700 1 -- 172.21.15.37:0/3768740636 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f7c74010920 con 0x7f7c80102880 2024-04-25T17:09:14.396 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:13.413+0000 7f7c7d7fa700 1 --2- 172.21.15.37:0/3768740636 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f7c70036850 0x7f7c70038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:14.396 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:13.413+0000 7f7c86bc1700 1 -- 172.21.15.37:0/3768740636 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c8004bed0 con 0x7f7c80102880 2024-04-25T17:09:14.396 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:13.413+0000 7f7c7d7fa700 1 -- 172.21.15.37:0/3768740636 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f7c7404a600 con 0x7f7c80102880 2024-04-25T17:09:14.396 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:13.413+0000 7f7c7ffff700 1 --2- 172.21.15.37:0/3768740636 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f7c70036850 0x7f7c70038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:14.396 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:13.414+0000 7f7c7ffff700 1 --2- 172.21.15.37:0/3768740636 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f7c70036850 0x7f7c70038d00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c009990 tx=0x7f7c6c006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:14.396 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:13.418+0000 7f7c7d7fa700 1 -- 172.21.15.37:0/3768740636 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f7c7401a530 con 0x7f7c80102880 2024-04-25T17:09:14.396 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:13.618+0000 7f7c86bc1700 1 -- 172.21.15.37:0/3768740636 --> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f7c80077dd0 con 0x7f7c70036850 2024-04-25T17:09:14.396 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:13.821+0000 7f7c7d7fa700 1 -- 172.21.15.37:0/3768740636 <== mgr.14118 v2:172.21.15.37:6800/3653320894 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f7c80077dd0 con 0x7f7c70036850 2024-04-25T17:09:14.396 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:13.823+0000 7f7c86bc1700 1 -- 172.21.15.37:0/3768740636 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f7c70036850 msgr2=0x7f7c70038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:14.396 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:13.823+0000 7f7c86bc1700 1 --2- 172.21.15.37:0/3768740636 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f7c70036850 0x7f7c70038d00 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c009990 tx=0x7f7c6c006e40 comp rx=0 tx=0).stop 2024-04-25T17:09:14.396 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:13.823+0000 7f7c86bc1700 1 -- 172.21.15.37:0/3768740636 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c80102880 msgr2=0x7f7c80078c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:14.396 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:13.823+0000 7f7c86bc1700 1 --2- 172.21.15.37:0/3768740636 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c80102880 0x7f7c80078c20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7c74000c00 tx=0x7f7c74009250 comp rx=0 tx=0).stop 2024-04-25T17:09:14.396 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:13.823+0000 7f7c86bc1700 1 -- 172.21.15.37:0/3768740636 shutdown_connections 2024-04-25T17:09:14.396 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:13.824+0000 7f7c86bc1700 1 --2- 172.21.15.37:0/3768740636 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f7c70036850 0x7f7c70038d00 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:14.396 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:13.824+0000 7f7c86bc1700 1 --2- 172.21.15.37:0/3768740636 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c80102880 0x7f7c80078c20 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:14.397 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:13.824+0000 7f7c86bc1700 1 -- 172.21.15.37:0/3768740636 >> 172.21.15.37:0/3768740636 conn(0x7f7c800fe060 msgr2=0x7f7c800feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:09:14.397 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:13.824+0000 7f7c86bc1700 1 -- 172.21.15.37:0/3768740636 shutdown_connections 2024-04-25T17:09:14.397 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:13.824+0000 7f7c86bc1700 1 -- 172.21.15.37:0/3768740636 wait complete. 2024-04-25T17:09:15.001 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:14 smithi037 ceph-mon[26472]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:09:15.001 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:14 smithi037 ceph-mon[26472]: Generating ssh key... 2024-04-25T17:09:15.002 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:14 smithi037 ceph-mon[26472]: from='mgr.14118 172.21.15.37:0/1694910703' entity='mgr.smithi037.txrgxl' 2024-04-25T17:09:15.002 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:14 smithi037 ceph-mon[26472]: from='mgr.14118 172.21.15.37:0/1694910703' entity='mgr.smithi037.txrgxl' 2024-04-25T17:09:15.549 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCqWAym/EOuZXfuHvw402aT3Wn2g1TwR0L33NU8pQwgBTmHMCmclf9RM2AZmDLSOfC24yigqHc5G+hZq2Lvvq7TBvHGP21YeI+Akzs8yOE9J6duG9aTwAhg0ruNDTXm6nvswZH2RP5kElSryJDVvPh+A+QVLppGm3Ikv4vV5vlQKqabKiwL2K6XS3JKGe9h09HYcpsfKHGU372Yl8dpAgYIOWHSwNp5O3kKsNjU05VGNPMUI/ch5zPUUIF08uGCPsNlinFHwfiMpZb1L/xwZwicgJdTAvsi82WiJUv0IGyhLQudg5/NMN/J7AeD11QURr54sr6Kl9YTL1l4TyKoZ4IQtLoeL0jAu7pTOUCFSmfiWOg2pR8sTOvTYUPpw0Ew1OawRIKoy13N9a5+WeNc6oxzfQXyfXPdLoo3LgFbQUv511+8YvxkTyqP+9YZWj8I6JQTY6usDZfy1IhSbRReRpJT4vllCmyRLM9q6arsGF7nMPSA8I+tjbzYWt1NZxN8vYM= ceph-599bb7fc-0326-11ef-bc93-c7b262605968 2024-04-25T17:09:15.549 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:14.792+0000 7fd2cd44a700 1 Processor -- start 2024-04-25T17:09:15.549 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:14.792+0000 7fd2cd44a700 1 -- start start 2024-04-25T17:09:15.549 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:14.792+0000 7fd2cd44a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2c8102880 0x7fd2c8102c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:15.549 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:14.792+0000 7fd2cd44a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c81031d0 con 0x7fd2c8102880 2024-04-25T17:09:15.549 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:14.792+0000 7fd2c6ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2c8102880 0x7fd2c8102c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:15.549 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:14.793+0000 7fd2c6ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2c8102880 0x7fd2c8102c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46766/0 (socket says 172.21.15.37:46766) 2024-04-25T17:09:15.550 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:14.793+0000 7fd2c6ffd700 1 -- 172.21.15.37:0/678463051 learned_addr learned my addr 172.21.15.37:0/678463051 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:09:15.550 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:14.793+0000 7fd2c6ffd700 1 -- 172.21.15.37:0/678463051 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2c8103310 con 0x7fd2c8102880 2024-04-25T17:09:15.550 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:14.793+0000 7fd2c6ffd700 1 --2- 172.21.15.37:0/678463051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2c8102880 0x7fd2c8102c90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd2b80098e0 tx=0x7fd2b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3df6df52bda4c9da server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:15.550 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:14.793+0000 7fd2c5ffb700 1 -- 172.21.15.37:0/678463051 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd2b800b860 con 0x7fd2c8102880 2024-04-25T17:09:15.550 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:14.793+0000 7fd2c5ffb700 1 -- 172.21.15.37:0/678463051 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fd2b800be50 con 0x7fd2c8102880 2024-04-25T17:09:15.550 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:14.793+0000 7fd2c5ffb700 1 -- 172.21.15.37:0/678463051 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd2b8010380 con 0x7fd2c8102880 2024-04-25T17:09:15.550 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:14.794+0000 7fd2cd44a700 1 -- 172.21.15.37:0/678463051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2c8102880 msgr2=0x7fd2c8102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:15.550 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:14.794+0000 7fd2cd44a700 1 --2- 172.21.15.37:0/678463051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2c8102880 0x7fd2c8102c90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd2b80098e0 tx=0x7fd2b8009250 comp rx=0 tx=0).stop 2024-04-25T17:09:15.550 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:14.794+0000 7fd2cd44a700 1 -- 172.21.15.37:0/678463051 shutdown_connections 2024-04-25T17:09:15.550 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:14.794+0000 7fd2cd44a700 1 --2- 172.21.15.37:0/678463051 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2c8102880 0x7fd2c8102c90 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:15.550 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:14.794+0000 7fd2cd44a700 1 -- 172.21.15.37:0/678463051 >> 172.21.15.37:0/678463051 conn(0x7fd2c80fe060 msgr2=0x7fd2c8100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:09:15.550 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:14.794+0000 7fd2cd44a700 1 -- 172.21.15.37:0/678463051 shutdown_connections 2024-04-25T17:09:15.550 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:14.794+0000 7fd2cd44a700 1 -- 172.21.15.37:0/678463051 wait complete. 2024-04-25T17:09:15.551 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:14.795+0000 7fd2cd44a700 1 Processor -- start 2024-04-25T17:09:15.551 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:14.795+0000 7fd2cd44a700 1 -- start start 2024-04-25T17:09:15.551 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:14.795+0000 7fd2cd44a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2c8102880 0x7fd2c81115f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:15.551 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:14.795+0000 7fd2cd44a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c8111b30 con 0x7fd2c8102880 2024-04-25T17:09:15.551 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:14.795+0000 7fd2c6ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2c8102880 0x7fd2c81115f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:15.551 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:14.795+0000 7fd2c6ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2c8102880 0x7fd2c81115f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46782/0 (socket says 172.21.15.37:46782) 2024-04-25T17:09:15.551 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:14.795+0000 7fd2c6ffd700 1 -- 172.21.15.37:0/1229641713 learned_addr learned my addr 172.21.15.37:0/1229641713 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:09:15.551 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:14.795+0000 7fd2c6ffd700 1 -- 172.21.15.37:0/1229641713 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b80094f0 con 0x7fd2c8102880 2024-04-25T17:09:15.551 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:14.796+0000 7fd2c6ffd700 1 --2- 172.21.15.37:0/1229641713 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2c8102880 0x7fd2c81115f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd2b800b440 tx=0x7fd2b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:15.551 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:14.796+0000 7fd2af7fe700 1 -- 172.21.15.37:0/1229641713 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd2b8010760 con 0x7fd2c8102880 2024-04-25T17:09:15.551 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:14.796+0000 7fd2af7fe700 1 -- 172.21.15.37:0/1229641713 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fd2b8010d50 con 0x7fd2c8102880 2024-04-25T17:09:15.551 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:14.796+0000 7fd2cd44a700 1 -- 172.21.15.37:0/1229641713 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2c8111d30 con 0x7fd2c8102880 2024-04-25T17:09:15.551 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:14.796+0000 7fd2af7fe700 1 -- 172.21.15.37:0/1229641713 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd2b801ae20 con 0x7fd2c8102880 2024-04-25T17:09:15.551 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:14.796+0000 7fd2cd44a700 1 -- 172.21.15.37:0/1229641713 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2c81128a0 con 0x7fd2c8102880 2024-04-25T17:09:15.551 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:14.797+0000 7fd2af7fe700 1 -- 172.21.15.37:0/1229641713 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7fd2b802e440 con 0x7fd2c8102880 2024-04-25T17:09:15.552 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:14.797+0000 7fd2af7fe700 1 --2- 172.21.15.37:0/1229641713 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7fd2b00368a0 0x7fd2b0038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:15.552 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:14.797+0000 7fd2cd44a700 1 -- 172.21.15.37:0/1229641713 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2c805f5c0 con 0x7fd2c8102880 2024-04-25T17:09:15.552 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:14.797+0000 7fd2af7fe700 1 -- 172.21.15.37:0/1229641713 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fd2b804a6a0 con 0x7fd2c8102880 2024-04-25T17:09:15.552 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:14.797+0000 7fd2c67fc700 1 --2- 172.21.15.37:0/1229641713 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7fd2b00368a0 0x7fd2b0038d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:15.552 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:14.797+0000 7fd2c67fc700 1 --2- 172.21.15.37:0/1229641713 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7fd2b00368a0 0x7fd2b0038d50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc009990 tx=0x7fd2bc006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:15.552 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:14.802+0000 7fd2af7fe700 1 -- 172.21.15.37:0/1229641713 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fd2b8023ce0 con 0x7fd2c8102880 2024-04-25T17:09:15.552 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:15.001+0000 7fd2cd44a700 1 -- 172.21.15.37:0/1229641713 --> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fd2c80ff200 con 0x7fd2b00368a0 2024-04-25T17:09:15.552 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:15.002+0000 7fd2af7fe700 1 -- 172.21.15.37:0/1229641713 <== mgr.14118 v2:172.21.15.37:6800/3653320894 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7fd2c80ff200 con 0x7fd2b00368a0 2024-04-25T17:09:15.552 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:15.004+0000 7fd2cd44a700 1 -- 172.21.15.37:0/1229641713 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7fd2b00368a0 msgr2=0x7fd2b0038d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:15.552 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:15.004+0000 7fd2cd44a700 1 --2- 172.21.15.37:0/1229641713 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7fd2b00368a0 0x7fd2b0038d50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc009990 tx=0x7fd2bc006e40 comp rx=0 tx=0).stop 2024-04-25T17:09:15.552 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:15.004+0000 7fd2cd44a700 1 -- 172.21.15.37:0/1229641713 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2c8102880 msgr2=0x7fd2c81115f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:15.552 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:15.004+0000 7fd2cd44a700 1 --2- 172.21.15.37:0/1229641713 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2c8102880 0x7fd2c81115f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd2b800b440 tx=0x7fd2b8009250 comp rx=0 tx=0).stop 2024-04-25T17:09:15.552 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:15.004+0000 7fd2cd44a700 1 -- 172.21.15.37:0/1229641713 shutdown_connections 2024-04-25T17:09:15.552 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:15.004+0000 7fd2cd44a700 1 --2- 172.21.15.37:0/1229641713 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7fd2b00368a0 0x7fd2b0038d50 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:15.553 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:15.004+0000 7fd2cd44a700 1 --2- 172.21.15.37:0/1229641713 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2c8102880 0x7fd2c81115f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:15.553 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:15.004+0000 7fd2cd44a700 1 -- 172.21.15.37:0/1229641713 >> 172.21.15.37:0/1229641713 conn(0x7fd2c80fe060 msgr2=0x7fd2c80feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:09:15.553 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:15.004+0000 7fd2cd44a700 1 -- 172.21.15.37:0/1229641713 shutdown_connections 2024-04-25T17:09:15.553 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:15.004+0000 7fd2cd44a700 1 -- 172.21.15.37:0/1229641713 wait complete. 2024-04-25T17:09:15.553 INFO:teuthology.orchestra.run.smithi037.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-04-25T17:09:15.553 INFO:teuthology.orchestra.run.smithi037.stdout:Adding key to root@localhost authorized_keys... 2024-04-25T17:09:15.553 INFO:teuthology.orchestra.run.smithi037.stdout:Adding host smithi037... 2024-04-25T17:09:16.070 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:15 smithi037 ceph-mon[26472]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:09:17.063 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:16 smithi037 ceph-mon[26472]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi037", "addr": "172.21.15.37", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:09:17.820 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:17 smithi037 ceph-mon[26472]: Deploying cephadm binary to smithi037 2024-04-25T17:09:18.615 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout Added host 'smithi037' with addr '172.21.15.37' 2024-04-25T17:09:18.615 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:15.964+0000 7fe43b3e7700 1 Processor -- start 2024-04-25T17:09:18.615 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:15.964+0000 7fe43b3e7700 1 -- start start 2024-04-25T17:09:18.615 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:15.965+0000 7fe43b3e7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe434076c20 0x7fe434107840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:18.615 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:15.965+0000 7fe43b3e7700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe434103230 con 0x7fe434076c20 2024-04-25T17:09:18.615 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:15.965+0000 7fe439183700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe434076c20 0x7fe434107840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:18.616 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:15.965+0000 7fe439183700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe434076c20 0x7fe434107840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46790/0 (socket says 172.21.15.37:46790) 2024-04-25T17:09:18.616 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:15.965+0000 7fe439183700 1 -- 172.21.15.37:0/1118140260 learned_addr learned my addr 172.21.15.37:0/1118140260 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:09:18.616 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:15.965+0000 7fe439183700 1 -- 172.21.15.37:0/1118140260 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe434107d80 con 0x7fe434076c20 2024-04-25T17:09:18.616 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:15.965+0000 7fe439183700 1 --2- 172.21.15.37:0/1118140260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe434076c20 0x7fe434107840 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe4280098e0 tx=0x7fe428009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59cf650f16ab460e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:18.616 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:15.965+0000 7fe427fff700 1 -- 172.21.15.37:0/1118140260 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe42800b860 con 0x7fe434076c20 2024-04-25T17:09:18.616 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:15.965+0000 7fe427fff700 1 -- 172.21.15.37:0/1118140260 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fe42800be50 con 0x7fe434076c20 2024-04-25T17:09:18.616 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:15.965+0000 7fe427fff700 1 -- 172.21.15.37:0/1118140260 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe428010380 con 0x7fe434076c20 2024-04-25T17:09:18.616 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:15.966+0000 7fe43b3e7700 1 -- 172.21.15.37:0/1118140260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe434076c20 msgr2=0x7fe434107840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:18.616 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:15.966+0000 7fe43b3e7700 1 --2- 172.21.15.37:0/1118140260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe434076c20 0x7fe434107840 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe4280098e0 tx=0x7fe428009250 comp rx=0 tx=0).stop 2024-04-25T17:09:18.616 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:15.966+0000 7fe43b3e7700 1 -- 172.21.15.37:0/1118140260 shutdown_connections 2024-04-25T17:09:18.616 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:15.966+0000 7fe43b3e7700 1 --2- 172.21.15.37:0/1118140260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe434076c20 0x7fe434107840 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:18.616 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:15.966+0000 7fe43b3e7700 1 -- 172.21.15.37:0/1118140260 >> 172.21.15.37:0/1118140260 conn(0x7fe4340fced0 msgr2=0x7fe4340ff2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:09:18.616 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:15.966+0000 7fe43b3e7700 1 -- 172.21.15.37:0/1118140260 shutdown_connections 2024-04-25T17:09:18.616 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:15.966+0000 7fe43b3e7700 1 -- 172.21.15.37:0/1118140260 wait complete. 2024-04-25T17:09:18.617 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:15.967+0000 7fe43b3e7700 1 Processor -- start 2024-04-25T17:09:18.617 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:15.967+0000 7fe43b3e7700 1 -- start start 2024-04-25T17:09:18.617 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:15.967+0000 7fe43b3e7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe434076c20 0x7fe4341137d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:18.617 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:15.967+0000 7fe43b3e7700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe434113d10 con 0x7fe434076c20 2024-04-25T17:09:18.617 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:15.967+0000 7fe439183700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe434076c20 0x7fe4341137d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:18.617 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:15.967+0000 7fe439183700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe434076c20 0x7fe4341137d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46804/0 (socket says 172.21.15.37:46804) 2024-04-25T17:09:18.617 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:15.967+0000 7fe439183700 1 -- 172.21.15.37:0/4091659829 learned_addr learned my addr 172.21.15.37:0/4091659829 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:09:18.617 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:15.967+0000 7fe439183700 1 -- 172.21.15.37:0/4091659829 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4280094f0 con 0x7fe434076c20 2024-04-25T17:09:18.617 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:15.967+0000 7fe439183700 1 --2- 172.21.15.37:0/4091659829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe434076c20 0x7fe4341137d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe428006b00 tx=0x7fe428009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:18.617 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:15.968+0000 7fe425ffb700 1 -- 172.21.15.37:0/4091659829 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe4280107c0 con 0x7fe434076c20 2024-04-25T17:09:18.617 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:15.968+0000 7fe425ffb700 1 -- 172.21.15.37:0/4091659829 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7fe428010db0 con 0x7fe434076c20 2024-04-25T17:09:18.617 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:15.968+0000 7fe43b3e7700 1 -- 172.21.15.37:0/4091659829 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe434113f10 con 0x7fe434076c20 2024-04-25T17:09:18.617 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:15.968+0000 7fe425ffb700 1 -- 172.21.15.37:0/4091659829 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe42801acf0 con 0x7fe434076c20 2024-04-25T17:09:18.617 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:15.968+0000 7fe43b3e7700 1 -- 172.21.15.37:0/4091659829 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe434114a80 con 0x7fe434076c20 2024-04-25T17:09:18.618 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:15.969+0000 7fe425ffb700 1 -- 172.21.15.37:0/4091659829 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7fe428010920 con 0x7fe434076c20 2024-04-25T17:09:18.618 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:15.969+0000 7fe43b3e7700 1 -- 172.21.15.37:0/4091659829 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe43405f5c0 con 0x7fe434076c20 2024-04-25T17:09:18.618 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:15.969+0000 7fe425ffb700 1 --2- 172.21.15.37:0/4091659829 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7fe4200368a0 0x7fe420038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:18.618 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:15.969+0000 7fe425ffb700 1 -- 172.21.15.37:0/4091659829 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fe42804a590 con 0x7fe434076c20 2024-04-25T17:09:18.618 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:15.969+0000 7fe438982700 1 --2- 172.21.15.37:0/4091659829 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7fe4200368a0 0x7fe420038d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:18.618 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:15.970+0000 7fe438982700 1 --2- 172.21.15.37:0/4091659829 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7fe4200368a0 0x7fe420038d50 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe430009990 tx=0x7fe430006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:18.618 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:15.974+0000 7fe425ffb700 1 -- 172.21.15.37:0/4091659829 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fe42801a530 con 0x7fe434076c20 2024-04-25T17:09:18.618 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:16.172+0000 7fe43b3e7700 1 -- 172.21.15.37:0/4091659829 --> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi037", "addr": "172.21.15.37", "target": ["mon-mgr", ""]}) v1 -- 0x7fe4340fe090 con 0x7fe4200368a0 2024-04-25T17:09:18.618 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:18.059+0000 7fe425ffb700 1 -- 172.21.15.37:0/4091659829 <== mgr.14118 v2:172.21.15.37:6800/3653320894 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7fe4340fe090 con 0x7fe4200368a0 2024-04-25T17:09:18.618 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:18.061+0000 7fe43b3e7700 1 -- 172.21.15.37:0/4091659829 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7fe4200368a0 msgr2=0x7fe420038d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:18.618 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:18.061+0000 7fe43b3e7700 1 --2- 172.21.15.37:0/4091659829 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7fe4200368a0 0x7fe420038d50 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe430009990 tx=0x7fe430006e40 comp rx=0 tx=0).stop 2024-04-25T17:09:18.618 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:18.061+0000 7fe43b3e7700 1 -- 172.21.15.37:0/4091659829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe434076c20 msgr2=0x7fe4341137d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:18.618 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:18.061+0000 7fe43b3e7700 1 --2- 172.21.15.37:0/4091659829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe434076c20 0x7fe4341137d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe428006b00 tx=0x7fe428009250 comp rx=0 tx=0).stop 2024-04-25T17:09:18.618 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:18.061+0000 7fe43b3e7700 1 -- 172.21.15.37:0/4091659829 shutdown_connections 2024-04-25T17:09:18.618 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:18.061+0000 7fe43b3e7700 1 --2- 172.21.15.37:0/4091659829 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7fe4200368a0 0x7fe420038d50 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:18.619 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:18.061+0000 7fe43b3e7700 1 --2- 172.21.15.37:0/4091659829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe434076c20 0x7fe4341137d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:18.619 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:18.061+0000 7fe43b3e7700 1 -- 172.21.15.37:0/4091659829 >> 172.21.15.37:0/4091659829 conn(0x7fe4340fced0 msgr2=0x7fe4340fd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:09:18.619 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:18.062+0000 7fe43b3e7700 1 -- 172.21.15.37:0/4091659829 shutdown_connections 2024-04-25T17:09:18.619 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:18.062+0000 7fe43b3e7700 1 -- 172.21.15.37:0/4091659829 wait complete. 2024-04-25T17:09:18.619 INFO:teuthology.orchestra.run.smithi037.stdout:Deploying mon service with default placement... 2024-04-25T17:09:19.253 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:19 smithi037 ceph-mon[26472]: from='mgr.14118 172.21.15.37:0/1694910703' entity='mgr.smithi037.txrgxl' 2024-04-25T17:09:19.253 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:19 smithi037 ceph-mon[26472]: Added host smithi037 2024-04-25T17:09:19.253 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:19 smithi037 ceph-mon[26472]: from='mgr.14118 172.21.15.37:0/1694910703' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:09:19.999 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-04-25T17:09:19.999 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:19.017+0000 7f8005112700 1 Processor -- start 2024-04-25T17:09:19.999 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:19.017+0000 7f8005112700 1 -- start start 2024-04-25T17:09:19.999 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:19.018+0000 7f8005112700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8000102c90 0x7f80001030a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:19.999 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:19.018+0000 7f8005112700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8000103670 con 0x7f8000102c90 2024-04-25T17:09:19.999 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:19.018+0000 7f7ffed9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8000102c90 0x7f80001030a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:19.999 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:19.018+0000 7f7ffed9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8000102c90 0x7f80001030a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50972/0 (socket says 172.21.15.37:50972) 2024-04-25T17:09:19.999 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:19.018+0000 7f7ffed9d700 1 -- 172.21.15.37:0/538733866 learned_addr learned my addr 172.21.15.37:0/538733866 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:09:19.999 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:19.018+0000 7f7ffed9d700 1 -- 172.21.15.37:0/538733866 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80001037b0 con 0x7f8000102c90 2024-04-25T17:09:19.999 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:19.018+0000 7f7ffed9d700 1 --2- 172.21.15.37:0/538733866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8000102c90 0x7f80001030a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7ff00098e0 tx=0x7f7ff0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d25037fdd7da91a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:19.999 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:19.018+0000 7f7ffdd9b700 1 -- 172.21.15.37:0/538733866 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7ff000b860 con 0x7f8000102c90 2024-04-25T17:09:20.000 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:19.018+0000 7f7ffdd9b700 1 -- 172.21.15.37:0/538733866 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f7ff000be50 con 0x7f8000102c90 2024-04-25T17:09:20.000 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:19.018+0000 7f7ffdd9b700 1 -- 172.21.15.37:0/538733866 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7ff0010380 con 0x7f8000102c90 2024-04-25T17:09:20.000 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:19.019+0000 7f8005112700 1 -- 172.21.15.37:0/538733866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8000102c90 msgr2=0x7f80001030a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:20.000 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:19.019+0000 7f8005112700 1 --2- 172.21.15.37:0/538733866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8000102c90 0x7f80001030a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7ff00098e0 tx=0x7f7ff0009250 comp rx=0 tx=0).stop 2024-04-25T17:09:20.000 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:19.019+0000 7f8005112700 1 -- 172.21.15.37:0/538733866 shutdown_connections 2024-04-25T17:09:20.000 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:19.019+0000 7f8005112700 1 --2- 172.21.15.37:0/538733866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8000102c90 0x7f80001030a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:20.000 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:19.019+0000 7f8005112700 1 -- 172.21.15.37:0/538733866 >> 172.21.15.37:0/538733866 conn(0x7f80000fc6f0 msgr2=0x7f80000feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:09:20.000 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:19.019+0000 7f8005112700 1 -- 172.21.15.37:0/538733866 shutdown_connections 2024-04-25T17:09:20.000 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:19.019+0000 7f8005112700 1 -- 172.21.15.37:0/538733866 wait complete. 2024-04-25T17:09:20.000 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:19.020+0000 7f8005112700 1 Processor -- start 2024-04-25T17:09:20.000 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:19.020+0000 7f8005112700 1 -- start start 2024-04-25T17:09:20.000 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:19.020+0000 7f8005112700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8000102c90 0x7f80001137d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:20.000 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:19.020+0000 7f8005112700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8000113d10 con 0x7f8000102c90 2024-04-25T17:09:20.000 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:19.020+0000 7f7ffed9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8000102c90 0x7f80001137d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:20.000 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:19.020+0000 7f7ffed9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8000102c90 0x7f80001137d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50986/0 (socket says 172.21.15.37:50986) 2024-04-25T17:09:20.001 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:19.020+0000 7f7ffed9d700 1 -- 172.21.15.37:0/3523377582 learned_addr learned my addr 172.21.15.37:0/3523377582 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:09:20.001 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:19.020+0000 7f7ffed9d700 1 -- 172.21.15.37:0/3523377582 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff00094f0 con 0x7f8000102c90 2024-04-25T17:09:20.001 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:19.021+0000 7f7ffed9d700 1 --2- 172.21.15.37:0/3523377582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8000102c90 0x7f80001137d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0000c00 tx=0x7f7ff0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:20.001 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:19.021+0000 7f7ff77fe700 1 -- 172.21.15.37:0/3523377582 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7ff00107c0 con 0x7f8000102c90 2024-04-25T17:09:20.001 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:19.021+0000 7f7ff77fe700 1 -- 172.21.15.37:0/3523377582 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f7ff0010db0 con 0x7f8000102c90 2024-04-25T17:09:20.001 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:19.021+0000 7f8005112700 1 -- 172.21.15.37:0/3523377582 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8000113f10 con 0x7f8000102c90 2024-04-25T17:09:20.001 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:19.021+0000 7f7ff77fe700 1 -- 172.21.15.37:0/3523377582 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7ff001ad00 con 0x7f8000102c90 2024-04-25T17:09:20.001 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:19.021+0000 7f8005112700 1 -- 172.21.15.37:0/3523377582 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8000114a80 con 0x7f8000102c90 2024-04-25T17:09:20.001 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:19.022+0000 7f7ff77fe700 1 -- 172.21.15.37:0/3523377582 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f7ff00193c0 con 0x7f8000102c90 2024-04-25T17:09:20.001 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:19.022+0000 7f8005112700 1 -- 172.21.15.37:0/3523377582 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f800005f5c0 con 0x7f8000102c90 2024-04-25T17:09:20.001 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:19.022+0000 7f7ff77fe700 1 --2- 172.21.15.37:0/3523377582 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f7fec0368a0 0x7f7fec038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:20.001 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:19.022+0000 7f7ff77fe700 1 -- 172.21.15.37:0/3523377582 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f7ff004a850 con 0x7f8000102c90 2024-04-25T17:09:20.001 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:19.022+0000 7f7ffe59c700 1 --2- 172.21.15.37:0/3523377582 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f7fec0368a0 0x7f7fec038d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:20.001 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:19.022+0000 7f7ffe59c700 1 --2- 172.21.15.37:0/3523377582 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f7fec0368a0 0x7f7fec038d50 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7fe8009990 tx=0x7f7fe8006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:20.001 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:19.027+0000 7f7ff77fe700 1 -- 172.21.15.37:0/3523377582 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f7ff0022930 con 0x7f8000102c90 2024-04-25T17:09:20.002 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:19.244+0000 7f8005112700 1 -- 172.21.15.37:0/3523377582 --> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7f80000fd8b0 con 0x7f7fec0368a0 2024-04-25T17:09:20.002 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:19.250+0000 7f7ff77fe700 1 -- 172.21.15.37:0/3523377582 <== mgr.14118 v2:172.21.15.37:6800/3653320894 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f80000fd8b0 con 0x7f7fec0368a0 2024-04-25T17:09:20.002 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:19.252+0000 7f8005112700 1 -- 172.21.15.37:0/3523377582 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f7fec0368a0 msgr2=0x7f7fec038d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:20.002 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:19.252+0000 7f8005112700 1 --2- 172.21.15.37:0/3523377582 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f7fec0368a0 0x7f7fec038d50 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7fe8009990 tx=0x7f7fe8006e40 comp rx=0 tx=0).stop 2024-04-25T17:09:20.002 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:19.252+0000 7f8005112700 1 -- 172.21.15.37:0/3523377582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8000102c90 msgr2=0x7f80001137d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:20.002 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:19.252+0000 7f8005112700 1 --2- 172.21.15.37:0/3523377582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8000102c90 0x7f80001137d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0000c00 tx=0x7f7ff0009250 comp rx=0 tx=0).stop 2024-04-25T17:09:20.002 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:19.252+0000 7f8005112700 1 -- 172.21.15.37:0/3523377582 shutdown_connections 2024-04-25T17:09:20.002 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:19.252+0000 7f8005112700 1 --2- 172.21.15.37:0/3523377582 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f7fec0368a0 0x7f7fec038d50 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:20.002 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:19.252+0000 7f8005112700 1 --2- 172.21.15.37:0/3523377582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8000102c90 0x7f80001137d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:20.002 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:19.252+0000 7f8005112700 1 -- 172.21.15.37:0/3523377582 >> 172.21.15.37:0/3523377582 conn(0x7f80000fc6f0 msgr2=0x7f80000fd1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:09:20.002 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:19.253+0000 7f8005112700 1 -- 172.21.15.37:0/3523377582 shutdown_connections 2024-04-25T17:09:20.002 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:19.253+0000 7f8005112700 1 -- 172.21.15.37:0/3523377582 wait complete. 2024-04-25T17:09:20.002 INFO:teuthology.orchestra.run.smithi037.stdout:Deploying mgr service with default placement... 2024-04-25T17:09:20.501 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:20 smithi037 ceph-mon[26472]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:09:20.501 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:20 smithi037 ceph-mon[26472]: Saving service mon spec with placement count:5 2024-04-25T17:09:20.501 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:20 smithi037 ceph-mon[26472]: from='mgr.14118 172.21.15.37:0/1694910703' entity='mgr.smithi037.txrgxl' 2024-04-25T17:09:21.232 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-04-25T17:09:21.232 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:20.491+0000 7f607e271700 1 Processor -- start 2024-04-25T17:09:21.232 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:20.491+0000 7f607e271700 1 -- start start 2024-04-25T17:09:21.233 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:20.491+0000 7f607e271700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6078076bf0 0x7f6078105480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:21.233 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:20.491+0000 7f607e271700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60781059c0 con 0x7f6078076bf0 2024-04-25T17:09:21.233 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:20.491+0000 7f6077fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6078076bf0 0x7f6078105480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:21.233 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:20.491+0000 7f6077fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6078076bf0 0x7f6078105480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50996/0 (socket says 172.21.15.37:50996) 2024-04-25T17:09:21.233 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:20.491+0000 7f6077fff700 1 -- 172.21.15.37:0/4177895894 learned_addr learned my addr 172.21.15.37:0/4177895894 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:09:21.233 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:20.492+0000 7f6077fff700 1 -- 172.21.15.37:0/4177895894 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6078105b00 con 0x7f6078076bf0 2024-04-25T17:09:21.233 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:20.492+0000 7f6077fff700 1 --2- 172.21.15.37:0/4177895894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6078076bf0 0x7f6078105480 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f60680098e0 tx=0x7f6068009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f96e45298753d85 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:21.233 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:20.492+0000 7f6076ffd700 1 -- 172.21.15.37:0/4177895894 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f606800b860 con 0x7f6078076bf0 2024-04-25T17:09:21.233 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:20.492+0000 7f6076ffd700 1 -- 172.21.15.37:0/4177895894 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f606800be50 con 0x7f6078076bf0 2024-04-25T17:09:21.233 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:20.492+0000 7f6076ffd700 1 -- 172.21.15.37:0/4177895894 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6068010380 con 0x7f6078076bf0 2024-04-25T17:09:21.233 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:20.492+0000 7f607e271700 1 -- 172.21.15.37:0/4177895894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6078076bf0 msgr2=0x7f6078105480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:21.233 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:20.492+0000 7f607e271700 1 --2- 172.21.15.37:0/4177895894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6078076bf0 0x7f6078105480 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f60680098e0 tx=0x7f6068009250 comp rx=0 tx=0).stop 2024-04-25T17:09:21.233 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:20.492+0000 7f607e271700 1 -- 172.21.15.37:0/4177895894 shutdown_connections 2024-04-25T17:09:21.233 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:20.492+0000 7f607e271700 1 --2- 172.21.15.37:0/4177895894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6078076bf0 0x7f6078105480 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:21.234 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:20.492+0000 7f607e271700 1 -- 172.21.15.37:0/4177895894 >> 172.21.15.37:0/4177895894 conn(0x7f60780fcef0 msgr2=0x7f60780ff300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:09:21.234 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:20.493+0000 7f607e271700 1 -- 172.21.15.37:0/4177895894 shutdown_connections 2024-04-25T17:09:21.234 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:20.493+0000 7f607e271700 1 -- 172.21.15.37:0/4177895894 wait complete. 2024-04-25T17:09:21.234 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:20.493+0000 7f607e271700 1 Processor -- start 2024-04-25T17:09:21.234 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:20.493+0000 7f607e271700 1 -- start start 2024-04-25T17:09:21.234 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:20.493+0000 7f607e271700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6078076bf0 0x7f6078111620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:21.234 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:20.493+0000 7f607e271700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6078111b60 con 0x7f6078076bf0 2024-04-25T17:09:21.234 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:20.494+0000 7f6077fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6078076bf0 0x7f6078111620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:21.234 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:20.494+0000 7f6077fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6078076bf0 0x7f6078111620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51010/0 (socket says 172.21.15.37:51010) 2024-04-25T17:09:21.234 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:20.494+0000 7f6077fff700 1 -- 172.21.15.37:0/3852454952 learned_addr learned my addr 172.21.15.37:0/3852454952 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:09:21.234 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:20.494+0000 7f6077fff700 1 -- 172.21.15.37:0/3852454952 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60680094f0 con 0x7f6078076bf0 2024-04-25T17:09:21.234 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:20.494+0000 7f6077fff700 1 --2- 172.21.15.37:0/3852454952 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6078076bf0 0x7f6078111620 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6068006b00 tx=0x7f6068009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:21.234 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:20.494+0000 7f6074ff9700 1 -- 172.21.15.37:0/3852454952 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f60680107c0 con 0x7f6078076bf0 2024-04-25T17:09:21.234 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:20.494+0000 7f6074ff9700 1 -- 172.21.15.37:0/3852454952 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1044+0+0 (secure 0 0 0) 0x7f6068010db0 con 0x7f6078076bf0 2024-04-25T17:09:21.235 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:20.494+0000 7f607e271700 1 -- 172.21.15.37:0/3852454952 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6078111d60 con 0x7f6078076bf0 2024-04-25T17:09:21.235 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:20.494+0000 7f6074ff9700 1 -- 172.21.15.37:0/3852454952 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f606801acf0 con 0x7f6078076bf0 2024-04-25T17:09:21.235 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:20.494+0000 7f607e271700 1 -- 172.21.15.37:0/3852454952 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60781128d0 con 0x7f6078076bf0 2024-04-25T17:09:21.235 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:20.495+0000 7f6074ff9700 1 -- 172.21.15.37:0/3852454952 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f6068010920 con 0x7f6078076bf0 2024-04-25T17:09:21.235 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:20.495+0000 7f6074ff9700 1 --2- 172.21.15.37:0/3852454952 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f6060036850 0x7f6060038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:21.235 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:20.495+0000 7f607e271700 1 -- 172.21.15.37:0/3852454952 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f607805f5c0 con 0x7f6078076bf0 2024-04-25T17:09:21.235 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:20.495+0000 7f6074ff9700 1 -- 172.21.15.37:0/3852454952 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f606804a620 con 0x7f6078076bf0 2024-04-25T17:09:21.235 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:20.496+0000 7f60777fe700 1 --2- 172.21.15.37:0/3852454952 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f6060036850 0x7f6060038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:21.235 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:20.496+0000 7f60777fe700 1 --2- 172.21.15.37:0/3852454952 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f6060036850 0x7f6060038d00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f606c009990 tx=0x7f606c006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:21.235 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:20.500+0000 7f6074ff9700 1 -- 172.21.15.37:0/3852454952 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f6068022340 con 0x7f6078076bf0 2024-04-25T17:09:21.235 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:20.711+0000 7f607e271700 1 -- 172.21.15.37:0/3852454952 --> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f60780fe0c0 con 0x7f6060036850 2024-04-25T17:09:21.235 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:20.718+0000 7f6074ff9700 1 -- 172.21.15.37:0/3852454952 <== mgr.14118 v2:172.21.15.37:6800/3653320894 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f60780fe0c0 con 0x7f6060036850 2024-04-25T17:09:21.235 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:20.720+0000 7f607e271700 1 -- 172.21.15.37:0/3852454952 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f6060036850 msgr2=0x7f6060038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:21.235 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:20.720+0000 7f607e271700 1 --2- 172.21.15.37:0/3852454952 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f6060036850 0x7f6060038d00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f606c009990 tx=0x7f606c006e40 comp rx=0 tx=0).stop 2024-04-25T17:09:21.236 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:20.720+0000 7f607e271700 1 -- 172.21.15.37:0/3852454952 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6078076bf0 msgr2=0x7f6078111620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:21.236 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:20.720+0000 7f607e271700 1 --2- 172.21.15.37:0/3852454952 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6078076bf0 0x7f6078111620 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6068006b00 tx=0x7f6068009250 comp rx=0 tx=0).stop 2024-04-25T17:09:21.236 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:20.720+0000 7f607e271700 1 -- 172.21.15.37:0/3852454952 shutdown_connections 2024-04-25T17:09:21.236 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:20.720+0000 7f607e271700 1 --2- 172.21.15.37:0/3852454952 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f6060036850 0x7f6060038d00 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:21.236 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:20.720+0000 7f607e271700 1 --2- 172.21.15.37:0/3852454952 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6078076bf0 0x7f6078111620 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:21.236 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:20.720+0000 7f607e271700 1 -- 172.21.15.37:0/3852454952 >> 172.21.15.37:0/3852454952 conn(0x7f60780fcef0 msgr2=0x7f60780fd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:09:21.236 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:20.720+0000 7f607e271700 1 -- 172.21.15.37:0/3852454952 shutdown_connections 2024-04-25T17:09:21.236 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:20.720+0000 7f607e271700 1 -- 172.21.15.37:0/3852454952 wait complete. 2024-04-25T17:09:21.236 INFO:teuthology.orchestra.run.smithi037.stdout:Deploying crash service with default placement... 2024-04-25T17:09:22.003 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:21 smithi037 ceph-mon[26472]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:09:22.003 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:21 smithi037 ceph-mon[26472]: Saving service mgr spec with placement count:2 2024-04-25T17:09:22.003 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:21 smithi037 ceph-mon[26472]: from='mgr.14118 172.21.15.37:0/1694910703' entity='mgr.smithi037.txrgxl' 2024-04-25T17:09:23.109 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:22 smithi037 ceph-mon[26472]: from='mgr.14118 172.21.15.37:0/1694910703' entity='mgr.smithi037.txrgxl' 2024-04-25T17:09:23.109 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:22 smithi037 ceph-mon[26472]: from='mgr.14118 172.21.15.37:0/1694910703' entity='mgr.smithi037.txrgxl' 2024-04-25T17:09:23.109 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:22 smithi037 ceph-mon[26472]: from='mgr.14118 172.21.15.37:0/1694910703' entity='mgr.smithi037.txrgxl' 2024-04-25T17:09:23.117 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-04-25T17:09:23.117 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:22.313+0000 7f523497e700 1 Processor -- start 2024-04-25T17:09:23.117 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:22.313+0000 7f523497e700 1 -- start start 2024-04-25T17:09:23.117 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:22.313+0000 7f523497e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5230100c20 0x7f5230101030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:23.117 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:22.313+0000 7f523497e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5230101570 con 0x7f5230100c20 2024-04-25T17:09:23.117 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:22.313+0000 7f522e59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5230100c20 0x7f5230101030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:23.117 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:22.313+0000 7f522e59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5230100c20 0x7f5230101030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51012/0 (socket says 172.21.15.37:51012) 2024-04-25T17:09:23.117 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:22.313+0000 7f522e59c700 1 -- 172.21.15.37:0/3584824035 learned_addr learned my addr 172.21.15.37:0/3584824035 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:09:23.117 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:22.313+0000 7f522e59c700 1 -- 172.21.15.37:0/3584824035 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52301016b0 con 0x7f5230100c20 2024-04-25T17:09:23.117 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:22.314+0000 7f522e59c700 1 --2- 172.21.15.37:0/3584824035 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5230100c20 0x7f5230101030 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f52200098e0 tx=0x7f5220009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b43ed360c056831e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:23.117 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:22.314+0000 7f522d59a700 1 -- 172.21.15.37:0/3584824035 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f522000b860 con 0x7f5230100c20 2024-04-25T17:09:23.117 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:22.314+0000 7f522d59a700 1 -- 172.21.15.37:0/3584824035 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f522000be90 con 0x7f5230100c20 2024-04-25T17:09:23.117 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:22.314+0000 7f522d59a700 1 -- 172.21.15.37:0/3584824035 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f52200103c0 con 0x7f5230100c20 2024-04-25T17:09:23.118 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:22.314+0000 7f523497e700 1 -- 172.21.15.37:0/3584824035 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5230100c20 msgr2=0x7f5230101030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:23.118 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:22.314+0000 7f523497e700 1 --2- 172.21.15.37:0/3584824035 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5230100c20 0x7f5230101030 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f52200098e0 tx=0x7f5220009250 comp rx=0 tx=0).stop 2024-04-25T17:09:23.118 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:22.314+0000 7f523497e700 1 -- 172.21.15.37:0/3584824035 shutdown_connections 2024-04-25T17:09:23.118 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:22.314+0000 7f523497e700 1 --2- 172.21.15.37:0/3584824035 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5230100c20 0x7f5230101030 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:23.118 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:22.314+0000 7f523497e700 1 -- 172.21.15.37:0/3584824035 >> 172.21.15.37:0/3584824035 conn(0x7f52300fc6f0 msgr2=0x7f52300feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:09:23.118 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:22.315+0000 7f523497e700 1 -- 172.21.15.37:0/3584824035 shutdown_connections 2024-04-25T17:09:23.118 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:22.315+0000 7f523497e700 1 -- 172.21.15.37:0/3584824035 wait complete. 2024-04-25T17:09:23.118 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:22.315+0000 7f523497e700 1 Processor -- start 2024-04-25T17:09:23.118 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:22.315+0000 7f523497e700 1 -- start start 2024-04-25T17:09:23.118 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:22.315+0000 7f523497e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5230100c20 0x7f52301115f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:23.118 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:22.315+0000 7f523497e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5230111b30 con 0x7f5230100c20 2024-04-25T17:09:23.118 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:22.315+0000 7f522e59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5230100c20 0x7f52301115f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:23.118 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:22.315+0000 7f522e59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5230100c20 0x7f52301115f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51024/0 (socket says 172.21.15.37:51024) 2024-04-25T17:09:23.118 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:22.315+0000 7f522e59c700 1 -- 172.21.15.37:0/4104722164 learned_addr learned my addr 172.21.15.37:0/4104722164 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:09:23.119 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:22.316+0000 7f522e59c700 1 -- 172.21.15.37:0/4104722164 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52200094f0 con 0x7f5230100c20 2024-04-25T17:09:23.119 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:22.316+0000 7f522e59c700 1 --2- 172.21.15.37:0/4104722164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5230100c20 0x7f52301115f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f52200090b0 tx=0x7f5220009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:23.119 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:22.316+0000 7f521effd700 1 -- 172.21.15.37:0/4104722164 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5220010840 con 0x7f5230100c20 2024-04-25T17:09:23.119 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:22.316+0000 7f521effd700 1 -- 172.21.15.37:0/4104722164 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5220010e70 con 0x7f5230100c20 2024-04-25T17:09:23.119 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:22.316+0000 7f523497e700 1 -- 172.21.15.37:0/4104722164 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5230111d30 con 0x7f5230100c20 2024-04-25T17:09:23.119 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:22.316+0000 7f521effd700 1 -- 172.21.15.37:0/4104722164 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5220024e40 con 0x7f5230100c20 2024-04-25T17:09:23.119 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:22.316+0000 7f523497e700 1 -- 172.21.15.37:0/4104722164 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52301128a0 con 0x7f5230100c20 2024-04-25T17:09:23.119 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:22.317+0000 7f521effd700 1 -- 172.21.15.37:0/4104722164 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f522001a510 con 0x7f5230100c20 2024-04-25T17:09:23.119 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:22.317+0000 7f523497e700 1 -- 172.21.15.37:0/4104722164 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f523005f5c0 con 0x7f5230100c20 2024-04-25T17:09:23.119 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:22.317+0000 7f521effd700 1 --2- 172.21.15.37:0/4104722164 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f5218036800 0x7f5218038cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:23.119 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:22.317+0000 7f521effd700 1 -- 172.21.15.37:0/4104722164 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f522004a7b0 con 0x7f5230100c20 2024-04-25T17:09:23.119 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:22.317+0000 7f522dd9b700 1 --2- 172.21.15.37:0/4104722164 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f5218036800 0x7f5218038cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:23.119 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:22.318+0000 7f522dd9b700 1 --2- 172.21.15.37:0/4104722164 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f5218036800 0x7f5218038cb0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5224009990 tx=0x7f5224006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:23.119 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:22.322+0000 7f521effd700 1 -- 172.21.15.37:0/4104722164 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f522002c520 con 0x7f5230100c20 2024-04-25T17:09:23.119 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:22.538+0000 7f523497e700 1 -- 172.21.15.37:0/4104722164 --> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7f52300fd8c0 con 0x7f5218036800 2024-04-25T17:09:23.119 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:22.545+0000 7f521effd700 1 -- 172.21.15.37:0/4104722164 <== mgr.14118 v2:172.21.15.37:6800/3653320894 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f52300fd8c0 con 0x7f5218036800 2024-04-25T17:09:23.120 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:22.547+0000 7f523497e700 1 -- 172.21.15.37:0/4104722164 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f5218036800 msgr2=0x7f5218038cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:23.120 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:22.547+0000 7f523497e700 1 --2- 172.21.15.37:0/4104722164 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f5218036800 0x7f5218038cb0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5224009990 tx=0x7f5224006e40 comp rx=0 tx=0).stop 2024-04-25T17:09:23.120 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:22.547+0000 7f523497e700 1 -- 172.21.15.37:0/4104722164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5230100c20 msgr2=0x7f52301115f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:23.120 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:22.547+0000 7f523497e700 1 --2- 172.21.15.37:0/4104722164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5230100c20 0x7f52301115f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f52200090b0 tx=0x7f5220009250 comp rx=0 tx=0).stop 2024-04-25T17:09:23.120 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:22.547+0000 7f523497e700 1 -- 172.21.15.37:0/4104722164 shutdown_connections 2024-04-25T17:09:23.120 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:22.547+0000 7f523497e700 1 --2- 172.21.15.37:0/4104722164 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f5218036800 0x7f5218038cb0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:23.120 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:22.547+0000 7f523497e700 1 --2- 172.21.15.37:0/4104722164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5230100c20 0x7f52301115f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:23.120 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:22.547+0000 7f523497e700 1 -- 172.21.15.37:0/4104722164 >> 172.21.15.37:0/4104722164 conn(0x7f52300fc6f0 msgr2=0x7f52300fd1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:09:23.120 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:22.547+0000 7f523497e700 1 -- 172.21.15.37:0/4104722164 shutdown_connections 2024-04-25T17:09:23.120 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:22.547+0000 7f523497e700 1 -- 172.21.15.37:0/4104722164 wait complete. 2024-04-25T17:09:23.120 INFO:teuthology.orchestra.run.smithi037.stdout:Deploying prometheus service with default placement... 2024-04-25T17:09:24.070 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:23 smithi037 ceph-mon[26472]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:09:24.070 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:23 smithi037 ceph-mon[26472]: Saving service crash spec with placement * 2024-04-25T17:09:24.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:23 smithi037 ceph-mon[26472]: from='mgr.14118 172.21.15.37:0/1694910703' entity='mgr.smithi037.txrgxl' 2024-04-25T17:09:24.685 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-04-25T17:09:24.685 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:23.552+0000 7fe7148e2700 1 Processor -- start 2024-04-25T17:09:24.685 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:23.552+0000 7fe7148e2700 1 -- start start 2024-04-25T17:09:24.685 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:23.553+0000 7fe7148e2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe710102890 0x7fe710102ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:24.685 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:23.553+0000 7fe7148e2700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7101031e0 con 0x7fe710102890 2024-04-25T17:09:24.685 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:23.553+0000 7fe70e59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe710102890 0x7fe710102ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:24.685 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:23.553+0000 7fe70e59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe710102890 0x7fe710102ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51028/0 (socket says 172.21.15.37:51028) 2024-04-25T17:09:24.685 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:23.553+0000 7fe70e59c700 1 -- 172.21.15.37:0/954436084 learned_addr learned my addr 172.21.15.37:0/954436084 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:09:24.685 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:23.553+0000 7fe70e59c700 1 -- 172.21.15.37:0/954436084 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe710103320 con 0x7fe710102890 2024-04-25T17:09:24.685 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:23.553+0000 7fe70e59c700 1 --2- 172.21.15.37:0/954436084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe710102890 0x7fe710102ca0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe708009e50 tx=0x7fe708009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a2605eee4095d56 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:24.685 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:23.554+0000 7fe70d59a700 1 -- 172.21.15.37:0/954436084 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe7080092e0 con 0x7fe710102890 2024-04-25T17:09:24.686 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:23.554+0000 7fe70d59a700 1 -- 172.21.15.37:0/954436084 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe708012430 con 0x7fe710102890 2024-04-25T17:09:24.686 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:23.554+0000 7fe70d59a700 1 -- 172.21.15.37:0/954436084 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe7080075a0 con 0x7fe710102890 2024-04-25T17:09:24.686 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:23.554+0000 7fe7148e2700 1 -- 172.21.15.37:0/954436084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe710102890 msgr2=0x7fe710102ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:24.686 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:23.554+0000 7fe7148e2700 1 --2- 172.21.15.37:0/954436084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe710102890 0x7fe710102ca0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe708009e50 tx=0x7fe708009840 comp rx=0 tx=0).stop 2024-04-25T17:09:24.686 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:23.555+0000 7fe7148e2700 1 -- 172.21.15.37:0/954436084 shutdown_connections 2024-04-25T17:09:24.686 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:23.555+0000 7fe7148e2700 1 --2- 172.21.15.37:0/954436084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe710102890 0x7fe710102ca0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:24.686 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:23.555+0000 7fe7148e2700 1 -- 172.21.15.37:0/954436084 >> 172.21.15.37:0/954436084 conn(0x7fe7100fe010 msgr2=0x7fe710100420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:09:24.686 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:23.555+0000 7fe7148e2700 1 -- 172.21.15.37:0/954436084 shutdown_connections 2024-04-25T17:09:24.686 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:23.555+0000 7fe7148e2700 1 -- 172.21.15.37:0/954436084 wait complete. 2024-04-25T17:09:24.686 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:23.555+0000 7fe7148e2700 1 Processor -- start 2024-04-25T17:09:24.686 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:23.555+0000 7fe7148e2700 1 -- start start 2024-04-25T17:09:24.686 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:23.555+0000 7fe7148e2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe710102890 0x7fe710111620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:24.686 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:23.555+0000 7fe7148e2700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe710111b60 con 0x7fe710102890 2024-04-25T17:09:24.687 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:23.556+0000 7fe70e59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe710102890 0x7fe710111620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:24.687 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:23.556+0000 7fe70e59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe710102890 0x7fe710111620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51030/0 (socket says 172.21.15.37:51030) 2024-04-25T17:09:24.687 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:23.556+0000 7fe70e59c700 1 -- 172.21.15.37:0/2072188370 learned_addr learned my addr 172.21.15.37:0/2072188370 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:09:24.687 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:23.556+0000 7fe70e59c700 1 -- 172.21.15.37:0/2072188370 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe708009ae0 con 0x7fe710102890 2024-04-25T17:09:24.687 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:23.556+0000 7fe70e59c700 1 --2- 172.21.15.37:0/2072188370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe710102890 0x7fe710111620 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe7080127d0 tx=0x7fe708009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:24.687 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:23.556+0000 7fe706ffd700 1 -- 172.21.15.37:0/2072188370 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe7080092e0 con 0x7fe710102890 2024-04-25T17:09:24.687 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:23.556+0000 7fe7148e2700 1 -- 172.21.15.37:0/2072188370 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe710111d60 con 0x7fe710102890 2024-04-25T17:09:24.687 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:23.557+0000 7fe7148e2700 1 -- 172.21.15.37:0/2072188370 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7101128d0 con 0x7fe710102890 2024-04-25T17:09:24.687 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:23.557+0000 7fe706ffd700 1 -- 172.21.15.37:0/2072188370 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe708007d30 con 0x7fe710102890 2024-04-25T17:09:24.687 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:23.557+0000 7fe706ffd700 1 -- 172.21.15.37:0/2072188370 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe708025960 con 0x7fe710102890 2024-04-25T17:09:24.687 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:23.557+0000 7fe706ffd700 1 -- 172.21.15.37:0/2072188370 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7fe708019050 con 0x7fe710102890 2024-04-25T17:09:24.687 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:23.558+0000 7fe7148e2700 1 -- 172.21.15.37:0/2072188370 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe71005f5c0 con 0x7fe710102890 2024-04-25T17:09:24.687 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:23.558+0000 7fe706ffd700 1 --2- 172.21.15.37:0/2072188370 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7fe6fc0368a0 0x7fe6fc038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:24.687 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:23.558+0000 7fe706ffd700 1 -- 172.21.15.37:0/2072188370 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fe70804a020 con 0x7fe710102890 2024-04-25T17:09:24.688 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:23.558+0000 7fe70dd9b700 1 --2- 172.21.15.37:0/2072188370 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7fe6fc0368a0 0x7fe6fc038d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:24.688 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:23.558+0000 7fe70dd9b700 1 --2- 172.21.15.37:0/2072188370 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7fe6fc0368a0 0x7fe6fc038d50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8009990 tx=0x7fe6f8006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:24.688 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:23.563+0000 7fe706ffd700 1 -- 172.21.15.37:0/2072188370 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fe70802d530 con 0x7fe710102890 2024-04-25T17:09:24.688 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:23.775+0000 7fe7148e2700 1 -- 172.21.15.37:0/2072188370 --> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7fe7100ff1e0 con 0x7fe6fc0368a0 2024-04-25T17:09:24.688 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:23.779+0000 7fe706ffd700 1 -- 172.21.15.37:0/2072188370 <== mgr.14118 v2:172.21.15.37:6800/3653320894 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7fe7100ff1e0 con 0x7fe6fc0368a0 2024-04-25T17:09:24.688 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:23.781+0000 7fe7148e2700 1 -- 172.21.15.37:0/2072188370 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7fe6fc0368a0 msgr2=0x7fe6fc038d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:24.688 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:23.781+0000 7fe7148e2700 1 --2- 172.21.15.37:0/2072188370 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7fe6fc0368a0 0x7fe6fc038d50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe6f8009990 tx=0x7fe6f8006e40 comp rx=0 tx=0).stop 2024-04-25T17:09:24.688 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:23.781+0000 7fe7148e2700 1 -- 172.21.15.37:0/2072188370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe710102890 msgr2=0x7fe710111620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:24.688 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:23.781+0000 7fe7148e2700 1 --2- 172.21.15.37:0/2072188370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe710102890 0x7fe710111620 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe7080127d0 tx=0x7fe708009840 comp rx=0 tx=0).stop 2024-04-25T17:09:24.688 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:23.781+0000 7fe7148e2700 1 -- 172.21.15.37:0/2072188370 shutdown_connections 2024-04-25T17:09:24.688 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:23.781+0000 7fe7148e2700 1 --2- 172.21.15.37:0/2072188370 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7fe6fc0368a0 0x7fe6fc038d50 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:24.688 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:23.781+0000 7fe7148e2700 1 --2- 172.21.15.37:0/2072188370 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe710102890 0x7fe710111620 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:24.688 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:23.781+0000 7fe7148e2700 1 -- 172.21.15.37:0/2072188370 >> 172.21.15.37:0/2072188370 conn(0x7fe7100fe010 msgr2=0x7fe7100fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:09:24.688 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:23.781+0000 7fe7148e2700 1 -- 172.21.15.37:0/2072188370 shutdown_connections 2024-04-25T17:09:24.688 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:23.781+0000 7fe7148e2700 1 -- 172.21.15.37:0/2072188370 wait complete. 2024-04-25T17:09:24.688 INFO:teuthology.orchestra.run.smithi037.stdout:Deploying grafana service with default placement... 2024-04-25T17:09:24.995 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:24 smithi037 ceph-mon[26472]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:09:24.996 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:24 smithi037 ceph-mon[26472]: Saving service prometheus spec with placement count:1 2024-04-25T17:09:25.975 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:25 smithi037 ceph-mon[26472]: from='mgr.14118 172.21.15.37:0/1694910703' entity='mgr.smithi037.txrgxl' 2024-04-25T17:09:25.975 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:25 smithi037 ceph-mon[26472]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:09:25.975 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:25 smithi037 ceph-mon[26472]: Saving service grafana spec with placement count:1 2024-04-25T17:09:25.975 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:25 smithi037 ceph-mon[26472]: from='mgr.14118 172.21.15.37:0/1694910703' entity='mgr.smithi037.txrgxl' 2024-04-25T17:09:25.983 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-04-25T17:09:25.983 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:25.097+0000 7f55108ce700 1 Processor -- start 2024-04-25T17:09:25.983 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:25.097+0000 7f55108ce700 1 -- start start 2024-04-25T17:09:25.983 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:25.098+0000 7f55108ce700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f550c101d40 0x7f550c102150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:25.983 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:25.098+0000 7f55108ce700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550c102690 con 0x7f550c101d40 2024-04-25T17:09:25.984 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:25.098+0000 7f550a59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f550c101d40 0x7f550c102150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:25.984 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:25.098+0000 7f550a59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f550c101d40 0x7f550c102150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51042/0 (socket says 172.21.15.37:51042) 2024-04-25T17:09:25.984 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:25.098+0000 7f550a59c700 1 -- 172.21.15.37:0/791174491 learned_addr learned my addr 172.21.15.37:0/791174491 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:09:25.984 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:25.098+0000 7f550a59c700 1 -- 172.21.15.37:0/791174491 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f550c1027d0 con 0x7f550c101d40 2024-04-25T17:09:25.984 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:25.098+0000 7f550a59c700 1 --2- 172.21.15.37:0/791174491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f550c101d40 0x7f550c102150 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f54fc0098e0 tx=0x7f54fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8fe5929012981fb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:25.984 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:25.099+0000 7f550959a700 1 -- 172.21.15.37:0/791174491 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f54fc00b860 con 0x7f550c101d40 2024-04-25T17:09:25.984 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:25.099+0000 7f550959a700 1 -- 172.21.15.37:0/791174491 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f54fc00be90 con 0x7f550c101d40 2024-04-25T17:09:25.984 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:25.099+0000 7f550959a700 1 -- 172.21.15.37:0/791174491 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f54fc0103c0 con 0x7f550c101d40 2024-04-25T17:09:25.984 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:25.099+0000 7f55108ce700 1 -- 172.21.15.37:0/791174491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f550c101d40 msgr2=0x7f550c102150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:25.984 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:25.099+0000 7f55108ce700 1 --2- 172.21.15.37:0/791174491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f550c101d40 0x7f550c102150 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f54fc0098e0 tx=0x7f54fc009250 comp rx=0 tx=0).stop 2024-04-25T17:09:25.984 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:25.099+0000 7f55108ce700 1 -- 172.21.15.37:0/791174491 shutdown_connections 2024-04-25T17:09:25.984 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:25.099+0000 7f55108ce700 1 --2- 172.21.15.37:0/791174491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f550c101d40 0x7f550c102150 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:25.984 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:25.099+0000 7f55108ce700 1 -- 172.21.15.37:0/791174491 >> 172.21.15.37:0/791174491 conn(0x7f550c0fc690 msgr2=0x7f550c0feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:09:25.985 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:25.099+0000 7f55108ce700 1 -- 172.21.15.37:0/791174491 shutdown_connections 2024-04-25T17:09:25.985 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:25.099+0000 7f55108ce700 1 -- 172.21.15.37:0/791174491 wait complete. 2024-04-25T17:09:25.985 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:25.100+0000 7f55108ce700 1 Processor -- start 2024-04-25T17:09:25.985 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:25.100+0000 7f55108ce700 1 -- start start 2024-04-25T17:09:25.985 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:25.100+0000 7f55108ce700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f550c101d40 0x7f550c101540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:25.985 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:25.100+0000 7f55108ce700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550c112110 con 0x7f550c101d40 2024-04-25T17:09:25.985 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:25.100+0000 7f550a59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f550c101d40 0x7f550c101540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:25.985 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:25.100+0000 7f550a59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f550c101d40 0x7f550c101540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51058/0 (socket says 172.21.15.37:51058) 2024-04-25T17:09:25.985 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:25.100+0000 7f550a59c700 1 -- 172.21.15.37:0/3497162512 learned_addr learned my addr 172.21.15.37:0/3497162512 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:09:25.985 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:25.100+0000 7f550a59c700 1 -- 172.21.15.37:0/3497162512 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54fc0094f0 con 0x7f550c101d40 2024-04-25T17:09:25.985 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:25.101+0000 7f550a59c700 1 --2- 172.21.15.37:0/3497162512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f550c101d40 0x7f550c101540 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f54fc011680 tx=0x7f54fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:25.986 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:25.101+0000 7f54faffd700 1 -- 172.21.15.37:0/3497162512 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f54fc010890 con 0x7f550c101d40 2024-04-25T17:09:25.986 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:25.101+0000 7f54faffd700 1 -- 172.21.15.37:0/3497162512 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f54fc010ec0 con 0x7f550c101d40 2024-04-25T17:09:25.986 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:25.101+0000 7f55108ce700 1 -- 172.21.15.37:0/3497162512 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f550c116720 con 0x7f550c101d40 2024-04-25T17:09:25.986 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:25.101+0000 7f54faffd700 1 -- 172.21.15.37:0/3497162512 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f54fc0243f0 con 0x7f550c101d40 2024-04-25T17:09:25.986 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:25.101+0000 7f55108ce700 1 -- 172.21.15.37:0/3497162512 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f550c116af0 con 0x7f550c101d40 2024-04-25T17:09:25.986 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:25.102+0000 7f54faffd700 1 -- 172.21.15.37:0/3497162512 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f54fc02d3f0 con 0x7f550c101d40 2024-04-25T17:09:25.986 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:25.102+0000 7f54faffd700 1 --2- 172.21.15.37:0/3497162512 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f54f4036850 0x7f54f4038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:25.986 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:25.102+0000 7f54faffd700 1 -- 172.21.15.37:0/3497162512 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f54fc04a380 con 0x7f550c101d40 2024-04-25T17:09:25.986 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:25.102+0000 7f55108ce700 1 -- 172.21.15.37:0/3497162512 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f550c04bed0 con 0x7f550c101d40 2024-04-25T17:09:25.986 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:25.102+0000 7f5509d9b700 1 --2- 172.21.15.37:0/3497162512 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f54f4036850 0x7f54f4038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:25.986 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:25.102+0000 7f5509d9b700 1 --2- 172.21.15.37:0/3497162512 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f54f4036850 0x7f54f4038d00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5500009990 tx=0x7f5500006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:25.986 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:25.107+0000 7f54faffd700 1 -- 172.21.15.37:0/3497162512 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f54fc02b8e0 con 0x7f550c101d40 2024-04-25T17:09:25.986 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:25.354+0000 7f55108ce700 1 -- 172.21.15.37:0/3497162512 --> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7f550c0fd850 con 0x7f54f4036850 2024-04-25T17:09:25.987 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:25.367+0000 7f54faffd700 1 -- 172.21.15.37:0/3497162512 <== mgr.14118 v2:172.21.15.37:6800/3653320894 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f550c0fd850 con 0x7f54f4036850 2024-04-25T17:09:25.987 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:25.369+0000 7f55108ce700 1 -- 172.21.15.37:0/3497162512 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f54f4036850 msgr2=0x7f54f4038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:25.987 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:25.369+0000 7f55108ce700 1 --2- 172.21.15.37:0/3497162512 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f54f4036850 0x7f54f4038d00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5500009990 tx=0x7f5500006e40 comp rx=0 tx=0).stop 2024-04-25T17:09:25.987 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:25.369+0000 7f55108ce700 1 -- 172.21.15.37:0/3497162512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f550c101d40 msgr2=0x7f550c101540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:25.987 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:25.369+0000 7f55108ce700 1 --2- 172.21.15.37:0/3497162512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f550c101d40 0x7f550c101540 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f54fc011680 tx=0x7f54fc009250 comp rx=0 tx=0).stop 2024-04-25T17:09:25.987 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:25.369+0000 7f55108ce700 1 -- 172.21.15.37:0/3497162512 shutdown_connections 2024-04-25T17:09:25.987 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:25.369+0000 7f55108ce700 1 --2- 172.21.15.37:0/3497162512 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f54f4036850 0x7f54f4038d00 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:25.987 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:25.369+0000 7f55108ce700 1 --2- 172.21.15.37:0/3497162512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f550c101d40 0x7f550c101540 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:25.987 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:25.369+0000 7f55108ce700 1 -- 172.21.15.37:0/3497162512 >> 172.21.15.37:0/3497162512 conn(0x7f550c0fc690 msgr2=0x7f550c0fd140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:09:25.987 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:25.369+0000 7f55108ce700 1 -- 172.21.15.37:0/3497162512 shutdown_connections 2024-04-25T17:09:25.987 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:25.369+0000 7f55108ce700 1 -- 172.21.15.37:0/3497162512 wait complete. 2024-04-25T17:09:25.987 INFO:teuthology.orchestra.run.smithi037.stdout:Deploying node-exporter service with default placement... 2024-04-25T17:09:27.320 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:27 smithi037 ceph-mon[26472]: from='mgr.14118 172.21.15.37:0/1694910703' entity='mgr.smithi037.txrgxl' 2024-04-25T17:09:27.321 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:27 smithi037 ceph-mon[26472]: from='mgr.14118 172.21.15.37:0/1694910703' entity='mgr.smithi037.txrgxl' 2024-04-25T17:09:27.592 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-04-25T17:09:27.592 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:26.421+0000 7fb3c16f5700 1 Processor -- start 2024-04-25T17:09:27.592 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:26.421+0000 7fb3c16f5700 1 -- start start 2024-04-25T17:09:27.592 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:26.421+0000 7fb3c16f5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3bc101ce0 0x7fb3bc1020f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:27.592 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:26.421+0000 7fb3c16f5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3bc102630 con 0x7fb3bc101ce0 2024-04-25T17:09:27.592 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:26.421+0000 7fb3baffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3bc101ce0 0x7fb3bc1020f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:27.592 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:26.421+0000 7fb3baffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3bc101ce0 0x7fb3bc1020f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51066/0 (socket says 172.21.15.37:51066) 2024-04-25T17:09:27.593 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:26.421+0000 7fb3baffd700 1 -- 172.21.15.37:0/4022226992 learned_addr learned my addr 172.21.15.37:0/4022226992 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:09:27.593 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:26.421+0000 7fb3baffd700 1 -- 172.21.15.37:0/4022226992 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3bc102770 con 0x7fb3bc101ce0 2024-04-25T17:09:27.593 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:26.422+0000 7fb3baffd700 1 --2- 172.21.15.37:0/4022226992 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3bc101ce0 0x7fb3bc1020f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac0098e0 tx=0x7fb3ac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80894aa6e8e51704 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:27.593 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:26.422+0000 7fb3b9ffb700 1 -- 172.21.15.37:0/4022226992 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb3ac00b860 con 0x7fb3bc101ce0 2024-04-25T17:09:27.593 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:26.422+0000 7fb3b9ffb700 1 -- 172.21.15.37:0/4022226992 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb3ac00be90 con 0x7fb3bc101ce0 2024-04-25T17:09:27.593 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:26.422+0000 7fb3b9ffb700 1 -- 172.21.15.37:0/4022226992 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb3ac0103c0 con 0x7fb3bc101ce0 2024-04-25T17:09:27.593 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:26.422+0000 7fb3c16f5700 1 -- 172.21.15.37:0/4022226992 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3bc101ce0 msgr2=0x7fb3bc1020f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:27.593 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:26.422+0000 7fb3c16f5700 1 --2- 172.21.15.37:0/4022226992 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3bc101ce0 0x7fb3bc1020f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac0098e0 tx=0x7fb3ac009250 comp rx=0 tx=0).stop 2024-04-25T17:09:27.593 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:26.422+0000 7fb3c16f5700 1 -- 172.21.15.37:0/4022226992 shutdown_connections 2024-04-25T17:09:27.593 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:26.422+0000 7fb3c16f5700 1 --2- 172.21.15.37:0/4022226992 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3bc101ce0 0x7fb3bc1020f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:27.593 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:26.422+0000 7fb3c16f5700 1 -- 172.21.15.37:0/4022226992 >> 172.21.15.37:0/4022226992 conn(0x7fb3bc0fc6f0 msgr2=0x7fb3bc0feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:09:27.593 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:26.422+0000 7fb3c16f5700 1 -- 172.21.15.37:0/4022226992 shutdown_connections 2024-04-25T17:09:27.593 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:26.423+0000 7fb3c16f5700 1 -- 172.21.15.37:0/4022226992 wait complete. 2024-04-25T17:09:27.593 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:26.423+0000 7fb3c16f5700 1 Processor -- start 2024-04-25T17:09:27.593 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:26.423+0000 7fb3c16f5700 1 -- start start 2024-04-25T17:09:27.593 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:26.423+0000 7fb3c16f5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3bc101ce0 0x7fb3bc1079d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:27.594 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:26.423+0000 7fb3c16f5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3bc107f10 con 0x7fb3bc101ce0 2024-04-25T17:09:27.594 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:26.423+0000 7fb3baffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3bc101ce0 0x7fb3bc1079d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:27.594 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:26.423+0000 7fb3baffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3bc101ce0 0x7fb3bc1079d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51078/0 (socket says 172.21.15.37:51078) 2024-04-25T17:09:27.594 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:26.423+0000 7fb3baffd700 1 -- 172.21.15.37:0/4123299165 learned_addr learned my addr 172.21.15.37:0/4123299165 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:09:27.594 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:26.424+0000 7fb3baffd700 1 -- 172.21.15.37:0/4123299165 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3ac0094f0 con 0x7fb3bc101ce0 2024-04-25T17:09:27.594 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:26.424+0000 7fb3baffd700 1 --2- 172.21.15.37:0/4123299165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3bc101ce0 0x7fb3bc1079d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac006d40 tx=0x7fb3ac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:27.594 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:26.424+0000 7fb3a37fe700 1 -- 172.21.15.37:0/4123299165 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb3ac010840 con 0x7fb3bc101ce0 2024-04-25T17:09:27.594 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:26.424+0000 7fb3c16f5700 1 -- 172.21.15.37:0/4123299165 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3bc105fd0 con 0x7fb3bc101ce0 2024-04-25T17:09:27.594 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:26.424+0000 7fb3a37fe700 1 -- 172.21.15.37:0/4123299165 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb3ac010e70 con 0x7fb3bc101ce0 2024-04-25T17:09:27.594 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:26.424+0000 7fb3a37fe700 1 -- 172.21.15.37:0/4123299165 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb3ac024ea0 con 0x7fb3bc101ce0 2024-04-25T17:09:27.594 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:26.424+0000 7fb3c16f5700 1 -- 172.21.15.37:0/4123299165 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3bc1064c0 con 0x7fb3bc101ce0 2024-04-25T17:09:27.594 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:26.425+0000 7fb3a37fe700 1 -- 172.21.15.37:0/4123299165 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7fb3ac01a510 con 0x7fb3bc101ce0 2024-04-25T17:09:27.594 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:26.425+0000 7fb3a37fe700 1 --2- 172.21.15.37:0/4123299165 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7fb3a4036800 0x7fb3a4038cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:27.594 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:26.425+0000 7fb3a37fe700 1 -- 172.21.15.37:0/4123299165 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fb3ac04a6c0 con 0x7fb3bc101ce0 2024-04-25T17:09:27.594 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:26.425+0000 7fb3c16f5700 1 -- 172.21.15.37:0/4123299165 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3bc04bed0 con 0x7fb3bc101ce0 2024-04-25T17:09:27.595 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:26.425+0000 7fb3ba7fc700 1 --2- 172.21.15.37:0/4123299165 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7fb3a4036800 0x7fb3a4038cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:27.595 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:26.426+0000 7fb3ba7fc700 1 --2- 172.21.15.37:0/4123299165 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7fb3a4036800 0x7fb3a4038cb0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0009990 tx=0x7fb3b0006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:27.595 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:26.430+0000 7fb3a37fe700 1 -- 172.21.15.37:0/4123299165 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fb3ac018940 con 0x7fb3bc101ce0 2024-04-25T17:09:27.595 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:26.644+0000 7fb3c16f5700 1 -- 172.21.15.37:0/4123299165 --> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7fb3bc10b2f0 con 0x7fb3a4036800 2024-04-25T17:09:27.595 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:26.649+0000 7fb3a37fe700 1 -- 172.21.15.37:0/4123299165 <== mgr.14118 v2:172.21.15.37:6800/3653320894 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7fb3bc10b2f0 con 0x7fb3a4036800 2024-04-25T17:09:27.595 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:26.651+0000 7fb3c16f5700 1 -- 172.21.15.37:0/4123299165 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7fb3a4036800 msgr2=0x7fb3a4038cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:27.595 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:26.651+0000 7fb3c16f5700 1 --2- 172.21.15.37:0/4123299165 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7fb3a4036800 0x7fb3a4038cb0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0009990 tx=0x7fb3b0006e40 comp rx=0 tx=0).stop 2024-04-25T17:09:27.595 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:26.651+0000 7fb3c16f5700 1 -- 172.21.15.37:0/4123299165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3bc101ce0 msgr2=0x7fb3bc1079d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:27.595 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:26.651+0000 7fb3c16f5700 1 --2- 172.21.15.37:0/4123299165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3bc101ce0 0x7fb3bc1079d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac006d40 tx=0x7fb3ac009250 comp rx=0 tx=0).stop 2024-04-25T17:09:27.595 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:26.651+0000 7fb3c16f5700 1 -- 172.21.15.37:0/4123299165 shutdown_connections 2024-04-25T17:09:27.595 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:26.651+0000 7fb3c16f5700 1 --2- 172.21.15.37:0/4123299165 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7fb3a4036800 0x7fb3a4038cb0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:27.595 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:26.651+0000 7fb3c16f5700 1 --2- 172.21.15.37:0/4123299165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb3bc101ce0 0x7fb3bc1079d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:27.595 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:26.651+0000 7fb3c16f5700 1 -- 172.21.15.37:0/4123299165 >> 172.21.15.37:0/4123299165 conn(0x7fb3bc0fc6f0 msgr2=0x7fb3bc0fd500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:09:27.595 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:26.651+0000 7fb3c16f5700 1 -- 172.21.15.37:0/4123299165 shutdown_connections 2024-04-25T17:09:27.595 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:26.651+0000 7fb3c16f5700 1 -- 172.21.15.37:0/4123299165 wait complete. 2024-04-25T17:09:27.595 INFO:teuthology.orchestra.run.smithi037.stdout:Deploying alertmanager service with default placement... 2024-04-25T17:09:28.230 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:28 smithi037 ceph-mon[26472]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:09:28.230 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:28 smithi037 ceph-mon[26472]: Saving service node-exporter spec with placement * 2024-04-25T17:09:28.892 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-04-25T17:09:28.892 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:28.001+0000 7f40f2ecc700 1 Processor -- start 2024-04-25T17:09:28.892 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:28.002+0000 7f40f2ecc700 1 -- start start 2024-04-25T17:09:28.892 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:28.002+0000 7f40f2ecc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40ec076bd0 0x7f40ec1078a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:28.892 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:28.002+0000 7f40f2ecc700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40ec103290 con 0x7f40ec076bd0 2024-04-25T17:09:28.892 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:28.002+0000 7f40f0c68700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40ec076bd0 0x7f40ec1078a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:28.892 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:28.002+0000 7f40f0c68700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40ec076bd0 0x7f40ec1078a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43410/0 (socket says 172.21.15.37:43410) 2024-04-25T17:09:28.892 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:28.002+0000 7f40f0c68700 1 -- 172.21.15.37:0/3656123933 learned_addr learned my addr 172.21.15.37:0/3656123933 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:09:28.892 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:28.002+0000 7f40f0c68700 1 -- 172.21.15.37:0/3656123933 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40ec107de0 con 0x7f40ec076bd0 2024-04-25T17:09:28.893 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:28.003+0000 7f40f0c68700 1 --2- 172.21.15.37:0/3656123933 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40ec076bd0 0x7f40ec1078a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f40e00098e0 tx=0x7f40e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64f497ad58530ece server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:28.893 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:28.003+0000 7f40eb7fe700 1 -- 172.21.15.37:0/3656123933 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f40e000b860 con 0x7f40ec076bd0 2024-04-25T17:09:28.893 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:28.003+0000 7f40eb7fe700 1 -- 172.21.15.37:0/3656123933 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f40e000be90 con 0x7f40ec076bd0 2024-04-25T17:09:28.893 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:28.003+0000 7f40eb7fe700 1 -- 172.21.15.37:0/3656123933 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f40e00103c0 con 0x7f40ec076bd0 2024-04-25T17:09:28.893 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:28.003+0000 7f40f2ecc700 1 -- 172.21.15.37:0/3656123933 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40ec076bd0 msgr2=0x7f40ec1078a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:28.893 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:28.003+0000 7f40f2ecc700 1 --2- 172.21.15.37:0/3656123933 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40ec076bd0 0x7f40ec1078a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f40e00098e0 tx=0x7f40e0009250 comp rx=0 tx=0).stop 2024-04-25T17:09:28.893 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:28.003+0000 7f40f2ecc700 1 -- 172.21.15.37:0/3656123933 shutdown_connections 2024-04-25T17:09:28.893 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:28.003+0000 7f40f2ecc700 1 --2- 172.21.15.37:0/3656123933 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40ec076bd0 0x7f40ec1078a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:28.893 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:28.003+0000 7f40f2ecc700 1 -- 172.21.15.37:0/3656123933 >> 172.21.15.37:0/3656123933 conn(0x7f40ec0fcef0 msgr2=0x7f40ec0ff300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:09:28.893 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:28.003+0000 7f40f2ecc700 1 -- 172.21.15.37:0/3656123933 shutdown_connections 2024-04-25T17:09:28.893 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:28.004+0000 7f40f2ecc700 1 -- 172.21.15.37:0/3656123933 wait complete. 2024-04-25T17:09:28.893 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:28.004+0000 7f40f2ecc700 1 Processor -- start 2024-04-25T17:09:28.893 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:28.004+0000 7f40f2ecc700 1 -- start start 2024-04-25T17:09:28.893 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:28.004+0000 7f40f2ecc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40ec076bd0 0x7f40ec113840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:28.893 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:28.004+0000 7f40f2ecc700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40ec113d80 con 0x7f40ec076bd0 2024-04-25T17:09:28.894 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:28.005+0000 7f40f0c68700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40ec076bd0 0x7f40ec113840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:28.894 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:28.005+0000 7f40f0c68700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40ec076bd0 0x7f40ec113840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43424/0 (socket says 172.21.15.37:43424) 2024-04-25T17:09:28.894 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:28.005+0000 7f40f0c68700 1 -- 172.21.15.37:0/145553294 learned_addr learned my addr 172.21.15.37:0/145553294 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:09:28.894 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:28.005+0000 7f40f0c68700 1 -- 172.21.15.37:0/145553294 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e00094f0 con 0x7f40ec076bd0 2024-04-25T17:09:28.894 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:28.005+0000 7f40f0c68700 1 --2- 172.21.15.37:0/145553294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40ec076bd0 0x7f40ec113840 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f40e00094c0 tx=0x7f40e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:28.894 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:28.005+0000 7f40e97fa700 1 -- 172.21.15.37:0/145553294 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f40e0010890 con 0x7f40ec076bd0 2024-04-25T17:09:28.894 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:28.005+0000 7f40e97fa700 1 -- 172.21.15.37:0/145553294 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f40e0010ec0 con 0x7f40ec076bd0 2024-04-25T17:09:28.894 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:28.005+0000 7f40f2ecc700 1 -- 172.21.15.37:0/145553294 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40ec113f80 con 0x7f40ec076bd0 2024-04-25T17:09:28.894 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:28.005+0000 7f40e97fa700 1 -- 172.21.15.37:0/145553294 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f40e00243f0 con 0x7f40ec076bd0 2024-04-25T17:09:28.894 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:28.005+0000 7f40f2ecc700 1 -- 172.21.15.37:0/145553294 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40ec114af0 con 0x7f40ec076bd0 2024-04-25T17:09:28.894 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:28.006+0000 7f40e97fa700 1 -- 172.21.15.37:0/145553294 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f40e002d3f0 con 0x7f40ec076bd0 2024-04-25T17:09:28.894 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:28.006+0000 7f40f2ecc700 1 -- 172.21.15.37:0/145553294 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40ec05f5c0 con 0x7f40ec076bd0 2024-04-25T17:09:28.894 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:28.006+0000 7f40e97fa700 1 --2- 172.21.15.37:0/145553294 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f40dc036850 0x7f40dc038d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:28.894 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:28.006+0000 7f40e97fa700 1 -- 172.21.15.37:0/145553294 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f40e004a400 con 0x7f40ec076bd0 2024-04-25T17:09:28.895 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:28.006+0000 7f40ebfff700 1 --2- 172.21.15.37:0/145553294 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f40dc036850 0x7f40dc038d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:28.895 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:28.007+0000 7f40ebfff700 1 --2- 172.21.15.37:0/145553294 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f40dc036850 0x7f40dc038d00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f40d8009990 tx=0x7f40d8006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:28.895 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:28.011+0000 7f40e97fa700 1 -- 172.21.15.37:0/145553294 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f40e002b2f0 con 0x7f40ec076bd0 2024-04-25T17:09:28.895 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:28.221+0000 7f40f2ecc700 1 -- 172.21.15.37:0/145553294 --> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7f40ec0fe090 con 0x7f40dc036850 2024-04-25T17:09:28.895 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:28.228+0000 7f40e97fa700 1 -- 172.21.15.37:0/145553294 <== mgr.14118 v2:172.21.15.37:6800/3653320894 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7f40ec0fe090 con 0x7f40dc036850 2024-04-25T17:09:28.895 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:28.230+0000 7f40f2ecc700 1 -- 172.21.15.37:0/145553294 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f40dc036850 msgr2=0x7f40dc038d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:28.895 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:28.230+0000 7f40f2ecc700 1 --2- 172.21.15.37:0/145553294 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f40dc036850 0x7f40dc038d00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f40d8009990 tx=0x7f40d8006e40 comp rx=0 tx=0).stop 2024-04-25T17:09:28.895 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:28.230+0000 7f40f2ecc700 1 -- 172.21.15.37:0/145553294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40ec076bd0 msgr2=0x7f40ec113840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:28.895 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:28.230+0000 7f40f2ecc700 1 --2- 172.21.15.37:0/145553294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40ec076bd0 0x7f40ec113840 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f40e00094c0 tx=0x7f40e0009250 comp rx=0 tx=0).stop 2024-04-25T17:09:28.895 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:28.231+0000 7f40f2ecc700 1 -- 172.21.15.37:0/145553294 shutdown_connections 2024-04-25T17:09:28.895 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:28.231+0000 7f40f2ecc700 1 --2- 172.21.15.37:0/145553294 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f40dc036850 0x7f40dc038d00 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:28.895 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:28.231+0000 7f40f2ecc700 1 --2- 172.21.15.37:0/145553294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40ec076bd0 0x7f40ec113840 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:28.895 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:28.231+0000 7f40f2ecc700 1 -- 172.21.15.37:0/145553294 >> 172.21.15.37:0/145553294 conn(0x7f40ec0fcef0 msgr2=0x7f40ec0fd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:09:28.895 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:28.231+0000 7f40f2ecc700 1 -- 172.21.15.37:0/145553294 shutdown_connections 2024-04-25T17:09:28.895 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:28.231+0000 7f40f2ecc700 1 -- 172.21.15.37:0/145553294 wait complete. 2024-04-25T17:09:29.303 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:29 smithi037 ceph-mon[26472]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:09:29.304 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:29 smithi037 ceph-mon[26472]: Saving service alertmanager spec with placement count:1 2024-04-25T17:09:29.304 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:29 smithi037 ceph-mon[26472]: from='mgr.14118 172.21.15.37:0/1694910703' entity='mgr.smithi037.txrgxl' 2024-04-25T17:09:30.070 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:29.326+0000 7f61ac277700 1 Processor -- start 2024-04-25T17:09:30.076 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:29.326+0000 7f61ac277700 1 -- start start 2024-04-25T17:09:30.076 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:29.326+0000 7f61ac277700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61a4102880 0x7f61a4102c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:30.076 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:29.326+0000 7f61ac277700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a41031d0 con 0x7f61a4102880 2024-04-25T17:09:30.076 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:29.326+0000 7f61aa013700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61a4102880 0x7f61a4102c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:30.076 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:29.326+0000 7f61aa013700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61a4102880 0x7f61a4102c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43440/0 (socket says 172.21.15.37:43440) 2024-04-25T17:09:30.076 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:29.326+0000 7f61aa013700 1 -- 172.21.15.37:0/1334701630 learned_addr learned my addr 172.21.15.37:0/1334701630 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:09:30.076 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:29.327+0000 7f61aa013700 1 -- 172.21.15.37:0/1334701630 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a4103310 con 0x7f61a4102880 2024-04-25T17:09:30.076 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:29.327+0000 7f61aa013700 1 --2- 172.21.15.37:0/1334701630 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61a4102880 0x7f61a4102c90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f61a00098e0 tx=0x7f61a0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47173645ed7cd1c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:30.077 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:29.327+0000 7f61a9011700 1 -- 172.21.15.37:0/1334701630 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f61a000b860 con 0x7f61a4102880 2024-04-25T17:09:30.077 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:29.327+0000 7f61a9011700 1 -- 172.21.15.37:0/1334701630 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f61a000be90 con 0x7f61a4102880 2024-04-25T17:09:30.077 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:29.327+0000 7f61a9011700 1 -- 172.21.15.37:0/1334701630 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f61a00103c0 con 0x7f61a4102880 2024-04-25T17:09:30.077 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:29.328+0000 7f61ac277700 1 -- 172.21.15.37:0/1334701630 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61a4102880 msgr2=0x7f61a4102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:30.077 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:29.328+0000 7f61ac277700 1 --2- 172.21.15.37:0/1334701630 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61a4102880 0x7f61a4102c90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f61a00098e0 tx=0x7f61a0009250 comp rx=0 tx=0).stop 2024-04-25T17:09:30.077 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:29.328+0000 7f61ac277700 1 -- 172.21.15.37:0/1334701630 shutdown_connections 2024-04-25T17:09:30.077 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:29.328+0000 7f61ac277700 1 --2- 172.21.15.37:0/1334701630 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61a4102880 0x7f61a4102c90 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:30.077 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:29.328+0000 7f61ac277700 1 -- 172.21.15.37:0/1334701630 >> 172.21.15.37:0/1334701630 conn(0x7f61a40fe060 msgr2=0x7f61a4100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:09:30.077 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:29.328+0000 7f61ac277700 1 -- 172.21.15.37:0/1334701630 shutdown_connections 2024-04-25T17:09:30.077 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:29.328+0000 7f61ac277700 1 -- 172.21.15.37:0/1334701630 wait complete. 2024-04-25T17:09:30.077 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:29.329+0000 7f61ac277700 1 Processor -- start 2024-04-25T17:09:30.077 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:29.329+0000 7f61ac277700 1 -- start start 2024-04-25T17:09:30.077 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:29.329+0000 7f61ac277700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61a4102880 0x7f61a41115c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:30.078 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:29.329+0000 7f61ac277700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a4111b00 con 0x7f61a4102880 2024-04-25T17:09:30.078 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:29.329+0000 7f61aa013700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61a4102880 0x7f61a41115c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:30.078 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:29.329+0000 7f61aa013700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61a4102880 0x7f61a41115c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43450/0 (socket says 172.21.15.37:43450) 2024-04-25T17:09:30.078 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:29.329+0000 7f61aa013700 1 -- 172.21.15.37:0/4269231467 learned_addr learned my addr 172.21.15.37:0/4269231467 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:09:30.078 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:29.329+0000 7f61aa013700 1 -- 172.21.15.37:0/4269231467 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a00094f0 con 0x7f61a4102880 2024-04-25T17:09:30.078 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:29.329+0000 7f61aa013700 1 --2- 172.21.15.37:0/4269231467 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61a4102880 0x7f61a41115c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f61a00090b0 tx=0x7f61a0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:30.078 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:29.330+0000 7f619affd700 1 -- 172.21.15.37:0/4269231467 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f61a0010840 con 0x7f61a4102880 2024-04-25T17:09:30.078 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:29.330+0000 7f619affd700 1 -- 172.21.15.37:0/4269231467 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f61a0010e70 con 0x7f61a4102880 2024-04-25T17:09:30.078 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:29.330+0000 7f61ac277700 1 -- 172.21.15.37:0/4269231467 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61a4111d00 con 0x7f61a4102880 2024-04-25T17:09:30.078 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:29.330+0000 7f619affd700 1 -- 172.21.15.37:0/4269231467 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f61a0024e40 con 0x7f61a4102880 2024-04-25T17:09:30.078 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:29.330+0000 7f61ac277700 1 -- 172.21.15.37:0/4269231467 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61a4112870 con 0x7f61a4102880 2024-04-25T17:09:30.078 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:29.331+0000 7f61ac277700 1 -- 172.21.15.37:0/4269231467 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61a405f5c0 con 0x7f61a4102880 2024-04-25T17:09:30.078 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:29.331+0000 7f619affd700 1 -- 172.21.15.37:0/4269231467 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7f61a0024430 con 0x7f61a4102880 2024-04-25T17:09:30.078 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:29.331+0000 7f619affd700 1 --2- 172.21.15.37:0/4269231467 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f6190036800 0x7f6190038cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:30.079 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:29.331+0000 7f619affd700 1 -- 172.21.15.37:0/4269231467 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f61a004a750 con 0x7f61a4102880 2024-04-25T17:09:30.079 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:29.331+0000 7f61a9812700 1 --2- 172.21.15.37:0/4269231467 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f6190036800 0x7f6190038cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:30.079 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:29.332+0000 7f61a9812700 1 --2- 172.21.15.37:0/4269231467 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f6190036800 0x7f6190038cb0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6194009990 tx=0x7f6194006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:30.079 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:29.336+0000 7f619affd700 1 -- 172.21.15.37:0/4269231467 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f61a002c930 con 0x7f61a4102880 2024-04-25T17:09:30.079 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:29.532+0000 7f61ac277700 1 -- 172.21.15.37:0/4269231467 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f61a404bed0 con 0x7f61a4102880 2024-04-25T17:09:30.079 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:29.537+0000 7f619affd700 1 -- 172.21.15.37:0/4269231467 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f61a002c340 con 0x7f61a4102880 2024-04-25T17:09:30.079 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:29.539+0000 7f61ac277700 1 -- 172.21.15.37:0/4269231467 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f6190036800 msgr2=0x7f6190038cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:30.079 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:29.539+0000 7f61ac277700 1 --2- 172.21.15.37:0/4269231467 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f6190036800 0x7f6190038cb0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6194009990 tx=0x7f6194006e40 comp rx=0 tx=0).stop 2024-04-25T17:09:30.079 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:29.539+0000 7f61ac277700 1 -- 172.21.15.37:0/4269231467 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61a4102880 msgr2=0x7f61a41115c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:30.079 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:29.539+0000 7f61ac277700 1 --2- 172.21.15.37:0/4269231467 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61a4102880 0x7f61a41115c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f61a00090b0 tx=0x7f61a0009250 comp rx=0 tx=0).stop 2024-04-25T17:09:30.079 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:29.539+0000 7f61ac277700 1 -- 172.21.15.37:0/4269231467 shutdown_connections 2024-04-25T17:09:30.079 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:29.539+0000 7f61ac277700 1 --2- 172.21.15.37:0/4269231467 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f6190036800 0x7f6190038cb0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:30.079 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:29.539+0000 7f61ac277700 1 --2- 172.21.15.37:0/4269231467 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61a4102880 0x7f61a41115c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:30.080 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:29.539+0000 7f61ac277700 1 -- 172.21.15.37:0/4269231467 >> 172.21.15.37:0/4269231467 conn(0x7f61a40fe060 msgr2=0x7f61a40feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:09:30.080 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:29.540+0000 7f61ac277700 1 -- 172.21.15.37:0/4269231467 shutdown_connections 2024-04-25T17:09:30.080 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:29.540+0000 7f61ac277700 1 -- 172.21.15.37:0/4269231467 wait complete. 2024-04-25T17:09:30.479 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:30 smithi037 ceph-mon[26472]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:09:30.479 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:30 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/4269231467' entity='client.admin' 2024-04-25T17:09:31.291 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:30.490+0000 7fa178fa4700 1 Processor -- start 2024-04-25T17:09:31.291 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:30.490+0000 7fa178fa4700 1 -- start start 2024-04-25T17:09:31.291 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:30.490+0000 7fa178fa4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa174071290 0x7fa174107890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:31.291 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:30.490+0000 7fa178fa4700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa174103280 con 0x7fa174071290 2024-04-25T17:09:31.291 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:30.491+0000 7fa17259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa174071290 0x7fa174107890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:31.291 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:30.491+0000 7fa17259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa174071290 0x7fa174107890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43462/0 (socket says 172.21.15.37:43462) 2024-04-25T17:09:31.291 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:30.491+0000 7fa17259c700 1 -- 172.21.15.37:0/3250441146 learned_addr learned my addr 172.21.15.37:0/3250441146 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:09:31.291 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:30.491+0000 7fa17259c700 1 -- 172.21.15.37:0/3250441146 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa174107dd0 con 0x7fa174071290 2024-04-25T17:09:31.291 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:30.491+0000 7fa17259c700 1 --2- 172.21.15.37:0/3250441146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa174071290 0x7fa174107890 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa164009e50 tx=0x7fa164009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=777c8fb3478c2732 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:31.291 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:30.491+0000 7fa17159a700 1 -- 172.21.15.37:0/3250441146 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa1640092e0 con 0x7fa174071290 2024-04-25T17:09:31.291 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:30.491+0000 7fa17159a700 1 -- 172.21.15.37:0/3250441146 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa164012430 con 0x7fa174071290 2024-04-25T17:09:31.292 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:30.491+0000 7fa17159a700 1 -- 172.21.15.37:0/3250441146 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa1640075a0 con 0x7fa174071290 2024-04-25T17:09:31.292 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:30.492+0000 7fa178fa4700 1 -- 172.21.15.37:0/3250441146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa174071290 msgr2=0x7fa174107890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:31.292 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:30.492+0000 7fa178fa4700 1 --2- 172.21.15.37:0/3250441146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa174071290 0x7fa174107890 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa164009e50 tx=0x7fa164009840 comp rx=0 tx=0).stop 2024-04-25T17:09:31.292 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:30.492+0000 7fa178fa4700 1 -- 172.21.15.37:0/3250441146 shutdown_connections 2024-04-25T17:09:31.292 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:30.492+0000 7fa178fa4700 1 --2- 172.21.15.37:0/3250441146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa174071290 0x7fa174107890 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:31.292 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:30.492+0000 7fa178fa4700 1 -- 172.21.15.37:0/3250441146 >> 172.21.15.37:0/3250441146 conn(0x7fa1740fcec0 msgr2=0x7fa1740ff2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:09:31.292 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:30.492+0000 7fa178fa4700 1 -- 172.21.15.37:0/3250441146 shutdown_connections 2024-04-25T17:09:31.292 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:30.492+0000 7fa178fa4700 1 -- 172.21.15.37:0/3250441146 wait complete. 2024-04-25T17:09:31.292 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:30.492+0000 7fa178fa4700 1 Processor -- start 2024-04-25T17:09:31.292 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:30.492+0000 7fa178fa4700 1 -- start start 2024-04-25T17:09:31.292 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:30.493+0000 7fa178fa4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa174071290 0x7fa174113840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:31.292 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:30.493+0000 7fa178fa4700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa174113d80 con 0x7fa174071290 2024-04-25T17:09:31.292 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:30.493+0000 7fa17259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa174071290 0x7fa174113840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:31.292 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:30.493+0000 7fa17259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa174071290 0x7fa174113840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43474/0 (socket says 172.21.15.37:43474) 2024-04-25T17:09:31.293 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:30.493+0000 7fa17259c700 1 -- 172.21.15.37:0/2432040420 learned_addr learned my addr 172.21.15.37:0/2432040420 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:09:31.293 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:30.493+0000 7fa17259c700 1 -- 172.21.15.37:0/2432040420 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa164009ae0 con 0x7fa174071290 2024-04-25T17:09:31.293 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:30.493+0000 7fa17259c700 1 --2- 172.21.15.37:0/2432040420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa174071290 0x7fa174113840 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa164009fd0 tx=0x7fa164009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:31.293 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:30.493+0000 7fa162ffd700 1 -- 172.21.15.37:0/2432040420 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa1640092e0 con 0x7fa174071290 2024-04-25T17:09:31.293 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:30.493+0000 7fa162ffd700 1 -- 172.21.15.37:0/2432040420 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa164007ce0 con 0x7fa174071290 2024-04-25T17:09:31.293 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:30.493+0000 7fa178fa4700 1 -- 172.21.15.37:0/2432040420 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa174113f80 con 0x7fa174071290 2024-04-25T17:09:31.293 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:30.493+0000 7fa162ffd700 1 -- 172.21.15.37:0/2432040420 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa1640259c0 con 0x7fa174071290 2024-04-25T17:09:31.293 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:30.493+0000 7fa178fa4700 1 -- 172.21.15.37:0/2432040420 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa174114af0 con 0x7fa174071290 2024-04-25T17:09:31.293 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:30.494+0000 7fa178fa4700 1 -- 172.21.15.37:0/2432040420 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa17405f5c0 con 0x7fa174071290 2024-04-25T17:09:31.293 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:30.494+0000 7fa162ffd700 1 -- 172.21.15.37:0/2432040420 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7fa164019050 con 0x7fa174071290 2024-04-25T17:09:31.293 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:30.495+0000 7fa162ffd700 1 --2- 172.21.15.37:0/2432040420 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7fa15c0368a0 0x7fa15c038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:31.293 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:30.495+0000 7fa162ffd700 1 -- 172.21.15.37:0/2432040420 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fa164049fa0 con 0x7fa174071290 2024-04-25T17:09:31.293 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:30.495+0000 7fa171d9b700 1 --2- 172.21.15.37:0/2432040420 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7fa15c0368a0 0x7fa15c038d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:31.293 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:30.495+0000 7fa171d9b700 1 --2- 172.21.15.37:0/2432040420 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7fa15c0368a0 0x7fa15c038d50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa168009990 tx=0x7fa168006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:31.293 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:30.499+0000 7fa162ffd700 1 -- 172.21.15.37:0/2432040420 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fa16400be50 con 0x7fa174071290 2024-04-25T17:09:31.294 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:30.694+0000 7fa178fa4700 1 -- 172.21.15.37:0/2432040420 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7fa17404bed0 con 0x7fa174071290 2024-04-25T17:09:31.294 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:30.699+0000 7fa162ffd700 1 -- 172.21.15.37:0/2432040420 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7fa164020030 con 0x7fa174071290 2024-04-25T17:09:31.294 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:30.701+0000 7fa178fa4700 1 -- 172.21.15.37:0/2432040420 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7fa15c0368a0 msgr2=0x7fa15c038d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:31.294 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:30.701+0000 7fa178fa4700 1 --2- 172.21.15.37:0/2432040420 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7fa15c0368a0 0x7fa15c038d50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa168009990 tx=0x7fa168006e40 comp rx=0 tx=0).stop 2024-04-25T17:09:31.294 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:30.701+0000 7fa178fa4700 1 -- 172.21.15.37:0/2432040420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa174071290 msgr2=0x7fa174113840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:31.294 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:30.701+0000 7fa178fa4700 1 --2- 172.21.15.37:0/2432040420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa174071290 0x7fa174113840 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa164009fd0 tx=0x7fa164009840 comp rx=0 tx=0).stop 2024-04-25T17:09:31.294 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:30.701+0000 7fa178fa4700 1 -- 172.21.15.37:0/2432040420 shutdown_connections 2024-04-25T17:09:31.294 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:30.701+0000 7fa178fa4700 1 --2- 172.21.15.37:0/2432040420 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7fa15c0368a0 0x7fa15c038d50 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:31.294 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:30.701+0000 7fa178fa4700 1 --2- 172.21.15.37:0/2432040420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa174071290 0x7fa174113840 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:31.294 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:30.701+0000 7fa178fa4700 1 -- 172.21.15.37:0/2432040420 >> 172.21.15.37:0/2432040420 conn(0x7fa1740fcec0 msgr2=0x7fa1740fda40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:09:31.294 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:30.701+0000 7fa178fa4700 1 -- 172.21.15.37:0/2432040420 shutdown_connections 2024-04-25T17:09:31.294 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:30.701+0000 7fa178fa4700 1 -- 172.21.15.37:0/2432040420 wait complete. 2024-04-25T17:09:31.294 INFO:teuthology.orchestra.run.smithi037.stdout:Enabling the dashboard module... 2024-04-25T17:09:32.030 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:31 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/2432040420' entity='client.admin' 2024-04-25T17:09:32.030 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:31 smithi037 ceph-mon[26472]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:09:33.047 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:32 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/1562224585' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-04-25T17:09:33.340 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:31.774+0000 7fec5ee1d700 1 Processor -- start 2024-04-25T17:09:33.341 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:31.774+0000 7fec5ee1d700 1 -- start start 2024-04-25T17:09:33.341 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:31.774+0000 7fec5ee1d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec58102880 0x7fec58102c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:33.341 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:31.774+0000 7fec5ee1d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec581031d0 con 0x7fec58102880 2024-04-25T17:09:33.341 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:31.774+0000 7fec5cbb9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec58102880 0x7fec58102c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:33.341 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:31.774+0000 7fec5cbb9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec58102880 0x7fec58102c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43490/0 (socket says 172.21.15.37:43490) 2024-04-25T17:09:33.341 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:31.774+0000 7fec5cbb9700 1 -- 172.21.15.37:0/68499715 learned_addr learned my addr 172.21.15.37:0/68499715 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:09:33.341 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:31.775+0000 7fec5cbb9700 1 -- 172.21.15.37:0/68499715 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec58103310 con 0x7fec58102880 2024-04-25T17:09:33.341 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:31.775+0000 7fec5cbb9700 1 --2- 172.21.15.37:0/68499715 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec58102880 0x7fec58102c90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fec4c0098e0 tx=0x7fec4c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b407f8e61ec2ee4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:33.341 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:31.775+0000 7fec577fe700 1 -- 172.21.15.37:0/68499715 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec4c00b860 con 0x7fec58102880 2024-04-25T17:09:33.341 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:31.775+0000 7fec577fe700 1 -- 172.21.15.37:0/68499715 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fec4c00be90 con 0x7fec58102880 2024-04-25T17:09:33.341 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:31.775+0000 7fec577fe700 1 -- 172.21.15.37:0/68499715 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec4c0103c0 con 0x7fec58102880 2024-04-25T17:09:33.341 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:31.775+0000 7fec5ee1d700 1 -- 172.21.15.37:0/68499715 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec58102880 msgr2=0x7fec58102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:33.342 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:31.775+0000 7fec5ee1d700 1 --2- 172.21.15.37:0/68499715 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec58102880 0x7fec58102c90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fec4c0098e0 tx=0x7fec4c009250 comp rx=0 tx=0).stop 2024-04-25T17:09:33.342 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:31.776+0000 7fec5ee1d700 1 -- 172.21.15.37:0/68499715 shutdown_connections 2024-04-25T17:09:33.342 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:31.776+0000 7fec5ee1d700 1 --2- 172.21.15.37:0/68499715 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec58102880 0x7fec58102c90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:33.342 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:31.776+0000 7fec5ee1d700 1 -- 172.21.15.37:0/68499715 >> 172.21.15.37:0/68499715 conn(0x7fec580fe060 msgr2=0x7fec58100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:09:33.342 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:31.776+0000 7fec5ee1d700 1 -- 172.21.15.37:0/68499715 shutdown_connections 2024-04-25T17:09:33.342 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:31.776+0000 7fec5ee1d700 1 -- 172.21.15.37:0/68499715 wait complete. 2024-04-25T17:09:33.342 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:31.776+0000 7fec5ee1d700 1 Processor -- start 2024-04-25T17:09:33.342 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:31.776+0000 7fec5ee1d700 1 -- start start 2024-04-25T17:09:33.342 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:31.777+0000 7fec5ee1d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec58102880 0x7fec58111620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:33.342 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:31.777+0000 7fec5ee1d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec58111b60 con 0x7fec58102880 2024-04-25T17:09:33.342 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:31.777+0000 7fec5cbb9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec58102880 0x7fec58111620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:33.343 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:31.777+0000 7fec5cbb9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec58102880 0x7fec58111620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43504/0 (socket says 172.21.15.37:43504) 2024-04-25T17:09:33.343 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:31.777+0000 7fec5cbb9700 1 -- 172.21.15.37:0/1562224585 learned_addr learned my addr 172.21.15.37:0/1562224585 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:09:33.343 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:31.777+0000 7fec5cbb9700 1 -- 172.21.15.37:0/1562224585 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec4c0094f0 con 0x7fec58102880 2024-04-25T17:09:33.343 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:31.777+0000 7fec5cbb9700 1 --2- 172.21.15.37:0/1562224585 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec58102880 0x7fec58111620 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fec4c011680 tx=0x7fec4c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:33.343 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:31.777+0000 7fec557fa700 1 -- 172.21.15.37:0/1562224585 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec4c010890 con 0x7fec58102880 2024-04-25T17:09:33.343 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:31.777+0000 7fec557fa700 1 -- 172.21.15.37:0/1562224585 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fec4c010ec0 con 0x7fec58102880 2024-04-25T17:09:33.343 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:31.777+0000 7fec5ee1d700 1 -- 172.21.15.37:0/1562224585 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec58111d60 con 0x7fec58102880 2024-04-25T17:09:33.343 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:31.777+0000 7fec557fa700 1 -- 172.21.15.37:0/1562224585 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec4c0243f0 con 0x7fec58102880 2024-04-25T17:09:33.343 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:31.778+0000 7fec5ee1d700 1 -- 172.21.15.37:0/1562224585 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec581128d0 con 0x7fec58102880 2024-04-25T17:09:33.343 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:31.778+0000 7fec557fa700 1 -- 172.21.15.37:0/1562224585 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 8) v1 ==== 43376+0+0 (secure 0 0 0) 0x7fec4c02d3f0 con 0x7fec58102880 2024-04-25T17:09:33.343 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:31.778+0000 7fec557fa700 1 --2- 172.21.15.37:0/1562224585 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7fec480368a0 0x7fec48038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:33.343 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:31.778+0000 7fec5ee1d700 1 -- 172.21.15.37:0/1562224585 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec5805f5c0 con 0x7fec58102880 2024-04-25T17:09:33.344 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:31.779+0000 7fec557fa700 1 -- 172.21.15.37:0/1562224585 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fec4c04a1e0 con 0x7fec58102880 2024-04-25T17:09:33.344 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:31.779+0000 7fec57fff700 1 --2- 172.21.15.37:0/1562224585 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7fec480368a0 0x7fec48038d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:33.344 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:31.779+0000 7fec57fff700 1 --2- 172.21.15.37:0/1562224585 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7fec480368a0 0x7fec48038d50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fec44009990 tx=0x7fec44006e40 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:33.344 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:31.783+0000 7fec557fa700 1 -- 172.21.15.37:0/1562224585 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fec4c02b8e0 con 0x7fec58102880 2024-04-25T17:09:33.344 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:32.030+0000 7fec5ee1d700 1 -- 172.21.15.37:0/1562224585 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7fec5804bed0 con 0x7fec58102880 2024-04-25T17:09:33.344 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:32.711+0000 7fec557fa700 1 -- 172.21.15.37:0/1562224585 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 9) v1 ==== 43389+0+0 (secure 0 0 0) 0x7fec4c01a5f0 con 0x7fec58102880 2024-04-25T17:09:33.344 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:32.712+0000 7fec557fa700 1 -- 172.21.15.37:0/1562224585 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7fec4c02ca10 con 0x7fec58102880 2024-04-25T17:09:33.344 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:32.716+0000 7fec5ee1d700 1 -- 172.21.15.37:0/1562224585 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7fec480368a0 msgr2=0x7fec48038d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:33.344 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:32.716+0000 7fec5ee1d700 1 --2- 172.21.15.37:0/1562224585 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7fec480368a0 0x7fec48038d50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fec44009990 tx=0x7fec44006e40 comp rx=0 tx=0).stop 2024-04-25T17:09:33.344 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:32.716+0000 7fec5ee1d700 1 -- 172.21.15.37:0/1562224585 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec58102880 msgr2=0x7fec58111620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:33.344 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:32.716+0000 7fec5ee1d700 1 --2- 172.21.15.37:0/1562224585 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec58102880 0x7fec58111620 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fec4c011680 tx=0x7fec4c009250 comp rx=0 tx=0).stop 2024-04-25T17:09:33.344 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:32.716+0000 7fec5ee1d700 1 -- 172.21.15.37:0/1562224585 shutdown_connections 2024-04-25T17:09:33.345 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:32.716+0000 7fec5ee1d700 1 --2- 172.21.15.37:0/1562224585 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7fec480368a0 0x7fec48038d50 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:33.345 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:32.716+0000 7fec5ee1d700 1 --2- 172.21.15.37:0/1562224585 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fec58102880 0x7fec58111620 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:33.345 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:32.716+0000 7fec5ee1d700 1 -- 172.21.15.37:0/1562224585 >> 172.21.15.37:0/1562224585 conn(0x7fec580fe060 msgr2=0x7fec580feb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:09:33.345 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:32.716+0000 7fec5ee1d700 1 -- 172.21.15.37:0/1562224585 shutdown_connections 2024-04-25T17:09:33.345 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:32.716+0000 7fec5ee1d700 1 -- 172.21.15.37:0/1562224585 wait complete. 2024-04-25T17:09:34.007 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:33 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/1562224585' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-04-25T17:09:34.008 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:33 smithi037 ceph-mon[26472]: mgrmap e9: smithi037.txrgxl(active, since 23s) 2024-04-25T17:09:34.679 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout { 2024-04-25T17:09:34.679 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-04-25T17:09:34.680 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "available": true, 2024-04-25T17:09:34.680 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "active_name": "smithi037.txrgxl", 2024-04-25T17:09:34.680 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-04-25T17:09:34.680 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout } 2024-04-25T17:09:34.680 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:33.802+0000 7f6580ac5700 1 Processor -- start 2024-04-25T17:09:34.680 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:33.802+0000 7f6580ac5700 1 -- start start 2024-04-25T17:09:34.680 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:33.802+0000 7f6580ac5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f657c101730 0x7f657c101b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:34.680 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:33.802+0000 7f6580ac5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f657c102080 con 0x7f657c101730 2024-04-25T17:09:34.680 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:33.803+0000 7f657a59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f657c101730 0x7f657c101b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:34.680 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:33.803+0000 7f657a59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f657c101730 0x7f657c101b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43540/0 (socket says 172.21.15.37:43540) 2024-04-25T17:09:34.680 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:33.803+0000 7f657a59c700 1 -- 172.21.15.37:0/2109437423 learned_addr learned my addr 172.21.15.37:0/2109437423 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:09:34.680 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:33.803+0000 7f657a59c700 1 -- 172.21.15.37:0/2109437423 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f657c1021c0 con 0x7f657c101730 2024-04-25T17:09:34.680 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:33.803+0000 7f657a59c700 1 --2- 172.21.15.37:0/2109437423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f657c101730 0x7f657c101b40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f65640098e0 tx=0x7f6564009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12822de4f71dc7d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:34.680 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:33.803+0000 7f657959a700 1 -- 172.21.15.37:0/2109437423 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f656400b860 con 0x7f657c101730 2024-04-25T17:09:34.681 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:33.803+0000 7f657959a700 1 -- 172.21.15.37:0/2109437423 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f656400be90 con 0x7f657c101730 2024-04-25T17:09:34.681 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:33.803+0000 7f657959a700 1 -- 172.21.15.37:0/2109437423 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f65640103c0 con 0x7f657c101730 2024-04-25T17:09:34.681 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:33.804+0000 7f6580ac5700 1 -- 172.21.15.37:0/2109437423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f657c101730 msgr2=0x7f657c101b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:34.681 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:33.804+0000 7f6580ac5700 1 --2- 172.21.15.37:0/2109437423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f657c101730 0x7f657c101b40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f65640098e0 tx=0x7f6564009250 comp rx=0 tx=0).stop 2024-04-25T17:09:34.681 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:33.804+0000 7f6580ac5700 1 -- 172.21.15.37:0/2109437423 shutdown_connections 2024-04-25T17:09:34.681 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:33.804+0000 7f6580ac5700 1 --2- 172.21.15.37:0/2109437423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f657c101730 0x7f657c101b40 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:34.681 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:33.804+0000 7f6580ac5700 1 -- 172.21.15.37:0/2109437423 >> 172.21.15.37:0/2109437423 conn(0x7f657c0fcef0 msgr2=0x7f657c0ff300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:09:34.681 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:33.804+0000 7f6580ac5700 1 -- 172.21.15.37:0/2109437423 shutdown_connections 2024-04-25T17:09:34.681 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:33.804+0000 7f6580ac5700 1 -- 172.21.15.37:0/2109437423 wait complete. 2024-04-25T17:09:34.681 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:33.805+0000 7f6580ac5700 1 Processor -- start 2024-04-25T17:09:34.681 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:33.805+0000 7f6580ac5700 1 -- start start 2024-04-25T17:09:34.681 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:33.805+0000 7f6580ac5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f657c101730 0x7f657c076b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:34.681 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:33.805+0000 7f6580ac5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f657c114350 con 0x7f657c101730 2024-04-25T17:09:34.681 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:33.805+0000 7f657a59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f657c101730 0x7f657c076b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:34.681 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:33.805+0000 7f657a59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f657c101730 0x7f657c076b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43550/0 (socket says 172.21.15.37:43550) 2024-04-25T17:09:34.682 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:33.805+0000 7f657a59c700 1 -- 172.21.15.37:0/719160076 learned_addr learned my addr 172.21.15.37:0/719160076 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:09:34.682 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:33.805+0000 7f657a59c700 1 -- 172.21.15.37:0/719160076 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65640094f0 con 0x7f657c101730 2024-04-25T17:09:34.682 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:33.805+0000 7f657a59c700 1 --2- 172.21.15.37:0/719160076 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f657c101730 0x7f657c076b00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6564011680 tx=0x7f6564009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:34.682 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:33.806+0000 7f6572ffd700 1 -- 172.21.15.37:0/719160076 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6564010890 con 0x7f657c101730 2024-04-25T17:09:34.682 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:33.806+0000 7f6572ffd700 1 -- 172.21.15.37:0/719160076 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6564010ec0 con 0x7f657c101730 2024-04-25T17:09:34.682 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:33.806+0000 7f6572ffd700 1 -- 172.21.15.37:0/719160076 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f65640243f0 con 0x7f657c101730 2024-04-25T17:09:34.682 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:33.806+0000 7f6580ac5700 1 -- 172.21.15.37:0/719160076 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f657c114490 con 0x7f657c101730 2024-04-25T17:09:34.682 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:33.806+0000 7f6580ac5700 1 -- 172.21.15.37:0/719160076 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f657c114920 con 0x7f657c101730 2024-04-25T17:09:34.682 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:33.806+0000 7f6572ffd700 1 -- 172.21.15.37:0/719160076 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 9) v1 ==== 43389+0+0 (secure 0 0 0) 0x7f656402d3f0 con 0x7f657c101730 2024-04-25T17:09:34.682 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:33.807+0000 7f6572ffd700 1 --2- 172.21.15.37:0/719160076 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f65680368f0 0x7f6568038da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:34.682 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:33.807+0000 7f6580ac5700 1 -- 172.21.15.37:0/719160076 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f657c04bed0 con 0x7f657c101730 2024-04-25T17:09:34.682 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:33.807+0000 7f6579d9b700 1 -- 172.21.15.37:0/719160076 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f65680368f0 msgr2=0x7f6568038da0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.37:6800/3653320894 2024-04-25T17:09:34.682 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:33.807+0000 7f6572ffd700 1 -- 172.21.15.37:0/719160076 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f656404a270 con 0x7f657c101730 2024-04-25T17:09:34.683 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:33.807+0000 7f6579d9b700 1 --2- 172.21.15.37:0/719160076 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f65680368f0 0x7f6568038da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T17:09:34.683 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:33.812+0000 7f6572ffd700 1 -- 172.21.15.37:0/719160076 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f656402b4d0 con 0x7f657c101730 2024-04-25T17:09:34.683 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:34.008+0000 7f6579d9b700 1 -- 172.21.15.37:0/719160076 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f65680368f0 msgr2=0x7f6568038da0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.37:6800/3653320894 2024-04-25T17:09:34.683 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:34.008+0000 7f6579d9b700 1 --2- 172.21.15.37:0/719160076 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f65680368f0 0x7f6568038da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T17:09:34.683 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:34.106+0000 7f6580ac5700 1 -- 172.21.15.37:0/719160076 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f657c114e80 con 0x7f657c101730 2024-04-25T17:09:34.683 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:34.106+0000 7f6572ffd700 1 -- 172.21.15.37:0/719160076 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7f656402b2f0 con 0x7f657c101730 2024-04-25T17:09:34.683 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:34.108+0000 7f6580ac5700 1 -- 172.21.15.37:0/719160076 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f65680368f0 msgr2=0x7f6568038da0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T17:09:34.683 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:34.108+0000 7f6580ac5700 1 --2- 172.21.15.37:0/719160076 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f65680368f0 0x7f6568038da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:34.683 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:34.108+0000 7f6580ac5700 1 -- 172.21.15.37:0/719160076 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f657c101730 msgr2=0x7f657c076b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:34.683 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:34.108+0000 7f6580ac5700 1 --2- 172.21.15.37:0/719160076 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f657c101730 0x7f657c076b00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6564011680 tx=0x7f6564009250 comp rx=0 tx=0).stop 2024-04-25T17:09:34.683 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:34.109+0000 7f6580ac5700 1 -- 172.21.15.37:0/719160076 shutdown_connections 2024-04-25T17:09:34.683 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:34.109+0000 7f6580ac5700 1 --2- 172.21.15.37:0/719160076 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7f65680368f0 0x7f6568038da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:34.683 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:34.109+0000 7f6580ac5700 1 --2- 172.21.15.37:0/719160076 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f657c101730 0x7f657c076b00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:34.683 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:34.109+0000 7f6580ac5700 1 -- 172.21.15.37:0/719160076 >> 172.21.15.37:0/719160076 conn(0x7f657c0fcef0 msgr2=0x7f657c0fd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:09:34.683 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:34.109+0000 7f6580ac5700 1 -- 172.21.15.37:0/719160076 shutdown_connections 2024-04-25T17:09:34.683 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:34.109+0000 7f6580ac5700 1 -- 172.21.15.37:0/719160076 wait complete. 2024-04-25T17:09:34.684 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for the mgr to restart... 2024-04-25T17:09:34.684 INFO:teuthology.orchestra.run.smithi037.stdout:Waiting for mgr epoch 9... 2024-04-25T17:09:34.974 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:34 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/719160076' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-04-25T17:09:39.531 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:39 smithi037 ceph-mon[26472]: Active manager daemon smithi037.txrgxl restarted 2024-04-25T17:09:39.531 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:39 smithi037 ceph-mon[26472]: Activating manager daemon smithi037.txrgxl 2024-04-25T17:09:39.531 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:39 smithi037 ceph-mon[26472]: osdmap e3: 0 total, 0 up, 0 in 2024-04-25T17:09:39.531 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:39 smithi037 ceph-mon[26472]: mgrmap e10: smithi037.txrgxl(active, starting, since 0.00318785s) 2024-04-25T17:09:39.531 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:39 smithi037 ceph-mon[26472]: from='mgr.14160 172.21.15.37:0/1872577945' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mon metadata", "id": "smithi037"}]: dispatch 2024-04-25T17:09:39.820 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:39 smithi037 ceph-mon[26472]: from='mgr.14160 172.21.15.37:0/1872577945' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mgr metadata", "who": "smithi037.txrgxl", "id": "smithi037.txrgxl"}]: dispatch 2024-04-25T17:09:39.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:39 smithi037 ceph-mon[26472]: from='mgr.14160 172.21.15.37:0/1872577945' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-25T17:09:39.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:39 smithi037 ceph-mon[26472]: from='mgr.14160 172.21.15.37:0/1872577945' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-25T17:09:39.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:39 smithi037 ceph-mon[26472]: from='mgr.14160 172.21.15.37:0/1872577945' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-25T17:09:39.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:39 smithi037 ceph-mon[26472]: Manager daemon smithi037.txrgxl is now available 2024-04-25T17:09:39.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:39 smithi037 ceph-mon[26472]: from='mgr.14160 172.21.15.37:0/1872577945' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:09:39.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:39 smithi037 ceph-mon[26472]: from='mgr.14160 172.21.15.37:0/1872577945' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:09:39.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:39 smithi037 ceph-mon[26472]: from='mgr.14160 172.21.15.37:0/1872577945' entity='mgr.smithi037.txrgxl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi037.txrgxl/mirror_snapshot_schedule"}]: dispatch 2024-04-25T17:09:39.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:39 smithi037 ceph-mon[26472]: from='mgr.14160 172.21.15.37:0/1872577945' entity='mgr.smithi037.txrgxl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi037.txrgxl/trash_purge_schedule"}]: dispatch 2024-04-25T17:09:41.224 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout { 2024-04-25T17:09:41.224 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-04-25T17:09:41.224 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout "initialized": true 2024-04-25T17:09:41.224 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout } 2024-04-25T17:09:41.224 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:35.075+0000 7fe591aec700 1 Processor -- start 2024-04-25T17:09:41.224 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:35.075+0000 7fe591aec700 1 -- start start 2024-04-25T17:09:41.224 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:35.075+0000 7fe591aec700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe58c071310 0x7fe58c105430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:41.224 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:35.075+0000 7fe591aec700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe58c105970 con 0x7fe58c071310 2024-04-25T17:09:41.224 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:35.075+0000 7fe58b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe58c071310 0x7fe58c105430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:41.224 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:35.076+0000 7fe58b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe58c071310 0x7fe58c105430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43564/0 (socket says 172.21.15.37:43564) 2024-04-25T17:09:41.225 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:35.076+0000 7fe58b7fe700 1 -- 172.21.15.37:0/4243806498 learned_addr learned my addr 172.21.15.37:0/4243806498 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:09:41.225 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:35.076+0000 7fe58b7fe700 1 -- 172.21.15.37:0/4243806498 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe58c105ab0 con 0x7fe58c071310 2024-04-25T17:09:41.225 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:35.076+0000 7fe58b7fe700 1 --2- 172.21.15.37:0/4243806498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe58c071310 0x7fe58c105430 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe57c0098e0 tx=0x7fe57c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c32b2dcf82f190c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:41.225 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:35.076+0000 7fe58a7fc700 1 -- 172.21.15.37:0/4243806498 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe57c00b860 con 0x7fe58c071310 2024-04-25T17:09:41.225 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:35.076+0000 7fe58a7fc700 1 -- 172.21.15.37:0/4243806498 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe57c00be90 con 0x7fe58c071310 2024-04-25T17:09:41.225 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:35.076+0000 7fe58a7fc700 1 -- 172.21.15.37:0/4243806498 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe57c0103c0 con 0x7fe58c071310 2024-04-25T17:09:41.225 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:35.077+0000 7fe591aec700 1 -- 172.21.15.37:0/4243806498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe58c071310 msgr2=0x7fe58c105430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:41.225 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:35.077+0000 7fe591aec700 1 --2- 172.21.15.37:0/4243806498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe58c071310 0x7fe58c105430 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe57c0098e0 tx=0x7fe57c009250 comp rx=0 tx=0).stop 2024-04-25T17:09:41.225 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:35.077+0000 7fe591aec700 1 -- 172.21.15.37:0/4243806498 shutdown_connections 2024-04-25T17:09:41.225 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:35.077+0000 7fe591aec700 1 --2- 172.21.15.37:0/4243806498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe58c071310 0x7fe58c105430 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:41.225 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:35.077+0000 7fe591aec700 1 -- 172.21.15.37:0/4243806498 >> 172.21.15.37:0/4243806498 conn(0x7fe58c0fcea0 msgr2=0x7fe58c0ff2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:09:41.225 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:35.077+0000 7fe591aec700 1 -- 172.21.15.37:0/4243806498 shutdown_connections 2024-04-25T17:09:41.225 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:35.077+0000 7fe591aec700 1 -- 172.21.15.37:0/4243806498 wait complete. 2024-04-25T17:09:41.225 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:35.078+0000 7fe591aec700 1 Processor -- start 2024-04-25T17:09:41.225 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:35.078+0000 7fe591aec700 1 -- start start 2024-04-25T17:09:41.225 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:35.078+0000 7fe591aec700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe58c071310 0x7fe58c102d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:41.226 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:35.078+0000 7fe591aec700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe58c1032c0 con 0x7fe58c071310 2024-04-25T17:09:41.226 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:35.078+0000 7fe58b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe58c071310 0x7fe58c102d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:41.226 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:35.078+0000 7fe58b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe58c071310 0x7fe58c102d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43568/0 (socket says 172.21.15.37:43568) 2024-04-25T17:09:41.226 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:35.078+0000 7fe58b7fe700 1 -- 172.21.15.37:0/2073241655 learned_addr learned my addr 172.21.15.37:0/2073241655 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:09:41.226 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:35.078+0000 7fe58b7fe700 1 -- 172.21.15.37:0/2073241655 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe57c0094f0 con 0x7fe58c071310 2024-04-25T17:09:41.226 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:35.079+0000 7fe58b7fe700 1 --2- 172.21.15.37:0/2073241655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe58c071310 0x7fe58c102d80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe57c0094c0 tx=0x7fe57c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:41.226 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:35.079+0000 7fe573fff700 1 -- 172.21.15.37:0/2073241655 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe57c010890 con 0x7fe58c071310 2024-04-25T17:09:41.226 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:35.079+0000 7fe573fff700 1 -- 172.21.15.37:0/2073241655 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe57c010ec0 con 0x7fe58c071310 2024-04-25T17:09:41.226 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:35.079+0000 7fe591aec700 1 -- 172.21.15.37:0/2073241655 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe58c101330 con 0x7fe58c071310 2024-04-25T17:09:41.226 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:35.079+0000 7fe573fff700 1 -- 172.21.15.37:0/2073241655 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe57c0243f0 con 0x7fe58c071310 2024-04-25T17:09:41.226 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:35.079+0000 7fe591aec700 1 -- 172.21.15.37:0/2073241655 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe58c101820 con 0x7fe58c071310 2024-04-25T17:09:41.226 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:35.080+0000 7fe573fff700 1 -- 172.21.15.37:0/2073241655 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 9) v1 ==== 43389+0+0 (secure 0 0 0) 0x7fe57c02d3f0 con 0x7fe58c071310 2024-04-25T17:09:41.226 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:35.080+0000 7fe573fff700 1 --2- 172.21.15.37:0/2073241655 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7fe5740368a0 0x7fe574038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:41.226 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:35.080+0000 7fe591aec700 1 -- 172.21.15.37:0/2073241655 --> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe58c04bed0 con 0x7fe5740368a0 2024-04-25T17:09:41.226 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:35.080+0000 7fe573fff700 1 -- 172.21.15.37:0/2073241655 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fe57c04a3f0 con 0x7fe58c071310 2024-04-25T17:09:41.227 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:35.080+0000 7fe58affd700 1 -- 172.21.15.37:0/2073241655 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7fe5740368a0 msgr2=0x7fe574038d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.37:6800/3653320894 2024-04-25T17:09:41.227 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:35.080+0000 7fe58affd700 1 --2- 172.21.15.37:0/2073241655 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7fe5740368a0 0x7fe574038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T17:09:41.227 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:35.281+0000 7fe58affd700 1 -- 172.21.15.37:0/2073241655 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7fe5740368a0 msgr2=0x7fe574038d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.37:6800/3653320894 2024-04-25T17:09:41.227 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:35.281+0000 7fe58affd700 1 --2- 172.21.15.37:0/2073241655 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7fe5740368a0 0x7fe574038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T17:09:41.227 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:35.682+0000 7fe58affd700 1 -- 172.21.15.37:0/2073241655 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7fe5740368a0 msgr2=0x7fe574038d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.37:6800/3653320894 2024-04-25T17:09:41.227 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:35.682+0000 7fe58affd700 1 --2- 172.21.15.37:0/2073241655 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7fe5740368a0 0x7fe574038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T17:09:41.227 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:36.483+0000 7fe58affd700 1 -- 172.21.15.37:0/2073241655 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7fe5740368a0 msgr2=0x7fe574038d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.37:6800/3653320894 2024-04-25T17:09:41.227 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:36.483+0000 7fe58affd700 1 --2- 172.21.15.37:0/2073241655 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7fe5740368a0 0x7fe574038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T17:09:41.227 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:38.084+0000 7fe58affd700 1 -- 172.21.15.37:0/2073241655 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7fe5740368a0 msgr2=0x7fe574038d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.37:6800/3653320894 2024-04-25T17:09:41.227 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:38.084+0000 7fe58affd700 1 --2- 172.21.15.37:0/2073241655 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7fe5740368a0 0x7fe574038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-25T17:09:41.227 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:39.482+0000 7fe573fff700 1 -- 172.21.15.37:0/2073241655 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mgrmap(e 10) v1 ==== 43156+0+0 (secure 0 0 0) 0x7fe57c0193c0 con 0x7fe58c071310 2024-04-25T17:09:41.227 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:39.482+0000 7fe573fff700 1 -- 172.21.15.37:0/2073241655 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7fe5740368a0 msgr2=0x7fe574038d50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T17:09:41.227 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:39.482+0000 7fe573fff700 1 --2- 172.21.15.37:0/2073241655 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7fe5740368a0 0x7fe574038d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:41.227 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:40.483+0000 7fe573fff700 1 -- 172.21.15.37:0/2073241655 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 11) v1 ==== 43283+0+0 (secure 0 0 0) 0x7fe57c01a7e0 con 0x7fe58c071310 2024-04-25T17:09:41.227 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:40.483+0000 7fe573fff700 1 --2- 172.21.15.37:0/2073241655 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7fe574039fc0 0x7fe57403c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:41.227 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:40.484+0000 7fe573fff700 1 -- 172.21.15.37:0/2073241655 --> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe58c04bed0 con 0x7fe574039fc0 2024-04-25T17:09:41.228 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:40.484+0000 7fe58affd700 1 --2- 172.21.15.37:0/2073241655 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7fe574039fc0 0x7fe57403c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:41.228 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:40.484+0000 7fe58affd700 1 --2- 172.21.15.37:0/2073241655 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7fe574039fc0 0x7fe57403c3a0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fe5800039d0 tx=0x7fe5800092f0 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:41.228 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:40.485+0000 7fe573fff700 1 -- 172.21.15.37:0/2073241655 <== mgr.14160 v2:172.21.15.37:6800/1299348474 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7fe58c04bed0 con 0x7fe574039fc0 2024-04-25T17:09:41.228 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:40.491+0000 7fe591aec700 1 -- 172.21.15.37:0/2073241655 --> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fe58c106830 con 0x7fe574039fc0 2024-04-25T17:09:41.228 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:40.492+0000 7fe573fff700 1 -- 172.21.15.37:0/2073241655 <== mgr.14160 v2:172.21.15.37:6800/1299348474 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7fe58c106830 con 0x7fe574039fc0 2024-04-25T17:09:41.228 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:40.492+0000 7fe591aec700 1 -- 172.21.15.37:0/2073241655 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7fe574039fc0 msgr2=0x7fe57403c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:41.228 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:40.492+0000 7fe591aec700 1 --2- 172.21.15.37:0/2073241655 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7fe574039fc0 0x7fe57403c3a0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fe5800039d0 tx=0x7fe5800092f0 comp rx=0 tx=0).stop 2024-04-25T17:09:41.228 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:40.492+0000 7fe591aec700 1 -- 172.21.15.37:0/2073241655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe58c071310 msgr2=0x7fe58c102d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:41.228 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:40.492+0000 7fe591aec700 1 --2- 172.21.15.37:0/2073241655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe58c071310 0x7fe58c102d80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe57c0094c0 tx=0x7fe57c009250 comp rx=0 tx=0).stop 2024-04-25T17:09:41.228 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:40.492+0000 7fe591aec700 1 -- 172.21.15.37:0/2073241655 shutdown_connections 2024-04-25T17:09:41.228 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:40.492+0000 7fe591aec700 1 --2- 172.21.15.37:0/2073241655 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7fe574039fc0 0x7fe57403c3a0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:41.228 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:40.492+0000 7fe591aec700 1 --2- 172.21.15.37:0/2073241655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe58c071310 0x7fe58c102d80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:41.228 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:40.492+0000 7fe591aec700 1 --2- 172.21.15.37:0/2073241655 >> [v2:172.21.15.37:6800/3653320894,v1:172.21.15.37:6801/3653320894] conn(0x7fe5740368a0 0x7fe574038d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:41.228 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:40.492+0000 7fe591aec700 1 -- 172.21.15.37:0/2073241655 >> 172.21.15.37:0/2073241655 conn(0x7fe58c0fcea0 msgr2=0x7fe58c0fda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:09:41.228 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:40.492+0000 7fe591aec700 1 -- 172.21.15.37:0/2073241655 shutdown_connections 2024-04-25T17:09:41.229 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:40.492+0000 7fe591aec700 1 -- 172.21.15.37:0/2073241655 wait complete. 2024-04-25T17:09:41.229 INFO:teuthology.orchestra.run.smithi037.stdout:mgr epoch 9 is available 2024-04-25T17:09:41.229 INFO:teuthology.orchestra.run.smithi037.stdout:Generating a dashboard self-signed certificate... 2024-04-25T17:09:41.733 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:41 smithi037 ceph-mon[26472]: [25/Apr/2024:17:09:40] ENGINE Bus STARTING 2024-04-25T17:09:41.733 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:41 smithi037 ceph-mon[26472]: [25/Apr/2024:17:09:40] ENGINE Serving on https://172.21.15.37:7150 2024-04-25T17:09:41.734 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:41 smithi037 ceph-mon[26472]: [25/Apr/2024:17:09:40] ENGINE Bus STARTED 2024-04-25T17:09:41.734 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:41 smithi037 ceph-mon[26472]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-04-25T17:09:41.734 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:41 smithi037 ceph-mon[26472]: mgrmap e11: smithi037.txrgxl(active, since 1.00564s) 2024-04-25T17:09:41.734 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:41 smithi037 ceph-mon[26472]: from='mgr.14160 172.21.15.37:0/1872577945' entity='mgr.smithi037.txrgxl' 2024-04-25T17:09:41.734 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:41 smithi037 ceph-mon[26472]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-04-25T17:09:41.734 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:41 smithi037 ceph-mon[26472]: from='mgr.14160 172.21.15.37:0/1872577945' entity='mgr.smithi037.txrgxl' 2024-04-25T17:09:42.545 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-04-25T17:09:42.546 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:41.669+0000 7f9576cf9700 1 Processor -- start 2024-04-25T17:09:42.546 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:41.669+0000 7f9576cf9700 1 -- start start 2024-04-25T17:09:42.546 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:41.669+0000 7f9576cf9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9570101730 0x7f9570101b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:42.546 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:41.669+0000 7f9576cf9700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9570102080 con 0x7f9570101730 2024-04-25T17:09:42.546 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:41.669+0000 7f9574a95700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9570101730 0x7f9570101b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:42.546 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:41.669+0000 7f9574a95700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9570101730 0x7f9570101b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37848/0 (socket says 172.21.15.37:37848) 2024-04-25T17:09:42.546 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:41.669+0000 7f9574a95700 1 -- 172.21.15.37:0/2416984866 learned_addr learned my addr 172.21.15.37:0/2416984866 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:09:42.546 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:41.670+0000 7f9574a95700 1 -- 172.21.15.37:0/2416984866 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95701021c0 con 0x7f9570101730 2024-04-25T17:09:42.546 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:41.670+0000 7f9574a95700 1 --2- 172.21.15.37:0/2416984866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9570101730 0x7f9570101b40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f956400bb80 tx=0x7f956400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4488173373375c48 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:42.546 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:41.670+0000 7f956f7fe700 1 -- 172.21.15.37:0/2416984866 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f956400dd00 con 0x7f9570101730 2024-04-25T17:09:42.546 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:41.670+0000 7f956f7fe700 1 -- 172.21.15.37:0/2416984866 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f956400de60 con 0x7f9570101730 2024-04-25T17:09:42.546 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:41.670+0000 7f956f7fe700 1 -- 172.21.15.37:0/2416984866 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9564018920 con 0x7f9570101730 2024-04-25T17:09:42.546 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:41.670+0000 7f9576cf9700 1 -- 172.21.15.37:0/2416984866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9570101730 msgr2=0x7f9570101b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:42.547 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:41.670+0000 7f9576cf9700 1 --2- 172.21.15.37:0/2416984866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9570101730 0x7f9570101b40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f956400bb80 tx=0x7f956400b4f0 comp rx=0 tx=0).stop 2024-04-25T17:09:42.547 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:41.671+0000 7f9576cf9700 1 -- 172.21.15.37:0/2416984866 shutdown_connections 2024-04-25T17:09:42.547 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:41.671+0000 7f9576cf9700 1 --2- 172.21.15.37:0/2416984866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9570101730 0x7f9570101b40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:42.547 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:41.671+0000 7f9576cf9700 1 -- 172.21.15.37:0/2416984866 >> 172.21.15.37:0/2416984866 conn(0x7f95700fcef0 msgr2=0x7f95700ff300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:09:42.547 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:41.671+0000 7f9576cf9700 1 -- 172.21.15.37:0/2416984866 shutdown_connections 2024-04-25T17:09:42.547 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:41.671+0000 7f9576cf9700 1 -- 172.21.15.37:0/2416984866 wait complete. 2024-04-25T17:09:42.547 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:41.671+0000 7f9576cf9700 1 Processor -- start 2024-04-25T17:09:42.547 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:41.671+0000 7f9576cf9700 1 -- start start 2024-04-25T17:09:42.547 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:41.671+0000 7f9576cf9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9570101730 0x7f957010f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:42.547 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:41.671+0000 7f9576cf9700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f957010f910 con 0x7f9570101730 2024-04-25T17:09:42.547 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:41.672+0000 7f9574a95700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9570101730 0x7f957010f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:42.547 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:41.672+0000 7f9574a95700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9570101730 0x7f957010f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37862/0 (socket says 172.21.15.37:37862) 2024-04-25T17:09:42.547 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:41.672+0000 7f9574a95700 1 -- 172.21.15.37:0/1847496378 learned_addr learned my addr 172.21.15.37:0/1847496378 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:09:42.548 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:41.672+0000 7f9574a95700 1 -- 172.21.15.37:0/1847496378 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f956400b790 con 0x7f9570101730 2024-04-25T17:09:42.548 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:41.672+0000 7f9574a95700 1 --2- 172.21.15.37:0/1847496378 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9570101730 0x7f957010f3d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9564006d40 tx=0x7f956400b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:42.548 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:41.672+0000 7f956d7fa700 1 -- 172.21.15.37:0/1847496378 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f956400dc70 con 0x7f9570101730 2024-04-25T17:09:42.548 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:41.672+0000 7f956d7fa700 1 -- 172.21.15.37:0/1847496378 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f956401d050 con 0x7f9570101730 2024-04-25T17:09:42.548 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:41.672+0000 7f9576cf9700 1 -- 172.21.15.37:0/1847496378 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f957010fb10 con 0x7f9570101730 2024-04-25T17:09:42.548 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:41.672+0000 7f956d7fa700 1 -- 172.21.15.37:0/1847496378 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f95640223d0 con 0x7f9570101730 2024-04-25T17:09:42.548 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:41.672+0000 7f9576cf9700 1 -- 172.21.15.37:0/1847496378 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9570110680 con 0x7f9570101730 2024-04-25T17:09:42.548 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:41.673+0000 7f956d7fa700 1 -- 172.21.15.37:0/1847496378 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 11) v1 ==== 43283+0+0 (secure 0 0 0) 0x7f9564022600 con 0x7f9570101730 2024-04-25T17:09:42.548 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:41.673+0000 7f9576cf9700 1 -- 172.21.15.37:0/1847496378 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f957005f5c0 con 0x7f9570101730 2024-04-25T17:09:42.548 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:41.673+0000 7f956d7fa700 1 --2- 172.21.15.37:0/1847496378 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f95600367d0 0x7f9560038c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:42.548 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:41.673+0000 7f956d7fa700 1 -- 172.21.15.37:0/1847496378 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f9564014070 con 0x7f9570101730 2024-04-25T17:09:42.548 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:41.673+0000 7f956ffff700 1 --2- 172.21.15.37:0/1847496378 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f95600367d0 0x7f9560038c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:42.548 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:41.674+0000 7f956ffff700 1 --2- 172.21.15.37:0/1847496378 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f95600367d0 0x7f9560038c80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f955c009990 tx=0x7f955c006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:42.548 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:41.678+0000 7f956d7fa700 1 -- 172.21.15.37:0/1847496378 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f956402c410 con 0x7f9570101730 2024-04-25T17:09:42.549 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:41.734+0000 7f956d7fa700 1 -- 172.21.15.37:0/1847496378 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 12) v1 ==== 43389+0+0 (secure 0 0 0) 0x7f956402c990 con 0x7f9570101730 2024-04-25T17:09:42.549 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:41.883+0000 7f9576cf9700 1 -- 172.21.15.37:0/1847496378 --> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f9570110a90 con 0x7f95600367d0 2024-04-25T17:09:42.549 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:41.924+0000 7f956d7fa700 1 -- 172.21.15.37:0/1847496378 <== mgr.14160 v2:172.21.15.37:6800/1299348474 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f9570110a90 con 0x7f95600367d0 2024-04-25T17:09:42.549 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:41.926+0000 7f9576cf9700 1 -- 172.21.15.37:0/1847496378 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f95600367d0 msgr2=0x7f9560038c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:42.549 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:41.926+0000 7f9576cf9700 1 --2- 172.21.15.37:0/1847496378 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f95600367d0 0x7f9560038c80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f955c009990 tx=0x7f955c006e40 comp rx=0 tx=0).stop 2024-04-25T17:09:42.549 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:41.926+0000 7f9576cf9700 1 -- 172.21.15.37:0/1847496378 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9570101730 msgr2=0x7f957010f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:42.549 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:41.926+0000 7f9576cf9700 1 --2- 172.21.15.37:0/1847496378 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9570101730 0x7f957010f3d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9564006d40 tx=0x7f956400b4f0 comp rx=0 tx=0).stop 2024-04-25T17:09:42.549 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:41.927+0000 7f9576cf9700 1 -- 172.21.15.37:0/1847496378 shutdown_connections 2024-04-25T17:09:42.549 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:41.927+0000 7f9576cf9700 1 --2- 172.21.15.37:0/1847496378 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f95600367d0 0x7f9560038c80 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:42.549 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:41.927+0000 7f9576cf9700 1 --2- 172.21.15.37:0/1847496378 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9570101730 0x7f957010f3d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:42.549 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:41.927+0000 7f9576cf9700 1 -- 172.21.15.37:0/1847496378 >> 172.21.15.37:0/1847496378 conn(0x7f95700fcef0 msgr2=0x7f9570105bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:09:42.549 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:41.927+0000 7f9576cf9700 1 -- 172.21.15.37:0/1847496378 shutdown_connections 2024-04-25T17:09:42.549 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:41.927+0000 7f9576cf9700 1 -- 172.21.15.37:0/1847496378 wait complete. 2024-04-25T17:09:42.549 INFO:teuthology.orchestra.run.smithi037.stdout:Creating initial admin user... 2024-04-25T17:09:42.907 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:42 smithi037 ceph-mon[26472]: mgrmap e12: smithi037.txrgxl(active, since 2s) 2024-04-25T17:09:42.907 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:42 smithi037 ceph-mon[26472]: from='mgr.14160 172.21.15.37:0/1872577945' entity='mgr.smithi037.txrgxl' 2024-04-25T17:09:42.907 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:42 smithi037 ceph-mon[26472]: from='mgr.14160 172.21.15.37:0/1872577945' entity='mgr.smithi037.txrgxl' 2024-04-25T17:09:42.907 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:42 smithi037 ceph-mon[26472]: from='mgr.14160 172.21.15.37:0/1872577945' entity='mgr.smithi037.txrgxl' 2024-04-25T17:09:43.939 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:43 smithi037 ceph-mon[26472]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:09:43.939 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:43 smithi037 ceph-mon[26472]: from='mgr.14160 172.21.15.37:0/1872577945' entity='mgr.smithi037.txrgxl' 2024-04-25T17:09:44.700 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$aIr5rqqQEcrC6kfmV0gGGOzwD4sD59.r5mX.kaS8pMpNaAaCGVuia", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1714064983, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-04-25T17:09:44.700 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:42.910+0000 7f82843fd700 1 Processor -- start 2024-04-25T17:09:44.700 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:42.910+0000 7f82843fd700 1 -- start start 2024-04-25T17:09:44.700 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:42.911+0000 7f82843fd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f827c101d90 0x7f827c104170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:44.700 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:42.911+0000 7f82843fd700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f827c104780 con 0x7f827c101d90 2024-04-25T17:09:44.700 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:42.911+0000 7f8282199700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f827c101d90 0x7f827c104170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:44.700 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:42.911+0000 7f8282199700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f827c101d90 0x7f827c104170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37866/0 (socket says 172.21.15.37:37866) 2024-04-25T17:09:44.700 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:42.911+0000 7f8282199700 1 -- 172.21.15.37:0/2723340413 learned_addr learned my addr 172.21.15.37:0/2723340413 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:09:44.700 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:42.911+0000 7f8282199700 1 -- 172.21.15.37:0/2723340413 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f827c1048c0 con 0x7f827c101d90 2024-04-25T17:09:44.700 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:42.911+0000 7f8282199700 1 --2- 172.21.15.37:0/2723340413 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f827c101d90 0x7f827c104170 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f827800bb80 tx=0x7f827800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f9eff3ae09356eb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:44.701 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:42.911+0000 7f8281197700 1 -- 172.21.15.37:0/2723340413 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f827800dd00 con 0x7f827c101d90 2024-04-25T17:09:44.701 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:42.911+0000 7f8281197700 1 -- 172.21.15.37:0/2723340413 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f827800de60 con 0x7f827c101d90 2024-04-25T17:09:44.701 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:42.912+0000 7f8281197700 1 -- 172.21.15.37:0/2723340413 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8278018920 con 0x7f827c101d90 2024-04-25T17:09:44.701 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:42.912+0000 7f82843fd700 1 -- 172.21.15.37:0/2723340413 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f827c101d90 msgr2=0x7f827c104170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:44.701 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:42.912+0000 7f82843fd700 1 --2- 172.21.15.37:0/2723340413 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f827c101d90 0x7f827c104170 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f827800bb80 tx=0x7f827800b4f0 comp rx=0 tx=0).stop 2024-04-25T17:09:44.701 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:42.912+0000 7f82843fd700 1 -- 172.21.15.37:0/2723340413 shutdown_connections 2024-04-25T17:09:44.701 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:42.912+0000 7f82843fd700 1 --2- 172.21.15.37:0/2723340413 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f827c101d90 0x7f827c104170 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:44.701 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:42.912+0000 7f82843fd700 1 -- 172.21.15.37:0/2723340413 >> 172.21.15.37:0/2723340413 conn(0x7f827c0fc6f0 msgr2=0x7f827c0feb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:09:44.701 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:42.912+0000 7f82843fd700 1 -- 172.21.15.37:0/2723340413 shutdown_connections 2024-04-25T17:09:44.701 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:42.912+0000 7f82843fd700 1 -- 172.21.15.37:0/2723340413 wait complete. 2024-04-25T17:09:44.701 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:42.913+0000 7f82843fd700 1 Processor -- start 2024-04-25T17:09:44.701 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:42.913+0000 7f82843fd700 1 -- start start 2024-04-25T17:09:44.702 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:42.913+0000 7f82843fd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f827c101d90 0x7f827c10f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:44.702 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:42.913+0000 7f82843fd700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f827c10f8b0 con 0x7f827c101d90 2024-04-25T17:09:44.702 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:42.913+0000 7f8282199700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f827c101d90 0x7f827c10f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:44.702 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:42.913+0000 7f8282199700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f827c101d90 0x7f827c10f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37872/0 (socket says 172.21.15.37:37872) 2024-04-25T17:09:44.702 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:42.913+0000 7f8282199700 1 -- 172.21.15.37:0/1359669287 learned_addr learned my addr 172.21.15.37:0/1359669287 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:09:44.702 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:42.913+0000 7f8282199700 1 -- 172.21.15.37:0/1359669287 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f827800b790 con 0x7f827c101d90 2024-04-25T17:09:44.702 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:42.914+0000 7f8282199700 1 --2- 172.21.15.37:0/1359669287 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f827c101d90 0x7f827c10f370 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8278006b00 tx=0x7f827800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:44.702 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:42.914+0000 7f8272ffd700 1 -- 172.21.15.37:0/1359669287 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8278010bd0 con 0x7f827c101d90 2024-04-25T17:09:44.702 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:42.914+0000 7f8272ffd700 1 -- 172.21.15.37:0/1359669287 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f827801d050 con 0x7f827c101d90 2024-04-25T17:09:44.702 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:42.914+0000 7f82843fd700 1 -- 172.21.15.37:0/1359669287 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f827c10fab0 con 0x7f827c101d90 2024-04-25T17:09:44.702 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:42.914+0000 7f8272ffd700 1 -- 172.21.15.37:0/1359669287 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8278022590 con 0x7f827c101d90 2024-04-25T17:09:44.702 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:42.914+0000 7f82843fd700 1 -- 172.21.15.37:0/1359669287 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f827c110620 con 0x7f827c101d90 2024-04-25T17:09:44.702 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:42.915+0000 7f8272ffd700 1 -- 172.21.15.37:0/1359669287 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 12) v1 ==== 43389+0+0 (secure 0 0 0) 0x7f82780227c0 con 0x7f827c101d90 2024-04-25T17:09:44.702 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:42.915+0000 7f8272ffd700 1 --2- 172.21.15.37:0/1359669287 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f82680368f0 0x7f8268038da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:44.702 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:42.915+0000 7f8272ffd700 1 -- 172.21.15.37:0/1359669287 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f8278014070 con 0x7f827c101d90 2024-04-25T17:09:44.703 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:42.915+0000 7f82843fd700 1 -- 172.21.15.37:0/1359669287 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f827c05f5c0 con 0x7f827c101d90 2024-04-25T17:09:44.703 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:42.915+0000 7f8281998700 1 --2- 172.21.15.37:0/1359669287 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f82680368f0 0x7f8268038da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:44.703 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:42.915+0000 7f8281998700 1 --2- 172.21.15.37:0/1359669287 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f82680368f0 0x7f8268038da0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f826c009990 tx=0x7f826c006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:44.703 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:42.920+0000 7f8272ffd700 1 -- 172.21.15.37:0/1359669287 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f827800e360 con 0x7f827c101d90 2024-04-25T17:09:44.703 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:43.137+0000 7f82843fd700 1 -- 172.21.15.37:0/1359669287 --> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f827c05f3b0 con 0x7f82680368f0 2024-04-25T17:09:44.703 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:43.384+0000 7f8272ffd700 1 -- 172.21.15.37:0/1359669287 <== mgr.14160 v2:172.21.15.37:6800/1299348474 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f827c05f3b0 con 0x7f82680368f0 2024-04-25T17:09:44.703 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:43.386+0000 7f82843fd700 1 -- 172.21.15.37:0/1359669287 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f82680368f0 msgr2=0x7f8268038da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:44.703 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:43.386+0000 7f82843fd700 1 --2- 172.21.15.37:0/1359669287 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f82680368f0 0x7f8268038da0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f826c009990 tx=0x7f826c006e40 comp rx=0 tx=0).stop 2024-04-25T17:09:44.703 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:43.386+0000 7f82843fd700 1 -- 172.21.15.37:0/1359669287 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f827c101d90 msgr2=0x7f827c10f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:44.703 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:43.386+0000 7f82843fd700 1 --2- 172.21.15.37:0/1359669287 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f827c101d90 0x7f827c10f370 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8278006b00 tx=0x7f827800b4f0 comp rx=0 tx=0).stop 2024-04-25T17:09:44.703 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:43.386+0000 7f82843fd700 1 -- 172.21.15.37:0/1359669287 shutdown_connections 2024-04-25T17:09:44.703 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:43.386+0000 7f82843fd700 1 --2- 172.21.15.37:0/1359669287 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f82680368f0 0x7f8268038da0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:44.704 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:43.386+0000 7f82843fd700 1 --2- 172.21.15.37:0/1359669287 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f827c101d90 0x7f827c10f370 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:44.704 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:43.386+0000 7f82843fd700 1 -- 172.21.15.37:0/1359669287 >> 172.21.15.37:0/1359669287 conn(0x7f827c0fc6f0 msgr2=0x7f827c0fd150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:09:44.704 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:43.386+0000 7f82843fd700 1 -- 172.21.15.37:0/1359669287 shutdown_connections 2024-04-25T17:09:44.704 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:43.386+0000 7f82843fd700 1 -- 172.21.15.37:0/1359669287 wait complete. 2024-04-25T17:09:44.704 INFO:teuthology.orchestra.run.smithi037.stdout:Fetching dashboard port number... 2024-04-25T17:09:44.951 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:44 smithi037 ceph-mon[26472]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:09:45.823 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stdout 8443 2024-04-25T17:09:45.823 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:45.146+0000 7f8e711a9700 1 Processor -- start 2024-04-25T17:09:45.823 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:45.146+0000 7f8e711a9700 1 -- start start 2024-04-25T17:09:45.823 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:45.146+0000 7f8e711a9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e6c1016f0 0x7f8e6c101b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:45.823 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:45.146+0000 7f8e711a9700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6c102040 con 0x7f8e6c1016f0 2024-04-25T17:09:45.823 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:45.147+0000 7f8e6ad9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e6c1016f0 0x7f8e6c101b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:45.823 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:45.147+0000 7f8e6ad9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e6c1016f0 0x7f8e6c101b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37884/0 (socket says 172.21.15.37:37884) 2024-04-25T17:09:45.823 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:45.147+0000 7f8e6ad9d700 1 -- 172.21.15.37:0/1168996601 learned_addr learned my addr 172.21.15.37:0/1168996601 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:09:45.823 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:45.147+0000 7f8e6ad9d700 1 -- 172.21.15.37:0/1168996601 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e6c102180 con 0x7f8e6c1016f0 2024-04-25T17:09:45.824 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:45.147+0000 7f8e6ad9d700 1 --2- 172.21.15.37:0/1168996601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e6c1016f0 0x7f8e6c101b00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c0098e0 tx=0x7f8e5c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7449b2c1d3c8b19b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:45.824 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:45.147+0000 7f8e69d9b700 1 -- 172.21.15.37:0/1168996601 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8e5c00b860 con 0x7f8e6c1016f0 2024-04-25T17:09:45.824 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:45.147+0000 7f8e69d9b700 1 -- 172.21.15.37:0/1168996601 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8e5c00be90 con 0x7f8e6c1016f0 2024-04-25T17:09:45.824 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:45.147+0000 7f8e69d9b700 1 -- 172.21.15.37:0/1168996601 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8e5c0103c0 con 0x7f8e6c1016f0 2024-04-25T17:09:45.824 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:45.148+0000 7f8e711a9700 1 -- 172.21.15.37:0/1168996601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e6c1016f0 msgr2=0x7f8e6c101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:45.824 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:45.148+0000 7f8e711a9700 1 --2- 172.21.15.37:0/1168996601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e6c1016f0 0x7f8e6c101b00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c0098e0 tx=0x7f8e5c009250 comp rx=0 tx=0).stop 2024-04-25T17:09:45.824 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:45.148+0000 7f8e711a9700 1 -- 172.21.15.37:0/1168996601 shutdown_connections 2024-04-25T17:09:45.824 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:45.148+0000 7f8e711a9700 1 --2- 172.21.15.37:0/1168996601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e6c1016f0 0x7f8e6c101b00 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:45.824 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:45.148+0000 7f8e711a9700 1 -- 172.21.15.37:0/1168996601 >> 172.21.15.37:0/1168996601 conn(0x7f8e6c0fced0 msgr2=0x7f8e6c0ff2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:09:45.824 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:45.148+0000 7f8e711a9700 1 -- 172.21.15.37:0/1168996601 shutdown_connections 2024-04-25T17:09:45.824 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:45.148+0000 7f8e711a9700 1 -- 172.21.15.37:0/1168996601 wait complete. 2024-04-25T17:09:45.824 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:45.149+0000 7f8e711a9700 1 Processor -- start 2024-04-25T17:09:45.824 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:45.149+0000 7f8e711a9700 1 -- start start 2024-04-25T17:09:45.824 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:45.149+0000 7f8e711a9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e6c1016f0 0x7f8e6c1104d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:45.825 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:45.149+0000 7f8e711a9700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e6c110a10 con 0x7f8e6c1016f0 2024-04-25T17:09:45.825 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:45.149+0000 7f8e6ad9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e6c1016f0 0x7f8e6c1104d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:45.825 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:45.149+0000 7f8e6ad9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e6c1016f0 0x7f8e6c1104d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37900/0 (socket says 172.21.15.37:37900) 2024-04-25T17:09:45.825 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:45.149+0000 7f8e6ad9d700 1 -- 172.21.15.37:0/1739186382 learned_addr learned my addr 172.21.15.37:0/1739186382 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:09:45.825 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:45.149+0000 7f8e6ad9d700 1 -- 172.21.15.37:0/1739186382 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e5c0094f0 con 0x7f8e6c1016f0 2024-04-25T17:09:45.825 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:45.149+0000 7f8e6ad9d700 1 --2- 172.21.15.37:0/1739186382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e6c1016f0 0x7f8e6c1104d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c011680 tx=0x7f8e5c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:45.825 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:45.149+0000 7f8e537fe700 1 -- 172.21.15.37:0/1739186382 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8e5c010680 con 0x7f8e6c1016f0 2024-04-25T17:09:45.825 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:45.150+0000 7f8e537fe700 1 -- 172.21.15.37:0/1739186382 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8e5c010cb0 con 0x7f8e6c1016f0 2024-04-25T17:09:45.825 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:45.150+0000 7f8e711a9700 1 -- 172.21.15.37:0/1739186382 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e6c110c10 con 0x7f8e6c1016f0 2024-04-25T17:09:45.825 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:45.150+0000 7f8e537fe700 1 -- 172.21.15.37:0/1739186382 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8e5c025430 con 0x7f8e6c1016f0 2024-04-25T17:09:45.825 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:45.150+0000 7f8e711a9700 1 -- 172.21.15.37:0/1739186382 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e6c111780 con 0x7f8e6c1016f0 2024-04-25T17:09:45.825 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:45.150+0000 7f8e537fe700 1 -- 172.21.15.37:0/1739186382 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 12) v1 ==== 43389+0+0 (secure 0 0 0) 0x7f8e5c022030 con 0x7f8e6c1016f0 2024-04-25T17:09:45.825 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:45.150+0000 7f8e711a9700 1 -- 172.21.15.37:0/1739186382 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e6c05f5c0 con 0x7f8e6c1016f0 2024-04-25T17:09:45.825 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:45.151+0000 7f8e537fe700 1 --2- 172.21.15.37:0/1739186382 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f8e540368a0 0x7f8e54038d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:45.825 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:45.151+0000 7f8e537fe700 1 -- 172.21.15.37:0/1739186382 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f8e5c04c8d0 con 0x7f8e6c1016f0 2024-04-25T17:09:45.826 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:45.151+0000 7f8e6a59c700 1 --2- 172.21.15.37:0/1739186382 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f8e540368a0 0x7f8e54038d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:45.826 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:45.151+0000 7f8e6a59c700 1 --2- 172.21.15.37:0/1739186382 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f8e540368a0 0x7f8e54038d50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8e60009990 tx=0x7f8e60006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:45.826 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:45.155+0000 7f8e537fe700 1 -- 172.21.15.37:0/1739186382 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f8e5c025670 con 0x7f8e6c1016f0 2024-04-25T17:09:45.826 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:45.351+0000 7f8e711a9700 1 -- 172.21.15.37:0/1739186382 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f8e6c05f5c0 con 0x7f8e6c1016f0 2024-04-25T17:09:45.826 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:45.352+0000 7f8e537fe700 1 -- 172.21.15.37:0/1739186382 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f8e5c023380 con 0x7f8e6c1016f0 2024-04-25T17:09:45.826 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:45.353+0000 7f8e711a9700 1 -- 172.21.15.37:0/1739186382 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f8e540368a0 msgr2=0x7f8e54038d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:45.826 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:45.353+0000 7f8e711a9700 1 --2- 172.21.15.37:0/1739186382 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f8e540368a0 0x7f8e54038d50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8e60009990 tx=0x7f8e60006e40 comp rx=0 tx=0).stop 2024-04-25T17:09:45.826 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:45.353+0000 7f8e711a9700 1 -- 172.21.15.37:0/1739186382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e6c1016f0 msgr2=0x7f8e6c1104d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:45.826 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:45.353+0000 7f8e711a9700 1 --2- 172.21.15.37:0/1739186382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e6c1016f0 0x7f8e6c1104d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c011680 tx=0x7f8e5c009250 comp rx=0 tx=0).stop 2024-04-25T17:09:45.826 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:45.354+0000 7f8e711a9700 1 -- 172.21.15.37:0/1739186382 shutdown_connections 2024-04-25T17:09:45.826 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:45.354+0000 7f8e711a9700 1 --2- 172.21.15.37:0/1739186382 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f8e540368a0 0x7f8e54038d50 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:45.826 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:45.354+0000 7f8e711a9700 1 --2- 172.21.15.37:0/1739186382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e6c1016f0 0x7f8e6c1104d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:45.826 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:45.354+0000 7f8e711a9700 1 -- 172.21.15.37:0/1739186382 >> 172.21.15.37:0/1739186382 conn(0x7f8e6c0fced0 msgr2=0x7f8e6c0fd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:09:45.826 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:45.354+0000 7f8e711a9700 1 -- 172.21.15.37:0/1739186382 shutdown_connections 2024-04-25T17:09:45.827 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:45.354+0000 7f8e711a9700 1 -- 172.21.15.37:0/1739186382 wait complete. 2024-04-25T17:09:45.830 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-04-25T17:09:45.831 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout disabled 2024-04-25T17:09:45.838 INFO:teuthology.orchestra.run.smithi037.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-04-25T17:09:45.838 INFO:teuthology.orchestra.run.smithi037.stdout:systemctl: stdout inactive 2024-04-25T17:09:45.838 INFO:teuthology.orchestra.run.smithi037.stdout:firewalld.service is not enabled 2024-04-25T17:09:45.838 INFO:teuthology.orchestra.run.smithi037.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-04-25T17:09:45.840 INFO:teuthology.orchestra.run.smithi037.stdout:Ceph Dashboard is now available at: 2024-04-25T17:09:45.840 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:09:45.840 INFO:teuthology.orchestra.run.smithi037.stdout: URL: https://smithi037:8443/ 2024-04-25T17:09:45.840 INFO:teuthology.orchestra.run.smithi037.stdout: User: admin 2024-04-25T17:09:45.840 INFO:teuthology.orchestra.run.smithi037.stdout: Password: 46y6nrmy00 2024-04-25T17:09:45.840 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:09:45.841 INFO:teuthology.orchestra.run.smithi037.stdout:Saving cluster configuration to /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/config directory 2024-04-25T17:09:45.841 INFO:teuthology.orchestra.run.smithi037.stdout:Enabling autotune for osd_memory_target 2024-04-25T17:09:46.024 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:45 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/1739186382' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-04-25T17:09:47.022 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:46 smithi037 ceph-mon[26472]: mgrmap e13: smithi037.txrgxl(active, since 6s) 2024-04-25T17:09:47.029 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:46.228+0000 7f3447507700 1 Processor -- start 2024-04-25T17:09:47.029 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:46.229+0000 7f3447507700 1 -- start start 2024-04-25T17:09:47.029 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:46.229+0000 7f3447507700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3440078ca0 0x7f3440077250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:47.029 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:46.229+0000 7f3447507700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34400790b0 con 0x7f3440078ca0 2024-04-25T17:09:47.029 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:46.229+0000 7f34452a3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3440078ca0 0x7f3440077250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:47.029 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:46.229+0000 7f34452a3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3440078ca0 0x7f3440077250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37908/0 (socket says 172.21.15.37:37908) 2024-04-25T17:09:47.029 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:46.229+0000 7f34452a3700 1 -- 172.21.15.37:0/529777109 learned_addr learned my addr 172.21.15.37:0/529777109 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:09:47.029 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:46.229+0000 7f34452a3700 1 -- 172.21.15.37:0/529777109 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3440077790 con 0x7f3440078ca0 2024-04-25T17:09:47.029 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:46.230+0000 7f34452a3700 1 --2- 172.21.15.37:0/529777109 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3440078ca0 0x7f3440077250 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f343c0098e0 tx=0x7f343c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebc64ebca1a0fbf8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:47.029 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:46.230+0000 7f3437fff700 1 -- 172.21.15.37:0/529777109 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f343c00b860 con 0x7f3440078ca0 2024-04-25T17:09:47.029 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:46.230+0000 7f3437fff700 1 -- 172.21.15.37:0/529777109 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f343c00be90 con 0x7f3440078ca0 2024-04-25T17:09:47.029 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:46.230+0000 7f3437fff700 1 -- 172.21.15.37:0/529777109 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f343c0103c0 con 0x7f3440078ca0 2024-04-25T17:09:47.029 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:46.230+0000 7f3447507700 1 -- 172.21.15.37:0/529777109 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3440078ca0 msgr2=0x7f3440077250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:47.030 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:46.230+0000 7f3447507700 1 --2- 172.21.15.37:0/529777109 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3440078ca0 0x7f3440077250 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f343c0098e0 tx=0x7f343c009250 comp rx=0 tx=0).stop 2024-04-25T17:09:47.030 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:46.230+0000 7f3447507700 1 -- 172.21.15.37:0/529777109 shutdown_connections 2024-04-25T17:09:47.030 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:46.230+0000 7f3447507700 1 --2- 172.21.15.37:0/529777109 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3440078ca0 0x7f3440077250 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:47.030 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:46.230+0000 7f3447507700 1 -- 172.21.15.37:0/529777109 >> 172.21.15.37:0/529777109 conn(0x7f34400fe060 msgr2=0x7f3440100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:09:47.030 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:46.230+0000 7f3447507700 1 -- 172.21.15.37:0/529777109 shutdown_connections 2024-04-25T17:09:47.030 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:46.231+0000 7f3447507700 1 -- 172.21.15.37:0/529777109 wait complete. 2024-04-25T17:09:47.030 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:46.231+0000 7f3447507700 1 Processor -- start 2024-04-25T17:09:47.030 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:46.231+0000 7f3447507700 1 -- start start 2024-04-25T17:09:47.030 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:46.231+0000 7f3447507700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3440078ca0 0x7f3440113860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:47.030 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:46.231+0000 7f3447507700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3440113da0 con 0x7f3440078ca0 2024-04-25T17:09:47.030 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:46.231+0000 7f34452a3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3440078ca0 0x7f3440113860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:47.030 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:46.231+0000 7f34452a3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3440078ca0 0x7f3440113860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37912/0 (socket says 172.21.15.37:37912) 2024-04-25T17:09:47.030 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:46.231+0000 7f34452a3700 1 -- 172.21.15.37:0/1344942374 learned_addr learned my addr 172.21.15.37:0/1344942374 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:09:47.030 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:46.232+0000 7f34452a3700 1 -- 172.21.15.37:0/1344942374 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f343c0094f0 con 0x7f3440078ca0 2024-04-25T17:09:47.031 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:46.232+0000 7f34452a3700 1 --2- 172.21.15.37:0/1344942374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3440078ca0 0x7f3440113860 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f343c006d40 tx=0x7f343c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:47.031 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:46.232+0000 7f3435ffb700 1 -- 172.21.15.37:0/1344942374 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f343c010840 con 0x7f3440078ca0 2024-04-25T17:09:47.031 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:46.232+0000 7f3435ffb700 1 -- 172.21.15.37:0/1344942374 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f343c010e70 con 0x7f3440078ca0 2024-04-25T17:09:47.031 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:46.232+0000 7f3447507700 1 -- 172.21.15.37:0/1344942374 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3440113fa0 con 0x7f3440078ca0 2024-04-25T17:09:47.031 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:46.232+0000 7f3435ffb700 1 -- 172.21.15.37:0/1344942374 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f343c024ea0 con 0x7f3440078ca0 2024-04-25T17:09:47.031 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:46.232+0000 7f3447507700 1 -- 172.21.15.37:0/1344942374 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3440114b10 con 0x7f3440078ca0 2024-04-25T17:09:47.031 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:46.233+0000 7f3435ffb700 1 -- 172.21.15.37:0/1344942374 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f343c01a4c0 con 0x7f3440078ca0 2024-04-25T17:09:47.031 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:46.233+0000 7f3435ffb700 1 --2- 172.21.15.37:0/1344942374 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f342c036940 0x7f342c038df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:47.031 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:46.233+0000 7f3435ffb700 1 -- 172.21.15.37:0/1344942374 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f343c04a960 con 0x7f3440078ca0 2024-04-25T17:09:47.031 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:46.233+0000 7f3444aa2700 1 --2- 172.21.15.37:0/1344942374 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f342c036940 0x7f342c038df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:47.031 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:46.233+0000 7f3447507700 1 -- 172.21.15.37:0/1344942374 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f344005f5c0 con 0x7f3440078ca0 2024-04-25T17:09:47.031 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:46.234+0000 7f3444aa2700 1 --2- 172.21.15.37:0/1344942374 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f342c036940 0x7f342c038df0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3430009990 tx=0x7f3430006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:47.031 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:46.238+0000 7f3435ffb700 1 -- 172.21.15.37:0/1344942374 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f343c018710 con 0x7f3440078ca0 2024-04-25T17:09:47.031 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:46.433+0000 7f3447507700 1 -- 172.21.15.37:0/1344942374 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f344004bed0 con 0x7f3440078ca0 2024-04-25T17:09:47.031 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:46.433+0000 7f3435ffb700 1 -- 172.21.15.37:0/1344942374 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f343c018350 con 0x7f3440078ca0 2024-04-25T17:09:47.032 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:46.435+0000 7f3447507700 1 -- 172.21.15.37:0/1344942374 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f342c036940 msgr2=0x7f342c038df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:47.032 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:46.435+0000 7f3447507700 1 --2- 172.21.15.37:0/1344942374 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f342c036940 0x7f342c038df0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3430009990 tx=0x7f3430006e40 comp rx=0 tx=0).stop 2024-04-25T17:09:47.032 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:46.435+0000 7f3447507700 1 -- 172.21.15.37:0/1344942374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3440078ca0 msgr2=0x7f3440113860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:47.032 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:46.435+0000 7f3447507700 1 --2- 172.21.15.37:0/1344942374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3440078ca0 0x7f3440113860 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f343c006d40 tx=0x7f343c009250 comp rx=0 tx=0).stop 2024-04-25T17:09:47.032 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:46.435+0000 7f3447507700 1 -- 172.21.15.37:0/1344942374 shutdown_connections 2024-04-25T17:09:47.032 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:46.435+0000 7f3447507700 1 --2- 172.21.15.37:0/1344942374 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f342c036940 0x7f342c038df0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:47.032 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:46.435+0000 7f3447507700 1 --2- 172.21.15.37:0/1344942374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3440078ca0 0x7f3440113860 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:47.032 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:46.436+0000 7f3447507700 1 -- 172.21.15.37:0/1344942374 >> 172.21.15.37:0/1344942374 conn(0x7f34400fe060 msgr2=0x7f34400febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:09:47.032 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:46.436+0000 7f3447507700 1 -- 172.21.15.37:0/1344942374 shutdown_connections 2024-04-25T17:09:47.032 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:46.436+0000 7f3447507700 1 -- 172.21.15.37:0/1344942374 wait complete. 2024-04-25T17:09:48.369 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:47.478+0000 7fcc6fcf7700 1 Processor -- start 2024-04-25T17:09:48.369 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:47.478+0000 7fcc6fcf7700 1 -- start start 2024-04-25T17:09:48.369 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:47.478+0000 7fcc6fcf7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc681028d0 0x7fcc68102ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:48.369 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:47.478+0000 7fcc6fcf7700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc68103220 con 0x7fcc681028d0 2024-04-25T17:09:48.369 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:47.479+0000 7fcc6da93700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc681028d0 0x7fcc68102ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:48.369 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:47.479+0000 7fcc6da93700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc681028d0 0x7fcc68102ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43988/0 (socket says 172.21.15.37:43988) 2024-04-25T17:09:48.370 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:47.479+0000 7fcc6da93700 1 -- 172.21.15.37:0/2766305512 learned_addr learned my addr 172.21.15.37:0/2766305512 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:09:48.370 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:47.479+0000 7fcc6da93700 1 -- 172.21.15.37:0/2766305512 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc68103360 con 0x7fcc681028d0 2024-04-25T17:09:48.370 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:47.479+0000 7fcc6da93700 1 --2- 172.21.15.37:0/2766305512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc681028d0 0x7fcc68102ce0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcc60009e50 tx=0x7fcc60009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e47ba62951cfabe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:48.370 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:47.479+0000 7fcc6ca91700 1 -- 172.21.15.37:0/2766305512 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcc600092e0 con 0x7fcc681028d0 2024-04-25T17:09:48.370 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:47.479+0000 7fcc6ca91700 1 -- 172.21.15.37:0/2766305512 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcc60012430 con 0x7fcc681028d0 2024-04-25T17:09:48.370 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:47.479+0000 7fcc6ca91700 1 -- 172.21.15.37:0/2766305512 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcc600075a0 con 0x7fcc681028d0 2024-04-25T17:09:48.370 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:47.480+0000 7fcc6fcf7700 1 -- 172.21.15.37:0/2766305512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc681028d0 msgr2=0x7fcc68102ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:48.370 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:47.480+0000 7fcc6fcf7700 1 --2- 172.21.15.37:0/2766305512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc681028d0 0x7fcc68102ce0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcc60009e50 tx=0x7fcc60009840 comp rx=0 tx=0).stop 2024-04-25T17:09:48.370 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:47.480+0000 7fcc6fcf7700 1 -- 172.21.15.37:0/2766305512 shutdown_connections 2024-04-25T17:09:48.370 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:47.480+0000 7fcc6fcf7700 1 --2- 172.21.15.37:0/2766305512 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc681028d0 0x7fcc68102ce0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:48.370 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:47.480+0000 7fcc6fcf7700 1 -- 172.21.15.37:0/2766305512 >> 172.21.15.37:0/2766305512 conn(0x7fcc680fe090 msgr2=0x7fcc681004a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:09:48.370 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:47.480+0000 7fcc6fcf7700 1 -- 172.21.15.37:0/2766305512 shutdown_connections 2024-04-25T17:09:48.370 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:47.480+0000 7fcc6fcf7700 1 -- 172.21.15.37:0/2766305512 wait complete. 2024-04-25T17:09:48.371 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:47.480+0000 7fcc6fcf7700 1 Processor -- start 2024-04-25T17:09:48.371 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:47.480+0000 7fcc6fcf7700 1 -- start start 2024-04-25T17:09:48.371 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:47.481+0000 7fcc6fcf7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc681028d0 0x7fcc68111620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:48.371 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:47.481+0000 7fcc6fcf7700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc68111b60 con 0x7fcc681028d0 2024-04-25T17:09:48.371 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:47.481+0000 7fcc6da93700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc681028d0 0x7fcc68111620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:48.371 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:47.481+0000 7fcc6da93700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc681028d0 0x7fcc68111620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44004/0 (socket says 172.21.15.37:44004) 2024-04-25T17:09:48.371 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:47.481+0000 7fcc6da93700 1 -- 172.21.15.37:0/276173127 learned_addr learned my addr 172.21.15.37:0/276173127 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:09:48.371 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:47.481+0000 7fcc6da93700 1 -- 172.21.15.37:0/276173127 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc60009ae0 con 0x7fcc681028d0 2024-04-25T17:09:48.371 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:47.481+0000 7fcc6da93700 1 --2- 172.21.15.37:0/276173127 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc681028d0 0x7fcc68111620 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcc600127d0 tx=0x7fcc60009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:48.371 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:47.481+0000 7fcc667fc700 1 -- 172.21.15.37:0/276173127 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcc600092e0 con 0x7fcc681028d0 2024-04-25T17:09:48.371 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:47.481+0000 7fcc667fc700 1 -- 172.21.15.37:0/276173127 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcc60007d30 con 0x7fcc681028d0 2024-04-25T17:09:48.371 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:47.481+0000 7fcc6fcf7700 1 -- 172.21.15.37:0/276173127 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc68111d60 con 0x7fcc681028d0 2024-04-25T17:09:48.371 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:47.481+0000 7fcc667fc700 1 -- 172.21.15.37:0/276173127 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcc60025960 con 0x7fcc681028d0 2024-04-25T17:09:48.371 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:47.482+0000 7fcc6fcf7700 1 -- 172.21.15.37:0/276173127 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc681128d0 con 0x7fcc681028d0 2024-04-25T17:09:48.371 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:47.482+0000 7fcc667fc700 1 -- 172.21.15.37:0/276173127 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7fcc60019050 con 0x7fcc681028d0 2024-04-25T17:09:48.372 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:47.482+0000 7fcc667fc700 1 --2- 172.21.15.37:0/276173127 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7fcc50036990 0x7fcc50038e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:48.372 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:47.483+0000 7fcc667fc700 1 -- 172.21.15.37:0/276173127 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fcc6004a3e0 con 0x7fcc681028d0 2024-04-25T17:09:48.372 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:47.483+0000 7fcc6fcf7700 1 -- 172.21.15.37:0/276173127 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc6805f5c0 con 0x7fcc681028d0 2024-04-25T17:09:48.372 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:47.483+0000 7fcc6d292700 1 --2- 172.21.15.37:0/276173127 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7fcc50036990 0x7fcc50038e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:48.372 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:47.483+0000 7fcc6d292700 1 --2- 172.21.15.37:0/276173127 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7fcc50036990 0x7fcc50038e40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c009990 tx=0x7fcc5c006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:48.372 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:47.487+0000 7fcc667fc700 1 -- 172.21.15.37:0/276173127 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fcc60017080 con 0x7fcc681028d0 2024-04-25T17:09:48.372 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:47.790+0000 7fcc6fcf7700 1 -- 172.21.15.37:0/276173127 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7fcc6804bed0 con 0x7fcc681028d0 2024-04-25T17:09:48.372 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:47.792+0000 7fcc667fc700 1 -- 172.21.15.37:0/276173127 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v33)=0 set mgr/dashboard/cluster/status v33) v1 ==== 153+0+0 (secure 0 0 0) 0x7fcc6001c410 con 0x7fcc681028d0 2024-04-25T17:09:48.372 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:47.794+0000 7fcc6fcf7700 1 -- 172.21.15.37:0/276173127 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7fcc50036990 msgr2=0x7fcc50038e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:48.372 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:47.794+0000 7fcc6fcf7700 1 --2- 172.21.15.37:0/276173127 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7fcc50036990 0x7fcc50038e40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c009990 tx=0x7fcc5c006e40 comp rx=0 tx=0).stop 2024-04-25T17:09:48.372 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:47.794+0000 7fcc6fcf7700 1 -- 172.21.15.37:0/276173127 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc681028d0 msgr2=0x7fcc68111620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:48.372 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:47.794+0000 7fcc6fcf7700 1 --2- 172.21.15.37:0/276173127 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc681028d0 0x7fcc68111620 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcc600127d0 tx=0x7fcc60009840 comp rx=0 tx=0).stop 2024-04-25T17:09:48.372 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:47.794+0000 7fcc6fcf7700 1 -- 172.21.15.37:0/276173127 shutdown_connections 2024-04-25T17:09:48.373 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:47.794+0000 7fcc6fcf7700 1 --2- 172.21.15.37:0/276173127 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7fcc50036990 0x7fcc50038e40 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:48.373 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:47.794+0000 7fcc6fcf7700 1 --2- 172.21.15.37:0/276173127 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc681028d0 0x7fcc68111620 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:48.373 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:47.794+0000 7fcc6fcf7700 1 -- 172.21.15.37:0/276173127 >> 172.21.15.37:0/276173127 conn(0x7fcc680fe090 msgr2=0x7fcc680feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:09:48.373 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:47.795+0000 7fcc6fcf7700 1 -- 172.21.15.37:0/276173127 shutdown_connections 2024-04-25T17:09:48.373 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr 2024-04-25T17:09:47.795+0000 7fcc6fcf7700 1 -- 172.21.15.37:0/276173127 wait complete. 2024-04-25T17:09:48.373 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-04-25T17:09:48.373 INFO:teuthology.orchestra.run.smithi037.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-04-25T17:09:48.373 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:09:48.373 INFO:teuthology.orchestra.run.smithi037.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-04-25T17:09:48.373 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:09:48.373 INFO:teuthology.orchestra.run.smithi037.stdout:Or, if you are only running a single cluster on this host: 2024-04-25T17:09:48.373 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:09:48.373 INFO:teuthology.orchestra.run.smithi037.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-04-25T17:09:48.373 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:09:48.373 INFO:teuthology.orchestra.run.smithi037.stdout:Please consider enabling telemetry to help improve Ceph: 2024-04-25T17:09:48.373 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:09:48.374 INFO:teuthology.orchestra.run.smithi037.stdout: ceph telemetry on 2024-04-25T17:09:48.374 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:09:48.374 INFO:teuthology.orchestra.run.smithi037.stdout:For more information see: 2024-04-25T17:09:48.374 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:09:48.374 INFO:teuthology.orchestra.run.smithi037.stdout: https://docs.ceph.com/docs/master/mgr/telemetry/ 2024-04-25T17:09:48.374 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:09:48.374 INFO:teuthology.orchestra.run.smithi037.stdout:Bootstrap complete. 2024-04-25T17:09:48.402 INFO:tasks.cephadm:Fetching config... 2024-04-25T17:09:48.403 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-25T17:09:48.403 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-04-25T17:09:48.418 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-04-25T17:09:48.419 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-25T17:09:48.419 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-04-25T17:09:48.474 INFO:tasks.cephadm:Fetching mon keyring... 2024-04-25T17:09:48.474 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-25T17:09:48.474 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/keyring of=/dev/stdout 2024-04-25T17:09:48.538 INFO:tasks.cephadm:Fetching pub ssh key... 2024-04-25T17:09:48.539 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-25T17:09:48.539 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-04-25T17:09:48.594 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-04-25T17:09:48.595 DEBUG:teuthology.orchestra.run.smithi037:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCqWAym/EOuZXfuHvw402aT3Wn2g1TwR0L33NU8pQwgBTmHMCmclf9RM2AZmDLSOfC24yigqHc5G+hZq2Lvvq7TBvHGP21YeI+Akzs8yOE9J6duG9aTwAhg0ruNDTXm6nvswZH2RP5kElSryJDVvPh+A+QVLppGm3Ikv4vV5vlQKqabKiwL2K6XS3JKGe9h09HYcpsfKHGU372Yl8dpAgYIOWHSwNp5O3kKsNjU05VGNPMUI/ch5zPUUIF08uGCPsNlinFHwfiMpZb1L/xwZwicgJdTAvsi82WiJUv0IGyhLQudg5/NMN/J7AeD11QURr54sr6Kl9YTL1l4TyKoZ4IQtLoeL0jAu7pTOUCFSmfiWOg2pR8sTOvTYUPpw0Ew1OawRIKoy13N9a5+WeNc6oxzfQXyfXPdLoo3LgFbQUv511+8YvxkTyqP+9YZWj8I6JQTY6usDZfy1IhSbRReRpJT4vllCmyRLM9q6arsGF7nMPSA8I+tjbzYWt1NZxN8vYM= ceph-599bb7fc-0326-11ef-bc93-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-25T17:09:48.670 INFO:teuthology.orchestra.run.smithi037.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCqWAym/EOuZXfuHvw402aT3Wn2g1TwR0L33NU8pQwgBTmHMCmclf9RM2AZmDLSOfC24yigqHc5G+hZq2Lvvq7TBvHGP21YeI+Akzs8yOE9J6duG9aTwAhg0ruNDTXm6nvswZH2RP5kElSryJDVvPh+A+QVLppGm3Ikv4vV5vlQKqabKiwL2K6XS3JKGe9h09HYcpsfKHGU372Yl8dpAgYIOWHSwNp5O3kKsNjU05VGNPMUI/ch5zPUUIF08uGCPsNlinFHwfiMpZb1L/xwZwicgJdTAvsi82WiJUv0IGyhLQudg5/NMN/J7AeD11QURr54sr6Kl9YTL1l4TyKoZ4IQtLoeL0jAu7pTOUCFSmfiWOg2pR8sTOvTYUPpw0Ew1OawRIKoy13N9a5+WeNc6oxzfQXyfXPdLoo3LgFbQUv511+8YvxkTyqP+9YZWj8I6JQTY6usDZfy1IhSbRReRpJT4vllCmyRLM9q6arsGF7nMPSA8I+tjbzYWt1NZxN8vYM= ceph-599bb7fc-0326-11ef-bc93-c7b262605968 2024-04-25T17:09:48.681 DEBUG:teuthology.orchestra.run.smithi069:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCqWAym/EOuZXfuHvw402aT3Wn2g1TwR0L33NU8pQwgBTmHMCmclf9RM2AZmDLSOfC24yigqHc5G+hZq2Lvvq7TBvHGP21YeI+Akzs8yOE9J6duG9aTwAhg0ruNDTXm6nvswZH2RP5kElSryJDVvPh+A+QVLppGm3Ikv4vV5vlQKqabKiwL2K6XS3JKGe9h09HYcpsfKHGU372Yl8dpAgYIOWHSwNp5O3kKsNjU05VGNPMUI/ch5zPUUIF08uGCPsNlinFHwfiMpZb1L/xwZwicgJdTAvsi82WiJUv0IGyhLQudg5/NMN/J7AeD11QURr54sr6Kl9YTL1l4TyKoZ4IQtLoeL0jAu7pTOUCFSmfiWOg2pR8sTOvTYUPpw0Ew1OawRIKoy13N9a5+WeNc6oxzfQXyfXPdLoo3LgFbQUv511+8YvxkTyqP+9YZWj8I6JQTY6usDZfy1IhSbRReRpJT4vllCmyRLM9q6arsGF7nMPSA8I+tjbzYWt1NZxN8vYM= ceph-599bb7fc-0326-11ef-bc93-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-04-25T17:09:48.719 INFO:teuthology.orchestra.run.smithi069.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCqWAym/EOuZXfuHvw402aT3Wn2g1TwR0L33NU8pQwgBTmHMCmclf9RM2AZmDLSOfC24yigqHc5G+hZq2Lvvq7TBvHGP21YeI+Akzs8yOE9J6duG9aTwAhg0ruNDTXm6nvswZH2RP5kElSryJDVvPh+A+QVLppGm3Ikv4vV5vlQKqabKiwL2K6XS3JKGe9h09HYcpsfKHGU372Yl8dpAgYIOWHSwNp5O3kKsNjU05VGNPMUI/ch5zPUUIF08uGCPsNlinFHwfiMpZb1L/xwZwicgJdTAvsi82WiJUv0IGyhLQudg5/NMN/J7AeD11QURr54sr6Kl9YTL1l4TyKoZ4IQtLoeL0jAu7pTOUCFSmfiWOg2pR8sTOvTYUPpw0Ew1OawRIKoy13N9a5+WeNc6oxzfQXyfXPdLoo3LgFbQUv511+8YvxkTyqP+9YZWj8I6JQTY6usDZfy1IhSbRReRpJT4vllCmyRLM9q6arsGF7nMPSA8I+tjbzYWt1NZxN8vYM= ceph-599bb7fc-0326-11ef-bc93-c7b262605968 2024-04-25T17:09:48.731 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-04-25T17:09:48.989 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:09:49.070 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:48 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/276173127' entity='client.admin' 2024-04-25T17:09:51.620 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:51 smithi037 ceph-mon[26472]: from='mgr.14160 172.21.15.37:0/1872577945' entity='mgr.smithi037.txrgxl' 2024-04-25T17:09:51.620 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:51 smithi037 ceph-mon[26472]: from='mgr.14160 172.21.15.37:0/1872577945' entity='mgr.smithi037.txrgxl' 2024-04-25T17:09:51.620 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:51 smithi037 ceph-mon[26472]: from='mgr.14160 172.21.15.37:0/1872577945' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "who": "osd/host:smithi037", "name": "osd_memory_target"}]: dispatch 2024-04-25T17:09:51.620 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:51 smithi037 ceph-mon[26472]: from='mgr.14160 172.21.15.37:0/1872577945' entity='mgr.smithi037.txrgxl' 2024-04-25T17:09:51.620 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:51 smithi037 ceph-mon[26472]: from='mgr.14160 172.21.15.37:0/1872577945' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi037", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-25T17:09:51.620 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:51 smithi037 ceph-mon[26472]: from='mgr.14160 172.21.15.37:0/1872577945' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi037", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-04-25T17:09:51.621 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:51 smithi037 ceph-mon[26472]: from='mgr.14160 172.21.15.37:0/1872577945' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:09:51.621 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:51 smithi037 ceph-mon[26472]: Deploying daemon crash.smithi037 on smithi037 2024-04-25T17:09:51.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:51.876+0000 7fbb9495d700 1 -- 172.21.15.37:0/1039696763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb900fb940 msgr2=0x7fbb900fbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:51.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:51.876+0000 7fbb9495d700 1 --2- 172.21.15.37:0/1039696763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb900fb940 0x7fbb900fbd50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbb800048c0 tx=0x7fbb80009e30 comp rx=0 tx=0).stop 2024-04-25T17:09:51.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:51.876+0000 7fbb9495d700 1 -- 172.21.15.37:0/1039696763 shutdown_connections 2024-04-25T17:09:51.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:51.876+0000 7fbb9495d700 1 --2- 172.21.15.37:0/1039696763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb900fb940 0x7fbb900fbd50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:51.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:51.876+0000 7fbb9495d700 1 -- 172.21.15.37:0/1039696763 >> 172.21.15.37:0/1039696763 conn(0x7fbb900f70a0 msgr2=0x7fbb900f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:09:51.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:51.876+0000 7fbb9495d700 1 -- 172.21.15.37:0/1039696763 shutdown_connections 2024-04-25T17:09:51.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:51.876+0000 7fbb9495d700 1 -- 172.21.15.37:0/1039696763 wait complete. 2024-04-25T17:09:51.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:51.876+0000 7fbb9495d700 1 Processor -- start 2024-04-25T17:09:51.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:51.876+0000 7fbb9495d700 1 -- start start 2024-04-25T17:09:51.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:51.877+0000 7fbb9495d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb900fb940 0x7fbb9010f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:51.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:51.877+0000 7fbb9495d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9010f7d0 con 0x7fbb900fb940 2024-04-25T17:09:51.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:51.877+0000 7fbb8e59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb900fb940 0x7fbb9010f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:51.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:51.877+0000 7fbb8e59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb900fb940 0x7fbb9010f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44018/0 (socket says 172.21.15.37:44018) 2024-04-25T17:09:51.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:51.877+0000 7fbb8e59c700 1 -- 172.21.15.37:0/1795602959 learned_addr learned my addr 172.21.15.37:0/1795602959 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:09:51.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:51.877+0000 7fbb8e59c700 1 -- 172.21.15.37:0/1795602959 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb80005040 con 0x7fbb900fb940 2024-04-25T17:09:51.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:51.877+0000 7fbb8e59c700 1 --2- 172.21.15.37:0/1795602959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb900fb940 0x7fbb9010f290 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbb80009680 tx=0x7fbb80009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:51.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:51.877+0000 7fbb7effd700 1 -- 172.21.15.37:0/1795602959 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbb8000b5c0 con 0x7fbb900fb940 2024-04-25T17:09:51.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:51.877+0000 7fbb7effd700 1 -- 172.21.15.37:0/1795602959 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbb8000be70 con 0x7fbb900fb940 2024-04-25T17:09:51.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:51.877+0000 7fbb9495d700 1 -- 172.21.15.37:0/1795602959 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb9010f9d0 con 0x7fbb900fb940 2024-04-25T17:09:51.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:51.877+0000 7fbb7effd700 1 -- 172.21.15.37:0/1795602959 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbb800135a0 con 0x7fbb900fb940 2024-04-25T17:09:51.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:51.877+0000 7fbb9495d700 1 -- 172.21.15.37:0/1795602959 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb90110540 con 0x7fbb900fb940 2024-04-25T17:09:51.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:51.878+0000 7fbb7effd700 1 -- 172.21.15.37:0/1795602959 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7fbb80013810 con 0x7fbb900fb940 2024-04-25T17:09:51.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:51.878+0000 7fbb9495d700 1 -- 172.21.15.37:0/1795602959 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb90101e50 con 0x7fbb900fb940 2024-04-25T17:09:51.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:51.879+0000 7fbb7effd700 1 --2- 172.21.15.37:0/1795602959 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7fbb780368d0 0x7fbb78038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:51.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:51.879+0000 7fbb7effd700 1 -- 172.21.15.37:0/1795602959 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fbb80049410 con 0x7fbb900fb940 2024-04-25T17:09:51.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:51.879+0000 7fbb8dd9b700 1 --2- 172.21.15.37:0/1795602959 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7fbb780368d0 0x7fbb78038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:51.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:51.879+0000 7fbb8dd9b700 1 --2- 172.21.15.37:0/1795602959 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7fbb780368d0 0x7fbb78038d80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbb84009990 tx=0x7fbb84006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:51.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:51.883+0000 7fbb7effd700 1 -- 172.21.15.37:0/1795602959 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fbb8001c610 con 0x7fbb900fb940 2024-04-25T17:09:52.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:52.080+0000 7fbb9495d700 1 -- 172.21.15.37:0/1795602959 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7fbb90110840 con 0x7fbb900fb940 2024-04-25T17:09:52.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:52.083+0000 7fbb7effd700 1 -- 172.21.15.37:0/1795602959 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7fbb80011370 con 0x7fbb900fb940 2024-04-25T17:09:52.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:52.085+0000 7fbb9495d700 1 -- 172.21.15.37:0/1795602959 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7fbb780368d0 msgr2=0x7fbb78038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:52.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:52.085+0000 7fbb9495d700 1 --2- 172.21.15.37:0/1795602959 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7fbb780368d0 0x7fbb78038d80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbb84009990 tx=0x7fbb84006e40 comp rx=0 tx=0).stop 2024-04-25T17:09:52.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:52.085+0000 7fbb9495d700 1 -- 172.21.15.37:0/1795602959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb900fb940 msgr2=0x7fbb9010f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:52.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:52.085+0000 7fbb9495d700 1 --2- 172.21.15.37:0/1795602959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb900fb940 0x7fbb9010f290 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbb80009680 tx=0x7fbb80009e30 comp rx=0 tx=0).stop 2024-04-25T17:09:52.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:52.086+0000 7fbb9495d700 1 -- 172.21.15.37:0/1795602959 shutdown_connections 2024-04-25T17:09:52.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:52.086+0000 7fbb9495d700 1 --2- 172.21.15.37:0/1795602959 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7fbb780368d0 0x7fbb78038d80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:52.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:52.086+0000 7fbb9495d700 1 --2- 172.21.15.37:0/1795602959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb900fb940 0x7fbb9010f290 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:52.085 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:52.086+0000 7fbb9495d700 1 -- 172.21.15.37:0/1795602959 >> 172.21.15.37:0/1795602959 conn(0x7fbb900f70a0 msgr2=0x7fbb900f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:09:52.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:52.086+0000 7fbb9495d700 1 -- 172.21.15.37:0/1795602959 shutdown_connections 2024-04-25T17:09:52.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:52.086+0000 7fbb9495d700 1 -- 172.21.15.37:0/1795602959 wait complete. 2024-04-25T17:09:52.758 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-04-25T17:09:52.758 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-04-25T17:09:53.172 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:53 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/1795602959' entity='client.admin' 2024-04-25T17:09:53.260 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:09:55.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:55.779+0000 7f4a111b0700 1 -- 172.21.15.37:0/2627239372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a0c0fe080 msgr2=0x7f4a0c0fe490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:55.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:55.779+0000 7f4a111b0700 1 --2- 172.21.15.37:0/2627239372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a0c0fe080 0x7f4a0c0fe490 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f49fc0048c0 tx=0x7f49fc009e30 comp rx=0 tx=0).stop 2024-04-25T17:09:55.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:55.779+0000 7f4a111b0700 1 -- 172.21.15.37:0/2627239372 shutdown_connections 2024-04-25T17:09:55.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:55.779+0000 7f4a111b0700 1 --2- 172.21.15.37:0/2627239372 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a0c0fe080 0x7f4a0c0fe490 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:55.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:55.779+0000 7f4a111b0700 1 -- 172.21.15.37:0/2627239372 >> 172.21.15.37:0/2627239372 conn(0x7f4a0c0f6820 msgr2=0x7f4a0c0f8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:09:55.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:55.779+0000 7f4a111b0700 1 -- 172.21.15.37:0/2627239372 shutdown_connections 2024-04-25T17:09:55.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:55.779+0000 7f4a111b0700 1 -- 172.21.15.37:0/2627239372 wait complete. 2024-04-25T17:09:55.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:55.780+0000 7f4a111b0700 1 Processor -- start 2024-04-25T17:09:55.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:55.780+0000 7f4a111b0700 1 -- start start 2024-04-25T17:09:55.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:55.780+0000 7f4a111b0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a0c0fe080 0x7f4a0c0fd790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:55.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:55.780+0000 7f4a111b0700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0c0fdcd0 con 0x7f4a0c0fe080 2024-04-25T17:09:55.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:55.780+0000 7f4a0ad9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a0c0fe080 0x7f4a0c0fd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:55.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:55.780+0000 7f4a0ad9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a0c0fe080 0x7f4a0c0fd790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44036/0 (socket says 172.21.15.37:44036) 2024-04-25T17:09:55.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:55.780+0000 7f4a0ad9d700 1 -- 172.21.15.37:0/1781245188 learned_addr learned my addr 172.21.15.37:0/1781245188 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:09:55.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:55.781+0000 7f4a0ad9d700 1 -- 172.21.15.37:0/1781245188 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49fc005040 con 0x7f4a0c0fe080 2024-04-25T17:09:55.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:55.781+0000 7f4a0ad9d700 1 --2- 172.21.15.37:0/1781245188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a0c0fe080 0x7f4a0c0fd790 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f49fc0096b0 tx=0x7f49fc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:55.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:55.781+0000 7f49f37fe700 1 -- 172.21.15.37:0/1781245188 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f49fc00bed0 con 0x7f4a0c0fe080 2024-04-25T17:09:55.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:55.781+0000 7f49f37fe700 1 -- 172.21.15.37:0/1781245188 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f49fc00b5c0 con 0x7f4a0c0fe080 2024-04-25T17:09:55.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:55.781+0000 7f4a111b0700 1 -- 172.21.15.37:0/1781245188 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a0c0fbda0 con 0x7f4a0c0fe080 2024-04-25T17:09:55.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:55.781+0000 7f49f37fe700 1 -- 172.21.15.37:0/1781245188 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f49fc01c5b0 con 0x7f4a0c0fe080 2024-04-25T17:09:55.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:55.781+0000 7f4a111b0700 1 -- 172.21.15.37:0/1781245188 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a0c0fc290 con 0x7f4a0c0fe080 2024-04-25T17:09:55.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:55.782+0000 7f49f37fe700 1 -- 172.21.15.37:0/1781245188 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f49fc01c710 con 0x7f4a0c0fe080 2024-04-25T17:09:55.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:55.782+0000 7f49f37fe700 1 --2- 172.21.15.37:0/1781245188 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f49f40368d0 0x7f49f4038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:55.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:55.782+0000 7f49f37fe700 1 -- 172.21.15.37:0/1781245188 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f49fc049c60 con 0x7f4a0c0fe080 2024-04-25T17:09:55.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:55.782+0000 7f4a111b0700 1 -- 172.21.15.37:0/1781245188 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a0c05f5c0 con 0x7f4a0c0fe080 2024-04-25T17:09:55.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:55.782+0000 7f4a0a59c700 1 --2- 172.21.15.37:0/1781245188 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f49f40368d0 0x7f49f4038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:55.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:55.783+0000 7f4a0a59c700 1 --2- 172.21.15.37:0/1781245188 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f49f40368d0 0x7f49f4038d80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4a00009990 tx=0x7f4a00006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:55.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:55.787+0000 7f49f37fe700 1 -- 172.21.15.37:0/1781245188 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f49fc025400 con 0x7f4a0c0fe080 2024-04-25T17:09:56.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:56.001+0000 7f4a111b0700 1 -- 172.21.15.37:0/1781245188 --> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f4a0c0fc4d0 con 0x7f49f40368d0 2024-04-25T17:09:56.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:56.004+0000 7f49f37fe700 1 -- 172.21.15.37:0/1781245188 <== mgr.14160 v2:172.21.15.37:6800/1299348474 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f4a0c0fc4d0 con 0x7f49f40368d0 2024-04-25T17:09:56.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:56.006+0000 7f4a111b0700 1 -- 172.21.15.37:0/1781245188 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f49f40368d0 msgr2=0x7f49f4038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:56.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:56.006+0000 7f4a111b0700 1 --2- 172.21.15.37:0/1781245188 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f49f40368d0 0x7f49f4038d80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4a00009990 tx=0x7f4a00006e40 comp rx=0 tx=0).stop 2024-04-25T17:09:56.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:56.006+0000 7f4a111b0700 1 -- 172.21.15.37:0/1781245188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a0c0fe080 msgr2=0x7f4a0c0fd790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:56.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:56.006+0000 7f4a111b0700 1 --2- 172.21.15.37:0/1781245188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a0c0fe080 0x7f4a0c0fd790 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f49fc0096b0 tx=0x7f49fc009e30 comp rx=0 tx=0).stop 2024-04-25T17:09:56.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:56.006+0000 7f4a111b0700 1 -- 172.21.15.37:0/1781245188 shutdown_connections 2024-04-25T17:09:56.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:56.006+0000 7f4a111b0700 1 --2- 172.21.15.37:0/1781245188 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f49f40368d0 0x7f49f4038d80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:56.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:56.006+0000 7f4a111b0700 1 --2- 172.21.15.37:0/1781245188 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a0c0fe080 0x7f4a0c0fd790 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:56.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:56.007+0000 7f4a111b0700 1 -- 172.21.15.37:0/1781245188 >> 172.21.15.37:0/1781245188 conn(0x7f4a0c0f6820 msgr2=0x7f4a0c103b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:09:56.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:56.007+0000 7f4a111b0700 1 -- 172.21.15.37:0/1781245188 shutdown_connections 2024-04-25T17:09:56.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:56.007+0000 7f4a111b0700 1 -- 172.21.15.37:0/1781245188 wait complete. 2024-04-25T17:09:56.655 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi069 2024-04-25T17:09:56.655 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-04-25T17:09:56.655 DEBUG:teuthology.orchestra.run.smithi069:> dd of=/etc/ceph/ceph.conf 2024-04-25T17:09:56.674 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-04-25T17:09:56.674 DEBUG:teuthology.orchestra.run.smithi069:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-25T17:09:56.731 INFO:tasks.cephadm:Adding host smithi069 to orchestrator... 2024-04-25T17:09:56.731 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph orch host add smithi069 2024-04-25T17:09:57.006 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:09:57.154 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:57 smithi037 ceph-mon[26472]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:09:57.154 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:57 smithi037 ceph-mon[26472]: from='mgr.14160 172.21.15.37:0/1872577945' entity='mgr.smithi037.txrgxl' 2024-04-25T17:09:57.154 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:57 smithi037 ceph-mon[26472]: from='mgr.14160 172.21.15.37:0/1872577945' entity='mgr.smithi037.txrgxl' 2024-04-25T17:09:57.154 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:57 smithi037 ceph-mon[26472]: from='mgr.14160 172.21.15.37:0/1872577945' entity='mgr.smithi037.txrgxl' 2024-04-25T17:09:58.321 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:58 smithi037 ceph-mon[26472]: from='mgr.14160 172.21.15.37:0/1872577945' entity='mgr.smithi037.txrgxl' 2024-04-25T17:09:58.321 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:58 smithi037 ceph-mon[26472]: from='mgr.14160 172.21.15.37:0/1872577945' entity='mgr.smithi037.txrgxl' 2024-04-25T17:09:58.321 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:09:58 smithi037 ceph-mon[26472]: Deploying daemon node-exporter.smithi037 on smithi037 2024-04-25T17:09:58.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:58.643+0000 7f15f2978700 1 -- 172.21.15.37:0/1828643550 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15ec0fe090 msgr2=0x7f15ec0fe4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:09:58.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:58.643+0000 7f15f2978700 1 --2- 172.21.15.37:0/1828643550 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15ec0fe090 0x7f15ec0fe4a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f15dc0048c0 tx=0x7f15dc009e30 comp rx=0 tx=0).stop 2024-04-25T17:09:58.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:58.643+0000 7f15f2978700 1 -- 172.21.15.37:0/1828643550 shutdown_connections 2024-04-25T17:09:58.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:58.643+0000 7f15f2978700 1 --2- 172.21.15.37:0/1828643550 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15ec0fe090 0x7f15ec0fe4a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:09:58.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:58.643+0000 7f15f2978700 1 -- 172.21.15.37:0/1828643550 >> 172.21.15.37:0/1828643550 conn(0x7f15ec0f6850 msgr2=0x7f15ec0f8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:09:58.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:58.643+0000 7f15f2978700 1 -- 172.21.15.37:0/1828643550 shutdown_connections 2024-04-25T17:09:58.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:58.643+0000 7f15f2978700 1 -- 172.21.15.37:0/1828643550 wait complete. 2024-04-25T17:09:58.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:58.643+0000 7f15f2978700 1 Processor -- start 2024-04-25T17:09:58.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:58.644+0000 7f15f2978700 1 -- start start 2024-04-25T17:09:58.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:58.644+0000 7f15f2978700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15ec0fe090 0x7f15ec10d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:58.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:58.644+0000 7f15f2978700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ec10d5f0 con 0x7f15ec0fe090 2024-04-25T17:09:58.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:58.644+0000 7f15ebfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15ec0fe090 0x7f15ec10d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:58.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:58.644+0000 7f15ebfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15ec0fe090 0x7f15ec10d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46192/0 (socket says 172.21.15.37:46192) 2024-04-25T17:09:58.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:58.644+0000 7f15ebfff700 1 -- 172.21.15.37:0/2575143954 learned_addr learned my addr 172.21.15.37:0/2575143954 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:09:58.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:58.644+0000 7f15ebfff700 1 -- 172.21.15.37:0/2575143954 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15dc005040 con 0x7f15ec0fe090 2024-04-25T17:09:58.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:58.644+0000 7f15ebfff700 1 --2- 172.21.15.37:0/2575143954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15ec0fe090 0x7f15ec10d0b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f15dc0096b0 tx=0x7f15dc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:58.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:58.644+0000 7f15e8ff9700 1 -- 172.21.15.37:0/2575143954 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f15dc00bed0 con 0x7f15ec0fe090 2024-04-25T17:09:58.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:58.644+0000 7f15f2978700 1 -- 172.21.15.37:0/2575143954 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15ec10d7f0 con 0x7f15ec0fe090 2024-04-25T17:09:58.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:58.644+0000 7f15e8ff9700 1 -- 172.21.15.37:0/2575143954 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f15dc00b5c0 con 0x7f15ec0fe090 2024-04-25T17:09:58.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:58.645+0000 7f15e8ff9700 1 -- 172.21.15.37:0/2575143954 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f15dc01c5b0 con 0x7f15ec0fe090 2024-04-25T17:09:58.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:58.645+0000 7f15f2978700 1 -- 172.21.15.37:0/2575143954 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15ec10e360 con 0x7f15ec0fe090 2024-04-25T17:09:58.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:58.646+0000 7f15d27fc700 1 -- 172.21.15.37:0/2575143954 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15cc0052b0 con 0x7f15ec0fe090 2024-04-25T17:09:58.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:58.646+0000 7f15e8ff9700 1 -- 172.21.15.37:0/2575143954 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f15dc004d30 con 0x7f15ec0fe090 2024-04-25T17:09:58.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:58.646+0000 7f15e8ff9700 1 --2- 172.21.15.37:0/2575143954 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f15d4036880 0x7f15d4038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:09:58.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:58.646+0000 7f15e8ff9700 1 -- 172.21.15.37:0/2575143954 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f15dc04a200 con 0x7f15ec0fe090 2024-04-25T17:09:58.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:58.647+0000 7f15eb7fe700 1 --2- 172.21.15.37:0/2575143954 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f15d4036880 0x7f15d4038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:09:58.647 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:58.647+0000 7f15eb7fe700 1 --2- 172.21.15.37:0/2575143954 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f15d4036880 0x7f15d4038d30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f15e0009990 tx=0x7f15e0006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:09:58.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:58.651+0000 7f15e8ff9700 1 -- 172.21.15.37:0/2575143954 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f15dc011960 con 0x7f15ec0fe090 2024-04-25T17:09:58.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:09:58.892+0000 7f15d27fc700 1 -- 172.21.15.37:0/2575143954 --> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi069", "target": ["mon-mgr", ""]}) v1 -- 0x7f15cc000bc0 con 0x7f15d4036880 2024-04-25T17:10:00.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:00 smithi037 ceph-mon[26472]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi069", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:10:00.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:00 smithi037 ceph-mon[26472]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:10:00.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:00 smithi037 ceph-mon[26472]: from='mgr.14160 172.21.15.37:0/1872577945' entity='mgr.smithi037.txrgxl' 2024-04-25T17:10:01.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:01.184+0000 7f15e8ff9700 1 -- 172.21.15.37:0/2575143954 <== mgr.14160 v2:172.21.15.37:6800/1299348474 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f15cc000bc0 con 0x7f15d4036880 2024-04-25T17:10:01.184 INFO:teuthology.orchestra.run.smithi037.stdout:Added host 'smithi069' with addr '172.21.15.69' 2024-04-25T17:10:01.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:01.186+0000 7f15d27fc700 1 -- 172.21.15.37:0/2575143954 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f15d4036880 msgr2=0x7f15d4038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:10:01.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:01.186+0000 7f15d27fc700 1 --2- 172.21.15.37:0/2575143954 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f15d4036880 0x7f15d4038d30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f15e0009990 tx=0x7f15e0006e40 comp rx=0 tx=0).stop 2024-04-25T17:10:01.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:01.186+0000 7f15d27fc700 1 -- 172.21.15.37:0/2575143954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15ec0fe090 msgr2=0x7f15ec10d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:10:01.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:01.186+0000 7f15d27fc700 1 --2- 172.21.15.37:0/2575143954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15ec0fe090 0x7f15ec10d0b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f15dc0096b0 tx=0x7f15dc009e30 comp rx=0 tx=0).stop 2024-04-25T17:10:01.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:01.186+0000 7f15d27fc700 1 -- 172.21.15.37:0/2575143954 shutdown_connections 2024-04-25T17:10:01.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:01.186+0000 7f15d27fc700 1 --2- 172.21.15.37:0/2575143954 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f15d4036880 0x7f15d4038d30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:10:01.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:01.186+0000 7f15d27fc700 1 --2- 172.21.15.37:0/2575143954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f15ec0fe090 0x7f15ec10d0b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:10:01.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:01.186+0000 7f15d27fc700 1 -- 172.21.15.37:0/2575143954 >> 172.21.15.37:0/2575143954 conn(0x7f15ec0f6850 msgr2=0x7f15ec103b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:10:01.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:01.186+0000 7f15d27fc700 1 -- 172.21.15.37:0/2575143954 shutdown_connections 2024-04-25T17:10:01.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:01.186+0000 7f15d27fc700 1 -- 172.21.15.37:0/2575143954 wait complete. 2024-04-25T17:10:01.820 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:01 smithi037 ceph-mon[26472]: Deploying cephadm binary to smithi069 2024-04-25T17:10:01.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:01 smithi037 ceph-mon[26472]: from='mgr.14160 172.21.15.37:0/1872577945' entity='mgr.smithi037.txrgxl' 2024-04-25T17:10:01.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:01 smithi037 ceph-mon[26472]: from='mgr.14160 172.21.15.37:0/1872577945' entity='mgr.smithi037.txrgxl' 2024-04-25T17:10:01.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:01 smithi037 ceph-mon[26472]: from='mgr.14160 172.21.15.37:0/1872577945' entity='mgr.smithi037.txrgxl' 2024-04-25T17:10:01.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:01 smithi037 ceph-mon[26472]: from='mgr.14160 172.21.15.37:0/1872577945' entity='mgr.smithi037.txrgxl' 2024-04-25T17:10:01.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:01 smithi037 ceph-mon[26472]: from='mgr.14160 172.21.15.37:0/1872577945' entity='mgr.smithi037.txrgxl' 2024-04-25T17:10:01.930 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph orch host ls --format=json 2024-04-25T17:10:02.211 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:10:02.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:02 smithi037 ceph-mon[26472]: Added host smithi069 2024-04-25T17:10:02.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:02 smithi037 ceph-mon[26472]: Deploying daemon alertmanager.smithi037 on smithi037 2024-04-25T17:10:02.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:02 smithi037 ceph-mon[26472]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:10:04.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:04.079+0000 7f5ca58eb700 1 -- 172.21.15.37:0/2270908028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ca0065d30 msgr2=0x7f5ca00ff630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:10:04.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:04.079+0000 7f5ca58eb700 1 --2- 172.21.15.37:0/2270908028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ca0065d30 0x7f5ca00ff630 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5c900048c0 tx=0x7f5c90009e30 comp rx=0 tx=0).stop 2024-04-25T17:10:04.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:04.079+0000 7f5ca58eb700 1 -- 172.21.15.37:0/2270908028 shutdown_connections 2024-04-25T17:10:04.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:04.079+0000 7f5ca58eb700 1 --2- 172.21.15.37:0/2270908028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ca0065d30 0x7f5ca00ff630 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:10:04.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:04.079+0000 7f5ca58eb700 1 -- 172.21.15.37:0/2270908028 >> 172.21.15.37:0/2270908028 conn(0x7f5ca00f70a0 msgr2=0x7f5ca00f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:10:04.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:04.079+0000 7f5ca58eb700 1 -- 172.21.15.37:0/2270908028 shutdown_connections 2024-04-25T17:10:04.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:04.079+0000 7f5ca58eb700 1 -- 172.21.15.37:0/2270908028 wait complete. 2024-04-25T17:10:04.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:04.080+0000 7f5ca58eb700 1 Processor -- start 2024-04-25T17:10:04.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:04.080+0000 7f5ca58eb700 1 -- start start 2024-04-25T17:10:04.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:04.080+0000 7f5ca58eb700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ca0065d30 0x7f5ca010d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:10:04.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:04.080+0000 7f5ca58eb700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca010d5a0 con 0x7f5ca0065d30 2024-04-25T17:10:04.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:04.080+0000 7f5c9effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ca0065d30 0x7f5ca010d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:10:04.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:04.080+0000 7f5c9effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ca0065d30 0x7f5ca010d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46204/0 (socket says 172.21.15.37:46204) 2024-04-25T17:10:04.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:04.080+0000 7f5c9effd700 1 -- 172.21.15.37:0/3947392151 learned_addr learned my addr 172.21.15.37:0/3947392151 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:10:04.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:04.080+0000 7f5c9effd700 1 -- 172.21.15.37:0/3947392151 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c90005040 con 0x7f5ca0065d30 2024-04-25T17:10:04.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:04.080+0000 7f5c9effd700 1 --2- 172.21.15.37:0/3947392151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ca0065d30 0x7f5ca010d060 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5c9000b900 tx=0x7f5c90009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:10:04.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:04.081+0000 7f5c877fe700 1 -- 172.21.15.37:0/3947392151 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5c9000b5c0 con 0x7f5ca0065d30 2024-04-25T17:10:04.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:04.081+0000 7f5c877fe700 1 -- 172.21.15.37:0/3947392151 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5c9000be70 con 0x7f5ca0065d30 2024-04-25T17:10:04.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:04.081+0000 7f5ca58eb700 1 -- 172.21.15.37:0/3947392151 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ca010d7a0 con 0x7f5ca0065d30 2024-04-25T17:10:04.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:04.081+0000 7f5c877fe700 1 -- 172.21.15.37:0/3947392151 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5c9001c590 con 0x7f5ca0065d30 2024-04-25T17:10:04.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:04.081+0000 7f5ca58eb700 1 -- 172.21.15.37:0/3947392151 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ca010e310 con 0x7f5ca0065d30 2024-04-25T17:10:04.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:04.081+0000 7f5c877fe700 1 -- 172.21.15.37:0/3947392151 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f5c9001c850 con 0x7f5ca0065d30 2024-04-25T17:10:04.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:04.082+0000 7f5c877fe700 1 --2- 172.21.15.37:0/3947392151 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f5c88036880 0x7f5c88038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:10:04.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:04.082+0000 7f5c877fe700 1 -- 172.21.15.37:0/3947392151 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f5c900493d0 con 0x7f5ca0065d30 2024-04-25T17:10:04.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:04.082+0000 7f5c9e7fc700 1 --2- 172.21.15.37:0/3947392151 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f5c88036880 0x7f5c88038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:10:04.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:04.082+0000 7f5ca58eb700 1 -- 172.21.15.37:0/3947392151 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ca0102f40 con 0x7f5ca0065d30 2024-04-25T17:10:04.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:04.082+0000 7f5c9e7fc700 1 --2- 172.21.15.37:0/3947392151 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f5c88036880 0x7f5c88038d30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5c94009990 tx=0x7f5c94006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:10:04.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:04.087+0000 7f5c877fe700 1 -- 172.21.15.37:0/3947392151 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f5c90021070 con 0x7f5ca0065d30 2024-04-25T17:10:04.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:04.316+0000 7f5ca58eb700 1 -- 172.21.15.37:0/3947392151 --> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5ca0102920 con 0x7f5c88036880 2024-04-25T17:10:04.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:04.317+0000 7f5c877fe700 1 -- 172.21.15.37:0/3947392151 <== mgr.14160 v2:172.21.15.37:6800/1299348474 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+159 (secure 0 0 0) 0x7f5c94009590 con 0x7f5c88036880 2024-04-25T17:10:04.317 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:10:04.317 INFO:teuthology.orchestra.run.smithi037.stdout:[{"addr": "172.21.15.37", "hostname": "smithi037", "labels": [], "status": ""}, {"addr": "172.21.15.69", "hostname": "smithi069", "labels": [], "status": ""}] 2024-04-25T17:10:04.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:04.319+0000 7f5ca58eb700 1 -- 172.21.15.37:0/3947392151 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f5c88036880 msgr2=0x7f5c88038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:10:04.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:04.319+0000 7f5ca58eb700 1 --2- 172.21.15.37:0/3947392151 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f5c88036880 0x7f5c88038d30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5c94009990 tx=0x7f5c94006e40 comp rx=0 tx=0).stop 2024-04-25T17:10:04.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:04.319+0000 7f5ca58eb700 1 -- 172.21.15.37:0/3947392151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ca0065d30 msgr2=0x7f5ca010d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:10:04.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:04.319+0000 7f5ca58eb700 1 --2- 172.21.15.37:0/3947392151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ca0065d30 0x7f5ca010d060 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5c9000b900 tx=0x7f5c90009e30 comp rx=0 tx=0).stop 2024-04-25T17:10:04.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:04.319+0000 7f5ca58eb700 1 -- 172.21.15.37:0/3947392151 shutdown_connections 2024-04-25T17:10:04.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:04.320+0000 7f5ca58eb700 1 --2- 172.21.15.37:0/3947392151 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f5c88036880 0x7f5c88038d30 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:10:04.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:04.320+0000 7f5ca58eb700 1 --2- 172.21.15.37:0/3947392151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5ca0065d30 0x7f5ca010d060 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:10:04.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:04.320+0000 7f5ca58eb700 1 -- 172.21.15.37:0/3947392151 >> 172.21.15.37:0/3947392151 conn(0x7f5ca00f70a0 msgr2=0x7f5ca0103b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:10:04.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:04.320+0000 7f5ca58eb700 1 -- 172.21.15.37:0/3947392151 shutdown_connections 2024-04-25T17:10:04.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:04.320+0000 7f5ca58eb700 1 -- 172.21.15.37:0/3947392151 wait complete. 2024-04-25T17:10:04.570 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:04 smithi037 ceph-mon[26472]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:10:05.741 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:05 smithi037 ceph-mon[26472]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T17:10:05.741 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:05 smithi037 ceph-mon[26472]: from='mgr.14160 172.21.15.37:0/1872577945' entity='mgr.smithi037.txrgxl' 2024-04-25T17:10:06.059 INFO:tasks.cephadm:Setting crush tunables to default 2024-04-25T17:10:06.059 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph osd crush tunables default 2024-04-25T17:10:06.348 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:10:06.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:06 smithi037 ceph-mon[26472]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:10:08.820 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:08 smithi037 ceph-mon[26472]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:10:10.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:10.356+0000 7f875a34a700 1 -- 172.21.15.37:0/4095070504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87540fb930 msgr2=0x7f87540fbd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:10:10.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:10.356+0000 7f875a34a700 1 --2- 172.21.15.37:0/4095070504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87540fb930 0x7f87540fbd40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f87440048c0 tx=0x7f8744009e30 comp rx=0 tx=0).stop 2024-04-25T17:10:10.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:10.356+0000 7f875a34a700 1 -- 172.21.15.37:0/4095070504 shutdown_connections 2024-04-25T17:10:10.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:10.356+0000 7f875a34a700 1 --2- 172.21.15.37:0/4095070504 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87540fb930 0x7f87540fbd40 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:10:10.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:10.356+0000 7f875a34a700 1 -- 172.21.15.37:0/4095070504 >> 172.21.15.37:0/4095070504 conn(0x7f87540f7070 msgr2=0x7f87540f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:10:10.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:10.356+0000 7f875a34a700 1 -- 172.21.15.37:0/4095070504 shutdown_connections 2024-04-25T17:10:10.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:10.356+0000 7f875a34a700 1 -- 172.21.15.37:0/4095070504 wait complete. 2024-04-25T17:10:10.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:10.357+0000 7f875a34a700 1 Processor -- start 2024-04-25T17:10:10.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:10.357+0000 7f875a34a700 1 -- start start 2024-04-25T17:10:10.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:10.357+0000 7f875a34a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87540fb930 0x7f87540f9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:10:10.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:10.357+0000 7f875a34a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87540f9560 con 0x7f87540fb930 2024-04-25T17:10:10.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:10.357+0000 7f8753fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87540fb930 0x7f87540f9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:10:10.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:10.357+0000 7f8753fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87540fb930 0x7f87540f9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55654/0 (socket says 172.21.15.37:55654) 2024-04-25T17:10:10.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:10.357+0000 7f8753fff700 1 -- 172.21.15.37:0/3310248404 learned_addr learned my addr 172.21.15.37:0/3310248404 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:10:10.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:10.358+0000 7f8753fff700 1 -- 172.21.15.37:0/3310248404 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8744005040 con 0x7f87540fb930 2024-04-25T17:10:10.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:10.358+0000 7f8753fff700 1 --2- 172.21.15.37:0/3310248404 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87540fb930 0x7f87540f9020 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f87440096b0 tx=0x7f8744009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:10:10.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:10.358+0000 7f8750ff9700 1 -- 172.21.15.37:0/3310248404 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f874400bed0 con 0x7f87540fb930 2024-04-25T17:10:10.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:10.358+0000 7f8750ff9700 1 -- 172.21.15.37:0/3310248404 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f874400b5c0 con 0x7f87540fb930 2024-04-25T17:10:10.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:10.358+0000 7f875a34a700 1 -- 172.21.15.37:0/3310248404 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87540f7630 con 0x7f87540fb930 2024-04-25T17:10:10.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:10.358+0000 7f8750ff9700 1 -- 172.21.15.37:0/3310248404 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f874401c5b0 con 0x7f87540fb930 2024-04-25T17:10:10.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:10.358+0000 7f875a34a700 1 -- 172.21.15.37:0/3310248404 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87540f7b20 con 0x7f87540fb930 2024-04-25T17:10:10.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:10.359+0000 7f8750ff9700 1 -- 172.21.15.37:0/3310248404 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f874401c710 con 0x7f87540fb930 2024-04-25T17:10:10.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:10.359+0000 7f875a34a700 1 -- 172.21.15.37:0/3310248404 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f875405f5c0 con 0x7f87540fb930 2024-04-25T17:10:10.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:10.359+0000 7f8750ff9700 1 --2- 172.21.15.37:0/3310248404 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f873c0368d0 0x7f873c038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:10:10.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:10.359+0000 7f8750ff9700 1 -- 172.21.15.37:0/3310248404 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f8744049a90 con 0x7f87540fb930 2024-04-25T17:10:10.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:10.359+0000 7f87537fe700 1 --2- 172.21.15.37:0/3310248404 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f873c0368d0 0x7f873c038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:10:10.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:10.360+0000 7f87537fe700 1 --2- 172.21.15.37:0/3310248404 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f873c0368d0 0x7f873c038d80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8748009990 tx=0x7f8748006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:10:10.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:10.364+0000 7f8750ff9700 1 -- 172.21.15.37:0/3310248404 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f8744025400 con 0x7f87540fb930 2024-04-25T17:10:10.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:10.566+0000 7f875a34a700 1 -- 172.21.15.37:0/3310248404 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f875404bed0 con 0x7f87540fb930 2024-04-25T17:10:10.820 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:10 smithi037 ceph-mon[26472]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:10:11.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:11.541+0000 7f8750ff9700 1 -- 172.21.15.37:0/3310248404 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f8744004d30 con 0x7f87540fb930 2024-04-25T17:10:11.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:11.544+0000 7f875a34a700 1 -- 172.21.15.37:0/3310248404 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f873c0368d0 msgr2=0x7f873c038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:10:11.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:11.544+0000 7f875a34a700 1 --2- 172.21.15.37:0/3310248404 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f873c0368d0 0x7f873c038d80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8748009990 tx=0x7f8748006e40 comp rx=0 tx=0).stop 2024-04-25T17:10:11.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:11.544+0000 7f875a34a700 1 -- 172.21.15.37:0/3310248404 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87540fb930 msgr2=0x7f87540f9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:10:11.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:11.544+0000 7f875a34a700 1 --2- 172.21.15.37:0/3310248404 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87540fb930 0x7f87540f9020 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f87440096b0 tx=0x7f8744009e30 comp rx=0 tx=0).stop 2024-04-25T17:10:11.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:11.544+0000 7f875a34a700 1 -- 172.21.15.37:0/3310248404 shutdown_connections 2024-04-25T17:10:11.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:11.544+0000 7f875a34a700 1 --2- 172.21.15.37:0/3310248404 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f873c0368d0 0x7f873c038d80 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:10:11.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:11.544+0000 7f875a34a700 1 --2- 172.21.15.37:0/3310248404 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87540fb930 0x7f87540f9020 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:10:11.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:11.544+0000 7f875a34a700 1 -- 172.21.15.37:0/3310248404 >> 172.21.15.37:0/3310248404 conn(0x7f87540f7070 msgr2=0x7f8754065cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:10:11.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:11.544+0000 7f875a34a700 1 -- 172.21.15.37:0/3310248404 shutdown_connections 2024-04-25T17:10:11.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:10:11.544+0000 7f875a34a700 1 -- 172.21.15.37:0/3310248404 wait complete. 2024-04-25T17:10:11.545 INFO:teuthology.orchestra.run.smithi037.stderr:adjusted tunables profile to default 2024-04-25T17:10:11.820 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:11 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/3310248404' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-04-25T17:10:12.642 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:12 smithi037 ceph-mon[26472]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:10:12.642 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:12 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/3310248404' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-04-25T17:10:12.642 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:12 smithi037 ceph-mon[26472]: osdmap e4: 0 total, 0 up, 0 in 2024-04-25T17:10:12.643 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:12 smithi037 ceph-mon[26472]: from='mgr.14160 172.21.15.37:0/1872577945' entity='mgr.smithi037.txrgxl' 2024-04-25T17:10:12.643 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:12 smithi037 ceph-mon[26472]: from='mgr.14160 172.21.15.37:0/1872577945' entity='mgr.smithi037.txrgxl' 2024-04-25T17:10:12.643 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:12 smithi037 ceph-mon[26472]: from='mgr.14160 172.21.15.37:0/1872577945' entity='mgr.smithi037.txrgxl' 2024-04-25T17:10:12.643 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:12 smithi037 ceph-mon[26472]: from='mgr.14160 172.21.15.37:0/1872577945' entity='mgr.smithi037.txrgxl' 2024-04-25T17:10:12.643 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:12 smithi037 ceph-mon[26472]: from='mgr.14160 172.21.15.37:0/1872577945' entity='mgr.smithi037.txrgxl' 2024-04-25T17:10:12.643 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:12 smithi037 ceph-mon[26472]: from='mgr.14160 172.21.15.37:0/1872577945' entity='mgr.smithi037.txrgxl' 2024-04-25T17:10:12.643 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:12 smithi037 ceph-mon[26472]: from='mgr.14160 172.21.15.37:0/1872577945' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-04-25T17:10:12.643 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:12 smithi037 ceph-mon[26472]: from='mgr.14160 172.21.15.37:0/1872577945' entity='mgr.smithi037.txrgxl' 2024-04-25T17:10:12.668 INFO:tasks.cephadm:Adding mon.smithi037 on smithi037 2024-04-25T17:10:12.668 INFO:tasks.cephadm:Adding mon.smithi069 on smithi069 2024-04-25T17:10:12.668 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph orch apply mon '2;smithi037:172.21.15.37=smithi037;smithi069:172.21.15.69=smithi069' 2024-04-25T17:10:12.926 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-25T17:10:12.974 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-25T17:10:13.820 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:13 smithi037 ceph-mon[26472]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-04-25T17:10:13.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:13 smithi037 ceph-mon[26472]: Deploying daemon grafana.smithi037 on smithi037 2024-04-25T17:10:14.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:14.504+0000 7fdfcbf26700 1 -- 172.21.15.69:0/2938057146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdfc40fca30 msgr2=0x7fdfc40fce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:10:14.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:14.504+0000 7fdfcbf26700 1 --2- 172.21.15.69:0/2938057146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdfc40fca30 0x7fdfc40fce40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdfb40048c0 tx=0x7fdfb4009e30 comp rx=0 tx=0).stop 2024-04-25T17:10:14.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:14.504+0000 7fdfcbf26700 1 -- 172.21.15.69:0/2938057146 shutdown_connections 2024-04-25T17:10:14.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:14.504+0000 7fdfcbf26700 1 --2- 172.21.15.69:0/2938057146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdfc40fca30 0x7fdfc40fce40 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:10:14.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:14.504+0000 7fdfcbf26700 1 -- 172.21.15.69:0/2938057146 >> 172.21.15.69:0/2938057146 conn(0x7fdfc40f8190 msgr2=0x7fdfc40fa5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:10:14.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:14.504+0000 7fdfcbf26700 1 -- 172.21.15.69:0/2938057146 shutdown_connections 2024-04-25T17:10:14.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:14.504+0000 7fdfcbf26700 1 -- 172.21.15.69:0/2938057146 wait complete. 2024-04-25T17:10:14.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:14.505+0000 7fdfcbf26700 1 Processor -- start 2024-04-25T17:10:14.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:14.505+0000 7fdfcbf26700 1 -- start start 2024-04-25T17:10:14.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:14.505+0000 7fdfcbf26700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdfc40fca30 0x7fdfc410d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:10:14.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:14.505+0000 7fdfcbf26700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc410d5c0 con 0x7fdfc40fca30 2024-04-25T17:10:14.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:14.505+0000 7fdfc9cc2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdfc40fca30 0x7fdfc410d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:10:14.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:14.505+0000 7fdfc9cc2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdfc40fca30 0x7fdfc410d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.69:59652/0 (socket says 172.21.15.69:59652) 2024-04-25T17:10:14.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:14.505+0000 7fdfc9cc2700 1 -- 172.21.15.69:0/4226178782 learned_addr learned my addr 172.21.15.69:0/4226178782 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-25T17:10:14.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:14.506+0000 7fdfc9cc2700 1 -- 172.21.15.69:0/4226178782 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb4005040 con 0x7fdfc40fca30 2024-04-25T17:10:14.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:14.506+0000 7fdfc9cc2700 1 --2- 172.21.15.69:0/4226178782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdfc40fca30 0x7fdfc410d080 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdfb40096b0 tx=0x7fdfb4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:10:14.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:14.506+0000 7fdfba7fc700 1 -- 172.21.15.69:0/4226178782 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdfb400bed0 con 0x7fdfc40fca30 2024-04-25T17:10:14.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:14.506+0000 7fdfcbf26700 1 -- 172.21.15.69:0/4226178782 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfc410d7c0 con 0x7fdfc40fca30 2024-04-25T17:10:14.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:14.506+0000 7fdfcbf26700 1 -- 172.21.15.69:0/4226178782 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfc410e330 con 0x7fdfc40fca30 2024-04-25T17:10:14.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:14.506+0000 7fdfba7fc700 1 -- 172.21.15.69:0/4226178782 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdfb400b5c0 con 0x7fdfc40fca30 2024-04-25T17:10:14.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:14.506+0000 7fdfba7fc700 1 -- 172.21.15.69:0/4226178782 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdfb401c5b0 con 0x7fdfc40fca30 2024-04-25T17:10:14.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:14.507+0000 7fdfcbf26700 1 -- 172.21.15.69:0/4226178782 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfa80052e0 con 0x7fdfc40fca30 2024-04-25T17:10:14.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:14.507+0000 7fdfba7fc700 1 -- 172.21.15.69:0/4226178782 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7fdfb4013a80 con 0x7fdfc40fca30 2024-04-25T17:10:14.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:14.507+0000 7fdfba7fc700 1 --2- 172.21.15.69:0/4226178782 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7fdfb00368d0 0x7fdfb0038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:10:14.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:14.507+0000 7fdfba7fc700 1 -- 172.21.15.69:0/4226178782 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fdfb4049a50 con 0x7fdfc40fca30 2024-04-25T17:10:14.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:14.507+0000 7fdfc94c1700 1 --2- 172.21.15.69:0/4226178782 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7fdfb00368d0 0x7fdfb0038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:10:14.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:14.508+0000 7fdfc94c1700 1 --2- 172.21.15.69:0/4226178782 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7fdfb00368d0 0x7fdfb0038d80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0009990 tx=0x7fdfc0006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:10:14.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:14.512+0000 7fdfba7fc700 1 -- 172.21.15.69:0/4226178782 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fdfb4011940 con 0x7fdfc40fca30 2024-04-25T17:10:14.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:14.707+0000 7fdfcbf26700 1 -- 172.21.15.69:0/4226178782 --> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi037:172.21.15.37=smithi037;smithi069:172.21.15.69=smithi069", "target": ["mon-mgr", ""]}) v1 -- 0x7fdfa8000ca0 con 0x7fdfb00368d0 2024-04-25T17:10:14.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:14.713+0000 7fdfba7fc700 1 -- 172.21.15.69:0/4226178782 <== mgr.14160 v2:172.21.15.37:6800/1299348474 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fdfa8000ca0 con 0x7fdfb00368d0 2024-04-25T17:10:14.713 INFO:teuthology.orchestra.run.smithi069.stdout:Scheduled mon update... 2024-04-25T17:10:14.715 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:14.715+0000 7fdfcbf26700 1 -- 172.21.15.69:0/4226178782 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7fdfb00368d0 msgr2=0x7fdfb0038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:10:14.715 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:14.715+0000 7fdfcbf26700 1 --2- 172.21.15.69:0/4226178782 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7fdfb00368d0 0x7fdfb0038d80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fdfc0009990 tx=0x7fdfc0006e40 comp rx=0 tx=0).stop 2024-04-25T17:10:14.715 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:14.715+0000 7fdfcbf26700 1 -- 172.21.15.69:0/4226178782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdfc40fca30 msgr2=0x7fdfc410d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:10:14.715 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:14.715+0000 7fdfcbf26700 1 --2- 172.21.15.69:0/4226178782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdfc40fca30 0x7fdfc410d080 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdfb40096b0 tx=0x7fdfb4009e30 comp rx=0 tx=0).stop 2024-04-25T17:10:14.716 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:14.715+0000 7fdfcbf26700 1 -- 172.21.15.69:0/4226178782 shutdown_connections 2024-04-25T17:10:14.716 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:14.715+0000 7fdfcbf26700 1 --2- 172.21.15.69:0/4226178782 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7fdfb00368d0 0x7fdfb0038d80 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:10:14.716 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:14.715+0000 7fdfcbf26700 1 --2- 172.21.15.69:0/4226178782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdfc40fca30 0x7fdfc410d080 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:10:14.716 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:14.715+0000 7fdfcbf26700 1 -- 172.21.15.69:0/4226178782 >> 172.21.15.69:0/4226178782 conn(0x7fdfc40f8190 msgr2=0x7fdfc4103b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:10:14.716 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:14.715+0000 7fdfcbf26700 1 -- 172.21.15.69:0/4226178782 shutdown_connections 2024-04-25T17:10:14.716 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:14.715+0000 7fdfcbf26700 1 -- 172.21.15.69:0/4226178782 wait complete. 2024-04-25T17:10:14.820 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:14 smithi037 ceph-mon[26472]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:10:14.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:14 smithi037 ceph-mon[26472]: from='mgr.14160 172.21.15.37:0/1872577945' entity='mgr.smithi037.txrgxl' 2024-04-25T17:10:15.278 DEBUG:teuthology.orchestra.run.smithi069:mon.smithi069> sudo journalctl -f -n 0 -u ceph-599bb7fc-0326-11ef-bc93-c7b262605968@mon.smithi069.service 2024-04-25T17:10:15.283 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-25T17:10:15.283 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-25T17:10:15.560 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-25T17:10:15.608 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-25T17:10:16.070 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:15 smithi037 ceph-mon[26472]: from='client.14192 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi037:172.21.15.37=smithi037;smithi069:172.21.15.69=smithi069", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:10:16.070 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:15 smithi037 ceph-mon[26472]: Saving service mon spec with placement smithi037:172.21.15.37=smithi037;smithi069:172.21.15.69=smithi069;count:2 2024-04-25T17:10:16.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:15 smithi037 ceph-mon[26472]: from='mgr.14160 172.21.15.37:0/1872577945' entity='mgr.smithi037.txrgxl' 2024-04-25T17:10:16.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:16.943+0000 7fb5f20ee700 1 -- 172.21.15.69:0/1615628125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5ec0fbf50 msgr2=0x7fb5ec0fc360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:10:16.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:16.943+0000 7fb5f20ee700 1 --2- 172.21.15.69:0/1615628125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5ec0fbf50 0x7fb5ec0fc360 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc0048c0 tx=0x7fb5dc009e30 comp rx=0 tx=0).stop 2024-04-25T17:10:16.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:16.943+0000 7fb5f20ee700 1 -- 172.21.15.69:0/1615628125 shutdown_connections 2024-04-25T17:10:16.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:16.943+0000 7fb5f20ee700 1 --2- 172.21.15.69:0/1615628125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5ec0fbf50 0x7fb5ec0fc360 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:10:16.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:16.943+0000 7fb5f20ee700 1 -- 172.21.15.69:0/1615628125 >> 172.21.15.69:0/1615628125 conn(0x7fb5ec0f6800 msgr2=0x7fb5ec0f8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:10:16.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:16.943+0000 7fb5f20ee700 1 -- 172.21.15.69:0/1615628125 shutdown_connections 2024-04-25T17:10:16.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:16.943+0000 7fb5f20ee700 1 -- 172.21.15.69:0/1615628125 wait complete. 2024-04-25T17:10:16.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:16.943+0000 7fb5f20ee700 1 Processor -- start 2024-04-25T17:10:16.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:16.943+0000 7fb5f20ee700 1 -- start start 2024-04-25T17:10:16.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:16.944+0000 7fb5f20ee700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5ec0fbf50 0x7fb5ec10bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:10:16.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:16.944+0000 7fb5f20ee700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec10c4f0 con 0x7fb5ec0fbf50 2024-04-25T17:10:16.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:16.944+0000 7fb5eb7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5ec0fbf50 0x7fb5ec10bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:10:16.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:16.944+0000 7fb5eb7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5ec0fbf50 0x7fb5ec10bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.69:59668/0 (socket says 172.21.15.69:59668) 2024-04-25T17:10:16.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:16.944+0000 7fb5eb7fe700 1 -- 172.21.15.69:0/2539135478 learned_addr learned my addr 172.21.15.69:0/2539135478 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-25T17:10:16.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:16.944+0000 7fb5eb7fe700 1 -- 172.21.15.69:0/2539135478 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5dc005040 con 0x7fb5ec0fbf50 2024-04-25T17:10:16.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:16.944+0000 7fb5eb7fe700 1 --2- 172.21.15.69:0/2539135478 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5ec0fbf50 0x7fb5ec10bfb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc0096b0 tx=0x7fb5dc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:10:16.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:16.945+0000 7fb5d3fff700 1 -- 172.21.15.69:0/2539135478 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb5dc00bed0 con 0x7fb5ec0fbf50 2024-04-25T17:10:16.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:16.945+0000 7fb5d3fff700 1 -- 172.21.15.69:0/2539135478 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb5dc00b5c0 con 0x7fb5ec0fbf50 2024-04-25T17:10:16.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:16.945+0000 7fb5f20ee700 1 -- 172.21.15.69:0/2539135478 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5ec10c6f0 con 0x7fb5ec0fbf50 2024-04-25T17:10:16.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:16.945+0000 7fb5d3fff700 1 -- 172.21.15.69:0/2539135478 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb5dc01c5b0 con 0x7fb5ec0fbf50 2024-04-25T17:10:16.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:16.945+0000 7fb5f20ee700 1 -- 172.21.15.69:0/2539135478 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5ec10d260 con 0x7fb5ec0fbf50 2024-04-25T17:10:16.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:16.945+0000 7fb5d3fff700 1 -- 172.21.15.69:0/2539135478 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7fb5dc01c820 con 0x7fb5ec0fbf50 2024-04-25T17:10:16.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:16.945+0000 7fb5f20ee700 1 -- 172.21.15.69:0/2539135478 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5ec101e40 con 0x7fb5ec0fbf50 2024-04-25T17:10:16.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:16.946+0000 7fb5d3fff700 1 --2- 172.21.15.69:0/2539135478 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7fb5d4036880 0x7fb5d4038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:10:16.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:16.946+0000 7fb5d3fff700 1 -- 172.21.15.69:0/2539135478 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fb5dc049c70 con 0x7fb5ec0fbf50 2024-04-25T17:10:16.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:16.946+0000 7fb5eaffd700 1 --2- 172.21.15.69:0/2539135478 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7fb5d4036880 0x7fb5d4038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:10:16.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:16.946+0000 7fb5eaffd700 1 --2- 172.21.15.69:0/2539135478 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7fb5d4036880 0x7fb5d4038d30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0009990 tx=0x7fb5e0006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:10:16.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:16.951+0000 7fb5d3fff700 1 -- 172.21.15.69:0/2539135478 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fb5dc023300 con 0x7fb5ec0fbf50 2024-04-25T17:10:17.070 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:16 smithi037 ceph-mon[26472]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:10:17.212 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:17.213+0000 7fb5f20ee700 1 -- 172.21.15.69:0/2539135478 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fb5ec10dc70 con 0x7fb5ec0fbf50 2024-04-25T17:10:17.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:17.213+0000 7fb5d3fff700 1 -- 172.21.15.69:0/2539135478 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fb5dc011b60 con 0x7fb5ec0fbf50 2024-04-25T17:10:17.213 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:10:17.213 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":1,"fsid":"599bb7fc-0326-11ef-bc93-c7b262605968","modified":"2024-04-25T17:08:34.994230Z","created":"2024-04-25T17:08:34.994230Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi037","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:3300","nonce":0},{"type":"v1","addr":"172.21.15.37:6789","nonce":0}]},"addr":"172.21.15.37:6789/0","public_addr":"172.21.15.37:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-25T17:10:17.215 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:17.215+0000 7fb5f20ee700 1 -- 172.21.15.69:0/2539135478 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7fb5d4036880 msgr2=0x7fb5d4038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:10:17.215 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:17.215+0000 7fb5f20ee700 1 --2- 172.21.15.69:0/2539135478 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7fb5d4036880 0x7fb5d4038d30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0009990 tx=0x7fb5e0006e40 comp rx=0 tx=0).stop 2024-04-25T17:10:17.215 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:17.215+0000 7fb5f20ee700 1 -- 172.21.15.69:0/2539135478 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5ec0fbf50 msgr2=0x7fb5ec10bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:10:17.215 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:17.215+0000 7fb5f20ee700 1 --2- 172.21.15.69:0/2539135478 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5ec0fbf50 0x7fb5ec10bfb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc0096b0 tx=0x7fb5dc009e30 comp rx=0 tx=0).stop 2024-04-25T17:10:17.215 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:17.215+0000 7fb5f20ee700 1 -- 172.21.15.69:0/2539135478 shutdown_connections 2024-04-25T17:10:17.215 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:17.215+0000 7fb5f20ee700 1 --2- 172.21.15.69:0/2539135478 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7fb5d4036880 0x7fb5d4038d30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:10:17.215 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:17.215+0000 7fb5f20ee700 1 --2- 172.21.15.69:0/2539135478 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5ec0fbf50 0x7fb5ec10bfb0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:10:17.215 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:17.215+0000 7fb5f20ee700 1 -- 172.21.15.69:0/2539135478 >> 172.21.15.69:0/2539135478 conn(0x7fb5ec0f6800 msgr2=0x7fb5ec102a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:10:17.215 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:17.215+0000 7fb5f20ee700 1 -- 172.21.15.69:0/2539135478 shutdown_connections 2024-04-25T17:10:17.216 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:17.215+0000 7fb5f20ee700 1 -- 172.21.15.69:0/2539135478 wait complete. 2024-04-25T17:10:17.216 INFO:teuthology.orchestra.run.smithi069.stderr:dumped monmap epoch 1 2024-04-25T17:10:18.070 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:17 smithi037 ceph-mon[26472]: from='client.? 172.21.15.69:0/2539135478' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T17:10:18.749 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-25T17:10:18.749 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-25T17:10:19.018 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-25T17:10:19.066 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-25T17:10:19.070 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:18 smithi037 ceph-mon[26472]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:10:20.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:20.573+0000 7fb581805700 1 -- 172.21.15.69:0/3743519234 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb57c0fe080 msgr2=0x7fb57c0fe490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:10:20.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:20.573+0000 7fb581805700 1 --2- 172.21.15.69:0/3743519234 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb57c0fe080 0x7fb57c0fe490 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb5700048c0 tx=0x7fb570009e30 comp rx=0 tx=0).stop 2024-04-25T17:10:20.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:20.573+0000 7fb581805700 1 -- 172.21.15.69:0/3743519234 shutdown_connections 2024-04-25T17:10:20.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:20.573+0000 7fb581805700 1 --2- 172.21.15.69:0/3743519234 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb57c0fe080 0x7fb57c0fe490 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:10:20.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:20.573+0000 7fb581805700 1 -- 172.21.15.69:0/3743519234 >> 172.21.15.69:0/3743519234 conn(0x7fb57c0f6820 msgr2=0x7fb57c0f8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:10:20.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:20.573+0000 7fb581805700 1 -- 172.21.15.69:0/3743519234 shutdown_connections 2024-04-25T17:10:20.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:20.573+0000 7fb581805700 1 -- 172.21.15.69:0/3743519234 wait complete. 2024-04-25T17:10:20.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:20.574+0000 7fb581805700 1 Processor -- start 2024-04-25T17:10:20.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:20.574+0000 7fb581805700 1 -- start start 2024-04-25T17:10:20.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:20.574+0000 7fb581805700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb57c0fe080 0x7fb57c10d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:10:20.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:20.574+0000 7fb581805700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb57c10d5e0 con 0x7fb57c0fe080 2024-04-25T17:10:20.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:20.574+0000 7fb57affd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb57c0fe080 0x7fb57c10d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:10:20.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:20.574+0000 7fb57affd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb57c0fe080 0x7fb57c10d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.69:53542/0 (socket says 172.21.15.69:53542) 2024-04-25T17:10:20.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:20.574+0000 7fb57affd700 1 -- 172.21.15.69:0/4091023802 learned_addr learned my addr 172.21.15.69:0/4091023802 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-25T17:10:20.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:20.575+0000 7fb57affd700 1 -- 172.21.15.69:0/4091023802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb570005040 con 0x7fb57c0fe080 2024-04-25T17:10:20.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:20.575+0000 7fb57affd700 1 --2- 172.21.15.69:0/4091023802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb57c0fe080 0x7fb57c10d0a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb5700096b0 tx=0x7fb570009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:10:20.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:20.575+0000 7fb5637fe700 1 -- 172.21.15.69:0/4091023802 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb57000bed0 con 0x7fb57c0fe080 2024-04-25T17:10:20.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:20.575+0000 7fb581805700 1 -- 172.21.15.69:0/4091023802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb57c10d7e0 con 0x7fb57c0fe080 2024-04-25T17:10:20.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:20.575+0000 7fb5637fe700 1 -- 172.21.15.69:0/4091023802 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb57000b5c0 con 0x7fb57c0fe080 2024-04-25T17:10:20.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:20.575+0000 7fb5637fe700 1 -- 172.21.15.69:0/4091023802 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb57001c5b0 con 0x7fb57c0fe080 2024-04-25T17:10:20.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:20.575+0000 7fb581805700 1 -- 172.21.15.69:0/4091023802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb57c10e350 con 0x7fb57c0fe080 2024-04-25T17:10:20.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:20.576+0000 7fb5637fe700 1 -- 172.21.15.69:0/4091023802 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7fb570013420 con 0x7fb57c0fe080 2024-04-25T17:10:20.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:20.576+0000 7fb581805700 1 -- 172.21.15.69:0/4091023802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb57c102f50 con 0x7fb57c0fe080 2024-04-25T17:10:20.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:20.576+0000 7fb5637fe700 1 --2- 172.21.15.69:0/4091023802 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7fb5640368d0 0x7fb564038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:10:20.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:20.576+0000 7fb5637fe700 1 -- 172.21.15.69:0/4091023802 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fb570049ac0 con 0x7fb57c0fe080 2024-04-25T17:10:20.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:20.576+0000 7fb57a7fc700 1 --2- 172.21.15.69:0/4091023802 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7fb5640368d0 0x7fb564038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:10:20.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:20.577+0000 7fb57a7fc700 1 --2- 172.21.15.69:0/4091023802 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7fb5640368d0 0x7fb564038d80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb56c009990 tx=0x7fb56c006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:10:20.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:20.581+0000 7fb5637fe700 1 -- 172.21.15.69:0/4091023802 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fb570025400 con 0x7fb57c0fe080 2024-04-25T17:10:20.839 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:20.839+0000 7fb581805700 1 -- 172.21.15.69:0/4091023802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fb57c10ed60 con 0x7fb57c0fe080 2024-04-25T17:10:20.840 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:20.840+0000 7fb5637fe700 1 -- 172.21.15.69:0/4091023802 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fb570004d30 con 0x7fb57c0fe080 2024-04-25T17:10:20.840 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:10:20.840 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":1,"fsid":"599bb7fc-0326-11ef-bc93-c7b262605968","modified":"2024-04-25T17:08:34.994230Z","created":"2024-04-25T17:08:34.994230Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi037","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:3300","nonce":0},{"type":"v1","addr":"172.21.15.37:6789","nonce":0}]},"addr":"172.21.15.37:6789/0","public_addr":"172.21.15.37:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-25T17:10:20.842 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:20.842+0000 7fb581805700 1 -- 172.21.15.69:0/4091023802 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7fb5640368d0 msgr2=0x7fb564038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:10:20.842 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:20.842+0000 7fb581805700 1 --2- 172.21.15.69:0/4091023802 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7fb5640368d0 0x7fb564038d80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb56c009990 tx=0x7fb56c006e40 comp rx=0 tx=0).stop 2024-04-25T17:10:20.842 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:20.842+0000 7fb581805700 1 -- 172.21.15.69:0/4091023802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb57c0fe080 msgr2=0x7fb57c10d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:10:20.842 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:20.842+0000 7fb581805700 1 --2- 172.21.15.69:0/4091023802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb57c0fe080 0x7fb57c10d0a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb5700096b0 tx=0x7fb570009e30 comp rx=0 tx=0).stop 2024-04-25T17:10:20.842 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:20.842+0000 7fb581805700 1 -- 172.21.15.69:0/4091023802 shutdown_connections 2024-04-25T17:10:20.842 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:20.842+0000 7fb581805700 1 --2- 172.21.15.69:0/4091023802 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7fb5640368d0 0x7fb564038d80 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:10:20.842 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:20.842+0000 7fb581805700 1 --2- 172.21.15.69:0/4091023802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb57c0fe080 0x7fb57c10d0a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:10:20.842 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:20.842+0000 7fb581805700 1 -- 172.21.15.69:0/4091023802 >> 172.21.15.69:0/4091023802 conn(0x7fb57c0f6820 msgr2=0x7fb57c103b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:10:20.842 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:20.842+0000 7fb581805700 1 -- 172.21.15.69:0/4091023802 shutdown_connections 2024-04-25T17:10:20.842 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:20.842+0000 7fb581805700 1 -- 172.21.15.69:0/4091023802 wait complete. 2024-04-25T17:10:20.843 INFO:teuthology.orchestra.run.smithi069.stderr:dumped monmap epoch 1 2024-04-25T17:10:21.070 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:20 smithi037 ceph-mon[26472]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:10:22.070 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:21 smithi037 ceph-mon[26472]: from='client.? 172.21.15.69:0/4091023802' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T17:10:22.407 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-25T17:10:22.407 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-25T17:10:22.668 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-25T17:10:22.715 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-25T17:10:23.070 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:22 smithi037 ceph-mon[26472]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:10:24.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:24.096+0000 7f8e174fa700 1 -- 172.21.15.69:0/698743240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e100fb940 msgr2=0x7f8e100fbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:10:24.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:24.096+0000 7f8e174fa700 1 --2- 172.21.15.69:0/698743240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e100fb940 0x7f8e100fbd50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8e000048c0 tx=0x7f8e00009e30 comp rx=0 tx=0).stop 2024-04-25T17:10:24.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:24.096+0000 7f8e174fa700 1 -- 172.21.15.69:0/698743240 shutdown_connections 2024-04-25T17:10:24.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:24.096+0000 7f8e174fa700 1 --2- 172.21.15.69:0/698743240 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e100fb940 0x7f8e100fbd50 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:10:24.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:24.096+0000 7f8e174fa700 1 -- 172.21.15.69:0/698743240 >> 172.21.15.69:0/698743240 conn(0x7f8e100f70a0 msgr2=0x7f8e100f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:10:24.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:24.096+0000 7f8e174fa700 1 -- 172.21.15.69:0/698743240 shutdown_connections 2024-04-25T17:10:24.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:24.096+0000 7f8e174fa700 1 -- 172.21.15.69:0/698743240 wait complete. 2024-04-25T17:10:24.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:24.097+0000 7f8e174fa700 1 Processor -- start 2024-04-25T17:10:24.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:24.097+0000 7f8e174fa700 1 -- start start 2024-04-25T17:10:24.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:24.097+0000 7f8e174fa700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e100fb940 0x7f8e1010bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:10:24.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:24.097+0000 7f8e174fa700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1010c4d0 con 0x7f8e100fb940 2024-04-25T17:10:24.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:24.097+0000 7f8e15296700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e100fb940 0x7f8e1010bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:10:24.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:24.097+0000 7f8e15296700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e100fb940 0x7f8e1010bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.69:53558/0 (socket says 172.21.15.69:53558) 2024-04-25T17:10:24.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:24.097+0000 7f8e15296700 1 -- 172.21.15.69:0/3608079385 learned_addr learned my addr 172.21.15.69:0/3608079385 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-25T17:10:24.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:24.098+0000 7f8e15296700 1 -- 172.21.15.69:0/3608079385 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e00005040 con 0x7f8e100fb940 2024-04-25T17:10:24.100 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:24.098+0000 7f8e15296700 1 --2- 172.21.15.69:0/3608079385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e100fb940 0x7f8e1010bf90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8e00009680 tx=0x7f8e00009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:10:24.100 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:24.098+0000 7f8e05ffb700 1 -- 172.21.15.69:0/3608079385 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8e0000b5c0 con 0x7f8e100fb940 2024-04-25T17:10:24.100 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:24.098+0000 7f8e174fa700 1 -- 172.21.15.69:0/3608079385 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e1010c6d0 con 0x7f8e100fb940 2024-04-25T17:10:24.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:24.098+0000 7f8e05ffb700 1 -- 172.21.15.69:0/3608079385 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8e0000be70 con 0x7f8e100fb940 2024-04-25T17:10:24.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:24.098+0000 7f8e05ffb700 1 -- 172.21.15.69:0/3608079385 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8e000135a0 con 0x7f8e100fb940 2024-04-25T17:10:24.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:24.098+0000 7f8e174fa700 1 -- 172.21.15.69:0/3608079385 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e1010d240 con 0x7f8e100fb940 2024-04-25T17:10:24.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:24.099+0000 7f8e05ffb700 1 -- 172.21.15.69:0/3608079385 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f8e0001c430 con 0x7f8e100fb940 2024-04-25T17:10:24.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:24.099+0000 7f8e174fa700 1 -- 172.21.15.69:0/3608079385 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e10101e50 con 0x7f8e100fb940 2024-04-25T17:10:24.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:24.099+0000 7f8e05ffb700 1 --2- 172.21.15.69:0/3608079385 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f8dfc036880 0x7f8dfc038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:10:24.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:24.099+0000 7f8e05ffb700 1 -- 172.21.15.69:0/3608079385 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f8e00049460 con 0x7f8e100fb940 2024-04-25T17:10:24.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:24.099+0000 7f8e14a95700 1 --2- 172.21.15.69:0/3608079385 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f8dfc036880 0x7f8dfc038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:10:24.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:24.100+0000 7f8e14a95700 1 --2- 172.21.15.69:0/3608079385 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f8dfc036880 0x7f8dfc038d30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c009990 tx=0x7f8e0c006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:10:24.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:24.104+0000 7f8e05ffb700 1 -- 172.21.15.69:0/3608079385 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f8e0001c7d0 con 0x7f8e100fb940 2024-04-25T17:10:24.366 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:24.365+0000 7f8e174fa700 1 -- 172.21.15.69:0/3608079385 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f8e1010dc50 con 0x7f8e100fb940 2024-04-25T17:10:24.367 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:24.366+0000 7f8e05ffb700 1 -- 172.21.15.69:0/3608079385 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f8e00021070 con 0x7f8e100fb940 2024-04-25T17:10:24.367 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:10:24.367 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":1,"fsid":"599bb7fc-0326-11ef-bc93-c7b262605968","modified":"2024-04-25T17:08:34.994230Z","created":"2024-04-25T17:08:34.994230Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi037","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:3300","nonce":0},{"type":"v1","addr":"172.21.15.37:6789","nonce":0}]},"addr":"172.21.15.37:6789/0","public_addr":"172.21.15.37:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-25T17:10:24.369 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:24.368+0000 7f8e174fa700 1 -- 172.21.15.69:0/3608079385 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f8dfc036880 msgr2=0x7f8dfc038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:10:24.369 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:24.368+0000 7f8e174fa700 1 --2- 172.21.15.69:0/3608079385 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f8dfc036880 0x7f8dfc038d30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c009990 tx=0x7f8e0c006e40 comp rx=0 tx=0).stop 2024-04-25T17:10:24.369 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:24.368+0000 7f8e174fa700 1 -- 172.21.15.69:0/3608079385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e100fb940 msgr2=0x7f8e1010bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:10:24.369 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:24.368+0000 7f8e174fa700 1 --2- 172.21.15.69:0/3608079385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e100fb940 0x7f8e1010bf90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8e00009680 tx=0x7f8e00009e30 comp rx=0 tx=0).stop 2024-04-25T17:10:24.369 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:24.368+0000 7f8e174fa700 1 -- 172.21.15.69:0/3608079385 shutdown_connections 2024-04-25T17:10:24.370 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:24.368+0000 7f8e174fa700 1 --2- 172.21.15.69:0/3608079385 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f8dfc036880 0x7f8dfc038d30 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:10:24.370 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:24.368+0000 7f8e174fa700 1 --2- 172.21.15.69:0/3608079385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8e100fb940 0x7f8e1010bf90 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:10:24.370 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:24.368+0000 7f8e174fa700 1 -- 172.21.15.69:0/3608079385 >> 172.21.15.69:0/3608079385 conn(0x7f8e100f70a0 msgr2=0x7f8e10102a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:10:24.370 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:24.368+0000 7f8e174fa700 1 -- 172.21.15.69:0/3608079385 shutdown_connections 2024-04-25T17:10:24.370 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:24.368+0000 7f8e174fa700 1 -- 172.21.15.69:0/3608079385 wait complete. 2024-04-25T17:10:24.370 INFO:teuthology.orchestra.run.smithi069.stderr:dumped monmap epoch 1 2024-04-25T17:10:25.070 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:24 smithi037 ceph-mon[26472]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:10:25.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:24 smithi037 ceph-mon[26472]: from='client.? 172.21.15.69:0/3608079385' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T17:10:25.949 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-25T17:10:25.949 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-25T17:10:26.196 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-25T17:10:26.243 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-25T17:10:27.070 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:26 smithi037 ceph-mon[26472]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:10:27.671 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:27.670+0000 7f6dc4ced700 1 -- 172.21.15.69:0/4196798634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6dc00fe080 msgr2=0x7f6dc00fe490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:10:27.671 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:27.670+0000 7f6dc4ced700 1 --2- 172.21.15.69:0/4196798634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6dc00fe080 0x7f6dc00fe490 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6db00048c0 tx=0x7f6db0009e30 comp rx=0 tx=0).stop 2024-04-25T17:10:27.671 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:27.670+0000 7f6dc4ced700 1 -- 172.21.15.69:0/4196798634 shutdown_connections 2024-04-25T17:10:27.671 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:27.670+0000 7f6dc4ced700 1 --2- 172.21.15.69:0/4196798634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6dc00fe080 0x7f6dc00fe490 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:10:27.671 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:27.670+0000 7f6dc4ced700 1 -- 172.21.15.69:0/4196798634 >> 172.21.15.69:0/4196798634 conn(0x7f6dc00f6820 msgr2=0x7f6dc00f8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:10:27.671 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:27.670+0000 7f6dc4ced700 1 -- 172.21.15.69:0/4196798634 shutdown_connections 2024-04-25T17:10:27.671 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:27.670+0000 7f6dc4ced700 1 -- 172.21.15.69:0/4196798634 wait complete. 2024-04-25T17:10:27.671 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:27.670+0000 7f6dc4ced700 1 Processor -- start 2024-04-25T17:10:27.672 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:27.670+0000 7f6dc4ced700 1 -- start start 2024-04-25T17:10:27.672 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:27.670+0000 7f6dc4ced700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6dc00fe080 0x7f6dc010d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:10:27.672 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:27.670+0000 7f6dc4ced700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dc010d5e0 con 0x7f6dc00fe080 2024-04-25T17:10:27.672 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:27.671+0000 7f6dbe59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6dc00fe080 0x7f6dc010d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:10:27.672 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:27.671+0000 7f6dbe59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6dc00fe080 0x7f6dc010d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.69:53572/0 (socket says 172.21.15.69:53572) 2024-04-25T17:10:27.672 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:27.671+0000 7f6dbe59c700 1 -- 172.21.15.69:0/2021985087 learned_addr learned my addr 172.21.15.69:0/2021985087 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-25T17:10:27.672 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:27.671+0000 7f6dbe59c700 1 -- 172.21.15.69:0/2021985087 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db0005040 con 0x7f6dc00fe080 2024-04-25T17:10:27.672 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:27.671+0000 7f6dbe59c700 1 --2- 172.21.15.69:0/2021985087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6dc00fe080 0x7f6dc010d0a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6db00096b0 tx=0x7f6db0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:10:27.672 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:27.671+0000 7f6daeffd700 1 -- 172.21.15.69:0/2021985087 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6db000bed0 con 0x7f6dc00fe080 2024-04-25T17:10:27.672 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:27.671+0000 7f6daeffd700 1 -- 172.21.15.69:0/2021985087 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6db000b5c0 con 0x7f6dc00fe080 2024-04-25T17:10:27.672 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:27.671+0000 7f6dc4ced700 1 -- 172.21.15.69:0/2021985087 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dc010d7e0 con 0x7f6dc00fe080 2024-04-25T17:10:27.672 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:27.671+0000 7f6daeffd700 1 -- 172.21.15.69:0/2021985087 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6db001c5b0 con 0x7f6dc00fe080 2024-04-25T17:10:27.672 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:27.671+0000 7f6dc4ced700 1 -- 172.21.15.69:0/2021985087 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dc010e350 con 0x7f6dc00fe080 2024-04-25T17:10:27.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:27.672+0000 7f6daeffd700 1 -- 172.21.15.69:0/2021985087 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f6db0013420 con 0x7f6dc00fe080 2024-04-25T17:10:27.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:27.672+0000 7f6dc4ced700 1 -- 172.21.15.69:0/2021985087 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dc0102f50 con 0x7f6dc00fe080 2024-04-25T17:10:27.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:27.672+0000 7f6daeffd700 1 --2- 172.21.15.69:0/2021985087 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f6da80368d0 0x7f6da8038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:10:27.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:27.672+0000 7f6daeffd700 1 -- 172.21.15.69:0/2021985087 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f6db0049a70 con 0x7f6dc00fe080 2024-04-25T17:10:27.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:27.673+0000 7f6dbdd9b700 1 --2- 172.21.15.69:0/2021985087 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f6da80368d0 0x7f6da8038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:10:27.674 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:27.673+0000 7f6dbdd9b700 1 --2- 172.21.15.69:0/2021985087 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f6da80368d0 0x7f6da8038d80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6db4009990 tx=0x7f6db4006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:10:27.677 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:27.678+0000 7f6daeffd700 1 -- 172.21.15.69:0/2021985087 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f6db0013a80 con 0x7f6dc00fe080 2024-04-25T17:10:27.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:27.938+0000 7f6dc4ced700 1 -- 172.21.15.69:0/2021985087 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f6dc010ed60 con 0x7f6dc00fe080 2024-04-25T17:10:27.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:27.939+0000 7f6daeffd700 1 -- 172.21.15.69:0/2021985087 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f6db0011370 con 0x7f6dc00fe080 2024-04-25T17:10:27.939 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:10:27.939 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":1,"fsid":"599bb7fc-0326-11ef-bc93-c7b262605968","modified":"2024-04-25T17:08:34.994230Z","created":"2024-04-25T17:08:34.994230Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi037","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:3300","nonce":0},{"type":"v1","addr":"172.21.15.37:6789","nonce":0}]},"addr":"172.21.15.37:6789/0","public_addr":"172.21.15.37:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-25T17:10:27.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:27.941+0000 7f6dc4ced700 1 -- 172.21.15.69:0/2021985087 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f6da80368d0 msgr2=0x7f6da8038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:10:27.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:27.941+0000 7f6dc4ced700 1 --2- 172.21.15.69:0/2021985087 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f6da80368d0 0x7f6da8038d80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6db4009990 tx=0x7f6db4006e40 comp rx=0 tx=0).stop 2024-04-25T17:10:27.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:27.941+0000 7f6dc4ced700 1 -- 172.21.15.69:0/2021985087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6dc00fe080 msgr2=0x7f6dc010d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:10:27.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:27.941+0000 7f6dc4ced700 1 --2- 172.21.15.69:0/2021985087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6dc00fe080 0x7f6dc010d0a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6db00096b0 tx=0x7f6db0009e30 comp rx=0 tx=0).stop 2024-04-25T17:10:27.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:27.941+0000 7f6dc4ced700 1 -- 172.21.15.69:0/2021985087 shutdown_connections 2024-04-25T17:10:27.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:27.941+0000 7f6dc4ced700 1 --2- 172.21.15.69:0/2021985087 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f6da80368d0 0x7f6da8038d80 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:10:27.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:27.941+0000 7f6dc4ced700 1 --2- 172.21.15.69:0/2021985087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6dc00fe080 0x7f6dc010d0a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:10:27.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:27.941+0000 7f6dc4ced700 1 -- 172.21.15.69:0/2021985087 >> 172.21.15.69:0/2021985087 conn(0x7f6dc00f6820 msgr2=0x7f6dc0103b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:10:27.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:27.941+0000 7f6dc4ced700 1 -- 172.21.15.69:0/2021985087 shutdown_connections 2024-04-25T17:10:27.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:27.941+0000 7f6dc4ced700 1 -- 172.21.15.69:0/2021985087 wait complete. 2024-04-25T17:10:27.941 INFO:teuthology.orchestra.run.smithi069.stderr:dumped monmap epoch 1 2024-04-25T17:10:28.975 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:28 smithi037 ceph-mon[26472]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:10:28.975 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:28 smithi037 ceph-mon[26472]: from='client.? 172.21.15.69:0/2021985087' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T17:10:29.476 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-25T17:10:29.476 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-25T17:10:29.724 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-25T17:10:29.771 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-25T17:10:30.980 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:30 smithi037 ceph-mon[26472]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:10:31.224 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:31.223+0000 7f0e0f635700 1 -- 172.21.15.69:0/3012730038 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e080fca30 msgr2=0x7f0e080fce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:10:31.224 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:31.223+0000 7f0e0f635700 1 --2- 172.21.15.69:0/3012730038 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e080fca30 0x7f0e080fce40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0e040048c0 tx=0x7f0e04009e30 comp rx=0 tx=0).stop 2024-04-25T17:10:31.224 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:31.223+0000 7f0e0f635700 1 -- 172.21.15.69:0/3012730038 shutdown_connections 2024-04-25T17:10:31.224 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:31.223+0000 7f0e0f635700 1 --2- 172.21.15.69:0/3012730038 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e080fca30 0x7f0e080fce40 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:10:31.224 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:31.223+0000 7f0e0f635700 1 -- 172.21.15.69:0/3012730038 >> 172.21.15.69:0/3012730038 conn(0x7f0e080f8170 msgr2=0x7f0e080fa5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:10:31.224 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:31.223+0000 7f0e0f635700 1 -- 172.21.15.69:0/3012730038 shutdown_connections 2024-04-25T17:10:31.224 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:31.223+0000 7f0e0f635700 1 -- 172.21.15.69:0/3012730038 wait complete. 2024-04-25T17:10:31.224 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:31.224+0000 7f0e0f635700 1 Processor -- start 2024-04-25T17:10:31.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:31.224+0000 7f0e0f635700 1 -- start start 2024-04-25T17:10:31.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:31.224+0000 7f0e0f635700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e080fca30 0x7f0e0810d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:10:31.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:31.224+0000 7f0e0f635700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0810d5f0 con 0x7f0e080fca30 2024-04-25T17:10:31.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:31.224+0000 7f0e0d3d1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e080fca30 0x7f0e0810d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:10:31.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:31.224+0000 7f0e0d3d1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e080fca30 0x7f0e0810d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.69:59254/0 (socket says 172.21.15.69:59254) 2024-04-25T17:10:31.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:31.224+0000 7f0e0d3d1700 1 -- 172.21.15.69:0/2614166586 learned_addr learned my addr 172.21.15.69:0/2614166586 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-25T17:10:31.226 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:31.225+0000 7f0e0d3d1700 1 -- 172.21.15.69:0/2614166586 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e04005040 con 0x7f0e080fca30 2024-04-25T17:10:31.227 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:31.225+0000 7f0e0d3d1700 1 --2- 172.21.15.69:0/2614166586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e080fca30 0x7f0e0810d0b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0e04009680 tx=0x7f0e04009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:10:31.227 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:31.225+0000 7f0dfdffb700 1 -- 172.21.15.69:0/2614166586 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0e0400b5c0 con 0x7f0e080fca30 2024-04-25T17:10:31.227 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:31.225+0000 7f0dfdffb700 1 -- 172.21.15.69:0/2614166586 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0e0400be70 con 0x7f0e080fca30 2024-04-25T17:10:31.227 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:31.225+0000 7f0e0f635700 1 -- 172.21.15.69:0/2614166586 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e0810d7f0 con 0x7f0e080fca30 2024-04-25T17:10:31.227 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:31.225+0000 7f0dfdffb700 1 -- 172.21.15.69:0/2614166586 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0e040135a0 con 0x7f0e080fca30 2024-04-25T17:10:31.227 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:31.225+0000 7f0e0f635700 1 -- 172.21.15.69:0/2614166586 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e0810e360 con 0x7f0e080fca30 2024-04-25T17:10:31.227 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:31.226+0000 7f0dfdffb700 1 -- 172.21.15.69:0/2614166586 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f0e04004d30 con 0x7f0e080fca30 2024-04-25T17:10:31.227 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:31.226+0000 7f0e0f635700 1 -- 172.21.15.69:0/2614166586 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e08102f40 con 0x7f0e080fca30 2024-04-25T17:10:31.227 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:31.226+0000 7f0dfdffb700 1 --2- 172.21.15.69:0/2614166586 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f0df4036880 0x7f0df4038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:10:31.227 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:31.226+0000 7f0dfdffb700 1 -- 172.21.15.69:0/2614166586 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f0e04049460 con 0x7f0e080fca30 2024-04-25T17:10:31.227 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:31.226+0000 7f0e0cbd0700 1 --2- 172.21.15.69:0/2614166586 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f0df4036880 0x7f0df4038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:10:31.227 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:31.227+0000 7f0e0cbd0700 1 --2- 172.21.15.69:0/2614166586 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f0df4036880 0x7f0df4038d30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0df8009990 tx=0x7f0df8006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:10:31.231 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:31.231+0000 7f0dfdffb700 1 -- 172.21.15.69:0/2614166586 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f0e04011960 con 0x7f0e080fca30 2024-04-25T17:10:31.488 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:31.488+0000 7f0e0f635700 1 -- 172.21.15.69:0/2614166586 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f0e0810edd0 con 0x7f0e080fca30 2024-04-25T17:10:31.488 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:31.489+0000 7f0dfdffb700 1 -- 172.21.15.69:0/2614166586 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f0e04021020 con 0x7f0e080fca30 2024-04-25T17:10:31.489 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:10:31.489 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":1,"fsid":"599bb7fc-0326-11ef-bc93-c7b262605968","modified":"2024-04-25T17:08:34.994230Z","created":"2024-04-25T17:08:34.994230Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi037","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:3300","nonce":0},{"type":"v1","addr":"172.21.15.37:6789","nonce":0}]},"addr":"172.21.15.37:6789/0","public_addr":"172.21.15.37:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-25T17:10:31.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:31.491+0000 7f0e0f635700 1 -- 172.21.15.69:0/2614166586 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f0df4036880 msgr2=0x7f0df4038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:10:31.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:31.491+0000 7f0e0f635700 1 --2- 172.21.15.69:0/2614166586 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f0df4036880 0x7f0df4038d30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0df8009990 tx=0x7f0df8006e40 comp rx=0 tx=0).stop 2024-04-25T17:10:31.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:31.491+0000 7f0e0f635700 1 -- 172.21.15.69:0/2614166586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e080fca30 msgr2=0x7f0e0810d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:10:31.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:31.491+0000 7f0e0f635700 1 --2- 172.21.15.69:0/2614166586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e080fca30 0x7f0e0810d0b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0e04009680 tx=0x7f0e04009e30 comp rx=0 tx=0).stop 2024-04-25T17:10:31.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:31.491+0000 7f0e0f635700 1 -- 172.21.15.69:0/2614166586 shutdown_connections 2024-04-25T17:10:31.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:31.491+0000 7f0e0f635700 1 --2- 172.21.15.69:0/2614166586 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f0df4036880 0x7f0df4038d30 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:10:31.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:31.491+0000 7f0e0f635700 1 --2- 172.21.15.69:0/2614166586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0e080fca30 0x7f0e0810d0b0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:10:31.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:31.491+0000 7f0e0f635700 1 -- 172.21.15.69:0/2614166586 >> 172.21.15.69:0/2614166586 conn(0x7f0e080f8170 msgr2=0x7f0e08103b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:10:31.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:31.491+0000 7f0e0f635700 1 -- 172.21.15.69:0/2614166586 shutdown_connections 2024-04-25T17:10:31.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:31.491+0000 7f0e0f635700 1 -- 172.21.15.69:0/2614166586 wait complete. 2024-04-25T17:10:31.492 INFO:teuthology.orchestra.run.smithi069.stderr:dumped monmap epoch 1 2024-04-25T17:10:31.839 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:31 smithi037 ceph-mon[26472]: from='client.? 172.21.15.69:0/2614166586' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T17:10:31.839 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:31 smithi037 ceph-mon[26472]: from='mgr.14160 172.21.15.37:0/1872577945' entity='mgr.smithi037.txrgxl' 2024-04-25T17:10:31.839 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:31 smithi037 ceph-mon[26472]: from='mgr.14160 172.21.15.37:0/1872577945' entity='mgr.smithi037.txrgxl' 2024-04-25T17:10:31.839 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:31 smithi037 ceph-mon[26472]: from='mgr.14160 172.21.15.37:0/1872577945' entity='mgr.smithi037.txrgxl' 2024-04-25T17:10:31.839 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:31 smithi037 ceph-mon[26472]: from='mgr.14160 172.21.15.37:0/1872577945' entity='mgr.smithi037.txrgxl' 2024-04-25T17:10:31.839 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:31 smithi037 ceph-mon[26472]: from='mgr.14160 172.21.15.37:0/1872577945' entity='mgr.smithi037.txrgxl' 2024-04-25T17:10:31.839 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:31 smithi037 ceph-mon[26472]: from='mgr.14160 172.21.15.37:0/1872577945' entity='mgr.smithi037.txrgxl' 2024-04-25T17:10:33.066 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-25T17:10:33.066 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-25T17:10:33.070 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:32 smithi037 ceph-mon[26472]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:10:33.070 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:32 smithi037 ceph-mon[26472]: Deploying daemon prometheus.smithi037 on smithi037 2024-04-25T17:10:33.313 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-25T17:10:33.360 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-25T17:10:34.614 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:34.612+0000 7fb7420cc700 1 -- 172.21.15.69:0/1913735869 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb73c065d30 msgr2=0x7fb73c0ff630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:10:34.614 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:34.612+0000 7fb7420cc700 1 --2- 172.21.15.69:0/1913735869 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb73c065d30 0x7fb73c0ff630 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb72c0048c0 tx=0x7fb72c009e30 comp rx=0 tx=0).stop 2024-04-25T17:10:34.614 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:34.612+0000 7fb7420cc700 1 -- 172.21.15.69:0/1913735869 shutdown_connections 2024-04-25T17:10:34.614 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:34.612+0000 7fb7420cc700 1 --2- 172.21.15.69:0/1913735869 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb73c065d30 0x7fb73c0ff630 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:10:34.614 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:34.612+0000 7fb7420cc700 1 -- 172.21.15.69:0/1913735869 >> 172.21.15.69:0/1913735869 conn(0x7fb73c0f70a0 msgr2=0x7fb73c0f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:10:34.614 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:34.612+0000 7fb7420cc700 1 -- 172.21.15.69:0/1913735869 shutdown_connections 2024-04-25T17:10:34.614 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:34.612+0000 7fb7420cc700 1 -- 172.21.15.69:0/1913735869 wait complete. 2024-04-25T17:10:34.614 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:34.613+0000 7fb7420cc700 1 Processor -- start 2024-04-25T17:10:34.614 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:34.613+0000 7fb7420cc700 1 -- start start 2024-04-25T17:10:34.614 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:34.613+0000 7fb7420cc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb73c065d30 0x7fb73c10d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:10:34.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:34.613+0000 7fb7420cc700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb73c10d5d0 con 0x7fb73c065d30 2024-04-25T17:10:34.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:34.613+0000 7fb73b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb73c065d30 0x7fb73c10d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:10:34.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:34.613+0000 7fb73b7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb73c065d30 0x7fb73c10d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.69:59270/0 (socket says 172.21.15.69:59270) 2024-04-25T17:10:34.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:34.613+0000 7fb73b7fe700 1 -- 172.21.15.69:0/1246138294 learned_addr learned my addr 172.21.15.69:0/1246138294 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-25T17:10:34.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:34.614+0000 7fb73b7fe700 1 -- 172.21.15.69:0/1246138294 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb72c005040 con 0x7fb73c065d30 2024-04-25T17:10:34.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:34.614+0000 7fb73b7fe700 1 --2- 172.21.15.69:0/1246138294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb73c065d30 0x7fb73c10d090 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb72c00b900 tx=0x7fb72c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:10:34.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:34.614+0000 7fb738ff9700 1 -- 172.21.15.69:0/1246138294 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb72c00b5c0 con 0x7fb73c065d30 2024-04-25T17:10:34.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:34.614+0000 7fb738ff9700 1 -- 172.21.15.69:0/1246138294 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb72c00be70 con 0x7fb73c065d30 2024-04-25T17:10:34.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:34.614+0000 7fb7420cc700 1 -- 172.21.15.69:0/1246138294 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb73c10d7d0 con 0x7fb73c065d30 2024-04-25T17:10:34.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:34.614+0000 7fb738ff9700 1 -- 172.21.15.69:0/1246138294 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb72c01c590 con 0x7fb73c065d30 2024-04-25T17:10:34.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:34.614+0000 7fb7420cc700 1 -- 172.21.15.69:0/1246138294 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb73c10e340 con 0x7fb73c065d30 2024-04-25T17:10:34.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:34.615+0000 7fb738ff9700 1 -- 172.21.15.69:0/1246138294 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7fb72c01c850 con 0x7fb73c065d30 2024-04-25T17:10:34.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:34.615+0000 7fb7420cc700 1 -- 172.21.15.69:0/1246138294 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb73c102f40 con 0x7fb73c065d30 2024-04-25T17:10:34.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:34.615+0000 7fb738ff9700 1 --2- 172.21.15.69:0/1246138294 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7fb728036880 0x7fb728038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:10:34.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:34.615+0000 7fb738ff9700 1 -- 172.21.15.69:0/1246138294 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fb72c049540 con 0x7fb73c065d30 2024-04-25T17:10:34.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:34.615+0000 7fb732ffd700 1 --2- 172.21.15.69:0/1246138294 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7fb728036880 0x7fb728038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:10:34.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:34.616+0000 7fb732ffd700 1 --2- 172.21.15.69:0/1246138294 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7fb728036880 0x7fb728038d30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb724009990 tx=0x7fb724006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:10:34.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:34.620+0000 7fb738ff9700 1 -- 172.21.15.69:0/1246138294 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fb72c01bb40 con 0x7fb73c065d30 2024-04-25T17:10:34.880 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:34.880+0000 7fb7420cc700 1 -- 172.21.15.69:0/1246138294 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fb73c10ed50 con 0x7fb73c065d30 2024-04-25T17:10:34.880 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:34.881+0000 7fb738ff9700 1 -- 172.21.15.69:0/1246138294 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fb72c024360 con 0x7fb73c065d30 2024-04-25T17:10:34.881 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:10:34.881 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":1,"fsid":"599bb7fc-0326-11ef-bc93-c7b262605968","modified":"2024-04-25T17:08:34.994230Z","created":"2024-04-25T17:08:34.994230Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi037","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:3300","nonce":0},{"type":"v1","addr":"172.21.15.37:6789","nonce":0}]},"addr":"172.21.15.37:6789/0","public_addr":"172.21.15.37:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-25T17:10:34.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:34.883+0000 7fb7420cc700 1 -- 172.21.15.69:0/1246138294 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7fb728036880 msgr2=0x7fb728038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:10:34.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:34.883+0000 7fb7420cc700 1 --2- 172.21.15.69:0/1246138294 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7fb728036880 0x7fb728038d30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb724009990 tx=0x7fb724006e40 comp rx=0 tx=0).stop 2024-04-25T17:10:34.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:34.883+0000 7fb7420cc700 1 -- 172.21.15.69:0/1246138294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb73c065d30 msgr2=0x7fb73c10d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:10:34.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:34.883+0000 7fb7420cc700 1 --2- 172.21.15.69:0/1246138294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb73c065d30 0x7fb73c10d090 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb72c00b900 tx=0x7fb72c009e30 comp rx=0 tx=0).stop 2024-04-25T17:10:34.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:34.883+0000 7fb7420cc700 1 -- 172.21.15.69:0/1246138294 shutdown_connections 2024-04-25T17:10:34.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:34.883+0000 7fb7420cc700 1 --2- 172.21.15.69:0/1246138294 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7fb728036880 0x7fb728038d30 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:10:34.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:34.883+0000 7fb7420cc700 1 --2- 172.21.15.69:0/1246138294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb73c065d30 0x7fb73c10d090 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:10:34.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:34.883+0000 7fb7420cc700 1 -- 172.21.15.69:0/1246138294 >> 172.21.15.69:0/1246138294 conn(0x7fb73c0f70a0 msgr2=0x7fb73c103b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:10:34.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:34.883+0000 7fb7420cc700 1 -- 172.21.15.69:0/1246138294 shutdown_connections 2024-04-25T17:10:34.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:34.883+0000 7fb7420cc700 1 -- 172.21.15.69:0/1246138294 wait complete. 2024-04-25T17:10:34.884 INFO:teuthology.orchestra.run.smithi069.stderr:dumped monmap epoch 1 2024-04-25T17:10:35.070 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:34 smithi037 ceph-mon[26472]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:10:35.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:34 smithi037 ceph-mon[26472]: from='mgr.14160 172.21.15.37:0/1872577945' entity='mgr.smithi037.txrgxl' 2024-04-25T17:10:36.070 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:35 smithi037 ceph-mon[26472]: from='client.? 172.21.15.69:0/1246138294' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T17:10:36.416 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-25T17:10:36.417 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-25T17:10:36.664 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-25T17:10:36.711 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-25T17:10:37.070 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:36 smithi037 ceph-mon[26472]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:10:38.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:38.209+0000 7f98901a6700 1 -- 172.21.15.69:0/1347072446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98880fe080 msgr2=0x7f98880fe490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:10:38.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:38.209+0000 7f98901a6700 1 --2- 172.21.15.69:0/1347072446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98880fe080 0x7f98880fe490 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f98780048c0 tx=0x7f9878009e30 comp rx=0 tx=0).stop 2024-04-25T17:10:38.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:38.209+0000 7f98901a6700 1 -- 172.21.15.69:0/1347072446 shutdown_connections 2024-04-25T17:10:38.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:38.209+0000 7f98901a6700 1 --2- 172.21.15.69:0/1347072446 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98880fe080 0x7f98880fe490 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:10:38.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:38.209+0000 7f98901a6700 1 -- 172.21.15.69:0/1347072446 >> 172.21.15.69:0/1347072446 conn(0x7f98880f6800 msgr2=0x7f98880f8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:10:38.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:38.210+0000 7f98901a6700 1 -- 172.21.15.69:0/1347072446 shutdown_connections 2024-04-25T17:10:38.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:38.210+0000 7f98901a6700 1 -- 172.21.15.69:0/1347072446 wait complete. 2024-04-25T17:10:38.212 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:38.210+0000 7f98901a6700 1 Processor -- start 2024-04-25T17:10:38.212 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:38.210+0000 7f98901a6700 1 -- start start 2024-04-25T17:10:38.212 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:38.210+0000 7f98901a6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98880fe080 0x7f988810d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:10:38.212 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:38.210+0000 7f98901a6700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f988810d5e0 con 0x7f98880fe080 2024-04-25T17:10:38.212 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:38.210+0000 7f988df42700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98880fe080 0x7f988810d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:10:38.212 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:38.210+0000 7f988df42700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98880fe080 0x7f988810d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.69:59284/0 (socket says 172.21.15.69:59284) 2024-04-25T17:10:38.212 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:38.210+0000 7f988df42700 1 -- 172.21.15.69:0/2723488061 learned_addr learned my addr 172.21.15.69:0/2723488061 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-25T17:10:38.212 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:38.211+0000 7f988df42700 1 -- 172.21.15.69:0/2723488061 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9878005040 con 0x7f98880fe080 2024-04-25T17:10:38.212 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:38.211+0000 7f988df42700 1 --2- 172.21.15.69:0/2723488061 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98880fe080 0x7f988810d0a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9878009680 tx=0x7f9878009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:10:38.212 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:38.211+0000 7f987e7fc700 1 -- 172.21.15.69:0/2723488061 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f987800b5c0 con 0x7f98880fe080 2024-04-25T17:10:38.212 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:38.211+0000 7f98901a6700 1 -- 172.21.15.69:0/2723488061 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f988810d7e0 con 0x7f98880fe080 2024-04-25T17:10:38.212 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:38.211+0000 7f987e7fc700 1 -- 172.21.15.69:0/2723488061 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f987800be70 con 0x7f98880fe080 2024-04-25T17:10:38.212 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:38.211+0000 7f987e7fc700 1 -- 172.21.15.69:0/2723488061 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f98780135a0 con 0x7f98880fe080 2024-04-25T17:10:38.212 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:38.211+0000 7f98901a6700 1 -- 172.21.15.69:0/2723488061 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f988810e350 con 0x7f98880fe080 2024-04-25T17:10:38.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:38.212+0000 7f987e7fc700 1 -- 172.21.15.69:0/2723488061 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f987801c430 con 0x7f98880fe080 2024-04-25T17:10:38.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:38.212+0000 7f98901a6700 1 -- 172.21.15.69:0/2723488061 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9888102f50 con 0x7f98880fe080 2024-04-25T17:10:38.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:38.212+0000 7f987e7fc700 1 --2- 172.21.15.69:0/2723488061 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f98740368d0 0x7f9874038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:10:38.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:38.212+0000 7f987e7fc700 1 -- 172.21.15.69:0/2723488061 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f9878049430 con 0x7f98880fe080 2024-04-25T17:10:38.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:38.212+0000 7f988d741700 1 --2- 172.21.15.69:0/2723488061 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f98740368d0 0x7f9874038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:10:38.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:38.213+0000 7f988d741700 1 --2- 172.21.15.69:0/2723488061 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f98740368d0 0x7f9874038d80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9884009990 tx=0x7f9884006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:10:38.217 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:38.217+0000 7f987e7fc700 1 -- 172.21.15.69:0/2723488061 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f98780117e0 con 0x7f98880fe080 2024-04-25T17:10:38.479 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:38.479+0000 7f98901a6700 1 -- 172.21.15.69:0/2723488061 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f988810ed60 con 0x7f98880fe080 2024-04-25T17:10:38.479 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:38.480+0000 7f987e7fc700 1 -- 172.21.15.69:0/2723488061 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f9878021070 con 0x7f98880fe080 2024-04-25T17:10:38.480 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:10:38.480 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":1,"fsid":"599bb7fc-0326-11ef-bc93-c7b262605968","modified":"2024-04-25T17:08:34.994230Z","created":"2024-04-25T17:08:34.994230Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi037","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:3300","nonce":0},{"type":"v1","addr":"172.21.15.37:6789","nonce":0}]},"addr":"172.21.15.37:6789/0","public_addr":"172.21.15.37:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-25T17:10:38.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:38.482+0000 7f98901a6700 1 -- 172.21.15.69:0/2723488061 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f98740368d0 msgr2=0x7f9874038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:10:38.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:38.482+0000 7f98901a6700 1 --2- 172.21.15.69:0/2723488061 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f98740368d0 0x7f9874038d80 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9884009990 tx=0x7f9884006e40 comp rx=0 tx=0).stop 2024-04-25T17:10:38.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:38.482+0000 7f98901a6700 1 -- 172.21.15.69:0/2723488061 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98880fe080 msgr2=0x7f988810d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:10:38.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:38.482+0000 7f98901a6700 1 --2- 172.21.15.69:0/2723488061 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98880fe080 0x7f988810d0a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9878009680 tx=0x7f9878009e30 comp rx=0 tx=0).stop 2024-04-25T17:10:38.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:38.482+0000 7f98901a6700 1 -- 172.21.15.69:0/2723488061 shutdown_connections 2024-04-25T17:10:38.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:38.482+0000 7f98901a6700 1 --2- 172.21.15.69:0/2723488061 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f98740368d0 0x7f9874038d80 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:10:38.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:38.482+0000 7f98901a6700 1 --2- 172.21.15.69:0/2723488061 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f98880fe080 0x7f988810d0a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:10:38.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:38.482+0000 7f98901a6700 1 -- 172.21.15.69:0/2723488061 >> 172.21.15.69:0/2723488061 conn(0x7f98880f6800 msgr2=0x7f9888103b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:10:38.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:38.482+0000 7f98901a6700 1 -- 172.21.15.69:0/2723488061 shutdown_connections 2024-04-25T17:10:38.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:38.482+0000 7f98901a6700 1 -- 172.21.15.69:0/2723488061 wait complete. 2024-04-25T17:10:38.482 INFO:teuthology.orchestra.run.smithi069.stderr:dumped monmap epoch 1 2024-04-25T17:10:39.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:38 smithi037 ceph-mon[26472]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:10:39.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:38 smithi037 ceph-mon[26472]: from='client.? 172.21.15.69:0/2723488061' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T17:10:40.079 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-25T17:10:40.080 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-25T17:10:40.326 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-25T17:10:40.372 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-25T17:10:41.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:40 smithi037 ceph-mon[26472]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:10:41.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:41.726+0000 7f59fee2e700 1 -- 172.21.15.69:0/1118569911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59f80fca30 msgr2=0x7f59f80fce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:10:41.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:41.726+0000 7f59fee2e700 1 --2- 172.21.15.69:0/1118569911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59f80fca30 0x7f59f80fce40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f59ec0048c0 tx=0x7f59ec009e30 comp rx=0 tx=0).stop 2024-04-25T17:10:41.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:41.726+0000 7f59fee2e700 1 -- 172.21.15.69:0/1118569911 shutdown_connections 2024-04-25T17:10:41.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:41.726+0000 7f59fee2e700 1 --2- 172.21.15.69:0/1118569911 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59f80fca30 0x7f59f80fce40 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:10:41.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:41.726+0000 7f59fee2e700 1 -- 172.21.15.69:0/1118569911 >> 172.21.15.69:0/1118569911 conn(0x7f59f80f8170 msgr2=0x7f59f80fa5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:10:41.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:41.726+0000 7f59fee2e700 1 -- 172.21.15.69:0/1118569911 shutdown_connections 2024-04-25T17:10:41.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:41.726+0000 7f59fee2e700 1 -- 172.21.15.69:0/1118569911 wait complete. 2024-04-25T17:10:41.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:41.726+0000 7f59fee2e700 1 Processor -- start 2024-04-25T17:10:41.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:41.727+0000 7f59fee2e700 1 -- start start 2024-04-25T17:10:41.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:41.727+0000 7f59fee2e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59f80fca30 0x7f59f810d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:10:41.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:41.727+0000 7f59fee2e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f810d5f0 con 0x7f59f80fca30 2024-04-25T17:10:41.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:41.727+0000 7f59fcbca700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59f80fca30 0x7f59f810d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:10:41.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:41.727+0000 7f59fcbca700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59f80fca30 0x7f59f810d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.69:56518/0 (socket says 172.21.15.69:56518) 2024-04-25T17:10:41.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:41.727+0000 7f59fcbca700 1 -- 172.21.15.69:0/4031051589 learned_addr learned my addr 172.21.15.69:0/4031051589 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-25T17:10:41.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:41.728+0000 7f59fcbca700 1 -- 172.21.15.69:0/4031051589 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59ec005040 con 0x7f59f80fca30 2024-04-25T17:10:41.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:41.728+0000 7f59fcbca700 1 --2- 172.21.15.69:0/4031051589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59f80fca30 0x7f59f810d0b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f59ec009680 tx=0x7f59ec009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:10:41.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:41.728+0000 7f59f57fa700 1 -- 172.21.15.69:0/4031051589 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f59ec00b5c0 con 0x7f59f80fca30 2024-04-25T17:10:41.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:41.728+0000 7f59f57fa700 1 -- 172.21.15.69:0/4031051589 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f59ec00be70 con 0x7f59f80fca30 2024-04-25T17:10:41.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:41.728+0000 7f59f57fa700 1 -- 172.21.15.69:0/4031051589 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f59ec0135a0 con 0x7f59f80fca30 2024-04-25T17:10:41.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:41.728+0000 7f59fee2e700 1 -- 172.21.15.69:0/4031051589 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59f810d7f0 con 0x7f59f80fca30 2024-04-25T17:10:41.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:41.728+0000 7f59fee2e700 1 -- 172.21.15.69:0/4031051589 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59f810e360 con 0x7f59f80fca30 2024-04-25T17:10:41.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:41.729+0000 7f59f57fa700 1 -- 172.21.15.69:0/4031051589 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f59ec01ca90 con 0x7f59f80fca30 2024-04-25T17:10:41.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:41.729+0000 7f59fee2e700 1 -- 172.21.15.69:0/4031051589 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59f8102f40 con 0x7f59f80fca30 2024-04-25T17:10:41.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:41.729+0000 7f59f57fa700 1 --2- 172.21.15.69:0/4031051589 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f59e80368d0 0x7f59e8038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:10:41.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:41.729+0000 7f59f57fa700 1 -- 172.21.15.69:0/4031051589 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f59ec049350 con 0x7f59f80fca30 2024-04-25T17:10:41.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:41.729+0000 7f59f7fff700 1 --2- 172.21.15.69:0/4031051589 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f59e80368d0 0x7f59e8038d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:10:41.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:41.730+0000 7f59f7fff700 1 --2- 172.21.15.69:0/4031051589 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f59e80368d0 0x7f59e8038d80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f59e4009990 tx=0x7f59e4006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:10:41.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:41.734+0000 7f59f57fa700 1 -- 172.21.15.69:0/4031051589 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f59ec011940 con 0x7f59f80fca30 2024-04-25T17:10:42.000 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:42.000+0000 7f59fee2e700 1 -- 172.21.15.69:0/4031051589 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f59f810ed70 con 0x7f59f80fca30 2024-04-25T17:10:42.000 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:42.000+0000 7f59f57fa700 1 -- 172.21.15.69:0/4031051589 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f59ec021070 con 0x7f59f80fca30 2024-04-25T17:10:42.000 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:10:42.000 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":1,"fsid":"599bb7fc-0326-11ef-bc93-c7b262605968","modified":"2024-04-25T17:08:34.994230Z","created":"2024-04-25T17:08:34.994230Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi037","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:3300","nonce":0},{"type":"v1","addr":"172.21.15.37:6789","nonce":0}]},"addr":"172.21.15.37:6789/0","public_addr":"172.21.15.37:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-25T17:10:42.002 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:42.002+0000 7f59fee2e700 1 -- 172.21.15.69:0/4031051589 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f59e80368d0 msgr2=0x7f59e8038d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:10:42.002 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:42.002+0000 7f59fee2e700 1 --2- 172.21.15.69:0/4031051589 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f59e80368d0 0x7f59e8038d80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f59e4009990 tx=0x7f59e4006e40 comp rx=0 tx=0).stop 2024-04-25T17:10:42.002 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:42.002+0000 7f59fee2e700 1 -- 172.21.15.69:0/4031051589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59f80fca30 msgr2=0x7f59f810d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:10:42.002 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:42.002+0000 7f59fee2e700 1 --2- 172.21.15.69:0/4031051589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59f80fca30 0x7f59f810d0b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f59ec009680 tx=0x7f59ec009e30 comp rx=0 tx=0).stop 2024-04-25T17:10:42.002 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:42.002+0000 7f59fee2e700 1 -- 172.21.15.69:0/4031051589 shutdown_connections 2024-04-25T17:10:42.002 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:42.002+0000 7f59fee2e700 1 --2- 172.21.15.69:0/4031051589 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f59e80368d0 0x7f59e8038d80 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:10:42.003 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:42.002+0000 7f59fee2e700 1 --2- 172.21.15.69:0/4031051589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59f80fca30 0x7f59f810d0b0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:10:42.003 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:42.002+0000 7f59fee2e700 1 -- 172.21.15.69:0/4031051589 >> 172.21.15.69:0/4031051589 conn(0x7f59f80f8170 msgr2=0x7f59f8103b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:10:42.003 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:42.002+0000 7f59fee2e700 1 -- 172.21.15.69:0/4031051589 shutdown_connections 2024-04-25T17:10:42.003 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:42.002+0000 7f59fee2e700 1 -- 172.21.15.69:0/4031051589 wait complete. 2024-04-25T17:10:42.003 INFO:teuthology.orchestra.run.smithi069.stderr:dumped monmap epoch 1 2024-04-25T17:10:43.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:42 smithi037 ceph-mon[26472]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:10:43.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:42 smithi037 ceph-mon[26472]: from='client.? 172.21.15.69:0/4031051589' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T17:10:43.576 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-25T17:10:43.577 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-25T17:10:43.822 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-25T17:10:43.869 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-25T17:10:44.994 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:44 smithi037 ceph-mon[26472]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:10:45.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:45.171+0000 7f31f71fd700 1 -- 172.21.15.69:0/1095285258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31f00fca20 msgr2=0x7f31f00fce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:10:45.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:45.171+0000 7f31f71fd700 1 --2- 172.21.15.69:0/1095285258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31f00fca20 0x7f31f00fce30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f31e40048c0 tx=0x7f31e4009e30 comp rx=0 tx=0).stop 2024-04-25T17:10:45.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:45.171+0000 7f31f71fd700 1 -- 172.21.15.69:0/1095285258 shutdown_connections 2024-04-25T17:10:45.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:45.171+0000 7f31f71fd700 1 --2- 172.21.15.69:0/1095285258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31f00fca20 0x7f31f00fce30 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:10:45.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:45.171+0000 7f31f71fd700 1 -- 172.21.15.69:0/1095285258 >> 172.21.15.69:0/1095285258 conn(0x7f31f00f81a0 msgr2=0x7f31f00fa5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:10:45.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:45.171+0000 7f31f71fd700 1 -- 172.21.15.69:0/1095285258 shutdown_connections 2024-04-25T17:10:45.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:45.171+0000 7f31f71fd700 1 -- 172.21.15.69:0/1095285258 wait complete. 2024-04-25T17:10:45.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:45.172+0000 7f31f71fd700 1 Processor -- start 2024-04-25T17:10:45.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:45.172+0000 7f31f71fd700 1 -- start start 2024-04-25T17:10:45.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:45.172+0000 7f31f71fd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31f00fca20 0x7f31f0071d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:10:45.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:45.172+0000 7f31f71fd700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f0072240 con 0x7f31f00fca20 2024-04-25T17:10:45.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:45.172+0000 7f31f4f99700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31f00fca20 0x7f31f0071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:10:45.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:45.172+0000 7f31f4f99700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31f00fca20 0x7f31f0071d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.69:56534/0 (socket says 172.21.15.69:56534) 2024-04-25T17:10:45.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:45.172+0000 7f31f4f99700 1 -- 172.21.15.69:0/1477652544 learned_addr learned my addr 172.21.15.69:0/1477652544 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-25T17:10:45.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:45.173+0000 7f31f4f99700 1 -- 172.21.15.69:0/1477652544 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e4005040 con 0x7f31f00fca20 2024-04-25T17:10:45.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:45.173+0000 7f31f4f99700 1 --2- 172.21.15.69:0/1477652544 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31f00fca20 0x7f31f0071d00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f31e40096b0 tx=0x7f31e4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:10:45.175 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:45.173+0000 7f31ed7fa700 1 -- 172.21.15.69:0/1477652544 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f31e400bed0 con 0x7f31f00fca20 2024-04-25T17:10:45.175 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:45.173+0000 7f31ed7fa700 1 -- 172.21.15.69:0/1477652544 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f31e400b5c0 con 0x7f31f00fca20 2024-04-25T17:10:45.175 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:45.173+0000 7f31f71fd700 1 -- 172.21.15.69:0/1477652544 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31f0070310 con 0x7f31f00fca20 2024-04-25T17:10:45.175 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:45.173+0000 7f31ed7fa700 1 -- 172.21.15.69:0/1477652544 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f31e401c5b0 con 0x7f31f00fca20 2024-04-25T17:10:45.175 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:45.173+0000 7f31f71fd700 1 -- 172.21.15.69:0/1477652544 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31f0070800 con 0x7f31f00fca20 2024-04-25T17:10:45.175 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:45.174+0000 7f31ed7fa700 1 -- 172.21.15.69:0/1477652544 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f31e4013a80 con 0x7f31f00fca20 2024-04-25T17:10:45.175 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:45.174+0000 7f31f71fd700 1 -- 172.21.15.69:0/1477652544 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31f005f5c0 con 0x7f31f00fca20 2024-04-25T17:10:45.175 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:45.174+0000 7f31ed7fa700 1 --2- 172.21.15.69:0/1477652544 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f31e0036880 0x7f31e0038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:10:45.175 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:45.174+0000 7f31ed7fa700 1 -- 172.21.15.69:0/1477652544 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f31e4049a00 con 0x7f31f00fca20 2024-04-25T17:10:45.175 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:45.174+0000 7f31effff700 1 --2- 172.21.15.69:0/1477652544 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f31e0036880 0x7f31e0038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:10:45.175 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:45.175+0000 7f31effff700 1 --2- 172.21.15.69:0/1477652544 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f31e0036880 0x7f31e0038d30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f31dc009990 tx=0x7f31dc006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:10:45.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:45.179+0000 7f31ed7fa700 1 -- 172.21.15.69:0/1477652544 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f31e4011960 con 0x7f31f00fca20 2024-04-25T17:10:45.438 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:45.438+0000 7f31f71fd700 1 -- 172.21.15.69:0/1477652544 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f31f0106400 con 0x7f31f00fca20 2024-04-25T17:10:45.438 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:45.439+0000 7f31ed7fa700 1 -- 172.21.15.69:0/1477652544 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f31e4011370 con 0x7f31f00fca20 2024-04-25T17:10:45.439 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:10:45.439 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":1,"fsid":"599bb7fc-0326-11ef-bc93-c7b262605968","modified":"2024-04-25T17:08:34.994230Z","created":"2024-04-25T17:08:34.994230Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi037","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:3300","nonce":0},{"type":"v1","addr":"172.21.15.37:6789","nonce":0}]},"addr":"172.21.15.37:6789/0","public_addr":"172.21.15.37:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-25T17:10:45.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:45.441+0000 7f31f71fd700 1 -- 172.21.15.69:0/1477652544 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f31e0036880 msgr2=0x7f31e0038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:10:45.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:45.441+0000 7f31f71fd700 1 --2- 172.21.15.69:0/1477652544 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f31e0036880 0x7f31e0038d30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f31dc009990 tx=0x7f31dc006e40 comp rx=0 tx=0).stop 2024-04-25T17:10:45.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:45.441+0000 7f31f71fd700 1 -- 172.21.15.69:0/1477652544 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31f00fca20 msgr2=0x7f31f0071d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:10:45.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:45.441+0000 7f31f71fd700 1 --2- 172.21.15.69:0/1477652544 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31f00fca20 0x7f31f0071d00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f31e40096b0 tx=0x7f31e4009e30 comp rx=0 tx=0).stop 2024-04-25T17:10:45.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:45.441+0000 7f31f71fd700 1 -- 172.21.15.69:0/1477652544 shutdown_connections 2024-04-25T17:10:45.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:45.441+0000 7f31f71fd700 1 --2- 172.21.15.69:0/1477652544 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f31e0036880 0x7f31e0038d30 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:10:45.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:45.441+0000 7f31f71fd700 1 --2- 172.21.15.69:0/1477652544 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31f00fca20 0x7f31f0071d00 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:10:45.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:45.441+0000 7f31f71fd700 1 -- 172.21.15.69:0/1477652544 >> 172.21.15.69:0/1477652544 conn(0x7f31f00f81a0 msgr2=0x7f31f0103b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:10:45.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:45.441+0000 7f31f71fd700 1 -- 172.21.15.69:0/1477652544 shutdown_connections 2024-04-25T17:10:45.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:45.441+0000 7f31f71fd700 1 -- 172.21.15.69:0/1477652544 wait complete. 2024-04-25T17:10:45.441 INFO:teuthology.orchestra.run.smithi069.stderr:dumped monmap epoch 1 2024-04-25T17:10:45.883 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:45 smithi037 ceph-mon[26472]: from='client.? 172.21.15.69:0/1477652544' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T17:10:46.978 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-25T17:10:46.978 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-25T17:10:47.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:46 smithi037 ceph-mon[26472]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:10:47.225 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-25T17:10:47.272 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-25T17:10:48.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:48.615+0000 7f6f3eece700 1 -- 172.21.15.69:0/3768817621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f380fca40 msgr2=0x7f6f380fce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:10:48.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:48.615+0000 7f6f3eece700 1 --2- 172.21.15.69:0/3768817621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f380fca40 0x7f6f380fce50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6f280048c0 tx=0x7f6f28009e30 comp rx=0 tx=0).stop 2024-04-25T17:10:48.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:48.615+0000 7f6f3eece700 1 -- 172.21.15.69:0/3768817621 shutdown_connections 2024-04-25T17:10:48.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:48.615+0000 7f6f3eece700 1 --2- 172.21.15.69:0/3768817621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f380fca40 0x7f6f380fce50 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:10:48.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:48.615+0000 7f6f3eece700 1 -- 172.21.15.69:0/3768817621 >> 172.21.15.69:0/3768817621 conn(0x7f6f380f81a0 msgr2=0x7f6f380fa5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:10:48.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:48.615+0000 7f6f3eece700 1 -- 172.21.15.69:0/3768817621 shutdown_connections 2024-04-25T17:10:48.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:48.615+0000 7f6f3eece700 1 -- 172.21.15.69:0/3768817621 wait complete. 2024-04-25T17:10:48.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:48.616+0000 7f6f3eece700 1 Processor -- start 2024-04-25T17:10:48.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:48.616+0000 7f6f3eece700 1 -- start start 2024-04-25T17:10:48.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:48.616+0000 7f6f3eece700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f380fca40 0x7f6f3810d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:10:48.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:48.616+0000 7f6f3eece700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3810d5d0 con 0x7f6f380fca40 2024-04-25T17:10:48.618 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:48.616+0000 7f6f3cc6a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f380fca40 0x7f6f3810d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:10:48.618 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:48.616+0000 7f6f3cc6a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f380fca40 0x7f6f3810d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.69:57264/0 (socket says 172.21.15.69:57264) 2024-04-25T17:10:48.618 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:48.616+0000 7f6f3cc6a700 1 -- 172.21.15.69:0/3266544123 learned_addr learned my addr 172.21.15.69:0/3266544123 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-25T17:10:48.618 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:48.616+0000 7f6f3cc6a700 1 -- 172.21.15.69:0/3266544123 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f28005040 con 0x7f6f380fca40 2024-04-25T17:10:48.618 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:48.617+0000 7f6f3cc6a700 1 --2- 172.21.15.69:0/3266544123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f380fca40 0x7f6f3810d090 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6f280096b0 tx=0x7f6f28009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:10:48.618 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:48.617+0000 7f6f357fa700 1 -- 172.21.15.69:0/3266544123 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6f2800bed0 con 0x7f6f380fca40 2024-04-25T17:10:48.618 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:48.617+0000 7f6f357fa700 1 -- 172.21.15.69:0/3266544123 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6f2800b5c0 con 0x7f6f380fca40 2024-04-25T17:10:48.618 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:48.617+0000 7f6f3eece700 1 -- 172.21.15.69:0/3266544123 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f3810d7d0 con 0x7f6f380fca40 2024-04-25T17:10:48.618 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:48.617+0000 7f6f357fa700 1 -- 172.21.15.69:0/3266544123 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6f2801c5b0 con 0x7f6f380fca40 2024-04-25T17:10:48.618 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:48.617+0000 7f6f3eece700 1 -- 172.21.15.69:0/3266544123 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f3810e340 con 0x7f6f380fca40 2024-04-25T17:10:48.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:48.618+0000 7f6f357fa700 1 -- 172.21.15.69:0/3266544123 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 13) v1 ==== 43432+0+0 (secure 0 0 0) 0x7f6f2801c820 con 0x7f6f380fca40 2024-04-25T17:10:48.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:48.618+0000 7f6f357fa700 1 --2- 172.21.15.69:0/3266544123 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f6f20036880 0x7f6f20038d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:10:48.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:48.618+0000 7f6f3eece700 1 -- 172.21.15.69:0/3266544123 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f38102f50 con 0x7f6f380fca40 2024-04-25T17:10:48.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:48.618+0000 7f6f357fa700 1 -- 172.21.15.69:0/3266544123 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f6f28049b90 con 0x7f6f380fca40 2024-04-25T17:10:48.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:48.618+0000 7f6f37fff700 1 --2- 172.21.15.69:0/3266544123 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f6f20036880 0x7f6f20038d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:10:48.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:48.619+0000 7f6f37fff700 1 --2- 172.21.15.69:0/3266544123 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f6f20036880 0x7f6f20038d30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c009990 tx=0x7f6f2c006e40 comp rx=0 tx=0).ready entity=mgr.14160 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:10:48.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:48.623+0000 7f6f357fa700 1 -- 172.21.15.69:0/3266544123 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f6f28013600 con 0x7f6f380fca40 2024-04-25T17:10:48.675 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:48.675+0000 7f6f357fa700 1 -- 172.21.15.69:0/3266544123 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 14) v1 ==== 43446+0+0 (secure 0 0 0) 0x7f6f28049d50 con 0x7f6f380fca40 2024-04-25T17:10:48.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:48.700+0000 7f6f37fff700 1 -- 172.21.15.69:0/3266544123 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f6f20036880 msgr2=0x7f6f20038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-04-25T17:10:48.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:48.700+0000 7f6f37fff700 1 -- 172.21.15.69:0/3266544123 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f6f20036880 msgr2=0x7f6f20038d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-25T17:10:48.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:48.700+0000 7f6f37fff700 1 --2- 172.21.15.69:0/3266544123 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f6f20036880 0x7f6f20038d30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c009990 tx=0x7f6f2c006e40 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-25T17:10:48.703 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:48.700+0000 7f6f37fff700 1 --2- 172.21.15.69:0/3266544123 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f6f20036880 0x7f6f20038d30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c009990 tx=0x7f6f2c006e40 comp rx=0 tx=0).stop 2024-04-25T17:10:48.703 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:48.700+0000 7f6f357fa700 1 -- 172.21.15.69:0/3266544123 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f6f20036880 msgr2=0x7f6f20038d30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T17:10:48.703 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:48.700+0000 7f6f357fa700 1 --2- 172.21.15.69:0/3266544123 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f6f20036880 0x7f6f20038d30 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:10:48.897 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:48.898+0000 7f6f3eece700 1 -- 172.21.15.69:0/3266544123 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f6f18005160 con 0x7f6f380fca40 2024-04-25T17:10:48.898 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:48.898+0000 7f6f357fa700 1 -- 172.21.15.69:0/3266544123 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f6f28011d00 con 0x7f6f380fca40 2024-04-25T17:10:48.898 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:10:48.898 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":1,"fsid":"599bb7fc-0326-11ef-bc93-c7b262605968","modified":"2024-04-25T17:08:34.994230Z","created":"2024-04-25T17:08:34.994230Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi037","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:3300","nonce":0},{"type":"v1","addr":"172.21.15.37:6789","nonce":0}]},"addr":"172.21.15.37:6789/0","public_addr":"172.21.15.37:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-25T17:10:48.900 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:48.900+0000 7f6f3eece700 1 -- 172.21.15.69:0/3266544123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f380fca40 msgr2=0x7f6f3810d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:10:48.900 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:48.900+0000 7f6f3eece700 1 --2- 172.21.15.69:0/3266544123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f380fca40 0x7f6f3810d090 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6f280096b0 tx=0x7f6f28009e30 comp rx=0 tx=0).stop 2024-04-25T17:10:48.900 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:48.900+0000 7f6f3eece700 1 -- 172.21.15.69:0/3266544123 shutdown_connections 2024-04-25T17:10:48.900 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:48.900+0000 7f6f3eece700 1 --2- 172.21.15.69:0/3266544123 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f6f20036880 0x7f6f20038d30 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:10:48.900 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:48.900+0000 7f6f3eece700 1 --2- 172.21.15.69:0/3266544123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f380fca40 0x7f6f3810d090 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:10:48.901 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:48.900+0000 7f6f3eece700 1 -- 172.21.15.69:0/3266544123 >> 172.21.15.69:0/3266544123 conn(0x7f6f380f81a0 msgr2=0x7f6f38103b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:10:48.901 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:48.900+0000 7f6f3eece700 1 -- 172.21.15.69:0/3266544123 shutdown_connections 2024-04-25T17:10:48.901 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:48.900+0000 7f6f3eece700 1 -- 172.21.15.69:0/3266544123 wait complete. 2024-04-25T17:10:48.901 INFO:teuthology.orchestra.run.smithi069.stderr:dumped monmap epoch 1 2024-04-25T17:10:49.015 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:48 smithi037 ceph-mon[26472]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:10:49.016 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:48 smithi037 ceph-mon[26472]: from='mgr.14160 172.21.15.37:0/1872577945' entity='mgr.smithi037.txrgxl' 2024-04-25T17:10:49.016 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:48 smithi037 ceph-mon[26472]: from='mgr.14160 172.21.15.37:0/1872577945' entity='mgr.smithi037.txrgxl' 2024-04-25T17:10:49.016 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:48 smithi037 ceph-mon[26472]: from='mgr.14160 172.21.15.37:0/1872577945' entity='mgr.smithi037.txrgxl' 2024-04-25T17:10:49.016 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:48 smithi037 ceph-mon[26472]: from='mgr.14160 172.21.15.37:0/1872577945' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-04-25T17:10:49.820 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:49 smithi037 ceph-mon[26472]: from='mgr.14160 172.21.15.37:0/1872577945' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-04-25T17:10:49.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:49 smithi037 ceph-mon[26472]: mgrmap e14: smithi037.txrgxl(active, since 69s) 2024-04-25T17:10:49.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:49 smithi037 ceph-mon[26472]: from='client.? 172.21.15.69:0/3266544123' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T17:10:50.443 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-25T17:10:50.443 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-25T17:10:50.696 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-25T17:10:50.748 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-25T17:10:52.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:52.153+0000 7f81ede8a700 1 -- 172.21.15.69:0/1425670524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81e80fca40 msgr2=0x7f81e80fce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:10:52.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:52.153+0000 7f81ede8a700 1 --2- 172.21.15.69:0/1425670524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81e80fca40 0x7f81e80fce50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f81d80048c0 tx=0x7f81d8009e30 comp rx=0 tx=0).stop 2024-04-25T17:10:52.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:52.153+0000 7f81ede8a700 1 -- 172.21.15.69:0/1425670524 shutdown_connections 2024-04-25T17:10:52.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:52.153+0000 7f81ede8a700 1 --2- 172.21.15.69:0/1425670524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81e80fca40 0x7f81e80fce50 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:10:52.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:52.153+0000 7f81ede8a700 1 -- 172.21.15.69:0/1425670524 >> 172.21.15.69:0/1425670524 conn(0x7f81e80f81c0 msgr2=0x7f81e80fa5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:10:52.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:52.153+0000 7f81ede8a700 1 -- 172.21.15.69:0/1425670524 shutdown_connections 2024-04-25T17:10:52.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:52.153+0000 7f81ede8a700 1 -- 172.21.15.69:0/1425670524 wait complete. 2024-04-25T17:10:52.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:52.154+0000 7f81ede8a700 1 Processor -- start 2024-04-25T17:10:52.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:52.154+0000 7f81ede8a700 1 -- start start 2024-04-25T17:10:52.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:52.154+0000 7f81ede8a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81e80fca40 0x7f81e810d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:10:52.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:52.154+0000 7f81ede8a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e810d5d0 con 0x7f81e80fca40 2024-04-25T17:10:52.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:52.154+0000 7f81e77fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81e80fca40 0x7f81e810d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:10:52.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:52.154+0000 7f81e77fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81e80fca40 0x7f81e810d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.69:57284/0 (socket says 172.21.15.69:57284) 2024-04-25T17:10:52.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:52.154+0000 7f81e77fe700 1 -- 172.21.15.69:0/637592231 learned_addr learned my addr 172.21.15.69:0/637592231 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-25T17:10:52.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:52.154+0000 7f81e77fe700 1 -- 172.21.15.69:0/637592231 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d8005040 con 0x7f81e80fca40 2024-04-25T17:10:52.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:52.154+0000 7f81e77fe700 1 --2- 172.21.15.69:0/637592231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81e80fca40 0x7f81e810d090 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f81d80096b0 tx=0x7f81d8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:10:52.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:52.155+0000 7f81e4ff9700 1 -- 172.21.15.69:0/637592231 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f81d800bed0 con 0x7f81e80fca40 2024-04-25T17:10:52.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:52.155+0000 7f81e4ff9700 1 -- 172.21.15.69:0/637592231 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f81d800b5c0 con 0x7f81e80fca40 2024-04-25T17:10:52.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:52.155+0000 7f81ede8a700 1 -- 172.21.15.69:0/637592231 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81e810d7d0 con 0x7f81e80fca40 2024-04-25T17:10:52.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:52.155+0000 7f81e4ff9700 1 -- 172.21.15.69:0/637592231 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f81d801c5b0 con 0x7f81e80fca40 2024-04-25T17:10:52.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:52.155+0000 7f81ede8a700 1 -- 172.21.15.69:0/637592231 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81e810e340 con 0x7f81e80fca40 2024-04-25T17:10:52.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:52.155+0000 7f81e4ff9700 1 -- 172.21.15.69:0/637592231 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 14) v1 ==== 43446+0+0 (secure 0 0 0) 0x7f81d8013420 con 0x7f81e80fca40 2024-04-25T17:10:52.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:52.156+0000 7f81ede8a700 1 -- 172.21.15.69:0/637592231 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81e8102f50 con 0x7f81e80fca40 2024-04-25T17:10:52.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:52.156+0000 7f81e4ff9700 1 --2- 172.21.15.69:0/637592231 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f81d40368d0 0x7f81d4038d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:10:52.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:52.156+0000 7f81e4ff9700 1 -- 172.21.15.69:0/637592231 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f81d8049ad0 con 0x7f81e80fca40 2024-04-25T17:10:52.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:52.156+0000 7f81dffff700 1 -- 172.21.15.69:0/637592231 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f81d40368d0 msgr2=0x7f81d4038d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.37:6800/1299348474 2024-04-25T17:10:52.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:52.156+0000 7f81dffff700 1 --2- 172.21.15.69:0/637592231 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f81d40368d0 0x7f81d4038d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T17:10:52.160 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:52.161+0000 7f81e4ff9700 1 -- 172.21.15.69:0/637592231 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f81d8013a80 con 0x7f81e80fca40 2024-04-25T17:10:52.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:52.357+0000 7f81dffff700 1 -- 172.21.15.69:0/637592231 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f81d40368d0 msgr2=0x7f81d4038d80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.37:6800/1299348474 2024-04-25T17:10:52.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:52.357+0000 7f81dffff700 1 --2- 172.21.15.69:0/637592231 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f81d40368d0 0x7f81d4038d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T17:10:52.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:52.420+0000 7f81ede8a700 1 -- 172.21.15.69:0/637592231 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f81e810ed50 con 0x7f81e80fca40 2024-04-25T17:10:52.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:52.421+0000 7f81e4ff9700 1 -- 172.21.15.69:0/637592231 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f81d8011370 con 0x7f81e80fca40 2024-04-25T17:10:52.420 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:10:52.421 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":1,"fsid":"599bb7fc-0326-11ef-bc93-c7b262605968","modified":"2024-04-25T17:08:34.994230Z","created":"2024-04-25T17:08:34.994230Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi037","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:3300","nonce":0},{"type":"v1","addr":"172.21.15.37:6789","nonce":0}]},"addr":"172.21.15.37:6789/0","public_addr":"172.21.15.37:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-25T17:10:52.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:52.423+0000 7f81ede8a700 1 -- 172.21.15.69:0/637592231 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f81d40368d0 msgr2=0x7f81d4038d80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T17:10:52.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:52.423+0000 7f81ede8a700 1 --2- 172.21.15.69:0/637592231 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f81d40368d0 0x7f81d4038d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:10:52.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:52.423+0000 7f81ede8a700 1 -- 172.21.15.69:0/637592231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81e80fca40 msgr2=0x7f81e810d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:10:52.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:52.423+0000 7f81ede8a700 1 --2- 172.21.15.69:0/637592231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81e80fca40 0x7f81e810d090 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f81d80096b0 tx=0x7f81d8009e30 comp rx=0 tx=0).stop 2024-04-25T17:10:52.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:52.423+0000 7f81ede8a700 1 -- 172.21.15.69:0/637592231 shutdown_connections 2024-04-25T17:10:52.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:52.423+0000 7f81ede8a700 1 --2- 172.21.15.69:0/637592231 >> [v2:172.21.15.37:6800/1299348474,v1:172.21.15.37:6801/1299348474] conn(0x7f81d40368d0 0x7f81d4038d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:10:52.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:52.423+0000 7f81ede8a700 1 --2- 172.21.15.69:0/637592231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81e80fca40 0x7f81e810d090 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:10:52.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:52.423+0000 7f81ede8a700 1 -- 172.21.15.69:0/637592231 >> 172.21.15.69:0/637592231 conn(0x7f81e80f81c0 msgr2=0x7f81e8103b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:10:52.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:52.423+0000 7f81ede8a700 1 -- 172.21.15.69:0/637592231 shutdown_connections 2024-04-25T17:10:52.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:52.423+0000 7f81ede8a700 1 -- 172.21.15.69:0/637592231 wait complete. 2024-04-25T17:10:52.424 INFO:teuthology.orchestra.run.smithi069.stderr:dumped monmap epoch 1 2024-04-25T17:10:52.570 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:52 smithi037 ceph-mon[26472]: from='client.? 172.21.15.69:0/637592231' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T17:10:53.959 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-25T17:10:53.960 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-25T17:10:54.211 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-25T17:10:54.257 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-25T17:10:55.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:55.619+0000 7f6e1860e700 1 -- 172.21.15.69:0/799912919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e100fbf30 msgr2=0x7f6e100fc340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:10:55.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:55.619+0000 7f6e1860e700 1 --2- 172.21.15.69:0/799912919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e100fbf30 0x7f6e100fc340 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c0048c0 tx=0x7f6e0c009e30 comp rx=0 tx=0).stop 2024-04-25T17:10:55.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:55.619+0000 7f6e1860e700 1 -- 172.21.15.69:0/799912919 shutdown_connections 2024-04-25T17:10:55.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:55.619+0000 7f6e1860e700 1 --2- 172.21.15.69:0/799912919 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e100fbf30 0x7f6e100fc340 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:10:55.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:55.620+0000 7f6e1860e700 1 -- 172.21.15.69:0/799912919 >> 172.21.15.69:0/799912919 conn(0x7f6e100f6800 msgr2=0x7f6e100f8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:10:55.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:55.620+0000 7f6e1860e700 1 -- 172.21.15.69:0/799912919 shutdown_connections 2024-04-25T17:10:55.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:55.620+0000 7f6e1860e700 1 -- 172.21.15.69:0/799912919 wait complete. 2024-04-25T17:10:55.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:55.620+0000 7f6e1860e700 1 Processor -- start 2024-04-25T17:10:55.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:55.620+0000 7f6e1860e700 1 -- start start 2024-04-25T17:10:55.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:55.620+0000 7f6e1860e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e100fbf30 0x7f6e1010bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:10:55.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:55.620+0000 7f6e1860e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1010c530 con 0x7f6e100fbf30 2024-04-25T17:10:55.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:55.620+0000 7f6e163aa700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e100fbf30 0x7f6e1010bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:10:55.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:55.620+0000 7f6e163aa700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e100fbf30 0x7f6e1010bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.69:57294/0 (socket says 172.21.15.69:57294) 2024-04-25T17:10:55.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:55.620+0000 7f6e163aa700 1 -- 172.21.15.69:0/1059068185 learned_addr learned my addr 172.21.15.69:0/1059068185 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-25T17:10:55.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:55.621+0000 7f6e163aa700 1 -- 172.21.15.69:0/1059068185 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e0c005040 con 0x7f6e100fbf30 2024-04-25T17:10:55.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:55.621+0000 7f6e163aa700 1 --2- 172.21.15.69:0/1059068185 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e100fbf30 0x7f6e1010bff0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c009680 tx=0x7f6e0c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:10:55.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:55.621+0000 7f6e06ffd700 1 -- 172.21.15.69:0/1059068185 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6e0c00bed0 con 0x7f6e100fbf30 2024-04-25T17:10:55.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:55.621+0000 7f6e1860e700 1 -- 172.21.15.69:0/1059068185 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e1010c730 con 0x7f6e100fbf30 2024-04-25T17:10:55.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:55.621+0000 7f6e06ffd700 1 -- 172.21.15.69:0/1059068185 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6e0c00b5c0 con 0x7f6e100fbf30 2024-04-25T17:10:55.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:55.621+0000 7f6e06ffd700 1 -- 172.21.15.69:0/1059068185 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6e0c01c5b0 con 0x7f6e100fbf30 2024-04-25T17:10:55.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:55.621+0000 7f6e1860e700 1 -- 172.21.15.69:0/1059068185 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e1010d2a0 con 0x7f6e100fbf30 2024-04-25T17:10:55.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:55.622+0000 7f6e1860e700 1 -- 172.21.15.69:0/1059068185 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e10101e40 con 0x7f6e100fbf30 2024-04-25T17:10:55.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:55.622+0000 7f6e06ffd700 1 -- 172.21.15.69:0/1059068185 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 15) v1 ==== 43170+0+0 (secure 0 0 0) 0x7f6e0c004d30 con 0x7f6e100fbf30 2024-04-25T17:10:55.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:55.622+0000 7f6e06ffd700 1 -- 172.21.15.69:0/1059068185 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f6e0c049630 con 0x7f6e100fbf30 2024-04-25T17:10:55.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:55.628+0000 7f6e06ffd700 1 -- 172.21.15.69:0/1059068185 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f6e0c011550 con 0x7f6e100fbf30 2024-04-25T17:10:55.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:55 smithi037 ceph-mon[26472]: Active manager daemon smithi037.txrgxl restarted 2024-04-25T17:10:55.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:55 smithi037 ceph-mon[26472]: Activating manager daemon smithi037.txrgxl 2024-04-25T17:10:55.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:55 smithi037 ceph-mon[26472]: osdmap e5: 0 total, 0 up, 0 in 2024-04-25T17:10:55.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:55 smithi037 ceph-mon[26472]: mgrmap e15: smithi037.txrgxl(active, starting, since 0.00702594s) 2024-04-25T17:10:55.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:55 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mon metadata", "id": "smithi037"}]: dispatch 2024-04-25T17:10:55.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:55 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mgr metadata", "who": "smithi037.txrgxl", "id": "smithi037.txrgxl"}]: dispatch 2024-04-25T17:10:55.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:55 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-25T17:10:55.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:55 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-25T17:10:55.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:55 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-25T17:10:55.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:55 smithi037 ceph-mon[26472]: Manager daemon smithi037.txrgxl is now available 2024-04-25T17:10:55.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:55 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:10:55.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:55 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:10:55.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:55 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:10:55.899 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:55.898+0000 7f6e1860e700 1 -- 172.21.15.69:0/1059068185 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f6e1010dcb0 con 0x7f6e100fbf30 2024-04-25T17:10:55.899 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:55.899+0000 7f6e06ffd700 1 -- 172.21.15.69:0/1059068185 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f6e0c011370 con 0x7f6e100fbf30 2024-04-25T17:10:55.899 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:10:55.899 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":1,"fsid":"599bb7fc-0326-11ef-bc93-c7b262605968","modified":"2024-04-25T17:08:34.994230Z","created":"2024-04-25T17:08:34.994230Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi037","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:3300","nonce":0},{"type":"v1","addr":"172.21.15.37:6789","nonce":0}]},"addr":"172.21.15.37:6789/0","public_addr":"172.21.15.37:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-25T17:10:55.901 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:55.901+0000 7f6e1860e700 1 -- 172.21.15.69:0/1059068185 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e100fbf30 msgr2=0x7f6e1010bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:10:55.901 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:55.901+0000 7f6e1860e700 1 --2- 172.21.15.69:0/1059068185 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e100fbf30 0x7f6e1010bff0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c009680 tx=0x7f6e0c009e30 comp rx=0 tx=0).stop 2024-04-25T17:10:55.901 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:55.901+0000 7f6e1860e700 1 -- 172.21.15.69:0/1059068185 shutdown_connections 2024-04-25T17:10:55.901 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:55.901+0000 7f6e1860e700 1 --2- 172.21.15.69:0/1059068185 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e100fbf30 0x7f6e1010bff0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:10:55.901 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:55.901+0000 7f6e1860e700 1 -- 172.21.15.69:0/1059068185 >> 172.21.15.69:0/1059068185 conn(0x7f6e100f6800 msgr2=0x7f6e10102a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:10:55.901 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:55.901+0000 7f6e1860e700 1 -- 172.21.15.69:0/1059068185 shutdown_connections 2024-04-25T17:10:55.901 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:10:55.901+0000 7f6e1860e700 1 -- 172.21.15.69:0/1059068185 wait complete. 2024-04-25T17:10:55.902 INFO:teuthology.orchestra.run.smithi069.stderr:dumped monmap epoch 1 2024-04-25T17:10:56.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:56 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:10:56.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:56 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi037.txrgxl/mirror_snapshot_schedule"}]: dispatch 2024-04-25T17:10:56.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:56 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi037.txrgxl/trash_purge_schedule"}]: dispatch 2024-04-25T17:10:56.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:56 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:10:56.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:56 smithi037 ceph-mon[26472]: from='client.? 172.21.15.69:0/1059068185' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T17:10:56.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:56 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:10:56.543 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:56 smithi037 ceph-mon[26472]: mgrmap e16: smithi037.txrgxl(active, since 1.00886s) 2024-04-25T17:10:57.531 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-25T17:10:57.531 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-25T17:10:57.965 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:57 smithi037 ceph-mon[26472]: [25/Apr/2024:17:10:55] ENGINE Bus STARTING 2024-04-25T17:10:57.966 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:57 smithi037 ceph-mon[26472]: [25/Apr/2024:17:10:55] ENGINE Serving on https://172.21.15.37:7150 2024-04-25T17:10:57.966 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:57 smithi037 ceph-mon[26472]: [25/Apr/2024:17:10:55] ENGINE Bus STARTED 2024-04-25T17:10:57.966 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:57 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:10:57.966 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:57 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:10:58.121 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-25T17:10:58.178 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /etc/ceph/ceph.conf 2024-04-25T17:10:59.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:10:59 smithi037 ceph-mon[26472]: mgrmap e17: smithi037.txrgxl(active, since 2s) 2024-04-25T17:11:00.266 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:00.264+0000 7f9c35513700 1 -- 172.21.15.69:0/398640291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c300fca30 msgr2=0x7f9c300fce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:11:00.266 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:00.264+0000 7f9c35513700 1 --2- 172.21.15.69:0/398640291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c300fca30 0x7f9c300fce40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9c240048c0 tx=0x7f9c24009e30 comp rx=0 tx=0).stop 2024-04-25T17:11:00.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:00.264+0000 7f9c35513700 1 -- 172.21.15.69:0/398640291 shutdown_connections 2024-04-25T17:11:00.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:00.264+0000 7f9c35513700 1 --2- 172.21.15.69:0/398640291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c300fca30 0x7f9c300fce40 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:11:00.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:00.264+0000 7f9c35513700 1 -- 172.21.15.69:0/398640291 >> 172.21.15.69:0/398640291 conn(0x7f9c300f8170 msgr2=0x7f9c300fa5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:11:00.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:00.264+0000 7f9c35513700 1 -- 172.21.15.69:0/398640291 shutdown_connections 2024-04-25T17:11:00.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:00.264+0000 7f9c35513700 1 -- 172.21.15.69:0/398640291 wait complete. 2024-04-25T17:11:00.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:00.265+0000 7f9c35513700 1 Processor -- start 2024-04-25T17:11:00.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:00.265+0000 7f9c35513700 1 -- start start 2024-04-25T17:11:00.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:00.265+0000 7f9c35513700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c300fca30 0x7f9c30071d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:11:00.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:00.265+0000 7f9c35513700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c30072240 con 0x7f9c300fca30 2024-04-25T17:11:00.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:00.265+0000 7f9c2effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c300fca30 0x7f9c30071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:11:00.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:00.265+0000 7f9c2effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c300fca30 0x7f9c30071d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.69:37774/0 (socket says 172.21.15.69:37774) 2024-04-25T17:11:00.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:00.265+0000 7f9c2effd700 1 -- 172.21.15.69:0/52583268 learned_addr learned my addr 172.21.15.69:0/52583268 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-25T17:11:00.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:00.266+0000 7f9c2effd700 1 -- 172.21.15.69:0/52583268 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c24005040 con 0x7f9c300fca30 2024-04-25T17:11:00.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:00.266+0000 7f9c2effd700 1 --2- 172.21.15.69:0/52583268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c300fca30 0x7f9c30071d00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9c240096b0 tx=0x7f9c24009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:11:00.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:00.266+0000 7f9c177fe700 1 -- 172.21.15.69:0/52583268 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9c2400bed0 con 0x7f9c300fca30 2024-04-25T17:11:00.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:00.266+0000 7f9c35513700 1 -- 172.21.15.69:0/52583268 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c30070310 con 0x7f9c300fca30 2024-04-25T17:11:00.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:00.266+0000 7f9c177fe700 1 -- 172.21.15.69:0/52583268 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9c2400b5c0 con 0x7f9c300fca30 2024-04-25T17:11:00.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:00.266+0000 7f9c177fe700 1 -- 172.21.15.69:0/52583268 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9c2401c5b0 con 0x7f9c300fca30 2024-04-25T17:11:00.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:00.266+0000 7f9c35513700 1 -- 172.21.15.69:0/52583268 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c30070800 con 0x7f9c300fca30 2024-04-25T17:11:00.268 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:00.267+0000 7f9c177fe700 1 -- 172.21.15.69:0/52583268 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) v1 ==== 43489+0+0 (secure 0 0 0) 0x7f9c2401c710 con 0x7f9c300fca30 2024-04-25T17:11:00.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:00.267+0000 7f9c35513700 1 -- 172.21.15.69:0/52583268 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c3005f5c0 con 0x7f9c300fca30 2024-04-25T17:11:00.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:00.267+0000 7f9c177fe700 1 --2- 172.21.15.69:0/52583268 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f9c180369c0 0x7f9c18038e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:11:00.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:00.267+0000 7f9c177fe700 1 -- 172.21.15.69:0/52583268 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f9c24049ca0 con 0x7f9c300fca30 2024-04-25T17:11:00.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:00.267+0000 7f9c2e7fc700 1 --2- 172.21.15.69:0/52583268 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f9c180369c0 0x7f9c18038e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:11:00.269 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:00.268+0000 7f9c2e7fc700 1 --2- 172.21.15.69:0/52583268 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f9c180369c0 0x7f9c18038e70 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9c20009990 tx=0x7f9c20006e40 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:11:00.272 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:00.273+0000 7f9c177fe700 1 -- 172.21.15.69:0/52583268 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f9c24025400 con 0x7f9c300fca30 2024-04-25T17:11:00.546 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:00.546+0000 7f9c35513700 1 -- 172.21.15.69:0/52583268 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f9c30106410 con 0x7f9c300fca30 2024-04-25T17:11:00.546 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:00.546+0000 7f9c177fe700 1 -- 172.21.15.69:0/52583268 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f9c24011b60 con 0x7f9c300fca30 2024-04-25T17:11:00.546 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:11:00.547 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":1,"fsid":"599bb7fc-0326-11ef-bc93-c7b262605968","modified":"2024-04-25T17:08:34.994230Z","created":"2024-04-25T17:08:34.994230Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi037","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:3300","nonce":0},{"type":"v1","addr":"172.21.15.37:6789","nonce":0}]},"addr":"172.21.15.37:6789/0","public_addr":"172.21.15.37:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-25T17:11:00.549 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:00.549+0000 7f9c35513700 1 -- 172.21.15.69:0/52583268 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f9c180369c0 msgr2=0x7f9c18038e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:11:00.550 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:00.549+0000 7f9c35513700 1 --2- 172.21.15.69:0/52583268 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f9c180369c0 0x7f9c18038e70 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f9c20009990 tx=0x7f9c20006e40 comp rx=0 tx=0).stop 2024-04-25T17:11:00.550 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:00.549+0000 7f9c35513700 1 -- 172.21.15.69:0/52583268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c300fca30 msgr2=0x7f9c30071d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:11:00.550 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:00.549+0000 7f9c35513700 1 --2- 172.21.15.69:0/52583268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c300fca30 0x7f9c30071d00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9c240096b0 tx=0x7f9c24009e30 comp rx=0 tx=0).stop 2024-04-25T17:11:00.550 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:00.550+0000 7f9c35513700 1 -- 172.21.15.69:0/52583268 shutdown_connections 2024-04-25T17:11:00.550 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:00.550+0000 7f9c35513700 1 --2- 172.21.15.69:0/52583268 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f9c180369c0 0x7f9c18038e70 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:11:00.550 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:00.550+0000 7f9c35513700 1 --2- 172.21.15.69:0/52583268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c300fca30 0x7f9c30071d00 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:11:00.550 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:00.550+0000 7f9c35513700 1 -- 172.21.15.69:0/52583268 >> 172.21.15.69:0/52583268 conn(0x7f9c300f8170 msgr2=0x7f9c30103b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:11:00.550 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:00.550+0000 7f9c35513700 1 -- 172.21.15.69:0/52583268 shutdown_connections 2024-04-25T17:11:00.550 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:00.550+0000 7f9c35513700 1 -- 172.21.15.69:0/52583268 wait complete. 2024-04-25T17:11:00.551 INFO:teuthology.orchestra.run.smithi069.stderr:dumped monmap epoch 1 2024-04-25T17:11:01.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:00 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:01.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:00 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:01.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:00 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:01.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:00 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:01.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:00 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "who": "osd/host:smithi037", "name": "osd_memory_target"}]: dispatch 2024-04-25T17:11:01.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:00 smithi037 ceph-mon[26472]: from='client.? 172.21.15.69:0/52583268' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T17:11:02.302 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-25T17:11:02.302 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-25T17:11:02.546 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T17:11:03.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:02 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:03.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:02 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:03.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:02 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:03.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:02 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:03.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:02 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "who": "osd/host:smithi069", "name": "osd_memory_target"}]: dispatch 2024-04-25T17:11:03.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:02 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:11:03.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:02 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:11:03.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:02 smithi037 ceph-mon[26472]: Updating smithi037:/etc/ceph/ceph.conf 2024-04-25T17:11:03.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:02 smithi037 ceph-mon[26472]: Updating smithi069:/etc/ceph/ceph.conf 2024-04-25T17:11:03.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:02 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:03.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:02 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:03.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:02 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:03.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:02 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:03.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:02 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:03.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:02 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi069", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-25T17:11:03.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:02 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi069", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-04-25T17:11:03.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:02 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:11:03.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:03.903+0000 7fa662d2f700 1 -- 172.21.15.69:0/2958814546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa65c0fda70 msgr2=0x7fa65c0fde40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:11:03.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:03.903+0000 7fa662d2f700 1 --2- 172.21.15.69:0/2958814546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa65c0fda70 0x7fa65c0fde40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa654009c60 tx=0x7fa654004d10 comp rx=0 tx=0).stop 2024-04-25T17:11:03.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:03.903+0000 7fa662d2f700 1 -- 172.21.15.69:0/2958814546 shutdown_connections 2024-04-25T17:11:03.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:03.903+0000 7fa662d2f700 1 --2- 172.21.15.69:0/2958814546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa65c0fda70 0x7fa65c0fde40 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:11:03.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:03.903+0000 7fa662d2f700 1 -- 172.21.15.69:0/2958814546 >> 172.21.15.69:0/2958814546 conn(0x7fa65c071800 msgr2=0x7fa65c071c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:11:03.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:03.903+0000 7fa662d2f700 1 -- 172.21.15.69:0/2958814546 shutdown_connections 2024-04-25T17:11:03.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:03.903+0000 7fa662d2f700 1 -- 172.21.15.69:0/2958814546 wait complete. 2024-04-25T17:11:03.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:03.904+0000 7fa662d2f700 1 Processor -- start 2024-04-25T17:11:03.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:03.904+0000 7fa662d2f700 1 -- start start 2024-04-25T17:11:03.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:03.904+0000 7fa662d2f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa65c0fda70 0x7fa65c113190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:11:03.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:03.904+0000 7fa662d2f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa65c1136d0 con 0x7fa65c0fda70 2024-04-25T17:11:03.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:03.904+0000 7fa660acb700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa65c0fda70 0x7fa65c113190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:11:03.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:03.904+0000 7fa660acb700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa65c0fda70 0x7fa65c113190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.69:37802/0 (socket says 172.21.15.69:37802) 2024-04-25T17:11:03.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:03.904+0000 7fa660acb700 1 -- 172.21.15.69:0/169361301 learned_addr learned my addr 172.21.15.69:0/169361301 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-25T17:11:03.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:03.905+0000 7fa660acb700 1 -- 172.21.15.69:0/169361301 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa654009940 con 0x7fa65c0fda70 2024-04-25T17:11:03.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:03.905+0000 7fa660acb700 1 --2- 172.21.15.69:0/169361301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa65c0fda70 0x7fa65c113190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa65400b740 tx=0x7fa654004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:11:03.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:03.905+0000 7fa6597fa700 1 -- 172.21.15.69:0/169361301 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa654007b30 con 0x7fa65c0fda70 2024-04-25T17:11:03.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:03.905+0000 7fa6597fa700 1 -- 172.21.15.69:0/169361301 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa65401d910 con 0x7fa65c0fda70 2024-04-25T17:11:03.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:03.905+0000 7fa662d2f700 1 -- 172.21.15.69:0/169361301 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa65c1138d0 con 0x7fa65c0fda70 2024-04-25T17:11:03.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:03.905+0000 7fa6597fa700 1 -- 172.21.15.69:0/169361301 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa6540128b0 con 0x7fa65c0fda70 2024-04-25T17:11:03.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:03.905+0000 7fa662d2f700 1 -- 172.21.15.69:0/169361301 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa65c113d40 con 0x7fa65c0fda70 2024-04-25T17:11:03.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:03.906+0000 7fa6597fa700 1 -- 172.21.15.69:0/169361301 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) v1 ==== 43489+0+0 (secure 0 0 0) 0x7fa654019040 con 0x7fa65c0fda70 2024-04-25T17:11:03.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:03.906+0000 7fa662d2f700 1 -- 172.21.15.69:0/169361301 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa65c0658b0 con 0x7fa65c0fda70 2024-04-25T17:11:03.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:03.906+0000 7fa6597fa700 1 --2- 172.21.15.69:0/169361301 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fa648036970 0x7fa648038e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:11:03.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:03.906+0000 7fa6597fa700 1 -- 172.21.15.69:0/169361301 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fa65404a440 con 0x7fa65c0fda70 2024-04-25T17:11:03.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:03.906+0000 7fa65bfff700 1 --2- 172.21.15.69:0/169361301 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fa648036970 0x7fa648038e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:11:03.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:03.907+0000 7fa65bfff700 1 --2- 172.21.15.69:0/169361301 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fa648036970 0x7fa648038e20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa64c009990 tx=0x7fa64c006e40 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:11:03.911 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:03.911+0000 7fa6597fa700 1 -- 172.21.15.69:0/169361301 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fa65402ed20 con 0x7fa65c0fda70 2024-04-25T17:11:04.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:03 smithi037 ceph-mon[26472]: Updating smithi037:/var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T17:11:04.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:03 smithi037 ceph-mon[26472]: Updating smithi069:/var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T17:11:04.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:03 smithi037 ceph-mon[26472]: Updating smithi069:/etc/ceph/ceph.client.admin.keyring 2024-04-25T17:11:04.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:03 smithi037 ceph-mon[26472]: Updating smithi037:/etc/ceph/ceph.client.admin.keyring 2024-04-25T17:11:04.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:03 smithi037 ceph-mon[26472]: Updating smithi069:/var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T17:11:04.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:03 smithi037 ceph-mon[26472]: Updating smithi037:/var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T17:11:04.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:03 smithi037 ceph-mon[26472]: Deploying daemon crash.smithi069 on smithi069 2024-04-25T17:11:04.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:04.185+0000 7fa662d2f700 1 -- 172.21.15.69:0/169361301 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa65c04bf60 con 0x7fa65c0fda70 2024-04-25T17:11:04.185 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:04.185+0000 7fa6597fa700 1 -- 172.21.15.69:0/169361301 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fa654017020 con 0x7fa65c0fda70 2024-04-25T17:11:04.185 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:11:04.185 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":1,"fsid":"599bb7fc-0326-11ef-bc93-c7b262605968","modified":"2024-04-25T17:08:34.994230Z","created":"2024-04-25T17:08:34.994230Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi037","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:3300","nonce":0},{"type":"v1","addr":"172.21.15.37:6789","nonce":0}]},"addr":"172.21.15.37:6789/0","public_addr":"172.21.15.37:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-25T17:11:04.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:04.187+0000 7fa662d2f700 1 -- 172.21.15.69:0/169361301 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fa648036970 msgr2=0x7fa648038e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:11:04.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:04.187+0000 7fa662d2f700 1 --2- 172.21.15.69:0/169361301 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fa648036970 0x7fa648038e20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa64c009990 tx=0x7fa64c006e40 comp rx=0 tx=0).stop 2024-04-25T17:11:04.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:04.187+0000 7fa662d2f700 1 -- 172.21.15.69:0/169361301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa65c0fda70 msgr2=0x7fa65c113190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:11:04.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:04.187+0000 7fa662d2f700 1 --2- 172.21.15.69:0/169361301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa65c0fda70 0x7fa65c113190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa65400b740 tx=0x7fa654004d10 comp rx=0 tx=0).stop 2024-04-25T17:11:04.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:04.187+0000 7fa662d2f700 1 -- 172.21.15.69:0/169361301 shutdown_connections 2024-04-25T17:11:04.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:04.187+0000 7fa662d2f700 1 --2- 172.21.15.69:0/169361301 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fa648036970 0x7fa648038e20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:11:04.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:04.187+0000 7fa662d2f700 1 --2- 172.21.15.69:0/169361301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa65c0fda70 0x7fa65c113190 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:11:04.187 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:04.187+0000 7fa662d2f700 1 -- 172.21.15.69:0/169361301 >> 172.21.15.69:0/169361301 conn(0x7fa65c071800 msgr2=0x7fa65c103640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:11:04.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:04.187+0000 7fa662d2f700 1 -- 172.21.15.69:0/169361301 shutdown_connections 2024-04-25T17:11:04.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:04.187+0000 7fa662d2f700 1 -- 172.21.15.69:0/169361301 wait complete. 2024-04-25T17:11:04.188 INFO:teuthology.orchestra.run.smithi069.stderr:dumped monmap epoch 1 2024-04-25T17:11:05.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:04 smithi037 ceph-mon[26472]: from='client.? 172.21.15.69:0/169361301' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T17:11:05.806 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-25T17:11:05.806 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-25T17:11:06.089 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T17:11:08.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:08.036+0000 7f09a3019700 1 -- 172.21.15.69:0/3763169384 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f099c1019d0 msgr2=0x7f099c101da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:11:08.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:08.036+0000 7f09a3019700 1 --2- 172.21.15.69:0/3763169384 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f099c1019d0 0x7f099c101da0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f09900048c0 tx=0x7f0990009e30 comp rx=0 tx=0).stop 2024-04-25T17:11:08.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:08.036+0000 7f09a3019700 1 -- 172.21.15.69:0/3763169384 shutdown_connections 2024-04-25T17:11:08.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:08.036+0000 7f09a3019700 1 --2- 172.21.15.69:0/3763169384 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f099c1019d0 0x7f099c101da0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:11:08.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:08.036+0000 7f09a3019700 1 -- 172.21.15.69:0/3763169384 >> 172.21.15.69:0/3763169384 conn(0x7f099c073090 msgr2=0x7f099c073490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:11:08.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:08.036+0000 7f09a3019700 1 -- 172.21.15.69:0/3763169384 shutdown_connections 2024-04-25T17:11:08.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:08.036+0000 7f09a3019700 1 -- 172.21.15.69:0/3763169384 wait complete. 2024-04-25T17:11:08.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:08.036+0000 7f09a3019700 1 Processor -- start 2024-04-25T17:11:08.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:08.036+0000 7f09a3019700 1 -- start start 2024-04-25T17:11:08.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:08.037+0000 7f09a3019700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f099c1019d0 0x7f099c10e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:11:08.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:08.037+0000 7f09a3019700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f099c10e5f0 con 0x7f099c1019d0 2024-04-25T17:11:08.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:08.037+0000 7f09a0db5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f099c1019d0 0x7f099c10e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:11:08.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:08.037+0000 7f09a0db5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f099c1019d0 0x7f099c10e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.69:37840/0 (socket says 172.21.15.69:37840) 2024-04-25T17:11:08.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:08.037+0000 7f09a0db5700 1 -- 172.21.15.69:0/222176098 learned_addr learned my addr 172.21.15.69:0/222176098 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-25T17:11:08.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:08.037+0000 7f09a0db5700 1 -- 172.21.15.69:0/222176098 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0990005040 con 0x7f099c1019d0 2024-04-25T17:11:08.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:08.038+0000 7f09a0db5700 1 --2- 172.21.15.69:0/222176098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f099c1019d0 0x7f099c10e0b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f099000b820 tx=0x7f0990009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:11:08.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:08.038+0000 7f09997fa700 1 -- 172.21.15.69:0/222176098 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f09900093f0 con 0x7f099c1019d0 2024-04-25T17:11:08.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:08.038+0000 7f09997fa700 1 -- 172.21.15.69:0/222176098 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0990013420 con 0x7f099c1019d0 2024-04-25T17:11:08.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:08.038+0000 7f09a3019700 1 -- 172.21.15.69:0/222176098 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f099c10e7f0 con 0x7f099c1019d0 2024-04-25T17:11:08.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:08.038+0000 7f09997fa700 1 -- 172.21.15.69:0/222176098 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f099001c570 con 0x7f099c1019d0 2024-04-25T17:11:08.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:08.038+0000 7f09a3019700 1 -- 172.21.15.69:0/222176098 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f099c10ec60 con 0x7f099c1019d0 2024-04-25T17:11:08.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:08.039+0000 7f09a3019700 1 -- 172.21.15.69:0/222176098 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f099c103990 con 0x7f099c1019d0 2024-04-25T17:11:08.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:08.039+0000 7f09997fa700 1 -- 172.21.15.69:0/222176098 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) v1 ==== 43489+0+0 (secure 0 0 0) 0x7f0990009550 con 0x7f099c1019d0 2024-04-25T17:11:08.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:08.039+0000 7f09997fa700 1 --2- 172.21.15.69:0/222176098 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f098c036970 0x7f098c038e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:11:08.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:08.039+0000 7f09997fa700 1 -- 172.21.15.69:0/222176098 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f0990049b70 con 0x7f099c1019d0 2024-04-25T17:11:08.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:08.039+0000 7f099bfff700 1 --2- 172.21.15.69:0/222176098 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f098c036970 0x7f098c038e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:11:08.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:08.039+0000 7f099bfff700 1 --2- 172.21.15.69:0/222176098 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f098c036970 0x7f098c038e20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0988009990 tx=0x7f0988006e40 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:11:08.045 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:08.044+0000 7f09997fa700 1 -- 172.21.15.69:0/222176098 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f0990013a70 con 0x7f099c1019d0 2024-04-25T17:11:08.329 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:11:08.329 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":1,"fsid":"599bb7fc-0326-11ef-bc93-c7b262605968","modified":"2024-04-25T17:08:34.994230Z","created":"2024-04-25T17:08:34.994230Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi037","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:3300","nonce":0},{"type":"v1","addr":"172.21.15.37:6789","nonce":0}]},"addr":"172.21.15.37:6789/0","public_addr":"172.21.15.37:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-25T17:11:08.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:08.324+0000 7f09a3019700 1 -- 172.21.15.69:0/222176098 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f099c0fd150 con 0x7f099c1019d0 2024-04-25T17:11:08.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:08.325+0000 7f09997fa700 1 -- 172.21.15.69:0/222176098 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f0990011370 con 0x7f099c1019d0 2024-04-25T17:11:08.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:08.328+0000 7f09a3019700 1 -- 172.21.15.69:0/222176098 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f098c036970 msgr2=0x7f098c038e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:11:08.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:08.328+0000 7f09a3019700 1 --2- 172.21.15.69:0/222176098 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f098c036970 0x7f098c038e20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0988009990 tx=0x7f0988006e40 comp rx=0 tx=0).stop 2024-04-25T17:11:08.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:08.328+0000 7f09a3019700 1 -- 172.21.15.69:0/222176098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f099c1019d0 msgr2=0x7f099c10e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:11:08.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:08.328+0000 7f09a3019700 1 --2- 172.21.15.69:0/222176098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f099c1019d0 0x7f099c10e0b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f099000b820 tx=0x7f0990009e30 comp rx=0 tx=0).stop 2024-04-25T17:11:08.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:08.328+0000 7f09a3019700 1 -- 172.21.15.69:0/222176098 shutdown_connections 2024-04-25T17:11:08.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:08.328+0000 7f09a3019700 1 --2- 172.21.15.69:0/222176098 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f098c036970 0x7f098c038e20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:11:08.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:08.328+0000 7f09a3019700 1 --2- 172.21.15.69:0/222176098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f099c1019d0 0x7f099c10e0b0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:11:08.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:08.328+0000 7f09a3019700 1 -- 172.21.15.69:0/222176098 >> 172.21.15.69:0/222176098 conn(0x7f099c073090 msgr2=0x7f099c1026e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:11:08.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:08.329+0000 7f09a3019700 1 -- 172.21.15.69:0/222176098 shutdown_connections 2024-04-25T17:11:08.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:08.329+0000 7f09a3019700 1 -- 172.21.15.69:0/222176098 wait complete. 2024-04-25T17:11:08.331 INFO:teuthology.orchestra.run.smithi069.stderr:dumped monmap epoch 1 2024-04-25T17:11:09.053 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:08 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:09.053 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:08 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:09.053 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:08 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:09.053 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:08 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:09.054 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:08 smithi037 ceph-mon[26472]: Deploying daemon node-exporter.smithi069 on smithi069 2024-04-25T17:11:09.054 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:08 smithi037 ceph-mon[26472]: from='client.? 172.21.15.69:0/222176098' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T17:11:09.892 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-25T17:11:09.892 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-25T17:11:10.153 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T17:11:11.820 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:11 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:11.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:11 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:11:12.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:12.219+0000 7f3712b1e700 1 -- 172.21.15.69:0/4114335281 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f370c0fda40 msgr2=0x7f370c0fde10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:11:12.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:12.219+0000 7f3712b1e700 1 --2- 172.21.15.69:0/4114335281 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f370c0fda40 0x7f370c0fde10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f37000048c0 tx=0x7f3700009e30 comp rx=0 tx=0).stop 2024-04-25T17:11:12.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:12.219+0000 7f3712b1e700 1 -- 172.21.15.69:0/4114335281 shutdown_connections 2024-04-25T17:11:12.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:12.219+0000 7f3712b1e700 1 --2- 172.21.15.69:0/4114335281 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f370c0fda40 0x7f370c0fde10 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:11:12.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:12.219+0000 7f3712b1e700 1 -- 172.21.15.69:0/4114335281 >> 172.21.15.69:0/4114335281 conn(0x7f370c0f74c0 msgr2=0x7f370c0f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:11:12.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:12.219+0000 7f3712b1e700 1 -- 172.21.15.69:0/4114335281 shutdown_connections 2024-04-25T17:11:12.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:12.219+0000 7f3712b1e700 1 -- 172.21.15.69:0/4114335281 wait complete. 2024-04-25T17:11:12.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:12.220+0000 7f3712b1e700 1 Processor -- start 2024-04-25T17:11:12.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:12.220+0000 7f3712b1e700 1 -- start start 2024-04-25T17:11:12.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:12.220+0000 7f3712b1e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f370c0fda40 0x7f370c112040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:11:12.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:12.220+0000 7f3712b1e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f370c112580 con 0x7f370c0fda40 2024-04-25T17:11:12.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:12.220+0000 7f37108ba700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f370c0fda40 0x7f370c112040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:11:12.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:12.220+0000 7f37108ba700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f370c0fda40 0x7f370c112040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.69:33142/0 (socket says 172.21.15.69:33142) 2024-04-25T17:11:12.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:12.220+0000 7f37108ba700 1 -- 172.21.15.69:0/2806200691 learned_addr learned my addr 172.21.15.69:0/2806200691 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-25T17:11:12.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:12.220+0000 7f37108ba700 1 -- 172.21.15.69:0/2806200691 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3700005040 con 0x7f370c0fda40 2024-04-25T17:11:12.222 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:12.221+0000 7f37108ba700 1 --2- 172.21.15.69:0/2806200691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f370c0fda40 0x7f370c112040 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f370000b820 tx=0x7f3700009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:11:12.223 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:12.221+0000 7f37097fa700 1 -- 172.21.15.69:0/2806200691 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f37000093c0 con 0x7f370c0fda40 2024-04-25T17:11:12.223 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:12.221+0000 7f3712b1e700 1 -- 172.21.15.69:0/2806200691 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f370c112720 con 0x7f370c0fda40 2024-04-25T17:11:12.223 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:12.221+0000 7f37097fa700 1 -- 172.21.15.69:0/2806200691 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3700013420 con 0x7f370c0fda40 2024-04-25T17:11:12.223 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:12.221+0000 7f37097fa700 1 -- 172.21.15.69:0/2806200691 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f370001c5b0 con 0x7f370c0fda40 2024-04-25T17:11:12.223 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:12.221+0000 7f3712b1e700 1 -- 172.21.15.69:0/2806200691 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f370c112b90 con 0x7f370c0fda40 2024-04-25T17:11:12.223 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:12.222+0000 7f37097fa700 1 -- 172.21.15.69:0/2806200691 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) v1 ==== 43489+0+0 (secure 0 0 0) 0x7f3700009520 con 0x7f370c0fda40 2024-04-25T17:11:12.223 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:12.222+0000 7f3712b1e700 1 -- 172.21.15.69:0/2806200691 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f370c066520 con 0x7f370c0fda40 2024-04-25T17:11:12.223 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:12.222+0000 7f37097fa700 1 --2- 172.21.15.69:0/2806200691 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f36fc036970 0x7f36fc038e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:11:12.223 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:12.222+0000 7f37097fa700 1 -- 172.21.15.69:0/2806200691 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f3700049aa0 con 0x7f370c0fda40 2024-04-25T17:11:12.223 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:12.222+0000 7f370bfff700 1 --2- 172.21.15.69:0/2806200691 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f36fc036970 0x7f36fc038e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:11:12.223 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:12.222+0000 7f370bfff700 1 --2- 172.21.15.69:0/2806200691 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f36fc036970 0x7f36fc038e20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f36f8009990 tx=0x7f36f8006e40 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:11:12.227 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:12.227+0000 7f37097fa700 1 -- 172.21.15.69:0/2806200691 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f3700013a90 con 0x7f370c0fda40 2024-04-25T17:11:12.517 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:12.516+0000 7f3712b1e700 1 -- 172.21.15.69:0/2806200691 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f370c106de0 con 0x7f370c0fda40 2024-04-25T17:11:12.517 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:12.517+0000 7f37097fa700 1 -- 172.21.15.69:0/2806200691 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f3700011370 con 0x7f370c0fda40 2024-04-25T17:11:12.517 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:11:12.517 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":1,"fsid":"599bb7fc-0326-11ef-bc93-c7b262605968","modified":"2024-04-25T17:08:34.994230Z","created":"2024-04-25T17:08:34.994230Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi037","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:3300","nonce":0},{"type":"v1","addr":"172.21.15.37:6789","nonce":0}]},"addr":"172.21.15.37:6789/0","public_addr":"172.21.15.37:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-25T17:11:12.519 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:12.519+0000 7f3712b1e700 1 -- 172.21.15.69:0/2806200691 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f36fc036970 msgr2=0x7f36fc038e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:11:12.519 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:12.519+0000 7f3712b1e700 1 --2- 172.21.15.69:0/2806200691 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f36fc036970 0x7f36fc038e20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f36f8009990 tx=0x7f36f8006e40 comp rx=0 tx=0).stop 2024-04-25T17:11:12.519 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:12.519+0000 7f3712b1e700 1 -- 172.21.15.69:0/2806200691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f370c0fda40 msgr2=0x7f370c112040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:11:12.519 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:12.519+0000 7f3712b1e700 1 --2- 172.21.15.69:0/2806200691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f370c0fda40 0x7f370c112040 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f370000b820 tx=0x7f3700009e30 comp rx=0 tx=0).stop 2024-04-25T17:11:12.519 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:12.519+0000 7f3712b1e700 1 -- 172.21.15.69:0/2806200691 shutdown_connections 2024-04-25T17:11:12.519 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:12.519+0000 7f3712b1e700 1 --2- 172.21.15.69:0/2806200691 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f36fc036970 0x7f36fc038e20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:11:12.519 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:12.519+0000 7f3712b1e700 1 --2- 172.21.15.69:0/2806200691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f370c0fda40 0x7f370c112040 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:11:12.519 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:12.519+0000 7f3712b1e700 1 -- 172.21.15.69:0/2806200691 >> 172.21.15.69:0/2806200691 conn(0x7f370c0f74c0 msgr2=0x7f370c1036a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:11:12.519 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:12.519+0000 7f3712b1e700 1 -- 172.21.15.69:0/2806200691 shutdown_connections 2024-04-25T17:11:12.519 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:12.519+0000 7f3712b1e700 1 -- 172.21.15.69:0/2806200691 wait complete. 2024-04-25T17:11:12.520 INFO:teuthology.orchestra.run.smithi069.stderr:dumped monmap epoch 1 2024-04-25T17:11:12.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:12 smithi037 ceph-mon[26472]: from='client.? 172.21.15.69:0/2806200691' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T17:11:14.382 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-25T17:11:14.382 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-25T17:11:15.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:14 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:15.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:14 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:15.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:14 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:15.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:14 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:15.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:14 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi069.mmuhdo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T17:11:15.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:14 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi069.mmuhdo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-04-25T17:11:15.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:14 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T17:11:15.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:14 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:11:15.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:14 smithi037 ceph-mon[26472]: Deploying daemon mgr.smithi069.mmuhdo on smithi069 2024-04-25T17:11:15.479 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T17:11:16.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:16 smithi037 ceph-mon[26472]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:11:16.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:16 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:17.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:17.193+0000 7f33e0409700 1 -- 172.21.15.69:0/1674052534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33d8102ab0 msgr2=0x7f33d8102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:11:17.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:17.193+0000 7f33e0409700 1 --2- 172.21.15.69:0/1674052534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33d8102ab0 0x7f33d8102e80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f33c8009c60 tx=0x7f33c8004d10 comp rx=0 tx=0).stop 2024-04-25T17:11:17.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:17.193+0000 7f33e0409700 1 -- 172.21.15.69:0/1674052534 shutdown_connections 2024-04-25T17:11:17.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:17.193+0000 7f33e0409700 1 --2- 172.21.15.69:0/1674052534 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33d8102ab0 0x7f33d8102e80 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:11:17.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:17.193+0000 7f33e0409700 1 -- 172.21.15.69:0/1674052534 >> 172.21.15.69:0/1674052534 conn(0x7f33d80f85b0 msgr2=0x7f33d80fa9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:11:17.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:17.193+0000 7f33e0409700 1 -- 172.21.15.69:0/1674052534 shutdown_connections 2024-04-25T17:11:17.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:17.193+0000 7f33e0409700 1 -- 172.21.15.69:0/1674052534 wait complete. 2024-04-25T17:11:17.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:17.194+0000 7f33e0409700 1 Processor -- start 2024-04-25T17:11:17.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:17.194+0000 7f33e0409700 1 -- start start 2024-04-25T17:11:17.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:17.194+0000 7f33e0409700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33d8102ab0 0x7f33d8113140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:11:17.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:17.194+0000 7f33e0409700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d8113680 con 0x7f33d8102ab0 2024-04-25T17:11:17.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:17.194+0000 7f33de1a5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33d8102ab0 0x7f33d8113140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:11:17.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:17.194+0000 7f33de1a5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33d8102ab0 0x7f33d8113140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.69:33148/0 (socket says 172.21.15.69:33148) 2024-04-25T17:11:17.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:17.195+0000 7f33de1a5700 1 -- 172.21.15.69:0/1746486552 learned_addr learned my addr 172.21.15.69:0/1746486552 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-25T17:11:17.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:17.195+0000 7f33de1a5700 1 -- 172.21.15.69:0/1746486552 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c8009940 con 0x7f33d8102ab0 2024-04-25T17:11:17.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:17.195+0000 7f33de1a5700 1 --2- 172.21.15.69:0/1746486552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33d8102ab0 0x7f33d8113140 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f33c800b740 tx=0x7f33c8004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:11:17.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:17.195+0000 7f33d6ffd700 1 -- 172.21.15.69:0/1746486552 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f33c8007b30 con 0x7f33d8102ab0 2024-04-25T17:11:17.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:17.195+0000 7f33e0409700 1 -- 172.21.15.69:0/1746486552 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33d8113880 con 0x7f33d8102ab0 2024-04-25T17:11:17.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:17.195+0000 7f33d6ffd700 1 -- 172.21.15.69:0/1746486552 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f33c801d910 con 0x7f33d8102ab0 2024-04-25T17:11:17.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:17.195+0000 7f33d6ffd700 1 -- 172.21.15.69:0/1746486552 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f33c80128b0 con 0x7f33d8102ab0 2024-04-25T17:11:17.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:17.195+0000 7f33e0409700 1 -- 172.21.15.69:0/1746486552 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33d8113d70 con 0x7f33d8102ab0 2024-04-25T17:11:17.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:17.196+0000 7f33e0409700 1 -- 172.21.15.69:0/1746486552 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33d80fe1b0 con 0x7f33d8102ab0 2024-04-25T17:11:17.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:17.196+0000 7f33d6ffd700 1 -- 172.21.15.69:0/1746486552 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) v1 ==== 43489+0+0 (secure 0 0 0) 0x7f33c8019040 con 0x7f33d8102ab0 2024-04-25T17:11:17.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:17.196+0000 7f33d6ffd700 1 --2- 172.21.15.69:0/1746486552 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f33c0036970 0x7f33c0038e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:11:17.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:17.197+0000 7f33d6ffd700 1 -- 172.21.15.69:0/1746486552 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f33c804a400 con 0x7f33d8102ab0 2024-04-25T17:11:17.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:17.197+0000 7f33dd9a4700 1 --2- 172.21.15.69:0/1746486552 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f33c0036970 0x7f33c0038e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:11:17.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:17.197+0000 7f33dd9a4700 1 --2- 172.21.15.69:0/1746486552 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f33c0036970 0x7f33c0038e20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f33cc009990 tx=0x7f33cc006e40 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:11:17.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:17.202+0000 7f33d6ffd700 1 -- 172.21.15.69:0/1746486552 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f33c802ed20 con 0x7f33d8102ab0 2024-04-25T17:11:17.492 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:17.492+0000 7f33e0409700 1 -- 172.21.15.69:0/1746486552 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f33d805f5c0 con 0x7f33d8102ab0 2024-04-25T17:11:17.493 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:17.493+0000 7f33d6ffd700 1 -- 172.21.15.69:0/1746486552 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f33c8017020 con 0x7f33d8102ab0 2024-04-25T17:11:17.493 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:11:17.493 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":1,"fsid":"599bb7fc-0326-11ef-bc93-c7b262605968","modified":"2024-04-25T17:08:34.994230Z","created":"2024-04-25T17:08:34.994230Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi037","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:3300","nonce":0},{"type":"v1","addr":"172.21.15.37:6789","nonce":0}]},"addr":"172.21.15.37:6789/0","public_addr":"172.21.15.37:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-25T17:11:17.495 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:17.495+0000 7f33e0409700 1 -- 172.21.15.69:0/1746486552 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f33c0036970 msgr2=0x7f33c0038e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:11:17.495 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:17.495+0000 7f33e0409700 1 --2- 172.21.15.69:0/1746486552 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f33c0036970 0x7f33c0038e20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f33cc009990 tx=0x7f33cc006e40 comp rx=0 tx=0).stop 2024-04-25T17:11:17.495 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:17.495+0000 7f33e0409700 1 -- 172.21.15.69:0/1746486552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33d8102ab0 msgr2=0x7f33d8113140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:11:17.495 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:17.495+0000 7f33e0409700 1 --2- 172.21.15.69:0/1746486552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33d8102ab0 0x7f33d8113140 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f33c800b740 tx=0x7f33c8004d10 comp rx=0 tx=0).stop 2024-04-25T17:11:17.495 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:17.495+0000 7f33e0409700 1 -- 172.21.15.69:0/1746486552 shutdown_connections 2024-04-25T17:11:17.495 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:17.495+0000 7f33e0409700 1 --2- 172.21.15.69:0/1746486552 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f33c0036970 0x7f33c0038e20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:11:17.495 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:17.495+0000 7f33e0409700 1 --2- 172.21.15.69:0/1746486552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33d8102ab0 0x7f33d8113140 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:11:17.495 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:17.495+0000 7f33e0409700 1 -- 172.21.15.69:0/1746486552 >> 172.21.15.69:0/1746486552 conn(0x7f33d80f85b0 msgr2=0x7f33d80f9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:11:17.495 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:17.495+0000 7f33e0409700 1 -- 172.21.15.69:0/1746486552 shutdown_connections 2024-04-25T17:11:17.495 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:17.495+0000 7f33e0409700 1 -- 172.21.15.69:0/1746486552 wait complete. 2024-04-25T17:11:17.496 INFO:teuthology.orchestra.run.smithi069.stderr:dumped monmap epoch 1 2024-04-25T17:11:18.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:18 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:18.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:18 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:18.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:18 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:18.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:18 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:18.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:18 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T17:11:18.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:18 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:11:18.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:18 smithi037 ceph-mon[26472]: Deploying daemon mon.smithi069 on smithi069 2024-04-25T17:11:18.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:18 smithi037 ceph-mon[26472]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:11:18.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:18 smithi037 ceph-mon[26472]: from='client.? 172.21.15.69:0/1746486552' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T17:11:19.117 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-25T17:11:19.117 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-25T17:11:20.135 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi069/config 2024-04-25T17:11:20.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:20 smithi037 ceph-mon[26472]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:11:20.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:20 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:21.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:21.740+0000 7fa3a7a5f700 1 -- 172.21.15.69:0/1999973461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3a0102b60 msgr2=0x7fa3a0102f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:11:21.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:21.740+0000 7fa3a7a5f700 1 --2- 172.21.15.69:0/1999973461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3a0102b60 0x7fa3a0102f30 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa3900048c0 tx=0x7fa390009e30 comp rx=0 tx=0).stop 2024-04-25T17:11:21.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:21.740+0000 7fa3a7a5f700 1 -- 172.21.15.69:0/1999973461 shutdown_connections 2024-04-25T17:11:21.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:21.740+0000 7fa3a7a5f700 1 --2- 172.21.15.69:0/1999973461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3a0102b60 0x7fa3a0102f30 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:11:21.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:21.740+0000 7fa3a7a5f700 1 -- 172.21.15.69:0/1999973461 >> 172.21.15.69:0/1999973461 conn(0x7fa3a00f86d0 msgr2=0x7fa3a00faae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:11:21.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:21.740+0000 7fa3a7a5f700 1 -- 172.21.15.69:0/1999973461 shutdown_connections 2024-04-25T17:11:21.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:21.740+0000 7fa3a7a5f700 1 -- 172.21.15.69:0/1999973461 wait complete. 2024-04-25T17:11:21.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:21.741+0000 7fa3a7a5f700 1 Processor -- start 2024-04-25T17:11:21.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:21.741+0000 7fa3a7a5f700 1 -- start start 2024-04-25T17:11:21.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:21.741+0000 7fa3a7a5f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3a0102b60 0x7fa3a0113220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:11:21.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:21.741+0000 7fa3a7a5f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a0113760 con 0x7fa3a0102b60 2024-04-25T17:11:21.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:21.742+0000 7fa3a57fb700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3a0102b60 0x7fa3a0113220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:11:21.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:21.742+0000 7fa3a57fb700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3a0102b60 0x7fa3a0113220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.69:44232/0 (socket says 172.21.15.69:44232) 2024-04-25T17:11:21.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:21.742+0000 7fa3a57fb700 1 -- 172.21.15.69:0/3869650032 learned_addr learned my addr 172.21.15.69:0/3869650032 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-25T17:11:21.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:21.742+0000 7fa3a57fb700 1 -- 172.21.15.69:0/3869650032 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa390005040 con 0x7fa3a0102b60 2024-04-25T17:11:21.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:21.742+0000 7fa3a57fb700 1 --2- 172.21.15.69:0/3869650032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3a0102b60 0x7fa3a0113220 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa39000b820 tx=0x7fa390009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:11:21.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:21.742+0000 7fa395ffb700 1 -- 172.21.15.69:0/3869650032 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa3900093c0 con 0x7fa3a0102b60 2024-04-25T17:11:21.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:21.742+0000 7fa395ffb700 1 -- 172.21.15.69:0/3869650032 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa390013420 con 0x7fa3a0102b60 2024-04-25T17:11:21.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:21.742+0000 7fa3a7a5f700 1 -- 172.21.15.69:0/3869650032 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3a0113960 con 0x7fa3a0102b60 2024-04-25T17:11:21.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:21.742+0000 7fa395ffb700 1 -- 172.21.15.69:0/3869650032 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa39001c5b0 con 0x7fa3a0102b60 2024-04-25T17:11:21.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:21.742+0000 7fa3a7a5f700 1 -- 172.21.15.69:0/3869650032 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3a0113d90 con 0x7fa3a0102b60 2024-04-25T17:11:21.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:21.743+0000 7fa395ffb700 1 -- 172.21.15.69:0/3869650032 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 17) v1 ==== 43489+0+0 (secure 0 0 0) 0x7fa39001c7f0 con 0x7fa3a0102b60 2024-04-25T17:11:21.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:21.743+0000 7fa395ffb700 1 --2- 172.21.15.69:0/3869650032 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fa38c036970 0x7fa38c038e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:11:21.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:21.744+0000 7fa395ffb700 1 -- 172.21.15.69:0/3869650032 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fa390049a70 con 0x7fa3a0102b60 2024-04-25T17:11:21.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:21.744+0000 7fa3a7a5f700 1 -- 172.21.15.69:0/3869650032 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3a00fe2b0 con 0x7fa3a0102b60 2024-04-25T17:11:21.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:21.744+0000 7fa3a4ffa700 1 --2- 172.21.15.69:0/3869650032 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fa38c036970 0x7fa38c038e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:11:21.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:21.744+0000 7fa3a4ffa700 1 --2- 172.21.15.69:0/3869650032 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fa38c036970 0x7fa38c038e20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa39c009990 tx=0x7fa39c006e40 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:11:21.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:21.749+0000 7fa395ffb700 1 -- 172.21.15.69:0/3869650032 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fa390023300 con 0x7fa3a0102b60 2024-04-25T17:11:21.992 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:21 smithi069 podman[34492]: 2024-04-25 17:11:21.796999733 +0000 UTC m=+0.026599502 image pull 0de407c1b3afb7a571e0cc4b0c826a995ed358d49d5f013ca6bdfad025b55c43 quay.ceph.io/ceph-ci/ceph@sha256:27d43f80a23d3545096a7bb490598a6f37852da2940e69e5a8f3e3d7fb58fd17 2024-04-25T17:11:22.027 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:22.027+0000 7fa3a7a5f700 1 -- 172.21.15.69:0/3869650032 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa3a0106e80 con 0x7fa3a0102b60 2024-04-25T17:11:22.028 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:22.028+0000 7fa395ffb700 1 -- 172.21.15.69:0/3869650032 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fa390034090 con 0x7fa3a0102b60 2024-04-25T17:11:22.029 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:11:22.030 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":1,"fsid":"599bb7fc-0326-11ef-bc93-c7b262605968","modified":"2024-04-25T17:08:34.994230Z","created":"2024-04-25T17:08:34.994230Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi037","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:3300","nonce":0},{"type":"v1","addr":"172.21.15.37:6789","nonce":0}]},"addr":"172.21.15.37:6789/0","public_addr":"172.21.15.37:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-04-25T17:11:22.030 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:22.030+0000 7fa3a7a5f700 1 -- 172.21.15.69:0/3869650032 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fa38c036970 msgr2=0x7fa38c038e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:11:22.030 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:22.030+0000 7fa3a7a5f700 1 --2- 172.21.15.69:0/3869650032 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fa38c036970 0x7fa38c038e20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa39c009990 tx=0x7fa39c006e40 comp rx=0 tx=0).stop 2024-04-25T17:11:22.030 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:22.030+0000 7fa3a7a5f700 1 -- 172.21.15.69:0/3869650032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3a0102b60 msgr2=0x7fa3a0113220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:11:22.030 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:22.030+0000 7fa3a7a5f700 1 --2- 172.21.15.69:0/3869650032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3a0102b60 0x7fa3a0113220 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa39000b820 tx=0x7fa390009e30 comp rx=0 tx=0).stop 2024-04-25T17:11:22.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:22.030+0000 7fa3a7a5f700 1 -- 172.21.15.69:0/3869650032 shutdown_connections 2024-04-25T17:11:22.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:22.030+0000 7fa3a7a5f700 1 --2- 172.21.15.69:0/3869650032 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fa38c036970 0x7fa38c038e20 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:11:22.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:22.030+0000 7fa3a7a5f700 1 --2- 172.21.15.69:0/3869650032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3a0102b60 0x7fa3a0113220 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:11:22.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:22.030+0000 7fa3a7a5f700 1 -- 172.21.15.69:0/3869650032 >> 172.21.15.69:0/3869650032 conn(0x7fa3a00f86d0 msgr2=0x7fa3a00f9e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:11:22.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:22.030+0000 7fa3a7a5f700 1 -- 172.21.15.69:0/3869650032 shutdown_connections 2024-04-25T17:11:22.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:22.030+0000 7fa3a7a5f700 1 -- 172.21.15.69:0/3869650032 wait complete. 2024-04-25T17:11:22.038 INFO:teuthology.orchestra.run.smithi069.stderr:dumped monmap epoch 1 2024-04-25T17:11:22.257 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 podman[34492]: 2024-04-25 17:11:22.078257742 +0000 UTC m=+0.307857505 container init ffcd456d1dcec5240f394061a460af207b6842c9e1f283ae49e5be1aae31b4b9 (image=quay.ceph.io/ceph-ci/ceph@sha256:27d43f80a23d3545096a7bb490598a6f37852da2940e69e5a8f3e3d7fb58fd17, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-mon-smithi069, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-c61472c, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-04-25T17:11:22.257 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 podman[34492]: 2024-04-25 17:11:22.081495566 +0000 UTC m=+0.311095327 container start ffcd456d1dcec5240f394061a460af207b6842c9e1f283ae49e5be1aae31b4b9 (image=quay.ceph.io/ceph-ci/ceph@sha256:27d43f80a23d3545096a7bb490598a6f37852da2940e69e5a8f3e3d7fb58fd17, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-mon-smithi069, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=quincy-c61472c, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-04-25T17:11:22.257 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: set uid:gid to 167:167 (ceph:ceph) 2024-04-25T17:11:22.257 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable), process ceph-mon, pid 2 2024-04-25T17:11:22.257 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: pidfile_write: ignore empty --pid-file 2024-04-25T17:11:22.257 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: load: jerasure load: lrc 2024-04-25T17:11:22.257 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: RocksDB version: 6.15.5 2024-04-25T17:11:22.257 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-04-25T17:11:22.258 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Compile date Apr 24 2024 2024-04-25T17:11:22.258 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: DB SUMMARY 2024-04-25T17:11:22.258 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: DB Session ID: W8L21DJQ1ASYPJBXWONE 2024-04-25T17:11:22.258 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: CURRENT file: CURRENT 2024-04-25T17:11:22.258 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: IDENTITY file: IDENTITY 2024-04-25T17:11:22.258 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: MANIFEST file: MANIFEST-000003 size: 57 Bytes 2024-04-25T17:11:22.258 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi069/store.db dir, Total Num: 0, files: 2024-04-25T17:11:22.258 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi069/store.db: 000004.log size: 511 ; 2024-04-25T17:11:22.258 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.error_if_exists: 0 2024-04-25T17:11:22.258 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.create_if_missing: 0 2024-04-25T17:11:22.258 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.paranoid_checks: 1 2024-04-25T17:11:22.258 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-25T17:11:22.258 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.env: 0x55ca9398eb00 2024-04-25T17:11:22.258 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.fs: Posix File System 2024-04-25T17:11:22.259 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.info_log: 0x55ca95431620 2024-04-25T17:11:22.259 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.max_file_opening_threads: 16 2024-04-25T17:11:22.259 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.statistics: (nil) 2024-04-25T17:11:22.259 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.use_fsync: 0 2024-04-25T17:11:22.260 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.max_log_file_size: 0 2024-04-25T17:11:22.260 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-25T17:11:22.261 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-25T17:11:22.261 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.keep_log_file_num: 1000 2024-04-25T17:11:22.261 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.recycle_log_file_num: 0 2024-04-25T17:11:22.261 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.allow_fallocate: 1 2024-04-25T17:11:22.261 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.allow_mmap_reads: 0 2024-04-25T17:11:22.261 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.allow_mmap_writes: 0 2024-04-25T17:11:22.261 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.use_direct_reads: 0 2024-04-25T17:11:22.261 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-25T17:11:22.261 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.create_missing_column_families: 0 2024-04-25T17:11:22.261 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.db_log_dir: 2024-04-25T17:11:22.261 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi069/store.db 2024-04-25T17:11:22.261 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-25T17:11:22.261 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-25T17:11:22.262 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-25T17:11:22.262 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-25T17:11:22.262 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-25T17:11:22.262 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-25T17:11:22.262 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.advise_random_on_open: 1 2024-04-25T17:11:22.262 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.db_write_buffer_size: 0 2024-04-25T17:11:22.262 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.write_buffer_manager: 0x55ca96124a20 2024-04-25T17:11:22.262 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-25T17:11:22.262 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-04-25T17:11:22.262 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-25T17:11:22.262 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-25T17:11:22.262 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.rate_limiter: (nil) 2024-04-25T17:11:22.262 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-25T17:11:22.262 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.wal_recovery_mode: 2 2024-04-25T17:11:22.263 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.enable_thread_tracking: 0 2024-04-25T17:11:22.263 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.enable_pipelined_write: 0 2024-04-25T17:11:22.263 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.unordered_write: 0 2024-04-25T17:11:22.263 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-25T17:11:22.263 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-25T17:11:22.263 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-25T17:11:22.263 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-25T17:11:22.263 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.row_cache: None 2024-04-25T17:11:22.263 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.wal_filter: None 2024-04-25T17:11:22.263 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-25T17:11:22.263 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.allow_ingest_behind: 0 2024-04-25T17:11:22.263 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.preserve_deletes: 0 2024-04-25T17:11:22.263 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.two_write_queues: 0 2024-04-25T17:11:22.263 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.manual_wal_flush: 0 2024-04-25T17:11:22.264 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.atomic_flush: 0 2024-04-25T17:11:22.264 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-25T17:11:22.264 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-25T17:11:22.264 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-25T17:11:22.264 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.log_readahead_size: 0 2024-04-25T17:11:22.264 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-25T17:11:22.264 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.best_efforts_recovery: 0 2024-04-25T17:11:22.264 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-25T17:11:22.264 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-25T17:11:22.264 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.allow_data_in_errors: 0 2024-04-25T17:11:22.264 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.db_host_id: __hostname__ 2024-04-25T17:11:22.264 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.max_background_jobs: 2 2024-04-25T17:11:22.264 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.max_background_compactions: -1 2024-04-25T17:11:22.264 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.max_subcompactions: 1 2024-04-25T17:11:22.264 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-25T17:11:22.265 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-25T17:11:22.265 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-25T17:11:22.265 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.max_total_wal_size: 0 2024-04-25T17:11:22.265 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-25T17:11:22.265 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-25T17:11:22.265 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-25T17:11:22.265 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-25T17:11:22.265 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.max_open_files: -1 2024-04-25T17:11:22.265 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.bytes_per_sync: 0 2024-04-25T17:11:22.265 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-25T17:11:22.265 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-25T17:11:22.265 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.compaction_readahead_size: 0 2024-04-25T17:11:22.265 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.max_background_flushes: -1 2024-04-25T17:11:22.265 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Compression algorithms supported: 2024-04-25T17:11:22.266 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-25T17:11:22.266 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: kZSTD supported: 0 2024-04-25T17:11:22.266 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: kXpressCompression supported: 0 2024-04-25T17:11:22.266 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: kLZ4HCCompression supported: 1 2024-04-25T17:11:22.266 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: kZlibCompression supported: 1 2024-04-25T17:11:22.266 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: kSnappyCompression supported: 1 2024-04-25T17:11:22.266 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: kLZ4Compression supported: 1 2024-04-25T17:11:22.266 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: kBZip2Compression supported: 0 2024-04-25T17:11:22.266 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-25T17:11:22.266 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi069/store.db/MANIFEST-000003 2024-04-25T17:11:22.266 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2024-04-25T17:11:22.266 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-25T17:11:22.266 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.merge_operator: 2024-04-25T17:11:22.267 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.compaction_filter: None 2024-04-25T17:11:22.267 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.compaction_filter_factory: None 2024-04-25T17:11:22.267 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.sst_partitioner_factory: None 2024-04-25T17:11:22.267 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-25T17:11:22.267 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-25T17:11:22.267 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55ca95404f58) 2024-04-25T17:11:22.267 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: cache_index_and_filter_blocks: 1 2024-04-25T17:11:22.267 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-25T17:11:22.267 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-25T17:11:22.267 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: pin_top_level_index_and_filter: 1 2024-04-25T17:11:22.267 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: index_type: 0 2024-04-25T17:11:22.267 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: data_block_index_type: 0 2024-04-25T17:11:22.267 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: index_shortening: 1 2024-04-25T17:11:22.267 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-25T17:11:22.268 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: hash_index_allow_collision: 1 2024-04-25T17:11:22.268 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: checksum: 1 2024-04-25T17:11:22.268 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: no_block_cache: 0 2024-04-25T17:11:22.268 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: block_cache: 0x55ca95437090 2024-04-25T17:11:22.268 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: block_cache_name: BinnedLRUCache 2024-04-25T17:11:22.268 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: block_cache_options: 2024-04-25T17:11:22.268 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: capacity : 536870912 2024-04-25T17:11:22.268 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: num_shard_bits : 4 2024-04-25T17:11:22.268 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: strict_capacity_limit : 0 2024-04-25T17:11:22.268 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: high_pri_pool_ratio: 0.000 2024-04-25T17:11:22.268 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: block_cache_compressed: (nil) 2024-04-25T17:11:22.268 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: persistent_cache: (nil) 2024-04-25T17:11:22.268 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: block_size: 4096 2024-04-25T17:11:22.268 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: block_size_deviation: 10 2024-04-25T17:11:22.268 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: block_restart_interval: 16 2024-04-25T17:11:22.269 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: index_block_restart_interval: 1 2024-04-25T17:11:22.269 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: metadata_block_size: 4096 2024-04-25T17:11:22.269 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: partition_filters: 0 2024-04-25T17:11:22.269 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: use_delta_encoding: 1 2024-04-25T17:11:22.269 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-04-25T17:11:22.269 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: whole_key_filtering: 1 2024-04-25T17:11:22.269 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: verify_compression: 0 2024-04-25T17:11:22.269 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: read_amp_bytes_per_bit: 0 2024-04-25T17:11:22.269 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: format_version: 4 2024-04-25T17:11:22.269 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: enable_index_compression: 1 2024-04-25T17:11:22.269 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: block_align: 0 2024-04-25T17:11:22.269 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.write_buffer_size: 33554432 2024-04-25T17:11:22.269 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.max_write_buffer_number: 2 2024-04-25T17:11:22.269 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.compression: NoCompression 2024-04-25T17:11:22.269 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.bottommost_compression: Disabled 2024-04-25T17:11:22.270 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.prefix_extractor: nullptr 2024-04-25T17:11:22.270 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-25T17:11:22.270 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.num_levels: 7 2024-04-25T17:11:22.270 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-25T17:11:22.270 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-25T17:11:22.270 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-25T17:11:22.270 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-25T17:11:22.270 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-25T17:11:22.270 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-25T17:11:22.270 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-25T17:11:22.270 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-25T17:11:22.270 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-25T17:11:22.270 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-25T17:11:22.270 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-25T17:11:22.271 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.compression_opts.level: 32767 2024-04-25T17:11:22.271 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.compression_opts.strategy: 0 2024-04-25T17:11:22.271 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-25T17:11:22.271 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-25T17:11:22.271 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-25T17:11:22.271 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.compression_opts.enabled: false 2024-04-25T17:11:22.271 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-25T17:11:22.271 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-25T17:11:22.271 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-25T17:11:22.271 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.target_file_size_base: 67108864 2024-04-25T17:11:22.271 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-25T17:11:22.271 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-25T17:11:22.271 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-25T17:11:22.271 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-25T17:11:22.271 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-25T17:11:22.272 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-25T17:11:22.272 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-25T17:11:22.272 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-25T17:11:22.272 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-25T17:11:22.272 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-25T17:11:22.272 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-25T17:11:22.272 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-25T17:11:22.272 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-25T17:11:22.272 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.arena_block_size: 4194304 2024-04-25T17:11:22.272 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-25T17:11:22.272 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-25T17:11:22.272 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-04-25T17:11:22.272 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.disable_auto_compactions: 0 2024-04-25T17:11:22.272 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-25T17:11:22.272 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-25T17:11:22.273 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-25T17:11:22.273 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-25T17:11:22.273 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-25T17:11:22.273 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-25T17:11:22.273 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-25T17:11:22.273 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-25T17:11:22.273 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-25T17:11:22.273 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-25T17:11:22.273 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.table_properties_collectors: 2024-04-25T17:11:22.273 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.inplace_update_support: 0 2024-04-25T17:11:22.273 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-25T17:11:22.273 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-25T17:11:22.273 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-25T17:11:22.273 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-25T17:11:22.273 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.bloom_locality: 0 2024-04-25T17:11:22.274 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.max_successive_merges: 0 2024-04-25T17:11:22.274 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-25T17:11:22.274 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.paranoid_file_checks: 0 2024-04-25T17:11:22.274 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.force_consistency_checks: 1 2024-04-25T17:11:22.274 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.report_bg_io_stats: 0 2024-04-25T17:11:22.274 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.ttl: 2592000 2024-04-25T17:11:22.274 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-25T17:11:22.274 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.enable_blob_files: false 2024-04-25T17:11:22.274 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.min_blob_size: 0 2024-04-25T17:11:22.274 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.blob_file_size: 268435456 2024-04-25T17:11:22.274 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-25T17:11:22.274 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-25T17:11:22.274 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-25T17:11:22.274 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi069/store.db/MANIFEST-000003 succeeded,manifest_file_number is 3, next_file_number is 5, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-25T17:11:22.274 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 0 2024-04-25T17:11:22.275 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: [db/version_set.cc:4082] Creating manifest 7 2024-04-25T17:11:22.275 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714065082108896, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-04-25T17:11:22.275 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #4 mode 2 2024-04-25T17:11:22.275 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-04-25T17:11:22.275 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714065082109335, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1545, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1714065082, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "49172aaa-fcc4-4699-acb2-0e3a41fa376d", "db_session_id": "W8L21DJQ1ASYPJBXWONE"}} 2024-04-25T17:11:22.275 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: [db/version_set.cc:4082] Creating manifest 9 2024-04-25T17:11:22.275 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714065082109750, "job": 1, "event": "recovery_finished"} 2024-04-25T17:11:22.275 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi069/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-25T17:11:22.275 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x55ca953cb180 2024-04-25T17:11:22.275 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: DB pointer 0x55ca954a0000 2024-04-25T17:11:22.275 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2024-04-25T17:11:22.275 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-04-25T17:11:22.275 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: ** DB Stats ** 2024-04-25T17:11:22.275 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-25T17:11:22.276 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-25T17:11:22.276 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-25T17:11:22.276 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-25T17:11:22.276 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-25T17:11:22.276 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-04-25T17:11:22.276 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-25T17:11:22.276 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: 2024-04-25T17:11:22.276 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: ** Compaction Stats [default] ** 2024-04-25T17:11:22.276 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-25T17:11:22.276 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-25T17:11:22.276 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: L0 1/0 1.51 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.6 0.00 0.00 1 0.000 0 0 2024-04-25T17:11:22.276 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: Sum 1/0 1.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.6 0.00 0.00 1 0.000 0 0 2024-04-25T17:11:22.276 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.6 0.00 0.00 1 0.000 0 0 2024-04-25T17:11:22.276 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: 2024-04-25T17:11:22.276 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: ** Compaction Stats [default] ** 2024-04-25T17:11:22.277 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-25T17:11:22.277 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-25T17:11:22.277 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.6 0.00 0.00 1 0.000 0 0 2024-04-25T17:11:22.277 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-25T17:11:22.277 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-25T17:11:22.277 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-25T17:11:22.277 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-25T17:11:22.277 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-25T17:11:22.277 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-25T17:11:22.277 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: Cumulative compaction: 0.00 GB write, 0.41 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-25T17:11:22.277 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: Interval compaction: 0.00 GB write, 0.41 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-25T17:11:22.277 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-25T17:11:22.277 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: 2024-04-25T17:11:22.277 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-25T17:11:22.277 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: 2024-04-25T17:11:22.278 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: ** Compaction Stats [default] ** 2024-04-25T17:11:22.278 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-25T17:11:22.278 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-25T17:11:22.278 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: L0 1/0 1.51 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.6 0.00 0.00 1 0.000 0 0 2024-04-25T17:11:22.278 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: Sum 1/0 1.51 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.6 0.00 0.00 1 0.000 0 0 2024-04-25T17:11:22.278 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-04-25T17:11:22.278 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: 2024-04-25T17:11:22.278 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: ** Compaction Stats [default] ** 2024-04-25T17:11:22.278 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-04-25T17:11:22.278 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-25T17:11:22.278 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.6 0.00 0.00 1 0.000 0 0 2024-04-25T17:11:22.278 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-25T17:11:22.278 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-25T17:11:22.278 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-25T17:11:22.279 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-25T17:11:22.279 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-25T17:11:22.279 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-25T17:11:22.279 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: Cumulative compaction: 0.00 GB write, 0.40 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-25T17:11:22.279 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-25T17:11:22.279 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-25T17:11:22.279 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: 2024-04-25T17:11:22.279 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-25T17:11:22.279 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: mon.smithi069 does not exist in monmap, will attempt to join an existing cluster 2024-04-25T17:11:22.279 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: using public_addr v2:172.21.15.69:0/0 -> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] 2024-04-25T17:11:22.279 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: starting mon.smithi069 rank -1 at public addrs [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] at bind addrs [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi069 fsid 599bb7fc-0326-11ef-bc93-c7b262605968 2024-04-25T17:11:22.279 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: mon.smithi069@-1(???) e0 preinit fsid 599bb7fc-0326-11ef-bc93-c7b262605968 2024-04-25T17:11:22.279 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: mon.smithi069@-1(synchronizing).mds e1 new map 2024-04-25T17:11:22.279 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: mon.smithi069@-1(synchronizing).mds e1 print_map 2024-04-25T17:11:22.279 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: e1 2024-04-25T17:11:22.280 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-25T17:11:22.280 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T17:11:22.280 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: legacy client fscid: -1 2024-04-25T17:11:22.280 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: 2024-04-25T17:11:22.280 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: No filesystems configured 2024-04-25T17:11:22.280 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: mon.smithi069@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-04-25T17:11:22.280 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: mon.smithi069@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-04-25T17:11:22.280 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: mon.smithi069@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-04-25T17:11:22.280 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: mon.smithi069@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-04-25T17:11:22.280 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: mon.smithi069@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-04-25T17:11:22.280 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: mon.smithi069@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-04-25T17:11:22.280 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: mon.smithi069@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2024-04-25T17:11:22.280 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: mon.smithi069@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2024-04-25T17:11:22.280 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: mon.smithi069@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-04-25T17:11:22.281 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: mon.smithi069@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-04-25T17:11:22.281 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: mon.smithi069@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-04-25T17:11:22.281 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:22.281 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:22.281 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:22.281 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:22.281 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T17:11:22.281 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:11:22.281 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: Deploying daemon mon.smithi069 on smithi069 2024-04-25T17:11:22.281 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:11:22.281 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: from='client.? 172.21.15.69:0/1746486552' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T17:11:22.281 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:11:22.281 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:22.281 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 ceph-mon[34527]: mon.smithi069@-1(synchronizing).paxosservice(auth 1..6) refresh upgraded, format 0 -> 3 2024-04-25T17:11:22.282 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 bash[34492]: ffcd456d1dcec5240f394061a460af207b6842c9e1f283ae49e5be1aae31b4b9 2024-04-25T17:11:22.282 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:22 smithi069 systemd[1]: Started Ceph mon.smithi069 for 599bb7fc-0326-11ef-bc93-c7b262605968. 2024-04-25T17:11:23.671 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-04-25T17:11:23.672 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph mon dump -f json 2024-04-25T17:11:23.924 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi069/config 2024-04-25T17:11:27.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:27 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mon metadata", "id": "smithi037"}]: dispatch 2024-04-25T17:11:27.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:27 smithi037 ceph-mon[26472]: mon.smithi037 calling monitor election 2024-04-25T17:11:27.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:27 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mon metadata", "id": "smithi069"}]: dispatch 2024-04-25T17:11:27.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:27 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mon metadata", "id": "smithi069"}]: dispatch 2024-04-25T17:11:27.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:27 smithi037 ceph-mon[26472]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:11:27.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:27 smithi037 ceph-mon[26472]: from='mgr.? 172.21.15.69:0/2080545483' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi069.mmuhdo/crt"}]: dispatch 2024-04-25T17:11:27.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:27 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mon metadata", "id": "smithi069"}]: dispatch 2024-04-25T17:11:27.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:27 smithi037 ceph-mon[26472]: mon.smithi069 calling monitor election 2024-04-25T17:11:27.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:27 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mon metadata", "id": "smithi069"}]: dispatch 2024-04-25T17:11:27.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:27 smithi037 ceph-mon[26472]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:11:27.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:27 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:11:27.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:27 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mon metadata", "id": "smithi069"}]: dispatch 2024-04-25T17:11:27.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:27 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mon metadata", "id": "smithi069"}]: dispatch 2024-04-25T17:11:27.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:27 smithi037 ceph-mon[26472]: mon.smithi037 is new leader, mons smithi037,smithi069 in quorum (ranks 0,1) 2024-04-25T17:11:27.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:27 smithi037 ceph-mon[26472]: monmap e2: 2 mons at {smithi037=[v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0],smithi069=[v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-25T17:11:27.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:27 smithi037 ceph-mon[26472]: fsmap 2024-04-25T17:11:27.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:27 smithi037 ceph-mon[26472]: osdmap e5: 0 total, 0 up, 0 in 2024-04-25T17:11:27.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:27 smithi037 ceph-mon[26472]: mgrmap e17: smithi037.txrgxl(active, since 31s) 2024-04-25T17:11:27.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:27 smithi037 ceph-mon[26472]: overall HEALTH_OK 2024-04-25T17:11:27.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:27 smithi037 ceph-mon[26472]: Standby manager daemon smithi069.mmuhdo started 2024-04-25T17:11:27.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:27 smithi037 ceph-mon[26472]: from='mgr.? 172.21.15.69:0/2080545483' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T17:11:27.573 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:27 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:27.573 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:27 smithi037 ceph-mon[26472]: from='mgr.? 172.21.15.69:0/2080545483' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi069.mmuhdo/key"}]: dispatch 2024-04-25T17:11:27.573 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:27 smithi037 ceph-mon[26472]: from='mgr.? 172.21.15.69:0/2080545483' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T17:11:27.573 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:27 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:27.670 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:27 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mon metadata", "id": "smithi037"}]: dispatch 2024-04-25T17:11:27.671 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:27 smithi069 ceph-mon[34527]: mon.smithi037 calling monitor election 2024-04-25T17:11:27.671 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:27 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mon metadata", "id": "smithi069"}]: dispatch 2024-04-25T17:11:27.671 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:27 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mon metadata", "id": "smithi069"}]: dispatch 2024-04-25T17:11:27.671 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:27 smithi069 ceph-mon[34527]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:11:27.671 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:27 smithi069 ceph-mon[34527]: from='mgr.? 172.21.15.69:0/2080545483' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi069.mmuhdo/crt"}]: dispatch 2024-04-25T17:11:27.671 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:27 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mon metadata", "id": "smithi069"}]: dispatch 2024-04-25T17:11:27.671 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:27 smithi069 ceph-mon[34527]: mon.smithi069 calling monitor election 2024-04-25T17:11:27.671 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:27 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mon metadata", "id": "smithi069"}]: dispatch 2024-04-25T17:11:27.671 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:27 smithi069 ceph-mon[34527]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:11:27.671 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:27 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:11:27.671 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:27 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mon metadata", "id": "smithi069"}]: dispatch 2024-04-25T17:11:27.671 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:27 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mon metadata", "id": "smithi069"}]: dispatch 2024-04-25T17:11:27.671 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:27 smithi069 ceph-mon[34527]: mon.smithi037 is new leader, mons smithi037,smithi069 in quorum (ranks 0,1) 2024-04-25T17:11:27.671 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:27 smithi069 ceph-mon[34527]: monmap e2: 2 mons at {smithi037=[v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0],smithi069=[v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-04-25T17:11:27.671 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:27 smithi069 ceph-mon[34527]: fsmap 2024-04-25T17:11:27.672 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:27 smithi069 ceph-mon[34527]: osdmap e5: 0 total, 0 up, 0 in 2024-04-25T17:11:27.672 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:27 smithi069 ceph-mon[34527]: mgrmap e17: smithi037.txrgxl(active, since 31s) 2024-04-25T17:11:27.672 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:27 smithi069 ceph-mon[34527]: overall HEALTH_OK 2024-04-25T17:11:27.672 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:27 smithi069 ceph-mon[34527]: Standby manager daemon smithi069.mmuhdo started 2024-04-25T17:11:27.672 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:27 smithi069 ceph-mon[34527]: from='mgr.? 172.21.15.69:0/2080545483' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T17:11:27.672 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:27 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:27.672 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:27 smithi069 ceph-mon[34527]: from='mgr.? 172.21.15.69:0/2080545483' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi069.mmuhdo/key"}]: dispatch 2024-04-25T17:11:27.672 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:27 smithi069 ceph-mon[34527]: from='mgr.? 172.21.15.69:0/2080545483' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T17:11:27.672 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:27 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:28.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:28.414+0000 7fd90f309700 1 -- 172.21.15.69:0/2010173608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8f4003580 msgr2=0x7fd8f4005a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:11:28.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:28.414+0000 7fd90f309700 1 --2- 172.21.15.69:0/2010173608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8f4003580 0x7fd8f4005a00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd908065f20 tx=0x7fd900009040 comp rx=0 tx=0).stop 2024-04-25T17:11:28.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:28.415+0000 7fd90f309700 1 -- 172.21.15.69:0/2010173608 shutdown_connections 2024-04-25T17:11:28.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:28.415+0000 7fd90f309700 1 --2- 172.21.15.69:0/2010173608 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd8f4003580 0x7fd8f4005a00 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:11:28.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:28.415+0000 7fd90f309700 1 -- 172.21.15.69:0/2010173608 >> 172.21.15.69:0/2010173608 conn(0x7fd9080f75c0 msgr2=0x7fd9080f99d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:11:28.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:28.415+0000 7fd90f309700 1 -- 172.21.15.69:0/2010173608 shutdown_connections 2024-04-25T17:11:28.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:28.415+0000 7fd90f309700 1 -- 172.21.15.69:0/2010173608 wait complete. 2024-04-25T17:11:28.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:28.415+0000 7fd90f309700 1 Processor -- start 2024-04-25T17:11:28.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:28.415+0000 7fd90f309700 1 -- start start 2024-04-25T17:11:28.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:28.415+0000 7fd90f309700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd8f4003580 0x7fd908113330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:11:28.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:28.415+0000 7fd90f309700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd908113870 0x7fd90810d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:11:28.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:28.415+0000 7fd90f309700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd908113e80 con 0x7fd908113870 2024-04-25T17:11:28.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:28.415+0000 7fd90f309700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd908113ff0 con 0x7fd8f4003580 2024-04-25T17:11:28.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:28.416+0000 7fd90d0a5700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd8f4003580 0x7fd908113330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:11:28.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:28.416+0000 7fd90d0a5700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd8f4003580 0x7fd908113330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40054/0 (socket says 172.21.15.69:40054) 2024-04-25T17:11:28.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:28.416+0000 7fd90d0a5700 1 -- 172.21.15.69:0/444873772 learned_addr learned my addr 172.21.15.69:0/444873772 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-25T17:11:28.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:28.416+0000 7fd90d0a5700 1 -- 172.21.15.69:0/444873772 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd8f4003580 msgr2=0x7fd908113330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-04-25T17:11:28.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:28.416+0000 7fd90d0a5700 1 -- 172.21.15.69:0/444873772 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd8f4003580 msgr2=0x7fd908113330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-25T17:11:28.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:28.416+0000 7fd90d0a5700 1 --2- 172.21.15.69:0/444873772 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd8f4003580 0x7fd908113330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-25T17:11:28.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:28.416+0000 7fd90d0a5700 1 --2- 172.21.15.69:0/444873772 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd8f4003580 0x7fd908113330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T17:11:28.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:28.416+0000 7fd90c8a4700 1 --2- 172.21.15.69:0/444873772 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd908113870 0x7fd90810d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:11:28.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:28.416+0000 7fd90c8a4700 1 -- 172.21.15.69:0/444873772 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd8f4003580 msgr2=0x7fd908113330 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T17:11:28.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:28.416+0000 7fd90c8a4700 1 --2- 172.21.15.69:0/444873772 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd8f4003580 0x7fd908113330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:11:28.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:28.416+0000 7fd90c8a4700 1 -- 172.21.15.69:0/444873772 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9000079e0 con 0x7fd908113870 2024-04-25T17:11:28.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:28.417+0000 7fd90c8a4700 1 --2- 172.21.15.69:0/444873772 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd908113870 0x7fd90810d2d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd8f800b790 tx=0x7fd8f80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:11:28.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:28.417+0000 7fd8fdffb700 1 -- 172.21.15.69:0/444873772 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8f8011810 con 0x7fd908113870 2024-04-25T17:11:28.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:28.417+0000 7fd90f309700 1 -- 172.21.15.69:0/444873772 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd90810d930 con 0x7fd908113870 2024-04-25T17:11:28.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:28.417+0000 7fd8fdffb700 1 -- 172.21.15.69:0/444873772 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd8f8011e40 con 0x7fd908113870 2024-04-25T17:11:28.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:28.417+0000 7fd8fdffb700 1 -- 172.21.15.69:0/444873772 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8f800f2e0 con 0x7fd908113870 2024-04-25T17:11:28.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:28.417+0000 7fd90f309700 1 -- 172.21.15.69:0/444873772 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd90810de70 con 0x7fd908113870 2024-04-25T17:11:28.419 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:28.418+0000 7fd90f309700 1 -- 172.21.15.69:0/444873772 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd90810e140 con 0x7fd908113870 2024-04-25T17:11:28.419 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:28.418+0000 7fd8fdffb700 1 -- 172.21.15.69:0/444873772 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) v1 ==== 86573+0+0 (secure 0 0 0) 0x7fd8f8011970 con 0x7fd908113870 2024-04-25T17:11:28.419 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:28.419+0000 7fd8fdffb700 1 --2- 172.21.15.69:0/444873772 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fd8ec069320 0x7fd8ec06b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:11:28.419 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:28.419+0000 7fd8fdffb700 1 -- 172.21.15.69:0/444873772 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fd8f8086410 con 0x7fd908113870 2024-04-25T17:11:28.419 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:28.419+0000 7fd90d0a5700 1 --2- 172.21.15.69:0/444873772 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fd8ec069320 0x7fd8ec06b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:11:28.419 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:28.419+0000 7fd90d0a5700 1 --2- 172.21.15.69:0/444873772 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fd8ec069320 0x7fd8ec06b7d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd9000139e0 tx=0x7fd900009040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:11:28.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:28.424+0000 7fd8fdffb700 1 -- 172.21.15.69:0/444873772 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fd90810e140 con 0x7fd908113870 2024-04-25T17:11:28.474 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:28 smithi037 ceph-mon[26472]: mgrmap e18: smithi037.txrgxl(active, since 31s), standbys: smithi069.mmuhdo 2024-04-25T17:11:28.474 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:28 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mgr metadata", "who": "smithi069.mmuhdo", "id": "smithi069.mmuhdo"}]: dispatch 2024-04-25T17:11:28.474 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:28 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:28.474 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:28 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:28.474 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:28 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:28.474 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:28 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:11:28.474 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:28 smithi037 ceph-mon[26472]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:11:28.474 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:28 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mon metadata", "id": "smithi069"}]: dispatch 2024-04-25T17:11:28.562 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:28 smithi069 ceph-mon[34527]: mgrmap e18: smithi037.txrgxl(active, since 31s), standbys: smithi069.mmuhdo 2024-04-25T17:11:28.562 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:28 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mgr metadata", "who": "smithi069.mmuhdo", "id": "smithi069.mmuhdo"}]: dispatch 2024-04-25T17:11:28.562 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:28 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:28.562 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:28 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:28.562 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:28 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:28.562 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:28 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:11:28.562 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:28 smithi069 ceph-mon[34527]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:11:28.562 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:28 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mon metadata", "id": "smithi069"}]: dispatch 2024-04-25T17:11:28.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:28.694+0000 7fd90f309700 1 -- 172.21.15.69:0/444873772 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd90810e140 con 0x7fd908113870 2024-04-25T17:11:28.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:28.694+0000 7fd8fdffb700 1 -- 172.21.15.69:0/444873772 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1013 (secure 0 0 0) 0x7fd90810e140 con 0x7fd908113870 2024-04-25T17:11:28.695 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-04-25T17:11:28.695 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":2,"fsid":"599bb7fc-0326-11ef-bc93-c7b262605968","modified":"2024-04-25T17:11:22.135482Z","created":"2024-04-25T17:08:34.994230Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi037","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:3300","nonce":0},{"type":"v1","addr":"172.21.15.37:6789","nonce":0}]},"addr":"172.21.15.37:6789/0","public_addr":"172.21.15.37:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi069","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:3300","nonce":0},{"type":"v1","addr":"172.21.15.69:6789","nonce":0}]},"addr":"172.21.15.69:6789/0","public_addr":"172.21.15.69:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-04-25T17:11:28.697 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:28.697+0000 7fd90f309700 1 -- 172.21.15.69:0/444873772 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fd8ec069320 msgr2=0x7fd8ec06b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:11:28.697 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:28.697+0000 7fd90f309700 1 --2- 172.21.15.69:0/444873772 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fd8ec069320 0x7fd8ec06b7d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd9000139e0 tx=0x7fd900009040 comp rx=0 tx=0).stop 2024-04-25T17:11:28.697 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:28.697+0000 7fd90f309700 1 -- 172.21.15.69:0/444873772 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd908113870 msgr2=0x7fd90810d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:11:28.697 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:28.697+0000 7fd90f309700 1 --2- 172.21.15.69:0/444873772 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd908113870 0x7fd90810d2d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd8f800b790 tx=0x7fd8f80091a0 comp rx=0 tx=0).stop 2024-04-25T17:11:28.697 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:28.697+0000 7fd90f309700 1 -- 172.21.15.69:0/444873772 shutdown_connections 2024-04-25T17:11:28.697 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:28.697+0000 7fd90f309700 1 --2- 172.21.15.69:0/444873772 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fd8ec069320 0x7fd8ec06b7d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:11:28.697 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:28.697+0000 7fd90f309700 1 --2- 172.21.15.69:0/444873772 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd8f4003580 0x7fd908113330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:11:28.697 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:28.697+0000 7fd90f309700 1 --2- 172.21.15.69:0/444873772 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd908113870 0x7fd90810d2d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:11:28.697 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:28.697+0000 7fd90f309700 1 -- 172.21.15.69:0/444873772 >> 172.21.15.69:0/444873772 conn(0x7fd9080f75c0 msgr2=0x7fd9081061e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:11:28.697 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:28.697+0000 7fd90f309700 1 -- 172.21.15.69:0/444873772 shutdown_connections 2024-04-25T17:11:28.697 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:11:28.697+0000 7fd90f309700 1 -- 172.21.15.69:0/444873772 wait complete. 2024-04-25T17:11:28.698 INFO:teuthology.orchestra.run.smithi069.stderr:dumped monmap epoch 2 2024-04-25T17:11:29.257 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:29 smithi069 ceph-mon[34527]: from='client.? 172.21.15.69:0/444873772' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T17:11:29.490 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:29 smithi037 ceph-mon[26472]: from='client.? 172.21.15.69:0/444873772' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-04-25T17:11:29.529 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-04-25T17:11:29.530 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph config generate-minimal-conf 2024-04-25T17:11:29.810 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:11:30.917 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:30 smithi069 ceph-mon[34527]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:11:30.917 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:30 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:30.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:30 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:30.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:30 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:11:30.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:30 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:11:30.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:30 smithi069 ceph-mon[34527]: Updating smithi037:/etc/ceph/ceph.conf 2024-04-25T17:11:30.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:30 smithi069 ceph-mon[34527]: Updating smithi069:/etc/ceph/ceph.conf 2024-04-25T17:11:30.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:30 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:30.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:30 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:30.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:30 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:30.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:30 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:30.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:30 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:30.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:30 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T17:11:30.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:30 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-25T17:11:30.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:30 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:11:30.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:30 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:30.957 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:30 smithi037 ceph-mon[26472]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:11:30.958 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:30 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:30.958 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:30 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:30.958 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:30 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:11:30.958 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:30 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:11:30.958 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:30 smithi037 ceph-mon[26472]: Updating smithi037:/etc/ceph/ceph.conf 2024-04-25T17:11:30.958 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:30 smithi037 ceph-mon[26472]: Updating smithi069:/etc/ceph/ceph.conf 2024-04-25T17:11:30.958 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:30 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:30.958 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:30 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:30.958 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:30 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:30.958 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:30 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:30.958 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:30 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:30.958 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:30 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T17:11:30.959 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:30 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-25T17:11:30.959 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:30 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:11:30.959 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:30 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:31.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:31 smithi037 ceph-mon[26472]: Updating smithi037:/var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T17:11:31.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:31 smithi037 ceph-mon[26472]: Updating smithi069:/var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T17:11:31.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:31 smithi037 ceph-mon[26472]: Reconfiguring mon.smithi037 (unknown last config time)... 2024-04-25T17:11:31.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:31 smithi037 ceph-mon[26472]: Reconfiguring daemon mon.smithi037 on smithi037 2024-04-25T17:11:31.917 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:31 smithi069 ceph-mon[34527]: Updating smithi037:/var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T17:11:31.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:31 smithi069 ceph-mon[34527]: Updating smithi069:/var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T17:11:31.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:31 smithi069 ceph-mon[34527]: Reconfiguring mon.smithi037 (unknown last config time)... 2024-04-25T17:11:31.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:31 smithi069 ceph-mon[34527]: Reconfiguring daemon mon.smithi037 on smithi037 2024-04-25T17:11:32.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:32.534+0000 7fefdd55f700 1 -- 172.21.15.37:0/2489892924 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefd80fc790 msgr2=0x7fefd80fcb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:11:32.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:32.534+0000 7fefdd55f700 1 --2- 172.21.15.37:0/2489892924 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefd80fc790 0x7fefd80fcb60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fefcc004940 tx=0x7fefcc009e30 comp rx=0 tx=0).stop 2024-04-25T17:11:32.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:32.534+0000 7fefdd55f700 1 -- 172.21.15.37:0/2489892924 shutdown_connections 2024-04-25T17:11:32.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:32.534+0000 7fefdd55f700 1 --2- 172.21.15.37:0/2489892924 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fefd80fd0a0 0x7fefd8109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:11:32.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:32.534+0000 7fefdd55f700 1 --2- 172.21.15.37:0/2489892924 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefd80fc790 0x7fefd80fcb60 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:11:32.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:32.534+0000 7fefdd55f700 1 -- 172.21.15.37:0/2489892924 >> 172.21.15.37:0/2489892924 conn(0x7fefd8071d00 msgr2=0x7fefd8072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:11:32.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:32.534+0000 7fefdd55f700 1 -- 172.21.15.37:0/2489892924 shutdown_connections 2024-04-25T17:11:32.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:32.534+0000 7fefdd55f700 1 -- 172.21.15.37:0/2489892924 wait complete. 2024-04-25T17:11:32.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:32.535+0000 7fefdd55f700 1 Processor -- start 2024-04-25T17:11:32.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:32.535+0000 7fefdd55f700 1 -- start start 2024-04-25T17:11:32.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:32.535+0000 7fefdd55f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fefd80fc790 0x7fefd8115df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:11:32.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:32.535+0000 7fefdd55f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefd80fd0a0 0x7fefd8116330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:11:32.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:32.535+0000 7fefdd55f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd8116a10 con 0x7fefd80fd0a0 2024-04-25T17:11:32.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:32.535+0000 7fefdd55f700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd810fd50 con 0x7fefd80fc790 2024-04-25T17:11:32.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:32.536+0000 7fefd67fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefd80fd0a0 0x7fefd8116330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:11:32.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:32.536+0000 7fefd67fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefd80fd0a0 0x7fefd8116330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42556/0 (socket says 172.21.15.37:42556) 2024-04-25T17:11:32.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:32.536+0000 7fefd67fc700 1 -- 172.21.15.37:0/1200320398 learned_addr learned my addr 172.21.15.37:0/1200320398 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:11:32.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:32.536+0000 7fefd6ffd700 1 --2- 172.21.15.37:0/1200320398 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fefd80fc790 0x7fefd8115df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:11:32.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:32.536+0000 7fefd67fc700 1 -- 172.21.15.37:0/1200320398 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fefd80fc790 msgr2=0x7fefd8115df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:11:32.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:32.536+0000 7fefd67fc700 1 --2- 172.21.15.37:0/1200320398 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fefd80fc790 0x7fefd8115df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:11:32.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:32.536+0000 7fefd67fc700 1 -- 172.21.15.37:0/1200320398 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefcc005040 con 0x7fefd80fd0a0 2024-04-25T17:11:32.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:32.536+0000 7fefd67fc700 1 --2- 172.21.15.37:0/1200320398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefd80fd0a0 0x7fefd8116330 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fefc800b790 tx=0x7fefc8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:11:32.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:32.536+0000 7fefbf7fe700 1 -- 172.21.15.37:0/1200320398 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fefc800f6f0 con 0x7fefd80fd0a0 2024-04-25T17:11:32.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:32.536+0000 7fefdd55f700 1 -- 172.21.15.37:0/1200320398 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefd810ffd0 con 0x7fefd80fd0a0 2024-04-25T17:11:32.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:32.536+0000 7fefbf7fe700 1 -- 172.21.15.37:0/1200320398 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fefc800fd20 con 0x7fefd80fd0a0 2024-04-25T17:11:32.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:32.536+0000 7fefbf7fe700 1 -- 172.21.15.37:0/1200320398 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fefc80103a0 con 0x7fefd80fd0a0 2024-04-25T17:11:32.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:32.536+0000 7fefdd55f700 1 -- 172.21.15.37:0/1200320398 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefd8110510 con 0x7fefd80fd0a0 2024-04-25T17:11:32.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:32.537+0000 7fefdd55f700 1 -- 172.21.15.37:0/1200320398 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefd80fc330 con 0x7fefd80fd0a0 2024-04-25T17:11:32.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:32.538+0000 7fefbf7fe700 1 -- 172.21.15.37:0/1200320398 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) v1 ==== 86573+0+0 (secure 0 0 0) 0x7fefc8011400 con 0x7fefd80fd0a0 2024-04-25T17:11:32.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:32.538+0000 7fefbf7fe700 1 --2- 172.21.15.37:0/1200320398 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fefc0069210 0x7fefc006b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:11:32.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:32.539+0000 7fefbf7fe700 1 -- 172.21.15.37:0/1200320398 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fefc8085e60 con 0x7fefd80fd0a0 2024-04-25T17:11:32.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:32.539+0000 7fefd6ffd700 1 --2- 172.21.15.37:0/1200320398 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fefc0069210 0x7fefc006b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:11:32.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:32.539+0000 7fefd6ffd700 1 --2- 172.21.15.37:0/1200320398 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fefc0069210 0x7fefc006b6c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fefcc004f90 tx=0x7fefcc009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:11:32.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:32.543+0000 7fefbf7fe700 1 -- 172.21.15.37:0/1200320398 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fefc8056d00 con 0x7fefd80fd0a0 2024-04-25T17:11:32.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:32.756+0000 7fefdd55f700 1 -- 172.21.15.37:0/1200320398 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fefd804bed0 con 0x7fefd80fd0a0 2024-04-25T17:11:32.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:32.757+0000 7fefbf7fe700 1 -- 172.21.15.37:0/1200320398 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+223 (secure 0 0 0) 0x7fefc8085610 con 0x7fefd80fd0a0 2024-04-25T17:11:32.758 INFO:teuthology.orchestra.run.smithi037.stdout:# minimal ceph.conf for 599bb7fc-0326-11ef-bc93-c7b262605968 2024-04-25T17:11:32.758 INFO:teuthology.orchestra.run.smithi037.stdout:[global] 2024-04-25T17:11:32.758 INFO:teuthology.orchestra.run.smithi037.stdout: fsid = 599bb7fc-0326-11ef-bc93-c7b262605968 2024-04-25T17:11:32.758 INFO:teuthology.orchestra.run.smithi037.stdout: mon_host = [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] 2024-04-25T17:11:32.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:32.759+0000 7fefdd55f700 1 -- 172.21.15.37:0/1200320398 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fefc0069210 msgr2=0x7fefc006b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:11:32.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:32.759+0000 7fefdd55f700 1 --2- 172.21.15.37:0/1200320398 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fefc0069210 0x7fefc006b6c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fefcc004f90 tx=0x7fefcc009e30 comp rx=0 tx=0).stop 2024-04-25T17:11:32.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:32.759+0000 7fefdd55f700 1 -- 172.21.15.37:0/1200320398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefd80fd0a0 msgr2=0x7fefd8116330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:11:32.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:32.759+0000 7fefdd55f700 1 --2- 172.21.15.37:0/1200320398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefd80fd0a0 0x7fefd8116330 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fefc800b790 tx=0x7fefc8009250 comp rx=0 tx=0).stop 2024-04-25T17:11:32.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:32.759+0000 7fefdd55f700 1 -- 172.21.15.37:0/1200320398 shutdown_connections 2024-04-25T17:11:32.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:32.759+0000 7fefdd55f700 1 --2- 172.21.15.37:0/1200320398 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fefc0069210 0x7fefc006b6c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:11:32.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:32.759+0000 7fefdd55f700 1 --2- 172.21.15.37:0/1200320398 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fefd80fc790 0x7fefd8115df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:11:32.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:32.759+0000 7fefdd55f700 1 --2- 172.21.15.37:0/1200320398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fefd80fd0a0 0x7fefd8116330 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:11:32.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:32.759+0000 7fefdd55f700 1 -- 172.21.15.37:0/1200320398 >> 172.21.15.37:0/1200320398 conn(0x7fefd8071d00 msgr2=0x7fefd80f9cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:11:32.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:32.759+0000 7fefdd55f700 1 -- 172.21.15.37:0/1200320398 shutdown_connections 2024-04-25T17:11:32.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:32.759+0000 7fefdd55f700 1 -- 172.21.15.37:0/1200320398 wait complete. 2024-04-25T17:11:32.824 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:32 smithi037 ceph-mon[26472]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:11:32.824 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:32 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:32.824 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:32 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:32.824 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:32 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi037.txrgxl", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T17:11:32.824 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:32 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T17:11:32.824 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:32 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:11:32.917 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:32 smithi069 ceph-mon[34527]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:11:32.917 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:32 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:32.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:32 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:32.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:32 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi037.txrgxl", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T17:11:32.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:32 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T17:11:32.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:32 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:11:33.830 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:33 smithi037 ceph-mon[26472]: Reconfiguring mgr.smithi037.txrgxl (unknown last config time)... 2024-04-25T17:11:33.830 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:33 smithi037 ceph-mon[26472]: Reconfiguring daemon mgr.smithi037.txrgxl on smithi037 2024-04-25T17:11:33.830 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:33 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/1200320398' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:11:33.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:33 smithi069 ceph-mon[34527]: Reconfiguring mgr.smithi037.txrgxl (unknown last config time)... 2024-04-25T17:11:33.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:33 smithi069 ceph-mon[34527]: Reconfiguring daemon mgr.smithi037.txrgxl on smithi037 2024-04-25T17:11:33.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:33 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/1200320398' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:11:34.262 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-04-25T17:11:34.263 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-25T17:11:34.263 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/ceph/ceph.conf 2024-04-25T17:11:34.293 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-25T17:11:34.293 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-25T17:11:34.359 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-04-25T17:11:34.359 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/etc/ceph/ceph.conf 2024-04-25T17:11:34.392 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-04-25T17:11:34.393 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-04-25T17:11:34.463 INFO:tasks.cephadm:Deploying OSDs... 2024-04-25T17:11:34.464 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-25T17:11:34.464 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T17:11:34.480 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T17:11:34.480 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_1 2024-04-25T17:11:34.537 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T17:11:34.537 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T17:11:34.537 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-04-25T17:11:34.538 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T17:11:34.538 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T17:11:34.538 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-04-25 17:10:47.018532528 +0000 2024-04-25T17:11:34.538 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-04-25 17:05:15.940758910 +0000 2024-04-25T17:11:34.538 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-04-25 17:05:15.940758910 +0000 2024-04-25T17:11:34.538 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-04-25 17:05:15.940758910 +0000 2024-04-25T17:11:34.538 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T17:11:34.602 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-04-25T17:11:34.603 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-04-25T17:11:34.603 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000352585 s, 1.5 MB/s 2024-04-25T17:11:34.604 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T17:11:34.665 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_2 2024-04-25T17:11:34.721 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T17:11:34.721 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T17:11:34.722 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-04-25T17:11:34.722 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T17:11:34.722 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T17:11:34.722 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-04-25 17:10:47.018532528 +0000 2024-04-25T17:11:34.722 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-04-25 17:05:16.297754083 +0000 2024-04-25T17:11:34.722 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-04-25 17:05:16.297754083 +0000 2024-04-25T17:11:34.722 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-04-25 17:05:16.297754083 +0000 2024-04-25T17:11:34.722 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T17:11:34.765 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:34 smithi037 ceph-mon[26472]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:11:34.765 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:34 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:34.765 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:34 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:34.765 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:34 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi037", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-25T17:11:34.766 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:34 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:11:34.788 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-04-25T17:11:34.788 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-04-25T17:11:34.788 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000210051 s, 2.4 MB/s 2024-04-25T17:11:34.789 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T17:11:34.845 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_3 2024-04-25T17:11:34.902 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T17:11:34.902 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T17:11:34.902 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-04-25T17:11:34.902 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T17:11:34.902 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T17:11:34.902 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-04-25 17:10:47.019532515 +0000 2024-04-25T17:11:34.902 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-04-25 17:05:16.662749147 +0000 2024-04-25T17:11:34.902 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-04-25 17:05:16.662749147 +0000 2024-04-25T17:11:34.902 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-04-25 17:05:16.662749147 +0000 2024-04-25T17:11:34.903 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T17:11:34.917 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:34 smithi069 ceph-mon[34527]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:11:34.917 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:34 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:34.917 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:34 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:34.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:34 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi037", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-25T17:11:34.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:34 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:11:34.966 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-04-25T17:11:34.967 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-04-25T17:11:34.967 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000220159 s, 2.3 MB/s 2024-04-25T17:11:34.968 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T17:11:35.026 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_4 2024-04-25T17:11:35.081 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T17:11:35.081 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T17:11:35.082 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-04-25T17:11:35.082 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T17:11:35.082 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T17:11:35.082 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-04-25 17:10:47.019532515 +0000 2024-04-25T17:11:35.082 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-04-25 17:05:17.013744401 +0000 2024-04-25T17:11:35.082 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-04-25 17:05:17.013744401 +0000 2024-04-25T17:11:35.082 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-04-25 17:05:17.013744401 +0000 2024-04-25T17:11:35.082 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T17:11:35.146 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-04-25T17:11:35.146 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-04-25T17:11:35.147 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000192753 s, 2.7 MB/s 2024-04-25T17:11:35.148 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T17:11:35.205 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-04-25T17:11:35.205 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T17:11:35.224 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T17:11:35.224 DEBUG:teuthology.orchestra.run.smithi069:> stat /dev/vg_nvme/lv_1 2024-04-25T17:11:35.282 INFO:teuthology.orchestra.run.smithi069.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T17:11:35.282 INFO:teuthology.orchestra.run.smithi069.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T17:11:35.282 INFO:teuthology.orchestra.run.smithi069.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-04-25T17:11:35.282 INFO:teuthology.orchestra.run.smithi069.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T17:11:35.282 INFO:teuthology.orchestra.run.smithi069.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T17:11:35.282 INFO:teuthology.orchestra.run.smithi069.stdout:Access: 2024-04-25 17:11:20.456703515 +0000 2024-04-25T17:11:35.283 INFO:teuthology.orchestra.run.smithi069.stdout:Modify: 2024-04-25 17:05:11.894487503 +0000 2024-04-25T17:11:35.283 INFO:teuthology.orchestra.run.smithi069.stdout:Change: 2024-04-25 17:05:11.894487503 +0000 2024-04-25T17:11:35.283 INFO:teuthology.orchestra.run.smithi069.stdout: Birth: 2024-04-25 17:05:11.894487503 +0000 2024-04-25T17:11:35.283 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T17:11:35.350 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records in 2024-04-25T17:11:35.350 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records out 2024-04-25T17:11:35.351 INFO:teuthology.orchestra.run.smithi069.stderr:512 bytes copied, 0.000297055 s, 1.7 MB/s 2024-04-25T17:11:35.353 DEBUG:teuthology.orchestra.run.smithi069:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T17:11:35.410 DEBUG:teuthology.orchestra.run.smithi069:> stat /dev/vg_nvme/lv_2 2024-04-25T17:11:35.467 INFO:teuthology.orchestra.run.smithi069.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T17:11:35.467 INFO:teuthology.orchestra.run.smithi069.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T17:11:35.467 INFO:teuthology.orchestra.run.smithi069.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-04-25T17:11:35.468 INFO:teuthology.orchestra.run.smithi069.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T17:11:35.468 INFO:teuthology.orchestra.run.smithi069.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T17:11:35.468 INFO:teuthology.orchestra.run.smithi069.stdout:Access: 2024-04-25 17:11:20.456703515 +0000 2024-04-25T17:11:35.468 INFO:teuthology.orchestra.run.smithi069.stdout:Modify: 2024-04-25 17:05:12.230479014 +0000 2024-04-25T17:11:35.468 INFO:teuthology.orchestra.run.smithi069.stdout:Change: 2024-04-25 17:05:12.230479014 +0000 2024-04-25T17:11:35.468 INFO:teuthology.orchestra.run.smithi069.stdout: Birth: 2024-04-25 17:05:12.230479014 +0000 2024-04-25T17:11:35.468 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T17:11:35.532 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records in 2024-04-25T17:11:35.533 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records out 2024-04-25T17:11:35.533 INFO:teuthology.orchestra.run.smithi069.stderr:512 bytes copied, 0.000197247 s, 2.6 MB/s 2024-04-25T17:11:35.534 DEBUG:teuthology.orchestra.run.smithi069:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T17:11:35.592 DEBUG:teuthology.orchestra.run.smithi069:> stat /dev/vg_nvme/lv_3 2024-04-25T17:11:35.649 INFO:teuthology.orchestra.run.smithi069.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T17:11:35.650 INFO:teuthology.orchestra.run.smithi069.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T17:11:35.650 INFO:teuthology.orchestra.run.smithi069.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-04-25T17:11:35.650 INFO:teuthology.orchestra.run.smithi069.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T17:11:35.650 INFO:teuthology.orchestra.run.smithi069.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T17:11:35.650 INFO:teuthology.orchestra.run.smithi069.stdout:Access: 2024-04-25 17:11:20.456703515 +0000 2024-04-25T17:11:35.650 INFO:teuthology.orchestra.run.smithi069.stdout:Modify: 2024-04-25 17:05:12.568470475 +0000 2024-04-25T17:11:35.650 INFO:teuthology.orchestra.run.smithi069.stdout:Change: 2024-04-25 17:05:12.568470475 +0000 2024-04-25T17:11:35.650 INFO:teuthology.orchestra.run.smithi069.stdout: Birth: 2024-04-25 17:05:12.568470475 +0000 2024-04-25T17:11:35.651 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T17:11:35.715 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records in 2024-04-25T17:11:35.715 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records out 2024-04-25T17:11:35.715 INFO:teuthology.orchestra.run.smithi069.stderr:512 bytes copied, 0.000234058 s, 2.2 MB/s 2024-04-25T17:11:35.716 DEBUG:teuthology.orchestra.run.smithi069:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T17:11:35.774 DEBUG:teuthology.orchestra.run.smithi069:> stat /dev/vg_nvme/lv_4 2024-04-25T17:11:35.820 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:35 smithi037 ceph-mon[26472]: Reconfiguring crash.smithi037 (monmap changed)... 2024-04-25T17:11:35.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:35 smithi037 ceph-mon[26472]: Reconfiguring daemon crash.smithi037 on smithi037 2024-04-25T17:11:35.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:35 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:35.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:35 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:35.830 INFO:teuthology.orchestra.run.smithi069.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T17:11:35.830 INFO:teuthology.orchestra.run.smithi069.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T17:11:35.830 INFO:teuthology.orchestra.run.smithi069.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-04-25T17:11:35.830 INFO:teuthology.orchestra.run.smithi069.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T17:11:35.831 INFO:teuthology.orchestra.run.smithi069.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T17:11:35.831 INFO:teuthology.orchestra.run.smithi069.stdout:Access: 2024-04-25 17:11:20.457703492 +0000 2024-04-25T17:11:35.831 INFO:teuthology.orchestra.run.smithi069.stdout:Modify: 2024-04-25 17:05:12.897462163 +0000 2024-04-25T17:11:35.831 INFO:teuthology.orchestra.run.smithi069.stdout:Change: 2024-04-25 17:05:12.897462163 +0000 2024-04-25T17:11:35.831 INFO:teuthology.orchestra.run.smithi069.stdout: Birth: 2024-04-25 17:05:12.897462163 +0000 2024-04-25T17:11:35.831 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T17:11:35.894 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records in 2024-04-25T17:11:35.894 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records out 2024-04-25T17:11:35.894 INFO:teuthology.orchestra.run.smithi069.stderr:512 bytes copied, 0.0002191 s, 2.3 MB/s 2024-04-25T17:11:35.895 DEBUG:teuthology.orchestra.run.smithi069:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T17:11:35.917 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:35 smithi069 ceph-mon[34527]: Reconfiguring crash.smithi037 (monmap changed)... 2024-04-25T17:11:35.917 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:35 smithi069 ceph-mon[34527]: Reconfiguring daemon crash.smithi037 on smithi037 2024-04-25T17:11:35.917 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:35 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:35.917 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:35 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:35.933 INFO:tasks.cephadm:Deploying osd.0 on smithi037 with /dev/vg_nvme/lv_4... 2024-04-25T17:11:35.933 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-25T17:11:36.631 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:11:36.917 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:36 smithi069 ceph-mon[34527]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:11:36.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:36 smithi069 ceph-mon[34527]: Reconfiguring alertmanager.smithi037 (dependencies changed)... 2024-04-25T17:11:36.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:36 smithi069 ceph-mon[34527]: Reconfiguring daemon alertmanager.smithi037 on smithi037 2024-04-25T17:11:36.955 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:36 smithi037 ceph-mon[26472]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:11:36.955 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:36 smithi037 ceph-mon[26472]: Reconfiguring alertmanager.smithi037 (dependencies changed)... 2024-04-25T17:11:36.955 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:36 smithi037 ceph-mon[26472]: Reconfiguring daemon alertmanager.smithi037 on smithi037 2024-04-25T17:11:38.917 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:38 smithi069 ceph-mon[34527]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:11:38.991 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:38 smithi037 ceph-mon[26472]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:11:40.349 INFO:teuthology.orchestra.run.smithi037.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-25T17:11:40.349 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-25T17:11:40.349 INFO:teuthology.orchestra.run.smithi037.stderr: stderr: 10+0 records in 2024-04-25T17:11:40.349 INFO:teuthology.orchestra.run.smithi037.stderr:10+0 records out 2024-04-25T17:11:40.349 INFO:teuthology.orchestra.run.smithi037.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0133716 s, 784 MB/s 2024-04-25T17:11:40.349 INFO:teuthology.orchestra.run.smithi037.stderr:--> Zapping successful for: 2024-04-25T17:11:40.917 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:40 smithi069 ceph-mon[34527]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:11:40.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:40 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:11:40.977 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:40 smithi037 ceph-mon[26472]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:11:40.977 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:40 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:11:41.533 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi037:vg_nvme/lv_4 2024-04-25T17:11:42.339 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:11:42.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:42 smithi037 ceph-mon[26472]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:11:42.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:42 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:42.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:42 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:42.917 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:42 smithi069 ceph-mon[34527]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:11:42.917 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:42 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:42.917 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:42 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:43.917 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:43 smithi069 ceph-mon[34527]: Reconfiguring grafana.smithi037 (dependencies changed)... 2024-04-25T17:11:43.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:43 smithi069 ceph-mon[34527]: Reconfiguring daemon grafana.smithi037 on smithi037 2024-04-25T17:11:43.945 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:43 smithi037 ceph-mon[26472]: Reconfiguring grafana.smithi037 (dependencies changed)... 2024-04-25T17:11:43.945 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:43 smithi037 ceph-mon[26472]: Reconfiguring daemon grafana.smithi037 on smithi037 2024-04-25T17:11:44.917 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:44 smithi069 ceph-mon[34527]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:11:44.925 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:44 smithi037 ceph-mon[26472]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:11:46.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:46.084+0000 7f361c2e5700 1 -- 172.21.15.37:0/3322214533 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36140fce60 msgr2=0x7f36140fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:11:46.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:46.084+0000 7f361c2e5700 1 --2- 172.21.15.37:0/3322214533 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36140fce60 0x7f36140fd270 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3610004940 tx=0x7f3610009e30 comp rx=0 tx=0).stop 2024-04-25T17:11:46.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:46.084+0000 7f361c2e5700 1 -- 172.21.15.37:0/3322214533 shutdown_connections 2024-04-25T17:11:46.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:46.084+0000 7f361c2e5700 1 --2- 172.21.15.37:0/3322214533 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f36140fdfd0 0x7f36140fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:11:46.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:46.084+0000 7f361c2e5700 1 --2- 172.21.15.37:0/3322214533 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36140fce60 0x7f36140fd270 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:11:46.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:46.084+0000 7f361c2e5700 1 -- 172.21.15.37:0/3322214533 >> 172.21.15.37:0/3322214533 conn(0x7f36140f8540 msgr2=0x7f36140fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:11:46.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:46.085+0000 7f361c2e5700 1 -- 172.21.15.37:0/3322214533 shutdown_connections 2024-04-25T17:11:46.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:46.085+0000 7f361c2e5700 1 -- 172.21.15.37:0/3322214533 wait complete. 2024-04-25T17:11:46.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:46.085+0000 7f361c2e5700 1 Processor -- start 2024-04-25T17:11:46.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:46.085+0000 7f361c2e5700 1 -- start start 2024-04-25T17:11:46.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:46.085+0000 7f361c2e5700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f36140fce60 0x7f3614071de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:11:46.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:46.085+0000 7f361c2e5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36140fdfd0 0x7f36140702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:11:46.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:46.085+0000 7f361c2e5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3614070860 con 0x7f36140fdfd0 2024-04-25T17:11:46.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:46.085+0000 7f361c2e5700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36140709d0 con 0x7f36140fce60 2024-04-25T17:11:46.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:46.086+0000 7f361a081700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f36140fce60 0x7f3614071de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:11:46.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:46.086+0000 7f361a081700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f36140fce60 0x7f3614071de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.37:50516/0 (socket says 172.21.15.37:50516) 2024-04-25T17:11:46.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:46.086+0000 7f361a081700 1 -- 172.21.15.37:0/2833066941 learned_addr learned my addr 172.21.15.37:0/2833066941 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:11:46.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:46.086+0000 7f3619880700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36140fdfd0 0x7f36140702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:11:46.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:46.086+0000 7f3619880700 1 -- 172.21.15.37:0/2833066941 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f36140fce60 msgr2=0x7f3614071de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:11:46.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:46.086+0000 7f3619880700 1 --2- 172.21.15.37:0/2833066941 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f36140fce60 0x7f3614071de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:11:46.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:46.086+0000 7f3619880700 1 -- 172.21.15.37:0/2833066941 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3610005040 con 0x7f36140fdfd0 2024-04-25T17:11:46.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:46.086+0000 7f361a081700 1 --2- 172.21.15.37:0/2833066941 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f36140fce60 0x7f3614071de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T17:11:46.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:46.086+0000 7f3619880700 1 --2- 172.21.15.37:0/2833066941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36140fdfd0 0x7f36140702b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3604009fd0 tx=0x7f360400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:11:46.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:46.086+0000 7f360affd700 1 -- 172.21.15.37:0/2833066941 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3604004e90 con 0x7f36140fdfd0 2024-04-25T17:11:46.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:46.086+0000 7f361c2e5700 1 -- 172.21.15.37:0/2833066941 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3614070c50 con 0x7f36140fdfd0 2024-04-25T17:11:46.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:46.086+0000 7f360affd700 1 -- 172.21.15.37:0/2833066941 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f360400f040 con 0x7f36140fdfd0 2024-04-25T17:11:46.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:46.086+0000 7f360affd700 1 -- 172.21.15.37:0/2833066941 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f360400ca50 con 0x7f36140fdfd0 2024-04-25T17:11:46.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:46.086+0000 7f361c2e5700 1 -- 172.21.15.37:0/2833066941 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36141159c0 con 0x7f36140fdfd0 2024-04-25T17:11:46.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:46.087+0000 7f361c2e5700 1 -- 172.21.15.37:0/2833066941 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f361405f5c0 con 0x7f36140fdfd0 2024-04-25T17:11:46.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:46.088+0000 7f360affd700 1 -- 172.21.15.37:0/2833066941 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) v1 ==== 86573+0+0 (secure 0 0 0) 0x7f3604007cc0 con 0x7f36140fdfd0 2024-04-25T17:11:46.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:46.089+0000 7f360affd700 1 --2- 172.21.15.37:0/2833066941 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f3600069210 0x7f360006b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:11:46.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:46.089+0000 7f360affd700 1 -- 172.21.15.37:0/2833066941 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f3604085b40 con 0x7f36140fdfd0 2024-04-25T17:11:46.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:46.089+0000 7f361a081700 1 --2- 172.21.15.37:0/2833066941 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f3600069210 0x7f360006b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:11:46.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:46.089+0000 7f361a081700 1 --2- 172.21.15.37:0/2833066941 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f3600069210 0x7f360006b6c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3610013740 tx=0x7f3610009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:11:46.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:46.093+0000 7f360affd700 1 -- 172.21.15.37:0/2833066941 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f360404e250 con 0x7f36140fdfd0 2024-04-25T17:11:46.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:11:46.302+0000 7f361c2e5700 1 -- 172.21.15.37:0/2833066941 --> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f3614102270 con 0x7f3600069210 2024-04-25T17:11:46.844 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:46 smithi037 ceph-mon[26472]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:11:46.844 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:46 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T17:11:46.844 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:46 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T17:11:46.844 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:46 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:11:46.917 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:46 smithi069 ceph-mon[34527]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:11:46.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:46 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T17:11:46.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:46 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T17:11:46.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:46 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:11:47.925 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:47 smithi037 ceph-mon[26472]: from='client.14250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:11:48.167 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:47 smithi069 ceph-mon[34527]: from='client.14250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:11:48.934 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:48 smithi037 ceph-mon[26472]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:11:48.934 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:48 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:48.934 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:48 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:49.069 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:48 smithi069 ceph-mon[34527]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:11:49.069 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:48 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:49.070 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:48 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:11:50.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:49 smithi037 ceph-mon[26472]: Reconfiguring prometheus.smithi037 (dependencies changed)... 2024-04-25T17:11:50.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:49 smithi037 ceph-mon[26472]: Reconfiguring daemon prometheus.smithi037 on smithi037 2024-04-25T17:11:50.090 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:49 smithi069 ceph-mon[34527]: Reconfiguring prometheus.smithi037 (dependencies changed)... 2024-04-25T17:11:50.090 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:49 smithi069 ceph-mon[34527]: Reconfiguring daemon prometheus.smithi037 on smithi037 2024-04-25T17:11:51.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:50 smithi037 ceph-mon[26472]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:11:51.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:50 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/890214308' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c142de25-7aff-4c4b-b351-14e7b18de11d"}]: dispatch 2024-04-25T17:11:51.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:50 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/890214308' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c142de25-7aff-4c4b-b351-14e7b18de11d"}]': finished 2024-04-25T17:11:51.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:50 smithi037 ceph-mon[26472]: osdmap e6: 1 total, 0 up, 1 in 2024-04-25T17:11:51.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:50 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T17:11:51.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:50 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/1411146133' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T17:11:51.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:50 smithi069 ceph-mon[34527]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:11:51.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:50 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/890214308' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c142de25-7aff-4c4b-b351-14e7b18de11d"}]: dispatch 2024-04-25T17:11:51.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:50 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/890214308' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c142de25-7aff-4c4b-b351-14e7b18de11d"}]': finished 2024-04-25T17:11:51.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:50 smithi069 ceph-mon[34527]: osdmap e6: 1 total, 0 up, 1 in 2024-04-25T17:11:51.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:50 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T17:11:51.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:50 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/1411146133' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T17:11:53.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:52 smithi037 ceph-mon[26472]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:11:53.167 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:52 smithi069 ceph-mon[34527]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:11:54.959 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:54 smithi037 ceph-mon[26472]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:11:55.167 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:54 smithi069 ceph-mon[34527]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:11:55.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:55 smithi037 ceph-mon[26472]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:11:55.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:55 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:11:56.167 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:55 smithi069 ceph-mon[34527]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:11:56.167 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:55 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:11:58.789 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:11:58 smithi037 ceph-mon[26472]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:11:58.917 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:11:58 smithi069 ceph-mon[34527]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:12:00.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:00 smithi037 ceph-mon[26472]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:12:00.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:00 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:00.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:00 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:00.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:00 smithi037 ceph-mon[26472]: Reconfiguring crash.smithi069 (monmap changed)... 2024-04-25T17:12:00.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:00 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi069", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-25T17:12:00.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:00 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:12:00.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:00 smithi037 ceph-mon[26472]: Reconfiguring daemon crash.smithi069 on smithi069 2024-04-25T17:12:00.862 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:00 smithi069 ceph-mon[34527]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:12:00.862 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:00 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:00.862 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:00 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:00.862 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:00 smithi069 ceph-mon[34527]: Reconfiguring crash.smithi069 (monmap changed)... 2024-04-25T17:12:00.863 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:00 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi069", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-25T17:12:00.863 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:00 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:12:00.863 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:00 smithi069 ceph-mon[34527]: Reconfiguring daemon crash.smithi069 on smithi069 2024-04-25T17:12:01.540 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:01 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-25T17:12:01.540 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:01 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:12:01.540 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:01 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:01.540 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:01 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:01.540 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:01 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi069.mmuhdo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T17:12:01.540 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:01 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T17:12:01.540 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:01 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:12:01.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:01 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-25T17:12:01.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:01 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:12:01.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:01 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:01.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:01 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:01.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:01 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi069.mmuhdo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T17:12:01.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:01 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T17:12:01.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:01 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:12:02.792 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:02 smithi069 ceph-mon[34527]: Deploying daemon osd.0 on smithi037 2024-04-25T17:12:02.792 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:02 smithi069 ceph-mon[34527]: Reconfiguring mgr.smithi069.mmuhdo (monmap changed)... 2024-04-25T17:12:02.792 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:02 smithi069 ceph-mon[34527]: Reconfiguring daemon mgr.smithi069.mmuhdo on smithi069 2024-04-25T17:12:02.792 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:02 smithi069 ceph-mon[34527]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:12:02.792 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:02 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:02.792 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:02 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:02.792 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:02 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T17:12:02.792 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:02 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-25T17:12:02.793 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:02 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:12:02.820 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:02 smithi037 ceph-mon[26472]: Deploying daemon osd.0 on smithi037 2024-04-25T17:12:02.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:02 smithi037 ceph-mon[26472]: Reconfiguring mgr.smithi069.mmuhdo (monmap changed)... 2024-04-25T17:12:02.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:02 smithi037 ceph-mon[26472]: Reconfiguring daemon mgr.smithi069.mmuhdo on smithi069 2024-04-25T17:12:02.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:02 smithi037 ceph-mon[26472]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:12:02.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:02 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:02.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:02 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:02.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:02 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T17:12:02.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:02 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-25T17:12:02.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:02 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:12:03.667 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:03 smithi069 ceph-mon[34527]: Reconfiguring mon.smithi069 (monmap changed)... 2024-04-25T17:12:03.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:03 smithi069 ceph-mon[34527]: Reconfiguring daemon mon.smithi069 on smithi069 2024-04-25T17:12:03.746 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:03 smithi037 ceph-mon[26472]: Reconfiguring mon.smithi069 (monmap changed)... 2024-04-25T17:12:03.746 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:03 smithi037 ceph-mon[26472]: Reconfiguring daemon mon.smithi069 on smithi069 2024-04-25T17:12:04.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:04 smithi069 ceph-mon[34527]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:12:04.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:04 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:04.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:04 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:04.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:04 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-25T17:12:04.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:04 smithi069 ceph-mon[34527]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-25T17:12:04.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:04 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi037:9093"}]: dispatch 2024-04-25T17:12:04.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:04 smithi069 ceph-mon[34527]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi037:9093"}]: dispatch 2024-04-25T17:12:04.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:04 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:04.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:04 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-25T17:12:04.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:04 smithi069 ceph-mon[34527]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-25T17:12:04.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:04 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi037:3000"}]: dispatch 2024-04-25T17:12:04.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:04 smithi069 ceph-mon[34527]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi037:3000"}]: dispatch 2024-04-25T17:12:04.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:04 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:04.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:04 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-25T17:12:04.920 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:04 smithi069 ceph-mon[34527]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-25T17:12:04.920 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:04 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi037:9095"}]: dispatch 2024-04-25T17:12:04.920 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:04 smithi069 ceph-mon[34527]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi037:9095"}]: dispatch 2024-04-25T17:12:04.920 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:04 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:04.920 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:04 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:12:04.996 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:04 smithi037 ceph-mon[26472]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:12:04.997 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:04 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:04.997 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:04 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:04.997 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:04 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-25T17:12:04.997 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:04 smithi037 ceph-mon[26472]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-25T17:12:04.997 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:04 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi037:9093"}]: dispatch 2024-04-25T17:12:04.997 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:04 smithi037 ceph-mon[26472]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi037:9093"}]: dispatch 2024-04-25T17:12:04.998 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:04 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:04.998 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:04 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-25T17:12:04.998 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:04 smithi037 ceph-mon[26472]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-25T17:12:04.998 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:04 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi037:3000"}]: dispatch 2024-04-25T17:12:04.998 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:04 smithi037 ceph-mon[26472]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi037:3000"}]: dispatch 2024-04-25T17:12:04.998 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:04 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:04.998 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:04 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-25T17:12:04.999 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:04 smithi037 ceph-mon[26472]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-25T17:12:04.999 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:04 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi037:9095"}]: dispatch 2024-04-25T17:12:04.999 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:04 smithi037 ceph-mon[26472]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi037:9095"}]: dispatch 2024-04-25T17:12:04.999 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:04 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:04.999 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:04 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:12:06.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:06 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:06.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:06 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:06.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:06 smithi037 ceph-mon[26472]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:12:06.667 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:06 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:06.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:06 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:06.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:06 smithi069 ceph-mon[34527]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:12:08.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:08 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:08.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:08 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:08.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:08 smithi037 ceph-mon[26472]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:12:08.667 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:08 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:08.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:08 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:08.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:08 smithi069 ceph-mon[34527]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:12:10.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:10 smithi037 ceph-mon[26472]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:12:10.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:10 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:12:10.917 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:10 smithi069 ceph-mon[34527]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:12:10.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:10 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:12:11.192 INFO:teuthology.orchestra.run.smithi037.stdout:Created osd(s) 0 on host 'smithi037' 2024-04-25T17:12:11.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:11.192+0000 7f360affd700 1 -- 172.21.15.37:0/2833066941 <== mgr.14214 v2:172.21.15.37:6800/3566135606 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f3614102270 con 0x7f3600069210 2024-04-25T17:12:11.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:11.194+0000 7f361c2e5700 1 -- 172.21.15.37:0/2833066941 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f3600069210 msgr2=0x7f360006b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:12:11.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:11.194+0000 7f361c2e5700 1 --2- 172.21.15.37:0/2833066941 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f3600069210 0x7f360006b6c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3610013740 tx=0x7f3610009e30 comp rx=0 tx=0).stop 2024-04-25T17:12:11.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:11.195+0000 7f361c2e5700 1 -- 172.21.15.37:0/2833066941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36140fdfd0 msgr2=0x7f36140702b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:12:11.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:11.195+0000 7f361c2e5700 1 --2- 172.21.15.37:0/2833066941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36140fdfd0 0x7f36140702b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3604009fd0 tx=0x7f360400b040 comp rx=0 tx=0).stop 2024-04-25T17:12:11.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:11.195+0000 7f361c2e5700 1 -- 172.21.15.37:0/2833066941 shutdown_connections 2024-04-25T17:12:11.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:11.195+0000 7f361c2e5700 1 --2- 172.21.15.37:0/2833066941 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f3600069210 0x7f360006b6c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:12:11.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:11.195+0000 7f361c2e5700 1 --2- 172.21.15.37:0/2833066941 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f36140fce60 0x7f3614071de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:12:11.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:11.195+0000 7f361c2e5700 1 --2- 172.21.15.37:0/2833066941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f36140fdfd0 0x7f36140702b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:12:11.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:11.195+0000 7f361c2e5700 1 -- 172.21.15.37:0/2833066941 >> 172.21.15.37:0/2833066941 conn(0x7f36140f8540 msgr2=0x7f36140f9bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:12:11.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:11.195+0000 7f361c2e5700 1 -- 172.21.15.37:0/2833066941 shutdown_connections 2024-04-25T17:12:11.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:11.195+0000 7f361c2e5700 1 -- 172.21.15.37:0/2833066941 wait complete. 2024-04-25T17:12:11.805 DEBUG:teuthology.orchestra.run.smithi037:osd.0> sudo journalctl -f -n 0 -u ceph-599bb7fc-0326-11ef-bc93-c7b262605968@osd.0.service 2024-04-25T17:12:11.807 INFO:tasks.cephadm:Deploying osd.1 on smithi037 with /dev/vg_nvme/lv_3... 2024-04-25T17:12:11.808 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-25T17:12:12.032 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:11 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:12.032 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:11 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:12.032 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:11 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:12.032 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:11 smithi037 ceph-mon[26472]: from='osd.0 [v2:172.21.15.37:6802/2457908683,v1:172.21.15.37:6803/2457908683]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-25T17:12:12.032 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:11 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:12.032 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:11 smithi037 ceph-mon[26472]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:12:12.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:11 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:12.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:11 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:12.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:11 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:12.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:11 smithi069 ceph-mon[34527]: from='osd.0 [v2:172.21.15.37:6802/2457908683,v1:172.21.15.37:6803/2457908683]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-25T17:12:12.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:11 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:12.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:11 smithi069 ceph-mon[34527]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:12:12.585 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:12:13.321 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:13 smithi037 ceph-mon[26472]: from='osd.0 [v2:172.21.15.37:6802/2457908683,v1:172.21.15.37:6803/2457908683]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-25T17:12:13.321 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:13 smithi037 ceph-mon[26472]: osdmap e7: 1 total, 0 up, 1 in 2024-04-25T17:12:13.321 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:13 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T17:12:13.321 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:13 smithi037 ceph-mon[26472]: from='osd.0 [v2:172.21.15.37:6802/2457908683,v1:172.21.15.37:6803/2457908683]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-04-25T17:12:13.322 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:12:13 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-0[44618]: 2024-04-25T17:12:13.152+0000 7f00f09d8700 -1 osd.0 0 waiting for initial osdmap 2024-04-25T17:12:13.322 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:12:13 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-0[44618]: 2024-04-25T17:12:13.160+0000 7f00ecfd6700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T17:12:13.417 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:13 smithi069 ceph-mon[34527]: from='osd.0 [v2:172.21.15.37:6802/2457908683,v1:172.21.15.37:6803/2457908683]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-25T17:12:13.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:13 smithi069 ceph-mon[34527]: osdmap e7: 1 total, 0 up, 1 in 2024-04-25T17:12:13.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:13 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T17:12:13.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:13 smithi069 ceph-mon[34527]: from='osd.0 [v2:172.21.15.37:6802/2457908683,v1:172.21.15.37:6803/2457908683]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-04-25T17:12:14.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:14 smithi069 ceph-mon[34527]: purged_snaps scrub starts 2024-04-25T17:12:14.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:14 smithi069 ceph-mon[34527]: purged_snaps scrub ok 2024-04-25T17:12:14.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:14 smithi069 ceph-mon[34527]: from='osd.0 [v2:172.21.15.37:6802/2457908683,v1:172.21.15.37:6803/2457908683]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-04-25T17:12:14.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:14 smithi069 ceph-mon[34527]: osdmap e8: 1 total, 0 up, 1 in 2024-04-25T17:12:14.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:14 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T17:12:14.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:14 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T17:12:14.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:14 smithi069 ceph-mon[34527]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:12:14.421 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:14 smithi037 ceph-mon[26472]: purged_snaps scrub starts 2024-04-25T17:12:14.421 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:14 smithi037 ceph-mon[26472]: purged_snaps scrub ok 2024-04-25T17:12:14.421 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:14 smithi037 ceph-mon[26472]: from='osd.0 [v2:172.21.15.37:6802/2457908683,v1:172.21.15.37:6803/2457908683]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-04-25T17:12:14.421 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:14 smithi037 ceph-mon[26472]: osdmap e8: 1 total, 0 up, 1 in 2024-04-25T17:12:14.421 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:14 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T17:12:14.421 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:14 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T17:12:14.421 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:14 smithi037 ceph-mon[26472]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-04-25T17:12:14.682 INFO:teuthology.orchestra.run.smithi037.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-25T17:12:14.682 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-25T17:12:14.682 INFO:teuthology.orchestra.run.smithi037.stderr: stderr: 10+0 records in 2024-04-25T17:12:14.683 INFO:teuthology.orchestra.run.smithi037.stderr:10+0 records out 2024-04-25T17:12:14.683 INFO:teuthology.orchestra.run.smithi037.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0132963 s, 789 MB/s 2024-04-25T17:12:14.683 INFO:teuthology.orchestra.run.smithi037.stderr:--> Zapping successful for: 2024-04-25T17:12:15.304 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:15 smithi037 ceph-mon[26472]: osd.0 [v2:172.21.15.37:6802/2457908683,v1:172.21.15.37:6803/2457908683] boot 2024-04-25T17:12:15.304 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:15 smithi037 ceph-mon[26472]: osdmap e9: 1 total, 1 up, 1 in 2024-04-25T17:12:15.304 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:15 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T17:12:15.330 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi037:vg_nvme/lv_3 2024-04-25T17:12:15.417 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:15 smithi069 ceph-mon[34527]: osd.0 [v2:172.21.15.37:6802/2457908683,v1:172.21.15.37:6803/2457908683] boot 2024-04-25T17:12:15.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:15 smithi069 ceph-mon[34527]: osdmap e9: 1 total, 1 up, 1 in 2024-04-25T17:12:15.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:15 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T17:12:15.798 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:12:16.194 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:16 smithi037 ceph-mon[26472]: osdmap e10: 1 total, 1 up, 1 in 2024-04-25T17:12:16.194 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:16 smithi037 ceph-mon[26472]: pgmap v38: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-25T17:12:16.417 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:16 smithi069 ceph-mon[34527]: osdmap e10: 1 total, 1 up, 1 in 2024-04-25T17:12:16.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:16 smithi069 ceph-mon[34527]: pgmap v38: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-25T17:12:18.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:18.076+0000 7f0f10c3e700 1 -- 172.21.15.37:0/1822473924 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f0c0fdfd0 msgr2=0x7f0f0c0fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:12:18.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:18.076+0000 7f0f10c3e700 1 --2- 172.21.15.37:0/1822473924 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f0c0fdfd0 0x7f0f0c0fe440 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0f00004940 tx=0x7f0f00009e30 comp rx=0 tx=0).stop 2024-04-25T17:12:18.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:18.076+0000 7f0f10c3e700 1 -- 172.21.15.37:0/1822473924 shutdown_connections 2024-04-25T17:12:18.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:18.076+0000 7f0f10c3e700 1 --2- 172.21.15.37:0/1822473924 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f0c0fdfd0 0x7f0f0c0fe440 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:12:18.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:18.076+0000 7f0f10c3e700 1 --2- 172.21.15.37:0/1822473924 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0f0c0fce60 0x7f0f0c0fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:12:18.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:18.076+0000 7f0f10c3e700 1 -- 172.21.15.37:0/1822473924 >> 172.21.15.37:0/1822473924 conn(0x7f0f0c0f8540 msgr2=0x7f0f0c0fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:12:18.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:18.076+0000 7f0f10c3e700 1 -- 172.21.15.37:0/1822473924 shutdown_connections 2024-04-25T17:12:18.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:18.076+0000 7f0f10c3e700 1 -- 172.21.15.37:0/1822473924 wait complete. 2024-04-25T17:12:18.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:18.076+0000 7f0f10c3e700 1 Processor -- start 2024-04-25T17:12:18.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:18.077+0000 7f0f10c3e700 1 -- start start 2024-04-25T17:12:18.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:18.077+0000 7f0f10c3e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0f0c0fce60 0x7f0f0c10d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:12:18.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:18.077+0000 7f0f10c3e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f0c0fdfd0 0x7f0f0c10de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:12:18.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:18.077+0000 7f0f10c3e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0c10e400 con 0x7f0f0c0fdfd0 2024-04-25T17:12:18.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:18.077+0000 7f0f10c3e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0c10e570 con 0x7f0f0c0fce60 2024-04-25T17:12:18.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:18.077+0000 7f0f09d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f0c0fdfd0 0x7f0f0c10de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:12:18.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:18.077+0000 7f0f09d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f0c0fdfd0 0x7f0f0c10de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51898/0 (socket says 172.21.15.37:51898) 2024-04-25T17:12:18.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:18.077+0000 7f0f09d9b700 1 -- 172.21.15.37:0/1899999127 learned_addr learned my addr 172.21.15.37:0/1899999127 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:12:18.079 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:18.077+0000 7f0f0a59c700 1 --2- 172.21.15.37:0/1899999127 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0f0c0fce60 0x7f0f0c10d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:12:18.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:18.077+0000 7f0f09d9b700 1 -- 172.21.15.37:0/1899999127 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0f0c0fce60 msgr2=0x7f0f0c10d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:12:18.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:18.077+0000 7f0f09d9b700 1 --2- 172.21.15.37:0/1899999127 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0f0c0fce60 0x7f0f0c10d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:12:18.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:18.077+0000 7f0f09d9b700 1 -- 172.21.15.37:0/1899999127 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f00005040 con 0x7f0f0c0fdfd0 2024-04-25T17:12:18.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:18.077+0000 7f0f09d9b700 1 --2- 172.21.15.37:0/1899999127 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f0c0fdfd0 0x7f0f0c10de00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0f0000b3b0 tx=0x7f0f00009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:12:18.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:18.077+0000 7f0efaffd700 1 -- 172.21.15.37:0/1899999127 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f0000e040 con 0x7f0f0c0fdfd0 2024-04-25T17:12:18.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:18.077+0000 7f0efaffd700 1 -- 172.21.15.37:0/1899999127 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0f00004290 con 0x7f0f0c0fdfd0 2024-04-25T17:12:18.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:18.077+0000 7f0f10c3e700 1 -- 172.21.15.37:0/1899999127 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f0c112f70 con 0x7f0f0c0fdfd0 2024-04-25T17:12:18.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:18.077+0000 7f0efaffd700 1 -- 172.21.15.37:0/1899999127 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f0001c3f0 con 0x7f0f0c0fdfd0 2024-04-25T17:12:18.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:18.078+0000 7f0f10c3e700 1 -- 172.21.15.37:0/1899999127 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f0c113500 con 0x7f0f0c0fdfd0 2024-04-25T17:12:18.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:18.079+0000 7f0f10c3e700 1 -- 172.21.15.37:0/1899999127 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f0c04c710 con 0x7f0f0c0fdfd0 2024-04-25T17:12:18.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:18.079+0000 7f0efaffd700 1 -- 172.21.15.37:0/1899999127 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) v1 ==== 86573+0+0 (secure 0 0 0) 0x7f0f0000bbf0 con 0x7f0f0c0fdfd0 2024-04-25T17:12:18.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:18.079+0000 7f0efaffd700 1 --2- 172.21.15.37:0/1899999127 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f0ef4069210 0x7f0ef406b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:12:18.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:18.080+0000 7f0efaffd700 1 -- 172.21.15.37:0/1899999127 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1978+0+0 (secure 0 0 0) 0x7f0f000875b0 con 0x7f0f0c0fdfd0 2024-04-25T17:12:18.081 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:18.080+0000 7f0f0a59c700 1 --2- 172.21.15.37:0/1899999127 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f0ef4069210 0x7f0ef406b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:12:18.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:18.080+0000 7f0f0a59c700 1 --2- 172.21.15.37:0/1899999127 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f0ef4069210 0x7f0ef406b6c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0efc007b20 tx=0x7f0efc009e20 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:12:18.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:18.084+0000 7f0efaffd700 1 -- 172.21.15.37:0/1899999127 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f0f000581f0 con 0x7f0f0c0fdfd0 2024-04-25T17:12:18.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:18.296+0000 7f0f10c3e700 1 -- 172.21.15.37:0/1899999127 --> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f0f0c1136f0 con 0x7f0ef4069210 2024-04-25T17:12:18.315 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:18 smithi037 ceph-mon[26472]: Detected new or changed devices on smithi037 2024-04-25T17:12:18.315 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:18 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:18.315 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:18 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:18.315 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:18 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T17:12:18.316 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:18 smithi037 ceph-mon[26472]: Adjusting osd_memory_target on smithi037 to 12869M 2024-04-25T17:12:18.316 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:18 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:18.316 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:18 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:12:18.316 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:18 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:12:18.316 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:18 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:18.316 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:18 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:12:18.316 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:18 smithi037 ceph-mon[26472]: pgmap v39: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-25T17:12:18.417 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:18 smithi069 ceph-mon[34527]: Detected new or changed devices on smithi037 2024-04-25T17:12:18.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:18 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:18.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:18 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:18.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:18 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T17:12:18.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:18 smithi069 ceph-mon[34527]: Adjusting osd_memory_target on smithi037 to 12869M 2024-04-25T17:12:18.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:18 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:18.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:18 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:12:18.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:18 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:12:18.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:18 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:18.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:18 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:12:18.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:18 smithi069 ceph-mon[34527]: pgmap v39: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-25T17:12:19.262 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:19 smithi037 ceph-mon[26472]: from='client.14268 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:12:19.262 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:19 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T17:12:19.263 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:19 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T17:12:19.263 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:19 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:12:19.263 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:19 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:19.263 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:19 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:19.667 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:19 smithi069 ceph-mon[34527]: from='client.14268 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:12:19.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:19 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T17:12:19.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:19 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T17:12:19.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:19 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:12:19.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:19 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:19.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:19 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:20.537 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:20 smithi037 ceph-mon[26472]: pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-25T17:12:20.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:20 smithi069 ceph-mon[34527]: pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-25T17:12:22.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:22 smithi037 ceph-mon[26472]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-25T17:12:22.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:22 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/2830871961' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ec683da0-f3c1-44b5-8f1d-69bec27fbe5b"}]: dispatch 2024-04-25T17:12:22.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:22 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/2830871961' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ec683da0-f3c1-44b5-8f1d-69bec27fbe5b"}]': finished 2024-04-25T17:12:22.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:22 smithi037 ceph-mon[26472]: osdmap e11: 2 total, 1 up, 2 in 2024-04-25T17:12:22.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:22 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T17:12:22.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:22 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/3469739523' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T17:12:22.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:22 smithi069 ceph-mon[34527]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-25T17:12:22.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:22 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/2830871961' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ec683da0-f3c1-44b5-8f1d-69bec27fbe5b"}]: dispatch 2024-04-25T17:12:22.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:22 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/2830871961' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ec683da0-f3c1-44b5-8f1d-69bec27fbe5b"}]': finished 2024-04-25T17:12:22.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:22 smithi069 ceph-mon[34527]: osdmap e11: 2 total, 1 up, 2 in 2024-04-25T17:12:22.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:22 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T17:12:22.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:22 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/3469739523' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T17:12:24.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:24 smithi037 ceph-mon[26472]: pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-25T17:12:24.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:24 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:24.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:24 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:24.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:24 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:12:24.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:24 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:12:24.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:24 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:24.917 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:24 smithi069 ceph-mon[34527]: pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-25T17:12:24.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:24 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:24.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:24 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:24.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:24 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:12:24.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:24 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:12:24.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:24 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:25.753 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:25 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:12:25.818 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:25 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:12:26.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:26 smithi037 ceph-mon[26472]: pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-25T17:12:26.917 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:26 smithi069 ceph-mon[34527]: pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-25T17:12:28.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:28 smithi037 ceph-mon[26472]: pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-25T17:12:28.917 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:28 smithi069 ceph-mon[34527]: pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-25T17:12:29.656 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:29 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-25T17:12:29.656 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:29 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:12:29.917 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:29 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-25T17:12:29.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:29 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:12:30.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:30 smithi069 ceph-mon[34527]: Deploying daemon osd.1 on smithi037 2024-04-25T17:12:30.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:30 smithi069 ceph-mon[34527]: pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-25T17:12:30.799 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:30 smithi037 ceph-mon[26472]: Deploying daemon osd.1 on smithi037 2024-04-25T17:12:30.799 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:30 smithi037 ceph-mon[26472]: pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-25T17:12:32.696 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:32 smithi037 ceph-mon[26472]: pgmap v47: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-25T17:12:32.917 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:32 smithi069 ceph-mon[34527]: pgmap v47: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-25T17:12:34.788 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:34 smithi037 ceph-mon[26472]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-25T17:12:34.788 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:34 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:34.789 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:34 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:12:34.789 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:34 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:34.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:34 smithi069 ceph-mon[34527]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-25T17:12:34.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:34 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:34.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:34 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:12:34.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:34 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:36.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:36 smithi037 ceph-mon[26472]: pgmap v49: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-25T17:12:36.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:36 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:36.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:36 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:36.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:36 smithi069 ceph-mon[34527]: pgmap v49: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-25T17:12:36.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:36 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:36.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:36 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:37.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:37.658+0000 7f0efaffd700 1 -- 172.21.15.37:0/1899999127 <== mgr.14214 v2:172.21.15.37:6800/3566135606 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f0f0c1136f0 con 0x7f0ef4069210 2024-04-25T17:12:37.658 INFO:teuthology.orchestra.run.smithi037.stdout:Created osd(s) 1 on host 'smithi037' 2024-04-25T17:12:37.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:37.660+0000 7f0f10c3e700 1 -- 172.21.15.37:0/1899999127 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f0ef4069210 msgr2=0x7f0ef406b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:12:37.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:37.660+0000 7f0f10c3e700 1 --2- 172.21.15.37:0/1899999127 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f0ef4069210 0x7f0ef406b6c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0efc007b20 tx=0x7f0efc009e20 comp rx=0 tx=0).stop 2024-04-25T17:12:37.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:37.660+0000 7f0f10c3e700 1 -- 172.21.15.37:0/1899999127 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f0c0fdfd0 msgr2=0x7f0f0c10de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:12:37.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:37.660+0000 7f0f10c3e700 1 --2- 172.21.15.37:0/1899999127 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f0c0fdfd0 0x7f0f0c10de00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0f0000b3b0 tx=0x7f0f00009e30 comp rx=0 tx=0).stop 2024-04-25T17:12:37.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:37.660+0000 7f0f10c3e700 1 -- 172.21.15.37:0/1899999127 shutdown_connections 2024-04-25T17:12:37.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:37.660+0000 7f0f10c3e700 1 --2- 172.21.15.37:0/1899999127 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f0ef4069210 0x7f0ef406b6c0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:12:37.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:37.660+0000 7f0f10c3e700 1 --2- 172.21.15.37:0/1899999127 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0f0c0fce60 0x7f0f0c10d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:12:37.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:37.660+0000 7f0f10c3e700 1 --2- 172.21.15.37:0/1899999127 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f0c0fdfd0 0x7f0f0c10de00 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:12:37.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:37.660+0000 7f0f10c3e700 1 -- 172.21.15.37:0/1899999127 >> 172.21.15.37:0/1899999127 conn(0x7f0f0c0f8540 msgr2=0x7f0f0c0f9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:12:37.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:37.660+0000 7f0f10c3e700 1 -- 172.21.15.37:0/1899999127 shutdown_connections 2024-04-25T17:12:37.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:37.660+0000 7f0f10c3e700 1 -- 172.21.15.37:0/1899999127 wait complete. 2024-04-25T17:12:38.629 DEBUG:teuthology.orchestra.run.smithi037:osd.1> sudo journalctl -f -n 0 -u ceph-599bb7fc-0326-11ef-bc93-c7b262605968@osd.1.service 2024-04-25T17:12:38.631 INFO:tasks.cephadm:Deploying osd.2 on smithi037 with /dev/vg_nvme/lv_2... 2024-04-25T17:12:38.632 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-25T17:12:38.881 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:38 smithi037 ceph-mon[26472]: pgmap v50: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-25T17:12:38.881 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:38 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:38.881 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:38 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:38.881 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:38 smithi037 ceph-mon[26472]: from='osd.1 [v2:172.21.15.37:6810/24763193,v1:172.21.15.37:6811/24763193]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-25T17:12:38.917 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:38 smithi069 ceph-mon[34527]: pgmap v50: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-25T17:12:38.917 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:38 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:38.917 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:38 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:38.917 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:38 smithi069 ceph-mon[34527]: from='osd.1 [v2:172.21.15.37:6810/24763193,v1:172.21.15.37:6811/24763193]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-25T17:12:39.310 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:12:39.765 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:39 smithi037 ceph-mon[26472]: from='osd.1 [v2:172.21.15.37:6810/24763193,v1:172.21.15.37:6811/24763193]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-25T17:12:39.765 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:39 smithi037 ceph-mon[26472]: osdmap e12: 2 total, 1 up, 2 in 2024-04-25T17:12:39.765 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:39 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T17:12:39.765 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:39 smithi037 ceph-mon[26472]: from='osd.1 [v2:172.21.15.37:6810/24763193,v1:172.21.15.37:6811/24763193]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-04-25T17:12:39.766 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:12:39 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-1[51671]: 2024-04-25T17:12:39.634+0000 7f825dabd700 -1 osd.1 0 waiting for initial osdmap 2024-04-25T17:12:39.766 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:12:39 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-1[51671]: 2024-04-25T17:12:39.639+0000 7f82550b1700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T17:12:39.917 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:39 smithi069 ceph-mon[34527]: from='osd.1 [v2:172.21.15.37:6810/24763193,v1:172.21.15.37:6811/24763193]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-25T17:12:39.917 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:39 smithi069 ceph-mon[34527]: osdmap e12: 2 total, 1 up, 2 in 2024-04-25T17:12:39.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:39 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T17:12:39.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:39 smithi069 ceph-mon[34527]: from='osd.1 [v2:172.21.15.37:6810/24763193,v1:172.21.15.37:6811/24763193]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-04-25T17:12:40.725 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:40 smithi037 ceph-mon[26472]: pgmap v52: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-25T17:12:40.725 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:40 smithi037 ceph-mon[26472]: from='osd.1 [v2:172.21.15.37:6810/24763193,v1:172.21.15.37:6811/24763193]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-04-25T17:12:40.725 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:40 smithi037 ceph-mon[26472]: osdmap e13: 2 total, 1 up, 2 in 2024-04-25T17:12:40.725 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:40 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T17:12:40.725 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:40 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T17:12:40.725 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:40 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:12:40.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:40 smithi069 ceph-mon[34527]: pgmap v52: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-25T17:12:40.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:40 smithi069 ceph-mon[34527]: from='osd.1 [v2:172.21.15.37:6810/24763193,v1:172.21.15.37:6811/24763193]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-04-25T17:12:40.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:40 smithi069 ceph-mon[34527]: osdmap e13: 2 total, 1 up, 2 in 2024-04-25T17:12:40.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:40 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T17:12:40.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:40 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T17:12:40.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:40 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:12:41.296 INFO:teuthology.orchestra.run.smithi037.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-25T17:12:41.296 INFO:teuthology.orchestra.run.smithi037.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-25T17:12:41.296 INFO:teuthology.orchestra.run.smithi037.stderr: stderr: 10+0 records in 2024-04-25T17:12:41.296 INFO:teuthology.orchestra.run.smithi037.stderr:10+0 records out 2024-04-25T17:12:41.296 INFO:teuthology.orchestra.run.smithi037.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0122779 s, 854 MB/s 2024-04-25T17:12:41.296 INFO:teuthology.orchestra.run.smithi037.stderr:--> Zapping successful for: 2024-04-25T17:12:41.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:41 smithi069 ceph-mon[34527]: purged_snaps scrub starts 2024-04-25T17:12:41.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:41 smithi069 ceph-mon[34527]: purged_snaps scrub ok 2024-04-25T17:12:41.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:41 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T17:12:41.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:41 smithi069 ceph-mon[34527]: osd.1 [v2:172.21.15.37:6810/24763193,v1:172.21.15.37:6811/24763193] boot 2024-04-25T17:12:41.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:41 smithi069 ceph-mon[34527]: osdmap e14: 2 total, 2 up, 2 in 2024-04-25T17:12:41.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:41 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T17:12:42.013 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:41 smithi037 ceph-mon[26472]: purged_snaps scrub starts 2024-04-25T17:12:42.013 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:41 smithi037 ceph-mon[26472]: purged_snaps scrub ok 2024-04-25T17:12:42.013 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:41 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T17:12:42.013 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:41 smithi037 ceph-mon[26472]: osd.1 [v2:172.21.15.37:6810/24763193,v1:172.21.15.37:6811/24763193] boot 2024-04-25T17:12:42.013 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:41 smithi037 ceph-mon[26472]: osdmap e14: 2 total, 2 up, 2 in 2024-04-25T17:12:42.013 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:41 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T17:12:42.288 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi037:vg_nvme/lv_2 2024-04-25T17:12:42.917 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:42 smithi069 ceph-mon[34527]: pgmap v55: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-25T17:12:42.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:42 smithi069 ceph-mon[34527]: osdmap e15: 2 total, 2 up, 2 in 2024-04-25T17:12:42.957 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:12:43.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:42 smithi037 ceph-mon[26472]: pgmap v55: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-04-25T17:12:43.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:42 smithi037 ceph-mon[26472]: osdmap e15: 2 total, 2 up, 2 in 2024-04-25T17:12:44.432 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:44 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:44.432 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:44 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:44.432 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:44 smithi037 ceph-mon[26472]: pgmap v57: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-25T17:12:44.667 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:44 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:44.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:44 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:44.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:44 smithi069 ceph-mon[34527]: pgmap v57: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-25T17:12:45.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:45.384+0000 7f473fa2e700 1 -- 172.21.15.37:0/2041772895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47380fdfd0 msgr2=0x7f47380fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:12:45.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:45.384+0000 7f473fa2e700 1 --2- 172.21.15.37:0/2041772895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47380fdfd0 0x7f47380fe440 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4728004940 tx=0x7f4728009e30 comp rx=0 tx=0).stop 2024-04-25T17:12:45.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:45.385+0000 7f473fa2e700 1 -- 172.21.15.37:0/2041772895 shutdown_connections 2024-04-25T17:12:45.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:45.385+0000 7f473fa2e700 1 --2- 172.21.15.37:0/2041772895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47380fdfd0 0x7f47380fe440 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:12:45.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:45.385+0000 7f473fa2e700 1 --2- 172.21.15.37:0/2041772895 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f47380fce60 0x7f47380fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:12:45.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:45.385+0000 7f473fa2e700 1 -- 172.21.15.37:0/2041772895 >> 172.21.15.37:0/2041772895 conn(0x7f47380f8540 msgr2=0x7f47380fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:12:45.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:45.385+0000 7f473fa2e700 1 -- 172.21.15.37:0/2041772895 shutdown_connections 2024-04-25T17:12:45.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:45.385+0000 7f473fa2e700 1 -- 172.21.15.37:0/2041772895 wait complete. 2024-04-25T17:12:45.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:45.385+0000 7f473fa2e700 1 Processor -- start 2024-04-25T17:12:45.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:45.385+0000 7f473fa2e700 1 -- start start 2024-04-25T17:12:45.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:45.385+0000 7f473fa2e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47380fce60 0x7f473810d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:12:45.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:45.385+0000 7f473fa2e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f47380fdfd0 0x7f473810de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:12:45.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:45.386+0000 7f473fa2e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f473810e450 con 0x7f47380fce60 2024-04-25T17:12:45.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:45.386+0000 7f473fa2e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f473810e5c0 con 0x7f47380fdfd0 2024-04-25T17:12:45.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:45.386+0000 7f473d7ca700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47380fce60 0x7f473810d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:12:45.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:45.386+0000 7f473d7ca700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47380fce60 0x7f473810d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45224/0 (socket says 172.21.15.37:45224) 2024-04-25T17:12:45.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:45.386+0000 7f473d7ca700 1 -- 172.21.15.37:0/3526015288 learned_addr learned my addr 172.21.15.37:0/3526015288 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:12:45.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:45.386+0000 7f473cfc9700 1 --2- 172.21.15.37:0/3526015288 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f47380fdfd0 0x7f473810de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:12:45.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:45.386+0000 7f473d7ca700 1 -- 172.21.15.37:0/3526015288 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f47380fdfd0 msgr2=0x7f473810de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:12:45.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:45.386+0000 7f473d7ca700 1 --2- 172.21.15.37:0/3526015288 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f47380fdfd0 0x7f473810de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:12:45.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:45.386+0000 7f473d7ca700 1 -- 172.21.15.37:0/3526015288 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4728005040 con 0x7f47380fce60 2024-04-25T17:12:45.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:45.386+0000 7f473d7ca700 1 --2- 172.21.15.37:0/3526015288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47380fce60 0x7f473810d910 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f473400c830 tx=0x7f4734004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:12:45.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:45.386+0000 7f472dffb700 1 -- 172.21.15.37:0/3526015288 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f473400a760 con 0x7f47380fce60 2024-04-25T17:12:45.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:45.386+0000 7f473fa2e700 1 -- 172.21.15.37:0/3526015288 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4738112fc0 con 0x7f47380fce60 2024-04-25T17:12:45.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:45.386+0000 7f472dffb700 1 -- 172.21.15.37:0/3526015288 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f473400ad90 con 0x7f47380fce60 2024-04-25T17:12:45.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:45.386+0000 7f472dffb700 1 -- 172.21.15.37:0/3526015288 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47340113a0 con 0x7f47380fce60 2024-04-25T17:12:45.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:45.387+0000 7f473fa2e700 1 -- 172.21.15.37:0/3526015288 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4738113550 con 0x7f47380fce60 2024-04-25T17:12:45.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:45.388+0000 7f473fa2e700 1 -- 172.21.15.37:0/3526015288 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f473804c710 con 0x7f47380fce60 2024-04-25T17:12:45.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:45.388+0000 7f472dffb700 1 -- 172.21.15.37:0/3526015288 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 18) v1 ==== 86573+0+0 (secure 0 0 0) 0x7f4734012400 con 0x7f47380fce60 2024-04-25T17:12:45.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:45.388+0000 7f472dffb700 1 --2- 172.21.15.37:0/3526015288 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f4724069210 0x7f472406b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:12:45.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:45.388+0000 7f472dffb700 1 -- 172.21.15.37:0/3526015288 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2410+0+0 (secure 0 0 0) 0x7f47340864f0 con 0x7f47380fce60 2024-04-25T17:12:45.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:45.388+0000 7f473cfc9700 1 --2- 172.21.15.37:0/3526015288 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f4724069210 0x7f472406b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:12:45.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:45.389+0000 7f473cfc9700 1 --2- 172.21.15.37:0/3526015288 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f4724069210 0x7f472406b6c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f472800b3b0 tx=0x7f4728009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:12:45.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:45.393+0000 7f472dffb700 1 -- 172.21.15.37:0/3526015288 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f4734056f80 con 0x7f47380fce60 2024-04-25T17:12:45.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:12:45.601+0000 7f473fa2e700 1 -- 172.21.15.37:0/3526015288 --> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f47381137a0 con 0x7f4724069210 2024-04-25T17:12:46.788 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:46 smithi037 ceph-mon[26472]: pgmap v58: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-25T17:12:46.788 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:46 smithi037 ceph-mon[26472]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:12:46.788 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:46 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T17:12:46.788 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:46 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T17:12:46.788 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:46 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:12:46.917 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:46 smithi069 ceph-mon[34527]: pgmap v58: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-25T17:12:46.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:46 smithi069 ceph-mon[34527]: from='client.14286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi037:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:12:46.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:46 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T17:12:46.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:46 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T17:12:46.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:46 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:12:48.962 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:48 smithi037 ceph-mon[26472]: pgmap v59: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-25T17:12:48.962 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:48 smithi037 ceph-mon[26472]: Detected new or changed devices on smithi037 2024-04-25T17:12:48.962 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:48 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:48.962 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:48 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:48.962 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:48 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T17:12:48.962 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:48 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T17:12:48.962 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:48 smithi037 ceph-mon[26472]: Adjusting osd_memory_target on smithi037 to 6434M 2024-04-25T17:12:48.963 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:48 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:48.963 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:48 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:12:48.963 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:48 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:12:48.963 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:48 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:48.963 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:48 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:12:49.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:48 smithi069 ceph-mon[34527]: pgmap v59: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-25T17:12:49.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:48 smithi069 ceph-mon[34527]: Detected new or changed devices on smithi037 2024-04-25T17:12:49.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:48 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:49.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:48 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:49.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:48 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T17:12:49.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:48 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T17:12:49.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:48 smithi069 ceph-mon[34527]: Adjusting osd_memory_target on smithi037 to 6434M 2024-04-25T17:12:49.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:48 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:49.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:48 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:12:49.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:48 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:12:49.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:48 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:49.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:48 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:12:49.772 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:49 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/3081117500' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8bf4e67b-e95f-44d3-b51f-afd8a2d30e31"}]: dispatch 2024-04-25T17:12:49.772 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:49 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/3081117500' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8bf4e67b-e95f-44d3-b51f-afd8a2d30e31"}]': finished 2024-04-25T17:12:49.773 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:49 smithi037 ceph-mon[26472]: osdmap e16: 3 total, 2 up, 3 in 2024-04-25T17:12:49.773 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:49 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T17:12:50.069 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:49 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/3081117500' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8bf4e67b-e95f-44d3-b51f-afd8a2d30e31"}]: dispatch 2024-04-25T17:12:50.069 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:49 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/3081117500' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8bf4e67b-e95f-44d3-b51f-afd8a2d30e31"}]': finished 2024-04-25T17:12:50.069 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:49 smithi069 ceph-mon[34527]: osdmap e16: 3 total, 2 up, 3 in 2024-04-25T17:12:50.069 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:49 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T17:12:51.014 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:50 smithi037 ceph-mon[26472]: pgmap v61: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-25T17:12:51.014 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:50 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/4107088167' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T17:12:51.084 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:50 smithi069 ceph-mon[34527]: pgmap v61: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-25T17:12:51.084 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:50 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/4107088167' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T17:12:53.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:52 smithi037 ceph-mon[26472]: pgmap v62: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-25T17:12:53.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:52 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:53.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:52 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:53.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:52 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:12:53.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:52 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:12:53.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:52 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:53.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:52 smithi069 ceph-mon[34527]: pgmap v62: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-25T17:12:53.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:52 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:53.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:52 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:53.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:52 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:12:53.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:52 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:12:53.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:52 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:12:55.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:54 smithi037 ceph-mon[26472]: pgmap v63: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-25T17:12:55.167 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:54 smithi069 ceph-mon[34527]: pgmap v63: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-25T17:12:56.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:55 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:12:56.167 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:55 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:12:56.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:56 smithi037 ceph-mon[26472]: pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-25T17:12:56.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:56 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-25T17:12:56.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:56 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:12:57.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:56 smithi069 ceph-mon[34527]: pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-25T17:12:57.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:56 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-25T17:12:57.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:56 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:12:57.851 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:57 smithi037 ceph-mon[26472]: Deploying daemon osd.2 on smithi037 2024-04-25T17:12:58.167 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:57 smithi069 ceph-mon[34527]: Deploying daemon osd.2 on smithi037 2024-04-25T17:12:58.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:12:58 smithi037 ceph-mon[26472]: pgmap v65: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-25T17:12:59.167 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:12:58 smithi069 ceph-mon[34527]: pgmap v65: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-25T17:13:00.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:00 smithi037 ceph-mon[26472]: pgmap v66: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-25T17:13:01.167 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:00 smithi069 ceph-mon[34527]: pgmap v66: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-25T17:13:02.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:02 smithi037 ceph-mon[26472]: pgmap v67: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-25T17:13:02.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:02 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:02.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:02 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:02.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:02 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:13:03.167 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:02 smithi069 ceph-mon[34527]: pgmap v67: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-25T17:13:03.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:02 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:03.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:02 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:03.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:02 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:13:05.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:04 smithi037 ceph-mon[26472]: pgmap v68: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-25T17:13:05.167 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:04 smithi069 ceph-mon[34527]: pgmap v68: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-25T17:13:05.226 INFO:teuthology.orchestra.run.smithi037.stdout:Created osd(s) 2 on host 'smithi037' 2024-04-25T17:13:05.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:13:05.225+0000 7f472dffb700 1 -- 172.21.15.37:0/3526015288 <== mgr.14214 v2:172.21.15.37:6800/3566135606 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f47381137a0 con 0x7f4724069210 2024-04-25T17:13:05.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:13:05.228+0000 7f473fa2e700 1 -- 172.21.15.37:0/3526015288 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f4724069210 msgr2=0x7f472406b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:13:05.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:13:05.228+0000 7f473fa2e700 1 --2- 172.21.15.37:0/3526015288 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f4724069210 0x7f472406b6c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f472800b3b0 tx=0x7f4728009e30 comp rx=0 tx=0).stop 2024-04-25T17:13:05.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:13:05.228+0000 7f473fa2e700 1 -- 172.21.15.37:0/3526015288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47380fce60 msgr2=0x7f473810d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:13:05.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:13:05.228+0000 7f473fa2e700 1 --2- 172.21.15.37:0/3526015288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47380fce60 0x7f473810d910 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f473400c830 tx=0x7f4734004470 comp rx=0 tx=0).stop 2024-04-25T17:13:05.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:13:05.228+0000 7f473fa2e700 1 -- 172.21.15.37:0/3526015288 shutdown_connections 2024-04-25T17:13:05.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:13:05.228+0000 7f473fa2e700 1 --2- 172.21.15.37:0/3526015288 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f4724069210 0x7f472406b6c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:13:05.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:13:05.228+0000 7f473fa2e700 1 --2- 172.21.15.37:0/3526015288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f47380fce60 0x7f473810d910 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:13:05.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:13:05.228+0000 7f473fa2e700 1 --2- 172.21.15.37:0/3526015288 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f47380fdfd0 0x7f473810de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:13:05.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:13:05.228+0000 7f473fa2e700 1 -- 172.21.15.37:0/3526015288 >> 172.21.15.37:0/3526015288 conn(0x7f47380f8540 msgr2=0x7f47380f9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:13:05.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:13:05.228+0000 7f473fa2e700 1 -- 172.21.15.37:0/3526015288 shutdown_connections 2024-04-25T17:13:05.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:13:05.228+0000 7f473fa2e700 1 -- 172.21.15.37:0/3526015288 wait complete. 2024-04-25T17:13:06.144 DEBUG:teuthology.orchestra.run.smithi037:osd.2> sudo journalctl -f -n 0 -u ceph-599bb7fc-0326-11ef-bc93-c7b262605968@osd.2.service 2024-04-25T17:13:06.147 INFO:tasks.cephadm:Deploying osd.3 on smithi069 with /dev/vg_nvme/lv_4... 2024-04-25T17:13:06.148 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-04-25T17:13:06.406 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi069/config 2024-04-25T17:13:06.527 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:06 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:06.527 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:06 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:06.528 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:06 smithi037 ceph-mon[26472]: pgmap v69: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-25T17:13:06.528 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:06 smithi037 ceph-mon[26472]: from='osd.2 [v2:172.21.15.37:6818/596257416,v1:172.21.15.37:6819/596257416]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-25T17:13:06.529 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:06 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:06.529 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:06 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:06.529 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:06 smithi069 ceph-mon[34527]: pgmap v69: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-25T17:13:06.529 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:06 smithi069 ceph-mon[34527]: from='osd.2 [v2:172.21.15.37:6818/596257416,v1:172.21.15.37:6819/596257416]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-25T17:13:07.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:07 smithi037 ceph-mon[26472]: from='osd.2 [v2:172.21.15.37:6818/596257416,v1:172.21.15.37:6819/596257416]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-25T17:13:07.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:07 smithi037 ceph-mon[26472]: osdmap e17: 3 total, 2 up, 3 in 2024-04-25T17:13:07.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:07 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T17:13:07.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:07 smithi037 ceph-mon[26472]: from='osd.2 [v2:172.21.15.37:6818/596257416,v1:172.21.15.37:6819/596257416]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-04-25T17:13:07.571 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:13:07 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-2[59490]: 2024-04-25T17:13:07.217+0000 7ffb36cbd700 -1 osd.2 0 waiting for initial osdmap 2024-04-25T17:13:07.572 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:13:07 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-2[59490]: 2024-04-25T17:13:07.225+0000 7ffb30ab6700 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T17:13:07.599 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:07 smithi069 ceph-mon[34527]: from='osd.2 [v2:172.21.15.37:6818/596257416,v1:172.21.15.37:6819/596257416]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-25T17:13:07.599 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:07 smithi069 ceph-mon[34527]: osdmap e17: 3 total, 2 up, 3 in 2024-04-25T17:13:07.599 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:07 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T17:13:07.599 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:07 smithi069 ceph-mon[34527]: from='osd.2 [v2:172.21.15.37:6818/596257416,v1:172.21.15.37:6819/596257416]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-04-25T17:13:08.271 INFO:teuthology.orchestra.run.smithi069.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-04-25T17:13:08.271 INFO:teuthology.orchestra.run.smithi069.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-04-25T17:13:08.271 INFO:teuthology.orchestra.run.smithi069.stderr: stderr: 10+0 records in 2024-04-25T17:13:08.272 INFO:teuthology.orchestra.run.smithi069.stderr:10+0 records out 2024-04-25T17:13:08.272 INFO:teuthology.orchestra.run.smithi069.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0113699 s, 922 MB/s 2024-04-25T17:13:08.272 INFO:teuthology.orchestra.run.smithi069.stderr:--> Zapping successful for: 2024-04-25T17:13:08.560 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:08 smithi069 ceph-mon[34527]: from='osd.2 [v2:172.21.15.37:6818/596257416,v1:172.21.15.37:6819/596257416]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-04-25T17:13:08.560 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:08 smithi069 ceph-mon[34527]: osdmap e18: 3 total, 2 up, 3 in 2024-04-25T17:13:08.560 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:08 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T17:13:08.560 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:08 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T17:13:08.561 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:08 smithi069 ceph-mon[34527]: pgmap v72: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-25T17:13:08.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:08 smithi037 ceph-mon[26472]: from='osd.2 [v2:172.21.15.37:6818/596257416,v1:172.21.15.37:6819/596257416]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]': finished 2024-04-25T17:13:08.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:08 smithi037 ceph-mon[26472]: osdmap e18: 3 total, 2 up, 3 in 2024-04-25T17:13:08.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:08 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T17:13:08.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:08 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T17:13:08.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:08 smithi037 ceph-mon[26472]: pgmap v72: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-04-25T17:13:08.840 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi069:vg_nvme/lv_4 2024-04-25T17:13:09.097 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi069/config 2024-04-25T17:13:09.518 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:09 smithi069 ceph-mon[34527]: purged_snaps scrub starts 2024-04-25T17:13:09.518 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:09 smithi069 ceph-mon[34527]: purged_snaps scrub ok 2024-04-25T17:13:09.518 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:09 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T17:13:09.518 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:09 smithi069 ceph-mon[34527]: osd.2 [v2:172.21.15.37:6818/596257416,v1:172.21.15.37:6819/596257416] boot 2024-04-25T17:13:09.518 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:09 smithi069 ceph-mon[34527]: osdmap e19: 3 total, 3 up, 3 in 2024-04-25T17:13:09.518 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:09 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T17:13:09.518 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:09 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:09.518 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:09 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:09.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:09 smithi037 ceph-mon[26472]: purged_snaps scrub starts 2024-04-25T17:13:09.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:09 smithi037 ceph-mon[26472]: purged_snaps scrub ok 2024-04-25T17:13:09.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:09 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T17:13:09.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:09 smithi037 ceph-mon[26472]: osd.2 [v2:172.21.15.37:6818/596257416,v1:172.21.15.37:6819/596257416] boot 2024-04-25T17:13:09.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:09 smithi037 ceph-mon[26472]: osdmap e19: 3 total, 3 up, 3 in 2024-04-25T17:13:09.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:09 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T17:13:09.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:09 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:09.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:09 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:10.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:10.615+0000 7f488255e700 1 -- 172.21.15.69:0/919739226 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f487c0fbcb0 msgr2=0x7f487c0fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:13:10.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:10.615+0000 7f488255e700 1 --2- 172.21.15.69:0/919739226 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f487c0fbcb0 0x7f487c0fc0c0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f4870004940 tx=0x7f4870009e30 comp rx=0 tx=0).stop 2024-04-25T17:13:10.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:10.615+0000 7f488255e700 1 -- 172.21.15.69:0/919739226 shutdown_connections 2024-04-25T17:13:10.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:10.615+0000 7f488255e700 1 --2- 172.21.15.69:0/919739226 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f487c0fcf60 0x7f487c0fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:13:10.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:10.615+0000 7f488255e700 1 --2- 172.21.15.69:0/919739226 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f487c0fbcb0 0x7f487c0fc0c0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:13:10.618 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:10.615+0000 7f488255e700 1 -- 172.21.15.69:0/919739226 >> 172.21.15.69:0/919739226 conn(0x7f487c0f7430 msgr2=0x7f487c0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:13:10.618 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:10.615+0000 7f488255e700 1 -- 172.21.15.69:0/919739226 shutdown_connections 2024-04-25T17:13:10.618 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:10.616+0000 7f488255e700 1 -- 172.21.15.69:0/919739226 wait complete. 2024-04-25T17:13:10.618 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:10.616+0000 7f488255e700 1 Processor -- start 2024-04-25T17:13:10.618 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:10.616+0000 7f488255e700 1 -- start start 2024-04-25T17:13:10.618 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:10.616+0000 7f488255e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f487c0fbcb0 0x7f487c10d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:13:10.618 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:10.616+0000 7f488255e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f487c0fcf60 0x7f487c10df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:13:10.618 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:10.616+0000 7f488255e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487c10e530 con 0x7f487c0fbcb0 2024-04-25T17:13:10.618 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:10.616+0000 7f488255e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487c10ed80 con 0x7f487c0fcf60 2024-04-25T17:13:10.618 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:10.616+0000 7f487b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f487c0fcf60 0x7f487c10df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:13:10.618 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:10.616+0000 7f487b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f487c0fcf60 0x7f487c10df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46134/0 (socket says 172.21.15.69:46134) 2024-04-25T17:13:10.618 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:10.616+0000 7f487b7fe700 1 -- 172.21.15.69:0/3047523832 learned_addr learned my addr 172.21.15.69:0/3047523832 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-25T17:13:10.618 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:10.616+0000 7f487bfff700 1 --2- 172.21.15.69:0/3047523832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f487c0fbcb0 0x7f487c10d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:13:10.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:10.617+0000 7f487b7fe700 1 -- 172.21.15.69:0/3047523832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f487c0fbcb0 msgr2=0x7f487c10d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:13:10.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:10.617+0000 7f487b7fe700 1 --2- 172.21.15.69:0/3047523832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f487c0fbcb0 0x7f487c10d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:13:10.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:10.617+0000 7f487b7fe700 1 -- 172.21.15.69:0/3047523832 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4870005040 con 0x7f487c0fcf60 2024-04-25T17:13:10.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:10.617+0000 7f487b7fe700 1 --2- 172.21.15.69:0/3047523832 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f487c0fcf60 0x7f487c10df30 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f486c002a50 tx=0x7f486c0046b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:13:10.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:10.617+0000 7f4878ff9700 1 -- 172.21.15.69:0/3047523832 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f486c007cc0 con 0x7f487c0fcf60 2024-04-25T17:13:10.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:10.617+0000 7f4878ff9700 1 -- 172.21.15.69:0/3047523832 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f486c00f040 con 0x7f487c0fcf60 2024-04-25T17:13:10.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:10.617+0000 7f488255e700 1 -- 172.21.15.69:0/3047523832 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f487c10f060 con 0x7f487c0fcf60 2024-04-25T17:13:10.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:10.617+0000 7f4878ff9700 1 -- 172.21.15.69:0/3047523832 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f486c00da30 con 0x7f487c0fcf60 2024-04-25T17:13:10.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:10.617+0000 7f488255e700 1 -- 172.21.15.69:0/3047523832 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f487c10f5a0 con 0x7f487c0fcf60 2024-04-25T17:13:10.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:10.618+0000 7f488255e700 1 -- 172.21.15.69:0/3047523832 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f487c101af0 con 0x7f487c0fcf60 2024-04-25T17:13:10.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:10.619+0000 7f4878ff9700 1 -- 172.21.15.69:0/3047523832 <== mon.1 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) v1 ==== 86573+0+0 (secure 0 0 0) 0x7f486c00db90 con 0x7f487c0fcf60 2024-04-25T17:13:10.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:10.619+0000 7f4878ff9700 1 --2- 172.21.15.69:0/3047523832 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f4864069210 0x7f486406b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:13:10.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:10.619+0000 7f4878ff9700 1 -- 172.21.15.69:0/3047523832 <== mon.1 v2:172.21.15.69:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3217+0+0 (secure 0 0 0) 0x7f486c086490 con 0x7f487c0fcf60 2024-04-25T17:13:10.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:10.619+0000 7f487bfff700 1 --2- 172.21.15.69:0/3047523832 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f4864069210 0x7f486406b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:13:10.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:10.619+0000 7f487bfff700 1 --2- 172.21.15.69:0/3047523832 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f4864069210 0x7f486406b6c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f487000b3b0 tx=0x7f4870009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:13:10.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:10.623+0000 7f4878ff9700 1 -- 172.21.15.69:0/3047523832 <== mon.1 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f486c056bf0 con 0x7f487c0fcf60 2024-04-25T17:13:10.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:10.815+0000 7f488255e700 1 -- 172.21.15.69:0/3047523832 --> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f487c10f810 con 0x7f4864069210 2024-04-25T17:13:10.816 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:10 smithi069 ceph-mon[34527]: osdmap e20: 3 total, 3 up, 3 in 2024-04-25T17:13:10.816 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:10 smithi069 ceph-mon[34527]: pgmap v75: 0 pgs: ; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-04-25T17:13:10.816 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:10 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-04-25T17:13:10.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:10 smithi037 ceph-mon[26472]: osdmap e20: 3 total, 3 up, 3 in 2024-04-25T17:13:10.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:10 smithi037 ceph-mon[26472]: pgmap v75: 0 pgs: ; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-04-25T17:13:10.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:10 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-04-25T17:13:11.503 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:11 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-04-25T17:13:11.504 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:11 smithi069 ceph-mon[34527]: osdmap e21: 3 total, 3 up, 3 in 2024-04-25T17:13:11.504 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:11 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-25T17:13:11.504 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:11 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:13:11.504 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:11 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T17:13:11.504 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:11 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T17:13:11.504 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:11 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:13:11.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:11 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-04-25T17:13:11.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:11 smithi037 ceph-mon[26472]: osdmap e21: 3 total, 3 up, 3 in 2024-04-25T17:13:11.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:11 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-04-25T17:13:11.541 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:11 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:13:11.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:11 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T17:13:11.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:11 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T17:13:11.542 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:11 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:13:12.543 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:12 smithi069 ceph-mon[34527]: from='client.24133 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:13:12.543 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:12 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-25T17:13:12.543 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:12 smithi069 ceph-mon[34527]: osdmap e22: 3 total, 3 up, 3 in 2024-04-25T17:13:12.543 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:12 smithi069 ceph-mon[34527]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-04-25T17:13:12.543 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:12 smithi069 ceph-mon[34527]: Detected new or changed devices on smithi037 2024-04-25T17:13:12.543 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:12 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:12.543 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:12 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:12.543 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:12 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T17:13:12.543 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:12 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T17:13:12.543 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:12 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T17:13:12.544 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:12 smithi069 ceph-mon[34527]: Adjusting osd_memory_target on smithi037 to 4289M 2024-04-25T17:13:12.544 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:12 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:12.544 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:12 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:13:12.544 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:12 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:13:12.544 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:12 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:12.544 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:12 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:13:12.821 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:13:12 smithi037 sudo[63828]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-25T17:13:12.821 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:13:12 smithi037 sudo[63828]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T17:13:12.821 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:13:12 smithi037 sudo[63828]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T17:13:12.821 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:13:12 smithi037 sudo[63828]: pam_unix(sudo:session): session closed for user root 2024-04-25T17:13:12.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:12 smithi037 ceph-mon[26472]: from='client.24133 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:13:12.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:12 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-04-25T17:13:12.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:12 smithi037 ceph-mon[26472]: osdmap e22: 3 total, 3 up, 3 in 2024-04-25T17:13:12.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:12 smithi037 ceph-mon[26472]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-04-25T17:13:12.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:12 smithi037 ceph-mon[26472]: Detected new or changed devices on smithi037 2024-04-25T17:13:12.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:12 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:12.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:12 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:12.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:12 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T17:13:12.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:12 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T17:13:12.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:12 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T17:13:12.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:12 smithi037 ceph-mon[26472]: Adjusting osd_memory_target on smithi037 to 4289M 2024-04-25T17:13:12.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:12 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:12.823 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:12 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:13:12.823 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:12 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:13:12.823 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:12 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:12.823 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:12 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:13:13.321 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:13:13 smithi037 sudo[63914]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-25T17:13:13.321 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:13:13 smithi037 sudo[63914]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T17:13:13.321 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:13:13 smithi037 sudo[63914]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T17:13:13.321 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:13:13 smithi037 sudo[63914]: pam_unix(sudo:session): session closed for user root 2024-04-25T17:13:13.630 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:13:13 smithi037 sudo[63939]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-25T17:13:13.631 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:13:13 smithi037 sudo[63939]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T17:13:13.631 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:13:13 smithi037 sudo[63939]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T17:13:13.631 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:13:13 smithi037 sudo[63939]: pam_unix(sudo:session): session closed for user root 2024-04-25T17:13:13.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:13 smithi069 ceph-mon[34527]: osdmap e23: 3 total, 3 up, 3 in 2024-04-25T17:13:13.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:13 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:13.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:13 smithi069 ceph-mon[34527]: from='client.? 172.21.15.69:0/2222917475' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ce5ff1f7-472a-4515-b851-e434ee545b27"}]: dispatch 2024-04-25T17:13:13.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:13 smithi069 ceph-mon[34527]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ce5ff1f7-472a-4515-b851-e434ee545b27"}]: dispatch 2024-04-25T17:13:13.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:13 smithi069 ceph-mon[34527]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ce5ff1f7-472a-4515-b851-e434ee545b27"}]': finished 2024-04-25T17:13:13.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:13 smithi069 ceph-mon[34527]: osdmap e24: 4 total, 3 up, 4 in 2024-04-25T17:13:13.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:13 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T17:13:13.935 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:13 smithi037 ceph-mon[26472]: osdmap e23: 3 total, 3 up, 3 in 2024-04-25T17:13:13.936 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:13 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:13.936 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:13 smithi037 ceph-mon[26472]: from='client.? 172.21.15.69:0/2222917475' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ce5ff1f7-472a-4515-b851-e434ee545b27"}]: dispatch 2024-04-25T17:13:13.936 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:13 smithi037 ceph-mon[26472]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ce5ff1f7-472a-4515-b851-e434ee545b27"}]: dispatch 2024-04-25T17:13:13.936 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:13 smithi037 ceph-mon[26472]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ce5ff1f7-472a-4515-b851-e434ee545b27"}]': finished 2024-04-25T17:13:13.936 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:13 smithi037 ceph-mon[26472]: osdmap e24: 4 total, 3 up, 4 in 2024-04-25T17:13:13.936 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:13 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T17:13:14.195 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:14.195+0000 7f4878ff9700 1 -- 172.21.15.69:0/3047523832 <== mon.1 v2:172.21.15.69:3300/0 7 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f486c053530 con 0x7f487c0fcf60 2024-04-25T17:13:14.321 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:13:13 smithi037 sudo[64013]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-25T17:13:14.321 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:13:13 smithi037 sudo[64013]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T17:13:14.321 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:13:13 smithi037 sudo[64013]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T17:13:14.321 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:13:13 smithi037 sudo[64013]: pam_unix(sudo:session): session closed for user root 2024-04-25T17:13:14.781 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:14 smithi037 ceph-mon[26472]: pgmap v81: 1 pgs: 1 creating+activating; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-04-25T17:13:14.781 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:14 smithi037 ceph-mon[26472]: from='client.? 172.21.15.69:0/550918089' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T17:13:14.781 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:14 smithi037 ceph-mon[26472]: mgrmap e19: smithi037.txrgxl(active, since 2m), standbys: smithi069.mmuhdo 2024-04-25T17:13:14.781 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:13:14 smithi037 sudo[64052]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-25T17:13:14.781 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:13:14 smithi037 sudo[64052]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T17:13:14.781 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:13:14 smithi037 sudo[64052]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T17:13:14.782 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:13:14 smithi037 sudo[64052]: pam_unix(sudo:session): session closed for user root 2024-04-25T17:13:14.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:14 smithi069 ceph-mon[34527]: pgmap v81: 1 pgs: 1 creating+activating; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-04-25T17:13:14.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:14 smithi069 ceph-mon[34527]: from='client.? 172.21.15.69:0/550918089' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T17:13:14.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:14 smithi069 ceph-mon[34527]: mgrmap e19: smithi037.txrgxl(active, since 2m), standbys: smithi069.mmuhdo 2024-04-25T17:13:15.071 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:13:14 smithi037 sudo[64094]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-25T17:13:15.071 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:13:14 smithi037 sudo[64094]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T17:13:15.071 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:13:14 smithi037 sudo[64094]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T17:13:15.071 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:13:14 smithi037 sudo[64094]: pam_unix(sudo:session): session closed for user root 2024-04-25T17:13:15.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:15 smithi037 sudo[64147]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-25T17:13:15.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:15 smithi037 sudo[64147]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T17:13:15.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:15 smithi037 sudo[64147]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T17:13:15.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:15 smithi037 sudo[64147]: pam_unix(sudo:session): session closed for user root 2024-04-25T17:13:16.197 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:15 smithi037 sudo[64192]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-25T17:13:16.197 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:15 smithi037 sudo[64192]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T17:13:16.197 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:15 smithi037 sudo[64192]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T17:13:16.197 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:15 smithi037 sudo[64192]: pam_unix(sudo:session): session closed for user root 2024-04-25T17:13:16.341 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:16 smithi069 sudo[38831]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-04-25T17:13:16.341 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:16 smithi069 sudo[38831]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T17:13:16.341 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:16 smithi069 sudo[38831]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T17:13:16.341 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:16 smithi069 sudo[38831]: pam_unix(sudo:session): session closed for user root 2024-04-25T17:13:16.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:16 smithi037 ceph-mon[26472]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-25T17:13:16.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:16 smithi037 ceph-mon[26472]: pgmap v82: 1 pgs: 1 creating+activating; 0 B data, 873 MiB used, 267 GiB / 268 GiB avail 2024-04-25T17:13:16.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:16 smithi037 ceph-mon[26472]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-25T17:13:16.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:16 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mon metadata", "id": "smithi037"}]: dispatch 2024-04-25T17:13:16.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:16 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mon metadata", "id": "smithi069"}]: dispatch 2024-04-25T17:13:16.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:16 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mon metadata", "id": "smithi037"}]: dispatch 2024-04-25T17:13:16.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:16 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mon metadata", "id": "smithi069"}]: dispatch 2024-04-25T17:13:16.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:16 smithi069 sudo[39019]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-04-25T17:13:16.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:16 smithi069 sudo[39019]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-04-25T17:13:16.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:16 smithi069 sudo[39019]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-04-25T17:13:16.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:16 smithi069 sudo[39019]: pam_unix(sudo:session): session closed for user root 2024-04-25T17:13:16.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:16 smithi069 ceph-mon[34527]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-25T17:13:16.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:16 smithi069 ceph-mon[34527]: pgmap v82: 1 pgs: 1 creating+activating; 0 B data, 873 MiB used, 267 GiB / 268 GiB avail 2024-04-25T17:13:16.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:16 smithi069 ceph-mon[34527]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-25T17:13:16.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:16 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mon metadata", "id": "smithi037"}]: dispatch 2024-04-25T17:13:16.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:16 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mon metadata", "id": "smithi069"}]: dispatch 2024-04-25T17:13:16.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:16 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mon metadata", "id": "smithi037"}]: dispatch 2024-04-25T17:13:16.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:16 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mon metadata", "id": "smithi069"}]: dispatch 2024-04-25T17:13:17.580 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:17 smithi069 ceph-mon[34527]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-25T17:13:17.580 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:17 smithi069 ceph-mon[34527]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-25T17:13:17.580 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:17 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:17.580 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:17 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:17.580 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:17 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:17.581 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:17 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:13:17.581 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:17 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:13:17.581 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:17 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:17.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:17 smithi037 ceph-mon[26472]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-04-25T17:13:17.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:17 smithi037 ceph-mon[26472]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-04-25T17:13:17.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:17 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:17.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:17 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:17.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:17 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:17.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:17 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:13:17.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:17 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:13:17.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:17 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:18.667 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:18 smithi069 ceph-mon[34527]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-25T17:13:18.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:18 smithi037 ceph-mon[26472]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-25T17:13:20.779 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:20 smithi069 ceph-mon[34527]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-25T17:13:20.779 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:20 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-25T17:13:20.779 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:20 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:13:20.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:20 smithi037 ceph-mon[26472]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-25T17:13:20.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:20 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-25T17:13:20.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:20 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:13:21.810 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:21 smithi069 ceph-mon[34527]: Deploying daemon osd.3 on smithi069 2024-04-25T17:13:21.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:21 smithi037 ceph-mon[26472]: Deploying daemon osd.3 on smithi069 2024-04-25T17:13:22.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:22 smithi037 ceph-mon[26472]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-25T17:13:22.849 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:22 smithi069 ceph-mon[34527]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-25T17:13:24.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:24 smithi037 ceph-mon[26472]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-25T17:13:24.824 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:24 smithi069 ceph-mon[34527]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-25T17:13:26.072 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:25 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:26.072 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:25 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:26.072 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:25 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:13:26.072 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:25 smithi069 ceph-mon[34527]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-25T17:13:26.072 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:25 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:13:26.196 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:25 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:26.196 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:25 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:26.196 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:25 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:13:26.196 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:25 smithi037 ceph-mon[26472]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-25T17:13:26.196 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:25 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:13:28.490 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:28.489+0000 7f4878ff9700 1 -- 172.21.15.69:0/3047523832 <== mgr.14214 v2:172.21.15.37:6800/3566135606 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f487c10f810 con 0x7f4864069210 2024-04-25T17:13:28.490 INFO:teuthology.orchestra.run.smithi069.stdout:Created osd(s) 3 on host 'smithi069' 2024-04-25T17:13:28.492 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:28.491+0000 7f488255e700 1 -- 172.21.15.69:0/3047523832 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f4864069210 msgr2=0x7f486406b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:13:28.492 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:28.492+0000 7f488255e700 1 --2- 172.21.15.69:0/3047523832 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f4864069210 0x7f486406b6c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f487000b3b0 tx=0x7f4870009e30 comp rx=0 tx=0).stop 2024-04-25T17:13:28.492 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:28.492+0000 7f488255e700 1 -- 172.21.15.69:0/3047523832 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f487c0fcf60 msgr2=0x7f487c10df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:13:28.492 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:28.492+0000 7f488255e700 1 --2- 172.21.15.69:0/3047523832 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f487c0fcf60 0x7f487c10df30 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f486c002a50 tx=0x7f486c0046b0 comp rx=0 tx=0).stop 2024-04-25T17:13:28.492 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:28.492+0000 7f488255e700 1 -- 172.21.15.69:0/3047523832 shutdown_connections 2024-04-25T17:13:28.492 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:28.492+0000 7f488255e700 1 --2- 172.21.15.69:0/3047523832 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f4864069210 0x7f486406b6c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:13:28.492 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:28.492+0000 7f488255e700 1 --2- 172.21.15.69:0/3047523832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f487c0fbcb0 0x7f487c10d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:13:28.492 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:28.492+0000 7f488255e700 1 --2- 172.21.15.69:0/3047523832 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f487c0fcf60 0x7f487c10df30 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:13:28.492 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:28.492+0000 7f488255e700 1 -- 172.21.15.69:0/3047523832 >> 172.21.15.69:0/3047523832 conn(0x7f487c0f7430 msgr2=0x7f487c0f8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:13:28.492 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:28.492+0000 7f488255e700 1 -- 172.21.15.69:0/3047523832 shutdown_connections 2024-04-25T17:13:28.492 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:28.492+0000 7f488255e700 1 -- 172.21.15.69:0/3047523832 wait complete. 2024-04-25T17:13:28.774 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:28 smithi069 ceph-mon[34527]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-25T17:13:28.774 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:28 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:28.774 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:28 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:28.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:28 smithi037 ceph-mon[26472]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-25T17:13:28.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:28 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:28.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:28 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:29.078 DEBUG:teuthology.orchestra.run.smithi069:osd.3> sudo journalctl -f -n 0 -u ceph-599bb7fc-0326-11ef-bc93-c7b262605968@osd.3.service 2024-04-25T17:13:29.080 INFO:tasks.cephadm:Deploying osd.4 on smithi069 with /dev/vg_nvme/lv_3... 2024-04-25T17:13:29.080 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-04-25T17:13:29.684 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi069/config 2024-04-25T17:13:30.044 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:29 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:30.044 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:29 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:30.044 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:29 smithi069 ceph-mon[34527]: from='osd.3 [v2:172.21.15.69:6800/3815031427,v1:172.21.15.69:6801/3815031427]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-25T17:13:30.044 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:29 smithi069 ceph-mon[34527]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-25T17:13:30.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:29 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:30.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:29 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:30.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:29 smithi037 ceph-mon[26472]: from='osd.3 [v2:172.21.15.69:6800/3815031427,v1:172.21.15.69:6801/3815031427]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-25T17:13:30.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:29 smithi037 ceph-mon[26472]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-25T17:13:31.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:30 smithi037 ceph-mon[26472]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-25T17:13:31.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:30 smithi037 ceph-mon[26472]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-25T17:13:31.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:30 smithi037 ceph-mon[26472]: osdmap e25: 4 total, 3 up, 4 in 2024-04-25T17:13:31.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:30 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T17:13:31.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:30 smithi037 ceph-mon[26472]: from='osd.3 [v2:172.21.15.69:6800/3815031427,v1:172.21.15.69:6801/3815031427]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2024-04-25T17:13:31.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:30 smithi037 ceph-mon[26472]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2024-04-25T17:13:31.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:30 smithi069 ceph-mon[34527]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-25T17:13:31.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:30 smithi069 ceph-mon[34527]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-25T17:13:31.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:30 smithi069 ceph-mon[34527]: osdmap e25: 4 total, 3 up, 4 in 2024-04-25T17:13:31.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:30 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T17:13:31.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:30 smithi069 ceph-mon[34527]: from='osd.3 [v2:172.21.15.69:6800/3815031427,v1:172.21.15.69:6801/3815031427]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2024-04-25T17:13:31.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:30 smithi069 ceph-mon[34527]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2024-04-25T17:13:31.168 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:13:30 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-3[40102]: 2024-04-25T17:13:30.759+0000 7fbc2cfaa700 -1 osd.3 0 waiting for initial osdmap 2024-04-25T17:13:31.169 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:13:30 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-3[40102]: 2024-04-25T17:13:30.765+0000 7fbc285a6700 -1 osd.3 26 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T17:13:31.789 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:31 smithi069 ceph-mon[34527]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]': finished 2024-04-25T17:13:31.789 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:31 smithi069 ceph-mon[34527]: osdmap e26: 4 total, 3 up, 4 in 2024-04-25T17:13:31.789 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:31 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T17:13:31.789 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:31 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T17:13:31.789 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:31 smithi069 ceph-mon[34527]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-25T17:13:32.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:31 smithi037 ceph-mon[26472]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]': finished 2024-04-25T17:13:32.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:31 smithi037 ceph-mon[26472]: osdmap e26: 4 total, 3 up, 4 in 2024-04-25T17:13:32.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:31 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T17:13:32.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:31 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T17:13:32.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:31 smithi037 ceph-mon[26472]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-04-25T17:13:32.800 INFO:teuthology.orchestra.run.smithi069.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-04-25T17:13:32.800 INFO:teuthology.orchestra.run.smithi069.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-04-25T17:13:32.801 INFO:teuthology.orchestra.run.smithi069.stderr: stderr: 10+0 records in 2024-04-25T17:13:32.801 INFO:teuthology.orchestra.run.smithi069.stderr:10+0 records out 2024-04-25T17:13:32.801 INFO:teuthology.orchestra.run.smithi069.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0123174 s, 851 MB/s 2024-04-25T17:13:32.801 INFO:teuthology.orchestra.run.smithi069.stderr:--> Zapping successful for: 2024-04-25T17:13:33.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:32 smithi037 ceph-mon[26472]: purged_snaps scrub starts 2024-04-25T17:13:33.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:32 smithi037 ceph-mon[26472]: purged_snaps scrub ok 2024-04-25T17:13:33.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:32 smithi037 ceph-mon[26472]: osd.3 [v2:172.21.15.69:6800/3815031427,v1:172.21.15.69:6801/3815031427] boot 2024-04-25T17:13:33.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:32 smithi037 ceph-mon[26472]: osdmap e27: 4 total, 4 up, 4 in 2024-04-25T17:13:33.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:32 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T17:13:33.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:32 smithi037 ceph-mon[26472]: Detected new or changed devices on smithi069 2024-04-25T17:13:33.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:32 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:33.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:32 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:33.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:32 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T17:13:33.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:32 smithi037 ceph-mon[26472]: Adjusting osd_memory_target on smithi069 to 15936M 2024-04-25T17:13:33.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:32 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:33.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:32 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:13:33.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:32 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:13:33.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:32 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:33.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:32 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:13:33.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:32 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:13:33.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:32 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:13:33.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:32 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:33.097 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:32 smithi069 ceph-mon[34527]: purged_snaps scrub starts 2024-04-25T17:13:33.097 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:32 smithi069 ceph-mon[34527]: purged_snaps scrub ok 2024-04-25T17:13:33.097 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:32 smithi069 ceph-mon[34527]: osd.3 [v2:172.21.15.69:6800/3815031427,v1:172.21.15.69:6801/3815031427] boot 2024-04-25T17:13:33.097 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:32 smithi069 ceph-mon[34527]: osdmap e27: 4 total, 4 up, 4 in 2024-04-25T17:13:33.097 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:32 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T17:13:33.097 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:32 smithi069 ceph-mon[34527]: Detected new or changed devices on smithi069 2024-04-25T17:13:33.097 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:32 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:33.097 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:32 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:33.097 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:32 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T17:13:33.097 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:32 smithi069 ceph-mon[34527]: Adjusting osd_memory_target on smithi069 to 15936M 2024-04-25T17:13:33.098 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:32 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:33.098 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:32 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:13:33.098 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:32 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:13:33.098 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:32 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:33.098 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:32 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:13:33.098 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:32 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:13:33.098 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:32 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:13:33.098 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:32 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:33.456 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi069:vg_nvme/lv_3 2024-04-25T17:13:33.702 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi069/config 2024-04-25T17:13:34.051 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:33 smithi069 ceph-mon[34527]: osdmap e28: 4 total, 4 up, 4 in 2024-04-25T17:13:34.051 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:33 smithi069 ceph-mon[34527]: pgmap v95: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-25T17:13:34.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:33 smithi037 ceph-mon[26472]: osdmap e28: 4 total, 4 up, 4 in 2024-04-25T17:13:34.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:33 smithi037 ceph-mon[26472]: pgmap v95: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-25T17:13:35.049 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:34 smithi069 ceph-mon[34527]: osdmap e29: 4 total, 4 up, 4 in 2024-04-25T17:13:35.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:34 smithi037 ceph-mon[26472]: osdmap e29: 4 total, 4 up, 4 in 2024-04-25T17:13:35.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:35.072+0000 7f4af84f6700 1 -- 172.21.15.69:0/647185775 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4af00fbce0 msgr2=0x7f4af00fc0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:13:35.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:35.072+0000 7f4af84f6700 1 --2- 172.21.15.69:0/647185775 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4af00fbce0 0x7f4af00fc0f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4aec004940 tx=0x7f4aec009e30 comp rx=0 tx=0).stop 2024-04-25T17:13:35.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:35.073+0000 7f4af84f6700 1 -- 172.21.15.69:0/647185775 shutdown_connections 2024-04-25T17:13:35.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:35.073+0000 7f4af84f6700 1 --2- 172.21.15.69:0/647185775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4af00fcf90 0x7f4af00fd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:13:35.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:35.073+0000 7f4af84f6700 1 --2- 172.21.15.69:0/647185775 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4af00fbce0 0x7f4af00fc0f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:13:35.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:35.073+0000 7f4af84f6700 1 -- 172.21.15.69:0/647185775 >> 172.21.15.69:0/647185775 conn(0x7f4af00f7480 msgr2=0x7f4af00f9890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:13:35.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:35.073+0000 7f4af84f6700 1 -- 172.21.15.69:0/647185775 shutdown_connections 2024-04-25T17:13:35.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:35.073+0000 7f4af84f6700 1 -- 172.21.15.69:0/647185775 wait complete. 2024-04-25T17:13:35.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:35.073+0000 7f4af84f6700 1 Processor -- start 2024-04-25T17:13:35.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:35.073+0000 7f4af84f6700 1 -- start start 2024-04-25T17:13:35.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:35.073+0000 7f4af84f6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4af00fbce0 0x7f4af010d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:13:35.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:35.073+0000 7f4af84f6700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4af00fcf90 0x7f4af010ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:13:35.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:35.073+0000 7f4af84f6700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af010e3f0 con 0x7f4af00fbce0 2024-04-25T17:13:35.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:35.073+0000 7f4af84f6700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af010e560 con 0x7f4af00fcf90 2024-04-25T17:13:35.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:35.073+0000 7f4af5a91700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4af00fcf90 0x7f4af010ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:13:35.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:35.073+0000 7f4af5a91700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4af00fcf90 0x7f4af010ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37356/0 (socket says 172.21.15.69:37356) 2024-04-25T17:13:35.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:35.073+0000 7f4af5a91700 1 -- 172.21.15.69:0/3136276976 learned_addr learned my addr 172.21.15.69:0/3136276976 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-25T17:13:35.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:35.074+0000 7f4af6292700 1 --2- 172.21.15.69:0/3136276976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4af00fbce0 0x7f4af010d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:13:35.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:35.074+0000 7f4af5a91700 1 -- 172.21.15.69:0/3136276976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4af00fbce0 msgr2=0x7f4af010d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:13:35.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:35.074+0000 7f4af5a91700 1 --2- 172.21.15.69:0/3136276976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4af00fbce0 0x7f4af010d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:13:35.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:35.074+0000 7f4af5a91700 1 -- 172.21.15.69:0/3136276976 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aec005040 con 0x7f4af00fcf90 2024-04-25T17:13:35.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:35.074+0000 7f4af5a91700 1 --2- 172.21.15.69:0/3136276976 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4af00fcf90 0x7f4af010ddf0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0002a80 tx=0x7f4ae00046b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:13:35.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:35.074+0000 7f4ae6ffd700 1 -- 172.21.15.69:0/3136276976 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ae0007cc0 con 0x7f4af00fcf90 2024-04-25T17:13:35.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:35.074+0000 7f4ae6ffd700 1 -- 172.21.15.69:0/3136276976 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4ae000f040 con 0x7f4af00fcf90 2024-04-25T17:13:35.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:35.074+0000 7f4af84f6700 1 -- 172.21.15.69:0/3136276976 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4af0112fc0 con 0x7f4af00fcf90 2024-04-25T17:13:35.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:35.074+0000 7f4ae6ffd700 1 -- 172.21.15.69:0/3136276976 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ae000dac0 con 0x7f4af00fcf90 2024-04-25T17:13:35.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:35.074+0000 7f4af84f6700 1 -- 172.21.15.69:0/3136276976 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4af0113550 con 0x7f4af00fcf90 2024-04-25T17:13:35.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:35.075+0000 7f4af84f6700 1 -- 172.21.15.69:0/3136276976 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4af0101b20 con 0x7f4af00fcf90 2024-04-25T17:13:35.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:35.075+0000 7f4ae6ffd700 1 -- 172.21.15.69:0/3136276976 <== mon.1 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f4ae000dc20 con 0x7f4af00fcf90 2024-04-25T17:13:35.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:35.076+0000 7f4ae6ffd700 1 --2- 172.21.15.69:0/3136276976 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f4adc0692a0 0x7f4adc06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:13:35.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:35.076+0000 7f4ae6ffd700 1 -- 172.21.15.69:0/3136276976 <== mon.1 v2:172.21.15.69:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 3770+0+0 (secure 0 0 0) 0x7f4ae0086760 con 0x7f4af00fcf90 2024-04-25T17:13:35.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:35.076+0000 7f4af6292700 1 --2- 172.21.15.69:0/3136276976 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f4adc0692a0 0x7f4adc06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:13:35.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:35.077+0000 7f4af6292700 1 --2- 172.21.15.69:0/3136276976 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f4adc0692a0 0x7f4adc06b750 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4aec00b970 tx=0x7f4aec009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:13:35.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:35.080+0000 7f4ae6ffd700 1 -- 172.21.15.69:0/3136276976 <== mon.1 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f4ae0056b40 con 0x7f4af00fcf90 2024-04-25T17:13:35.272 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:35.272+0000 7f4af84f6700 1 -- 172.21.15.69:0/3136276976 --> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f4af002b3e0 con 0x7f4adc0692a0 2024-04-25T17:13:35.987 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:35 smithi069 ceph-mon[34527]: osdmap e30: 4 total, 4 up, 4 in 2024-04-25T17:13:35.987 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:35 smithi069 ceph-mon[34527]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:13:35.988 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:35 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T17:13:35.988 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:35 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T17:13:35.988 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:35 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:13:35.988 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:35 smithi069 ceph-mon[34527]: pgmap v98: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-25T17:13:36.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:35 smithi037 ceph-mon[26472]: osdmap e30: 4 total, 4 up, 4 in 2024-04-25T17:13:36.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:35 smithi037 ceph-mon[26472]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:13:36.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:35 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T17:13:36.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:35 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T17:13:36.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:35 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:13:36.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:35 smithi037 ceph-mon[26472]: pgmap v98: 1 pgs: 1 peering; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-25T17:13:36.969 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:36 smithi069 ceph-mon[34527]: osdmap e31: 4 total, 4 up, 4 in 2024-04-25T17:13:37.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:36 smithi037 ceph-mon[26472]: osdmap e31: 4 total, 4 up, 4 in 2024-04-25T17:13:38.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:37 smithi037 ceph-mon[26472]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 123 KiB/s, 0 objects/s recovering 2024-04-25T17:13:38.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:37 smithi037 ceph-mon[26472]: from='client.? 172.21.15.69:0/3556719325' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "26cf2aeb-fc85-4d14-b936-08b8280489e1"}]: dispatch 2024-04-25T17:13:38.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:37 smithi037 ceph-mon[26472]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "26cf2aeb-fc85-4d14-b936-08b8280489e1"}]: dispatch 2024-04-25T17:13:38.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:37 smithi037 ceph-mon[26472]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "26cf2aeb-fc85-4d14-b936-08b8280489e1"}]': finished 2024-04-25T17:13:38.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:37 smithi037 ceph-mon[26472]: osdmap e32: 5 total, 4 up, 5 in 2024-04-25T17:13:38.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:37 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T17:13:38.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:37 smithi069 ceph-mon[34527]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 123 KiB/s, 0 objects/s recovering 2024-04-25T17:13:38.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:37 smithi069 ceph-mon[34527]: from='client.? 172.21.15.69:0/3556719325' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "26cf2aeb-fc85-4d14-b936-08b8280489e1"}]: dispatch 2024-04-25T17:13:38.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:37 smithi069 ceph-mon[34527]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "26cf2aeb-fc85-4d14-b936-08b8280489e1"}]: dispatch 2024-04-25T17:13:38.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:37 smithi069 ceph-mon[34527]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "26cf2aeb-fc85-4d14-b936-08b8280489e1"}]': finished 2024-04-25T17:13:38.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:37 smithi069 ceph-mon[34527]: osdmap e32: 5 total, 4 up, 5 in 2024-04-25T17:13:38.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:37 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T17:13:39.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:38 smithi037 ceph-mon[26472]: from='client.? 172.21.15.69:0/2822378728' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T17:13:39.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:38 smithi069 ceph-mon[34527]: from='client.? 172.21.15.69:0/2822378728' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T17:13:39.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:39 smithi037 ceph-mon[26472]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-04-25T17:13:40.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:39 smithi069 ceph-mon[34527]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 101 KiB/s, 0 objects/s recovering 2024-04-25T17:13:41.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:40 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:13:41.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:40 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:13:42.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:41 smithi037 ceph-mon[26472]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-04-25T17:13:42.115 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:41 smithi069 ceph-mon[34527]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-04-25T17:13:44.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:44 smithi069 ceph-mon[34527]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-25T17:13:44.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:44 smithi037 ceph-mon[26472]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-04-25T17:13:45.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:45 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-25T17:13:45.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:45 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:13:45.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:45 smithi069 ceph-mon[34527]: Deploying daemon osd.4 on smithi069 2024-04-25T17:13:45.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:45 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-25T17:13:45.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:45 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:13:45.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:45 smithi037 ceph-mon[26472]: Deploying daemon osd.4 on smithi069 2024-04-25T17:13:46.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:46 smithi069 ceph-mon[34527]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-04-25T17:13:46.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:46 smithi037 ceph-mon[26472]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-04-25T17:13:48.620 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:48 smithi069 ceph-mon[34527]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-25T17:13:48.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:48 smithi037 ceph-mon[26472]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-25T17:13:50.738 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:50 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:50.738 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:50 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:50.738 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:50 smithi069 ceph-mon[34527]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-25T17:13:50.739 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:50 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:13:50.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:50 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:50.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:50 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:50.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:50 smithi037 ceph-mon[26472]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-25T17:13:50.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:50 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:13:52.784 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:52 smithi069 ceph-mon[34527]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-25T17:13:52.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:52 smithi037 ceph-mon[26472]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-25T17:13:52.836 INFO:teuthology.orchestra.run.smithi069.stdout:Created osd(s) 4 on host 'smithi069' 2024-04-25T17:13:52.836 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:52.835+0000 7f4ae6ffd700 1 -- 172.21.15.69:0/3136276976 <== mgr.14214 v2:172.21.15.37:6800/3566135606 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f4af002b3e0 con 0x7f4adc0692a0 2024-04-25T17:13:52.837 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:52.837+0000 7f4af84f6700 1 -- 172.21.15.69:0/3136276976 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f4adc0692a0 msgr2=0x7f4adc06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:13:52.838 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:52.837+0000 7f4af84f6700 1 --2- 172.21.15.69:0/3136276976 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f4adc0692a0 0x7f4adc06b750 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4aec00b970 tx=0x7f4aec009e30 comp rx=0 tx=0).stop 2024-04-25T17:13:52.838 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:52.837+0000 7f4af84f6700 1 -- 172.21.15.69:0/3136276976 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4af00fcf90 msgr2=0x7f4af010ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:13:52.838 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:52.837+0000 7f4af84f6700 1 --2- 172.21.15.69:0/3136276976 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4af00fcf90 0x7f4af010ddf0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0002a80 tx=0x7f4ae00046b0 comp rx=0 tx=0).stop 2024-04-25T17:13:52.838 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:52.838+0000 7f4af84f6700 1 -- 172.21.15.69:0/3136276976 shutdown_connections 2024-04-25T17:13:52.838 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:52.838+0000 7f4af84f6700 1 --2- 172.21.15.69:0/3136276976 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f4adc0692a0 0x7f4adc06b750 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:13:52.838 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:52.838+0000 7f4af84f6700 1 --2- 172.21.15.69:0/3136276976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4af00fbce0 0x7f4af010d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:13:52.838 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:52.838+0000 7f4af84f6700 1 --2- 172.21.15.69:0/3136276976 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4af00fcf90 0x7f4af010ddf0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:13:52.838 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:52.838+0000 7f4af84f6700 1 -- 172.21.15.69:0/3136276976 >> 172.21.15.69:0/3136276976 conn(0x7f4af00f7480 msgr2=0x7f4af00f8ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:13:52.839 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:52.838+0000 7f4af84f6700 1 -- 172.21.15.69:0/3136276976 shutdown_connections 2024-04-25T17:13:52.839 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:52.838+0000 7f4af84f6700 1 -- 172.21.15.69:0/3136276976 wait complete. 2024-04-25T17:13:53.445 DEBUG:teuthology.orchestra.run.smithi069:osd.4> sudo journalctl -f -n 0 -u ceph-599bb7fc-0326-11ef-bc93-c7b262605968@osd.4.service 2024-04-25T17:13:53.447 INFO:tasks.cephadm:Deploying osd.5 on smithi069 with /dev/vg_nvme/lv_2... 2024-04-25T17:13:53.447 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-04-25T17:13:53.741 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi069/config 2024-04-25T17:13:54.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:53 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:54.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:53 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:54.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:53 smithi037 ceph-mon[26472]: from='osd.4 [v2:172.21.15.69:6808/2571772778,v1:172.21.15.69:6809/2571772778]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-25T17:13:54.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:53 smithi037 ceph-mon[26472]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-25T17:13:54.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:53 smithi037 ceph-mon[26472]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-25T17:13:54.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:53 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:54.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:53 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:54.141 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:53 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:54.141 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:53 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:54.141 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:53 smithi069 ceph-mon[34527]: from='osd.4 [v2:172.21.15.69:6808/2571772778,v1:172.21.15.69:6809/2571772778]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-25T17:13:54.141 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:53 smithi069 ceph-mon[34527]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-25T17:13:54.141 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:53 smithi069 ceph-mon[34527]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-25T17:13:54.141 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:53 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:54.141 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:53 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:55.131 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:54 smithi069 ceph-mon[34527]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-25T17:13:55.131 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:54 smithi069 ceph-mon[34527]: osdmap e33: 5 total, 4 up, 5 in 2024-04-25T17:13:55.131 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:54 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T17:13:55.131 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:54 smithi069 ceph-mon[34527]: from='osd.4 [v2:172.21.15.69:6808/2571772778,v1:172.21.15.69:6809/2571772778]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2024-04-25T17:13:55.131 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:54 smithi069 ceph-mon[34527]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2024-04-25T17:13:55.131 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:13:54 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4[46528]: 2024-04-25T17:13:54.836+0000 7f291be0d700 -1 osd.4 0 waiting for initial osdmap 2024-04-25T17:13:55.131 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:13:54 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4[46528]: 2024-04-25T17:13:54.843+0000 7f2917409700 -1 osd.4 34 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T17:13:55.321 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:54 smithi037 ceph-mon[26472]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-25T17:13:55.321 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:54 smithi037 ceph-mon[26472]: osdmap e33: 5 total, 4 up, 5 in 2024-04-25T17:13:55.321 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:54 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T17:13:55.321 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:54 smithi037 ceph-mon[26472]: from='osd.4 [v2:172.21.15.69:6808/2571772778,v1:172.21.15.69:6809/2571772778]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2024-04-25T17:13:55.321 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:54 smithi037 ceph-mon[26472]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2024-04-25T17:13:56.029 INFO:teuthology.orchestra.run.smithi069.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-04-25T17:13:56.029 INFO:teuthology.orchestra.run.smithi069.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-04-25T17:13:56.029 INFO:teuthology.orchestra.run.smithi069.stderr: stderr: 10+0 records in 2024-04-25T17:13:56.029 INFO:teuthology.orchestra.run.smithi069.stderr:10+0 records out 2024-04-25T17:13:56.029 INFO:teuthology.orchestra.run.smithi069.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0121873 s, 860 MB/s 2024-04-25T17:13:56.029 INFO:teuthology.orchestra.run.smithi069.stderr:--> Zapping successful for: 2024-04-25T17:13:56.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:55 smithi069 ceph-mon[34527]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]': finished 2024-04-25T17:13:56.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:55 smithi069 ceph-mon[34527]: osdmap e34: 5 total, 4 up, 5 in 2024-04-25T17:13:56.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:55 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T17:13:56.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:55 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T17:13:56.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:55 smithi069 ceph-mon[34527]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-25T17:13:56.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:55 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:13:56.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:55 smithi069 ceph-mon[34527]: osd.4 [v2:172.21.15.69:6808/2571772778,v1:172.21.15.69:6809/2571772778] boot 2024-04-25T17:13:56.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:55 smithi069 ceph-mon[34527]: osdmap e35: 5 total, 5 up, 5 in 2024-04-25T17:13:56.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:55 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T17:13:56.196 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:55 smithi037 ceph-mon[26472]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]': finished 2024-04-25T17:13:56.196 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:55 smithi037 ceph-mon[26472]: osdmap e34: 5 total, 4 up, 5 in 2024-04-25T17:13:56.196 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:55 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T17:13:56.196 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:55 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T17:13:56.196 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:55 smithi037 ceph-mon[26472]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-04-25T17:13:56.196 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:55 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:13:56.196 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:55 smithi037 ceph-mon[26472]: osd.4 [v2:172.21.15.69:6808/2571772778,v1:172.21.15.69:6809/2571772778] boot 2024-04-25T17:13:56.196 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:55 smithi037 ceph-mon[26472]: osdmap e35: 5 total, 5 up, 5 in 2024-04-25T17:13:56.196 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:55 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T17:13:56.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:56 smithi069 ceph-mon[34527]: purged_snaps scrub starts 2024-04-25T17:13:56.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:56 smithi069 ceph-mon[34527]: purged_snaps scrub ok 2024-04-25T17:13:57.061 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph orch daemon add osd smithi069:vg_nvme/lv_2 2024-04-25T17:13:57.321 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:56 smithi037 ceph-mon[26472]: purged_snaps scrub starts 2024-04-25T17:13:57.321 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:56 smithi037 ceph-mon[26472]: purged_snaps scrub ok 2024-04-25T17:13:57.832 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi069/config 2024-04-25T17:13:58.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:57 smithi069 ceph-mon[34527]: osdmap e36: 5 total, 5 up, 5 in 2024-04-25T17:13:58.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:57 smithi069 ceph-mon[34527]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-25T17:13:58.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:57 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:58.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:57 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:58.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:57 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T17:13:58.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:57 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T17:13:58.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:57 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:58.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:57 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:13:58.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:57 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:13:58.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:57 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:58.223 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:57 smithi037 ceph-mon[26472]: osdmap e36: 5 total, 5 up, 5 in 2024-04-25T17:13:58.223 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:57 smithi037 ceph-mon[26472]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-25T17:13:58.223 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:57 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:58.223 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:57 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:58.223 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:57 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T17:13:58.223 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:57 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T17:13:58.223 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:57 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:58.223 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:57 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:13:58.223 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:57 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:13:58.223 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:57 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:58.913 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:58 smithi069 ceph-mon[34527]: Detected new or changed devices on smithi069 2024-04-25T17:13:58.913 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:58 smithi069 ceph-mon[34527]: Adjusting osd_memory_target on smithi069 to 7968M 2024-04-25T17:13:58.913 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:58 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:13:58.913 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:58 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:13:58.913 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:58 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:13:58.913 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:58 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:59.321 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:58 smithi037 ceph-mon[26472]: Detected new or changed devices on smithi069 2024-04-25T17:13:59.321 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:58 smithi037 ceph-mon[26472]: Adjusting osd_memory_target on smithi069 to 7968M 2024-04-25T17:13:59.321 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:58 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:13:59.321 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:58 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:13:59.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:58 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:13:59.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:58 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:13:59.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:59.383+0000 7f04b117b700 1 -- 172.21.15.69:0/2697980229 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04ac0fe080 msgr2=0x7f04ac0fe4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:13:59.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:59.383+0000 7f04b117b700 1 --2- 172.21.15.69:0/2697980229 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04ac0fe080 0x7f04ac0fe4f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f04a0004940 tx=0x7f04a0009e30 comp rx=0 tx=0).stop 2024-04-25T17:13:59.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:59.383+0000 7f04b117b700 1 -- 172.21.15.69:0/2697980229 shutdown_connections 2024-04-25T17:13:59.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:59.383+0000 7f04b117b700 1 --2- 172.21.15.69:0/2697980229 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04ac0fe080 0x7f04ac0fe4f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:13:59.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:59.383+0000 7f04b117b700 1 --2- 172.21.15.69:0/2697980229 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04ac0fcf10 0x7f04ac0fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:13:59.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:59.383+0000 7f04b117b700 1 -- 172.21.15.69:0/2697980229 >> 172.21.15.69:0/2697980229 conn(0x7f04ac0f8560 msgr2=0x7f04ac0fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:13:59.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:59.383+0000 7f04b117b700 1 -- 172.21.15.69:0/2697980229 shutdown_connections 2024-04-25T17:13:59.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:59.384+0000 7f04b117b700 1 -- 172.21.15.69:0/2697980229 wait complete. 2024-04-25T17:13:59.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:59.384+0000 7f04b117b700 1 Processor -- start 2024-04-25T17:13:59.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:59.384+0000 7f04b117b700 1 -- start start 2024-04-25T17:13:59.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:59.384+0000 7f04b117b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04ac0fcf10 0x7f04ac10d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:13:59.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:59.384+0000 7f04b117b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04ac0fe080 0x7f04ac10df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:13:59.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:59.384+0000 7f04b117b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04ac10e530 con 0x7f04ac0fcf10 2024-04-25T17:13:59.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:59.384+0000 7f04b117b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04ac10ed80 con 0x7f04ac0fe080 2024-04-25T17:13:59.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:59.384+0000 7f04aa59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04ac0fe080 0x7f04ac10df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:13:59.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:59.385+0000 7f04aa59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04ac0fe080 0x7f04ac10df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58878/0 (socket says 172.21.15.69:58878) 2024-04-25T17:13:59.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:59.385+0000 7f04aa59c700 1 -- 172.21.15.69:0/1927830399 learned_addr learned my addr 172.21.15.69:0/1927830399 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-25T17:13:59.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:59.385+0000 7f04aad9d700 1 --2- 172.21.15.69:0/1927830399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04ac0fcf10 0x7f04ac10d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:13:59.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:59.385+0000 7f04aa59c700 1 -- 172.21.15.69:0/1927830399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04ac0fcf10 msgr2=0x7f04ac10d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:13:59.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:59.385+0000 7f04aa59c700 1 --2- 172.21.15.69:0/1927830399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04ac0fcf10 0x7f04ac10d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:13:59.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:59.385+0000 7f04aa59c700 1 -- 172.21.15.69:0/1927830399 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a0005040 con 0x7f04ac0fe080 2024-04-25T17:13:59.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:59.385+0000 7f04aa59c700 1 --2- 172.21.15.69:0/1927830399 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04ac0fe080 0x7f04ac10df30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f04a0009150 tx=0x7f04a0009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:13:59.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:59.385+0000 7f04937fe700 1 -- 172.21.15.69:0/1927830399 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04a000e040 con 0x7f04ac0fe080 2024-04-25T17:13:59.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:59.385+0000 7f04937fe700 1 -- 172.21.15.69:0/1927830399 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f04a0004290 con 0x7f04ac0fe080 2024-04-25T17:13:59.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:59.385+0000 7f04b117b700 1 -- 172.21.15.69:0/1927830399 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04ac10f000 con 0x7f04ac0fe080 2024-04-25T17:13:59.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:59.385+0000 7f04937fe700 1 -- 172.21.15.69:0/1927830399 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04a001c630 con 0x7f04ac0fe080 2024-04-25T17:13:59.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:59.385+0000 7f04b117b700 1 -- 172.21.15.69:0/1927830399 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04ac10f540 con 0x7f04ac0fe080 2024-04-25T17:13:59.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:59.386+0000 7f04b117b700 1 -- 172.21.15.69:0/1927830399 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04ac05f5c0 con 0x7f04ac0fe080 2024-04-25T17:13:59.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:59.386+0000 7f04937fe700 1 -- 172.21.15.69:0/1927830399 <== mon.1 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f04a000bbf0 con 0x7f04ac0fe080 2024-04-25T17:13:59.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:59.387+0000 7f04937fe700 1 --2- 172.21.15.69:0/1927830399 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f04940692a0 0x7f049406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:13:59.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:59.387+0000 7f04937fe700 1 -- 172.21.15.69:0/1927830399 <== mon.1 v2:172.21.15.69:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4202+0+0 (secure 0 0 0) 0x7f04a0087890 con 0x7f04ac0fe080 2024-04-25T17:13:59.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:59.387+0000 7f04aad9d700 1 --2- 172.21.15.69:0/1927830399 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f04940692a0 0x7f049406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:13:59.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:59.388+0000 7f04aad9d700 1 --2- 172.21.15.69:0/1927830399 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f04940692a0 0x7f049406b750 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f049c007fd0 tx=0x7f049c009040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:13:59.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:59.391+0000 7f04937fe700 1 -- 172.21.15.69:0/1927830399 <== mon.1 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f04a0057be0 con 0x7f04ac0fe080 2024-04-25T17:13:59.589 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:13:59.589+0000 7f04b117b700 1 -- 172.21.15.69:0/1927830399 --> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f04ac10f870 con 0x7f04940692a0 2024-04-25T17:14:00.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:59 smithi069 ceph-mon[34527]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-25T17:14:00.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:59 smithi069 ceph-mon[34527]: from='client.24175 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:14:00.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:59 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T17:14:00.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:59 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T17:14:00.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:13:59 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:14:00.321 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:59 smithi037 ceph-mon[26472]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-25T17:14:00.321 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:59 smithi037 ceph-mon[26472]: from='client.24175 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:14:00.321 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:59 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-04-25T17:14:00.321 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:59 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-04-25T17:14:00.321 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:13:59 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:14:02.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:02 smithi037 ceph-mon[26472]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-25T17:14:02.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:02 smithi037 ceph-mon[26472]: from='client.? 172.21.15.69:0/4294281574' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fb3edb82-8f78-40d6-a339-5c469ef08371"}]: dispatch 2024-04-25T17:14:02.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:02 smithi037 ceph-mon[26472]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fb3edb82-8f78-40d6-a339-5c469ef08371"}]: dispatch 2024-04-25T17:14:02.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:02 smithi037 ceph-mon[26472]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fb3edb82-8f78-40d6-a339-5c469ef08371"}]': finished 2024-04-25T17:14:02.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:02 smithi037 ceph-mon[26472]: osdmap e37: 6 total, 5 up, 6 in 2024-04-25T17:14:02.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:02 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T17:14:02.854 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:02 smithi069 ceph-mon[34527]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-25T17:14:02.854 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:02 smithi069 ceph-mon[34527]: from='client.? 172.21.15.69:0/4294281574' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fb3edb82-8f78-40d6-a339-5c469ef08371"}]: dispatch 2024-04-25T17:14:02.854 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:02 smithi069 ceph-mon[34527]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fb3edb82-8f78-40d6-a339-5c469ef08371"}]: dispatch 2024-04-25T17:14:02.854 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:02 smithi069 ceph-mon[34527]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fb3edb82-8f78-40d6-a339-5c469ef08371"}]': finished 2024-04-25T17:14:02.854 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:02 smithi069 ceph-mon[34527]: osdmap e37: 6 total, 5 up, 6 in 2024-04-25T17:14:02.854 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:02 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T17:14:03.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:03 smithi037 ceph-mon[26472]: from='client.? 172.21.15.69:0/3830299555' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T17:14:03.917 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:03 smithi069 ceph-mon[34527]: from='client.? 172.21.15.69:0/3830299555' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-04-25T17:14:04.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:04 smithi037 ceph-mon[26472]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-25T17:14:04.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:04 smithi069 ceph-mon[34527]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-25T17:14:06.798 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:06 smithi069 ceph-mon[34527]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-25T17:14:06.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:06 smithi037 ceph-mon[26472]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-25T17:14:08.609 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:08 smithi069 ceph-mon[34527]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-25T17:14:08.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:08 smithi037 ceph-mon[26472]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-25T17:14:09.621 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:09 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-25T17:14:09.621 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:09 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:14:09.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:09 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-25T17:14:09.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:09 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:14:10.812 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:10 smithi069 ceph-mon[34527]: Deploying daemon osd.5 on smithi069 2024-04-25T17:14:10.812 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:10 smithi069 ceph-mon[34527]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-25T17:14:10.812 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:10 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:14:10.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:10 smithi037 ceph-mon[26472]: Deploying daemon osd.5 on smithi069 2024-04-25T17:14:10.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:10 smithi037 ceph-mon[26472]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-25T17:14:10.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:10 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:14:12.642 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:12 smithi069 ceph-mon[34527]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-25T17:14:12.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:12 smithi037 ceph-mon[26472]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-25T17:14:14.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:14 smithi069 ceph-mon[34527]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-25T17:14:14.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:14 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:14:14.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:14 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:14:14.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:14 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:14:15.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:14 smithi037 ceph-mon[26472]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-25T17:14:15.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:14 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:14:15.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:14 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:14:15.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:14 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:14:16.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:16 smithi069 ceph-mon[34527]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-25T17:14:17.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:16 smithi037 ceph-mon[26472]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-25T17:14:17.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:14:17.354+0000 7f04937fe700 1 -- 172.21.15.69:0/1927830399 <== mgr.14214 v2:172.21.15.37:6800/3566135606 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f04ac10f870 con 0x7f04940692a0 2024-04-25T17:14:17.355 INFO:teuthology.orchestra.run.smithi069.stdout:Created osd(s) 5 on host 'smithi069' 2024-04-25T17:14:17.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:14:17.356+0000 7f04b117b700 1 -- 172.21.15.69:0/1927830399 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f04940692a0 msgr2=0x7f049406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:17.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:14:17.356+0000 7f04b117b700 1 --2- 172.21.15.69:0/1927830399 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f04940692a0 0x7f049406b750 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f049c007fd0 tx=0x7f049c009040 comp rx=0 tx=0).stop 2024-04-25T17:14:17.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:14:17.356+0000 7f04b117b700 1 -- 172.21.15.69:0/1927830399 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04ac0fe080 msgr2=0x7f04ac10df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:17.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:14:17.356+0000 7f04b117b700 1 --2- 172.21.15.69:0/1927830399 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04ac0fe080 0x7f04ac10df30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f04a0009150 tx=0x7f04a0009e30 comp rx=0 tx=0).stop 2024-04-25T17:14:17.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:14:17.356+0000 7f04b117b700 1 -- 172.21.15.69:0/1927830399 shutdown_connections 2024-04-25T17:14:17.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:14:17.356+0000 7f04b117b700 1 --2- 172.21.15.69:0/1927830399 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f04940692a0 0x7f049406b750 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:17.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:14:17.356+0000 7f04b117b700 1 --2- 172.21.15.69:0/1927830399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04ac0fcf10 0x7f04ac10d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:17.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:14:17.356+0000 7f04b117b700 1 --2- 172.21.15.69:0/1927830399 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04ac0fe080 0x7f04ac10df30 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:17.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:14:17.356+0000 7f04b117b700 1 -- 172.21.15.69:0/1927830399 >> 172.21.15.69:0/1927830399 conn(0x7f04ac0f8560 msgr2=0x7f04ac0f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:14:17.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:14:17.356+0000 7f04b117b700 1 -- 172.21.15.69:0/1927830399 shutdown_connections 2024-04-25T17:14:17.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:14:17.356+0000 7f04b117b700 1 -- 172.21.15.69:0/1927830399 wait complete. 2024-04-25T17:14:17.961 DEBUG:teuthology.orchestra.run.smithi069:osd.5> sudo journalctl -f -n 0 -u ceph-599bb7fc-0326-11ef-bc93-c7b262605968@osd.5.service 2024-04-25T17:14:17.963 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-04-25T17:14:17.964 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph osd stat -f json 2024-04-25T17:14:18.246 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:14:18.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:18 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:14:18.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:18 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:14:18.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:18 smithi037 ceph-mon[26472]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-25T17:14:18.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:18 smithi037 ceph-mon[26472]: from='osd.5 [v2:172.21.15.69:6816/2319222775,v1:172.21.15.69:6817/2319222775]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-25T17:14:18.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:18 smithi037 ceph-mon[26472]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-25T17:14:18.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:18 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:14:18.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:18 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:14:18.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:18 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:14:18.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:18 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:14:18.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:18 smithi069 ceph-mon[34527]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-25T17:14:18.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:18 smithi069 ceph-mon[34527]: from='osd.5 [v2:172.21.15.69:6816/2319222775,v1:172.21.15.69:6817/2319222775]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-25T17:14:18.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:18 smithi069 ceph-mon[34527]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-25T17:14:18.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:18 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:14:18.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:18 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:14:19.583 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:19 smithi037 ceph-mon[26472]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-25T17:14:19.584 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:19 smithi037 ceph-mon[26472]: osdmap e38: 6 total, 5 up, 6 in 2024-04-25T17:14:19.584 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:19 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T17:14:19.584 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:19 smithi037 ceph-mon[26472]: from='osd.5 [v2:172.21.15.69:6816/2319222775,v1:172.21.15.69:6817/2319222775]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2024-04-25T17:14:19.584 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:19 smithi037 ceph-mon[26472]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2024-04-25T17:14:19.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:19 smithi069 ceph-mon[34527]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-25T17:14:19.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:19 smithi069 ceph-mon[34527]: osdmap e38: 6 total, 5 up, 6 in 2024-04-25T17:14:19.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:19 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T17:14:19.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:19 smithi069 ceph-mon[34527]: from='osd.5 [v2:172.21.15.69:6816/2319222775,v1:172.21.15.69:6817/2319222775]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2024-04-25T17:14:19.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:19 smithi069 ceph-mon[34527]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2024-04-25T17:14:19.668 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:14:19 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5[53009]: 2024-04-25T17:14:19.336+0000 7ff7cebd3700 -1 osd.5 0 waiting for initial osdmap 2024-04-25T17:14:19.668 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:14:19 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5[53009]: 2024-04-25T17:14:19.344+0000 7ff7ca1cf700 -1 osd.5 39 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T17:14:19.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:19.917+0000 7ff38b54d700 1 -- 172.21.15.37:0/981276543 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3840fce60 msgr2=0x7ff3840fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:19.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:19.917+0000 7ff38b54d700 1 --2- 172.21.15.37:0/981276543 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3840fce60 0x7ff3840fd270 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff374004940 tx=0x7ff374009e30 comp rx=0 tx=0).stop 2024-04-25T17:14:19.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:19.917+0000 7ff38b54d700 1 -- 172.21.15.37:0/981276543 shutdown_connections 2024-04-25T17:14:19.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:19.917+0000 7ff38b54d700 1 --2- 172.21.15.37:0/981276543 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff3840fdfd0 0x7ff3840fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:19.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:19.917+0000 7ff38b54d700 1 --2- 172.21.15.37:0/981276543 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3840fce60 0x7ff3840fd270 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:19.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:19.917+0000 7ff38b54d700 1 -- 172.21.15.37:0/981276543 >> 172.21.15.37:0/981276543 conn(0x7ff3840f8540 msgr2=0x7ff3840fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:14:19.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:19.918+0000 7ff38b54d700 1 -- 172.21.15.37:0/981276543 shutdown_connections 2024-04-25T17:14:19.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:19.918+0000 7ff38b54d700 1 -- 172.21.15.37:0/981276543 wait complete. 2024-04-25T17:14:19.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:19.918+0000 7ff38b54d700 1 Processor -- start 2024-04-25T17:14:19.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:19.918+0000 7ff38b54d700 1 -- start start 2024-04-25T17:14:19.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:19.918+0000 7ff38b54d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff3840fce60 0x7ff384071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:14:19.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:19.918+0000 7ff38b54d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3840fdfd0 0x7ff3840702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:14:19.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:19.918+0000 7ff38b54d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff384072200 con 0x7ff3840fdfd0 2024-04-25T17:14:19.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:19.918+0000 7ff38b54d700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3840707f0 con 0x7ff3840fce60 2024-04-25T17:14:19.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:19.919+0000 7ff3892e9700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff3840fce60 0x7ff384071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:14:19.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:19.919+0000 7ff388ae8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3840fdfd0 0x7ff3840702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:14:19.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:19.919+0000 7ff3892e9700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff3840fce60 0x7ff384071c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.37:34524/0 (socket says 172.21.15.37:34524) 2024-04-25T17:14:19.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:19.919+0000 7ff3892e9700 1 -- 172.21.15.37:0/4133332075 learned_addr learned my addr 172.21.15.37:0/4133332075 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:14:19.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:19.919+0000 7ff388ae8700 1 -- 172.21.15.37:0/4133332075 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff3840fce60 msgr2=0x7ff384071c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:19.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:19.919+0000 7ff388ae8700 1 --2- 172.21.15.37:0/4133332075 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff3840fce60 0x7ff384071c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:19.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:19.919+0000 7ff388ae8700 1 -- 172.21.15.37:0/4133332075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff374005040 con 0x7ff3840fdfd0 2024-04-25T17:14:19.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:19.919+0000 7ff3892e9700 1 --2- 172.21.15.37:0/4133332075 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff3840fce60 0x7ff384071c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T17:14:19.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:19.919+0000 7ff388ae8700 1 --2- 172.21.15.37:0/4133332075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3840fdfd0 0x7ff3840702b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff38000c800 tx=0x7ff380004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:14:19.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:19.919+0000 7ff379ffb700 1 -- 172.21.15.37:0/4133332075 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3800106f0 con 0x7ff3840fdfd0 2024-04-25T17:14:19.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:19.919+0000 7ff379ffb700 1 -- 172.21.15.37:0/4133332075 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff380010d20 con 0x7ff3840fdfd0 2024-04-25T17:14:19.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:19.919+0000 7ff38b54d700 1 -- 172.21.15.37:0/4133332075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff384070aa0 con 0x7ff3840fdfd0 2024-04-25T17:14:19.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:19.919+0000 7ff379ffb700 1 -- 172.21.15.37:0/4133332075 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3800113a0 con 0x7ff3840fdfd0 2024-04-25T17:14:19.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:19.920+0000 7ff38b54d700 1 -- 172.21.15.37:0/4133332075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff384071060 con 0x7ff3840fdfd0 2024-04-25T17:14:19.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:19.920+0000 7ff38b54d700 1 -- 172.21.15.37:0/4133332075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff38404c710 con 0x7ff3840fdfd0 2024-04-25T17:14:19.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:19.921+0000 7ff379ffb700 1 -- 172.21.15.37:0/4133332075 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7ff380012400 con 0x7ff3840fdfd0 2024-04-25T17:14:19.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:19.921+0000 7ff379ffb700 1 --2- 172.21.15.37:0/4133332075 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7ff3700692a0 0x7ff37006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:14:19.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:19.921+0000 7ff379ffb700 1 -- 172.21.15.37:0/4133332075 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4354+0+0 (secure 0 0 0) 0x7ff380086d30 con 0x7ff3840fdfd0 2024-04-25T17:14:19.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:19.921+0000 7ff3892e9700 1 --2- 172.21.15.37:0/4133332075 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7ff3700692a0 0x7ff37006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:14:19.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:19.922+0000 7ff3892e9700 1 --2- 172.21.15.37:0/4133332075 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7ff3700692a0 0x7ff37006b750 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff374004f90 tx=0x7ff374009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:14:19.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:19.926+0000 7ff379ffb700 1 -- 172.21.15.37:0/4133332075 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7ff380056f40 con 0x7ff3840fdfd0 2024-04-25T17:14:20.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:20.121+0000 7ff38b54d700 1 -- 172.21.15.37:0/4133332075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7ff3841058c0 con 0x7ff3840fdfd0 2024-04-25T17:14:20.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:20.122+0000 7ff379ffb700 1 -- 172.21.15.37:0/4133332075 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v39) v1 ==== 74+0+130 (secure 0 0 0) 0x7ff380056ad0 con 0x7ff3840fdfd0 2024-04-25T17:14:20.123 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:14:20.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:20.124+0000 7ff38b54d700 1 -- 172.21.15.37:0/4133332075 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7ff3700692a0 msgr2=0x7ff37006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:20.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:20.124+0000 7ff38b54d700 1 --2- 172.21.15.37:0/4133332075 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7ff3700692a0 0x7ff37006b750 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff374004f90 tx=0x7ff374009e30 comp rx=0 tx=0).stop 2024-04-25T17:14:20.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:20.124+0000 7ff38b54d700 1 -- 172.21.15.37:0/4133332075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3840fdfd0 msgr2=0x7ff3840702b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:20.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:20.124+0000 7ff38b54d700 1 --2- 172.21.15.37:0/4133332075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3840fdfd0 0x7ff3840702b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff38000c800 tx=0x7ff380004430 comp rx=0 tx=0).stop 2024-04-25T17:14:20.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:20.124+0000 7ff38b54d700 1 -- 172.21.15.37:0/4133332075 shutdown_connections 2024-04-25T17:14:20.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:20.124+0000 7ff38b54d700 1 --2- 172.21.15.37:0/4133332075 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7ff3700692a0 0x7ff37006b750 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:20.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:20.124+0000 7ff38b54d700 1 --2- 172.21.15.37:0/4133332075 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff3840fce60 0x7ff384071c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:20.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:20.124+0000 7ff38b54d700 1 --2- 172.21.15.37:0/4133332075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3840fdfd0 0x7ff3840702b0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:20.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:20.124+0000 7ff38b54d700 1 -- 172.21.15.37:0/4133332075 >> 172.21.15.37:0/4133332075 conn(0x7ff3840f8540 msgr2=0x7ff3840f9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:14:20.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:20.124+0000 7ff38b54d700 1 -- 172.21.15.37:0/4133332075 shutdown_connections 2024-04-25T17:14:20.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:20.124+0000 7ff38b54d700 1 -- 172.21.15.37:0/4133332075 wait complete. 2024-04-25T17:14:20.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:20 smithi069 ceph-mon[34527]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]': finished 2024-04-25T17:14:20.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:20 smithi069 ceph-mon[34527]: osdmap e39: 6 total, 5 up, 6 in 2024-04-25T17:14:20.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:20 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T17:14:20.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:20 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T17:14:20.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:20 smithi069 ceph-mon[34527]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-25T17:14:20.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:20 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/4133332075' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-25T17:14:20.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:20 smithi037 ceph-mon[26472]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]': finished 2024-04-25T17:14:20.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:20 smithi037 ceph-mon[26472]: osdmap e39: 6 total, 5 up, 6 in 2024-04-25T17:14:20.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:20 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T17:14:20.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:20 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T17:14:20.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:20 smithi037 ceph-mon[26472]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-04-25T17:14:20.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:20 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/4133332075' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-25T17:14:20.944 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":39,"num_osds":6,"num_up_osds":5,"osd_up_since":1714065235,"num_in_osds":6,"osd_in_since":1714065241,"num_remapped_pgs":0} 2024-04-25T17:14:21.379 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:21 smithi069 ceph-mon[34527]: purged_snaps scrub starts 2024-04-25T17:14:21.379 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:21 smithi069 ceph-mon[34527]: purged_snaps scrub ok 2024-04-25T17:14:21.379 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:21 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T17:14:21.379 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:21 smithi069 ceph-mon[34527]: osd.5 [v2:172.21.15.69:6816/2319222775,v1:172.21.15.69:6817/2319222775] boot 2024-04-25T17:14:21.379 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:21 smithi069 ceph-mon[34527]: osdmap e40: 6 total, 6 up, 6 in 2024-04-25T17:14:21.379 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:21 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T17:14:21.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:21 smithi037 ceph-mon[26472]: purged_snaps scrub starts 2024-04-25T17:14:21.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:21 smithi037 ceph-mon[26472]: purged_snaps scrub ok 2024-04-25T17:14:21.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:21 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T17:14:21.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:21 smithi037 ceph-mon[26472]: osd.5 [v2:172.21.15.69:6816/2319222775,v1:172.21.15.69:6817/2319222775] boot 2024-04-25T17:14:21.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:21 smithi037 ceph-mon[26472]: osdmap e40: 6 total, 6 up, 6 in 2024-04-25T17:14:21.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:21 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T17:14:21.945 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph osd stat -f json 2024-04-25T17:14:22.211 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:14:22.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:22 smithi037 ceph-mon[26472]: osdmap e41: 6 total, 6 up, 6 in 2024-04-25T17:14:22.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:22 smithi037 ceph-mon[26472]: Detected new or changed devices on smithi069 2024-04-25T17:14:22.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:22 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:14:22.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:22 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:14:22.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:22 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T17:14:22.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:22 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T17:14:22.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:22 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T17:14:22.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:22 smithi037 ceph-mon[26472]: Adjusting osd_memory_target on smithi069 to 5312M 2024-04-25T17:14:22.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:22 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:14:22.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:22 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:14:22.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:22 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:14:22.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:22 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:14:22.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:22 smithi037 ceph-mon[26472]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:14:22.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:22 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:14:22.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:22 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:14:22.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:22 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:14:22.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:22 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:14:22.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:22 smithi069 ceph-mon[34527]: osdmap e41: 6 total, 6 up, 6 in 2024-04-25T17:14:22.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:22 smithi069 ceph-mon[34527]: Detected new or changed devices on smithi069 2024-04-25T17:14:22.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:22 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:14:22.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:22 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:14:22.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:22 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T17:14:22.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:22 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T17:14:22.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:22 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T17:14:22.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:22 smithi069 ceph-mon[34527]: Adjusting osd_memory_target on smithi069 to 5312M 2024-04-25T17:14:22.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:22 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:14:22.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:22 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:14:22.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:22 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:14:22.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:22 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:14:22.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:22 smithi069 ceph-mon[34527]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:14:22.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:22 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:14:22.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:22 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:14:22.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:22 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:14:22.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:22 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:14:23.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:23.823+0000 7fc6e9b2b700 1 -- 172.21.15.37:0/2566192403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6e40fdfd0 msgr2=0x7fc6e40fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:23.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:23.823+0000 7fc6e9b2b700 1 --2- 172.21.15.37:0/2566192403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6e40fdfd0 0x7fc6e40fe440 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4004940 tx=0x7fc6d4009e30 comp rx=0 tx=0).stop 2024-04-25T17:14:23.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:23.823+0000 7fc6e9b2b700 1 -- 172.21.15.37:0/2566192403 shutdown_connections 2024-04-25T17:14:23.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:23.823+0000 7fc6e9b2b700 1 --2- 172.21.15.37:0/2566192403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6e40fdfd0 0x7fc6e40fe440 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:23.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:23.823+0000 7fc6e9b2b700 1 --2- 172.21.15.37:0/2566192403 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6e40fce60 0x7fc6e40fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:23.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:23.823+0000 7fc6e9b2b700 1 -- 172.21.15.37:0/2566192403 >> 172.21.15.37:0/2566192403 conn(0x7fc6e40f8560 msgr2=0x7fc6e40fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:14:23.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:23.823+0000 7fc6e9b2b700 1 -- 172.21.15.37:0/2566192403 shutdown_connections 2024-04-25T17:14:23.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:23.823+0000 7fc6e9b2b700 1 -- 172.21.15.37:0/2566192403 wait complete. 2024-04-25T17:14:23.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:23.823+0000 7fc6e9b2b700 1 Processor -- start 2024-04-25T17:14:23.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:23.824+0000 7fc6e9b2b700 1 -- start start 2024-04-25T17:14:23.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:23.824+0000 7fc6e9b2b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6e40fce60 0x7fc6e410d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:14:23.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:23.824+0000 7fc6e9b2b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6e40fdfd0 0x7fc6e410df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:14:23.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:23.824+0000 7fc6e9b2b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e410e5b0 con 0x7fc6e40fdfd0 2024-04-25T17:14:23.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:23.824+0000 7fc6e9b2b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e410eda0 con 0x7fc6e40fce60 2024-04-25T17:14:23.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:23.824+0000 7fc6e2ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6e40fdfd0 0x7fc6e410df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:14:23.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:23.824+0000 7fc6e2ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6e40fdfd0 0x7fc6e410df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37578/0 (socket says 172.21.15.37:37578) 2024-04-25T17:14:23.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:23.824+0000 7fc6e2ffd700 1 -- 172.21.15.37:0/1943015381 learned_addr learned my addr 172.21.15.37:0/1943015381 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:14:23.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:23.824+0000 7fc6e37fe700 1 --2- 172.21.15.37:0/1943015381 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6e40fce60 0x7fc6e410d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:14:23.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:23.824+0000 7fc6e2ffd700 1 -- 172.21.15.37:0/1943015381 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6e40fce60 msgr2=0x7fc6e410d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:23.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:23.824+0000 7fc6e2ffd700 1 --2- 172.21.15.37:0/1943015381 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6e40fce60 0x7fc6e410d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:23.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:23.824+0000 7fc6e2ffd700 1 -- 172.21.15.37:0/1943015381 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6d4005040 con 0x7fc6e40fdfd0 2024-04-25T17:14:23.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:23.824+0000 7fc6e2ffd700 1 --2- 172.21.15.37:0/1943015381 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6e40fdfd0 0x7fc6e410df20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc6d400b3b0 tx=0x7fc6d4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:14:23.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:23.825+0000 7fc6cbfff700 1 -- 172.21.15.37:0/1943015381 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6d400e040 con 0x7fc6e40fdfd0 2024-04-25T17:14:23.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:23.825+0000 7fc6cbfff700 1 -- 172.21.15.37:0/1943015381 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc6d400bbf0 con 0x7fc6e40fdfd0 2024-04-25T17:14:23.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:23.825+0000 7fc6e9b2b700 1 -- 172.21.15.37:0/1943015381 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6e410f020 con 0x7fc6e40fdfd0 2024-04-25T17:14:23.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:23.825+0000 7fc6cbfff700 1 -- 172.21.15.37:0/1943015381 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6d401c630 con 0x7fc6e40fdfd0 2024-04-25T17:14:23.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:23.825+0000 7fc6e9b2b700 1 -- 172.21.15.37:0/1943015381 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6e410f590 con 0x7fc6e40fdfd0 2024-04-25T17:14:23.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:23.826+0000 7fc6e9b2b700 1 -- 172.21.15.37:0/1943015381 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6e405f5c0 con 0x7fc6e40fdfd0 2024-04-25T17:14:23.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:23.826+0000 7fc6cbfff700 1 -- 172.21.15.37:0/1943015381 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fc6d400bd60 con 0x7fc6e40fdfd0 2024-04-25T17:14:23.828 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:23.826+0000 7fc6cbfff700 1 --2- 172.21.15.37:0/1943015381 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fc6cc0692a0 0x7fc6cc06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:14:23.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:23.827+0000 7fc6cbfff700 1 -- 172.21.15.37:0/1943015381 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fc6d4087b10 con 0x7fc6e40fdfd0 2024-04-25T17:14:23.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:23.827+0000 7fc6e37fe700 1 --2- 172.21.15.37:0/1943015381 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fc6cc0692a0 0x7fc6cc06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:14:23.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:23.827+0000 7fc6e37fe700 1 --2- 172.21.15.37:0/1943015381 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fc6cc0692a0 0x7fc6cc06b750 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc6d8009bf0 tx=0x7fc6d80091a0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:14:23.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:23.831+0000 7fc6cbfff700 1 -- 172.21.15.37:0/1943015381 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fc6d4057c10 con 0x7fc6e40fdfd0 2024-04-25T17:14:24.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:24.025+0000 7fc6e9b2b700 1 -- 172.21.15.37:0/1943015381 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7fc6e404bed0 con 0x7fc6e40fdfd0 2024-04-25T17:14:24.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:24.027+0000 7fc6cbfff700 1 -- 172.21.15.37:0/1943015381 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v41) v1 ==== 74+0+130 (secure 0 0 0) 0x7fc6d40577a0 con 0x7fc6e40fdfd0 2024-04-25T17:14:24.027 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:14:24.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:24.028+0000 7fc6e9b2b700 1 -- 172.21.15.37:0/1943015381 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fc6cc0692a0 msgr2=0x7fc6cc06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:24.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:24.028+0000 7fc6e9b2b700 1 --2- 172.21.15.37:0/1943015381 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fc6cc0692a0 0x7fc6cc06b750 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc6d8009bf0 tx=0x7fc6d80091a0 comp rx=0 tx=0).stop 2024-04-25T17:14:24.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:24.028+0000 7fc6e9b2b700 1 -- 172.21.15.37:0/1943015381 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6e40fdfd0 msgr2=0x7fc6e410df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:24.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:24.028+0000 7fc6e9b2b700 1 --2- 172.21.15.37:0/1943015381 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6e40fdfd0 0x7fc6e410df20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc6d400b3b0 tx=0x7fc6d4009e30 comp rx=0 tx=0).stop 2024-04-25T17:14:24.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:24.028+0000 7fc6e9b2b700 1 -- 172.21.15.37:0/1943015381 shutdown_connections 2024-04-25T17:14:24.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:24.028+0000 7fc6e9b2b700 1 --2- 172.21.15.37:0/1943015381 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fc6cc0692a0 0x7fc6cc06b750 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:24.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:24.028+0000 7fc6e9b2b700 1 --2- 172.21.15.37:0/1943015381 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6e40fce60 0x7fc6e410d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:24.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:24.028+0000 7fc6e9b2b700 1 --2- 172.21.15.37:0/1943015381 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6e40fdfd0 0x7fc6e410df20 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:24.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:24.028+0000 7fc6e9b2b700 1 -- 172.21.15.37:0/1943015381 >> 172.21.15.37:0/1943015381 conn(0x7fc6e40f8560 msgr2=0x7fc6e40f9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:14:24.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:24.028+0000 7fc6e9b2b700 1 -- 172.21.15.37:0/1943015381 shutdown_connections 2024-04-25T17:14:24.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:24.028+0000 7fc6e9b2b700 1 -- 172.21.15.37:0/1943015381 wait complete. 2024-04-25T17:14:24.692 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:24 smithi037 ceph-mon[26472]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:14:24.692 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:24 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/1943015381' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-25T17:14:24.718 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":41,"num_osds":6,"num_up_osds":6,"osd_up_since":1714065260,"num_in_osds":6,"osd_in_since":1714065241,"num_remapped_pgs":0} 2024-04-25T17:14:24.719 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-25T17:14:24.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:24 smithi069 ceph-mon[34527]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:14:24.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:24 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/1943015381' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-04-25T17:14:24.984 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:14:25.819 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:25 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:14:25.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:25 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:14:26.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:26.686+0000 7fea61616700 1 -- 172.21.15.37:0/556142303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea5c0fb7f0 msgr2=0x7fea5c0fbbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:26.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:26.686+0000 7fea61616700 1 --2- 172.21.15.37:0/556142303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea5c0fb7f0 0x7fea5c0fbbc0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fea4c004940 tx=0x7fea4c009e30 comp rx=0 tx=0).stop 2024-04-25T17:14:26.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:26.687+0000 7fea61616700 1 -- 172.21.15.37:0/556142303 shutdown_connections 2024-04-25T17:14:26.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:26.687+0000 7fea61616700 1 --2- 172.21.15.37:0/556142303 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea5c0fc190 0x7fea5c101a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:26.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:26.687+0000 7fea61616700 1 --2- 172.21.15.37:0/556142303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea5c0fb7f0 0x7fea5c0fbbc0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:26.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:26.687+0000 7fea61616700 1 -- 172.21.15.37:0/556142303 >> 172.21.15.37:0/556142303 conn(0x7fea5c071460 msgr2=0x7fea5c071860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:14:26.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:26.687+0000 7fea61616700 1 -- 172.21.15.37:0/556142303 shutdown_connections 2024-04-25T17:14:26.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:26.687+0000 7fea61616700 1 -- 172.21.15.37:0/556142303 wait complete. 2024-04-25T17:14:26.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:26.687+0000 7fea61616700 1 Processor -- start 2024-04-25T17:14:26.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:26.687+0000 7fea61616700 1 -- start start 2024-04-25T17:14:26.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:26.687+0000 7fea61616700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea5c0fb7f0 0x7fea5c115c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:14:26.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:26.687+0000 7fea61616700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea5c0fc190 0x7fea5c116160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:14:26.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:26.687+0000 7fea61616700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c1167b0 con 0x7fea5c0fb7f0 2024-04-25T17:14:26.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:26.687+0000 7fea61616700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c10fd90 con 0x7fea5c0fc190 2024-04-25T17:14:26.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:26.688+0000 7fea5affd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea5c0fb7f0 0x7fea5c115c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:14:26.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:26.688+0000 7fea5affd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea5c0fb7f0 0x7fea5c115c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50250/0 (socket says 172.21.15.37:50250) 2024-04-25T17:14:26.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:26.688+0000 7fea5affd700 1 -- 172.21.15.37:0/524318657 learned_addr learned my addr 172.21.15.37:0/524318657 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:14:26.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:26.688+0000 7fea53fff700 1 --2- 172.21.15.37:0/524318657 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea5c0fc190 0x7fea5c116160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:14:26.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:26.688+0000 7fea5affd700 1 -- 172.21.15.37:0/524318657 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea5c0fc190 msgr2=0x7fea5c116160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:26.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:26.688+0000 7fea5affd700 1 --2- 172.21.15.37:0/524318657 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea5c0fc190 0x7fea5c116160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:26.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:26.688+0000 7fea5affd700 1 -- 172.21.15.37:0/524318657 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea4c005040 con 0x7fea5c0fb7f0 2024-04-25T17:14:26.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:26.688+0000 7fea5affd700 1 --2- 172.21.15.37:0/524318657 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea5c0fb7f0 0x7fea5c115c20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fea4c00b3b0 tx=0x7fea4c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:14:26.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:26.688+0000 7fea537fe700 1 -- 172.21.15.37:0/524318657 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea4c00e040 con 0x7fea5c0fb7f0 2024-04-25T17:14:26.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:26.688+0000 7fea537fe700 1 -- 172.21.15.37:0/524318657 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fea4c013420 con 0x7fea5c0fb7f0 2024-04-25T17:14:26.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:26.688+0000 7fea61616700 1 -- 172.21.15.37:0/524318657 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea5c110010 con 0x7fea5c0fb7f0 2024-04-25T17:14:26.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:26.688+0000 7fea537fe700 1 -- 172.21.15.37:0/524318657 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea4c01c630 con 0x7fea5c0fb7f0 2024-04-25T17:14:26.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:26.688+0000 7fea61616700 1 -- 172.21.15.37:0/524318657 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea5c110550 con 0x7fea5c0fb7f0 2024-04-25T17:14:26.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:26.689+0000 7fea61616700 1 -- 172.21.15.37:0/524318657 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea5c065f30 con 0x7fea5c0fb7f0 2024-04-25T17:14:26.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:26.690+0000 7fea537fe700 1 -- 172.21.15.37:0/524318657 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fea4c013590 con 0x7fea5c0fb7f0 2024-04-25T17:14:26.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:26.690+0000 7fea537fe700 1 --2- 172.21.15.37:0/524318657 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fea480692a0 0x7fea4806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:14:26.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:26.690+0000 7fea53fff700 1 --2- 172.21.15.37:0/524318657 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fea480692a0 0x7fea4806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:14:26.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:26.690+0000 7fea537fe700 1 -- 172.21.15.37:0/524318657 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fea4c088040 con 0x7fea5c0fb7f0 2024-04-25T17:14:26.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:26.691+0000 7fea53fff700 1 --2- 172.21.15.37:0/524318657 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fea480692a0 0x7fea4806b750 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fea5c1114c0 tx=0x7fea4400b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:14:26.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:26.694+0000 7fea537fe700 1 -- 172.21.15.37:0/524318657 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fea4c058140 con 0x7fea5c0fb7f0 2024-04-25T17:14:26.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:26 smithi037 ceph-mon[26472]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:14:26.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:26.891+0000 7fea61616700 1 -- 172.21.15.37:0/524318657 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fea5c04c710 con 0x7fea5c0fb7f0 2024-04-25T17:14:26.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:26.892+0000 7fea537fe700 1 -- 172.21.15.37:0/524318657 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11024 (secure 0 0 0) 0x7fea4c057cd0 con 0x7fea5c0fb7f0 2024-04-25T17:14:26.892 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:14:26.893 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":41,"fsid":"599bb7fc-0326-11ef-bc93-c7b262605968","created":"2024-04-25T17:08:37.882631+0000","modified":"2024-04-25T17:14:21.343451+0000","last_up_change":"2024-04-25T17:14:20.333710+0000","last_in_change":"2024-04-25T17:14:01.927070+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T17:13:09.960202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"c142de25-7aff-4c4b-b351-14e7b18de11d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2457908683},{"type":"v1","addr":"172.21.15.37:6803","nonce":2457908683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2457908683},{"type":"v1","addr":"172.21.15.37:6805","nonce":2457908683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2457908683},{"type":"v1","addr":"172.21.15.37:6809","nonce":2457908683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2457908683},{"type":"v1","addr":"172.21.15.37:6807","nonce":2457908683}]},"public_addr":"172.21.15.37:6803/2457908683","cluster_addr":"172.21.15.37:6805/2457908683","heartbeat_back_addr":"172.21.15.37:6809/2457908683","heartbeat_front_addr":"172.21.15.37:6807/2457908683","state":["exists","up"]},{"osd":1,"uuid":"ec683da0-f3c1-44b5-8f1d-69bec27fbe5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":24763193},{"type":"v1","addr":"172.21.15.37:6811","nonce":24763193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":24763193},{"type":"v1","addr":"172.21.15.37:6813","nonce":24763193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":24763193},{"type":"v1","addr":"172.21.15.37:6817","nonce":24763193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":24763193},{"type":"v1","addr":"172.21.15.37:6815","nonce":24763193}]},"public_addr":"172.21.15.37:6811/24763193","cluster_addr":"172.21.15.37:6813/24763193","heartbeat_back_addr":"172.21.15.37:6817/24763193","heartbeat_front_addr":"172.21.15.37:6815/24763193","state":["exists","up"]},{"osd":2,"uuid":"8bf4e67b-e95f-44d3-b51f-afd8a2d30e31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":596257416},{"type":"v1","addr":"172.21.15.37:6819","nonce":596257416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":596257416},{"type":"v1","addr":"172.21.15.37:6821","nonce":596257416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":596257416},{"type":"v1","addr":"172.21.15.37:6825","nonce":596257416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":596257416},{"type":"v1","addr":"172.21.15.37:6823","nonce":596257416}]},"public_addr":"172.21.15.37:6819/596257416","cluster_addr":"172.21.15.37:6821/596257416","heartbeat_back_addr":"172.21.15.37:6825/596257416","heartbeat_front_addr":"172.21.15.37:6823/596257416","state":["exists","up"]},{"osd":3,"uuid":"ce5ff1f7-472a-4515-b851-e434ee545b27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":3815031427},{"type":"v1","addr":"172.21.15.69:6801","nonce":3815031427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3815031427},{"type":"v1","addr":"172.21.15.69:6803","nonce":3815031427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3815031427},{"type":"v1","addr":"172.21.15.69:6807","nonce":3815031427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3815031427},{"type":"v1","addr":"172.21.15.69:6805","nonce":3815031427}]},"public_addr":"172.21.15.69:6801/3815031427","cluster_addr":"172.21.15.69:6803/3815031427","heartbeat_back_addr":"172.21.15.69:6807/3815031427","heartbeat_front_addr":"172.21.15.69:6805/3815031427","state":["exists","up"]},{"osd":4,"uuid":"26cf2aeb-fc85-4d14-b936-08b8280489e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":2571772778},{"type":"v1","addr":"172.21.15.69:6809","nonce":2571772778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":2571772778},{"type":"v1","addr":"172.21.15.69:6811","nonce":2571772778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":2571772778},{"type":"v1","addr":"172.21.15.69:6815","nonce":2571772778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":2571772778},{"type":"v1","addr":"172.21.15.69:6813","nonce":2571772778}]},"public_addr":"172.21.15.69:6809/2571772778","cluster_addr":"172.21.15.69:6811/2571772778","heartbeat_back_addr":"172.21.15.69:6815/2571772778","heartbeat_front_addr":"172.21.15.69:6813/2571772778","state":["exists","up"]},{"osd":5,"uuid":"fb3edb82-8f78-40d6-a339-5c469ef08371","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":2319222775},{"type":"v1","addr":"172.21.15.69:6817","nonce":2319222775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":2319222775},{"type":"v1","addr":"172.21.15.69:6819","nonce":2319222775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":2319222775},{"type":"v1","addr":"172.21.15.69:6823","nonce":2319222775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":2319222775},{"type":"v1","addr":"172.21.15.69:6821","nonce":2319222775}]},"public_addr":"172.21.15.69:6817/2319222775","cluster_addr":"172.21.15.69:6819/2319222775","heartbeat_back_addr":"172.21.15.69:6823/2319222775","heartbeat_front_addr":"172.21.15.69:6821/2319222775","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T17:12:12.145795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T17:12:39.059274+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T17:13:06.628770+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T17:13:29.779894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T17:13:54.338391+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T17:14:18.637188+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:0/4258551295":"2024-04-26T17:10:55.431694+0000","172.21.15.37:6801/1299348474":"2024-04-26T17:10:55.431694+0000","172.21.15.37:0/350553669":"2024-04-26T17:10:55.431694+0000","172.21.15.37:6801/3653320894":"2024-04-26T17:09:39.480662+0000","172.21.15.37:0/3689680514":"2024-04-26T17:09:39.480662+0000","172.21.15.37:0/1135030866":"2024-04-26T17:09:39.480662+0000","172.21.15.37:6800/2509847167":"2024-04-26T17:09:09.103933+0000","172.21.15.37:6800/3653320894":"2024-04-26T17:09:39.480662+0000","172.21.15.37:0/2586714806":"2024-04-26T17:09:09.103933+0000","172.21.15.37:6800/1299348474":"2024-04-26T17:10:55.431694+0000","172.21.15.37:0/3277643196":"2024-04-26T17:09:09.103933+0000","172.21.15.37:0/1487666224":"2024-04-26T17:09:09.103933+0000","172.21.15.37:6801/2509847167":"2024-04-26T17:09:09.103933+0000","172.21.15.37:0/1749794583":"2024-04-26T17:10:55.431694+0000","172.21.15.37:0/3089604872":"2024-04-26T17:09:39.480662+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T17:14:26.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:26.894+0000 7fea61616700 1 -- 172.21.15.37:0/524318657 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fea480692a0 msgr2=0x7fea4806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:26.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:26.894+0000 7fea61616700 1 --2- 172.21.15.37:0/524318657 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fea480692a0 0x7fea4806b750 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fea5c1114c0 tx=0x7fea4400b040 comp rx=0 tx=0).stop 2024-04-25T17:14:26.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:26.894+0000 7fea61616700 1 -- 172.21.15.37:0/524318657 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea5c0fb7f0 msgr2=0x7fea5c115c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:26.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:26.894+0000 7fea61616700 1 --2- 172.21.15.37:0/524318657 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea5c0fb7f0 0x7fea5c115c20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fea4c00b3b0 tx=0x7fea4c009e30 comp rx=0 tx=0).stop 2024-04-25T17:14:26.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:26.894+0000 7fea61616700 1 -- 172.21.15.37:0/524318657 shutdown_connections 2024-04-25T17:14:26.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:26.894+0000 7fea61616700 1 --2- 172.21.15.37:0/524318657 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fea480692a0 0x7fea4806b750 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:26.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:26.894+0000 7fea61616700 1 --2- 172.21.15.37:0/524318657 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea5c0fb7f0 0x7fea5c115c20 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:26.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:26.894+0000 7fea61616700 1 --2- 172.21.15.37:0/524318657 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea5c0fc190 0x7fea5c116160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:26.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:26.894+0000 7fea61616700 1 -- 172.21.15.37:0/524318657 >> 172.21.15.37:0/524318657 conn(0x7fea5c071460 msgr2=0x7fea5c0f93d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:14:26.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:26.894+0000 7fea61616700 1 -- 172.21.15.37:0/524318657 shutdown_connections 2024-04-25T17:14:26.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:26.894+0000 7fea61616700 1 -- 172.21.15.37:0/524318657 wait complete. 2024-04-25T17:14:26.917 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:26 smithi069 ceph-mon[34527]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:14:27.646 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T17:13:09.960202+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-04-25T17:14:27.646 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-04-25T17:14:27.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:27 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/524318657' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T17:14:27.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:27 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/524318657' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T17:14:27.918 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:14:28.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:28 smithi037 ceph-mon[26472]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:14:28.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:28 smithi069 ceph-mon[34527]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:14:29.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:29.496+0000 7f8a62dae700 1 -- 172.21.15.37:0/3655230100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a5c102de0 msgr2=0x7f8a5c1031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:29.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:29.496+0000 7f8a62dae700 1 --2- 172.21.15.37:0/3655230100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a5c102de0 0x7f8a5c1031b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8a50004940 tx=0x7f8a50009e30 comp rx=0 tx=0).stop 2024-04-25T17:14:29.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:29.496+0000 7f8a62dae700 1 -- 172.21.15.37:0/3655230100 shutdown_connections 2024-04-25T17:14:29.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:29.496+0000 7f8a62dae700 1 --2- 172.21.15.37:0/3655230100 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a5c103780 0x7f8a5c0fcdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:29.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:29.496+0000 7f8a62dae700 1 --2- 172.21.15.37:0/3655230100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a5c102de0 0x7f8a5c1031b0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:29.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:29.496+0000 7f8a62dae700 1 -- 172.21.15.37:0/3655230100 >> 172.21.15.37:0/3655230100 conn(0x7f8a5c0f8990 msgr2=0x7f8a5c0fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:14:29.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:29.496+0000 7f8a62dae700 1 -- 172.21.15.37:0/3655230100 shutdown_connections 2024-04-25T17:14:29.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:29.497+0000 7f8a62dae700 1 -- 172.21.15.37:0/3655230100 wait complete. 2024-04-25T17:14:29.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:29.497+0000 7f8a62dae700 1 Processor -- start 2024-04-25T17:14:29.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:29.497+0000 7f8a62dae700 1 -- start start 2024-04-25T17:14:29.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:29.497+0000 7f8a62dae700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a5c102de0 0x7f8a5c113970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:14:29.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:29.497+0000 7f8a62dae700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a5c103780 0x7f8a5c113eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:14:29.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:29.497+0000 7f8a62dae700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5c114500 con 0x7f8a5c102de0 2024-04-25T17:14:29.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:29.497+0000 7f8a62dae700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a5c10db50 con 0x7f8a5c103780 2024-04-25T17:14:29.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:29.498+0000 7f8a60b4a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a5c102de0 0x7f8a5c113970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:14:29.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:29.498+0000 7f8a60b4a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a5c102de0 0x7f8a5c113970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50280/0 (socket says 172.21.15.37:50280) 2024-04-25T17:14:29.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:29.498+0000 7f8a60b4a700 1 -- 172.21.15.37:0/730616159 learned_addr learned my addr 172.21.15.37:0/730616159 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:14:29.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:29.498+0000 7f8a5bfff700 1 --2- 172.21.15.37:0/730616159 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a5c103780 0x7f8a5c113eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:14:29.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:29.498+0000 7f8a60b4a700 1 -- 172.21.15.37:0/730616159 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a5c103780 msgr2=0x7f8a5c113eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:29.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:29.498+0000 7f8a60b4a700 1 --2- 172.21.15.37:0/730616159 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a5c103780 0x7f8a5c113eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:29.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:29.498+0000 7f8a60b4a700 1 -- 172.21.15.37:0/730616159 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a50005040 con 0x7f8a5c102de0 2024-04-25T17:14:29.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:29.498+0000 7f8a60b4a700 1 --2- 172.21.15.37:0/730616159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a5c102de0 0x7f8a5c113970 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8a5000b3b0 tx=0x7f8a50009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:14:29.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:29.498+0000 7f8a597fa700 1 -- 172.21.15.37:0/730616159 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a5000e040 con 0x7f8a5c102de0 2024-04-25T17:14:29.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:29.498+0000 7f8a597fa700 1 -- 172.21.15.37:0/730616159 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8a50013420 con 0x7f8a5c102de0 2024-04-25T17:14:29.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:29.498+0000 7f8a597fa700 1 -- 172.21.15.37:0/730616159 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a5001c630 con 0x7f8a5c102de0 2024-04-25T17:14:29.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:29.498+0000 7f8a62dae700 1 -- 172.21.15.37:0/730616159 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a5c10ddd0 con 0x7f8a5c102de0 2024-04-25T17:14:29.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:29.498+0000 7f8a62dae700 1 -- 172.21.15.37:0/730616159 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a5c10e390 con 0x7f8a5c102de0 2024-04-25T17:14:29.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:29.499+0000 7f8a62dae700 1 -- 172.21.15.37:0/730616159 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a5c1000f0 con 0x7f8a5c102de0 2024-04-25T17:14:29.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:29.500+0000 7f8a597fa700 1 -- 172.21.15.37:0/730616159 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f8a50013590 con 0x7f8a5c102de0 2024-04-25T17:14:29.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:29.500+0000 7f8a597fa700 1 --2- 172.21.15.37:0/730616159 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f8a4c0692a0 0x7f8a4c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:14:29.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:29.500+0000 7f8a597fa700 1 -- 172.21.15.37:0/730616159 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f8a50087fa0 con 0x7f8a5c102de0 2024-04-25T17:14:29.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:29.501+0000 7f8a5bfff700 1 --2- 172.21.15.37:0/730616159 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f8a4c0692a0 0x7f8a4c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:14:29.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:29.501+0000 7f8a5bfff700 1 --2- 172.21.15.37:0/730616159 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f8a4c0692a0 0x7f8a4c06b750 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c10ecc0 tx=0x7f8a4800b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:14:29.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:29.505+0000 7f8a597fa700 1 -- 172.21.15.37:0/730616159 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f8a50058140 con 0x7f8a5c102de0 2024-04-25T17:14:29.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:29.702+0000 7f8a62dae700 1 -- 172.21.15.37:0/730616159 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8a5c10efc0 con 0x7f8a5c102de0 2024-04-25T17:14:29.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:29.702+0000 7f8a597fa700 1 -- 172.21.15.37:0/730616159 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8a50057cd0 con 0x7f8a5c102de0 2024-04-25T17:14:29.703 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-04-25T17:14:29.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:29.704+0000 7f8a62dae700 1 -- 172.21.15.37:0/730616159 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f8a4c0692a0 msgr2=0x7f8a4c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:29.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:29.704+0000 7f8a62dae700 1 --2- 172.21.15.37:0/730616159 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f8a4c0692a0 0x7f8a4c06b750 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8a5c10ecc0 tx=0x7f8a4800b040 comp rx=0 tx=0).stop 2024-04-25T17:14:29.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:29.704+0000 7f8a62dae700 1 -- 172.21.15.37:0/730616159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a5c102de0 msgr2=0x7f8a5c113970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:29.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:29.704+0000 7f8a62dae700 1 --2- 172.21.15.37:0/730616159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a5c102de0 0x7f8a5c113970 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8a5000b3b0 tx=0x7f8a50009e30 comp rx=0 tx=0).stop 2024-04-25T17:14:29.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:29.704+0000 7f8a62dae700 1 -- 172.21.15.37:0/730616159 shutdown_connections 2024-04-25T17:14:29.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:29.704+0000 7f8a62dae700 1 --2- 172.21.15.37:0/730616159 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f8a4c0692a0 0x7f8a4c06b750 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:29.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:29.704+0000 7f8a62dae700 1 --2- 172.21.15.37:0/730616159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a5c102de0 0x7f8a5c113970 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:29.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:29.704+0000 7f8a62dae700 1 --2- 172.21.15.37:0/730616159 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a5c103780 0x7f8a5c113eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:29.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:29.704+0000 7f8a62dae700 1 -- 172.21.15.37:0/730616159 >> 172.21.15.37:0/730616159 conn(0x7f8a5c0f8990 msgr2=0x7f8a5c107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:14:29.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:29.704+0000 7f8a62dae700 1 -- 172.21.15.37:0/730616159 shutdown_connections 2024-04-25T17:14:29.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:29.704+0000 7f8a62dae700 1 -- 172.21.15.37:0/730616159 wait complete. 2024-04-25T17:14:30.443 INFO:tasks.cephadm:Setting up client nodes... 2024-04-25T17:14:30.443 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-04-25T17:14:30.714 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:14:30.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:30 smithi037 ceph-mon[26472]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:14:30.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:30 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/730616159' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T17:14:30.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:30 smithi069 ceph-mon[34527]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:14:30.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:30 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/730616159' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T17:14:32.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:32.353+0000 7f325642d700 1 -- 172.21.15.37:0/1485762455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32500fcfa0 msgr2=0x7f32500fd410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:32.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:32.353+0000 7f325642d700 1 --2- 172.21.15.37:0/1485762455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32500fcfa0 0x7f32500fd410 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3244004940 tx=0x7f3244009e30 comp rx=0 tx=0).stop 2024-04-25T17:14:32.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:32.353+0000 7f325642d700 1 -- 172.21.15.37:0/1485762455 shutdown_connections 2024-04-25T17:14:32.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:32.353+0000 7f325642d700 1 --2- 172.21.15.37:0/1485762455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32500fcfa0 0x7f32500fd410 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:32.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:32.353+0000 7f325642d700 1 --2- 172.21.15.37:0/1485762455 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f32500fbcf0 0x7f32500fc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:32.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:32.353+0000 7f325642d700 1 -- 172.21.15.37:0/1485762455 >> 172.21.15.37:0/1485762455 conn(0x7f32500f7430 msgr2=0x7f32500f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:14:32.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:32.353+0000 7f325642d700 1 -- 172.21.15.37:0/1485762455 shutdown_connections 2024-04-25T17:14:32.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:32.353+0000 7f325642d700 1 -- 172.21.15.37:0/1485762455 wait complete. 2024-04-25T17:14:32.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:32.354+0000 7f325642d700 1 Processor -- start 2024-04-25T17:14:32.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:32.354+0000 7f325642d700 1 -- start start 2024-04-25T17:14:32.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:32.354+0000 7f325642d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32500fbcf0 0x7f325010d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:14:32.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:32.354+0000 7f325642d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f32500fcfa0 0x7f325010de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:14:32.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:32.354+0000 7f325642d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f325010e410 con 0x7f32500fbcf0 2024-04-25T17:14:32.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:32.354+0000 7f325642d700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f325010e580 con 0x7f32500fcfa0 2024-04-25T17:14:32.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:32.354+0000 7f324ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32500fbcf0 0x7f325010d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:14:32.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:32.354+0000 7f324ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32500fbcf0 0x7f325010d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50296/0 (socket says 172.21.15.37:50296) 2024-04-25T17:14:32.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:32.354+0000 7f324ffff700 1 -- 172.21.15.37:0/4208005669 learned_addr learned my addr 172.21.15.37:0/4208005669 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:14:32.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:32.354+0000 7f324f7fe700 1 --2- 172.21.15.37:0/4208005669 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f32500fcfa0 0x7f325010de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:14:32.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:32.355+0000 7f324ffff700 1 -- 172.21.15.37:0/4208005669 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f32500fcfa0 msgr2=0x7f325010de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:32.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:32.355+0000 7f324ffff700 1 --2- 172.21.15.37:0/4208005669 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f32500fcfa0 0x7f325010de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:32.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:32.355+0000 7f324ffff700 1 -- 172.21.15.37:0/4208005669 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3244005040 con 0x7f32500fbcf0 2024-04-25T17:14:32.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:32.355+0000 7f324ffff700 1 --2- 172.21.15.37:0/4208005669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32500fbcf0 0x7f325010d8d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f324000eb40 tx=0x7f324000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:14:32.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:32.355+0000 7f324cff9700 1 -- 172.21.15.37:0/4208005669 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3240007cc0 con 0x7f32500fbcf0 2024-04-25T17:14:32.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:32.355+0000 7f324cff9700 1 -- 172.21.15.37:0/4208005669 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f324000f040 con 0x7f32500fbcf0 2024-04-25T17:14:32.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:32.355+0000 7f325642d700 1 -- 172.21.15.37:0/4208005669 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3250112f30 con 0x7f32500fbcf0 2024-04-25T17:14:32.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:32.355+0000 7f324cff9700 1 -- 172.21.15.37:0/4208005669 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f324000ca10 con 0x7f32500fbcf0 2024-04-25T17:14:32.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:32.355+0000 7f325642d700 1 -- 172.21.15.37:0/4208005669 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32501133e0 con 0x7f32500fbcf0 2024-04-25T17:14:32.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:32.356+0000 7f325642d700 1 -- 172.21.15.37:0/4208005669 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3250101b30 con 0x7f32500fbcf0 2024-04-25T17:14:32.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:32.357+0000 7f324cff9700 1 -- 172.21.15.37:0/4208005669 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f324000cc80 con 0x7f32500fbcf0 2024-04-25T17:14:32.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:32.357+0000 7f324cff9700 1 --2- 172.21.15.37:0/4208005669 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f32380692a0 0x7f323806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:14:32.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:32.357+0000 7f324cff9700 1 -- 172.21.15.37:0/4208005669 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f3240086a10 con 0x7f32500fbcf0 2024-04-25T17:14:32.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:32.357+0000 7f324f7fe700 1 --2- 172.21.15.37:0/4208005669 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f32380692a0 0x7f323806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:14:32.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:32.358+0000 7f324f7fe700 1 --2- 172.21.15.37:0/4208005669 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f32380692a0 0x7f323806b750 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3244009b30 tx=0x7f3244009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:14:32.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:32.362+0000 7f324cff9700 1 -- 172.21.15.37:0/4208005669 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f324004e250 con 0x7f32500fbcf0 2024-04-25T17:14:32.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:32.635+0000 7f325642d700 1 -- 172.21.15.37:0/4208005669 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f325004c710 con 0x7f32500fbcf0 2024-04-25T17:14:32.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:32.638+0000 7f324cff9700 1 -- 172.21.15.37:0/4208005669 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v14) v1 ==== 170+0+59 (secure 0 0 0) 0x7f32400568b0 con 0x7f32500fbcf0 2024-04-25T17:14:32.638 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2024-04-25T17:14:32.638 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQB4jypmd8/rJRAAEXBVqQYO/BLKEv6ViMkIbg== 2024-04-25T17:14:32.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:32.640+0000 7f325642d700 1 -- 172.21.15.37:0/4208005669 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f32380692a0 msgr2=0x7f323806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:32.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:32.640+0000 7f325642d700 1 --2- 172.21.15.37:0/4208005669 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f32380692a0 0x7f323806b750 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3244009b30 tx=0x7f3244009e30 comp rx=0 tx=0).stop 2024-04-25T17:14:32.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:32.640+0000 7f325642d700 1 -- 172.21.15.37:0/4208005669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32500fbcf0 msgr2=0x7f325010d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:32.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:32.640+0000 7f325642d700 1 --2- 172.21.15.37:0/4208005669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32500fbcf0 0x7f325010d8d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f324000eb40 tx=0x7f324000b040 comp rx=0 tx=0).stop 2024-04-25T17:14:32.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:32.640+0000 7f325642d700 1 -- 172.21.15.37:0/4208005669 shutdown_connections 2024-04-25T17:14:32.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:32.641+0000 7f325642d700 1 --2- 172.21.15.37:0/4208005669 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f32380692a0 0x7f323806b750 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:32.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:32.641+0000 7f325642d700 1 --2- 172.21.15.37:0/4208005669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32500fbcf0 0x7f325010d8d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:32.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:32.641+0000 7f325642d700 1 --2- 172.21.15.37:0/4208005669 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f32500fcfa0 0x7f325010de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:32.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:32.641+0000 7f325642d700 1 -- 172.21.15.37:0/4208005669 >> 172.21.15.37:0/4208005669 conn(0x7f32500f7430 msgr2=0x7f32500f8a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:14:32.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:32.641+0000 7f325642d700 1 -- 172.21.15.37:0/4208005669 shutdown_connections 2024-04-25T17:14:32.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:32.641+0000 7f325642d700 1 -- 172.21.15.37:0/4208005669 wait complete. 2024-04-25T17:14:32.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:32 smithi037 ceph-mon[26472]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:14:32.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:32 smithi069 ceph-mon[34527]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:14:33.274 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-25T17:14:33.274 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-04-25T17:14:33.274 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-25T17:14:33.315 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-04-25T17:14:33.579 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi069/config 2024-04-25T17:14:33.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:33 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/4208005669' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-25T17:14:33.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:33 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/4208005669' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-25T17:14:33.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:33 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/4208005669' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-25T17:14:33.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:33 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/4208005669' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-25T17:14:34.865 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:34 smithi069 ceph-mon[34527]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:14:35.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:14:35.070+0000 7f3a23906700 1 -- 172.21.15.69:0/904396338 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3a1c0fe410 msgr2=0x7f3a1c0fe820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:35.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:14:35.070+0000 7f3a23906700 1 --2- 172.21.15.69:0/904396338 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3a1c0fe410 0x7f3a1c0fe820 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3a18004940 tx=0x7f3a18009e30 comp rx=0 tx=0).stop 2024-04-25T17:14:35.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:14:35.070+0000 7f3a23906700 1 -- 172.21.15.69:0/904396338 shutdown_connections 2024-04-25T17:14:35.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:14:35.070+0000 7f3a23906700 1 --2- 172.21.15.69:0/904396338 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a1c0fed60 0x7f3a1c0faea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:35.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:14:35.070+0000 7f3a23906700 1 --2- 172.21.15.69:0/904396338 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3a1c0fe410 0x7f3a1c0fe820 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:35.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:14:35.070+0000 7f3a23906700 1 -- 172.21.15.69:0/904396338 >> 172.21.15.69:0/904396338 conn(0x7f3a1c0f6bb0 msgr2=0x7f3a1c0f8fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:14:35.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:14:35.070+0000 7f3a23906700 1 -- 172.21.15.69:0/904396338 shutdown_connections 2024-04-25T17:14:35.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:14:35.070+0000 7f3a23906700 1 -- 172.21.15.69:0/904396338 wait complete. 2024-04-25T17:14:35.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:14:35.071+0000 7f3a23906700 1 Processor -- start 2024-04-25T17:14:35.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:14:35.071+0000 7f3a23906700 1 -- start start 2024-04-25T17:14:35.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:14:35.071+0000 7f3a23906700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3a1c0fe410 0x7f3a1c10d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:14:35.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:14:35.071+0000 7f3a23906700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a1c0fed60 0x7f3a1c10deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:14:35.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:14:35.071+0000 7f3a23906700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c10e540 con 0x7f3a1c0fed60 2024-04-25T17:14:35.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:14:35.071+0000 7f3a23906700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c112e20 con 0x7f3a1c0fe410 2024-04-25T17:14:35.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:14:35.071+0000 7f3a216a2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3a1c0fe410 0x7f3a1c10d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:14:35.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:14:35.071+0000 7f3a216a2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3a1c0fe410 0x7f3a1c10d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52124/0 (socket says 172.21.15.69:52124) 2024-04-25T17:14:35.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:14:35.071+0000 7f3a216a2700 1 -- 172.21.15.69:0/3839751589 learned_addr learned my addr 172.21.15.69:0/3839751589 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-04-25T17:14:35.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:14:35.071+0000 7f3a20ea1700 1 --2- 172.21.15.69:0/3839751589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a1c0fed60 0x7f3a1c10deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:14:35.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:14:35.071+0000 7f3a216a2700 1 -- 172.21.15.69:0/3839751589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a1c0fed60 msgr2=0x7f3a1c10deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:35.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:14:35.071+0000 7f3a216a2700 1 --2- 172.21.15.69:0/3839751589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a1c0fed60 0x7f3a1c10deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:35.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:14:35.071+0000 7f3a216a2700 1 -- 172.21.15.69:0/3839751589 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a18005040 con 0x7f3a1c0fe410 2024-04-25T17:14:35.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:14:35.071+0000 7f3a20ea1700 1 --2- 172.21.15.69:0/3839751589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a1c0fed60 0x7f3a1c10deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T17:14:35.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:14:35.072+0000 7f3a216a2700 1 --2- 172.21.15.69:0/3839751589 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3a1c0fe410 0x7f3a1c10d970 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3a18009150 tx=0x7f3a18009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:14:35.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:14:35.072+0000 7f3a11ffb700 1 -- 172.21.15.69:0/3839751589 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a1800e040 con 0x7f3a1c0fe410 2024-04-25T17:14:35.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:14:35.072+0000 7f3a11ffb700 1 -- 172.21.15.69:0/3839751589 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3a1800bbf0 con 0x7f3a1c0fe410 2024-04-25T17:14:35.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:14:35.072+0000 7f3a23906700 1 -- 172.21.15.69:0/3839751589 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a1c113020 con 0x7f3a1c0fe410 2024-04-25T17:14:35.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:14:35.072+0000 7f3a11ffb700 1 -- 172.21.15.69:0/3839751589 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a1801c630 con 0x7f3a1c0fe410 2024-04-25T17:14:35.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:14:35.072+0000 7f3a23906700 1 -- 172.21.15.69:0/3839751589 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a1c113590 con 0x7f3a1c0fe410 2024-04-25T17:14:35.075 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:34 smithi037 ceph-mon[26472]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:14:35.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:14:35.073+0000 7f3a23906700 1 -- 172.21.15.69:0/3839751589 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a1c04c710 con 0x7f3a1c0fe410 2024-04-25T17:14:35.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:14:35.073+0000 7f3a11ffb700 1 -- 172.21.15.69:0/3839751589 <== mon.1 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f3a1800bd60 con 0x7f3a1c0fe410 2024-04-25T17:14:35.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:14:35.074+0000 7f3a11ffb700 1 --2- 172.21.15.69:0/3839751589 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f3a080692b0 0x7f3a0806b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:14:35.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:14:35.074+0000 7f3a11ffb700 1 -- 172.21.15.69:0/3839751589 <== mon.1 v2:172.21.15.69:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f3a180882b0 con 0x7f3a1c0fe410 2024-04-25T17:14:35.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:14:35.074+0000 7f3a20ea1700 1 --2- 172.21.15.69:0/3839751589 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f3a080692b0 0x7f3a0806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:14:35.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:14:35.074+0000 7f3a20ea1700 1 --2- 172.21.15.69:0/3839751589 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f3a080692b0 0x7f3a0806b760 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c009b10 tx=0x7f3a0c008040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:14:35.078 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:14:35.078+0000 7f3a11ffb700 1 -- 172.21.15.69:0/3839751589 <== mon.1 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f3a18058460 con 0x7f3a1c0fe410 2024-04-25T17:14:35.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:14:35.337+0000 7f3a23906700 1 -- 172.21.15.69:0/3839751589 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f3a1c105940 con 0x7f3a1c0fe410 2024-04-25T17:14:35.342 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:14:35.342+0000 7f3a11ffb700 1 -- 172.21.15.69:0/3839751589 <== mon.1 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v15) v1 ==== 170+0+59 (secure 0 0 0) 0x7f3a18057ff0 con 0x7f3a1c0fe410 2024-04-25T17:14:35.343 INFO:teuthology.orchestra.run.smithi069.stdout:[client.1] 2024-04-25T17:14:35.343 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQB7jypmlDg9FBAARqnYzBIvBiGsu4WJAt/0Gw== 2024-04-25T17:14:35.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:14:35.345+0000 7f3a23906700 1 -- 172.21.15.69:0/3839751589 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f3a080692b0 msgr2=0x7f3a0806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:35.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:14:35.345+0000 7f3a23906700 1 --2- 172.21.15.69:0/3839751589 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f3a080692b0 0x7f3a0806b760 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c009b10 tx=0x7f3a0c008040 comp rx=0 tx=0).stop 2024-04-25T17:14:35.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:14:35.345+0000 7f3a23906700 1 -- 172.21.15.69:0/3839751589 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3a1c0fe410 msgr2=0x7f3a1c10d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:35.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:14:35.345+0000 7f3a23906700 1 --2- 172.21.15.69:0/3839751589 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3a1c0fe410 0x7f3a1c10d970 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3a18009150 tx=0x7f3a18009e30 comp rx=0 tx=0).stop 2024-04-25T17:14:35.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:14:35.345+0000 7f3a23906700 1 -- 172.21.15.69:0/3839751589 shutdown_connections 2024-04-25T17:14:35.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:14:35.345+0000 7f3a23906700 1 --2- 172.21.15.69:0/3839751589 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f3a080692b0 0x7f3a0806b760 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:35.346 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:14:35.345+0000 7f3a23906700 1 --2- 172.21.15.69:0/3839751589 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3a1c0fe410 0x7f3a1c10d970 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:35.346 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:14:35.345+0000 7f3a23906700 1 --2- 172.21.15.69:0/3839751589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3a1c0fed60 0x7f3a1c10deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:35.346 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:14:35.345+0000 7f3a23906700 1 -- 172.21.15.69:0/3839751589 >> 172.21.15.69:0/3839751589 conn(0x7f3a1c0f6bb0 msgr2=0x7f3a1c0f8200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:14:35.346 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:14:35.345+0000 7f3a23906700 1 -- 172.21.15.69:0/3839751589 shutdown_connections 2024-04-25T17:14:35.346 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:14:35.345+0000 7f3a23906700 1 -- 172.21.15.69:0/3839751589 wait complete. 2024-04-25T17:14:35.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:35 smithi069 ceph-mon[34527]: from='client.? 172.21.15.69:0/3839751589' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-25T17:14:35.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:35 smithi069 ceph-mon[34527]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-25T17:14:35.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:35 smithi069 ceph-mon[34527]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-25T17:14:35.953 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-04-25T17:14:35.953 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-04-25T17:14:35.953 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-25T17:14:35.989 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-25T17:14:35.989 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-04-25T17:14:35.989 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph mgr dump --format=json 2024-04-25T17:14:36.015 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:35 smithi037 ceph-mon[26472]: from='client.? 172.21.15.69:0/3839751589' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-25T17:14:36.015 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:35 smithi037 ceph-mon[26472]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-04-25T17:14:36.015 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:35 smithi037 ceph-mon[26472]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-04-25T17:14:36.266 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:14:36.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:36 smithi069 ceph-mon[34527]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:14:37.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:36 smithi037 ceph-mon[26472]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:14:37.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:37.931+0000 7f0b881a2700 1 -- 172.21.15.37:0/529223103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b80102de0 msgr2=0x7f0b801031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:37.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:37.931+0000 7f0b881a2700 1 --2- 172.21.15.37:0/529223103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b80102de0 0x7f0b801031b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0b78009ce0 tx=0x7f0b78004d10 comp rx=0 tx=0).stop 2024-04-25T17:14:37.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:37.931+0000 7f0b881a2700 1 -- 172.21.15.37:0/529223103 shutdown_connections 2024-04-25T17:14:37.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:37.931+0000 7f0b881a2700 1 --2- 172.21.15.37:0/529223103 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0b80103780 0x7f0b800fcdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:37.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:37.931+0000 7f0b881a2700 1 --2- 172.21.15.37:0/529223103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b80102de0 0x7f0b801031b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:37.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:37.931+0000 7f0b881a2700 1 -- 172.21.15.37:0/529223103 >> 172.21.15.37:0/529223103 conn(0x7f0b800f8990 msgr2=0x7f0b800fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:14:37.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:37.932+0000 7f0b881a2700 1 -- 172.21.15.37:0/529223103 shutdown_connections 2024-04-25T17:14:37.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:37.932+0000 7f0b881a2700 1 -- 172.21.15.37:0/529223103 wait complete. 2024-04-25T17:14:37.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:37.932+0000 7f0b881a2700 1 Processor -- start 2024-04-25T17:14:37.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:37.932+0000 7f0b881a2700 1 -- start start 2024-04-25T17:14:37.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:37.932+0000 7f0b881a2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b80102de0 0x7f0b80115ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:14:37.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:37.932+0000 7f0b881a2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0b80103780 0x7f0b801161e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:14:37.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:37.932+0000 7f0b881a2700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b801168c0 con 0x7f0b80102de0 2024-04-25T17:14:37.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:37.932+0000 7f0b881a2700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8010fe10 con 0x7f0b80103780 2024-04-25T17:14:37.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:37.933+0000 7f0b85f3e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b80102de0 0x7f0b80115ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:14:37.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:37.933+0000 7f0b85f3e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b80102de0 0x7f0b80115ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50684/0 (socket says 172.21.15.37:50684) 2024-04-25T17:14:37.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:37.933+0000 7f0b85f3e700 1 -- 172.21.15.37:0/976938334 learned_addr learned my addr 172.21.15.37:0/976938334 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:14:37.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:37.933+0000 7f0b8573d700 1 --2- 172.21.15.37:0/976938334 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0b80103780 0x7f0b801161e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:14:37.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:37.933+0000 7f0b85f3e700 1 -- 172.21.15.37:0/976938334 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0b80103780 msgr2=0x7f0b801161e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:37.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:37.933+0000 7f0b85f3e700 1 --2- 172.21.15.37:0/976938334 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0b80103780 0x7f0b801161e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:37.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:37.933+0000 7f0b85f3e700 1 -- 172.21.15.37:0/976938334 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b78009940 con 0x7f0b80102de0 2024-04-25T17:14:37.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:37.933+0000 7f0b85f3e700 1 --2- 172.21.15.37:0/976938334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b80102de0 0x7f0b80115ca0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0b7800be90 tx=0x7f0b78004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:14:37.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:37.933+0000 7f0b7e7fc700 1 -- 172.21.15.37:0/976938334 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b7800e040 con 0x7f0b80102de0 2024-04-25T17:14:37.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:37.933+0000 7f0b881a2700 1 -- 172.21.15.37:0/976938334 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b80110030 con 0x7f0b80102de0 2024-04-25T17:14:37.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:37.933+0000 7f0b7e7fc700 1 -- 172.21.15.37:0/976938334 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0b78004610 con 0x7f0b80102de0 2024-04-25T17:14:37.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:37.933+0000 7f0b7e7fc700 1 -- 172.21.15.37:0/976938334 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b7801c6d0 con 0x7f0b80102de0 2024-04-25T17:14:37.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:37.933+0000 7f0b881a2700 1 -- 172.21.15.37:0/976938334 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b801105f0 con 0x7f0b80102de0 2024-04-25T17:14:37.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:37.934+0000 7f0b881a2700 1 -- 172.21.15.37:0/976938334 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b801069e0 con 0x7f0b80102de0 2024-04-25T17:14:37.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:37.935+0000 7f0b7e7fc700 1 -- 172.21.15.37:0/976938334 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f0b78012b00 con 0x7f0b80102de0 2024-04-25T17:14:37.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:37.935+0000 7f0b7e7fc700 1 --2- 172.21.15.37:0/976938334 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f0b680692a0 0x7f0b6806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:14:37.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:37.935+0000 7f0b7e7fc700 1 -- 172.21.15.37:0/976938334 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f0b780889e0 con 0x7f0b80102de0 2024-04-25T17:14:37.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:37.935+0000 7f0b8573d700 1 --2- 172.21.15.37:0/976938334 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f0b680692a0 0x7f0b6806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:14:37.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:37.936+0000 7f0b8573d700 1 --2- 172.21.15.37:0/976938334 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f0b680692a0 0x7f0b6806b750 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0b80111540 tx=0x7f0b740091a0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:14:37.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:37.940+0000 7f0b7e7fc700 1 -- 172.21.15.37:0/976938334 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f0b780589c0 con 0x7f0b80102de0 2024-04-25T17:14:38.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:38.189+0000 7f0b881a2700 1 -- 172.21.15.37:0/976938334 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f0b80109f50 con 0x7f0b80102de0 2024-04-25T17:14:38.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:38.192+0000 7f0b7e7fc700 1 -- 172.21.15.37:0/976938334 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+167178 (secure 0 0 0) 0x7f0b78004e10 con 0x7f0b80102de0 2024-04-25T17:14:38.195 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:14:38.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:38.195+0000 7f0b881a2700 1 -- 172.21.15.37:0/976938334 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f0b680692a0 msgr2=0x7f0b6806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:38.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:38.195+0000 7f0b881a2700 1 --2- 172.21.15.37:0/976938334 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f0b680692a0 0x7f0b6806b750 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0b80111540 tx=0x7f0b740091a0 comp rx=0 tx=0).stop 2024-04-25T17:14:38.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:38.195+0000 7f0b881a2700 1 -- 172.21.15.37:0/976938334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b80102de0 msgr2=0x7f0b80115ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:38.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:38.195+0000 7f0b881a2700 1 --2- 172.21.15.37:0/976938334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b80102de0 0x7f0b80115ca0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0b7800be90 tx=0x7f0b78004d10 comp rx=0 tx=0).stop 2024-04-25T17:14:38.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:38.195+0000 7f0b881a2700 1 -- 172.21.15.37:0/976938334 shutdown_connections 2024-04-25T17:14:38.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:38.195+0000 7f0b881a2700 1 --2- 172.21.15.37:0/976938334 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f0b680692a0 0x7f0b6806b750 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:38.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:38.195+0000 7f0b881a2700 1 --2- 172.21.15.37:0/976938334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b80102de0 0x7f0b80115ca0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:38.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:38.195+0000 7f0b881a2700 1 --2- 172.21.15.37:0/976938334 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0b80103780 0x7f0b801161e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:38.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:38.195+0000 7f0b881a2700 1 -- 172.21.15.37:0/976938334 >> 172.21.15.37:0/976938334 conn(0x7f0b800f8990 msgr2=0x7f0b800fa470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:14:38.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:38.195+0000 7f0b881a2700 1 -- 172.21.15.37:0/976938334 shutdown_connections 2024-04-25T17:14:38.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:38.195+0000 7f0b881a2700 1 -- 172.21.15.37:0/976938334 wait complete. 2024-04-25T17:14:38.781 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:38 smithi037 ceph-mon[26472]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:14:38.781 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:38 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/976938334' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-25T17:14:38.808 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":19,"flags":0,"active_gid":14214,"active_name":"smithi037.txrgxl","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":3566135606},{"type":"v1","addr":"172.21.15.37:6801","nonce":3566135606}]},"active_addr":"172.21.15.37:6801/3566135606","active_change":"2024-04-25T17:10:55.431845+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":14236,"name":"smithi069.mmuhdo","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.37:8443/","prometheus":"http://172.21.15.37:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":767276846}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":2176923815}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":4179549689}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.37:0","nonce":2627363304}]}]} 2024-04-25T17:14:38.812 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-04-25T17:14:38.812 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-04-25T17:14:38.812 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-25T17:14:38.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:38 smithi069 ceph-mon[34527]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:14:38.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:38 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/976938334' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-04-25T17:14:39.117 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:14:40.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:40.624+0000 7fd861ef2700 1 -- 172.21.15.37:0/769925598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd85c102de0 msgr2=0x7fd85c1031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:40.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:40.624+0000 7fd861ef2700 1 --2- 172.21.15.37:0/769925598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd85c102de0 0x7fd85c1031b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd84c004940 tx=0x7fd84c009e30 comp rx=0 tx=0).stop 2024-04-25T17:14:40.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:40.624+0000 7fd861ef2700 1 -- 172.21.15.37:0/769925598 shutdown_connections 2024-04-25T17:14:40.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:40.624+0000 7fd861ef2700 1 --2- 172.21.15.37:0/769925598 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd85c103780 0x7fd85c0fcdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:40.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:40.624+0000 7fd861ef2700 1 --2- 172.21.15.37:0/769925598 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd85c102de0 0x7fd85c1031b0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:40.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:40.624+0000 7fd861ef2700 1 -- 172.21.15.37:0/769925598 >> 172.21.15.37:0/769925598 conn(0x7fd85c0f8990 msgr2=0x7fd85c0fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:14:40.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:40.624+0000 7fd861ef2700 1 -- 172.21.15.37:0/769925598 shutdown_connections 2024-04-25T17:14:40.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:40.624+0000 7fd861ef2700 1 -- 172.21.15.37:0/769925598 wait complete. 2024-04-25T17:14:40.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:40.625+0000 7fd861ef2700 1 Processor -- start 2024-04-25T17:14:40.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:40.625+0000 7fd861ef2700 1 -- start start 2024-04-25T17:14:40.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:40.625+0000 7fd861ef2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd85c102de0 0x7fd85c113990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:14:40.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:40.625+0000 7fd861ef2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd85c103780 0x7fd85c113ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:14:40.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:40.625+0000 7fd861ef2700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd85c114520 con 0x7fd85c103780 2024-04-25T17:14:40.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:40.625+0000 7fd861ef2700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd85c10db70 con 0x7fd85c102de0 2024-04-25T17:14:40.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:40.625+0000 7fd85affd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd85c103780 0x7fd85c113ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:14:40.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:40.625+0000 7fd85affd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd85c103780 0x7fd85c113ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50692/0 (socket says 172.21.15.37:50692) 2024-04-25T17:14:40.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:40.625+0000 7fd85affd700 1 -- 172.21.15.37:0/448638977 learned_addr learned my addr 172.21.15.37:0/448638977 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:14:40.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:40.626+0000 7fd85affd700 1 -- 172.21.15.37:0/448638977 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd85c102de0 msgr2=0x7fd85c113990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:40.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:40.626+0000 7fd85affd700 1 --2- 172.21.15.37:0/448638977 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd85c102de0 0x7fd85c113990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:40.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:40.626+0000 7fd85affd700 1 -- 172.21.15.37:0/448638977 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd84c005040 con 0x7fd85c103780 2024-04-25T17:14:40.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:40.626+0000 7fd85affd700 1 --2- 172.21.15.37:0/448638977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd85c103780 0x7fd85c113ed0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd850002a80 tx=0x7fd850004630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:14:40.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:40.626+0000 7fd843fff700 1 -- 172.21.15.37:0/448638977 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd850007cc0 con 0x7fd85c103780 2024-04-25T17:14:40.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:40.626+0000 7fd861ef2700 1 -- 172.21.15.37:0/448638977 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd85c10de50 con 0x7fd85c103780 2024-04-25T17:14:40.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:40.626+0000 7fd843fff700 1 -- 172.21.15.37:0/448638977 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd85000f040 con 0x7fd85c103780 2024-04-25T17:14:40.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:40.626+0000 7fd843fff700 1 -- 172.21.15.37:0/448638977 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd85000daf0 con 0x7fd85c103780 2024-04-25T17:14:40.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:40.626+0000 7fd861ef2700 1 -- 172.21.15.37:0/448638977 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd85c10e410 con 0x7fd85c103780 2024-04-25T17:14:40.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:40.627+0000 7fd861ef2700 1 -- 172.21.15.37:0/448638977 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd85c1000f0 con 0x7fd85c103780 2024-04-25T17:14:40.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:40.628+0000 7fd843fff700 1 -- 172.21.15.37:0/448638977 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fd85000dc90 con 0x7fd85c103780 2024-04-25T17:14:40.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:40.628+0000 7fd843fff700 1 --2- 172.21.15.37:0/448638977 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fd8440692a0 0x7fd84406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:14:40.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:40.628+0000 7fd843fff700 1 -- 172.21.15.37:0/448638977 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fd850086580 con 0x7fd85c103780 2024-04-25T17:14:40.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:40.628+0000 7fd85b7fe700 1 --2- 172.21.15.37:0/448638977 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fd8440692a0 0x7fd84406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:14:40.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:40.628+0000 7fd85b7fe700 1 --2- 172.21.15.37:0/448638977 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fd8440692a0 0x7fd84406b750 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd84c004f90 tx=0x7fd84c009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:14:40.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:40.632+0000 7fd843fff700 1 -- 172.21.15.37:0/448638977 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fd85004d250 con 0x7fd85c103780 2024-04-25T17:14:40.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:40.829+0000 7fd861ef2700 1 -- 172.21.15.37:0/448638977 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd85c10efe0 con 0x7fd85c103780 2024-04-25T17:14:40.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:40.829+0000 7fd843fff700 1 -- 172.21.15.37:0/448638977 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11024 (secure 0 0 0) 0x7fd850056600 con 0x7fd85c103780 2024-04-25T17:14:40.830 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:14:40.830 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":41,"fsid":"599bb7fc-0326-11ef-bc93-c7b262605968","created":"2024-04-25T17:08:37.882631+0000","modified":"2024-04-25T17:14:21.343451+0000","last_up_change":"2024-04-25T17:14:20.333710+0000","last_in_change":"2024-04-25T17:14:01.927070+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T17:13:09.960202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"c142de25-7aff-4c4b-b351-14e7b18de11d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2457908683},{"type":"v1","addr":"172.21.15.37:6803","nonce":2457908683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2457908683},{"type":"v1","addr":"172.21.15.37:6805","nonce":2457908683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2457908683},{"type":"v1","addr":"172.21.15.37:6809","nonce":2457908683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2457908683},{"type":"v1","addr":"172.21.15.37:6807","nonce":2457908683}]},"public_addr":"172.21.15.37:6803/2457908683","cluster_addr":"172.21.15.37:6805/2457908683","heartbeat_back_addr":"172.21.15.37:6809/2457908683","heartbeat_front_addr":"172.21.15.37:6807/2457908683","state":["exists","up"]},{"osd":1,"uuid":"ec683da0-f3c1-44b5-8f1d-69bec27fbe5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":24763193},{"type":"v1","addr":"172.21.15.37:6811","nonce":24763193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":24763193},{"type":"v1","addr":"172.21.15.37:6813","nonce":24763193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":24763193},{"type":"v1","addr":"172.21.15.37:6817","nonce":24763193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":24763193},{"type":"v1","addr":"172.21.15.37:6815","nonce":24763193}]},"public_addr":"172.21.15.37:6811/24763193","cluster_addr":"172.21.15.37:6813/24763193","heartbeat_back_addr":"172.21.15.37:6817/24763193","heartbeat_front_addr":"172.21.15.37:6815/24763193","state":["exists","up"]},{"osd":2,"uuid":"8bf4e67b-e95f-44d3-b51f-afd8a2d30e31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":596257416},{"type":"v1","addr":"172.21.15.37:6819","nonce":596257416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":596257416},{"type":"v1","addr":"172.21.15.37:6821","nonce":596257416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":596257416},{"type":"v1","addr":"172.21.15.37:6825","nonce":596257416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":596257416},{"type":"v1","addr":"172.21.15.37:6823","nonce":596257416}]},"public_addr":"172.21.15.37:6819/596257416","cluster_addr":"172.21.15.37:6821/596257416","heartbeat_back_addr":"172.21.15.37:6825/596257416","heartbeat_front_addr":"172.21.15.37:6823/596257416","state":["exists","up"]},{"osd":3,"uuid":"ce5ff1f7-472a-4515-b851-e434ee545b27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":3815031427},{"type":"v1","addr":"172.21.15.69:6801","nonce":3815031427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3815031427},{"type":"v1","addr":"172.21.15.69:6803","nonce":3815031427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3815031427},{"type":"v1","addr":"172.21.15.69:6807","nonce":3815031427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3815031427},{"type":"v1","addr":"172.21.15.69:6805","nonce":3815031427}]},"public_addr":"172.21.15.69:6801/3815031427","cluster_addr":"172.21.15.69:6803/3815031427","heartbeat_back_addr":"172.21.15.69:6807/3815031427","heartbeat_front_addr":"172.21.15.69:6805/3815031427","state":["exists","up"]},{"osd":4,"uuid":"26cf2aeb-fc85-4d14-b936-08b8280489e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":2571772778},{"type":"v1","addr":"172.21.15.69:6809","nonce":2571772778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":2571772778},{"type":"v1","addr":"172.21.15.69:6811","nonce":2571772778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":2571772778},{"type":"v1","addr":"172.21.15.69:6815","nonce":2571772778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":2571772778},{"type":"v1","addr":"172.21.15.69:6813","nonce":2571772778}]},"public_addr":"172.21.15.69:6809/2571772778","cluster_addr":"172.21.15.69:6811/2571772778","heartbeat_back_addr":"172.21.15.69:6815/2571772778","heartbeat_front_addr":"172.21.15.69:6813/2571772778","state":["exists","up"]},{"osd":5,"uuid":"fb3edb82-8f78-40d6-a339-5c469ef08371","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":2319222775},{"type":"v1","addr":"172.21.15.69:6817","nonce":2319222775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":2319222775},{"type":"v1","addr":"172.21.15.69:6819","nonce":2319222775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":2319222775},{"type":"v1","addr":"172.21.15.69:6823","nonce":2319222775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":2319222775},{"type":"v1","addr":"172.21.15.69:6821","nonce":2319222775}]},"public_addr":"172.21.15.69:6817/2319222775","cluster_addr":"172.21.15.69:6819/2319222775","heartbeat_back_addr":"172.21.15.69:6823/2319222775","heartbeat_front_addr":"172.21.15.69:6821/2319222775","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T17:12:12.145795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T17:12:39.059274+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T17:13:06.628770+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T17:13:29.779894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T17:13:54.338391+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T17:14:18.637188+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:0/4258551295":"2024-04-26T17:10:55.431694+0000","172.21.15.37:6801/1299348474":"2024-04-26T17:10:55.431694+0000","172.21.15.37:0/350553669":"2024-04-26T17:10:55.431694+0000","172.21.15.37:6801/3653320894":"2024-04-26T17:09:39.480662+0000","172.21.15.37:0/3689680514":"2024-04-26T17:09:39.480662+0000","172.21.15.37:0/1135030866":"2024-04-26T17:09:39.480662+0000","172.21.15.37:6800/2509847167":"2024-04-26T17:09:09.103933+0000","172.21.15.37:6800/3653320894":"2024-04-26T17:09:39.480662+0000","172.21.15.37:0/2586714806":"2024-04-26T17:09:09.103933+0000","172.21.15.37:6800/1299348474":"2024-04-26T17:10:55.431694+0000","172.21.15.37:0/3277643196":"2024-04-26T17:09:09.103933+0000","172.21.15.37:0/1487666224":"2024-04-26T17:09:09.103933+0000","172.21.15.37:6801/2509847167":"2024-04-26T17:09:09.103933+0000","172.21.15.37:0/1749794583":"2024-04-26T17:10:55.431694+0000","172.21.15.37:0/3089604872":"2024-04-26T17:09:39.480662+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T17:14:40.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:40.831+0000 7fd861ef2700 1 -- 172.21.15.37:0/448638977 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fd8440692a0 msgr2=0x7fd84406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:40.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:40.831+0000 7fd861ef2700 1 --2- 172.21.15.37:0/448638977 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fd8440692a0 0x7fd84406b750 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd84c004f90 tx=0x7fd84c009e30 comp rx=0 tx=0).stop 2024-04-25T17:14:40.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:40.831+0000 7fd861ef2700 1 -- 172.21.15.37:0/448638977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd85c103780 msgr2=0x7fd85c113ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:40.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:40.831+0000 7fd861ef2700 1 --2- 172.21.15.37:0/448638977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd85c103780 0x7fd85c113ed0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd850002a80 tx=0x7fd850004630 comp rx=0 tx=0).stop 2024-04-25T17:14:40.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:40.831+0000 7fd861ef2700 1 -- 172.21.15.37:0/448638977 shutdown_connections 2024-04-25T17:14:40.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:40.831+0000 7fd861ef2700 1 --2- 172.21.15.37:0/448638977 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fd8440692a0 0x7fd84406b750 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:40.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:40.831+0000 7fd861ef2700 1 --2- 172.21.15.37:0/448638977 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd85c102de0 0x7fd85c113990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:40.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:40.831+0000 7fd861ef2700 1 --2- 172.21.15.37:0/448638977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd85c103780 0x7fd85c113ed0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:40.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:40.831+0000 7fd861ef2700 1 -- 172.21.15.37:0/448638977 >> 172.21.15.37:0/448638977 conn(0x7fd85c0f8990 msgr2=0x7fd85c107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:14:40.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:40.832+0000 7fd861ef2700 1 -- 172.21.15.37:0/448638977 shutdown_connections 2024-04-25T17:14:40.832 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:40.832+0000 7fd861ef2700 1 -- 172.21.15.37:0/448638977 wait complete. 2024-04-25T17:14:40.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:40 smithi069 ceph-mon[34527]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:14:40.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:40 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:14:41.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:40 smithi037 ceph-mon[26472]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:14:41.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:40 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:14:41.593 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-04-25T17:14:41.593 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph osd dump --format=json 2024-04-25T17:14:41.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:41 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/448638977' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T17:14:41.864 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:14:41.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:41 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/448638977' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T17:14:42.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:42 smithi069 ceph-mon[34527]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:14:42.961 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:42 smithi037 ceph-mon[26472]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:14:43.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:43.466+0000 7f5678c64700 1 -- 172.21.15.37:0/3467799306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5674102de0 msgr2=0x7f56741031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:43.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:43.466+0000 7f5678c64700 1 --2- 172.21.15.37:0/3467799306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5674102de0 0x7f56741031b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5664004940 tx=0x7f5664009e30 comp rx=0 tx=0).stop 2024-04-25T17:14:43.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:43.466+0000 7f5678c64700 1 -- 172.21.15.37:0/3467799306 shutdown_connections 2024-04-25T17:14:43.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:43.466+0000 7f5678c64700 1 --2- 172.21.15.37:0/3467799306 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5674103780 0x7f56740fcdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:43.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:43.466+0000 7f5678c64700 1 --2- 172.21.15.37:0/3467799306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5674102de0 0x7f56741031b0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:43.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:43.466+0000 7f5678c64700 1 -- 172.21.15.37:0/3467799306 >> 172.21.15.37:0/3467799306 conn(0x7f56740f8990 msgr2=0x7f56740fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:14:43.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:43.466+0000 7f5678c64700 1 -- 172.21.15.37:0/3467799306 shutdown_connections 2024-04-25T17:14:43.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:43.467+0000 7f5678c64700 1 -- 172.21.15.37:0/3467799306 wait complete. 2024-04-25T17:14:43.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:43.467+0000 7f5678c64700 1 Processor -- start 2024-04-25T17:14:43.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:43.467+0000 7f5678c64700 1 -- start start 2024-04-25T17:14:43.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:43.467+0000 7f5678c64700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5674102de0 0x7f5674070260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:14:43.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:43.467+0000 7f5678c64700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5674103780 0x7f56740707a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:14:43.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:43.467+0000 7f5678c64700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5674072240 con 0x7f5674102de0 2024-04-25T17:14:43.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:43.467+0000 7f5678c64700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5674070ce0 con 0x7f5674103780 2024-04-25T17:14:43.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:43.467+0000 7f567259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5674102de0 0x7f5674070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:14:43.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:43.467+0000 7f567259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5674102de0 0x7f5674070260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50714/0 (socket says 172.21.15.37:50714) 2024-04-25T17:14:43.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:43.467+0000 7f567259c700 1 -- 172.21.15.37:0/356372976 learned_addr learned my addr 172.21.15.37:0/356372976 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:14:43.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:43.468+0000 7f5671d9b700 1 --2- 172.21.15.37:0/356372976 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5674103780 0x7f56740707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:14:43.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:43.468+0000 7f567259c700 1 -- 172.21.15.37:0/356372976 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5674103780 msgr2=0x7f56740707a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:43.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:43.468+0000 7f567259c700 1 --2- 172.21.15.37:0/356372976 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5674103780 0x7f56740707a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:43.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:43.468+0000 7f567259c700 1 -- 172.21.15.37:0/356372976 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5664005040 con 0x7f5674102de0 2024-04-25T17:14:43.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:43.468+0000 7f5671d9b700 1 --2- 172.21.15.37:0/356372976 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5674103780 0x7f56740707a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T17:14:43.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:43.468+0000 7f567259c700 1 --2- 172.21.15.37:0/356372976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5674102de0 0x7f5674070260 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f566400b8b0 tx=0x7f5664009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:14:43.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:43.468+0000 7f5662ffd700 1 -- 172.21.15.37:0/356372976 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f566400e040 con 0x7f5674102de0 2024-04-25T17:14:43.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:43.468+0000 7f5678c64700 1 -- 172.21.15.37:0/356372976 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5674070f60 con 0x7f5674102de0 2024-04-25T17:14:43.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:43.468+0000 7f5662ffd700 1 -- 172.21.15.37:0/356372976 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5664004290 con 0x7f5674102de0 2024-04-25T17:14:43.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:43.468+0000 7f5662ffd700 1 -- 172.21.15.37:0/356372976 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f566401c3f0 con 0x7f5674102de0 2024-04-25T17:14:43.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:43.468+0000 7f5678c64700 1 -- 172.21.15.37:0/356372976 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f567411a130 con 0x7f5674102de0 2024-04-25T17:14:43.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:43.469+0000 7f5678c64700 1 -- 172.21.15.37:0/356372976 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56741000f0 con 0x7f5674102de0 2024-04-25T17:14:43.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:43.470+0000 7f5662ffd700 1 -- 172.21.15.37:0/356372976 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f56640137b0 con 0x7f5674102de0 2024-04-25T17:14:43.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:43.470+0000 7f5662ffd700 1 --2- 172.21.15.37:0/356372976 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f565c0692a0 0x7f565c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:14:43.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:43.470+0000 7f5662ffd700 1 -- 172.21.15.37:0/356372976 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f56640880d0 con 0x7f5674102de0 2024-04-25T17:14:43.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:43.470+0000 7f5671d9b700 1 --2- 172.21.15.37:0/356372976 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f565c0692a0 0x7f565c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:14:43.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:43.470+0000 7f5671d9b700 1 --2- 172.21.15.37:0/356372976 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f565c0692a0 0x7f565c06b750 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5668006fd0 tx=0x7f5668008040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:14:43.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:43.475+0000 7f5662ffd700 1 -- 172.21.15.37:0/356372976 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f56640547e0 con 0x7f5674102de0 2024-04-25T17:14:43.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:43.671+0000 7f5678c64700 1 -- 172.21.15.37:0/356372976 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5674109f50 con 0x7f5674102de0 2024-04-25T17:14:43.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:43.672+0000 7f5662ffd700 1 -- 172.21.15.37:0/356372976 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+11024 (secure 0 0 0) 0x7f5664057e00 con 0x7f5674102de0 2024-04-25T17:14:43.672 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:14:43.672 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":41,"fsid":"599bb7fc-0326-11ef-bc93-c7b262605968","created":"2024-04-25T17:08:37.882631+0000","modified":"2024-04-25T17:14:21.343451+0000","last_up_change":"2024-04-25T17:14:20.333710+0000","last_in_change":"2024-04-25T17:14:01.927070+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T17:13:09.960202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"c142de25-7aff-4c4b-b351-14e7b18de11d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2457908683},{"type":"v1","addr":"172.21.15.37:6803","nonce":2457908683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2457908683},{"type":"v1","addr":"172.21.15.37:6805","nonce":2457908683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2457908683},{"type":"v1","addr":"172.21.15.37:6809","nonce":2457908683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2457908683},{"type":"v1","addr":"172.21.15.37:6807","nonce":2457908683}]},"public_addr":"172.21.15.37:6803/2457908683","cluster_addr":"172.21.15.37:6805/2457908683","heartbeat_back_addr":"172.21.15.37:6809/2457908683","heartbeat_front_addr":"172.21.15.37:6807/2457908683","state":["exists","up"]},{"osd":1,"uuid":"ec683da0-f3c1-44b5-8f1d-69bec27fbe5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":24763193},{"type":"v1","addr":"172.21.15.37:6811","nonce":24763193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":24763193},{"type":"v1","addr":"172.21.15.37:6813","nonce":24763193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":24763193},{"type":"v1","addr":"172.21.15.37:6817","nonce":24763193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":24763193},{"type":"v1","addr":"172.21.15.37:6815","nonce":24763193}]},"public_addr":"172.21.15.37:6811/24763193","cluster_addr":"172.21.15.37:6813/24763193","heartbeat_back_addr":"172.21.15.37:6817/24763193","heartbeat_front_addr":"172.21.15.37:6815/24763193","state":["exists","up"]},{"osd":2,"uuid":"8bf4e67b-e95f-44d3-b51f-afd8a2d30e31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":596257416},{"type":"v1","addr":"172.21.15.37:6819","nonce":596257416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":596257416},{"type":"v1","addr":"172.21.15.37:6821","nonce":596257416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":596257416},{"type":"v1","addr":"172.21.15.37:6825","nonce":596257416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":596257416},{"type":"v1","addr":"172.21.15.37:6823","nonce":596257416}]},"public_addr":"172.21.15.37:6819/596257416","cluster_addr":"172.21.15.37:6821/596257416","heartbeat_back_addr":"172.21.15.37:6825/596257416","heartbeat_front_addr":"172.21.15.37:6823/596257416","state":["exists","up"]},{"osd":3,"uuid":"ce5ff1f7-472a-4515-b851-e434ee545b27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":3815031427},{"type":"v1","addr":"172.21.15.69:6801","nonce":3815031427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3815031427},{"type":"v1","addr":"172.21.15.69:6803","nonce":3815031427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3815031427},{"type":"v1","addr":"172.21.15.69:6807","nonce":3815031427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3815031427},{"type":"v1","addr":"172.21.15.69:6805","nonce":3815031427}]},"public_addr":"172.21.15.69:6801/3815031427","cluster_addr":"172.21.15.69:6803/3815031427","heartbeat_back_addr":"172.21.15.69:6807/3815031427","heartbeat_front_addr":"172.21.15.69:6805/3815031427","state":["exists","up"]},{"osd":4,"uuid":"26cf2aeb-fc85-4d14-b936-08b8280489e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":2571772778},{"type":"v1","addr":"172.21.15.69:6809","nonce":2571772778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":2571772778},{"type":"v1","addr":"172.21.15.69:6811","nonce":2571772778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":2571772778},{"type":"v1","addr":"172.21.15.69:6815","nonce":2571772778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":2571772778},{"type":"v1","addr":"172.21.15.69:6813","nonce":2571772778}]},"public_addr":"172.21.15.69:6809/2571772778","cluster_addr":"172.21.15.69:6811/2571772778","heartbeat_back_addr":"172.21.15.69:6815/2571772778","heartbeat_front_addr":"172.21.15.69:6813/2571772778","state":["exists","up"]},{"osd":5,"uuid":"fb3edb82-8f78-40d6-a339-5c469ef08371","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":2319222775},{"type":"v1","addr":"172.21.15.69:6817","nonce":2319222775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":2319222775},{"type":"v1","addr":"172.21.15.69:6819","nonce":2319222775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":2319222775},{"type":"v1","addr":"172.21.15.69:6823","nonce":2319222775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":2319222775},{"type":"v1","addr":"172.21.15.69:6821","nonce":2319222775}]},"public_addr":"172.21.15.69:6817/2319222775","cluster_addr":"172.21.15.69:6819/2319222775","heartbeat_back_addr":"172.21.15.69:6823/2319222775","heartbeat_front_addr":"172.21.15.69:6821/2319222775","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T17:12:12.145795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T17:12:39.059274+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T17:13:06.628770+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T17:13:29.779894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T17:13:54.338391+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T17:14:18.637188+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:0/4258551295":"2024-04-26T17:10:55.431694+0000","172.21.15.37:6801/1299348474":"2024-04-26T17:10:55.431694+0000","172.21.15.37:0/350553669":"2024-04-26T17:10:55.431694+0000","172.21.15.37:6801/3653320894":"2024-04-26T17:09:39.480662+0000","172.21.15.37:0/3689680514":"2024-04-26T17:09:39.480662+0000","172.21.15.37:0/1135030866":"2024-04-26T17:09:39.480662+0000","172.21.15.37:6800/2509847167":"2024-04-26T17:09:09.103933+0000","172.21.15.37:6800/3653320894":"2024-04-26T17:09:39.480662+0000","172.21.15.37:0/2586714806":"2024-04-26T17:09:09.103933+0000","172.21.15.37:6800/1299348474":"2024-04-26T17:10:55.431694+0000","172.21.15.37:0/3277643196":"2024-04-26T17:09:09.103933+0000","172.21.15.37:0/1487666224":"2024-04-26T17:09:09.103933+0000","172.21.15.37:6801/2509847167":"2024-04-26T17:09:09.103933+0000","172.21.15.37:0/1749794583":"2024-04-26T17:10:55.431694+0000","172.21.15.37:0/3089604872":"2024-04-26T17:09:39.480662+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T17:14:43.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:43.673+0000 7f5678c64700 1 -- 172.21.15.37:0/356372976 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f565c0692a0 msgr2=0x7f565c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:43.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:43.673+0000 7f5678c64700 1 --2- 172.21.15.37:0/356372976 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f565c0692a0 0x7f565c06b750 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5668006fd0 tx=0x7f5668008040 comp rx=0 tx=0).stop 2024-04-25T17:14:43.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:43.674+0000 7f5678c64700 1 -- 172.21.15.37:0/356372976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5674102de0 msgr2=0x7f5674070260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:43.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:43.674+0000 7f5678c64700 1 --2- 172.21.15.37:0/356372976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5674102de0 0x7f5674070260 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f566400b8b0 tx=0x7f5664009e30 comp rx=0 tx=0).stop 2024-04-25T17:14:43.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:43.674+0000 7f5678c64700 1 -- 172.21.15.37:0/356372976 shutdown_connections 2024-04-25T17:14:43.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:43.674+0000 7f5678c64700 1 --2- 172.21.15.37:0/356372976 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f565c0692a0 0x7f565c06b750 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:43.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:43.674+0000 7f5678c64700 1 --2- 172.21.15.37:0/356372976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5674102de0 0x7f5674070260 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:43.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:43.674+0000 7f5678c64700 1 --2- 172.21.15.37:0/356372976 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5674103780 0x7f56740707a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:43.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:43.674+0000 7f5678c64700 1 -- 172.21.15.37:0/356372976 >> 172.21.15.37:0/356372976 conn(0x7f56740f8990 msgr2=0x7f56740fa6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:14:43.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:43.674+0000 7f5678c64700 1 -- 172.21.15.37:0/356372976 shutdown_connections 2024-04-25T17:14:43.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:43.674+0000 7f5678c64700 1 -- 172.21.15.37:0/356372976 wait complete. 2024-04-25T17:14:44.438 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-04-25T17:14:44.438 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-04-25T17:14:44.441 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-04-25T17:14:44.442 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-04-25T17:14:44.442 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-04-25T17:14:44.443 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-04-25T17:14:44.661 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:44 smithi037 ceph-mon[26472]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:14:44.661 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:44 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/356372976' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T17:14:44.785 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:14:44.787 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:14:44.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:44 smithi069 ceph-mon[34527]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:14:44.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:44 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/356372976' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T17:14:46.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:46 smithi037 ceph-mon[26472]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:14:46.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:46 smithi069 ceph-mon[34527]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:14:47.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:47.194+0000 7f7b22e1d700 1 -- 172.21.15.37:0/3795738075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b1c0fbd40 msgr2=0x7f7b1c0fc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:47.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:47.194+0000 7f7b22e1d700 1 --2- 172.21.15.37:0/3795738075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b1c0fbd40 0x7f7b1c0fc1b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7b10004940 tx=0x7f7b10009e30 comp rx=0 tx=0).stop 2024-04-25T17:14:47.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:47.194+0000 7f7b22e1d700 1 -- 172.21.15.37:0/3795738075 shutdown_connections 2024-04-25T17:14:47.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:47.194+0000 7f7b22e1d700 1 --2- 172.21.15.37:0/3795738075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b1c0fbd40 0x7f7b1c0fc1b0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:47.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:47.194+0000 7f7b22e1d700 1 --2- 172.21.15.37:0/3795738075 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b1c101d90 0x7f7b1c102160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:47.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:47.194+0000 7f7b22e1d700 1 -- 172.21.15.37:0/3795738075 >> 172.21.15.37:0/3795738075 conn(0x7f7b1c071d00 msgr2=0x7f7b1c072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:14:47.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:47.194+0000 7f7b22e1d700 1 -- 172.21.15.37:0/3795738075 shutdown_connections 2024-04-25T17:14:47.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:47.194+0000 7f7b22e1d700 1 -- 172.21.15.37:0/3795738075 wait complete. 2024-04-25T17:14:47.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:47.195+0000 7f7b22e1d700 1 Processor -- start 2024-04-25T17:14:47.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:47.195+0000 7f7b22e1d700 1 -- start start 2024-04-25T17:14:47.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:47.195+0000 7f7b22e1d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b1c0fbd40 0x7f7b1c102b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:14:47.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:47.195+0000 7f7b22e1d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b1c101d90 0x7f7b1c103060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:14:47.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:47.195+0000 7f7b22e1d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c1035f0 con 0x7f7b1c0fbd40 2024-04-25T17:14:47.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:47.195+0000 7f7b22e1d700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c103730 con 0x7f7b1c101d90 2024-04-25T17:14:47.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:47.195+0000 7f7b20bb9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b1c0fbd40 0x7f7b1c102b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:14:47.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:47.195+0000 7f7b20bb9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b1c0fbd40 0x7f7b1c102b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55986/0 (socket says 172.21.15.37:55986) 2024-04-25T17:14:47.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:47.195+0000 7f7b20bb9700 1 -- 172.21.15.37:0/2374921301 learned_addr learned my addr 172.21.15.37:0/2374921301 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:14:47.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:47.195+0000 7f7b1bfff700 1 --2- 172.21.15.37:0/2374921301 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b1c101d90 0x7f7b1c103060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:14:47.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:47.196+0000 7f7b20bb9700 1 -- 172.21.15.37:0/2374921301 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b1c101d90 msgr2=0x7f7b1c103060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:47.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:47.196+0000 7f7b20bb9700 1 --2- 172.21.15.37:0/2374921301 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b1c101d90 0x7f7b1c103060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:47.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:47.196+0000 7f7b20bb9700 1 -- 172.21.15.37:0/2374921301 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b10005040 con 0x7f7b1c0fbd40 2024-04-25T17:14:47.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:47.196+0000 7f7b20bb9700 1 --2- 172.21.15.37:0/2374921301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b1c0fbd40 0x7f7b1c102b20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7b14001d80 tx=0x7f7b14009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:14:47.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:47.196+0000 7f7b197fa700 1 -- 172.21.15.37:0/2374921301 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b14007d10 con 0x7f7b1c0fbd40 2024-04-25T17:14:47.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:47.196+0000 7f7b197fa700 1 -- 172.21.15.37:0/2374921301 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7b14001e80 con 0x7f7b1c0fbd40 2024-04-25T17:14:47.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:47.196+0000 7f7b22e1d700 1 -- 172.21.15.37:0/2374921301 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b1c119e90 con 0x7f7b1c0fbd40 2024-04-25T17:14:47.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:47.196+0000 7f7b197fa700 1 -- 172.21.15.37:0/2374921301 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b14014640 con 0x7f7b1c0fbd40 2024-04-25T17:14:47.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:47.196+0000 7f7b22e1d700 1 -- 172.21.15.37:0/2374921301 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b1c11a310 con 0x7f7b1c0fbd40 2024-04-25T17:14:47.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:47.197+0000 7f7b22e1d700 1 -- 172.21.15.37:0/2374921301 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7b1c0fd430 con 0x7f7b1c0fbd40 2024-04-25T17:14:47.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:47.197+0000 7f7b197fa700 1 -- 172.21.15.37:0/2374921301 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f7b1400e960 con 0x7f7b1c0fbd40 2024-04-25T17:14:47.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:47.198+0000 7f7b197fa700 1 --2- 172.21.15.37:0/2374921301 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f7b040692a0 0x7f7b0406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:14:47.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:47.198+0000 7f7b197fa700 1 -- 172.21.15.37:0/2374921301 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f7b14086bd0 con 0x7f7b1c0fbd40 2024-04-25T17:14:47.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:47.198+0000 7f7b1bfff700 1 --2- 172.21.15.37:0/2374921301 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f7b040692a0 0x7f7b0406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:14:47.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:47.198+0000 7f7b197fa700 1 --2- 172.21.15.37:0/2374921301 >> [v2:172.21.15.37:6802/2457908683,v1:172.21.15.37:6803/2457908683] conn(0x7f7b0406ef70 0x7f7b04071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:14:47.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:47.198+0000 7f7b197fa700 1 -- 172.21.15.37:0/2374921301 --> [v2:172.21.15.37:6802/2457908683,v1:172.21.15.37:6803/2457908683] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7b04071a30 con 0x7f7b0406ef70 2024-04-25T17:14:47.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:47.198+0000 7f7b197fa700 1 -- 172.21.15.37:0/2374921301 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b1408b220 con 0x7f7b1c0fbd40 2024-04-25T17:14:47.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:47.198+0000 7f7b213ba700 1 --2- 172.21.15.37:0/2374921301 >> [v2:172.21.15.37:6802/2457908683,v1:172.21.15.37:6803/2457908683] conn(0x7f7b0406ef70 0x7f7b04071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:14:47.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:47.198+0000 7f7b1bfff700 1 --2- 172.21.15.37:0/2374921301 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f7b040692a0 0x7f7b0406b750 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c104460 tx=0x7f7b10009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:14:47.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:47.199+0000 7f7b213ba700 1 --2- 172.21.15.37:0/2374921301 >> [v2:172.21.15.37:6802/2457908683,v1:172.21.15.37:6803/2457908683] conn(0x7f7b0406ef70 0x7f7b04071380 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:14:47.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:47.199+0000 7f7b197fa700 1 -- 172.21.15.37:0/2374921301 <== osd.0 v2:172.21.15.37:6802/2457908683 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f7b04071a30 con 0x7f7b0406ef70 2024-04-25T17:14:47.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:47.215+0000 7f7b22e1d700 1 -- 172.21.15.37:0/2374921301 --> [v2:172.21.15.37:6802/2457908683,v1:172.21.15.37:6803/2457908683] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7b1c0fb180 con 0x7f7b0406ef70 2024-04-25T17:14:47.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:47.215+0000 7f7b197fa700 1 -- 172.21.15.37:0/2374921301 <== osd.0 v2:172.21.15.37:6802/2457908683 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7b1c0fb180 con 0x7f7b0406ef70 2024-04-25T17:14:47.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:47.215+0000 7f7b22e1d700 1 -- 172.21.15.37:0/2374921301 >> [v2:172.21.15.37:6802/2457908683,v1:172.21.15.37:6803/2457908683] conn(0x7f7b0406ef70 msgr2=0x7f7b04071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:47.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:47.215+0000 7f7b22e1d700 1 --2- 172.21.15.37:0/2374921301 >> [v2:172.21.15.37:6802/2457908683,v1:172.21.15.37:6803/2457908683] conn(0x7f7b0406ef70 0x7f7b04071380 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:47.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:47.215+0000 7f7b22e1d700 1 -- 172.21.15.37:0/2374921301 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f7b040692a0 msgr2=0x7f7b0406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:47.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:47.215+0000 7f7b22e1d700 1 --2- 172.21.15.37:0/2374921301 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f7b040692a0 0x7f7b0406b750 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c104460 tx=0x7f7b10009e30 comp rx=0 tx=0).stop 2024-04-25T17:14:47.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:47.215+0000 7f7b22e1d700 1 -- 172.21.15.37:0/2374921301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b1c0fbd40 msgr2=0x7f7b1c102b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:47.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:47.215+0000 7f7b22e1d700 1 --2- 172.21.15.37:0/2374921301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b1c0fbd40 0x7f7b1c102b20 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7b14001d80 tx=0x7f7b14009ec0 comp rx=0 tx=0).stop 2024-04-25T17:14:47.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:47.216+0000 7f7b22e1d700 1 -- 172.21.15.37:0/2374921301 shutdown_connections 2024-04-25T17:14:47.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:47.216+0000 7f7b22e1d700 1 --2- 172.21.15.37:0/2374921301 >> [v2:172.21.15.37:6802/2457908683,v1:172.21.15.37:6803/2457908683] conn(0x7f7b0406ef70 0x7f7b04071380 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:47.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:47.216+0000 7f7b22e1d700 1 --2- 172.21.15.37:0/2374921301 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f7b040692a0 0x7f7b0406b750 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:47.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:47.216+0000 7f7b22e1d700 1 --2- 172.21.15.37:0/2374921301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b1c0fbd40 0x7f7b1c102b20 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:47.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:47.216+0000 7f7b22e1d700 1 --2- 172.21.15.37:0/2374921301 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b1c101d90 0x7f7b1c103060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:47.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:47.216+0000 7f7b22e1d700 1 -- 172.21.15.37:0/2374921301 >> 172.21.15.37:0/2374921301 conn(0x7f7b1c071d00 msgr2=0x7f7b1c0fa830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:14:47.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:47.216+0000 7f7b22e1d700 1 -- 172.21.15.37:0/2374921301 shutdown_connections 2024-04-25T17:14:47.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:47.216+0000 7f7b22e1d700 1 -- 172.21.15.37:0/2374921301 wait complete. 2024-04-25T17:14:47.969 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:14:47.970 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:14:47.970 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:14:47.971 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:14:48.360 INFO:teuthology.orchestra.run.smithi037.stdout:38654705698 2024-04-25T17:14:48.361 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-04-25T17:14:48.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:48 smithi069 ceph-mon[34527]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:14:49.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:48 smithi037 ceph-mon[26472]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:14:49.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:49.414+0000 7f8180db0700 1 -- 172.21.15.37:0/3166482985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f817c101d90 msgr2=0x7f817c102160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:49.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:49.414+0000 7f8180db0700 1 --2- 172.21.15.37:0/3166482985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f817c101d90 0x7f817c102160 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f816c004940 tx=0x7f816c009e30 comp rx=0 tx=0).stop 2024-04-25T17:14:49.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:49.414+0000 7f8180db0700 1 -- 172.21.15.37:0/3166482985 shutdown_connections 2024-04-25T17:14:49.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:49.414+0000 7f8180db0700 1 --2- 172.21.15.37:0/3166482985 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f817c0fbd40 0x7f817c0fc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:49.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:49.414+0000 7f8180db0700 1 --2- 172.21.15.37:0/3166482985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f817c101d90 0x7f817c102160 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:49.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:49.414+0000 7f8180db0700 1 -- 172.21.15.37:0/3166482985 >> 172.21.15.37:0/3166482985 conn(0x7f817c071d00 msgr2=0x7f817c072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:14:49.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:49.414+0000 7f8180db0700 1 -- 172.21.15.37:0/3166482985 shutdown_connections 2024-04-25T17:14:49.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:49.414+0000 7f8180db0700 1 -- 172.21.15.37:0/3166482985 wait complete. 2024-04-25T17:14:49.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:49.414+0000 7f8180db0700 1 Processor -- start 2024-04-25T17:14:49.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:49.415+0000 7f8180db0700 1 -- start start 2024-04-25T17:14:49.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:49.415+0000 7f8180db0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f817c0fbd40 0x7f817c10eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:14:49.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:49.415+0000 7f8180db0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f817c101d90 0x7f817c10f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:14:49.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:49.415+0000 7f8180db0700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817c10f660 con 0x7f817c0fbd40 2024-04-25T17:14:49.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:49.415+0000 7f8180db0700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817c10f7d0 con 0x7f817c101d90 2024-04-25T17:14:49.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:49.415+0000 7f817a59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f817c0fbd40 0x7f817c10eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:14:49.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:49.415+0000 7f817a59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f817c0fbd40 0x7f817c10eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55996/0 (socket says 172.21.15.37:55996) 2024-04-25T17:14:49.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:49.415+0000 7f817a59c700 1 -- 172.21.15.37:0/3901501714 learned_addr learned my addr 172.21.15.37:0/3901501714 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:14:49.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:49.415+0000 7f8179d9b700 1 --2- 172.21.15.37:0/3901501714 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f817c101d90 0x7f817c10f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:14:49.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:49.415+0000 7f817a59c700 1 -- 172.21.15.37:0/3901501714 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f817c101d90 msgr2=0x7f817c10f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:49.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:49.415+0000 7f817a59c700 1 --2- 172.21.15.37:0/3901501714 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f817c101d90 0x7f817c10f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:49.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:49.415+0000 7f817a59c700 1 -- 172.21.15.37:0/3901501714 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f816c005040 con 0x7f817c0fbd40 2024-04-25T17:14:49.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:49.415+0000 7f817a59c700 1 --2- 172.21.15.37:0/3901501714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f817c0fbd40 0x7f817c10eb20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f816c00b8b0 tx=0x7f816c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:14:49.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:49.416+0000 7f816affd700 1 -- 172.21.15.37:0/3901501714 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f816c00e040 con 0x7f817c0fbd40 2024-04-25T17:14:49.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:49.416+0000 7f816affd700 1 -- 172.21.15.37:0/3901501714 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f816c004290 con 0x7f817c0fbd40 2024-04-25T17:14:49.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:49.416+0000 7f8180db0700 1 -- 172.21.15.37:0/3901501714 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f817c117b90 con 0x7f817c0fbd40 2024-04-25T17:14:49.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:49.416+0000 7f816affd700 1 -- 172.21.15.37:0/3901501714 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f816c01c3f0 con 0x7f817c0fbd40 2024-04-25T17:14:49.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:49.416+0000 7f8180db0700 1 -- 172.21.15.37:0/3901501714 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f817c118070 con 0x7f817c0fbd40 2024-04-25T17:14:49.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:49.416+0000 7f8180db0700 1 -- 172.21.15.37:0/3901501714 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f817c106480 con 0x7f817c0fbd40 2024-04-25T17:14:49.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:49.417+0000 7f816affd700 1 -- 172.21.15.37:0/3901501714 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f816c013820 con 0x7f817c0fbd40 2024-04-25T17:14:49.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:49.417+0000 7f816affd700 1 --2- 172.21.15.37:0/3901501714 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f81640692a0 0x7f816406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:14:49.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:49.418+0000 7f816affd700 1 -- 172.21.15.37:0/3901501714 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f816c088110 con 0x7f817c0fbd40 2024-04-25T17:14:49.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:49.418+0000 7f8179d9b700 1 --2- 172.21.15.37:0/3901501714 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f81640692a0 0x7f816406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:14:49.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:49.418+0000 7f816affd700 1 --2- 172.21.15.37:0/3901501714 >> [v2:172.21.15.37:6810/24763193,v1:172.21.15.37:6811/24763193] conn(0x7f816406ef70 0x7f8164071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:14:49.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:49.418+0000 7f816affd700 1 -- 172.21.15.37:0/3901501714 --> [v2:172.21.15.37:6810/24763193,v1:172.21.15.37:6811/24763193] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8164071a30 con 0x7f816406ef70 2024-04-25T17:14:49.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:49.418+0000 7f816affd700 1 -- 172.21.15.37:0/3901501714 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f816c08a700 con 0x7f817c0fbd40 2024-04-25T17:14:49.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:49.418+0000 7f817ad9d700 1 --2- 172.21.15.37:0/3901501714 >> [v2:172.21.15.37:6810/24763193,v1:172.21.15.37:6811/24763193] conn(0x7f816406ef70 0x7f8164071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:14:49.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:49.418+0000 7f8179d9b700 1 --2- 172.21.15.37:0/3901501714 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f81640692a0 0x7f816406b750 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f817c065fb0 tx=0x7f8170009040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:14:49.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:49.418+0000 7f817ad9d700 1 --2- 172.21.15.37:0/3901501714 >> [v2:172.21.15.37:6810/24763193,v1:172.21.15.37:6811/24763193] conn(0x7f816406ef70 0x7f8164071380 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:14:49.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:49.419+0000 7f816affd700 1 -- 172.21.15.37:0/3901501714 <== osd.1 v2:172.21.15.37:6810/24763193 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f8164071a30 con 0x7f816406ef70 2024-04-25T17:14:49.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:49.434+0000 7f8180db0700 1 -- 172.21.15.37:0/3901501714 --> [v2:172.21.15.37:6810/24763193,v1:172.21.15.37:6811/24763193] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f817c0fd430 con 0x7f816406ef70 2024-04-25T17:14:49.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:49.434+0000 7f816affd700 1 -- 172.21.15.37:0/3901501714 <== osd.1 v2:172.21.15.37:6810/24763193 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f817c0fd430 con 0x7f816406ef70 2024-04-25T17:14:49.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:49.434+0000 7f8180db0700 1 -- 172.21.15.37:0/3901501714 >> [v2:172.21.15.37:6810/24763193,v1:172.21.15.37:6811/24763193] conn(0x7f816406ef70 msgr2=0x7f8164071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:49.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:49.434+0000 7f8180db0700 1 --2- 172.21.15.37:0/3901501714 >> [v2:172.21.15.37:6810/24763193,v1:172.21.15.37:6811/24763193] conn(0x7f816406ef70 0x7f8164071380 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:49.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:49.434+0000 7f8180db0700 1 -- 172.21.15.37:0/3901501714 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f81640692a0 msgr2=0x7f816406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:49.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:49.434+0000 7f8180db0700 1 --2- 172.21.15.37:0/3901501714 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f81640692a0 0x7f816406b750 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f817c065fb0 tx=0x7f8170009040 comp rx=0 tx=0).stop 2024-04-25T17:14:49.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:49.434+0000 7f8180db0700 1 -- 172.21.15.37:0/3901501714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f817c0fbd40 msgr2=0x7f817c10eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:49.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:49.434+0000 7f8180db0700 1 --2- 172.21.15.37:0/3901501714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f817c0fbd40 0x7f817c10eb20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f816c00b8b0 tx=0x7f816c009e30 comp rx=0 tx=0).stop 2024-04-25T17:14:49.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:49.434+0000 7f8180db0700 1 -- 172.21.15.37:0/3901501714 shutdown_connections 2024-04-25T17:14:49.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:49.434+0000 7f8180db0700 1 --2- 172.21.15.37:0/3901501714 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f81640692a0 0x7f816406b750 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:49.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:49.434+0000 7f8180db0700 1 --2- 172.21.15.37:0/3901501714 >> [v2:172.21.15.37:6810/24763193,v1:172.21.15.37:6811/24763193] conn(0x7f816406ef70 0x7f8164071380 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:49.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:49.434+0000 7f8180db0700 1 --2- 172.21.15.37:0/3901501714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f817c0fbd40 0x7f817c10eb20 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:49.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:49.434+0000 7f8180db0700 1 --2- 172.21.15.37:0/3901501714 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f817c101d90 0x7f817c10f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:49.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:49.434+0000 7f8180db0700 1 -- 172.21.15.37:0/3901501714 >> 172.21.15.37:0/3901501714 conn(0x7f817c071d00 msgr2=0x7f817c104a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:14:49.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:49.435+0000 7f8180db0700 1 -- 172.21.15.37:0/3901501714 shutdown_connections 2024-04-25T17:14:49.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:49.435+0000 7f8180db0700 1 -- 172.21.15.37:0/3901501714 wait complete. 2024-04-25T17:14:50.382 INFO:teuthology.orchestra.run.smithi037.stdout:60129542173 2024-04-25T17:14:50.382 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-04-25T17:14:50.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:50 smithi069 ceph-mon[34527]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:14:50.971 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:50 smithi037 ceph-mon[26472]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:14:52.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:52 smithi037 ceph-mon[26472]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:14:53.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:52 smithi069 ceph-mon[34527]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:14:53.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:53.687+0000 7f84567a6700 1 -- 172.21.15.37:0/1501967024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8450102f60 msgr2=0x7f8450103330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:53.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:53.687+0000 7f84567a6700 1 --2- 172.21.15.37:0/1501967024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8450102f60 0x7f8450103330 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8440004940 tx=0x7f8440009e30 comp rx=0 tx=0).stop 2024-04-25T17:14:53.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:53.687+0000 7f84567a6700 1 -- 172.21.15.37:0/1501967024 shutdown_connections 2024-04-25T17:14:53.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:53.687+0000 7f84567a6700 1 --2- 172.21.15.37:0/1501967024 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f84500fb520 0x7f84500fb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:53.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:53.687+0000 7f84567a6700 1 --2- 172.21.15.37:0/1501967024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8450102f60 0x7f8450103330 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:53.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:53.687+0000 7f84567a6700 1 -- 172.21.15.37:0/1501967024 >> 172.21.15.37:0/1501967024 conn(0x7f84500714d0 msgr2=0x7f84500718d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:14:53.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:53.687+0000 7f84567a6700 1 -- 172.21.15.37:0/1501967024 shutdown_connections 2024-04-25T17:14:53.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:53.687+0000 7f84567a6700 1 -- 172.21.15.37:0/1501967024 wait complete. 2024-04-25T17:14:53.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:53.687+0000 7f84567a6700 1 Processor -- start 2024-04-25T17:14:53.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:53.687+0000 7f84567a6700 1 -- start start 2024-04-25T17:14:53.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:53.688+0000 7f84567a6700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f84500fb520 0x7f8450113a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:14:53.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:53.688+0000 7f84567a6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8450102f60 0x7f8450113f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:14:53.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:53.688+0000 7f84567a6700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8450114660 con 0x7f8450102f60 2024-04-25T17:14:53.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:53.688+0000 7f84567a6700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845010dbb0 con 0x7f84500fb520 2024-04-25T17:14:53.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:53.688+0000 7f844f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8450102f60 0x7f8450113f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:14:53.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:53.688+0000 7f844f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8450102f60 0x7f8450113f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56014/0 (socket says 172.21.15.37:56014) 2024-04-25T17:14:53.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:53.688+0000 7f844f7fe700 1 -- 172.21.15.37:0/3306656633 learned_addr learned my addr 172.21.15.37:0/3306656633 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:14:53.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:53.688+0000 7f844ffff700 1 --2- 172.21.15.37:0/3306656633 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f84500fb520 0x7f8450113a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:14:53.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:53.688+0000 7f844f7fe700 1 -- 172.21.15.37:0/3306656633 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f84500fb520 msgr2=0x7f8450113a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:53.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:53.688+0000 7f844f7fe700 1 --2- 172.21.15.37:0/3306656633 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f84500fb520 0x7f8450113a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:53.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:53.688+0000 7f844f7fe700 1 -- 172.21.15.37:0/3306656633 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8440005040 con 0x7f8450102f60 2024-04-25T17:14:53.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:53.688+0000 7f844f7fe700 1 --2- 172.21.15.37:0/3306656633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8450102f60 0x7f8450113f80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f844400b790 tx=0x7f8444009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:14:53.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:53.688+0000 7f844cff9700 1 -- 172.21.15.37:0/3306656633 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f844400f6f0 con 0x7f8450102f60 2024-04-25T17:14:53.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:53.689+0000 7f844cff9700 1 -- 172.21.15.37:0/3306656633 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f844400fd20 con 0x7f8450102f60 2024-04-25T17:14:53.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:53.689+0000 7f844cff9700 1 -- 172.21.15.37:0/3306656633 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84440103a0 con 0x7f8450102f60 2024-04-25T17:14:53.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:53.689+0000 7f84567a6700 1 -- 172.21.15.37:0/3306656633 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f845010de30 con 0x7f8450102f60 2024-04-25T17:14:53.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:53.689+0000 7f84567a6700 1 -- 172.21.15.37:0/3306656633 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f845010e370 con 0x7f8450102f60 2024-04-25T17:14:53.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:53.689+0000 7f84567a6700 1 -- 172.21.15.37:0/3306656633 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f845010e830 con 0x7f8450102f60 2024-04-25T17:14:53.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:53.690+0000 7f844cff9700 1 -- 172.21.15.37:0/3306656633 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f8444011400 con 0x7f8450102f60 2024-04-25T17:14:53.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:53.690+0000 7f844cff9700 1 --2- 172.21.15.37:0/3306656633 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f84380692a0 0x7f843806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:14:53.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:53.691+0000 7f844cff9700 1 -- 172.21.15.37:0/3306656633 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f8444086c40 con 0x7f8450102f60 2024-04-25T17:14:53.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:53.691+0000 7f844ffff700 1 --2- 172.21.15.37:0/3306656633 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f84380692a0 0x7f843806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:14:53.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:53.691+0000 7f844cff9700 1 --2- 172.21.15.37:0/3306656633 >> [v2:172.21.15.37:6818/596257416,v1:172.21.15.37:6819/596257416] conn(0x7f843806ef70 0x7f8438071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:14:53.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:53.691+0000 7f844cff9700 1 -- 172.21.15.37:0/3306656633 --> [v2:172.21.15.37:6818/596257416,v1:172.21.15.37:6819/596257416] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8438071a30 con 0x7f843806ef70 2024-04-25T17:14:53.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:53.691+0000 7f844cff9700 1 -- 172.21.15.37:0/3306656633 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f844408c240 con 0x7f8450102f60 2024-04-25T17:14:53.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:53.691+0000 7f8454d43700 1 --2- 172.21.15.37:0/3306656633 >> [v2:172.21.15.37:6818/596257416,v1:172.21.15.37:6819/596257416] conn(0x7f843806ef70 0x7f8438071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:14:53.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:53.691+0000 7f844ffff700 1 --2- 172.21.15.37:0/3306656633 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f84380692a0 0x7f843806b750 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8440004f90 tx=0x7f8440009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:14:53.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:53.691+0000 7f8454d43700 1 --2- 172.21.15.37:0/3306656633 >> [v2:172.21.15.37:6818/596257416,v1:172.21.15.37:6819/596257416] conn(0x7f843806ef70 0x7f8438071380 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:14:53.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:53.692+0000 7f844cff9700 1 -- 172.21.15.37:0/3306656633 <== osd.2 v2:172.21.15.37:6818/596257416 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f8438071a30 con 0x7f843806ef70 2024-04-25T17:14:53.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:53.707+0000 7f84567a6700 1 -- 172.21.15.37:0/3306656633 --> [v2:172.21.15.37:6818/596257416,v1:172.21.15.37:6819/596257416] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f845005e5e0 con 0x7f843806ef70 2024-04-25T17:14:53.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:53.707+0000 7f844cff9700 1 -- 172.21.15.37:0/3306656633 <== osd.2 v2:172.21.15.37:6818/596257416 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f845005e5e0 con 0x7f843806ef70 2024-04-25T17:14:53.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:53.707+0000 7f84567a6700 1 -- 172.21.15.37:0/3306656633 >> [v2:172.21.15.37:6818/596257416,v1:172.21.15.37:6819/596257416] conn(0x7f843806ef70 msgr2=0x7f8438071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:53.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:53.707+0000 7f84567a6700 1 --2- 172.21.15.37:0/3306656633 >> [v2:172.21.15.37:6818/596257416,v1:172.21.15.37:6819/596257416] conn(0x7f843806ef70 0x7f8438071380 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:53.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:53.707+0000 7f84567a6700 1 -- 172.21.15.37:0/3306656633 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f84380692a0 msgr2=0x7f843806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:53.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:53.707+0000 7f84567a6700 1 --2- 172.21.15.37:0/3306656633 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f84380692a0 0x7f843806b750 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8440004f90 tx=0x7f8440009e30 comp rx=0 tx=0).stop 2024-04-25T17:14:53.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:53.707+0000 7f84567a6700 1 -- 172.21.15.37:0/3306656633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8450102f60 msgr2=0x7f8450113f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:53.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:53.707+0000 7f84567a6700 1 --2- 172.21.15.37:0/3306656633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8450102f60 0x7f8450113f80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f844400b790 tx=0x7f8444009250 comp rx=0 tx=0).stop 2024-04-25T17:14:53.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:53.707+0000 7f84567a6700 1 -- 172.21.15.37:0/3306656633 shutdown_connections 2024-04-25T17:14:53.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:53.707+0000 7f84567a6700 1 --2- 172.21.15.37:0/3306656633 >> [v2:172.21.15.37:6818/596257416,v1:172.21.15.37:6819/596257416] conn(0x7f843806ef70 0x7f8438071380 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:53.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:53.707+0000 7f84567a6700 1 --2- 172.21.15.37:0/3306656633 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f84380692a0 0x7f843806b750 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:53.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:53.707+0000 7f84567a6700 1 --2- 172.21.15.37:0/3306656633 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f84500fb520 0x7f8450113a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:53.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:53.707+0000 7f84567a6700 1 --2- 172.21.15.37:0/3306656633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8450102f60 0x7f8450113f80 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:53.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:53.708+0000 7f84567a6700 1 -- 172.21.15.37:0/3306656633 >> 172.21.15.37:0/3306656633 conn(0x7f84500714d0 msgr2=0x7f84500fa830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:14:53.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:53.708+0000 7f84567a6700 1 -- 172.21.15.37:0/3306656633 shutdown_connections 2024-04-25T17:14:53.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:53.708+0000 7f84567a6700 1 -- 172.21.15.37:0/3306656633 wait complete. 2024-04-25T17:14:54.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:54.288+0000 7ff3f741b700 1 -- 172.21.15.37:0/705809579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3f00fbbf0 msgr2=0x7ff3f00fbfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:54.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:54.288+0000 7ff3f741b700 1 --2- 172.21.15.37:0/705809579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3f00fbbf0 0x7ff3f00fbfc0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec009ce0 tx=0x7ff3ec004d10 comp rx=0 tx=0).stop 2024-04-25T17:14:54.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:54.288+0000 7ff3f741b700 1 -- 172.21.15.37:0/705809579 shutdown_connections 2024-04-25T17:14:54.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:54.288+0000 7ff3f741b700 1 --2- 172.21.15.37:0/705809579 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff3f00fc590 0x7ff3f0100bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:54.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:54.288+0000 7ff3f741b700 1 --2- 172.21.15.37:0/705809579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3f00fbbf0 0x7ff3f00fbfc0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:54.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:54.288+0000 7ff3f741b700 1 -- 172.21.15.37:0/705809579 >> 172.21.15.37:0/705809579 conn(0x7ff3f00f7870 msgr2=0x7ff3f00f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:14:54.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:54.288+0000 7ff3f741b700 1 -- 172.21.15.37:0/705809579 shutdown_connections 2024-04-25T17:14:54.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:54.288+0000 7ff3f741b700 1 -- 172.21.15.37:0/705809579 wait complete. 2024-04-25T17:14:54.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:54.288+0000 7ff3f741b700 1 Processor -- start 2024-04-25T17:14:54.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:54.288+0000 7ff3f741b700 1 -- start start 2024-04-25T17:14:54.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:54.289+0000 7ff3f741b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff3f00fbbf0 0x7ff3f011a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:14:54.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:54.289+0000 7ff3f741b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3f00fc590 0x7ff3f011a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:14:54.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:54.289+0000 7ff3f741b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f011ada0 con 0x7ff3f00fc590 2024-04-25T17:14:54.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:54.289+0000 7ff3f741b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f01142f0 con 0x7ff3f00fbbf0 2024-04-25T17:14:54.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:54.289+0000 7ff3f49b6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3f00fc590 0x7ff3f011a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:14:54.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:54.289+0000 7ff3f49b6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3f00fc590 0x7ff3f011a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56032/0 (socket says 172.21.15.37:56032) 2024-04-25T17:14:54.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:54.289+0000 7ff3f49b6700 1 -- 172.21.15.37:0/1798356747 learned_addr learned my addr 172.21.15.37:0/1798356747 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:14:54.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:54.289+0000 7ff3f51b7700 1 --2- 172.21.15.37:0/1798356747 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff3f00fbbf0 0x7ff3f011a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:14:54.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:54.289+0000 7ff3f49b6700 1 -- 172.21.15.37:0/1798356747 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff3f00fbbf0 msgr2=0x7ff3f011a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:54.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:54.289+0000 7ff3f49b6700 1 --2- 172.21.15.37:0/1798356747 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff3f00fbbf0 0x7ff3f011a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:54.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:54.289+0000 7ff3f49b6700 1 -- 172.21.15.37:0/1798356747 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3ec009940 con 0x7ff3f00fc590 2024-04-25T17:14:54.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:54.289+0000 7ff3f49b6700 1 --2- 172.21.15.37:0/1798356747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3f00fc590 0x7ff3f011a6c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff3e000b790 tx=0x7ff3e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:14:54.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:54.289+0000 7ff3e5ffb700 1 -- 172.21.15.37:0/1798356747 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3e000f770 con 0x7ff3f00fc590 2024-04-25T17:14:54.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:54.289+0000 7ff3e5ffb700 1 -- 172.21.15.37:0/1798356747 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff3e000fda0 con 0x7ff3f00fc590 2024-04-25T17:14:54.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:54.289+0000 7ff3e5ffb700 1 -- 172.21.15.37:0/1798356747 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3e000d310 con 0x7ff3f00fc590 2024-04-25T17:14:54.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:54.289+0000 7ff3f741b700 1 -- 172.21.15.37:0/1798356747 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3f0114570 con 0x7ff3f00fc590 2024-04-25T17:14:54.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:54.290+0000 7ff3f741b700 1 -- 172.21.15.37:0/1798356747 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3f0114a60 con 0x7ff3f00fc590 2024-04-25T17:14:54.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:54.290+0000 7ff3f741b700 1 -- 172.21.15.37:0/1798356747 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff3f0114ff0 con 0x7ff3f00fc590 2024-04-25T17:14:54.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:54.291+0000 7ff3e5ffb700 1 -- 172.21.15.37:0/1798356747 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7ff3e0010420 con 0x7ff3f00fc590 2024-04-25T17:14:54.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:54.291+0000 7ff3e5ffb700 1 --2- 172.21.15.37:0/1798356747 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7ff3dc0692a0 0x7ff3dc06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:14:54.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:54.291+0000 7ff3e5ffb700 1 -- 172.21.15.37:0/1798356747 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ff3e0086e80 con 0x7ff3f00fc590 2024-04-25T17:14:54.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:54.291+0000 7ff3f51b7700 1 --2- 172.21.15.37:0/1798356747 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7ff3dc0692a0 0x7ff3dc06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:14:54.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:54.291+0000 7ff3e5ffb700 1 --2- 172.21.15.37:0/1798356747 >> [v2:172.21.15.69:6800/3815031427,v1:172.21.15.69:6801/3815031427] conn(0x7ff3dc06ef70 0x7ff3dc071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:14:54.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:54.291+0000 7ff3e5ffb700 1 -- 172.21.15.37:0/1798356747 --> [v2:172.21.15.69:6800/3815031427,v1:172.21.15.69:6801/3815031427] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff3dc071a30 con 0x7ff3dc06ef70 2024-04-25T17:14:54.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:54.291+0000 7ff3e5ffb700 1 -- 172.21.15.37:0/1798356747 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff3e008c4e0 con 0x7ff3f00fc590 2024-04-25T17:14:54.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:54.292+0000 7ff3f51b7700 1 --2- 172.21.15.37:0/1798356747 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7ff3dc0692a0 0x7ff3dc06b750 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec015040 tx=0x7ff3ec004d10 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:14:54.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:54.292+0000 7ff3f59b8700 1 --2- 172.21.15.37:0/1798356747 >> [v2:172.21.15.69:6800/3815031427,v1:172.21.15.69:6801/3815031427] conn(0x7ff3dc06ef70 0x7ff3dc071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:14:54.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:54.292+0000 7ff3f59b8700 1 --2- 172.21.15.37:0/1798356747 >> [v2:172.21.15.69:6800/3815031427,v1:172.21.15.69:6801/3815031427] conn(0x7ff3dc06ef70 0x7ff3dc071380 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:14:54.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:54.293+0000 7ff3e5ffb700 1 -- 172.21.15.37:0/1798356747 <== osd.3 v2:172.21.15.69:6800/3815031427 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7ff3dc071a30 con 0x7ff3dc06ef70 2024-04-25T17:14:54.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:54.308+0000 7ff3f741b700 1 -- 172.21.15.37:0/1798356747 --> [v2:172.21.15.69:6800/3815031427,v1:172.21.15.69:6801/3815031427] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff3f010d5a0 con 0x7ff3dc06ef70 2024-04-25T17:14:54.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:54.309+0000 7ff3e5ffb700 1 -- 172.21.15.37:0/1798356747 <== osd.3 v2:172.21.15.69:6800/3815031427 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7ff3f010d5a0 con 0x7ff3dc06ef70 2024-04-25T17:14:54.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:54.309+0000 7ff3f741b700 1 -- 172.21.15.37:0/1798356747 >> [v2:172.21.15.69:6800/3815031427,v1:172.21.15.69:6801/3815031427] conn(0x7ff3dc06ef70 msgr2=0x7ff3dc071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:54.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:54.309+0000 7ff3f741b700 1 --2- 172.21.15.37:0/1798356747 >> [v2:172.21.15.69:6800/3815031427,v1:172.21.15.69:6801/3815031427] conn(0x7ff3dc06ef70 0x7ff3dc071380 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:54.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:54.309+0000 7ff3f741b700 1 -- 172.21.15.37:0/1798356747 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7ff3dc0692a0 msgr2=0x7ff3dc06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:54.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:54.309+0000 7ff3f741b700 1 --2- 172.21.15.37:0/1798356747 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7ff3dc0692a0 0x7ff3dc06b750 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec015040 tx=0x7ff3ec004d10 comp rx=0 tx=0).stop 2024-04-25T17:14:54.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:54.309+0000 7ff3f741b700 1 -- 172.21.15.37:0/1798356747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3f00fc590 msgr2=0x7ff3f011a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:54.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:54.309+0000 7ff3f741b700 1 --2- 172.21.15.37:0/1798356747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3f00fc590 0x7ff3f011a6c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff3e000b790 tx=0x7ff3e0009250 comp rx=0 tx=0).stop 2024-04-25T17:14:54.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:54.309+0000 7ff3f741b700 1 -- 172.21.15.37:0/1798356747 shutdown_connections 2024-04-25T17:14:54.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:54.309+0000 7ff3f741b700 1 --2- 172.21.15.37:0/1798356747 >> [v2:172.21.15.69:6800/3815031427,v1:172.21.15.69:6801/3815031427] conn(0x7ff3dc06ef70 0x7ff3dc071380 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:54.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:54.309+0000 7ff3f741b700 1 --2- 172.21.15.37:0/1798356747 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7ff3dc0692a0 0x7ff3dc06b750 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:54.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:54.309+0000 7ff3f741b700 1 --2- 172.21.15.37:0/1798356747 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff3f00fbbf0 0x7ff3f011a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:54.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:54.309+0000 7ff3f741b700 1 --2- 172.21.15.37:0/1798356747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3f00fc590 0x7ff3f011a6c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:54.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:54.309+0000 7ff3f741b700 1 -- 172.21.15.37:0/1798356747 >> 172.21.15.37:0/1798356747 conn(0x7ff3f00f7870 msgr2=0x7ff3f010cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:14:54.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:54.309+0000 7ff3f741b700 1 -- 172.21.15.37:0/1798356747 shutdown_connections 2024-04-25T17:14:54.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:54.309+0000 7ff3f741b700 1 -- 172.21.15.37:0/1798356747 wait complete. 2024-04-25T17:14:54.992 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:54 smithi037 ceph-mon[26472]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:14:55.018 INFO:teuthology.orchestra.run.smithi037.stdout:115964117010 2024-04-25T17:14:55.018 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-04-25T17:14:55.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:54 smithi069 ceph-mon[34527]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:14:55.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:55.241+0000 7f5d89d9b700 1 -- 172.21.15.37:0/2109287491 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d8000e070 con 0x7f5d8c0fc4d0 2024-04-25T17:14:55.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:55.241+0000 7f5d910cd700 1 -- 172.21.15.37:0/2109287491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d8c0fc4d0 msgr2=0x7f5d8c109230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:55.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:55.241+0000 7f5d910cd700 1 --2- 172.21.15.37:0/2109287491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d8c0fc4d0 0x7f5d8c109230 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5d80004940 tx=0x7f5d80009e30 comp rx=0 tx=0).stop 2024-04-25T17:14:55.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:55.241+0000 7f5d910cd700 1 -- 172.21.15.37:0/2109287491 shutdown_connections 2024-04-25T17:14:55.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:55.241+0000 7f5d910cd700 1 --2- 172.21.15.37:0/2109287491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d8c0fc4d0 0x7f5d8c109230 secure :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5d80004940 tx=0x7f5d80009e30 comp rx=0 tx=0).stop 2024-04-25T17:14:55.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:55.241+0000 7f5d910cd700 1 --2- 172.21.15.37:0/2109287491 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5d8c0fbbc0 0x7f5d8c0fbf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:55.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:55.241+0000 7f5d910cd700 1 -- 172.21.15.37:0/2109287491 >> 172.21.15.37:0/2109287491 conn(0x7f5d8c0f78d0 msgr2=0x7f5d8c0f9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:14:55.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:55.241+0000 7f5d910cd700 1 -- 172.21.15.37:0/2109287491 shutdown_connections 2024-04-25T17:14:55.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:55.242+0000 7f5d910cd700 1 -- 172.21.15.37:0/2109287491 wait complete. 2024-04-25T17:14:55.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:55.242+0000 7f5d910cd700 1 Processor -- start 2024-04-25T17:14:55.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:55.242+0000 7f5d910cd700 1 -- start start 2024-04-25T17:14:55.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:55.243+0000 7f5d910cd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5d8c0fbbc0 0x7f5d8c11a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:14:55.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:55.243+0000 7f5d910cd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d8c11a760 0x7f5d8c107fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:14:55.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:55.243+0000 7f5d910cd700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8c11ace0 con 0x7f5d8c11a760 2024-04-25T17:14:55.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:55.243+0000 7f5d910cd700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8c1084e0 con 0x7f5d8c0fbbc0 2024-04-25T17:14:55.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:55.243+0000 7f5d8ad9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5d8c0fbbc0 0x7f5d8c11a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:14:55.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:55.243+0000 7f5d8a59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d8c11a760 0x7f5d8c107fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:14:55.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:55.243+0000 7f5d8a59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d8c11a760 0x7f5d8c107fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56052/0 (socket says 172.21.15.37:56052) 2024-04-25T17:14:55.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:55.243+0000 7f5d8a59c700 1 -- 172.21.15.37:0/2087767041 learned_addr learned my addr 172.21.15.37:0/2087767041 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:14:55.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:55.244+0000 7f5d8ad9d700 1 -- 172.21.15.37:0/2087767041 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d8c11a760 msgr2=0x7f5d8c107fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:55.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:55.244+0000 7f5d8ad9d700 1 --2- 172.21.15.37:0/2087767041 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d8c11a760 0x7f5d8c107fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:55.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:55.244+0000 7f5d8ad9d700 1 -- 172.21.15.37:0/2087767041 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d80005040 con 0x7f5d8c0fbbc0 2024-04-25T17:14:55.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:55.244+0000 7f5d8ad9d700 1 --2- 172.21.15.37:0/2087767041 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5d8c0fbbc0 0x7f5d8c11a220 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c002820 tx=0x7f5d7c004570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:14:55.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:55.244+0000 7f5d737fe700 1 -- 172.21.15.37:0/2087767041 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d7c007cc0 con 0x7f5d8c0fbbc0 2024-04-25T17:14:55.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:55.244+0000 7f5d737fe700 1 -- 172.21.15.37:0/2087767041 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5d7c00f040 con 0x7f5d8c0fbbc0 2024-04-25T17:14:55.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:55.244+0000 7f5d737fe700 1 -- 172.21.15.37:0/2087767041 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d7c013860 con 0x7f5d8c0fbbc0 2024-04-25T17:14:55.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:55.244+0000 7f5d910cd700 1 -- 172.21.15.37:0/2087767041 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d8c1087c0 con 0x7f5d8c0fbbc0 2024-04-25T17:14:55.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:55.245+0000 7f5d910cd700 1 -- 172.21.15.37:0/2087767041 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d8c108cb0 con 0x7f5d8c0fbbc0 2024-04-25T17:14:55.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:55.245+0000 7f5d910cd700 1 -- 172.21.15.37:0/2087767041 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5d8c05e660 con 0x7f5d8c0fbbc0 2024-04-25T17:14:55.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:55.246+0000 7f5d737fe700 1 -- 172.21.15.37:0/2087767041 <== mon.1 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f5d7c013b20 con 0x7f5d8c0fbbc0 2024-04-25T17:14:55.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:55.247+0000 7f5d737fe700 1 --2- 172.21.15.37:0/2087767041 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f5d740692a0 0x7f5d7406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:14:55.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:55.247+0000 7f5d737fe700 1 -- 172.21.15.37:0/2087767041 <== mon.1 v2:172.21.15.69:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f5d7c086910 con 0x7f5d8c0fbbc0 2024-04-25T17:14:55.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:55.247+0000 7f5d8a59c700 1 --2- 172.21.15.37:0/2087767041 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f5d740692a0 0x7f5d7406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:14:55.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:55.247+0000 7f5d737fe700 1 --2- 172.21.15.37:0/2087767041 >> [v2:172.21.15.69:6808/2571772778,v1:172.21.15.69:6809/2571772778] conn(0x7f5d7406ef70 0x7f5d74071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:14:55.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:55.247+0000 7f5d737fe700 1 -- 172.21.15.37:0/2087767041 --> [v2:172.21.15.69:6808/2571772778,v1:172.21.15.69:6809/2571772778] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5d74071a30 con 0x7f5d7406ef70 2024-04-25T17:14:55.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:55.247+0000 7f5d737fe700 1 -- 172.21.15.37:0/2087767041 <== mon.1 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5d7c08b220 con 0x7f5d8c0fbbc0 2024-04-25T17:14:55.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:55.248+0000 7f5d8b59e700 1 --2- 172.21.15.37:0/2087767041 >> [v2:172.21.15.69:6808/2571772778,v1:172.21.15.69:6809/2571772778] conn(0x7f5d7406ef70 0x7f5d74071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:14:55.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:55.248+0000 7f5d8a59c700 1 --2- 172.21.15.37:0/2087767041 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f5d740692a0 0x7f5d7406b750 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5d80009fd0 tx=0x7f5d80009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:14:55.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:55.248+0000 7f5d8b59e700 1 --2- 172.21.15.37:0/2087767041 >> [v2:172.21.15.69:6808/2571772778,v1:172.21.15.69:6809/2571772778] conn(0x7f5d7406ef70 0x7f5d74071380 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:14:55.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:55.249+0000 7f5d737fe700 1 -- 172.21.15.37:0/2087767041 <== osd.4 v2:172.21.15.69:6808/2571772778 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f5d74071a30 con 0x7f5d7406ef70 2024-04-25T17:14:55.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:55.266+0000 7f5d910cd700 1 -- 172.21.15.37:0/2087767041 --> [v2:172.21.15.69:6808/2571772778,v1:172.21.15.69:6809/2571772778] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5d8c05ea60 con 0x7f5d7406ef70 2024-04-25T17:14:55.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:55.267+0000 7f5d737fe700 1 -- 172.21.15.37:0/2087767041 <== osd.4 v2:172.21.15.69:6808/2571772778 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f5d8c05ea60 con 0x7f5d7406ef70 2024-04-25T17:14:55.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:55.267+0000 7f5d910cd700 1 -- 172.21.15.37:0/2087767041 >> [v2:172.21.15.69:6808/2571772778,v1:172.21.15.69:6809/2571772778] conn(0x7f5d7406ef70 msgr2=0x7f5d74071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:55.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:55.267+0000 7f5d910cd700 1 --2- 172.21.15.37:0/2087767041 >> [v2:172.21.15.69:6808/2571772778,v1:172.21.15.69:6809/2571772778] conn(0x7f5d7406ef70 0x7f5d74071380 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:55.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:55.267+0000 7f5d910cd700 1 -- 172.21.15.37:0/2087767041 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f5d740692a0 msgr2=0x7f5d7406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:55.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:55.267+0000 7f5d910cd700 1 --2- 172.21.15.37:0/2087767041 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f5d740692a0 0x7f5d7406b750 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5d80009fd0 tx=0x7f5d80009e30 comp rx=0 tx=0).stop 2024-04-25T17:14:55.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:55.267+0000 7f5d910cd700 1 -- 172.21.15.37:0/2087767041 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5d8c0fbbc0 msgr2=0x7f5d8c11a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:55.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:55.267+0000 7f5d910cd700 1 --2- 172.21.15.37:0/2087767041 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5d8c0fbbc0 0x7f5d8c11a220 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c002820 tx=0x7f5d7c004570 comp rx=0 tx=0).stop 2024-04-25T17:14:55.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:55.267+0000 7f5d910cd700 1 -- 172.21.15.37:0/2087767041 shutdown_connections 2024-04-25T17:14:55.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:55.267+0000 7f5d910cd700 1 --2- 172.21.15.37:0/2087767041 >> [v2:172.21.15.69:6808/2571772778,v1:172.21.15.69:6809/2571772778] conn(0x7f5d7406ef70 0x7f5d74071380 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:55.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:55.267+0000 7f5d910cd700 1 --2- 172.21.15.37:0/2087767041 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f5d740692a0 0x7f5d7406b750 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:55.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:55.267+0000 7f5d910cd700 1 --2- 172.21.15.37:0/2087767041 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5d8c0fbbc0 0x7f5d8c11a220 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:55.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:55.267+0000 7f5d910cd700 1 --2- 172.21.15.37:0/2087767041 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5d8c11a760 0x7f5d8c107fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:55.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:55.268+0000 7f5d910cd700 1 -- 172.21.15.37:0/2087767041 >> 172.21.15.37:0/2087767041 conn(0x7f5d8c0f78d0 msgr2=0x7f5d8c0f7f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:14:55.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:55.268+0000 7f5d910cd700 1 -- 172.21.15.37:0/2087767041 shutdown_connections 2024-04-25T17:14:55.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:55.268+0000 7f5d910cd700 1 -- 172.21.15.37:0/2087767041 wait complete. 2024-04-25T17:14:55.790 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:14:55.807 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:55 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:14:56.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:55 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:14:57.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:56 smithi037 ceph-mon[26472]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:14:57.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:56 smithi069 ceph-mon[34527]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:14:57.706 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:14:57.708 INFO:teuthology.orchestra.run.smithi037.stdout:150323855374 2024-04-25T17:14:57.708 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-04-25T17:14:58.604 INFO:teuthology.orchestra.run.smithi037.stdout:81604378648 2024-04-25T17:14:58.605 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-04-25T17:14:58.834 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:58 smithi037 ceph-mon[26472]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:14:59.047 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:14:59.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:59.063+0000 7f66504a7700 1 -- 172.21.15.37:0/423811219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6648102e00 msgr2=0x7f66481031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:59.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:59.063+0000 7f66504a7700 1 --2- 172.21.15.37:0/423811219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6648102e00 0x7f66481031d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6644004940 tx=0x7f6644009e30 comp rx=0 tx=0).stop 2024-04-25T17:14:59.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:59.063+0000 7f66504a7700 1 -- 172.21.15.37:0/423811219 shutdown_connections 2024-04-25T17:14:59.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:59.063+0000 7f66504a7700 1 --2- 172.21.15.37:0/423811219 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f66481037a0 0x7f66480fce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:59.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:59.063+0000 7f66504a7700 1 --2- 172.21.15.37:0/423811219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6648102e00 0x7f66481031d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:59.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:59.063+0000 7f66504a7700 1 -- 172.21.15.37:0/423811219 >> 172.21.15.37:0/423811219 conn(0x7f66480f89b0 msgr2=0x7f66480fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:14:59.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:59.063+0000 7f66504a7700 1 -- 172.21.15.37:0/423811219 shutdown_connections 2024-04-25T17:14:59.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:59.063+0000 7f66504a7700 1 -- 172.21.15.37:0/423811219 wait complete. 2024-04-25T17:14:59.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:59.064+0000 7f66504a7700 1 Processor -- start 2024-04-25T17:14:59.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:59.064+0000 7f66504a7700 1 -- start start 2024-04-25T17:14:59.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:59.064+0000 7f66504a7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6648102e00 0x7f6648115d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:14:59.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:59.064+0000 7f66504a7700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f66481037a0 0x7f66481162c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:14:59.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:59.064+0000 7f66504a7700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6648116910 con 0x7f6648102e00 2024-04-25T17:14:59.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:59.064+0000 7f66504a7700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f664810fce0 con 0x7f66481037a0 2024-04-25T17:14:59.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:59.064+0000 7f664e243700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6648102e00 0x7f6648115d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:14:59.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:59.065+0000 7f664e243700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6648102e00 0x7f6648115d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43994/0 (socket says 172.21.15.37:43994) 2024-04-25T17:14:59.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:59.065+0000 7f664e243700 1 -- 172.21.15.37:0/4041385758 learned_addr learned my addr 172.21.15.37:0/4041385758 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:14:59.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:59.065+0000 7f664da42700 1 --2- 172.21.15.37:0/4041385758 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f66481037a0 0x7f66481162c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:14:59.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:59.065+0000 7f664e243700 1 -- 172.21.15.37:0/4041385758 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f66481037a0 msgr2=0x7f66481162c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:59.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:59.065+0000 7f664e243700 1 --2- 172.21.15.37:0/4041385758 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f66481037a0 0x7f66481162c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:59.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:59.065+0000 7f664e243700 1 -- 172.21.15.37:0/4041385758 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6644005040 con 0x7f6648102e00 2024-04-25T17:14:59.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:59.065+0000 7f664e243700 1 --2- 172.21.15.37:0/4041385758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6648102e00 0x7f6648115d80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6644009150 tx=0x7f6644009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:14:59.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:59.065+0000 7f663effd700 1 -- 172.21.15.37:0/4041385758 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f664400e040 con 0x7f6648102e00 2024-04-25T17:14:59.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:59.065+0000 7f66504a7700 1 -- 172.21.15.37:0/4041385758 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f664810ff60 con 0x7f6648102e00 2024-04-25T17:14:59.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:59.066+0000 7f66504a7700 1 -- 172.21.15.37:0/4041385758 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6648110520 con 0x7f6648102e00 2024-04-25T17:14:59.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:59.066+0000 7f663effd700 1 -- 172.21.15.37:0/4041385758 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6644013420 con 0x7f6648102e00 2024-04-25T17:14:59.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:59.066+0000 7f663effd700 1 -- 172.21.15.37:0/4041385758 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f664401c630 con 0x7f6648102e00 2024-04-25T17:14:59.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:59.067+0000 7f66504a7700 1 -- 172.21.15.37:0/4041385758 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6648107300 con 0x7f6648102e00 2024-04-25T17:14:59.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:59.068+0000 7f663effd700 1 -- 172.21.15.37:0/4041385758 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f6644013590 con 0x7f6648102e00 2024-04-25T17:14:59.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:59.069+0000 7f663effd700 1 --2- 172.21.15.37:0/4041385758 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f66340692b0 0x7f663406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:14:59.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:59.069+0000 7f663effd700 1 -- 172.21.15.37:0/4041385758 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f6644088030 con 0x7f6648102e00 2024-04-25T17:14:59.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:59.069+0000 7f664da42700 1 --2- 172.21.15.37:0/4041385758 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f66340692b0 0x7f663406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:14:59.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:59.069+0000 7f664da42700 1 --2- 172.21.15.37:0/4041385758 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f66340692b0 0x7f663406b760 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6648111620 tx=0x7f6638009ee0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:14:59.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:59.076+0000 7f663effd700 1 -- 172.21.15.37:0/4041385758 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f66440581d0 con 0x7f6648102e00 2024-04-25T17:14:59.090 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:14:59.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:58 smithi069 ceph-mon[34527]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:14:59.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:59.277+0000 7f66504a7700 1 -- 172.21.15.37:0/4041385758 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f66480fe550 con 0x7f6648102e00 2024-04-25T17:14:59.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:59.277+0000 7f663effd700 1 -- 172.21.15.37:0/4041385758 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6644057d60 con 0x7f6648102e00 2024-04-25T17:14:59.278 INFO:teuthology.orchestra.run.smithi037.stdout:38654705700 2024-04-25T17:14:59.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:59.280+0000 7f66504a7700 1 -- 172.21.15.37:0/4041385758 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f66340692b0 msgr2=0x7f663406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:59.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:59.280+0000 7f66504a7700 1 --2- 172.21.15.37:0/4041385758 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f66340692b0 0x7f663406b760 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6648111620 tx=0x7f6638009ee0 comp rx=0 tx=0).stop 2024-04-25T17:14:59.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:59.280+0000 7f66504a7700 1 -- 172.21.15.37:0/4041385758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6648102e00 msgr2=0x7f6648115d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:14:59.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:59.280+0000 7f66504a7700 1 --2- 172.21.15.37:0/4041385758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6648102e00 0x7f6648115d80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6644009150 tx=0x7f6644009e30 comp rx=0 tx=0).stop 2024-04-25T17:14:59.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:59.280+0000 7f66504a7700 1 -- 172.21.15.37:0/4041385758 shutdown_connections 2024-04-25T17:14:59.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:59.280+0000 7f66504a7700 1 --2- 172.21.15.37:0/4041385758 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f66340692b0 0x7f663406b760 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:59.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:59.280+0000 7f66504a7700 1 --2- 172.21.15.37:0/4041385758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6648102e00 0x7f6648115d80 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:59.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:59.280+0000 7f66504a7700 1 --2- 172.21.15.37:0/4041385758 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f66481037a0 0x7f66481162c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:14:59.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:59.280+0000 7f66504a7700 1 -- 172.21.15.37:0/4041385758 >> 172.21.15.37:0/4041385758 conn(0x7f66480f89b0 msgr2=0x7f6648070a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:14:59.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:59.280+0000 7f66504a7700 1 -- 172.21.15.37:0/4041385758 shutdown_connections 2024-04-25T17:14:59.280 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:14:59.280+0000 7f66504a7700 1 -- 172.21.15.37:0/4041385758 wait complete. 2024-04-25T17:14:59.983 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:14:59 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/4041385758' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-25T17:15:00.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:14:59 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/4041385758' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-04-25T17:15:01.014 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:00 smithi037 ceph-mon[26472]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:15:01.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:01.123+0000 7f6ad9a02700 1 -- 172.21.15.37:0/1576496694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ad40fbd40 msgr2=0x7f6ad40fc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:01.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:01.123+0000 7f6ad9a02700 1 --2- 172.21.15.37:0/1576496694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ad40fbd40 0x7f6ad40fc1b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6ac8004940 tx=0x7f6ac8009e30 comp rx=0 tx=0).stop 2024-04-25T17:15:01.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:01.123+0000 7f6ad9a02700 1 -- 172.21.15.37:0/1576496694 shutdown_connections 2024-04-25T17:15:01.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:01.123+0000 7f6ad9a02700 1 --2- 172.21.15.37:0/1576496694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ad40fbd40 0x7f6ad40fc1b0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:01.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:01.123+0000 7f6ad9a02700 1 --2- 172.21.15.37:0/1576496694 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6ad4101d90 0x7f6ad4102160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:01.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:01.123+0000 7f6ad9a02700 1 -- 172.21.15.37:0/1576496694 >> 172.21.15.37:0/1576496694 conn(0x7f6ad4071d00 msgr2=0x7f6ad4072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:15:01.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:01.123+0000 7f6ad9a02700 1 -- 172.21.15.37:0/1576496694 shutdown_connections 2024-04-25T17:15:01.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:01.123+0000 7f6ad9a02700 1 -- 172.21.15.37:0/1576496694 wait complete. 2024-04-25T17:15:01.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:01.124+0000 7f6ad9a02700 1 Processor -- start 2024-04-25T17:15:01.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:01.124+0000 7f6ad9a02700 1 -- start start 2024-04-25T17:15:01.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:01.124+0000 7f6ad9a02700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6ad40fbd40 0x7f6ad4113bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:15:01.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:01.124+0000 7f6ad9a02700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ad4101d90 0x7f6ad41140f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:15:01.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:01.124+0000 7f6ad9a02700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad4114740 con 0x7f6ad4101d90 2024-04-25T17:15:01.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:01.124+0000 7f6ad9a02700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad410db30 con 0x7f6ad40fbd40 2024-04-25T17:15:01.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:01.124+0000 7f6ad27fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ad4101d90 0x7f6ad41140f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:15:01.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:01.124+0000 7f6ad27fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ad4101d90 0x7f6ad41140f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44008/0 (socket says 172.21.15.37:44008) 2024-04-25T17:15:01.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:01.124+0000 7f6ad27fc700 1 -- 172.21.15.37:0/305927818 learned_addr learned my addr 172.21.15.37:0/305927818 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:15:01.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:01.124+0000 7f6ad2ffd700 1 --2- 172.21.15.37:0/305927818 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6ad40fbd40 0x7f6ad4113bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:15:01.125 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:01.124+0000 7f6ad27fc700 1 -- 172.21.15.37:0/305927818 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6ad40fbd40 msgr2=0x7f6ad4113bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:01.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:01.124+0000 7f6ad27fc700 1 --2- 172.21.15.37:0/305927818 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6ad40fbd40 0x7f6ad4113bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:01.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:01.124+0000 7f6ad27fc700 1 -- 172.21.15.37:0/305927818 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac8005040 con 0x7f6ad4101d90 2024-04-25T17:15:01.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:01.124+0000 7f6ad27fc700 1 --2- 172.21.15.37:0/305927818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ad4101d90 0x7f6ad41140f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6ac800b3b0 tx=0x7f6ac8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:15:01.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:01.125+0000 7f6abb7fe700 1 -- 172.21.15.37:0/305927818 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ac800e040 con 0x7f6ad4101d90 2024-04-25T17:15:01.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:01.125+0000 7f6abb7fe700 1 -- 172.21.15.37:0/305927818 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6ac8013420 con 0x7f6ad4101d90 2024-04-25T17:15:01.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:01.125+0000 7f6ad9a02700 1 -- 172.21.15.37:0/305927818 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ad410ddb0 con 0x7f6ad4101d90 2024-04-25T17:15:01.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:01.125+0000 7f6abb7fe700 1 -- 172.21.15.37:0/305927818 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ac801c630 con 0x7f6ad4101d90 2024-04-25T17:15:01.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:01.125+0000 7f6ad9a02700 1 -- 172.21.15.37:0/305927818 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ad410e370 con 0x7f6ad4101d90 2024-04-25T17:15:01.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:01.126+0000 7f6ad9a02700 1 -- 172.21.15.37:0/305927818 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6ad410e8e0 con 0x7f6ad4101d90 2024-04-25T17:15:01.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:01.126+0000 7f6abb7fe700 1 -- 172.21.15.37:0/305927818 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f6ac800baf0 con 0x7f6ad4101d90 2024-04-25T17:15:01.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:01.127+0000 7f6abb7fe700 1 --2- 172.21.15.37:0/305927818 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f6abc0692a0 0x7f6abc06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:15:01.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:01.127+0000 7f6abb7fe700 1 -- 172.21.15.37:0/305927818 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f6ac8088040 con 0x7f6ad4101d90 2024-04-25T17:15:01.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:01.127+0000 7f6ad2ffd700 1 --2- 172.21.15.37:0/305927818 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f6abc0692a0 0x7f6abc06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:15:01.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:01.127+0000 7f6abb7fe700 1 --2- 172.21.15.37:0/305927818 >> [v2:172.21.15.69:6816/2319222775,v1:172.21.15.69:6817/2319222775] conn(0x7f6abc06ef70 0x7f6abc071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:15:01.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:01.127+0000 7f6abb7fe700 1 -- 172.21.15.37:0/305927818 --> [v2:172.21.15.69:6816/2319222775,v1:172.21.15.69:6817/2319222775] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6abc071a30 con 0x7f6abc06ef70 2024-04-25T17:15:01.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:01.127+0000 7f6abb7fe700 1 -- 172.21.15.37:0/305927818 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ac808a6b0 con 0x7f6ad4101d90 2024-04-25T17:15:01.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:01.127+0000 7f6ad2ffd700 1 --2- 172.21.15.37:0/305927818 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f6abc0692a0 0x7f6abc06b750 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6ac40041d0 tx=0x7f6ac40043c0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:15:01.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:01.127+0000 7f6ad37fe700 1 --2- 172.21.15.37:0/305927818 >> [v2:172.21.15.69:6816/2319222775,v1:172.21.15.69:6817/2319222775] conn(0x7f6abc06ef70 0x7f6abc071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:15:01.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:01.128+0000 7f6ad37fe700 1 --2- 172.21.15.37:0/305927818 >> [v2:172.21.15.69:6816/2319222775,v1:172.21.15.69:6817/2319222775] conn(0x7f6abc06ef70 0x7f6abc071380 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:15:01.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:01.128+0000 7f6abb7fe700 1 -- 172.21.15.37:0/305927818 <== osd.5 v2:172.21.15.69:6816/2319222775 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f6abc071a30 con 0x7f6abc06ef70 2024-04-25T17:15:01.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:01.144+0000 7f6ad9a02700 1 -- 172.21.15.37:0/305927818 --> [v2:172.21.15.69:6816/2319222775,v1:172.21.15.69:6817/2319222775] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6ad40faa80 con 0x7f6abc06ef70 2024-04-25T17:15:01.144 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:01.144+0000 7f6abb7fe700 1 -- 172.21.15.37:0/305927818 <== osd.5 v2:172.21.15.69:6816/2319222775 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f6ad40faa80 con 0x7f6abc06ef70 2024-04-25T17:15:01.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:01.144+0000 7f6ad9a02700 1 -- 172.21.15.37:0/305927818 >> [v2:172.21.15.69:6816/2319222775,v1:172.21.15.69:6817/2319222775] conn(0x7f6abc06ef70 msgr2=0x7f6abc071380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:01.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:01.144+0000 7f6ad9a02700 1 --2- 172.21.15.37:0/305927818 >> [v2:172.21.15.69:6816/2319222775,v1:172.21.15.69:6817/2319222775] conn(0x7f6abc06ef70 0x7f6abc071380 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:01.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:01.144+0000 7f6ad9a02700 1 -- 172.21.15.37:0/305927818 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f6abc0692a0 msgr2=0x7f6abc06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:01.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:01.144+0000 7f6ad9a02700 1 --2- 172.21.15.37:0/305927818 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f6abc0692a0 0x7f6abc06b750 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6ac40041d0 tx=0x7f6ac40043c0 comp rx=0 tx=0).stop 2024-04-25T17:15:01.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:01.144+0000 7f6ad9a02700 1 -- 172.21.15.37:0/305927818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ad4101d90 msgr2=0x7f6ad41140f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:01.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:01.144+0000 7f6ad9a02700 1 --2- 172.21.15.37:0/305927818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ad4101d90 0x7f6ad41140f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6ac800b3b0 tx=0x7f6ac8009e30 comp rx=0 tx=0).stop 2024-04-25T17:15:01.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:01.145+0000 7f6ad9a02700 1 -- 172.21.15.37:0/305927818 shutdown_connections 2024-04-25T17:15:01.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:01.145+0000 7f6ad9a02700 1 --2- 172.21.15.37:0/305927818 >> [v2:172.21.15.69:6816/2319222775,v1:172.21.15.69:6817/2319222775] conn(0x7f6abc06ef70 0x7f6abc071380 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:01.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:01.145+0000 7f6ad9a02700 1 --2- 172.21.15.37:0/305927818 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f6abc0692a0 0x7f6abc06b750 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:01.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:01.145+0000 7f6ad9a02700 1 --2- 172.21.15.37:0/305927818 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6ad40fbd40 0x7f6ad4113bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:01.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:01.145+0000 7f6ad9a02700 1 --2- 172.21.15.37:0/305927818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ad4101d90 0x7f6ad41140f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:01.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:01.145+0000 7f6ad9a02700 1 -- 172.21.15.37:0/305927818 >> 172.21.15.37:0/305927818 conn(0x7f6ad4071d00 msgr2=0x7f6ad40fa0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:15:01.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:01.145+0000 7f6ad9a02700 1 -- 172.21.15.37:0/305927818 shutdown_connections 2024-04-25T17:15:01.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:01.145+0000 7f6ad9a02700 1 -- 172.21.15.37:0/305927818 wait complete. 2024-04-25T17:15:01.167 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:00 smithi069 ceph-mon[34527]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:15:03.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:02 smithi037 ceph-mon[26472]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:15:03.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:02 smithi069 ceph-mon[34527]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:15:03.234 INFO:teuthology.orchestra.run.smithi037.stdout:171798691851 2024-04-25T17:15:03.235 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-04-25T17:15:03.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.443+0000 7fc63ea12700 1 -- 172.21.15.37:0/3472319539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc638101d00 msgr2=0x7fc6381020d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:03.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.443+0000 7fc63ea12700 1 --2- 172.21.15.37:0/3472319539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc638101d00 0x7fc6381020d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc628004940 tx=0x7fc628009e30 comp rx=0 tx=0).stop 2024-04-25T17:15:03.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.443+0000 7fc63ea12700 1 -- 172.21.15.37:0/3472319539 shutdown_connections 2024-04-25T17:15:03.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.443+0000 7fc63ea12700 1 --2- 172.21.15.37:0/3472319539 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6381026a0 0x7fc6380fbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:03.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.443+0000 7fc63ea12700 1 --2- 172.21.15.37:0/3472319539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc638101d00 0x7fc6381020d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:03.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.443+0000 7fc63ea12700 1 -- 172.21.15.37:0/3472319539 >> 172.21.15.37:0/3472319539 conn(0x7fc6380f7870 msgr2=0x7fc6380f9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:15:03.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.443+0000 7fc63ea12700 1 -- 172.21.15.37:0/3472319539 shutdown_connections 2024-04-25T17:15:03.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.443+0000 7fc63ea12700 1 -- 172.21.15.37:0/3472319539 wait complete. 2024-04-25T17:15:03.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.444+0000 7fc63ea12700 1 Processor -- start 2024-04-25T17:15:03.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.444+0000 7fc63ea12700 1 -- start start 2024-04-25T17:15:03.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.444+0000 7fc63ea12700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc638101d00 0x7fc6381128f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:15:03.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.444+0000 7fc63ea12700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6381026a0 0x7fc638112e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:15:03.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.444+0000 7fc63ea12700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc638113480 con 0x7fc638101d00 2024-04-25T17:15:03.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.444+0000 7fc63ea12700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc63810ca80 con 0x7fc6381026a0 2024-04-25T17:15:03.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.445+0000 7fc637fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc638101d00 0x7fc6381128f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:15:03.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.445+0000 7fc637fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc638101d00 0x7fc6381128f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44028/0 (socket says 172.21.15.37:44028) 2024-04-25T17:15:03.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.445+0000 7fc637fff700 1 -- 172.21.15.37:0/1494915794 learned_addr learned my addr 172.21.15.37:0/1494915794 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:15:03.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.445+0000 7fc6377fe700 1 --2- 172.21.15.37:0/1494915794 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6381026a0 0x7fc638112e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:15:03.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.445+0000 7fc637fff700 1 -- 172.21.15.37:0/1494915794 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6381026a0 msgr2=0x7fc638112e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:03.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.445+0000 7fc637fff700 1 --2- 172.21.15.37:0/1494915794 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6381026a0 0x7fc638112e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:03.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.445+0000 7fc637fff700 1 -- 172.21.15.37:0/1494915794 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc628005040 con 0x7fc638101d00 2024-04-25T17:15:03.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.445+0000 7fc637fff700 1 --2- 172.21.15.37:0/1494915794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc638101d00 0x7fc6381128f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc62800b8b0 tx=0x7fc628009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:15:03.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.445+0000 7fc634ff9700 1 -- 172.21.15.37:0/1494915794 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc62800e040 con 0x7fc638101d00 2024-04-25T17:15:03.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.445+0000 7fc63ea12700 1 -- 172.21.15.37:0/1494915794 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc63810cd00 con 0x7fc638101d00 2024-04-25T17:15:03.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.445+0000 7fc634ff9700 1 -- 172.21.15.37:0/1494915794 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc628004290 con 0x7fc638101d00 2024-04-25T17:15:03.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.445+0000 7fc634ff9700 1 -- 172.21.15.37:0/1494915794 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc62801a630 con 0x7fc638101d00 2024-04-25T17:15:03.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.446+0000 7fc63ea12700 1 -- 172.21.15.37:0/1494915794 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc63810d2c0 con 0x7fc638101d00 2024-04-25T17:15:03.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.447+0000 7fc63ea12700 1 -- 172.21.15.37:0/1494915794 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6380fd450 con 0x7fc638101d00 2024-04-25T17:15:03.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.447+0000 7fc634ff9700 1 -- 172.21.15.37:0/1494915794 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fc628020020 con 0x7fc638101d00 2024-04-25T17:15:03.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.447+0000 7fc634ff9700 1 --2- 172.21.15.37:0/1494915794 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fc6200692a0 0x7fc62006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:15:03.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.447+0000 7fc634ff9700 1 -- 172.21.15.37:0/1494915794 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fc628089bf0 con 0x7fc638101d00 2024-04-25T17:15:03.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.447+0000 7fc6377fe700 1 --2- 172.21.15.37:0/1494915794 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fc6200692a0 0x7fc62006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:15:03.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.448+0000 7fc6377fe700 1 --2- 172.21.15.37:0/1494915794 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fc6200692a0 0x7fc62006b750 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc62c007fd0 tx=0x7fc62c009040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:15:03.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.456+0000 7fc634ff9700 1 -- 172.21.15.37:0/1494915794 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fc628059d90 con 0x7fc638101d00 2024-04-25T17:15:03.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.660+0000 7fc63ea12700 1 -- 172.21.15.37:0/1494915794 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fc638108e20 con 0x7fc638101d00 2024-04-25T17:15:03.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.660+0000 7fc634ff9700 1 -- 172.21.15.37:0/1494915794 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc628028090 con 0x7fc638101d00 2024-04-25T17:15:03.660 INFO:teuthology.orchestra.run.smithi037.stdout:115964117011 2024-04-25T17:15:03.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.663+0000 7fc63ea12700 1 -- 172.21.15.37:0/1494915794 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fc6200692a0 msgr2=0x7fc62006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:03.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.663+0000 7fc63ea12700 1 --2- 172.21.15.37:0/1494915794 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fc6200692a0 0x7fc62006b750 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc62c007fd0 tx=0x7fc62c009040 comp rx=0 tx=0).stop 2024-04-25T17:15:03.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.663+0000 7fc63ea12700 1 -- 172.21.15.37:0/1494915794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc638101d00 msgr2=0x7fc6381128f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:03.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.663+0000 7fc63ea12700 1 --2- 172.21.15.37:0/1494915794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc638101d00 0x7fc6381128f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc62800b8b0 tx=0x7fc628009e30 comp rx=0 tx=0).stop 2024-04-25T17:15:03.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.663+0000 7fc63ea12700 1 -- 172.21.15.37:0/1494915794 shutdown_connections 2024-04-25T17:15:03.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.663+0000 7fc63ea12700 1 --2- 172.21.15.37:0/1494915794 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fc6200692a0 0x7fc62006b750 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:03.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.663+0000 7fc63ea12700 1 --2- 172.21.15.37:0/1494915794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc638101d00 0x7fc6381128f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:03.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.663+0000 7fc63ea12700 1 --2- 172.21.15.37:0/1494915794 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6381026a0 0x7fc638112e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:03.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.663+0000 7fc63ea12700 1 -- 172.21.15.37:0/1494915794 >> 172.21.15.37:0/1494915794 conn(0x7fc6380f7870 msgr2=0x7fc6380f8820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:15:03.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.663+0000 7fc63ea12700 1 -- 172.21.15.37:0/1494915794 shutdown_connections 2024-04-25T17:15:03.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.663+0000 7fc63ea12700 1 -- 172.21.15.37:0/1494915794 wait complete. 2024-04-25T17:15:03.679 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:15:04.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:03 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/1494915794' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-25T17:15:04.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:03 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/1494915794' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-04-25T17:15:04.577 INFO:tasks.cephadm.ceph_manager.ceph:need seq 115964117010 got 115964117011 for osd.3 2024-04-25T17:15:04.577 DEBUG:teuthology.parallel:result is None 2024-04-25T17:15:04.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:04 smithi037 ceph-mon[26472]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:15:04.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:04 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/1235836178' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-25T17:15:05.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:04 smithi069 ceph-mon[34527]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:15:05.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:04 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/1235836178' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-04-25T17:15:05.640 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705698 got 38654705700 for osd.0 2024-04-25T17:15:05.640 DEBUG:teuthology.parallel:result is None 2024-04-25T17:15:05.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.916+0000 7fd9c4c28700 1 -- 172.21.15.37:0/1022977077 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9c0101d90 msgr2=0x7fd9c0102160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:05.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.916+0000 7fd9c4c28700 1 --2- 172.21.15.37:0/1022977077 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9c0101d90 0x7fd9c0102160 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd9b0004940 tx=0x7fd9b0009e30 comp rx=0 tx=0).stop 2024-04-25T17:15:05.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.916+0000 7fd9c4c28700 1 -- 172.21.15.37:0/1022977077 shutdown_connections 2024-04-25T17:15:05.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.916+0000 7fd9c4c28700 1 --2- 172.21.15.37:0/1022977077 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9c00fbd40 0x7fd9c00fc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:05.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.916+0000 7fd9c4c28700 1 --2- 172.21.15.37:0/1022977077 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9c0101d90 0x7fd9c0102160 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:05.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.916+0000 7fd9c4c28700 1 -- 172.21.15.37:0/1022977077 >> 172.21.15.37:0/1022977077 conn(0x7fd9c0071d00 msgr2=0x7fd9c0072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:15:05.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.916+0000 7fd9c4c28700 1 -- 172.21.15.37:0/1022977077 shutdown_connections 2024-04-25T17:15:05.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.916+0000 7fd9c4c28700 1 -- 172.21.15.37:0/1022977077 wait complete. 2024-04-25T17:15:05.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.917+0000 7fd9c4c28700 1 Processor -- start 2024-04-25T17:15:05.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.917+0000 7fd9c4c28700 1 -- start start 2024-04-25T17:15:05.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.917+0000 7fd9c4c28700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9c00fbd40 0x7fd9c0113b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:15:05.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.917+0000 7fd9c4c28700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9c0101d90 0x7fd9c01140c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:15:05.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.917+0000 7fd9c4c28700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c0114710 con 0x7fd9c0101d90 2024-04-25T17:15:05.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.917+0000 7fd9c4c28700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c010db00 con 0x7fd9c00fbd40 2024-04-25T17:15:05.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.917+0000 7fd9bdd9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9c0101d90 0x7fd9c01140c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:15:05.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.917+0000 7fd9bdd9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9c0101d90 0x7fd9c01140c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44046/0 (socket says 172.21.15.37:44046) 2024-04-25T17:15:05.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.917+0000 7fd9bdd9b700 1 -- 172.21.15.37:0/1235836178 learned_addr learned my addr 172.21.15.37:0/1235836178 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:15:05.730 INFO:teuthology.orchestra.run.smithi037.stdout:150323855376 2024-04-25T17:15:05.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.917+0000 7fd9be59c700 1 --2- 172.21.15.37:0/1235836178 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9c00fbd40 0x7fd9c0113b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:15:05.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.917+0000 7fd9bdd9b700 1 -- 172.21.15.37:0/1235836178 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9c00fbd40 msgr2=0x7fd9c0113b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:05.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.917+0000 7fd9bdd9b700 1 --2- 172.21.15.37:0/1235836178 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9c00fbd40 0x7fd9c0113b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:05.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.917+0000 7fd9bdd9b700 1 -- 172.21.15.37:0/1235836178 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b0005040 con 0x7fd9c0101d90 2024-04-25T17:15:05.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.917+0000 7fd9be59c700 1 --2- 172.21.15.37:0/1235836178 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9c00fbd40 0x7fd9c0113b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T17:15:05.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.917+0000 7fd9bdd9b700 1 --2- 172.21.15.37:0/1235836178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9c0101d90 0x7fd9c01140c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd9b400c8c0 tx=0x7fd9b40044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:15:05.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.917+0000 7fd9aeffd700 1 -- 172.21.15.37:0/1235836178 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9b400a980 con 0x7fd9c0101d90 2024-04-25T17:15:05.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.917+0000 7fd9c4c28700 1 -- 172.21.15.37:0/1235836178 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9c010dde0 con 0x7fd9c0101d90 2024-04-25T17:15:05.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.917+0000 7fd9aeffd700 1 -- 172.21.15.37:0/1235836178 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd9b400ce60 con 0x7fd9c0101d90 2024-04-25T17:15:05.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.917+0000 7fd9aeffd700 1 -- 172.21.15.37:0/1235836178 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9b40115e0 con 0x7fd9c0101d90 2024-04-25T17:15:05.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.918+0000 7fd9c4c28700 1 -- 172.21.15.37:0/1235836178 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9c010e3a0 con 0x7fd9c0101d90 2024-04-25T17:15:05.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.918+0000 7fd9c4c28700 1 -- 172.21.15.37:0/1235836178 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9c00fd430 con 0x7fd9c0101d90 2024-04-25T17:15:05.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.919+0000 7fd9aeffd700 1 -- 172.21.15.37:0/1235836178 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fd9b4012400 con 0x7fd9c0101d90 2024-04-25T17:15:05.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.919+0000 7fd9aeffd700 1 --2- 172.21.15.37:0/1235836178 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fd9a80692a0 0x7fd9a806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:15:05.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.920+0000 7fd9aeffd700 1 -- 172.21.15.37:0/1235836178 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fd9b4086f60 con 0x7fd9c0101d90 2024-04-25T17:15:05.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.920+0000 7fd9be59c700 1 --2- 172.21.15.37:0/1235836178 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fd9a80692a0 0x7fd9a806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:15:05.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.920+0000 7fd9be59c700 1 --2- 172.21.15.37:0/1235836178 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fd9a80692a0 0x7fd9a806b750 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd9b0004560 tx=0x7fd9b0009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:15:05.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:03.924+0000 7fd9aeffd700 1 -- 172.21.15.37:0/1235836178 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fd9b4057060 con 0x7fd9c0101d90 2024-04-25T17:15:05.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:04.121+0000 7fd9c4c28700 1 -- 172.21.15.37:0/1235836178 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fd9c0108df0 con 0x7fd9c0101d90 2024-04-25T17:15:05.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:04.121+0000 7fd9aeffd700 1 -- 172.21.15.37:0/1235836178 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd9b40126b0 con 0x7fd9c0101d90 2024-04-25T17:15:05.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:04.123+0000 7fd9c4c28700 1 -- 172.21.15.37:0/1235836178 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fd9a80692a0 msgr2=0x7fd9a806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:05.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:04.123+0000 7fd9c4c28700 1 --2- 172.21.15.37:0/1235836178 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fd9a80692a0 0x7fd9a806b750 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd9b0004560 tx=0x7fd9b0009e30 comp rx=0 tx=0).stop 2024-04-25T17:15:05.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:04.123+0000 7fd9c4c28700 1 -- 172.21.15.37:0/1235836178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9c0101d90 msgr2=0x7fd9c01140c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:05.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:04.123+0000 7fd9c4c28700 1 --2- 172.21.15.37:0/1235836178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9c0101d90 0x7fd9c01140c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd9b400c8c0 tx=0x7fd9b40044c0 comp rx=0 tx=0).stop 2024-04-25T17:15:05.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:04.123+0000 7fd9c4c28700 1 -- 172.21.15.37:0/1235836178 shutdown_connections 2024-04-25T17:15:05.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:04.123+0000 7fd9c4c28700 1 --2- 172.21.15.37:0/1235836178 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fd9a80692a0 0x7fd9a806b750 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:05.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:04.123+0000 7fd9c4c28700 1 --2- 172.21.15.37:0/1235836178 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9c00fbd40 0x7fd9c0113b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:05.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:04.123+0000 7fd9c4c28700 1 --2- 172.21.15.37:0/1235836178 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9c0101d90 0x7fd9c01140c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:05.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:04.123+0000 7fd9c4c28700 1 -- 172.21.15.37:0/1235836178 >> 172.21.15.37:0/1235836178 conn(0x7fd9c0071d00 msgr2=0x7fd9c00fa810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:15:05.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:04.123+0000 7fd9c4c28700 1 -- 172.21.15.37:0/1235836178 shutdown_connections 2024-04-25T17:15:05.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:04.123+0000 7fd9c4c28700 1 -- 172.21.15.37:0/1235836178 wait complete. 2024-04-25T17:15:06.435 INFO:tasks.cephadm.ceph_manager.ceph:need seq 150323855374 got 150323855376 for osd.4 2024-04-25T17:15:06.435 DEBUG:teuthology.parallel:result is None 2024-04-25T17:15:06.907 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:15:07.006 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:06 smithi037 ceph-mon[26472]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:15:07.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:06 smithi069 ceph-mon[34527]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:15:07.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:07.862+0000 7f58baeef700 1 -- 172.21.15.37:0/4180968694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58b4101d10 msgr2=0x7f58b41020e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:07.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:07.862+0000 7f58baeef700 1 --2- 172.21.15.37:0/4180968694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58b4101d10 0x7f58b41020e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f58a4004940 tx=0x7f58a4009e30 comp rx=0 tx=0).stop 2024-04-25T17:15:07.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:07.862+0000 7f58baeef700 1 -- 172.21.15.37:0/4180968694 shutdown_connections 2024-04-25T17:15:07.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:07.862+0000 7f58baeef700 1 --2- 172.21.15.37:0/4180968694 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f58b41026b0 0x7f58b40fbd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:07.870 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:07.862+0000 7f58baeef700 1 --2- 172.21.15.37:0/4180968694 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58b4101d10 0x7f58b41020e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:07.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:07.862+0000 7f58baeef700 1 -- 172.21.15.37:0/4180968694 >> 172.21.15.37:0/4180968694 conn(0x7f58b40f7820 msgr2=0x7f58b40f9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:15:07.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:07.862+0000 7f58baeef700 1 -- 172.21.15.37:0/4180968694 shutdown_connections 2024-04-25T17:15:07.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:07.862+0000 7f58baeef700 1 -- 172.21.15.37:0/4180968694 wait complete. 2024-04-25T17:15:07.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:07.863+0000 7f58baeef700 1 Processor -- start 2024-04-25T17:15:07.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:07.863+0000 7f58baeef700 1 -- start start 2024-04-25T17:15:07.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:07.863+0000 7f58baeef700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58b4101d10 0x7f58b4102b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:15:07.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:07.863+0000 7f58baeef700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f58b41026b0 0x7f58b41030b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:15:07.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:07.863+0000 7f58baeef700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b4104b50 con 0x7f58b4101d10 2024-04-25T17:15:07.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:07.863+0000 7f58baeef700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b41035f0 con 0x7f58b41026b0 2024-04-25T17:15:07.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:07.863+0000 7f58b8c8b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58b4101d10 0x7f58b4102b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:15:07.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:07.863+0000 7f58b8c8b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58b4101d10 0x7f58b4102b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39656/0 (socket says 172.21.15.37:39656) 2024-04-25T17:15:07.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:07.863+0000 7f58b8c8b700 1 -- 172.21.15.37:0/2254757811 learned_addr learned my addr 172.21.15.37:0/2254757811 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:15:07.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:07.864+0000 7f58b3fff700 1 --2- 172.21.15.37:0/2254757811 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f58b41026b0 0x7f58b41030b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:15:07.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:07.864+0000 7f58b8c8b700 1 -- 172.21.15.37:0/2254757811 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f58b41026b0 msgr2=0x7f58b41030b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:07.871 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:07.864+0000 7f58b8c8b700 1 --2- 172.21.15.37:0/2254757811 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f58b41026b0 0x7f58b41030b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:07.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:07.864+0000 7f58b8c8b700 1 -- 172.21.15.37:0/2254757811 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a4005040 con 0x7f58b4101d10 2024-04-25T17:15:07.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:07.864+0000 7f58b8c8b700 1 --2- 172.21.15.37:0/2254757811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58b4101d10 0x7f58b4102b70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f58a400b3b0 tx=0x7f58a4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:15:07.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:07.864+0000 7f58b17fa700 1 -- 172.21.15.37:0/2254757811 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58a400e040 con 0x7f58b4101d10 2024-04-25T17:15:07.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:07.864+0000 7f58b17fa700 1 -- 172.21.15.37:0/2254757811 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f58a400bbc0 con 0x7f58b4101d10 2024-04-25T17:15:07.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:07.864+0000 7f58baeef700 1 -- 172.21.15.37:0/2254757811 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58b4103870 con 0x7f58b4101d10 2024-04-25T17:15:07.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:07.864+0000 7f58b17fa700 1 -- 172.21.15.37:0/2254757811 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58a401c3f0 con 0x7f58b4101d10 2024-04-25T17:15:07.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:07.864+0000 7f58baeef700 1 -- 172.21.15.37:0/2254757811 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58b411a4b0 con 0x7f58b4101d10 2024-04-25T17:15:07.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:07.865+0000 7f58baeef700 1 -- 172.21.15.37:0/2254757811 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58b40fd460 con 0x7f58b4101d10 2024-04-25T17:15:07.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:07.866+0000 7f58b17fa700 1 -- 172.21.15.37:0/2254757811 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f58a400bd30 con 0x7f58b4101d10 2024-04-25T17:15:07.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:07.866+0000 7f58b17fa700 1 --2- 172.21.15.37:0/2254757811 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f589c0692a0 0x7f589c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:15:07.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:07.866+0000 7f58b17fa700 1 -- 172.21.15.37:0/2254757811 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f58a40880f0 con 0x7f58b4101d10 2024-04-25T17:15:07.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:07.866+0000 7f58b3fff700 1 --2- 172.21.15.37:0/2254757811 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f589c0692a0 0x7f589c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:15:07.872 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:07.867+0000 7f58b3fff700 1 --2- 172.21.15.37:0/2254757811 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f589c0692a0 0x7f589c06b750 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f58a8006fd0 tx=0x7f58a8008040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:15:07.873 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:07.871+0000 7f58b17fa700 1 -- 172.21.15.37:0/2254757811 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f58a40546e0 con 0x7f58b4101d10 2024-04-25T17:15:08.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:08.067+0000 7f58baeef700 1 -- 172.21.15.37:0/2254757811 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f58b404c710 con 0x7f58b4101d10 2024-04-25T17:15:08.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:08.068+0000 7f58b17fa700 1 -- 172.21.15.37:0/2254757811 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f58a4086e60 con 0x7f58b4101d10 2024-04-25T17:15:08.068 INFO:teuthology.orchestra.run.smithi037.stdout:60129542177 2024-04-25T17:15:08.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:08.070+0000 7f58baeef700 1 -- 172.21.15.37:0/2254757811 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f589c0692a0 msgr2=0x7f589c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:08.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:08.070+0000 7f58baeef700 1 --2- 172.21.15.37:0/2254757811 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f589c0692a0 0x7f589c06b750 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f58a8006fd0 tx=0x7f58a8008040 comp rx=0 tx=0).stop 2024-04-25T17:15:08.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:08.070+0000 7f58baeef700 1 -- 172.21.15.37:0/2254757811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58b4101d10 msgr2=0x7f58b4102b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:08.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:08.070+0000 7f58baeef700 1 --2- 172.21.15.37:0/2254757811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58b4101d10 0x7f58b4102b70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f58a400b3b0 tx=0x7f58a4009e30 comp rx=0 tx=0).stop 2024-04-25T17:15:08.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:08.070+0000 7f58baeef700 1 -- 172.21.15.37:0/2254757811 shutdown_connections 2024-04-25T17:15:08.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:08.070+0000 7f58baeef700 1 --2- 172.21.15.37:0/2254757811 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f589c0692a0 0x7f589c06b750 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:08.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:08.070+0000 7f58baeef700 1 --2- 172.21.15.37:0/2254757811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f58b4101d10 0x7f58b4102b70 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:08.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:08.070+0000 7f58baeef700 1 --2- 172.21.15.37:0/2254757811 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f58b41026b0 0x7f58b41030b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:08.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:08.070+0000 7f58baeef700 1 -- 172.21.15.37:0/2254757811 >> 172.21.15.37:0/2254757811 conn(0x7f58b40f7820 msgr2=0x7f58b40f8710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:15:08.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:08.070+0000 7f58baeef700 1 -- 172.21.15.37:0/2254757811 shutdown_connections 2024-04-25T17:15:08.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:08.070+0000 7f58baeef700 1 -- 172.21.15.37:0/2254757811 wait complete. 2024-04-25T17:15:08.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:08.543+0000 7fc013964700 1 -- 172.21.15.37:0/1224361055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc00c102e50 msgr2=0x7fc00c103220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:08.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:08.543+0000 7fc013964700 1 --2- 172.21.15.37:0/1224361055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc00c102e50 0x7fc00c103220 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc008004940 tx=0x7fc008009e30 comp rx=0 tx=0).stop 2024-04-25T17:15:08.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:08.543+0000 7fc013964700 1 -- 172.21.15.37:0/1224361055 shutdown_connections 2024-04-25T17:15:08.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:08.543+0000 7fc013964700 1 --2- 172.21.15.37:0/1224361055 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc00c065640 0x7fc00c065ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:08.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:08.543+0000 7fc013964700 1 --2- 172.21.15.37:0/1224361055 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc00c102e50 0x7fc00c103220 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:08.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:08.543+0000 7fc013964700 1 -- 172.21.15.37:0/1224361055 >> 172.21.15.37:0/1224361055 conn(0x7fc00c071d00 msgr2=0x7fc00c072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:15:08.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:08.543+0000 7fc013964700 1 -- 172.21.15.37:0/1224361055 shutdown_connections 2024-04-25T17:15:08.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:08.543+0000 7fc013964700 1 -- 172.21.15.37:0/1224361055 wait complete. 2024-04-25T17:15:08.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:08.544+0000 7fc013964700 1 Processor -- start 2024-04-25T17:15:08.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:08.544+0000 7fc013964700 1 -- start start 2024-04-25T17:15:08.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:08.544+0000 7fc013964700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc00c065640 0x7fc00c113b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:15:08.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:08.544+0000 7fc013964700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc00c102e50 0x7fc00c1140c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:15:08.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:08.544+0000 7fc013964700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc00c1147a0 con 0x7fc00c065640 2024-04-25T17:15:08.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:08.544+0000 7fc013964700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc00c10db00 con 0x7fc00c102e50 2024-04-25T17:15:08.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:08.544+0000 7fc011700700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc00c065640 0x7fc00c113b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:15:08.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:08.544+0000 7fc011700700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc00c065640 0x7fc00c113b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39672/0 (socket says 172.21.15.37:39672) 2024-04-25T17:15:08.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:08.544+0000 7fc011700700 1 -- 172.21.15.37:0/385494432 learned_addr learned my addr 172.21.15.37:0/385494432 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:15:08.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:08.544+0000 7fc010eff700 1 --2- 172.21.15.37:0/385494432 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc00c102e50 0x7fc00c1140c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:15:08.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:08.544+0000 7fc011700700 1 -- 172.21.15.37:0/385494432 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc00c102e50 msgr2=0x7fc00c1140c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:08.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:08.544+0000 7fc011700700 1 --2- 172.21.15.37:0/385494432 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc00c102e50 0x7fc00c1140c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:08.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:08.544+0000 7fc011700700 1 -- 172.21.15.37:0/385494432 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc008005040 con 0x7fc00c065640 2024-04-25T17:15:08.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:08.545+0000 7fc011700700 1 --2- 172.21.15.37:0/385494432 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc00c065640 0x7fc00c113b80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc00800b8b0 tx=0x7fc008009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:15:08.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:08.545+0000 7fc001ffb700 1 -- 172.21.15.37:0/385494432 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc00800e040 con 0x7fc00c065640 2024-04-25T17:15:08.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:08.545+0000 7fc001ffb700 1 -- 172.21.15.37:0/385494432 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc008004290 con 0x7fc00c065640 2024-04-25T17:15:08.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:08.545+0000 7fc013964700 1 -- 172.21.15.37:0/385494432 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc00c10dd80 con 0x7fc00c065640 2024-04-25T17:15:08.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:08.545+0000 7fc001ffb700 1 -- 172.21.15.37:0/385494432 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc00801c3f0 con 0x7fc00c065640 2024-04-25T17:15:08.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:08.545+0000 7fc013964700 1 -- 172.21.15.37:0/385494432 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc00c10e340 con 0x7fc00c065640 2024-04-25T17:15:08.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:08.546+0000 7fc013964700 1 -- 172.21.15.37:0/385494432 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc00c0fe540 con 0x7fc00c065640 2024-04-25T17:15:08.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:08.546+0000 7fc001ffb700 1 -- 172.21.15.37:0/385494432 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fc0080137b0 con 0x7fc00c065640 2024-04-25T17:15:08.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:08.547+0000 7fc001ffb700 1 --2- 172.21.15.37:0/385494432 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fbff80692a0 0x7fbff806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:15:08.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:08.547+0000 7fc001ffb700 1 -- 172.21.15.37:0/385494432 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fc0080880a0 con 0x7fc00c065640 2024-04-25T17:15:08.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:08.547+0000 7fc010eff700 1 --2- 172.21.15.37:0/385494432 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fbff80692a0 0x7fbff806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:15:08.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:08.547+0000 7fc010eff700 1 --2- 172.21.15.37:0/385494432 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fbff80692a0 0x7fbff806b750 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbffc006fd0 tx=0x7fbffc008040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:15:08.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:08.551+0000 7fc001ffb700 1 -- 172.21.15.37:0/385494432 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fc008058240 con 0x7fc00c065640 2024-04-25T17:15:08.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:08.754+0000 7fc013964700 1 -- 172.21.15.37:0/385494432 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc00c04bed0 con 0x7fc00c065640 2024-04-25T17:15:08.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:08.754+0000 7fc001ffb700 1 -- 172.21.15.37:0/385494432 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc008057dd0 con 0x7fc00c065640 2024-04-25T17:15:08.754 INFO:teuthology.orchestra.run.smithi037.stdout:81604378651 2024-04-25T17:15:08.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:08.756+0000 7fc013964700 1 -- 172.21.15.37:0/385494432 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fbff80692a0 msgr2=0x7fbff806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:08.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:08.756+0000 7fc013964700 1 --2- 172.21.15.37:0/385494432 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fbff80692a0 0x7fbff806b750 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbffc006fd0 tx=0x7fbffc008040 comp rx=0 tx=0).stop 2024-04-25T17:15:08.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:08.756+0000 7fc013964700 1 -- 172.21.15.37:0/385494432 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc00c065640 msgr2=0x7fc00c113b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:08.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:08.756+0000 7fc013964700 1 --2- 172.21.15.37:0/385494432 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc00c065640 0x7fc00c113b80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc00800b8b0 tx=0x7fc008009e30 comp rx=0 tx=0).stop 2024-04-25T17:15:08.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:08.756+0000 7fc013964700 1 -- 172.21.15.37:0/385494432 shutdown_connections 2024-04-25T17:15:08.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:08.756+0000 7fc013964700 1 --2- 172.21.15.37:0/385494432 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fbff80692a0 0x7fbff806b750 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:08.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:08.756+0000 7fc013964700 1 --2- 172.21.15.37:0/385494432 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc00c065640 0x7fc00c113b80 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:08.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:08.756+0000 7fc013964700 1 --2- 172.21.15.37:0/385494432 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc00c102e50 0x7fc00c1140c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:08.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:08.756+0000 7fc013964700 1 -- 172.21.15.37:0/385494432 >> 172.21.15.37:0/385494432 conn(0x7fc00c071d00 msgr2=0x7fc00c0fa0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:15:08.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:08.756+0000 7fc013964700 1 -- 172.21.15.37:0/385494432 shutdown_connections 2024-04-25T17:15:08.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:08.756+0000 7fc013964700 1 -- 172.21.15.37:0/385494432 wait complete. 2024-04-25T17:15:09.054 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:08 smithi037 ceph-mon[26472]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:15:09.054 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:08 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/2254757811' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-25T17:15:09.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:08 smithi069 ceph-mon[34527]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:15:09.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:08 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/2254757811' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-04-25T17:15:09.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:09 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/385494432' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-25T17:15:10.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:09 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/385494432' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-04-25T17:15:10.458 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378648 got 81604378651 for osd.2 2024-04-25T17:15:10.458 DEBUG:teuthology.parallel:result is None 2024-04-25T17:15:10.785 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542173 got 60129542177 for osd.1 2024-04-25T17:15:10.786 DEBUG:teuthology.parallel:result is None 2024-04-25T17:15:11.025 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:10 smithi037 ceph-mon[26472]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:15:11.025 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:10 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:15:11.170 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:10 smithi069 ceph-mon[34527]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:15:11.171 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:10 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:15:11.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:11.280+0000 7f49ee254700 1 -- 172.21.15.37:0/4189068005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49e8102f60 msgr2=0x7f49e8103330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:11.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:11.280+0000 7f49ee254700 1 --2- 172.21.15.37:0/4189068005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49e8102f60 0x7f49e8103330 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f49d8004940 tx=0x7f49d8009e30 comp rx=0 tx=0).stop 2024-04-25T17:15:11.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:11.280+0000 7f49ee254700 1 -- 172.21.15.37:0/4189068005 shutdown_connections 2024-04-25T17:15:11.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:11.280+0000 7f49ee254700 1 --2- 172.21.15.37:0/4189068005 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f49e80fb520 0x7f49e80fb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:11.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:11.280+0000 7f49ee254700 1 --2- 172.21.15.37:0/4189068005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49e8102f60 0x7f49e8103330 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:11.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:11.280+0000 7f49ee254700 1 -- 172.21.15.37:0/4189068005 >> 172.21.15.37:0/4189068005 conn(0x7f49e80714d0 msgr2=0x7f49e80718d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:15:11.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:11.280+0000 7f49ee254700 1 -- 172.21.15.37:0/4189068005 shutdown_connections 2024-04-25T17:15:11.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:11.281+0000 7f49ee254700 1 -- 172.21.15.37:0/4189068005 wait complete. 2024-04-25T17:15:11.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:11.281+0000 7f49ee254700 1 Processor -- start 2024-04-25T17:15:11.282 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:11.281+0000 7f49ee254700 1 -- start start 2024-04-25T17:15:11.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:11.281+0000 7f49ee254700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49e80fb520 0x7f49e8113a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:15:11.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:11.281+0000 7f49ee254700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f49e8102f60 0x7f49e8113f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:15:11.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:11.281+0000 7f49ee254700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e8114660 con 0x7f49e80fb520 2024-04-25T17:15:11.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:11.281+0000 7f49ee254700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e810dbb0 con 0x7f49e8102f60 2024-04-25T17:15:11.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:11.282+0000 7f49e77fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49e80fb520 0x7f49e8113a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:15:11.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:11.282+0000 7f49e77fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49e80fb520 0x7f49e8113a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39692/0 (socket says 172.21.15.37:39692) 2024-04-25T17:15:11.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:11.282+0000 7f49e77fe700 1 -- 172.21.15.37:0/1063256675 learned_addr learned my addr 172.21.15.37:0/1063256675 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:15:11.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:11.282+0000 7f49e6ffd700 1 --2- 172.21.15.37:0/1063256675 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f49e8102f60 0x7f49e8113f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:15:11.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:11.282+0000 7f49e77fe700 1 -- 172.21.15.37:0/1063256675 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f49e8102f60 msgr2=0x7f49e8113f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:11.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:11.282+0000 7f49e77fe700 1 --2- 172.21.15.37:0/1063256675 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f49e8102f60 0x7f49e8113f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:11.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:11.282+0000 7f49e77fe700 1 -- 172.21.15.37:0/1063256675 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d8005040 con 0x7f49e80fb520 2024-04-25T17:15:11.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:11.282+0000 7f49e6ffd700 1 --2- 172.21.15.37:0/1063256675 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f49e8102f60 0x7f49e8113f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T17:15:11.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:11.282+0000 7f49e77fe700 1 --2- 172.21.15.37:0/1063256675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49e80fb520 0x7f49e8113a40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f49d800b3b0 tx=0x7f49d8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:15:11.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:11.282+0000 7f49cffff700 1 -- 172.21.15.37:0/1063256675 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49d800e040 con 0x7f49e80fb520 2024-04-25T17:15:11.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:11.282+0000 7f49cffff700 1 -- 172.21.15.37:0/1063256675 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f49d800bbc0 con 0x7f49e80fb520 2024-04-25T17:15:11.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:11.282+0000 7f49cffff700 1 -- 172.21.15.37:0/1063256675 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49d801c630 con 0x7f49e80fb520 2024-04-25T17:15:11.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:11.282+0000 7f49ee254700 1 -- 172.21.15.37:0/1063256675 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49e810ddd0 con 0x7f49e80fb520 2024-04-25T17:15:11.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:11.282+0000 7f49ee254700 1 -- 172.21.15.37:0/1063256675 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49e810e310 con 0x7f49e80fb520 2024-04-25T17:15:11.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:11.283+0000 7f49ee254700 1 -- 172.21.15.37:0/1063256675 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49e8100250 con 0x7f49e80fb520 2024-04-25T17:15:11.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:11.284+0000 7f49cffff700 1 -- 172.21.15.37:0/1063256675 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f49d800bd30 con 0x7f49e80fb520 2024-04-25T17:15:11.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:11.285+0000 7f49cffff700 1 --2- 172.21.15.37:0/1063256675 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f49d00692a0 0x7f49d006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:15:11.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:11.285+0000 7f49e6ffd700 1 --2- 172.21.15.37:0/1063256675 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f49d00692a0 0x7f49d006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:15:11.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:11.285+0000 7f49cffff700 1 -- 172.21.15.37:0/1063256675 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f49d8088010 con 0x7f49e80fb520 2024-04-25T17:15:11.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:11.285+0000 7f49e6ffd700 1 --2- 172.21.15.37:0/1063256675 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f49d00692a0 0x7f49d006b750 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f49dc006fd0 tx=0x7f49dc008040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:15:11.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:11.289+0000 7f49cffff700 1 -- 172.21.15.37:0/1063256675 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f49d80581b0 con 0x7f49e80fb520 2024-04-25T17:15:11.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:11.484+0000 7f49ee254700 1 -- 172.21.15.37:0/1063256675 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f49e810a060 con 0x7f49e80fb520 2024-04-25T17:15:11.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:11.484+0000 7f49cffff700 1 -- 172.21.15.37:0/1063256675 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f49d8057d40 con 0x7f49e80fb520 2024-04-25T17:15:11.485 INFO:teuthology.orchestra.run.smithi037.stdout:171798691853 2024-04-25T17:15:11.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:11.486+0000 7f49ee254700 1 -- 172.21.15.37:0/1063256675 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f49d00692a0 msgr2=0x7f49d006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:11.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:11.486+0000 7f49ee254700 1 --2- 172.21.15.37:0/1063256675 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f49d00692a0 0x7f49d006b750 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f49dc006fd0 tx=0x7f49dc008040 comp rx=0 tx=0).stop 2024-04-25T17:15:11.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:11.486+0000 7f49ee254700 1 -- 172.21.15.37:0/1063256675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49e80fb520 msgr2=0x7f49e8113a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:11.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:11.486+0000 7f49ee254700 1 --2- 172.21.15.37:0/1063256675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49e80fb520 0x7f49e8113a40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f49d800b3b0 tx=0x7f49d8009e30 comp rx=0 tx=0).stop 2024-04-25T17:15:11.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:11.486+0000 7f49ee254700 1 -- 172.21.15.37:0/1063256675 shutdown_connections 2024-04-25T17:15:11.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:11.486+0000 7f49ee254700 1 --2- 172.21.15.37:0/1063256675 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f49d00692a0 0x7f49d006b750 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:11.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:11.486+0000 7f49ee254700 1 --2- 172.21.15.37:0/1063256675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f49e80fb520 0x7f49e8113a40 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:11.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:11.486+0000 7f49ee254700 1 --2- 172.21.15.37:0/1063256675 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f49e8102f60 0x7f49e8113f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:11.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:11.486+0000 7f49ee254700 1 -- 172.21.15.37:0/1063256675 >> 172.21.15.37:0/1063256675 conn(0x7f49e80714d0 msgr2=0x7f49e80fa830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:15:11.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:11.486+0000 7f49ee254700 1 -- 172.21.15.37:0/1063256675 shutdown_connections 2024-04-25T17:15:11.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:11.486+0000 7f49ee254700 1 -- 172.21.15.37:0/1063256675 wait complete. 2024-04-25T17:15:12.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:11 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/1063256675' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-25T17:15:12.116 INFO:tasks.cephadm.ceph_manager.ceph:need seq 171798691851 got 171798691853 for osd.5 2024-04-25T17:15:12.116 DEBUG:teuthology.parallel:result is None 2024-04-25T17:15:12.116 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-04-25T17:15:12.116 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-25T17:15:12.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:11 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/1063256675' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-04-25T17:15:12.384 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:15:12.806 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:12 smithi037 ceph-mon[26472]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:15:13.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:12 smithi069 ceph-mon[34527]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:15:14.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:14.091+0000 7f72afd1b700 1 -- 172.21.15.37:0/448510965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72a8103780 msgr2=0x7f72a80fcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:14.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:14.091+0000 7f72afd1b700 1 --2- 172.21.15.37:0/448510965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72a8103780 0x7f72a80fcdf0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7298004940 tx=0x7f7298009e30 comp rx=0 tx=0).stop 2024-04-25T17:15:14.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:14.091+0000 7f72afd1b700 1 -- 172.21.15.37:0/448510965 shutdown_connections 2024-04-25T17:15:14.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:14.091+0000 7f72afd1b700 1 --2- 172.21.15.37:0/448510965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72a8103780 0x7f72a80fcdf0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:14.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:14.091+0000 7f72afd1b700 1 --2- 172.21.15.37:0/448510965 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f72a8102de0 0x7f72a81031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:14.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:14.091+0000 7f72afd1b700 1 -- 172.21.15.37:0/448510965 >> 172.21.15.37:0/448510965 conn(0x7f72a80f8990 msgr2=0x7f72a80fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:15:14.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:14.091+0000 7f72afd1b700 1 -- 172.21.15.37:0/448510965 shutdown_connections 2024-04-25T17:15:14.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:14.091+0000 7f72afd1b700 1 -- 172.21.15.37:0/448510965 wait complete. 2024-04-25T17:15:14.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:14.091+0000 7f72afd1b700 1 Processor -- start 2024-04-25T17:15:14.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:14.091+0000 7f72afd1b700 1 -- start start 2024-04-25T17:15:14.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:14.091+0000 7f72afd1b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72a8102de0 0x7f72a8113980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:15:14.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:14.092+0000 7f72afd1b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f72a8103780 0x7f72a8113ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:15:14.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:14.092+0000 7f72afd1b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a81145a0 con 0x7f72a8102de0 2024-04-25T17:15:14.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:14.092+0000 7f72afd1b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a810db60 con 0x7f72a8103780 2024-04-25T17:15:14.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:14.092+0000 7f72adab7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72a8102de0 0x7f72a8113980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:15:14.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:14.092+0000 7f72adab7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72a8102de0 0x7f72a8113980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39720/0 (socket says 172.21.15.37:39720) 2024-04-25T17:15:14.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:14.092+0000 7f72adab7700 1 -- 172.21.15.37:0/3101919330 learned_addr learned my addr 172.21.15.37:0/3101919330 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:15:14.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:14.092+0000 7f72ad2b6700 1 --2- 172.21.15.37:0/3101919330 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f72a8103780 0x7f72a8113ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:15:14.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:14.092+0000 7f72adab7700 1 -- 172.21.15.37:0/3101919330 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f72a8103780 msgr2=0x7f72a8113ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:14.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:14.092+0000 7f72adab7700 1 --2- 172.21.15.37:0/3101919330 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f72a8103780 0x7f72a8113ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:14.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:14.092+0000 7f72adab7700 1 -- 172.21.15.37:0/3101919330 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7298005040 con 0x7f72a8102de0 2024-04-25T17:15:14.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:14.092+0000 7f72adab7700 1 --2- 172.21.15.37:0/3101919330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72a8102de0 0x7f72a8113980 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f72a400b790 tx=0x7f72a4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:15:14.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:14.092+0000 7f729e7fc700 1 -- 172.21.15.37:0/3101919330 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72a400f770 con 0x7f72a8102de0 2024-04-25T17:15:14.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:14.092+0000 7f729e7fc700 1 -- 172.21.15.37:0/3101919330 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f72a400fda0 con 0x7f72a8102de0 2024-04-25T17:15:14.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:14.092+0000 7f72afd1b700 1 -- 172.21.15.37:0/3101919330 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72a810de40 con 0x7f72a8102de0 2024-04-25T17:15:14.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:14.092+0000 7f729e7fc700 1 -- 172.21.15.37:0/3101919330 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72a400d310 con 0x7f72a8102de0 2024-04-25T17:15:14.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:14.092+0000 7f72afd1b700 1 -- 172.21.15.37:0/3101919330 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72a810e400 con 0x7f72a8102de0 2024-04-25T17:15:14.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:14.093+0000 7f72afd1b700 1 -- 172.21.15.37:0/3101919330 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72a81000f0 con 0x7f72a8102de0 2024-04-25T17:15:14.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:14.094+0000 7f729e7fc700 1 -- 172.21.15.37:0/3101919330 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f72a4010420 con 0x7f72a8102de0 2024-04-25T17:15:14.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:14.094+0000 7f729e7fc700 1 --2- 172.21.15.37:0/3101919330 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f72940692a0 0x7f729406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:15:14.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:14.094+0000 7f729e7fc700 1 -- 172.21.15.37:0/3101919330 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f72a4086e70 con 0x7f72a8102de0 2024-04-25T17:15:14.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:14.094+0000 7f72ad2b6700 1 --2- 172.21.15.37:0/3101919330 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f72940692a0 0x7f729406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:15:14.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:14.095+0000 7f72ad2b6700 1 --2- 172.21.15.37:0/3101919330 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f72940692a0 0x7f729406b750 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f72a810ecd0 tx=0x7f7298009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:15:14.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:14.099+0000 7f729e7fc700 1 -- 172.21.15.37:0/3101919330 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f72a4056f70 con 0x7f72a8102de0 2024-04-25T17:15:14.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:14.288+0000 7f72afd1b700 1 -- 172.21.15.37:0/3101919330 --> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f72a810f040 con 0x7f72940692a0 2024-04-25T17:15:14.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:14.290+0000 7f729e7fc700 1 -- 172.21.15.37:0/3101919330 <== mgr.14214 v2:172.21.15.37:6800/3566135606 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+28118 (secure 0 0 0) 0x7f72a810f040 con 0x7f72940692a0 2024-04-25T17:15:14.290 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:15:14.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:14.293+0000 7f72afd1b700 1 -- 172.21.15.37:0/3101919330 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f72940692a0 msgr2=0x7f729406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:14.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:14.293+0000 7f72afd1b700 1 --2- 172.21.15.37:0/3101919330 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f72940692a0 0x7f729406b750 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f72a810ecd0 tx=0x7f7298009e30 comp rx=0 tx=0).stop 2024-04-25T17:15:14.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:14.293+0000 7f72afd1b700 1 -- 172.21.15.37:0/3101919330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72a8102de0 msgr2=0x7f72a8113980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:14.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:14.293+0000 7f72afd1b700 1 --2- 172.21.15.37:0/3101919330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72a8102de0 0x7f72a8113980 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f72a400b790 tx=0x7f72a4009250 comp rx=0 tx=0).stop 2024-04-25T17:15:14.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:14.293+0000 7f72afd1b700 1 -- 172.21.15.37:0/3101919330 shutdown_connections 2024-04-25T17:15:14.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:14.293+0000 7f72afd1b700 1 --2- 172.21.15.37:0/3101919330 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f72940692a0 0x7f729406b750 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:14.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:14.293+0000 7f72afd1b700 1 --2- 172.21.15.37:0/3101919330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72a8102de0 0x7f72a8113980 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:14.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:14.293+0000 7f72afd1b700 1 --2- 172.21.15.37:0/3101919330 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f72a8103780 0x7f72a8113ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:14.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:14.293+0000 7f72afd1b700 1 -- 172.21.15.37:0/3101919330 >> 172.21.15.37:0/3101919330 conn(0x7f72a80f8990 msgr2=0x7f72a8107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:15:14.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:14.293+0000 7f72afd1b700 1 -- 172.21.15.37:0/3101919330 shutdown_connections 2024-04-25T17:15:14.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:14.293+0000 7f72afd1b700 1 -- 172.21.15.37:0/3101919330 wait complete. 2024-04-25T17:15:14.294 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-04-25T17:15:14.877 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":158,"stamp":"2024-04-25T17:15:13.502794+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1788080,"kb_used_data":3924,"kb_used_omap":9,"kb_used_meta":1784054,"kb_avail":560682832,"statfs":{"total":575970213888,"available":574139219968,"internally_reserved":0,"allocated":4018176,"data_stored":2624466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10224,"internal_metadata":1826871312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002348"},"pg_stats":[{"pgid":"1.0","version":"24'117","reported_seq":190,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T17:14:20.336639+0000","last_change":"2024-04-25T17:13:55.833679+0000","last_active":"2024-04-25T17:14:20.336639+0000","last_peered":"2024-04-25T17:14:20.336639+0000","last_clean":"2024-04-25T17:14:20.336639+0000","last_became_active":"2024-04-25T17:13:55.833381+0000","last_became_peered":"2024-04-25T17:13:55.833381+0000","last_unstale":"2024-04-25T17:14:20.336639+0000","last_undegraded":"2024-04-25T17:14:20.336639+0000","last_fullsized":"2024-04-25T17:14:20.336639+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T17:13:10.431282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T17:13:10.431282+0000","last_clean_scrub_stamp":"2024-04-25T17:13:10.431282+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:15:04.777528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":40,"seq":171798691854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297720,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447432,"statfs":{"total":95995035648,"available":95690170368,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]}]},{"osd":4,"up_from":35,"seq":150323855378,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297724,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447428,"statfs":{"total":95995035648,"available":95690166272,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 17:14:59 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.48799999999999999}]},{"osd":1,"last update":"Thu Apr 25 17:14:59 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.50800000000000001}]},{"osd":2,"last update":"Thu Apr 25 17:14:59 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.44700000000000001}]},{"osd":3,"last update":"Thu Apr 25 17:14:59 2024","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.374}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]}]},{"osd":3,"up_from":27,"seq":115964117014,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298308,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446844,"statfs":{"total":95995035648,"available":95689568256,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 17:14:33 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.65900000000000003}]},{"osd":1,"last update":"Thu Apr 25 17:14:33 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.61199999999999999}]},{"osd":2,"last update":"Thu Apr 25 17:14:33 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.624},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.64200000000000002}]},{"osd":4,"last update":"Thu Apr 25 17:14:58 2024","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.47399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]}]},{"osd":2,"up_from":19,"seq":81604378652,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297724,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447428,"statfs":{"total":95995035648,"available":95690166272,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 17:14:08 2024","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.503,"5min":0.503,"15min":0.503},"last":0.34000000000000002}]},{"osd":1,"last update":"Thu Apr 25 17:14:08 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.32400000000000001}]},{"osd":3,"last update":"Thu Apr 25 17:14:34 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.67400000000000004}]},{"osd":4,"last update":"Thu Apr 25 17:15:00 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.58899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705703,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298300,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446852,"statfs":{"total":95995035648,"available":95689576448,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 25 17:14:44 2024","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.34599999999999997,"15min":0.34499999999999997},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.316},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.35399999999999998,"15min":0.34399999999999997},"min":{"1min":0.26200000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.373}]},{"osd":2,"last update":"Thu Apr 25 17:14:12 2024","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.34200000000000003}]},{"osd":3,"last update":"Thu Apr 25 17:14:35 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.58499999999999996}]},{"osd":4,"last update":"Thu Apr 25 17:14:57 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.51600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]}]},{"osd":1,"up_from":14,"seq":60129542178,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298304,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446848,"statfs":{"total":95995035648,"available":95689572352,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 17:14:47 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.32800000000000001,"15min":0.31900000000000001},"min":{"1min":0.30299999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.32900000000000001,"15min":0.32000000000000001},"min":{"1min":0.245,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.251}]},{"osd":2,"last update":"Thu Apr 25 17:14:12 2024","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.26900000000000002}]},{"osd":3,"last update":"Thu Apr 25 17:14:36 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.48299999999999998}]},{"osd":4,"last update":"Thu Apr 25 17:14:56 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.46200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T17:15:14.878 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph pg dump --format=json 2024-04-25T17:15:15.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:14 smithi037 ceph-mon[26472]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:15:15.145 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:15:15.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:14 smithi069 ceph-mon[34527]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:15:15.956 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:15 smithi037 ceph-mon[26472]: from='client.14426 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T17:15:16.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:15 smithi069 ceph-mon[34527]: from='client.14426 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T17:15:16.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:16.726+0000 7ff473188700 1 -- 172.21.15.37:0/2077356584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff46c102de0 msgr2=0x7ff46c1031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:16.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:16.726+0000 7ff473188700 1 --2- 172.21.15.37:0/2077356584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff46c102de0 0x7ff46c1031b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff45c004940 tx=0x7ff45c009e30 comp rx=0 tx=0).stop 2024-04-25T17:15:16.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:16.726+0000 7ff473188700 1 -- 172.21.15.37:0/2077356584 shutdown_connections 2024-04-25T17:15:16.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:16.726+0000 7ff473188700 1 --2- 172.21.15.37:0/2077356584 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff46c103780 0x7ff46c0fcdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:16.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:16.726+0000 7ff473188700 1 --2- 172.21.15.37:0/2077356584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff46c102de0 0x7ff46c1031b0 secure :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff45c004940 tx=0x7ff45c009e30 comp rx=0 tx=0).stop 2024-04-25T17:15:16.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:16.726+0000 7ff473188700 1 -- 172.21.15.37:0/2077356584 >> 172.21.15.37:0/2077356584 conn(0x7ff46c0f8990 msgr2=0x7ff46c0fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:15:16.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:16.726+0000 7ff473188700 1 -- 172.21.15.37:0/2077356584 shutdown_connections 2024-04-25T17:15:16.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:16.726+0000 7ff473188700 1 -- 172.21.15.37:0/2077356584 wait complete. 2024-04-25T17:15:16.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:16.727+0000 7ff473188700 1 Processor -- start 2024-04-25T17:15:16.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:16.727+0000 7ff473188700 1 -- start start 2024-04-25T17:15:16.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:16.727+0000 7ff473188700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff46c103780 0x7ff46c070260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:15:16.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:16.727+0000 7ff473188700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff46c0707a0 0x7ff46c070c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:15:16.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:16.727+0000 7ff473188700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46c072130 con 0x7ff46c103780 2024-04-25T17:15:16.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:16.727+0000 7ff473188700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46c11a030 con 0x7ff46c0707a0 2024-04-25T17:15:16.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:16.727+0000 7ff470f24700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff46c103780 0x7ff46c070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:15:16.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:16.727+0000 7ff470f24700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff46c103780 0x7ff46c070260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55674/0 (socket says 172.21.15.37:55674) 2024-04-25T17:15:16.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:16.727+0000 7ff470f24700 1 -- 172.21.15.37:0/3385059764 learned_addr learned my addr 172.21.15.37:0/3385059764 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:15:16.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:16.727+0000 7ff46bfff700 1 --2- 172.21.15.37:0/3385059764 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff46c0707a0 0x7ff46c070c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:15:16.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:16.728+0000 7ff470f24700 1 -- 172.21.15.37:0/3385059764 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff46c0707a0 msgr2=0x7ff46c070c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:16.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:16.728+0000 7ff470f24700 1 --2- 172.21.15.37:0/3385059764 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff46c0707a0 0x7ff46c070c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:16.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:16.728+0000 7ff470f24700 1 -- 172.21.15.37:0/3385059764 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff45c005040 con 0x7ff46c103780 2024-04-25T17:15:16.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:16.728+0000 7ff46bfff700 1 --2- 172.21.15.37:0/3385059764 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff46c0707a0 0x7ff46c070c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T17:15:16.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:16.728+0000 7ff470f24700 1 --2- 172.21.15.37:0/3385059764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff46c103780 0x7ff46c070260 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff45c00b3b0 tx=0x7ff45c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:15:16.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:16.728+0000 7ff4697fa700 1 -- 172.21.15.37:0/3385059764 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff45c00e040 con 0x7ff46c103780 2024-04-25T17:15:16.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:16.728+0000 7ff4697fa700 1 -- 172.21.15.37:0/3385059764 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff45c013420 con 0x7ff46c103780 2024-04-25T17:15:16.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:16.728+0000 7ff4697fa700 1 -- 172.21.15.37:0/3385059764 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff45c01c630 con 0x7ff46c103780 2024-04-25T17:15:16.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:16.728+0000 7ff473188700 1 -- 172.21.15.37:0/3385059764 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff46c11a170 con 0x7ff46c103780 2024-04-25T17:15:16.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:16.728+0000 7ff473188700 1 -- 172.21.15.37:0/3385059764 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff46c11a700 con 0x7ff46c103780 2024-04-25T17:15:16.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:16.729+0000 7ff473188700 1 -- 172.21.15.37:0/3385059764 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff46c1000f0 con 0x7ff46c103780 2024-04-25T17:15:16.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:16.730+0000 7ff4697fa700 1 -- 172.21.15.37:0/3385059764 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7ff45c013590 con 0x7ff46c103780 2024-04-25T17:15:16.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:16.730+0000 7ff4697fa700 1 --2- 172.21.15.37:0/3385059764 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7ff4540692a0 0x7ff45406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:15:16.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:16.730+0000 7ff4697fa700 1 -- 172.21.15.37:0/3385059764 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ff45c087ed0 con 0x7ff46c103780 2024-04-25T17:15:16.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:16.730+0000 7ff46bfff700 1 --2- 172.21.15.37:0/3385059764 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7ff4540692a0 0x7ff45406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:15:16.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:16.730+0000 7ff46bfff700 1 --2- 172.21.15.37:0/3385059764 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7ff4540692a0 0x7ff45406b750 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff46c067310 tx=0x7ff460008040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:15:16.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:16.735+0000 7ff4697fa700 1 -- 172.21.15.37:0/3385059764 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7ff45c0545e0 con 0x7ff46c103780 2024-04-25T17:15:16.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:16 smithi037 ceph-mon[26472]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:15:16.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:16.926+0000 7ff473188700 1 -- 172.21.15.37:0/3385059764 --> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff46c0717b0 con 0x7ff4540692a0 2024-04-25T17:15:16.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:16.928+0000 7ff4697fa700 1 -- 172.21.15.37:0/3385059764 <== mgr.14214 v2:172.21.15.37:6800/3566135606 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+28187 (secure 0 0 0) 0x7ff46c0717b0 con 0x7ff4540692a0 2024-04-25T17:15:16.929 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:15:16.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:16.930+0000 7ff473188700 1 -- 172.21.15.37:0/3385059764 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7ff4540692a0 msgr2=0x7ff45406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:16.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:16.930+0000 7ff473188700 1 --2- 172.21.15.37:0/3385059764 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7ff4540692a0 0x7ff45406b750 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff46c067310 tx=0x7ff460008040 comp rx=0 tx=0).stop 2024-04-25T17:15:16.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:16.930+0000 7ff473188700 1 -- 172.21.15.37:0/3385059764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff46c103780 msgr2=0x7ff46c070260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:16.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:16.930+0000 7ff473188700 1 --2- 172.21.15.37:0/3385059764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff46c103780 0x7ff46c070260 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff45c00b3b0 tx=0x7ff45c009e30 comp rx=0 tx=0).stop 2024-04-25T17:15:16.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:16.930+0000 7ff473188700 1 -- 172.21.15.37:0/3385059764 shutdown_connections 2024-04-25T17:15:16.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:16.930+0000 7ff473188700 1 --2- 172.21.15.37:0/3385059764 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7ff4540692a0 0x7ff45406b750 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:16.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:16.930+0000 7ff473188700 1 --2- 172.21.15.37:0/3385059764 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff46c103780 0x7ff46c070260 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:16.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:16.930+0000 7ff473188700 1 --2- 172.21.15.37:0/3385059764 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff46c0707a0 0x7ff46c070c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:16.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:16.930+0000 7ff473188700 1 -- 172.21.15.37:0/3385059764 >> 172.21.15.37:0/3385059764 conn(0x7ff46c0f8990 msgr2=0x7ff46c0fabc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:15:16.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:16.930+0000 7ff473188700 1 -- 172.21.15.37:0/3385059764 shutdown_connections 2024-04-25T17:15:16.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:16.930+0000 7ff473188700 1 -- 172.21.15.37:0/3385059764 wait complete. 2024-04-25T17:15:16.932 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-04-25T17:15:17.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:16 smithi069 ceph-mon[34527]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:15:17.629 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2024-04-25T17:15:15.503206+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1788080,"kb_used_data":3924,"kb_used_omap":9,"kb_used_meta":1784054,"kb_avail":560682832,"statfs":{"total":575970213888,"available":574139219968,"internally_reserved":0,"allocated":4018176,"data_stored":2624466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10224,"internal_metadata":1826871312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002492"},"pg_stats":[{"pgid":"1.0","version":"24'117","reported_seq":190,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-04-25T17:14:20.336639+0000","last_change":"2024-04-25T17:13:55.833679+0000","last_active":"2024-04-25T17:14:20.336639+0000","last_peered":"2024-04-25T17:14:20.336639+0000","last_clean":"2024-04-25T17:14:20.336639+0000","last_became_active":"2024-04-25T17:13:55.833381+0000","last_became_peered":"2024-04-25T17:13:55.833381+0000","last_unstale":"2024-04-25T17:14:20.336639+0000","last_undegraded":"2024-04-25T17:14:20.336639+0000","last_fullsized":"2024-04-25T17:14:20.336639+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T17:13:10.431282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T17:13:10.431282+0000","last_clean_scrub_stamp":"2024-04-25T17:13:10.431282+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:15:04.777528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":40,"seq":171798691854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297720,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447432,"statfs":{"total":95995035648,"available":95690170368,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]}]},{"osd":4,"up_from":35,"seq":150323855378,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297724,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447428,"statfs":{"total":95995035648,"available":95690166272,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 17:14:59 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.48799999999999999}]},{"osd":1,"last update":"Thu Apr 25 17:14:59 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.50800000000000001}]},{"osd":2,"last update":"Thu Apr 25 17:14:59 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.44700000000000001}]},{"osd":3,"last update":"Thu Apr 25 17:14:59 2024","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.374}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]}]},{"osd":3,"up_from":27,"seq":115964117014,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298308,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446844,"statfs":{"total":95995035648,"available":95689568256,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 17:14:33 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.65900000000000003}]},{"osd":1,"last update":"Thu Apr 25 17:14:33 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.61199999999999999}]},{"osd":2,"last update":"Thu Apr 25 17:14:33 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.624},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.64200000000000002}]},{"osd":4,"last update":"Thu Apr 25 17:14:58 2024","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.47399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]}]},{"osd":2,"up_from":19,"seq":81604378653,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297724,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447428,"statfs":{"total":95995035648,"available":95690166272,"internally_reserved":0,"allocated":372736,"data_stored":142227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 17:15:09 2024","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.37,"15min":0.372},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.313},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.38800000000000001,"15min":0.39300000000000002},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.246}]},{"osd":1,"last update":"Thu Apr 25 17:15:09 2024","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.249,"5min":0.221,"15min":0.221},"max":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.40899999999999997,"15min":0.41299999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.53600000000000003,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.29299999999999998}]},{"osd":3,"last update":"Thu Apr 25 17:14:34 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.41499999999999998}]},{"osd":4,"last update":"Thu Apr 25 17:15:00 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.36499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705704,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298300,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446852,"statfs":{"total":95995035648,"available":95689576448,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 25 17:14:44 2024","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.34599999999999997,"15min":0.34499999999999997},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.35399999999999998,"15min":0.34399999999999997},"min":{"1min":0.26200000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.29799999999999999}]},{"osd":2,"last update":"Thu Apr 25 17:15:14 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.41699999999999998,"15min":0.42599999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.374,"5min":0.40200000000000002,"15min":0.40600000000000003},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.27700000000000002}]},{"osd":3,"last update":"Thu Apr 25 17:14:35 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.623},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.61399999999999999}]},{"osd":4,"last update":"Thu Apr 25 17:14:57 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.63800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]}]},{"osd":1,"up_from":14,"seq":60129542178,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298304,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446848,"statfs":{"total":95995035648,"available":95689572352,"internally_reserved":0,"allocated":966656,"data_stored":732595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 17:14:47 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.32800000000000001,"15min":0.31900000000000001},"min":{"1min":0.30299999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.32900000000000001,"15min":0.32000000000000001},"min":{"1min":0.245,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.251}]},{"osd":2,"last update":"Thu Apr 25 17:14:12 2024","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.26900000000000002}]},{"osd":3,"last update":"Thu Apr 25 17:14:36 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.48299999999999998}]},{"osd":4,"last update":"Thu Apr 25 17:14:56 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.46200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T17:15:17.630 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-04-25T17:15:17.630 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-25T17:15:17.630 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-04-25T17:15:17.630 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph health --format=json 2024-04-25T17:15:17.902 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:15:18.979 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:18 smithi037 ceph-mon[26472]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T17:15:18.979 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:18 smithi037 ceph-mon[26472]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:15:19.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:18 smithi069 ceph-mon[34527]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-04-25T17:15:19.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:18 smithi069 ceph-mon[34527]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:15:19.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:19.447+0000 7fed2ab47700 1 -- 172.21.15.37:0/2826412146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed24065640 msgr2=0x7fed24065ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:19.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:19.447+0000 7fed2ab47700 1 --2- 172.21.15.37:0/2826412146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed24065640 0x7fed24065ab0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fed18004940 tx=0x7fed18009e30 comp rx=0 tx=0).stop 2024-04-25T17:15:19.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:19.447+0000 7fed2ab47700 1 -- 172.21.15.37:0/2826412146 shutdown_connections 2024-04-25T17:15:19.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:19.447+0000 7fed2ab47700 1 --2- 172.21.15.37:0/2826412146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed24065640 0x7fed24065ab0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:19.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:19.447+0000 7fed2ab47700 1 --2- 172.21.15.37:0/2826412146 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fed24102e50 0x7fed24103220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:19.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:19.447+0000 7fed2ab47700 1 -- 172.21.15.37:0/2826412146 >> 172.21.15.37:0/2826412146 conn(0x7fed24071d00 msgr2=0x7fed24072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:15:19.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:19.447+0000 7fed2ab47700 1 -- 172.21.15.37:0/2826412146 shutdown_connections 2024-04-25T17:15:19.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:19.447+0000 7fed2ab47700 1 -- 172.21.15.37:0/2826412146 wait complete. 2024-04-25T17:15:19.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:19.448+0000 7fed2ab47700 1 Processor -- start 2024-04-25T17:15:19.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:19.448+0000 7fed2ab47700 1 -- start start 2024-04-25T17:15:19.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:19.448+0000 7fed2ab47700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fed24065640 0x7fed24113b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:15:19.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:19.448+0000 7fed2ab47700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed24102e50 0x7fed241140b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:15:19.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:19.448+0000 7fed2ab47700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed24114700 con 0x7fed24102e50 2024-04-25T17:15:19.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:19.448+0000 7fed2ab47700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2410daf0 con 0x7fed24065640 2024-04-25T17:15:19.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:19.448+0000 7fed23fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed24102e50 0x7fed241140b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:15:19.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:19.448+0000 7fed23fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed24102e50 0x7fed241140b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55690/0 (socket says 172.21.15.37:55690) 2024-04-25T17:15:19.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:19.448+0000 7fed23fff700 1 -- 172.21.15.37:0/358675787 learned_addr learned my addr 172.21.15.37:0/358675787 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:15:19.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:19.448+0000 7fed288e3700 1 --2- 172.21.15.37:0/358675787 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fed24065640 0x7fed24113b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:15:19.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:19.448+0000 7fed23fff700 1 -- 172.21.15.37:0/358675787 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fed24065640 msgr2=0x7fed24113b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:19.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:19.448+0000 7fed23fff700 1 --2- 172.21.15.37:0/358675787 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fed24065640 0x7fed24113b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:19.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:19.448+0000 7fed23fff700 1 -- 172.21.15.37:0/358675787 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed18005040 con 0x7fed24102e50 2024-04-25T17:15:19.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:19.449+0000 7fed23fff700 1 --2- 172.21.15.37:0/358675787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed24102e50 0x7fed241140b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fed1800b3b0 tx=0x7fed18009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:15:19.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:19.449+0000 7fed217fa700 1 -- 172.21.15.37:0/358675787 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed1800e040 con 0x7fed24102e50 2024-04-25T17:15:19.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:19.449+0000 7fed217fa700 1 -- 172.21.15.37:0/358675787 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fed1800bbc0 con 0x7fed24102e50 2024-04-25T17:15:19.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:19.449+0000 7fed2ab47700 1 -- 172.21.15.37:0/358675787 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed2410dd70 con 0x7fed24102e50 2024-04-25T17:15:19.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:19.449+0000 7fed217fa700 1 -- 172.21.15.37:0/358675787 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed1801c3f0 con 0x7fed24102e50 2024-04-25T17:15:19.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:19.449+0000 7fed2ab47700 1 -- 172.21.15.37:0/358675787 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed2410e330 con 0x7fed24102e50 2024-04-25T17:15:19.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:19.450+0000 7fed2ab47700 1 -- 172.21.15.37:0/358675787 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed24100100 con 0x7fed24102e50 2024-04-25T17:15:19.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:19.450+0000 7fed217fa700 1 -- 172.21.15.37:0/358675787 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fed1800bd30 con 0x7fed24102e50 2024-04-25T17:15:19.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:19.451+0000 7fed217fa700 1 --2- 172.21.15.37:0/358675787 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fed0c0692a0 0x7fed0c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:15:19.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:19.451+0000 7fed217fa700 1 -- 172.21.15.37:0/358675787 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fed180880f0 con 0x7fed24102e50 2024-04-25T17:15:19.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:19.451+0000 7fed288e3700 1 --2- 172.21.15.37:0/358675787 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fed0c0692a0 0x7fed0c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:15:19.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:19.451+0000 7fed288e3700 1 --2- 172.21.15.37:0/358675787 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fed0c0692a0 0x7fed0c06b750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fed1c004550 tx=0x7fed1c009040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:15:19.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:19.455+0000 7fed217fa700 1 -- 172.21.15.37:0/358675787 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fed18058170 con 0x7fed24102e50 2024-04-25T17:15:19.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:19.697+0000 7fed2ab47700 1 -- 172.21.15.37:0/358675787 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fed2410f1c0 con 0x7fed24102e50 2024-04-25T17:15:19.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:19.697+0000 7fed217fa700 1 -- 172.21.15.37:0/358675787 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fed18086e60 con 0x7fed24102e50 2024-04-25T17:15:19.698 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:15:19.699 INFO:teuthology.orchestra.run.smithi037.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T17:15:19.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:19.699+0000 7fed2ab47700 1 -- 172.21.15.37:0/358675787 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fed0c0692a0 msgr2=0x7fed0c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:19.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:19.699+0000 7fed2ab47700 1 --2- 172.21.15.37:0/358675787 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fed0c0692a0 0x7fed0c06b750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fed1c004550 tx=0x7fed1c009040 comp rx=0 tx=0).stop 2024-04-25T17:15:19.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:19.699+0000 7fed2ab47700 1 -- 172.21.15.37:0/358675787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed24102e50 msgr2=0x7fed241140b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:19.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:19.699+0000 7fed2ab47700 1 --2- 172.21.15.37:0/358675787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed24102e50 0x7fed241140b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fed1800b3b0 tx=0x7fed18009e30 comp rx=0 tx=0).stop 2024-04-25T17:15:19.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:19.699+0000 7fed2ab47700 1 -- 172.21.15.37:0/358675787 shutdown_connections 2024-04-25T17:15:19.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:19.699+0000 7fed2ab47700 1 --2- 172.21.15.37:0/358675787 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fed0c0692a0 0x7fed0c06b750 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:19.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:19.699+0000 7fed2ab47700 1 --2- 172.21.15.37:0/358675787 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fed24065640 0x7fed24113b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:19.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:19.699+0000 7fed2ab47700 1 --2- 172.21.15.37:0/358675787 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed24102e50 0x7fed241140b0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:19.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:19.699+0000 7fed2ab47700 1 -- 172.21.15.37:0/358675787 >> 172.21.15.37:0/358675787 conn(0x7fed24071d00 msgr2=0x7fed240fb000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:15:19.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:19.699+0000 7fed2ab47700 1 -- 172.21.15.37:0/358675787 shutdown_connections 2024-04-25T17:15:19.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:19.699+0000 7fed2ab47700 1 -- 172.21.15.37:0/358675787 wait complete. 2024-04-25T17:15:20.069 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:19 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/358675787' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-25T17:15:20.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:19 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/358675787' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-04-25T17:15:20.315 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-04-25T17:15:20.316 INFO:tasks.cephadm:Setup complete, yielding 2024-04-25T17:15:20.316 INFO:teuthology.run_tasks:Running task print... 2024-04-25T17:15:20.325 INFO:teuthology.task.print:**** done end installing quincy cephadm ... 2024-04-25T17:15:20.325 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-25T17:15:20.346 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi037.front.sepia.ceph.com 2024-04-25T17:15:20.346 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-04-25T17:15:20.626 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:15:20.899 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:20 smithi037 ceph-mon[26472]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:15:21.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:20 smithi069 ceph-mon[34527]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:15:22.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:22.117+0000 7f81a9dc4700 1 -- 172.21.15.37:0/456512451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81a40fcff0 msgr2=0x7f81a40fd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:22.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:22.117+0000 7f81a9dc4700 1 --2- 172.21.15.37:0/456512451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81a40fcff0 0x7f81a40fd460 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8198004940 tx=0x7f8198009e30 comp rx=0 tx=0).stop 2024-04-25T17:15:22.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:22.117+0000 7f81a9dc4700 1 -- 172.21.15.37:0/456512451 shutdown_connections 2024-04-25T17:15:22.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:22.117+0000 7f81a9dc4700 1 --2- 172.21.15.37:0/456512451 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81a40fcff0 0x7f81a40fd460 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:22.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:22.117+0000 7f81a9dc4700 1 --2- 172.21.15.37:0/456512451 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f81a40fbd40 0x7f81a40fc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:22.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:22.117+0000 7f81a9dc4700 1 -- 172.21.15.37:0/456512451 >> 172.21.15.37:0/456512451 conn(0x7f81a40f74c0 msgr2=0x7f81a40f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:15:22.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:22.117+0000 7f81a9dc4700 1 -- 172.21.15.37:0/456512451 shutdown_connections 2024-04-25T17:15:22.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:22.117+0000 7f81a9dc4700 1 -- 172.21.15.37:0/456512451 wait complete. 2024-04-25T17:15:22.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:22.117+0000 7f81a9dc4700 1 Processor -- start 2024-04-25T17:15:22.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:22.118+0000 7f81a9dc4700 1 -- start start 2024-04-25T17:15:22.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:22.118+0000 7f81a9dc4700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f81a40fbd40 0x7f81a4110690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:15:22.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:22.118+0000 7f81a9dc4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81a40fcff0 0x7f81a4112be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:15:22.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:22.118+0000 7f81a9dc4700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a4066be0 con 0x7f81a40fcff0 2024-04-25T17:15:22.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:22.118+0000 7f81a9dc4700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a4066d20 con 0x7f81a40fbd40 2024-04-25T17:15:22.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:22.118+0000 7f81a2ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81a40fcff0 0x7f81a4112be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:15:22.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:22.118+0000 7f81a2ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81a40fcff0 0x7f81a4112be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55704/0 (socket says 172.21.15.37:55704) 2024-04-25T17:15:22.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:22.118+0000 7f81a2ffd700 1 -- 172.21.15.37:0/2224483596 learned_addr learned my addr 172.21.15.37:0/2224483596 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:15:22.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:22.118+0000 7f81a37fe700 1 --2- 172.21.15.37:0/2224483596 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f81a40fbd40 0x7f81a4110690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:15:22.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:22.118+0000 7f81a2ffd700 1 -- 172.21.15.37:0/2224483596 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f81a40fbd40 msgr2=0x7f81a4110690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:22.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:22.118+0000 7f81a2ffd700 1 --2- 172.21.15.37:0/2224483596 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f81a40fbd40 0x7f81a4110690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:22.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:22.118+0000 7f81a2ffd700 1 -- 172.21.15.37:0/2224483596 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8198005040 con 0x7f81a40fcff0 2024-04-25T17:15:22.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:22.118+0000 7f81a37fe700 1 --2- 172.21.15.37:0/2224483596 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f81a40fbd40 0x7f81a4110690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T17:15:22.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:22.119+0000 7f81a2ffd700 1 --2- 172.21.15.37:0/2224483596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81a40fcff0 0x7f81a4112be0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8198013870 tx=0x7f8198009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:15:22.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:22.119+0000 7f818bfff700 1 -- 172.21.15.37:0/2224483596 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8198021070 con 0x7f81a40fcff0 2024-04-25T17:15:22.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:22.119+0000 7f81a9dc4700 1 -- 172.21.15.37:0/2224483596 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81a4113180 con 0x7f81a40fcff0 2024-04-25T17:15:22.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:22.119+0000 7f81a9dc4700 1 -- 172.21.15.37:0/2224483596 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81a4113690 con 0x7f81a40fcff0 2024-04-25T17:15:22.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:22.119+0000 7f818bfff700 1 -- 172.21.15.37:0/2224483596 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8198009430 con 0x7f81a40fcff0 2024-04-25T17:15:22.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:22.119+0000 7f818bfff700 1 -- 172.21.15.37:0/2224483596 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f819800e070 con 0x7f81a40fcff0 2024-04-25T17:15:22.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:22.120+0000 7f81a9dc4700 1 -- 172.21.15.37:0/2224483596 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81900052e0 con 0x7f81a40fcff0 2024-04-25T17:15:22.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:22.120+0000 7f818bfff700 1 -- 172.21.15.37:0/2224483596 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f8198026410 con 0x7f81a40fcff0 2024-04-25T17:15:22.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:22.121+0000 7f818bfff700 1 --2- 172.21.15.37:0/2224483596 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f818c0692a0 0x7f818c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:15:22.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:22.121+0000 7f818bfff700 1 -- 172.21.15.37:0/2224483596 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f8198087f50 con 0x7f81a40fcff0 2024-04-25T17:15:22.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:22.121+0000 7f81a37fe700 1 --2- 172.21.15.37:0/2224483596 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f818c0692a0 0x7f818c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:15:22.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:22.121+0000 7f81a37fe700 1 --2- 172.21.15.37:0/2224483596 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f818c0692a0 0x7f818c06b750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f81a4066860 tx=0x7f819400b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:15:22.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:22.125+0000 7f818bfff700 1 -- 172.21.15.37:0/2224483596 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f81980ba250 con 0x7f81a40fcff0 2024-04-25T17:15:22.335 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:22.334+0000 7f81a9dc4700 1 -- 172.21.15.37:0/2224483596 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7f8190005590 con 0x7f81a40fcff0 2024-04-25T17:15:22.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:22.338+0000 7f818bfff700 1 -- 172.21.15.37:0/2224483596 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7f8198057cb0 con 0x7f81a40fcff0 2024-04-25T17:15:22.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:22.341+0000 7f81a9dc4700 1 -- 172.21.15.37:0/2224483596 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f818c0692a0 msgr2=0x7f818c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:22.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:22.341+0000 7f81a9dc4700 1 --2- 172.21.15.37:0/2224483596 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f818c0692a0 0x7f818c06b750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f81a4066860 tx=0x7f819400b040 comp rx=0 tx=0).stop 2024-04-25T17:15:22.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:22.341+0000 7f81a9dc4700 1 -- 172.21.15.37:0/2224483596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81a40fcff0 msgr2=0x7f81a4112be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:22.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:22.341+0000 7f81a9dc4700 1 --2- 172.21.15.37:0/2224483596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81a40fcff0 0x7f81a4112be0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8198013870 tx=0x7f8198009e30 comp rx=0 tx=0).stop 2024-04-25T17:15:22.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:22.341+0000 7f81a9dc4700 1 -- 172.21.15.37:0/2224483596 shutdown_connections 2024-04-25T17:15:22.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:22.341+0000 7f81a9dc4700 1 --2- 172.21.15.37:0/2224483596 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f818c0692a0 0x7f818c06b750 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:22.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:22.341+0000 7f81a9dc4700 1 --2- 172.21.15.37:0/2224483596 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f81a40fbd40 0x7f81a4110690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:22.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:22.341+0000 7f81a9dc4700 1 --2- 172.21.15.37:0/2224483596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81a40fcff0 0x7f81a4112be0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:22.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:22.341+0000 7f81a9dc4700 1 -- 172.21.15.37:0/2224483596 >> 172.21.15.37:0/2224483596 conn(0x7f81a40f74c0 msgr2=0x7f81a40f8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:15:22.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:22.341+0000 7f81a9dc4700 1 -- 172.21.15.37:0/2224483596 shutdown_connections 2024-04-25T17:15:22.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:22.341+0000 7f81a9dc4700 1 -- 172.21.15.37:0/2224483596 wait complete. 2024-04-25T17:15:22.975 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:22 smithi037 ceph-mon[26472]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:15:22.975 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:22 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:15:22.975 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:22 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/2224483596' entity='client.admin' 2024-04-25T17:15:22.975 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:22 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:15:22.975 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:22 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:15:22.975 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:22 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:15:22.975 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:22 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:15:22.975 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:22 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:15:22.975 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:22 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:15:22.975 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:22 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:15:23.000 INFO:teuthology.run_tasks:Running task print... 2024-04-25T17:15:23.008 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-04-25T17:15:23.008 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-25T17:15:23.016 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi037.front.sepia.ceph.com 2024-04-25T17:15:23.016 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- bash -c 'ceph orch status' 2024-04-25T17:15:23.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:22 smithi069 ceph-mon[34527]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:15:23.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:22 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:15:23.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:22 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/2224483596' entity='client.admin' 2024-04-25T17:15:23.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:22 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:15:23.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:22 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:15:23.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:22 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:15:23.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:22 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:15:23.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:22 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:15:23.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:22 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:15:23.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:22 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:15:23.280 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:15:24.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:24.868+0000 7f6a5d726700 1 -- 172.21.15.37:0/1533715290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a58066eb0 msgr2=0x7f6a580ffa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:24.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:24.868+0000 7f6a5d726700 1 --2- 172.21.15.37:0/1533715290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a58066eb0 0x7f6a580ffa30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6a48004940 tx=0x7f6a48009e30 comp rx=0 tx=0).stop 2024-04-25T17:15:24.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:24.868+0000 7f6a5d726700 1 -- 172.21.15.37:0/1533715290 shutdown_connections 2024-04-25T17:15:24.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:24.868+0000 7f6a5d726700 1 --2- 172.21.15.37:0/1533715290 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a580fff70 0x7f6a58102350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:24.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:24.868+0000 7f6a5d726700 1 --2- 172.21.15.37:0/1533715290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a58066eb0 0x7f6a580ffa30 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:24.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:24.868+0000 7f6a5d726700 1 -- 172.21.15.37:0/1533715290 >> 172.21.15.37:0/1533715290 conn(0x7f6a580f7440 msgr2=0x7f6a580f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:15:24.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:24.868+0000 7f6a5d726700 1 -- 172.21.15.37:0/1533715290 shutdown_connections 2024-04-25T17:15:24.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:24.868+0000 7f6a5d726700 1 -- 172.21.15.37:0/1533715290 wait complete. 2024-04-25T17:15:24.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:24.869+0000 7f6a5d726700 1 Processor -- start 2024-04-25T17:15:24.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:24.869+0000 7f6a5d726700 1 -- start start 2024-04-25T17:15:24.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:24.869+0000 7f6a5d726700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a58066eb0 0x7f6a5810d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:15:24.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:24.869+0000 7f6a5d726700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a580fff70 0x7f6a5810dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:15:24.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:24.869+0000 7f6a5d726700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5810e3e0 con 0x7f6a58066eb0 2024-04-25T17:15:24.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:24.869+0000 7f6a5d726700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a5810e550 con 0x7f6a580fff70 2024-04-25T17:15:24.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:24.869+0000 7f6a56ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a58066eb0 0x7f6a5810d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:15:24.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:24.869+0000 7f6a56ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a58066eb0 0x7f6a5810d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55732/0 (socket says 172.21.15.37:55732) 2024-04-25T17:15:24.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:24.869+0000 7f6a56ffd700 1 -- 172.21.15.37:0/3316230760 learned_addr learned my addr 172.21.15.37:0/3316230760 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:15:24.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:24.869+0000 7f6a567fc700 1 --2- 172.21.15.37:0/3316230760 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a580fff70 0x7f6a5810dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:15:24.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:24.870+0000 7f6a56ffd700 1 -- 172.21.15.37:0/3316230760 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a580fff70 msgr2=0x7f6a5810dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:24.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:24.870+0000 7f6a56ffd700 1 --2- 172.21.15.37:0/3316230760 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a580fff70 0x7f6a5810dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:24.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:24.870+0000 7f6a56ffd700 1 -- 172.21.15.37:0/3316230760 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a48005040 con 0x7f6a58066eb0 2024-04-25T17:15:24.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:24.870+0000 7f6a56ffd700 1 --2- 172.21.15.37:0/3316230760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a58066eb0 0x7f6a5810d8a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6a48000c00 tx=0x7f6a48009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:15:24.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:24.870+0000 7f6a3f7fe700 1 -- 172.21.15.37:0/3316230760 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a4800e030 con 0x7f6a58066eb0 2024-04-25T17:15:24.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:24.870+0000 7f6a3f7fe700 1 -- 172.21.15.37:0/3316230760 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6a48013de0 con 0x7f6a58066eb0 2024-04-25T17:15:24.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:24.870+0000 7f6a5d726700 1 -- 172.21.15.37:0/3316230760 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a58112f50 con 0x7f6a58066eb0 2024-04-25T17:15:24.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:24.870+0000 7f6a3f7fe700 1 -- 172.21.15.37:0/3316230760 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a4801ce50 con 0x7f6a58066eb0 2024-04-25T17:15:24.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:24.870+0000 7f6a5d726700 1 -- 172.21.15.37:0/3316230760 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a58113400 con 0x7f6a58066eb0 2024-04-25T17:15:24.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:24.871+0000 7f6a5d726700 1 -- 172.21.15.37:0/3316230760 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a5804c710 con 0x7f6a58066eb0 2024-04-25T17:15:24.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:24.871+0000 7f6a3f7fe700 1 -- 172.21.15.37:0/3316230760 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f6a4801c400 con 0x7f6a58066eb0 2024-04-25T17:15:24.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:24.872+0000 7f6a3f7fe700 1 --2- 172.21.15.37:0/3316230760 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f6a400692a0 0x7f6a4006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:15:24.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:24.872+0000 7f6a3f7fe700 1 -- 172.21.15.37:0/3316230760 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f6a480887e0 con 0x7f6a58066eb0 2024-04-25T17:15:24.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:24.872+0000 7f6a567fc700 1 --2- 172.21.15.37:0/3316230760 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f6a400692a0 0x7f6a4006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:15:24.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:24.872+0000 7f6a567fc700 1 --2- 172.21.15.37:0/3316230760 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f6a400692a0 0x7f6a4006b750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c009b80 tx=0x7f6a4c00b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:15:24.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:24.876+0000 7f6a3f7fe700 1 -- 172.21.15.37:0/3316230760 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f6a480588e0 con 0x7f6a58066eb0 2024-04-25T17:15:25.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:24 smithi037 ceph-mon[26472]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:15:25.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:25.090+0000 7f6a5d726700 1 -- 172.21.15.37:0/3316230760 --> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6a58113620 con 0x7f6a400692a0 2024-04-25T17:15:25.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:25.091+0000 7f6a3f7fe700 1 -- 172.21.15.37:0/3316230760 <== mgr.14214 v2:172.21.15.37:6800/3566135606 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f6a58113620 con 0x7f6a400692a0 2024-04-25T17:15:25.092 INFO:teuthology.orchestra.run.smithi037.stdout:Backend: cephadm 2024-04-25T17:15:25.092 INFO:teuthology.orchestra.run.smithi037.stdout:Available: Yes 2024-04-25T17:15:25.092 INFO:teuthology.orchestra.run.smithi037.stdout:Paused: No 2024-04-25T17:15:25.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:25.092+0000 7f6a5d726700 1 -- 172.21.15.37:0/3316230760 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f6a400692a0 msgr2=0x7f6a4006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:25.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:25.092+0000 7f6a5d726700 1 --2- 172.21.15.37:0/3316230760 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f6a400692a0 0x7f6a4006b750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c009b80 tx=0x7f6a4c00b040 comp rx=0 tx=0).stop 2024-04-25T17:15:25.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:25.093+0000 7f6a5d726700 1 -- 172.21.15.37:0/3316230760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a58066eb0 msgr2=0x7f6a5810d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:25.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:25.093+0000 7f6a5d726700 1 --2- 172.21.15.37:0/3316230760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a58066eb0 0x7f6a5810d8a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6a48000c00 tx=0x7f6a48009e30 comp rx=0 tx=0).stop 2024-04-25T17:15:25.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:25.093+0000 7f6a5d726700 1 -- 172.21.15.37:0/3316230760 shutdown_connections 2024-04-25T17:15:25.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:25.093+0000 7f6a5d726700 1 --2- 172.21.15.37:0/3316230760 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f6a400692a0 0x7f6a4006b750 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:25.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:25.093+0000 7f6a5d726700 1 --2- 172.21.15.37:0/3316230760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a58066eb0 0x7f6a5810d8a0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:25.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:25.093+0000 7f6a5d726700 1 --2- 172.21.15.37:0/3316230760 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a580fff70 0x7f6a5810dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:25.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:25.093+0000 7f6a5d726700 1 -- 172.21.15.37:0/3316230760 >> 172.21.15.37:0/3316230760 conn(0x7f6a580f7440 msgr2=0x7f6a580f7810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:15:25.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:25.093+0000 7f6a5d726700 1 -- 172.21.15.37:0/3316230760 shutdown_connections 2024-04-25T17:15:25.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:25.093+0000 7f6a5d726700 1 -- 172.21.15.37:0/3316230760 wait complete. 2024-04-25T17:15:25.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:24 smithi069 ceph-mon[34527]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:15:25.739 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- bash -c 'ceph orch ps' 2024-04-25T17:15:26.006 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:15:26.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:25 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:15:26.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:25 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:15:27.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:26 smithi037 ceph-mon[26472]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:15:27.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:26 smithi037 ceph-mon[26472]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:15:27.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:26 smithi069 ceph-mon[34527]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:15:27.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:26 smithi069 ceph-mon[34527]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:15:27.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:27.577+0000 7ff50ba06700 1 -- 172.21.15.37:0/3931834339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5040fdfd0 msgr2=0x7ff5040fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:27.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:27.577+0000 7ff50ba06700 1 --2- 172.21.15.37:0/3931834339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5040fdfd0 0x7ff5040fe440 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8004940 tx=0x7ff4f8009e30 comp rx=0 tx=0).stop 2024-04-25T17:15:27.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:27.577+0000 7ff50ba06700 1 -- 172.21.15.37:0/3931834339 shutdown_connections 2024-04-25T17:15:27.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:27.577+0000 7ff50ba06700 1 --2- 172.21.15.37:0/3931834339 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5040fdfd0 0x7ff5040fe440 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:27.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:27.577+0000 7ff50ba06700 1 --2- 172.21.15.37:0/3931834339 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff5040fce60 0x7ff5040fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:27.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:27.577+0000 7ff50ba06700 1 -- 172.21.15.37:0/3931834339 >> 172.21.15.37:0/3931834339 conn(0x7ff5040f8540 msgr2=0x7ff5040fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:15:27.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:27.577+0000 7ff50ba06700 1 -- 172.21.15.37:0/3931834339 shutdown_connections 2024-04-25T17:15:27.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:27.577+0000 7ff50ba06700 1 -- 172.21.15.37:0/3931834339 wait complete. 2024-04-25T17:15:27.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:27.578+0000 7ff50ba06700 1 Processor -- start 2024-04-25T17:15:27.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:27.578+0000 7ff50ba06700 1 -- start start 2024-04-25T17:15:27.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:27.578+0000 7ff50ba06700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5040fce60 0x7ff504071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:15:27.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:27.578+0000 7ff50ba06700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff5040fdfd0 0x7ff5040702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:15:27.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:27.578+0000 7ff50ba06700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff504072200 con 0x7ff5040fce60 2024-04-25T17:15:27.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:27.578+0000 7ff50ba06700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5040707f0 con 0x7ff5040fdfd0 2024-04-25T17:15:27.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:27.578+0000 7ff5097a2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5040fce60 0x7ff504071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:15:27.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:27.578+0000 7ff5097a2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5040fce60 0x7ff504071c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56946/0 (socket says 172.21.15.37:56946) 2024-04-25T17:15:27.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:27.578+0000 7ff5097a2700 1 -- 172.21.15.37:0/2680818190 learned_addr learned my addr 172.21.15.37:0/2680818190 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:15:27.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:27.578+0000 7ff508fa1700 1 --2- 172.21.15.37:0/2680818190 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff5040fdfd0 0x7ff5040702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:15:27.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:27.578+0000 7ff5097a2700 1 -- 172.21.15.37:0/2680818190 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff5040fdfd0 msgr2=0x7ff5040702b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:27.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:27.578+0000 7ff5097a2700 1 --2- 172.21.15.37:0/2680818190 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff5040fdfd0 0x7ff5040702b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:27.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:27.578+0000 7ff5097a2700 1 -- 172.21.15.37:0/2680818190 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f8005040 con 0x7ff5040fce60 2024-04-25T17:15:27.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:27.579+0000 7ff5097a2700 1 --2- 172.21.15.37:0/2680818190 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5040fce60 0x7ff504071c00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff4f4001d80 tx=0x7ff4f4009ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:15:27.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:27.579+0000 7ff501ffb700 1 -- 172.21.15.37:0/2680818190 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4f4007d10 con 0x7ff5040fce60 2024-04-25T17:15:27.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:27.579+0000 7ff50ba06700 1 -- 172.21.15.37:0/2680818190 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff504070aa0 con 0x7ff5040fce60 2024-04-25T17:15:27.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:27.579+0000 7ff501ffb700 1 -- 172.21.15.37:0/2680818190 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff4f4001e80 con 0x7ff5040fce60 2024-04-25T17:15:27.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:27.579+0000 7ff501ffb700 1 -- 172.21.15.37:0/2680818190 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4f4014640 con 0x7ff5040fce60 2024-04-25T17:15:27.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:27.579+0000 7ff50ba06700 1 -- 172.21.15.37:0/2680818190 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff504071060 con 0x7ff5040fce60 2024-04-25T17:15:27.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:27.580+0000 7ff50ba06700 1 -- 172.21.15.37:0/2680818190 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff50404c710 con 0x7ff5040fce60 2024-04-25T17:15:27.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:27.580+0000 7ff501ffb700 1 -- 172.21.15.37:0/2680818190 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7ff4f400e960 con 0x7ff5040fce60 2024-04-25T17:15:27.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:27.581+0000 7ff501ffb700 1 --2- 172.21.15.37:0/2680818190 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7ff4ec0692a0 0x7ff4ec06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:15:27.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:27.581+0000 7ff501ffb700 1 -- 172.21.15.37:0/2680818190 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ff4f4086bd0 con 0x7ff5040fce60 2024-04-25T17:15:27.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:27.581+0000 7ff508fa1700 1 --2- 172.21.15.37:0/2680818190 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7ff4ec0692a0 0x7ff4ec06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:15:27.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:27.581+0000 7ff508fa1700 1 --2- 172.21.15.37:0/2680818190 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7ff4ec0692a0 0x7ff4ec06b750 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff4f800b970 tx=0x7ff4f8009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:15:27.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:27.585+0000 7ff501ffb700 1 -- 172.21.15.37:0/2680818190 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7ff4f404e250 con 0x7ff5040fce60 2024-04-25T17:15:27.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:27.790+0000 7ff50ba06700 1 -- 172.21.15.37:0/2680818190 --> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff5041023e0 con 0x7ff4ec0692a0 2024-04-25T17:15:27.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:27.799+0000 7ff501ffb700 1 -- 172.21.15.37:0/2680818190 <== mgr.14214 v2:172.21.15.37:6800/3566135606 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2682 (secure 0 0 0) 0x7ff5041023e0 con 0x7ff4ec0692a0 2024-04-25T17:15:27.800 INFO:teuthology.orchestra.run.smithi037.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-25T17:15:27.800 INFO:teuthology.orchestra.run.smithi037.stdout:alertmanager.smithi037 smithi037 *:9093,9094 running (3m) 2m ago 5m 27.7M - 0.25.0 c8568f914cd2 82eacf476143 2024-04-25T17:15:27.801 INFO:teuthology.orchestra.run.smithi037.stdout:crash.smithi037 smithi037 running (5m) 2m ago 5m 6656k - 17.2.7-902-gc61472c8 0de407c1b3af b3d152574e80 2024-04-25T17:15:27.801 INFO:teuthology.orchestra.run.smithi037.stdout:crash.smithi069 smithi069 running (4m) 69s ago 4m 6660k - 17.2.7-902-gc61472c8 0de407c1b3af aa6086c64cc3 2024-04-25T17:15:27.801 INFO:teuthology.orchestra.run.smithi037.stdout:grafana.smithi037 smithi037 *:3000 running (3m) 2m ago 4m 80.2M - 9.4.7 954c08fa6188 0a09ff60869f 2024-04-25T17:15:27.801 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.smithi037.txrgxl smithi037 *:9283 running (6m) 2m ago 6m 470M - 17.2.7-902-gc61472c8 0de407c1b3af 796b326569c2 2024-04-25T17:15:27.801 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.smithi069.mmuhdo smithi069 *:8443,9283 running (4m) 69s ago 4m 430M - 17.2.7-902-gc61472c8 0de407c1b3af 32fa92400de4 2024-04-25T17:15:27.801 INFO:teuthology.orchestra.run.smithi037.stdout:mon.smithi037 smithi037 running (6m) 2m ago 6m 41.2M 2048M 17.2.7-902-gc61472c8 0de407c1b3af 5cfadcf8f2e4 2024-04-25T17:15:27.802 INFO:teuthology.orchestra.run.smithi037.stdout:mon.smithi069 smithi069 running (4m) 69s ago 4m 38.4M 2048M 17.2.7-902-gc61472c8 0de407c1b3af ffcd456d1dce 2024-04-25T17:15:27.802 INFO:teuthology.orchestra.run.smithi037.stdout:node-exporter.smithi037 smithi037 *:9100 running (5m) 2m ago 5m 14.2M - 1.5.0 0da6a335fe13 363761df1e06 2024-04-25T17:15:27.802 INFO:teuthology.orchestra.run.smithi037.stdout:node-exporter.smithi069 smithi069 *:9100 running (4m) 69s ago 4m 16.4M - 1.5.0 0da6a335fe13 5d407954c21f 2024-04-25T17:15:27.802 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0 smithi037 running (3m) 2m ago 3m 40.4M 4289M 17.2.7-902-gc61472c8 0de407c1b3af 8ff4b0f1aae9 2024-04-25T17:15:27.802 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1 smithi037 running (2m) 2m ago 2m 39.4M 4289M 17.2.7-902-gc61472c8 0de407c1b3af 5715a5da241d 2024-04-25T17:15:27.802 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2 smithi037 running (2m) 2m ago 2m 35.4M 4289M 17.2.7-902-gc61472c8 0de407c1b3af 2eedaf9886dd 2024-04-25T17:15:27.803 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3 smithi069 running (2m) 69s ago 2m 38.0M 5312M 17.2.7-902-gc61472c8 0de407c1b3af ebba78fb1923 2024-04-25T17:15:27.803 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4 smithi069 running (98s) 69s ago 98s 39.0M 5312M 17.2.7-902-gc61472c8 0de407c1b3af ba7b785c50f9 2024-04-25T17:15:27.803 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5 smithi069 running (74s) 69s ago 74s 13.4M 5312M 17.2.7-902-gc61472c8 0de407c1b3af f6be99c364ff 2024-04-25T17:15:27.803 INFO:teuthology.orchestra.run.smithi037.stdout:prometheus.smithi037 smithi037 *:9095 running (3m) 2m ago 4m 36.7M - 2.43.0 a07b618ecd1d 13d3c6f36732 2024-04-25T17:15:27.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:27.801+0000 7ff50ba06700 1 -- 172.21.15.37:0/2680818190 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7ff4ec0692a0 msgr2=0x7ff4ec06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:27.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:27.801+0000 7ff50ba06700 1 --2- 172.21.15.37:0/2680818190 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7ff4ec0692a0 0x7ff4ec06b750 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff4f800b970 tx=0x7ff4f8009e30 comp rx=0 tx=0).stop 2024-04-25T17:15:27.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:27.801+0000 7ff50ba06700 1 -- 172.21.15.37:0/2680818190 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5040fce60 msgr2=0x7ff504071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:27.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:27.801+0000 7ff50ba06700 1 --2- 172.21.15.37:0/2680818190 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5040fce60 0x7ff504071c00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff4f4001d80 tx=0x7ff4f4009ec0 comp rx=0 tx=0).stop 2024-04-25T17:15:27.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:27.801+0000 7ff50ba06700 1 -- 172.21.15.37:0/2680818190 shutdown_connections 2024-04-25T17:15:27.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:27.801+0000 7ff50ba06700 1 --2- 172.21.15.37:0/2680818190 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7ff4ec0692a0 0x7ff4ec06b750 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:27.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:27.801+0000 7ff50ba06700 1 --2- 172.21.15.37:0/2680818190 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5040fce60 0x7ff504071c00 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:27.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:27.801+0000 7ff50ba06700 1 --2- 172.21.15.37:0/2680818190 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff5040fdfd0 0x7ff5040702b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:27.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:27.801+0000 7ff50ba06700 1 -- 172.21.15.37:0/2680818190 >> 172.21.15.37:0/2680818190 conn(0x7ff5040f8540 msgr2=0x7ff5040f9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:15:27.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:27.802+0000 7ff50ba06700 1 -- 172.21.15.37:0/2680818190 shutdown_connections 2024-04-25T17:15:27.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:27.802+0000 7ff50ba06700 1 -- 172.21.15.37:0/2680818190 wait complete. 2024-04-25T17:15:28.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:27 smithi037 ceph-mon[26472]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:15:28.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:27 smithi069 ceph-mon[34527]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:15:28.600 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- bash -c 'ceph orch ls' 2024-04-25T17:15:28.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:28 smithi037 ceph-mon[26472]: from='client.14446 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:15:28.871 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:15:29.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:28 smithi069 ceph-mon[34527]: from='client.14446 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:15:29.918 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:29 smithi037 ceph-mon[26472]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:15:30.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:29 smithi069 ceph-mon[34527]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:15:30.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:30.465+0000 7eff0f811700 1 -- 172.21.15.37:0/2388711461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff080fce80 msgr2=0x7eff080fd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:30.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:30.465+0000 7eff0f811700 1 --2- 172.21.15.37:0/2388711461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff080fce80 0x7eff080fd290 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7eff04004940 tx=0x7eff04009e30 comp rx=0 tx=0).stop 2024-04-25T17:15:30.468 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:30.466+0000 7eff0f811700 1 -- 172.21.15.37:0/2388711461 shutdown_connections 2024-04-25T17:15:30.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:30.466+0000 7eff0f811700 1 --2- 172.21.15.37:0/2388711461 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7eff080fdff0 0x7eff080fe460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:30.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:30.466+0000 7eff0f811700 1 --2- 172.21.15.37:0/2388711461 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff080fce80 0x7eff080fd290 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:30.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:30.466+0000 7eff0f811700 1 -- 172.21.15.37:0/2388711461 >> 172.21.15.37:0/2388711461 conn(0x7eff080f8580 msgr2=0x7eff080fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:15:30.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:30.466+0000 7eff0f811700 1 -- 172.21.15.37:0/2388711461 shutdown_connections 2024-04-25T17:15:30.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:30.466+0000 7eff0f811700 1 -- 172.21.15.37:0/2388711461 wait complete. 2024-04-25T17:15:30.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:30.466+0000 7eff0f811700 1 Processor -- start 2024-04-25T17:15:30.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:30.466+0000 7eff0f811700 1 -- start start 2024-04-25T17:15:30.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:30.466+0000 7eff0f811700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff080fce80 0x7eff0810d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:15:30.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:30.466+0000 7eff0f811700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7eff080fdff0 0x7eff0810de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:15:30.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:30.466+0000 7eff0f811700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff0810e500 con 0x7eff080fce80 2024-04-25T17:15:30.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:30.466+0000 7eff0f811700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff08112ea0 con 0x7eff080fdff0 2024-04-25T17:15:30.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:30.466+0000 7eff0d5ad700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff080fce80 0x7eff0810d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:15:30.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:30.466+0000 7eff0d5ad700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff080fce80 0x7eff0810d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56956/0 (socket says 172.21.15.37:56956) 2024-04-25T17:15:30.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:30.466+0000 7eff0d5ad700 1 -- 172.21.15.37:0/3454577284 learned_addr learned my addr 172.21.15.37:0/3454577284 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:15:30.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:30.467+0000 7eff0cdac700 1 --2- 172.21.15.37:0/3454577284 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7eff080fdff0 0x7eff0810de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:15:30.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:30.467+0000 7eff0d5ad700 1 -- 172.21.15.37:0/3454577284 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7eff080fdff0 msgr2=0x7eff0810de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:30.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:30.467+0000 7eff0d5ad700 1 --2- 172.21.15.37:0/3454577284 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7eff080fdff0 0x7eff0810de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:30.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:30.467+0000 7eff0d5ad700 1 -- 172.21.15.37:0/3454577284 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff04005040 con 0x7eff080fce80 2024-04-25T17:15:30.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:30.467+0000 7eff0d5ad700 1 --2- 172.21.15.37:0/3454577284 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff080fce80 0x7eff0810d930 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7eff04009150 tx=0x7eff04009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:15:30.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:30.467+0000 7efefdffb700 1 -- 172.21.15.37:0/3454577284 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff0400e040 con 0x7eff080fce80 2024-04-25T17:15:30.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:30.467+0000 7efefdffb700 1 -- 172.21.15.37:0/3454577284 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7eff0400bbf0 con 0x7eff080fce80 2024-04-25T17:15:30.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:30.467+0000 7eff0f811700 1 -- 172.21.15.37:0/3454577284 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff081130a0 con 0x7eff080fce80 2024-04-25T17:15:30.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:30.467+0000 7efefdffb700 1 -- 172.21.15.37:0/3454577284 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff0401c630 con 0x7eff080fce80 2024-04-25T17:15:30.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:30.467+0000 7eff0f811700 1 -- 172.21.15.37:0/3454577284 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff08113610 con 0x7eff080fce80 2024-04-25T17:15:30.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:30.468+0000 7eff0f811700 1 -- 172.21.15.37:0/3454577284 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff0804c710 con 0x7eff080fce80 2024-04-25T17:15:30.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:30.469+0000 7efefdffb700 1 -- 172.21.15.37:0/3454577284 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7eff0400bd60 con 0x7eff080fce80 2024-04-25T17:15:30.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:30.469+0000 7efefdffb700 1 --2- 172.21.15.37:0/3454577284 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7efef40692a0 0x7efef406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:15:30.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:30.469+0000 7efefdffb700 1 -- 172.21.15.37:0/3454577284 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7eff040881c0 con 0x7eff080fce80 2024-04-25T17:15:30.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:30.469+0000 7eff0cdac700 1 --2- 172.21.15.37:0/3454577284 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7efef40692a0 0x7efef406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:15:30.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:30.470+0000 7eff0cdac700 1 --2- 172.21.15.37:0/3454577284 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7efef40692a0 0x7efef406b750 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7efef8006fd0 tx=0x7efef8008040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:15:30.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:30.474+0000 7efefdffb700 1 -- 172.21.15.37:0/3454577284 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7eff04058410 con 0x7eff080fce80 2024-04-25T17:15:30.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:30.676+0000 7eff0f811700 1 -- 172.21.15.37:0/3454577284 --> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7eff08102290 con 0x7efef40692a0 2024-04-25T17:15:30.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:30.680+0000 7efefdffb700 1 -- 172.21.15.37:0/3454577284 <== mgr.14214 v2:172.21.15.37:6800/3566135606 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1161 (secure 0 0 0) 0x7eff08102290 con 0x7efef40692a0 2024-04-25T17:15:30.682 INFO:teuthology.orchestra.run.smithi037.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-04-25T17:15:30.682 INFO:teuthology.orchestra.run.smithi037.stdout:alertmanager ?:9093,9094 1/1 2m ago 6m count:1 2024-04-25T17:15:30.682 INFO:teuthology.orchestra.run.smithi037.stdout:crash 2/2 2m ago 6m * 2024-04-25T17:15:30.682 INFO:teuthology.orchestra.run.smithi037.stdout:grafana ?:3000 1/1 2m ago 6m count:1 2024-04-25T17:15:30.682 INFO:teuthology.orchestra.run.smithi037.stdout:mgr 2/2 2m ago 6m count:2 2024-04-25T17:15:30.682 INFO:teuthology.orchestra.run.smithi037.stdout:mon 2/2 2m ago 5m smithi037:172.21.15.37=smithi037;smithi069:172.21.15.69=smithi069;count:2 2024-04-25T17:15:30.682 INFO:teuthology.orchestra.run.smithi037.stdout:node-exporter ?:9100 2/2 2m ago 6m * 2024-04-25T17:15:30.682 INFO:teuthology.orchestra.run.smithi037.stdout:osd 6 2m ago - 2024-04-25T17:15:30.682 INFO:teuthology.orchestra.run.smithi037.stdout:prometheus ?:9095 1/1 2m ago 6m count:1 2024-04-25T17:15:30.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:30.683+0000 7eff0f811700 1 -- 172.21.15.37:0/3454577284 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7efef40692a0 msgr2=0x7efef406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:30.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:30.683+0000 7eff0f811700 1 --2- 172.21.15.37:0/3454577284 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7efef40692a0 0x7efef406b750 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7efef8006fd0 tx=0x7efef8008040 comp rx=0 tx=0).stop 2024-04-25T17:15:30.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:30.683+0000 7eff0f811700 1 -- 172.21.15.37:0/3454577284 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff080fce80 msgr2=0x7eff0810d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:30.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:30.683+0000 7eff0f811700 1 --2- 172.21.15.37:0/3454577284 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff080fce80 0x7eff0810d930 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7eff04009150 tx=0x7eff04009e30 comp rx=0 tx=0).stop 2024-04-25T17:15:30.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:30.683+0000 7eff0f811700 1 -- 172.21.15.37:0/3454577284 shutdown_connections 2024-04-25T17:15:30.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:30.683+0000 7eff0f811700 1 --2- 172.21.15.37:0/3454577284 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7efef40692a0 0x7efef406b750 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:30.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:30.683+0000 7eff0f811700 1 --2- 172.21.15.37:0/3454577284 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff080fce80 0x7eff0810d930 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:30.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:30.683+0000 7eff0f811700 1 --2- 172.21.15.37:0/3454577284 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7eff080fdff0 0x7eff0810de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:30.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:30.683+0000 7eff0f811700 1 -- 172.21.15.37:0/3454577284 >> 172.21.15.37:0/3454577284 conn(0x7eff080f8580 msgr2=0x7eff080f9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:15:30.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:30.683+0000 7eff0f811700 1 -- 172.21.15.37:0/3454577284 shutdown_connections 2024-04-25T17:15:30.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:30.683+0000 7eff0f811700 1 -- 172.21.15.37:0/3454577284 wait complete. 2024-04-25T17:15:31.067 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:30 smithi037 ceph-mon[26472]: from='client.14450 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:15:31.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:30 smithi069 ceph-mon[34527]: from='client.14450 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:15:31.516 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- bash -c 'ceph orch host ls' 2024-04-25T17:15:31.788 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:15:32.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:31 smithi037 ceph-mon[26472]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:15:32.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:31 smithi069 ceph-mon[34527]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:15:33.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:33.365+0000 7f93df03e700 1 -- 172.21.15.37:0/4267531999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93d80fce60 msgr2=0x7f93d80fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:33.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:33.365+0000 7f93df03e700 1 --2- 172.21.15.37:0/4267531999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93d80fce60 0x7f93d80fd270 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f93cc004940 tx=0x7f93cc009e30 comp rx=0 tx=0).stop 2024-04-25T17:15:33.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:33.366+0000 7f93df03e700 1 -- 172.21.15.37:0/4267531999 shutdown_connections 2024-04-25T17:15:33.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:33.366+0000 7f93df03e700 1 --2- 172.21.15.37:0/4267531999 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f93d80fdfd0 0x7f93d80fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:33.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:33.366+0000 7f93df03e700 1 --2- 172.21.15.37:0/4267531999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93d80fce60 0x7f93d80fd270 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:33.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:33.366+0000 7f93df03e700 1 -- 172.21.15.37:0/4267531999 >> 172.21.15.37:0/4267531999 conn(0x7f93d80f8540 msgr2=0x7f93d80fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:15:33.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:33.366+0000 7f93df03e700 1 -- 172.21.15.37:0/4267531999 shutdown_connections 2024-04-25T17:15:33.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:33.366+0000 7f93df03e700 1 -- 172.21.15.37:0/4267531999 wait complete. 2024-04-25T17:15:33.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:33.366+0000 7f93df03e700 1 Processor -- start 2024-04-25T17:15:33.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:33.366+0000 7f93df03e700 1 -- start start 2024-04-25T17:15:33.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:33.366+0000 7f93df03e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93d80fce60 0x7f93d810fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:15:33.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:33.366+0000 7f93df03e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f93d80fdfd0 0x7f93d8110070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:15:33.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:33.366+0000 7f93df03e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d8110670 con 0x7f93d80fce60 2024-04-25T17:15:33.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:33.366+0000 7f93df03e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d81107e0 con 0x7f93d80fdfd0 2024-04-25T17:15:33.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:33.367+0000 7f93dcdda700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93d80fce60 0x7f93d810fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:15:33.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:33.367+0000 7f93dcdda700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93d80fce60 0x7f93d810fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56966/0 (socket says 172.21.15.37:56966) 2024-04-25T17:15:33.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:33.367+0000 7f93dcdda700 1 -- 172.21.15.37:0/3801799128 learned_addr learned my addr 172.21.15.37:0/3801799128 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:15:33.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:33.367+0000 7f93d7fff700 1 --2- 172.21.15.37:0/3801799128 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f93d80fdfd0 0x7f93d8110070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:15:33.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:33.367+0000 7f93dcdda700 1 -- 172.21.15.37:0/3801799128 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f93d80fdfd0 msgr2=0x7f93d8110070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:33.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:33.367+0000 7f93dcdda700 1 --2- 172.21.15.37:0/3801799128 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f93d80fdfd0 0x7f93d8110070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:33.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:33.367+0000 7f93dcdda700 1 -- 172.21.15.37:0/3801799128 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93cc005040 con 0x7f93d80fce60 2024-04-25T17:15:33.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:33.367+0000 7f93dcdda700 1 --2- 172.21.15.37:0/3801799128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93d80fce60 0x7f93d810fb30 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f93cc009150 tx=0x7f93cc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:15:33.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:33.367+0000 7f93d57fa700 1 -- 172.21.15.37:0/3801799128 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93cc00e040 con 0x7f93d80fce60 2024-04-25T17:15:33.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:33.367+0000 7f93df03e700 1 -- 172.21.15.37:0/3801799128 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93d81151e0 con 0x7f93d80fce60 2024-04-25T17:15:33.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:33.367+0000 7f93d57fa700 1 -- 172.21.15.37:0/3801799128 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f93cc00bbf0 con 0x7f93d80fce60 2024-04-25T17:15:33.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:33.367+0000 7f93d57fa700 1 -- 172.21.15.37:0/3801799128 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93cc01c630 con 0x7f93d80fce60 2024-04-25T17:15:33.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:33.367+0000 7f93df03e700 1 -- 172.21.15.37:0/3801799128 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93d81157a0 con 0x7f93d80fce60 2024-04-25T17:15:33.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:33.368+0000 7f93df03e700 1 -- 172.21.15.37:0/3801799128 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93d8101960 con 0x7f93d80fce60 2024-04-25T17:15:33.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:33.369+0000 7f93d57fa700 1 -- 172.21.15.37:0/3801799128 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f93cc00bd60 con 0x7f93d80fce60 2024-04-25T17:15:33.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:33.369+0000 7f93d57fa700 1 --2- 172.21.15.37:0/3801799128 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f93c80692a0 0x7f93c806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:15:33.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:33.369+0000 7f93d57fa700 1 -- 172.21.15.37:0/3801799128 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f93cc088190 con 0x7f93d80fce60 2024-04-25T17:15:33.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:33.369+0000 7f93d7fff700 1 --2- 172.21.15.37:0/3801799128 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f93c80692a0 0x7f93c806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:15:33.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:33.370+0000 7f93d7fff700 1 --2- 172.21.15.37:0/3801799128 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f93c80692a0 0x7f93c806b750 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f93c4004990 tx=0x7f93c4009ee0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:15:33.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:33.374+0000 7f93d57fa700 1 -- 172.21.15.37:0/3801799128 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f93cc058330 con 0x7f93d80fce60 2024-04-25T17:15:33.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:33.576+0000 7f93df03e700 1 -- 172.21.15.37:0/3801799128 --> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f93d802b340 con 0x7f93c80692a0 2024-04-25T17:15:33.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:33.578+0000 7f93d57fa700 1 -- 172.21.15.37:0/3801799128 <== mgr.14214 v2:172.21.15.37:6800/3566135606 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+145 (secure 0 0 0) 0x7f93d802b340 con 0x7f93c80692a0 2024-04-25T17:15:33.579 INFO:teuthology.orchestra.run.smithi037.stdout:HOST ADDR LABELS STATUS 2024-04-25T17:15:33.579 INFO:teuthology.orchestra.run.smithi037.stdout:smithi037 172.21.15.37 2024-04-25T17:15:33.579 INFO:teuthology.orchestra.run.smithi037.stdout:smithi069 172.21.15.69 2024-04-25T17:15:33.579 INFO:teuthology.orchestra.run.smithi037.stdout:2 hosts in cluster 2024-04-25T17:15:33.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:33.580+0000 7f93df03e700 1 -- 172.21.15.37:0/3801799128 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f93c80692a0 msgr2=0x7f93c806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:33.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:33.580+0000 7f93df03e700 1 --2- 172.21.15.37:0/3801799128 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f93c80692a0 0x7f93c806b750 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f93c4004990 tx=0x7f93c4009ee0 comp rx=0 tx=0).stop 2024-04-25T17:15:33.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:33.580+0000 7f93df03e700 1 -- 172.21.15.37:0/3801799128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93d80fce60 msgr2=0x7f93d810fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:33.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:33.580+0000 7f93df03e700 1 --2- 172.21.15.37:0/3801799128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93d80fce60 0x7f93d810fb30 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f93cc009150 tx=0x7f93cc009e30 comp rx=0 tx=0).stop 2024-04-25T17:15:33.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:33.580+0000 7f93df03e700 1 -- 172.21.15.37:0/3801799128 shutdown_connections 2024-04-25T17:15:33.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:33.580+0000 7f93df03e700 1 --2- 172.21.15.37:0/3801799128 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f93c80692a0 0x7f93c806b750 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:33.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:33.580+0000 7f93df03e700 1 --2- 172.21.15.37:0/3801799128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93d80fce60 0x7f93d810fb30 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:33.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:33.580+0000 7f93df03e700 1 --2- 172.21.15.37:0/3801799128 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f93d80fdfd0 0x7f93d8110070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:33.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:33.580+0000 7f93df03e700 1 -- 172.21.15.37:0/3801799128 >> 172.21.15.37:0/3801799128 conn(0x7f93d80f8540 msgr2=0x7f93d80f9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:15:33.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:33.580+0000 7f93df03e700 1 -- 172.21.15.37:0/3801799128 shutdown_connections 2024-04-25T17:15:33.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:33.580+0000 7f93df03e700 1 -- 172.21.15.37:0/3801799128 wait complete. 2024-04-25T17:15:34.284 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- bash -c 'ceph orch device ls' 2024-04-25T17:15:34.546 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:15:34.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:34 smithi037 ceph-mon[26472]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:15:34.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:34 smithi037 ceph-mon[26472]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:15:34.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:34 smithi069 ceph-mon[34527]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:15:34.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:34 smithi069 ceph-mon[34527]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:15:36.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:36.145+0000 7fc6906d4700 1 -- 172.21.15.37:0/1558436994 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6880fdff0 msgr2=0x7fc6880fe460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:36.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:36.145+0000 7fc6906d4700 1 --2- 172.21.15.37:0/1558436994 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6880fdff0 0x7fc6880fe460 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc678004940 tx=0x7fc678009e30 comp rx=0 tx=0).stop 2024-04-25T17:15:36.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:36.145+0000 7fc6906d4700 1 -- 172.21.15.37:0/1558436994 shutdown_connections 2024-04-25T17:15:36.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:36.145+0000 7fc6906d4700 1 --2- 172.21.15.37:0/1558436994 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6880fdff0 0x7fc6880fe460 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:36.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:36.145+0000 7fc6906d4700 1 --2- 172.21.15.37:0/1558436994 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6880fce80 0x7fc6880fd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:36.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:36.145+0000 7fc6906d4700 1 -- 172.21.15.37:0/1558436994 >> 172.21.15.37:0/1558436994 conn(0x7fc6880f8540 msgr2=0x7fc6880fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:15:36.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:36.145+0000 7fc6906d4700 1 -- 172.21.15.37:0/1558436994 shutdown_connections 2024-04-25T17:15:36.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:36.145+0000 7fc6906d4700 1 -- 172.21.15.37:0/1558436994 wait complete. 2024-04-25T17:15:36.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:36.145+0000 7fc6906d4700 1 Processor -- start 2024-04-25T17:15:36.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:36.145+0000 7fc6906d4700 1 -- start start 2024-04-25T17:15:36.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:36.146+0000 7fc6906d4700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6880fce80 0x7fc688071de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:15:36.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:36.146+0000 7fc6906d4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6880fdff0 0x7fc6880702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:15:36.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:36.146+0000 7fc6906d4700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc688070860 con 0x7fc6880fdff0 2024-04-25T17:15:36.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:36.146+0000 7fc6906d4700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6880709d0 con 0x7fc6880fce80 2024-04-25T17:15:36.148 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:36.146+0000 7fc68dc6f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6880fdff0 0x7fc6880702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:15:36.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:36.146+0000 7fc68dc6f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6880fdff0 0x7fc6880702b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56974/0 (socket says 172.21.15.37:56974) 2024-04-25T17:15:36.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:36.146+0000 7fc68dc6f700 1 -- 172.21.15.37:0/2992635618 learned_addr learned my addr 172.21.15.37:0/2992635618 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:15:36.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:36.146+0000 7fc68e470700 1 --2- 172.21.15.37:0/2992635618 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6880fce80 0x7fc688071de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:15:36.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:36.146+0000 7fc68dc6f700 1 -- 172.21.15.37:0/2992635618 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6880fce80 msgr2=0x7fc688071de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:36.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:36.146+0000 7fc68dc6f700 1 --2- 172.21.15.37:0/2992635618 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6880fce80 0x7fc688071de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:36.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:36.146+0000 7fc68dc6f700 1 -- 172.21.15.37:0/2992635618 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc678005040 con 0x7fc6880fdff0 2024-04-25T17:15:36.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:36.146+0000 7fc68dc6f700 1 --2- 172.21.15.37:0/2992635618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6880fdff0 0x7fc6880702b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc67800b3b0 tx=0x7fc678009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:15:36.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:36.146+0000 7fc67effd700 1 -- 172.21.15.37:0/2992635618 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc67800e040 con 0x7fc6880fdff0 2024-04-25T17:15:36.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:36.146+0000 7fc6906d4700 1 -- 172.21.15.37:0/2992635618 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc688070c50 con 0x7fc6880fdff0 2024-04-25T17:15:36.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:36.146+0000 7fc67effd700 1 -- 172.21.15.37:0/2992635618 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc67800bbf0 con 0x7fc6880fdff0 2024-04-25T17:15:36.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:36.146+0000 7fc67effd700 1 -- 172.21.15.37:0/2992635618 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc67801c630 con 0x7fc6880fdff0 2024-04-25T17:15:36.149 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:36.146+0000 7fc6906d4700 1 -- 172.21.15.37:0/2992635618 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc688115a50 con 0x7fc6880fdff0 2024-04-25T17:15:36.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:36.147+0000 7fc6906d4700 1 -- 172.21.15.37:0/2992635618 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc68805f5c0 con 0x7fc6880fdff0 2024-04-25T17:15:36.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:36.148+0000 7fc67effd700 1 -- 172.21.15.37:0/2992635618 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fc67800bd60 con 0x7fc6880fdff0 2024-04-25T17:15:36.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:36.148+0000 7fc67effd700 1 --2- 172.21.15.37:0/2992635618 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fc6740692a0 0x7fc67406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:15:36.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:36.148+0000 7fc67effd700 1 -- 172.21.15.37:0/2992635618 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fc678087c20 con 0x7fc6880fdff0 2024-04-25T17:15:36.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:36.148+0000 7fc68e470700 1 --2- 172.21.15.37:0/2992635618 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fc6740692a0 0x7fc67406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:15:36.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:36.149+0000 7fc68e470700 1 --2- 172.21.15.37:0/2992635618 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fc6740692a0 0x7fc67406b750 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc684004550 tx=0x7fc684007ed0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:15:36.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:36.153+0000 7fc67effd700 1 -- 172.21.15.37:0/2992635618 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fc6780541f0 con 0x7fc6880fdff0 2024-04-25T17:15:36.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:36.356+0000 7fc6906d4700 1 -- 172.21.15.37:0/2992635618 --> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fc688102310 con 0x7fc6740692a0 2024-04-25T17:15:36.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:36.358+0000 7fc67effd700 1 -- 172.21.15.37:0/2992635618 <== mgr.14214 v2:172.21.15.37:6800/3566135606 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7fc688102310 con 0x7fc6740692a0 2024-04-25T17:15:36.359 INFO:teuthology.orchestra.run.smithi037.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-04-25T17:15:36.359 INFO:teuthology.orchestra.run.smithi037.stdout:smithi037 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT5331005T400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-04-25T17:15:36.359 INFO:teuthology.orchestra.run.smithi037.stdout:smithi069 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400Y0400BGN 372G No 74s ago Has a FileSystem, LVM detected 2024-04-25T17:15:36.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:36.359+0000 7fc6906d4700 1 -- 172.21.15.37:0/2992635618 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fc6740692a0 msgr2=0x7fc67406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:36.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:36.359+0000 7fc6906d4700 1 --2- 172.21.15.37:0/2992635618 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fc6740692a0 0x7fc67406b750 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc684004550 tx=0x7fc684007ed0 comp rx=0 tx=0).stop 2024-04-25T17:15:36.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:36.359+0000 7fc6906d4700 1 -- 172.21.15.37:0/2992635618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6880fdff0 msgr2=0x7fc6880702b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:36.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:36.359+0000 7fc6906d4700 1 --2- 172.21.15.37:0/2992635618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6880fdff0 0x7fc6880702b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc67800b3b0 tx=0x7fc678009e30 comp rx=0 tx=0).stop 2024-04-25T17:15:36.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:36.359+0000 7fc6906d4700 1 -- 172.21.15.37:0/2992635618 shutdown_connections 2024-04-25T17:15:36.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:36.359+0000 7fc6906d4700 1 --2- 172.21.15.37:0/2992635618 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fc6740692a0 0x7fc67406b750 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:36.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:36.359+0000 7fc6906d4700 1 --2- 172.21.15.37:0/2992635618 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6880fce80 0x7fc688071de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:36.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:36.360+0000 7fc6906d4700 1 --2- 172.21.15.37:0/2992635618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6880fdff0 0x7fc6880702b0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:36.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:36.360+0000 7fc6906d4700 1 -- 172.21.15.37:0/2992635618 >> 172.21.15.37:0/2992635618 conn(0x7fc6880f8540 msgr2=0x7fc6880f9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:15:36.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:36.360+0000 7fc6906d4700 1 -- 172.21.15.37:0/2992635618 shutdown_connections 2024-04-25T17:15:36.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:36.360+0000 7fc6906d4700 1 -- 172.21.15.37:0/2992635618 wait complete. 2024-04-25T17:15:36.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:36 smithi037 ceph-mon[26472]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:15:36.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:36 smithi069 ceph-mon[34527]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:15:36.939 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-25T17:15:36.947 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi037.front.sepia.ceph.com 2024-04-25T17:15:36.948 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-04-25T17:15:37.215 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:15:37.623 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:37 smithi037 ceph-mon[26472]: from='client.14458 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:15:37.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:37 smithi069 ceph-mon[34527]: from='client.14458 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:15:38.616 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:38 smithi037 ceph-mon[26472]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:15:38.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:38.836+0000 7fe4c81c8700 1 -- 172.21.15.37:0/679678727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4c00fdca0 msgr2=0x7fe4c01045f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:38.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:38.836+0000 7fe4c81c8700 1 --2- 172.21.15.37:0/679678727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4c00fdca0 0x7fe4c01045f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe4b0004940 tx=0x7fe4b0009e30 comp rx=0 tx=0).stop 2024-04-25T17:15:38.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:38.836+0000 7fe4c81c8700 1 -- 172.21.15.37:0/679678727 shutdown_connections 2024-04-25T17:15:38.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:38.836+0000 7fe4c81c8700 1 --2- 172.21.15.37:0/679678727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4c00fdca0 0x7fe4c01045f0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:38.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:38.836+0000 7fe4c81c8700 1 --2- 172.21.15.37:0/679678727 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe4c00fd350 0x7fe4c00fd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:38.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:38.836+0000 7fe4c81c8700 1 -- 172.21.15.37:0/679678727 >> 172.21.15.37:0/679678727 conn(0x7fe4c00f6be0 msgr2=0x7fe4c00f8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:15:38.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:38.836+0000 7fe4c81c8700 1 -- 172.21.15.37:0/679678727 shutdown_connections 2024-04-25T17:15:38.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:38.836+0000 7fe4c81c8700 1 -- 172.21.15.37:0/679678727 wait complete. 2024-04-25T17:15:38.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:38.836+0000 7fe4c81c8700 1 Processor -- start 2024-04-25T17:15:38.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:38.836+0000 7fe4c81c8700 1 -- start start 2024-04-25T17:15:38.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:38.836+0000 7fe4c81c8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4c00fd350 0x7fe4c010fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:15:38.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:38.836+0000 7fe4c81c8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe4c00fdca0 0x7fe4c0110060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:15:38.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:38.836+0000 7fe4c81c8700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c01106f0 con 0x7fe4c00fd350 2024-04-25T17:15:38.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:38.836+0000 7fe4c81c8700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c0115090 con 0x7fe4c00fdca0 2024-04-25T17:15:38.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:38.837+0000 7fe4c5f64700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4c00fd350 0x7fe4c010fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:15:38.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:38.837+0000 7fe4c5f64700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4c00fd350 0x7fe4c010fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34370/0 (socket says 172.21.15.37:34370) 2024-04-25T17:15:38.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:38.837+0000 7fe4c5f64700 1 -- 172.21.15.37:0/3610082885 learned_addr learned my addr 172.21.15.37:0/3610082885 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:15:38.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:38.837+0000 7fe4c5763700 1 --2- 172.21.15.37:0/3610082885 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe4c00fdca0 0x7fe4c0110060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:15:38.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:38.837+0000 7fe4c5f64700 1 -- 172.21.15.37:0/3610082885 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe4c00fdca0 msgr2=0x7fe4c0110060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:38.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:38.837+0000 7fe4c5f64700 1 --2- 172.21.15.37:0/3610082885 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe4c00fdca0 0x7fe4c0110060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:38.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:38.837+0000 7fe4c5f64700 1 -- 172.21.15.37:0/3610082885 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b0005040 con 0x7fe4c00fd350 2024-04-25T17:15:38.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:38.837+0000 7fe4c5f64700 1 --2- 172.21.15.37:0/3610082885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4c00fd350 0x7fe4c010fb20 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc00b790 tx=0x7fe4bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:15:38.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:38.837+0000 7fe4b67fc700 1 -- 172.21.15.37:0/3610082885 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4bc00f6f0 con 0x7fe4c00fd350 2024-04-25T17:15:38.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:38.837+0000 7fe4b67fc700 1 -- 172.21.15.37:0/3610082885 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe4bc00fd20 con 0x7fe4c00fd350 2024-04-25T17:15:38.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:38.837+0000 7fe4c81c8700 1 -- 172.21.15.37:0/3610082885 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4c01152f0 con 0x7fe4c00fd350 2024-04-25T17:15:38.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:38.838+0000 7fe4b67fc700 1 -- 172.21.15.37:0/3610082885 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4bc0103a0 con 0x7fe4c00fd350 2024-04-25T17:15:38.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:38.838+0000 7fe4c81c8700 1 -- 172.21.15.37:0/3610082885 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4c0115860 con 0x7fe4c00fd350 2024-04-25T17:15:38.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:38.838+0000 7fe4c81c8700 1 -- 172.21.15.37:0/3610082885 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4c004c710 con 0x7fe4c00fd350 2024-04-25T17:15:38.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:38.839+0000 7fe4b67fc700 1 -- 172.21.15.37:0/3610082885 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fe4bc011400 con 0x7fe4c00fd350 2024-04-25T17:15:38.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:38.839+0000 7fe4b67fc700 1 --2- 172.21.15.37:0/3610082885 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fe4ac0692a0 0x7fe4ac06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:15:38.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:38.839+0000 7fe4b67fc700 1 -- 172.21.15.37:0/3610082885 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe4bc086b60 con 0x7fe4c00fd350 2024-04-25T17:15:38.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:38.839+0000 7fe4c5763700 1 --2- 172.21.15.37:0/3610082885 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fe4ac0692a0 0x7fe4ac06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:15:38.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:38.840+0000 7fe4c5763700 1 --2- 172.21.15.37:0/3610082885 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fe4ac0692a0 0x7fe4ac06b750 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe4b000b970 tx=0x7fe4b0009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:15:38.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:38.844+0000 7fe4b67fc700 1 -- 172.21.15.37:0/3610082885 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fe4bc056d00 con 0x7fe4c00fd350 2024-04-25T17:15:38.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:38 smithi069 ceph-mon[34527]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:15:39.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:39.068+0000 7fe4c81c8700 1 -- 172.21.15.37:0/3610082885 --> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fe4c00f86d0 con 0x7fe4ac0692a0 2024-04-25T17:15:39.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:39 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-04-25T17:15:40.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:39 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-04-25T17:15:40.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:40.606+0000 7fe4b67fc700 1 -- 172.21.15.37:0/3610082885 <== mgr.14214 v2:172.21.15.37:6800/3566135606 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fe4c00f86d0 con 0x7fe4ac0692a0 2024-04-25T17:15:40.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:40.610+0000 7fe4c81c8700 1 -- 172.21.15.37:0/3610082885 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fe4ac0692a0 msgr2=0x7fe4ac06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:40.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:40.610+0000 7fe4c81c8700 1 --2- 172.21.15.37:0/3610082885 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fe4ac0692a0 0x7fe4ac06b750 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe4b000b970 tx=0x7fe4b0009e30 comp rx=0 tx=0).stop 2024-04-25T17:15:40.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:40.610+0000 7fe4c81c8700 1 -- 172.21.15.37:0/3610082885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4c00fd350 msgr2=0x7fe4c010fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:40.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:40.610+0000 7fe4c81c8700 1 --2- 172.21.15.37:0/3610082885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4c00fd350 0x7fe4c010fb20 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc00b790 tx=0x7fe4bc009250 comp rx=0 tx=0).stop 2024-04-25T17:15:40.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:40.610+0000 7fe4c81c8700 1 -- 172.21.15.37:0/3610082885 shutdown_connections 2024-04-25T17:15:40.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:40.610+0000 7fe4c81c8700 1 --2- 172.21.15.37:0/3610082885 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fe4ac0692a0 0x7fe4ac06b750 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:40.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:40.610+0000 7fe4c81c8700 1 --2- 172.21.15.37:0/3610082885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe4c00fd350 0x7fe4c010fb20 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:40.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:40.610+0000 7fe4c81c8700 1 --2- 172.21.15.37:0/3610082885 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe4c00fdca0 0x7fe4c0110060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:40.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:40.610+0000 7fe4c81c8700 1 -- 172.21.15.37:0/3610082885 >> 172.21.15.37:0/3610082885 conn(0x7fe4c00f6be0 msgr2=0x7fe4c00f6fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:15:40.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:40.610+0000 7fe4c81c8700 1 -- 172.21.15.37:0/3610082885 shutdown_connections 2024-04-25T17:15:40.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:40.610+0000 7fe4c81c8700 1 -- 172.21.15.37:0/3610082885 wait complete. 2024-04-25T17:15:40.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:40 smithi069 ceph-mon[34527]: from='client.14462 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:15:40.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:40 smithi069 ceph-mon[34527]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:15:40.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:40 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-04-25T17:15:40.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:40 smithi069 ceph-mon[34527]: osdmap e42: 6 total, 6 up, 6 in 2024-04-25T17:15:40.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:40 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-04-25T17:15:40.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:40 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:15:40.942 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:40 smithi037 ceph-mon[26472]: from='client.14462 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:15:40.942 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:40 smithi037 ceph-mon[26472]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:15:40.942 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:40 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-04-25T17:15:40.942 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:40 smithi037 ceph-mon[26472]: osdmap e42: 6 total, 6 up, 6 in 2024-04-25T17:15:40.942 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:40 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-04-25T17:15:40.943 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:40 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:15:40.943 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:40 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-mon-smithi037[26468]: 2024-04-25T17:15:40.585+0000 7f77305f5700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T17:15:41.267 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- bash -c 'ceph fs dump' 2024-04-25T17:15:41.762 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:41 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-04-25T17:15:41.762 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:41 smithi037 ceph-mon[26472]: osdmap e43: 6 total, 6 up, 6 in 2024-04-25T17:15:41.762 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:41 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-04-25T17:15:41.762 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:41 smithi037 ceph-mon[26472]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T17:15:41.763 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:41 smithi037 ceph-mon[26472]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-25T17:15:41.763 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:41 smithi037 ceph-mon[26472]: osdmap e44: 6 total, 6 up, 6 in 2024-04-25T17:15:41.763 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:41 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-04-25T17:15:41.763 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:41 smithi037 ceph-mon[26472]: fsmap cephfs:0 2024-04-25T17:15:41.763 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:41 smithi037 ceph-mon[26472]: Saving service mds.cephfs spec with placement count:4 2024-04-25T17:15:41.763 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:41 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:15:41.763 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:41 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:15:41.763 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:41 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:15:41.763 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:41 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:15:41.763 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:41 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:15:41.763 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:41 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi037.ksmixc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T17:15:41.763 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:41 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi037.ksmixc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T17:15:41.763 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:41 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:15:41.764 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:41 smithi037 ceph-mon[26472]: Deploying daemon mds.cephfs.smithi037.ksmixc on smithi037 2024-04-25T17:15:41.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:41 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-04-25T17:15:41.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:41 smithi069 ceph-mon[34527]: osdmap e43: 6 total, 6 up, 6 in 2024-04-25T17:15:41.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:41 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-04-25T17:15:41.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:41 smithi069 ceph-mon[34527]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T17:15:41.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:41 smithi069 ceph-mon[34527]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-04-25T17:15:41.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:41 smithi069 ceph-mon[34527]: osdmap e44: 6 total, 6 up, 6 in 2024-04-25T17:15:41.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:41 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-04-25T17:15:41.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:41 smithi069 ceph-mon[34527]: fsmap cephfs:0 2024-04-25T17:15:41.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:41 smithi069 ceph-mon[34527]: Saving service mds.cephfs spec with placement count:4 2024-04-25T17:15:41.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:41 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:15:41.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:41 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:15:41.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:41 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:15:41.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:41 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:15:41.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:41 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:15:41.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:41 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi037.ksmixc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T17:15:41.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:41 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi037.ksmixc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T17:15:41.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:41 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:15:41.920 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:41 smithi069 ceph-mon[34527]: Deploying daemon mds.cephfs.smithi037.ksmixc on smithi037 2024-04-25T17:15:42.636 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:15:42.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:42 smithi037 ceph-mon[26472]: pgmap v175: 65 pgs: 2 creating+activating, 3 creating+peering, 18 active+clean, 42 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:15:42.791 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:42 smithi037 ceph-mon[26472]: osdmap e45: 6 total, 6 up, 6 in 2024-04-25T17:15:42.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:42 smithi069 ceph-mon[34527]: pgmap v175: 65 pgs: 2 creating+activating, 3 creating+peering, 18 active+clean, 42 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:15:42.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:42 smithi069 ceph-mon[34527]: osdmap e45: 6 total, 6 up, 6 in 2024-04-25T17:15:43.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:43 smithi037 ceph-mon[26472]: osdmap e46: 6 total, 6 up, 6 in 2024-04-25T17:15:43.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:43 smithi069 ceph-mon[34527]: osdmap e46: 6 total, 6 up, 6 in 2024-04-25T17:15:44.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:44.682+0000 7f927f94f700 1 -- 172.21.15.37:0/3203138596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92780fcf60 msgr2=0x7f92780fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:44.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:44.682+0000 7f927f94f700 1 --2- 172.21.15.37:0/3203138596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92780fcf60 0x7f92780fd3d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9268004940 tx=0x7f9268009e30 comp rx=0 tx=0).stop 2024-04-25T17:15:44.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:44.682+0000 7f927f94f700 1 -- 172.21.15.37:0/3203138596 shutdown_connections 2024-04-25T17:15:44.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:44.682+0000 7f927f94f700 1 --2- 172.21.15.37:0/3203138596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92780fcf60 0x7f92780fd3d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:44.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:44.682+0000 7f927f94f700 1 --2- 172.21.15.37:0/3203138596 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f92780fbcb0 0x7f92780fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:44.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:44.682+0000 7f927f94f700 1 -- 172.21.15.37:0/3203138596 >> 172.21.15.37:0/3203138596 conn(0x7f92780f7430 msgr2=0x7f92780f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:15:44.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:44.682+0000 7f927f94f700 1 -- 172.21.15.37:0/3203138596 shutdown_connections 2024-04-25T17:15:44.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:44.682+0000 7f927f94f700 1 -- 172.21.15.37:0/3203138596 wait complete. 2024-04-25T17:15:44.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:44.683+0000 7f927f94f700 1 Processor -- start 2024-04-25T17:15:44.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:44.683+0000 7f927f94f700 1 -- start start 2024-04-25T17:15:44.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:44.683+0000 7f927f94f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f92780fbcb0 0x7f92781106f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:15:44.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:44.683+0000 7f927f94f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92780fcf60 0x7f9278112c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:15:44.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:44.683+0000 7f927f94f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9278066390 con 0x7f92780fcf60 2024-04-25T17:15:44.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:44.683+0000 7f927f94f700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92780664d0 con 0x7f92780fbcb0 2024-04-25T17:15:44.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:44.683+0000 7f927ceea700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92780fcf60 0x7f9278112c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:15:44.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:44.683+0000 7f927ceea700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92780fcf60 0x7f9278112c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34392/0 (socket says 172.21.15.37:34392) 2024-04-25T17:15:44.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:44.683+0000 7f927d6eb700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f92780fbcb0 0x7f92781106f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:15:44.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:44.683+0000 7f927ceea700 1 -- 172.21.15.37:0/713596882 learned_addr learned my addr 172.21.15.37:0/713596882 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:15:44.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:44.683+0000 7f927ceea700 1 -- 172.21.15.37:0/713596882 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f92780fbcb0 msgr2=0x7f92781106f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:44.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:44.683+0000 7f927ceea700 1 --2- 172.21.15.37:0/713596882 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f92780fbcb0 0x7f92781106f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:44.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:44.683+0000 7f927ceea700 1 -- 172.21.15.37:0/713596882 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9268005040 con 0x7f92780fcf60 2024-04-25T17:15:44.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:44.684+0000 7f927ceea700 1 --2- 172.21.15.37:0/713596882 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92780fcf60 0x7f9278112c40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f926800b3b0 tx=0x7f9268009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:15:44.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:44.684+0000 7f926dffb700 1 -- 172.21.15.37:0/713596882 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f926800e040 con 0x7f92780fcf60 2024-04-25T17:15:44.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:44.684+0000 7f927f94f700 1 -- 172.21.15.37:0/713596882 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92781131e0 con 0x7f92780fcf60 2024-04-25T17:15:44.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:44.684+0000 7f926dffb700 1 -- 172.21.15.37:0/713596882 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f926800bbf0 con 0x7f92780fcf60 2024-04-25T17:15:44.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:44.684+0000 7f926dffb700 1 -- 172.21.15.37:0/713596882 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f926801c630 con 0x7f92780fcf60 2024-04-25T17:15:44.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:44.684+0000 7f927f94f700 1 -- 172.21.15.37:0/713596882 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92781137a0 con 0x7f92780fcf60 2024-04-25T17:15:44.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:44.685+0000 7f927f94f700 1 -- 172.21.15.37:0/713596882 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f927805f5c0 con 0x7f92780fcf60 2024-04-25T17:15:44.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:44.686+0000 7f926dffb700 1 -- 172.21.15.37:0/713596882 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f926800bd60 con 0x7f92780fcf60 2024-04-25T17:15:44.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:44.686+0000 7f926dffb700 1 --2- 172.21.15.37:0/713596882 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f92640692a0 0x7f926406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:15:44.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:44.686+0000 7f926dffb700 1 -- 172.21.15.37:0/713596882 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f9268087e50 con 0x7f92780fcf60 2024-04-25T17:15:44.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:44.686+0000 7f927d6eb700 1 --2- 172.21.15.37:0/713596882 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f92640692a0 0x7f926406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:15:44.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:44.686+0000 7f927d6eb700 1 --2- 172.21.15.37:0/713596882 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f92640692a0 0x7f926406b750 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9278066010 tx=0x7f927400b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:15:44.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:44.691+0000 7f926dffb700 1 -- 172.21.15.37:0/713596882 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f9268054180 con 0x7f92780fcf60 2024-04-25T17:15:44.780 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:44 smithi037 ceph-mon[26472]: pgmap v178: 65 pgs: 6 creating+activating, 3 creating+peering, 41 active+clean, 15 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:15:44.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:44 smithi069 ceph-mon[34527]: pgmap v178: 65 pgs: 6 creating+activating, 3 creating+peering, 41 active+clean, 15 unknown; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:15:44.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:44.940+0000 7f927f94f700 1 -- 172.21.15.37:0/713596882 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f92781047a0 con 0x7f92780fcf60 2024-04-25T17:15:44.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:44.943+0000 7f926dffb700 1 -- 172.21.15.37:0/713596882 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1076 (secure 0 0 0) 0x7f92680577a0 con 0x7f92780fcf60 2024-04-25T17:15:44.943 INFO:teuthology.orchestra.run.smithi037.stdout:e2 2024-04-25T17:15:44.943 INFO:teuthology.orchestra.run.smithi037.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-25T17:15:44.943 INFO:teuthology.orchestra.run.smithi037.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T17:15:44.943 INFO:teuthology.orchestra.run.smithi037.stdout:legacy client fscid: 1 2024-04-25T17:15:44.944 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:15:44.944 INFO:teuthology.orchestra.run.smithi037.stdout:Filesystem 'cephfs' (1) 2024-04-25T17:15:44.944 INFO:teuthology.orchestra.run.smithi037.stdout:fs_name cephfs 2024-04-25T17:15:44.944 INFO:teuthology.orchestra.run.smithi037.stdout:epoch 2 2024-04-25T17:15:44.944 INFO:teuthology.orchestra.run.smithi037.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-25T17:15:44.944 INFO:teuthology.orchestra.run.smithi037.stdout:created 2024-04-25T17:15:40.586130+0000 2024-04-25T17:15:44.944 INFO:teuthology.orchestra.run.smithi037.stdout:modified 2024-04-25T17:15:40.586204+0000 2024-04-25T17:15:44.944 INFO:teuthology.orchestra.run.smithi037.stdout:tableserver 0 2024-04-25T17:15:44.944 INFO:teuthology.orchestra.run.smithi037.stdout:root 0 2024-04-25T17:15:44.944 INFO:teuthology.orchestra.run.smithi037.stdout:session_timeout 60 2024-04-25T17:15:44.944 INFO:teuthology.orchestra.run.smithi037.stdout:session_autoclose 300 2024-04-25T17:15:44.944 INFO:teuthology.orchestra.run.smithi037.stdout:max_file_size 1099511627776 2024-04-25T17:15:44.944 INFO:teuthology.orchestra.run.smithi037.stdout:required_client_features {} 2024-04-25T17:15:44.945 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure 0 2024-04-25T17:15:44.945 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure_osd_epoch 0 2024-04-25T17:15:44.945 INFO:teuthology.orchestra.run.smithi037.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T17:15:44.945 INFO:teuthology.orchestra.run.smithi037.stdout:max_mds 1 2024-04-25T17:15:44.945 INFO:teuthology.orchestra.run.smithi037.stdout:in 2024-04-25T17:15:44.945 INFO:teuthology.orchestra.run.smithi037.stdout:up {} 2024-04-25T17:15:44.945 INFO:teuthology.orchestra.run.smithi037.stdout:failed 2024-04-25T17:15:44.945 INFO:teuthology.orchestra.run.smithi037.stdout:damaged 2024-04-25T17:15:44.945 INFO:teuthology.orchestra.run.smithi037.stdout:stopped 2024-04-25T17:15:44.945 INFO:teuthology.orchestra.run.smithi037.stdout:data_pools [3] 2024-04-25T17:15:44.945 INFO:teuthology.orchestra.run.smithi037.stdout:metadata_pool 2 2024-04-25T17:15:44.946 INFO:teuthology.orchestra.run.smithi037.stdout:inline_data disabled 2024-04-25T17:15:44.946 INFO:teuthology.orchestra.run.smithi037.stdout:balancer 2024-04-25T17:15:44.946 INFO:teuthology.orchestra.run.smithi037.stdout:standby_count_wanted 0 2024-04-25T17:15:44.946 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:15:44.946 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:15:44.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:44.945+0000 7f927f94f700 1 -- 172.21.15.37:0/713596882 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f92640692a0 msgr2=0x7f926406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:44.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:44.945+0000 7f927f94f700 1 --2- 172.21.15.37:0/713596882 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f92640692a0 0x7f926406b750 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9278066010 tx=0x7f927400b040 comp rx=0 tx=0).stop 2024-04-25T17:15:44.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:44.945+0000 7f927f94f700 1 -- 172.21.15.37:0/713596882 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92780fcf60 msgr2=0x7f9278112c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:44.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:44.945+0000 7f927f94f700 1 --2- 172.21.15.37:0/713596882 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92780fcf60 0x7f9278112c40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f926800b3b0 tx=0x7f9268009e30 comp rx=0 tx=0).stop 2024-04-25T17:15:44.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:44.945+0000 7f927f94f700 1 -- 172.21.15.37:0/713596882 shutdown_connections 2024-04-25T17:15:44.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:44.945+0000 7f927f94f700 1 --2- 172.21.15.37:0/713596882 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f92640692a0 0x7f926406b750 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:44.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:44.945+0000 7f927f94f700 1 --2- 172.21.15.37:0/713596882 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f92780fbcb0 0x7f92781106f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:44.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:44.945+0000 7f927f94f700 1 --2- 172.21.15.37:0/713596882 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f92780fcf60 0x7f9278112c40 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:44.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:44.945+0000 7f927f94f700 1 -- 172.21.15.37:0/713596882 >> 172.21.15.37:0/713596882 conn(0x7f92780f7430 msgr2=0x7f92780f8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:15:44.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:44.945+0000 7f927f94f700 1 -- 172.21.15.37:0/713596882 shutdown_connections 2024-04-25T17:15:44.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:44.945+0000 7f927f94f700 1 -- 172.21.15.37:0/713596882 wait complete. 2024-04-25T17:15:44.948 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 2 2024-04-25T17:15:45.704 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-25T17:15:45.719 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi037.front.sepia.ceph.com 2024-04-25T17:15:45.719 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- bash -c 'ceph fs set cephfs max_mds 1' 2024-04-25T17:15:45.990 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:15:46.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:45 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:15:46.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:45 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:15:46.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:45 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/713596882' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T17:15:46.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:45 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:15:46.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:45 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi069.ytlqcf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T17:15:46.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:45 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi069.ytlqcf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T17:15:46.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:45 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:15:46.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:45 smithi069 ceph-mon[34527]: Deploying daemon mds.cephfs.smithi069.ytlqcf on smithi069 2024-04-25T17:15:46.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:45 smithi069 ceph-mon[34527]: pgmap v179: 65 pgs: 6 creating+activating, 59 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:15:46.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:45 smithi069 ceph-mon[34527]: mds.? [v2:172.21.15.37:6826/1903989494,v1:172.21.15.37:6827/1903989494] up:boot 2024-04-25T17:15:46.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:45 smithi069 ceph-mon[34527]: daemon mds.cephfs.smithi037.ksmixc assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-04-25T17:15:46.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:45 smithi069 ceph-mon[34527]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-25T17:15:46.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:45 smithi069 ceph-mon[34527]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-25T17:15:46.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:45 smithi069 ceph-mon[34527]: Cluster is now healthy 2024-04-25T17:15:46.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:45 smithi069 ceph-mon[34527]: fsmap cephfs:0 1 up:standby 2024-04-25T17:15:46.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:45 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi037.ksmixc"}]: dispatch 2024-04-25T17:15:46.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:45 smithi069 ceph-mon[34527]: fsmap cephfs:1 {0=cephfs.smithi037.ksmixc=up:creating} 2024-04-25T17:15:46.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:45 smithi069 ceph-mon[34527]: daemon mds.cephfs.smithi037.ksmixc is now active in filesystem cephfs as rank 0 2024-04-25T17:15:46.197 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:45 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:15:46.197 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:45 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:15:46.197 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:45 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/713596882' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T17:15:46.197 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:45 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:15:46.197 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:45 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi069.ytlqcf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T17:15:46.197 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:45 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi069.ytlqcf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T17:15:46.197 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:45 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:15:46.197 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:45 smithi037 ceph-mon[26472]: Deploying daemon mds.cephfs.smithi069.ytlqcf on smithi069 2024-04-25T17:15:46.197 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:45 smithi037 ceph-mon[26472]: pgmap v179: 65 pgs: 6 creating+activating, 59 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:15:46.197 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:45 smithi037 ceph-mon[26472]: mds.? [v2:172.21.15.37:6826/1903989494,v1:172.21.15.37:6827/1903989494] up:boot 2024-04-25T17:15:46.197 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:45 smithi037 ceph-mon[26472]: daemon mds.cephfs.smithi037.ksmixc assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-04-25T17:15:46.197 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:45 smithi037 ceph-mon[26472]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-25T17:15:46.198 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:45 smithi037 ceph-mon[26472]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-04-25T17:15:46.198 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:45 smithi037 ceph-mon[26472]: Cluster is now healthy 2024-04-25T17:15:46.198 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:45 smithi037 ceph-mon[26472]: fsmap cephfs:0 1 up:standby 2024-04-25T17:15:46.198 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:45 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi037.ksmixc"}]: dispatch 2024-04-25T17:15:46.198 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:45 smithi037 ceph-mon[26472]: fsmap cephfs:1 {0=cephfs.smithi037.ksmixc=up:creating} 2024-04-25T17:15:46.198 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:45 smithi037 ceph-mon[26472]: daemon mds.cephfs.smithi037.ksmixc is now active in filesystem cephfs as rank 0 2024-04-25T17:15:47.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:47.583+0000 7f074a8d6700 1 -- 172.21.15.37:0/4165096991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07440fce60 msgr2=0x7f07440fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:47.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:47.583+0000 7f074a8d6700 1 --2- 172.21.15.37:0/4165096991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07440fce60 0x7f07440fd270 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0734004940 tx=0x7f0734009e30 comp rx=0 tx=0).stop 2024-04-25T17:15:47.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:47.583+0000 7f074a8d6700 1 -- 172.21.15.37:0/4165096991 shutdown_connections 2024-04-25T17:15:47.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:47.583+0000 7f074a8d6700 1 --2- 172.21.15.37:0/4165096991 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07440fdfd0 0x7f07440fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:47.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:47.583+0000 7f074a8d6700 1 --2- 172.21.15.37:0/4165096991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07440fce60 0x7f07440fd270 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:47.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:47.583+0000 7f074a8d6700 1 -- 172.21.15.37:0/4165096991 >> 172.21.15.37:0/4165096991 conn(0x7f07440f8540 msgr2=0x7f07440fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:15:47.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:47.583+0000 7f074a8d6700 1 -- 172.21.15.37:0/4165096991 shutdown_connections 2024-04-25T17:15:47.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:47.583+0000 7f074a8d6700 1 -- 172.21.15.37:0/4165096991 wait complete. 2024-04-25T17:15:47.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:47.583+0000 7f074a8d6700 1 Processor -- start 2024-04-25T17:15:47.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:47.584+0000 7f074a8d6700 1 -- start start 2024-04-25T17:15:47.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:47.584+0000 7f074a8d6700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07440fce60 0x7f0744071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:15:47.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:47.584+0000 7f074a8d6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07440fdfd0 0x7f07440702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:15:47.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:47.584+0000 7f074a8d6700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0744072200 con 0x7f07440fdfd0 2024-04-25T17:15:47.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:47.584+0000 7f074a8d6700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07440707f0 con 0x7f07440fce60 2024-04-25T17:15:47.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:47.584+0000 7f07437fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07440fdfd0 0x7f07440702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:15:47.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:47.584+0000 7f07437fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07440fdfd0 0x7f07440702b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53930/0 (socket says 172.21.15.37:53930) 2024-04-25T17:15:47.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:47.584+0000 7f07437fe700 1 -- 172.21.15.37:0/1698347209 learned_addr learned my addr 172.21.15.37:0/1698347209 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:15:47.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:47.584+0000 7f0743fff700 1 --2- 172.21.15.37:0/1698347209 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07440fce60 0x7f0744071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:15:47.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:47.584+0000 7f0743fff700 1 -- 172.21.15.37:0/1698347209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07440fdfd0 msgr2=0x7f07440702b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:47.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:47.584+0000 7f0743fff700 1 --2- 172.21.15.37:0/1698347209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07440fdfd0 0x7f07440702b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:47.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:47.584+0000 7f0743fff700 1 -- 172.21.15.37:0/1698347209 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0734005040 con 0x7f07440fce60 2024-04-25T17:15:47.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:47.584+0000 7f0743fff700 1 --2- 172.21.15.37:0/1698347209 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07440fce60 0x7f0744071c00 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0734000c00 tx=0x7f0734009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:15:47.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:47.585+0000 7f0740ff9700 1 -- 172.21.15.37:0/1698347209 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f073400e030 con 0x7f07440fce60 2024-04-25T17:15:47.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:47.585+0000 7f074a8d6700 1 -- 172.21.15.37:0/1698347209 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0744070a40 con 0x7f07440fce60 2024-04-25T17:15:47.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:47.585+0000 7f0740ff9700 1 -- 172.21.15.37:0/1698347209 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0734013de0 con 0x7f07440fce60 2024-04-25T17:15:47.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:47.585+0000 7f074a8d6700 1 -- 172.21.15.37:0/1698347209 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0744070f80 con 0x7f07440fce60 2024-04-25T17:15:47.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:47.585+0000 7f0740ff9700 1 -- 172.21.15.37:0/1698347209 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f073401ce50 con 0x7f07440fce60 2024-04-25T17:15:47.613 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:47.586+0000 7f074a8d6700 1 -- 172.21.15.37:0/1698347209 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f074404c710 con 0x7f07440fce60 2024-04-25T17:15:47.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:47.586+0000 7f0740ff9700 1 -- 172.21.15.37:0/1698347209 <== mon.1 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f073400b460 con 0x7f07440fce60 2024-04-25T17:15:47.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:47.587+0000 7f0740ff9700 1 --2- 172.21.15.37:0/1698347209 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f07300692a0 0x7f073006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:15:47.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:47.587+0000 7f07437fe700 1 --2- 172.21.15.37:0/1698347209 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f07300692a0 0x7f073006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:15:47.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:47.587+0000 7f0740ff9700 1 -- 172.21.15.37:0/1698347209 <== mon.1 v2:172.21.15.69:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f0734088b60 con 0x7f07440fce60 2024-04-25T17:15:47.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:47.587+0000 7f07437fe700 1 --2- 172.21.15.37:0/1698347209 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f07300692a0 0x7f073006b750 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f072c008fd0 tx=0x7f072c00b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:15:47.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:47.591+0000 7f0740ff9700 1 -- 172.21.15.37:0/1698347209 <== mon.1 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f07340588f0 con 0x7f07440fce60 2024-04-25T17:15:47.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:47.850+0000 7f074a8d6700 1 -- 172.21.15.37:0/1698347209 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7f0744115b70 con 0x7f07440fce60 2024-04-25T17:15:47.850 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:47 smithi037 ceph-mon[26472]: mds.? [v2:172.21.15.37:6826/1903989494,v1:172.21.15.37:6827/1903989494] up:active 2024-04-25T17:15:47.850 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:47 smithi037 ceph-mon[26472]: fsmap cephfs:1 {0=cephfs.smithi037.ksmixc=up:active} 2024-04-25T17:15:47.851 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:47 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:15:47.851 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:47 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:15:47.851 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:47 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:15:47.851 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:47 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi037.ovkrpq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T17:15:47.851 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:47 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi037.ovkrpq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T17:15:47.851 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:47 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:15:47.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:47 smithi069 ceph-mon[34527]: mds.? [v2:172.21.15.37:6826/1903989494,v1:172.21.15.37:6827/1903989494] up:active 2024-04-25T17:15:47.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:47 smithi069 ceph-mon[34527]: fsmap cephfs:1 {0=cephfs.smithi037.ksmixc=up:active} 2024-04-25T17:15:47.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:47 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:15:47.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:47 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:15:47.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:47 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:15:47.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:47 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi037.ovkrpq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T17:15:47.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:47 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi037.ovkrpq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T17:15:47.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:47 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:15:48.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:48.635+0000 7f0740ff9700 1 -- 172.21.15.37:0/1698347209 <== mon.1 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v8) v1 ==== 105+0+0 (secure 0 0 0) 0x7f0734058480 con 0x7f07440fce60 2024-04-25T17:15:48.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:48.637+0000 7f074a8d6700 1 -- 172.21.15.37:0/1698347209 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f07300692a0 msgr2=0x7f073006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:48.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:48.637+0000 7f074a8d6700 1 --2- 172.21.15.37:0/1698347209 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f07300692a0 0x7f073006b750 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f072c008fd0 tx=0x7f072c00b040 comp rx=0 tx=0).stop 2024-04-25T17:15:48.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:48.637+0000 7f074a8d6700 1 -- 172.21.15.37:0/1698347209 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07440fce60 msgr2=0x7f0744071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:48.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:48.637+0000 7f074a8d6700 1 --2- 172.21.15.37:0/1698347209 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07440fce60 0x7f0744071c00 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0734000c00 tx=0x7f0734009e30 comp rx=0 tx=0).stop 2024-04-25T17:15:48.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:48.637+0000 7f074a8d6700 1 -- 172.21.15.37:0/1698347209 shutdown_connections 2024-04-25T17:15:48.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:48.637+0000 7f074a8d6700 1 --2- 172.21.15.37:0/1698347209 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f07300692a0 0x7f073006b750 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:48.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:48.637+0000 7f074a8d6700 1 --2- 172.21.15.37:0/1698347209 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07440fce60 0x7f0744071c00 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:48.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:48.637+0000 7f074a8d6700 1 --2- 172.21.15.37:0/1698347209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f07440fdfd0 0x7f07440702b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:48.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:48.637+0000 7f074a8d6700 1 -- 172.21.15.37:0/1698347209 >> 172.21.15.37:0/1698347209 conn(0x7f07440f8540 msgr2=0x7f07440f9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:15:48.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:48.638+0000 7f074a8d6700 1 -- 172.21.15.37:0/1698347209 shutdown_connections 2024-04-25T17:15:48.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:48.638+0000 7f074a8d6700 1 -- 172.21.15.37:0/1698347209 wait complete. 2024-04-25T17:15:48.881 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:48 smithi069 ceph-mon[34527]: Deploying daemon mds.cephfs.smithi037.ovkrpq on smithi037 2024-04-25T17:15:48.881 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:48 smithi069 ceph-mon[34527]: pgmap v180: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 444 B/s wr, 1 op/s 2024-04-25T17:15:48.881 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:48 smithi069 ceph-mon[34527]: mds.? [v2:172.21.15.69:6824/1672609751,v1:172.21.15.69:6825/1672609751] up:boot 2024-04-25T17:15:48.881 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:48 smithi069 ceph-mon[34527]: fsmap cephfs:1 {0=cephfs.smithi037.ksmixc=up:active} 1 up:standby 2024-04-25T17:15:48.881 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:48 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi069.ytlqcf"}]: dispatch 2024-04-25T17:15:48.881 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:48 smithi069 ceph-mon[34527]: fsmap cephfs:1 {0=cephfs.smithi037.ksmixc=up:active} 1 up:standby 2024-04-25T17:15:48.881 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:48 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/1698347209' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-04-25T17:15:48.881 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:48 smithi069 ceph-mon[34527]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-04-25T17:15:48.931 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:48 smithi037 ceph-mon[26472]: Deploying daemon mds.cephfs.smithi037.ovkrpq on smithi037 2024-04-25T17:15:48.931 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:48 smithi037 ceph-mon[26472]: pgmap v180: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 444 B/s wr, 1 op/s 2024-04-25T17:15:48.931 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:48 smithi037 ceph-mon[26472]: mds.? [v2:172.21.15.69:6824/1672609751,v1:172.21.15.69:6825/1672609751] up:boot 2024-04-25T17:15:48.931 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:48 smithi037 ceph-mon[26472]: fsmap cephfs:1 {0=cephfs.smithi037.ksmixc=up:active} 1 up:standby 2024-04-25T17:15:48.931 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:48 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi069.ytlqcf"}]: dispatch 2024-04-25T17:15:48.931 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:48 smithi037 ceph-mon[26472]: fsmap cephfs:1 {0=cephfs.smithi037.ksmixc=up:active} 1 up:standby 2024-04-25T17:15:48.932 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:48 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/1698347209' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-04-25T17:15:48.932 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:48 smithi037 ceph-mon[26472]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-04-25T17:15:49.764 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:49 smithi037 ceph-mon[26472]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-04-25T17:15:49.764 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:49 smithi037 ceph-mon[26472]: fsmap cephfs:1 {0=cephfs.smithi037.ksmixc=up:active} 1 up:standby 2024-04-25T17:15:49.792 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-25T17:15:49.803 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi037.front.sepia.ceph.com 2024-04-25T17:15:49.803 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- bash -c 'ceph fs set cephfs allow_standby_replay true' 2024-04-25T17:15:49.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:49 smithi069 ceph-mon[34527]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-04-25T17:15:49.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:49 smithi069 ceph-mon[34527]: fsmap cephfs:1 {0=cephfs.smithi037.ksmixc=up:active} 1 up:standby 2024-04-25T17:15:50.497 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:15:50.870 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:50 smithi037 ceph-mon[26472]: pgmap v181: 65 pgs: 65 active+clean; 578 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 4 op/s 2024-04-25T17:15:50.870 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:50 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:15:50.870 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:50 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:15:50.870 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:50 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:15:50.870 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:50 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi069.cpprst", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T17:15:50.870 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:50 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi069.cpprst", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T17:15:50.870 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:50 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:15:50.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:50 smithi069 ceph-mon[34527]: pgmap v181: 65 pgs: 65 active+clean; 578 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 4 op/s 2024-04-25T17:15:50.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:50 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:15:50.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:50 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:15:50.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:50 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:15:50.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:50 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi069.cpprst", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T17:15:50.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:50 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi069.cpprst", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-04-25T17:15:50.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:50 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:15:51.895 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:51 smithi037 ceph-mon[26472]: Deploying daemon mds.cephfs.smithi069.cpprst on smithi069 2024-04-25T17:15:51.895 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:51 smithi037 ceph-mon[26472]: mds.? [v2:172.21.15.37:6828/4206394422,v1:172.21.15.37:6829/4206394422] up:boot 2024-04-25T17:15:51.895 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:51 smithi037 ceph-mon[26472]: fsmap cephfs:1 {0=cephfs.smithi037.ksmixc=up:active} 2 up:standby 2024-04-25T17:15:51.895 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:51 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi037.ovkrpq"}]: dispatch 2024-04-25T17:15:51.903 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:51 smithi069 ceph-mon[34527]: Deploying daemon mds.cephfs.smithi069.cpprst on smithi069 2024-04-25T17:15:51.903 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:51 smithi069 ceph-mon[34527]: mds.? [v2:172.21.15.37:6828/4206394422,v1:172.21.15.37:6829/4206394422] up:boot 2024-04-25T17:15:51.903 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:51 smithi069 ceph-mon[34527]: fsmap cephfs:1 {0=cephfs.smithi037.ksmixc=up:active} 2 up:standby 2024-04-25T17:15:51.903 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:51 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi037.ovkrpq"}]: dispatch 2024-04-25T17:15:52.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:52.161+0000 7f88ce9d6700 1 -- 172.21.15.37:0/145448763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88c80fe3e0 msgr2=0x7f88c80fe7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:52.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:52.161+0000 7f88ce9d6700 1 --2- 172.21.15.37:0/145448763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88c80fe3e0 0x7f88c80fe7f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f88b8004940 tx=0x7f88b8009e30 comp rx=0 tx=0).stop 2024-04-25T17:15:52.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:52.161+0000 7f88ce9d6700 1 -- 172.21.15.37:0/145448763 shutdown_connections 2024-04-25T17:15:52.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:52.161+0000 7f88ce9d6700 1 --2- 172.21.15.37:0/145448763 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f88c80fed30 0x7f88c80fae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:52.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:52.161+0000 7f88ce9d6700 1 --2- 172.21.15.37:0/145448763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88c80fe3e0 0x7f88c80fe7f0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:52.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:52.161+0000 7f88ce9d6700 1 -- 172.21.15.37:0/145448763 >> 172.21.15.37:0/145448763 conn(0x7f88c80f6b80 msgr2=0x7f88c80f8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:15:52.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:52.161+0000 7f88ce9d6700 1 -- 172.21.15.37:0/145448763 shutdown_connections 2024-04-25T17:15:52.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:52.161+0000 7f88ce9d6700 1 -- 172.21.15.37:0/145448763 wait complete. 2024-04-25T17:15:52.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:52.161+0000 7f88ce9d6700 1 Processor -- start 2024-04-25T17:15:52.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:52.162+0000 7f88ce9d6700 1 -- start start 2024-04-25T17:15:52.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:52.162+0000 7f88ce9d6700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f88c80fe3e0 0x7f88c810da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:15:52.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:52.162+0000 7f88ce9d6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88c80fed30 0x7f88c810df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:15:52.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:52.162+0000 7f88ce9d6700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c810e560 con 0x7f88c80fed30 2024-04-25T17:15:52.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:52.162+0000 7f88ce9d6700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c810edb0 con 0x7f88c80fe3e0 2024-04-25T17:15:52.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:52.162+0000 7f88c77fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88c80fed30 0x7f88c810df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:15:52.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:52.162+0000 7f88c7fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f88c80fe3e0 0x7f88c810da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:15:52.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:52.162+0000 7f88c7fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f88c80fe3e0 0x7f88c810da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.37:53000/0 (socket says 172.21.15.37:53000) 2024-04-25T17:15:52.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:52.162+0000 7f88c7fff700 1 -- 172.21.15.37:0/300900079 learned_addr learned my addr 172.21.15.37:0/300900079 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:15:52.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:52.162+0000 7f88c77fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88c80fed30 0x7f88c810df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53964/0 (socket says 172.21.15.37:53964) 2024-04-25T17:15:52.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:52.162+0000 7f88c7fff700 1 -- 172.21.15.37:0/300900079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88c80fed30 msgr2=0x7f88c810df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:52.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:52.162+0000 7f88c7fff700 1 --2- 172.21.15.37:0/300900079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88c80fed30 0x7f88c810df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:52.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:52.162+0000 7f88c7fff700 1 -- 172.21.15.37:0/300900079 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b8005040 con 0x7f88c80fe3e0 2024-04-25T17:15:52.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:52.163+0000 7f88c7fff700 1 --2- 172.21.15.37:0/300900079 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f88c80fe3e0 0x7f88c810da20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f88b800b3b0 tx=0x7f88b8009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:15:52.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:52.163+0000 7f88c4ff9700 1 -- 172.21.15.37:0/300900079 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88b800e040 con 0x7f88c80fe3e0 2024-04-25T17:15:52.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:52.163+0000 7f88ce9d6700 1 -- 172.21.15.37:0/300900079 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88c810f030 con 0x7f88c80fe3e0 2024-04-25T17:15:52.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:52.163+0000 7f88c4ff9700 1 -- 172.21.15.37:0/300900079 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f88b8004290 con 0x7f88c80fe3e0 2024-04-25T17:15:52.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:52.163+0000 7f88c4ff9700 1 -- 172.21.15.37:0/300900079 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f88b801c3f0 con 0x7f88c80fe3e0 2024-04-25T17:15:52.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:52.163+0000 7f88ce9d6700 1 -- 172.21.15.37:0/300900079 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88c810f570 con 0x7f88c80fe3e0 2024-04-25T17:15:52.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:52.164+0000 7f88ce9d6700 1 -- 172.21.15.37:0/300900079 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88c805f5c0 con 0x7f88c80fe3e0 2024-04-25T17:15:52.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:52.164+0000 7f88c4ff9700 1 -- 172.21.15.37:0/300900079 <== mon.1 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f88b801c6b0 con 0x7f88c80fe3e0 2024-04-25T17:15:52.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:52.165+0000 7f88c4ff9700 1 --2- 172.21.15.37:0/300900079 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f88b00692b0 0x7f88b006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:15:52.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:52.165+0000 7f88c4ff9700 1 -- 172.21.15.37:0/300900079 <== mon.1 v2:172.21.15.69:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f88b8088520 con 0x7f88c80fe3e0 2024-04-25T17:15:52.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:52.165+0000 7f88c77fe700 1 --2- 172.21.15.37:0/300900079 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f88b00692b0 0x7f88b006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:15:52.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:52.165+0000 7f88c77fe700 1 --2- 172.21.15.37:0/300900079 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f88b00692b0 0x7f88b006b760 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f88bc007fd0 tx=0x7f88bc009040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:15:52.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:52.169+0000 7f88c4ff9700 1 -- 172.21.15.37:0/300900079 <== mon.1 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f88b8058280 con 0x7f88c80fe3e0 2024-04-25T17:15:52.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:52.417+0000 7f88ce9d6700 1 -- 172.21.15.37:0/300900079 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7f88c804bed0 con 0x7f88c80fe3e0 2024-04-25T17:15:52.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:52.665+0000 7f88c4ff9700 1 -- 172.21.15.37:0/300900079 <== mon.1 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v10) v1 ==== 121+0+0 (secure 0 0 0) 0x7f88b8057e10 con 0x7f88c80fe3e0 2024-04-25T17:15:52.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:52.667+0000 7f88ce9d6700 1 -- 172.21.15.37:0/300900079 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f88b00692b0 msgr2=0x7f88b006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:52.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:52.667+0000 7f88ce9d6700 1 --2- 172.21.15.37:0/300900079 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f88b00692b0 0x7f88b006b760 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f88bc007fd0 tx=0x7f88bc009040 comp rx=0 tx=0).stop 2024-04-25T17:15:52.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:52.667+0000 7f88ce9d6700 1 -- 172.21.15.37:0/300900079 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f88c80fe3e0 msgr2=0x7f88c810da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:52.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:52.667+0000 7f88ce9d6700 1 --2- 172.21.15.37:0/300900079 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f88c80fe3e0 0x7f88c810da20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f88b800b3b0 tx=0x7f88b8009e30 comp rx=0 tx=0).stop 2024-04-25T17:15:52.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:52.667+0000 7f88ce9d6700 1 -- 172.21.15.37:0/300900079 shutdown_connections 2024-04-25T17:15:52.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:52.667+0000 7f88ce9d6700 1 --2- 172.21.15.37:0/300900079 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f88b00692b0 0x7f88b006b760 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:52.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:52.667+0000 7f88ce9d6700 1 --2- 172.21.15.37:0/300900079 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f88c80fe3e0 0x7f88c810da20 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:52.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:52.667+0000 7f88ce9d6700 1 --2- 172.21.15.37:0/300900079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f88c80fed30 0x7f88c810df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:52.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:52.667+0000 7f88ce9d6700 1 -- 172.21.15.37:0/300900079 >> 172.21.15.37:0/300900079 conn(0x7f88c80f6b80 msgr2=0x7f88c80f8280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:15:52.668 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:52 smithi037 ceph-mon[26472]: pgmap v182: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s wr, 4 op/s 2024-04-25T17:15:52.668 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:52 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/300900079' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-25T17:15:52.668 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:52 smithi037 ceph-mon[26472]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-25T17:15:52.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:52.667+0000 7f88ce9d6700 1 -- 172.21.15.37:0/300900079 shutdown_connections 2024-04-25T17:15:52.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:52.667+0000 7f88ce9d6700 1 -- 172.21.15.37:0/300900079 wait complete. 2024-04-25T17:15:52.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:52 smithi069 ceph-mon[34527]: pgmap v182: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s wr, 4 op/s 2024-04-25T17:15:52.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:52 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/300900079' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-25T17:15:52.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:52 smithi069 ceph-mon[34527]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-04-25T17:15:53.328 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-25T17:15:53.338 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi037.front.sepia.ceph.com 2024-04-25T17:15:53.338 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- bash -c 'ceph fs set cephfs inline_data false' 2024-04-25T17:15:53.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:53 smithi069 ceph-mon[34527]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-25T17:15:53.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:53 smithi069 ceph-mon[34527]: fsmap cephfs:1 {0=cephfs.smithi037.ksmixc=up:active} 2 up:standby 2024-04-25T17:15:53.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:53 smithi069 ceph-mon[34527]: fsmap cephfs:1 {0=cephfs.smithi037.ksmixc=up:active} 1 up:standby-replay 1 up:standby 2024-04-25T17:15:53.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:53 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:15:53.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:53 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:15:53.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:53 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:15:53.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:53 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:15:53.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:53 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:15:53.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:53 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:15:54.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:53 smithi037 ceph-mon[26472]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-04-25T17:15:54.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:53 smithi037 ceph-mon[26472]: fsmap cephfs:1 {0=cephfs.smithi037.ksmixc=up:active} 2 up:standby 2024-04-25T17:15:54.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:53 smithi037 ceph-mon[26472]: fsmap cephfs:1 {0=cephfs.smithi037.ksmixc=up:active} 1 up:standby-replay 1 up:standby 2024-04-25T17:15:54.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:53 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:15:54.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:53 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:15:54.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:53 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:15:54.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:53 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:15:54.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:53 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:15:54.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:53 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:15:54.358 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:15:54.813 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:54 smithi037 ceph-mon[26472]: pgmap v183: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 469 B/s rd, 1.2 KiB/s wr, 4 op/s 2024-04-25T17:15:54.813 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:54 smithi037 ceph-mon[26472]: mds.? [v2:172.21.15.69:6826/518856100,v1:172.21.15.69:6827/518856100] up:boot 2024-04-25T17:15:54.814 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:54 smithi037 ceph-mon[26472]: mds.? [v2:172.21.15.37:6826/1903989494,v1:172.21.15.37:6827/1903989494] up:active 2024-04-25T17:15:54.814 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:54 smithi037 ceph-mon[26472]: fsmap cephfs:1 {0=cephfs.smithi037.ksmixc=up:active} 1 up:standby-replay 2 up:standby 2024-04-25T17:15:54.814 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:54 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi069.cpprst"}]: dispatch 2024-04-25T17:15:54.991 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:54 smithi069 ceph-mon[34527]: pgmap v183: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 469 B/s rd, 1.2 KiB/s wr, 4 op/s 2024-04-25T17:15:54.991 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:54 smithi069 ceph-mon[34527]: mds.? [v2:172.21.15.69:6826/518856100,v1:172.21.15.69:6827/518856100] up:boot 2024-04-25T17:15:54.991 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:54 smithi069 ceph-mon[34527]: mds.? [v2:172.21.15.37:6826/1903989494,v1:172.21.15.37:6827/1903989494] up:active 2024-04-25T17:15:54.991 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:54 smithi069 ceph-mon[34527]: fsmap cephfs:1 {0=cephfs.smithi037.ksmixc=up:active} 1 up:standby-replay 2 up:standby 2024-04-25T17:15:54.991 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:54 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi069.cpprst"}]: dispatch 2024-04-25T17:15:56.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:55 smithi037 ceph-mon[26472]: mds.? [v2:172.21.15.37:6828/4206394422,v1:172.21.15.37:6829/4206394422] up:standby 2024-04-25T17:15:56.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:55 smithi037 ceph-mon[26472]: Dropping low affinity standby-replay daemon mds.cephfs.smithi069.ytlqcf in favor of higher affinity standby. 2024-04-25T17:15:56.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:55 smithi037 ceph-mon[26472]: fsmap cephfs:1 {0=cephfs.smithi037.ksmixc=up:active} 1 up:standby-replay 2 up:standby 2024-04-25T17:15:56.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:55 smithi037 ceph-mon[26472]: fsmap cephfs:1 {0=cephfs.smithi037.ksmixc=up:active} 1 up:standby-replay 1 up:standby 2024-04-25T17:15:56.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:55 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:15:56.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:55 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:15:56.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:55 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:15:56.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:55 smithi037 ceph-mon[26472]: pgmap v184: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1.1 KiB/s wr, 4 op/s 2024-04-25T17:15:56.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:55 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:15:56.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:55 smithi069 ceph-mon[34527]: mds.? [v2:172.21.15.37:6828/4206394422,v1:172.21.15.37:6829/4206394422] up:standby 2024-04-25T17:15:56.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:55 smithi069 ceph-mon[34527]: Dropping low affinity standby-replay daemon mds.cephfs.smithi069.ytlqcf in favor of higher affinity standby. 2024-04-25T17:15:56.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:55 smithi069 ceph-mon[34527]: fsmap cephfs:1 {0=cephfs.smithi037.ksmixc=up:active} 1 up:standby-replay 2 up:standby 2024-04-25T17:15:56.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:55 smithi069 ceph-mon[34527]: fsmap cephfs:1 {0=cephfs.smithi037.ksmixc=up:active} 1 up:standby-replay 1 up:standby 2024-04-25T17:15:56.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:55 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:15:56.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:55 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:15:56.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:55 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:15:56.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:55 smithi069 ceph-mon[34527]: pgmap v184: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1.1 KiB/s wr, 4 op/s 2024-04-25T17:15:56.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:55 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:15:56.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:56.718+0000 7f258c475700 1 -- 172.21.15.37:0/2177470312 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25840fcf70 msgr2=0x7f25840fd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:56.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:56.718+0000 7f258c475700 1 --2- 172.21.15.37:0/2177470312 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25840fcf70 0x7f25840fd3e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2574004940 tx=0x7f2574009e30 comp rx=0 tx=0).stop 2024-04-25T17:15:56.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:56.718+0000 7f258c475700 1 -- 172.21.15.37:0/2177470312 shutdown_connections 2024-04-25T17:15:56.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:56.718+0000 7f258c475700 1 --2- 172.21.15.37:0/2177470312 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25840fcf70 0x7f25840fd3e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:56.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:56.718+0000 7f258c475700 1 --2- 172.21.15.37:0/2177470312 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25840fbcc0 0x7f25840fc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:56.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:56.718+0000 7f258c475700 1 -- 172.21.15.37:0/2177470312 >> 172.21.15.37:0/2177470312 conn(0x7f25840f7440 msgr2=0x7f25840f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:15:56.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:56.718+0000 7f258c475700 1 -- 172.21.15.37:0/2177470312 shutdown_connections 2024-04-25T17:15:56.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:56.718+0000 7f258c475700 1 -- 172.21.15.37:0/2177470312 wait complete. 2024-04-25T17:15:56.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:56.719+0000 7f258c475700 1 Processor -- start 2024-04-25T17:15:56.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:56.719+0000 7f258c475700 1 -- start start 2024-04-25T17:15:56.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:56.719+0000 7f258c475700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25840fbcc0 0x7f2584066cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:15:56.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:56.719+0000 7f258c475700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25840fcf70 0x7f25841127a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:15:56.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:56.719+0000 7f258c475700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2584112ce0 con 0x7f25840fcf70 2024-04-25T17:15:56.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:56.719+0000 7f258c475700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2584112e20 con 0x7f25840fbcc0 2024-04-25T17:15:56.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:56.719+0000 7f2589a10700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25840fcf70 0x7f25841127a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:15:56.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:56.719+0000 7f2589a10700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25840fcf70 0x7f25841127a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46114/0 (socket says 172.21.15.37:46114) 2024-04-25T17:15:56.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:56.719+0000 7f2589a10700 1 -- 172.21.15.37:0/863424920 learned_addr learned my addr 172.21.15.37:0/863424920 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:15:56.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:56.719+0000 7f258a211700 1 --2- 172.21.15.37:0/863424920 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25840fbcc0 0x7f2584066cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:15:56.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:56.719+0000 7f2589a10700 1 -- 172.21.15.37:0/863424920 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25840fbcc0 msgr2=0x7f2584066cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:56.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:56.719+0000 7f2589a10700 1 --2- 172.21.15.37:0/863424920 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25840fbcc0 0x7f2584066cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:56.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:56.719+0000 7f2589a10700 1 -- 172.21.15.37:0/863424920 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2574005040 con 0x7f25840fcf70 2024-04-25T17:15:56.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:56.720+0000 7f2589a10700 1 --2- 172.21.15.37:0/863424920 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25840fcf70 0x7f25841127a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f25740090d0 tx=0x7f2574009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:15:56.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:56.720+0000 7f257affd700 1 -- 172.21.15.37:0/863424920 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f257400e040 con 0x7f25840fcf70 2024-04-25T17:15:56.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:56.720+0000 7f258c475700 1 -- 172.21.15.37:0/863424920 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2584113020 con 0x7f25840fcf70 2024-04-25T17:15:56.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:56.720+0000 7f257affd700 1 -- 172.21.15.37:0/863424920 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2574009430 con 0x7f25840fcf70 2024-04-25T17:15:56.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:56.720+0000 7f257affd700 1 -- 172.21.15.37:0/863424920 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f257401c630 con 0x7f25840fcf70 2024-04-25T17:15:56.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:56.720+0000 7f258c475700 1 -- 172.21.15.37:0/863424920 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25841135e0 con 0x7f25840fcf70 2024-04-25T17:15:56.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:56.721+0000 7f258c475700 1 -- 172.21.15.37:0/863424920 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f258404c710 con 0x7f25840fcf70 2024-04-25T17:15:56.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:56.721+0000 7f257affd700 1 -- 172.21.15.37:0/863424920 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f257400bbf0 con 0x7f25840fcf70 2024-04-25T17:15:56.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:56.722+0000 7f257affd700 1 --2- 172.21.15.37:0/863424920 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f25700692a0 0x7f257006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:15:56.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:56.722+0000 7f257affd700 1 -- 172.21.15.37:0/863424920 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f25740885f0 con 0x7f25840fcf70 2024-04-25T17:15:56.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:56.722+0000 7f258a211700 1 --2- 172.21.15.37:0/863424920 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f25700692a0 0x7f257006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:15:56.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:56.722+0000 7f258a211700 1 --2- 172.21.15.37:0/863424920 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f25700692a0 0x7f257006b750 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2580007fd0 tx=0x7f2580009040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:15:56.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:56.727+0000 7f257affd700 1 -- 172.21.15.37:0/863424920 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f25740583b0 con 0x7f25840fcf70 2024-04-25T17:15:56.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:56.977+0000 7f258c475700 1 -- 172.21.15.37:0/863424920 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"} v 0) v1 -- 0x7f25841047b0 con 0x7f25840fcf70 2024-04-25T17:15:57.210 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:56 smithi037 ceph-mon[26472]: mds.? [v2:172.21.15.69:6824/134210439,v1:172.21.15.69:6825/134210439] up:boot 2024-04-25T17:15:57.210 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:56 smithi037 ceph-mon[26472]: fsmap cephfs:1 {0=cephfs.smithi037.ksmixc=up:active} 1 up:standby-replay 2 up:standby 2024-04-25T17:15:57.210 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:56 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi069.ytlqcf"}]: dispatch 2024-04-25T17:15:57.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:56 smithi069 ceph-mon[34527]: mds.? [v2:172.21.15.69:6824/134210439,v1:172.21.15.69:6825/134210439] up:boot 2024-04-25T17:15:57.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:56 smithi069 ceph-mon[34527]: fsmap cephfs:1 {0=cephfs.smithi037.ksmixc=up:active} 1 up:standby-replay 2 up:standby 2024-04-25T17:15:57.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:56 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi069.ytlqcf"}]: dispatch 2024-04-25T17:15:57.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:57.511+0000 7f257affd700 1 -- 172.21.15.37:0/863424920 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]=0 inline data disabled v16) v1 ==== 133+0+0 (secure 0 0 0) 0x7f2574057f40 con 0x7f25840fcf70 2024-04-25T17:15:57.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:57.513+0000 7f258c475700 1 -- 172.21.15.37:0/863424920 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f25700692a0 msgr2=0x7f257006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:57.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:57.513+0000 7f258c475700 1 --2- 172.21.15.37:0/863424920 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f25700692a0 0x7f257006b750 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2580007fd0 tx=0x7f2580009040 comp rx=0 tx=0).stop 2024-04-25T17:15:57.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:57.513+0000 7f258c475700 1 -- 172.21.15.37:0/863424920 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25840fcf70 msgr2=0x7f25841127a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:15:57.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:57.513+0000 7f258c475700 1 --2- 172.21.15.37:0/863424920 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25840fcf70 0x7f25841127a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f25740090d0 tx=0x7f2574009e30 comp rx=0 tx=0).stop 2024-04-25T17:15:57.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:57.514+0000 7f258c475700 1 -- 172.21.15.37:0/863424920 shutdown_connections 2024-04-25T17:15:57.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:57.514+0000 7f258c475700 1 --2- 172.21.15.37:0/863424920 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f25700692a0 0x7f257006b750 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:57.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:57.514+0000 7f258c475700 1 --2- 172.21.15.37:0/863424920 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25840fbcc0 0x7f2584066cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:57.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:57.514+0000 7f258c475700 1 --2- 172.21.15.37:0/863424920 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25840fcf70 0x7f25841127a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:15:57.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:57.514+0000 7f258c475700 1 -- 172.21.15.37:0/863424920 >> 172.21.15.37:0/863424920 conn(0x7f25840f7440 msgr2=0x7f25840f8ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:15:57.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:57.514+0000 7f258c475700 1 -- 172.21.15.37:0/863424920 shutdown_connections 2024-04-25T17:15:57.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:15:57.514+0000 7f258c475700 1 -- 172.21.15.37:0/863424920 wait complete. 2024-04-25T17:15:57.515 INFO:teuthology.orchestra.run.smithi037.stderr:inline data disabled 2024-04-25T17:15:58.254 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:57 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/863424920' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-04-25T17:15:58.254 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:57 smithi037 ceph-mon[26472]: pgmap v185: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-04-25T17:15:58.255 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:57 smithi037 ceph-mon[26472]: mds.? [v2:172.21.15.69:6826/518856100,v1:172.21.15.69:6827/518856100] up:standby 2024-04-25T17:15:58.255 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:57 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/863424920' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-04-25T17:15:58.255 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:15:57 smithi037 ceph-mon[26472]: fsmap cephfs:1 {0=cephfs.smithi037.ksmixc=up:active} 1 up:standby-replay 2 up:standby 2024-04-25T17:15:58.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:57 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/863424920' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-04-25T17:15:58.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:57 smithi069 ceph-mon[34527]: pgmap v185: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-04-25T17:15:58.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:57 smithi069 ceph-mon[34527]: mds.? [v2:172.21.15.69:6826/518856100,v1:172.21.15.69:6827/518856100] up:standby 2024-04-25T17:15:58.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:57 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/863424920' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-04-25T17:15:58.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:15:57 smithi069 ceph-mon[34527]: fsmap cephfs:1 {0=cephfs.smithi037.ksmixc=up:active} 1 up:standby-replay 2 up:standby 2024-04-25T17:15:58.891 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-25T17:15:58.905 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi037.front.sepia.ceph.com 2024-04-25T17:15:58.905 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- bash -c 'ceph fs dump' 2024-04-25T17:15:59.615 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:16:00.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:00 smithi037 ceph-mon[26472]: pgmap v186: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 853 B/s wr, 5 op/s 2024-04-25T17:16:00.871 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:00 smithi069 ceph-mon[34527]: pgmap v186: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 853 B/s wr, 5 op/s 2024-04-25T17:16:01.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:01.219+0000 7f7daf758700 1 -- 172.21.15.37:0/910362061 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7da80fe3e0 msgr2=0x7f7da80fe7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:01.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:01.219+0000 7f7daf758700 1 --2- 172.21.15.37:0/910362061 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7da80fe3e0 0x7f7da80fe7f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7da4004940 tx=0x7f7da4009e30 comp rx=0 tx=0).stop 2024-04-25T17:16:01.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:01.219+0000 7f7daf758700 1 -- 172.21.15.37:0/910362061 shutdown_connections 2024-04-25T17:16:01.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:01.219+0000 7f7daf758700 1 --2- 172.21.15.37:0/910362061 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7da80fed30 0x7f7da80fae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:01.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:01.219+0000 7f7daf758700 1 --2- 172.21.15.37:0/910362061 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7da80fe3e0 0x7f7da80fe7f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:01.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:01.219+0000 7f7daf758700 1 -- 172.21.15.37:0/910362061 >> 172.21.15.37:0/910362061 conn(0x7f7da80f6b80 msgr2=0x7f7da80f8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:16:01.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:01.219+0000 7f7daf758700 1 -- 172.21.15.37:0/910362061 shutdown_connections 2024-04-25T17:16:01.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:01.219+0000 7f7daf758700 1 -- 172.21.15.37:0/910362061 wait complete. 2024-04-25T17:16:01.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:01.219+0000 7f7daf758700 1 Processor -- start 2024-04-25T17:16:01.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:01.219+0000 7f7daf758700 1 -- start start 2024-04-25T17:16:01.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:01.219+0000 7f7daf758700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7da80fe3e0 0x7f7da810d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:01.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:01.219+0000 7f7daf758700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7da80fed30 0x7f7da810deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:01.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:01.219+0000 7f7daf758700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7da810e4b0 con 0x7f7da80fed30 2024-04-25T17:16:01.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:01.219+0000 7f7daf758700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7da810ed00 con 0x7f7da80fe3e0 2024-04-25T17:16:01.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:01.220+0000 7f7daccf3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7da80fed30 0x7f7da810deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:01.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:01.220+0000 7f7daccf3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7da80fed30 0x7f7da810deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46138/0 (socket says 172.21.15.37:46138) 2024-04-25T17:16:01.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:01.220+0000 7f7daccf3700 1 -- 172.21.15.37:0/4042439466 learned_addr learned my addr 172.21.15.37:0/4042439466 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:16:01.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:01.220+0000 7f7dad4f4700 1 --2- 172.21.15.37:0/4042439466 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7da80fe3e0 0x7f7da810d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:01.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:01.220+0000 7f7daccf3700 1 -- 172.21.15.37:0/4042439466 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7da80fe3e0 msgr2=0x7f7da810d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:01.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:01.220+0000 7f7daccf3700 1 --2- 172.21.15.37:0/4042439466 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7da80fe3e0 0x7f7da810d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:01.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:01.220+0000 7f7daccf3700 1 -- 172.21.15.37:0/4042439466 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7da4005040 con 0x7f7da80fed30 2024-04-25T17:16:01.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:01.220+0000 7f7daccf3700 1 --2- 172.21.15.37:0/4042439466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7da80fed30 0x7f7da810deb0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7d9800eb40 tx=0x7f7d9800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:16:01.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:01.220+0000 7f7d9dffb700 1 -- 172.21.15.37:0/4042439466 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d98007cc0 con 0x7f7da80fed30 2024-04-25T17:16:01.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:01.220+0000 7f7d9dffb700 1 -- 172.21.15.37:0/4042439466 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7d9800f040 con 0x7f7da80fed30 2024-04-25T17:16:01.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:01.220+0000 7f7daf758700 1 -- 172.21.15.37:0/4042439466 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7da810ef80 con 0x7f7da80fed30 2024-04-25T17:16:01.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:01.220+0000 7f7d9dffb700 1 -- 172.21.15.37:0/4042439466 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d9800ca10 con 0x7f7da80fed30 2024-04-25T17:16:01.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:01.221+0000 7f7daf758700 1 -- 172.21.15.37:0/4042439466 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7da810f4c0 con 0x7f7da80fed30 2024-04-25T17:16:01.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:01.222+0000 7f7daf758700 1 -- 172.21.15.37:0/4042439466 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7da805f5c0 con 0x7f7da80fed30 2024-04-25T17:16:01.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:01.222+0000 7f7d9dffb700 1 -- 172.21.15.37:0/4042439466 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f7d9800cb70 con 0x7f7da80fed30 2024-04-25T17:16:01.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:01.222+0000 7f7d9dffb700 1 --2- 172.21.15.37:0/4042439466 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f7d940692b0 0x7f7d9406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:01.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:01.222+0000 7f7d9dffb700 1 -- 172.21.15.37:0/4042439466 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f7d98086cb0 con 0x7f7da80fed30 2024-04-25T17:16:01.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:01.222+0000 7f7dad4f4700 1 --2- 172.21.15.37:0/4042439466 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f7d940692b0 0x7f7d9406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:01.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:01.223+0000 7f7dad4f4700 1 --2- 172.21.15.37:0/4042439466 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f7d940692b0 0x7f7d9406b760 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7da400b0d0 tx=0x7f7da4009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:16:01.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:01.227+0000 7f7d9dffb700 1 -- 172.21.15.37:0/4042439466 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f7d9804e250 con 0x7f7da80fed30 2024-04-25T17:16:01.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:01.474+0000 7f7daf758700 1 -- 172.21.15.37:0/4042439466 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7da804bed0 con 0x7f7da80fed30 2024-04-25T17:16:01.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:01.475+0000 7f7d9dffb700 1 -- 172.21.15.37:0/4042439466 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1830 (secure 0 0 0) 0x7f7d98056b20 con 0x7f7da80fed30 2024-04-25T17:16:01.475 INFO:teuthology.orchestra.run.smithi037.stdout:e16 2024-04-25T17:16:01.475 INFO:teuthology.orchestra.run.smithi037.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-25T17:16:01.475 INFO:teuthology.orchestra.run.smithi037.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T17:16:01.476 INFO:teuthology.orchestra.run.smithi037.stdout:legacy client fscid: 1 2024-04-25T17:16:01.476 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:16:01.476 INFO:teuthology.orchestra.run.smithi037.stdout:Filesystem 'cephfs' (1) 2024-04-25T17:16:01.476 INFO:teuthology.orchestra.run.smithi037.stdout:fs_name cephfs 2024-04-25T17:16:01.476 INFO:teuthology.orchestra.run.smithi037.stdout:epoch 16 2024-04-25T17:16:01.476 INFO:teuthology.orchestra.run.smithi037.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-25T17:16:01.476 INFO:teuthology.orchestra.run.smithi037.stdout:created 2024-04-25T17:15:40.586130+0000 2024-04-25T17:16:01.476 INFO:teuthology.orchestra.run.smithi037.stdout:modified 2024-04-25T17:15:57.508740+0000 2024-04-25T17:16:01.476 INFO:teuthology.orchestra.run.smithi037.stdout:tableserver 0 2024-04-25T17:16:01.476 INFO:teuthology.orchestra.run.smithi037.stdout:root 0 2024-04-25T17:16:01.476 INFO:teuthology.orchestra.run.smithi037.stdout:session_timeout 60 2024-04-25T17:16:01.476 INFO:teuthology.orchestra.run.smithi037.stdout:session_autoclose 300 2024-04-25T17:16:01.476 INFO:teuthology.orchestra.run.smithi037.stdout:max_file_size 1099511627776 2024-04-25T17:16:01.476 INFO:teuthology.orchestra.run.smithi037.stdout:required_client_features {} 2024-04-25T17:16:01.476 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure 0 2024-04-25T17:16:01.477 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure_osd_epoch 0 2024-04-25T17:16:01.477 INFO:teuthology.orchestra.run.smithi037.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T17:16:01.477 INFO:teuthology.orchestra.run.smithi037.stdout:max_mds 1 2024-04-25T17:16:01.477 INFO:teuthology.orchestra.run.smithi037.stdout:in 0 2024-04-25T17:16:01.477 INFO:teuthology.orchestra.run.smithi037.stdout:up {0=14470} 2024-04-25T17:16:01.477 INFO:teuthology.orchestra.run.smithi037.stdout:failed 2024-04-25T17:16:01.477 INFO:teuthology.orchestra.run.smithi037.stdout:damaged 2024-04-25T17:16:01.477 INFO:teuthology.orchestra.run.smithi037.stdout:stopped 2024-04-25T17:16:01.477 INFO:teuthology.orchestra.run.smithi037.stdout:data_pools [3] 2024-04-25T17:16:01.477 INFO:teuthology.orchestra.run.smithi037.stdout:metadata_pool 2 2024-04-25T17:16:01.477 INFO:teuthology.orchestra.run.smithi037.stdout:inline_data disabled 2024-04-25T17:16:01.478 INFO:teuthology.orchestra.run.smithi037.stdout:balancer 2024-04-25T17:16:01.478 INFO:teuthology.orchestra.run.smithi037.stdout:standby_count_wanted 1 2024-04-25T17:16:01.478 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi037.ksmixc{0:14470} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.37:6826/1903989494,v1:172.21.15.37:6827/1903989494] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:16:01.478 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi037.ovkrpq{0:14482} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.37:6828/4206394422,v1:172.21.15.37:6829/4206394422] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:16:01.478 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:16:01.478 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:16:01.478 INFO:teuthology.orchestra.run.smithi037.stdout:Standby daemons: 2024-04-25T17:16:01.478 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:16:01.478 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi069.cpprst{-1:24289} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.69:6826/518856100,v1:172.21.15.69:6827/518856100] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:16:01.478 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi069.ytlqcf{-1:24293} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.69:6824/134210439,v1:172.21.15.69:6825/134210439] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:16:01.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:01.477+0000 7f7daf758700 1 -- 172.21.15.37:0/4042439466 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f7d940692b0 msgr2=0x7f7d9406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:01.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:01.477+0000 7f7daf758700 1 --2- 172.21.15.37:0/4042439466 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f7d940692b0 0x7f7d9406b760 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7da400b0d0 tx=0x7f7da4009e30 comp rx=0 tx=0).stop 2024-04-25T17:16:01.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:01.477+0000 7f7daf758700 1 -- 172.21.15.37:0/4042439466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7da80fed30 msgr2=0x7f7da810deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:01.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:01.477+0000 7f7daf758700 1 --2- 172.21.15.37:0/4042439466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7da80fed30 0x7f7da810deb0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7d9800eb40 tx=0x7f7d9800b040 comp rx=0 tx=0).stop 2024-04-25T17:16:01.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:01.477+0000 7f7daf758700 1 -- 172.21.15.37:0/4042439466 shutdown_connections 2024-04-25T17:16:01.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:01.477+0000 7f7daf758700 1 --2- 172.21.15.37:0/4042439466 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f7d940692b0 0x7f7d9406b760 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:01.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:01.477+0000 7f7daf758700 1 --2- 172.21.15.37:0/4042439466 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7da80fe3e0 0x7f7da810d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:01.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:01.477+0000 7f7daf758700 1 --2- 172.21.15.37:0/4042439466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7da80fed30 0x7f7da810deb0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:01.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:01.477+0000 7f7daf758700 1 -- 172.21.15.37:0/4042439466 >> 172.21.15.37:0/4042439466 conn(0x7f7da80f6b80 msgr2=0x7f7da80f81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:16:01.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:01.477+0000 7f7daf758700 1 -- 172.21.15.37:0/4042439466 shutdown_connections 2024-04-25T17:16:01.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:01.477+0000 7f7daf758700 1 -- 172.21.15.37:0/4042439466 wait complete. 2024-04-25T17:16:01.480 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 16 2024-04-25T17:16:02.119 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:02 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:16:02.119 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:02 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:16:02.119 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:02 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:16:02.120 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:02 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:16:02.120 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:02 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:16:02.120 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:02 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:16:02.120 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:02 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/4042439466' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T17:16:02.120 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:02 smithi037 ceph-mon[26472]: pgmap v187: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 597 B/s wr, 2 op/s 2024-04-25T17:16:02.146 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-04-25T17:16:02.366 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:02 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:16:02.366 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:02 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:16:02.367 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:02 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:16:02.367 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:02 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:16:02.367 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:02 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:16:02.367 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:02 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:16:02.367 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:02 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/4042439466' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T17:16:02.367 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:02 smithi069 ceph-mon[34527]: pgmap v187: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 597 B/s wr, 2 op/s 2024-04-25T17:16:02.921 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:16:04.321 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:04 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:16:04.321 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:04 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:16:04.321 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:04 smithi037 ceph-mon[26472]: pgmap v188: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-25T17:16:04.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:04 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:16:04.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:04 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:16:04.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:04 smithi069 ceph-mon[34527]: pgmap v188: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-04-25T17:16:06.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:06.671+0000 7f0b5b7fe700 1 -- 172.21.15.37:0/3537178064 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b5000e070 con 0x7f0b5c0fbcb0 2024-04-25T17:16:06.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:06.672+0000 7f0b62f99700 1 -- 172.21.15.37:0/3537178064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b5c0fbcb0 msgr2=0x7f0b5c0fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:06.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:06.672+0000 7f0b62f99700 1 --2- 172.21.15.37:0/3537178064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b5c0fbcb0 0x7f0b5c0fc0c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0b50004940 tx=0x7f0b50009e30 comp rx=0 tx=0).stop 2024-04-25T17:16:06.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:06.672+0000 7f0b62f99700 1 -- 172.21.15.37:0/3537178064 shutdown_connections 2024-04-25T17:16:06.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:06.672+0000 7f0b62f99700 1 --2- 172.21.15.37:0/3537178064 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0b5c0fcf60 0x7f0b5c0fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:06.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:06.672+0000 7f0b62f99700 1 --2- 172.21.15.37:0/3537178064 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b5c0fbcb0 0x7f0b5c0fc0c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:06.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:06.672+0000 7f0b62f99700 1 -- 172.21.15.37:0/3537178064 >> 172.21.15.37:0/3537178064 conn(0x7f0b5c0f73f0 msgr2=0x7f0b5c0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:16:06.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:06.672+0000 7f0b62f99700 1 -- 172.21.15.37:0/3537178064 shutdown_connections 2024-04-25T17:16:06.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:06.672+0000 7f0b62f99700 1 -- 172.21.15.37:0/3537178064 wait complete. 2024-04-25T17:16:06.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:06.673+0000 7f0b62f99700 1 Processor -- start 2024-04-25T17:16:06.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:06.673+0000 7f0b62f99700 1 -- start start 2024-04-25T17:16:06.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:06.673+0000 7f0b62f99700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0b5c0fbcb0 0x7f0b5c10d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:06.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:06.673+0000 7f0b62f99700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b5c0fcf60 0x7f0b5c10deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:06.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:06.674+0000 7f0b62f99700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c10e4b0 con 0x7f0b5c0fcf60 2024-04-25T17:16:06.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:06.674+0000 7f0b62f99700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c10ed00 con 0x7f0b5c0fbcb0 2024-04-25T17:16:06.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:06.674+0000 7f0b5bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b5c0fcf60 0x7f0b5c10deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:06.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:06.674+0000 7f0b5bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b5c0fcf60 0x7f0b5c10deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52788/0 (socket says 172.21.15.37:52788) 2024-04-25T17:16:06.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:06.674+0000 7f0b5bfff700 1 -- 172.21.15.37:0/2574217038 learned_addr learned my addr 172.21.15.37:0/2574217038 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:16:06.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:06.674+0000 7f0b60d35700 1 --2- 172.21.15.37:0/2574217038 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0b5c0fbcb0 0x7f0b5c10d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:06.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:06.674+0000 7f0b5bfff700 1 -- 172.21.15.37:0/2574217038 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0b5c0fbcb0 msgr2=0x7f0b5c10d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:06.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:06.674+0000 7f0b5bfff700 1 --2- 172.21.15.37:0/2574217038 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0b5c0fbcb0 0x7f0b5c10d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:06.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:06.674+0000 7f0b5bfff700 1 -- 172.21.15.37:0/2574217038 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b50005040 con 0x7f0b5c0fcf60 2024-04-25T17:16:06.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:06.674+0000 7f0b5bfff700 1 --2- 172.21.15.37:0/2574217038 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b5c0fcf60 0x7f0b5c10deb0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0b48002a50 tx=0x7f0b480046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:16:06.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:06.675+0000 7f0b597fa700 1 -- 172.21.15.37:0/2574217038 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b48007cc0 con 0x7f0b5c0fcf60 2024-04-25T17:16:06.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:06.675+0000 7f0b597fa700 1 -- 172.21.15.37:0/2574217038 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0b4800f040 con 0x7f0b5c0fcf60 2024-04-25T17:16:06.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:06.675+0000 7f0b62f99700 1 -- 172.21.15.37:0/2574217038 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b5c10efe0 con 0x7f0b5c0fcf60 2024-04-25T17:16:06.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:06.675+0000 7f0b597fa700 1 -- 172.21.15.37:0/2574217038 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b4800da60 con 0x7f0b5c0fcf60 2024-04-25T17:16:06.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:06.675+0000 7f0b62f99700 1 -- 172.21.15.37:0/2574217038 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b5c10f520 con 0x7f0b5c0fcf60 2024-04-25T17:16:06.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:06.676+0000 7f0b62f99700 1 -- 172.21.15.37:0/2574217038 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b5c05f5c0 con 0x7f0b5c0fcf60 2024-04-25T17:16:06.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:06.676+0000 7f0b597fa700 1 -- 172.21.15.37:0/2574217038 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f0b4800dbc0 con 0x7f0b5c0fcf60 2024-04-25T17:16:06.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:06.677+0000 7f0b597fa700 1 --2- 172.21.15.37:0/2574217038 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f0b4c0692a0 0x7f0b4c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:06.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:06.677+0000 7f0b597fa700 1 -- 172.21.15.37:0/2574217038 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f0b48086e80 con 0x7f0b5c0fcf60 2024-04-25T17:16:06.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:06.677+0000 7f0b60d35700 1 --2- 172.21.15.37:0/2574217038 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f0b4c0692a0 0x7f0b4c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:06.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:06.677+0000 7f0b60d35700 1 --2- 172.21.15.37:0/2574217038 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f0b4c0692a0 0x7f0b4c06b750 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0b5000b3b0 tx=0x7f0b50009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:16:06.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:06.682+0000 7f0b597fa700 1 -- 172.21.15.37:0/2574217038 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f0b48056c40 con 0x7f0b5c0fcf60 2024-04-25T17:16:06.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:06 smithi037 ceph-mon[26472]: pgmap v189: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 2 op/s 2024-04-25T17:16:06.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:06 smithi069 ceph-mon[34527]: pgmap v189: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 2 op/s 2024-04-25T17:16:06.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:06.935+0000 7f0b62f99700 1 -- 172.21.15.37:0/2574217038 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0b5c04bed0 con 0x7f0b5c0fcf60 2024-04-25T17:16:06.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:06.936+0000 7f0b597fa700 1 -- 172.21.15.37:0/2574217038 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4688 (secure 0 0 0) 0x7f0b480567d0 con 0x7f0b5c0fcf60 2024-04-25T17:16:06.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:06.938+0000 7f0b62f99700 1 -- 172.21.15.37:0/2574217038 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f0b4c0692a0 msgr2=0x7f0b4c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:06.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:06.938+0000 7f0b62f99700 1 --2- 172.21.15.37:0/2574217038 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f0b4c0692a0 0x7f0b4c06b750 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0b5000b3b0 tx=0x7f0b50009e30 comp rx=0 tx=0).stop 2024-04-25T17:16:06.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:06.938+0000 7f0b62f99700 1 -- 172.21.15.37:0/2574217038 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b5c0fcf60 msgr2=0x7f0b5c10deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:06.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:06.938+0000 7f0b62f99700 1 --2- 172.21.15.37:0/2574217038 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b5c0fcf60 0x7f0b5c10deb0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0b48002a50 tx=0x7f0b480046b0 comp rx=0 tx=0).stop 2024-04-25T17:16:06.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:06.938+0000 7f0b62f99700 1 -- 172.21.15.37:0/2574217038 shutdown_connections 2024-04-25T17:16:06.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:06.938+0000 7f0b62f99700 1 --2- 172.21.15.37:0/2574217038 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f0b4c0692a0 0x7f0b4c06b750 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:06.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:06.938+0000 7f0b62f99700 1 --2- 172.21.15.37:0/2574217038 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0b5c0fbcb0 0x7f0b5c10d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:06.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:06.938+0000 7f0b62f99700 1 --2- 172.21.15.37:0/2574217038 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0b5c0fcf60 0x7f0b5c10deb0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:06.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:06.938+0000 7f0b62f99700 1 -- 172.21.15.37:0/2574217038 >> 172.21.15.37:0/2574217038 conn(0x7f0b5c0f73f0 msgr2=0x7f0b5c0f8a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:16:06.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:06.938+0000 7f0b62f99700 1 -- 172.21.15.37:0/2574217038 shutdown_connections 2024-04-25T17:16:06.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:06.938+0000 7f0b62f99700 1 -- 172.21.15.37:0/2574217038 wait complete. 2024-04-25T17:16:06.939 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 16 2024-04-25T17:16:06.948 INFO:teuthology.orchestra.run.smithi037.stdout:true 2024-04-25T17:16:07.613 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-04-25T17:16:07.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:07 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/2574217038' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T17:16:07.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:07 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/2574217038' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T17:16:07.998 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:16:08.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:08 smithi037 ceph-mon[26472]: pgmap v190: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s 2024-04-25T17:16:08.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:08 smithi069 ceph-mon[34527]: pgmap v190: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s 2024-04-25T17:16:09.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:09.650+0000 7ff83b040700 1 -- 172.21.15.37:0/2661302125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8340fbcb0 msgr2=0x7ff8340fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:09.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:09.650+0000 7ff83b040700 1 --2- 172.21.15.37:0/2661302125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8340fbcb0 0x7ff8340fc0c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff82c009ce0 tx=0x7ff82c004d10 comp rx=0 tx=0).stop 2024-04-25T17:16:09.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:09.650+0000 7ff83b040700 1 -- 172.21.15.37:0/2661302125 shutdown_connections 2024-04-25T17:16:09.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:09.650+0000 7ff83b040700 1 --2- 172.21.15.37:0/2661302125 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff8340fcf60 0x7ff8340fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:09.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:09.650+0000 7ff83b040700 1 --2- 172.21.15.37:0/2661302125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8340fbcb0 0x7ff8340fc0c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:09.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:09.650+0000 7ff83b040700 1 -- 172.21.15.37:0/2661302125 >> 172.21.15.37:0/2661302125 conn(0x7ff8340f7430 msgr2=0x7ff8340f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:16:09.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:09.650+0000 7ff83b040700 1 -- 172.21.15.37:0/2661302125 shutdown_connections 2024-04-25T17:16:09.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:09.650+0000 7ff83b040700 1 -- 172.21.15.37:0/2661302125 wait complete. 2024-04-25T17:16:09.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:09.651+0000 7ff83b040700 1 Processor -- start 2024-04-25T17:16:09.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:09.651+0000 7ff83b040700 1 -- start start 2024-04-25T17:16:09.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:09.651+0000 7ff83b040700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff8340fbcb0 0x7ff83410ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:09.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:09.651+0000 7ff83b040700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8340fcf60 0x7ff83410cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:09.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:09.651+0000 7ff83b040700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83410d5b0 con 0x7ff8340fcf60 2024-04-25T17:16:09.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:09.651+0000 7ff83b040700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83410de00 con 0x7ff8340fbcb0 2024-04-25T17:16:09.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:09.651+0000 7ff833fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8340fcf60 0x7ff83410cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:09.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:09.651+0000 7ff833fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8340fcf60 0x7ff83410cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52814/0 (socket says 172.21.15.37:52814) 2024-04-25T17:16:09.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:09.651+0000 7ff833fff700 1 -- 172.21.15.37:0/2759241101 learned_addr learned my addr 172.21.15.37:0/2759241101 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:16:09.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:09.651+0000 7ff838ddc700 1 --2- 172.21.15.37:0/2759241101 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff8340fbcb0 0x7ff83410ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:09.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:09.652+0000 7ff833fff700 1 -- 172.21.15.37:0/2759241101 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff8340fbcb0 msgr2=0x7ff83410ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:09.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:09.652+0000 7ff833fff700 1 --2- 172.21.15.37:0/2759241101 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff8340fbcb0 0x7ff83410ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:09.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:09.652+0000 7ff833fff700 1 -- 172.21.15.37:0/2759241101 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff82c009940 con 0x7ff8340fcf60 2024-04-25T17:16:09.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:09.652+0000 7ff838ddc700 1 --2- 172.21.15.37:0/2759241101 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff8340fbcb0 0x7ff83410ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T17:16:09.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:09.652+0000 7ff833fff700 1 --2- 172.21.15.37:0/2759241101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8340fcf60 0x7ff83410cfb0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff82800ead0 tx=0x7ff828004500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:16:09.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:09.652+0000 7ff8317fa700 1 -- 172.21.15.37:0/2759241101 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff82800cc60 con 0x7ff8340fcf60 2024-04-25T17:16:09.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:09.652+0000 7ff8317fa700 1 -- 172.21.15.37:0/2759241101 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff82800cdc0 con 0x7ff8340fcf60 2024-04-25T17:16:09.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:09.652+0000 7ff8317fa700 1 -- 172.21.15.37:0/2759241101 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff8280109f0 con 0x7ff8340fcf60 2024-04-25T17:16:09.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:09.652+0000 7ff83b040700 1 -- 172.21.15.37:0/2759241101 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff83410e080 con 0x7ff8340fcf60 2024-04-25T17:16:09.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:09.652+0000 7ff83b040700 1 -- 172.21.15.37:0/2759241101 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff83410e640 con 0x7ff8340fcf60 2024-04-25T17:16:09.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:09.653+0000 7ff83b040700 1 -- 172.21.15.37:0/2759241101 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff83405f5c0 con 0x7ff8340fcf60 2024-04-25T17:16:09.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:09.654+0000 7ff8317fa700 1 -- 172.21.15.37:0/2759241101 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7ff828010b50 con 0x7ff8340fcf60 2024-04-25T17:16:09.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:09.654+0000 7ff8317fa700 1 --2- 172.21.15.37:0/2759241101 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7ff81c0692a0 0x7ff81c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:09.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:09.654+0000 7ff8317fa700 1 -- 172.21.15.37:0/2759241101 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7ff828089980 con 0x7ff8340fcf60 2024-04-25T17:16:09.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:09.654+0000 7ff838ddc700 1 --2- 172.21.15.37:0/2759241101 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7ff81c0692a0 0x7ff81c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:09.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:09.654+0000 7ff838ddc700 1 --2- 172.21.15.37:0/2759241101 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7ff81c0692a0 0x7ff81c06b750 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff82c0095a0 tx=0x7ff82c004d10 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:16:09.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:09.658+0000 7ff8317fa700 1 -- 172.21.15.37:0/2759241101 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7ff8280597e0 con 0x7ff8340fcf60 2024-04-25T17:16:09.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:09.949+0000 7ff83b040700 1 -- 172.21.15.37:0/2759241101 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7ff83404bed0 con 0x7ff8340fcf60 2024-04-25T17:16:09.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:09.950+0000 7ff8317fa700 1 -- 172.21.15.37:0/2759241101 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v16) v1 ==== 78+0+99 (secure 0 0 0) 0x7ff828015080 con 0x7ff8340fcf60 2024-04-25T17:16:09.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:09.952+0000 7ff83b040700 1 -- 172.21.15.37:0/2759241101 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7ff81c0692a0 msgr2=0x7ff81c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:09.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:09.952+0000 7ff83b040700 1 --2- 172.21.15.37:0/2759241101 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7ff81c0692a0 0x7ff81c06b750 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff82c0095a0 tx=0x7ff82c004d10 comp rx=0 tx=0).stop 2024-04-25T17:16:09.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:09.952+0000 7ff83b040700 1 -- 172.21.15.37:0/2759241101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8340fcf60 msgr2=0x7ff83410cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:09.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:09.952+0000 7ff83b040700 1 --2- 172.21.15.37:0/2759241101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8340fcf60 0x7ff83410cfb0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff82800ead0 tx=0x7ff828004500 comp rx=0 tx=0).stop 2024-04-25T17:16:09.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:09.952+0000 7ff83b040700 1 -- 172.21.15.37:0/2759241101 shutdown_connections 2024-04-25T17:16:09.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:09.952+0000 7ff83b040700 1 --2- 172.21.15.37:0/2759241101 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7ff81c0692a0 0x7ff81c06b750 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:09.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:09.952+0000 7ff83b040700 1 --2- 172.21.15.37:0/2759241101 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff8340fbcb0 0x7ff83410ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:09.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:09.952+0000 7ff83b040700 1 --2- 172.21.15.37:0/2759241101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff8340fcf60 0x7ff83410cfb0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:09.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:09.952+0000 7ff83b040700 1 -- 172.21.15.37:0/2759241101 >> 172.21.15.37:0/2759241101 conn(0x7ff8340f7430 msgr2=0x7ff8340f8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:16:09.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:09.952+0000 7ff83b040700 1 -- 172.21.15.37:0/2759241101 shutdown_connections 2024-04-25T17:16:09.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:09.952+0000 7ff83b040700 1 -- 172.21.15.37:0/2759241101 wait complete. 2024-04-25T17:16:09.963 INFO:teuthology.orchestra.run.smithi037.stdout:true 2024-04-25T17:16:10.590 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-04-25T17:16:10.603 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T17:16:10.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:10.724+0000 7ff3f459d640 1 -- 172.21.15.37:0/1531993061 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3ec0ff2d0 msgr2=0x7ff3ec1016b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:10.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:10.724+0000 7ff3f459d640 1 --2- 172.21.15.37:0/1531993061 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3ec0ff2d0 0x7ff3ec1016b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff3e80048d0 tx=0x7ff3e8009da0 comp rx=0 tx=0).stop 2024-04-25T17:16:10.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:10.725+0000 7ff3f459d640 1 -- 172.21.15.37:0/1531993061 shutdown_connections 2024-04-25T17:16:10.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:10.725+0000 7ff3f459d640 1 --2- 172.21.15.37:0/1531993061 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3ec0ff2d0 0x7ff3ec1016b0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:10.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:10.725+0000 7ff3f459d640 1 --2- 172.21.15.37:0/1531993061 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff3ec0661b0 0x7ff3ec0fed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:10.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:10.725+0000 7ff3f459d640 1 -- 172.21.15.37:0/1531993061 >> 172.21.15.37:0/1531993061 conn(0x7ff3ec0f6840 msgr2=0x7ff3ec0f8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:16:10.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:10.725+0000 7ff3f459d640 1 -- 172.21.15.37:0/1531993061 shutdown_connections 2024-04-25T17:16:10.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:10.725+0000 7ff3f459d640 1 -- 172.21.15.37:0/1531993061 wait complete. 2024-04-25T17:16:10.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:10.725+0000 7ff3f459d640 1 Processor -- start 2024-04-25T17:16:10.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:10.725+0000 7ff3f459d640 1 -- start start 2024-04-25T17:16:10.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:10.725+0000 7ff3f459d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff3ec0661b0 0x7ff3ec10cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:10.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:10.725+0000 7ff3f459d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3ec0ff2d0 0x7ff3ec10d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:10.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:10.725+0000 7ff3f459d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ec10d9f0 con 0x7ff3ec0ff2d0 2024-04-25T17:16:10.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:10.725+0000 7ff3f459d640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ec112310 con 0x7ff3ec0661b0 2024-04-25T17:16:10.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:10.725+0000 7ff3f1b38640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3ec0ff2d0 0x7ff3ec10d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:10.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:10.725+0000 7ff3f1b38640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3ec0ff2d0 0x7ff3ec10d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52838/0 (socket says 172.21.15.37:52838) 2024-04-25T17:16:10.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:10.725+0000 7ff3f1b38640 1 -- 172.21.15.37:0/1983906091 learned_addr learned my addr 172.21.15.37:0/1983906091 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:16:10.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:10.726+0000 7ff3f2339640 1 --2- 172.21.15.37:0/1983906091 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff3ec0661b0 0x7ff3ec10cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:10.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:10.726+0000 7ff3f1b38640 1 -- 172.21.15.37:0/1983906091 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff3ec0661b0 msgr2=0x7ff3ec10cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:10.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:10.726+0000 7ff3f1b38640 1 --2- 172.21.15.37:0/1983906091 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff3ec0661b0 0x7ff3ec10cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:10.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:10.726+0000 7ff3f1b38640 1 -- 172.21.15.37:0/1983906091 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e8005040 con 0x7ff3ec0ff2d0 2024-04-25T17:16:10.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:10.726+0000 7ff3f1b38640 1 --2- 172.21.15.37:0/1983906091 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3ec0ff2d0 0x7ff3ec10d310 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8007d20 tx=0x7ff3e8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:16:10.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:10.726+0000 7ff3e2ffd640 1 -- 172.21.15.37:0/1983906091 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3e8009590 con 0x7ff3ec0ff2d0 2024-04-25T17:16:10.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:10.726+0000 7ff3e2ffd640 1 -- 172.21.15.37:0/1983906091 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff3e80096f0 con 0x7ff3ec0ff2d0 2024-04-25T17:16:10.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:10.726+0000 7ff3f459d640 1 -- 172.21.15.37:0/1983906091 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3ec112510 con 0x7ff3ec0ff2d0 2024-04-25T17:16:10.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:10.726+0000 7ff3e2ffd640 1 -- 172.21.15.37:0/1983906091 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3e803b6d0 con 0x7ff3ec0ff2d0 2024-04-25T17:16:10.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:10.726+0000 7ff3f459d640 1 -- 172.21.15.37:0/1983906091 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3ec112a30 con 0x7ff3ec0ff2d0 2024-04-25T17:16:10.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:10.727+0000 7ff3f459d640 1 -- 172.21.15.37:0/1983906091 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3ec04bcc0 con 0x7ff3ec0ff2d0 2024-04-25T17:16:10.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:10.727+0000 7ff3e2ffd640 1 -- 172.21.15.37:0/1983906091 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7ff3e802f070 con 0x7ff3ec0ff2d0 2024-04-25T17:16:10.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:10.728+0000 7ff3e2ffd640 1 --2- 172.21.15.37:0/1983906091 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7ff3d8069210 0x7ff3d806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:10.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:10.728+0000 7ff3f2339640 1 --2- 172.21.15.37:0/1983906091 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7ff3d8069210 0x7ff3d806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:10.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:10.728+0000 7ff3e2ffd640 1 -- 172.21.15.37:0/1983906091 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7ff3e80a9780 con 0x7ff3ec0ff2d0 2024-04-25T17:16:10.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:10.728+0000 7ff3f2339640 1 --2- 172.21.15.37:0/1983906091 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7ff3d8069210 0x7ff3d806b6c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc006fd0 tx=0x7ff3dc008040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:16:10.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:10.733+0000 7ff3e2ffd640 1 -- 172.21.15.37:0/1983906091 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7ff3e8075ab0 con 0x7ff3ec0ff2d0 2024-04-25T17:16:10.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:10 smithi037 ceph-mon[26472]: pgmap v191: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 2 op/s 2024-04-25T17:16:10.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:10 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:16:10.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:10 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:16:10.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:10 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:16:10.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:10 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:16:10.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:10 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:16:10.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:10 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/2759241101' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-04-25T17:16:10.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:10 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:16:10.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:10.910+0000 7ff3f459d640 1 -- 172.21.15.37:0/1983906091 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff3ec104d70 con 0x7ff3ec0ff2d0 2024-04-25T17:16:10.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:10.910+0000 7ff3e2ffd640 1 -- 172.21.15.37:0/1983906091 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+14209 (secure 0 0 0) 0x7ff3e80790d0 con 0x7ff3ec0ff2d0 2024-04-25T17:16:10.911 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:16:10.911 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":46,"fsid":"599bb7fc-0326-11ef-bc93-c7b262605968","created":"2024-04-25T17:08:37.882631+0000","modified":"2024-04-25T17:15:42.590958+0000","last_up_change":"2024-04-25T17:14:20.333710+0000","last_in_change":"2024-04-25T17:14:01.927070+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T17:13:09.960202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-04-25T17:15:39.512161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-04-25T17:15:40.014896+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c142de25-7aff-4c4b-b351-14e7b18de11d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2457908683},{"type":"v1","addr":"172.21.15.37:6803","nonce":2457908683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2457908683},{"type":"v1","addr":"172.21.15.37:6805","nonce":2457908683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2457908683},{"type":"v1","addr":"172.21.15.37:6809","nonce":2457908683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2457908683},{"type":"v1","addr":"172.21.15.37:6807","nonce":2457908683}]},"public_addr":"172.21.15.37:6803/2457908683","cluster_addr":"172.21.15.37:6805/2457908683","heartbeat_back_addr":"172.21.15.37:6809/2457908683","heartbeat_front_addr":"172.21.15.37:6807/2457908683","state":["exists","up"]},{"osd":1,"uuid":"ec683da0-f3c1-44b5-8f1d-69bec27fbe5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":24763193},{"type":"v1","addr":"172.21.15.37:6811","nonce":24763193}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":24763193},{"type":"v1","addr":"172.21.15.37:6813","nonce":24763193}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":24763193},{"type":"v1","addr":"172.21.15.37:6817","nonce":24763193}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":24763193},{"type":"v1","addr":"172.21.15.37:6815","nonce":24763193}]},"public_addr":"172.21.15.37:6811/24763193","cluster_addr":"172.21.15.37:6813/24763193","heartbeat_back_addr":"172.21.15.37:6817/24763193","heartbeat_front_addr":"172.21.15.37:6815/24763193","state":["exists","up"]},{"osd":2,"uuid":"8bf4e67b-e95f-44d3-b51f-afd8a2d30e31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":596257416},{"type":"v1","addr":"172.21.15.37:6819","nonce":596257416}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":596257416},{"type":"v1","addr":"172.21.15.37:6821","nonce":596257416}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":596257416},{"type":"v1","addr":"172.21.15.37:6825","nonce":596257416}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":596257416},{"type":"v1","addr":"172.21.15.37:6823","nonce":596257416}]},"public_addr":"172.21.15.37:6819/596257416","cluster_addr":"172.21.15.37:6821/596257416","heartbeat_back_addr":"172.21.15.37:6825/596257416","heartbeat_front_addr":"172.21.15.37:6823/596257416","state":["exists","up"]},{"osd":3,"uuid":"ce5ff1f7-472a-4515-b851-e434ee545b27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":3815031427},{"type":"v1","addr":"172.21.15.69:6801","nonce":3815031427}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":3815031427},{"type":"v1","addr":"172.21.15.69:6803","nonce":3815031427}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":3815031427},{"type":"v1","addr":"172.21.15.69:6807","nonce":3815031427}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":3815031427},{"type":"v1","addr":"172.21.15.69:6805","nonce":3815031427}]},"public_addr":"172.21.15.69:6801/3815031427","cluster_addr":"172.21.15.69:6803/3815031427","heartbeat_back_addr":"172.21.15.69:6807/3815031427","heartbeat_front_addr":"172.21.15.69:6805/3815031427","state":["exists","up"]},{"osd":4,"uuid":"26cf2aeb-fc85-4d14-b936-08b8280489e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":2571772778},{"type":"v1","addr":"172.21.15.69:6809","nonce":2571772778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":2571772778},{"type":"v1","addr":"172.21.15.69:6811","nonce":2571772778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":2571772778},{"type":"v1","addr":"172.21.15.69:6815","nonce":2571772778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":2571772778},{"type":"v1","addr":"172.21.15.69:6813","nonce":2571772778}]},"public_addr":"172.21.15.69:6809/2571772778","cluster_addr":"172.21.15.69:6811/2571772778","heartbeat_back_addr":"172.21.15.69:6815/2571772778","heartbeat_front_addr":"172.21.15.69:6813/2571772778","state":["exists","up"]},{"osd":5,"uuid":"fb3edb82-8f78-40d6-a339-5c469ef08371","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":2319222775},{"type":"v1","addr":"172.21.15.69:6817","nonce":2319222775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":2319222775},{"type":"v1","addr":"172.21.15.69:6819","nonce":2319222775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":2319222775},{"type":"v1","addr":"172.21.15.69:6823","nonce":2319222775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":2319222775},{"type":"v1","addr":"172.21.15.69:6821","nonce":2319222775}]},"public_addr":"172.21.15.69:6817/2319222775","cluster_addr":"172.21.15.69:6819/2319222775","heartbeat_back_addr":"172.21.15.69:6823/2319222775","heartbeat_front_addr":"172.21.15.69:6821/2319222775","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T17:12:12.145795+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T17:12:39.059274+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T17:13:06.628770+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T17:13:29.779894+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T17:13:54.338391+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T17:14:18.637188+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.37:0/4258551295":"2024-04-26T17:10:55.431694+0000","172.21.15.37:6801/1299348474":"2024-04-26T17:10:55.431694+0000","172.21.15.37:0/350553669":"2024-04-26T17:10:55.431694+0000","172.21.15.37:6801/3653320894":"2024-04-26T17:09:39.480662+0000","172.21.15.37:0/3689680514":"2024-04-26T17:09:39.480662+0000","172.21.15.37:0/1135030866":"2024-04-26T17:09:39.480662+0000","172.21.15.37:6800/2509847167":"2024-04-26T17:09:09.103933+0000","172.21.15.37:6800/3653320894":"2024-04-26T17:09:39.480662+0000","172.21.15.37:0/2586714806":"2024-04-26T17:09:09.103933+0000","172.21.15.37:6800/1299348474":"2024-04-26T17:10:55.431694+0000","172.21.15.37:0/3277643196":"2024-04-26T17:09:09.103933+0000","172.21.15.37:0/1487666224":"2024-04-26T17:09:09.103933+0000","172.21.15.37:6801/2509847167":"2024-04-26T17:09:09.103933+0000","172.21.15.37:0/1749794583":"2024-04-26T17:10:55.431694+0000","172.21.15.37:0/3089604872":"2024-04-26T17:09:39.480662+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T17:16:10.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:10.912+0000 7ff3f459d640 1 -- 172.21.15.37:0/1983906091 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7ff3d8069210 msgr2=0x7ff3d806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:10.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:10.912+0000 7ff3f459d640 1 --2- 172.21.15.37:0/1983906091 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7ff3d8069210 0x7ff3d806b6c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc006fd0 tx=0x7ff3dc008040 comp rx=0 tx=0).stop 2024-04-25T17:16:10.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:10.912+0000 7ff3f459d640 1 -- 172.21.15.37:0/1983906091 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3ec0ff2d0 msgr2=0x7ff3ec10d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:10.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:10.912+0000 7ff3f459d640 1 --2- 172.21.15.37:0/1983906091 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3ec0ff2d0 0x7ff3ec10d310 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8007d20 tx=0x7ff3e8009da0 comp rx=0 tx=0).stop 2024-04-25T17:16:10.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:10.912+0000 7ff3f459d640 1 -- 172.21.15.37:0/1983906091 shutdown_connections 2024-04-25T17:16:10.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:10.912+0000 7ff3f459d640 1 --2- 172.21.15.37:0/1983906091 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3ec0ff2d0 0x7ff3ec10d310 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:10.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:10.912+0000 7ff3f459d640 1 --2- 172.21.15.37:0/1983906091 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7ff3d8069210 0x7ff3d806b6c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:10.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:10.912+0000 7ff3f459d640 1 --2- 172.21.15.37:0/1983906091 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff3ec0661b0 0x7ff3ec10cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:10.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:10.912+0000 7ff3f459d640 1 -- 172.21.15.37:0/1983906091 >> 172.21.15.37:0/1983906091 conn(0x7ff3ec0f6840 msgr2=0x7ff3ec0f8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:16:10.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:10.913+0000 7ff3f459d640 1 -- 172.21.15.37:0/1983906091 shutdown_connections 2024-04-25T17:16:10.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:10.913+0000 7ff3f459d640 1 -- 172.21.15.37:0/1983906091 wait complete. 2024-04-25T17:16:10.923 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T17:13:09.960202+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-04-25T17:15:39.512161+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-04-25T17:15:40.014896+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T17:16:10.923 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T17:16:11.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.024+0000 7f3ba0aae640 1 -- 172.21.15.37:0/3289322750 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b9c064fb0 msgr2=0x7f3b9c0fedd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:11.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.024+0000 7f3ba0aae640 1 --2- 172.21.15.37:0/3289322750 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b9c064fb0 0x7f3b9c0fedd0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3b940048d0 tx=0x7f3b94009da0 comp rx=0 tx=0).stop 2024-04-25T17:16:11.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.025+0000 7f3ba0aae640 1 -- 172.21.15.37:0/3289322750 shutdown_connections 2024-04-25T17:16:11.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.025+0000 7f3ba0aae640 1 --2- 172.21.15.37:0/3289322750 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3b9c0ff310 0x7f3b9c1016f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:11.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.025+0000 7f3ba0aae640 1 --2- 172.21.15.37:0/3289322750 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b9c064fb0 0x7f3b9c0fedd0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:11.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.025+0000 7f3ba0aae640 1 -- 172.21.15.37:0/3289322750 >> 172.21.15.37:0/3289322750 conn(0x7f3b9c0f6820 msgr2=0x7f3b9c0f8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:16:11.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.025+0000 7f3ba0aae640 1 -- 172.21.15.37:0/3289322750 shutdown_connections 2024-04-25T17:16:11.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.025+0000 7f3ba0aae640 1 -- 172.21.15.37:0/3289322750 wait complete. 2024-04-25T17:16:11.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.025+0000 7f3ba0aae640 1 Processor -- start 2024-04-25T17:16:11.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.025+0000 7f3ba0aae640 1 -- start start 2024-04-25T17:16:11.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.025+0000 7f3ba0aae640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b9c064fb0 0x7f3b9c10cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:11.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.025+0000 7f3ba0aae640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3b9c0ff310 0x7f3b9c10d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:11.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.025+0000 7f3ba0aae640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9c10d8d0 con 0x7f3b9c064fb0 2024-04-25T17:16:11.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.025+0000 7f3ba0aae640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9c112290 con 0x7f3b9c0ff310 2024-04-25T17:16:11.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.025+0000 7f3b9a59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b9c064fb0 0x7f3b9c10cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:11.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.025+0000 7f3b9a59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b9c064fb0 0x7f3b9c10cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52864/0 (socket says 172.21.15.37:52864) 2024-04-25T17:16:11.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.025+0000 7f3b9a59c640 1 -- 172.21.15.37:0/2207539063 learned_addr learned my addr 172.21.15.37:0/2207539063 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:16:11.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.025+0000 7f3b99d9b640 1 --2- 172.21.15.37:0/2207539063 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3b9c0ff310 0x7f3b9c10d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:11.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.026+0000 7f3b9a59c640 1 -- 172.21.15.37:0/2207539063 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3b9c0ff310 msgr2=0x7f3b9c10d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:11.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.026+0000 7f3b9a59c640 1 --2- 172.21.15.37:0/2207539063 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3b9c0ff310 0x7f3b9c10d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:11.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.026+0000 7f3b9a59c640 1 -- 172.21.15.37:0/2207539063 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b94005040 con 0x7f3b9c064fb0 2024-04-25T17:16:11.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.026+0000 7f3b99d9b640 1 --2- 172.21.15.37:0/2207539063 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3b9c0ff310 0x7f3b9c10d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T17:16:11.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.026+0000 7f3b9a59c640 1 --2- 172.21.15.37:0/2207539063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b9c064fb0 0x7f3b9c10cd40 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3b940048a0 tx=0x7f3b94009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:16:11.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.026+0000 7f3b8affd640 1 -- 172.21.15.37:0/2207539063 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b940092e0 con 0x7f3b9c064fb0 2024-04-25T17:16:11.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.026+0000 7f3b8affd640 1 -- 172.21.15.37:0/2207539063 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3b94009440 con 0x7f3b9c064fb0 2024-04-25T17:16:11.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.026+0000 7f3ba0aae640 1 -- 172.21.15.37:0/2207539063 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b9c1123d0 con 0x7f3b9c064fb0 2024-04-25T17:16:11.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.026+0000 7f3b8affd640 1 -- 172.21.15.37:0/2207539063 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b94043620 con 0x7f3b9c064fb0 2024-04-25T17:16:11.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.026+0000 7f3ba0aae640 1 -- 172.21.15.37:0/2207539063 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b9c1128a0 con 0x7f3b9c064fb0 2024-04-25T17:16:11.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.027+0000 7f3ba0aae640 1 -- 172.21.15.37:0/2207539063 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b9c1054f0 con 0x7f3b9c064fb0 2024-04-25T17:16:11.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.027+0000 7f3b8affd640 1 -- 172.21.15.37:0/2207539063 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f3b9403b420 con 0x7f3b9c064fb0 2024-04-25T17:16:11.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.028+0000 7f3b8affd640 1 --2- 172.21.15.37:0/2207539063 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f3b84069210 0x7f3b8406b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:11.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.028+0000 7f3b8affd640 1 -- 172.21.15.37:0/2207539063 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f3b940a9e20 con 0x7f3b9c064fb0 2024-04-25T17:16:11.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.028+0000 7f3b99d9b640 1 --2- 172.21.15.37:0/2207539063 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f3b84069210 0x7f3b8406b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:11.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.028+0000 7f3b99d9b640 1 --2- 172.21.15.37:0/2207539063 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f3b84069210 0x7f3b8406b6c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3b90007fd0 tx=0x7f3b90009e90 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:16:11.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.032+0000 7f3b8affd640 1 -- 172.21.15.37:0/2207539063 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f3b940760b0 con 0x7f3b9c064fb0 2024-04-25T17:16:11.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:10 smithi069 ceph-mon[34527]: pgmap v191: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 2 op/s 2024-04-25T17:16:11.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:10 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:16:11.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:10 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:16:11.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:10 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:16:11.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:10 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:16:11.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:10 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:16:11.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:10 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/2759241101' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-04-25T17:16:11.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:10 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:16:11.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.206+0000 7f3ba0aae640 1 -- 172.21.15.37:0/2207539063 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3b9c112cd0 con 0x7f3b9c064fb0 2024-04-25T17:16:11.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.207+0000 7f3b8affd640 1 -- 172.21.15.37:0/2207539063 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3b940796d0 con 0x7f3b9c064fb0 2024-04-25T17:16:11.207 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-04-25T17:16:11.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.209+0000 7f3ba0aae640 1 -- 172.21.15.37:0/2207539063 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f3b84069210 msgr2=0x7f3b8406b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:11.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.209+0000 7f3ba0aae640 1 --2- 172.21.15.37:0/2207539063 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f3b84069210 0x7f3b8406b6c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3b90007fd0 tx=0x7f3b90009e90 comp rx=0 tx=0).stop 2024-04-25T17:16:11.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.209+0000 7f3ba0aae640 1 -- 172.21.15.37:0/2207539063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b9c064fb0 msgr2=0x7f3b9c10cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:11.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.209+0000 7f3ba0aae640 1 --2- 172.21.15.37:0/2207539063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b9c064fb0 0x7f3b9c10cd40 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3b940048a0 tx=0x7f3b94009da0 comp rx=0 tx=0).stop 2024-04-25T17:16:11.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.209+0000 7f3ba0aae640 1 -- 172.21.15.37:0/2207539063 shutdown_connections 2024-04-25T17:16:11.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.209+0000 7f3ba0aae640 1 --2- 172.21.15.37:0/2207539063 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f3b84069210 0x7f3b8406b6c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:11.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.209+0000 7f3ba0aae640 1 --2- 172.21.15.37:0/2207539063 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3b9c0ff310 0x7f3b9c10d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:11.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.209+0000 7f3ba0aae640 1 --2- 172.21.15.37:0/2207539063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b9c064fb0 0x7f3b9c10cd40 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:11.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.209+0000 7f3ba0aae640 1 -- 172.21.15.37:0/2207539063 >> 172.21.15.37:0/2207539063 conn(0x7f3b9c0f6820 msgr2=0x7f3b9c0f6c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:16:11.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.209+0000 7f3ba0aae640 1 -- 172.21.15.37:0/2207539063 shutdown_connections 2024-04-25T17:16:11.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.209+0000 7f3ba0aae640 1 -- 172.21.15.37:0/2207539063 wait complete. 2024-04-25T17:16:11.219 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-04-25T17:16:11.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.319+0000 7fbf1415d640 1 -- 172.21.15.37:0/464748662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf0c0fc330 msgr2=0x7fbf0c0fc7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:11.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.319+0000 7fbf1415d640 1 --2- 172.21.15.37:0/464748662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf0c0fc330 0x7fbf0c0fc7a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fbefc0048d0 tx=0x7fbefc009da0 comp rx=0 tx=0).stop 2024-04-25T17:16:11.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.319+0000 7fbf1415d640 1 -- 172.21.15.37:0/464748662 shutdown_connections 2024-04-25T17:16:11.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.319+0000 7fbf1415d640 1 --2- 172.21.15.37:0/464748662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf0c0fc330 0x7fbf0c0fc7a0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:11.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.319+0000 7fbf1415d640 1 --2- 172.21.15.37:0/464748662 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf0c0fb060 0x7fbf0c0fb470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:11.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.319+0000 7fbf1415d640 1 -- 172.21.15.37:0/464748662 >> 172.21.15.37:0/464748662 conn(0x7fbf0c0f6820 msgr2=0x7fbf0c0f8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:16:11.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.319+0000 7fbf1415d640 1 -- 172.21.15.37:0/464748662 shutdown_connections 2024-04-25T17:16:11.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.319+0000 7fbf1415d640 1 -- 172.21.15.37:0/464748662 wait complete. 2024-04-25T17:16:11.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.319+0000 7fbf1415d640 1 Processor -- start 2024-04-25T17:16:11.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.320+0000 7fbf1415d640 1 -- start start 2024-04-25T17:16:11.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.320+0000 7fbf1415d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf0c0fb060 0x7fbf0c10cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:11.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.320+0000 7fbf1415d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf0c0fc330 0x7fbf0c10d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:11.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.320+0000 7fbf1415d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0c10d820 con 0x7fbf0c0fb060 2024-04-25T17:16:11.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.320+0000 7fbf1415d640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0c1121e0 con 0x7fbf0c0fc330 2024-04-25T17:16:11.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.320+0000 7fbf11ef9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf0c0fb060 0x7fbf0c10cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:11.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.320+0000 7fbf11ef9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf0c0fb060 0x7fbf0c10cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52874/0 (socket says 172.21.15.37:52874) 2024-04-25T17:16:11.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.320+0000 7fbf11ef9640 1 -- 172.21.15.37:0/2602695968 learned_addr learned my addr 172.21.15.37:0/2602695968 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:16:11.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.320+0000 7fbf116f8640 1 --2- 172.21.15.37:0/2602695968 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf0c0fc330 0x7fbf0c10d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:11.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.320+0000 7fbf11ef9640 1 -- 172.21.15.37:0/2602695968 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf0c0fc330 msgr2=0x7fbf0c10d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:11.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.320+0000 7fbf11ef9640 1 --2- 172.21.15.37:0/2602695968 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf0c0fc330 0x7fbf0c10d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:11.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.320+0000 7fbf11ef9640 1 -- 172.21.15.37:0/2602695968 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbefc005040 con 0x7fbf0c0fb060 2024-04-25T17:16:11.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.320+0000 7fbf11ef9640 1 --2- 172.21.15.37:0/2602695968 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf0c0fb060 0x7fbf0c10cc90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fbf08002a50 tx=0x7fbf08004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:16:11.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.320+0000 7fbf027fc640 1 -- 172.21.15.37:0/2602695968 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf08007c30 con 0x7fbf0c0fb060 2024-04-25T17:16:11.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.320+0000 7fbf027fc640 1 -- 172.21.15.37:0/2602695968 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbf0800f040 con 0x7fbf0c0fb060 2024-04-25T17:16:11.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.320+0000 7fbf1415d640 1 -- 172.21.15.37:0/2602695968 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf0c112380 con 0x7fbf0c0fb060 2024-04-25T17:16:11.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.320+0000 7fbf027fc640 1 -- 172.21.15.37:0/2602695968 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf0800db50 con 0x7fbf0c0fb060 2024-04-25T17:16:11.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.320+0000 7fbf1415d640 1 -- 172.21.15.37:0/2602695968 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf0c112850 con 0x7fbf0c0fb060 2024-04-25T17:16:11.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.321+0000 7fbf1415d640 1 -- 172.21.15.37:0/2602695968 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf0c04bcc0 con 0x7fbf0c0fb060 2024-04-25T17:16:11.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.322+0000 7fbf027fc640 1 -- 172.21.15.37:0/2602695968 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fbf0801c400 con 0x7fbf0c0fb060 2024-04-25T17:16:11.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.322+0000 7fbf027fc640 1 --2- 172.21.15.37:0/2602695968 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fbef8069210 0x7fbef806b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:11.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.322+0000 7fbf027fc640 1 -- 172.21.15.37:0/2602695968 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fbf08086ad0 con 0x7fbf0c0fb060 2024-04-25T17:16:11.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.322+0000 7fbf116f8640 1 --2- 172.21.15.37:0/2602695968 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fbef8069210 0x7fbef806b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:11.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.323+0000 7fbf116f8640 1 --2- 172.21.15.37:0/2602695968 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fbef8069210 0x7fbef806b6c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbefc0317e0 tx=0x7fbefc009da0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:16:11.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.326+0000 7fbf027fc640 1 -- 172.21.15.37:0/2602695968 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fbf0804d250 con 0x7fbf0c0fb060 2024-04-25T17:16:11.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.500+0000 7fbf1415d640 1 -- 172.21.15.37:0/2602695968 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7fbf0c103bd0 con 0x7fbf0c0fb060 2024-04-25T17:16:11.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.500+0000 7fbf027fc640 1 -- 172.21.15.37:0/2602695968 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v46) v1 ==== 107+0+11 (secure 0 0 0) 0x7fbf08052d80 con 0x7fbf0c0fb060 2024-04-25T17:16:11.500 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2024-04-25T17:16:11.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.502+0000 7fbf1415d640 1 -- 172.21.15.37:0/2602695968 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fbef8069210 msgr2=0x7fbef806b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:11.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.502+0000 7fbf1415d640 1 --2- 172.21.15.37:0/2602695968 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fbef8069210 0x7fbef806b6c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbefc0317e0 tx=0x7fbefc009da0 comp rx=0 tx=0).stop 2024-04-25T17:16:11.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.502+0000 7fbf1415d640 1 -- 172.21.15.37:0/2602695968 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf0c0fb060 msgr2=0x7fbf0c10cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:11.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.502+0000 7fbf1415d640 1 --2- 172.21.15.37:0/2602695968 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf0c0fb060 0x7fbf0c10cc90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fbf08002a50 tx=0x7fbf08004600 comp rx=0 tx=0).stop 2024-04-25T17:16:11.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.502+0000 7fbf1415d640 1 -- 172.21.15.37:0/2602695968 shutdown_connections 2024-04-25T17:16:11.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.502+0000 7fbf1415d640 1 --2- 172.21.15.37:0/2602695968 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fbef8069210 0x7fbef806b6c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:11.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.502+0000 7fbf1415d640 1 --2- 172.21.15.37:0/2602695968 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf0c0fc330 0x7fbf0c10d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:11.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.502+0000 7fbf1415d640 1 --2- 172.21.15.37:0/2602695968 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf0c0fb060 0x7fbf0c10cc90 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:11.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.502+0000 7fbf1415d640 1 -- 172.21.15.37:0/2602695968 >> 172.21.15.37:0/2602695968 conn(0x7fbf0c0f6820 msgr2=0x7fbf0c064350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:16:11.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.502+0000 7fbf1415d640 1 -- 172.21.15.37:0/2602695968 shutdown_connections 2024-04-25T17:16:11.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.502+0000 7fbf1415d640 1 -- 172.21.15.37:0/2602695968 wait complete. 2024-04-25T17:16:11.513 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-04-25T17:16:11.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.613+0000 7f341a59d640 1 -- 172.21.15.37:0/736113243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34140fc320 msgr2=0x7f34140fc790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:11.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.613+0000 7f341a59d640 1 --2- 172.21.15.37:0/736113243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34140fc320 0x7f34140fc790 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f34080048d0 tx=0x7f3408009da0 comp rx=0 tx=0).stop 2024-04-25T17:16:11.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.613+0000 7f341a59d640 1 -- 172.21.15.37:0/736113243 shutdown_connections 2024-04-25T17:16:11.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.613+0000 7f341a59d640 1 --2- 172.21.15.37:0/736113243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34140fc320 0x7f34140fc790 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:11.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.613+0000 7f341a59d640 1 --2- 172.21.15.37:0/736113243 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34140fb0f0 0x7f34140fb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:11.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.613+0000 7f341a59d640 1 -- 172.21.15.37:0/736113243 >> 172.21.15.37:0/736113243 conn(0x7f34140f6830 msgr2=0x7f34140f8c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:16:11.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.613+0000 7f341a59d640 1 -- 172.21.15.37:0/736113243 shutdown_connections 2024-04-25T17:16:11.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.613+0000 7f341a59d640 1 -- 172.21.15.37:0/736113243 wait complete. 2024-04-25T17:16:11.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.614+0000 7f341a59d640 1 Processor -- start 2024-04-25T17:16:11.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.614+0000 7f341a59d640 1 -- start start 2024-04-25T17:16:11.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.614+0000 7f341a59d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34140fb0f0 0x7f341410cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:11.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.614+0000 7f341a59d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34140fc320 0x7f341410d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:11.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.614+0000 7f341a59d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f341410d850 con 0x7f34140fb0f0 2024-04-25T17:16:11.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.614+0000 7f341a59d640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3414112210 con 0x7f34140fc320 2024-04-25T17:16:11.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.614+0000 7f3413fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34140fb0f0 0x7f341410cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:11.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.614+0000 7f3413fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34140fb0f0 0x7f341410cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52886/0 (socket says 172.21.15.37:52886) 2024-04-25T17:16:11.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.614+0000 7f3413fff640 1 -- 172.21.15.37:0/2896335117 learned_addr learned my addr 172.21.15.37:0/2896335117 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:16:11.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.614+0000 7f34137fe640 1 --2- 172.21.15.37:0/2896335117 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34140fc320 0x7f341410d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:11.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.614+0000 7f3413fff640 1 -- 172.21.15.37:0/2896335117 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34140fc320 msgr2=0x7f341410d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:11.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.614+0000 7f3413fff640 1 --2- 172.21.15.37:0/2896335117 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34140fc320 0x7f341410d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:11.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.614+0000 7f3413fff640 1 -- 172.21.15.37:0/2896335117 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3408005040 con 0x7f34140fb0f0 2024-04-25T17:16:11.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.614+0000 7f34137fe640 1 --2- 172.21.15.37:0/2896335117 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34140fc320 0x7f341410d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T17:16:11.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.615+0000 7f3413fff640 1 --2- 172.21.15.37:0/2896335117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34140fb0f0 0x7f341410cc90 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3404002870 tx=0x7f3404004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:16:11.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.615+0000 7f3410ff9640 1 -- 172.21.15.37:0/2896335117 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3404007c30 con 0x7f34140fb0f0 2024-04-25T17:16:11.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.615+0000 7f341a59d640 1 -- 172.21.15.37:0/2896335117 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34141123b0 con 0x7f34140fb0f0 2024-04-25T17:16:11.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.615+0000 7f3410ff9640 1 -- 172.21.15.37:0/2896335117 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f340400f040 con 0x7f34140fb0f0 2024-04-25T17:16:11.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.615+0000 7f3410ff9640 1 -- 172.21.15.37:0/2896335117 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34040094c0 con 0x7f34140fb0f0 2024-04-25T17:16:11.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.615+0000 7f341a59d640 1 -- 172.21.15.37:0/2896335117 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34141128a0 con 0x7f34140fb0f0 2024-04-25T17:16:11.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.616+0000 7f341a59d640 1 -- 172.21.15.37:0/2896335117 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f341404bcc0 con 0x7f34140fb0f0 2024-04-25T17:16:11.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.616+0000 7f3410ff9640 1 -- 172.21.15.37:0/2896335117 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f34040097c0 con 0x7f34140fb0f0 2024-04-25T17:16:11.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.617+0000 7f3410ff9640 1 --2- 172.21.15.37:0/2896335117 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f33fc069210 0x7f33fc06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:11.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.617+0000 7f3410ff9640 1 -- 172.21.15.37:0/2896335117 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f3404087170 con 0x7f34140fb0f0 2024-04-25T17:16:11.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.617+0000 7f34137fe640 1 --2- 172.21.15.37:0/2896335117 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f33fc069210 0x7f33fc06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:11.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.617+0000 7f34137fe640 1 --2- 172.21.15.37:0/2896335117 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f33fc069210 0x7f33fc06b6c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f341410e180 tx=0x7f3408009da0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:16:11.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.621+0000 7f3410ff9640 1 -- 172.21.15.37:0/2896335117 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f3404053380 con 0x7f34140fb0f0 2024-04-25T17:16:11.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.796+0000 7f341a59d640 1 -- 172.21.15.37:0/2896335117 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f3414103bf0 con 0x7f34140fb0f0 2024-04-25T17:16:11.796 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.796+0000 7f3410ff9640 1 -- 172.21.15.37:0/2896335117 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v46) v1 ==== 107+0+11 (secure 0 0 0) 0x7f34040569a0 con 0x7f34140fb0f0 2024-04-25T17:16:11.797 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2024-04-25T17:16:11.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.798+0000 7f341a59d640 1 -- 172.21.15.37:0/2896335117 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f33fc069210 msgr2=0x7f33fc06b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:11.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.798+0000 7f341a59d640 1 --2- 172.21.15.37:0/2896335117 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f33fc069210 0x7f33fc06b6c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f341410e180 tx=0x7f3408009da0 comp rx=0 tx=0).stop 2024-04-25T17:16:11.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.798+0000 7f341a59d640 1 -- 172.21.15.37:0/2896335117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34140fb0f0 msgr2=0x7f341410cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:11.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.798+0000 7f341a59d640 1 --2- 172.21.15.37:0/2896335117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34140fb0f0 0x7f341410cc90 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3404002870 tx=0x7f3404004570 comp rx=0 tx=0).stop 2024-04-25T17:16:11.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.798+0000 7f341a59d640 1 -- 172.21.15.37:0/2896335117 shutdown_connections 2024-04-25T17:16:11.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.798+0000 7f341a59d640 1 --2- 172.21.15.37:0/2896335117 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f33fc069210 0x7f33fc06b6c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:11.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.798+0000 7f341a59d640 1 --2- 172.21.15.37:0/2896335117 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34140fc320 0x7f341410d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:11.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.798+0000 7f341a59d640 1 --2- 172.21.15.37:0/2896335117 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34140fb0f0 0x7f341410cc90 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:11.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.798+0000 7f341a59d640 1 -- 172.21.15.37:0/2896335117 >> 172.21.15.37:0/2896335117 conn(0x7f34140f6830 msgr2=0x7f34140655a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:16:11.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.798+0000 7f341a59d640 1 -- 172.21.15.37:0/2896335117 shutdown_connections 2024-04-25T17:16:11.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.798+0000 7f341a59d640 1 -- 172.21.15.37:0/2896335117 wait complete. 2024-04-25T17:16:11.809 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T17:16:11.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.907+0000 7fa61746e640 1 -- 172.21.15.37:0/2233142795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6100fe1d0 msgr2=0x7fa6100fa330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:11.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.907+0000 7fa61746e640 1 --2- 172.21.15.37:0/2233142795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6100fe1d0 0x7fa6100fa330 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa6000048d0 tx=0x7fa600009da0 comp rx=0 tx=0).stop 2024-04-25T17:16:11.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.907+0000 7fa61746e640 1 -- 172.21.15.37:0/2233142795 shutdown_connections 2024-04-25T17:16:11.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.907+0000 7fa61746e640 1 --2- 172.21.15.37:0/2233142795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6100fe1d0 0x7fa6100fa330 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:11.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.907+0000 7fa61746e640 1 --2- 172.21.15.37:0/2233142795 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6100fd880 0x7fa6100fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:11.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.907+0000 7fa61746e640 1 -- 172.21.15.37:0/2233142795 >> 172.21.15.37:0/2233142795 conn(0x7fa6100f5fc0 msgr2=0x7fa6100f83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:16:11.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.907+0000 7fa61746e640 1 -- 172.21.15.37:0/2233142795 shutdown_connections 2024-04-25T17:16:11.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.907+0000 7fa61746e640 1 -- 172.21.15.37:0/2233142795 wait complete. 2024-04-25T17:16:11.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.907+0000 7fa61746e640 1 Processor -- start 2024-04-25T17:16:11.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.907+0000 7fa61746e640 1 -- start start 2024-04-25T17:16:11.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.907+0000 7fa61746e640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6100fd880 0x7fa61010cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:11.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.907+0000 7fa61746e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6100fe1d0 0x7fa61010d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:11.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.907+0000 7fa61746e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa61010d860 con 0x7fa6100fe1d0 2024-04-25T17:16:11.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.907+0000 7fa61746e640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa610112220 con 0x7fa6100fd880 2024-04-25T17:16:11.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.908+0000 7fa614a09640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6100fe1d0 0x7fa61010d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:11.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.908+0000 7fa614a09640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6100fe1d0 0x7fa61010d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52906/0 (socket says 172.21.15.37:52906) 2024-04-25T17:16:11.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.908+0000 7fa614a09640 1 -- 172.21.15.37:0/3842733459 learned_addr learned my addr 172.21.15.37:0/3842733459 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:16:11.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.908+0000 7fa61520a640 1 --2- 172.21.15.37:0/3842733459 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6100fd880 0x7fa61010cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:11.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.908+0000 7fa614a09640 1 -- 172.21.15.37:0/3842733459 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6100fd880 msgr2=0x7fa61010cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:11.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.908+0000 7fa614a09640 1 --2- 172.21.15.37:0/3842733459 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6100fd880 0x7fa61010cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:11.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.908+0000 7fa614a09640 1 -- 172.21.15.37:0/3842733459 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa600005040 con 0x7fa6100fe1d0 2024-04-25T17:16:11.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.908+0000 7fa614a09640 1 --2- 172.21.15.37:0/3842733459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6100fe1d0 0x7fa61010d1e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa600007da0 tx=0x7fa600009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:16:11.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.908+0000 7fa605ffb640 1 -- 172.21.15.37:0/3842733459 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6000094c0 con 0x7fa6100fe1d0 2024-04-25T17:16:11.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.908+0000 7fa61746e640 1 -- 172.21.15.37:0/3842733459 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa610112360 con 0x7fa6100fe1d0 2024-04-25T17:16:11.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.908+0000 7fa605ffb640 1 -- 172.21.15.37:0/3842733459 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa600009620 con 0x7fa6100fe1d0 2024-04-25T17:16:11.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.908+0000 7fa605ffb640 1 -- 172.21.15.37:0/3842733459 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa60003b640 con 0x7fa6100fe1d0 2024-04-25T17:16:11.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.908+0000 7fa61746e640 1 -- 172.21.15.37:0/3842733459 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa610112850 con 0x7fa6100fe1d0 2024-04-25T17:16:11.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.909+0000 7fa61746e640 1 -- 172.21.15.37:0/3842733459 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa61004bcc0 con 0x7fa6100fe1d0 2024-04-25T17:16:11.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.910+0000 7fa605ffb640 1 -- 172.21.15.37:0/3842733459 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fa60002f070 con 0x7fa6100fe1d0 2024-04-25T17:16:11.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.910+0000 7fa605ffb640 1 --2- 172.21.15.37:0/3842733459 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fa5fc069210 0x7fa5fc06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:11.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.910+0000 7fa605ffb640 1 -- 172.21.15.37:0/3842733459 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fa6000a9760 con 0x7fa6100fe1d0 2024-04-25T17:16:11.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.910+0000 7fa61520a640 1 --2- 172.21.15.37:0/3842733459 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fa5fc069210 0x7fa5fc06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:11.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.911+0000 7fa61520a640 1 --2- 172.21.15.37:0/3842733459 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fa5fc069210 0x7fa5fc06b6c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa60c009af0 tx=0x7fa60c00b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:16:11.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:11.915+0000 7fa605ffb640 1 -- 172.21.15.37:0/3842733459 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fa600075a10 con 0x7fa6100fe1d0 2024-04-25T17:16:12.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:11 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/1983906091' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T17:16:12.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:11 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/2207539063' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T17:16:12.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:11 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/2602695968' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-25T17:16:12.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:12.126+0000 7fa61746e640 1 -- 172.21.15.37:0/3842733459 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa610104d00 con 0x7fa6100fe1d0 2024-04-25T17:16:12.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:12.127+0000 7fa605ffb640 1 -- 172.21.15.37:0/3842733459 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4688 (secure 0 0 0) 0x7fa600079030 con 0x7fa6100fe1d0 2024-04-25T17:16:12.127 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:16:12.127 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24289,"name":"cephfs.smithi069.cpprst","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.69:6827/518856100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":518856100},{"type":"v1","addr":"172.21.15.69:6827","nonce":518856100}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":24293,"name":"cephfs.smithi069.ytlqcf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6825/134210439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":134210439},{"type":"v1","addr":"172.21.15.69:6825","nonce":134210439}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":16,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T17:15:40.586130+0000","modified":"2024-04-25T17:15:57.508740+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14470":{"gid":14470,"name":"cephfs.smithi037.ksmixc","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.37:6827/1903989494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1903989494},{"type":"v1","addr":"172.21.15.37:6827","nonce":1903989494}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14482":{"gid":14482,"name":"cephfs.smithi037.ovkrpq","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.37:6829/4206394422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":4206394422},{"type":"v1","addr":"172.21.15.37:6829","nonce":4206394422}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-04-25T17:16:12.127 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 16 2024-04-25T17:16:12.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:12.128+0000 7fa61746e640 1 -- 172.21.15.37:0/3842733459 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fa5fc069210 msgr2=0x7fa5fc06b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:12.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:12.128+0000 7fa61746e640 1 --2- 172.21.15.37:0/3842733459 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fa5fc069210 0x7fa5fc06b6c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa60c009af0 tx=0x7fa60c00b040 comp rx=0 tx=0).stop 2024-04-25T17:16:12.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:12.128+0000 7fa61746e640 1 -- 172.21.15.37:0/3842733459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6100fe1d0 msgr2=0x7fa61010d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:12.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:12.128+0000 7fa61746e640 1 --2- 172.21.15.37:0/3842733459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6100fe1d0 0x7fa61010d1e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa600007da0 tx=0x7fa600009da0 comp rx=0 tx=0).stop 2024-04-25T17:16:12.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:12.129+0000 7fa61746e640 1 -- 172.21.15.37:0/3842733459 shutdown_connections 2024-04-25T17:16:12.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:12.129+0000 7fa61746e640 1 --2- 172.21.15.37:0/3842733459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6100fe1d0 0x7fa61010d1e0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:12.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:12.129+0000 7fa61746e640 1 --2- 172.21.15.37:0/3842733459 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fa5fc069210 0x7fa5fc06b6c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:12.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:12.129+0000 7fa61746e640 1 --2- 172.21.15.37:0/3842733459 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6100fd880 0x7fa61010cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:12.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:12.129+0000 7fa61746e640 1 -- 172.21.15.37:0/3842733459 >> 172.21.15.37:0/3842733459 conn(0x7fa6100f5fc0 msgr2=0x7fa6100f7680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:16:12.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:12.129+0000 7fa61746e640 1 -- 172.21.15.37:0/3842733459 shutdown_connections 2024-04-25T17:16:12.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:12.129+0000 7fa61746e640 1 -- 172.21.15.37:0/3842733459 wait complete. 2024-04-25T17:16:12.140 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 16, 'max_mds': 1, 'flags': 50} 2024-04-25T17:16:12.140 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-25T17:16:12.169 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-25T17:16:12.169 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2024-04-25T17:16:12.169 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-25T17:16:12.169 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T17:16:12.169 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T17:16:12.169 INFO:tasks.ceph_fuse:client.1 config is {} 2024-04-25T17:16:12.169 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T17:16:12.169 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-25T17:16:12.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T17:16:12.170 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-04-25T17:16:12.170 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:11 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/1983906091' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T17:16:12.170 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:11 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/2207539063' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T17:16:12.170 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:11 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/2602695968' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-25T17:16:12.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T17:16:12.185 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link delete ceph-brx 2024-04-25T17:16:12.252 INFO:teuthology.orchestra.run.smithi037.stderr:Cannot find device "ceph-brx" 2024-04-25T17:16:12.253 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T17:16:12.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T17:16:12.253 DEBUG:teuthology.orchestra.run.smithi069:> ip netns list 2024-04-25T17:16:12.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T17:16:12.273 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link delete ceph-brx 2024-04-25T17:16:12.346 INFO:teuthology.orchestra.run.smithi069.stderr:Cannot find device "ceph-brx" 2024-04-25T17:16:12.347 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T17:16:12.348 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-25T17:16:12.348 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph fs ls 2024-04-25T17:16:12.613 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:16:13.066 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:12 smithi037 ceph-mon[26472]: pgmap v192: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:16:13.067 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:12 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/2896335117' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-25T17:16:13.067 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:12 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/3842733459' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T17:16:13.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:12 smithi069 ceph-mon[34527]: pgmap v192: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:16:13.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:12 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/2896335117' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-25T17:16:13.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:12 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/3842733459' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T17:16:13.985 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:13 smithi037 ceph-mon[26472]: pgmap v193: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:16:14.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:13 smithi069 ceph-mon[34527]: pgmap v193: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:16:14.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:14.225+0000 7fc83fc63700 1 -- 172.21.15.37:0/825548785 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8381026b0 msgr2=0x7fc8380fbd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:14.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:14.225+0000 7fc83fc63700 1 --2- 172.21.15.37:0/825548785 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8381026b0 0x7fc8380fbd20 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc828004940 tx=0x7fc828009e30 comp rx=0 tx=0).stop 2024-04-25T17:16:14.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:14.225+0000 7fc83fc63700 1 -- 172.21.15.37:0/825548785 shutdown_connections 2024-04-25T17:16:14.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:14.225+0000 7fc83fc63700 1 --2- 172.21.15.37:0/825548785 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8381026b0 0x7fc8380fbd20 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:14.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:14.225+0000 7fc83fc63700 1 --2- 172.21.15.37:0/825548785 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc838101d10 0x7fc8381020e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:14.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:14.225+0000 7fc83fc63700 1 -- 172.21.15.37:0/825548785 >> 172.21.15.37:0/825548785 conn(0x7fc8380f7860 msgr2=0x7fc8380f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:16:14.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:14.225+0000 7fc83fc63700 1 -- 172.21.15.37:0/825548785 shutdown_connections 2024-04-25T17:16:14.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:14.225+0000 7fc83fc63700 1 -- 172.21.15.37:0/825548785 wait complete. 2024-04-25T17:16:14.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:14.225+0000 7fc83fc63700 1 Processor -- start 2024-04-25T17:16:14.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:14.226+0000 7fc83fc63700 1 -- start start 2024-04-25T17:16:14.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:14.226+0000 7fc83fc63700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc838101d10 0x7fc8380fd990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:14.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:14.226+0000 7fc83fc63700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8381026b0 0x7fc8380fded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:14.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:14.226+0000 7fc83fc63700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8380ff890 con 0x7fc838101d10 2024-04-25T17:16:14.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:14.226+0000 7fc83fc63700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8380fe410 con 0x7fc8381026b0 2024-04-25T17:16:14.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:14.226+0000 7fc83d9ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc838101d10 0x7fc8380fd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:14.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:14.226+0000 7fc83d9ff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc838101d10 0x7fc8380fd990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52932/0 (socket says 172.21.15.37:52932) 2024-04-25T17:16:14.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:14.226+0000 7fc83d9ff700 1 -- 172.21.15.37:0/4127544944 learned_addr learned my addr 172.21.15.37:0/4127544944 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:16:14.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:14.226+0000 7fc83d1fe700 1 --2- 172.21.15.37:0/4127544944 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8381026b0 0x7fc8380fded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:14.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:14.226+0000 7fc83d9ff700 1 -- 172.21.15.37:0/4127544944 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8381026b0 msgr2=0x7fc8380fded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:14.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:14.226+0000 7fc83d9ff700 1 --2- 172.21.15.37:0/4127544944 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8381026b0 0x7fc8380fded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:14.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:14.226+0000 7fc83d9ff700 1 -- 172.21.15.37:0/4127544944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc828005040 con 0x7fc838101d10 2024-04-25T17:16:14.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:14.226+0000 7fc83d9ff700 1 --2- 172.21.15.37:0/4127544944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc838101d10 0x7fc8380fd990 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc83400c810 tx=0x7fc834004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:16:14.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:14.227+0000 7fc82e7fc700 1 -- 172.21.15.37:0/4127544944 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc834012810 con 0x7fc838101d10 2024-04-25T17:16:14.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:14.227+0000 7fc83fc63700 1 -- 172.21.15.37:0/4127544944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8380fe6f0 con 0x7fc838101d10 2024-04-25T17:16:14.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:14.227+0000 7fc82e7fc700 1 -- 172.21.15.37:0/4127544944 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc834012e40 con 0x7fc838101d10 2024-04-25T17:16:14.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:14.227+0000 7fc82e7fc700 1 -- 172.21.15.37:0/4127544944 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8340102e0 con 0x7fc838101d10 2024-04-25T17:16:14.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:14.227+0000 7fc83fc63700 1 -- 172.21.15.37:0/4127544944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc83811a1a0 con 0x7fc838101d10 2024-04-25T17:16:14.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:14.228+0000 7fc83fc63700 1 -- 172.21.15.37:0/4127544944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8380fd460 con 0x7fc838101d10 2024-04-25T17:16:14.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:14.228+0000 7fc82e7fc700 1 -- 172.21.15.37:0/4127544944 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fc834011380 con 0x7fc838101d10 2024-04-25T17:16:14.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:14.229+0000 7fc82e7fc700 1 --2- 172.21.15.37:0/4127544944 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fc8240692a0 0x7fc82406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:14.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:14.229+0000 7fc82e7fc700 1 -- 172.21.15.37:0/4127544944 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fc8340875a0 con 0x7fc838101d10 2024-04-25T17:16:14.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:14.229+0000 7fc83d1fe700 1 --2- 172.21.15.37:0/4127544944 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fc8240692a0 0x7fc82406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:14.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:14.229+0000 7fc83d1fe700 1 --2- 172.21.15.37:0/4127544944 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fc8240692a0 0x7fc82406b750 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc828004890 tx=0x7fc828009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:16:14.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:14.233+0000 7fc82e7fc700 1 -- 172.21.15.37:0/4127544944 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fc834053850 con 0x7fc838101d10 2024-04-25T17:16:14.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:14.475+0000 7fc83fc63700 1 -- 172.21.15.37:0/4127544944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc8380feeb0 con 0x7fc838101d10 2024-04-25T17:16:14.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:14.475+0000 7fc82e7fc700 1 -- 172.21.15.37:0/4127544944 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+83 (secure 0 0 0) 0x7fc834011630 con 0x7fc838101d10 2024-04-25T17:16:14.476 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-04-25T17:16:14.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:14.477+0000 7fc83fc63700 1 -- 172.21.15.37:0/4127544944 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fc8240692a0 msgr2=0x7fc82406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:14.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:14.477+0000 7fc83fc63700 1 --2- 172.21.15.37:0/4127544944 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fc8240692a0 0x7fc82406b750 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc828004890 tx=0x7fc828009e30 comp rx=0 tx=0).stop 2024-04-25T17:16:14.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:14.477+0000 7fc83fc63700 1 -- 172.21.15.37:0/4127544944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc838101d10 msgr2=0x7fc8380fd990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:14.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:14.477+0000 7fc83fc63700 1 --2- 172.21.15.37:0/4127544944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc838101d10 0x7fc8380fd990 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc83400c810 tx=0x7fc834004470 comp rx=0 tx=0).stop 2024-04-25T17:16:14.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:14.478+0000 7fc83fc63700 1 -- 172.21.15.37:0/4127544944 shutdown_connections 2024-04-25T17:16:14.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:14.478+0000 7fc83fc63700 1 --2- 172.21.15.37:0/4127544944 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fc8240692a0 0x7fc82406b750 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:14.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:14.478+0000 7fc83fc63700 1 --2- 172.21.15.37:0/4127544944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc838101d10 0x7fc8380fd990 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:14.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:14.478+0000 7fc83fc63700 1 --2- 172.21.15.37:0/4127544944 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8381026b0 0x7fc8380fded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:14.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:14.478+0000 7fc83fc63700 1 -- 172.21.15.37:0/4127544944 >> 172.21.15.37:0/4127544944 conn(0x7fc8380f7860 msgr2=0x7fc8380f8880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:16:14.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:14.478+0000 7fc83fc63700 1 -- 172.21.15.37:0/4127544944 shutdown_connections 2024-04-25T17:16:14.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:14.478+0000 7fc83fc63700 1 -- 172.21.15.37:0/4127544944 wait complete. 2024-04-25T17:16:15.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:14 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/4127544944' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-25T17:16:15.235 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:14 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/4127544944' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-25T17:16:15.266 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T17:16:15.266 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T17:16:15.266 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2024-04-25T17:16:15.266 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T17:16:15.266 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T17:16:15.266 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T17:16:15.266 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T17:16:15.266 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T17:16:15.266 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T17:16:15.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T17:16:15.267 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2024-04-25T17:16:15.286 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T17:16:15.286 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T17:16:15.286 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T17:16:15.286 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-04-25T17:16:15.286 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2024-04-25T17:16:15.287 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-04-25T17:16:15.287 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T17:16:15.287 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2024-04-25T17:16:15.287 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2024-04-25T17:16:15.287 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T17:16:15.287 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2024-04-25T17:16:15.287 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2024-04-25T17:16:15.287 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T17:16:15.287 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2024-04-25T17:16:15.287 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2024-04-25T17:16:15.287 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-25T17:16:15.287 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42261sec preferred_lft 42261sec 2024-04-25T17:16:15.288 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link noprefixroute 2024-04-25T17:16:15.288 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2024-04-25T17:16:15.288 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T17:16:15.288 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2024-04-25T17:16:15.288 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2024-04-25T17:16:15.288 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T17:16:15.289 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T17:16:15.289 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-04-25T17:16:15.289 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add name ceph-brx type bridge 2024-04-25T17:16:15.289 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip addr flush dev ceph-brx 2024-04-25T17:16:15.289 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set ceph-brx up 2024-04-25T17:16:15.289 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T17:16:15.289 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-04-25T17:16:15.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T17:16:15.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T17:16:15.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T17:16:15.476 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T17:16:15.501 INFO:teuthology.orchestra.run.smithi037.stdout:1 2024-04-25T17:16:15.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T17:16:15.504 DEBUG:teuthology.orchestra.run.smithi037:> route 2024-04-25T17:16:15.580 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2024-04-25T17:16:15.580 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T17:16:15.581 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-25T17:16:15.581 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-25T17:16:15.581 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T17:16:15.581 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T17:16:15.581 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-04-25T17:16:15.581 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T17:16:15.581 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T17:16:15.581 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T17:16:15.582 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-04-25T17:16:15.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T17:16:15.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T17:16:15.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T17:16:15.875 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2024-04-25T17:16:15.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T17:16:15.890 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list-id 2024-04-25T17:16:15.945 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T17:16:15.945 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-04-25T17:16:15.945 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T17:16:15.945 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-25T17:16:15.945 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-04-25T17:16:16.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T17:16:16.043 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:15 smithi037 ceph-mon[26472]: pgmap v194: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:16:16.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T17:16:16.063 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-25T17:16:16.063 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T17:16:16.063 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-04-25T17:16:16.063 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-25T17:16:16.064 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T17:16:16.064 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-25T17:16:16.064 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-25T17:16:16.064 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-25T17:16:16.064 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-04-25T17:16:16.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T17:16:16.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:15 smithi069 ceph-mon[34527]: pgmap v194: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:16:16.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T17:16:16.188 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T17:16:16.188 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2024-04-25T17:16:16.188 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2024-04-25T17:16:16.188 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T17:16:16.188 DEBUG:teuthology.orchestra.run.smithi037:> ') 2024-04-25T17:16:16.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:16 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T17:16:16.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T17:16:16.266 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-25T17:16:16.266 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T17:16:16.266 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T17:16:16.281 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T17:16:16.281 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T17:16:16.281 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T17:16:16.336 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2024-04-25T17:16:16.401 DEBUG:teuthology.orchestra.run.smithi037:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T17:16:16.458 INFO:teuthology.orchestra.run.smithi037.stdout:/proc 2024-04-25T17:16:16.458 INFO:teuthology.orchestra.run.smithi037.stdout:/sys 2024-04-25T17:16:16.458 INFO:teuthology.orchestra.run.smithi037.stdout:/dev 2024-04-25T17:16:16.458 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/security 2024-04-25T17:16:16.458 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/shm 2024-04-25T17:16:16.458 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/pts 2024-04-25T17:16:16.459 INFO:teuthology.orchestra.run.smithi037.stdout:/run 2024-04-25T17:16:16.459 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/cgroup 2024-04-25T17:16:16.459 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/pstore 2024-04-25T17:16:16.459 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/bpf 2024-04-25T17:16:16.459 INFO:teuthology.orchestra.run.smithi037.stdout:/ 2024-04-25T17:16:16.459 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/selinux 2024-04-25T17:16:16.459 INFO:teuthology.orchestra.run.smithi037.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T17:16:16.459 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/mqueue 2024-04-25T17:16:16.459 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/debug 2024-04-25T17:16:16.459 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/hugepages 2024-04-25T17:16:16.459 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/tracing 2024-04-25T17:16:16.459 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T17:16:16.459 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/config 2024-04-25T17:16:16.459 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/fuse/connections 2024-04-25T17:16:16.459 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-sysctl.service 2024-04-25T17:16:16.459 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-25T17:16:16.460 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-25T17:16:16.460 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/nfs/rpc_pipefs 2024-04-25T17:16:16.460 INFO:teuthology.orchestra.run.smithi037.stdout:/run/user/1000 2024-04-25T17:16:16.460 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/ceph 2024-04-25T17:16:16.460 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay 2024-04-25T17:16:16.460 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/4b2701f055b3fad3d97ba21c3d560ed2e0f7f6eb4ebd6998f6160d9cb2f54497/merged 2024-04-25T17:16:16.460 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/d21a43c575163ebe09613589b9884741233b5a3612bf184a83d7dd4914d7f475/merged 2024-04-25T17:16:16.460 INFO:teuthology.orchestra.run.smithi037.stdout:/run/user/0 2024-04-25T17:16:16.460 INFO:teuthology.orchestra.run.smithi037.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T17:16:16.460 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/db312733c879efa71fa037b906dfb4c54e9cdc3c44f76d5e526d4bd26fec0303/merged 2024-04-25T17:16:16.460 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/99ddbec46213062687fbae4a3b99c07ec44867130e7eb35aa29931c7022338db/merged 2024-04-25T17:16:16.460 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/b7ea44b640cf34214dd93ab30b2ae97f0a8753cae257305b171794707e8d586b/merged 2024-04-25T17:16:16.460 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/b56e077d85b5bf600deced68e5faab4314e966d5dde6e2129a6218d9443d07e1/merged 2024-04-25T17:16:16.460 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/0ef1758d6e82ace2503223eea397212d3878c76c6f53bfea17f2ededd9e0bfe8/merged 2024-04-25T17:16:16.460 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/7f7bf805afb17f842590b9907a1f153d80ebc4b2b4e220f87f482ab13f2f6be1/merged 2024-04-25T17:16:16.460 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/773ae591183f6f6c6425caa99e8cf1d74e6994d981b0bfb17ca9db66a9288a14/merged 2024-04-25T17:16:16.461 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/6805e83dc4ab3c0cc04606425ca95d7be450f60ba91faa6e347e3d9e826f9317/merged 2024-04-25T17:16:16.461 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/f172b263c5fedd26f51b20a7621364b642aa719d68a4b33a6943e63d6e4472ab/merged 2024-04-25T17:16:16.461 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/4abd6b824d2ac1ae777d96bdb3870644cb14e50e8bd268de9a732ab78aadf119/merged 2024-04-25T17:16:16.461 INFO:teuthology.orchestra.run.smithi037.stdout:/run/netns 2024-04-25T17:16:16.461 INFO:teuthology.orchestra.run.smithi037.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T17:16:16.461 INFO:teuthology.orchestra.run.smithi037.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T17:16:16.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T17:16:16.461 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2024-04-25T17:16:16.513 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-25T17:16:16.513 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-25T17:16:16.556 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2024-04-25T17:16:16.580 DEBUG:teuthology.orchestra.run.smithi037:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T17:16:16.636 INFO:teuthology.orchestra.run.smithi037.stdout:/proc 2024-04-25T17:16:16.636 INFO:teuthology.orchestra.run.smithi037.stdout:/sys 2024-04-25T17:16:16.636 INFO:teuthology.orchestra.run.smithi037.stdout:/dev 2024-04-25T17:16:16.637 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/security 2024-04-25T17:16:16.637 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/shm 2024-04-25T17:16:16.637 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/pts 2024-04-25T17:16:16.637 INFO:teuthology.orchestra.run.smithi037.stdout:/run 2024-04-25T17:16:16.637 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/cgroup 2024-04-25T17:16:16.638 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/pstore 2024-04-25T17:16:16.638 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/bpf 2024-04-25T17:16:16.638 INFO:teuthology.orchestra.run.smithi037.stdout:/ 2024-04-25T17:16:16.638 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/selinux 2024-04-25T17:16:16.638 INFO:teuthology.orchestra.run.smithi037.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T17:16:16.638 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/mqueue 2024-04-25T17:16:16.639 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/debug 2024-04-25T17:16:16.639 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/hugepages 2024-04-25T17:16:16.639 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/tracing 2024-04-25T17:16:16.639 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T17:16:16.639 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/config 2024-04-25T17:16:16.640 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/fuse/connections 2024-04-25T17:16:16.640 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-sysctl.service 2024-04-25T17:16:16.640 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-25T17:16:16.640 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-25T17:16:16.640 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/nfs/rpc_pipefs 2024-04-25T17:16:16.640 INFO:teuthology.orchestra.run.smithi037.stdout:/run/user/1000 2024-04-25T17:16:16.641 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/ceph 2024-04-25T17:16:16.641 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay 2024-04-25T17:16:16.641 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/4b2701f055b3fad3d97ba21c3d560ed2e0f7f6eb4ebd6998f6160d9cb2f54497/merged 2024-04-25T17:16:16.641 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/d21a43c575163ebe09613589b9884741233b5a3612bf184a83d7dd4914d7f475/merged 2024-04-25T17:16:16.641 INFO:teuthology.orchestra.run.smithi037.stdout:/run/user/0 2024-04-25T17:16:16.641 INFO:teuthology.orchestra.run.smithi037.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T17:16:16.642 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/db312733c879efa71fa037b906dfb4c54e9cdc3c44f76d5e526d4bd26fec0303/merged 2024-04-25T17:16:16.642 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/99ddbec46213062687fbae4a3b99c07ec44867130e7eb35aa29931c7022338db/merged 2024-04-25T17:16:16.642 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/b7ea44b640cf34214dd93ab30b2ae97f0a8753cae257305b171794707e8d586b/merged 2024-04-25T17:16:16.642 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/b56e077d85b5bf600deced68e5faab4314e966d5dde6e2129a6218d9443d07e1/merged 2024-04-25T17:16:16.642 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/0ef1758d6e82ace2503223eea397212d3878c76c6f53bfea17f2ededd9e0bfe8/merged 2024-04-25T17:16:16.643 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/7f7bf805afb17f842590b9907a1f153d80ebc4b2b4e220f87f482ab13f2f6be1/merged 2024-04-25T17:16:16.643 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/773ae591183f6f6c6425caa99e8cf1d74e6994d981b0bfb17ca9db66a9288a14/merged 2024-04-25T17:16:16.643 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/6805e83dc4ab3c0cc04606425ca95d7be450f60ba91faa6e347e3d9e826f9317/merged 2024-04-25T17:16:16.643 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/f172b263c5fedd26f51b20a7621364b642aa719d68a4b33a6943e63d6e4472ab/merged 2024-04-25T17:16:16.643 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/containers/storage/overlay/4abd6b824d2ac1ae777d96bdb3870644cb14e50e8bd268de9a732ab78aadf119/merged 2024-04-25T17:16:16.643 INFO:teuthology.orchestra.run.smithi037.stdout:/run/netns 2024-04-25T17:16:16.643 INFO:teuthology.orchestra.run.smithi037.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T17:16:16.644 INFO:teuthology.orchestra.run.smithi037.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T17:16:16.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T17:16:16.644 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2024-04-25T17:16:16.645 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:2024-04-25T17:16:16.644+0000 7f72218ad300 -1 init, newargv = 0x557d6bc9e9b0 newargc=15 2024-04-25T17:16:16.646 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[73457]: starting ceph client 2024-04-25T17:16:16.650 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[73457]: starting fuse 2024-04-25T17:16:16.661 INFO:teuthology.orchestra.run.smithi037.stdout:145 2024-04-25T17:16:16.661 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [145] 2024-04-25T17:16:16.662 DEBUG:teuthology.orchestra.run.smithi037:> sudo stdin-killer -- python3 -c ' 2024-04-25T17:16:16.662 DEBUG:teuthology.orchestra.run.smithi037:> import glob 2024-04-25T17:16:16.662 DEBUG:teuthology.orchestra.run.smithi037:> import re 2024-04-25T17:16:16.662 DEBUG:teuthology.orchestra.run.smithi037:> import os 2024-04-25T17:16:16.662 DEBUG:teuthology.orchestra.run.smithi037:> import subprocess 2024-04-25T17:16:16.662 DEBUG:teuthology.orchestra.run.smithi037:> 2024-04-25T17:16:16.662 DEBUG:teuthology.orchestra.run.smithi037:> def _find_admin_socket(client_name): 2024-04-25T17:16:16.662 DEBUG:teuthology.orchestra.run.smithi037:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-25T17:16:16.662 DEBUG:teuthology.orchestra.run.smithi037:> files = glob.glob(asok_path) 2024-04-25T17:16:16.662 DEBUG:teuthology.orchestra.run.smithi037:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-25T17:16:16.662 DEBUG:teuthology.orchestra.run.smithi037:> 2024-04-25T17:16:16.662 DEBUG:teuthology.orchestra.run.smithi037:> # Given a non-glob path, it better be there 2024-04-25T17:16:16.663 DEBUG:teuthology.orchestra.run.smithi037:> if "*" not in asok_path: 2024-04-25T17:16:16.663 DEBUG:teuthology.orchestra.run.smithi037:> assert(len(files) == 1) 2024-04-25T17:16:16.663 DEBUG:teuthology.orchestra.run.smithi037:> return files[0] 2024-04-25T17:16:16.663 DEBUG:teuthology.orchestra.run.smithi037:> 2024-04-25T17:16:16.663 DEBUG:teuthology.orchestra.run.smithi037:> for f in files: 2024-04-25T17:16:16.663 DEBUG:teuthology.orchestra.run.smithi037:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-25T17:16:16.663 DEBUG:teuthology.orchestra.run.smithi037:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-25T17:16:16.663 DEBUG:teuthology.orchestra.run.smithi037:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-25T17:16:16.663 DEBUG:teuthology.orchestra.run.smithi037:> contents = proc_f.read() 2024-04-25T17:16:16.663 DEBUG:teuthology.orchestra.run.smithi037:> if mountpoint in contents: 2024-04-25T17:16:16.663 DEBUG:teuthology.orchestra.run.smithi037:> return f 2024-04-25T17:16:16.663 DEBUG:teuthology.orchestra.run.smithi037:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-25T17:16:16.663 DEBUG:teuthology.orchestra.run.smithi037:> 2024-04-25T17:16:16.664 DEBUG:teuthology.orchestra.run.smithi037:> print(_find_admin_socket("client.0")) 2024-04-25T17:16:16.664 DEBUG:teuthology.orchestra.run.smithi037:> ' 2024-04-25T17:16:16.782 INFO:teuthology.orchestra.run.smithi037.stdout:/var/run/ceph/ceph-client.0.73457.asok 2024-04-25T17:16:16.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T17:16:16.792 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.73457.asok 2024-04-25T17:16:16.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T17:16:16.793 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.73457.asok status 2024-04-25T17:16:16.925 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-25T17:16:16.925 INFO:teuthology.orchestra.run.smithi037.stdout: "metadata": { 2024-04-25T17:16:16.925 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_sha1": "c61472c83ce76869b0fe076c19ed2f4bcc3fb4af", 2024-04-25T17:16:16.925 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_version": "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)", 2024-04-25T17:16:16.925 INFO:teuthology.orchestra.run.smithi037.stdout: "entity_id": "0", 2024-04-25T17:16:16.925 INFO:teuthology.orchestra.run.smithi037.stdout: "hostname": "smithi037", 2024-04-25T17:16:16.925 INFO:teuthology.orchestra.run.smithi037.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-25T17:16:16.925 INFO:teuthology.orchestra.run.smithi037.stdout: "pid": "73457", 2024-04-25T17:16:16.925 INFO:teuthology.orchestra.run.smithi037.stdout: "root": "/" 2024-04-25T17:16:16.925 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:16:16.926 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_count": 0, 2024-04-25T17:16:16.926 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_pinned_count": 0, 2024-04-25T17:16:16.926 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 14538, 2024-04-25T17:16:16.926 INFO:teuthology.orchestra.run.smithi037.stdout: "inst": { 2024-04-25T17:16:16.926 INFO:teuthology.orchestra.run.smithi037.stdout: "name": { 2024-04-25T17:16:16.926 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "client", 2024-04-25T17:16:16.926 INFO:teuthology.orchestra.run.smithi037.stdout: "num": 14538 2024-04-25T17:16:16.926 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:16:16.926 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2024-04-25T17:16:16.926 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2024-04-25T17:16:16.926 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.1:0", 2024-04-25T17:16:16.926 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 2684522872 2024-04-25T17:16:16.926 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-04-25T17:16:16.927 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:16:16.927 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2024-04-25T17:16:16.927 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2024-04-25T17:16:16.927 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.1:0", 2024-04-25T17:16:16.927 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 2684522872 2024-04-25T17:16:16.927 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:16:16.927 INFO:teuthology.orchestra.run.smithi037.stdout: "inst_str": "client.14538 192.168.0.1:0/2684522872", 2024-04-25T17:16:16.927 INFO:teuthology.orchestra.run.smithi037.stdout: "addr_str": "192.168.0.1:0/2684522872", 2024-04-25T17:16:16.927 INFO:teuthology.orchestra.run.smithi037.stdout: "inode_count": 1, 2024-04-25T17:16:16.927 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_epoch": 16, 2024-04-25T17:16:16.927 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch": 46, 2024-04-25T17:16:16.927 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch_barrier": 0, 2024-04-25T17:16:16.927 INFO:teuthology.orchestra.run.smithi037.stdout: "blocklisted": false, 2024-04-25T17:16:16.927 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs" 2024-04-25T17:16:16.927 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-25T17:16:16.933 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- ceph fs ls 2024-04-25T17:16:17.199 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:16:18.617 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:18 smithi037 ceph-mon[26472]: pgmap v195: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:16:18.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:18.840+0000 7f6417191700 1 -- 172.21.15.37:0/443802423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6410102f60 msgr2=0x7f6410103330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:18.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:18.840+0000 7f6417191700 1 --2- 172.21.15.37:0/443802423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6410102f60 0x7f6410103330 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f63f8004940 tx=0x7f63f8009e30 comp rx=0 tx=0).stop 2024-04-25T17:16:18.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:18.840+0000 7f6417191700 1 -- 172.21.15.37:0/443802423 shutdown_connections 2024-04-25T17:16:18.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:18.840+0000 7f6417191700 1 --2- 172.21.15.37:0/443802423 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f64100fb520 0x7f64100fb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:18.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:18.840+0000 7f6417191700 1 --2- 172.21.15.37:0/443802423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6410102f60 0x7f6410103330 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:18.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:18.840+0000 7f6417191700 1 -- 172.21.15.37:0/443802423 >> 172.21.15.37:0/443802423 conn(0x7f64100714d0 msgr2=0x7f64100718d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:16:18.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:18.840+0000 7f6417191700 1 -- 172.21.15.37:0/443802423 shutdown_connections 2024-04-25T17:16:18.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:18.840+0000 7f6417191700 1 -- 172.21.15.37:0/443802423 wait complete. 2024-04-25T17:16:18.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:18.841+0000 7f6417191700 1 Processor -- start 2024-04-25T17:16:18.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:18.841+0000 7f6417191700 1 -- start start 2024-04-25T17:16:18.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:18.841+0000 7f6417191700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64100fb520 0x7f64101139a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:18.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:18.841+0000 7f6417191700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6410102f60 0x7f6410113ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:18.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:18.841+0000 7f6417191700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6410114530 con 0x7f64100fb520 2024-04-25T17:16:18.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:18.841+0000 7f6417191700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f641010db30 con 0x7f6410102f60 2024-04-25T17:16:18.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:18.841+0000 7f6414f2d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64100fb520 0x7f64101139a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:18.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:18.842+0000 7f6414f2d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64100fb520 0x7f64101139a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37094/0 (socket says 172.21.15.37:37094) 2024-04-25T17:16:18.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:18.842+0000 7f6414f2d700 1 -- 172.21.15.37:0/3850443501 learned_addr learned my addr 172.21.15.37:0/3850443501 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:16:18.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:18.842+0000 7f640ffff700 1 --2- 172.21.15.37:0/3850443501 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6410102f60 0x7f6410113ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:18.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:18.842+0000 7f6414f2d700 1 -- 172.21.15.37:0/3850443501 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6410102f60 msgr2=0x7f6410113ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:18.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:18.842+0000 7f6414f2d700 1 --2- 172.21.15.37:0/3850443501 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6410102f60 0x7f6410113ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:18.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:18.842+0000 7f6414f2d700 1 -- 172.21.15.37:0/3850443501 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f8005040 con 0x7f64100fb520 2024-04-25T17:16:18.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:18.842+0000 7f640ffff700 1 --2- 172.21.15.37:0/3850443501 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6410102f60 0x7f6410113ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T17:16:18.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:18.842+0000 7f6414f2d700 1 --2- 172.21.15.37:0/3850443501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64100fb520 0x7f64101139a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f63f800b3b0 tx=0x7f63f8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:16:18.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:18.842+0000 7f640d7fa700 1 -- 172.21.15.37:0/3850443501 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63f800e040 con 0x7f64100fb520 2024-04-25T17:16:18.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:18.842+0000 7f640d7fa700 1 -- 172.21.15.37:0/3850443501 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f63f800bbc0 con 0x7f64100fb520 2024-04-25T17:16:18.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:18.842+0000 7f6417191700 1 -- 172.21.15.37:0/3850443501 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f641010ddb0 con 0x7f64100fb520 2024-04-25T17:16:18.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:18.842+0000 7f640d7fa700 1 -- 172.21.15.37:0/3850443501 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63f801c3f0 con 0x7f64100fb520 2024-04-25T17:16:18.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:18.842+0000 7f6417191700 1 -- 172.21.15.37:0/3850443501 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f641010e2f0 con 0x7f64100fb520 2024-04-25T17:16:18.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:18.843+0000 7f6417191700 1 -- 172.21.15.37:0/3850443501 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6410100250 con 0x7f64100fb520 2024-04-25T17:16:18.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:18.844+0000 7f640d7fa700 1 -- 172.21.15.37:0/3850443501 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f63f800bd30 con 0x7f64100fb520 2024-04-25T17:16:18.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:18.844+0000 7f640d7fa700 1 --2- 172.21.15.37:0/3850443501 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f63fc0692a0 0x7f63fc06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:18.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:18.844+0000 7f640d7fa700 1 -- 172.21.15.37:0/3850443501 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f63f8088370 con 0x7f64100fb520 2024-04-25T17:16:18.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:18.844+0000 7f640ffff700 1 --2- 172.21.15.37:0/3850443501 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f63fc0692a0 0x7f63fc06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:18.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:18.845+0000 7f640ffff700 1 --2- 172.21.15.37:0/3850443501 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f63fc0692a0 0x7f63fc06b750 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6400007fd0 tx=0x7f6400009040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:16:18.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:18.849+0000 7f640d7fa700 1 -- 172.21.15.37:0/3850443501 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f63f80581e0 con 0x7f64100fb520 2024-04-25T17:16:18.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:18 smithi069 ceph-mon[34527]: pgmap v195: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:16:19.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:19.096+0000 7f6417191700 1 -- 172.21.15.37:0/3850443501 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f641010eff0 con 0x7f64100fb520 2024-04-25T17:16:19.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:19.096+0000 7f640d7fa700 1 -- 172.21.15.37:0/3850443501 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+83 (secure 0 0 0) 0x7f63f8057d70 con 0x7f64100fb520 2024-04-25T17:16:19.096 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-04-25T17:16:19.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:19.098+0000 7f6417191700 1 -- 172.21.15.37:0/3850443501 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f63fc0692a0 msgr2=0x7f63fc06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:19.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:19.098+0000 7f6417191700 1 --2- 172.21.15.37:0/3850443501 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f63fc0692a0 0x7f63fc06b750 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6400007fd0 tx=0x7f6400009040 comp rx=0 tx=0).stop 2024-04-25T17:16:19.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:19.098+0000 7f6417191700 1 -- 172.21.15.37:0/3850443501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64100fb520 msgr2=0x7f64101139a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:19.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:19.098+0000 7f6417191700 1 --2- 172.21.15.37:0/3850443501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64100fb520 0x7f64101139a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f63f800b3b0 tx=0x7f63f8009e30 comp rx=0 tx=0).stop 2024-04-25T17:16:19.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:19.098+0000 7f6417191700 1 -- 172.21.15.37:0/3850443501 shutdown_connections 2024-04-25T17:16:19.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:19.098+0000 7f6417191700 1 --2- 172.21.15.37:0/3850443501 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f63fc0692a0 0x7f63fc06b750 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:19.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:19.098+0000 7f6417191700 1 --2- 172.21.15.37:0/3850443501 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64100fb520 0x7f64101139a0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:19.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:19.098+0000 7f6417191700 1 --2- 172.21.15.37:0/3850443501 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6410102f60 0x7f6410113ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:19.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:19.098+0000 7f6417191700 1 -- 172.21.15.37:0/3850443501 >> 172.21.15.37:0/3850443501 conn(0x7f64100714d0 msgr2=0x7f64100fa7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:16:19.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:19.098+0000 7f6417191700 1 -- 172.21.15.37:0/3850443501 shutdown_connections 2024-04-25T17:16:19.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:19.098+0000 7f6417191700 1 -- 172.21.15.37:0/3850443501 wait complete. 2024-04-25T17:16:19.768 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:19 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/3850443501' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-25T17:16:19.797 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T17:16:19.797 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T17:16:19.797 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi069.front.sepia.ceph.com 2024-04-25T17:16:19.797 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-25T17:16:19.797 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-25T17:16:19.797 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T17:16:19.797 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T17:16:19.797 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T17:16:19.797 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-25T17:16:19.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T17:16:19.798 DEBUG:teuthology.orchestra.run.smithi069:> ip addr 2024-04-25T17:16:19.817 INFO:teuthology.orchestra.run.smithi069.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T17:16:19.817 INFO:teuthology.orchestra.run.smithi069.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T17:16:19.817 INFO:teuthology.orchestra.run.smithi069.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T17:16:19.817 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2024-04-25T17:16:19.817 INFO:teuthology.orchestra.run.smithi069.stdout: inet6 ::1/128 scope host 2024-04-25T17:16:19.817 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2024-04-25T17:16:19.817 INFO:teuthology.orchestra.run.smithi069.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T17:16:19.817 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:d8:d9:c2 brd ff:ff:ff:ff:ff:ff 2024-04-25T17:16:19.817 INFO:teuthology.orchestra.run.smithi069.stdout: altname enp7s0f0 2024-04-25T17:16:19.817 INFO:teuthology.orchestra.run.smithi069.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T17:16:19.817 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:d8:d9:c3 brd ff:ff:ff:ff:ff:ff 2024-04-25T17:16:19.817 INFO:teuthology.orchestra.run.smithi069.stdout: altname enp7s0f1 2024-04-25T17:16:19.817 INFO:teuthology.orchestra.run.smithi069.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T17:16:19.818 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:8f:d7:36 brd ff:ff:ff:ff:ff:ff 2024-04-25T17:16:19.818 INFO:teuthology.orchestra.run.smithi069.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T17:16:19.818 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:8f:d7:37 brd ff:ff:ff:ff:ff:ff 2024-04-25T17:16:19.818 INFO:teuthology.orchestra.run.smithi069.stdout: inet 172.21.15.69/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T17:16:19.818 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft 42270sec preferred_lft 42270sec 2024-04-25T17:16:19.818 INFO:teuthology.orchestra.run.smithi069.stdout: inet6 fe80::2be9:2d7c:c600:b28b/64 scope link noprefixroute 2024-04-25T17:16:19.818 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2024-04-25T17:16:19.818 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T17:16:19.818 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T17:16:19.818 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2024-04-25T17:16:19.819 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link add name ceph-brx type bridge 2024-04-25T17:16:19.819 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip addr flush dev ceph-brx 2024-04-25T17:16:19.819 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link set ceph-brx up 2024-04-25T17:16:19.819 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T17:16:19.819 DEBUG:teuthology.orchestra.run.smithi069:> ') 2024-04-25T17:16:19.913 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:16:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T17:16:19.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:19 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/3850443501' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-04-25T17:16:20.002 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:16:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T17:16:20.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T17:16:20.009 DEBUG:teuthology.orchestra.run.smithi069:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T17:16:20.033 INFO:teuthology.orchestra.run.smithi069.stdout:1 2024-04-25T17:16:20.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T17:16:20.035 DEBUG:teuthology.orchestra.run.smithi069:> route 2024-04-25T17:16:20.109 INFO:teuthology.orchestra.run.smithi069.stdout:Kernel IP routing table 2024-04-25T17:16:20.109 INFO:teuthology.orchestra.run.smithi069.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T17:16:20.109 INFO:teuthology.orchestra.run.smithi069.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T17:16:20.109 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T17:16:20.110 INFO:teuthology.orchestra.run.smithi069.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T17:16:20.110 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T17:16:20.110 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2024-04-25T17:16:20.110 DEBUG:teuthology.orchestra.run.smithi069:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T17:16:20.110 DEBUG:teuthology.orchestra.run.smithi069:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T17:16:20.110 DEBUG:teuthology.orchestra.run.smithi069:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T17:16:20.110 DEBUG:teuthology.orchestra.run.smithi069:> ') 2024-04-25T17:16:20.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:16:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T17:16:20.370 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:16:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T17:16:20.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T17:16:20.376 DEBUG:teuthology.orchestra.run.smithi069:> ip netns list 2024-04-25T17:16:20.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T17:16:20.390 DEBUG:teuthology.orchestra.run.smithi069:> ip netns list-id 2024-04-25T17:16:20.445 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T17:16:20.445 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2024-04-25T17:16:20.445 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T17:16:20.445 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-25T17:16:20.445 DEBUG:teuthology.orchestra.run.smithi069:> ') 2024-04-25T17:16:20.533 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:16:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T17:16:20.554 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:16:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T17:16:20.561 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-25T17:16:20.561 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T17:16:20.561 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2024-04-25T17:16:20.561 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-25T17:16:20.561 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T17:16:20.561 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-25T17:16:20.561 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-25T17:16:20.561 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-25T17:16:20.561 DEBUG:teuthology.orchestra.run.smithi069:> ') 2024-04-25T17:16:20.614 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:16:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T17:16:20.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:16:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T17:16:20.690 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T17:16:20.690 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2024-04-25T17:16:20.690 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link set brx.0 up 2024-04-25T17:16:20.690 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T17:16:20.691 DEBUG:teuthology.orchestra.run.smithi069:> ') 2024-04-25T17:16:20.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:16:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T17:16:20.745 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:20 smithi069 ceph-mon[34527]: pgmap v196: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-25T17:16:20.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:16:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T17:16:20.766 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-04-25T17:16:20.766 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T17:16:20.766 DEBUG:teuthology.orchestra.run.smithi069:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-25T17:16:20.780 INFO:teuthology.orchestra.run.smithi069.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-25T17:16:20.780 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T17:16:20.780 DEBUG:teuthology.orchestra.run.smithi069:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-25T17:16:20.835 DEBUG:teuthology.orchestra.run.smithi069:> sudo modprobe fuse 2024-04-25T17:16:20.899 DEBUG:teuthology.orchestra.run.smithi069:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T17:16:20.954 INFO:teuthology.orchestra.run.smithi069.stdout:/proc 2024-04-25T17:16:20.954 INFO:teuthology.orchestra.run.smithi069.stdout:/sys 2024-04-25T17:16:20.954 INFO:teuthology.orchestra.run.smithi069.stdout:/dev 2024-04-25T17:16:20.954 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/security 2024-04-25T17:16:20.954 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/shm 2024-04-25T17:16:20.954 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/pts 2024-04-25T17:16:20.954 INFO:teuthology.orchestra.run.smithi069.stdout:/run 2024-04-25T17:16:20.954 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup 2024-04-25T17:16:20.954 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/pstore 2024-04-25T17:16:20.954 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/bpf 2024-04-25T17:16:20.954 INFO:teuthology.orchestra.run.smithi069.stdout:/ 2024-04-25T17:16:20.954 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/selinux 2024-04-25T17:16:20.955 INFO:teuthology.orchestra.run.smithi069.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T17:16:20.955 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/mqueue 2024-04-25T17:16:20.955 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/hugepages 2024-04-25T17:16:20.955 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/debug 2024-04-25T17:16:20.955 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/tracing 2024-04-25T17:16:20.955 INFO:teuthology.orchestra.run.smithi069.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T17:16:20.955 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/config 2024-04-25T17:16:20.955 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/fuse/connections 2024-04-25T17:16:20.955 INFO:teuthology.orchestra.run.smithi069.stdout:/run/credentials/systemd-sysctl.service 2024-04-25T17:16:20.955 INFO:teuthology.orchestra.run.smithi069.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-25T17:16:20.955 INFO:teuthology.orchestra.run.smithi069.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-25T17:16:20.955 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/nfs/rpc_pipefs 2024-04-25T17:16:20.955 INFO:teuthology.orchestra.run.smithi069.stdout:/run/user/1000 2024-04-25T17:16:20.956 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph 2024-04-25T17:16:20.956 INFO:teuthology.orchestra.run.smithi069.stdout:/run/user/0 2024-04-25T17:16:20.956 INFO:teuthology.orchestra.run.smithi069.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T17:16:20.956 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay 2024-04-25T17:16:20.956 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/8b315129a5f9048c960126950b6f1786a96283e61e745b0c1f620b0736fdf6ee/merged 2024-04-25T17:16:20.956 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/301a65ce2efa3fb9f5f310977bd66c0c66c173262351adf0eef9a2e92b84fae9/merged 2024-04-25T17:16:20.956 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/37217e0d2ee6197a0cd41af5b4fd9da4429c7dbc0512ba1e34b36a9d4f2af0fe/merged 2024-04-25T17:16:20.956 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/a67dde53376efd5bbccbbdd89a550329e5df2559065ade699553a5d525969737/merged 2024-04-25T17:16:20.956 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/7b3c3b7a955b23457e17ec799a1554ffaaf034788669868a69c4b0618dd76ba1/merged 2024-04-25T17:16:20.956 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/04d9576f492beb73ca75bb244a43e10401ac51134ac147d7e12feddf039c3211/merged 2024-04-25T17:16:20.956 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/b026806ed5dc8443a82e203939aac74a4d16485edd427db8878779bfaa7c1a0e/merged 2024-04-25T17:16:20.956 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/20ab4a92dfce5ad58f2f401e75cd84889e8cfeea2451b552f62a54265ed275fa/merged 2024-04-25T17:16:20.956 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/0e56695e1697ea86903862a7499e0882f4be59ac25064a4df707fd7204662189/merged 2024-04-25T17:16:20.956 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns 2024-04-25T17:16:20.957 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T17:16:20.957 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T17:16:20.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T17:16:20.957 DEBUG:teuthology.orchestra.run.smithi069:> ls /sys/fs/fuse/connections 2024-04-25T17:16:21.008 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-25T17:16:21.008 DEBUG:teuthology.orchestra.run.smithi069:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-04-25T17:16:21.050 DEBUG:teuthology.orchestra.run.smithi069:> sudo modprobe fuse 2024-04-25T17:16:21.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:20 smithi037 ceph-mon[26472]: pgmap v196: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-25T17:16:21.073 DEBUG:teuthology.orchestra.run.smithi069:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T17:16:21.127 INFO:teuthology.orchestra.run.smithi069.stdout:/proc 2024-04-25T17:16:21.128 INFO:teuthology.orchestra.run.smithi069.stdout:/sys 2024-04-25T17:16:21.128 INFO:teuthology.orchestra.run.smithi069.stdout:/dev 2024-04-25T17:16:21.128 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/security 2024-04-25T17:16:21.128 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/shm 2024-04-25T17:16:21.128 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/pts 2024-04-25T17:16:21.128 INFO:teuthology.orchestra.run.smithi069.stdout:/run 2024-04-25T17:16:21.128 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup 2024-04-25T17:16:21.128 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/pstore 2024-04-25T17:16:21.128 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/bpf 2024-04-25T17:16:21.128 INFO:teuthology.orchestra.run.smithi069.stdout:/ 2024-04-25T17:16:21.128 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/selinux 2024-04-25T17:16:21.128 INFO:teuthology.orchestra.run.smithi069.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T17:16:21.128 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/mqueue 2024-04-25T17:16:21.129 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/hugepages 2024-04-25T17:16:21.129 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/debug 2024-04-25T17:16:21.129 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/tracing 2024-04-25T17:16:21.129 INFO:teuthology.orchestra.run.smithi069.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T17:16:21.129 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/config 2024-04-25T17:16:21.129 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/fuse/connections 2024-04-25T17:16:21.129 INFO:teuthology.orchestra.run.smithi069.stdout:/run/credentials/systemd-sysctl.service 2024-04-25T17:16:21.129 INFO:teuthology.orchestra.run.smithi069.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-25T17:16:21.129 INFO:teuthology.orchestra.run.smithi069.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-25T17:16:21.129 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/nfs/rpc_pipefs 2024-04-25T17:16:21.129 INFO:teuthology.orchestra.run.smithi069.stdout:/run/user/1000 2024-04-25T17:16:21.129 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph 2024-04-25T17:16:21.129 INFO:teuthology.orchestra.run.smithi069.stdout:/run/user/0 2024-04-25T17:16:21.129 INFO:teuthology.orchestra.run.smithi069.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T17:16:21.129 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay 2024-04-25T17:16:21.130 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/8b315129a5f9048c960126950b6f1786a96283e61e745b0c1f620b0736fdf6ee/merged 2024-04-25T17:16:21.130 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/301a65ce2efa3fb9f5f310977bd66c0c66c173262351adf0eef9a2e92b84fae9/merged 2024-04-25T17:16:21.130 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/37217e0d2ee6197a0cd41af5b4fd9da4429c7dbc0512ba1e34b36a9d4f2af0fe/merged 2024-04-25T17:16:21.130 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/a67dde53376efd5bbccbbdd89a550329e5df2559065ade699553a5d525969737/merged 2024-04-25T17:16:21.130 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/7b3c3b7a955b23457e17ec799a1554ffaaf034788669868a69c4b0618dd76ba1/merged 2024-04-25T17:16:21.130 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/04d9576f492beb73ca75bb244a43e10401ac51134ac147d7e12feddf039c3211/merged 2024-04-25T17:16:21.130 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/b026806ed5dc8443a82e203939aac74a4d16485edd427db8878779bfaa7c1a0e/merged 2024-04-25T17:16:21.130 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/20ab4a92dfce5ad58f2f401e75cd84889e8cfeea2451b552f62a54265ed275fa/merged 2024-04-25T17:16:21.130 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/0e56695e1697ea86903862a7499e0882f4be59ac25064a4df707fd7204662189/merged 2024-04-25T17:16:21.130 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns 2024-04-25T17:16:21.130 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T17:16:21.130 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T17:16:21.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T17:16:21.131 DEBUG:teuthology.orchestra.run.smithi069:> ls /sys/fs/fuse/connections 2024-04-25T17:16:21.157 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi069.stderr:2024-04-25T17:16:21.157+0000 7fae6b0c7300 -1 init, newargv = 0x55fffe5ed930 newargc=15 2024-04-25T17:16:21.157 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi069.stderr:ceph-fuse[59568]: starting ceph client 2024-04-25T17:16:21.162 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi069.stderr:ceph-fuse[59568]: starting fuse 2024-04-25T17:16:21.172 INFO:teuthology.orchestra.run.smithi069.stdout:112 2024-04-25T17:16:21.172 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [112] 2024-04-25T17:16:21.173 DEBUG:teuthology.orchestra.run.smithi069:> sudo stdin-killer -- python3 -c ' 2024-04-25T17:16:21.173 DEBUG:teuthology.orchestra.run.smithi069:> import glob 2024-04-25T17:16:21.173 DEBUG:teuthology.orchestra.run.smithi069:> import re 2024-04-25T17:16:21.173 DEBUG:teuthology.orchestra.run.smithi069:> import os 2024-04-25T17:16:21.173 DEBUG:teuthology.orchestra.run.smithi069:> import subprocess 2024-04-25T17:16:21.173 DEBUG:teuthology.orchestra.run.smithi069:> 2024-04-25T17:16:21.173 DEBUG:teuthology.orchestra.run.smithi069:> def _find_admin_socket(client_name): 2024-04-25T17:16:21.173 DEBUG:teuthology.orchestra.run.smithi069:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-04-25T17:16:21.173 DEBUG:teuthology.orchestra.run.smithi069:> files = glob.glob(asok_path) 2024-04-25T17:16:21.173 DEBUG:teuthology.orchestra.run.smithi069:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-04-25T17:16:21.173 DEBUG:teuthology.orchestra.run.smithi069:> 2024-04-25T17:16:21.173 DEBUG:teuthology.orchestra.run.smithi069:> # Given a non-glob path, it better be there 2024-04-25T17:16:21.173 DEBUG:teuthology.orchestra.run.smithi069:> if "*" not in asok_path: 2024-04-25T17:16:21.174 DEBUG:teuthology.orchestra.run.smithi069:> assert(len(files) == 1) 2024-04-25T17:16:21.174 DEBUG:teuthology.orchestra.run.smithi069:> return files[0] 2024-04-25T17:16:21.174 DEBUG:teuthology.orchestra.run.smithi069:> 2024-04-25T17:16:21.174 DEBUG:teuthology.orchestra.run.smithi069:> for f in files: 2024-04-25T17:16:21.174 DEBUG:teuthology.orchestra.run.smithi069:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-25T17:16:21.174 DEBUG:teuthology.orchestra.run.smithi069:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-25T17:16:21.174 DEBUG:teuthology.orchestra.run.smithi069:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-25T17:16:21.174 DEBUG:teuthology.orchestra.run.smithi069:> contents = proc_f.read() 2024-04-25T17:16:21.174 DEBUG:teuthology.orchestra.run.smithi069:> if mountpoint in contents: 2024-04-25T17:16:21.174 DEBUG:teuthology.orchestra.run.smithi069:> return f 2024-04-25T17:16:21.174 DEBUG:teuthology.orchestra.run.smithi069:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-25T17:16:21.174 DEBUG:teuthology.orchestra.run.smithi069:> 2024-04-25T17:16:21.174 DEBUG:teuthology.orchestra.run.smithi069:> print(_find_admin_socket("client.1")) 2024-04-25T17:16:21.174 DEBUG:teuthology.orchestra.run.smithi069:> ' 2024-04-25T17:16:21.289 INFO:teuthology.orchestra.run.smithi069.stdout:/var/run/ceph/ceph-client.1.59568.asok 2024-04-25T17:16:21.293 INFO:teuthology.orchestra.run.smithi069.stderr:2024-04-25T17:16:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T17:16:21.300 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.59568.asok 2024-04-25T17:16:21.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T17:16:21.300 DEBUG:teuthology.orchestra.run.smithi069:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.59568.asok status 2024-04-25T17:16:21.429 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-04-25T17:16:21.429 INFO:teuthology.orchestra.run.smithi069.stdout: "metadata": { 2024-04-25T17:16:21.429 INFO:teuthology.orchestra.run.smithi069.stdout: "ceph_sha1": "c61472c83ce76869b0fe076c19ed2f4bcc3fb4af", 2024-04-25T17:16:21.429 INFO:teuthology.orchestra.run.smithi069.stdout: "ceph_version": "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)", 2024-04-25T17:16:21.429 INFO:teuthology.orchestra.run.smithi069.stdout: "entity_id": "1", 2024-04-25T17:16:21.429 INFO:teuthology.orchestra.run.smithi069.stdout: "hostname": "smithi069", 2024-04-25T17:16:21.430 INFO:teuthology.orchestra.run.smithi069.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-04-25T17:16:21.430 INFO:teuthology.orchestra.run.smithi069.stdout: "pid": "59568", 2024-04-25T17:16:21.430 INFO:teuthology.orchestra.run.smithi069.stdout: "root": "/" 2024-04-25T17:16:21.430 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-25T17:16:21.430 INFO:teuthology.orchestra.run.smithi069.stdout: "dentry_count": 0, 2024-04-25T17:16:21.430 INFO:teuthology.orchestra.run.smithi069.stdout: "dentry_pinned_count": 0, 2024-04-25T17:16:21.430 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 24331, 2024-04-25T17:16:21.430 INFO:teuthology.orchestra.run.smithi069.stdout: "inst": { 2024-04-25T17:16:21.430 INFO:teuthology.orchestra.run.smithi069.stdout: "name": { 2024-04-25T17:16:21.430 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "client", 2024-04-25T17:16:21.430 INFO:teuthology.orchestra.run.smithi069.stdout: "num": 24331 2024-04-25T17:16:21.430 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-25T17:16:21.430 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": { 2024-04-25T17:16:21.430 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "v1", 2024-04-25T17:16:21.430 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": "192.168.0.1:0", 2024-04-25T17:16:21.430 INFO:teuthology.orchestra.run.smithi069.stdout: "nonce": 3631080618 2024-04-25T17:16:21.431 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-04-25T17:16:21.431 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-25T17:16:21.431 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": { 2024-04-25T17:16:21.431 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "v1", 2024-04-25T17:16:21.431 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": "192.168.0.1:0", 2024-04-25T17:16:21.431 INFO:teuthology.orchestra.run.smithi069.stdout: "nonce": 3631080618 2024-04-25T17:16:21.431 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-04-25T17:16:21.431 INFO:teuthology.orchestra.run.smithi069.stdout: "inst_str": "client.24331 192.168.0.1:0/3631080618", 2024-04-25T17:16:21.431 INFO:teuthology.orchestra.run.smithi069.stdout: "addr_str": "192.168.0.1:0/3631080618", 2024-04-25T17:16:21.431 INFO:teuthology.orchestra.run.smithi069.stdout: "inode_count": 1, 2024-04-25T17:16:21.431 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_epoch": 16, 2024-04-25T17:16:21.431 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_epoch": 46, 2024-04-25T17:16:21.431 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_epoch_barrier": 0, 2024-04-25T17:16:21.431 INFO:teuthology.orchestra.run.smithi069.stdout: "blocklisted": false, 2024-04-25T17:16:21.431 INFO:teuthology.orchestra.run.smithi069.stdout: "fs_name": "cephfs" 2024-04-25T17:16:21.431 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-04-25T17:16:21.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T17:16:21.438 DEBUG:teuthology.orchestra.run.smithi037:> stat --file-system '--printf=%T 2024-04-25T17:16:21.438 DEBUG:teuthology.orchestra.run.smithi037:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-25T17:16:21.459 INFO:teuthology.orchestra.run.smithi037.stdout:fuseblk 2024-04-25T17:16:21.459 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-25T17:16:21.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T17:16:21.459 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T17:16:21.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T17:16:21.533 DEBUG:teuthology.orchestra.run.smithi069:> stat --file-system '--printf=%T 2024-04-25T17:16:21.533 DEBUG:teuthology.orchestra.run.smithi069:> ' -- /home/ubuntu/cephtest/mnt.1 2024-04-25T17:16:21.548 INFO:teuthology.orchestra.run.smithi069.stdout:fuseblk 2024-04-25T17:16:21.548 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-04-25T17:16:21.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T17:16:21.549 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-25T17:16:21.616 INFO:teuthology.run_tasks:Running task print... 2024-04-25T17:16:21.625 INFO:teuthology.task.print:**** done client 2024-04-25T17:16:21.625 INFO:teuthology.run_tasks:Running task parallel... 2024-04-25T17:16:21.636 INFO:teuthology.task.parallel:starting parallel... 2024-04-25T17:16:21.636 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-04-25T17:16:21.637 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-04-25T17:16:21.637 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi037.front.sepia.ceph.com 2024-04-25T17:16:21.637 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -e sha1=994e2f20102a20fa9a27966c14b625cc01884df8 -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs false || true' 2024-04-25T17:16:21.638 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-04-25T17:16:21.638 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-04-25T17:16:21.641 INFO:tasks.workunit:Pulling workunits from ref 994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T17:16:21.641 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-25T17:16:21.641 INFO:tasks.workunit:timeout=3h 2024-04-25T17:16:21.641 INFO:tasks.workunit:cleanup=True 2024-04-25T17:16:21.641 DEBUG:teuthology.orchestra.run.smithi037:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-25T17:16:21.661 INFO:teuthology.orchestra.run.smithi037.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-25T17:16:21.661 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-25T17:16:21.661 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 91h/145d Inode: 1 Links: 2 2024-04-25T17:16:21.661 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T17:16:21.661 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:fusefs_t:s0 2024-04-25T17:16:21.661 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-25T17:16:21.661 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-04-25 17:15:45.613306431 +0000 2024-04-25T17:16:21.661 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-04-25 17:16:21.530427719 +0000 2024-04-25T17:16:21.661 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: - 2024-04-25T17:16:21.661 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-25T17:16:21.662 DEBUG:teuthology.orchestra.run.smithi037:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-25T17:16:21.732 DEBUG:teuthology.orchestra.run.smithi069:> stat -- /home/ubuntu/cephtest/mnt.1 2024-04-25T17:16:21.748 INFO:teuthology.orchestra.run.smithi069.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-04-25T17:16:21.748 INFO:teuthology.orchestra.run.smithi069.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-25T17:16:21.748 INFO:teuthology.orchestra.run.smithi069.stdout:Device: 70h/112d Inode: 1 Links: 3 2024-04-25T17:16:21.748 INFO:teuthology.orchestra.run.smithi069.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T17:16:21.748 INFO:teuthology.orchestra.run.smithi069.stdout:Context: system_u:object_r:fusefs_t:s0 2024-04-25T17:16:21.749 INFO:teuthology.orchestra.run.smithi069.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-25T17:16:21.749 INFO:teuthology.orchestra.run.smithi069.stdout:Modify: 2024-04-25 17:16:21.727892684 +0000 2024-04-25T17:16:21.749 INFO:teuthology.orchestra.run.smithi069.stdout:Change: 2024-04-25 17:16:21.727892684 +0000 2024-04-25T17:16:21.749 INFO:teuthology.orchestra.run.smithi069.stdout: Birth: - 2024-04-25T17:16:21.749 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-04-25T17:16:21.749 DEBUG:teuthology.orchestra.run.smithi069:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-04-25T17:16:21.816 DEBUG:teuthology.orchestra.run.smithi037:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T17:16:21.817 DEBUG:teuthology.orchestra.run.smithi069:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T17:16:21.832 INFO:tasks.workunit.client.0.smithi037.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-25T17:16:21.871 INFO:tasks.workunit.client.1.smithi069.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-04-25T17:16:21.918 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:16:22.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:22 smithi069 ceph-mon[34527]: pgmap v197: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-25T17:16:23.042 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:22 smithi037 ceph-mon[26472]: pgmap v197: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-04-25T17:16:23.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:23.586+0000 7ff471363700 1 -- 172.21.15.37:0/3935978976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff46c0fed70 msgr2=0x7ff46c0faeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:23.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:23.586+0000 7ff471363700 1 --2- 172.21.15.37:0/3935978976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff46c0fed70 0x7ff46c0faeb0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff460004940 tx=0x7ff460009e30 comp rx=0 tx=0).stop 2024-04-25T17:16:23.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:23.586+0000 7ff471363700 1 -- 172.21.15.37:0/3935978976 shutdown_connections 2024-04-25T17:16:23.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:23.586+0000 7ff471363700 1 --2- 172.21.15.37:0/3935978976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff46c0fed70 0x7ff46c0faeb0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:23.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:23.586+0000 7ff471363700 1 --2- 172.21.15.37:0/3935978976 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff46c0fe420 0x7ff46c0fe830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:23.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:23.586+0000 7ff471363700 1 -- 172.21.15.37:0/3935978976 >> 172.21.15.37:0/3935978976 conn(0x7ff46c0f6be0 msgr2=0x7ff46c0f8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:16:23.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:23.587+0000 7ff471363700 1 -- 172.21.15.37:0/3935978976 shutdown_connections 2024-04-25T17:16:23.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:23.587+0000 7ff471363700 1 -- 172.21.15.37:0/3935978976 wait complete. 2024-04-25T17:16:23.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:23.587+0000 7ff471363700 1 Processor -- start 2024-04-25T17:16:23.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:23.587+0000 7ff471363700 1 -- start start 2024-04-25T17:16:23.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:23.587+0000 7ff471363700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff46c0fe420 0x7ff46c10d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:23.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:23.587+0000 7ff471363700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff46c0fed70 0x7ff46c10de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:23.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:23.587+0000 7ff471363700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46c10e4c0 con 0x7ff46c0fed70 2024-04-25T17:16:23.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:23.587+0000 7ff471363700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46c112e60 con 0x7ff46c0fe420 2024-04-25T17:16:23.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:23.588+0000 7ff46a7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff46c0fed70 0x7ff46c10de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:23.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:23.588+0000 7ff46a7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff46c0fed70 0x7ff46c10de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37122/0 (socket says 172.21.15.37:37122) 2024-04-25T17:16:23.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:23.588+0000 7ff46a7fc700 1 -- 172.21.15.37:0/2627815192 learned_addr learned my addr 172.21.15.37:0/2627815192 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:16:23.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:23.588+0000 7ff46affd700 1 --2- 172.21.15.37:0/2627815192 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff46c0fe420 0x7ff46c10d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:23.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:23.588+0000 7ff46a7fc700 1 -- 172.21.15.37:0/2627815192 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff46c0fe420 msgr2=0x7ff46c10d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:23.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:23.588+0000 7ff46a7fc700 1 --2- 172.21.15.37:0/2627815192 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff46c0fe420 0x7ff46c10d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:23.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:23.588+0000 7ff46a7fc700 1 -- 172.21.15.37:0/2627815192 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff460005040 con 0x7ff46c0fed70 2024-04-25T17:16:23.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:23.588+0000 7ff46a7fc700 1 --2- 172.21.15.37:0/2627815192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff46c0fed70 0x7ff46c10de30 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff46000b3b0 tx=0x7ff460009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:16:23.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:23.588+0000 7ff4537fe700 1 -- 172.21.15.37:0/2627815192 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff46000e040 con 0x7ff46c0fed70 2024-04-25T17:16:23.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:23.588+0000 7ff4537fe700 1 -- 172.21.15.37:0/2627815192 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff46000bcc0 con 0x7ff46c0fed70 2024-04-25T17:16:23.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:23.588+0000 7ff4537fe700 1 -- 172.21.15.37:0/2627815192 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff46001c630 con 0x7ff46c0fed70 2024-04-25T17:16:23.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:23.588+0000 7ff471363700 1 -- 172.21.15.37:0/2627815192 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff46c113060 con 0x7ff46c0fed70 2024-04-25T17:16:23.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:23.588+0000 7ff471363700 1 -- 172.21.15.37:0/2627815192 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff46c1135d0 con 0x7ff46c0fed70 2024-04-25T17:16:23.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:23.589+0000 7ff471363700 1 -- 172.21.15.37:0/2627815192 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff46c04c710 con 0x7ff46c0fed70 2024-04-25T17:16:23.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:23.590+0000 7ff4537fe700 1 -- 172.21.15.37:0/2627815192 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7ff460013980 con 0x7ff46c0fed70 2024-04-25T17:16:23.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:23.590+0000 7ff4537fe700 1 --2- 172.21.15.37:0/2627815192 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7ff4540692a0 0x7ff45406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:23.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:23.590+0000 7ff4537fe700 1 -- 172.21.15.37:0/2627815192 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7ff460087f10 con 0x7ff46c0fed70 2024-04-25T17:16:23.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:23.590+0000 7ff46affd700 1 --2- 172.21.15.37:0/2627815192 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7ff4540692a0 0x7ff45406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:23.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:23.591+0000 7ff46affd700 1 --2- 172.21.15.37:0/2627815192 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7ff4540692a0 0x7ff45406b750 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff45c006fd0 tx=0x7ff45c008040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:16:23.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:23.595+0000 7ff4537fe700 1 -- 172.21.15.37:0/2627815192 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7ff460057cd0 con 0x7ff46c0fed70 2024-04-25T17:16:23.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:23.788+0000 7ff471363700 1 -- 172.21.15.37:0/2627815192 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7ff46c113a70 con 0x7ff46c0fed70 2024-04-25T17:16:23.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:23.788+0000 7ff4537fe700 1 -- 172.21.15.37:0/2627815192 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=-22 unrecognized config option 'mgr/orchestrator/fail_fs' v21)=-22 unrecognized config option 'mgr/orchestrator/fail_fs' v21) v1 ==== 179+0+0 (secure 0 0 0) 0x7ff460057860 con 0x7ff46c0fed70 2024-04-25T17:16:23.790 INFO:teuthology.orchestra.run.smithi037.stderr:Error EINVAL: unrecognized config option 'mgr/orchestrator/fail_fs' 2024-04-25T17:16:24.451 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-04-25T17:16:24.452 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi037.front.sepia.ceph.com 2024-04-25T17:16:24.452 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -e sha1=994e2f20102a20fa9a27966c14b625cc01884df8 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-04-25T17:16:24.768 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:16:24.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:24 smithi037 ceph-mon[26472]: pgmap v198: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 682 B/s wr, 3 op/s 2024-04-25T17:16:24.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:24 smithi069 ceph-mon[34527]: pgmap v198: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 682 B/s wr, 3 op/s 2024-04-25T17:16:25.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:25 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:16:25.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:25 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:16:26.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:26.440+0000 7fbbeb103700 1 -- 172.21.15.37:0/2433901535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbe40fbcb0 msgr2=0x7fbbe40fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:26.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:26.440+0000 7fbbeb103700 1 --2- 172.21.15.37:0/2433901535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbe40fbcb0 0x7fbbe40fc0c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc009ce0 tx=0x7fbbdc004d10 comp rx=0 tx=0).stop 2024-04-25T17:16:26.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:26.440+0000 7fbbeb103700 1 -- 172.21.15.37:0/2433901535 shutdown_connections 2024-04-25T17:16:26.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:26.440+0000 7fbbeb103700 1 --2- 172.21.15.37:0/2433901535 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbbe40fcf60 0x7fbbe40fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:26.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:26.440+0000 7fbbeb103700 1 --2- 172.21.15.37:0/2433901535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbe40fbcb0 0x7fbbe40fc0c0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:26.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:26.440+0000 7fbbeb103700 1 -- 172.21.15.37:0/2433901535 >> 172.21.15.37:0/2433901535 conn(0x7fbbe40f7430 msgr2=0x7fbbe40f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:16:26.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:26.440+0000 7fbbeb103700 1 -- 172.21.15.37:0/2433901535 shutdown_connections 2024-04-25T17:16:26.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:26.440+0000 7fbbeb103700 1 -- 172.21.15.37:0/2433901535 wait complete. 2024-04-25T17:16:26.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:26.441+0000 7fbbeb103700 1 Processor -- start 2024-04-25T17:16:26.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:26.441+0000 7fbbeb103700 1 -- start start 2024-04-25T17:16:26.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:26.441+0000 7fbbeb103700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbe40fbcb0 0x7fbbe40ffd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:26.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:26.441+0000 7fbbeb103700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbbe40fcf60 0x7fbbe40fe2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:26.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:26.441+0000 7fbbeb103700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe40fe830 con 0x7fbbe40fbcb0 2024-04-25T17:16:26.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:26.441+0000 7fbbeb103700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe40fe970 con 0x7fbbe40fcf60 2024-04-25T17:16:26.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:26.441+0000 7fbbe8e9f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbe40fbcb0 0x7fbbe40ffd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:26.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:26.441+0000 7fbbe8e9f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbe40fbcb0 0x7fbbe40ffd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37140/0 (socket says 172.21.15.37:37140) 2024-04-25T17:16:26.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:26.441+0000 7fbbe8e9f700 1 -- 172.21.15.37:0/2171168272 learned_addr learned my addr 172.21.15.37:0/2171168272 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:16:26.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:26.442+0000 7fbbe3fff700 1 --2- 172.21.15.37:0/2171168272 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbbe40fcf60 0x7fbbe40fe2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:26.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:26.442+0000 7fbbe8e9f700 1 -- 172.21.15.37:0/2171168272 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbbe40fcf60 msgr2=0x7fbbe40fe2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:26.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:26.442+0000 7fbbe8e9f700 1 --2- 172.21.15.37:0/2171168272 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbbe40fcf60 0x7fbbe40fe2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:26.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:26.442+0000 7fbbe8e9f700 1 -- 172.21.15.37:0/2171168272 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbdc009940 con 0x7fbbe40fbcb0 2024-04-25T17:16:26.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:26.442+0000 7fbbe8e9f700 1 --2- 172.21.15.37:0/2171168272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbe40fbcb0 0x7fbbe40ffd80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc005010 tx=0x7fbbdc004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:16:26.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:26.442+0000 7fbbe17fa700 1 -- 172.21.15.37:0/2171168272 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbbdc00e040 con 0x7fbbe40fbcb0 2024-04-25T17:16:26.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:26.442+0000 7fbbeb103700 1 -- 172.21.15.37:0/2171168272 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbe40febf0 con 0x7fbbe40fbcb0 2024-04-25T17:16:26.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:26.442+0000 7fbbe17fa700 1 -- 172.21.15.37:0/2171168272 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbbdc0128e0 con 0x7fbbe40fbcb0 2024-04-25T17:16:26.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:26.442+0000 7fbbe17fa700 1 -- 172.21.15.37:0/2171168272 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbbdc01c910 con 0x7fbbe40fbcb0 2024-04-25T17:16:26.444 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:26.442+0000 7fbbeb103700 1 -- 172.21.15.37:0/2171168272 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbe4115c50 con 0x7fbbe40fbcb0 2024-04-25T17:16:26.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:26.443+0000 7fbbeb103700 1 -- 172.21.15.37:0/2171168272 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbe4101af0 con 0x7fbbe40fbcb0 2024-04-25T17:16:26.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:26.444+0000 7fbbe17fa700 1 -- 172.21.15.37:0/2171168272 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fbbdc012410 con 0x7fbbe40fbcb0 2024-04-25T17:16:26.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:26.444+0000 7fbbe17fa700 1 --2- 172.21.15.37:0/2171168272 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fbbcc0692b0 0x7fbbcc06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:26.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:26.444+0000 7fbbe17fa700 1 -- 172.21.15.37:0/2171168272 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fbbdc088f40 con 0x7fbbe40fbcb0 2024-04-25T17:16:26.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:26.444+0000 7fbbe3fff700 1 --2- 172.21.15.37:0/2171168272 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fbbcc0692b0 0x7fbbcc06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:26.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:26.445+0000 7fbbe3fff700 1 --2- 172.21.15.37:0/2171168272 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fbbcc0692b0 0x7fbbcc06b760 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4100360 tx=0x7fbbd8009040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:16:26.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:26.449+0000 7fbbe17fa700 1 -- 172.21.15.37:0/2171168272 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fbbdc0bb250 con 0x7fbbe40fbcb0 2024-04-25T17:16:26.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:26.646+0000 7fbbeb103700 1 -- 172.21.15.37:0/2171168272 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7fbbe41048b0 con 0x7fbbe40fbcb0 2024-04-25T17:16:26.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:26.646+0000 7fbbe17fa700 1 -- 172.21.15.37:0/2171168272 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v21)=0 v21) v1 ==== 155+0+0 (secure 0 0 0) 0x7fbbdc058c80 con 0x7fbbe40fbcb0 2024-04-25T17:16:26.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:26.648+0000 7fbbeb103700 1 -- 172.21.15.37:0/2171168272 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fbbcc0692b0 msgr2=0x7fbbcc06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:26.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:26.648+0000 7fbbeb103700 1 --2- 172.21.15.37:0/2171168272 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fbbcc0692b0 0x7fbbcc06b760 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4100360 tx=0x7fbbd8009040 comp rx=0 tx=0).stop 2024-04-25T17:16:26.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:26.648+0000 7fbbeb103700 1 -- 172.21.15.37:0/2171168272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbe40fbcb0 msgr2=0x7fbbe40ffd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:26.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:26.648+0000 7fbbeb103700 1 --2- 172.21.15.37:0/2171168272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbe40fbcb0 0x7fbbe40ffd80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc005010 tx=0x7fbbdc004d10 comp rx=0 tx=0).stop 2024-04-25T17:16:26.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:26.648+0000 7fbbeb103700 1 -- 172.21.15.37:0/2171168272 shutdown_connections 2024-04-25T17:16:26.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:26.649+0000 7fbbeb103700 1 --2- 172.21.15.37:0/2171168272 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fbbcc0692b0 0x7fbbcc06b760 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:26.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:26.649+0000 7fbbeb103700 1 --2- 172.21.15.37:0/2171168272 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbe40fbcb0 0x7fbbe40ffd80 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:26.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:26.649+0000 7fbbeb103700 1 --2- 172.21.15.37:0/2171168272 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbbe40fcf60 0x7fbbe40fe2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:26.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:26.649+0000 7fbbeb103700 1 -- 172.21.15.37:0/2171168272 >> 172.21.15.37:0/2171168272 conn(0x7fbbe40f7430 msgr2=0x7fbbe4065bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:16:26.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:26.649+0000 7fbbeb103700 1 -- 172.21.15.37:0/2171168272 shutdown_connections 2024-04-25T17:16:26.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:26.649+0000 7fbbeb103700 1 -- 172.21.15.37:0/2171168272 wait complete. 2024-04-25T17:16:26.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:26 smithi037 ceph-mon[26472]: pgmap v199: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 682 B/s wr, 2 op/s 2024-04-25T17:16:26.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:26 smithi069 ceph-mon[34527]: pgmap v199: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 682 B/s wr, 2 op/s 2024-04-25T17:16:27.359 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -e sha1=994e2f20102a20fa9a27966c14b625cc01884df8 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-04-25T17:16:27.629 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:16:28.744 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:28 smithi037 ceph-mon[26472]: pgmap v200: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-25T17:16:28.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:28 smithi069 ceph-mon[34527]: pgmap v200: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 767 B/s wr, 2 op/s 2024-04-25T17:16:29.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:29.281+0000 7fc6d5859700 1 -- 172.21.15.37:0/2707018791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6d00fff80 msgr2=0x7fc6d0102360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:29.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:29.281+0000 7fc6d5859700 1 --2- 172.21.15.37:0/2707018791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6d00fff80 0x7fc6d0102360 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4004940 tx=0x7fc6c4009e30 comp rx=0 tx=0).stop 2024-04-25T17:16:29.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:29.281+0000 7fc6d5859700 1 -- 172.21.15.37:0/2707018791 shutdown_connections 2024-04-25T17:16:29.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:29.281+0000 7fc6d5859700 1 --2- 172.21.15.37:0/2707018791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6d00fff80 0x7fc6d0102360 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:29.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:29.281+0000 7fc6d5859700 1 --2- 172.21.15.37:0/2707018791 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6d0066220 0x7fc6d00ffa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:29.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:29.281+0000 7fc6d5859700 1 -- 172.21.15.37:0/2707018791 >> 172.21.15.37:0/2707018791 conn(0x7fc6d00f7430 msgr2=0x7fc6d00f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:16:29.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:29.281+0000 7fc6d5859700 1 -- 172.21.15.37:0/2707018791 shutdown_connections 2024-04-25T17:16:29.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:29.281+0000 7fc6d5859700 1 -- 172.21.15.37:0/2707018791 wait complete. 2024-04-25T17:16:29.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:29.282+0000 7fc6d5859700 1 Processor -- start 2024-04-25T17:16:29.284 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:29.282+0000 7fc6d5859700 1 -- start start 2024-04-25T17:16:29.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:29.282+0000 7fc6d5859700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6d0066220 0x7fc6d010da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:29.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:29.282+0000 7fc6d5859700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6d00fff80 0x7fc6d010df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:29.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:29.282+0000 7fc6d5859700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d010e560 con 0x7fc6d0066220 2024-04-25T17:16:29.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:29.282+0000 7fc6d5859700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d010edb0 con 0x7fc6d00fff80 2024-04-25T17:16:29.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:29.282+0000 7fc6ceffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6d0066220 0x7fc6d010da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:29.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:29.282+0000 7fc6ceffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6d0066220 0x7fc6d010da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43406/0 (socket says 172.21.15.37:43406) 2024-04-25T17:16:29.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:29.282+0000 7fc6ceffd700 1 -- 172.21.15.37:0/441331720 learned_addr learned my addr 172.21.15.37:0/441331720 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:16:29.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:29.283+0000 7fc6ce7fc700 1 --2- 172.21.15.37:0/441331720 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6d00fff80 0x7fc6d010df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:29.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:29.283+0000 7fc6ceffd700 1 -- 172.21.15.37:0/441331720 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6d00fff80 msgr2=0x7fc6d010df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:29.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:29.283+0000 7fc6ceffd700 1 --2- 172.21.15.37:0/441331720 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6d00fff80 0x7fc6d010df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:29.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:29.283+0000 7fc6ceffd700 1 -- 172.21.15.37:0/441331720 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c4005040 con 0x7fc6d0066220 2024-04-25T17:16:29.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:29.283+0000 7fc6ce7fc700 1 --2- 172.21.15.37:0/441331720 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6d00fff80 0x7fc6d010df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T17:16:29.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:29.283+0000 7fc6ceffd700 1 --2- 172.21.15.37:0/441331720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6d0066220 0x7fc6d010da20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc6c000c8e0 tx=0x7fc6c00044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:16:29.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:29.283+0000 7fc6b77fe700 1 -- 172.21.15.37:0/441331720 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6c000a940 con 0x7fc6d0066220 2024-04-25T17:16:29.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:29.283+0000 7fc6d5859700 1 -- 172.21.15.37:0/441331720 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6d010f090 con 0x7fc6d0066220 2024-04-25T17:16:29.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:29.283+0000 7fc6b77fe700 1 -- 172.21.15.37:0/441331720 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc6c000ce80 con 0x7fc6d0066220 2024-04-25T17:16:29.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:29.283+0000 7fc6b77fe700 1 -- 172.21.15.37:0/441331720 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6c00113a0 con 0x7fc6d0066220 2024-04-25T17:16:29.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:29.283+0000 7fc6d5859700 1 -- 172.21.15.37:0/441331720 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6d010f5d0 con 0x7fc6d0066220 2024-04-25T17:16:29.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:29.284+0000 7fc6d5859700 1 -- 172.21.15.37:0/441331720 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6d005f5c0 con 0x7fc6d0066220 2024-04-25T17:16:29.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:29.285+0000 7fc6b77fe700 1 -- 172.21.15.37:0/441331720 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fc6c0012400 con 0x7fc6d0066220 2024-04-25T17:16:29.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:29.285+0000 7fc6b77fe700 1 --2- 172.21.15.37:0/441331720 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fc6b80692a0 0x7fc6b806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:29.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:29.285+0000 7fc6b77fe700 1 -- 172.21.15.37:0/441331720 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fc6c00872a0 con 0x7fc6d0066220 2024-04-25T17:16:29.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:29.285+0000 7fc6ce7fc700 1 --2- 172.21.15.37:0/441331720 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fc6b80692a0 0x7fc6b806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:29.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:29.286+0000 7fc6ce7fc700 1 --2- 172.21.15.37:0/441331720 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fc6b80692a0 0x7fc6b806b750 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc6c400b3b0 tx=0x7fc6c4009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:16:29.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:29.289+0000 7fc6b77fe700 1 -- 172.21.15.37:0/441331720 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fc6c0057060 con 0x7fc6d0066220 2024-04-25T17:16:29.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:29.487+0000 7fc6d5859700 1 -- 172.21.15.37:0/441331720 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7fc6d004bed0 con 0x7fc6d0066220 2024-04-25T17:16:29.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:29.487+0000 7fc6b77fe700 1 -- 172.21.15.37:0/441331720 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v21)=0 v21) v1 ==== 163+0+0 (secure 0 0 0) 0x7fc6c0056bf0 con 0x7fc6d0066220 2024-04-25T17:16:29.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:29.489+0000 7fc6d5859700 1 -- 172.21.15.37:0/441331720 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fc6b80692a0 msgr2=0x7fc6b806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:29.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:29.489+0000 7fc6d5859700 1 --2- 172.21.15.37:0/441331720 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fc6b80692a0 0x7fc6b806b750 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc6c400b3b0 tx=0x7fc6c4009e30 comp rx=0 tx=0).stop 2024-04-25T17:16:29.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:29.489+0000 7fc6d5859700 1 -- 172.21.15.37:0/441331720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6d0066220 msgr2=0x7fc6d010da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:29.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:29.489+0000 7fc6d5859700 1 --2- 172.21.15.37:0/441331720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6d0066220 0x7fc6d010da20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc6c000c8e0 tx=0x7fc6c00044c0 comp rx=0 tx=0).stop 2024-04-25T17:16:29.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:29.489+0000 7fc6d5859700 1 -- 172.21.15.37:0/441331720 shutdown_connections 2024-04-25T17:16:29.489 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:29.489+0000 7fc6d5859700 1 --2- 172.21.15.37:0/441331720 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fc6b80692a0 0x7fc6b806b750 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:29.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:29.489+0000 7fc6d5859700 1 --2- 172.21.15.37:0/441331720 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6d0066220 0x7fc6d010da20 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:29.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:29.489+0000 7fc6d5859700 1 --2- 172.21.15.37:0/441331720 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6d00fff80 0x7fc6d010df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:29.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:29.489+0000 7fc6d5859700 1 -- 172.21.15.37:0/441331720 >> 172.21.15.37:0/441331720 conn(0x7fc6d00f7430 msgr2=0x7fc6d00f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:16:29.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:29.489+0000 7fc6d5859700 1 -- 172.21.15.37:0/441331720 shutdown_connections 2024-04-25T17:16:29.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:29.489+0000 7fc6d5859700 1 -- 172.21.15.37:0/441331720 wait complete. 2024-04-25T17:16:30.192 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -e sha1=994e2f20102a20fa9a27966c14b625cc01884df8 -- bash -c 'ceph config set global log_to_journald false --force' 2024-04-25T17:16:30.465 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:16:30.857 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:30 smithi037 ceph-mon[26472]: pgmap v201: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 767 B/s wr, 3 op/s 2024-04-25T17:16:30.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:30 smithi069 ceph-mon[34527]: pgmap v201: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 767 B/s wr, 3 op/s 2024-04-25T17:16:32.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:32.263+0000 7f5e7d435700 1 -- 172.21.15.37:0/2816080581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e780fdfd0 msgr2=0x7f5e780fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:32.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:32.263+0000 7f5e7d435700 1 --2- 172.21.15.37:0/2816080581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e780fdfd0 0x7f5e780fe440 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c004940 tx=0x7f5e6c009e30 comp rx=0 tx=0).stop 2024-04-25T17:16:32.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:32.263+0000 7f5e7d435700 1 -- 172.21.15.37:0/2816080581 shutdown_connections 2024-04-25T17:16:32.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:32.263+0000 7f5e7d435700 1 --2- 172.21.15.37:0/2816080581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e780fdfd0 0x7f5e780fe440 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:32.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:32.263+0000 7f5e7d435700 1 --2- 172.21.15.37:0/2816080581 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5e780fce60 0x7f5e780fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:32.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:32.263+0000 7f5e7d435700 1 -- 172.21.15.37:0/2816080581 >> 172.21.15.37:0/2816080581 conn(0x7f5e780f8540 msgr2=0x7f5e780fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:16:32.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:32.263+0000 7f5e7d435700 1 -- 172.21.15.37:0/2816080581 shutdown_connections 2024-04-25T17:16:32.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:32.263+0000 7f5e7d435700 1 -- 172.21.15.37:0/2816080581 wait complete. 2024-04-25T17:16:32.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:32.264+0000 7f5e7d435700 1 Processor -- start 2024-04-25T17:16:32.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:32.264+0000 7f5e7d435700 1 -- start start 2024-04-25T17:16:32.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:32.264+0000 7f5e7d435700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5e780fce60 0x7f5e7810fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:32.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:32.264+0000 7f5e7d435700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e780fdfd0 0x7f5e78110060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:32.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:32.264+0000 7f5e7d435700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e78110660 con 0x7f5e780fdfd0 2024-04-25T17:16:32.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:32.264+0000 7f5e7d435700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e781107d0 con 0x7f5e780fce60 2024-04-25T17:16:32.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:32.264+0000 7f5e767fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e780fdfd0 0x7f5e78110060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:32.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:32.264+0000 7f5e767fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e780fdfd0 0x7f5e78110060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43434/0 (socket says 172.21.15.37:43434) 2024-04-25T17:16:32.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:32.264+0000 7f5e767fc700 1 -- 172.21.15.37:0/2528937196 learned_addr learned my addr 172.21.15.37:0/2528937196 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:16:32.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:32.264+0000 7f5e76ffd700 1 --2- 172.21.15.37:0/2528937196 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5e780fce60 0x7f5e7810fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:32.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:32.264+0000 7f5e767fc700 1 -- 172.21.15.37:0/2528937196 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5e780fce60 msgr2=0x7f5e7810fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:32.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:32.264+0000 7f5e767fc700 1 --2- 172.21.15.37:0/2528937196 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5e780fce60 0x7f5e7810fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:32.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:32.264+0000 7f5e767fc700 1 -- 172.21.15.37:0/2528937196 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e6c005040 con 0x7f5e780fdfd0 2024-04-25T17:16:32.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:32.264+0000 7f5e76ffd700 1 --2- 172.21.15.37:0/2528937196 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5e780fce60 0x7f5e7810fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T17:16:32.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:32.265+0000 7f5e767fc700 1 --2- 172.21.15.37:0/2528937196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e780fdfd0 0x7f5e78110060 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c00b3b0 tx=0x7f5e6c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:16:32.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:32.265+0000 7f5e5f7fe700 1 -- 172.21.15.37:0/2528937196 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e6c00e040 con 0x7f5e780fdfd0 2024-04-25T17:16:32.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:32.265+0000 7f5e7d435700 1 -- 172.21.15.37:0/2528937196 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e781151d0 con 0x7f5e780fdfd0 2024-04-25T17:16:32.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:32.265+0000 7f5e5f7fe700 1 -- 172.21.15.37:0/2528937196 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5e6c00bcc0 con 0x7f5e780fdfd0 2024-04-25T17:16:32.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:32.265+0000 7f5e5f7fe700 1 -- 172.21.15.37:0/2528937196 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e6c01c630 con 0x7f5e780fdfd0 2024-04-25T17:16:32.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:32.265+0000 7f5e7d435700 1 -- 172.21.15.37:0/2528937196 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e78115790 con 0x7f5e780fdfd0 2024-04-25T17:16:32.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:32.266+0000 7f5e7d435700 1 -- 172.21.15.37:0/2528937196 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e78101960 con 0x7f5e780fdfd0 2024-04-25T17:16:32.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:32.266+0000 7f5e5f7fe700 1 -- 172.21.15.37:0/2528937196 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f5e6c013980 con 0x7f5e780fdfd0 2024-04-25T17:16:32.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:32.267+0000 7f5e5f7fe700 1 --2- 172.21.15.37:0/2528937196 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f5e600692a0 0x7f5e6006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:32.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:32.267+0000 7f5e5f7fe700 1 -- 172.21.15.37:0/2528937196 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f5e6c087fd0 con 0x7f5e780fdfd0 2024-04-25T17:16:32.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:32.267+0000 7f5e76ffd700 1 --2- 172.21.15.37:0/2528937196 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f5e600692a0 0x7f5e6006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:32.269 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:32.267+0000 7f5e76ffd700 1 --2- 172.21.15.37:0/2528937196 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f5e600692a0 0x7f5e6006b750 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5e680041d0 tx=0x7f5e68009040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:16:32.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:32.271+0000 7f5e5f7fe700 1 -- 172.21.15.37:0/2528937196 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f5e6c057d10 con 0x7f5e780fdfd0 2024-04-25T17:16:32.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:32.469+0000 7f5e7d435700 1 -- 172.21.15.37:0/2528937196 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f5e78101380 con 0x7f5e780fdfd0 2024-04-25T17:16:32.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:32.470+0000 7f5e5f7fe700 1 -- 172.21.15.37:0/2528937196 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v21)=0 v21) v1 ==== 135+0+0 (secure 0 0 0) 0x7f5e6c0578a0 con 0x7f5e780fdfd0 2024-04-25T17:16:32.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:32.472+0000 7f5e7d435700 1 -- 172.21.15.37:0/2528937196 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f5e600692a0 msgr2=0x7f5e6006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:32.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:32.472+0000 7f5e7d435700 1 --2- 172.21.15.37:0/2528937196 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f5e600692a0 0x7f5e6006b750 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5e680041d0 tx=0x7f5e68009040 comp rx=0 tx=0).stop 2024-04-25T17:16:32.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:32.472+0000 7f5e7d435700 1 -- 172.21.15.37:0/2528937196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e780fdfd0 msgr2=0x7f5e78110060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:32.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:32.472+0000 7f5e7d435700 1 --2- 172.21.15.37:0/2528937196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e780fdfd0 0x7f5e78110060 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c00b3b0 tx=0x7f5e6c009e30 comp rx=0 tx=0).stop 2024-04-25T17:16:32.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:32.472+0000 7f5e7d435700 1 -- 172.21.15.37:0/2528937196 shutdown_connections 2024-04-25T17:16:32.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:32.472+0000 7f5e7d435700 1 --2- 172.21.15.37:0/2528937196 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f5e600692a0 0x7f5e6006b750 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:32.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:32.472+0000 7f5e7d435700 1 --2- 172.21.15.37:0/2528937196 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5e780fce60 0x7f5e7810fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:32.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:32.472+0000 7f5e7d435700 1 --2- 172.21.15.37:0/2528937196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e780fdfd0 0x7f5e78110060 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:32.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:32.472+0000 7f5e7d435700 1 -- 172.21.15.37:0/2528937196 >> 172.21.15.37:0/2528937196 conn(0x7f5e780f8540 msgr2=0x7f5e780f9b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:16:32.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:32.472+0000 7f5e7d435700 1 -- 172.21.15.37:0/2528937196 shutdown_connections 2024-04-25T17:16:32.474 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:32.472+0000 7f5e7d435700 1 -- 172.21.15.37:0/2528937196 wait complete. 2024-04-25T17:16:32.775 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:32 smithi037 ceph-mon[26472]: pgmap v202: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 597 B/s wr, 2 op/s 2024-04-25T17:16:32.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:32 smithi069 ceph-mon[34527]: pgmap v202: 65 pgs: 65 active+clean; 585 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 597 B/s wr, 2 op/s 2024-04-25T17:16:33.182 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -e sha1=994e2f20102a20fa9a27966c14b625cc01884df8 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-04-25T17:16:33.454 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:16:34.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:34 smithi069 ceph-mon[34527]: pgmap v203: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 1023 B/s wr, 3 op/s 2024-04-25T17:16:34.933 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:34 smithi037 ceph-mon[26472]: pgmap v203: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 1023 B/s wr, 3 op/s 2024-04-25T17:16:35.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:35.159+0000 7f3fcf745700 1 -- 172.21.15.37:0/3562349690 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fc80fce60 msgr2=0x7f3fc80fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:35.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:35.159+0000 7f3fcf745700 1 --2- 172.21.15.37:0/3562349690 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fc80fce60 0x7f3fc80fd270 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3fb8004940 tx=0x7f3fb8009e30 comp rx=0 tx=0).stop 2024-04-25T17:16:35.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:35.159+0000 7f3fcf745700 1 -- 172.21.15.37:0/3562349690 shutdown_connections 2024-04-25T17:16:35.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:35.159+0000 7f3fcf745700 1 --2- 172.21.15.37:0/3562349690 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3fc80fdfd0 0x7f3fc80fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:35.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:35.159+0000 7f3fcf745700 1 --2- 172.21.15.37:0/3562349690 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fc80fce60 0x7f3fc80fd270 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:35.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:35.159+0000 7f3fcf745700 1 -- 172.21.15.37:0/3562349690 >> 172.21.15.37:0/3562349690 conn(0x7f3fc80f8520 msgr2=0x7f3fc80fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:16:35.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:35.159+0000 7f3fcf745700 1 -- 172.21.15.37:0/3562349690 shutdown_connections 2024-04-25T17:16:35.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:35.159+0000 7f3fcf745700 1 -- 172.21.15.37:0/3562349690 wait complete. 2024-04-25T17:16:35.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:35.159+0000 7f3fcf745700 1 Processor -- start 2024-04-25T17:16:35.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:35.159+0000 7f3fcf745700 1 -- start start 2024-04-25T17:16:35.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:35.159+0000 7f3fcf745700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3fc80fce60 0x7f3fc8071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:35.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:35.159+0000 7f3fcf745700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fc80fdfd0 0x7f3fc80702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:35.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:35.159+0000 7f3fcf745700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc8072200 con 0x7f3fc80fdfd0 2024-04-25T17:16:35.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:35.159+0000 7f3fcf745700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc80707f0 con 0x7f3fc80fce60 2024-04-25T17:16:35.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:35.160+0000 7f3fccce0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fc80fdfd0 0x7f3fc80702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:35.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:35.160+0000 7f3fccce0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fc80fdfd0 0x7f3fc80702b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43450/0 (socket says 172.21.15.37:43450) 2024-04-25T17:16:35.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:35.160+0000 7f3fccce0700 1 -- 172.21.15.37:0/513214586 learned_addr learned my addr 172.21.15.37:0/513214586 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:16:35.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:35.160+0000 7f3fcd4e1700 1 --2- 172.21.15.37:0/513214586 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3fc80fce60 0x7f3fc8071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:35.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:35.160+0000 7f3fccce0700 1 -- 172.21.15.37:0/513214586 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3fc80fce60 msgr2=0x7f3fc8071c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:35.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:35.160+0000 7f3fccce0700 1 --2- 172.21.15.37:0/513214586 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3fc80fce60 0x7f3fc8071c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:35.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:35.160+0000 7f3fccce0700 1 -- 172.21.15.37:0/513214586 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb8005040 con 0x7f3fc80fdfd0 2024-04-25T17:16:35.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:35.160+0000 7f3fccce0700 1 --2- 172.21.15.37:0/513214586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fc80fdfd0 0x7f3fc80702b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3fc4002a50 tx=0x7f3fc40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:16:35.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:35.160+0000 7f3fbdffb700 1 -- 172.21.15.37:0/513214586 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fc4007cc0 con 0x7f3fc80fdfd0 2024-04-25T17:16:35.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:35.160+0000 7f3fcf745700 1 -- 172.21.15.37:0/513214586 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fc8070aa0 con 0x7f3fc80fdfd0 2024-04-25T17:16:35.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:35.160+0000 7f3fbdffb700 1 -- 172.21.15.37:0/513214586 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3fc400f040 con 0x7f3fc80fdfd0 2024-04-25T17:16:35.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:35.160+0000 7f3fbdffb700 1 -- 172.21.15.37:0/513214586 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fc400da30 con 0x7f3fc80fdfd0 2024-04-25T17:16:35.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:35.161+0000 7f3fcf745700 1 -- 172.21.15.37:0/513214586 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fc8071060 con 0x7f3fc80fdfd0 2024-04-25T17:16:35.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:35.162+0000 7f3fcf745700 1 -- 172.21.15.37:0/513214586 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fc804c710 con 0x7f3fc80fdfd0 2024-04-25T17:16:35.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:35.162+0000 7f3fbdffb700 1 -- 172.21.15.37:0/513214586 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f3fc400db90 con 0x7f3fc80fdfd0 2024-04-25T17:16:35.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:35.162+0000 7f3fbdffb700 1 --2- 172.21.15.37:0/513214586 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f3fb40692a0 0x7f3fb406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:35.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:35.162+0000 7f3fbdffb700 1 -- 172.21.15.37:0/513214586 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f3fc4086f50 con 0x7f3fc80fdfd0 2024-04-25T17:16:35.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:35.162+0000 7f3fcd4e1700 1 --2- 172.21.15.37:0/513214586 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f3fb40692a0 0x7f3fb406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:35.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:35.163+0000 7f3fcd4e1700 1 --2- 172.21.15.37:0/513214586 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f3fb40692a0 0x7f3fb406b750 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3fb800b970 tx=0x7f3fb8009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:16:35.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:35.167+0000 7f3fbdffb700 1 -- 172.21.15.37:0/513214586 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f3fc4056c90 con 0x7f3fc80fdfd0 2024-04-25T17:16:35.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:35.379+0000 7f3fcf745700 1 -- 172.21.15.37:0/513214586 --> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8", "target": ["mon-mgr", ""]}) v1 -- 0x7f3fc8102450 con 0x7f3fb40692a0 2024-04-25T17:16:35.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:35.385+0000 7f3fbdffb700 1 -- 172.21.15.37:0/513214586 <== mgr.14214 v2:172.21.15.37:6800/3566135606 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f3fc8102450 con 0x7f3fb40692a0 2024-04-25T17:16:35.386 INFO:teuthology.orchestra.run.smithi037.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T17:16:35.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:35.387+0000 7f3fcf745700 1 -- 172.21.15.37:0/513214586 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f3fb40692a0 msgr2=0x7f3fb406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:35.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:35.387+0000 7f3fcf745700 1 --2- 172.21.15.37:0/513214586 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f3fb40692a0 0x7f3fb406b750 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3fb800b970 tx=0x7f3fb8009e30 comp rx=0 tx=0).stop 2024-04-25T17:16:35.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:35.387+0000 7f3fcf745700 1 -- 172.21.15.37:0/513214586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fc80fdfd0 msgr2=0x7f3fc80702b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:35.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:35.387+0000 7f3fcf745700 1 --2- 172.21.15.37:0/513214586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fc80fdfd0 0x7f3fc80702b0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3fc4002a50 tx=0x7f3fc40046b0 comp rx=0 tx=0).stop 2024-04-25T17:16:35.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:35.387+0000 7f3fcf745700 1 -- 172.21.15.37:0/513214586 shutdown_connections 2024-04-25T17:16:35.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:35.387+0000 7f3fcf745700 1 --2- 172.21.15.37:0/513214586 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f3fb40692a0 0x7f3fb406b750 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:35.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:35.387+0000 7f3fcf745700 1 --2- 172.21.15.37:0/513214586 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3fc80fce60 0x7f3fc8071c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:35.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:35.387+0000 7f3fcf745700 1 --2- 172.21.15.37:0/513214586 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fc80fdfd0 0x7f3fc80702b0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:35.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:35.387+0000 7f3fcf745700 1 -- 172.21.15.37:0/513214586 >> 172.21.15.37:0/513214586 conn(0x7f3fc80f8520 msgr2=0x7f3fc80f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:16:35.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:35.387+0000 7f3fcf745700 1 -- 172.21.15.37:0/513214586 shutdown_connections 2024-04-25T17:16:35.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:35.387+0000 7f3fcf745700 1 -- 172.21.15.37:0/513214586 wait complete. 2024-04-25T17:16:36.132 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-04-25T17:16:36.133 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi037.front.sepia.ceph.com 2024-04-25T17:16:36.133 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -e sha1=994e2f20102a20fa9a27966c14b625cc01884df8 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-04-25T17:16:36.425 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:16:36.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:36 smithi069 ceph-mon[34527]: from='client.14564 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:16:36.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:36 smithi069 ceph-mon[34527]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T17:16:36.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:36 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:16:36.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:36 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:16:36.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:36 smithi069 ceph-mon[34527]: pgmap v204: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-04-25T17:16:36.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:36 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:16:36.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:36 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:16:36.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:36 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:16:36.718 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:36 smithi037 ceph-mon[26472]: from='client.14564 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:16:36.719 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:36 smithi037 ceph-mon[26472]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T17:16:36.719 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:36 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:16:36.719 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:36 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:16:36.719 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:36 smithi037 ceph-mon[26472]: pgmap v204: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-04-25T17:16:36.719 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:36 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:16:36.719 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:36 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:16:36.719 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:36 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:16:37.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:37 smithi069 ceph-mon[34527]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T17:16:37.722 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:37 smithi037 ceph-mon[26472]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 2024-04-25T17:16:38.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.345+0000 7f640b289700 1 -- 172.21.15.37:0/1788526045 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64040fcf60 msgr2=0x7f64040fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:38.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.345+0000 7f640b289700 1 --2- 172.21.15.37:0/1788526045 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64040fcf60 0x7f64040fd3d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f63f8004940 tx=0x7f63f8009e30 comp rx=0 tx=0).stop 2024-04-25T17:16:38.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.345+0000 7f640b289700 1 -- 172.21.15.37:0/1788526045 shutdown_connections 2024-04-25T17:16:38.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.345+0000 7f640b289700 1 --2- 172.21.15.37:0/1788526045 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64040fcf60 0x7f64040fd3d0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:38.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.345+0000 7f640b289700 1 --2- 172.21.15.37:0/1788526045 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f64040fbcb0 0x7f64040fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:38.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.345+0000 7f640b289700 1 -- 172.21.15.37:0/1788526045 >> 172.21.15.37:0/1788526045 conn(0x7f64040f7430 msgr2=0x7f64040f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:16:38.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.345+0000 7f640b289700 1 -- 172.21.15.37:0/1788526045 shutdown_connections 2024-04-25T17:16:38.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.345+0000 7f640b289700 1 -- 172.21.15.37:0/1788526045 wait complete. 2024-04-25T17:16:38.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.346+0000 7f640b289700 1 Processor -- start 2024-04-25T17:16:38.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.346+0000 7f640b289700 1 -- start start 2024-04-25T17:16:38.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.346+0000 7f640b289700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f64040fbcb0 0x7f64041106a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:38.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.346+0000 7f640b289700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64040fcf60 0x7f6404112bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:38.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.346+0000 7f640b289700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6404066420 con 0x7f64040fcf60 2024-04-25T17:16:38.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.346+0000 7f640b289700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6404066560 con 0x7f64040fbcb0 2024-04-25T17:16:38.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.346+0000 7f6408824700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64040fcf60 0x7f6404112bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:38.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.346+0000 7f6408824700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64040fcf60 0x7f6404112bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35988/0 (socket says 172.21.15.37:35988) 2024-04-25T17:16:38.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.346+0000 7f6408824700 1 -- 172.21.15.37:0/4145460088 learned_addr learned my addr 172.21.15.37:0/4145460088 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:16:38.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.346+0000 7f6409025700 1 --2- 172.21.15.37:0/4145460088 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f64040fbcb0 0x7f64041106a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:38.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.347+0000 7f6408824700 1 -- 172.21.15.37:0/4145460088 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f64040fbcb0 msgr2=0x7f64041106a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:38.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.347+0000 7f6408824700 1 --2- 172.21.15.37:0/4145460088 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f64040fbcb0 0x7f64041106a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:38.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.347+0000 7f6408824700 1 -- 172.21.15.37:0/4145460088 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f8005040 con 0x7f64040fcf60 2024-04-25T17:16:38.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.347+0000 7f6408824700 1 --2- 172.21.15.37:0/4145460088 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64040fcf60 0x7f6404112bf0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f63f800b970 tx=0x7f63f8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:16:38.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.347+0000 7f6401ffb700 1 -- 172.21.15.37:0/4145460088 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63f800e040 con 0x7f64040fcf60 2024-04-25T17:16:38.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.347+0000 7f6401ffb700 1 -- 172.21.15.37:0/4145460088 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f63f800bbf0 con 0x7f64040fcf60 2024-04-25T17:16:38.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.347+0000 7f640b289700 1 -- 172.21.15.37:0/4145460088 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6404113220 con 0x7f64040fcf60 2024-04-25T17:16:38.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.347+0000 7f6401ffb700 1 -- 172.21.15.37:0/4145460088 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63f801c630 con 0x7f64040fcf60 2024-04-25T17:16:38.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.347+0000 7f640b289700 1 -- 172.21.15.37:0/4145460088 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64041137e0 con 0x7f64040fcf60 2024-04-25T17:16:38.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.348+0000 7f640b289700 1 -- 172.21.15.37:0/4145460088 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f640405f5c0 con 0x7f64040fcf60 2024-04-25T17:16:38.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.349+0000 7f6401ffb700 1 -- 172.21.15.37:0/4145460088 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f63f800bd60 con 0x7f64040fcf60 2024-04-25T17:16:38.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.349+0000 7f6401ffb700 1 --2- 172.21.15.37:0/4145460088 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f63ec0692a0 0x7f63ec06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:38.358 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.349+0000 7f6401ffb700 1 -- 172.21.15.37:0/4145460088 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f63f8088500 con 0x7f64040fcf60 2024-04-25T17:16:38.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.349+0000 7f6409025700 1 --2- 172.21.15.37:0/4145460088 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f63ec0692a0 0x7f63ec06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:38.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.350+0000 7f6409025700 1 --2- 172.21.15.37:0/4145460088 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f63ec0692a0 0x7f63ec06b750 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6404066010 tx=0x7f63f4009780 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:16:38.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.354+0000 7f6401ffb700 1 -- 172.21.15.37:0/4145460088 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f63f80548e0 con 0x7f64040fcf60 2024-04-25T17:16:38.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.584+0000 7f640b289700 1 -- 172.21.15.37:0/4145460088 --> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6404101280 con 0x7f63ec0692a0 2024-04-25T17:16:38.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.585+0000 7f6401ffb700 1 -- 172.21.15.37:0/4145460088 <== mgr.14214 v2:172.21.15.37:6800/3566135606 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f6404101280 con 0x7f63ec0692a0 2024-04-25T17:16:38.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.588+0000 7f640b289700 1 -- 172.21.15.37:0/4145460088 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f63ec0692a0 msgr2=0x7f63ec06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:38.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.588+0000 7f640b289700 1 --2- 172.21.15.37:0/4145460088 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f63ec0692a0 0x7f63ec06b750 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6404066010 tx=0x7f63f4009780 comp rx=0 tx=0).stop 2024-04-25T17:16:38.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.588+0000 7f640b289700 1 -- 172.21.15.37:0/4145460088 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64040fcf60 msgr2=0x7f6404112bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:38.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.588+0000 7f640b289700 1 --2- 172.21.15.37:0/4145460088 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64040fcf60 0x7f6404112bf0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f63f800b970 tx=0x7f63f8009e30 comp rx=0 tx=0).stop 2024-04-25T17:16:38.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.588+0000 7f640b289700 1 -- 172.21.15.37:0/4145460088 shutdown_connections 2024-04-25T17:16:38.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.588+0000 7f640b289700 1 --2- 172.21.15.37:0/4145460088 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f63ec0692a0 0x7f63ec06b750 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:38.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.588+0000 7f640b289700 1 --2- 172.21.15.37:0/4145460088 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f64040fbcb0 0x7f64041106a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:38.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.588+0000 7f640b289700 1 --2- 172.21.15.37:0/4145460088 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64040fcf60 0x7f6404112bf0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:38.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.588+0000 7f640b289700 1 -- 172.21.15.37:0/4145460088 >> 172.21.15.37:0/4145460088 conn(0x7f64040f7430 msgr2=0x7f64040f8a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:16:38.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.588+0000 7f640b289700 1 -- 172.21.15.37:0/4145460088 shutdown_connections 2024-04-25T17:16:38.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.588+0000 7f640b289700 1 -- 172.21.15.37:0/4145460088 wait complete. 2024-04-25T17:16:38.603 INFO:teuthology.orchestra.run.smithi037.stdout:true 2024-04-25T17:16:38.603 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:38 smithi037 ceph-mon[26472]: pgmap v205: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-04-25T17:16:38.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:38 smithi069 ceph-mon[34527]: pgmap v205: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-04-25T17:16:38.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.705+0000 7fa142b27700 1 -- 172.21.15.37:0/4267694940 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa13c0fff70 msgr2=0x7fa13c102390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:38.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.705+0000 7fa142b27700 1 --2- 172.21.15.37:0/4267694940 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa13c0fff70 0x7fa13c102390 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa128004940 tx=0x7fa128009e30 comp rx=0 tx=0).stop 2024-04-25T17:16:38.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.705+0000 7fa142b27700 1 -- 172.21.15.37:0/4267694940 shutdown_connections 2024-04-25T17:16:38.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.705+0000 7fa142b27700 1 --2- 172.21.15.37:0/4267694940 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa13c0fff70 0x7fa13c102390 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:38.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.705+0000 7fa142b27700 1 --2- 172.21.15.37:0/4267694940 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa13c066b50 0x7fa13c0ffa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:38.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.705+0000 7fa142b27700 1 -- 172.21.15.37:0/4267694940 >> 172.21.15.37:0/4267694940 conn(0x7fa13c0f74c0 msgr2=0x7fa13c0f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:16:38.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.705+0000 7fa142b27700 1 -- 172.21.15.37:0/4267694940 shutdown_connections 2024-04-25T17:16:38.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.705+0000 7fa142b27700 1 -- 172.21.15.37:0/4267694940 wait complete. 2024-04-25T17:16:38.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.705+0000 7fa142b27700 1 Processor -- start 2024-04-25T17:16:38.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.705+0000 7fa142b27700 1 -- start start 2024-04-25T17:16:38.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.706+0000 7fa142b27700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa13c066b50 0x7fa13c10fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:38.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.706+0000 7fa142b27700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa13c0fff70 0x7fa13c110150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:38.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.706+0000 7fa142b27700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa13c110750 con 0x7fa13c066b50 2024-04-25T17:16:38.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.706+0000 7fa142b27700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa13c110fa0 con 0x7fa13c0fff70 2024-04-25T17:16:38.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.706+0000 7fa1408c3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa13c066b50 0x7fa13c10fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:38.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.706+0000 7fa1408c3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa13c066b50 0x7fa13c10fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36012/0 (socket says 172.21.15.37:36012) 2024-04-25T17:16:38.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.706+0000 7fa1408c3700 1 -- 172.21.15.37:0/3095068680 learned_addr learned my addr 172.21.15.37:0/3095068680 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:16:38.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.706+0000 7fa13bfff700 1 --2- 172.21.15.37:0/3095068680 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa13c0fff70 0x7fa13c110150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:38.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.706+0000 7fa1408c3700 1 -- 172.21.15.37:0/3095068680 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa13c0fff70 msgr2=0x7fa13c110150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:38.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.706+0000 7fa1408c3700 1 --2- 172.21.15.37:0/3095068680 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa13c0fff70 0x7fa13c110150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:38.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.706+0000 7fa1408c3700 1 -- 172.21.15.37:0/3095068680 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa128005040 con 0x7fa13c066b50 2024-04-25T17:16:38.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.706+0000 7fa1408c3700 1 --2- 172.21.15.37:0/3095068680 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa13c066b50 0x7fa13c10fc10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa130002a50 tx=0x7fa1300046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:16:38.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.707+0000 7fa1397fa700 1 -- 172.21.15.37:0/3095068680 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa130007cc0 con 0x7fa13c066b50 2024-04-25T17:16:38.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.707+0000 7fa142b27700 1 -- 172.21.15.37:0/3095068680 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa13c111280 con 0x7fa13c066b50 2024-04-25T17:16:38.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.707+0000 7fa1397fa700 1 -- 172.21.15.37:0/3095068680 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa13000f040 con 0x7fa13c066b50 2024-04-25T17:16:38.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.707+0000 7fa1397fa700 1 -- 172.21.15.37:0/3095068680 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa130009630 con 0x7fa13c066b50 2024-04-25T17:16:38.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.707+0000 7fa142b27700 1 -- 172.21.15.37:0/3095068680 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa13c1117c0 con 0x7fa13c066b50 2024-04-25T17:16:38.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.708+0000 7fa142b27700 1 -- 172.21.15.37:0/3095068680 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa13c05f5c0 con 0x7fa13c066b50 2024-04-25T17:16:38.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.708+0000 7fa1397fa700 1 -- 172.21.15.37:0/3095068680 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fa130009790 con 0x7fa13c066b50 2024-04-25T17:16:38.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.709+0000 7fa1397fa700 1 --2- 172.21.15.37:0/3095068680 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fa12c0692b0 0x7fa12c06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:38.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.709+0000 7fa1397fa700 1 -- 172.21.15.37:0/3095068680 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fa130087000 con 0x7fa13c066b50 2024-04-25T17:16:38.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.709+0000 7fa13bfff700 1 --2- 172.21.15.37:0/3095068680 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fa12c0692b0 0x7fa12c06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:38.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.710+0000 7fa13bfff700 1 --2- 172.21.15.37:0/3095068680 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fa12c0692b0 0x7fa12c06b760 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa12800b3b0 tx=0x7fa128009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:16:38.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.715+0000 7fa1397fa700 1 -- 172.21.15.37:0/3095068680 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fa130056df0 con 0x7fa13c066b50 2024-04-25T17:16:38.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.951+0000 7fa142b27700 1 -- 172.21.15.37:0/3095068680 --> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa13c111aa0 con 0x7fa12c0692b0 2024-04-25T17:16:38.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.952+0000 7fa1397fa700 1 -- 172.21.15.37:0/3095068680 <== mgr.14214 v2:172.21.15.37:6800/3566135606 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fa13c111aa0 con 0x7fa12c0692b0 2024-04-25T17:16:38.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.955+0000 7fa142b27700 1 -- 172.21.15.37:0/3095068680 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fa12c0692b0 msgr2=0x7fa12c06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:38.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.955+0000 7fa142b27700 1 --2- 172.21.15.37:0/3095068680 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fa12c0692b0 0x7fa12c06b760 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa12800b3b0 tx=0x7fa128009e30 comp rx=0 tx=0).stop 2024-04-25T17:16:38.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.955+0000 7fa142b27700 1 -- 172.21.15.37:0/3095068680 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa13c066b50 msgr2=0x7fa13c10fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:38.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.955+0000 7fa142b27700 1 --2- 172.21.15.37:0/3095068680 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa13c066b50 0x7fa13c10fc10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa130002a50 tx=0x7fa1300046b0 comp rx=0 tx=0).stop 2024-04-25T17:16:38.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.955+0000 7fa142b27700 1 -- 172.21.15.37:0/3095068680 shutdown_connections 2024-04-25T17:16:38.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.955+0000 7fa142b27700 1 --2- 172.21.15.37:0/3095068680 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fa12c0692b0 0x7fa12c06b760 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:38.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.955+0000 7fa142b27700 1 --2- 172.21.15.37:0/3095068680 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa13c066b50 0x7fa13c10fc10 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:38.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.955+0000 7fa142b27700 1 --2- 172.21.15.37:0/3095068680 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa13c0fff70 0x7fa13c110150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:38.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.955+0000 7fa142b27700 1 -- 172.21.15.37:0/3095068680 >> 172.21.15.37:0/3095068680 conn(0x7fa13c0f74c0 msgr2=0x7fa13c0fbaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:16:38.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.955+0000 7fa142b27700 1 -- 172.21.15.37:0/3095068680 shutdown_connections 2024-04-25T17:16:38.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:38.955+0000 7fa142b27700 1 -- 172.21.15.37:0/3095068680 wait complete. 2024-04-25T17:16:39.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.064+0000 7f99e9c6f700 1 -- 172.21.15.37:0/3217401230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99e40fff40 msgr2=0x7f99e4102320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:39.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.064+0000 7f99e9c6f700 1 --2- 172.21.15.37:0/3217401230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99e40fff40 0x7f99e4102320 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f99d8004940 tx=0x7f99d8009e30 comp rx=0 tx=0).stop 2024-04-25T17:16:39.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.064+0000 7f99e9c6f700 1 -- 172.21.15.37:0/3217401230 shutdown_connections 2024-04-25T17:16:39.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.064+0000 7f99e9c6f700 1 --2- 172.21.15.37:0/3217401230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99e40fff40 0x7f99e4102320 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:39.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.064+0000 7f99e9c6f700 1 --2- 172.21.15.37:0/3217401230 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99e4066260 0x7f99e40ffa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:39.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.064+0000 7f99e9c6f700 1 -- 172.21.15.37:0/3217401230 >> 172.21.15.37:0/3217401230 conn(0x7f99e40f7430 msgr2=0x7f99e40f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:16:39.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.064+0000 7f99e9c6f700 1 -- 172.21.15.37:0/3217401230 shutdown_connections 2024-04-25T17:16:39.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.064+0000 7f99e9c6f700 1 -- 172.21.15.37:0/3217401230 wait complete. 2024-04-25T17:16:39.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.065+0000 7f99e9c6f700 1 Processor -- start 2024-04-25T17:16:39.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.065+0000 7f99e9c6f700 1 -- start start 2024-04-25T17:16:39.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.065+0000 7f99e9c6f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99e4066260 0x7f99e410d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:39.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.065+0000 7f99e9c6f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99e40fff40 0x7f99e410df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:39.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.065+0000 7f99e9c6f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e410e520 con 0x7f99e40fff40 2024-04-25T17:16:39.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.065+0000 7f99e9c6f700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e410ed70 con 0x7f99e4066260 2024-04-25T17:16:39.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.065+0000 7f99e2ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99e40fff40 0x7f99e410df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:39.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.065+0000 7f99e2ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99e40fff40 0x7f99e410df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36036/0 (socket says 172.21.15.37:36036) 2024-04-25T17:16:39.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.065+0000 7f99e2ffd700 1 -- 172.21.15.37:0/4155726725 learned_addr learned my addr 172.21.15.37:0/4155726725 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:16:39.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.065+0000 7f99e37fe700 1 --2- 172.21.15.37:0/4155726725 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99e4066260 0x7f99e410d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:39.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.066+0000 7f99e2ffd700 1 -- 172.21.15.37:0/4155726725 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99e4066260 msgr2=0x7f99e410d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:39.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.066+0000 7f99e2ffd700 1 --2- 172.21.15.37:0/4155726725 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99e4066260 0x7f99e410d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:39.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.066+0000 7f99e2ffd700 1 -- 172.21.15.37:0/4155726725 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d8005040 con 0x7f99e40fff40 2024-04-25T17:16:39.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.066+0000 7f99e2ffd700 1 --2- 172.21.15.37:0/4155726725 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99e40fff40 0x7f99e410df20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f99d800b3b0 tx=0x7f99d8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:16:39.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.066+0000 7f99cbfff700 1 -- 172.21.15.37:0/4155726725 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99d800e040 con 0x7f99e40fff40 2024-04-25T17:16:39.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.066+0000 7f99e9c6f700 1 -- 172.21.15.37:0/4155726725 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99e410eff0 con 0x7f99e40fff40 2024-04-25T17:16:39.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.066+0000 7f99e9c6f700 1 -- 172.21.15.37:0/4155726725 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99e410f530 con 0x7f99e40fff40 2024-04-25T17:16:39.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.066+0000 7f99cbfff700 1 -- 172.21.15.37:0/4155726725 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f99d8004290 con 0x7f99e40fff40 2024-04-25T17:16:39.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.066+0000 7f99cbfff700 1 -- 172.21.15.37:0/4155726725 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99d801c3f0 con 0x7f99e40fff40 2024-04-25T17:16:39.074 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.067+0000 7f99e9c6f700 1 -- 172.21.15.37:0/4155726725 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99d00052e0 con 0x7f99e40fff40 2024-04-25T17:16:39.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.068+0000 7f99cbfff700 1 -- 172.21.15.37:0/4155726725 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f99d800bbf0 con 0x7f99e40fff40 2024-04-25T17:16:39.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.068+0000 7f99cbfff700 1 --2- 172.21.15.37:0/4155726725 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f99cc06d6c0 0x7f99cc06fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:39.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.069+0000 7f99cbfff700 1 -- 172.21.15.37:0/4155726725 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f99d8088310 con 0x7f99e40fff40 2024-04-25T17:16:39.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.069+0000 7f99e37fe700 1 --2- 172.21.15.37:0/4155726725 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f99cc06d6c0 0x7f99cc06fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:39.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.069+0000 7f99e37fe700 1 --2- 172.21.15.37:0/4155726725 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f99cc06d6c0 0x7f99cc06fb70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f99e4065fa0 tx=0x7f99d4009040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:16:39.076 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.073+0000 7f99cbfff700 1 -- 172.21.15.37:0/4155726725 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f99d8058170 con 0x7f99e40fff40 2024-04-25T17:16:39.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.287+0000 7f99e9c6f700 1 -- 172.21.15.37:0/4155726725 --> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f99d0000bf0 con 0x7f99cc06d6c0 2024-04-25T17:16:39.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.298+0000 7f99cbfff700 1 -- 172.21.15.37:0/4155726725 <== mgr.14214 v2:172.21.15.37:6800/3566135606 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7f99d0000bf0 con 0x7f99cc06d6c0 2024-04-25T17:16:39.299 INFO:teuthology.orchestra.run.smithi037.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-25T17:16:39.299 INFO:teuthology.orchestra.run.smithi037.stdout:alertmanager.smithi037 smithi037 *:9093,9094 running (4m) 29s ago 6m 26.6M - 0.25.0 c8568f914cd2 82eacf476143 2024-04-25T17:16:39.300 INFO:teuthology.orchestra.run.smithi037.stdout:crash.smithi037 smithi037 running (6m) 29s ago 6m 6656k - 17.2.7-902-gc61472c8 0de407c1b3af b3d152574e80 2024-04-25T17:16:39.300 INFO:teuthology.orchestra.run.smithi037.stdout:crash.smithi069 smithi069 running (5m) 36s ago 5m 6660k - 17.2.7-902-gc61472c8 0de407c1b3af aa6086c64cc3 2024-04-25T17:16:39.300 INFO:teuthology.orchestra.run.smithi037.stdout:grafana.smithi037 smithi037 *:3000 running (4m) 29s ago 6m 86.3M - 9.4.7 954c08fa6188 0a09ff60869f 2024-04-25T17:16:39.300 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi037.ksmixc smithi037 running (55s) 29s ago 54s 17.1M - 17.2.7-902-gc61472c8 0de407c1b3af 394aa56079b4 2024-04-25T17:16:39.300 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi037.ovkrpq smithi037 running (49s) 29s ago 48s 13.2M - 17.2.7-902-gc61472c8 0de407c1b3af 73ca662174a7 2024-04-25T17:16:39.300 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi069.cpprst smithi069 running (46s) 36s ago 46s 12.2M - 17.2.7-902-gc61472c8 0de407c1b3af dbda101df20e 2024-04-25T17:16:39.300 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi069.ytlqcf smithi069 running (52s) 36s ago 51s 10.4M - 17.2.7-902-gc61472c8 0de407c1b3af 911df6b18215 2024-04-25T17:16:39.300 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.smithi037.txrgxl smithi037 *:9283 running (7m) 29s ago 7m 480M - 17.2.7-902-gc61472c8 0de407c1b3af 796b326569c2 2024-04-25T17:16:39.300 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.smithi069.mmuhdo smithi069 *:8443,9283 running (5m) 36s ago 5m 431M - 17.2.7-902-gc61472c8 0de407c1b3af 32fa92400de4 2024-04-25T17:16:39.300 INFO:teuthology.orchestra.run.smithi037.stdout:mon.smithi037 smithi037 running (7m) 29s ago 8m 41.1M 2048M 17.2.7-902-gc61472c8 0de407c1b3af 5cfadcf8f2e4 2024-04-25T17:16:39.300 INFO:teuthology.orchestra.run.smithi037.stdout:mon.smithi069 smithi069 running (5m) 36s ago 5m 33.1M 2048M 17.2.7-902-gc61472c8 0de407c1b3af ffcd456d1dce 2024-04-25T17:16:39.300 INFO:teuthology.orchestra.run.smithi037.stdout:node-exporter.smithi037 smithi037 *:9100 running (6m) 29s ago 6m 14.2M - 1.5.0 0da6a335fe13 363761df1e06 2024-04-25T17:16:39.300 INFO:teuthology.orchestra.run.smithi037.stdout:node-exporter.smithi069 smithi069 *:9100 running (5m) 36s ago 5m 16.8M - 1.5.0 0da6a335fe13 5d407954c21f 2024-04-25T17:16:39.300 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0 smithi037 running (4m) 29s ago 4m 50.0M 4289M 17.2.7-902-gc61472c8 0de407c1b3af 8ff4b0f1aae9 2024-04-25T17:16:39.300 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1 smithi037 running (4m) 29s ago 4m 48.3M 4289M 17.2.7-902-gc61472c8 0de407c1b3af 5715a5da241d 2024-04-25T17:16:39.300 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2 smithi037 running (3m) 29s ago 3m 43.1M 4289M 17.2.7-902-gc61472c8 0de407c1b3af 2eedaf9886dd 2024-04-25T17:16:39.301 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3 smithi069 running (3m) 36s ago 3m 43.5M 5312M 17.2.7-902-gc61472c8 0de407c1b3af ebba78fb1923 2024-04-25T17:16:39.301 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4 smithi069 running (2m) 36s ago 2m 43.7M 5312M 17.2.7-902-gc61472c8 0de407c1b3af ba7b785c50f9 2024-04-25T17:16:39.301 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5 smithi069 running (2m) 36s ago 2m 44.5M 5312M 17.2.7-902-gc61472c8 0de407c1b3af f6be99c364ff 2024-04-25T17:16:39.301 INFO:teuthology.orchestra.run.smithi037.stdout:prometheus.smithi037 smithi037 *:9095 running (4m) 29s ago 5m 54.9M - 2.43.0 a07b618ecd1d 13d3c6f36732 2024-04-25T17:16:39.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.301+0000 7f99e9c6f700 1 -- 172.21.15.37:0/4155726725 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f99cc06d6c0 msgr2=0x7f99cc06fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:39.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.301+0000 7f99e9c6f700 1 --2- 172.21.15.37:0/4155726725 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f99cc06d6c0 0x7f99cc06fb70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f99e4065fa0 tx=0x7f99d4009040 comp rx=0 tx=0).stop 2024-04-25T17:16:39.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.301+0000 7f99e9c6f700 1 -- 172.21.15.37:0/4155726725 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99e40fff40 msgr2=0x7f99e410df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:39.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.301+0000 7f99e9c6f700 1 --2- 172.21.15.37:0/4155726725 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99e40fff40 0x7f99e410df20 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f99d800b3b0 tx=0x7f99d8009e30 comp rx=0 tx=0).stop 2024-04-25T17:16:39.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.301+0000 7f99e9c6f700 1 -- 172.21.15.37:0/4155726725 shutdown_connections 2024-04-25T17:16:39.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.301+0000 7f99e9c6f700 1 --2- 172.21.15.37:0/4155726725 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f99cc06d6c0 0x7f99cc06fb70 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:39.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.301+0000 7f99e9c6f700 1 --2- 172.21.15.37:0/4155726725 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99e4066260 0x7f99e410d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:39.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.301+0000 7f99e9c6f700 1 --2- 172.21.15.37:0/4155726725 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99e40fff40 0x7f99e410df20 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:39.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.301+0000 7f99e9c6f700 1 -- 172.21.15.37:0/4155726725 >> 172.21.15.37:0/4155726725 conn(0x7f99e40f7430 msgr2=0x7f99e40f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:16:39.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.301+0000 7f99e9c6f700 1 -- 172.21.15.37:0/4155726725 shutdown_connections 2024-04-25T17:16:39.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.301+0000 7f99e9c6f700 1 -- 172.21.15.37:0/4155726725 wait complete. 2024-04-25T17:16:39.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.414+0000 7f573cd46700 1 -- 172.21.15.37:0/1666139100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57381022e0 msgr2=0x7f57381046c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:39.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.414+0000 7f573cd46700 1 --2- 172.21.15.37:0/1666139100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57381022e0 0x7f57381046c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f572c004940 tx=0x7f572c009e30 comp rx=0 tx=0).stop 2024-04-25T17:16:39.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.415+0000 7f573cd46700 1 -- 172.21.15.37:0/1666139100 shutdown_connections 2024-04-25T17:16:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.415+0000 7f573cd46700 1 --2- 172.21.15.37:0/1666139100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57381022e0 0x7f57381046c0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.415+0000 7f573cd46700 1 --2- 172.21.15.37:0/1666139100 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57380662c0 0x7f5738101da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.415+0000 7f573cd46700 1 -- 172.21.15.37:0/1666139100 >> 172.21.15.37:0/1666139100 conn(0x7f57380f7430 msgr2=0x7f57380f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:16:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.415+0000 7f573cd46700 1 -- 172.21.15.37:0/1666139100 shutdown_connections 2024-04-25T17:16:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.415+0000 7f573cd46700 1 -- 172.21.15.37:0/1666139100 wait complete. 2024-04-25T17:16:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.415+0000 7f573cd46700 1 Processor -- start 2024-04-25T17:16:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.415+0000 7f573cd46700 1 -- start start 2024-04-25T17:16:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.415+0000 7f573cd46700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57380662c0 0x7f573810fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.415+0000 7f573cd46700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57381022e0 0x7f5738110170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.415+0000 7f573cd46700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5738110770 con 0x7f57380662c0 2024-04-25T17:16:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.415+0000 7f573cd46700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5738110fc0 con 0x7f57381022e0 2024-04-25T17:16:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.416+0000 7f573659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57380662c0 0x7f573810fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:39.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.416+0000 7f573659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57380662c0 0x7f573810fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36054/0 (socket says 172.21.15.37:36054) 2024-04-25T17:16:39.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.416+0000 7f573659c700 1 -- 172.21.15.37:0/4125722963 learned_addr learned my addr 172.21.15.37:0/4125722963 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:16:39.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.416+0000 7f573659c700 1 -- 172.21.15.37:0/4125722963 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57381022e0 msgr2=0x7f5738110170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:39.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.416+0000 7f573659c700 1 --2- 172.21.15.37:0/4125722963 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57381022e0 0x7f5738110170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:39.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.416+0000 7f573659c700 1 -- 172.21.15.37:0/4125722963 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f572c005040 con 0x7f57380662c0 2024-04-25T17:16:39.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.416+0000 7f573659c700 1 --2- 172.21.15.37:0/4125722963 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57380662c0 0x7f573810fc30 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5728002a50 tx=0x7f5728004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:16:39.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.416+0000 7f5726ffd700 1 -- 172.21.15.37:0/4125722963 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5728007cc0 con 0x7f57380662c0 2024-04-25T17:16:39.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.416+0000 7f5726ffd700 1 -- 172.21.15.37:0/4125722963 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f572800f040 con 0x7f57380662c0 2024-04-25T17:16:39.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.416+0000 7f573cd46700 1 -- 172.21.15.37:0/4125722963 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57381112a0 con 0x7f57380662c0 2024-04-25T17:16:39.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.416+0000 7f5726ffd700 1 -- 172.21.15.37:0/4125722963 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f572800daf0 con 0x7f57380662c0 2024-04-25T17:16:39.419 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.416+0000 7f573cd46700 1 -- 172.21.15.37:0/4125722963 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57381117e0 con 0x7f57380662c0 2024-04-25T17:16:39.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.417+0000 7f573cd46700 1 -- 172.21.15.37:0/4125722963 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f573805f5c0 con 0x7f57380662c0 2024-04-25T17:16:39.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.418+0000 7f5726ffd700 1 -- 172.21.15.37:0/4125722963 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f5728009810 con 0x7f57380662c0 2024-04-25T17:16:39.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.418+0000 7f5726ffd700 1 --2- 172.21.15.37:0/4125722963 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f57200692b0 0x7f572006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:39.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.419+0000 7f5726ffd700 1 -- 172.21.15.37:0/4125722963 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f5728086e60 con 0x7f57380662c0 2024-04-25T17:16:39.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.419+0000 7f5735d9b700 1 --2- 172.21.15.37:0/4125722963 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f57200692b0 0x7f572006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:39.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.419+0000 7f5735d9b700 1 --2- 172.21.15.37:0/4125722963 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f57200692b0 0x7f572006b760 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f572c004f90 tx=0x7f572c009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:16:39.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.423+0000 7f5726ffd700 1 -- 172.21.15.37:0/4125722963 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f5728056c20 con 0x7f57380662c0 2024-04-25T17:16:39.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:39 smithi037 ceph-mon[26472]: from='client.14568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:16:39.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:39 smithi069 ceph-mon[34527]: from='client.14568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:16:39.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.730+0000 7f573cd46700 1 -- 172.21.15.37:0/4125722963 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5738111bb0 con 0x7f57380662c0 2024-04-25T17:16:39.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.730+0000 7f5726ffd700 1 -- 172.21.15.37:0/4125722963 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f57280567b0 con 0x7f57380662c0 2024-04-25T17:16:39.731 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-25T17:16:39.731 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": { 2024-04-25T17:16:39.732 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 2 2024-04-25T17:16:39.732 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:16:39.732 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": { 2024-04-25T17:16:39.732 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 2 2024-04-25T17:16:39.732 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:16:39.732 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": { 2024-04-25T17:16:39.732 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 6 2024-04-25T17:16:39.732 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:16:39.732 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": { 2024-04-25T17:16:39.732 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 4 2024-04-25T17:16:39.732 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:16:39.732 INFO:teuthology.orchestra.run.smithi037.stdout: "overall": { 2024-04-25T17:16:39.732 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 14 2024-04-25T17:16:39.732 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-04-25T17:16:39.733 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-25T17:16:39.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.732+0000 7f573cd46700 1 -- 172.21.15.37:0/4125722963 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f57200692b0 msgr2=0x7f572006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:39.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.732+0000 7f573cd46700 1 --2- 172.21.15.37:0/4125722963 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f57200692b0 0x7f572006b760 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f572c004f90 tx=0x7f572c009e30 comp rx=0 tx=0).stop 2024-04-25T17:16:39.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.732+0000 7f573cd46700 1 -- 172.21.15.37:0/4125722963 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57380662c0 msgr2=0x7f573810fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:39.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.732+0000 7f573cd46700 1 --2- 172.21.15.37:0/4125722963 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57380662c0 0x7f573810fc30 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5728002a50 tx=0x7f5728004600 comp rx=0 tx=0).stop 2024-04-25T17:16:39.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.732+0000 7f573cd46700 1 -- 172.21.15.37:0/4125722963 shutdown_connections 2024-04-25T17:16:39.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.732+0000 7f573cd46700 1 --2- 172.21.15.37:0/4125722963 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f57200692b0 0x7f572006b760 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:39.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.732+0000 7f573cd46700 1 --2- 172.21.15.37:0/4125722963 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57380662c0 0x7f573810fc30 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:39.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.732+0000 7f573cd46700 1 --2- 172.21.15.37:0/4125722963 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57381022e0 0x7f5738110170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:39.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.732+0000 7f573cd46700 1 -- 172.21.15.37:0/4125722963 >> 172.21.15.37:0/4125722963 conn(0x7f57380f7430 msgr2=0x7f57380f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:16:39.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.732+0000 7f573cd46700 1 -- 172.21.15.37:0/4125722963 shutdown_connections 2024-04-25T17:16:39.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.732+0000 7f573cd46700 1 -- 172.21.15.37:0/4125722963 wait complete. 2024-04-25T17:16:39.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.841+0000 7f965caa7700 1 -- 172.21.15.37:0/2467338354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96580fcf10 msgr2=0x7f96580fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:39.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.841+0000 7f965caa7700 1 --2- 172.21.15.37:0/2467338354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96580fcf10 0x7f96580fd320 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9648009ce0 tx=0x7f9648004d10 comp rx=0 tx=0).stop 2024-04-25T17:16:39.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.841+0000 7f965caa7700 1 -- 172.21.15.37:0/2467338354 shutdown_connections 2024-04-25T17:16:39.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.841+0000 7f965caa7700 1 --2- 172.21.15.37:0/2467338354 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96580fe080 0x7f96580fe4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:39.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.841+0000 7f965caa7700 1 --2- 172.21.15.37:0/2467338354 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96580fcf10 0x7f96580fd320 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:39.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.841+0000 7f965caa7700 1 -- 172.21.15.37:0/2467338354 >> 172.21.15.37:0/2467338354 conn(0x7f96580f8560 msgr2=0x7f96580fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:16:39.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.841+0000 7f965caa7700 1 -- 172.21.15.37:0/2467338354 shutdown_connections 2024-04-25T17:16:39.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.841+0000 7f965caa7700 1 -- 172.21.15.37:0/2467338354 wait complete. 2024-04-25T17:16:39.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.842+0000 7f965caa7700 1 Processor -- start 2024-04-25T17:16:39.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.842+0000 7f965caa7700 1 -- start start 2024-04-25T17:16:39.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.842+0000 7f965caa7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96580fcf10 0x7f965810db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:39.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.842+0000 7f965caa7700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96580fe080 0x7f965810e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:39.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.842+0000 7f965caa7700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f965810e720 con 0x7f96580fcf10 2024-04-25T17:16:39.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.842+0000 7f965caa7700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f965810ef10 con 0x7f96580fe080 2024-04-25T17:16:39.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.842+0000 7f965659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96580fcf10 0x7f965810db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:39.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.842+0000 7f965659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96580fcf10 0x7f965810db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36078/0 (socket says 172.21.15.37:36078) 2024-04-25T17:16:39.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.842+0000 7f965659c700 1 -- 172.21.15.37:0/3016572466 learned_addr learned my addr 172.21.15.37:0/3016572466 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:16:39.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.842+0000 7f9655d9b700 1 --2- 172.21.15.37:0/3016572466 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96580fe080 0x7f965810e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:39.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.842+0000 7f965659c700 1 -- 172.21.15.37:0/3016572466 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96580fe080 msgr2=0x7f965810e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:39.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.842+0000 7f965659c700 1 --2- 172.21.15.37:0/3016572466 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96580fe080 0x7f965810e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:39.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.842+0000 7f965659c700 1 -- 172.21.15.37:0/3016572466 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9648009940 con 0x7f96580fcf10 2024-04-25T17:16:39.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.843+0000 7f965659c700 1 --2- 172.21.15.37:0/3016572466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96580fcf10 0x7f965810db50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9648004740 tx=0x7f9648004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:16:39.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.843+0000 7f964effd700 1 -- 172.21.15.37:0/3016572466 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f964800e040 con 0x7f96580fcf10 2024-04-25T17:16:39.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.843+0000 7f964effd700 1 -- 172.21.15.37:0/3016572466 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f96480128e0 con 0x7f96580fcf10 2024-04-25T17:16:39.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.843+0000 7f965caa7700 1 -- 172.21.15.37:0/3016572466 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f965810f190 con 0x7f96580fcf10 2024-04-25T17:16:39.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.843+0000 7f964effd700 1 -- 172.21.15.37:0/3016572466 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f964801ca80 con 0x7f96580fcf10 2024-04-25T17:16:39.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.843+0000 7f965caa7700 1 -- 172.21.15.37:0/3016572466 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f965810f750 con 0x7f96580fcf10 2024-04-25T17:16:39.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.844+0000 7f965caa7700 1 -- 172.21.15.37:0/3016572466 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f965805f5c0 con 0x7f96580fcf10 2024-04-25T17:16:39.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.844+0000 7f964effd700 1 -- 172.21.15.37:0/3016572466 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f9648012a50 con 0x7f96580fcf10 2024-04-25T17:16:39.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.845+0000 7f964effd700 1 --2- 172.21.15.37:0/3016572466 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f96440692a0 0x7f964406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:39.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.845+0000 7f964effd700 1 -- 172.21.15.37:0/3016572466 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f9648088ea0 con 0x7f96580fcf10 2024-04-25T17:16:39.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.845+0000 7f9655d9b700 1 --2- 172.21.15.37:0/3016572466 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f96440692a0 0x7f964406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:39.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.845+0000 7f9655d9b700 1 --2- 172.21.15.37:0/3016572466 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f96440692a0 0x7f964406b750 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9640006fd0 tx=0x7f9640008040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:16:39.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:39.849+0000 7f964effd700 1 -- 172.21.15.37:0/3016572466 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f9648058be0 con 0x7f96580fcf10 2024-04-25T17:16:40.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.110+0000 7f965caa7700 1 -- 172.21.15.37:0/3016572466 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f965804bed0 con 0x7f96580fcf10 2024-04-25T17:16:40.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.110+0000 7f964effd700 1 -- 172.21.15.37:0/3016572466 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1830 (secure 0 0 0) 0x7f9648020740 con 0x7f96580fcf10 2024-04-25T17:16:40.111 INFO:teuthology.orchestra.run.smithi037.stdout:e16 2024-04-25T17:16:40.112 INFO:teuthology.orchestra.run.smithi037.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-25T17:16:40.112 INFO:teuthology.orchestra.run.smithi037.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T17:16:40.112 INFO:teuthology.orchestra.run.smithi037.stdout:legacy client fscid: 1 2024-04-25T17:16:40.112 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:16:40.112 INFO:teuthology.orchestra.run.smithi037.stdout:Filesystem 'cephfs' (1) 2024-04-25T17:16:40.112 INFO:teuthology.orchestra.run.smithi037.stdout:fs_name cephfs 2024-04-25T17:16:40.112 INFO:teuthology.orchestra.run.smithi037.stdout:epoch 16 2024-04-25T17:16:40.112 INFO:teuthology.orchestra.run.smithi037.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-25T17:16:40.112 INFO:teuthology.orchestra.run.smithi037.stdout:created 2024-04-25T17:15:40.586130+0000 2024-04-25T17:16:40.112 INFO:teuthology.orchestra.run.smithi037.stdout:modified 2024-04-25T17:15:57.508740+0000 2024-04-25T17:16:40.112 INFO:teuthology.orchestra.run.smithi037.stdout:tableserver 0 2024-04-25T17:16:40.112 INFO:teuthology.orchestra.run.smithi037.stdout:root 0 2024-04-25T17:16:40.112 INFO:teuthology.orchestra.run.smithi037.stdout:session_timeout 60 2024-04-25T17:16:40.112 INFO:teuthology.orchestra.run.smithi037.stdout:session_autoclose 300 2024-04-25T17:16:40.113 INFO:teuthology.orchestra.run.smithi037.stdout:max_file_size 1099511627776 2024-04-25T17:16:40.113 INFO:teuthology.orchestra.run.smithi037.stdout:required_client_features {} 2024-04-25T17:16:40.113 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure 0 2024-04-25T17:16:40.113 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure_osd_epoch 0 2024-04-25T17:16:40.113 INFO:teuthology.orchestra.run.smithi037.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T17:16:40.113 INFO:teuthology.orchestra.run.smithi037.stdout:max_mds 1 2024-04-25T17:16:40.113 INFO:teuthology.orchestra.run.smithi037.stdout:in 0 2024-04-25T17:16:40.113 INFO:teuthology.orchestra.run.smithi037.stdout:up {0=14470} 2024-04-25T17:16:40.113 INFO:teuthology.orchestra.run.smithi037.stdout:failed 2024-04-25T17:16:40.113 INFO:teuthology.orchestra.run.smithi037.stdout:damaged 2024-04-25T17:16:40.113 INFO:teuthology.orchestra.run.smithi037.stdout:stopped 2024-04-25T17:16:40.113 INFO:teuthology.orchestra.run.smithi037.stdout:data_pools [3] 2024-04-25T17:16:40.113 INFO:teuthology.orchestra.run.smithi037.stdout:metadata_pool 2 2024-04-25T17:16:40.113 INFO:teuthology.orchestra.run.smithi037.stdout:inline_data disabled 2024-04-25T17:16:40.114 INFO:teuthology.orchestra.run.smithi037.stdout:balancer 2024-04-25T17:16:40.114 INFO:teuthology.orchestra.run.smithi037.stdout:standby_count_wanted 1 2024-04-25T17:16:40.114 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi037.ksmixc{0:14470} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.37:6826/1903989494,v1:172.21.15.37:6827/1903989494] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:16:40.114 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi037.ovkrpq{0:14482} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.37:6828/4206394422,v1:172.21.15.37:6829/4206394422] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:16:40.114 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:16:40.114 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:16:40.114 INFO:teuthology.orchestra.run.smithi037.stdout:Standby daemons: 2024-04-25T17:16:40.114 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:16:40.114 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi069.cpprst{-1:24289} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.69:6826/518856100,v1:172.21.15.69:6827/518856100] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:16:40.114 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi069.ytlqcf{-1:24293} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.69:6824/134210439,v1:172.21.15.69:6825/134210439] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:16:40.115 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.112+0000 7f965caa7700 1 -- 172.21.15.37:0/3016572466 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f96440692a0 msgr2=0x7f964406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:40.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.112+0000 7f965caa7700 1 --2- 172.21.15.37:0/3016572466 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f96440692a0 0x7f964406b750 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9640006fd0 tx=0x7f9640008040 comp rx=0 tx=0).stop 2024-04-25T17:16:40.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.112+0000 7f965caa7700 1 -- 172.21.15.37:0/3016572466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96580fcf10 msgr2=0x7f965810db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:40.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.112+0000 7f965caa7700 1 --2- 172.21.15.37:0/3016572466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96580fcf10 0x7f965810db50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9648004740 tx=0x7f9648004d10 comp rx=0 tx=0).stop 2024-04-25T17:16:40.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.112+0000 7f965caa7700 1 -- 172.21.15.37:0/3016572466 shutdown_connections 2024-04-25T17:16:40.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.112+0000 7f965caa7700 1 --2- 172.21.15.37:0/3016572466 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f96440692a0 0x7f964406b750 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:40.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.112+0000 7f965caa7700 1 --2- 172.21.15.37:0/3016572466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96580fcf10 0x7f965810db50 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:40.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.112+0000 7f965caa7700 1 --2- 172.21.15.37:0/3016572466 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96580fe080 0x7f965810e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:40.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.112+0000 7f965caa7700 1 -- 172.21.15.37:0/3016572466 >> 172.21.15.37:0/3016572466 conn(0x7f96580f8560 msgr2=0x7f96580f9b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:16:40.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.113+0000 7f965caa7700 1 -- 172.21.15.37:0/3016572466 shutdown_connections 2024-04-25T17:16:40.116 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.113+0000 7f965caa7700 1 -- 172.21.15.37:0/3016572466 wait complete. 2024-04-25T17:16:40.116 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 16 2024-04-25T17:16:40.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.224+0000 7fabc64f4700 1 -- 172.21.15.37:0/4053300326 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabc00662c0 msgr2=0x7fabc0101da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:40.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.224+0000 7fabc64f4700 1 --2- 172.21.15.37:0/4053300326 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabc00662c0 0x7fabc0101da0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fabb0004940 tx=0x7fabb0009e30 comp rx=0 tx=0).stop 2024-04-25T17:16:40.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.224+0000 7fabc64f4700 1 -- 172.21.15.37:0/4053300326 shutdown_connections 2024-04-25T17:16:40.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.224+0000 7fabc64f4700 1 --2- 172.21.15.37:0/4053300326 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fabc01022e0 0x7fabc01046c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:40.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.224+0000 7fabc64f4700 1 --2- 172.21.15.37:0/4053300326 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabc00662c0 0x7fabc0101da0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:40.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.224+0000 7fabc64f4700 1 -- 172.21.15.37:0/4053300326 >> 172.21.15.37:0/4053300326 conn(0x7fabc00f7430 msgr2=0x7fabc00f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:16:40.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.224+0000 7fabc64f4700 1 -- 172.21.15.37:0/4053300326 shutdown_connections 2024-04-25T17:16:40.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.224+0000 7fabc64f4700 1 -- 172.21.15.37:0/4053300326 wait complete. 2024-04-25T17:16:40.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.224+0000 7fabc64f4700 1 Processor -- start 2024-04-25T17:16:40.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.225+0000 7fabc64f4700 1 -- start start 2024-04-25T17:16:40.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.225+0000 7fabc64f4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabc00662c0 0x7fabc010fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:40.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.225+0000 7fabc64f4700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fabc01022e0 0x7fabc0110190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:40.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.225+0000 7fabc64f4700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc0110790 con 0x7fabc00662c0 2024-04-25T17:16:40.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.225+0000 7fabc64f4700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc0110fe0 con 0x7fabc01022e0 2024-04-25T17:16:40.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.225+0000 7fabbffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabc00662c0 0x7fabc010fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:40.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.225+0000 7fabbffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabc00662c0 0x7fabc010fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36100/0 (socket says 172.21.15.37:36100) 2024-04-25T17:16:40.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.225+0000 7fabbffff700 1 -- 172.21.15.37:0/1006750379 learned_addr learned my addr 172.21.15.37:0/1006750379 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:16:40.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.225+0000 7fabbf7fe700 1 --2- 172.21.15.37:0/1006750379 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fabc01022e0 0x7fabc0110190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:40.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.225+0000 7fabbffff700 1 -- 172.21.15.37:0/1006750379 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fabc01022e0 msgr2=0x7fabc0110190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:40.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.225+0000 7fabbffff700 1 --2- 172.21.15.37:0/1006750379 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fabc01022e0 0x7fabc0110190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:40.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.225+0000 7fabbffff700 1 -- 172.21.15.37:0/1006750379 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb0005040 con 0x7fabc00662c0 2024-04-25T17:16:40.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.225+0000 7fabbf7fe700 1 --2- 172.21.15.37:0/1006750379 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fabc01022e0 0x7fabc0110190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T17:16:40.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.225+0000 7fabbffff700 1 --2- 172.21.15.37:0/1006750379 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabc00662c0 0x7fabc010fc50 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fabb000b970 tx=0x7fabb0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:16:40.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.225+0000 7fabbcff9700 1 -- 172.21.15.37:0/1006750379 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabb000e040 con 0x7fabc00662c0 2024-04-25T17:16:40.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.226+0000 7fabbcff9700 1 -- 172.21.15.37:0/1006750379 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fabb000bcc0 con 0x7fabc00662c0 2024-04-25T17:16:40.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.226+0000 7fabc64f4700 1 -- 172.21.15.37:0/1006750379 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabc0111260 con 0x7fabc00662c0 2024-04-25T17:16:40.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.226+0000 7fabbcff9700 1 -- 172.21.15.37:0/1006750379 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabb0013660 con 0x7fabc00662c0 2024-04-25T17:16:40.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.226+0000 7fabc64f4700 1 -- 172.21.15.37:0/1006750379 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabc01117a0 con 0x7fabc00662c0 2024-04-25T17:16:40.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.226+0000 7fabc64f4700 1 -- 172.21.15.37:0/1006750379 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabc005f5c0 con 0x7fabc00662c0 2024-04-25T17:16:40.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.227+0000 7fabbcff9700 1 -- 172.21.15.37:0/1006750379 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fabb001ca00 con 0x7fabc00662c0 2024-04-25T17:16:40.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.227+0000 7fabbcff9700 1 --2- 172.21.15.37:0/1006750379 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7faba80692a0 0x7faba806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:40.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.228+0000 7fabbcff9700 1 -- 172.21.15.37:0/1006750379 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fabb0087db0 con 0x7fabc00662c0 2024-04-25T17:16:40.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.228+0000 7fabbf7fe700 1 --2- 172.21.15.37:0/1006750379 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7faba80692a0 0x7faba806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:40.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.228+0000 7fabbf7fe700 1 --2- 172.21.15.37:0/1006750379 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7faba80692a0 0x7faba806b750 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fabb4009fd0 tx=0x7fabb4009ee0 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:16:40.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.232+0000 7fabbcff9700 1 -- 172.21.15.37:0/1006750379 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fabb0057cc0 con 0x7fabc00662c0 2024-04-25T17:16:40.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.457+0000 7fabc64f4700 1 -- 172.21.15.37:0/1006750379 --> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fabc0111ad0 con 0x7faba80692a0 2024-04-25T17:16:40.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.458+0000 7fabbcff9700 1 -- 172.21.15.37:0/1006750379 <== mgr.14214 v2:172.21.15.37:6800/3566135606 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fabc0111ad0 con 0x7faba80692a0 2024-04-25T17:16:40.460 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-25T17:16:40.460 INFO:teuthology.orchestra.run.smithi037.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8", 2024-04-25T17:16:40.460 INFO:teuthology.orchestra.run.smithi037.stdout: "in_progress": true, 2024-04-25T17:16:40.460 INFO:teuthology.orchestra.run.smithi037.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-25T17:16:40.460 INFO:teuthology.orchestra.run.smithi037.stdout: "services_complete": [], 2024-04-25T17:16:40.460 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": "", 2024-04-25T17:16:40.460 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:994e2f20102a20fa9a27966c14b625cc01884df8 image", 2024-04-25T17:16:40.460 INFO:teuthology.orchestra.run.smithi037.stdout: "is_paused": false 2024-04-25T17:16:40.460 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-25T17:16:40.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.461+0000 7fabc64f4700 1 -- 172.21.15.37:0/1006750379 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7faba80692a0 msgr2=0x7faba806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:40.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.461+0000 7fabc64f4700 1 --2- 172.21.15.37:0/1006750379 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7faba80692a0 0x7faba806b750 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fabb4009fd0 tx=0x7fabb4009ee0 comp rx=0 tx=0).stop 2024-04-25T17:16:40.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.461+0000 7fabc64f4700 1 -- 172.21.15.37:0/1006750379 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabc00662c0 msgr2=0x7fabc010fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:40.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.461+0000 7fabc64f4700 1 --2- 172.21.15.37:0/1006750379 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabc00662c0 0x7fabc010fc50 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fabb000b970 tx=0x7fabb0009e30 comp rx=0 tx=0).stop 2024-04-25T17:16:40.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.461+0000 7fabc64f4700 1 -- 172.21.15.37:0/1006750379 shutdown_connections 2024-04-25T17:16:40.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.461+0000 7fabc64f4700 1 --2- 172.21.15.37:0/1006750379 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7faba80692a0 0x7faba806b750 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:40.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.461+0000 7fabc64f4700 1 --2- 172.21.15.37:0/1006750379 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabc00662c0 0x7fabc010fc50 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:40.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.461+0000 7fabc64f4700 1 --2- 172.21.15.37:0/1006750379 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fabc01022e0 0x7fabc0110190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:40.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.461+0000 7fabc64f4700 1 -- 172.21.15.37:0/1006750379 >> 172.21.15.37:0/1006750379 conn(0x7fabc00f7430 msgr2=0x7fabc00f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:16:40.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.461+0000 7fabc64f4700 1 -- 172.21.15.37:0/1006750379 shutdown_connections 2024-04-25T17:16:40.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.461+0000 7fabc64f4700 1 -- 172.21.15.37:0/1006750379 wait complete. 2024-04-25T17:16:40.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.572+0000 7fbca1ba8700 1 -- 172.21.15.37:0/4189801263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc9c0fe3e0 msgr2=0x7fbc9c0fe7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:40.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.572+0000 7fbca1ba8700 1 --2- 172.21.15.37:0/4189801263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc9c0fe3e0 0x7fbc9c0fe7f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c004940 tx=0x7fbc8c009e30 comp rx=0 tx=0).stop 2024-04-25T17:16:40.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.572+0000 7fbca1ba8700 1 -- 172.21.15.37:0/4189801263 shutdown_connections 2024-04-25T17:16:40.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.572+0000 7fbca1ba8700 1 --2- 172.21.15.37:0/4189801263 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc9c0fed30 0x7fbc9c0fae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:40.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.572+0000 7fbca1ba8700 1 --2- 172.21.15.37:0/4189801263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc9c0fe3e0 0x7fbc9c0fe7f0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:40.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.572+0000 7fbca1ba8700 1 -- 172.21.15.37:0/4189801263 >> 172.21.15.37:0/4189801263 conn(0x7fbc9c0f6b80 msgr2=0x7fbc9c0f8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:16:40.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.572+0000 7fbca1ba8700 1 -- 172.21.15.37:0/4189801263 shutdown_connections 2024-04-25T17:16:40.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.572+0000 7fbca1ba8700 1 -- 172.21.15.37:0/4189801263 wait complete. 2024-04-25T17:16:40.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.572+0000 7fbca1ba8700 1 Processor -- start 2024-04-25T17:16:40.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.573+0000 7fbca1ba8700 1 -- start start 2024-04-25T17:16:40.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.573+0000 7fbca1ba8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc9c0fe3e0 0x7fbc9c10da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:40.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.573+0000 7fbca1ba8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc9c0fed30 0x7fbc9c10df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:40.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.573+0000 7fbca1ba8700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9c10e560 con 0x7fbc9c0fed30 2024-04-25T17:16:40.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.573+0000 7fbca1ba8700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9c10edb0 con 0x7fbc9c0fe3e0 2024-04-25T17:16:40.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.573+0000 7fbc9affd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc9c0fed30 0x7fbc9c10df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:40.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.573+0000 7fbc9affd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc9c0fed30 0x7fbc9c10df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:36112/0 (socket says 172.21.15.37:36112) 2024-04-25T17:16:40.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.573+0000 7fbc9affd700 1 -- 172.21.15.37:0/3427868687 learned_addr learned my addr 172.21.15.37:0/3427868687 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:16:40.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.573+0000 7fbc9b7fe700 1 --2- 172.21.15.37:0/3427868687 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc9c0fe3e0 0x7fbc9c10da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:40.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.573+0000 7fbc9affd700 1 -- 172.21.15.37:0/3427868687 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc9c0fe3e0 msgr2=0x7fbc9c10da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:40.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.573+0000 7fbc9affd700 1 --2- 172.21.15.37:0/3427868687 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc9c0fe3e0 0x7fbc9c10da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:40.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.573+0000 7fbc9affd700 1 -- 172.21.15.37:0/3427868687 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc8c005040 con 0x7fbc9c0fed30 2024-04-25T17:16:40.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.573+0000 7fbc9affd700 1 --2- 172.21.15.37:0/3427868687 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc9c0fed30 0x7fbc9c10df60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fbc90002a50 tx=0x7fbc900046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:16:40.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.574+0000 7fbc83fff700 1 -- 172.21.15.37:0/3427868687 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc90007cc0 con 0x7fbc9c0fed30 2024-04-25T17:16:40.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.574+0000 7fbca1ba8700 1 -- 172.21.15.37:0/3427868687 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc9c10f090 con 0x7fbc9c0fed30 2024-04-25T17:16:40.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.574+0000 7fbc83fff700 1 -- 172.21.15.37:0/3427868687 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbc9000f040 con 0x7fbc9c0fed30 2024-04-25T17:16:40.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.574+0000 7fbc83fff700 1 -- 172.21.15.37:0/3427868687 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc9000da30 con 0x7fbc9c0fed30 2024-04-25T17:16:40.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.574+0000 7fbca1ba8700 1 -- 172.21.15.37:0/3427868687 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc9c10f5d0 con 0x7fbc9c0fed30 2024-04-25T17:16:40.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.575+0000 7fbca1ba8700 1 -- 172.21.15.37:0/3427868687 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc9c05f5c0 con 0x7fbc9c0fed30 2024-04-25T17:16:40.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.575+0000 7fbc83fff700 1 -- 172.21.15.37:0/3427868687 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fbc9000dbb0 con 0x7fbc9c0fed30 2024-04-25T17:16:40.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.576+0000 7fbc83fff700 1 --2- 172.21.15.37:0/3427868687 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fbc840692a0 0x7fbc8406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:16:40.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.576+0000 7fbc83fff700 1 -- 172.21.15.37:0/3427868687 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fbc90086f50 con 0x7fbc9c0fed30 2024-04-25T17:16:40.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.576+0000 7fbc9b7fe700 1 --2- 172.21.15.37:0/3427868687 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fbc840692a0 0x7fbc8406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:16:40.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.576+0000 7fbc9b7fe700 1 --2- 172.21.15.37:0/3427868687 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fbc840692a0 0x7fbc8406b750 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c00b970 tx=0x7fbc8c009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:16:40.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.580+0000 7fbc83fff700 1 -- 172.21.15.37:0/3427868687 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fbc90056c90 con 0x7fbc9c0fed30 2024-04-25T17:16:40.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:40 smithi069 ceph-mon[34527]: from='client.14572 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:16:40.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:40 smithi069 ceph-mon[34527]: from='client.14576 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:16:40.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:40 smithi069 ceph-mon[34527]: pgmap v206: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 426 B/s wr, 2 op/s 2024-04-25T17:16:40.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:40 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/4125722963' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:16:40.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:40 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/3016572466' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T17:16:40.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:40 smithi037 ceph-mon[26472]: from='client.14572 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:16:40.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:40 smithi037 ceph-mon[26472]: from='client.14576 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:16:40.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:40 smithi037 ceph-mon[26472]: pgmap v206: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 426 B/s wr, 2 op/s 2024-04-25T17:16:40.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:40 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/4125722963' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:16:40.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:40 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/3016572466' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T17:16:40.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.896+0000 7fbca1ba8700 1 -- 172.21.15.37:0/3427868687 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fbc9c04bed0 con 0x7fbc9c0fed30 2024-04-25T17:16:40.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.896+0000 7fbc83fff700 1 -- 172.21.15.37:0/3427868687 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fbc90056820 con 0x7fbc9c0fed30 2024-04-25T17:16:40.897 INFO:teuthology.orchestra.run.smithi037.stdout:HEALTH_OK 2024-04-25T17:16:40.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.898+0000 7fbca1ba8700 1 -- 172.21.15.37:0/3427868687 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fbc840692a0 msgr2=0x7fbc8406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:40.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.898+0000 7fbca1ba8700 1 --2- 172.21.15.37:0/3427868687 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fbc840692a0 0x7fbc8406b750 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c00b970 tx=0x7fbc8c009e30 comp rx=0 tx=0).stop 2024-04-25T17:16:40.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.898+0000 7fbca1ba8700 1 -- 172.21.15.37:0/3427868687 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc9c0fed30 msgr2=0x7fbc9c10df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:16:40.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.898+0000 7fbca1ba8700 1 --2- 172.21.15.37:0/3427868687 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc9c0fed30 0x7fbc9c10df60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fbc90002a50 tx=0x7fbc900046b0 comp rx=0 tx=0).stop 2024-04-25T17:16:40.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.898+0000 7fbca1ba8700 1 -- 172.21.15.37:0/3427868687 shutdown_connections 2024-04-25T17:16:40.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.898+0000 7fbca1ba8700 1 --2- 172.21.15.37:0/3427868687 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fbc840692a0 0x7fbc8406b750 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:40.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.898+0000 7fbca1ba8700 1 --2- 172.21.15.37:0/3427868687 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbc9c0fe3e0 0x7fbc9c10da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:40.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.898+0000 7fbca1ba8700 1 --2- 172.21.15.37:0/3427868687 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbc9c0fed30 0x7fbc9c10df60 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:16:40.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.898+0000 7fbca1ba8700 1 -- 172.21.15.37:0/3427868687 >> 172.21.15.37:0/3427868687 conn(0x7fbc9c0f6b80 msgr2=0x7fbc9c0f8280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:16:40.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.899+0000 7fbca1ba8700 1 -- 172.21.15.37:0/3427868687 shutdown_connections 2024-04-25T17:16:40.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:16:40.899+0000 7fbca1ba8700 1 -- 172.21.15.37:0/3427868687 wait complete. 2024-04-25T17:16:41.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:41 smithi069 ceph-mon[34527]: from='client.14588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:16:41.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:41 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:16:41.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:41 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/3427868687' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T17:16:41.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:41 smithi037 ceph-mon[26472]: from='client.14588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:16:41.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:41 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:16:41.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:41 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/3427868687' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T17:16:42.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:42 smithi069 ceph-mon[34527]: pgmap v207: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 426 B/s wr, 1 op/s 2024-04-25T17:16:42.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:42 smithi037 ceph-mon[26472]: pgmap v207: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 426 B/s wr, 1 op/s 2024-04-25T17:16:44.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:44 smithi069 ceph-mon[34527]: pgmap v208: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 426 B/s wr, 2 op/s 2024-04-25T17:16:45.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:44 smithi037 ceph-mon[26472]: pgmap v208: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 426 B/s wr, 2 op/s 2024-04-25T17:16:46.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:46 smithi069 ceph-mon[34527]: pgmap v209: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:16:47.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:46 smithi037 ceph-mon[26472]: pgmap v209: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:16:48.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:48 smithi069 ceph-mon[34527]: pgmap v210: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:16:49.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:48 smithi037 ceph-mon[26472]: pgmap v210: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:16:50.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:50 smithi069 ceph-mon[34527]: pgmap v211: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:16:51.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:50 smithi037 ceph-mon[26472]: pgmap v211: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:16:52.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:52 smithi069 ceph-mon[34527]: pgmap v212: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:16:53.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:52 smithi037 ceph-mon[26472]: pgmap v212: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:16:54.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:54 smithi069 ceph-mon[34527]: pgmap v213: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:16:55.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:54 smithi037 ceph-mon[26472]: pgmap v213: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:16:55.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:55 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:16:56.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:55 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:16:56.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:56 smithi069 ceph-mon[34527]: pgmap v214: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:16:57.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:56 smithi037 ceph-mon[26472]: pgmap v214: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:16:58.873 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:16:58 smithi037 ceph-mon[26472]: pgmap v215: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:16:58.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:16:58 smithi069 ceph-mon[34527]: pgmap v215: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:17:00.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:00 smithi069 ceph-mon[34527]: pgmap v216: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:17:01.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:00 smithi037 ceph-mon[26472]: pgmap v216: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:17:02.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:02 smithi069 ceph-mon[34527]: pgmap v217: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:17:03.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:02 smithi037 ceph-mon[26472]: pgmap v217: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:17:04.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:04 smithi069 ceph-mon[34527]: pgmap v218: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:17:05.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:04 smithi037 ceph-mon[26472]: pgmap v218: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:17:06.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:06 smithi069 ceph-mon[34527]: pgmap v219: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:17:07.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:06 smithi037 ceph-mon[26472]: pgmap v219: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:17:08.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:08 smithi069 ceph-mon[34527]: pgmap v220: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:17:09.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:08 smithi037 ceph-mon[26472]: pgmap v220: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:17:10.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:10 smithi069 ceph-mon[34527]: pgmap v221: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:17:10.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:10 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:17:10.976 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:10 smithi037 ceph-mon[26472]: pgmap v221: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:17:10.976 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:10 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:17:11.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.011+0000 7f6c7ce4b700 1 -- 172.21.15.37:0/484061503 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c780fcf70 msgr2=0x7f6c780fd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:17:11.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.011+0000 7f6c7ce4b700 1 --2- 172.21.15.37:0/484061503 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c780fcf70 0x7f6c780fd3e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c004940 tx=0x7f6c6c009e30 comp rx=0 tx=0).stop 2024-04-25T17:17:11.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.011+0000 7f6c7ce4b700 1 -- 172.21.15.37:0/484061503 shutdown_connections 2024-04-25T17:17:11.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.011+0000 7f6c7ce4b700 1 --2- 172.21.15.37:0/484061503 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c780fcf70 0x7f6c780fd3e0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:11.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.011+0000 7f6c7ce4b700 1 --2- 172.21.15.37:0/484061503 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c780fbcc0 0x7f6c780fc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:11.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.011+0000 7f6c7ce4b700 1 -- 172.21.15.37:0/484061503 >> 172.21.15.37:0/484061503 conn(0x7f6c780f7420 msgr2=0x7f6c780f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:17:11.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.011+0000 7f6c7ce4b700 1 -- 172.21.15.37:0/484061503 shutdown_connections 2024-04-25T17:17:11.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.011+0000 7f6c7ce4b700 1 -- 172.21.15.37:0/484061503 wait complete. 2024-04-25T17:17:11.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.012+0000 7f6c7ce4b700 1 Processor -- start 2024-04-25T17:17:11.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.012+0000 7f6c7ce4b700 1 -- start start 2024-04-25T17:17:11.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.012+0000 7f6c7ce4b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c780fbcc0 0x7f6c78110620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:17:11.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.012+0000 7f6c7ce4b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c780fcf70 0x7f6c78112b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:17:11.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.012+0000 7f6c7ce4b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c78066c20 con 0x7f6c780fbcc0 2024-04-25T17:17:11.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.012+0000 7f6c7ce4b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c78066d60 con 0x7f6c780fcf70 2024-04-25T17:17:11.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.012+0000 7f6c7659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c780fbcc0 0x7f6c78110620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:17:11.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.012+0000 7f6c7659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c780fbcc0 0x7f6c78110620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52530/0 (socket says 172.21.15.37:52530) 2024-04-25T17:17:11.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.012+0000 7f6c7659c700 1 -- 172.21.15.37:0/3649399156 learned_addr learned my addr 172.21.15.37:0/3649399156 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:17:11.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.012+0000 7f6c75d9b700 1 --2- 172.21.15.37:0/3649399156 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c780fcf70 0x7f6c78112b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:17:11.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.012+0000 7f6c7659c700 1 -- 172.21.15.37:0/3649399156 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c780fcf70 msgr2=0x7f6c78112b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:17:11.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.012+0000 7f6c7659c700 1 --2- 172.21.15.37:0/3649399156 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c780fcf70 0x7f6c78112b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:11.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.012+0000 7f6c7659c700 1 -- 172.21.15.37:0/3649399156 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c6c005040 con 0x7f6c780fbcc0 2024-04-25T17:17:11.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.012+0000 7f6c7659c700 1 --2- 172.21.15.37:0/3649399156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c780fbcc0 0x7f6c78110620 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6c6800eb40 tx=0x7f6c6800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:17:11.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.013+0000 7f6c66ffd700 1 -- 172.21.15.37:0/3649399156 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c68007cc0 con 0x7f6c780fbcc0 2024-04-25T17:17:11.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.013+0000 7f6c66ffd700 1 -- 172.21.15.37:0/3649399156 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6c6800f040 con 0x7f6c780fbcc0 2024-04-25T17:17:11.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.013+0000 7f6c7ce4b700 1 -- 172.21.15.37:0/3649399156 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c78113110 con 0x7f6c780fbcc0 2024-04-25T17:17:11.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.013+0000 7f6c66ffd700 1 -- 172.21.15.37:0/3649399156 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c6800ca10 con 0x7f6c780fbcc0 2024-04-25T17:17:11.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.013+0000 7f6c7ce4b700 1 -- 172.21.15.37:0/3649399156 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c781136d0 con 0x7f6c780fbcc0 2024-04-25T17:17:11.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.014+0000 7f6c7ce4b700 1 -- 172.21.15.37:0/3649399156 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c7805f5c0 con 0x7f6c780fbcc0 2024-04-25T17:17:11.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.014+0000 7f6c66ffd700 1 -- 172.21.15.37:0/3649399156 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f6c6800cc80 con 0x7f6c780fbcc0 2024-04-25T17:17:11.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.014+0000 7f6c66ffd700 1 --2- 172.21.15.37:0/3649399156 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f6c600692b0 0x7f6c6006b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:17:11.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.015+0000 7f6c66ffd700 1 -- 172.21.15.37:0/3649399156 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f6c68086d90 con 0x7f6c780fbcc0 2024-04-25T17:17:11.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.015+0000 7f6c75d9b700 1 --2- 172.21.15.37:0/3649399156 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f6c600692b0 0x7f6c6006b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:17:11.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.015+0000 7f6c75d9b700 1 --2- 172.21.15.37:0/3649399156 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f6c600692b0 0x7f6c6006b760 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c009fd0 tx=0x7f6c6c009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:17:11.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.023+0000 7f6c66ffd700 1 -- 172.21.15.37:0/3649399156 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f6c6804e250 con 0x7f6c780fbcc0 2024-04-25T17:17:11.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.258+0000 7f6c7ce4b700 1 -- 172.21.15.37:0/3649399156 --> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6c78101240 con 0x7f6c600692b0 2024-04-25T17:17:11.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.259+0000 7f6c66ffd700 1 -- 172.21.15.37:0/3649399156 <== mgr.14214 v2:172.21.15.37:6800/3566135606 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f6c78101240 con 0x7f6c600692b0 2024-04-25T17:17:11.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.261+0000 7f6c7ce4b700 1 -- 172.21.15.37:0/3649399156 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f6c600692b0 msgr2=0x7f6c6006b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:17:11.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.261+0000 7f6c7ce4b700 1 --2- 172.21.15.37:0/3649399156 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f6c600692b0 0x7f6c6006b760 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c009fd0 tx=0x7f6c6c009e30 comp rx=0 tx=0).stop 2024-04-25T17:17:11.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.261+0000 7f6c7ce4b700 1 -- 172.21.15.37:0/3649399156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c780fbcc0 msgr2=0x7f6c78110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:17:11.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.261+0000 7f6c7ce4b700 1 --2- 172.21.15.37:0/3649399156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c780fbcc0 0x7f6c78110620 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6c6800eb40 tx=0x7f6c6800b040 comp rx=0 tx=0).stop 2024-04-25T17:17:11.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.261+0000 7f6c7ce4b700 1 -- 172.21.15.37:0/3649399156 shutdown_connections 2024-04-25T17:17:11.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.261+0000 7f6c7ce4b700 1 --2- 172.21.15.37:0/3649399156 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f6c600692b0 0x7f6c6006b760 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:11.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.261+0000 7f6c7ce4b700 1 --2- 172.21.15.37:0/3649399156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c780fbcc0 0x7f6c78110620 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:11.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.261+0000 7f6c7ce4b700 1 --2- 172.21.15.37:0/3649399156 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c780fcf70 0x7f6c78112b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:11.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.261+0000 7f6c7ce4b700 1 -- 172.21.15.37:0/3649399156 >> 172.21.15.37:0/3649399156 conn(0x7f6c780f7420 msgr2=0x7f6c780f8aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:17:11.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.261+0000 7f6c7ce4b700 1 -- 172.21.15.37:0/3649399156 shutdown_connections 2024-04-25T17:17:11.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.262+0000 7f6c7ce4b700 1 -- 172.21.15.37:0/3649399156 wait complete. 2024-04-25T17:17:11.272 INFO:teuthology.orchestra.run.smithi037.stdout:true 2024-04-25T17:17:11.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.369+0000 7f3e0b2df700 1 -- 172.21.15.37:0/1835175426 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e040fcf60 msgr2=0x7f3e040fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:17:11.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.369+0000 7f3e0b2df700 1 --2- 172.21.15.37:0/1835175426 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e040fcf60 0x7f3e040fd3d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3df4004940 tx=0x7f3df4009e30 comp rx=0 tx=0).stop 2024-04-25T17:17:11.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.369+0000 7f3e0b2df700 1 -- 172.21.15.37:0/1835175426 shutdown_connections 2024-04-25T17:17:11.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.369+0000 7f3e0b2df700 1 --2- 172.21.15.37:0/1835175426 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e040fcf60 0x7f3e040fd3d0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:11.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.369+0000 7f3e0b2df700 1 --2- 172.21.15.37:0/1835175426 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3e040fbcb0 0x7f3e040fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:11.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.370+0000 7f3e0b2df700 1 -- 172.21.15.37:0/1835175426 >> 172.21.15.37:0/1835175426 conn(0x7f3e040f7430 msgr2=0x7f3e040f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:17:11.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.370+0000 7f3e0b2df700 1 -- 172.21.15.37:0/1835175426 shutdown_connections 2024-04-25T17:17:11.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.370+0000 7f3e0b2df700 1 -- 172.21.15.37:0/1835175426 wait complete. 2024-04-25T17:17:11.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.370+0000 7f3e0b2df700 1 Processor -- start 2024-04-25T17:17:11.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.370+0000 7f3e0b2df700 1 -- start start 2024-04-25T17:17:11.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.371+0000 7f3e0b2df700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3e040fbcb0 0x7f3e041106e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:17:11.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.371+0000 7f3e0b2df700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e040fcf60 0x7f3e04112c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:17:11.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.371+0000 7f3e0b2df700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e040662e0 con 0x7f3e040fcf60 2024-04-25T17:17:11.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.371+0000 7f3e0b2df700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e04066420 con 0x7f3e040fbcb0 2024-04-25T17:17:11.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.371+0000 7f3e0887a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e040fcf60 0x7f3e04112c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:17:11.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.371+0000 7f3e0887a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e040fcf60 0x7f3e04112c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52552/0 (socket says 172.21.15.37:52552) 2024-04-25T17:17:11.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.371+0000 7f3e0887a700 1 -- 172.21.15.37:0/3889492998 learned_addr learned my addr 172.21.15.37:0/3889492998 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:17:11.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.371+0000 7f3e0907b700 1 --2- 172.21.15.37:0/3889492998 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3e040fbcb0 0x7f3e041106e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:17:11.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.371+0000 7f3e0887a700 1 -- 172.21.15.37:0/3889492998 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3e040fbcb0 msgr2=0x7f3e041106e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:17:11.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.371+0000 7f3e0887a700 1 --2- 172.21.15.37:0/3889492998 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3e040fbcb0 0x7f3e041106e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:11.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.371+0000 7f3e0887a700 1 -- 172.21.15.37:0/3889492998 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df4005040 con 0x7f3e040fcf60 2024-04-25T17:17:11.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.371+0000 7f3e0887a700 1 --2- 172.21.15.37:0/3889492998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e040fcf60 0x7f3e04112c30 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3df4009150 tx=0x7f3df4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:17:11.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.371+0000 7f3df9ffb700 1 -- 172.21.15.37:0/3889492998 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3df400e040 con 0x7f3e040fcf60 2024-04-25T17:17:11.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.372+0000 7f3df9ffb700 1 -- 172.21.15.37:0/3889492998 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3df4004290 con 0x7f3e040fcf60 2024-04-25T17:17:11.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.372+0000 7f3e0b2df700 1 -- 172.21.15.37:0/3889492998 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e04113170 con 0x7f3e040fcf60 2024-04-25T17:17:11.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.372+0000 7f3df9ffb700 1 -- 172.21.15.37:0/3889492998 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3df401c630 con 0x7f3e040fcf60 2024-04-25T17:17:11.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.372+0000 7f3e0b2df700 1 -- 172.21.15.37:0/3889492998 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e041136e0 con 0x7f3e040fcf60 2024-04-25T17:17:11.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.373+0000 7f3e0b2df700 1 -- 172.21.15.37:0/3889492998 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e0405f5c0 con 0x7f3e040fcf60 2024-04-25T17:17:11.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.374+0000 7f3df9ffb700 1 -- 172.21.15.37:0/3889492998 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f3df400bbf0 con 0x7f3e040fcf60 2024-04-25T17:17:11.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.374+0000 7f3df9ffb700 1 --2- 172.21.15.37:0/3889492998 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f3df00692a0 0x7f3df006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:17:11.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.374+0000 7f3df9ffb700 1 -- 172.21.15.37:0/3889492998 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f3df4087e70 con 0x7f3e040fcf60 2024-04-25T17:17:11.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.374+0000 7f3e0907b700 1 --2- 172.21.15.37:0/3889492998 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f3df00692a0 0x7f3df006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:17:11.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.375+0000 7f3e0907b700 1 --2- 172.21.15.37:0/3889492998 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f3df00692a0 0x7f3df006b750 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3e04065f60 tx=0x7f3e0000b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:17:11.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.379+0000 7f3df9ffb700 1 -- 172.21.15.37:0/3889492998 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f3df40541a0 con 0x7f3e040fcf60 2024-04-25T17:17:11.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.638+0000 7f3e0b2df700 1 -- 172.21.15.37:0/3889492998 --> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3e04101250 con 0x7f3df00692a0 2024-04-25T17:17:11.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.639+0000 7f3df9ffb700 1 -- 172.21.15.37:0/3889492998 <== mgr.14214 v2:172.21.15.37:6800/3566135606 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f3e04101250 con 0x7f3df00692a0 2024-04-25T17:17:11.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.642+0000 7f3e0b2df700 1 -- 172.21.15.37:0/3889492998 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f3df00692a0 msgr2=0x7f3df006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:17:11.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.642+0000 7f3e0b2df700 1 --2- 172.21.15.37:0/3889492998 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f3df00692a0 0x7f3df006b750 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3e04065f60 tx=0x7f3e0000b040 comp rx=0 tx=0).stop 2024-04-25T17:17:11.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.642+0000 7f3e0b2df700 1 -- 172.21.15.37:0/3889492998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e040fcf60 msgr2=0x7f3e04112c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:17:11.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.642+0000 7f3e0b2df700 1 --2- 172.21.15.37:0/3889492998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e040fcf60 0x7f3e04112c30 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3df4009150 tx=0x7f3df4009e30 comp rx=0 tx=0).stop 2024-04-25T17:17:11.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.642+0000 7f3e0b2df700 1 -- 172.21.15.37:0/3889492998 shutdown_connections 2024-04-25T17:17:11.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.642+0000 7f3e0b2df700 1 --2- 172.21.15.37:0/3889492998 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f3df00692a0 0x7f3df006b750 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:11.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.642+0000 7f3e0b2df700 1 --2- 172.21.15.37:0/3889492998 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3e040fbcb0 0x7f3e041106e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:11.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.642+0000 7f3e0b2df700 1 --2- 172.21.15.37:0/3889492998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e040fcf60 0x7f3e04112c30 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:11.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.642+0000 7f3e0b2df700 1 -- 172.21.15.37:0/3889492998 >> 172.21.15.37:0/3889492998 conn(0x7f3e040f7430 msgr2=0x7f3e040f8ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:17:11.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.642+0000 7f3e0b2df700 1 -- 172.21.15.37:0/3889492998 shutdown_connections 2024-04-25T17:17:11.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.642+0000 7f3e0b2df700 1 -- 172.21.15.37:0/3889492998 wait complete. 2024-04-25T17:17:11.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.751+0000 7ff25a673700 1 -- 172.21.15.37:0/2597614619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2540fbcb0 msgr2=0x7ff2540fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:17:11.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.751+0000 7ff25a673700 1 --2- 172.21.15.37:0/2597614619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2540fbcb0 0x7ff2540fc0c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ff244004940 tx=0x7ff244009e30 comp rx=0 tx=0).stop 2024-04-25T17:17:11.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.751+0000 7ff25a673700 1 -- 172.21.15.37:0/2597614619 shutdown_connections 2024-04-25T17:17:11.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.751+0000 7ff25a673700 1 --2- 172.21.15.37:0/2597614619 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff2540fcf60 0x7ff2540fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:11.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.751+0000 7ff25a673700 1 --2- 172.21.15.37:0/2597614619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2540fbcb0 0x7ff2540fc0c0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:11.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.751+0000 7ff25a673700 1 -- 172.21.15.37:0/2597614619 >> 172.21.15.37:0/2597614619 conn(0x7ff2540f7430 msgr2=0x7ff2540f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:17:11.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.751+0000 7ff25a673700 1 -- 172.21.15.37:0/2597614619 shutdown_connections 2024-04-25T17:17:11.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.751+0000 7ff25a673700 1 -- 172.21.15.37:0/2597614619 wait complete. 2024-04-25T17:17:11.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.752+0000 7ff25a673700 1 Processor -- start 2024-04-25T17:17:11.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.752+0000 7ff25a673700 1 -- start start 2024-04-25T17:17:11.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.752+0000 7ff25a673700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2540fbcb0 0x7ff2540ffd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:17:11.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.752+0000 7ff25a673700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff2540fcf60 0x7ff2540fe2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:17:11.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.752+0000 7ff25a673700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2540fe830 con 0x7ff2540fbcb0 2024-04-25T17:17:11.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.752+0000 7ff25a673700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2540fe970 con 0x7ff2540fcf60 2024-04-25T17:17:11.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.752+0000 7ff253fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2540fbcb0 0x7ff2540ffd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:17:11.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.752+0000 7ff2537fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff2540fcf60 0x7ff2540fe2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:17:11.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.752+0000 7ff253fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2540fbcb0 0x7ff2540ffd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52572/0 (socket says 172.21.15.37:52572) 2024-04-25T17:17:11.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.752+0000 7ff253fff700 1 -- 172.21.15.37:0/3900614012 learned_addr learned my addr 172.21.15.37:0/3900614012 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:17:11.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.753+0000 7ff253fff700 1 -- 172.21.15.37:0/3900614012 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff2540fcf60 msgr2=0x7ff2540fe2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:17:11.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.753+0000 7ff253fff700 1 --2- 172.21.15.37:0/3900614012 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff2540fcf60 0x7ff2540fe2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:11.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.753+0000 7ff253fff700 1 -- 172.21.15.37:0/3900614012 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff244005040 con 0x7ff2540fbcb0 2024-04-25T17:17:11.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.753+0000 7ff253fff700 1 --2- 172.21.15.37:0/3900614012 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2540fbcb0 0x7ff2540ffd80 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff24400b3b0 tx=0x7ff244009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:17:11.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.753+0000 7ff250ff9700 1 -- 172.21.15.37:0/3900614012 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff24400e040 con 0x7ff2540fbcb0 2024-04-25T17:17:11.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.753+0000 7ff250ff9700 1 -- 172.21.15.37:0/3900614012 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff24400bbf0 con 0x7ff2540fbcb0 2024-04-25T17:17:11.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.753+0000 7ff25a673700 1 -- 172.21.15.37:0/3900614012 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2540febf0 con 0x7ff2540fbcb0 2024-04-25T17:17:11.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.753+0000 7ff250ff9700 1 -- 172.21.15.37:0/3900614012 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff24401c630 con 0x7ff2540fbcb0 2024-04-25T17:17:11.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.753+0000 7ff25a673700 1 -- 172.21.15.37:0/3900614012 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff254115a20 con 0x7ff2540fbcb0 2024-04-25T17:17:11.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.754+0000 7ff25a673700 1 -- 172.21.15.37:0/3900614012 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff254101af0 con 0x7ff2540fbcb0 2024-04-25T17:17:11.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.755+0000 7ff250ff9700 1 -- 172.21.15.37:0/3900614012 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7ff24400bd60 con 0x7ff2540fbcb0 2024-04-25T17:17:11.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.756+0000 7ff250ff9700 1 --2- 172.21.15.37:0/3900614012 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7ff23c0692a0 0x7ff23c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:17:11.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.756+0000 7ff250ff9700 1 -- 172.21.15.37:0/3900614012 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7ff244087d80 con 0x7ff2540fbcb0 2024-04-25T17:17:11.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.756+0000 7ff2537fe700 1 --2- 172.21.15.37:0/3900614012 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7ff23c0692a0 0x7ff23c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:17:11.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.756+0000 7ff2537fe700 1 --2- 172.21.15.37:0/3900614012 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7ff23c0692a0 0x7ff23c06b750 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff254100360 tx=0x7ff24800b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:17:11.760 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.760+0000 7ff250ff9700 1 -- 172.21.15.37:0/3900614012 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7ff244054150 con 0x7ff2540fbcb0 2024-04-25T17:17:11.972 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.972+0000 7ff25a673700 1 -- 172.21.15.37:0/3900614012 --> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff254104950 con 0x7ff23c0692a0 2024-04-25T17:17:11.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.984+0000 7ff250ff9700 1 -- 172.21.15.37:0/3900614012 <== mgr.14214 v2:172.21.15.37:6800/3566135606 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7ff24800f040 con 0x7ff23c0692a0 2024-04-25T17:17:11.984 INFO:teuthology.orchestra.run.smithi037.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-25T17:17:11.985 INFO:teuthology.orchestra.run.smithi037.stdout:alertmanager.smithi037 smithi037 *:9093,9094 running (5m) 62s ago 6m 26.6M - 0.25.0 c8568f914cd2 82eacf476143 2024-04-25T17:17:11.985 INFO:teuthology.orchestra.run.smithi037.stdout:crash.smithi037 smithi037 running (7m) 62s ago 7m 6656k - 17.2.7-902-gc61472c8 0de407c1b3af b3d152574e80 2024-04-25T17:17:11.985 INFO:teuthology.orchestra.run.smithi037.stdout:crash.smithi069 smithi069 running (6m) 68s ago 6m 6660k - 17.2.7-902-gc61472c8 0de407c1b3af aa6086c64cc3 2024-04-25T17:17:11.985 INFO:teuthology.orchestra.run.smithi037.stdout:grafana.smithi037 smithi037 *:3000 running (5m) 62s ago 6m 86.3M - 9.4.7 954c08fa6188 0a09ff60869f 2024-04-25T17:17:11.985 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi037.ksmixc smithi037 running (87s) 62s ago 87s 17.1M - 17.2.7-902-gc61472c8 0de407c1b3af 394aa56079b4 2024-04-25T17:17:11.985 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi037.ovkrpq smithi037 running (82s) 62s ago 81s 13.2M - 17.2.7-902-gc61472c8 0de407c1b3af 73ca662174a7 2024-04-25T17:17:11.985 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi069.cpprst smithi069 running (79s) 68s ago 79s 12.2M - 17.2.7-902-gc61472c8 0de407c1b3af dbda101df20e 2024-04-25T17:17:11.985 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi069.ytlqcf smithi069 running (84s) 68s ago 84s 10.4M - 17.2.7-902-gc61472c8 0de407c1b3af 911df6b18215 2024-04-25T17:17:11.985 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.smithi037.txrgxl smithi037 *:9283 running (8m) 62s ago 8m 480M - 17.2.7-902-gc61472c8 0de407c1b3af 796b326569c2 2024-04-25T17:17:11.985 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.smithi069.mmuhdo smithi069 *:8443,9283 running (5m) 68s ago 5m 431M - 17.2.7-902-gc61472c8 0de407c1b3af 32fa92400de4 2024-04-25T17:17:11.985 INFO:teuthology.orchestra.run.smithi037.stdout:mon.smithi037 smithi037 running (8m) 62s ago 8m 41.1M 2048M 17.2.7-902-gc61472c8 0de407c1b3af 5cfadcf8f2e4 2024-04-25T17:17:11.985 INFO:teuthology.orchestra.run.smithi037.stdout:mon.smithi069 smithi069 running (5m) 68s ago 5m 33.1M 2048M 17.2.7-902-gc61472c8 0de407c1b3af ffcd456d1dce 2024-04-25T17:17:11.985 INFO:teuthology.orchestra.run.smithi037.stdout:node-exporter.smithi037 smithi037 *:9100 running (7m) 62s ago 7m 14.2M - 1.5.0 0da6a335fe13 363761df1e06 2024-04-25T17:17:11.985 INFO:teuthology.orchestra.run.smithi037.stdout:node-exporter.smithi069 smithi069 *:9100 running (5m) 68s ago 5m 16.8M - 1.5.0 0da6a335fe13 5d407954c21f 2024-04-25T17:17:11.985 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0 smithi037 running (5m) 62s ago 5m 50.0M 4289M 17.2.7-902-gc61472c8 0de407c1b3af 8ff4b0f1aae9 2024-04-25T17:17:11.985 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1 smithi037 running (4m) 62s ago 4m 48.3M 4289M 17.2.7-902-gc61472c8 0de407c1b3af 5715a5da241d 2024-04-25T17:17:11.986 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2 smithi037 running (4m) 62s ago 4m 43.1M 4289M 17.2.7-902-gc61472c8 0de407c1b3af 2eedaf9886dd 2024-04-25T17:17:11.986 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3 smithi069 running (3m) 68s ago 3m 43.5M 5312M 17.2.7-902-gc61472c8 0de407c1b3af ebba78fb1923 2024-04-25T17:17:11.986 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4 smithi069 running (3m) 68s ago 3m 43.7M 5312M 17.2.7-902-gc61472c8 0de407c1b3af ba7b785c50f9 2024-04-25T17:17:11.986 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5 smithi069 running (2m) 68s ago 2m 44.5M 5312M 17.2.7-902-gc61472c8 0de407c1b3af f6be99c364ff 2024-04-25T17:17:11.986 INFO:teuthology.orchestra.run.smithi037.stdout:prometheus.smithi037 smithi037 *:9095 running (5m) 62s ago 6m 54.9M - 2.43.0 a07b618ecd1d 13d3c6f36732 2024-04-25T17:17:11.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.987+0000 7ff25a673700 1 -- 172.21.15.37:0/3900614012 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7ff23c0692a0 msgr2=0x7ff23c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:17:11.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.987+0000 7ff25a673700 1 --2- 172.21.15.37:0/3900614012 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7ff23c0692a0 0x7ff23c06b750 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff254100360 tx=0x7ff24800b040 comp rx=0 tx=0).stop 2024-04-25T17:17:11.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.987+0000 7ff25a673700 1 -- 172.21.15.37:0/3900614012 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2540fbcb0 msgr2=0x7ff2540ffd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:17:11.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.987+0000 7ff25a673700 1 --2- 172.21.15.37:0/3900614012 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2540fbcb0 0x7ff2540ffd80 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff24400b3b0 tx=0x7ff244009e30 comp rx=0 tx=0).stop 2024-04-25T17:17:11.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.987+0000 7ff25a673700 1 -- 172.21.15.37:0/3900614012 shutdown_connections 2024-04-25T17:17:11.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.987+0000 7ff25a673700 1 --2- 172.21.15.37:0/3900614012 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7ff23c0692a0 0x7ff23c06b750 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:11.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.987+0000 7ff25a673700 1 --2- 172.21.15.37:0/3900614012 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2540fbcb0 0x7ff2540ffd80 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:11.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.987+0000 7ff25a673700 1 --2- 172.21.15.37:0/3900614012 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff2540fcf60 0x7ff2540fe2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:11.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.987+0000 7ff25a673700 1 -- 172.21.15.37:0/3900614012 >> 172.21.15.37:0/3900614012 conn(0x7ff2540f7430 msgr2=0x7ff254065ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:17:11.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.987+0000 7ff25a673700 1 -- 172.21.15.37:0/3900614012 shutdown_connections 2024-04-25T17:17:11.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:11.987+0000 7ff25a673700 1 -- 172.21.15.37:0/3900614012 wait complete. 2024-04-25T17:17:12.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.097+0000 7f0c47724700 1 -- 172.21.15.37:0/1431577142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c400662c0 msgr2=0x7f0c400ff9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:17:12.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.097+0000 7f0c47724700 1 --2- 172.21.15.37:0/1431577142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c400662c0 0x7f0c400ff9a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c004940 tx=0x7f0c3c009e30 comp rx=0 tx=0).stop 2024-04-25T17:17:12.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.097+0000 7f0c47724700 1 -- 172.21.15.37:0/1431577142 shutdown_connections 2024-04-25T17:17:12.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.097+0000 7f0c47724700 1 --2- 172.21.15.37:0/1431577142 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0c400ffee0 0x7f0c40102300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:12.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.097+0000 7f0c47724700 1 --2- 172.21.15.37:0/1431577142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c400662c0 0x7f0c400ff9a0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:12.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.097+0000 7f0c47724700 1 -- 172.21.15.37:0/1431577142 >> 172.21.15.37:0/1431577142 conn(0x7f0c400f7430 msgr2=0x7f0c400f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:17:12.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.097+0000 7f0c47724700 1 -- 172.21.15.37:0/1431577142 shutdown_connections 2024-04-25T17:17:12.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.097+0000 7f0c47724700 1 -- 172.21.15.37:0/1431577142 wait complete. 2024-04-25T17:17:12.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.098+0000 7f0c47724700 1 Processor -- start 2024-04-25T17:17:12.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.098+0000 7f0c47724700 1 -- start start 2024-04-25T17:17:12.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.098+0000 7f0c47724700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0c400662c0 0x7f0c4010d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:17:12.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.098+0000 7f0c47724700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c400ffee0 0x7f0c4010df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:17:12.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.098+0000 7f0c47724700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4010e520 con 0x7f0c400ffee0 2024-04-25T17:17:12.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.098+0000 7f0c47724700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4010ed20 con 0x7f0c400662c0 2024-04-25T17:17:12.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.098+0000 7f0c44cbf700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c400ffee0 0x7f0c4010df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:17:12.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.098+0000 7f0c44cbf700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c400ffee0 0x7f0c4010df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52600/0 (socket says 172.21.15.37:52600) 2024-04-25T17:17:12.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.098+0000 7f0c44cbf700 1 -- 172.21.15.37:0/2253741846 learned_addr learned my addr 172.21.15.37:0/2253741846 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:17:12.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.098+0000 7f0c454c0700 1 --2- 172.21.15.37:0/2253741846 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0c400662c0 0x7f0c4010d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:17:12.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.098+0000 7f0c44cbf700 1 -- 172.21.15.37:0/2253741846 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0c400662c0 msgr2=0x7f0c4010d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:17:12.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.098+0000 7f0c44cbf700 1 --2- 172.21.15.37:0/2253741846 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0c400662c0 0x7f0c4010d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:12.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.098+0000 7f0c44cbf700 1 -- 172.21.15.37:0/2253741846 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c3c005040 con 0x7f0c400ffee0 2024-04-25T17:17:12.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.099+0000 7f0c44cbf700 1 --2- 172.21.15.37:0/2253741846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c400ffee0 0x7f0c4010df20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0c3000eb40 tx=0x7f0c3000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:17:12.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.099+0000 7f0c35ffb700 1 -- 172.21.15.37:0/2253741846 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c30007cc0 con 0x7f0c400ffee0 2024-04-25T17:17:12.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.099+0000 7f0c35ffb700 1 -- 172.21.15.37:0/2253741846 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0c3000f040 con 0x7f0c400ffee0 2024-04-25T17:17:12.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.099+0000 7f0c35ffb700 1 -- 172.21.15.37:0/2253741846 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c3000ca10 con 0x7f0c400ffee0 2024-04-25T17:17:12.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.099+0000 7f0c47724700 1 -- 172.21.15.37:0/2253741846 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c4010efa0 con 0x7f0c400ffee0 2024-04-25T17:17:12.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.099+0000 7f0c47724700 1 -- 172.21.15.37:0/2253741846 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c4010f4e0 con 0x7f0c400ffee0 2024-04-25T17:17:12.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.100+0000 7f0c47724700 1 -- 172.21.15.37:0/2253741846 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c4005f5c0 con 0x7f0c400ffee0 2024-04-25T17:17:12.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.100+0000 7f0c35ffb700 1 -- 172.21.15.37:0/2253741846 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f0c3000cc80 con 0x7f0c400ffee0 2024-04-25T17:17:12.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.101+0000 7f0c35ffb700 1 --2- 172.21.15.37:0/2253741846 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f0c2c0692a0 0x7f0c2c06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:17:12.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.101+0000 7f0c35ffb700 1 -- 172.21.15.37:0/2253741846 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f0c30086d90 con 0x7f0c400ffee0 2024-04-25T17:17:12.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.101+0000 7f0c454c0700 1 --2- 172.21.15.37:0/2253741846 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f0c2c0692a0 0x7f0c2c06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:17:12.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.101+0000 7f0c454c0700 1 --2- 172.21.15.37:0/2253741846 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f0c2c0692a0 0x7f0c2c06b750 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c004890 tx=0x7f0c3c009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:17:12.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.105+0000 7f0c35ffb700 1 -- 172.21.15.37:0/2253741846 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f0c3004e250 con 0x7f0c400ffee0 2024-04-25T17:17:12.321 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:12 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:17:12.321 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:12 smithi037 ceph-mon[26472]: Upgrade: Target is version 19.0.0-3291-g994e2f20 (unknown) 2024-04-25T17:17:12.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:12 smithi037 ceph-mon[26472]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, digests ['quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385'] 2024-04-25T17:17:12.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:12 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:17:12.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:12 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:17:12.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:12 smithi037 ceph-mon[26472]: Upgrade: Need to upgrade myself (mgr.smithi037.txrgxl) 2024-04-25T17:17:12.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:12 smithi037 ceph-mon[26472]: from='client.14596 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:17:12.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:12 smithi037 ceph-mon[26472]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 on smithi069 2024-04-25T17:17:12.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:12 smithi037 ceph-mon[26472]: pgmap v222: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:17:12.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:12 smithi037 ceph-mon[26472]: from='client.14600 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:17:12.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.387+0000 7f0c47724700 1 -- 172.21.15.37:0/2253741846 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0c4004bed0 con 0x7f0c400ffee0 2024-04-25T17:17:12.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.387+0000 7f0c35ffb700 1 -- 172.21.15.37:0/2253741846 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f0c30056b80 con 0x7f0c400ffee0 2024-04-25T17:17:12.388 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-25T17:17:12.388 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": { 2024-04-25T17:17:12.388 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 2 2024-04-25T17:17:12.388 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:17:12.388 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": { 2024-04-25T17:17:12.388 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 2 2024-04-25T17:17:12.388 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:17:12.388 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": { 2024-04-25T17:17:12.388 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 6 2024-04-25T17:17:12.388 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:17:12.388 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": { 2024-04-25T17:17:12.389 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 4 2024-04-25T17:17:12.389 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:17:12.389 INFO:teuthology.orchestra.run.smithi037.stdout: "overall": { 2024-04-25T17:17:12.389 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 14 2024-04-25T17:17:12.389 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-04-25T17:17:12.389 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-25T17:17:12.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.390+0000 7f0c47724700 1 -- 172.21.15.37:0/2253741846 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f0c2c0692a0 msgr2=0x7f0c2c06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:17:12.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.390+0000 7f0c47724700 1 --2- 172.21.15.37:0/2253741846 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f0c2c0692a0 0x7f0c2c06b750 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c004890 tx=0x7f0c3c009e30 comp rx=0 tx=0).stop 2024-04-25T17:17:12.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.390+0000 7f0c47724700 1 -- 172.21.15.37:0/2253741846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c400ffee0 msgr2=0x7f0c4010df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:17:12.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.390+0000 7f0c47724700 1 --2- 172.21.15.37:0/2253741846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c400ffee0 0x7f0c4010df20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0c3000eb40 tx=0x7f0c3000b040 comp rx=0 tx=0).stop 2024-04-25T17:17:12.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.390+0000 7f0c47724700 1 -- 172.21.15.37:0/2253741846 shutdown_connections 2024-04-25T17:17:12.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.390+0000 7f0c47724700 1 --2- 172.21.15.37:0/2253741846 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f0c2c0692a0 0x7f0c2c06b750 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:12.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.390+0000 7f0c47724700 1 --2- 172.21.15.37:0/2253741846 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0c400662c0 0x7f0c4010d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:12.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.390+0000 7f0c47724700 1 --2- 172.21.15.37:0/2253741846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c400ffee0 0x7f0c4010df20 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:12.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.390+0000 7f0c47724700 1 -- 172.21.15.37:0/2253741846 >> 172.21.15.37:0/2253741846 conn(0x7f0c400f7430 msgr2=0x7f0c400f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:17:12.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.390+0000 7f0c47724700 1 -- 172.21.15.37:0/2253741846 shutdown_connections 2024-04-25T17:17:12.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.390+0000 7f0c47724700 1 -- 172.21.15.37:0/2253741846 wait complete. 2024-04-25T17:17:12.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:12 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:17:12.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:12 smithi069 ceph-mon[34527]: Upgrade: Target is version 19.0.0-3291-g994e2f20 (unknown) 2024-04-25T17:17:12.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:12 smithi069 ceph-mon[34527]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, digests ['quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385'] 2024-04-25T17:17:12.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:12 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:17:12.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:12 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:17:12.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:12 smithi069 ceph-mon[34527]: Upgrade: Need to upgrade myself (mgr.smithi037.txrgxl) 2024-04-25T17:17:12.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:12 smithi069 ceph-mon[34527]: from='client.14596 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:17:12.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:12 smithi069 ceph-mon[34527]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 on smithi069 2024-04-25T17:17:12.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:12 smithi069 ceph-mon[34527]: pgmap v222: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:17:12.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:12 smithi069 ceph-mon[34527]: from='client.14600 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:17:12.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.496+0000 7f1fd95e2700 1 -- 172.21.15.37:0/2295786244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fd40fce60 msgr2=0x7f1fd40fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:17:12.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.496+0000 7f1fd95e2700 1 --2- 172.21.15.37:0/2295786244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fd40fce60 0x7f1fd40fd270 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4004940 tx=0x7f1fc4009e30 comp rx=0 tx=0).stop 2024-04-25T17:17:12.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.496+0000 7f1fd95e2700 1 -- 172.21.15.37:0/2295786244 shutdown_connections 2024-04-25T17:17:12.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.496+0000 7f1fd95e2700 1 --2- 172.21.15.37:0/2295786244 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1fd40fdfd0 0x7f1fd40fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:12.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.496+0000 7f1fd95e2700 1 --2- 172.21.15.37:0/2295786244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fd40fce60 0x7f1fd40fd270 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:12.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.496+0000 7f1fd95e2700 1 -- 172.21.15.37:0/2295786244 >> 172.21.15.37:0/2295786244 conn(0x7f1fd40f8540 msgr2=0x7f1fd40fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:17:12.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.496+0000 7f1fd95e2700 1 -- 172.21.15.37:0/2295786244 shutdown_connections 2024-04-25T17:17:12.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.496+0000 7f1fd95e2700 1 -- 172.21.15.37:0/2295786244 wait complete. 2024-04-25T17:17:12.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.497+0000 7f1fd95e2700 1 Processor -- start 2024-04-25T17:17:12.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.497+0000 7f1fd95e2700 1 -- start start 2024-04-25T17:17:12.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.497+0000 7f1fd95e2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fd40fce60 0x7f1fd410d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:17:12.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.497+0000 7f1fd95e2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1fd40fdfd0 0x7f1fd410de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:17:12.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.497+0000 7f1fd2ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fd40fce60 0x7f1fd410d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:17:12.498 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.497+0000 7f1fd2ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fd40fce60 0x7f1fd410d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52626/0 (socket says 172.21.15.37:52626) 2024-04-25T17:17:12.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.497+0000 7f1fd95e2700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd410e440 con 0x7f1fd40fce60 2024-04-25T17:17:12.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.497+0000 7f1fd2ffd700 1 -- 172.21.15.37:0/69775937 learned_addr learned my addr 172.21.15.37:0/69775937 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:17:12.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.497+0000 7f1fd27fc700 1 --2- 172.21.15.37:0/69775937 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1fd40fdfd0 0x7f1fd410de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:17:12.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.497+0000 7f1fd95e2700 1 -- 172.21.15.37:0/69775937 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd410e5b0 con 0x7f1fd40fdfd0 2024-04-25T17:17:12.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.498+0000 7f1fd2ffd700 1 -- 172.21.15.37:0/69775937 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1fd40fdfd0 msgr2=0x7f1fd410de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:17:12.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.498+0000 7f1fd2ffd700 1 --2- 172.21.15.37:0/69775937 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1fd40fdfd0 0x7f1fd410de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:12.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.498+0000 7f1fd2ffd700 1 -- 172.21.15.37:0/69775937 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc4005040 con 0x7f1fd40fce60 2024-04-25T17:17:12.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.498+0000 7f1fd2ffd700 1 --2- 172.21.15.37:0/69775937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fd40fce60 0x7f1fd410d900 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4013870 tx=0x7f1fc4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:17:12.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.498+0000 7f1fbb7fe700 1 -- 172.21.15.37:0/69775937 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fc4021070 con 0x7f1fd40fce60 2024-04-25T17:17:12.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.498+0000 7f1fbb7fe700 1 -- 172.21.15.37:0/69775937 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1fc4009430 con 0x7f1fd40fce60 2024-04-25T17:17:12.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.498+0000 7f1fd95e2700 1 -- 172.21.15.37:0/69775937 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fd4112fb0 con 0x7f1fd40fce60 2024-04-25T17:17:12.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.498+0000 7f1fbb7fe700 1 -- 172.21.15.37:0/69775937 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fc400e070 con 0x7f1fd40fce60 2024-04-25T17:17:12.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.498+0000 7f1fd95e2700 1 -- 172.21.15.37:0/69775937 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fd4113460 con 0x7f1fd40fce60 2024-04-25T17:17:12.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.499+0000 7f1fd95e2700 1 -- 172.21.15.37:0/69775937 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fd404c710 con 0x7f1fd40fce60 2024-04-25T17:17:12.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.500+0000 7f1fbb7fe700 1 -- 172.21.15.37:0/69775937 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f1fc401c750 con 0x7f1fd40fce60 2024-04-25T17:17:12.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.500+0000 7f1fbb7fe700 1 --2- 172.21.15.37:0/69775937 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f1fbc069240 0x7f1fbc06b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:17:12.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.500+0000 7f1fbb7fe700 1 -- 172.21.15.37:0/69775937 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f1fc4088460 con 0x7f1fd40fce60 2024-04-25T17:17:12.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.500+0000 7f1fd27fc700 1 --2- 172.21.15.37:0/69775937 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f1fbc069240 0x7f1fbc06b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:17:12.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.501+0000 7f1fd27fc700 1 --2- 172.21.15.37:0/69775937 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f1fbc069240 0x7f1fbc06b6f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1fc8009b80 tx=0x7f1fc800b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:17:12.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.505+0000 7f1fbb7fe700 1 -- 172.21.15.37:0/69775937 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f1fc4058220 con 0x7f1fd40fce60 2024-04-25T17:17:12.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.758+0000 7f1fd95e2700 1 -- 172.21.15.37:0/69775937 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1fd41058e0 con 0x7f1fd40fce60 2024-04-25T17:17:12.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.759+0000 7f1fbb7fe700 1 -- 172.21.15.37:0/69775937 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1830 (secure 0 0 0) 0x7f1fc4057db0 con 0x7f1fd40fce60 2024-04-25T17:17:12.759 INFO:teuthology.orchestra.run.smithi037.stdout:e16 2024-04-25T17:17:12.759 INFO:teuthology.orchestra.run.smithi037.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-25T17:17:12.759 INFO:teuthology.orchestra.run.smithi037.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T17:17:12.759 INFO:teuthology.orchestra.run.smithi037.stdout:legacy client fscid: 1 2024-04-25T17:17:12.760 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:17:12.760 INFO:teuthology.orchestra.run.smithi037.stdout:Filesystem 'cephfs' (1) 2024-04-25T17:17:12.760 INFO:teuthology.orchestra.run.smithi037.stdout:fs_name cephfs 2024-04-25T17:17:12.760 INFO:teuthology.orchestra.run.smithi037.stdout:epoch 16 2024-04-25T17:17:12.760 INFO:teuthology.orchestra.run.smithi037.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-25T17:17:12.760 INFO:teuthology.orchestra.run.smithi037.stdout:created 2024-04-25T17:15:40.586130+0000 2024-04-25T17:17:12.760 INFO:teuthology.orchestra.run.smithi037.stdout:modified 2024-04-25T17:15:57.508740+0000 2024-04-25T17:17:12.760 INFO:teuthology.orchestra.run.smithi037.stdout:tableserver 0 2024-04-25T17:17:12.760 INFO:teuthology.orchestra.run.smithi037.stdout:root 0 2024-04-25T17:17:12.760 INFO:teuthology.orchestra.run.smithi037.stdout:session_timeout 60 2024-04-25T17:17:12.760 INFO:teuthology.orchestra.run.smithi037.stdout:session_autoclose 300 2024-04-25T17:17:12.760 INFO:teuthology.orchestra.run.smithi037.stdout:max_file_size 1099511627776 2024-04-25T17:17:12.760 INFO:teuthology.orchestra.run.smithi037.stdout:required_client_features {} 2024-04-25T17:17:12.760 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure 0 2024-04-25T17:17:12.760 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure_osd_epoch 0 2024-04-25T17:17:12.760 INFO:teuthology.orchestra.run.smithi037.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T17:17:12.761 INFO:teuthology.orchestra.run.smithi037.stdout:max_mds 1 2024-04-25T17:17:12.761 INFO:teuthology.orchestra.run.smithi037.stdout:in 0 2024-04-25T17:17:12.761 INFO:teuthology.orchestra.run.smithi037.stdout:up {0=14470} 2024-04-25T17:17:12.761 INFO:teuthology.orchestra.run.smithi037.stdout:failed 2024-04-25T17:17:12.761 INFO:teuthology.orchestra.run.smithi037.stdout:damaged 2024-04-25T17:17:12.761 INFO:teuthology.orchestra.run.smithi037.stdout:stopped 2024-04-25T17:17:12.761 INFO:teuthology.orchestra.run.smithi037.stdout:data_pools [3] 2024-04-25T17:17:12.761 INFO:teuthology.orchestra.run.smithi037.stdout:metadata_pool 2 2024-04-25T17:17:12.761 INFO:teuthology.orchestra.run.smithi037.stdout:inline_data disabled 2024-04-25T17:17:12.761 INFO:teuthology.orchestra.run.smithi037.stdout:balancer 2024-04-25T17:17:12.761 INFO:teuthology.orchestra.run.smithi037.stdout:standby_count_wanted 1 2024-04-25T17:17:12.761 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi037.ksmixc{0:14470} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.37:6826/1903989494,v1:172.21.15.37:6827/1903989494] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:17:12.761 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi037.ovkrpq{0:14482} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.37:6828/4206394422,v1:172.21.15.37:6829/4206394422] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:17:12.761 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:17:12.761 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:17:12.761 INFO:teuthology.orchestra.run.smithi037.stdout:Standby daemons: 2024-04-25T17:17:12.761 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:17:12.762 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi069.cpprst{-1:24289} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.69:6826/518856100,v1:172.21.15.69:6827/518856100] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:17:12.762 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi069.ytlqcf{-1:24293} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.69:6824/134210439,v1:172.21.15.69:6825/134210439] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:17:12.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.761+0000 7f1fd95e2700 1 -- 172.21.15.37:0/69775937 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f1fbc069240 msgr2=0x7f1fbc06b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:17:12.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.761+0000 7f1fd95e2700 1 --2- 172.21.15.37:0/69775937 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f1fbc069240 0x7f1fbc06b6f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1fc8009b80 tx=0x7f1fc800b040 comp rx=0 tx=0).stop 2024-04-25T17:17:12.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.761+0000 7f1fd95e2700 1 -- 172.21.15.37:0/69775937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fd40fce60 msgr2=0x7f1fd410d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:17:12.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.761+0000 7f1fd95e2700 1 --2- 172.21.15.37:0/69775937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fd40fce60 0x7f1fd410d900 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1fc4013870 tx=0x7f1fc4009e30 comp rx=0 tx=0).stop 2024-04-25T17:17:12.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.761+0000 7f1fd95e2700 1 -- 172.21.15.37:0/69775937 shutdown_connections 2024-04-25T17:17:12.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.761+0000 7f1fd95e2700 1 --2- 172.21.15.37:0/69775937 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f1fbc069240 0x7f1fbc06b6f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:12.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.761+0000 7f1fd95e2700 1 --2- 172.21.15.37:0/69775937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fd40fce60 0x7f1fd410d900 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:12.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.761+0000 7f1fd95e2700 1 --2- 172.21.15.37:0/69775937 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1fd40fdfd0 0x7f1fd410de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:12.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.761+0000 7f1fd95e2700 1 -- 172.21.15.37:0/69775937 >> 172.21.15.37:0/69775937 conn(0x7f1fd40f8540 msgr2=0x7f1fd40f9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:17:12.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.762+0000 7f1fd95e2700 1 -- 172.21.15.37:0/69775937 shutdown_connections 2024-04-25T17:17:12.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.762+0000 7f1fd95e2700 1 -- 172.21.15.37:0/69775937 wait complete. 2024-04-25T17:17:12.763 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 16 2024-04-25T17:17:12.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.872+0000 7f7fd676f700 1 -- 172.21.15.37:0/182433475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fd00fbcb0 msgr2=0x7f7fd00fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:17:12.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.872+0000 7f7fd676f700 1 --2- 172.21.15.37:0/182433475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fd00fbcb0 0x7f7fd00fc0c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0004940 tx=0x7f7fc0009e30 comp rx=0 tx=0).stop 2024-04-25T17:17:12.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.872+0000 7f7fd676f700 1 -- 172.21.15.37:0/182433475 shutdown_connections 2024-04-25T17:17:12.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.872+0000 7f7fd676f700 1 --2- 172.21.15.37:0/182433475 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7fd00fcf60 0x7f7fd00fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:12.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.872+0000 7f7fd676f700 1 --2- 172.21.15.37:0/182433475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fd00fbcb0 0x7f7fd00fc0c0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:12.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.872+0000 7f7fd676f700 1 -- 172.21.15.37:0/182433475 >> 172.21.15.37:0/182433475 conn(0x7f7fd00f7430 msgr2=0x7f7fd00f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:17:12.874 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.872+0000 7f7fd676f700 1 -- 172.21.15.37:0/182433475 shutdown_connections 2024-04-25T17:17:12.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.872+0000 7f7fd676f700 1 -- 172.21.15.37:0/182433475 wait complete. 2024-04-25T17:17:12.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.873+0000 7f7fd676f700 1 Processor -- start 2024-04-25T17:17:12.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.873+0000 7f7fd676f700 1 -- start start 2024-04-25T17:17:12.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.873+0000 7f7fd676f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7fd00fbcb0 0x7f7fd0110680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:17:12.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.873+0000 7f7fd676f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fd00fcf60 0x7f7fd0112bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:17:12.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.873+0000 7f7fd676f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd0066340 con 0x7f7fd00fcf60 2024-04-25T17:17:12.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.873+0000 7f7fd676f700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd0066480 con 0x7f7fd00fbcb0 2024-04-25T17:17:12.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.874+0000 7f7fcf7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fd00fcf60 0x7f7fd0112bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:17:12.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.874+0000 7f7fcffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7fd00fbcb0 0x7f7fd0110680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:17:12.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.874+0000 7f7fcf7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fd00fcf60 0x7f7fd0112bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52636/0 (socket says 172.21.15.37:52636) 2024-04-25T17:17:12.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.874+0000 7f7fcffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7fd00fbcb0 0x7f7fd0110680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.37:47996/0 (socket says 172.21.15.37:47996) 2024-04-25T17:17:12.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.874+0000 7f7fcf7fe700 1 -- 172.21.15.37:0/1934730767 learned_addr learned my addr 172.21.15.37:0/1934730767 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:17:12.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.874+0000 7f7fcf7fe700 1 -- 172.21.15.37:0/1934730767 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7fd00fbcb0 msgr2=0x7f7fd0110680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:17:12.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.874+0000 7f7fcf7fe700 1 --2- 172.21.15.37:0/1934730767 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7fd00fbcb0 0x7f7fd0110680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:12.875 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.874+0000 7f7fcf7fe700 1 -- 172.21.15.37:0/1934730767 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc0005040 con 0x7f7fd00fcf60 2024-04-25T17:17:12.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.874+0000 7f7fcffff700 1 --2- 172.21.15.37:0/1934730767 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7fd00fbcb0 0x7f7fd0110680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T17:17:12.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.874+0000 7f7fcf7fe700 1 --2- 172.21.15.37:0/1934730767 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fd00fcf60 0x7f7fd0112bd0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7fc400eb40 tx=0x7f7fc400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:17:12.876 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.874+0000 7f7fccff9700 1 -- 172.21.15.37:0/1934730767 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fc4007cc0 con 0x7f7fd00fcf60 2024-04-25T17:17:12.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.874+0000 7f7fd676f700 1 -- 172.21.15.37:0/1934730767 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fd0113170 con 0x7f7fd00fcf60 2024-04-25T17:17:12.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.874+0000 7f7fccff9700 1 -- 172.21.15.37:0/1934730767 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7fc400f040 con 0x7f7fd00fcf60 2024-04-25T17:17:12.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.874+0000 7f7fccff9700 1 -- 172.21.15.37:0/1934730767 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fc400ca10 con 0x7f7fd00fcf60 2024-04-25T17:17:12.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.874+0000 7f7fd676f700 1 -- 172.21.15.37:0/1934730767 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fd0113660 con 0x7f7fd00fcf60 2024-04-25T17:17:12.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.875+0000 7f7fd676f700 1 -- 172.21.15.37:0/1934730767 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fd005f5c0 con 0x7f7fd00fcf60 2024-04-25T17:17:12.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.876+0000 7f7fccff9700 1 -- 172.21.15.37:0/1934730767 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f7fc400cc80 con 0x7f7fd00fcf60 2024-04-25T17:17:12.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.877+0000 7f7fccff9700 1 --2- 172.21.15.37:0/1934730767 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f7fb80692a0 0x7f7fb806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:17:12.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.877+0000 7f7fccff9700 1 -- 172.21.15.37:0/1934730767 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f7fc4086db0 con 0x7f7fd00fcf60 2024-04-25T17:17:12.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.877+0000 7f7fcffff700 1 --2- 172.21.15.37:0/1934730767 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f7fb80692a0 0x7f7fb806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:17:12.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.877+0000 7f7fcffff700 1 --2- 172.21.15.37:0/1934730767 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f7fb80692a0 0x7f7fb806b750 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0004890 tx=0x7f7fc0009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:17:12.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:12.881+0000 7f7fccff9700 1 -- 172.21.15.37:0/1934730767 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f7fc404e250 con 0x7f7fd00fcf60 2024-04-25T17:17:13.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:13.102+0000 7f7fd676f700 1 -- 172.21.15.37:0/1934730767 --> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7fd0101250 con 0x7f7fb80692a0 2024-04-25T17:17:13.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:13.103+0000 7f7fccff9700 1 -- 172.21.15.37:0/1934730767 <== mgr.14214 v2:172.21.15.37:6800/3566135606 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f7fd0101250 con 0x7f7fb80692a0 2024-04-25T17:17:13.103 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-25T17:17:13.103 INFO:teuthology.orchestra.run.smithi037.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385", 2024-04-25T17:17:13.103 INFO:teuthology.orchestra.run.smithi037.stdout: "in_progress": true, 2024-04-25T17:17:13.103 INFO:teuthology.orchestra.run.smithi037.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-25T17:17:13.103 INFO:teuthology.orchestra.run.smithi037.stdout: "services_complete": [], 2024-04-25T17:17:13.103 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": "0/21 daemons upgraded", 2024-04-25T17:17:13.103 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 image on host smithi069", 2024-04-25T17:17:13.103 INFO:teuthology.orchestra.run.smithi037.stdout: "is_paused": false 2024-04-25T17:17:13.103 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-25T17:17:13.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:13.105+0000 7f7fd676f700 1 -- 172.21.15.37:0/1934730767 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f7fb80692a0 msgr2=0x7f7fb806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:17:13.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:13.105+0000 7f7fd676f700 1 --2- 172.21.15.37:0/1934730767 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f7fb80692a0 0x7f7fb806b750 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0004890 tx=0x7f7fc0009e30 comp rx=0 tx=0).stop 2024-04-25T17:17:13.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:13.105+0000 7f7fd676f700 1 -- 172.21.15.37:0/1934730767 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fd00fcf60 msgr2=0x7f7fd0112bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:17:13.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:13.105+0000 7f7fd676f700 1 --2- 172.21.15.37:0/1934730767 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fd00fcf60 0x7f7fd0112bd0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7fc400eb40 tx=0x7f7fc400b040 comp rx=0 tx=0).stop 2024-04-25T17:17:13.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:13.105+0000 7f7fd676f700 1 -- 172.21.15.37:0/1934730767 shutdown_connections 2024-04-25T17:17:13.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:13.105+0000 7f7fd676f700 1 --2- 172.21.15.37:0/1934730767 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f7fb80692a0 0x7f7fb806b750 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:13.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:13.105+0000 7f7fd676f700 1 --2- 172.21.15.37:0/1934730767 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7fd00fbcb0 0x7f7fd0110680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:13.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:13.105+0000 7f7fd676f700 1 --2- 172.21.15.37:0/1934730767 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7fd00fcf60 0x7f7fd0112bd0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:13.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:13.105+0000 7f7fd676f700 1 -- 172.21.15.37:0/1934730767 >> 172.21.15.37:0/1934730767 conn(0x7f7fd00f7430 msgr2=0x7f7fd00f8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:17:13.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:13.105+0000 7f7fd676f700 1 -- 172.21.15.37:0/1934730767 shutdown_connections 2024-04-25T17:17:13.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:13.105+0000 7f7fd676f700 1 -- 172.21.15.37:0/1934730767 wait complete. 2024-04-25T17:17:13.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:13.211+0000 7fdf92e8a700 1 -- 172.21.15.37:0/1390562335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf8c0fcf60 msgr2=0x7fdf8c0fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:17:13.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:13.211+0000 7fdf92e8a700 1 --2- 172.21.15.37:0/1390562335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf8c0fcf60 0x7fdf8c0fd3d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fdf78004940 tx=0x7fdf78009e30 comp rx=0 tx=0).stop 2024-04-25T17:17:13.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:13.211+0000 7fdf92e8a700 1 -- 172.21.15.37:0/1390562335 shutdown_connections 2024-04-25T17:17:13.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:13.211+0000 7fdf92e8a700 1 --2- 172.21.15.37:0/1390562335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf8c0fcf60 0x7fdf8c0fd3d0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:13.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:13.211+0000 7fdf92e8a700 1 --2- 172.21.15.37:0/1390562335 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdf8c0fbcb0 0x7fdf8c0fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:13.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:13.211+0000 7fdf92e8a700 1 -- 172.21.15.37:0/1390562335 >> 172.21.15.37:0/1390562335 conn(0x7fdf8c0f7430 msgr2=0x7fdf8c0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:17:13.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:13.211+0000 7fdf92e8a700 1 -- 172.21.15.37:0/1390562335 shutdown_connections 2024-04-25T17:17:13.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:13.211+0000 7fdf92e8a700 1 -- 172.21.15.37:0/1390562335 wait complete. 2024-04-25T17:17:13.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:13.212+0000 7fdf92e8a700 1 Processor -- start 2024-04-25T17:17:13.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:13.212+0000 7fdf92e8a700 1 -- start start 2024-04-25T17:17:13.213 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:13.212+0000 7fdf92e8a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf8c0fbcb0 0x7fdf8c110660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:17:13.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:13.212+0000 7fdf92e8a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdf8c0fcf60 0x7fdf8c112bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:17:13.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:13.212+0000 7fdf92e8a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c066390 con 0x7fdf8c0fbcb0 2024-04-25T17:17:13.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:13.212+0000 7fdf92e8a700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c0664d0 con 0x7fdf8c0fcf60 2024-04-25T17:17:13.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:13.212+0000 7fdf90c26700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf8c0fbcb0 0x7fdf8c110660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:17:13.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:13.213+0000 7fdf90c26700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf8c0fbcb0 0x7fdf8c110660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52644/0 (socket says 172.21.15.37:52644) 2024-04-25T17:17:13.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:13.213+0000 7fdf90c26700 1 -- 172.21.15.37:0/1270189804 learned_addr learned my addr 172.21.15.37:0/1270189804 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:17:13.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:13.213+0000 7fdf8bfff700 1 --2- 172.21.15.37:0/1270189804 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdf8c0fcf60 0x7fdf8c112bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:17:13.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:13.213+0000 7fdf90c26700 1 -- 172.21.15.37:0/1270189804 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdf8c0fcf60 msgr2=0x7fdf8c112bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:17:13.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:13.213+0000 7fdf90c26700 1 --2- 172.21.15.37:0/1270189804 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdf8c0fcf60 0x7fdf8c112bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:13.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:13.213+0000 7fdf90c26700 1 -- 172.21.15.37:0/1270189804 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf78005040 con 0x7fdf8c0fbcb0 2024-04-25T17:17:13.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:13.213+0000 7fdf90c26700 1 --2- 172.21.15.37:0/1270189804 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf8c0fbcb0 0x7fdf8c110660 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fdf8000eb40 tx=0x7fdf8000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:17:13.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:13.213+0000 7fdf897fa700 1 -- 172.21.15.37:0/1270189804 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf80007cc0 con 0x7fdf8c0fbcb0 2024-04-25T17:17:13.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:13.213+0000 7fdf92e8a700 1 -- 172.21.15.37:0/1270189804 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf8c113150 con 0x7fdf8c0fbcb0 2024-04-25T17:17:13.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:13.213+0000 7fdf897fa700 1 -- 172.21.15.37:0/1270189804 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdf8000f040 con 0x7fdf8c0fbcb0 2024-04-25T17:17:13.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:13.213+0000 7fdf897fa700 1 -- 172.21.15.37:0/1270189804 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf8000ca10 con 0x7fdf8c0fbcb0 2024-04-25T17:17:13.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:13.213+0000 7fdf92e8a700 1 -- 172.21.15.37:0/1270189804 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf8c113690 con 0x7fdf8c0fbcb0 2024-04-25T17:17:13.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:13.214+0000 7fdf92e8a700 1 -- 172.21.15.37:0/1270189804 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf8c05f5c0 con 0x7fdf8c0fbcb0 2024-04-25T17:17:13.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:13.215+0000 7fdf897fa700 1 -- 172.21.15.37:0/1270189804 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7fdf8000cc80 con 0x7fdf8c0fbcb0 2024-04-25T17:17:13.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:13.215+0000 7fdf897fa700 1 --2- 172.21.15.37:0/1270189804 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fdf7c0692b0 0x7fdf7c06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:17:13.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:13.215+0000 7fdf897fa700 1 -- 172.21.15.37:0/1270189804 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fdf80086e50 con 0x7fdf8c0fbcb0 2024-04-25T17:17:13.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:13.216+0000 7fdf8bfff700 1 --2- 172.21.15.37:0/1270189804 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fdf7c0692b0 0x7fdf7c06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:17:13.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:13.216+0000 7fdf8bfff700 1 --2- 172.21.15.37:0/1270189804 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fdf7c0692b0 0x7fdf7c06b760 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdf7800b0d0 tx=0x7fdf78009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:17:13.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:13.220+0000 7fdf897fa700 1 -- 172.21.15.37:0/1270189804 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7fdf8004e250 con 0x7fdf8c0fbcb0 2024-04-25T17:17:13.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:13 smithi069 ceph-mon[34527]: from='client.14604 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:17:13.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:13 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/2253741846' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:17:13.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:13 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/69775937' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T17:17:13.547 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:13.547+0000 7fdf92e8a700 1 -- 172.21.15.37:0/1270189804 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fdf8c04bed0 con 0x7fdf8c0fbcb0 2024-04-25T17:17:13.548 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:13 smithi037 ceph-mon[26472]: from='client.14604 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:17:13.548 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:13 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/2253741846' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:17:13.548 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:13 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/69775937' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T17:17:13.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:13.548+0000 7fdf897fa700 1 -- 172.21.15.37:0/1270189804 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fdf80053110 con 0x7fdf8c0fbcb0 2024-04-25T17:17:13.548 INFO:teuthology.orchestra.run.smithi037.stdout:HEALTH_OK 2024-04-25T17:17:13.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:13.550+0000 7fdf92e8a700 1 -- 172.21.15.37:0/1270189804 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fdf7c0692b0 msgr2=0x7fdf7c06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:17:13.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:13.550+0000 7fdf92e8a700 1 --2- 172.21.15.37:0/1270189804 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fdf7c0692b0 0x7fdf7c06b760 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdf7800b0d0 tx=0x7fdf78009e30 comp rx=0 tx=0).stop 2024-04-25T17:17:13.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:13.550+0000 7fdf92e8a700 1 -- 172.21.15.37:0/1270189804 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf8c0fbcb0 msgr2=0x7fdf8c110660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:17:13.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:13.550+0000 7fdf92e8a700 1 --2- 172.21.15.37:0/1270189804 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf8c0fbcb0 0x7fdf8c110660 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fdf8000eb40 tx=0x7fdf8000b040 comp rx=0 tx=0).stop 2024-04-25T17:17:13.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:13.550+0000 7fdf92e8a700 1 -- 172.21.15.37:0/1270189804 shutdown_connections 2024-04-25T17:17:13.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:13.550+0000 7fdf92e8a700 1 --2- 172.21.15.37:0/1270189804 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7fdf7c0692b0 0x7fdf7c06b760 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:13.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:13.550+0000 7fdf92e8a700 1 --2- 172.21.15.37:0/1270189804 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdf8c0fbcb0 0x7fdf8c110660 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:13.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:13.550+0000 7fdf92e8a700 1 --2- 172.21.15.37:0/1270189804 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdf8c0fcf60 0x7fdf8c112bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:13.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:13.550+0000 7fdf92e8a700 1 -- 172.21.15.37:0/1270189804 >> 172.21.15.37:0/1270189804 conn(0x7fdf8c0f7430 msgr2=0x7fdf8c0f8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:17:13.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:13.550+0000 7fdf92e8a700 1 -- 172.21.15.37:0/1270189804 shutdown_connections 2024-04-25T17:17:13.551 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:13.550+0000 7fdf92e8a700 1 -- 172.21.15.37:0/1270189804 wait complete. 2024-04-25T17:17:14.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:14 smithi069 ceph-mon[34527]: from='client.14616 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:17:14.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:14 smithi069 ceph-mon[34527]: pgmap v223: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:17:14.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:14 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/1270189804' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T17:17:14.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:14 smithi037 ceph-mon[26472]: from='client.14616 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:17:14.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:14 smithi037 ceph-mon[26472]: pgmap v223: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:17:14.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:14 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/1270189804' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T17:17:16.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:16 smithi069 ceph-mon[34527]: pgmap v224: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:17:17.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:16 smithi037 ceph-mon[26472]: pgmap v224: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:17:18.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:18 smithi069 ceph-mon[34527]: pgmap v225: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:17:19.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:18 smithi037 ceph-mon[26472]: pgmap v225: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:17:20.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:20 smithi069 ceph-mon[34527]: pgmap v226: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:17:21.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:20 smithi037 ceph-mon[26472]: pgmap v226: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:17:22.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:22 smithi069 ceph-mon[34527]: pgmap v227: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:17:23.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:22 smithi037 ceph-mon[26472]: pgmap v227: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:17:24.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:24 smithi069 ceph-mon[34527]: pgmap v228: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:17:25.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:24 smithi037 ceph-mon[26472]: pgmap v228: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:17:25.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:25 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:17:26.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:25 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:17:26.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:26 smithi069 ceph-mon[34527]: pgmap v229: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:17:27.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:26 smithi037 ceph-mon[26472]: pgmap v229: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:17:28.874 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:28 smithi037 ceph-mon[26472]: pgmap v230: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:17:28.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:28 smithi069 ceph-mon[34527]: pgmap v230: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:17:30.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:30 smithi069 ceph-mon[34527]: pgmap v231: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:17:31.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:30 smithi037 ceph-mon[26472]: pgmap v231: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:17:32.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:32 smithi069 ceph-mon[34527]: pgmap v232: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:17:33.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:32 smithi037 ceph-mon[26472]: pgmap v232: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:17:34.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:34 smithi069 ceph-mon[34527]: pgmap v233: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:17:35.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:34 smithi037 ceph-mon[26472]: pgmap v233: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:17:36.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:36 smithi069 ceph-mon[34527]: pgmap v234: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:17:37.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:36 smithi037 ceph-mon[26472]: pgmap v234: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:17:38.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:38 smithi069 ceph-mon[34527]: pgmap v235: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:17:39.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:38 smithi037 ceph-mon[26472]: pgmap v235: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:17:40.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:40 smithi069 ceph-mon[34527]: pgmap v236: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:17:40.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:40 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:17:41.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:40 smithi037 ceph-mon[26472]: pgmap v236: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:17:41.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:40 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:17:42.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:42 smithi069 ceph-mon[34527]: pgmap v237: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:17:42.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:42 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:17:42.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:42 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi069.mmuhdo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T17:17:42.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:42 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T17:17:42.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:42 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:17:43.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:42 smithi037 ceph-mon[26472]: pgmap v237: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:17:43.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:42 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:17:43.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:42 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi069.mmuhdo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T17:17:43.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:42 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T17:17:43.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:42 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:17:43.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:43.714+0000 7f99eddfc700 1 -- 172.21.15.37:0/3939967477 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99e80fce80 msgr2=0x7f99e80fd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:17:43.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:43.714+0000 7f99eddfc700 1 --2- 172.21.15.37:0/3939967477 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99e80fce80 0x7f99e80fd290 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f99d8004940 tx=0x7f99d8009e30 comp rx=0 tx=0).stop 2024-04-25T17:17:43.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:43.714+0000 7f99eddfc700 1 -- 172.21.15.37:0/3939967477 shutdown_connections 2024-04-25T17:17:43.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:43.714+0000 7f99eddfc700 1 --2- 172.21.15.37:0/3939967477 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99e80fe080 0x7f99e80fe4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:43.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:43.714+0000 7f99eddfc700 1 --2- 172.21.15.37:0/3939967477 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99e80fce80 0x7f99e80fd290 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:43.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:43.714+0000 7f99eddfc700 1 -- 172.21.15.37:0/3939967477 >> 172.21.15.37:0/3939967477 conn(0x7f99e80f8590 msgr2=0x7f99e80fa9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:17:43.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:43.715+0000 7f99eddfc700 1 -- 172.21.15.37:0/3939967477 shutdown_connections 2024-04-25T17:17:43.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:43.715+0000 7f99eddfc700 1 -- 172.21.15.37:0/3939967477 wait complete. 2024-04-25T17:17:43.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:43.716+0000 7f99eddfc700 1 Processor -- start 2024-04-25T17:17:43.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:43.717+0000 7f99eddfc700 1 -- start start 2024-04-25T17:17:43.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:43.717+0000 7f99eddfc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99e80fe080 0x7f99e810db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:17:43.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:43.717+0000 7f99eddfc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99e810e0c0 0x7f99e810ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:17:43.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:43.717+0000 7f99eddfc700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e810e580 con 0x7f99e80fe080 2024-04-25T17:17:43.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:43.718+0000 7f99eddfc700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e810e6c0 con 0x7f99e810e0c0 2024-04-25T17:17:43.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:43.718+0000 7f99e6ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99e810e0c0 0x7f99e810ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:17:43.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:43.718+0000 7f99e6ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99e810e0c0 0x7f99e810ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.37:44958/0 (socket says 172.21.15.37:44958) 2024-04-25T17:17:43.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:43.718+0000 7f99e6ffd700 1 -- 172.21.15.37:0/1124658408 learned_addr learned my addr 172.21.15.37:0/1124658408 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:17:43.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:43.718+0000 7f99e77fe700 1 --2- 172.21.15.37:0/1124658408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99e80fe080 0x7f99e810db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:17:43.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:43.718+0000 7f99e6ffd700 1 -- 172.21.15.37:0/1124658408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99e80fe080 msgr2=0x7f99e810db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:17:43.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:43.718+0000 7f99e6ffd700 1 --2- 172.21.15.37:0/1124658408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99e80fe080 0x7f99e810db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:43.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:43.718+0000 7f99e6ffd700 1 -- 172.21.15.37:0/1124658408 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d8005040 con 0x7f99e810e0c0 2024-04-25T17:17:43.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:43.718+0000 7f99e77fe700 1 --2- 172.21.15.37:0/1124658408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99e80fe080 0x7f99e810db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T17:17:43.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:43.718+0000 7f99e6ffd700 1 --2- 172.21.15.37:0/1124658408 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99e810e0c0 0x7f99e810ef10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f99dc00eb40 tx=0x7f99dc00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:17:43.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:43.719+0000 7f99cffff700 1 -- 172.21.15.37:0/1124658408 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99dc007cc0 con 0x7f99e810e0c0 2024-04-25T17:17:43.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:43.719+0000 7f99cffff700 1 -- 172.21.15.37:0/1124658408 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f99dc00f040 con 0x7f99e810e0c0 2024-04-25T17:17:43.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:43.719+0000 7f99eddfc700 1 -- 172.21.15.37:0/1124658408 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99e810f510 con 0x7f99e810e0c0 2024-04-25T17:17:43.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:43.719+0000 7f99eddfc700 1 -- 172.21.15.37:0/1124658408 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99e810f960 con 0x7f99e810e0c0 2024-04-25T17:17:43.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:43.720+0000 7f99cffff700 1 -- 172.21.15.37:0/1124658408 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f99dc009620 con 0x7f99e810e0c0 2024-04-25T17:17:43.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:43.720+0000 7f99eddfc700 1 -- 172.21.15.37:0/1124658408 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99d40052e0 con 0x7f99e810e0c0 2024-04-25T17:17:43.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:43.721+0000 7f99cffff700 1 -- 172.21.15.37:0/1124658408 <== mon.1 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f99dc009840 con 0x7f99e810e0c0 2024-04-25T17:17:43.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:43.722+0000 7f99cffff700 1 --2- 172.21.15.37:0/1124658408 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f99d00692a0 0x7f99d006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:17:43.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:43.722+0000 7f99cffff700 1 -- 172.21.15.37:0/1124658408 <== mon.1 v2:172.21.15.69:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f99dc086d00 con 0x7f99e810e0c0 2024-04-25T17:17:43.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:43.722+0000 7f99e77fe700 1 --2- 172.21.15.37:0/1124658408 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f99d00692a0 0x7f99d006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:17:43.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:43.722+0000 7f99e77fe700 1 --2- 172.21.15.37:0/1124658408 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f99d00692a0 0x7f99d006b750 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f99d8009fd0 tx=0x7f99d8009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:17:43.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:43.730+0000 7f99cffff700 1 -- 172.21.15.37:0/1124658408 <== mon.1 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f99dc04e250 con 0x7f99e810e0c0 2024-04-25T17:17:43.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:43 smithi069 ceph-mon[34527]: Upgrade: Updating mgr.smithi069.mmuhdo 2024-04-25T17:17:43.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:43 smithi069 ceph-mon[34527]: Deploying daemon mgr.smithi069.mmuhdo on smithi069 2024-04-25T17:17:44.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.066+0000 7f99eddfc700 1 -- 172.21.15.37:0/1124658408 --> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f99d4000bf0 con 0x7f99d00692a0 2024-04-25T17:17:44.067 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:43 smithi037 ceph-mon[26472]: Upgrade: Updating mgr.smithi069.mmuhdo 2024-04-25T17:17:44.067 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:43 smithi037 ceph-mon[26472]: Deploying daemon mgr.smithi069.mmuhdo on smithi069 2024-04-25T17:17:44.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.068+0000 7f99cffff700 1 -- 172.21.15.37:0/1124658408 <== mgr.14214 v2:172.21.15.37:6800/3566135606 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f99d4000bf0 con 0x7f99d00692a0 2024-04-25T17:17:44.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.070+0000 7f99eddfc700 1 -- 172.21.15.37:0/1124658408 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f99d00692a0 msgr2=0x7f99d006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:17:44.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.070+0000 7f99eddfc700 1 --2- 172.21.15.37:0/1124658408 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f99d00692a0 0x7f99d006b750 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f99d8009fd0 tx=0x7f99d8009e30 comp rx=0 tx=0).stop 2024-04-25T17:17:44.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.070+0000 7f99eddfc700 1 -- 172.21.15.37:0/1124658408 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99e810e0c0 msgr2=0x7f99e810ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:17:44.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.070+0000 7f99eddfc700 1 --2- 172.21.15.37:0/1124658408 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99e810e0c0 0x7f99e810ef10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f99dc00eb40 tx=0x7f99dc00b040 comp rx=0 tx=0).stop 2024-04-25T17:17:44.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.070+0000 7f99eddfc700 1 -- 172.21.15.37:0/1124658408 shutdown_connections 2024-04-25T17:17:44.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.070+0000 7f99eddfc700 1 --2- 172.21.15.37:0/1124658408 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f99d00692a0 0x7f99d006b750 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:44.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.070+0000 7f99eddfc700 1 --2- 172.21.15.37:0/1124658408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f99e80fe080 0x7f99e810db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:44.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.070+0000 7f99eddfc700 1 --2- 172.21.15.37:0/1124658408 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99e810e0c0 0x7f99e810ef10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:44.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.070+0000 7f99eddfc700 1 -- 172.21.15.37:0/1124658408 >> 172.21.15.37:0/1124658408 conn(0x7f99e80f8590 msgr2=0x7f99e80f9d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:17:44.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.070+0000 7f99eddfc700 1 -- 172.21.15.37:0/1124658408 shutdown_connections 2024-04-25T17:17:44.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.071+0000 7f99eddfc700 1 -- 172.21.15.37:0/1124658408 wait complete. 2024-04-25T17:17:44.081 INFO:teuthology.orchestra.run.smithi037.stdout:true 2024-04-25T17:17:44.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.177+0000 7f0d1dffb700 1 -- 172.21.15.37:0/3003999589 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d10013b70 con 0x7f0d20066260 2024-04-25T17:17:44.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.177+0000 7f0d2594b700 1 -- 172.21.15.37:0/3003999589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d20066260 msgr2=0x7f0d20101e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:17:44.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.177+0000 7f0d2594b700 1 --2- 172.21.15.37:0/3003999589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d20066260 0x7f0d20101e00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0d10004940 tx=0x7f0d10009e30 comp rx=0 tx=0).stop 2024-04-25T17:17:44.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.178+0000 7f0d2594b700 1 -- 172.21.15.37:0/3003999589 shutdown_connections 2024-04-25T17:17:44.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.178+0000 7f0d2594b700 1 --2- 172.21.15.37:0/3003999589 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0d20102340 0x7f0d20104720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:44.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.178+0000 7f0d2594b700 1 --2- 172.21.15.37:0/3003999589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d20066260 0x7f0d20101e00 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:44.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.178+0000 7f0d2594b700 1 -- 172.21.15.37:0/3003999589 >> 172.21.15.37:0/3003999589 conn(0x7f0d200f7430 msgr2=0x7f0d200f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:17:44.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.178+0000 7f0d2594b700 1 -- 172.21.15.37:0/3003999589 shutdown_connections 2024-04-25T17:17:44.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.178+0000 7f0d2594b700 1 -- 172.21.15.37:0/3003999589 wait complete. 2024-04-25T17:17:44.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.179+0000 7f0d2594b700 1 Processor -- start 2024-04-25T17:17:44.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.179+0000 7f0d2594b700 1 -- start start 2024-04-25T17:17:44.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.179+0000 7f0d2594b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d20066260 0x7f0d2010fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:17:44.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.179+0000 7f0d2594b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0d20102340 0x7f0d20110130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:17:44.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.179+0000 7f0d2594b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d20110730 con 0x7f0d20066260 2024-04-25T17:17:44.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.179+0000 7f0d2594b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d20110f30 con 0x7f0d20102340 2024-04-25T17:17:44.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.179+0000 7f0d1effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d20066260 0x7f0d2010fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:17:44.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.179+0000 7f0d1e7fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0d20102340 0x7f0d20110130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:17:44.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.179+0000 7f0d1e7fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0d20102340 0x7f0d20110130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.37:44978/0 (socket says 172.21.15.37:44978) 2024-04-25T17:17:44.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.179+0000 7f0d1effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d20066260 0x7f0d2010fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37892/0 (socket says 172.21.15.37:37892) 2024-04-25T17:17:44.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.179+0000 7f0d1e7fc700 1 -- 172.21.15.37:0/2165595200 learned_addr learned my addr 172.21.15.37:0/2165595200 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:17:44.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.179+0000 7f0d1e7fc700 1 -- 172.21.15.37:0/2165595200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d20066260 msgr2=0x7f0d2010fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:17:44.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.179+0000 7f0d1e7fc700 1 --2- 172.21.15.37:0/2165595200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d20066260 0x7f0d2010fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:44.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.179+0000 7f0d1e7fc700 1 -- 172.21.15.37:0/2165595200 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d10005040 con 0x7f0d20102340 2024-04-25T17:17:44.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.180+0000 7f0d1e7fc700 1 --2- 172.21.15.37:0/2165595200 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0d20102340 0x7f0d20110130 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0d1400eb40 tx=0x7f0d1400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:17:44.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.180+0000 7f0d077fe700 1 -- 172.21.15.37:0/2165595200 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d14007cc0 con 0x7f0d20102340 2024-04-25T17:17:44.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.180+0000 7f0d2594b700 1 -- 172.21.15.37:0/2165595200 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d201111b0 con 0x7f0d20102340 2024-04-25T17:17:44.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.180+0000 7f0d077fe700 1 -- 172.21.15.37:0/2165595200 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0d1400f040 con 0x7f0d20102340 2024-04-25T17:17:44.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.180+0000 7f0d077fe700 1 -- 172.21.15.37:0/2165595200 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d1400ca10 con 0x7f0d20102340 2024-04-25T17:17:44.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.180+0000 7f0d2594b700 1 -- 172.21.15.37:0/2165595200 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d201116f0 con 0x7f0d20102340 2024-04-25T17:17:44.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.181+0000 7f0d2594b700 1 -- 172.21.15.37:0/2165595200 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d2005f5c0 con 0x7f0d20102340 2024-04-25T17:17:44.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.182+0000 7f0d077fe700 1 -- 172.21.15.37:0/2165595200 <== mon.1 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f0d1400cc80 con 0x7f0d20102340 2024-04-25T17:17:44.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.182+0000 7f0d077fe700 1 --2- 172.21.15.37:0/2165595200 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f0d080692a0 0x7f0d0806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:17:44.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.182+0000 7f0d077fe700 1 -- 172.21.15.37:0/2165595200 <== mon.1 v2:172.21.15.69:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f0d14086d90 con 0x7f0d20102340 2024-04-25T17:17:44.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.182+0000 7f0d1effd700 1 --2- 172.21.15.37:0/2165595200 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f0d080692a0 0x7f0d0806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:17:44.183 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.183+0000 7f0d1effd700 1 --2- 172.21.15.37:0/2165595200 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f0d080692a0 0x7f0d0806b750 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0d10004890 tx=0x7f0d10009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:17:44.186 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.186+0000 7f0d077fe700 1 -- 172.21.15.37:0/2165595200 <== mon.1 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f0d1404e250 con 0x7f0d20102340 2024-04-25T17:17:44.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.495+0000 7f0d2594b700 1 -- 172.21.15.37:0/2165595200 --> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0d20111980 con 0x7f0d080692a0 2024-04-25T17:17:44.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.497+0000 7f0d077fe700 1 -- 172.21.15.37:0/2165595200 <== mgr.14214 v2:172.21.15.37:6800/3566135606 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f0d20111980 con 0x7f0d080692a0 2024-04-25T17:17:44.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.499+0000 7f0d2594b700 1 -- 172.21.15.37:0/2165595200 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f0d080692a0 msgr2=0x7f0d0806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:17:44.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.499+0000 7f0d2594b700 1 --2- 172.21.15.37:0/2165595200 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f0d080692a0 0x7f0d0806b750 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0d10004890 tx=0x7f0d10009e30 comp rx=0 tx=0).stop 2024-04-25T17:17:44.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.499+0000 7f0d2594b700 1 -- 172.21.15.37:0/2165595200 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0d20102340 msgr2=0x7f0d20110130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:17:44.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.499+0000 7f0d2594b700 1 --2- 172.21.15.37:0/2165595200 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0d20102340 0x7f0d20110130 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0d1400eb40 tx=0x7f0d1400b040 comp rx=0 tx=0).stop 2024-04-25T17:17:44.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.500+0000 7f0d2594b700 1 -- 172.21.15.37:0/2165595200 shutdown_connections 2024-04-25T17:17:44.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.500+0000 7f0d2594b700 1 --2- 172.21.15.37:0/2165595200 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f0d080692a0 0x7f0d0806b750 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:44.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.500+0000 7f0d2594b700 1 --2- 172.21.15.37:0/2165595200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0d20066260 0x7f0d2010fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:44.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.500+0000 7f0d2594b700 1 --2- 172.21.15.37:0/2165595200 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0d20102340 0x7f0d20110130 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:44.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.500+0000 7f0d2594b700 1 -- 172.21.15.37:0/2165595200 >> 172.21.15.37:0/2165595200 conn(0x7f0d200f7430 msgr2=0x7f0d200f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:17:44.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.500+0000 7f0d2594b700 1 -- 172.21.15.37:0/2165595200 shutdown_connections 2024-04-25T17:17:44.500 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.500+0000 7f0d2594b700 1 -- 172.21.15.37:0/2165595200 wait complete. 2024-04-25T17:17:44.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.661+0000 7f83c2903700 1 -- 172.21.15.37:0/905830722 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83bc0fe080 msgr2=0x7f83bc0fe4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:17:44.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.661+0000 7f83c2903700 1 --2- 172.21.15.37:0/905830722 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83bc0fe080 0x7f83bc0fe4f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f83b0004940 tx=0x7f83b0009e30 comp rx=0 tx=0).stop 2024-04-25T17:17:44.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.661+0000 7f83c2903700 1 -- 172.21.15.37:0/905830722 shutdown_connections 2024-04-25T17:17:44.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.661+0000 7f83c2903700 1 --2- 172.21.15.37:0/905830722 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83bc0fe080 0x7f83bc0fe4f0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:44.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.661+0000 7f83c2903700 1 --2- 172.21.15.37:0/905830722 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f83bc0fce80 0x7f83bc0fd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:44.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.661+0000 7f83c2903700 1 -- 172.21.15.37:0/905830722 >> 172.21.15.37:0/905830722 conn(0x7f83bc0f8590 msgr2=0x7f83bc0fa9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:17:44.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.661+0000 7f83c2903700 1 -- 172.21.15.37:0/905830722 shutdown_connections 2024-04-25T17:17:44.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.661+0000 7f83c2903700 1 -- 172.21.15.37:0/905830722 wait complete. 2024-04-25T17:17:44.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.662+0000 7f83c2903700 1 Processor -- start 2024-04-25T17:17:44.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.662+0000 7f83c2903700 1 -- start start 2024-04-25T17:17:44.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.662+0000 7f83c2903700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83bc0fce80 0x7f83bc10da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:17:44.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.662+0000 7f83c2903700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f83bc0fe080 0x7f83bc10df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:17:44.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.663+0000 7f83c2903700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc10e570 con 0x7f83bc0fce80 2024-04-25T17:17:44.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.663+0000 7f83c2903700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc10edc0 con 0x7f83bc0fe080 2024-04-25T17:17:44.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.663+0000 7f83bbfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83bc0fce80 0x7f83bc10da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:17:44.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.663+0000 7f83bbfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83bc0fce80 0x7f83bc10da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37896/0 (socket says 172.21.15.37:37896) 2024-04-25T17:17:44.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.663+0000 7f83bbfff700 1 -- 172.21.15.37:0/1659882377 learned_addr learned my addr 172.21.15.37:0/1659882377 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:17:44.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.663+0000 7f83bbfff700 1 -- 172.21.15.37:0/1659882377 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f83bc0fe080 msgr2=0x7f83bc10df70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T17:17:44.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.663+0000 7f83bbfff700 1 --2- 172.21.15.37:0/1659882377 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f83bc0fe080 0x7f83bc10df70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:44.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.663+0000 7f83bbfff700 1 -- 172.21.15.37:0/1659882377 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b0005040 con 0x7f83bc0fce80 2024-04-25T17:17:44.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.663+0000 7f83bbfff700 1 --2- 172.21.15.37:0/1659882377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83bc0fce80 0x7f83bc10da30 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f83ac00c8b0 tx=0x7f83ac004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:17:44.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.664+0000 7f83b8ff9700 1 -- 172.21.15.37:0/1659882377 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83ac00a760 con 0x7f83bc0fce80 2024-04-25T17:17:44.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.664+0000 7f83b8ff9700 1 -- 172.21.15.37:0/1659882377 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f83ac00ad90 con 0x7f83bc0fce80 2024-04-25T17:17:44.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.665+0000 7f83b8ff9700 1 -- 172.21.15.37:0/1659882377 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83ac0113a0 con 0x7f83bc0fce80 2024-04-25T17:17:44.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.665+0000 7f83c2903700 1 -- 172.21.15.37:0/1659882377 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83bc10f0a0 con 0x7f83bc0fce80 2024-04-25T17:17:44.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.665+0000 7f83c2903700 1 -- 172.21.15.37:0/1659882377 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83bc10f5e0 con 0x7f83bc0fce80 2024-04-25T17:17:44.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.666+0000 7f83c2903700 1 -- 172.21.15.37:0/1659882377 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83bc05f5c0 con 0x7f83bc0fce80 2024-04-25T17:17:44.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.667+0000 7f83b8ff9700 1 -- 172.21.15.37:0/1659882377 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f83ac012400 con 0x7f83bc0fce80 2024-04-25T17:17:44.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.667+0000 7f83b8ff9700 1 --2- 172.21.15.37:0/1659882377 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f83a40692b0 0x7f83a406b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:17:44.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.667+0000 7f83b8ff9700 1 -- 172.21.15.37:0/1659882377 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f83ac086ee0 con 0x7f83bc0fce80 2024-04-25T17:17:44.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.668+0000 7f83bb7fe700 1 --2- 172.21.15.37:0/1659882377 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f83a40692b0 0x7f83a406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:17:44.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.668+0000 7f83bb7fe700 1 --2- 172.21.15.37:0/1659882377 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f83a40692b0 0x7f83a406b760 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f83b0004f90 tx=0x7f83b0009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:17:44.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.672+0000 7f83b8ff9700 1 -- 172.21.15.37:0/1659882377 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f83ac056d40 con 0x7f83bc0fce80 2024-04-25T17:17:44.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:44 smithi037 ceph-mon[26472]: pgmap v238: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:17:44.890 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:44 smithi069 ceph-mon[34527]: pgmap v238: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:17:44.990 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:44.989+0000 7f83c2903700 1 -- 172.21.15.37:0/1659882377 --> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f83bc10fa50 con 0x7f83a40692b0 2024-04-25T17:17:45.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.000+0000 7f83b8ff9700 1 -- 172.21.15.37:0/1659882377 <== mgr.14214 v2:172.21.15.37:6800/3566135606 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3410 (secure 0 0 0) 0x7f83bc10fa50 con 0x7f83a40692b0 2024-04-25T17:17:45.000 INFO:teuthology.orchestra.run.smithi037.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-25T17:17:45.000 INFO:teuthology.orchestra.run.smithi037.stdout:alertmanager.smithi037 smithi037 *:9093,9094 running (6m) 95s ago 7m 26.6M - 0.25.0 c8568f914cd2 82eacf476143 2024-04-25T17:17:45.001 INFO:teuthology.orchestra.run.smithi037.stdout:crash.smithi037 smithi037 running (7m) 95s ago 7m 6656k - 17.2.7-902-gc61472c8 0de407c1b3af b3d152574e80 2024-04-25T17:17:45.001 INFO:teuthology.orchestra.run.smithi037.stdout:crash.smithi069 smithi069 running (6m) 101s ago 6m 6660k - 17.2.7-902-gc61472c8 0de407c1b3af aa6086c64cc3 2024-04-25T17:17:45.001 INFO:teuthology.orchestra.run.smithi037.stdout:grafana.smithi037 smithi037 *:3000 running (5m) 95s ago 7m 86.3M - 9.4.7 954c08fa6188 0a09ff60869f 2024-04-25T17:17:45.001 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi037.ksmixc smithi037 running (2m) 95s ago 2m 17.1M - 17.2.7-902-gc61472c8 0de407c1b3af 394aa56079b4 2024-04-25T17:17:45.001 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi037.ovkrpq smithi037 running (115s) 95s ago 114s 13.2M - 17.2.7-902-gc61472c8 0de407c1b3af 73ca662174a7 2024-04-25T17:17:45.001 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi069.cpprst smithi069 running (112s) 101s ago 112s 12.2M - 17.2.7-902-gc61472c8 0de407c1b3af dbda101df20e 2024-04-25T17:17:45.001 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi069.ytlqcf smithi069 running (118s) 101s ago 117s 10.4M - 17.2.7-902-gc61472c8 0de407c1b3af 911df6b18215 2024-04-25T17:17:45.001 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.smithi037.txrgxl smithi037 *:9283 running (9m) 95s ago 8m 480M - 17.2.7-902-gc61472c8 0de407c1b3af 796b326569c2 2024-04-25T17:17:45.001 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.smithi069.mmuhdo smithi069 *:8443,9283 running (6m) 101s ago 6m 431M - 17.2.7-902-gc61472c8 0de407c1b3af 32fa92400de4 2024-04-25T17:17:45.001 INFO:teuthology.orchestra.run.smithi037.stdout:mon.smithi037 smithi037 running (9m) 95s ago 9m 41.1M 2048M 17.2.7-902-gc61472c8 0de407c1b3af 5cfadcf8f2e4 2024-04-25T17:17:45.001 INFO:teuthology.orchestra.run.smithi037.stdout:mon.smithi069 smithi069 running (6m) 101s ago 6m 33.1M 2048M 17.2.7-902-gc61472c8 0de407c1b3af ffcd456d1dce 2024-04-25T17:17:45.001 INFO:teuthology.orchestra.run.smithi037.stdout:node-exporter.smithi037 smithi037 *:9100 running (7m) 95s ago 7m 14.2M - 1.5.0 0da6a335fe13 363761df1e06 2024-04-25T17:17:45.001 INFO:teuthology.orchestra.run.smithi037.stdout:node-exporter.smithi069 smithi069 *:9100 running (6m) 101s ago 6m 16.8M - 1.5.0 0da6a335fe13 5d407954c21f 2024-04-25T17:17:45.001 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0 smithi037 running (5m) 95s ago 5m 50.0M 4289M 17.2.7-902-gc61472c8 0de407c1b3af 8ff4b0f1aae9 2024-04-25T17:17:45.002 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1 smithi037 running (5m) 95s ago 5m 48.3M 4289M 17.2.7-902-gc61472c8 0de407c1b3af 5715a5da241d 2024-04-25T17:17:45.002 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2 smithi037 running (4m) 95s ago 4m 43.1M 4289M 17.2.7-902-gc61472c8 0de407c1b3af 2eedaf9886dd 2024-04-25T17:17:45.002 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3 smithi069 running (4m) 101s ago 4m 43.5M 5312M 17.2.7-902-gc61472c8 0de407c1b3af ebba78fb1923 2024-04-25T17:17:45.002 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4 smithi069 running (3m) 101s ago 3m 43.7M 5312M 17.2.7-902-gc61472c8 0de407c1b3af ba7b785c50f9 2024-04-25T17:17:45.002 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5 smithi069 running (3m) 101s ago 3m 44.5M 5312M 17.2.7-902-gc61472c8 0de407c1b3af f6be99c364ff 2024-04-25T17:17:45.002 INFO:teuthology.orchestra.run.smithi037.stdout:prometheus.smithi037 smithi037 *:9095 running (5m) 95s ago 6m 54.9M - 2.43.0 a07b618ecd1d 13d3c6f36732 2024-04-25T17:17:45.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.002+0000 7f83c2903700 1 -- 172.21.15.37:0/1659882377 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f83a40692b0 msgr2=0x7f83a406b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:17:45.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.002+0000 7f83c2903700 1 --2- 172.21.15.37:0/1659882377 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f83a40692b0 0x7f83a406b760 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f83b0004f90 tx=0x7f83b0009e30 comp rx=0 tx=0).stop 2024-04-25T17:17:45.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.002+0000 7f83c2903700 1 -- 172.21.15.37:0/1659882377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83bc0fce80 msgr2=0x7f83bc10da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:17:45.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.002+0000 7f83c2903700 1 --2- 172.21.15.37:0/1659882377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83bc0fce80 0x7f83bc10da30 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f83ac00c8b0 tx=0x7f83ac004470 comp rx=0 tx=0).stop 2024-04-25T17:17:45.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.003+0000 7f83c2903700 1 -- 172.21.15.37:0/1659882377 shutdown_connections 2024-04-25T17:17:45.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.003+0000 7f83c2903700 1 --2- 172.21.15.37:0/1659882377 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f83a40692b0 0x7f83a406b760 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:45.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.003+0000 7f83c2903700 1 --2- 172.21.15.37:0/1659882377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83bc0fce80 0x7f83bc10da30 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:45.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.003+0000 7f83c2903700 1 --2- 172.21.15.37:0/1659882377 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f83bc0fe080 0x7f83bc10df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:45.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.003+0000 7f83c2903700 1 -- 172.21.15.37:0/1659882377 >> 172.21.15.37:0/1659882377 conn(0x7f83bc0f8590 msgr2=0x7f83bc0f9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:17:45.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.003+0000 7f83c2903700 1 -- 172.21.15.37:0/1659882377 shutdown_connections 2024-04-25T17:17:45.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.003+0000 7f83c2903700 1 -- 172.21.15.37:0/1659882377 wait complete. 2024-04-25T17:17:45.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.108+0000 7f2928f48700 1 -- 172.21.15.37:0/4037389698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29240ffee0 msgr2=0x7f2924102300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:17:45.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.108+0000 7f2928f48700 1 --2- 172.21.15.37:0/4037389698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29240ffee0 0x7f2924102300 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f2918004940 tx=0x7f2918009e30 comp rx=0 tx=0).stop 2024-04-25T17:17:45.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.108+0000 7f2928f48700 1 -- 172.21.15.37:0/4037389698 shutdown_connections 2024-04-25T17:17:45.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.108+0000 7f2928f48700 1 --2- 172.21.15.37:0/4037389698 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29240ffee0 0x7f2924102300 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:45.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.108+0000 7f2928f48700 1 --2- 172.21.15.37:0/4037389698 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f29240662c0 0x7f29240ff9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:45.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.108+0000 7f2928f48700 1 -- 172.21.15.37:0/4037389698 >> 172.21.15.37:0/4037389698 conn(0x7f29240f7430 msgr2=0x7f29240f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:17:45.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.108+0000 7f2928f48700 1 -- 172.21.15.37:0/4037389698 shutdown_connections 2024-04-25T17:17:45.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.109+0000 7f2928f48700 1 -- 172.21.15.37:0/4037389698 wait complete. 2024-04-25T17:17:45.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.109+0000 7f2928f48700 1 Processor -- start 2024-04-25T17:17:45.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.109+0000 7f2928f48700 1 -- start start 2024-04-25T17:17:45.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.109+0000 7f2928f48700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f29240662c0 0x7f292410d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:17:45.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.109+0000 7f2928f48700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29240ffee0 0x7f292410df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:17:45.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.109+0000 7f2928f48700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f292410e510 con 0x7f29240ffee0 2024-04-25T17:17:45.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.109+0000 7f2928f48700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f292410ed10 con 0x7f29240662c0 2024-04-25T17:17:45.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.110+0000 7f292259c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f29240662c0 0x7f292410d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:17:45.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.110+0000 7f292259c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f29240662c0 0x7f292410d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.37:44998/0 (socket says 172.21.15.37:44998) 2024-04-25T17:17:45.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.110+0000 7f292259c700 1 -- 172.21.15.37:0/2684608104 learned_addr learned my addr 172.21.15.37:0/2684608104 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:17:45.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.110+0000 7f2921d9b700 1 --2- 172.21.15.37:0/2684608104 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29240ffee0 0x7f292410df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:17:45.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.110+0000 7f292259c700 1 -- 172.21.15.37:0/2684608104 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29240ffee0 msgr2=0x7f292410df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:17:45.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.110+0000 7f292259c700 1 --2- 172.21.15.37:0/2684608104 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29240ffee0 0x7f292410df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:45.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.110+0000 7f292259c700 1 -- 172.21.15.37:0/2684608104 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2918005040 con 0x7f29240662c0 2024-04-25T17:17:45.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.110+0000 7f2921d9b700 1 --2- 172.21.15.37:0/2684608104 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29240ffee0 0x7f292410df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T17:17:45.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.110+0000 7f292259c700 1 --2- 172.21.15.37:0/2684608104 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f29240662c0 0x7f292410d9d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f291400eb40 tx=0x7f291400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:17:45.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.111+0000 7f2912ffd700 1 -- 172.21.15.37:0/2684608104 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2914007cc0 con 0x7f29240662c0 2024-04-25T17:17:45.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.111+0000 7f2928f48700 1 -- 172.21.15.37:0/2684608104 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f292410ef90 con 0x7f29240662c0 2024-04-25T17:17:45.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.111+0000 7f2912ffd700 1 -- 172.21.15.37:0/2684608104 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f291400f040 con 0x7f29240662c0 2024-04-25T17:17:45.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.111+0000 7f2928f48700 1 -- 172.21.15.37:0/2684608104 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f292410f4d0 con 0x7f29240662c0 2024-04-25T17:17:45.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.112+0000 7f2912ffd700 1 -- 172.21.15.37:0/2684608104 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f291400c9d0 con 0x7f29240662c0 2024-04-25T17:17:45.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.112+0000 7f2928f48700 1 -- 172.21.15.37:0/2684608104 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f292405f5c0 con 0x7f29240662c0 2024-04-25T17:17:45.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.113+0000 7f2912ffd700 1 -- 172.21.15.37:0/2684608104 <== mon.1 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f291400cb30 con 0x7f29240662c0 2024-04-25T17:17:45.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.113+0000 7f2912ffd700 1 --2- 172.21.15.37:0/2684608104 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f290c0692b0 0x7f290c06b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:17:45.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.113+0000 7f2912ffd700 1 -- 172.21.15.37:0/2684608104 <== mon.1 v2:172.21.15.69:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f2914086b20 con 0x7f29240662c0 2024-04-25T17:17:45.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.113+0000 7f2921d9b700 1 --2- 172.21.15.37:0/2684608104 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f290c0692b0 0x7f290c06b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:17:45.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.114+0000 7f2921d9b700 1 --2- 172.21.15.37:0/2684608104 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f290c0692b0 0x7f290c06b760 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f291800b0d0 tx=0x7f2918009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:17:45.121 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.121+0000 7f2912ffd700 1 -- 172.21.15.37:0/2684608104 <== mon.1 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f291404e250 con 0x7f29240662c0 2024-04-25T17:17:45.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.410+0000 7f2928f48700 1 -- 172.21.15.37:0/2684608104 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f292404bed0 con 0x7f29240662c0 2024-04-25T17:17:45.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.410+0000 7f2912ffd700 1 -- 172.21.15.37:0/2684608104 <== mon.1 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7f2914019290 con 0x7f29240662c0 2024-04-25T17:17:45.427 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-25T17:17:45.427 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": { 2024-04-25T17:17:45.427 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 2 2024-04-25T17:17:45.427 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:17:45.427 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": { 2024-04-25T17:17:45.427 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 2 2024-04-25T17:17:45.427 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:17:45.427 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": { 2024-04-25T17:17:45.427 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 6 2024-04-25T17:17:45.427 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:17:45.427 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": { 2024-04-25T17:17:45.427 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 4 2024-04-25T17:17:45.428 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:17:45.428 INFO:teuthology.orchestra.run.smithi037.stdout: "overall": { 2024-04-25T17:17:45.428 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 14 2024-04-25T17:17:45.428 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-04-25T17:17:45.428 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-25T17:17:45.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.413+0000 7f2928f48700 1 -- 172.21.15.37:0/2684608104 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f290c0692b0 msgr2=0x7f290c06b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:17:45.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.413+0000 7f2928f48700 1 --2- 172.21.15.37:0/2684608104 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f290c0692b0 0x7f290c06b760 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f291800b0d0 tx=0x7f2918009e30 comp rx=0 tx=0).stop 2024-04-25T17:17:45.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.413+0000 7f2928f48700 1 -- 172.21.15.37:0/2684608104 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f29240662c0 msgr2=0x7f292410d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:17:45.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.413+0000 7f2928f48700 1 --2- 172.21.15.37:0/2684608104 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f29240662c0 0x7f292410d9d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f291400eb40 tx=0x7f291400b040 comp rx=0 tx=0).stop 2024-04-25T17:17:45.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.413+0000 7f2928f48700 1 -- 172.21.15.37:0/2684608104 shutdown_connections 2024-04-25T17:17:45.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.413+0000 7f2928f48700 1 --2- 172.21.15.37:0/2684608104 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f290c0692b0 0x7f290c06b760 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:45.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.413+0000 7f2928f48700 1 --2- 172.21.15.37:0/2684608104 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f29240662c0 0x7f292410d9d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:45.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.413+0000 7f2928f48700 1 --2- 172.21.15.37:0/2684608104 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f29240ffee0 0x7f292410df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:45.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.413+0000 7f2928f48700 1 -- 172.21.15.37:0/2684608104 >> 172.21.15.37:0/2684608104 conn(0x7f29240f7430 msgr2=0x7f29240f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:17:45.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.413+0000 7f2928f48700 1 -- 172.21.15.37:0/2684608104 shutdown_connections 2024-04-25T17:17:45.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.413+0000 7f2928f48700 1 -- 172.21.15.37:0/2684608104 wait complete. 2024-04-25T17:17:45.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.519+0000 7f38537f4700 1 -- 172.21.15.37:0/3116378037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f384c0fe3e0 msgr2=0x7f384c0fe7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:17:45.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.519+0000 7f38537f4700 1 --2- 172.21.15.37:0/3116378037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f384c0fe3e0 0x7f384c0fe7f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3848004940 tx=0x7f3848009e30 comp rx=0 tx=0).stop 2024-04-25T17:17:45.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.519+0000 7f38537f4700 1 -- 172.21.15.37:0/3116378037 shutdown_connections 2024-04-25T17:17:45.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.519+0000 7f38537f4700 1 --2- 172.21.15.37:0/3116378037 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f384c0fed30 0x7f384c0fae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:45.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.519+0000 7f38537f4700 1 --2- 172.21.15.37:0/3116378037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f384c0fe3e0 0x7f384c0fe7f0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:45.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.519+0000 7f38537f4700 1 -- 172.21.15.37:0/3116378037 >> 172.21.15.37:0/3116378037 conn(0x7f384c0f6b80 msgr2=0x7f384c0f8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:17:45.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.520+0000 7f38537f4700 1 -- 172.21.15.37:0/3116378037 shutdown_connections 2024-04-25T17:17:45.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.520+0000 7f38537f4700 1 -- 172.21.15.37:0/3116378037 wait complete. 2024-04-25T17:17:45.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.520+0000 7f38537f4700 1 Processor -- start 2024-04-25T17:17:45.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.520+0000 7f38537f4700 1 -- start start 2024-04-25T17:17:45.522 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.521+0000 7f38537f4700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f384c0fe3e0 0x7f384c10fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:17:45.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.521+0000 7f38537f4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f384c0fed30 0x7f384c1100e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:17:45.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.521+0000 7f38537f4700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384c1106e0 con 0x7f384c0fed30 2024-04-25T17:17:45.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.521+0000 7f38537f4700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384c110f30 con 0x7f384c0fe3e0 2024-04-25T17:17:45.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.521+0000 7f3850d8f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f384c0fed30 0x7f384c1100e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:17:45.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.521+0000 7f3850d8f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f384c0fed30 0x7f384c1100e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37934/0 (socket says 172.21.15.37:37934) 2024-04-25T17:17:45.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.521+0000 7f3850d8f700 1 -- 172.21.15.37:0/419356843 learned_addr learned my addr 172.21.15.37:0/419356843 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:17:45.523 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.521+0000 7f3851590700 1 --2- 172.21.15.37:0/419356843 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f384c0fe3e0 0x7f384c10fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:17:45.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.521+0000 7f3850d8f700 1 -- 172.21.15.37:0/419356843 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f384c0fe3e0 msgr2=0x7f384c10fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:17:45.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.521+0000 7f3850d8f700 1 --2- 172.21.15.37:0/419356843 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f384c0fe3e0 0x7f384c10fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:45.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.521+0000 7f3850d8f700 1 -- 172.21.15.37:0/419356843 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3848005040 con 0x7f384c0fed30 2024-04-25T17:17:45.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.521+0000 7f3850d8f700 1 --2- 172.21.15.37:0/419356843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f384c0fed30 0x7f384c1100e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f383c002a80 tx=0x7f383c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:17:45.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.521+0000 7f3841ffb700 1 -- 172.21.15.37:0/419356843 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f383c007cc0 con 0x7f384c0fed30 2024-04-25T17:17:45.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.522+0000 7f3841ffb700 1 -- 172.21.15.37:0/419356843 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f383c00f040 con 0x7f384c0fed30 2024-04-25T17:17:45.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.522+0000 7f38537f4700 1 -- 172.21.15.37:0/419356843 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f384c111210 con 0x7f384c0fed30 2024-04-25T17:17:45.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.522+0000 7f38537f4700 1 -- 172.21.15.37:0/419356843 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f384c111750 con 0x7f384c0fed30 2024-04-25T17:17:45.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.522+0000 7f3841ffb700 1 -- 172.21.15.37:0/419356843 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f383c00dac0 con 0x7f384c0fed30 2024-04-25T17:17:45.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.524+0000 7f38537f4700 1 -- 172.21.15.37:0/419356843 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f384c101b20 con 0x7f384c0fed30 2024-04-25T17:17:45.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.524+0000 7f3841ffb700 1 -- 172.21.15.37:0/419356843 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f383c00dcc0 con 0x7f384c0fed30 2024-04-25T17:17:45.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.524+0000 7f3841ffb700 1 --2- 172.21.15.37:0/419356843 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f38380692a0 0x7f383806b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:17:45.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.525+0000 7f3851590700 1 --2- 172.21.15.37:0/419356843 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f38380692a0 0x7f383806b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:17:45.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.525+0000 7f3841ffb700 1 -- 172.21.15.37:0/419356843 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f383c086d50 con 0x7f384c0fed30 2024-04-25T17:17:45.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.525+0000 7f3851590700 1 --2- 172.21.15.37:0/419356843 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f38380692a0 0x7f383806b750 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f384800b3b0 tx=0x7f3848009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:17:45.533 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.533+0000 7f3841ffb700 1 -- 172.21.15.37:0/419356843 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f383c056b10 con 0x7f384c0fed30 2024-04-25T17:17:45.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.820+0000 7f38537f4700 1 -- 172.21.15.37:0/419356843 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f384c05f5c0 con 0x7f384c0fed30 2024-04-25T17:17:45.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.820+0000 7f3841ffb700 1 -- 172.21.15.37:0/419356843 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1830 (secure 0 0 0) 0x7f383c0566a0 con 0x7f384c0fed30 2024-04-25T17:17:45.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:45 smithi037 ceph-mon[26472]: from='client.24393 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:17:45.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:45 smithi037 ceph-mon[26472]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:17:45.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:45 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/2684608104' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:17:45.821 INFO:teuthology.orchestra.run.smithi037.stdout:e16 2024-04-25T17:17:45.821 INFO:teuthology.orchestra.run.smithi037.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-25T17:17:45.821 INFO:teuthology.orchestra.run.smithi037.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T17:17:45.821 INFO:teuthology.orchestra.run.smithi037.stdout:legacy client fscid: 1 2024-04-25T17:17:45.821 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:17:45.821 INFO:teuthology.orchestra.run.smithi037.stdout:Filesystem 'cephfs' (1) 2024-04-25T17:17:45.821 INFO:teuthology.orchestra.run.smithi037.stdout:fs_name cephfs 2024-04-25T17:17:45.821 INFO:teuthology.orchestra.run.smithi037.stdout:epoch 16 2024-04-25T17:17:45.822 INFO:teuthology.orchestra.run.smithi037.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-25T17:17:45.822 INFO:teuthology.orchestra.run.smithi037.stdout:created 2024-04-25T17:15:40.586130+0000 2024-04-25T17:17:45.822 INFO:teuthology.orchestra.run.smithi037.stdout:modified 2024-04-25T17:15:57.508740+0000 2024-04-25T17:17:45.822 INFO:teuthology.orchestra.run.smithi037.stdout:tableserver 0 2024-04-25T17:17:45.822 INFO:teuthology.orchestra.run.smithi037.stdout:root 0 2024-04-25T17:17:45.822 INFO:teuthology.orchestra.run.smithi037.stdout:session_timeout 60 2024-04-25T17:17:45.822 INFO:teuthology.orchestra.run.smithi037.stdout:session_autoclose 300 2024-04-25T17:17:45.822 INFO:teuthology.orchestra.run.smithi037.stdout:max_file_size 1099511627776 2024-04-25T17:17:45.822 INFO:teuthology.orchestra.run.smithi037.stdout:required_client_features {} 2024-04-25T17:17:45.822 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure 0 2024-04-25T17:17:45.822 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure_osd_epoch 0 2024-04-25T17:17:45.822 INFO:teuthology.orchestra.run.smithi037.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T17:17:45.823 INFO:teuthology.orchestra.run.smithi037.stdout:max_mds 1 2024-04-25T17:17:45.823 INFO:teuthology.orchestra.run.smithi037.stdout:in 0 2024-04-25T17:17:45.823 INFO:teuthology.orchestra.run.smithi037.stdout:up {0=14470} 2024-04-25T17:17:45.823 INFO:teuthology.orchestra.run.smithi037.stdout:failed 2024-04-25T17:17:45.823 INFO:teuthology.orchestra.run.smithi037.stdout:damaged 2024-04-25T17:17:45.823 INFO:teuthology.orchestra.run.smithi037.stdout:stopped 2024-04-25T17:17:45.823 INFO:teuthology.orchestra.run.smithi037.stdout:data_pools [3] 2024-04-25T17:17:45.823 INFO:teuthology.orchestra.run.smithi037.stdout:metadata_pool 2 2024-04-25T17:17:45.823 INFO:teuthology.orchestra.run.smithi037.stdout:inline_data disabled 2024-04-25T17:17:45.823 INFO:teuthology.orchestra.run.smithi037.stdout:balancer 2024-04-25T17:17:45.823 INFO:teuthology.orchestra.run.smithi037.stdout:standby_count_wanted 1 2024-04-25T17:17:45.823 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi037.ksmixc{0:14470} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.37:6826/1903989494,v1:172.21.15.37:6827/1903989494] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:17:45.823 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi037.ovkrpq{0:14482} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.37:6828/4206394422,v1:172.21.15.37:6829/4206394422] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:17:45.823 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:17:45.823 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:17:45.824 INFO:teuthology.orchestra.run.smithi037.stdout:Standby daemons: 2024-04-25T17:17:45.824 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:17:45.824 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi069.cpprst{-1:24289} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.69:6826/518856100,v1:172.21.15.69:6827/518856100] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:17:45.824 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi069.ytlqcf{-1:24293} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.69:6824/134210439,v1:172.21.15.69:6825/134210439] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:17:45.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.822+0000 7f38537f4700 1 -- 172.21.15.37:0/419356843 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f38380692a0 msgr2=0x7f383806b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:17:45.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.822+0000 7f38537f4700 1 --2- 172.21.15.37:0/419356843 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f38380692a0 0x7f383806b750 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f384800b3b0 tx=0x7f3848009e30 comp rx=0 tx=0).stop 2024-04-25T17:17:45.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.822+0000 7f38537f4700 1 -- 172.21.15.37:0/419356843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f384c0fed30 msgr2=0x7f384c1100e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:17:45.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.822+0000 7f38537f4700 1 --2- 172.21.15.37:0/419356843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f384c0fed30 0x7f384c1100e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f383c002a80 tx=0x7f383c0046b0 comp rx=0 tx=0).stop 2024-04-25T17:17:45.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.823+0000 7f38537f4700 1 -- 172.21.15.37:0/419356843 shutdown_connections 2024-04-25T17:17:45.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.823+0000 7f38537f4700 1 --2- 172.21.15.37:0/419356843 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f38380692a0 0x7f383806b750 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:45.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.823+0000 7f38537f4700 1 --2- 172.21.15.37:0/419356843 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f384c0fe3e0 0x7f384c10fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:45.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.823+0000 7f38537f4700 1 --2- 172.21.15.37:0/419356843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f384c0fed30 0x7f384c1100e0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:45.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.823+0000 7f38537f4700 1 -- 172.21.15.37:0/419356843 >> 172.21.15.37:0/419356843 conn(0x7f384c0f6b80 msgr2=0x7f384c0f80d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:17:45.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.823+0000 7f38537f4700 1 -- 172.21.15.37:0/419356843 shutdown_connections 2024-04-25T17:17:45.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.823+0000 7f38537f4700 1 -- 172.21.15.37:0/419356843 wait complete. 2024-04-25T17:17:45.825 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 16 2024-04-25T17:17:45.910 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:45 smithi069 ceph-mon[34527]: from='client.24393 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:17:45.910 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:45 smithi069 ceph-mon[34527]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:17:45.910 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:45 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/2684608104' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:17:45.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.932+0000 7f02da6c6700 1 -- 172.21.15.37:0/222490981 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02d40fe3e0 msgr2=0x7f02d40fe7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:17:45.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.932+0000 7f02da6c6700 1 --2- 172.21.15.37:0/222490981 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02d40fe3e0 0x7f02d40fe7f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f02c4004940 tx=0x7f02c4009e30 comp rx=0 tx=0).stop 2024-04-25T17:17:45.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.932+0000 7f02da6c6700 1 -- 172.21.15.37:0/222490981 shutdown_connections 2024-04-25T17:17:45.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.932+0000 7f02da6c6700 1 --2- 172.21.15.37:0/222490981 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f02d40fed30 0x7f02d40fae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:45.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.932+0000 7f02da6c6700 1 --2- 172.21.15.37:0/222490981 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02d40fe3e0 0x7f02d40fe7f0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:45.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.932+0000 7f02da6c6700 1 -- 172.21.15.37:0/222490981 >> 172.21.15.37:0/222490981 conn(0x7f02d40f6b80 msgr2=0x7f02d40f8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:17:45.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.932+0000 7f02da6c6700 1 -- 172.21.15.37:0/222490981 shutdown_connections 2024-04-25T17:17:45.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.932+0000 7f02da6c6700 1 -- 172.21.15.37:0/222490981 wait complete. 2024-04-25T17:17:45.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.932+0000 7f02da6c6700 1 Processor -- start 2024-04-25T17:17:45.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.933+0000 7f02da6c6700 1 -- start start 2024-04-25T17:17:45.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.933+0000 7f02da6c6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02d40fe3e0 0x7f02d410d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:17:45.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.933+0000 7f02da6c6700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f02d40fed30 0x7f02d410df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:17:45.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.933+0000 7f02da6c6700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d410e510 con 0x7f02d40fe3e0 2024-04-25T17:17:45.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.933+0000 7f02da6c6700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02d410ed60 con 0x7f02d40fed30 2024-04-25T17:17:45.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.933+0000 7f02d3fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02d40fe3e0 0x7f02d410d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:17:45.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.933+0000 7f02d3fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02d40fe3e0 0x7f02d410d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37944/0 (socket says 172.21.15.37:37944) 2024-04-25T17:17:45.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.933+0000 7f02d3fff700 1 -- 172.21.15.37:0/835216483 learned_addr learned my addr 172.21.15.37:0/835216483 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:17:45.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.933+0000 7f02d37fe700 1 --2- 172.21.15.37:0/835216483 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f02d40fed30 0x7f02d410df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:17:45.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.933+0000 7f02d3fff700 1 -- 172.21.15.37:0/835216483 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f02d40fed30 msgr2=0x7f02d410df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:17:45.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.933+0000 7f02d3fff700 1 --2- 172.21.15.37:0/835216483 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f02d40fed30 0x7f02d410df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:45.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.933+0000 7f02d3fff700 1 -- 172.21.15.37:0/835216483 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02c4005040 con 0x7f02d40fe3e0 2024-04-25T17:17:45.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.934+0000 7f02d3fff700 1 --2- 172.21.15.37:0/835216483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02d40fe3e0 0x7f02d410d9d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f02c400b3b0 tx=0x7f02c4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:17:45.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.934+0000 7f02d0ff9700 1 -- 172.21.15.37:0/835216483 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f02c400e040 con 0x7f02d40fe3e0 2024-04-25T17:17:45.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.934+0000 7f02da6c6700 1 -- 172.21.15.37:0/835216483 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02d410efe0 con 0x7f02d40fe3e0 2024-04-25T17:17:45.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.934+0000 7f02d0ff9700 1 -- 172.21.15.37:0/835216483 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f02c400bbf0 con 0x7f02d40fe3e0 2024-04-25T17:17:45.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.934+0000 7f02d0ff9700 1 -- 172.21.15.37:0/835216483 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f02c401c630 con 0x7f02d40fe3e0 2024-04-25T17:17:45.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.934+0000 7f02da6c6700 1 -- 172.21.15.37:0/835216483 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02d410f520 con 0x7f02d40fe3e0 2024-04-25T17:17:45.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.935+0000 7f02da6c6700 1 -- 172.21.15.37:0/835216483 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02d405f5c0 con 0x7f02d40fe3e0 2024-04-25T17:17:45.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.935+0000 7f02d0ff9700 1 -- 172.21.15.37:0/835216483 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7f02c400bd60 con 0x7f02d40fe3e0 2024-04-25T17:17:45.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.936+0000 7f02d0ff9700 1 --2- 172.21.15.37:0/835216483 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f02bc0692a0 0x7f02bc06b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:17:45.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.936+0000 7f02d0ff9700 1 -- 172.21.15.37:0/835216483 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f02c4087da0 con 0x7f02d40fe3e0 2024-04-25T17:17:45.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.936+0000 7f02d37fe700 1 --2- 172.21.15.37:0/835216483 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f02bc0692a0 0x7f02bc06b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:17:45.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.936+0000 7f02d37fe700 1 --2- 172.21.15.37:0/835216483 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f02bc0692a0 0x7f02bc06b750 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f02c8004f40 tx=0x7f02c800b040 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:17:45.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:45.940+0000 7f02d0ff9700 1 -- 172.21.15.37:0/835216483 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7f02c4057c00 con 0x7f02d40fe3e0 2024-04-25T17:17:46.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:46.156+0000 7f02da6c6700 1 -- 172.21.15.37:0/835216483 --> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f02d410f850 con 0x7f02bc0692a0 2024-04-25T17:17:46.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:46.157+0000 7f02d0ff9700 1 -- 172.21.15.37:0/835216483 <== mgr.14214 v2:172.21.15.37:6800/3566135606 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f02d410f850 con 0x7f02bc0692a0 2024-04-25T17:17:46.157 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-25T17:17:46.158 INFO:teuthology.orchestra.run.smithi037.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385", 2024-04-25T17:17:46.158 INFO:teuthology.orchestra.run.smithi037.stdout: "in_progress": true, 2024-04-25T17:17:46.158 INFO:teuthology.orchestra.run.smithi037.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-25T17:17:46.158 INFO:teuthology.orchestra.run.smithi037.stdout: "services_complete": [], 2024-04-25T17:17:46.158 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": "0/21 daemons upgraded", 2024-04-25T17:17:46.158 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "Currently upgrading mgr daemons", 2024-04-25T17:17:46.158 INFO:teuthology.orchestra.run.smithi037.stdout: "is_paused": false 2024-04-25T17:17:46.158 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-25T17:17:46.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:46.159+0000 7f02da6c6700 1 -- 172.21.15.37:0/835216483 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f02bc0692a0 msgr2=0x7f02bc06b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:17:46.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:46.159+0000 7f02da6c6700 1 --2- 172.21.15.37:0/835216483 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f02bc0692a0 0x7f02bc06b750 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f02c8004f40 tx=0x7f02c800b040 comp rx=0 tx=0).stop 2024-04-25T17:17:46.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:46.159+0000 7f02da6c6700 1 -- 172.21.15.37:0/835216483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02d40fe3e0 msgr2=0x7f02d410d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:17:46.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:46.159+0000 7f02da6c6700 1 --2- 172.21.15.37:0/835216483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02d40fe3e0 0x7f02d410d9d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f02c400b3b0 tx=0x7f02c4009e30 comp rx=0 tx=0).stop 2024-04-25T17:17:46.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:46.160+0000 7f02da6c6700 1 -- 172.21.15.37:0/835216483 shutdown_connections 2024-04-25T17:17:46.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:46.160+0000 7f02da6c6700 1 --2- 172.21.15.37:0/835216483 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7f02bc0692a0 0x7f02bc06b750 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:46.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:46.160+0000 7f02da6c6700 1 --2- 172.21.15.37:0/835216483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f02d40fe3e0 0x7f02d410d9d0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:46.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:46.160+0000 7f02da6c6700 1 --2- 172.21.15.37:0/835216483 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f02d40fed30 0x7f02d410df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:46.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:46.160+0000 7f02da6c6700 1 -- 172.21.15.37:0/835216483 >> 172.21.15.37:0/835216483 conn(0x7f02d40f6b80 msgr2=0x7f02d40f8260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:17:46.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:46.160+0000 7f02da6c6700 1 -- 172.21.15.37:0/835216483 shutdown_connections 2024-04-25T17:17:46.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:46.160+0000 7f02da6c6700 1 -- 172.21.15.37:0/835216483 wait complete. 2024-04-25T17:17:46.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:46.269+0000 7ffa4b861700 1 -- 172.21.15.37:0/1443664492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa440ffef0 msgr2=0x7ffa44102310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:17:46.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:46.269+0000 7ffa4b861700 1 --2- 172.21.15.37:0/1443664492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa440ffef0 0x7ffa44102310 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ffa34004940 tx=0x7ffa34009e30 comp rx=0 tx=0).stop 2024-04-25T17:17:46.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:46.269+0000 7ffa4b861700 1 -- 172.21.15.37:0/1443664492 shutdown_connections 2024-04-25T17:17:46.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:46.269+0000 7ffa4b861700 1 --2- 172.21.15.37:0/1443664492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa440ffef0 0x7ffa44102310 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:46.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:46.269+0000 7ffa4b861700 1 --2- 172.21.15.37:0/1443664492 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffa44066f30 0x7ffa440ff9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:46.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:46.269+0000 7ffa4b861700 1 -- 172.21.15.37:0/1443664492 >> 172.21.15.37:0/1443664492 conn(0x7ffa440f7440 msgr2=0x7ffa440f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:17:46.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:46.270+0000 7ffa4b861700 1 -- 172.21.15.37:0/1443664492 shutdown_connections 2024-04-25T17:17:46.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:46.270+0000 7ffa4b861700 1 -- 172.21.15.37:0/1443664492 wait complete. 2024-04-25T17:17:46.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:46.270+0000 7ffa4b861700 1 Processor -- start 2024-04-25T17:17:46.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:46.270+0000 7ffa4b861700 1 -- start start 2024-04-25T17:17:46.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:46.270+0000 7ffa4b861700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa44066f30 0x7ffa4410d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:17:46.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:46.270+0000 7ffa4b861700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffa440ffef0 0x7ffa4410dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:17:46.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:46.270+0000 7ffa4b861700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4410e4a0 con 0x7ffa44066f30 2024-04-25T17:17:46.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:46.270+0000 7ffa4b861700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4410e610 con 0x7ffa440ffef0 2024-04-25T17:17:46.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:46.270+0000 7ffa495fd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa44066f30 0x7ffa4410d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:17:46.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:46.270+0000 7ffa495fd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa44066f30 0x7ffa4410d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37958/0 (socket says 172.21.15.37:37958) 2024-04-25T17:17:46.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:46.270+0000 7ffa495fd700 1 -- 172.21.15.37:0/2712168411 learned_addr learned my addr 172.21.15.37:0/2712168411 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:17:46.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:46.271+0000 7ffa48dfc700 1 --2- 172.21.15.37:0/2712168411 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffa440ffef0 0x7ffa4410dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:17:46.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:46.271+0000 7ffa495fd700 1 -- 172.21.15.37:0/2712168411 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffa440ffef0 msgr2=0x7ffa4410dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:17:46.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:46.271+0000 7ffa495fd700 1 --2- 172.21.15.37:0/2712168411 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffa440ffef0 0x7ffa4410dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:46.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:46.271+0000 7ffa495fd700 1 -- 172.21.15.37:0/2712168411 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa34005040 con 0x7ffa44066f30 2024-04-25T17:17:46.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:46.271+0000 7ffa495fd700 1 --2- 172.21.15.37:0/2712168411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa44066f30 0x7ffa4410d960 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ffa40002a50 tx=0x7ffa40004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:17:46.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:46.271+0000 7ffa39ffb700 1 -- 172.21.15.37:0/2712168411 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa40007cc0 con 0x7ffa44066f30 2024-04-25T17:17:46.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:46.271+0000 7ffa39ffb700 1 -- 172.21.15.37:0/2712168411 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffa4000f040 con 0x7ffa44066f30 2024-04-25T17:17:46.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:46.271+0000 7ffa4b861700 1 -- 172.21.15.37:0/2712168411 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa44113070 con 0x7ffa44066f30 2024-04-25T17:17:46.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:46.271+0000 7ffa39ffb700 1 -- 172.21.15.37:0/2712168411 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa4000d9c0 con 0x7ffa44066f30 2024-04-25T17:17:46.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:46.271+0000 7ffa4b861700 1 -- 172.21.15.37:0/2712168411 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa44113630 con 0x7ffa44066f30 2024-04-25T17:17:46.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:46.272+0000 7ffa4b861700 1 -- 172.21.15.37:0/2712168411 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa4404c710 con 0x7ffa44066f30 2024-04-25T17:17:46.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:46.273+0000 7ffa39ffb700 1 -- 172.21.15.37:0/2712168411 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 19) v1 ==== 86629+0+0 (secure 0 0 0) 0x7ffa40009730 con 0x7ffa44066f30 2024-04-25T17:17:46.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:46.273+0000 7ffa39ffb700 1 --2- 172.21.15.37:0/2712168411 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7ffa300692a0 0x7ffa3006b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:17:46.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:46.273+0000 7ffa39ffb700 1 -- 172.21.15.37:0/2712168411 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5464+0+0 (secure 0 0 0) 0x7ffa40086f40 con 0x7ffa44066f30 2024-04-25T17:17:46.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:46.273+0000 7ffa48dfc700 1 --2- 172.21.15.37:0/2712168411 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7ffa300692a0 0x7ffa3006b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:17:46.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:46.274+0000 7ffa48dfc700 1 --2- 172.21.15.37:0/2712168411 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7ffa300692a0 0x7ffa3006b750 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ffa3400b970 tx=0x7ffa34009e30 comp rx=0 tx=0).ready entity=mgr.14214 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:17:46.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:46.278+0000 7ffa39ffb700 1 -- 172.21.15.37:0/2712168411 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176702 (secure 0 0 0) 0x7ffa40056c80 con 0x7ffa44066f30 2024-04-25T17:17:46.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:46.557+0000 7ffa4b861700 1 -- 172.21.15.37:0/2712168411 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ffa44113a70 con 0x7ffa44066f30 2024-04-25T17:17:46.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:46.557+0000 7ffa39ffb700 1 -- 172.21.15.37:0/2712168411 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7ffa40056810 con 0x7ffa44066f30 2024-04-25T17:17:46.559 INFO:teuthology.orchestra.run.smithi037.stdout:HEALTH_OK 2024-04-25T17:17:46.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:46.559+0000 7ffa4b861700 1 -- 172.21.15.37:0/2712168411 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7ffa300692a0 msgr2=0x7ffa3006b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:17:46.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:46.559+0000 7ffa4b861700 1 --2- 172.21.15.37:0/2712168411 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7ffa300692a0 0x7ffa3006b750 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ffa3400b970 tx=0x7ffa34009e30 comp rx=0 tx=0).stop 2024-04-25T17:17:46.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:46.559+0000 7ffa4b861700 1 -- 172.21.15.37:0/2712168411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa44066f30 msgr2=0x7ffa4410d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:17:46.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:46.559+0000 7ffa4b861700 1 --2- 172.21.15.37:0/2712168411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa44066f30 0x7ffa4410d960 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ffa40002a50 tx=0x7ffa40004600 comp rx=0 tx=0).stop 2024-04-25T17:17:46.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:46.559+0000 7ffa4b861700 1 -- 172.21.15.37:0/2712168411 shutdown_connections 2024-04-25T17:17:46.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:46.559+0000 7ffa4b861700 1 --2- 172.21.15.37:0/2712168411 >> [v2:172.21.15.37:6800/3566135606,v1:172.21.15.37:6801/3566135606] conn(0x7ffa300692a0 0x7ffa3006b750 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:46.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:46.559+0000 7ffa4b861700 1 --2- 172.21.15.37:0/2712168411 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa44066f30 0x7ffa4410d960 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:46.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:46.559+0000 7ffa4b861700 1 --2- 172.21.15.37:0/2712168411 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffa440ffef0 0x7ffa4410dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:17:46.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:46.559+0000 7ffa4b861700 1 -- 172.21.15.37:0/2712168411 >> 172.21.15.37:0/2712168411 conn(0x7ffa440f7440 msgr2=0x7ffa440f7810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:17:46.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:46.559+0000 7ffa4b861700 1 -- 172.21.15.37:0/2712168411 shutdown_connections 2024-04-25T17:17:46.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:17:46.559+0000 7ffa4b861700 1 -- 172.21.15.37:0/2712168411 wait complete. 2024-04-25T17:17:46.632 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:46 smithi069 ceph-mon[34527]: from='client.14632 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:17:46.632 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:46 smithi069 ceph-mon[34527]: pgmap v239: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:17:46.633 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:46 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/419356843' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T17:17:46.633 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:46 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/2712168411' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T17:17:46.633 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:46 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:17:46.633 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:46 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:17:46.633 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:46 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:17:46.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:46 smithi037 ceph-mon[26472]: from='client.14632 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:17:46.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:46 smithi037 ceph-mon[26472]: pgmap v239: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:17:46.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:46 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/419356843' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T17:17:46.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:46 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/2712168411' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T17:17:46.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:46 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:17:46.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:46 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:17:46.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:46 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:17:47.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:47 smithi069 ceph-mon[34527]: from='client.14644 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:17:48.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:47 smithi037 ceph-mon[26472]: from='client.14644 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:17:48.530 INFO:tasks.workunit.client.0.smithi037.stderr:Updating files: 93% (11422/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-04-25T17:17:48.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:48 smithi069 ceph-mon[34527]: pgmap v240: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:17:49.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:48 smithi037 ceph-mon[26472]: pgmap v240: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:17:49.253 INFO:tasks.workunit.client.0.smithi037.stderr:Note: switching to '994e2f20102a20fa9a27966c14b625cc01884df8'. 2024-04-25T17:17:49.253 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-04-25T17:17:49.253 INFO:tasks.workunit.client.0.smithi037.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-25T17:17:49.254 INFO:tasks.workunit.client.0.smithi037.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-25T17:17:49.254 INFO:tasks.workunit.client.0.smithi037.stderr:state without impacting any branches by switching back to a branch. 2024-04-25T17:17:49.254 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-04-25T17:17:49.254 INFO:tasks.workunit.client.0.smithi037.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-25T17:17:49.254 INFO:tasks.workunit.client.0.smithi037.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-25T17:17:49.254 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-04-25T17:17:49.254 INFO:tasks.workunit.client.0.smithi037.stderr: git switch -c 2024-04-25T17:17:49.254 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-04-25T17:17:49.254 INFO:tasks.workunit.client.0.smithi037.stderr:Or undo this operation with: 2024-04-25T17:17:49.254 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-04-25T17:17:49.254 INFO:tasks.workunit.client.0.smithi037.stderr: git switch - 2024-04-25T17:17:49.254 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-04-25T17:17:49.254 INFO:tasks.workunit.client.0.smithi037.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-25T17:17:49.254 INFO:tasks.workunit.client.0.smithi037.stderr: 2024-04-25T17:17:49.254 INFO:tasks.workunit.client.0.smithi037.stderr:HEAD is now at 994e2f20102 Merge PR #56810 into wip-pdonnell-testing-20240425.015853-debug 2024-04-25T17:17:49.260 DEBUG:teuthology.orchestra.run.smithi037:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-25T17:17:49.323 INFO:tasks.workunit.client.0.smithi037.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-25T17:17:49.325 INFO:tasks.workunit.client.0.smithi037.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-25T17:17:49.326 INFO:tasks.workunit.client.0.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-25T17:17:49.949 INFO:tasks.workunit.client.0.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-25T17:17:50.004 INFO:tasks.workunit.client.0.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-25T17:17:50.044 INFO:tasks.workunit.client.0.smithi037.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-25T17:17:50.046 INFO:tasks.workunit.client.0.smithi037.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-25T17:17:50.046 INFO:tasks.workunit.client.0.smithi037.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-25T17:17:50.088 INFO:tasks.workunit.client.0.smithi037.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-25T17:17:50.091 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-25T17:17:50.091 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-25T17:17:50.147 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-04-25T17:17:50.148 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-04-25T17:17:50.149 DEBUG:teuthology.orchestra.run.smithi037:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=994e2f20102a20fa9a27966c14b625cc01884df8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-04-25T17:17:50.212 INFO:tasks.workunit.client.0.smithi037.stderr:+ mkdir -p fsstress 2024-04-25T17:17:50.214 INFO:tasks.workunit.client.0.smithi037.stderr:+ pushd fsstress 2024-04-25T17:17:50.215 INFO:tasks.workunit.client.0.smithi037.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-25T17:17:50.215 INFO:tasks.workunit.client.0.smithi037.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-04-25T17:17:50.999 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:50 smithi069 ceph-mon[34527]: pgmap v241: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:17:50.999 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:50 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:17:50.999 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:50 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:17:50.999 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:50 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:17:50.999 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:50 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:17:51.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:50 smithi037 ceph-mon[26472]: pgmap v241: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:17:51.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:50 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:17:51.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:50 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:17:51.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:50 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:17:51.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:50 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:17:51.502 INFO:tasks.workunit.client.0.smithi037.stderr:+ tar xzf ltp-full.tgz 2024-04-25T17:17:52.882 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:52 smithi069 ceph-mon[34527]: pgmap v242: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:17:53.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:52 smithi037 ceph-mon[26472]: pgmap v242: 65 pgs: 65 active+clean; 588 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:17:54.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:54 smithi069 ceph-mon[34527]: pgmap v243: 65 pgs: 65 active+clean; 4.3 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 324 KiB/s wr, 11 op/s 2024-04-25T17:17:55.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:54 smithi037 ceph-mon[26472]: pgmap v243: 65 pgs: 65 active+clean; 4.3 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 324 KiB/s wr, 11 op/s 2024-04-25T17:17:55.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:55 smithi069 ceph-mon[34527]: Standby manager daemon smithi069.mmuhdo restarted 2024-04-25T17:17:55.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:55 smithi069 ceph-mon[34527]: Standby manager daemon smithi069.mmuhdo started 2024-04-25T17:17:55.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:55 smithi069 ceph-mon[34527]: from='mgr.? 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi069.mmuhdo/crt"}]: dispatch 2024-04-25T17:17:55.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:55 smithi069 ceph-mon[34527]: from='mgr.? 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T17:17:55.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:55 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:17:55.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:55 smithi069 ceph-mon[34527]: from='mgr.? 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi069.mmuhdo/key"}]: dispatch 2024-04-25T17:17:55.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:55 smithi069 ceph-mon[34527]: from='mgr.? 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T17:17:56.066 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:55 smithi037 ceph-mon[26472]: Standby manager daemon smithi069.mmuhdo restarted 2024-04-25T17:17:56.066 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:55 smithi037 ceph-mon[26472]: Standby manager daemon smithi069.mmuhdo started 2024-04-25T17:17:56.066 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:55 smithi037 ceph-mon[26472]: from='mgr.? 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi069.mmuhdo/crt"}]: dispatch 2024-04-25T17:17:56.066 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:55 smithi037 ceph-mon[26472]: from='mgr.? 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T17:17:56.066 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:55 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:17:56.066 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:55 smithi037 ceph-mon[26472]: from='mgr.? 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi069.mmuhdo/key"}]: dispatch 2024-04-25T17:17:56.067 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:55 smithi037 ceph-mon[26472]: from='mgr.? 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T17:17:56.707 INFO:tasks.workunit.client.1.smithi069.stderr:Updating files: 87% (10728/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-04-25T17:17:57.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:56 smithi037 ceph-mon[26472]: pgmap v244: 65 pgs: 65 active+clean; 9.4 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 780 KiB/s wr, 40 op/s 2024-04-25T17:17:57.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:56 smithi037 ceph-mon[26472]: mgrmap e20: smithi037.txrgxl(active, since 7m), standbys: smithi069.mmuhdo 2024-04-25T17:17:57.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:56 smithi069 ceph-mon[34527]: pgmap v244: 65 pgs: 65 active+clean; 9.4 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 780 KiB/s wr, 40 op/s 2024-04-25T17:17:57.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:56 smithi069 ceph-mon[34527]: mgrmap e20: smithi037.txrgxl(active, since 7m), standbys: smithi069.mmuhdo 2024-04-25T17:17:57.600 INFO:tasks.workunit.client.1.smithi069.stderr:Note: switching to '994e2f20102a20fa9a27966c14b625cc01884df8'. 2024-04-25T17:17:57.600 INFO:tasks.workunit.client.1.smithi069.stderr: 2024-04-25T17:17:57.600 INFO:tasks.workunit.client.1.smithi069.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-25T17:17:57.601 INFO:tasks.workunit.client.1.smithi069.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-25T17:17:57.601 INFO:tasks.workunit.client.1.smithi069.stderr:state without impacting any branches by switching back to a branch. 2024-04-25T17:17:57.601 INFO:tasks.workunit.client.1.smithi069.stderr: 2024-04-25T17:17:57.601 INFO:tasks.workunit.client.1.smithi069.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-25T17:17:57.601 INFO:tasks.workunit.client.1.smithi069.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-25T17:17:57.601 INFO:tasks.workunit.client.1.smithi069.stderr: 2024-04-25T17:17:57.601 INFO:tasks.workunit.client.1.smithi069.stderr: git switch -c 2024-04-25T17:17:57.601 INFO:tasks.workunit.client.1.smithi069.stderr: 2024-04-25T17:17:57.601 INFO:tasks.workunit.client.1.smithi069.stderr:Or undo this operation with: 2024-04-25T17:17:57.601 INFO:tasks.workunit.client.1.smithi069.stderr: 2024-04-25T17:17:57.601 INFO:tasks.workunit.client.1.smithi069.stderr: git switch - 2024-04-25T17:17:57.601 INFO:tasks.workunit.client.1.smithi069.stderr: 2024-04-25T17:17:57.601 INFO:tasks.workunit.client.1.smithi069.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-25T17:17:57.601 INFO:tasks.workunit.client.1.smithi069.stderr: 2024-04-25T17:17:57.602 INFO:tasks.workunit.client.1.smithi069.stderr:HEAD is now at 994e2f20102 Merge PR #56810 into wip-pdonnell-testing-20240425.015853-debug 2024-04-25T17:17:57.607 DEBUG:teuthology.orchestra.run.smithi069:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-04-25T17:17:57.779 INFO:tasks.workunit.client.1.smithi069.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-25T17:17:57.781 INFO:tasks.workunit.client.1.smithi069.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-04-25T17:17:57.781 INFO:tasks.workunit.client.1.smithi069.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-25T17:17:59.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:17:58 smithi037 ceph-mon[26472]: pgmap v245: 65 pgs: 65 active+clean; 16 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 1.4 MiB/s wr, 109 op/s 2024-04-25T17:17:59.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:17:58 smithi069 ceph-mon[34527]: pgmap v245: 65 pgs: 65 active+clean; 16 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 1.4 MiB/s wr, 109 op/s 2024-04-25T17:18:00.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:00 smithi069 ceph-mon[34527]: pgmap v246: 65 pgs: 65 active+clean; 21 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 342 KiB/s rd, 1.8 MiB/s wr, 156 op/s 2024-04-25T17:18:01.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:00 smithi037 ceph-mon[26472]: pgmap v246: 65 pgs: 65 active+clean; 21 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 342 KiB/s rd, 1.8 MiB/s wr, 156 op/s 2024-04-25T17:18:03.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:02 smithi037 ceph-mon[26472]: pgmap v247: 65 pgs: 65 active+clean; 24 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 341 KiB/s rd, 2.1 MiB/s wr, 220 op/s 2024-04-25T17:18:03.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:02 smithi069 ceph-mon[34527]: pgmap v247: 65 pgs: 65 active+clean; 24 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 341 KiB/s rd, 2.1 MiB/s wr, 220 op/s 2024-04-25T17:18:03.990 INFO:tasks.workunit.client.1.smithi069.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-25T17:18:04.069 INFO:tasks.workunit.client.1.smithi069.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-25T17:18:04.111 INFO:tasks.workunit.client.1.smithi069.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-04-25T17:18:04.112 INFO:tasks.workunit.client.1.smithi069.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-04-25T17:18:04.112 INFO:tasks.workunit.client.1.smithi069.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-25T17:18:04.155 INFO:tasks.workunit.client.1.smithi069.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-04-25T17:18:04.158 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-04-25T17:18:04.159 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-04-25T17:18:04.174 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-04-25T17:18:04.175 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-04-25T17:18:04.175 DEBUG:teuthology.orchestra.run.smithi069:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=994e2f20102a20fa9a27966c14b625cc01884df8 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-04-25T17:18:04.242 INFO:tasks.workunit.client.1.smithi069.stderr:+ mkdir -p fsstress 2024-04-25T17:18:04.245 INFO:tasks.workunit.client.1.smithi069.stderr:+ pushd fsstress 2024-04-25T17:18:04.246 INFO:tasks.workunit.client.1.smithi069.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-04-25T17:18:04.246 INFO:tasks.workunit.client.1.smithi069.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-04-25T17:18:05.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:04 smithi037 ceph-mon[26472]: pgmap v248: 65 pgs: 65 active+clean; 34 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 711 KiB/s rd, 3.0 MiB/s wr, 268 op/s 2024-04-25T17:18:05.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:04 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:18:05.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:04 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:18:05.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:04 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:18:05.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:04 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:18:05.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:04 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:18:05.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:04 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:18:05.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:04 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mgr fail", "who": "smithi037.txrgxl"}]: dispatch 2024-04-25T17:18:05.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:04 smithi037 ceph-mon[26472]: Activating manager daemon smithi069.mmuhdo 2024-04-25T17:18:05.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:04 smithi037 ceph-mon[26472]: osdmap e47: 6 total, 6 up, 6 in 2024-04-25T17:18:05.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:04 smithi037 ceph-mon[26472]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "mon metadata", "id": "smithi037"}]: dispatch 2024-04-25T17:18:05.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:04 smithi037 ceph-mon[26472]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "mgr fail", "who": "smithi037.txrgxl"}]': finished 2024-04-25T17:18:05.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:04 smithi037 ceph-mon[26472]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "mon metadata", "id": "smithi069"}]: dispatch 2024-04-25T17:18:05.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:04 smithi037 ceph-mon[26472]: mgrmap e21: smithi069.mmuhdo(active, starting, since 0.00788525s) 2024-04-25T17:18:05.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:04 smithi037 ceph-mon[26472]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi037.ksmixc"}]: dispatch 2024-04-25T17:18:05.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:04 smithi037 ceph-mon[26472]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi037.ovkrpq"}]: dispatch 2024-04-25T17:18:05.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:04 smithi037 ceph-mon[26472]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi069.cpprst"}]: dispatch 2024-04-25T17:18:05.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:04 smithi037 ceph-mon[26472]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi069.ytlqcf"}]: dispatch 2024-04-25T17:18:05.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:04 smithi037 ceph-mon[26472]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "mgr metadata", "who": "smithi069.mmuhdo", "id": "smithi069.mmuhdo"}]: dispatch 2024-04-25T17:18:05.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:04 smithi037 ceph-mon[26472]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T17:18:05.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:04 smithi037 ceph-mon[26472]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T17:18:05.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:04 smithi037 ceph-mon[26472]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T17:18:05.074 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:04 smithi037 ceph-mon[26472]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T17:18:05.074 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:04 smithi037 ceph-mon[26472]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T17:18:05.074 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:04 smithi037 ceph-mon[26472]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T17:18:05.074 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:04 smithi037 ceph-mon[26472]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-25T17:18:05.074 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:04 smithi037 ceph-mon[26472]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-25T17:18:05.074 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:04 smithi037 ceph-mon[26472]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-25T17:18:05.074 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:04 smithi037 ceph-mon[26472]: Manager daemon smithi069.mmuhdo is now available 2024-04-25T17:18:05.074 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:04 smithi037 ceph-mon[26472]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:18:05.074 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:04 smithi037 ceph-mon[26472]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:18:05.074 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:04 smithi037 ceph-mon[26472]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi069.mmuhdo/mirror_snapshot_schedule"}]: dispatch 2024-04-25T17:18:05.074 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:04 smithi037 ceph-mon[26472]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi069.mmuhdo/mirror_snapshot_schedule"}]: dispatch 2024-04-25T17:18:05.074 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:04 smithi037 ceph-mon[26472]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi069.mmuhdo/trash_purge_schedule"}]: dispatch 2024-04-25T17:18:05.074 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:04 smithi037 ceph-mon[26472]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi069.mmuhdo/trash_purge_schedule"}]: dispatch 2024-04-25T17:18:05.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:04 smithi069 ceph-mon[34527]: pgmap v248: 65 pgs: 65 active+clean; 34 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 711 KiB/s rd, 3.0 MiB/s wr, 268 op/s 2024-04-25T17:18:05.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:04 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:18:05.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:04 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:18:05.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:04 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:18:05.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:04 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:18:05.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:04 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' 2024-04-25T17:18:05.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:04 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:18:05.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:04 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mgr fail", "who": "smithi037.txrgxl"}]: dispatch 2024-04-25T17:18:05.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:04 smithi069 ceph-mon[34527]: Activating manager daemon smithi069.mmuhdo 2024-04-25T17:18:05.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:04 smithi069 ceph-mon[34527]: osdmap e47: 6 total, 6 up, 6 in 2024-04-25T17:18:05.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:04 smithi069 ceph-mon[34527]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "mon metadata", "id": "smithi037"}]: dispatch 2024-04-25T17:18:05.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:04 smithi069 ceph-mon[34527]: from='mgr.14214 172.21.15.37:0/280665645' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "mgr fail", "who": "smithi037.txrgxl"}]': finished 2024-04-25T17:18:05.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:04 smithi069 ceph-mon[34527]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "mon metadata", "id": "smithi069"}]: dispatch 2024-04-25T17:18:05.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:04 smithi069 ceph-mon[34527]: mgrmap e21: smithi069.mmuhdo(active, starting, since 0.00788525s) 2024-04-25T17:18:05.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:04 smithi069 ceph-mon[34527]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi037.ksmixc"}]: dispatch 2024-04-25T17:18:05.170 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:04 smithi069 ceph-mon[34527]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi037.ovkrpq"}]: dispatch 2024-04-25T17:18:05.170 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:04 smithi069 ceph-mon[34527]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi069.cpprst"}]: dispatch 2024-04-25T17:18:05.170 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:04 smithi069 ceph-mon[34527]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi069.ytlqcf"}]: dispatch 2024-04-25T17:18:05.170 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:04 smithi069 ceph-mon[34527]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "mgr metadata", "who": "smithi069.mmuhdo", "id": "smithi069.mmuhdo"}]: dispatch 2024-04-25T17:18:05.170 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:04 smithi069 ceph-mon[34527]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T17:18:05.170 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:04 smithi069 ceph-mon[34527]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T17:18:05.170 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:04 smithi069 ceph-mon[34527]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T17:18:05.170 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:04 smithi069 ceph-mon[34527]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T17:18:05.170 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:04 smithi069 ceph-mon[34527]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T17:18:05.170 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:04 smithi069 ceph-mon[34527]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T17:18:05.170 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:04 smithi069 ceph-mon[34527]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-25T17:18:05.170 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:04 smithi069 ceph-mon[34527]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-25T17:18:05.170 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:04 smithi069 ceph-mon[34527]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-25T17:18:05.170 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:04 smithi069 ceph-mon[34527]: Manager daemon smithi069.mmuhdo is now available 2024-04-25T17:18:05.171 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:04 smithi069 ceph-mon[34527]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:18:05.171 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:04 smithi069 ceph-mon[34527]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:18:05.171 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:04 smithi069 ceph-mon[34527]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi069.mmuhdo/mirror_snapshot_schedule"}]: dispatch 2024-04-25T17:18:05.171 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:04 smithi069 ceph-mon[34527]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi069.mmuhdo/mirror_snapshot_schedule"}]: dispatch 2024-04-25T17:18:05.171 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:04 smithi069 ceph-mon[34527]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi069.mmuhdo/trash_purge_schedule"}]: dispatch 2024-04-25T17:18:05.171 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:04 smithi069 ceph-mon[34527]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi069.mmuhdo/trash_purge_schedule"}]: dispatch 2024-04-25T17:18:05.279 INFO:tasks.workunit.client.1.smithi069.stderr:+ tar xzf ltp-full.tgz 2024-04-25T17:18:06.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:05 smithi037 ceph-mon[26472]: Deploying cephadm binary to smithi069 2024-04-25T17:18:06.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:05 smithi037 ceph-mon[26472]: Deploying cephadm binary to smithi037 2024-04-25T17:18:06.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:05 smithi037 ceph-mon[26472]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:18:06.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:05 smithi037 ceph-mon[26472]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:18:06.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:05 smithi037 ceph-mon[26472]: mgrmap e22: smithi069.mmuhdo(active, since 1.01222s) 2024-04-25T17:18:06.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:05 smithi037 ceph-mon[26472]: pgmap v3: 65 pgs: 65 active+clean; 51 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:18:06.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:05 smithi069 ceph-mon[34527]: Deploying cephadm binary to smithi069 2024-04-25T17:18:06.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:05 smithi069 ceph-mon[34527]: Deploying cephadm binary to smithi037 2024-04-25T17:18:06.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:05 smithi069 ceph-mon[34527]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:18:06.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:05 smithi069 ceph-mon[34527]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:18:06.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:05 smithi069 ceph-mon[34527]: mgrmap e22: smithi069.mmuhdo(active, since 1.01222s) 2024-04-25T17:18:06.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:05 smithi069 ceph-mon[34527]: pgmap v3: 65 pgs: 65 active+clean; 51 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:18:07.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:07 smithi037 ceph-mon[26472]: [25/Apr/2024:17:18:05] ENGINE Bus STARTING 2024-04-25T17:18:07.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:07 smithi037 ceph-mon[26472]: [25/Apr/2024:17:18:06] ENGINE Serving on https://172.21.15.69:7150 2024-04-25T17:18:07.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:07 smithi037 ceph-mon[26472]: [25/Apr/2024:17:18:06] ENGINE Serving on http://172.21.15.69:8765 2024-04-25T17:18:07.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:07 smithi037 ceph-mon[26472]: [25/Apr/2024:17:18:06] ENGINE Bus STARTED 2024-04-25T17:18:07.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:07 smithi037 ceph-mon[26472]: pgmap v4: 65 pgs: 65 active+clean; 51 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:18:07.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:07 smithi037 ceph-mon[26472]: mgrmap e23: smithi069.mmuhdo(active, since 2s) 2024-04-25T17:18:07.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:07 smithi069 ceph-mon[34527]: [25/Apr/2024:17:18:05] ENGINE Bus STARTING 2024-04-25T17:18:07.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:07 smithi069 ceph-mon[34527]: [25/Apr/2024:17:18:06] ENGINE Serving on https://172.21.15.69:7150 2024-04-25T17:18:07.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:07 smithi069 ceph-mon[34527]: [25/Apr/2024:17:18:06] ENGINE Serving on http://172.21.15.69:8765 2024-04-25T17:18:07.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:07 smithi069 ceph-mon[34527]: [25/Apr/2024:17:18:06] ENGINE Bus STARTED 2024-04-25T17:18:07.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:07 smithi069 ceph-mon[34527]: pgmap v4: 65 pgs: 65 active+clean; 51 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:18:07.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:07 smithi069 ceph-mon[34527]: mgrmap e23: smithi069.mmuhdo(active, since 2s) 2024-04-25T17:18:09.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:09 smithi037 ceph-mon[26472]: pgmap v5: 65 pgs: 65 active+clean; 51 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:18:09.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:09 smithi037 ceph-mon[26472]: mgrmap e24: smithi069.mmuhdo(active, since 4s) 2024-04-25T17:18:09.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:09 smithi069 ceph-mon[34527]: pgmap v5: 65 pgs: 65 active+clean; 51 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:18:09.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:09 smithi069 ceph-mon[34527]: mgrmap e24: smithi069.mmuhdo(active, since 4s) 2024-04-25T17:18:11.321 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:11 smithi037 ceph-mon[26472]: pgmap v6: 65 pgs: 65 active+clean; 51 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:18:11.528 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:11 smithi069 ceph-mon[34527]: pgmap v6: 65 pgs: 65 active+clean; 51 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:18:13.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:13 smithi037 ceph-mon[26472]: pgmap v7: 65 pgs: 65 active+clean; 70 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 906 KiB/s rd, 2.9 MiB/s wr, 321 op/s 2024-04-25T17:18:13.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:13 smithi069 ceph-mon[34527]: pgmap v7: 65 pgs: 65 active+clean; 70 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 906 KiB/s rd, 2.9 MiB/s wr, 321 op/s 2024-04-25T17:18:14.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:14 smithi069 ceph-mon[34527]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:18:14.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:14 smithi069 ceph-mon[34527]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:18:14.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:14 smithi069 ceph-mon[34527]: Standby manager daemon smithi037.txrgxl started 2024-04-25T17:18:14.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:14 smithi069 ceph-mon[34527]: from='mgr.? 172.21.15.37:0/2884643701' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi037.txrgxl/crt"}]: dispatch 2024-04-25T17:18:14.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:14 smithi069 ceph-mon[34527]: from='mgr.? 172.21.15.37:0/2884643701' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T17:18:14.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:14 smithi069 ceph-mon[34527]: from='mgr.? 172.21.15.37:0/2884643701' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi037.txrgxl/key"}]: dispatch 2024-04-25T17:18:14.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:14 smithi069 ceph-mon[34527]: from='mgr.? 172.21.15.37:0/2884643701' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T17:18:14.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:14 smithi069 ceph-mon[34527]: pgmap v8: 65 pgs: 65 active+clean; 70 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 704 KiB/s rd, 2.3 MiB/s wr, 250 op/s 2024-04-25T17:18:15.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:14 smithi037 ceph-mon[26472]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:18:15.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:14 smithi037 ceph-mon[26472]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:18:15.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:14 smithi037 ceph-mon[26472]: Standby manager daemon smithi037.txrgxl started 2024-04-25T17:18:15.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:14 smithi037 ceph-mon[26472]: from='mgr.? 172.21.15.37:0/2884643701' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi037.txrgxl/crt"}]: dispatch 2024-04-25T17:18:15.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:14 smithi037 ceph-mon[26472]: from='mgr.? 172.21.15.37:0/2884643701' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T17:18:15.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:14 smithi037 ceph-mon[26472]: from='mgr.? 172.21.15.37:0/2884643701' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi037.txrgxl/key"}]: dispatch 2024-04-25T17:18:15.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:14 smithi037 ceph-mon[26472]: from='mgr.? 172.21.15.37:0/2884643701' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T17:18:15.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:14 smithi037 ceph-mon[26472]: pgmap v8: 65 pgs: 65 active+clean; 70 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 704 KiB/s rd, 2.3 MiB/s wr, 250 op/s 2024-04-25T17:18:15.864 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:15 smithi069 ceph-mon[34527]: mgrmap e25: smithi069.mmuhdo(active, since 10s), standbys: smithi037.txrgxl 2024-04-25T17:18:15.865 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:15 smithi069 ceph-mon[34527]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "mgr metadata", "who": "smithi037.txrgxl", "id": "smithi037.txrgxl"}]: dispatch 2024-04-25T17:18:15.865 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:15 smithi069 ceph-mon[34527]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:18:15.865 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:15 smithi069 ceph-mon[34527]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:18:16.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:15 smithi037 ceph-mon[26472]: mgrmap e25: smithi069.mmuhdo(active, since 10s), standbys: smithi037.txrgxl 2024-04-25T17:18:16.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:15 smithi037 ceph-mon[26472]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "mgr metadata", "who": "smithi037.txrgxl", "id": "smithi037.txrgxl"}]: dispatch 2024-04-25T17:18:16.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:15 smithi037 ceph-mon[26472]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:18:16.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:15 smithi037 ceph-mon[26472]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:18:16.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:16.714+0000 7f7f9b672700 1 -- 172.21.15.37:0/1870844946 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f940fe3e0 msgr2=0x7f7f940fe7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:18:16.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:16.714+0000 7f7f9b672700 1 --2- 172.21.15.37:0/1870844946 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f940fe3e0 0x7f7f940fe7f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7f90004940 tx=0x7f7f90009e30 comp rx=0 tx=0).stop 2024-04-25T17:18:16.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:16.714+0000 7f7f9b672700 1 -- 172.21.15.37:0/1870844946 shutdown_connections 2024-04-25T17:18:16.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:16.714+0000 7f7f9b672700 1 --2- 172.21.15.37:0/1870844946 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f940fed30 0x7f7f940fae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:16.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:16.714+0000 7f7f9b672700 1 --2- 172.21.15.37:0/1870844946 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f940fe3e0 0x7f7f940fe7f0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:16.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:16.714+0000 7f7f9b672700 1 -- 172.21.15.37:0/1870844946 >> 172.21.15.37:0/1870844946 conn(0x7f7f940f6b80 msgr2=0x7f7f940f8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:18:16.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:16.714+0000 7f7f9b672700 1 -- 172.21.15.37:0/1870844946 shutdown_connections 2024-04-25T17:18:16.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:16.714+0000 7f7f9b672700 1 -- 172.21.15.37:0/1870844946 wait complete. 2024-04-25T17:18:16.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:16.715+0000 7f7f9b672700 1 Processor -- start 2024-04-25T17:18:16.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:16.715+0000 7f7f9b672700 1 -- start start 2024-04-25T17:18:16.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:16.715+0000 7f7f9b672700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f940fe3e0 0x7f7f9410d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:18:16.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:16.715+0000 7f7f9b672700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f940fed30 0x7f7f9410dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:18:16.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:16.715+0000 7f7f9b672700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9410e4a0 con 0x7f7f940fed30 2024-04-25T17:18:16.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:16.715+0000 7f7f9b672700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9410ecf0 con 0x7f7f940fe3e0 2024-04-25T17:18:16.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:16.715+0000 7f7f98c0d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f940fed30 0x7f7f9410dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:18:16.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:16.715+0000 7f7f9940e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f940fe3e0 0x7f7f9410d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:18:16.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:16.715+0000 7f7f9940e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f940fe3e0 0x7f7f9410d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.37:45840/0 (socket says 172.21.15.37:45840) 2024-04-25T17:18:16.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:16.715+0000 7f7f9940e700 1 -- 172.21.15.37:0/1858002228 learned_addr learned my addr 172.21.15.37:0/1858002228 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:18:16.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:16.715+0000 7f7f9940e700 1 -- 172.21.15.37:0/1858002228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f940fed30 msgr2=0x7f7f9410dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:18:16.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:16.715+0000 7f7f9940e700 1 --2- 172.21.15.37:0/1858002228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f940fed30 0x7f7f9410dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:16.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:16.715+0000 7f7f9940e700 1 -- 172.21.15.37:0/1858002228 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f90005040 con 0x7f7f940fe3e0 2024-04-25T17:18:16.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:16.716+0000 7f7f9940e700 1 --2- 172.21.15.37:0/1858002228 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f940fe3e0 0x7f7f9410d960 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7f9000b0d0 tx=0x7f7f90009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:18:16.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:16.716+0000 7f7f89ffb700 1 -- 172.21.15.37:0/1858002228 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f9000e070 con 0x7f7f940fe3e0 2024-04-25T17:18:16.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:16.716+0000 7f7f89ffb700 1 -- 172.21.15.37:0/1858002228 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7f9000b410 con 0x7f7f940fe3e0 2024-04-25T17:18:16.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:16.716+0000 7f7f9b672700 1 -- 172.21.15.37:0/1858002228 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f9410ef70 con 0x7f7f940fe3e0 2024-04-25T17:18:16.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:16.716+0000 7f7f89ffb700 1 -- 172.21.15.37:0/1858002228 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f900125e0 con 0x7f7f940fe3e0 2024-04-25T17:18:16.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:16.716+0000 7f7f9b672700 1 -- 172.21.15.37:0/1858002228 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f9410f4b0 con 0x7f7f940fe3e0 2024-04-25T17:18:16.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:16.717+0000 7f7f9b672700 1 -- 172.21.15.37:0/1858002228 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f9405f5c0 con 0x7f7f940fe3e0 2024-04-25T17:18:16.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:16.718+0000 7f7f89ffb700 1 -- 172.21.15.37:0/1858002228 <== mon.1 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) v1 ==== 92608+0+0 (secure 0 0 0) 0x7f7f9000b580 con 0x7f7f940fe3e0 2024-04-25T17:18:16.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:16.719+0000 7f7f89ffb700 1 --2- 172.21.15.37:0/1858002228 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f7f8006fd80 0x7f7f80072230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:18:16.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:16.719+0000 7f7f89ffb700 1 -- 172.21.15.37:0/1858002228 <== mon.1 v2:172.21.15.69:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f7f900904f0 con 0x7f7f940fe3e0 2024-04-25T17:18:16.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:16.719+0000 7f7f98c0d700 1 --2- 172.21.15.37:0/1858002228 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f7f8006fd80 0x7f7f80072230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:18:16.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:16.720+0000 7f7f98c0d700 1 --2- 172.21.15.37:0/1858002228 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f7f8006fd80 0x7f7f80072230 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7f84009b80 tx=0x7f7f8400b040 comp rx=0 tx=0).ready entity=mgr.24417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:18:16.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:16.725+0000 7f7f89ffb700 1 -- 172.21.15.37:0/1858002228 <== mon.1 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f7f90059810 con 0x7f7f940fe3e0 2024-04-25T17:18:16.914 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:16 smithi069 ceph-mon[34527]: pgmap v9: 65 pgs: 65 active+clean; 83 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.1 MiB/s wr, 381 op/s 2024-04-25T17:18:17.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:16 smithi037 ceph-mon[26472]: pgmap v9: 65 pgs: 65 active+clean; 83 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.1 MiB/s wr, 381 op/s 2024-04-25T17:18:17.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.107+0000 7f7f9b672700 1 -- 172.21.15.37:0/1858002228 --> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7f9410f8a0 con 0x7f7f8006fd80 2024-04-25T17:18:17.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.109+0000 7f7f89ffb700 1 -- 172.21.15.37:0/1858002228 <== mgr.24417 v2:172.21.15.69:6828/2602478 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f7f9410f8a0 con 0x7f7f8006fd80 2024-04-25T17:18:17.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.112+0000 7f7f9b672700 1 -- 172.21.15.37:0/1858002228 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f7f8006fd80 msgr2=0x7f7f80072230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:18:17.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.112+0000 7f7f9b672700 1 --2- 172.21.15.37:0/1858002228 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f7f8006fd80 0x7f7f80072230 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7f84009b80 tx=0x7f7f8400b040 comp rx=0 tx=0).stop 2024-04-25T17:18:17.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.112+0000 7f7f9b672700 1 -- 172.21.15.37:0/1858002228 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f940fe3e0 msgr2=0x7f7f9410d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:18:17.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.112+0000 7f7f9b672700 1 --2- 172.21.15.37:0/1858002228 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f940fe3e0 0x7f7f9410d960 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7f9000b0d0 tx=0x7f7f90009e30 comp rx=0 tx=0).stop 2024-04-25T17:18:17.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.113+0000 7f7f9b672700 1 -- 172.21.15.37:0/1858002228 shutdown_connections 2024-04-25T17:18:17.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.113+0000 7f7f9b672700 1 --2- 172.21.15.37:0/1858002228 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f7f8006fd80 0x7f7f80072230 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:17.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.113+0000 7f7f9b672700 1 --2- 172.21.15.37:0/1858002228 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f940fe3e0 0x7f7f9410d960 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:17.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.113+0000 7f7f9b672700 1 --2- 172.21.15.37:0/1858002228 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f940fed30 0x7f7f9410dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:17.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.113+0000 7f7f9b672700 1 -- 172.21.15.37:0/1858002228 >> 172.21.15.37:0/1858002228 conn(0x7f7f940f6b80 msgr2=0x7f7f940f8180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:18:17.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.113+0000 7f7f9b672700 1 -- 172.21.15.37:0/1858002228 shutdown_connections 2024-04-25T17:18:17.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.113+0000 7f7f9b672700 1 -- 172.21.15.37:0/1858002228 wait complete. 2024-04-25T17:18:17.127 INFO:teuthology.orchestra.run.smithi037.stdout:true 2024-04-25T17:18:17.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.259+0000 7f2b18146700 1 -- 172.21.15.37:0/2794631386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b100fe3e0 msgr2=0x7f2b100fe7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:18:17.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.259+0000 7f2b18146700 1 --2- 172.21.15.37:0/2794631386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b100fe3e0 0x7f2b100fe7f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c004940 tx=0x7f2b0c009e30 comp rx=0 tx=0).stop 2024-04-25T17:18:17.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.259+0000 7f2b18146700 1 -- 172.21.15.37:0/2794631386 shutdown_connections 2024-04-25T17:18:17.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.259+0000 7f2b18146700 1 --2- 172.21.15.37:0/2794631386 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b100fed30 0x7f2b100fae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:17.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.259+0000 7f2b18146700 1 --2- 172.21.15.37:0/2794631386 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b100fe3e0 0x7f2b100fe7f0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:17.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.259+0000 7f2b18146700 1 -- 172.21.15.37:0/2794631386 >> 172.21.15.37:0/2794631386 conn(0x7f2b100f6b80 msgr2=0x7f2b100f8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:18:17.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.260+0000 7f2b18146700 1 -- 172.21.15.37:0/2794631386 shutdown_connections 2024-04-25T17:18:17.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.260+0000 7f2b18146700 1 -- 172.21.15.37:0/2794631386 wait complete. 2024-04-25T17:18:17.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.260+0000 7f2b18146700 1 Processor -- start 2024-04-25T17:18:17.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.260+0000 7f2b18146700 1 -- start start 2024-04-25T17:18:17.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.261+0000 7f2b18146700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b100fe3e0 0x7f2b1010d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:18:17.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.261+0000 7f2b18146700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b100fed30 0x7f2b1010dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:18:17.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.261+0000 7f2b18146700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1010e4a0 con 0x7f2b100fed30 2024-04-25T17:18:17.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.261+0000 7f2b18146700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1010ecf0 con 0x7f2b100fe3e0 2024-04-25T17:18:17.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.261+0000 7f2b15ee2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b100fe3e0 0x7f2b1010d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:18:17.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.261+0000 7f2b15ee2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b100fe3e0 0x7f2b1010d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.37:45862/0 (socket says 172.21.15.37:45862) 2024-04-25T17:18:17.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.261+0000 7f2b15ee2700 1 -- 172.21.15.37:0/1171763760 learned_addr learned my addr 172.21.15.37:0/1171763760 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:18:17.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.261+0000 7f2b156e1700 1 --2- 172.21.15.37:0/1171763760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b100fed30 0x7f2b1010dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:18:17.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.261+0000 7f2b15ee2700 1 -- 172.21.15.37:0/1171763760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b100fed30 msgr2=0x7f2b1010dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:18:17.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.261+0000 7f2b15ee2700 1 --2- 172.21.15.37:0/1171763760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b100fed30 0x7f2b1010dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:17.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.261+0000 7f2b15ee2700 1 -- 172.21.15.37:0/1171763760 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b0c005040 con 0x7f2b100fe3e0 2024-04-25T17:18:17.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.262+0000 7f2b15ee2700 1 --2- 172.21.15.37:0/1171763760 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b100fe3e0 0x7f2b1010d960 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c009150 tx=0x7f2b0c009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:18:17.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.262+0000 7f2b067fc700 1 -- 172.21.15.37:0/1171763760 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b0c00e040 con 0x7f2b100fe3e0 2024-04-25T17:18:17.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.262+0000 7f2b067fc700 1 -- 172.21.15.37:0/1171763760 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2b0c004290 con 0x7f2b100fe3e0 2024-04-25T17:18:17.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.262+0000 7f2b18146700 1 -- 172.21.15.37:0/1171763760 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b1010ef70 con 0x7f2b100fe3e0 2024-04-25T17:18:17.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.262+0000 7f2b067fc700 1 -- 172.21.15.37:0/1171763760 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b0c01c630 con 0x7f2b100fe3e0 2024-04-25T17:18:17.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.262+0000 7f2b18146700 1 -- 172.21.15.37:0/1171763760 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b1010f4b0 con 0x7f2b100fe3e0 2024-04-25T17:18:17.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.264+0000 7f2b18146700 1 -- 172.21.15.37:0/1171763760 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b1005f5c0 con 0x7f2b100fe3e0 2024-04-25T17:18:17.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.264+0000 7f2b067fc700 1 -- 172.21.15.37:0/1171763760 <== mon.1 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) v1 ==== 92608+0+0 (secure 0 0 0) 0x7f2b0c00bbf0 con 0x7f2b100fe3e0 2024-04-25T17:18:17.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.265+0000 7f2b067fc700 1 --2- 172.21.15.37:0/1171763760 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f2afc06fd80 0x7f2afc072230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:18:17.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.265+0000 7f2b067fc700 1 -- 172.21.15.37:0/1171763760 <== mon.1 v2:172.21.15.69:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f2b0c090280 con 0x7f2b100fe3e0 2024-04-25T17:18:17.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.265+0000 7f2b156e1700 1 --2- 172.21.15.37:0/1171763760 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f2afc06fd80 0x7f2afc072230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:18:17.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.266+0000 7f2b156e1700 1 --2- 172.21.15.37:0/1171763760 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f2afc06fd80 0x7f2afc072230 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2b00009fd0 tx=0x7f2b0000b040 comp rx=0 tx=0).ready entity=mgr.24417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:18:17.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.274+0000 7f2b067fc700 1 -- 172.21.15.37:0/1171763760 <== mon.1 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f2b0c059780 con 0x7f2b100fe3e0 2024-04-25T17:18:17.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.610+0000 7f2b18146700 1 -- 172.21.15.37:0/1171763760 --> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b1010f7b0 con 0x7f2afc06fd80 2024-04-25T17:18:17.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.612+0000 7f2b067fc700 1 -- 172.21.15.37:0/1171763760 <== mgr.24417 v2:172.21.15.69:6828/2602478 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f2b1010f7b0 con 0x7f2afc06fd80 2024-04-25T17:18:17.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.615+0000 7f2b18146700 1 -- 172.21.15.37:0/1171763760 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f2afc06fd80 msgr2=0x7f2afc072230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:18:17.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.615+0000 7f2b18146700 1 --2- 172.21.15.37:0/1171763760 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f2afc06fd80 0x7f2afc072230 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2b00009fd0 tx=0x7f2b0000b040 comp rx=0 tx=0).stop 2024-04-25T17:18:17.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.615+0000 7f2b18146700 1 -- 172.21.15.37:0/1171763760 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b100fe3e0 msgr2=0x7f2b1010d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:18:17.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.615+0000 7f2b18146700 1 --2- 172.21.15.37:0/1171763760 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b100fe3e0 0x7f2b1010d960 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c009150 tx=0x7f2b0c009e30 comp rx=0 tx=0).stop 2024-04-25T17:18:17.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.615+0000 7f2b18146700 1 -- 172.21.15.37:0/1171763760 shutdown_connections 2024-04-25T17:18:17.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.615+0000 7f2b18146700 1 --2- 172.21.15.37:0/1171763760 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f2afc06fd80 0x7f2afc072230 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:17.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.615+0000 7f2b18146700 1 --2- 172.21.15.37:0/1171763760 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2b100fe3e0 0x7f2b1010d960 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:17.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.615+0000 7f2b18146700 1 --2- 172.21.15.37:0/1171763760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2b100fed30 0x7f2b1010dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:17.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.615+0000 7f2b18146700 1 -- 172.21.15.37:0/1171763760 >> 172.21.15.37:0/1171763760 conn(0x7f2b100f6b80 msgr2=0x7f2b100f8180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:18:17.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.615+0000 7f2b18146700 1 -- 172.21.15.37:0/1171763760 shutdown_connections 2024-04-25T17:18:17.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.615+0000 7f2b18146700 1 -- 172.21.15.37:0/1171763760 wait complete. 2024-04-25T17:18:17.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.770+0000 7f840cd5b700 1 -- 172.21.15.37:0/2077285164 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f84080727c0 msgr2=0x7f8408072bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:18:17.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.770+0000 7f840cd5b700 1 --2- 172.21.15.37:0/2077285164 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f84080727c0 0x7f8408072bd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8400009ce0 tx=0x7f8400004d10 comp rx=0 tx=0).stop 2024-04-25T17:18:17.771 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.770+0000 7f840cd5b700 1 -- 172.21.15.37:0/2077285164 shutdown_connections 2024-04-25T17:18:17.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.770+0000 7f840cd5b700 1 --2- 172.21.15.37:0/2077285164 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8408073110 0x7f8408073b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:17.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.770+0000 7f840cd5b700 1 --2- 172.21.15.37:0/2077285164 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f84080727c0 0x7f8408072bd0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:17.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.770+0000 7f840cd5b700 1 -- 172.21.15.37:0/2077285164 >> 172.21.15.37:0/2077285164 conn(0x7f84080fa8f0 msgr2=0x7f84080fccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:18:17.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.771+0000 7f840cd5b700 1 -- 172.21.15.37:0/2077285164 shutdown_connections 2024-04-25T17:18:17.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.771+0000 7f840cd5b700 1 -- 172.21.15.37:0/2077285164 wait complete. 2024-04-25T17:18:17.772 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:17 smithi037 ceph-mon[26472]: from='client.24449 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:18:17.773 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.772+0000 7f840cd5b700 1 Processor -- start 2024-04-25T17:18:17.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.772+0000 7f840cd5b700 1 -- start start 2024-04-25T17:18:17.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.772+0000 7f840cd5b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f84080727c0 0x7f84081140f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:18:17.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.772+0000 7f840cd5b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8408114630 0x7f8408115480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:18:17.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.772+0000 7f840cd5b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8408114af0 con 0x7f8408114630 2024-04-25T17:18:17.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.772+0000 7f840cd5b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8408114c30 con 0x7f84080727c0 2024-04-25T17:18:17.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.772+0000 7f840659c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f84080727c0 0x7f84081140f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:18:17.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.772+0000 7f840659c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f84080727c0 0x7f84081140f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.37:45888/0 (socket says 172.21.15.37:45888) 2024-04-25T17:18:17.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.772+0000 7f840659c700 1 -- 172.21.15.37:0/322243493 learned_addr learned my addr 172.21.15.37:0/322243493 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:18:17.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.772+0000 7f8405d9b700 1 --2- 172.21.15.37:0/322243493 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8408114630 0x7f8408115480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:18:17.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.773+0000 7f840659c700 1 -- 172.21.15.37:0/322243493 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8408114630 msgr2=0x7f8408115480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:18:17.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.773+0000 7f840659c700 1 --2- 172.21.15.37:0/322243493 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8408114630 0x7f8408115480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:17.774 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.773+0000 7f840659c700 1 -- 172.21.15.37:0/322243493 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f8005040 con 0x7f84080727c0 2024-04-25T17:18:17.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.773+0000 7f840659c700 1 --2- 172.21.15.37:0/322243493 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f84080727c0 0x7f84081140f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8400009380 tx=0x7f8400004d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:18:17.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.774+0000 7f83f6ffd700 1 -- 172.21.15.37:0/322243493 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f840000e040 con 0x7f84080727c0 2024-04-25T17:18:17.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.774+0000 7f840cd5b700 1 -- 172.21.15.37:0/322243493 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8400009940 con 0x7f84080727c0 2024-04-25T17:18:17.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.774+0000 7f840cd5b700 1 -- 172.21.15.37:0/322243493 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8408115e80 con 0x7f84080727c0 2024-04-25T17:18:17.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.774+0000 7f83f6ffd700 1 -- 172.21.15.37:0/322243493 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f840001cb20 con 0x7f84080727c0 2024-04-25T17:18:17.775 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.774+0000 7f83f6ffd700 1 -- 172.21.15.37:0/322243493 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8400012b10 con 0x7f84080727c0 2024-04-25T17:18:17.776 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.775+0000 7f840cd5b700 1 -- 172.21.15.37:0/322243493 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83e80052e0 con 0x7f84080727c0 2024-04-25T17:18:17.777 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.777+0000 7f83f6ffd700 1 -- 172.21.15.37:0/322243493 <== mon.1 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) v1 ==== 92608+0+0 (secure 0 0 0) 0x7f840001c650 con 0x7f84080727c0 2024-04-25T17:18:17.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.778+0000 7f83f6ffd700 1 --2- 172.21.15.37:0/322243493 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f83f006fcb0 0x7f83f0072160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:18:17.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.778+0000 7f83f6ffd700 1 -- 172.21.15.37:0/322243493 <== mon.1 v2:172.21.15.69:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f8400092190 con 0x7f84080727c0 2024-04-25T17:18:17.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.778+0000 7f8405d9b700 1 --2- 172.21.15.37:0/322243493 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f83f006fcb0 0x7f83f0072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:18:17.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.779+0000 7f8405d9b700 1 --2- 172.21.15.37:0/322243493 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f83f006fcb0 0x7f83f0072160 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f83f8009fd0 tx=0x7f83f800b040 comp rx=0 tx=0).ready entity=mgr.24417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:18:17.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:17.782+0000 7f83f6ffd700 1 -- 172.21.15.37:0/322243493 <== mon.1 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f840005b4f0 con 0x7f84080727c0 2024-04-25T17:18:17.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:17 smithi069 ceph-mon[34527]: from='client.24449 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:18:18.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.139+0000 7f840cd5b700 1 -- 172.21.15.37:0/322243493 --> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f83e8000bf0 con 0x7f83f006fcb0 2024-04-25T17:18:18.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.157+0000 7f83f6ffd700 1 -- 172.21.15.37:0/322243493 <== mgr.24417 v2:172.21.15.69:6828/2602478 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f83e8000bf0 con 0x7f83f006fcb0 2024-04-25T17:18:18.157 INFO:teuthology.orchestra.run.smithi037.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-25T17:18:18.157 INFO:teuthology.orchestra.run.smithi037.stdout:alertmanager.smithi037 smithi037 *:9093,9094 running (6m) 0s ago 8m 26.5M - 0.25.0 c8568f914cd2 82eacf476143 2024-04-25T17:18:18.157 INFO:teuthology.orchestra.run.smithi037.stdout:crash.smithi037 smithi037 running (8m) 0s ago 8m 6656k - 17.2.7-902-gc61472c8 0de407c1b3af b3d152574e80 2024-04-25T17:18:18.158 INFO:teuthology.orchestra.run.smithi037.stdout:crash.smithi069 smithi069 running (7m) 4s ago 7m 6660k - 17.2.7-902-gc61472c8 0de407c1b3af aa6086c64cc3 2024-04-25T17:18:18.158 INFO:teuthology.orchestra.run.smithi037.stdout:grafana.smithi037 smithi037 *:3000 running (6m) 0s ago 7m 86.9M - 9.4.7 954c08fa6188 0a09ff60869f 2024-04-25T17:18:18.158 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi037.ksmixc smithi037 running (2m) 0s ago 2m 86.1M - 17.2.7-902-gc61472c8 0de407c1b3af 394aa56079b4 2024-04-25T17:18:18.158 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi037.ovkrpq smithi037 running (2m) 0s ago 2m 52.7M - 17.2.7-902-gc61472c8 0de407c1b3af 73ca662174a7 2024-04-25T17:18:18.158 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi069.cpprst smithi069 running (2m) 4s ago 2m 13.4M - 17.2.7-902-gc61472c8 0de407c1b3af dbda101df20e 2024-04-25T17:18:18.158 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi069.ytlqcf smithi069 running (2m) 4s ago 2m 11.7M - 17.2.7-902-gc61472c8 0de407c1b3af 911df6b18215 2024-04-25T17:18:18.158 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.smithi037.txrgxl smithi037 *:9283 running (9m) 0s ago 9m 322M - 17.2.7-902-gc61472c8 0de407c1b3af 796b326569c2 2024-04-25T17:18:18.158 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.smithi069.mmuhdo smithi069 *:8443,9283 running (32s) 4s ago 7m 558M - 19.0.0-3291-g994e2f20 d53c96779a29 defb664cef69 2024-04-25T17:18:18.158 INFO:teuthology.orchestra.run.smithi037.stdout:mon.smithi037 smithi037 running (9m) 0s ago 9m 46.5M 2048M 17.2.7-902-gc61472c8 0de407c1b3af 5cfadcf8f2e4 2024-04-25T17:18:18.158 INFO:teuthology.orchestra.run.smithi037.stdout:mon.smithi069 smithi069 running (6m) 4s ago 6m 38.6M 2048M 17.2.7-902-gc61472c8 0de407c1b3af ffcd456d1dce 2024-04-25T17:18:18.158 INFO:teuthology.orchestra.run.smithi037.stdout:node-exporter.smithi037 smithi037 *:9100 running (8m) 0s ago 8m 13.9M - 1.5.0 0da6a335fe13 363761df1e06 2024-04-25T17:18:18.158 INFO:teuthology.orchestra.run.smithi037.stdout:node-exporter.smithi069 smithi069 *:9100 running (7m) 4s ago 7m 16.9M - 1.5.0 0da6a335fe13 5d407954c21f 2024-04-25T17:18:18.158 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0 smithi037 running (6m) 0s ago 6m 80.2M 4289M 17.2.7-902-gc61472c8 0de407c1b3af 8ff4b0f1aae9 2024-04-25T17:18:18.159 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1 smithi037 running (5m) 0s ago 5m 81.3M 4289M 17.2.7-902-gc61472c8 0de407c1b3af 5715a5da241d 2024-04-25T17:18:18.159 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2 smithi037 running (5m) 0s ago 5m 72.4M 4289M 17.2.7-902-gc61472c8 0de407c1b3af 2eedaf9886dd 2024-04-25T17:18:18.159 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3 smithi069 running (4m) 4s ago 4m 79.0M 5312M 17.2.7-902-gc61472c8 0de407c1b3af ebba78fb1923 2024-04-25T17:18:18.159 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4 smithi069 running (4m) 4s ago 4m 80.0M 5312M 17.2.7-902-gc61472c8 0de407c1b3af ba7b785c50f9 2024-04-25T17:18:18.159 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5 smithi069 running (4m) 4s ago 4m 77.2M 5312M 17.2.7-902-gc61472c8 0de407c1b3af f6be99c364ff 2024-04-25T17:18:18.159 INFO:teuthology.orchestra.run.smithi037.stdout:prometheus.smithi037 smithi037 *:9095 running (6m) 0s ago 7m 59.2M - 2.43.0 a07b618ecd1d 13d3c6f36732 2024-04-25T17:18:18.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.160+0000 7f840cd5b700 1 -- 172.21.15.37:0/322243493 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f83f006fcb0 msgr2=0x7f83f0072160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:18:18.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.160+0000 7f840cd5b700 1 --2- 172.21.15.37:0/322243493 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f83f006fcb0 0x7f83f0072160 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f83f8009fd0 tx=0x7f83f800b040 comp rx=0 tx=0).stop 2024-04-25T17:18:18.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.160+0000 7f840cd5b700 1 -- 172.21.15.37:0/322243493 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f84080727c0 msgr2=0x7f84081140f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:18:18.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.160+0000 7f840cd5b700 1 --2- 172.21.15.37:0/322243493 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f84080727c0 0x7f84081140f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8400009380 tx=0x7f8400004d10 comp rx=0 tx=0).stop 2024-04-25T17:18:18.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.160+0000 7f840cd5b700 1 -- 172.21.15.37:0/322243493 shutdown_connections 2024-04-25T17:18:18.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.160+0000 7f840cd5b700 1 --2- 172.21.15.37:0/322243493 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f83f006fcb0 0x7f83f0072160 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:18.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.160+0000 7f840cd5b700 1 --2- 172.21.15.37:0/322243493 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f84080727c0 0x7f84081140f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:18.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.160+0000 7f840cd5b700 1 --2- 172.21.15.37:0/322243493 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8408114630 0x7f8408115480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:18.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.160+0000 7f840cd5b700 1 -- 172.21.15.37:0/322243493 >> 172.21.15.37:0/322243493 conn(0x7f84080fa8f0 msgr2=0x7f84080fd0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:18:18.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.160+0000 7f840cd5b700 1 -- 172.21.15.37:0/322243493 shutdown_connections 2024-04-25T17:18:18.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.160+0000 7f840cd5b700 1 -- 172.21.15.37:0/322243493 wait complete. 2024-04-25T17:18:18.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.299+0000 7f7f5b161700 1 -- 172.21.15.37:0/2093070611 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f540fbcb0 msgr2=0x7f7f540fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:18:18.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.299+0000 7f7f5b161700 1 --2- 172.21.15.37:0/2093070611 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f540fbcb0 0x7f7f540fc0c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7f48004940 tx=0x7f7f48009e30 comp rx=0 tx=0).stop 2024-04-25T17:18:18.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.299+0000 7f7f5b161700 1 -- 172.21.15.37:0/2093070611 shutdown_connections 2024-04-25T17:18:18.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.299+0000 7f7f5b161700 1 --2- 172.21.15.37:0/2093070611 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f540fcf60 0x7f7f540fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:18.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.299+0000 7f7f5b161700 1 --2- 172.21.15.37:0/2093070611 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f540fbcb0 0x7f7f540fc0c0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:18.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.299+0000 7f7f5b161700 1 -- 172.21.15.37:0/2093070611 >> 172.21.15.37:0/2093070611 conn(0x7f7f540f7430 msgr2=0x7f7f540f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:18:18.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.299+0000 7f7f5b161700 1 -- 172.21.15.37:0/2093070611 shutdown_connections 2024-04-25T17:18:18.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.299+0000 7f7f5b161700 1 -- 172.21.15.37:0/2093070611 wait complete. 2024-04-25T17:18:18.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.300+0000 7f7f5b161700 1 Processor -- start 2024-04-25T17:18:18.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.300+0000 7f7f5b161700 1 -- start start 2024-04-25T17:18:18.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.300+0000 7f7f5b161700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f540fbcb0 0x7f7f54104760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:18:18.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.300+0000 7f7f5b161700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f540fcf60 0x7f7f54104ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:18:18.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.300+0000 7f7f5b161700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f541052f0 con 0x7f7f540fcf60 2024-04-25T17:18:18.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.300+0000 7f7f5b161700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f54105af0 con 0x7f7f540fbcb0 2024-04-25T17:18:18.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.300+0000 7f7f53fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f540fcf60 0x7f7f54104ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:18:18.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.300+0000 7f7f58efd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f540fbcb0 0x7f7f54104760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:18:18.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.300+0000 7f7f53fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f540fcf60 0x7f7f54104ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53338/0 (socket says 172.21.15.37:53338) 2024-04-25T17:18:18.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.300+0000 7f7f58efd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f540fbcb0 0x7f7f54104760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.37:45894/0 (socket says 172.21.15.37:45894) 2024-04-25T17:18:18.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.300+0000 7f7f53fff700 1 -- 172.21.15.37:0/2340653059 learned_addr learned my addr 172.21.15.37:0/2340653059 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:18:18.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.301+0000 7f7f58efd700 1 -- 172.21.15.37:0/2340653059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f540fcf60 msgr2=0x7f7f54104ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:18:18.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.301+0000 7f7f58efd700 1 --2- 172.21.15.37:0/2340653059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f540fcf60 0x7f7f54104ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:18.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.301+0000 7f7f58efd700 1 -- 172.21.15.37:0/2340653059 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f40005040 con 0x7f7f540fbcb0 2024-04-25T17:18:18.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.301+0000 7f7f58efd700 1 --2- 172.21.15.37:0/2340653059 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f540fbcb0 0x7f7f54104760 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7f48000c00 tx=0x7f7f48009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:18:18.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.301+0000 7f7f517fa700 1 -- 172.21.15.37:0/2340653059 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f4800e030 con 0x7f7f540fbcb0 2024-04-25T17:18:18.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.301+0000 7f7f5b161700 1 -- 172.21.15.37:0/2340653059 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f48005040 con 0x7f7f540fbcb0 2024-04-25T17:18:18.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.302+0000 7f7f5b161700 1 -- 172.21.15.37:0/2340653059 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f54106120 con 0x7f7f540fbcb0 2024-04-25T17:18:18.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.302+0000 7f7f517fa700 1 -- 172.21.15.37:0/2340653059 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7f48013de0 con 0x7f7f540fbcb0 2024-04-25T17:18:18.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.302+0000 7f7f517fa700 1 -- 172.21.15.37:0/2340653059 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f4801ce50 con 0x7f7f540fbcb0 2024-04-25T17:18:18.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.304+0000 7f7f517fa700 1 -- 172.21.15.37:0/2340653059 <== mon.1 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) v1 ==== 92608+0+0 (secure 0 0 0) 0x7f7f4800b460 con 0x7f7f540fbcb0 2024-04-25T17:18:18.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.304+0000 7f7f5b161700 1 -- 172.21.15.37:0/2340653059 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f5405f5c0 con 0x7f7f540fbcb0 2024-04-25T17:18:18.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.305+0000 7f7f517fa700 1 --2- 172.21.15.37:0/2340653059 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f7f4406fcb0 0x7f7f44072160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:18:18.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.305+0000 7f7f517fa700 1 -- 172.21.15.37:0/2340653059 <== mon.1 v2:172.21.15.69:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f7f48090ff0 con 0x7f7f540fbcb0 2024-04-25T17:18:18.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.305+0000 7f7f53fff700 1 --2- 172.21.15.37:0/2340653059 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f7f4406fcb0 0x7f7f44072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:18:18.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.305+0000 7f7f53fff700 1 --2- 172.21.15.37:0/2340653059 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f7f4406fcb0 0x7f7f44072160 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7f400044e0 tx=0x7f7f4000b040 comp rx=0 tx=0).ready entity=mgr.24417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:18:18.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.310+0000 7f7f517fa700 1 -- 172.21.15.37:0/2340653059 <== mon.1 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f7f4805a410 con 0x7f7f540fbcb0 2024-04-25T17:18:18.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.781+0000 7f7f5b161700 1 -- 172.21.15.37:0/2340653059 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7f54106390 con 0x7f7f540fbcb0 2024-04-25T17:18:18.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.782+0000 7f7f517fa700 1 -- 172.21.15.37:0/2340653059 <== mon.1 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7f7f48059dd0 con 0x7f7f540fbcb0 2024-04-25T17:18:18.783 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-25T17:18:18.783 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": { 2024-04-25T17:18:18.783 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 2 2024-04-25T17:18:18.783 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:18:18.783 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": { 2024-04-25T17:18:18.783 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 1, 2024-04-25T17:18:18.783 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 1 2024-04-25T17:18:18.783 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:18:18.783 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": { 2024-04-25T17:18:18.783 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 6 2024-04-25T17:18:18.783 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:18:18.783 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": { 2024-04-25T17:18:18.783 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 4 2024-04-25T17:18:18.784 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:18:18.784 INFO:teuthology.orchestra.run.smithi037.stdout: "overall": { 2024-04-25T17:18:18.784 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 13, 2024-04-25T17:18:18.784 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 1 2024-04-25T17:18:18.784 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-04-25T17:18:18.784 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-25T17:18:18.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.786+0000 7f7f5b161700 1 -- 172.21.15.37:0/2340653059 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f7f4406fcb0 msgr2=0x7f7f44072160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:18:18.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.786+0000 7f7f5b161700 1 --2- 172.21.15.37:0/2340653059 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f7f4406fcb0 0x7f7f44072160 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7f400044e0 tx=0x7f7f4000b040 comp rx=0 tx=0).stop 2024-04-25T17:18:18.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.786+0000 7f7f5b161700 1 -- 172.21.15.37:0/2340653059 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f540fbcb0 msgr2=0x7f7f54104760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:18:18.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.786+0000 7f7f5b161700 1 --2- 172.21.15.37:0/2340653059 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f540fbcb0 0x7f7f54104760 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7f48000c00 tx=0x7f7f48009e30 comp rx=0 tx=0).stop 2024-04-25T17:18:18.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.786+0000 7f7f5b161700 1 -- 172.21.15.37:0/2340653059 shutdown_connections 2024-04-25T17:18:18.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.786+0000 7f7f5b161700 1 --2- 172.21.15.37:0/2340653059 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f7f4406fcb0 0x7f7f44072160 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:18.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.786+0000 7f7f5b161700 1 --2- 172.21.15.37:0/2340653059 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f540fbcb0 0x7f7f54104760 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:18.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.786+0000 7f7f5b161700 1 --2- 172.21.15.37:0/2340653059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7f540fcf60 0x7f7f54104ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:18.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.786+0000 7f7f5b161700 1 -- 172.21.15.37:0/2340653059 >> 172.21.15.37:0/2340653059 conn(0x7f7f540f7430 msgr2=0x7f7f540f8f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:18:18.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.787+0000 7f7f5b161700 1 -- 172.21.15.37:0/2340653059 shutdown_connections 2024-04-25T17:18:18.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.787+0000 7f7f5b161700 1 -- 172.21.15.37:0/2340653059 wait complete. 2024-04-25T17:18:18.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.944+0000 7f3c40ece700 1 -- 172.21.15.37:0/31229969 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c3c0fbcb0 msgr2=0x7f3c3c0fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:18:18.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.944+0000 7f3c40ece700 1 --2- 172.21.15.37:0/31229969 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c3c0fbcb0 0x7f3c3c0fc0c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c004940 tx=0x7f3c2c009e30 comp rx=0 tx=0).stop 2024-04-25T17:18:18.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.944+0000 7f3c40ece700 1 -- 172.21.15.37:0/31229969 shutdown_connections 2024-04-25T17:18:18.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.944+0000 7f3c40ece700 1 --2- 172.21.15.37:0/31229969 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3c3c0fcf60 0x7f3c3c0fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:18.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.944+0000 7f3c40ece700 1 --2- 172.21.15.37:0/31229969 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c3c0fbcb0 0x7f3c3c0fc0c0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:18.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.944+0000 7f3c40ece700 1 -- 172.21.15.37:0/31229969 >> 172.21.15.37:0/31229969 conn(0x7f3c3c0f7430 msgr2=0x7f3c3c0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:18:18.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.945+0000 7f3c40ece700 1 -- 172.21.15.37:0/31229969 shutdown_connections 2024-04-25T17:18:18.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.945+0000 7f3c40ece700 1 -- 172.21.15.37:0/31229969 wait complete. 2024-04-25T17:18:18.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.945+0000 7f3c40ece700 1 Processor -- start 2024-04-25T17:18:18.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.945+0000 7f3c40ece700 1 -- start start 2024-04-25T17:18:18.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.946+0000 7f3c40ece700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c3c0fbcb0 0x7f3c3c10fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:18:18.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.946+0000 7f3c40ece700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3c3c0fcf60 0x7f3c3c110180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:18:18.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.946+0000 7f3c40ece700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3c110810 con 0x7f3c3c0fbcb0 2024-04-25T17:18:18.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.946+0000 7f3c40ece700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3c110fb0 con 0x7f3c3c0fcf60 2024-04-25T17:18:18.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.946+0000 7f3c3a59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c3c0fbcb0 0x7f3c3c10fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:18:18.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.946+0000 7f3c3a59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c3c0fbcb0 0x7f3c3c10fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53362/0 (socket says 172.21.15.37:53362) 2024-04-25T17:18:18.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.946+0000 7f3c3a59c700 1 -- 172.21.15.37:0/22246408 learned_addr learned my addr 172.21.15.37:0/22246408 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:18:18.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.946+0000 7f3c39d9b700 1 --2- 172.21.15.37:0/22246408 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3c3c0fcf60 0x7f3c3c110180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:18:18.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.946+0000 7f3c3a59c700 1 -- 172.21.15.37:0/22246408 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3c3c0fcf60 msgr2=0x7f3c3c110180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:18:18.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.946+0000 7f3c3a59c700 1 --2- 172.21.15.37:0/22246408 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3c3c0fcf60 0x7f3c3c110180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:18.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.946+0000 7f3c3a59c700 1 -- 172.21.15.37:0/22246408 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c2c005040 con 0x7f3c3c0fbcb0 2024-04-25T17:18:18.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.946+0000 7f3c3a59c700 1 --2- 172.21.15.37:0/22246408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c3c0fbcb0 0x7f3c3c10fc40 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c009150 tx=0x7f3c2c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:18:18.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.947+0000 7f3c2affd700 1 -- 172.21.15.37:0/22246408 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c2c00e040 con 0x7f3c3c0fbcb0 2024-04-25T17:18:18.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.947+0000 7f3c40ece700 1 -- 172.21.15.37:0/22246408 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c3c111230 con 0x7f3c3c0fbcb0 2024-04-25T17:18:18.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.947+0000 7f3c2affd700 1 -- 172.21.15.37:0/22246408 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3c2c004290 con 0x7f3c3c0fbcb0 2024-04-25T17:18:18.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.947+0000 7f3c2affd700 1 -- 172.21.15.37:0/22246408 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c2c01c630 con 0x7f3c3c0fbcb0 2024-04-25T17:18:18.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.947+0000 7f3c40ece700 1 -- 172.21.15.37:0/22246408 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c3c1117f0 con 0x7f3c3c0fbcb0 2024-04-25T17:18:18.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.948+0000 7f3c40ece700 1 -- 172.21.15.37:0/22246408 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c3c05f5c0 con 0x7f3c3c0fbcb0 2024-04-25T17:18:18.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.949+0000 7f3c2affd700 1 -- 172.21.15.37:0/22246408 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) v1 ==== 92608+0+0 (secure 0 0 0) 0x7f3c2c013420 con 0x7f3c3c0fbcb0 2024-04-25T17:18:18.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.950+0000 7f3c2affd700 1 --2- 172.21.15.37:0/22246408 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f3c2406fd00 0x7f3c240721b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:18:18.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.950+0000 7f3c2affd700 1 -- 172.21.15.37:0/22246408 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f3c2c090420 con 0x7f3c3c0fbcb0 2024-04-25T17:18:18.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.951+0000 7f3c39d9b700 1 --2- 172.21.15.37:0/22246408 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f3c2406fd00 0x7f3c240721b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:18:18.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.951+0000 7f3c39d9b700 1 --2- 172.21.15.37:0/22246408 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f3c2406fd00 0x7f3c240721b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3c30009bf0 tx=0x7f3c300091a0 comp rx=0 tx=0).ready entity=mgr.24417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:18:18.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:18.958+0000 7f3c2affd700 1 -- 172.21.15.37:0/22246408 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f3c2c0597e0 con 0x7f3c3c0fbcb0 2024-04-25T17:18:19.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:19 smithi069 ceph-mon[34527]: from='client.24453 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:18:19.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:19 smithi069 ceph-mon[34527]: from='client.24457 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:18:19.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:19 smithi069 ceph-mon[34527]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:18:19.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:19 smithi069 ceph-mon[34527]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:18:19.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:19 smithi069 ceph-mon[34527]: pgmap v10: 65 pgs: 65 active+clean; 83 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 2.9 MiB/s wr, 349 op/s 2024-04-25T17:18:19.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:19 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/2340653059' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:18:19.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:19 smithi069 ceph-mon[34527]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:18:19.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:19 smithi069 ceph-mon[34527]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:18:19.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:19 smithi069 ceph-mon[34527]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T17:18:19.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:19 smithi069 ceph-mon[34527]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T17:18:19.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:19 smithi069 ceph-mon[34527]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T17:18:19.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:19 smithi069 ceph-mon[34527]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T17:18:19.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:19 smithi069 ceph-mon[34527]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T17:18:19.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:19 smithi069 ceph-mon[34527]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T17:18:19.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:19 smithi069 ceph-mon[34527]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:18:19.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:19.439+0000 7f3c40ece700 1 -- 172.21.15.37:0/22246408 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3c3c111a10 con 0x7f3c3c0fbcb0 2024-04-25T17:18:19.440 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:19 smithi037 ceph-mon[26472]: from='client.24453 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:18:19.440 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:19 smithi037 ceph-mon[26472]: from='client.24457 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:18:19.440 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:19 smithi037 ceph-mon[26472]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:18:19.440 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:19 smithi037 ceph-mon[26472]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:18:19.441 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:19 smithi037 ceph-mon[26472]: pgmap v10: 65 pgs: 65 active+clean; 83 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 2.9 MiB/s wr, 349 op/s 2024-04-25T17:18:19.441 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:19 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/2340653059' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:18:19.441 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:19 smithi037 ceph-mon[26472]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:18:19.441 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:19 smithi037 ceph-mon[26472]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:18:19.441 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:19 smithi037 ceph-mon[26472]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T17:18:19.441 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:19 smithi037 ceph-mon[26472]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-04-25T17:18:19.441 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:19 smithi037 ceph-mon[26472]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T17:18:19.441 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:19 smithi037 ceph-mon[26472]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-04-25T17:18:19.441 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:19 smithi037 ceph-mon[26472]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T17:18:19.441 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:19 smithi037 ceph-mon[26472]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-04-25T17:18:19.442 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:19 smithi037 ceph-mon[26472]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:18:19.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:19.440+0000 7f3c2affd700 1 -- 172.21.15.37:0/22246408 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1830 (secure 0 0 0) 0x7f3c2c059180 con 0x7f3c3c0fbcb0 2024-04-25T17:18:19.442 INFO:teuthology.orchestra.run.smithi037.stdout:e16 2024-04-25T17:18:19.442 INFO:teuthology.orchestra.run.smithi037.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-25T17:18:19.442 INFO:teuthology.orchestra.run.smithi037.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T17:18:19.442 INFO:teuthology.orchestra.run.smithi037.stdout:legacy client fscid: 1 2024-04-25T17:18:19.442 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:18:19.442 INFO:teuthology.orchestra.run.smithi037.stdout:Filesystem 'cephfs' (1) 2024-04-25T17:18:19.443 INFO:teuthology.orchestra.run.smithi037.stdout:fs_name cephfs 2024-04-25T17:18:19.443 INFO:teuthology.orchestra.run.smithi037.stdout:epoch 16 2024-04-25T17:18:19.443 INFO:teuthology.orchestra.run.smithi037.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-25T17:18:19.443 INFO:teuthology.orchestra.run.smithi037.stdout:created 2024-04-25T17:15:40.586130+0000 2024-04-25T17:18:19.443 INFO:teuthology.orchestra.run.smithi037.stdout:modified 2024-04-25T17:15:57.508740+0000 2024-04-25T17:18:19.443 INFO:teuthology.orchestra.run.smithi037.stdout:tableserver 0 2024-04-25T17:18:19.443 INFO:teuthology.orchestra.run.smithi037.stdout:root 0 2024-04-25T17:18:19.443 INFO:teuthology.orchestra.run.smithi037.stdout:session_timeout 60 2024-04-25T17:18:19.443 INFO:teuthology.orchestra.run.smithi037.stdout:session_autoclose 300 2024-04-25T17:18:19.443 INFO:teuthology.orchestra.run.smithi037.stdout:max_file_size 1099511627776 2024-04-25T17:18:19.443 INFO:teuthology.orchestra.run.smithi037.stdout:required_client_features {} 2024-04-25T17:18:19.443 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure 0 2024-04-25T17:18:19.443 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure_osd_epoch 0 2024-04-25T17:18:19.443 INFO:teuthology.orchestra.run.smithi037.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T17:18:19.443 INFO:teuthology.orchestra.run.smithi037.stdout:max_mds 1 2024-04-25T17:18:19.443 INFO:teuthology.orchestra.run.smithi037.stdout:in 0 2024-04-25T17:18:19.444 INFO:teuthology.orchestra.run.smithi037.stdout:up {0=14470} 2024-04-25T17:18:19.444 INFO:teuthology.orchestra.run.smithi037.stdout:failed 2024-04-25T17:18:19.444 INFO:teuthology.orchestra.run.smithi037.stdout:damaged 2024-04-25T17:18:19.444 INFO:teuthology.orchestra.run.smithi037.stdout:stopped 2024-04-25T17:18:19.444 INFO:teuthology.orchestra.run.smithi037.stdout:data_pools [3] 2024-04-25T17:18:19.444 INFO:teuthology.orchestra.run.smithi037.stdout:metadata_pool 2 2024-04-25T17:18:19.444 INFO:teuthology.orchestra.run.smithi037.stdout:inline_data disabled 2024-04-25T17:18:19.444 INFO:teuthology.orchestra.run.smithi037.stdout:balancer 2024-04-25T17:18:19.444 INFO:teuthology.orchestra.run.smithi037.stdout:standby_count_wanted 1 2024-04-25T17:18:19.444 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi037.ksmixc{0:14470} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.37:6826/1903989494,v1:172.21.15.37:6827/1903989494] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:18:19.444 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi037.ovkrpq{0:14482} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.37:6828/4206394422,v1:172.21.15.37:6829/4206394422] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:18:19.444 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:18:19.444 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:18:19.444 INFO:teuthology.orchestra.run.smithi037.stdout:Standby daemons: 2024-04-25T17:18:19.444 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:18:19.445 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi069.cpprst{-1:24289} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.69:6826/518856100,v1:172.21.15.69:6827/518856100] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:18:19.445 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi069.ytlqcf{-1:24293} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.69:6824/134210439,v1:172.21.15.69:6825/134210439] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:18:19.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:19.444+0000 7f3c40ece700 1 -- 172.21.15.37:0/22246408 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f3c2406fd00 msgr2=0x7f3c240721b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:18:19.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:19.444+0000 7f3c40ece700 1 --2- 172.21.15.37:0/22246408 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f3c2406fd00 0x7f3c240721b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3c30009bf0 tx=0x7f3c300091a0 comp rx=0 tx=0).stop 2024-04-25T17:18:19.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:19.444+0000 7f3c40ece700 1 -- 172.21.15.37:0/22246408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c3c0fbcb0 msgr2=0x7f3c3c10fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:18:19.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:19.444+0000 7f3c40ece700 1 --2- 172.21.15.37:0/22246408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c3c0fbcb0 0x7f3c3c10fc40 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c009150 tx=0x7f3c2c009e30 comp rx=0 tx=0).stop 2024-04-25T17:18:19.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:19.444+0000 7f3c40ece700 1 -- 172.21.15.37:0/22246408 shutdown_connections 2024-04-25T17:18:19.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:19.444+0000 7f3c40ece700 1 --2- 172.21.15.37:0/22246408 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f3c2406fd00 0x7f3c240721b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:19.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:19.444+0000 7f3c40ece700 1 --2- 172.21.15.37:0/22246408 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c3c0fbcb0 0x7f3c3c10fc40 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:19.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:19.444+0000 7f3c40ece700 1 --2- 172.21.15.37:0/22246408 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3c3c0fcf60 0x7f3c3c110180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:19.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:19.444+0000 7f3c40ece700 1 -- 172.21.15.37:0/22246408 >> 172.21.15.37:0/22246408 conn(0x7f3c3c0f7430 msgr2=0x7f3c3c0f8f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:18:19.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:19.444+0000 7f3c40ece700 1 -- 172.21.15.37:0/22246408 shutdown_connections 2024-04-25T17:18:19.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:19.444+0000 7f3c40ece700 1 -- 172.21.15.37:0/22246408 wait complete. 2024-04-25T17:18:19.446 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 16 2024-04-25T17:18:19.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:19.591+0000 7f930685e700 1 -- 172.21.15.37:0/31052581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93000fce80 msgr2=0x7f93000fd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:18:19.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:19.591+0000 7f930685e700 1 --2- 172.21.15.37:0/31052581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93000fce80 0x7f93000fd290 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f92f4004940 tx=0x7f92f4009e30 comp rx=0 tx=0).stop 2024-04-25T17:18:19.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:19.591+0000 7f930685e700 1 -- 172.21.15.37:0/31052581 shutdown_connections 2024-04-25T17:18:19.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:19.591+0000 7f930685e700 1 --2- 172.21.15.37:0/31052581 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f93000fdff0 0x7f93000fe460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:19.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:19.592+0000 7f930685e700 1 --2- 172.21.15.37:0/31052581 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93000fce80 0x7f93000fd290 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:19.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:19.592+0000 7f930685e700 1 -- 172.21.15.37:0/31052581 >> 172.21.15.37:0/31052581 conn(0x7f93000f8520 msgr2=0x7f93000fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:18:19.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:19.592+0000 7f930685e700 1 -- 172.21.15.37:0/31052581 shutdown_connections 2024-04-25T17:18:19.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:19.592+0000 7f930685e700 1 -- 172.21.15.37:0/31052581 wait complete. 2024-04-25T17:18:19.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:19.592+0000 7f930685e700 1 Processor -- start 2024-04-25T17:18:19.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:19.592+0000 7f930685e700 1 -- start start 2024-04-25T17:18:19.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:19.593+0000 7f930685e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f93000fce80 0x7f930010d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:18:19.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:19.593+0000 7f930685e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93000fdff0 0x7f930010dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:18:19.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:19.593+0000 7f930685e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f930010e4c0 con 0x7f93000fdff0 2024-04-25T17:18:19.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:19.593+0000 7f930685e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f930010ed10 con 0x7f93000fce80 2024-04-25T17:18:19.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:19.593+0000 7f92ff7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93000fdff0 0x7f930010dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:18:19.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:19.593+0000 7f92fffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f93000fce80 0x7f930010d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:18:19.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:19.593+0000 7f92fffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f93000fce80 0x7f930010d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.37:45928/0 (socket says 172.21.15.37:45928) 2024-04-25T17:18:19.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:19.593+0000 7f92ff7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93000fdff0 0x7f930010dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53378/0 (socket says 172.21.15.37:53378) 2024-04-25T17:18:19.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:19.593+0000 7f92fffff700 1 -- 172.21.15.37:0/2708235400 learned_addr learned my addr 172.21.15.37:0/2708235400 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:18:19.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:19.593+0000 7f92fffff700 1 -- 172.21.15.37:0/2708235400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93000fdff0 msgr2=0x7f930010dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:18:19.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:19.593+0000 7f92fffff700 1 --2- 172.21.15.37:0/2708235400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93000fdff0 0x7f930010dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:19.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:19.593+0000 7f92fffff700 1 -- 172.21.15.37:0/2708235400 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f4005040 con 0x7f93000fce80 2024-04-25T17:18:19.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:19.594+0000 7f92fffff700 1 --2- 172.21.15.37:0/2708235400 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f93000fce80 0x7f930010d980 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f92f4013870 tx=0x7f92f4009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:18:19.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:19.594+0000 7f92fcff9700 1 -- 172.21.15.37:0/2708235400 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92f4021070 con 0x7f93000fce80 2024-04-25T17:18:19.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:19.594+0000 7f930685e700 1 -- 172.21.15.37:0/2708235400 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f930010ef90 con 0x7f93000fce80 2024-04-25T17:18:19.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:19.594+0000 7f92fcff9700 1 -- 172.21.15.37:0/2708235400 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f92f4009430 con 0x7f93000fce80 2024-04-25T17:18:19.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:19.594+0000 7f930685e700 1 -- 172.21.15.37:0/2708235400 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f930010f4d0 con 0x7f93000fce80 2024-04-25T17:18:19.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:19.594+0000 7f92fcff9700 1 -- 172.21.15.37:0/2708235400 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f92f400e070 con 0x7f93000fce80 2024-04-25T17:18:19.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:19.595+0000 7f930685e700 1 -- 172.21.15.37:0/2708235400 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f930005f5c0 con 0x7f93000fce80 2024-04-25T17:18:19.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:19.596+0000 7f92fcff9700 1 -- 172.21.15.37:0/2708235400 <== mon.1 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) v1 ==== 92608+0+0 (secure 0 0 0) 0x7f92f4013af0 con 0x7f93000fce80 2024-04-25T17:18:19.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:19.597+0000 7f92fcff9700 1 --2- 172.21.15.37:0/2708235400 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f92e806fcb0 0x7f92e8072160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:18:19.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:19.597+0000 7f92fcff9700 1 -- 172.21.15.37:0/2708235400 <== mon.1 v2:172.21.15.69:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f92f4090970 con 0x7f93000fce80 2024-04-25T17:18:19.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:19.597+0000 7f92ff7fe700 1 --2- 172.21.15.37:0/2708235400 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f92e806fcb0 0x7f92e8072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:18:19.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:19.597+0000 7f92ff7fe700 1 --2- 172.21.15.37:0/2708235400 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f92e806fcb0 0x7f92e8072160 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f92f0009b80 tx=0x7f92f000b040 comp rx=0 tx=0).ready entity=mgr.24417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:18:19.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:19.601+0000 7f92fcff9700 1 -- 172.21.15.37:0/2708235400 <== mon.1 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f92f4059db0 con 0x7f93000fce80 2024-04-25T17:18:19.991 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:19.990+0000 7f930685e700 1 -- 172.21.15.37:0/2708235400 --> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f930010f800 con 0x7f92e806fcb0 2024-04-25T17:18:19.992 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:19.991+0000 7f92fcff9700 1 -- 172.21.15.37:0/2708235400 <== mgr.24417 v2:172.21.15.69:6828/2602478 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f930010f800 con 0x7f92e806fcb0 2024-04-25T17:18:19.992 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-25T17:18:19.992 INFO:teuthology.orchestra.run.smithi037.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385", 2024-04-25T17:18:19.992 INFO:teuthology.orchestra.run.smithi037.stdout: "in_progress": true, 2024-04-25T17:18:19.993 INFO:teuthology.orchestra.run.smithi037.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-25T17:18:19.993 INFO:teuthology.orchestra.run.smithi037.stdout: "services_complete": [], 2024-04-25T17:18:19.993 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": "1/21 daemons upgraded", 2024-04-25T17:18:19.993 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "", 2024-04-25T17:18:19.993 INFO:teuthology.orchestra.run.smithi037.stdout: "is_paused": false 2024-04-25T17:18:19.993 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-25T17:18:19.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:19.995+0000 7f930685e700 1 -- 172.21.15.37:0/2708235400 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f92e806fcb0 msgr2=0x7f92e8072160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:18:19.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:19.995+0000 7f930685e700 1 --2- 172.21.15.37:0/2708235400 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f92e806fcb0 0x7f92e8072160 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f92f0009b80 tx=0x7f92f000b040 comp rx=0 tx=0).stop 2024-04-25T17:18:19.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:19.995+0000 7f930685e700 1 -- 172.21.15.37:0/2708235400 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f93000fce80 msgr2=0x7f930010d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:18:19.996 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:19.995+0000 7f930685e700 1 --2- 172.21.15.37:0/2708235400 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f93000fce80 0x7f930010d980 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f92f4013870 tx=0x7f92f4009e30 comp rx=0 tx=0).stop 2024-04-25T17:18:19.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:19.995+0000 7f930685e700 1 -- 172.21.15.37:0/2708235400 shutdown_connections 2024-04-25T17:18:19.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:19.995+0000 7f930685e700 1 --2- 172.21.15.37:0/2708235400 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f92e806fcb0 0x7f92e8072160 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:19.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:19.995+0000 7f930685e700 1 --2- 172.21.15.37:0/2708235400 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f93000fce80 0x7f930010d980 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:19.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:19.995+0000 7f930685e700 1 --2- 172.21.15.37:0/2708235400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93000fdff0 0x7f930010dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:19.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:19.995+0000 7f930685e700 1 -- 172.21.15.37:0/2708235400 >> 172.21.15.37:0/2708235400 conn(0x7f93000f8520 msgr2=0x7f93000f9bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:18:19.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:19.995+0000 7f930685e700 1 -- 172.21.15.37:0/2708235400 shutdown_connections 2024-04-25T17:18:19.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:19.995+0000 7f930685e700 1 -- 172.21.15.37:0/2708235400 wait complete. 2024-04-25T17:18:20.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:20.162+0000 7f80a15af700 1 -- 172.21.15.37:0/2760679782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f809c104680 msgr2=0x7f809c104af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:18:20.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:20.162+0000 7f80a15af700 1 --2- 172.21.15.37:0/2760679782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f809c104680 0x7f809c104af0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8090004940 tx=0x7f8090009e30 comp rx=0 tx=0).stop 2024-04-25T17:18:20.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:20.162+0000 7f80a15af700 1 -- 172.21.15.37:0/2760679782 shutdown_connections 2024-04-25T17:18:20.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:20.162+0000 7f80a15af700 1 --2- 172.21.15.37:0/2760679782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f809c104680 0x7f809c104af0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:20.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:20.162+0000 7f80a15af700 1 --2- 172.21.15.37:0/2760679782 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f809c1033d0 0x7f809c1037e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:20.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:20.162+0000 7f80a15af700 1 -- 172.21.15.37:0/2760679782 >> 172.21.15.37:0/2760679782 conn(0x7f809c066ce0 msgr2=0x7f809c067100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:18:20.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:20.162+0000 7f80a15af700 1 -- 172.21.15.37:0/2760679782 shutdown_connections 2024-04-25T17:18:20.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:20.162+0000 7f80a15af700 1 -- 172.21.15.37:0/2760679782 wait complete. 2024-04-25T17:18:20.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:20.163+0000 7f80a15af700 1 Processor -- start 2024-04-25T17:18:20.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:20.163+0000 7f80a15af700 1 -- start start 2024-04-25T17:18:20.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:20.164+0000 7f80a15af700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f809c1033d0 0x7f809c113f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:18:20.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:20.164+0000 7f80a15af700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f809c104680 0x7f809c1144b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:18:20.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:20.164+0000 7f80a15af700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f809c114ab0 con 0x7f809c104680 2024-04-25T17:18:20.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:20.164+0000 7f80a15af700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f809c115300 con 0x7f809c1033d0 2024-04-25T17:18:20.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:20.164+0000 7f809affd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f809c1033d0 0x7f809c113f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:18:20.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:20.164+0000 7f809a7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f809c104680 0x7f809c1144b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:18:20.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:20.164+0000 7f809affd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f809c1033d0 0x7f809c113f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.37:45946/0 (socket says 172.21.15.37:45946) 2024-04-25T17:18:20.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:20.164+0000 7f809affd700 1 -- 172.21.15.37:0/1238989791 learned_addr learned my addr 172.21.15.37:0/1238989791 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:18:20.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:20.164+0000 7f809affd700 1 -- 172.21.15.37:0/1238989791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f809c104680 msgr2=0x7f809c1144b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:18:20.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:20.164+0000 7f809affd700 1 --2- 172.21.15.37:0/1238989791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f809c104680 0x7f809c1144b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:20.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:20.164+0000 7f809affd700 1 -- 172.21.15.37:0/1238989791 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8090005040 con 0x7f809c1033d0 2024-04-25T17:18:20.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:20.165+0000 7f809affd700 1 --2- 172.21.15.37:0/1238989791 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f809c1033d0 0x7f809c113f70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f809400eb40 tx=0x7f809400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:18:20.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:20.165+0000 7f80837fe700 1 -- 172.21.15.37:0/1238989791 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8094007cc0 con 0x7f809c1033d0 2024-04-25T17:18:20.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:20.165+0000 7f80837fe700 1 -- 172.21.15.37:0/1238989791 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f809400f040 con 0x7f809c1033d0 2024-04-25T17:18:20.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:20.165+0000 7f80a15af700 1 -- 172.21.15.37:0/1238989791 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f809c115580 con 0x7f809c1033d0 2024-04-25T17:18:20.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:20.165+0000 7f80837fe700 1 -- 172.21.15.37:0/1238989791 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f809400ca10 con 0x7f809c1033d0 2024-04-25T17:18:20.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:20.165+0000 7f80a15af700 1 -- 172.21.15.37:0/1238989791 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f809c115ac0 con 0x7f809c1033d0 2024-04-25T17:18:20.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:20.166+0000 7f80a15af700 1 -- 172.21.15.37:0/1238989791 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f809c05f5c0 con 0x7f809c1033d0 2024-04-25T17:18:20.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:20.167+0000 7f80837fe700 1 -- 172.21.15.37:0/1238989791 <== mon.1 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) v1 ==== 92608+0+0 (secure 0 0 0) 0x7f809400cb70 con 0x7f809c1033d0 2024-04-25T17:18:20.168 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:20.167+0000 7f80837fe700 1 --2- 172.21.15.37:0/1238989791 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f808406fcb0 0x7f8084072160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:18:20.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:20.168+0000 7f80837fe700 1 -- 172.21.15.37:0/1238989791 <== mon.1 v2:172.21.15.69:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f809408f2c0 con 0x7f809c1033d0 2024-04-25T17:18:20.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:20.168+0000 7f809a7fc700 1 --2- 172.21.15.37:0/1238989791 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f808406fcb0 0x7f8084072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:18:20.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:20.169+0000 7f809a7fc700 1 --2- 172.21.15.37:0/1238989791 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f808406fcb0 0x7f8084072160 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8090009b30 tx=0x7f8090009e30 comp rx=0 tx=0).ready entity=mgr.24417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:18:20.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:20.172+0000 7f80837fe700 1 -- 172.21.15.37:0/1238989791 <== mon.1 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f8094050930 con 0x7f809c1033d0 2024-04-25T17:18:20.321 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:20 smithi037 ceph-mon[26472]: Adjusting osd_memory_target on smithi069 to 2581M 2024-04-25T17:18:20.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:20 smithi037 ceph-mon[26472]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:18:20.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:20 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/22246408' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T17:18:20.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:20 smithi037 ceph-mon[26472]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:18:20.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:20 smithi037 ceph-mon[26472]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:18:20.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:20 smithi037 ceph-mon[26472]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T17:18:20.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:20 smithi037 ceph-mon[26472]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T17:18:20.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:20 smithi037 ceph-mon[26472]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T17:18:20.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:20 smithi037 ceph-mon[26472]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T17:18:20.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:20 smithi037 ceph-mon[26472]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T17:18:20.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:20 smithi037 ceph-mon[26472]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T17:18:20.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:20 smithi037 ceph-mon[26472]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:18:20.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:20 smithi037 ceph-mon[26472]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:18:20.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:20 smithi037 ceph-mon[26472]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:18:20.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:20 smithi069 ceph-mon[34527]: Adjusting osd_memory_target on smithi069 to 2581M 2024-04-25T17:18:20.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:20 smithi069 ceph-mon[34527]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:18:20.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:20 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/22246408' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T17:18:20.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:20 smithi069 ceph-mon[34527]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:18:20.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:20 smithi069 ceph-mon[34527]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:18:20.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:20 smithi069 ceph-mon[34527]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T17:18:20.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:20 smithi069 ceph-mon[34527]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-04-25T17:18:20.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:20 smithi069 ceph-mon[34527]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T17:18:20.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:20 smithi069 ceph-mon[34527]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-04-25T17:18:20.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:20 smithi069 ceph-mon[34527]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T17:18:20.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:20 smithi069 ceph-mon[34527]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-04-25T17:18:20.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:20 smithi069 ceph-mon[34527]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:18:20.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:20 smithi069 ceph-mon[34527]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:18:20.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:20 smithi069 ceph-mon[34527]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:18:20.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:20.676+0000 7f80a15af700 1 -- 172.21.15.37:0/1238989791 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f809c04bed0 con 0x7f809c1033d0 2024-04-25T17:18:20.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:20.676+0000 7f80837fe700 1 -- 172.21.15.37:0/1238989791 <== mon.1 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f80940586b0 con 0x7f809c1033d0 2024-04-25T17:18:20.677 INFO:teuthology.orchestra.run.smithi037.stdout:HEALTH_OK 2024-04-25T17:18:20.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:20.680+0000 7f80a15af700 1 -- 172.21.15.37:0/1238989791 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f808406fcb0 msgr2=0x7f8084072160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:18:20.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:20.680+0000 7f80a15af700 1 --2- 172.21.15.37:0/1238989791 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f808406fcb0 0x7f8084072160 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8090009b30 tx=0x7f8090009e30 comp rx=0 tx=0).stop 2024-04-25T17:18:20.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:20.680+0000 7f80a15af700 1 -- 172.21.15.37:0/1238989791 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f809c1033d0 msgr2=0x7f809c113f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:18:20.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:20.680+0000 7f80a15af700 1 --2- 172.21.15.37:0/1238989791 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f809c1033d0 0x7f809c113f70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f809400eb40 tx=0x7f809400b040 comp rx=0 tx=0).stop 2024-04-25T17:18:20.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:20.680+0000 7f80a15af700 1 -- 172.21.15.37:0/1238989791 shutdown_connections 2024-04-25T17:18:20.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:20.680+0000 7f80a15af700 1 --2- 172.21.15.37:0/1238989791 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f808406fcb0 0x7f8084072160 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:20.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:20.680+0000 7f80a15af700 1 --2- 172.21.15.37:0/1238989791 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f809c1033d0 0x7f809c113f70 secure :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f809400eb40 tx=0x7f809400b040 comp rx=0 tx=0).stop 2024-04-25T17:18:20.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:20.680+0000 7f80a15af700 1 --2- 172.21.15.37:0/1238989791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f809c104680 0x7f809c1144b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:20.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:20.680+0000 7f80a15af700 1 -- 172.21.15.37:0/1238989791 >> 172.21.15.37:0/1238989791 conn(0x7f809c066ce0 msgr2=0x7f809c075080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:18:20.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:20.681+0000 7f80a15af700 1 -- 172.21.15.37:0/1238989791 shutdown_connections 2024-04-25T17:18:20.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:20.681+0000 7f80a15af700 1 -- 172.21.15.37:0/1238989791 wait complete. 2024-04-25T17:18:21.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:21 smithi069 ceph-mon[34527]: Adjusting osd_memory_target on smithi037 to 1559M 2024-04-25T17:18:21.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:21 smithi069 ceph-mon[34527]: Updating smithi037:/etc/ceph/ceph.conf 2024-04-25T17:18:21.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:21 smithi069 ceph-mon[34527]: Updating smithi069:/etc/ceph/ceph.conf 2024-04-25T17:18:21.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:21 smithi069 ceph-mon[34527]: from='client.24467 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:18:21.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:21 smithi069 ceph-mon[34527]: Updating smithi069:/var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T17:18:21.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:21 smithi069 ceph-mon[34527]: Updating smithi037:/var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T17:18:21.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:21 smithi069 ceph-mon[34527]: pgmap v11: 65 pgs: 65 active+clean; 83 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 2.9 MiB/s wr, 349 op/s 2024-04-25T17:18:21.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:21 smithi069 ceph-mon[34527]: Updating smithi069:/etc/ceph/ceph.client.admin.keyring 2024-04-25T17:18:21.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:21 smithi069 ceph-mon[34527]: Updating smithi037:/etc/ceph/ceph.client.admin.keyring 2024-04-25T17:18:21.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:21 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/1238989791' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T17:18:21.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:21 smithi069 ceph-mon[34527]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:18:21.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:21 smithi069 ceph-mon[34527]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:18:21.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:21 smithi037 ceph-mon[26472]: Adjusting osd_memory_target on smithi037 to 1559M 2024-04-25T17:18:21.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:21 smithi037 ceph-mon[26472]: Updating smithi037:/etc/ceph/ceph.conf 2024-04-25T17:18:21.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:21 smithi037 ceph-mon[26472]: Updating smithi069:/etc/ceph/ceph.conf 2024-04-25T17:18:21.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:21 smithi037 ceph-mon[26472]: from='client.24467 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:18:21.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:21 smithi037 ceph-mon[26472]: Updating smithi069:/var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T17:18:21.573 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:21 smithi037 ceph-mon[26472]: Updating smithi037:/var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T17:18:21.573 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:21 smithi037 ceph-mon[26472]: pgmap v11: 65 pgs: 65 active+clean; 83 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 2.9 MiB/s wr, 349 op/s 2024-04-25T17:18:21.573 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:21 smithi037 ceph-mon[26472]: Updating smithi069:/etc/ceph/ceph.client.admin.keyring 2024-04-25T17:18:21.573 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:21 smithi037 ceph-mon[26472]: Updating smithi037:/etc/ceph/ceph.client.admin.keyring 2024-04-25T17:18:21.573 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:21 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/1238989791' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T17:18:21.573 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:21 smithi037 ceph-mon[26472]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:18:21.574 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:21 smithi037 ceph-mon[26472]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:18:22.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:22 smithi037 ceph-mon[26472]: Updating smithi069:/var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T17:18:22.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:22 smithi037 ceph-mon[26472]: Updating smithi037:/var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T17:18:22.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:22 smithi037 ceph-mon[26472]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:18:22.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:22 smithi037 ceph-mon[26472]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:18:22.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:22 smithi037 ceph-mon[26472]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:18:22.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:22 smithi037 ceph-mon[26472]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:18:22.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:22 smithi037 ceph-mon[26472]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:18:22.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:22 smithi037 ceph-mon[26472]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:18:22.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:22 smithi037 ceph-mon[26472]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:18:22.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:22 smithi037 ceph-mon[26472]: Reconfiguring node-exporter.smithi037 (dependencies changed)... 2024-04-25T17:18:22.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:22 smithi037 ceph-mon[26472]: Reconfiguring daemon node-exporter.smithi037 on smithi037 2024-04-25T17:18:22.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:22 smithi069 ceph-mon[34527]: Updating smithi069:/var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T17:18:22.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:22 smithi069 ceph-mon[34527]: Updating smithi037:/var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T17:18:22.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:22 smithi069 ceph-mon[34527]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:18:22.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:22 smithi069 ceph-mon[34527]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:18:22.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:22 smithi069 ceph-mon[34527]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:18:22.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:22 smithi069 ceph-mon[34527]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:18:22.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:22 smithi069 ceph-mon[34527]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:18:22.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:22 smithi069 ceph-mon[34527]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:18:22.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:22 smithi069 ceph-mon[34527]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:18:22.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:22 smithi069 ceph-mon[34527]: Reconfiguring node-exporter.smithi037 (dependencies changed)... 2024-04-25T17:18:22.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:22 smithi069 ceph-mon[34527]: Reconfiguring daemon node-exporter.smithi037 on smithi037 2024-04-25T17:18:23.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:23 smithi037 ceph-mon[26472]: pgmap v12: 65 pgs: 65 active+clean; 97 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s rd, 4.1 MiB/s wr, 484 op/s 2024-04-25T17:18:23.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:23 smithi069 ceph-mon[34527]: pgmap v12: 65 pgs: 65 active+clean; 97 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s rd, 4.1 MiB/s wr, 484 op/s 2024-04-25T17:18:25.726 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:25 smithi037 ceph-mon[26472]: pgmap v13: 65 pgs: 65 active+clean; 97 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 2.4 MiB/s wr, 297 op/s 2024-04-25T17:18:25.819 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:25 smithi069 ceph-mon[34527]: pgmap v13: 65 pgs: 65 active+clean; 97 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 2.4 MiB/s wr, 297 op/s 2024-04-25T17:18:27.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:27 smithi037 ceph-mon[26472]: pgmap v14: 65 pgs: 65 active+clean; 120 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 4.4 MiB/s wr, 454 op/s 2024-04-25T17:18:27.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:27 smithi037 ceph-mon[26472]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:18:27.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:27 smithi037 ceph-mon[26472]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:18:27.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:27 smithi069 ceph-mon[34527]: pgmap v14: 65 pgs: 65 active+clean; 120 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 4.4 MiB/s wr, 454 op/s 2024-04-25T17:18:27.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:27 smithi069 ceph-mon[34527]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:18:27.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:27 smithi069 ceph-mon[34527]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:18:28.476 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:28 smithi037 ceph-mon[26472]: Reconfiguring alertmanager.smithi037 (dependencies changed)... 2024-04-25T17:18:28.476 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:28 smithi037 ceph-mon[26472]: Reconfiguring daemon alertmanager.smithi037 on smithi037 2024-04-25T17:18:28.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:28 smithi069 ceph-mon[34527]: Reconfiguring alertmanager.smithi037 (dependencies changed)... 2024-04-25T17:18:28.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:28 smithi069 ceph-mon[34527]: Reconfiguring daemon alertmanager.smithi037 on smithi037 2024-04-25T17:18:29.804 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:29 smithi037 ceph-mon[26472]: pgmap v15: 65 pgs: 65 active+clean; 120 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.2 MiB/s wr, 292 op/s 2024-04-25T17:18:29.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:29 smithi069 ceph-mon[34527]: pgmap v15: 65 pgs: 65 active+clean; 120 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.2 MiB/s wr, 292 op/s 2024-04-25T17:18:31.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:31 smithi037 ceph-mon[26472]: pgmap v16: 65 pgs: 65 active+clean; 120 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.2 MiB/s wr, 292 op/s 2024-04-25T17:18:31.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:31 smithi069 ceph-mon[34527]: pgmap v16: 65 pgs: 65 active+clean; 120 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.2 MiB/s wr, 292 op/s 2024-04-25T17:18:33.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:33 smithi037 ceph-mon[26472]: pgmap v17: 65 pgs: 65 active+clean; 135 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 4.6 MiB/s wr, 456 op/s 2024-04-25T17:18:33.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:33 smithi069 ceph-mon[34527]: pgmap v17: 65 pgs: 65 active+clean; 135 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 4.6 MiB/s wr, 456 op/s 2024-04-25T17:18:34.622 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:34 smithi037 ceph-mon[26472]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:18:34.622 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:34 smithi037 ceph-mon[26472]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:18:34.623 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:34 smithi037 ceph-mon[26472]: Reconfiguring grafana.smithi037 (dependencies changed)... 2024-04-25T17:18:34.623 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:34 smithi037 ceph-mon[26472]: Reconfiguring daemon grafana.smithi037 on smithi037 2024-04-25T17:18:34.623 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:34 smithi037 ceph-mon[26472]: pgmap v18: 65 pgs: 65 active+clean; 135 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.0 MiB/s rd, 3.4 MiB/s wr, 320 op/s 2024-04-25T17:18:34.623 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:34 smithi037 ceph-mon[26472]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:18:34.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:34 smithi069 ceph-mon[34527]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:18:34.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:34 smithi069 ceph-mon[34527]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:18:34.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:34 smithi069 ceph-mon[34527]: Reconfiguring grafana.smithi037 (dependencies changed)... 2024-04-25T17:18:34.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:34 smithi069 ceph-mon[34527]: Reconfiguring daemon grafana.smithi037 on smithi037 2024-04-25T17:18:34.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:34 smithi069 ceph-mon[34527]: pgmap v18: 65 pgs: 65 active+clean; 135 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.0 MiB/s rd, 3.4 MiB/s wr, 320 op/s 2024-04-25T17:18:34.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:34 smithi069 ceph-mon[34527]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:18:37.475 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:37 smithi037 ceph-mon[26472]: pgmap v19: 65 pgs: 65 active+clean; 151 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 4.7 MiB/s wr, 482 op/s 2024-04-25T17:18:37.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:37 smithi069 ceph-mon[34527]: pgmap v19: 65 pgs: 65 active+clean; 151 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 4.7 MiB/s wr, 482 op/s 2024-04-25T17:18:39.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:39 smithi037 ceph-mon[26472]: pgmap v20: 65 pgs: 65 active+clean; 151 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 2.7 MiB/s wr, 325 op/s 2024-04-25T17:18:39.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:39 smithi037 ceph-mon[26472]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:18:39.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:39 smithi037 ceph-mon[26472]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:18:39.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:39 smithi069 ceph-mon[34527]: pgmap v20: 65 pgs: 65 active+clean; 151 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 2.7 MiB/s wr, 325 op/s 2024-04-25T17:18:39.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:39 smithi069 ceph-mon[34527]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:18:39.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:39 smithi069 ceph-mon[34527]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:18:40.569 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:40 smithi037 ceph-mon[26472]: Reconfiguring prometheus.smithi037 (dependencies changed)... 2024-04-25T17:18:40.569 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:40 smithi037 ceph-mon[26472]: Reconfiguring daemon prometheus.smithi037 on smithi037 2024-04-25T17:18:40.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:40 smithi069 ceph-mon[34527]: Reconfiguring prometheus.smithi037 (dependencies changed)... 2024-04-25T17:18:40.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:40 smithi069 ceph-mon[34527]: Reconfiguring daemon prometheus.smithi037 on smithi037 2024-04-25T17:18:41.558 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:41 smithi037 ceph-mon[26472]: pgmap v21: 65 pgs: 65 active+clean; 154 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.0 MiB/s wr, 381 op/s 2024-04-25T17:18:41.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:41 smithi069 ceph-mon[34527]: pgmap v21: 65 pgs: 65 active+clean; 154 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.0 MiB/s wr, 381 op/s 2024-04-25T17:18:41.810 INFO:tasks.workunit.client.0.smithi037.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-04-25T17:18:41.816 INFO:tasks.workunit.client.0.smithi037.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-25T17:18:41.817 INFO:tasks.workunit.client.0.smithi037.stderr:+ make 2024-04-25T17:18:42.160 INFO:tasks.workunit.client.0.smithi037.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-04-25T17:18:42.973 INFO:tasks.workunit.client.0.smithi037.stderr:++ readlink -f fsstress 2024-04-25T17:18:42.975 INFO:tasks.workunit.client.0.smithi037.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-04-25T17:18:42.975 INFO:tasks.workunit.client.0.smithi037.stderr:+ popd 2024-04-25T17:18:42.977 INFO:tasks.workunit.client.0.smithi037.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-25T17:18:42.977 INFO:tasks.workunit.client.0.smithi037.stderr:+ popd 2024-04-25T17:18:42.977 INFO:tasks.workunit.client.0.smithi037.stdout:~/cephtest/mnt.0/client.0/tmp 2024-04-25T17:18:42.978 INFO:tasks.workunit.client.0.smithi037.stderr:++ mktemp -d -p . 2024-04-25T17:18:42.981 INFO:tasks.workunit.client.0.smithi037.stderr:+ T=./tmp.iWwsdQYkoI 2024-04-25T17:18:42.981 INFO:tasks.workunit.client.0.smithi037.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.iWwsdQYkoI -l 1 -n 1000 -p 10 -v 2024-04-25T17:18:42.986 INFO:tasks.workunit.client.0.smithi037.stdout:seed = 1713733748 2024-04-25T17:18:42.992 INFO:tasks.workunit.client.0.smithi037.stdout:0/0: readlink - no filename 2024-04-25T17:18:42.998 INFO:tasks.workunit.client.0.smithi037.stdout:2/0: fdatasync - no filename 2024-04-25T17:18:42.998 INFO:tasks.workunit.client.0.smithi037.stdout:2/1: dread - no filename 2024-04-25T17:18:43.001 INFO:tasks.workunit.client.0.smithi037.stdout:1/0: creat f0 x:0 0 0 2024-04-25T17:18:43.003 INFO:tasks.workunit.client.0.smithi037.stdout:4/0: write - no filename 2024-04-25T17:18:43.003 INFO:tasks.workunit.client.0.smithi037.stdout:4/1: rmdir - no directory 2024-04-25T17:18:43.003 INFO:tasks.workunit.client.0.smithi037.stdout:4/2: chown . 119 1 2024-04-25T17:18:43.005 INFO:tasks.workunit.client.0.smithi037.stdout:2/2: getdents . 0 2024-04-25T17:18:43.005 INFO:tasks.workunit.client.0.smithi037.stdout:2/3: dread - no filename 2024-04-25T17:18:43.005 INFO:tasks.workunit.client.0.smithi037.stdout:2/4: link - no file 2024-04-25T17:18:43.005 INFO:tasks.workunit.client.0.smithi037.stdout:2/5: chown . 699333464 1 2024-04-25T17:18:43.005 INFO:tasks.workunit.client.0.smithi037.stdout:2/6: readlink - no filename 2024-04-25T17:18:43.005 INFO:tasks.workunit.client.0.smithi037.stdout:2/7: truncate - no filename 2024-04-25T17:18:43.006 INFO:tasks.workunit.client.0.smithi037.stdout:1/1: rename f0 to f1 0 2024-04-25T17:18:43.006 INFO:tasks.workunit.client.0.smithi037.stdout:1/2: stat f1 0 2024-04-25T17:18:43.007 INFO:tasks.workunit.client.0.smithi037.stdout:1/3: chown f1 775339758 1 2024-04-25T17:18:43.007 INFO:tasks.workunit.client.0.smithi037.stdout:1/4: stat f1 0 2024-04-25T17:18:43.008 INFO:tasks.workunit.client.0.smithi037.stdout:5/0: dwrite - no filename 2024-04-25T17:18:43.010 INFO:tasks.workunit.client.0.smithi037.stdout:3/0: mknod c0 0 2024-04-25T17:18:43.016 INFO:tasks.workunit.client.0.smithi037.stdout:6/0: link - no file 2024-04-25T17:18:43.019 INFO:tasks.workunit.client.0.smithi037.stdout:4/3: mknod c0 0 2024-04-25T17:18:43.019 INFO:tasks.workunit.client.0.smithi037.stdout:4/4: dwrite - no filename 2024-04-25T17:18:43.019 INFO:tasks.workunit.client.0.smithi037.stdout:4/5: dwrite - no filename 2024-04-25T17:18:43.020 INFO:tasks.workunit.client.0.smithi037.stdout:3/1: symlink l1 0 2024-04-25T17:18:43.022 INFO:tasks.workunit.client.0.smithi037.stdout:2/8: mkdir d0 0 2024-04-25T17:18:43.022 INFO:tasks.workunit.client.0.smithi037.stdout:2/9: dread - no filename 2024-04-25T17:18:43.024 INFO:tasks.workunit.client.0.smithi037.stdout:1/5: dwrite f1 [0,4194304] 0 2024-04-25T17:18:43.026 INFO:tasks.workunit.client.0.smithi037.stdout:5/1: getdents . 0 2024-04-25T17:18:43.026 INFO:tasks.workunit.client.0.smithi037.stdout:5/2: write - no filename 2024-04-25T17:18:43.026 INFO:tasks.workunit.client.0.smithi037.stdout:5/3: rmdir - no directory 2024-04-25T17:18:43.026 INFO:tasks.workunit.client.0.smithi037.stdout:5/4: read - no filename 2024-04-25T17:18:43.026 INFO:tasks.workunit.client.0.smithi037.stdout:5/5: write - no filename 2024-04-25T17:18:43.026 INFO:tasks.workunit.client.0.smithi037.stdout:5/6: rmdir - no directory 2024-04-25T17:18:43.027 INFO:tasks.workunit.client.0.smithi037.stdout:7/0: dwrite - no filename 2024-04-25T17:18:43.027 INFO:tasks.workunit.client.0.smithi037.stdout:7/1: write - no filename 2024-04-25T17:18:43.027 INFO:tasks.workunit.client.0.smithi037.stdout:7/2: link - no file 2024-04-25T17:18:43.027 INFO:tasks.workunit.client.0.smithi037.stdout:1/6: write f1 [3928578,56651] 0 2024-04-25T17:18:43.027 INFO:tasks.workunit.client.0.smithi037.stdout:1/7: chown f1 8761 1 2024-04-25T17:18:43.027 INFO:tasks.workunit.client.0.smithi037.stdout:1/8: readlink - no filename 2024-04-25T17:18:43.028 INFO:tasks.workunit.client.0.smithi037.stdout:1/9: write f1 [2838790,4492] 0 2024-04-25T17:18:43.030 INFO:tasks.workunit.client.0.smithi037.stdout:4/6: unlink c0 0 2024-04-25T17:18:43.030 INFO:tasks.workunit.client.0.smithi037.stdout:4/7: rmdir - no directory 2024-04-25T17:18:43.031 INFO:tasks.workunit.client.0.smithi037.stdout:4/8: dread - no filename 2024-04-25T17:18:43.031 INFO:tasks.workunit.client.0.smithi037.stdout:4/9: truncate - no filename 2024-04-25T17:18:43.032 INFO:tasks.workunit.client.0.smithi037.stdout:3/2: mknod c2 0 2024-04-25T17:18:43.035 INFO:tasks.workunit.client.0.smithi037.stdout:6/1: symlink l0 0 2024-04-25T17:18:43.035 INFO:tasks.workunit.client.0.smithi037.stdout:6/2: write - no filename 2024-04-25T17:18:43.036 INFO:tasks.workunit.client.0.smithi037.stdout:6/3: fdatasync - no filename 2024-04-25T17:18:43.036 INFO:tasks.workunit.client.0.smithi037.stdout:6/4: truncate - no filename 2024-04-25T17:18:43.036 INFO:tasks.workunit.client.0.smithi037.stdout:6/5: truncate - no filename 2024-04-25T17:18:43.036 INFO:tasks.workunit.client.0.smithi037.stdout:6/6: truncate - no filename 2024-04-25T17:18:43.036 INFO:tasks.workunit.client.0.smithi037.stdout:6/7: truncate - no filename 2024-04-25T17:18:43.040 INFO:tasks.workunit.client.0.smithi037.stdout:4/10: creat f1 x:0 0 0 2024-04-25T17:18:43.095 INFO:tasks.workunit.client.0.smithi037.stdout:3/3: creat f3 x:0 0 0 2024-04-25T17:18:43.096 INFO:tasks.workunit.client.0.smithi037.stdout:3/4: truncate f3 447491 0 2024-04-25T17:18:43.096 INFO:tasks.workunit.client.0.smithi037.stdout:2/10: creat d0/f1 x:0 0 0 2024-04-25T17:18:43.097 INFO:tasks.workunit.client.0.smithi037.stdout:6/8: unlink l0 0 2024-04-25T17:18:43.097 INFO:tasks.workunit.client.0.smithi037.stdout:6/9: write - no filename 2024-04-25T17:18:43.097 INFO:tasks.workunit.client.0.smithi037.stdout:6/10: stat - no entries 2024-04-25T17:18:43.097 INFO:tasks.workunit.client.0.smithi037.stdout:6/11: write - no filename 2024-04-25T17:18:43.099 INFO:tasks.workunit.client.0.smithi037.stdout:5/7: creat f0 x:0 0 0 2024-04-25T17:18:43.100 INFO:tasks.workunit.client.0.smithi037.stdout:9/0: unlink - no file 2024-04-25T17:18:43.102 INFO:tasks.workunit.client.0.smithi037.stdout:4/11: creat f2 x:0 0 0 2024-04-25T17:18:43.260 INFO:tasks.workunit.client.0.smithi037.stdout:6/12: creat f1 x:0 0 0 2024-04-25T17:18:43.261 INFO:tasks.workunit.client.0.smithi037.stdout:5/8: creat f1 x:0 0 0 2024-04-25T17:18:43.270 INFO:tasks.workunit.client.0.smithi037.stdout:5/9: write f0 [976617,108404] 0 2024-04-25T17:18:43.270 INFO:tasks.workunit.client.0.smithi037.stdout:4/12: dwrite f2 [0,4194304] 0 2024-04-25T17:18:43.273 INFO:tasks.workunit.client.0.smithi037.stdout:5/10: dread - f1 zero size 2024-04-25T17:18:43.277 INFO:tasks.workunit.client.0.smithi037.stdout:5/11: write f1 [87700,54164] 0 2024-04-25T17:18:43.277 INFO:tasks.workunit.client.0.smithi037.stdout:6/13: dwrite f1 [0,4194304] 0 2024-04-25T17:18:43.278 INFO:tasks.workunit.client.0.smithi037.stdout:6/14: chown f1 2028183 1 2024-04-25T17:18:43.282 INFO:tasks.workunit.client.0.smithi037.stdout:6/15: write f1 [1279902,59516] 0 2024-04-25T17:18:43.284 INFO:tasks.workunit.client.0.smithi037.stdout:9/1: getdents . 0 2024-04-25T17:18:43.285 INFO:tasks.workunit.client.0.smithi037.stdout:9/2: dwrite - no filename 2024-04-25T17:18:43.285 INFO:tasks.workunit.client.0.smithi037.stdout:9/3: dwrite - no filename 2024-04-25T17:18:43.285 INFO:tasks.workunit.client.0.smithi037.stdout:1/10: getdents . 0 2024-04-25T17:18:43.285 INFO:tasks.workunit.client.0.smithi037.stdout:4/13: creat f3 x:0 0 0 2024-04-25T17:18:43.287 INFO:tasks.workunit.client.0.smithi037.stdout:4/14: write f3 [693502,2159] 0 2024-04-25T17:18:43.288 INFO:tasks.workunit.client.0.smithi037.stdout:6/16: symlink l2 0 2024-04-25T17:18:43.288 INFO:tasks.workunit.client.0.smithi037.stdout:5/12: creat f2 x:0 0 0 2024-04-25T17:18:43.290 INFO:tasks.workunit.client.0.smithi037.stdout:3/5: getdents . 0 2024-04-25T17:18:43.291 INFO:tasks.workunit.client.0.smithi037.stdout:3/6: chown c0 1555785 1 2024-04-25T17:18:43.291 INFO:tasks.workunit.client.0.smithi037.stdout:3/7: fsync f3 0 2024-04-25T17:18:43.291 INFO:tasks.workunit.client.0.smithi037.stdout:3/8: stat c0 0 2024-04-25T17:18:43.292 INFO:tasks.workunit.client.0.smithi037.stdout:1/11: creat f2 x:0 0 0 2024-04-25T17:18:43.294 INFO:tasks.workunit.client.0.smithi037.stdout:4/15: creat f4 x:0 0 0 2024-04-25T17:18:43.294 INFO:tasks.workunit.client.0.smithi037.stdout:4/16: stat f1 0 2024-04-25T17:18:43.295 INFO:tasks.workunit.client.0.smithi037.stdout:4/17: truncate f1 542542 0 2024-04-25T17:18:43.296 INFO:tasks.workunit.client.0.smithi037.stdout:4/18: write f2 [1408972,68066] 0 2024-04-25T17:18:43.298 INFO:tasks.workunit.client.0.smithi037.stdout:5/13: creat f3 x:0 0 0 2024-04-25T17:18:43.303 INFO:tasks.workunit.client.0.smithi037.stdout:3/9: mknod c4 0 2024-04-25T17:18:43.304 INFO:tasks.workunit.client.0.smithi037.stdout:1/12: mknod c3 0 2024-04-25T17:18:43.305 INFO:tasks.workunit.client.0.smithi037.stdout:3/10: fdatasync f3 0 2024-04-25T17:18:43.307 INFO:tasks.workunit.client.0.smithi037.stdout:1/13: chown c3 226216 1 2024-04-25T17:18:43.307 INFO:tasks.workunit.client.0.smithi037.stdout:9/4: mknod c0 0 2024-04-25T17:18:43.309 INFO:tasks.workunit.client.0.smithi037.stdout:4/19: dwrite f3 [0,4194304] 0 2024-04-25T17:18:43.310 INFO:tasks.workunit.client.0.smithi037.stdout:9/5: chown c0 24391042 1 2024-04-25T17:18:43.311 INFO:tasks.workunit.client.0.smithi037.stdout:9/6: chown c0 50699 1 2024-04-25T17:18:43.312 INFO:tasks.workunit.client.0.smithi037.stdout:9/7: truncate - no filename 2024-04-25T17:18:43.312 INFO:tasks.workunit.client.0.smithi037.stdout:5/14: dwrite f2 [0,4194304] 0 2024-04-25T17:18:43.313 INFO:tasks.workunit.client.0.smithi037.stdout:3/11: creat f5 x:0 0 0 2024-04-25T17:18:43.316 INFO:tasks.workunit.client.0.smithi037.stdout:5/15: read f0 [822391,13452] 0 2024-04-25T17:18:43.317 INFO:tasks.workunit.client.0.smithi037.stdout:1/14: symlink l4 0 2024-04-25T17:18:43.321 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:43 smithi037 ceph-mon[26472]: pgmap v22: 65 pgs: 65 active+clean; 171 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 4.5 MiB/s wr, 498 op/s 2024-04-25T17:18:43.322 INFO:tasks.workunit.client.0.smithi037.stdout:4/20: creat f5 x:0 0 0 2024-04-25T17:18:43.323 INFO:tasks.workunit.client.0.smithi037.stdout:9/8: mkdir d1 0 2024-04-25T17:18:43.326 INFO:tasks.workunit.client.0.smithi037.stdout:4/21: write f4 [191280,23800] 0 2024-04-25T17:18:43.327 INFO:tasks.workunit.client.0.smithi037.stdout:5/16: symlink l4 0 2024-04-25T17:18:43.330 INFO:tasks.workunit.client.0.smithi037.stdout:3/12: dwrite f3 [0,4194304] 0 2024-04-25T17:18:43.330 INFO:tasks.workunit.client.0.smithi037.stdout:5/17: read - f3 zero size 2024-04-25T17:18:43.334 INFO:tasks.workunit.client.0.smithi037.stdout:1/15: dwrite f2 [0,4194304] 0 2024-04-25T17:18:43.338 INFO:tasks.workunit.client.0.smithi037.stdout:5/18: mknod c5 0 2024-04-25T17:18:43.342 INFO:tasks.workunit.client.0.smithi037.stdout:3/13: rename c2 to c6 0 2024-04-25T17:18:43.343 INFO:tasks.workunit.client.0.smithi037.stdout:9/9: creat d1/f2 x:0 0 0 2024-04-25T17:18:43.344 INFO:tasks.workunit.client.0.smithi037.stdout:3/14: write f5 [398900,22836] 0 2024-04-25T17:18:43.344 INFO:tasks.workunit.client.0.smithi037.stdout:1/16: dwrite f2 [0,4194304] 0 2024-04-25T17:18:43.346 INFO:tasks.workunit.client.0.smithi037.stdout:1/17: write f1 [865009,26835] 0 2024-04-25T17:18:43.355 INFO:tasks.workunit.client.0.smithi037.stdout:5/19: rename f2 to f6 0 2024-04-25T17:18:43.355 INFO:tasks.workunit.client.0.smithi037.stdout:9/10: dwrite d1/f2 [0,4194304] 0 2024-04-25T17:18:43.356 INFO:tasks.workunit.client.0.smithi037.stdout:5/20: readlink l4 0 2024-04-25T17:18:43.357 INFO:tasks.workunit.client.0.smithi037.stdout:5/21: write f3 [389940,114619] 0 2024-04-25T17:18:43.364 INFO:tasks.workunit.client.0.smithi037.stdout:1/18: fsync f1 0 2024-04-25T17:18:43.368 INFO:tasks.workunit.client.0.smithi037.stdout:1/19: dread f2 [0,4194304] 0 2024-04-25T17:18:43.368 INFO:tasks.workunit.client.0.smithi037.stdout:3/15: link f3 f7 0 2024-04-25T17:18:43.368 INFO:tasks.workunit.client.0.smithi037.stdout:1/20: chown f1 136422 1 2024-04-25T17:18:43.374 INFO:tasks.workunit.client.0.smithi037.stdout:3/16: unlink f3 0 2024-04-25T17:18:43.375 INFO:tasks.workunit.client.0.smithi037.stdout:6/17: dwrite f1 [4194304,4194304] 0 2024-04-25T17:18:43.378 INFO:tasks.workunit.client.0.smithi037.stdout:3/17: mkdir d8 0 2024-04-25T17:18:43.378 INFO:tasks.workunit.client.0.smithi037.stdout:3/18: readlink l1 0 2024-04-25T17:18:43.380 INFO:tasks.workunit.client.0.smithi037.stdout:1/21: rename f2 to f5 0 2024-04-25T17:18:43.383 INFO:tasks.workunit.client.0.smithi037.stdout:1/22: mknod c6 0 2024-04-25T17:18:43.386 INFO:tasks.workunit.client.0.smithi037.stdout:3/19: creat d8/f9 x:0 0 0 2024-04-25T17:18:43.387 INFO:tasks.workunit.client.0.smithi037.stdout:1/23: dread f5 [0,4194304] 0 2024-04-25T17:18:43.391 INFO:tasks.workunit.client.0.smithi037.stdout:1/24: write f5 [3164958,11089] 0 2024-04-25T17:18:43.393 INFO:tasks.workunit.client.0.smithi037.stdout:1/25: creat f7 x:0 0 0 2024-04-25T17:18:43.397 INFO:tasks.workunit.client.0.smithi037.stdout:1/26: dread f5 [0,4194304] 0 2024-04-25T17:18:43.397 INFO:tasks.workunit.client.0.smithi037.stdout:1/27: read f1 [2141049,55137] 0 2024-04-25T17:18:43.399 INFO:tasks.workunit.client.0.smithi037.stdout:4/22: getdents . 0 2024-04-25T17:18:43.401 INFO:tasks.workunit.client.0.smithi037.stdout:1/28: creat f8 x:0 0 0 2024-04-25T17:18:43.404 INFO:tasks.workunit.client.0.smithi037.stdout:1/29: write f5 [3884384,97458] 0 2024-04-25T17:18:43.404 INFO:tasks.workunit.client.0.smithi037.stdout:1/30: rmdir - no directory 2024-04-25T17:18:43.404 INFO:tasks.workunit.client.0.smithi037.stdout:4/23: getdents . 0 2024-04-25T17:18:43.405 INFO:tasks.workunit.client.0.smithi037.stdout:5/22: truncate f0 106483 0 2024-04-25T17:18:43.412 INFO:tasks.workunit.client.0.smithi037.stdout:4/24: dwrite f1 [0,4194304] 0 2024-04-25T17:18:43.417 INFO:tasks.workunit.client.0.smithi037.stdout:5/23: getdents . 0 2024-04-25T17:18:43.420 INFO:tasks.workunit.client.0.smithi037.stdout:4/25: dwrite f1 [0,4194304] 0 2024-04-25T17:18:43.421 INFO:tasks.workunit.client.0.smithi037.stdout:4/26: dread - f5 zero size 2024-04-25T17:18:43.421 INFO:tasks.workunit.client.0.smithi037.stdout:5/24: dread f1 [0,4194304] 0 2024-04-25T17:18:43.422 INFO:tasks.workunit.client.0.smithi037.stdout:5/25: fdatasync f6 0 2024-04-25T17:18:43.426 INFO:tasks.workunit.client.0.smithi037.stdout:9/11: truncate d1/f2 393930 0 2024-04-25T17:18:43.430 INFO:tasks.workunit.client.0.smithi037.stdout:5/26: dwrite f6 [4194304,4194304] 0 2024-04-25T17:18:43.431 INFO:tasks.workunit.client.0.smithi037.stdout:5/27: write f6 [1350268,56105] 0 2024-04-25T17:18:43.432 INFO:tasks.workunit.client.0.smithi037.stdout:5/28: read f6 [6647156,61214] 0 2024-04-25T17:18:43.434 INFO:tasks.workunit.client.0.smithi037.stdout:6/18: truncate f1 7724874 0 2024-04-25T17:18:43.434 INFO:tasks.workunit.client.0.smithi037.stdout:6/19: readlink l2 0 2024-04-25T17:18:43.435 INFO:tasks.workunit.client.0.smithi037.stdout:9/12: symlink d1/l3 0 2024-04-25T17:18:43.437 INFO:tasks.workunit.client.0.smithi037.stdout:3/20: getdents d8 0 2024-04-25T17:18:43.447 INFO:tasks.workunit.client.0.smithi037.stdout:5/29: mkdir d7 0 2024-04-25T17:18:43.450 INFO:tasks.workunit.client.0.smithi037.stdout:6/20: creat f3 x:0 0 0 2024-04-25T17:18:43.450 INFO:tasks.workunit.client.0.smithi037.stdout:6/21: stat f1 0 2024-04-25T17:18:43.452 INFO:tasks.workunit.client.0.smithi037.stdout:6/22: write f3 [449246,77061] 0 2024-04-25T17:18:43.452 INFO:tasks.workunit.client.0.smithi037.stdout:9/13: creat d1/f4 x:0 0 0 2024-04-25T17:18:43.452 INFO:tasks.workunit.client.0.smithi037.stdout:6/23: stat f3 0 2024-04-25T17:18:43.460 INFO:tasks.workunit.client.0.smithi037.stdout:3/21: creat d8/fa x:0 0 0 2024-04-25T17:18:43.464 INFO:tasks.workunit.client.0.smithi037.stdout:4/27: truncate f3 1929052 0 2024-04-25T17:18:43.466 INFO:tasks.workunit.client.0.smithi037.stdout:5/30: link c5 d7/c8 0 2024-04-25T17:18:43.467 INFO:tasks.workunit.client.0.smithi037.stdout:9/14: dwrite d1/f2 [0,4194304] 0 2024-04-25T17:18:43.470 INFO:tasks.workunit.client.0.smithi037.stdout:6/24: dread f1 [0,4194304] 0 2024-04-25T17:18:43.471 INFO:tasks.workunit.client.0.smithi037.stdout:4/28: unlink f2 0 2024-04-25T17:18:43.473 INFO:tasks.workunit.client.0.smithi037.stdout:5/31: dread f6 [0,4194304] 0 2024-04-25T17:18:43.475 INFO:tasks.workunit.client.0.smithi037.stdout:6/25: dread f3 [0,4194304] 0 2024-04-25T17:18:43.476 INFO:tasks.workunit.client.0.smithi037.stdout:6/26: stat f3 0 2024-04-25T17:18:43.478 INFO:tasks.workunit.client.0.smithi037.stdout:9/15: mkdir d1/d5 0 2024-04-25T17:18:43.482 INFO:tasks.workunit.client.0.smithi037.stdout:4/29: rename f4 to f6 0 2024-04-25T17:18:43.484 INFO:tasks.workunit.client.0.smithi037.stdout:6/27: fsync f3 0 2024-04-25T17:18:43.485 INFO:tasks.workunit.client.0.smithi037.stdout:6/28: chown l2 0 1 2024-04-25T17:18:43.488 INFO:tasks.workunit.client.0.smithi037.stdout:9/16: fdatasync d1/f2 0 2024-04-25T17:18:43.489 INFO:tasks.workunit.client.0.smithi037.stdout:9/17: dread - d1/f4 zero size 2024-04-25T17:18:43.490 INFO:tasks.workunit.client.0.smithi037.stdout:5/32: dwrite f1 [0,4194304] 0 2024-04-25T17:18:43.490 INFO:tasks.workunit.client.0.smithi037.stdout:9/18: readlink d1/l3 0 2024-04-25T17:18:43.499 INFO:tasks.workunit.client.0.smithi037.stdout:4/30: mkdir d7 0 2024-04-25T17:18:43.500 INFO:tasks.workunit.client.0.smithi037.stdout:9/19: dwrite d1/f4 [0,4194304] 0 2024-04-25T17:18:43.512 INFO:tasks.workunit.client.0.smithi037.stdout:3/22: write f7 [4325193,116769] 0 2024-04-25T17:18:43.513 INFO:tasks.workunit.client.0.smithi037.stdout:6/29: dwrite f1 [0,4194304] 0 2024-04-25T17:18:43.515 INFO:tasks.workunit.client.0.smithi037.stdout:6/30: chown f3 393 1 2024-04-25T17:18:43.517 INFO:tasks.workunit.client.0.smithi037.stdout:6/31: write f1 [5012147,17962] 0 2024-04-25T17:18:43.522 INFO:tasks.workunit.client.0.smithi037.stdout:4/31: mknod d7/c8 0 2024-04-25T17:18:43.523 INFO:tasks.workunit.client.0.smithi037.stdout:5/33: dwrite f6 [4194304,4194304] 0 2024-04-25T17:18:43.523 INFO:tasks.workunit.client.0.smithi037.stdout:4/32: stat d7/c8 0 2024-04-25T17:18:43.526 INFO:tasks.workunit.client.0.smithi037.stdout:9/20: mknod d1/d5/c6 0 2024-04-25T17:18:43.527 INFO:tasks.workunit.client.0.smithi037.stdout:9/21: write d1/f4 [2477823,69519] 0 2024-04-25T17:18:43.528 INFO:tasks.workunit.client.0.smithi037.stdout:6/32: mknod c4 0 2024-04-25T17:18:43.534 INFO:tasks.workunit.client.0.smithi037.stdout:3/23: unlink f7 0 2024-04-25T17:18:43.537 INFO:tasks.workunit.client.0.smithi037.stdout:6/33: dwrite f3 [0,4194304] 0 2024-04-25T17:18:43.537 INFO:tasks.workunit.client.0.smithi037.stdout:6/34: rmdir - no directory 2024-04-25T17:18:43.540 INFO:tasks.workunit.client.0.smithi037.stdout:5/34: dread f0 [0,4194304] 0 2024-04-25T17:18:43.540 INFO:tasks.workunit.client.0.smithi037.stdout:4/33: creat d7/f9 x:0 0 0 2024-04-25T17:18:43.541 INFO:tasks.workunit.client.0.smithi037.stdout:4/34: write f5 [426540,117540] 0 2024-04-25T17:18:43.543 INFO:tasks.workunit.client.0.smithi037.stdout:9/22: mknod d1/c7 0 2024-04-25T17:18:43.547 INFO:tasks.workunit.client.0.smithi037.stdout:9/23: dread d1/f2 [0,4194304] 0 2024-04-25T17:18:43.550 INFO:tasks.workunit.client.0.smithi037.stdout:9/24: chown d1/c7 27032700 1 2024-04-25T17:18:43.550 INFO:tasks.workunit.client.0.smithi037.stdout:9/25: read d1/f4 [502841,39598] 0 2024-04-25T17:18:43.550 INFO:tasks.workunit.client.0.smithi037.stdout:3/24: symlink d8/lb 0 2024-04-25T17:18:43.552 INFO:tasks.workunit.client.0.smithi037.stdout:6/35: creat f5 x:0 0 0 2024-04-25T17:18:43.558 INFO:tasks.workunit.client.0.smithi037.stdout:6/36: dwrite f1 [4194304,4194304] 0 2024-04-25T17:18:43.559 INFO:tasks.workunit.client.0.smithi037.stdout:6/37: truncate f5 153644 0 2024-04-25T17:18:43.559 INFO:tasks.workunit.client.0.smithi037.stdout:6/38: stat c4 0 2024-04-25T17:18:43.560 INFO:tasks.workunit.client.0.smithi037.stdout:6/39: chown l2 2032117775 1 2024-04-25T17:18:43.573 INFO:tasks.workunit.client.0.smithi037.stdout:9/26: mknod d1/c8 0 2024-04-25T17:18:43.573 INFO:tasks.workunit.client.0.smithi037.stdout:3/25: symlink d8/lc 0 2024-04-25T17:18:43.574 INFO:tasks.workunit.client.0.smithi037.stdout:9/27: readlink d1/l3 0 2024-04-25T17:18:43.574 INFO:tasks.workunit.client.0.smithi037.stdout:5/35: creat d7/f9 x:0 0 0 2024-04-25T17:18:43.576 INFO:tasks.workunit.client.0.smithi037.stdout:6/40: mknod c6 0 2024-04-25T17:18:43.576 INFO:tasks.workunit.client.0.smithi037.stdout:6/41: fsync f3 0 2024-04-25T17:18:43.579 INFO:tasks.workunit.client.0.smithi037.stdout:3/26: dwrite d8/fa [0,4194304] 0 2024-04-25T17:18:43.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:43 smithi069 ceph-mon[34527]: pgmap v22: 65 pgs: 65 active+clean; 171 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 4.5 MiB/s wr, 498 op/s 2024-04-25T17:18:43.994 INFO:tasks.workunit.client.0.smithi037.stdout:4/35: link f1 d7/fa 0 2024-04-25T17:18:43.998 INFO:tasks.workunit.client.0.smithi037.stdout:6/42: creat f7 x:0 0 0 2024-04-25T17:18:43.999 INFO:tasks.workunit.client.0.smithi037.stdout:6/43: truncate f5 904674 0 2024-04-25T17:18:44.000 INFO:tasks.workunit.client.0.smithi037.stdout:6/44: fdatasync f3 0 2024-04-25T17:18:44.002 INFO:tasks.workunit.client.0.smithi037.stdout:9/28: dwrite d1/f4 [0,4194304] 0 2024-04-25T17:18:44.002 INFO:tasks.workunit.client.0.smithi037.stdout:6/45: fdatasync f5 0 2024-04-25T17:18:44.002 INFO:tasks.workunit.client.0.smithi037.stdout:4/36: creat d7/fb x:0 0 0 2024-04-25T17:18:44.005 INFO:tasks.workunit.client.0.smithi037.stdout:5/36: rename d7/c8 to d7/ca 0 2024-04-25T17:18:44.007 INFO:tasks.workunit.client.0.smithi037.stdout:4/37: creat d7/fc x:0 0 0 2024-04-25T17:18:44.009 INFO:tasks.workunit.client.0.smithi037.stdout:6/46: symlink l8 0 2024-04-25T17:18:44.010 INFO:tasks.workunit.client.0.smithi037.stdout:5/37: dread f6 [0,4194304] 0 2024-04-25T17:18:44.012 INFO:tasks.workunit.client.0.smithi037.stdout:5/38: write f3 [723302,88929] 0 2024-04-25T17:18:44.013 INFO:tasks.workunit.client.0.smithi037.stdout:5/39: write f6 [1265409,82180] 0 2024-04-25T17:18:44.014 INFO:tasks.workunit.client.0.smithi037.stdout:6/47: dread f1 [0,4194304] 0 2024-04-25T17:18:44.015 INFO:tasks.workunit.client.0.smithi037.stdout:4/38: rename d7/fc to d7/fd 0 2024-04-25T17:18:44.015 INFO:tasks.workunit.client.0.smithi037.stdout:4/39: fdatasync d7/f9 0 2024-04-25T17:18:44.018 INFO:tasks.workunit.client.0.smithi037.stdout:9/29: fsync d1/f4 0 2024-04-25T17:18:44.021 INFO:tasks.workunit.client.0.smithi037.stdout:5/40: fdatasync f0 0 2024-04-25T17:18:44.026 INFO:tasks.workunit.client.0.smithi037.stdout:4/40: rename f6 to d7/fe 0 2024-04-25T17:18:44.027 INFO:tasks.workunit.client.0.smithi037.stdout:9/30: dwrite d1/f2 [4194304,4194304] 0 2024-04-25T17:18:44.030 INFO:tasks.workunit.client.0.smithi037.stdout:5/41: creat d7/fb x:0 0 0 2024-04-25T17:18:44.031 INFO:tasks.workunit.client.0.smithi037.stdout:5/42: chown f6 3605 1 2024-04-25T17:18:44.033 INFO:tasks.workunit.client.0.smithi037.stdout:5/43: chown f1 6129282 1 2024-04-25T17:18:44.035 INFO:tasks.workunit.client.0.smithi037.stdout:5/44: write f3 [1821120,114296] 0 2024-04-25T17:18:44.036 INFO:tasks.workunit.client.0.smithi037.stdout:5/45: stat f6 0 2024-04-25T17:18:44.037 INFO:tasks.workunit.client.0.smithi037.stdout:4/41: creat d7/ff x:0 0 0 2024-04-25T17:18:44.038 INFO:tasks.workunit.client.0.smithi037.stdout:9/31: dwrite d1/f2 [4194304,4194304] 0 2024-04-25T17:18:44.039 INFO:tasks.workunit.client.0.smithi037.stdout:4/42: read d7/fa [1992787,10269] 0 2024-04-25T17:18:44.047 INFO:tasks.workunit.client.0.smithi037.stdout:9/32: creat d1/f9 x:0 0 0 2024-04-25T17:18:44.048 INFO:tasks.workunit.client.0.smithi037.stdout:9/33: write d1/f4 [4624351,129305] 0 2024-04-25T17:18:44.049 INFO:tasks.workunit.client.0.smithi037.stdout:5/46: dread f3 [0,4194304] 0 2024-04-25T17:18:44.049 INFO:tasks.workunit.client.0.smithi037.stdout:5/47: fsync f1 0 2024-04-25T17:18:44.050 INFO:tasks.workunit.client.0.smithi037.stdout:9/34: truncate d1/f9 583873 0 2024-04-25T17:18:44.050 INFO:tasks.workunit.client.0.smithi037.stdout:5/48: dread - d7/f9 zero size 2024-04-25T17:18:44.050 INFO:tasks.workunit.client.0.smithi037.stdout:9/35: stat d1/f2 0 2024-04-25T17:18:44.051 INFO:tasks.workunit.client.0.smithi037.stdout:9/36: write d1/f9 [664531,65069] 0 2024-04-25T17:18:44.055 INFO:tasks.workunit.client.0.smithi037.stdout:5/49: dread f1 [0,4194304] 0 2024-04-25T17:18:44.058 INFO:tasks.workunit.client.0.smithi037.stdout:9/37: creat d1/d5/fa x:0 0 0 2024-04-25T17:18:44.061 INFO:tasks.workunit.client.0.smithi037.stdout:5/50: creat d7/fc x:0 0 0 2024-04-25T17:18:44.061 INFO:tasks.workunit.client.0.smithi037.stdout:5/51: truncate f1 4391532 0 2024-04-25T17:18:44.062 INFO:tasks.workunit.client.0.smithi037.stdout:9/38: creat d1/fb x:0 0 0 2024-04-25T17:18:44.064 INFO:tasks.workunit.client.0.smithi037.stdout:5/52: creat d7/fd x:0 0 0 2024-04-25T17:18:44.066 INFO:tasks.workunit.client.0.smithi037.stdout:9/39: mkdir d1/d5/dc 0 2024-04-25T17:18:44.067 INFO:tasks.workunit.client.0.smithi037.stdout:5/53: creat d7/fe x:0 0 0 2024-04-25T17:18:44.069 INFO:tasks.workunit.client.0.smithi037.stdout:9/40: creat d1/fd x:0 0 0 2024-04-25T17:18:44.074 INFO:tasks.workunit.client.0.smithi037.stdout:9/41: creat d1/d5/dc/fe x:0 0 0 2024-04-25T17:18:44.237 INFO:tasks.workunit.client.0.smithi037.stdout:6/48: getdents . 0 2024-04-25T17:18:44.240 INFO:tasks.workunit.client.0.smithi037.stdout:6/49: rename f7 to f9 0 2024-04-25T17:18:44.249 INFO:tasks.workunit.client.0.smithi037.stdout:4/43: getdents d7 0 2024-04-25T17:18:44.251 INFO:tasks.workunit.client.0.smithi037.stdout:4/44: creat d7/f10 x:0 0 0 2024-04-25T17:18:44.255 INFO:tasks.workunit.client.0.smithi037.stdout:4/45: rename f5 to d7/f11 0 2024-04-25T17:18:44.257 INFO:tasks.workunit.client.0.smithi037.stdout:4/46: creat d7/f12 x:0 0 0 2024-04-25T17:18:44.258 INFO:tasks.workunit.client.0.smithi037.stdout:4/47: read - d7/f12 zero size 2024-04-25T17:18:44.258 INFO:tasks.workunit.client.0.smithi037.stdout:4/48: chown f1 3219506 1 2024-04-25T17:18:44.259 INFO:tasks.workunit.client.0.smithi037.stdout:4/49: read - d7/f9 zero size 2024-04-25T17:18:44.265 INFO:tasks.workunit.client.0.smithi037.stdout:5/54: truncate f3 807354 0 2024-04-25T17:18:44.266 INFO:tasks.workunit.client.0.smithi037.stdout:9/42: rmdir d1 39 2024-04-25T17:18:44.270 INFO:tasks.workunit.client.0.smithi037.stdout:5/55: link f1 d7/ff 0 2024-04-25T17:18:44.272 INFO:tasks.workunit.client.0.smithi037.stdout:9/43: creat d1/ff x:0 0 0 2024-04-25T17:18:44.274 INFO:tasks.workunit.client.0.smithi037.stdout:5/56: stat c5 0 2024-04-25T17:18:44.274 INFO:tasks.workunit.client.0.smithi037.stdout:5/57: chown d7 873094 1 2024-04-25T17:18:44.277 INFO:tasks.workunit.client.0.smithi037.stdout:9/44: rename d1/fb to d1/d5/dc/f10 0 2024-04-25T17:18:44.280 INFO:tasks.workunit.client.0.smithi037.stdout:5/58: rename c5 to d7/c10 0 2024-04-25T17:18:44.288 INFO:tasks.workunit.client.0.smithi037.stdout:9/45: getdents d1/d5 0 2024-04-25T17:18:44.290 INFO:tasks.workunit.client.0.smithi037.stdout:9/46: creat d1/d5/dc/f11 x:0 0 0 2024-04-25T17:18:44.352 INFO:tasks.workunit.client.0.smithi037.stdout:9/47: rename d1/d5/fa to d1/d5/f12 0 2024-04-25T17:18:44.353 INFO:tasks.workunit.client.0.smithi037.stdout:9/48: fdatasync d1/f4 0 2024-04-25T17:18:44.355 INFO:tasks.workunit.client.0.smithi037.stdout:9/49: creat d1/f13 x:0 0 0 2024-04-25T17:18:44.375 INFO:tasks.workunit.client.0.smithi037.stdout:9/50: creat d1/d5/dc/f14 x:0 0 0 2024-04-25T17:18:44.381 INFO:tasks.workunit.client.0.smithi037.stdout:9/51: dwrite d1/f13 [0,4194304] 0 2024-04-25T17:18:44.395 INFO:tasks.workunit.client.0.smithi037.stdout:6/50: getdents . 0 2024-04-25T17:18:44.398 INFO:tasks.workunit.client.0.smithi037.stdout:6/51: creat fa x:0 0 0 2024-04-25T17:18:44.402 INFO:tasks.workunit.client.0.smithi037.stdout:4/50: rmdir d7 39 2024-04-25T17:18:44.406 INFO:tasks.workunit.client.0.smithi037.stdout:6/52: dwrite f5 [0,4194304] 0 2024-04-25T17:18:44.410 INFO:tasks.workunit.client.0.smithi037.stdout:4/51: creat d7/f13 x:0 0 0 2024-04-25T17:18:44.410 INFO:tasks.workunit.client.0.smithi037.stdout:6/53: mkdir db 0 2024-04-25T17:18:44.413 INFO:tasks.workunit.client.0.smithi037.stdout:4/52: symlink d7/l14 0 2024-04-25T17:18:44.419 INFO:tasks.workunit.client.0.smithi037.stdout:6/54: dwrite f5 [0,4194304] 0 2024-04-25T17:18:44.419 INFO:tasks.workunit.client.0.smithi037.stdout:4/53: mknod d7/c15 0 2024-04-25T17:18:44.422 INFO:tasks.workunit.client.0.smithi037.stdout:4/54: fdatasync d7/fa 0 2024-04-25T17:18:44.423 INFO:tasks.workunit.client.0.smithi037.stdout:4/55: write d7/f10 [332404,81090] 0 2024-04-25T17:18:44.424 INFO:tasks.workunit.client.0.smithi037.stdout:5/59: truncate f6 5681741 0 2024-04-25T17:18:44.426 INFO:tasks.workunit.client.0.smithi037.stdout:6/55: creat db/fc x:0 0 0 2024-04-25T17:18:44.427 INFO:tasks.workunit.client.0.smithi037.stdout:6/56: read f1 [1568796,9496] 0 2024-04-25T17:18:44.431 INFO:tasks.workunit.client.0.smithi037.stdout:5/60: creat d7/f11 x:0 0 0 2024-04-25T17:18:44.438 INFO:tasks.workunit.client.0.smithi037.stdout:5/61: mkdir d7/d12 0 2024-04-25T17:18:44.441 INFO:tasks.workunit.client.0.smithi037.stdout:5/62: creat d7/d12/f13 x:0 0 0 2024-04-25T17:18:44.442 INFO:tasks.workunit.client.0.smithi037.stdout:9/52: dwrite d1/f13 [4194304,4194304] 0 2024-04-25T17:18:44.449 INFO:tasks.workunit.client.0.smithi037.stdout:9/53: mkdir d1/d5/dc/d15 0 2024-04-25T17:18:44.449 INFO:tasks.workunit.client.0.smithi037.stdout:9/54: readlink d1/l3 0 2024-04-25T17:18:44.450 INFO:tasks.workunit.client.0.smithi037.stdout:9/55: write d1/f9 [288485,63574] 0 2024-04-25T17:18:44.451 INFO:tasks.workunit.client.0.smithi037.stdout:5/63: rename d7/c10 to d7/c14 0 2024-04-25T17:18:44.451 INFO:tasks.workunit.client.0.smithi037.stdout:9/56: stat d1/ff 0 2024-04-25T17:18:44.454 INFO:tasks.workunit.client.0.smithi037.stdout:5/64: mkdir d7/d12/d15 0 2024-04-25T17:18:44.460 INFO:tasks.workunit.client.0.smithi037.stdout:9/57: link d1/d5/dc/fe d1/f16 0 2024-04-25T17:18:44.461 INFO:tasks.workunit.client.0.smithi037.stdout:9/58: read - d1/d5/dc/f14 zero size 2024-04-25T17:18:44.462 INFO:tasks.workunit.client.0.smithi037.stdout:9/59: chown d1/d5/dc/f14 313265 1 2024-04-25T17:18:44.466 INFO:tasks.workunit.client.0.smithi037.stdout:9/60: write d1/d5/f12 [844100,123443] 0 2024-04-25T17:18:44.470 INFO:tasks.workunit.client.0.smithi037.stdout:6/57: write f1 [6127160,114079] 0 2024-04-25T17:18:44.472 INFO:tasks.workunit.client.0.smithi037.stdout:4/56: dwrite f1 [0,4194304] 0 2024-04-25T17:18:44.475 INFO:tasks.workunit.client.0.smithi037.stdout:6/58: write f9 [31577,71808] 0 2024-04-25T17:18:44.475 INFO:tasks.workunit.client.0.smithi037.stdout:9/61: dwrite d1/f13 [8388608,4194304] 0 2024-04-25T17:18:44.477 INFO:tasks.workunit.client.0.smithi037.stdout:9/62: dread - d1/d5/dc/f14 zero size 2024-04-25T17:18:44.479 INFO:tasks.workunit.client.0.smithi037.stdout:4/57: dread f3 [0,4194304] 0 2024-04-25T17:18:44.479 INFO:tasks.workunit.client.0.smithi037.stdout:6/59: rename db/fc to db/fd 0 2024-04-25T17:18:44.480 INFO:tasks.workunit.client.0.smithi037.stdout:6/60: readlink l8 0 2024-04-25T17:18:44.483 INFO:tasks.workunit.client.0.smithi037.stdout:4/58: dread f1 [0,4194304] 0 2024-04-25T17:18:44.484 INFO:tasks.workunit.client.0.smithi037.stdout:9/63: dread d1/d5/f12 [0,4194304] 0 2024-04-25T17:18:44.486 INFO:tasks.workunit.client.0.smithi037.stdout:9/64: dread - d1/fd zero size 2024-04-25T17:18:44.491 INFO:tasks.workunit.client.0.smithi037.stdout:6/61: mknod db/ce 0 2024-04-25T17:18:44.492 INFO:tasks.workunit.client.0.smithi037.stdout:4/59: dwrite d7/f9 [0,4194304] 0 2024-04-25T17:18:44.494 INFO:tasks.workunit.client.0.smithi037.stdout:5/65: chown d7/c14 2832 1 2024-04-25T17:18:44.496 INFO:tasks.workunit.client.0.smithi037.stdout:9/65: rmdir d1 39 2024-04-25T17:18:44.502 INFO:tasks.workunit.client.0.smithi037.stdout:6/62: creat db/ff x:0 0 0 2024-04-25T17:18:44.503 INFO:tasks.workunit.client.0.smithi037.stdout:4/60: symlink d7/l16 0 2024-04-25T17:18:44.503 INFO:tasks.workunit.client.0.smithi037.stdout:4/61: chown d7/c15 28834730 1 2024-04-25T17:18:44.504 INFO:tasks.workunit.client.0.smithi037.stdout:4/62: fsync d7/ff 0 2024-04-25T17:18:44.504 INFO:tasks.workunit.client.0.smithi037.stdout:5/66: rename d7/fd to d7/d12/d15/f16 0 2024-04-25T17:18:44.509 INFO:tasks.workunit.client.0.smithi037.stdout:4/63: creat d7/f17 x:0 0 0 2024-04-25T17:18:44.510 INFO:tasks.workunit.client.0.smithi037.stdout:4/64: write d7/f17 [402016,67302] 0 2024-04-25T17:18:44.511 INFO:tasks.workunit.client.0.smithi037.stdout:5/67: creat d7/f17 x:0 0 0 2024-04-25T17:18:44.511 INFO:tasks.workunit.client.0.smithi037.stdout:4/65: truncate f1 4306221 0 2024-04-25T17:18:44.512 INFO:tasks.workunit.client.0.smithi037.stdout:9/66: mknod d1/c17 0 2024-04-25T17:18:44.515 INFO:tasks.workunit.client.0.smithi037.stdout:4/66: dread d7/f11 [0,4194304] 0 2024-04-25T17:18:44.515 INFO:tasks.workunit.client.0.smithi037.stdout:9/67: symlink d1/d5/l18 0 2024-04-25T17:18:44.518 INFO:tasks.workunit.client.0.smithi037.stdout:4/67: mkdir d7/d18 0 2024-04-25T17:18:44.523 INFO:tasks.workunit.client.0.smithi037.stdout:4/68: creat d7/f19 x:0 0 0 2024-04-25T17:18:44.523 INFO:tasks.workunit.client.0.smithi037.stdout:5/68: dwrite d7/f9 [0,4194304] 0 2024-04-25T17:18:44.527 INFO:tasks.workunit.client.0.smithi037.stdout:4/69: write d7/ff [702969,110990] 0 2024-04-25T17:18:44.530 INFO:tasks.workunit.client.0.smithi037.stdout:5/69: mkdir d7/d18 0 2024-04-25T17:18:44.530 INFO:tasks.workunit.client.0.smithi037.stdout:9/68: dwrite d1/d5/dc/f14 [0,4194304] 0 2024-04-25T17:18:44.532 INFO:tasks.workunit.client.0.smithi037.stdout:5/70: write d7/fc [162429,23227] 0 2024-04-25T17:18:44.535 INFO:tasks.workunit.client.0.smithi037.stdout:4/70: creat d7/f1a x:0 0 0 2024-04-25T17:18:44.538 INFO:tasks.workunit.client.0.smithi037.stdout:5/71: creat d7/d12/f19 x:0 0 0 2024-04-25T17:18:44.542 INFO:tasks.workunit.client.0.smithi037.stdout:9/69: dwrite d1/f9 [0,4194304] 0 2024-04-25T17:18:44.543 INFO:tasks.workunit.client.0.smithi037.stdout:5/72: fdatasync d7/ff 0 2024-04-25T17:18:44.544 INFO:tasks.workunit.client.0.smithi037.stdout:5/73: rename d7 to d7/d18/d1a 22 2024-04-25T17:18:44.546 INFO:tasks.workunit.client.0.smithi037.stdout:5/74: truncate d7/d12/f19 292586 0 2024-04-25T17:18:44.547 INFO:tasks.workunit.client.0.smithi037.stdout:4/71: creat d7/d18/f1b x:0 0 0 2024-04-25T17:18:44.550 INFO:tasks.workunit.client.0.smithi037.stdout:4/72: dread f1 [0,4194304] 0 2024-04-25T17:18:44.551 INFO:tasks.workunit.client.0.smithi037.stdout:4/73: write d7/fb [423527,17230] 0 2024-04-25T17:18:44.561 INFO:tasks.workunit.client.0.smithi037.stdout:9/70: dwrite d1/d5/f12 [0,4194304] 0 2024-04-25T17:18:44.563 INFO:tasks.workunit.client.0.smithi037.stdout:4/74: dwrite d7/f9 [0,4194304] 0 2024-04-25T17:18:44.563 INFO:tasks.workunit.client.0.smithi037.stdout:5/75: dread f6 [0,4194304] 0 2024-04-25T17:18:44.564 INFO:tasks.workunit.client.0.smithi037.stdout:9/71: stat d1/d5/dc/d15 0 2024-04-25T17:18:44.565 INFO:tasks.workunit.client.0.smithi037.stdout:9/72: fdatasync d1/d5/dc/f14 0 2024-04-25T17:18:44.569 INFO:tasks.workunit.client.0.smithi037.stdout:4/75: mknod d7/c1c 0 2024-04-25T17:18:44.570 INFO:tasks.workunit.client.0.smithi037.stdout:4/76: read f3 [1922041,67895] 0 2024-04-25T17:18:44.571 INFO:tasks.workunit.client.0.smithi037.stdout:4/77: chown d7/c15 906174836 1 2024-04-25T17:18:44.571 INFO:tasks.workunit.client.0.smithi037.stdout:4/78: read - d7/f13 zero size 2024-04-25T17:18:44.572 INFO:tasks.workunit.client.0.smithi037.stdout:5/76: creat d7/f1b x:0 0 0 2024-04-25T17:18:44.586 INFO:tasks.workunit.client.0.smithi037.stdout:9/73: mkdir d1/d5/d19 0 2024-04-25T17:18:44.586 INFO:tasks.workunit.client.0.smithi037.stdout:4/79: mknod d7/d18/c1d 0 2024-04-25T17:18:44.587 INFO:tasks.workunit.client.0.smithi037.stdout:4/80: dread - d7/f13 zero size 2024-04-25T17:18:44.592 INFO:tasks.workunit.client.0.smithi037.stdout:5/77: dwrite d7/d12/f13 [0,4194304] 0 2024-04-25T17:18:44.592 INFO:tasks.workunit.client.0.smithi037.stdout:5/78: chown f0 0 1 2024-04-25T17:18:44.921 INFO:tasks.workunit.client.0.smithi037.stdout:9/74: mkdir d1/d1a 0 2024-04-25T17:18:44.922 INFO:tasks.workunit.client.0.smithi037.stdout:9/75: stat d1/d5/l18 0 2024-04-25T17:18:44.922 INFO:tasks.workunit.client.0.smithi037.stdout:4/81: mkdir d7/d18/d1e 0 2024-04-25T17:18:44.923 INFO:tasks.workunit.client.0.smithi037.stdout:4/82: read - d7/f1a zero size 2024-04-25T17:18:44.926 INFO:tasks.workunit.client.0.smithi037.stdout:5/79: creat d7/f1c x:0 0 0 2024-04-25T17:18:44.931 INFO:tasks.workunit.client.0.smithi037.stdout:5/80: mknod d7/d12/c1d 0 2024-04-25T17:18:44.933 INFO:tasks.workunit.client.0.smithi037.stdout:9/76: creat d1/d5/d19/f1b x:0 0 0 2024-04-25T17:18:44.934 INFO:tasks.workunit.client.0.smithi037.stdout:9/77: chown d1/d5/dc/f11 5002962 1 2024-04-25T17:18:44.934 INFO:tasks.workunit.client.0.smithi037.stdout:4/83: symlink d7/d18/d1e/l1f 0 2024-04-25T17:18:44.935 INFO:tasks.workunit.client.0.smithi037.stdout:9/78: write d1/fd [564524,41234] 0 2024-04-25T17:18:44.936 INFO:tasks.workunit.client.0.smithi037.stdout:4/84: chown d7/fd 14140663 1 2024-04-25T17:18:44.936 INFO:tasks.workunit.client.0.smithi037.stdout:9/79: chown d1 511804781 1 2024-04-25T17:18:44.937 INFO:tasks.workunit.client.0.smithi037.stdout:4/85: write d7/f1a [687389,33133] 0 2024-04-25T17:18:44.937 INFO:tasks.workunit.client.0.smithi037.stdout:9/80: read - d1/d5/dc/f10 zero size 2024-04-25T17:18:44.938 INFO:tasks.workunit.client.0.smithi037.stdout:9/81: dread - d1/d5/dc/f11 zero size 2024-04-25T17:18:44.940 INFO:tasks.workunit.client.0.smithi037.stdout:4/86: write f1 [2421677,100023] 0 2024-04-25T17:18:44.945 INFO:tasks.workunit.client.0.smithi037.stdout:4/87: symlink d7/d18/l20 0 2024-04-25T17:18:44.946 INFO:tasks.workunit.client.0.smithi037.stdout:9/82: mkdir d1/d1a/d1c 0 2024-04-25T17:18:44.949 INFO:tasks.workunit.client.0.smithi037.stdout:4/88: dread d7/fa [0,4194304] 0 2024-04-25T17:18:44.950 INFO:tasks.workunit.client.0.smithi037.stdout:4/89: readlink d7/l14 0 2024-04-25T17:18:44.953 INFO:tasks.workunit.client.0.smithi037.stdout:4/90: symlink d7/d18/d1e/l21 0 2024-04-25T17:18:44.956 INFO:tasks.workunit.client.0.smithi037.stdout:9/83: truncate d1/d5/dc/f14 3180109 0 2024-04-25T17:18:44.958 INFO:tasks.workunit.client.0.smithi037.stdout:4/91: symlink d7/d18/l22 0 2024-04-25T17:18:44.962 INFO:tasks.workunit.client.0.smithi037.stdout:9/84: creat d1/d1a/d1c/f1d x:0 0 0 2024-04-25T17:18:44.966 INFO:tasks.workunit.client.0.smithi037.stdout:4/92: dwrite d7/d18/f1b [0,4194304] 0 2024-04-25T17:18:44.967 INFO:tasks.workunit.client.0.smithi037.stdout:4/93: chown d7/fd 20115 1 2024-04-25T17:18:44.975 INFO:tasks.workunit.client.0.smithi037.stdout:9/85: dwrite d1/d5/dc/f11 [0,4194304] 0 2024-04-25T17:18:45.158 INFO:tasks.workunit.client.0.smithi037.stdout:5/81: dwrite f3 [0,4194304] 0 2024-04-25T17:18:45.161 INFO:tasks.workunit.client.0.smithi037.stdout:4/94: rmdir d7 39 2024-04-25T17:18:45.164 INFO:tasks.workunit.client.0.smithi037.stdout:4/95: chown d7/l16 42 1 2024-04-25T17:18:45.169 INFO:tasks.workunit.client.0.smithi037.stdout:4/96: unlink d7/f17 0 2024-04-25T17:18:45.171 INFO:tasks.workunit.client.0.smithi037.stdout:9/86: truncate d1/f13 3946324 0 2024-04-25T17:18:45.174 INFO:tasks.workunit.client.0.smithi037.stdout:4/97: dread d7/fa [0,4194304] 0 2024-04-25T17:18:45.174 INFO:tasks.workunit.client.0.smithi037.stdout:4/98: readlink d7/l16 0 2024-04-25T17:18:45.175 INFO:tasks.workunit.client.0.smithi037.stdout:5/82: getdents d7/d12 0 2024-04-25T17:18:45.176 INFO:tasks.workunit.client.0.smithi037.stdout:5/83: write d7/d12/f13 [223041,127576] 0 2024-04-25T17:18:45.177 INFO:tasks.workunit.client.0.smithi037.stdout:5/84: read d7/ff [952910,55013] 0 2024-04-25T17:18:45.184 INFO:tasks.workunit.client.0.smithi037.stdout:4/99: link d7/fe d7/f23 0 2024-04-25T17:18:45.184 INFO:tasks.workunit.client.0.smithi037.stdout:4/100: chown f1 255543058 1 2024-04-25T17:18:45.185 INFO:tasks.workunit.client.0.smithi037.stdout:5/85: creat d7/d18/f1e x:0 0 0 2024-04-25T17:18:45.185 INFO:tasks.workunit.client.0.smithi037.stdout:5/86: readlink l4 0 2024-04-25T17:18:45.185 INFO:tasks.workunit.client.0.smithi037.stdout:4/101: write d7/f10 [635158,127497] 0 2024-04-25T17:18:45.186 INFO:tasks.workunit.client.0.smithi037.stdout:4/102: truncate d7/f13 318035 0 2024-04-25T17:18:45.187 INFO:tasks.workunit.client.0.smithi037.stdout:4/103: fsync d7/f12 0 2024-04-25T17:18:45.190 INFO:tasks.workunit.client.0.smithi037.stdout:4/104: mknod d7/c24 0 2024-04-25T17:18:45.192 INFO:tasks.workunit.client.0.smithi037.stdout:4/105: write d7/f11 [95248,22586] 0 2024-04-25T17:18:45.196 INFO:tasks.workunit.client.0.smithi037.stdout:4/106: dread d7/f10 [0,4194304] 0 2024-04-25T17:18:45.198 INFO:tasks.workunit.client.0.smithi037.stdout:4/107: creat d7/d18/f25 x:0 0 0 2024-04-25T17:18:45.200 INFO:tasks.workunit.client.0.smithi037.stdout:4/108: creat d7/f26 x:0 0 0 2024-04-25T17:18:45.204 INFO:tasks.workunit.client.0.smithi037.stdout:4/109: rename d7/c1c to d7/c27 0 2024-04-25T17:18:45.211 INFO:tasks.workunit.client.0.smithi037.stdout:4/110: dwrite d7/fa [0,4194304] 0 2024-04-25T17:18:45.213 INFO:tasks.workunit.client.0.smithi037.stdout:4/111: mknod d7/c28 0 2024-04-25T17:18:45.215 INFO:tasks.workunit.client.0.smithi037.stdout:4/112: dread d7/f11 [0,4194304] 0 2024-04-25T17:18:45.242 INFO:tasks.workunit.client.0.smithi037.stdout:5/87: dwrite f6 [0,4194304] 0 2024-04-25T17:18:45.243 INFO:tasks.workunit.client.0.smithi037.stdout:4/113: rename d7/d18 to d7/d29 0 2024-04-25T17:18:45.248 INFO:tasks.workunit.client.0.smithi037.stdout:4/114: creat d7/f2a x:0 0 0 2024-04-25T17:18:45.252 INFO:tasks.workunit.client.0.smithi037.stdout:9/87: truncate d1/d5/dc/f14 2044541 0 2024-04-25T17:18:45.255 INFO:tasks.workunit.client.0.smithi037.stdout:4/115: dwrite d7/f13 [0,4194304] 0 2024-04-25T17:18:45.256 INFO:tasks.workunit.client.0.smithi037.stdout:5/88: getdents d7 0 2024-04-25T17:18:45.257 INFO:tasks.workunit.client.0.smithi037.stdout:5/89: readlink l4 0 2024-04-25T17:18:45.257 INFO:tasks.workunit.client.0.smithi037.stdout:5/90: read f6 [3138033,79996] 0 2024-04-25T17:18:45.259 INFO:tasks.workunit.client.0.smithi037.stdout:9/88: mknod d1/d5/dc/c1e 0 2024-04-25T17:18:45.263 INFO:tasks.workunit.client.0.smithi037.stdout:9/89: dread d1/d5/dc/f11 [0,4194304] 0 2024-04-25T17:18:45.265 INFO:tasks.workunit.client.0.smithi037.stdout:5/91: creat d7/f1f x:0 0 0 2024-04-25T17:18:45.273 INFO:tasks.workunit.client.0.smithi037.stdout:5/92: creat d7/d12/f20 x:0 0 0 2024-04-25T17:18:45.277 INFO:tasks.workunit.client.0.smithi037.stdout:5/93: dread d7/d12/f13 [0,4194304] 0 2024-04-25T17:18:45.278 INFO:tasks.workunit.client.0.smithi037.stdout:5/94: truncate d7/d18/f1e 741397 0 2024-04-25T17:18:45.279 INFO:tasks.workunit.client.0.smithi037.stdout:5/95: chown d7/f1c 4 1 2024-04-25T17:18:45.283 INFO:tasks.workunit.client.0.smithi037.stdout:9/90: dread d1/d5/dc/f14 [0,4194304] 0 2024-04-25T17:18:45.284 INFO:tasks.workunit.client.0.smithi037.stdout:9/91: dread - d1/d5/dc/f10 zero size 2024-04-25T17:18:45.284 INFO:tasks.workunit.client.0.smithi037.stdout:5/96: creat d7/d12/f21 x:0 0 0 2024-04-25T17:18:45.293 INFO:tasks.workunit.client.0.smithi037.stdout:5/97: link d7/f9 d7/d18/f22 0 2024-04-25T17:18:45.294 INFO:tasks.workunit.client.0.smithi037.stdout:4/116: dwrite f3 [0,4194304] 0 2024-04-25T17:18:45.298 INFO:tasks.workunit.client.0.smithi037.stdout:4/117: mkdir d7/d29/d1e/d2b 0 2024-04-25T17:18:45.301 INFO:tasks.workunit.client.0.smithi037.stdout:4/118: dread d7/fe [0,4194304] 0 2024-04-25T17:18:45.309 INFO:tasks.workunit.client.0.smithi037.stdout:9/92: write d1/f16 [917803,120298] 0 2024-04-25T17:18:45.310 INFO:tasks.workunit.client.0.smithi037.stdout:9/93: fsync d1/d5/d19/f1b 0 2024-04-25T17:18:45.311 INFO:tasks.workunit.client.0.smithi037.stdout:9/94: chown d1/fd 1948677398 1 2024-04-25T17:18:45.314 INFO:tasks.workunit.client.0.smithi037.stdout:9/95: unlink d1/l3 0 2024-04-25T17:18:45.315 INFO:tasks.workunit.client.0.smithi037.stdout:9/96: read - d1/d5/d19/f1b zero size 2024-04-25T17:18:45.316 INFO:tasks.workunit.client.0.smithi037.stdout:9/97: write d1/f9 [525363,113117] 0 2024-04-25T17:18:45.317 INFO:tasks.workunit.client.0.smithi037.stdout:5/98: write f1 [4219438,108999] 0 2024-04-25T17:18:45.323 INFO:tasks.workunit.client.0.smithi037.stdout:5/99: rename d7/d12/f13 to d7/d12/f23 0 2024-04-25T17:18:45.324 INFO:tasks.workunit.client.0.smithi037.stdout:9/98: rmdir d1/d5/dc/d15 0 2024-04-25T17:18:45.324 INFO:tasks.workunit.client.0.smithi037.stdout:9/99: chown d1/d5/dc 8149 1 2024-04-25T17:18:45.326 INFO:tasks.workunit.client.0.smithi037.stdout:9/100: write d1/ff [940671,67686] 0 2024-04-25T17:18:45.329 INFO:tasks.workunit.client.0.smithi037.stdout:5/100: creat d7/d12/f24 x:0 0 0 2024-04-25T17:18:45.330 INFO:tasks.workunit.client.0.smithi037.stdout:4/119: dwrite d7/f23 [0,4194304] 0 2024-04-25T17:18:45.330 INFO:tasks.workunit.client.0.smithi037.stdout:5/101: read - d7/fe zero size 2024-04-25T17:18:45.331 INFO:tasks.workunit.client.0.smithi037.stdout:4/120: truncate d7/f26 243105 0 2024-04-25T17:18:45.331 INFO:tasks.workunit.client.0.smithi037.stdout:5/102: write d7/d12/f21 [735457,15545] 0 2024-04-25T17:18:45.333 INFO:tasks.workunit.client.0.smithi037.stdout:9/101: fdatasync d1/f13 0 2024-04-25T17:18:45.335 INFO:tasks.workunit.client.0.smithi037.stdout:5/103: rmdir d7/d12/d15 39 2024-04-25T17:18:45.343 INFO:tasks.workunit.client.0.smithi037.stdout:9/102: dwrite d1/f2 [0,4194304] 0 2024-04-25T17:18:45.345 INFO:tasks.workunit.client.0.smithi037.stdout:5/104: dwrite d7/ff [4194304,4194304] 0 2024-04-25T17:18:45.346 INFO:tasks.workunit.client.0.smithi037.stdout:5/105: read - d7/f11 zero size 2024-04-25T17:18:45.350 INFO:tasks.workunit.client.0.smithi037.stdout:5/106: mkdir d7/d25 0 2024-04-25T17:18:45.357 INFO:tasks.workunit.client.0.smithi037.stdout:9/103: dwrite d1/d5/dc/f10 [0,4194304] 0 2024-04-25T17:18:45.358 INFO:tasks.workunit.client.0.smithi037.stdout:9/104: chown d1/fd 4009 1 2024-04-25T17:18:45.362 INFO:tasks.workunit.client.0.smithi037.stdout:9/105: mknod d1/c1f 0 2024-04-25T17:18:45.365 INFO:tasks.workunit.client.0.smithi037.stdout:9/106: mknod d1/d5/dc/c20 0 2024-04-25T17:18:45.366 INFO:tasks.workunit.client.0.smithi037.stdout:9/107: dread - d1/d1a/d1c/f1d zero size 2024-04-25T17:18:45.367 INFO:tasks.workunit.client.0.smithi037.stdout:5/107: dwrite d7/f9 [0,4194304] 0 2024-04-25T17:18:45.375 INFO:tasks.workunit.client.0.smithi037.stdout:9/108: dwrite d1/d1a/d1c/f1d [0,4194304] 0 2024-04-25T17:18:45.376 INFO:tasks.workunit.client.0.smithi037.stdout:5/108: dread d7/f9 [0,4194304] 0 2024-04-25T17:18:45.382 INFO:tasks.workunit.client.0.smithi037.stdout:9/109: rename d1/d1a to d1/d21 0 2024-04-25T17:18:45.383 INFO:tasks.workunit.client.0.smithi037.stdout:5/109: creat d7/d12/d15/f26 x:0 0 0 2024-04-25T17:18:45.386 INFO:tasks.workunit.client.0.smithi037.stdout:9/110: unlink d1/c7 0 2024-04-25T17:18:45.388 INFO:tasks.workunit.client.0.smithi037.stdout:9/111: dread d1/d5/dc/f14 [0,4194304] 0 2024-04-25T17:18:45.389 INFO:tasks.workunit.client.0.smithi037.stdout:5/110: symlink d7/d12/l27 0 2024-04-25T17:18:45.389 INFO:tasks.workunit.client.0.smithi037.stdout:5/111: stat d7/d18 0 2024-04-25T17:18:45.390 INFO:tasks.workunit.client.0.smithi037.stdout:5/112: fsync d7/d12/f20 0 2024-04-25T17:18:45.393 INFO:tasks.workunit.client.0.smithi037.stdout:9/112: dread d1/d5/dc/fe [0,4194304] 0 2024-04-25T17:18:45.394 INFO:tasks.workunit.client.0.smithi037.stdout:5/113: rename d7/c14 to d7/c28 0 2024-04-25T17:18:45.394 INFO:tasks.workunit.client.0.smithi037.stdout:9/113: write d1/f4 [3249539,85818] 0 2024-04-25T17:18:45.394 INFO:tasks.workunit.client.0.smithi037.stdout:5/114: stat f0 0 2024-04-25T17:18:45.396 INFO:tasks.workunit.client.0.smithi037.stdout:9/114: creat d1/d21/f22 x:0 0 0 2024-04-25T17:18:45.397 INFO:tasks.workunit.client.0.smithi037.stdout:5/115: creat d7/d18/f29 x:0 0 0 2024-04-25T17:18:45.397 INFO:tasks.workunit.client.0.smithi037.stdout:5/116: stat d7/f1c 0 2024-04-25T17:18:45.400 INFO:tasks.workunit.client.0.smithi037.stdout:5/117: write d7/f9 [2452162,123545] 0 2024-04-25T17:18:45.401 INFO:tasks.workunit.client.0.smithi037.stdout:5/118: dread - d7/d12/f20 zero size 2024-04-25T17:18:45.422 INFO:tasks.workunit.client.0.smithi037.stdout:9/115: dwrite d1/f13 [4194304,4194304] 0 2024-04-25T17:18:45.423 INFO:tasks.workunit.client.0.smithi037.stdout:5/119: dwrite f6 [4194304,4194304] 0 2024-04-25T17:18:45.424 INFO:tasks.workunit.client.0.smithi037.stdout:9/116: fsync d1/d21/f22 0 2024-04-25T17:18:45.425 INFO:tasks.workunit.client.0.smithi037.stdout:5/120: read d7/d18/f22 [476883,94546] 0 2024-04-25T17:18:45.429 INFO:tasks.workunit.client.0.smithi037.stdout:9/117: creat d1/d5/dc/f23 x:0 0 0 2024-04-25T17:18:45.438 INFO:tasks.workunit.client.0.smithi037.stdout:9/118: dwrite d1/ff [0,4194304] 0 2024-04-25T17:18:45.440 INFO:tasks.workunit.client.0.smithi037.stdout:9/119: symlink d1/l24 0 2024-04-25T17:18:45.466 INFO:tasks.workunit.client.0.smithi037.stdout:5/121: write d7/d12/f23 [2192063,120103] 0 2024-04-25T17:18:45.475 INFO:tasks.workunit.client.0.smithi037.stdout:9/120: dwrite d1/d5/dc/f14 [0,4194304] 0 2024-04-25T17:18:45.476 INFO:tasks.workunit.client.0.smithi037.stdout:9/121: truncate d1/f16 2073877 0 2024-04-25T17:18:45.478 INFO:tasks.workunit.client.0.smithi037.stdout:9/122: mkdir d1/d25 0 2024-04-25T17:18:45.480 INFO:tasks.workunit.client.0.smithi037.stdout:9/123: fdatasync d1/f16 0 2024-04-25T17:18:45.482 INFO:tasks.workunit.client.0.smithi037.stdout:9/124: mkdir d1/d21/d26 0 2024-04-25T17:18:45.486 INFO:tasks.workunit.client.0.smithi037.stdout:9/125: rename d1/d5/dc/f14 to d1/d5/dc/f27 0 2024-04-25T17:18:45.491 INFO:tasks.workunit.client.0.smithi037.stdout:9/126: creat d1/d5/f28 x:0 0 0 2024-04-25T17:18:45.491 INFO:tasks.workunit.client.0.smithi037.stdout:9/127: write d1/ff [1033470,112079] 0 2024-04-25T17:18:45.492 INFO:tasks.workunit.client.0.smithi037.stdout:9/128: chown d1/c8 7913 1 2024-04-25T17:18:45.495 INFO:tasks.workunit.client.0.smithi037.stdout:9/129: creat d1/d5/dc/f29 x:0 0 0 2024-04-25T17:18:45.498 INFO:tasks.workunit.client.0.smithi037.stdout:9/130: symlink d1/d5/l2a 0 2024-04-25T17:18:45.500 INFO:tasks.workunit.client.0.smithi037.stdout:9/131: fsync d1/d5/dc/f11 0 2024-04-25T17:18:45.505 INFO:tasks.workunit.client.0.smithi037.stdout:9/132: symlink d1/d21/l2b 0 2024-04-25T17:18:45.513 INFO:tasks.workunit.client.0.smithi037.stdout:9/133: dwrite d1/d5/f28 [0,4194304] 0 2024-04-25T17:18:45.514 INFO:tasks.workunit.client.0.smithi037.stdout:9/134: write d1/f9 [1595229,61555] 0 2024-04-25T17:18:45.521 INFO:tasks.workunit.client.0.smithi037.stdout:9/135: rmdir d1/d25 0 2024-04-25T17:18:45.522 INFO:tasks.workunit.client.0.smithi037.stdout:9/136: chown d1/d5/d19/f1b 1847329 1 2024-04-25T17:18:45.523 INFO:tasks.workunit.client.0.smithi037.stdout:9/137: stat d1/fd 0 2024-04-25T17:18:45.529 INFO:tasks.workunit.client.0.smithi037.stdout:9/138: dwrite d1/f9 [0,4194304] 0 2024-04-25T17:18:45.530 INFO:tasks.workunit.client.0.smithi037.stdout:9/139: write d1/d5/dc/f23 [545375,126362] 0 2024-04-25T17:18:45.533 INFO:tasks.workunit.client.0.smithi037.stdout:9/140: symlink d1/d5/d19/l2c 0 2024-04-25T17:18:45.535 INFO:tasks.workunit.client.0.smithi037.stdout:9/141: creat d1/d5/dc/f2d x:0 0 0 2024-04-25T17:18:45.542 INFO:tasks.workunit.client.0.smithi037.stdout:9/142: dwrite d1/d5/dc/fe [0,4194304] 0 2024-04-25T17:18:45.546 INFO:tasks.workunit.client.0.smithi037.stdout:9/143: mkdir d1/d5/d2e 0 2024-04-25T17:18:45.551 INFO:tasks.workunit.client.0.smithi037.stdout:9/144: dread d1/d5/f12 [0,4194304] 0 2024-04-25T17:18:45.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:45 smithi037 ceph-mon[26472]: pgmap v23: 65 pgs: 65 active+clean; 171 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.1 MiB/s wr, 335 op/s 2024-04-25T17:18:45.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:45 smithi069 ceph-mon[34527]: pgmap v23: 65 pgs: 65 active+clean; 171 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.1 MiB/s wr, 335 op/s 2024-04-25T17:18:47.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:47 smithi037 ceph-mon[26472]: pgmap v24: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.6 MiB/s rd, 18 MiB/s wr, 461 op/s 2024-04-25T17:18:47.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:47 smithi069 ceph-mon[34527]: pgmap v24: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.6 MiB/s rd, 18 MiB/s wr, 461 op/s 2024-04-25T17:18:49.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:49 smithi037 ceph-mon[26472]: pgmap v25: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 17 MiB/s wr, 300 op/s 2024-04-25T17:18:49.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:49 smithi037 ceph-mon[26472]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:18:49.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:49 smithi069 ceph-mon[34527]: pgmap v25: 65 pgs: 65 active+clean; 301 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 17 MiB/s wr, 300 op/s 2024-04-25T17:18:49.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:49 smithi069 ceph-mon[34527]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:18:50.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:50.810+0000 7fe9297f2700 1 -- 172.21.15.37:0/928416999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9240662c0 msgr2=0x7fe9240ff9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:18:50.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:50.810+0000 7fe9297f2700 1 --2- 172.21.15.37:0/928416999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9240662c0 0x7fe9240ff9a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe914004940 tx=0x7fe914009e30 comp rx=0 tx=0).stop 2024-04-25T17:18:50.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:50.810+0000 7fe9297f2700 1 -- 172.21.15.37:0/928416999 shutdown_connections 2024-04-25T17:18:50.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:50.810+0000 7fe9297f2700 1 --2- 172.21.15.37:0/928416999 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9240ffee0 0x7fe924102300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:50.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:50.810+0000 7fe9297f2700 1 --2- 172.21.15.37:0/928416999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9240662c0 0x7fe9240ff9a0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:50.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:50.810+0000 7fe9297f2700 1 -- 172.21.15.37:0/928416999 >> 172.21.15.37:0/928416999 conn(0x7fe9240f7430 msgr2=0x7fe9240f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:18:50.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:50.810+0000 7fe9297f2700 1 -- 172.21.15.37:0/928416999 shutdown_connections 2024-04-25T17:18:50.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:50.810+0000 7fe9297f2700 1 -- 172.21.15.37:0/928416999 wait complete. 2024-04-25T17:18:50.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:50.811+0000 7fe9297f2700 1 Processor -- start 2024-04-25T17:18:50.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:50.811+0000 7fe9297f2700 1 -- start start 2024-04-25T17:18:50.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:50.811+0000 7fe9297f2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9240662c0 0x7fe9240fd380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:18:50.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:50.811+0000 7fe9297f2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9240ffee0 0x7fe9240fb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:18:50.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:50.811+0000 7fe9297f2700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9240fbe30 con 0x7fe9240ffee0 2024-04-25T17:18:50.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:50.811+0000 7fe9297f2700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9240fbf70 con 0x7fe9240662c0 2024-04-25T17:18:50.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:50.811+0000 7fe9227fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9240ffee0 0x7fe9240fb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:18:50.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:50.811+0000 7fe9227fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9240ffee0 0x7fe9240fb8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37858/0 (socket says 172.21.15.37:37858) 2024-04-25T17:18:50.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:50.811+0000 7fe9227fc700 1 -- 172.21.15.37:0/3994948674 learned_addr learned my addr 172.21.15.37:0/3994948674 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:18:50.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:50.811+0000 7fe922ffd700 1 --2- 172.21.15.37:0/3994948674 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9240662c0 0x7fe9240fd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:18:50.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:50.811+0000 7fe9227fc700 1 -- 172.21.15.37:0/3994948674 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9240662c0 msgr2=0x7fe9240fd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:18:50.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:50.811+0000 7fe9227fc700 1 --2- 172.21.15.37:0/3994948674 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9240662c0 0x7fe9240fd380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:50.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:50.811+0000 7fe9227fc700 1 -- 172.21.15.37:0/3994948674 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe914005040 con 0x7fe9240ffee0 2024-04-25T17:18:50.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:50.811+0000 7fe9227fc700 1 --2- 172.21.15.37:0/3994948674 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9240ffee0 0x7fe9240fb8a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe91800eb70 tx=0x7fe91800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:18:50.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:50.812+0000 7fe90b7fe700 1 -- 172.21.15.37:0/3994948674 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe918007cc0 con 0x7fe9240ffee0 2024-04-25T17:18:50.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:50.812+0000 7fe90b7fe700 1 -- 172.21.15.37:0/3994948674 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe91800f040 con 0x7fe9240ffee0 2024-04-25T17:18:50.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:50.812+0000 7fe90b7fe700 1 -- 172.21.15.37:0/3994948674 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe91800ca90 con 0x7fe9240ffee0 2024-04-25T17:18:50.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:50.812+0000 7fe9297f2700 1 -- 172.21.15.37:0/3994948674 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9240fc1f0 con 0x7fe9240ffee0 2024-04-25T17:18:50.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:50.812+0000 7fe9297f2700 1 -- 172.21.15.37:0/3994948674 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9240fc6e0 con 0x7fe9240ffee0 2024-04-25T17:18:50.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:50.813+0000 7fe9297f2700 1 -- 172.21.15.37:0/3994948674 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe92405f5c0 con 0x7fe9240ffee0 2024-04-25T17:18:50.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:50.814+0000 7fe90b7fe700 1 -- 172.21.15.37:0/3994948674 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) v1 ==== 92608+0+0 (secure 0 0 0) 0x7fe91800cbf0 con 0x7fe9240ffee0 2024-04-25T17:18:50.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:50.814+0000 7fe90b7fe700 1 --2- 172.21.15.37:0/3994948674 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7fe90c06fcb0 0x7fe90c072160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:18:50.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:50.814+0000 7fe90b7fe700 1 -- 172.21.15.37:0/3994948674 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fe91808f340 con 0x7fe9240ffee0 2024-04-25T17:18:50.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:50.814+0000 7fe922ffd700 1 --2- 172.21.15.37:0/3994948674 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7fe90c06fcb0 0x7fe90c072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:18:50.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:50.815+0000 7fe922ffd700 1 --2- 172.21.15.37:0/3994948674 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7fe90c06fcb0 0x7fe90c072160 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe914013740 tx=0x7fe914009e30 comp rx=0 tx=0).ready entity=mgr.24417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:18:50.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:50.821+0000 7fe90b7fe700 1 -- 172.21.15.37:0/3994948674 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7fe918058600 con 0x7fe9240ffee0 2024-04-25T17:18:51.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.105+0000 7fe9297f2700 1 -- 172.21.15.37:0/3994948674 --> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe9240f8f20 con 0x7fe90c06fcb0 2024-04-25T17:18:51.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.106+0000 7fe90b7fe700 1 -- 172.21.15.37:0/3994948674 <== mgr.24417 v2:172.21.15.69:6828/2602478 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fe9240f8f20 con 0x7fe90c06fcb0 2024-04-25T17:18:51.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.109+0000 7fe9297f2700 1 -- 172.21.15.37:0/3994948674 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7fe90c06fcb0 msgr2=0x7fe90c072160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:18:51.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.109+0000 7fe9297f2700 1 --2- 172.21.15.37:0/3994948674 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7fe90c06fcb0 0x7fe90c072160 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe914013740 tx=0x7fe914009e30 comp rx=0 tx=0).stop 2024-04-25T17:18:51.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.109+0000 7fe9297f2700 1 -- 172.21.15.37:0/3994948674 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9240ffee0 msgr2=0x7fe9240fb8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:18:51.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.109+0000 7fe9297f2700 1 --2- 172.21.15.37:0/3994948674 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9240ffee0 0x7fe9240fb8a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe91800eb70 tx=0x7fe91800b040 comp rx=0 tx=0).stop 2024-04-25T17:18:51.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.109+0000 7fe9297f2700 1 -- 172.21.15.37:0/3994948674 shutdown_connections 2024-04-25T17:18:51.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.109+0000 7fe9297f2700 1 --2- 172.21.15.37:0/3994948674 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7fe90c06fcb0 0x7fe90c072160 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:51.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.109+0000 7fe9297f2700 1 --2- 172.21.15.37:0/3994948674 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9240662c0 0x7fe9240fd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:51.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.109+0000 7fe9297f2700 1 --2- 172.21.15.37:0/3994948674 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9240ffee0 0x7fe9240fb8a0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:51.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.109+0000 7fe9297f2700 1 -- 172.21.15.37:0/3994948674 >> 172.21.15.37:0/3994948674 conn(0x7fe9240f7430 msgr2=0x7fe9240f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:18:51.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.109+0000 7fe9297f2700 1 -- 172.21.15.37:0/3994948674 shutdown_connections 2024-04-25T17:18:51.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.109+0000 7fe9297f2700 1 -- 172.21.15.37:0/3994948674 wait complete. 2024-04-25T17:18:51.122 INFO:teuthology.orchestra.run.smithi037.stdout:true 2024-04-25T17:18:51.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.236+0000 7f45c8047700 1 -- 172.21.15.37:0/947278675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45c00ffee0 msgr2=0x7f45c0102300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:18:51.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.236+0000 7f45c8047700 1 --2- 172.21.15.37:0/947278675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45c00ffee0 0x7f45c0102300 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f45b0004940 tx=0x7f45b0009e30 comp rx=0 tx=0).stop 2024-04-25T17:18:51.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.236+0000 7f45c8047700 1 -- 172.21.15.37:0/947278675 shutdown_connections 2024-04-25T17:18:51.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.236+0000 7f45c8047700 1 --2- 172.21.15.37:0/947278675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45c00ffee0 0x7f45c0102300 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:51.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.236+0000 7f45c8047700 1 --2- 172.21.15.37:0/947278675 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45c00662c0 0x7f45c00ff9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:51.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.236+0000 7f45c8047700 1 -- 172.21.15.37:0/947278675 >> 172.21.15.37:0/947278675 conn(0x7f45c00f7430 msgr2=0x7f45c00f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:18:51.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.236+0000 7f45c8047700 1 -- 172.21.15.37:0/947278675 shutdown_connections 2024-04-25T17:18:51.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.236+0000 7f45c8047700 1 -- 172.21.15.37:0/947278675 wait complete. 2024-04-25T17:18:51.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.237+0000 7f45c8047700 1 Processor -- start 2024-04-25T17:18:51.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.237+0000 7f45c8047700 1 -- start start 2024-04-25T17:18:51.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.237+0000 7f45c8047700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45c00662c0 0x7f45c010d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:18:51.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.237+0000 7f45c8047700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45c00ffee0 0x7f45c010def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:18:51.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.237+0000 7f45c8047700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c010e4f0 con 0x7f45c00ffee0 2024-04-25T17:18:51.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.237+0000 7f45c8047700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45c010ed40 con 0x7f45c00662c0 2024-04-25T17:18:51.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.237+0000 7f45c55e2700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45c00ffee0 0x7f45c010def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:18:51.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.237+0000 7f45c5de3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45c00662c0 0x7f45c010d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:18:51.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.237+0000 7f45c5de3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45c00662c0 0x7f45c010d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.37:54526/0 (socket says 172.21.15.37:54526) 2024-04-25T17:18:51.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.237+0000 7f45c5de3700 1 -- 172.21.15.37:0/4124561302 learned_addr learned my addr 172.21.15.37:0/4124561302 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:18:51.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.237+0000 7f45c55e2700 1 -- 172.21.15.37:0/4124561302 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45c00662c0 msgr2=0x7f45c010d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:18:51.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.237+0000 7f45c55e2700 1 --2- 172.21.15.37:0/4124561302 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45c00662c0 0x7f45c010d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:51.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.237+0000 7f45c55e2700 1 -- 172.21.15.37:0/4124561302 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b0005040 con 0x7f45c00ffee0 2024-04-25T17:18:51.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.237+0000 7f45c5de3700 1 --2- 172.21.15.37:0/4124561302 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45c00662c0 0x7f45c010d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T17:18:51.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.238+0000 7f45c55e2700 1 --2- 172.21.15.37:0/4124561302 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45c00ffee0 0x7f45c010def0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f45b0009fd0 tx=0x7f45b0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:18:51.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.238+0000 7f45b67fc700 1 -- 172.21.15.37:0/4124561302 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45b000e030 con 0x7f45c00ffee0 2024-04-25T17:18:51.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.238+0000 7f45b67fc700 1 -- 172.21.15.37:0/4124561302 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f45b00093f0 con 0x7f45c00ffee0 2024-04-25T17:18:51.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.238+0000 7f45c8047700 1 -- 172.21.15.37:0/4124561302 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45c010efc0 con 0x7f45c00ffee0 2024-04-25T17:18:51.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.238+0000 7f45b67fc700 1 -- 172.21.15.37:0/4124561302 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45b001f070 con 0x7f45c00ffee0 2024-04-25T17:18:51.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.238+0000 7f45c8047700 1 -- 172.21.15.37:0/4124561302 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45c010f500 con 0x7f45c00ffee0 2024-04-25T17:18:51.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.239+0000 7f45c8047700 1 -- 172.21.15.37:0/4124561302 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45c005f5c0 con 0x7f45c00ffee0 2024-04-25T17:18:51.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.240+0000 7f45b67fc700 1 -- 172.21.15.37:0/4124561302 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) v1 ==== 92608+0+0 (secure 0 0 0) 0x7f45b0013d00 con 0x7f45c00ffee0 2024-04-25T17:18:51.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.240+0000 7f45b67fc700 1 --2- 172.21.15.37:0/4124561302 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f45ac06fcb0 0x7f45ac072160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:18:51.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.240+0000 7f45b67fc700 1 -- 172.21.15.37:0/4124561302 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f45b0094d70 con 0x7f45c00ffee0 2024-04-25T17:18:51.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.240+0000 7f45c5de3700 1 --2- 172.21.15.37:0/4124561302 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f45ac06fcb0 0x7f45ac072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:18:51.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.241+0000 7f45c5de3700 1 --2- 172.21.15.37:0/4124561302 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f45ac06fcb0 0x7f45ac072160 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f45bc009b80 tx=0x7f45bc00b040 comp rx=0 tx=0).ready entity=mgr.24417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:18:51.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.246+0000 7f45b67fc700 1 -- 172.21.15.37:0/4124561302 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f45b005e0b0 con 0x7f45c00ffee0 2024-04-25T17:18:51.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.530+0000 7f45c8047700 1 -- 172.21.15.37:0/4124561302 --> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f45c010f720 con 0x7f45ac06fcb0 2024-04-25T17:18:51.531 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:51 smithi037 ceph-mon[26472]: pgmap v26: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s rd, 18 MiB/s wr, 339 op/s 2024-04-25T17:18:51.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.532+0000 7f45b67fc700 1 -- 172.21.15.37:0/4124561302 <== mgr.24417 v2:172.21.15.69:6828/2602478 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f45c010f720 con 0x7f45ac06fcb0 2024-04-25T17:18:51.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.534+0000 7f45c8047700 1 -- 172.21.15.37:0/4124561302 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f45ac06fcb0 msgr2=0x7f45ac072160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:18:51.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.534+0000 7f45c8047700 1 --2- 172.21.15.37:0/4124561302 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f45ac06fcb0 0x7f45ac072160 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f45bc009b80 tx=0x7f45bc00b040 comp rx=0 tx=0).stop 2024-04-25T17:18:51.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.534+0000 7f45c8047700 1 -- 172.21.15.37:0/4124561302 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45c00ffee0 msgr2=0x7f45c010def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:18:51.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.534+0000 7f45c8047700 1 --2- 172.21.15.37:0/4124561302 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45c00ffee0 0x7f45c010def0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f45b0009fd0 tx=0x7f45b0009e30 comp rx=0 tx=0).stop 2024-04-25T17:18:51.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.534+0000 7f45c8047700 1 -- 172.21.15.37:0/4124561302 shutdown_connections 2024-04-25T17:18:51.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.534+0000 7f45c8047700 1 --2- 172.21.15.37:0/4124561302 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f45ac06fcb0 0x7f45ac072160 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:51.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.534+0000 7f45c8047700 1 --2- 172.21.15.37:0/4124561302 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45c00662c0 0x7f45c010d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:51.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.534+0000 7f45c8047700 1 --2- 172.21.15.37:0/4124561302 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45c00ffee0 0x7f45c010def0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:51.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.534+0000 7f45c8047700 1 -- 172.21.15.37:0/4124561302 >> 172.21.15.37:0/4124561302 conn(0x7f45c00f7430 msgr2=0x7f45c00f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:18:51.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.534+0000 7f45c8047700 1 -- 172.21.15.37:0/4124561302 shutdown_connections 2024-04-25T17:18:51.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.534+0000 7f45c8047700 1 -- 172.21.15.37:0/4124561302 wait complete. 2024-04-25T17:18:51.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.661+0000 7f34b10d3700 1 -- 172.21.15.37:0/1567788032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34ac0fbcb0 msgr2=0x7f34ac0fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:18:51.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.661+0000 7f34b10d3700 1 --2- 172.21.15.37:0/1567788032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34ac0fbcb0 0x7f34ac0fc0c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f349c004940 tx=0x7f349c009e30 comp rx=0 tx=0).stop 2024-04-25T17:18:51.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.662+0000 7f34b10d3700 1 -- 172.21.15.37:0/1567788032 shutdown_connections 2024-04-25T17:18:51.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.662+0000 7f34b10d3700 1 --2- 172.21.15.37:0/1567788032 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34ac0fcf60 0x7f34ac0fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:51.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.662+0000 7f34b10d3700 1 --2- 172.21.15.37:0/1567788032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34ac0fbcb0 0x7f34ac0fc0c0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:51.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.662+0000 7f34b10d3700 1 -- 172.21.15.37:0/1567788032 >> 172.21.15.37:0/1567788032 conn(0x7f34ac0f7430 msgr2=0x7f34ac0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:18:51.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.662+0000 7f34b10d3700 1 -- 172.21.15.37:0/1567788032 shutdown_connections 2024-04-25T17:18:51.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.662+0000 7f34b10d3700 1 -- 172.21.15.37:0/1567788032 wait complete. 2024-04-25T17:18:51.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.662+0000 7f34b10d3700 1 Processor -- start 2024-04-25T17:18:51.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.662+0000 7f34b10d3700 1 -- start start 2024-04-25T17:18:51.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.663+0000 7f34b10d3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34ac0fbcb0 0x7f34ac112b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:18:51.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.663+0000 7f34b10d3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34ac0fcf60 0x7f34ac115070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:18:51.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.663+0000 7f34b10d3700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac066220 con 0x7f34ac0fcf60 2024-04-25T17:18:51.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.663+0000 7f34b10d3700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac066360 con 0x7f34ac0fbcb0 2024-04-25T17:18:51.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.663+0000 7f34aa59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34ac0fcf60 0x7f34ac115070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:18:51.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.663+0000 7f34aa59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34ac0fcf60 0x7f34ac115070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37888/0 (socket says 172.21.15.37:37888) 2024-04-25T17:18:51.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.663+0000 7f34aa59c700 1 -- 172.21.15.37:0/3787387662 learned_addr learned my addr 172.21.15.37:0/3787387662 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:18:51.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.663+0000 7f34aad9d700 1 --2- 172.21.15.37:0/3787387662 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34ac0fbcb0 0x7f34ac112b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:18:51.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.663+0000 7f34aa59c700 1 -- 172.21.15.37:0/3787387662 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34ac0fbcb0 msgr2=0x7f34ac112b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:18:51.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.663+0000 7f34aa59c700 1 --2- 172.21.15.37:0/3787387662 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34ac0fbcb0 0x7f34ac112b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:51.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.663+0000 7f34aa59c700 1 -- 172.21.15.37:0/3787387662 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f349c005040 con 0x7f34ac0fcf60 2024-04-25T17:18:51.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.663+0000 7f34aa59c700 1 --2- 172.21.15.37:0/3787387662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34ac0fcf60 0x7f34ac115070 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f34a000c8c0 tx=0x7f34a00044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:18:51.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.663+0000 7f34937fe700 1 -- 172.21.15.37:0/3787387662 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34a000a980 con 0x7f34ac0fcf60 2024-04-25T17:18:51.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.664+0000 7f34937fe700 1 -- 172.21.15.37:0/3787387662 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f34a000ce60 con 0x7f34ac0fcf60 2024-04-25T17:18:51.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.664+0000 7f34b10d3700 1 -- 172.21.15.37:0/3787387662 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34ac1155b0 con 0x7f34ac0fcf60 2024-04-25T17:18:51.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.664+0000 7f34937fe700 1 -- 172.21.15.37:0/3787387662 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34a00115e0 con 0x7f34ac0fcf60 2024-04-25T17:18:51.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.664+0000 7f34b10d3700 1 -- 172.21.15.37:0/3787387662 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34ac115980 con 0x7f34ac0fcf60 2024-04-25T17:18:51.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.665+0000 7f34b10d3700 1 -- 172.21.15.37:0/3787387662 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34ac05f5c0 con 0x7f34ac0fcf60 2024-04-25T17:18:51.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.665+0000 7f34937fe700 1 -- 172.21.15.37:0/3787387662 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) v1 ==== 92608+0+0 (secure 0 0 0) 0x7f34a0012400 con 0x7f34ac0fcf60 2024-04-25T17:18:51.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.666+0000 7f34937fe700 1 --2- 172.21.15.37:0/3787387662 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f349406fcb0 0x7f3494072160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:18:51.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.666+0000 7f34937fe700 1 -- 172.21.15.37:0/3787387662 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f34a008f7b0 con 0x7f34ac0fcf60 2024-04-25T17:18:51.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.666+0000 7f34aad9d700 1 --2- 172.21.15.37:0/3787387662 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f349406fcb0 0x7f3494072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:18:51.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.667+0000 7f34aad9d700 1 --2- 172.21.15.37:0/3787387662 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f349406fcb0 0x7f3494072160 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f349c00b3b0 tx=0x7f349c009e30 comp rx=0 tx=0).ready entity=mgr.24417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:18:51.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:51 smithi069 ceph-mon[34527]: pgmap v26: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s rd, 18 MiB/s wr, 339 op/s 2024-04-25T17:18:51.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.671+0000 7f34937fe700 1 -- 172.21.15.37:0/3787387662 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f34a0058c00 con 0x7f34ac0fcf60 2024-04-25T17:18:51.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.929+0000 7f34b10d3700 1 -- 172.21.15.37:0/3787387662 --> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f34ac101320 con 0x7f349406fcb0 2024-04-25T17:18:51.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.942+0000 7f34937fe700 1 -- 172.21.15.37:0/3787387662 <== mgr.24417 v2:172.21.15.69:6828/2602478 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f34ac101320 con 0x7f349406fcb0 2024-04-25T17:18:51.942 INFO:teuthology.orchestra.run.smithi037.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-25T17:18:51.942 INFO:teuthology.orchestra.run.smithi037.stdout:alertmanager.smithi037 smithi037 *:9093,9094 starting - - - - 2024-04-25T17:18:51.943 INFO:teuthology.orchestra.run.smithi037.stdout:crash.smithi037 smithi037 running (8m) 33s ago 8m 6656k - 17.2.7-902-gc61472c8 0de407c1b3af b3d152574e80 2024-04-25T17:18:51.943 INFO:teuthology.orchestra.run.smithi037.stdout:crash.smithi069 smithi069 running (7m) 38s ago 7m 6660k - 17.2.7-902-gc61472c8 0de407c1b3af aa6086c64cc3 2024-04-25T17:18:51.943 INFO:teuthology.orchestra.run.smithi037.stdout:grafana.smithi037 smithi037 *:3000 starting - - - - 2024-04-25T17:18:51.943 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi037.ksmixc smithi037 running (3m) 33s ago 3m 86.1M - 17.2.7-902-gc61472c8 0de407c1b3af 394aa56079b4 2024-04-25T17:18:51.943 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi037.ovkrpq smithi037 running (3m) 33s ago 3m 52.7M - 17.2.7-902-gc61472c8 0de407c1b3af 73ca662174a7 2024-04-25T17:18:51.943 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi069.cpprst smithi069 running (2m) 38s ago 2m 13.4M - 17.2.7-902-gc61472c8 0de407c1b3af dbda101df20e 2024-04-25T17:18:51.943 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi069.ytlqcf smithi069 running (3m) 38s ago 3m 11.7M - 17.2.7-902-gc61472c8 0de407c1b3af 911df6b18215 2024-04-25T17:18:51.943 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.smithi037.txrgxl smithi037 *:9283 running (10m) 33s ago 10m 322M - 17.2.7-902-gc61472c8 0de407c1b3af 796b326569c2 2024-04-25T17:18:51.943 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.smithi069.mmuhdo smithi069 *:8443,9283 running (65s) 38s ago 7m 558M - 19.0.0-3291-g994e2f20 d53c96779a29 defb664cef69 2024-04-25T17:18:51.943 INFO:teuthology.orchestra.run.smithi037.stdout:mon.smithi037 smithi037 running (10m) 33s ago 10m 46.5M 2048M 17.2.7-902-gc61472c8 0de407c1b3af 5cfadcf8f2e4 2024-04-25T17:18:51.943 INFO:teuthology.orchestra.run.smithi037.stdout:mon.smithi069 smithi069 running (7m) 38s ago 7m 38.6M 2048M 17.2.7-902-gc61472c8 0de407c1b3af ffcd456d1dce 2024-04-25T17:18:51.943 INFO:teuthology.orchestra.run.smithi037.stdout:node-exporter.smithi037 smithi037 *:9100 starting - - - - 2024-04-25T17:18:51.943 INFO:teuthology.orchestra.run.smithi037.stdout:node-exporter.smithi069 smithi069 *:9100 running (7m) 38s ago 7m 16.9M - 1.5.0 0da6a335fe13 5d407954c21f 2024-04-25T17:18:51.943 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0 smithi037 running (6m) 33s ago 6m 80.2M 1559M 17.2.7-902-gc61472c8 0de407c1b3af 8ff4b0f1aae9 2024-04-25T17:18:51.943 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1 smithi037 running (6m) 33s ago 6m 81.3M 1559M 17.2.7-902-gc61472c8 0de407c1b3af 5715a5da241d 2024-04-25T17:18:51.944 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2 smithi037 running (5m) 33s ago 5m 72.4M 1559M 17.2.7-902-gc61472c8 0de407c1b3af 2eedaf9886dd 2024-04-25T17:18:51.944 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3 smithi069 running (5m) 38s ago 5m 79.0M 2581M 17.2.7-902-gc61472c8 0de407c1b3af ebba78fb1923 2024-04-25T17:18:51.944 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4 smithi069 running (5m) 38s ago 5m 80.0M 2581M 17.2.7-902-gc61472c8 0de407c1b3af ba7b785c50f9 2024-04-25T17:18:51.944 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5 smithi069 running (4m) 38s ago 4m 77.2M 2581M 17.2.7-902-gc61472c8 0de407c1b3af f6be99c364ff 2024-04-25T17:18:51.944 INFO:teuthology.orchestra.run.smithi037.stdout:prometheus.smithi037 smithi037 *:9095 running (6m) 33s ago 8m 59.2M - 2.43.0 a07b618ecd1d 13d3c6f36732 2024-04-25T17:18:51.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.944+0000 7f34b10d3700 1 -- 172.21.15.37:0/3787387662 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f349406fcb0 msgr2=0x7f3494072160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:18:51.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.944+0000 7f34b10d3700 1 --2- 172.21.15.37:0/3787387662 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f349406fcb0 0x7f3494072160 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f349c00b3b0 tx=0x7f349c009e30 comp rx=0 tx=0).stop 2024-04-25T17:18:51.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.944+0000 7f34b10d3700 1 -- 172.21.15.37:0/3787387662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34ac0fcf60 msgr2=0x7f34ac115070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:18:51.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.944+0000 7f34b10d3700 1 --2- 172.21.15.37:0/3787387662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34ac0fcf60 0x7f34ac115070 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f34a000c8c0 tx=0x7f34a00044c0 comp rx=0 tx=0).stop 2024-04-25T17:18:51.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.945+0000 7f34b10d3700 1 -- 172.21.15.37:0/3787387662 shutdown_connections 2024-04-25T17:18:51.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.945+0000 7f34b10d3700 1 --2- 172.21.15.37:0/3787387662 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f349406fcb0 0x7f3494072160 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:51.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.945+0000 7f34b10d3700 1 --2- 172.21.15.37:0/3787387662 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34ac0fbcb0 0x7f34ac112b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:51.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.945+0000 7f34b10d3700 1 --2- 172.21.15.37:0/3787387662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34ac0fcf60 0x7f34ac115070 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:51.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.945+0000 7f34b10d3700 1 -- 172.21.15.37:0/3787387662 >> 172.21.15.37:0/3787387662 conn(0x7f34ac0f7430 msgr2=0x7f34ac0f8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:18:51.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.945+0000 7f34b10d3700 1 -- 172.21.15.37:0/3787387662 shutdown_connections 2024-04-25T17:18:51.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:51.945+0000 7f34b10d3700 1 -- 172.21.15.37:0/3787387662 wait complete. 2024-04-25T17:18:52.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.085+0000 7f86e0494700 1 -- 172.21.15.37:0/1378377011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86d80fdfd0 msgr2=0x7f86d80fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:18:52.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.085+0000 7f86e0494700 1 --2- 172.21.15.37:0/1378377011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86d80fdfd0 0x7f86d80fe440 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f86c8004940 tx=0x7f86c8009e30 comp rx=0 tx=0).stop 2024-04-25T17:18:52.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.085+0000 7f86e0494700 1 -- 172.21.15.37:0/1378377011 shutdown_connections 2024-04-25T17:18:52.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.085+0000 7f86e0494700 1 --2- 172.21.15.37:0/1378377011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86d80fdfd0 0x7f86d80fe440 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:52.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.085+0000 7f86e0494700 1 --2- 172.21.15.37:0/1378377011 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86d80fce60 0x7f86d80fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:52.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.085+0000 7f86e0494700 1 -- 172.21.15.37:0/1378377011 >> 172.21.15.37:0/1378377011 conn(0x7f86d80f8540 msgr2=0x7f86d80fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:18:52.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.086+0000 7f86e0494700 1 -- 172.21.15.37:0/1378377011 shutdown_connections 2024-04-25T17:18:52.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.086+0000 7f86e0494700 1 -- 172.21.15.37:0/1378377011 wait complete. 2024-04-25T17:18:52.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.086+0000 7f86e0494700 1 Processor -- start 2024-04-25T17:18:52.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.086+0000 7f86e0494700 1 -- start start 2024-04-25T17:18:52.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.087+0000 7f86e0494700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86d80fce60 0x7f86d8071d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:18:52.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.087+0000 7f86e0494700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86d80fdfd0 0x7f86d80702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:18:52.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.087+0000 7f86e0494700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d8070840 con 0x7f86d80fdfd0 2024-04-25T17:18:52.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.087+0000 7f86e0494700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d8070980 con 0x7f86d80fce60 2024-04-25T17:18:52.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.087+0000 7f86dda2f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86d80fdfd0 0x7f86d80702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:18:52.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.087+0000 7f86dda2f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86d80fdfd0 0x7f86d80702b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37898/0 (socket says 172.21.15.37:37898) 2024-04-25T17:18:52.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.087+0000 7f86dda2f700 1 -- 172.21.15.37:0/2033299021 learned_addr learned my addr 172.21.15.37:0/2033299021 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:18:52.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.087+0000 7f86de230700 1 --2- 172.21.15.37:0/2033299021 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86d80fce60 0x7f86d8071d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:18:52.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.087+0000 7f86dda2f700 1 -- 172.21.15.37:0/2033299021 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86d80fce60 msgr2=0x7f86d8071d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:18:52.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.087+0000 7f86dda2f700 1 --2- 172.21.15.37:0/2033299021 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86d80fce60 0x7f86d8071d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:52.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.087+0000 7f86dda2f700 1 -- 172.21.15.37:0/2033299021 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c8005040 con 0x7f86d80fdfd0 2024-04-25T17:18:52.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.087+0000 7f86de230700 1 --2- 172.21.15.37:0/2033299021 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86d80fce60 0x7f86d8071d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T17:18:52.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.087+0000 7f86dda2f700 1 --2- 172.21.15.37:0/2033299021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86d80fdfd0 0x7f86d80702b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f86c800b0d0 tx=0x7f86c8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:18:52.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.088+0000 7f86ceffd700 1 -- 172.21.15.37:0/2033299021 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86c800e030 con 0x7f86d80fdfd0 2024-04-25T17:18:52.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.088+0000 7f86ceffd700 1 -- 172.21.15.37:0/2033299021 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f86c801c400 con 0x7f86d80fdfd0 2024-04-25T17:18:52.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.088+0000 7f86e0494700 1 -- 172.21.15.37:0/2033299021 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86d8070c00 con 0x7f86d80fdfd0 2024-04-25T17:18:52.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.088+0000 7f86ceffd700 1 -- 172.21.15.37:0/2033299021 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86c800b630 con 0x7f86d80fdfd0 2024-04-25T17:18:52.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.088+0000 7f86e0494700 1 -- 172.21.15.37:0/2033299021 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86d8071100 con 0x7f86d80fdfd0 2024-04-25T17:18:52.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.089+0000 7f86e0494700 1 -- 172.21.15.37:0/2033299021 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86d805f5c0 con 0x7f86d80fdfd0 2024-04-25T17:18:52.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.090+0000 7f86ceffd700 1 -- 172.21.15.37:0/2033299021 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) v1 ==== 92608+0+0 (secure 0 0 0) 0x7f86c801c570 con 0x7f86d80fdfd0 2024-04-25T17:18:52.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.090+0000 7f86ceffd700 1 --2- 172.21.15.37:0/2033299021 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f86c406fcb0 0x7f86c4072160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:18:52.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.090+0000 7f86ceffd700 1 -- 172.21.15.37:0/2033299021 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f86c8090f80 con 0x7f86d80fdfd0 2024-04-25T17:18:52.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.091+0000 7f86de230700 1 --2- 172.21.15.37:0/2033299021 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f86c406fcb0 0x7f86c4072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:18:52.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.091+0000 7f86de230700 1 --2- 172.21.15.37:0/2033299021 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f86c406fcb0 0x7f86c4072160 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f86d8071b20 tx=0x7f86d400b040 comp rx=0 tx=0).ready entity=mgr.24417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:18:52.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.095+0000 7f86ceffd700 1 -- 172.21.15.37:0/2033299021 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f86c805a480 con 0x7f86d80fdfd0 2024-04-25T17:18:52.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.526+0000 7f86e0494700 1 -- 172.21.15.37:0/2033299021 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f86d81058c0 con 0x7f86d80fdfd0 2024-04-25T17:18:52.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.527+0000 7f86ceffd700 1 -- 172.21.15.37:0/2033299021 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7f86c801c820 con 0x7f86d80fdfd0 2024-04-25T17:18:52.528 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-25T17:18:52.528 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": { 2024-04-25T17:18:52.528 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 2 2024-04-25T17:18:52.528 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:18:52.528 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": { 2024-04-25T17:18:52.528 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 1, 2024-04-25T17:18:52.528 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 1 2024-04-25T17:18:52.528 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:18:52.528 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": { 2024-04-25T17:18:52.529 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 6 2024-04-25T17:18:52.529 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:18:52.529 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": { 2024-04-25T17:18:52.529 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 4 2024-04-25T17:18:52.529 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:18:52.529 INFO:teuthology.orchestra.run.smithi037.stdout: "overall": { 2024-04-25T17:18:52.529 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 13, 2024-04-25T17:18:52.529 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 1 2024-04-25T17:18:52.529 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-04-25T17:18:52.529 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-25T17:18:52.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.530+0000 7f86e0494700 1 -- 172.21.15.37:0/2033299021 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f86c406fcb0 msgr2=0x7f86c4072160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:18:52.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.530+0000 7f86e0494700 1 --2- 172.21.15.37:0/2033299021 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f86c406fcb0 0x7f86c4072160 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f86d8071b20 tx=0x7f86d400b040 comp rx=0 tx=0).stop 2024-04-25T17:18:52.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.530+0000 7f86e0494700 1 -- 172.21.15.37:0/2033299021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86d80fdfd0 msgr2=0x7f86d80702b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:18:52.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.530+0000 7f86e0494700 1 --2- 172.21.15.37:0/2033299021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86d80fdfd0 0x7f86d80702b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f86c800b0d0 tx=0x7f86c8009e30 comp rx=0 tx=0).stop 2024-04-25T17:18:52.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.530+0000 7f86e0494700 1 -- 172.21.15.37:0/2033299021 shutdown_connections 2024-04-25T17:18:52.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.530+0000 7f86e0494700 1 --2- 172.21.15.37:0/2033299021 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f86c406fcb0 0x7f86c4072160 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:52.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.530+0000 7f86e0494700 1 --2- 172.21.15.37:0/2033299021 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f86d80fce60 0x7f86d8071d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:52.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.530+0000 7f86e0494700 1 --2- 172.21.15.37:0/2033299021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f86d80fdfd0 0x7f86d80702b0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:52.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.530+0000 7f86e0494700 1 -- 172.21.15.37:0/2033299021 >> 172.21.15.37:0/2033299021 conn(0x7f86d80f8540 msgr2=0x7f86d80f9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:18:52.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.530+0000 7f86e0494700 1 -- 172.21.15.37:0/2033299021 shutdown_connections 2024-04-25T17:18:52.531 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.530+0000 7f86e0494700 1 -- 172.21.15.37:0/2033299021 wait complete. 2024-04-25T17:18:52.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:52 smithi037 ceph-mon[26472]: from='client.14710 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:18:52.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.660+0000 7f130a923700 1 -- 172.21.15.37:0/3530111604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1304066260 msgr2=0x7f13040ffa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:18:52.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.660+0000 7f130a923700 1 --2- 172.21.15.37:0/3530111604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1304066260 0x7f13040ffa00 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f12f4004940 tx=0x7f12f4009e30 comp rx=0 tx=0).stop 2024-04-25T17:18:52.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.660+0000 7f130a923700 1 -- 172.21.15.37:0/3530111604 shutdown_connections 2024-04-25T17:18:52.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.660+0000 7f130a923700 1 --2- 172.21.15.37:0/3530111604 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f13040fff40 0x7f1304102320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:52.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.660+0000 7f130a923700 1 --2- 172.21.15.37:0/3530111604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1304066260 0x7f13040ffa00 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:52.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.660+0000 7f130a923700 1 -- 172.21.15.37:0/3530111604 >> 172.21.15.37:0/3530111604 conn(0x7f13040f7430 msgr2=0x7f13040f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:18:52.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.660+0000 7f130a923700 1 -- 172.21.15.37:0/3530111604 shutdown_connections 2024-04-25T17:18:52.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.660+0000 7f130a923700 1 -- 172.21.15.37:0/3530111604 wait complete. 2024-04-25T17:18:52.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.661+0000 7f130a923700 1 Processor -- start 2024-04-25T17:18:52.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.661+0000 7f130a923700 1 -- start start 2024-04-25T17:18:52.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.661+0000 7f130a923700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1304066260 0x7f13040fd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:18:52.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.661+0000 7f130a923700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13040fff40 0x7f13040fb900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:18:52.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.661+0000 7f130a923700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13040fbe90 con 0x7f13040fff40 2024-04-25T17:18:52.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.661+0000 7f130a923700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13040fbfd0 con 0x7f1304066260 2024-04-25T17:18:52.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.661+0000 7f13037fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13040fff40 0x7f13040fb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:18:52.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.661+0000 7f13037fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13040fff40 0x7f13040fb900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37910/0 (socket says 172.21.15.37:37910) 2024-04-25T17:18:52.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.661+0000 7f13037fe700 1 -- 172.21.15.37:0/1345429970 learned_addr learned my addr 172.21.15.37:0/1345429970 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:18:52.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.662+0000 7f1303fff700 1 --2- 172.21.15.37:0/1345429970 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1304066260 0x7f13040fd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:18:52.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.662+0000 7f13037fe700 1 -- 172.21.15.37:0/1345429970 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1304066260 msgr2=0x7f13040fd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:18:52.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.662+0000 7f13037fe700 1 --2- 172.21.15.37:0/1345429970 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1304066260 0x7f13040fd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:52.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.662+0000 7f13037fe700 1 -- 172.21.15.37:0/1345429970 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f4005040 con 0x7f13040fff40 2024-04-25T17:18:52.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.662+0000 7f13037fe700 1 --2- 172.21.15.37:0/1345429970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13040fff40 0x7f13040fb900 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f12f800eb70 tx=0x7f12f800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:18:52.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.662+0000 7f1300ff9700 1 -- 172.21.15.37:0/1345429970 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12f8007cc0 con 0x7f13040fff40 2024-04-25T17:18:52.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.663+0000 7f130a923700 1 -- 172.21.15.37:0/1345429970 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13040fc250 con 0x7f13040fff40 2024-04-25T17:18:52.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.663+0000 7f1300ff9700 1 -- 172.21.15.37:0/1345429970 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f12f800f040 con 0x7f13040fff40 2024-04-25T17:18:52.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.663+0000 7f130a923700 1 -- 172.21.15.37:0/1345429970 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1304115a50 con 0x7f13040fff40 2024-04-25T17:18:52.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.663+0000 7f1300ff9700 1 -- 172.21.15.37:0/1345429970 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f12f800ca90 con 0x7f13040fff40 2024-04-25T17:18:52.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.664+0000 7f130a923700 1 -- 172.21.15.37:0/1345429970 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12f00052e0 con 0x7f13040fff40 2024-04-25T17:18:52.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.664+0000 7f1300ff9700 1 -- 172.21.15.37:0/1345429970 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) v1 ==== 92608+0+0 (secure 0 0 0) 0x7f12f800cbf0 con 0x7f13040fff40 2024-04-25T17:18:52.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.665+0000 7f1300ff9700 1 --2- 172.21.15.37:0/1345429970 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f12ec06fcb0 0x7f12ec072160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:18:52.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.665+0000 7f1300ff9700 1 -- 172.21.15.37:0/1345429970 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f12f808f1c0 con 0x7f13040fff40 2024-04-25T17:18:52.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.665+0000 7f1303fff700 1 --2- 172.21.15.37:0/1345429970 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f12ec06fcb0 0x7f12ec072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:18:52.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.666+0000 7f1303fff700 1 --2- 172.21.15.37:0/1345429970 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f12ec06fcb0 0x7f12ec072160 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f12f4013740 tx=0x7f12f4009e30 comp rx=0 tx=0).ready entity=mgr.24417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:18:52.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:52 smithi069 ceph-mon[34527]: from='client.14710 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:18:52.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:52.670+0000 7f1300ff9700 1 -- 172.21.15.37:0/1345429970 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f12f8058500 con 0x7f13040fff40 2024-04-25T17:18:53.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.018+0000 7f130a923700 1 -- 172.21.15.37:0/1345429970 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f12f0005860 con 0x7f13040fff40 2024-04-25T17:18:53.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.019+0000 7f1300ff9700 1 -- 172.21.15.37:0/1345429970 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1830 (secure 0 0 0) 0x7f12f8057ea0 con 0x7f13040fff40 2024-04-25T17:18:53.019 INFO:teuthology.orchestra.run.smithi037.stdout:e16 2024-04-25T17:18:53.019 INFO:teuthology.orchestra.run.smithi037.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-25T17:18:53.019 INFO:teuthology.orchestra.run.smithi037.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T17:18:53.019 INFO:teuthology.orchestra.run.smithi037.stdout:legacy client fscid: 1 2024-04-25T17:18:53.019 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:18:53.020 INFO:teuthology.orchestra.run.smithi037.stdout:Filesystem 'cephfs' (1) 2024-04-25T17:18:53.020 INFO:teuthology.orchestra.run.smithi037.stdout:fs_name cephfs 2024-04-25T17:18:53.020 INFO:teuthology.orchestra.run.smithi037.stdout:epoch 16 2024-04-25T17:18:53.020 INFO:teuthology.orchestra.run.smithi037.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-25T17:18:53.020 INFO:teuthology.orchestra.run.smithi037.stdout:created 2024-04-25T17:15:40.586130+0000 2024-04-25T17:18:53.020 INFO:teuthology.orchestra.run.smithi037.stdout:modified 2024-04-25T17:15:57.508740+0000 2024-04-25T17:18:53.020 INFO:teuthology.orchestra.run.smithi037.stdout:tableserver 0 2024-04-25T17:18:53.020 INFO:teuthology.orchestra.run.smithi037.stdout:root 0 2024-04-25T17:18:53.020 INFO:teuthology.orchestra.run.smithi037.stdout:session_timeout 60 2024-04-25T17:18:53.020 INFO:teuthology.orchestra.run.smithi037.stdout:session_autoclose 300 2024-04-25T17:18:53.020 INFO:teuthology.orchestra.run.smithi037.stdout:max_file_size 1099511627776 2024-04-25T17:18:53.020 INFO:teuthology.orchestra.run.smithi037.stdout:required_client_features {} 2024-04-25T17:18:53.020 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure 0 2024-04-25T17:18:53.020 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure_osd_epoch 0 2024-04-25T17:18:53.021 INFO:teuthology.orchestra.run.smithi037.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T17:18:53.021 INFO:teuthology.orchestra.run.smithi037.stdout:max_mds 1 2024-04-25T17:18:53.021 INFO:teuthology.orchestra.run.smithi037.stdout:in 0 2024-04-25T17:18:53.021 INFO:teuthology.orchestra.run.smithi037.stdout:up {0=14470} 2024-04-25T17:18:53.021 INFO:teuthology.orchestra.run.smithi037.stdout:failed 2024-04-25T17:18:53.021 INFO:teuthology.orchestra.run.smithi037.stdout:damaged 2024-04-25T17:18:53.021 INFO:teuthology.orchestra.run.smithi037.stdout:stopped 2024-04-25T17:18:53.021 INFO:teuthology.orchestra.run.smithi037.stdout:data_pools [3] 2024-04-25T17:18:53.021 INFO:teuthology.orchestra.run.smithi037.stdout:metadata_pool 2 2024-04-25T17:18:53.021 INFO:teuthology.orchestra.run.smithi037.stdout:inline_data disabled 2024-04-25T17:18:53.021 INFO:teuthology.orchestra.run.smithi037.stdout:balancer 2024-04-25T17:18:53.021 INFO:teuthology.orchestra.run.smithi037.stdout:standby_count_wanted 1 2024-04-25T17:18:53.021 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi037.ksmixc{0:14470} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.37:6826/1903989494,v1:172.21.15.37:6827/1903989494] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:18:53.021 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi037.ovkrpq{0:14482} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.37:6828/4206394422,v1:172.21.15.37:6829/4206394422] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:18:53.021 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:18:53.022 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:18:53.022 INFO:teuthology.orchestra.run.smithi037.stdout:Standby daemons: 2024-04-25T17:18:53.022 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:18:53.022 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi069.cpprst{-1:24289} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.69:6826/518856100,v1:172.21.15.69:6827/518856100] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:18:53.022 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi069.ytlqcf{-1:24293} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.69:6824/134210439,v1:172.21.15.69:6825/134210439] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:18:53.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.022+0000 7f130a923700 1 -- 172.21.15.37:0/1345429970 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f12ec06fcb0 msgr2=0x7f12ec072160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:18:53.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.022+0000 7f130a923700 1 --2- 172.21.15.37:0/1345429970 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f12ec06fcb0 0x7f12ec072160 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f12f4013740 tx=0x7f12f4009e30 comp rx=0 tx=0).stop 2024-04-25T17:18:53.026 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.022+0000 7f130a923700 1 -- 172.21.15.37:0/1345429970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13040fff40 msgr2=0x7f13040fb900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:18:53.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.022+0000 7f130a923700 1 --2- 172.21.15.37:0/1345429970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13040fff40 0x7f13040fb900 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f12f800eb70 tx=0x7f12f800b040 comp rx=0 tx=0).stop 2024-04-25T17:18:53.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.022+0000 7f130a923700 1 -- 172.21.15.37:0/1345429970 shutdown_connections 2024-04-25T17:18:53.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.022+0000 7f130a923700 1 --2- 172.21.15.37:0/1345429970 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f12ec06fcb0 0x7f12ec072160 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:53.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.022+0000 7f130a923700 1 --2- 172.21.15.37:0/1345429970 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1304066260 0x7f13040fd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:53.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.022+0000 7f130a923700 1 --2- 172.21.15.37:0/1345429970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13040fff40 0x7f13040fb900 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:53.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.022+0000 7f130a923700 1 -- 172.21.15.37:0/1345429970 >> 172.21.15.37:0/1345429970 conn(0x7f13040f7430 msgr2=0x7f13040f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:18:53.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.022+0000 7f130a923700 1 -- 172.21.15.37:0/1345429970 shutdown_connections 2024-04-25T17:18:53.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.022+0000 7f130a923700 1 -- 172.21.15.37:0/1345429970 wait complete. 2024-04-25T17:18:53.027 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 16 2024-04-25T17:18:53.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.151+0000 7f7274c44700 1 -- 172.21.15.37:0/1213623236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72700fcf60 msgr2=0x7f72700fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:18:53.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.151+0000 7f7274c44700 1 --2- 172.21.15.37:0/1213623236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72700fcf60 0x7f72700fd3d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7264004940 tx=0x7f7264009e30 comp rx=0 tx=0).stop 2024-04-25T17:18:53.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.151+0000 7f7274c44700 1 -- 172.21.15.37:0/1213623236 shutdown_connections 2024-04-25T17:18:53.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.151+0000 7f7274c44700 1 --2- 172.21.15.37:0/1213623236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72700fcf60 0x7f72700fd3d0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:53.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.151+0000 7f7274c44700 1 --2- 172.21.15.37:0/1213623236 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f72700fbcb0 0x7f72700fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:53.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.151+0000 7f7274c44700 1 -- 172.21.15.37:0/1213623236 >> 172.21.15.37:0/1213623236 conn(0x7f72700f7430 msgr2=0x7f72700f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:18:53.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.151+0000 7f7274c44700 1 -- 172.21.15.37:0/1213623236 shutdown_connections 2024-04-25T17:18:53.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.151+0000 7f7274c44700 1 -- 172.21.15.37:0/1213623236 wait complete. 2024-04-25T17:18:53.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.152+0000 7f7274c44700 1 Processor -- start 2024-04-25T17:18:53.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.152+0000 7f7274c44700 1 -- start start 2024-04-25T17:18:53.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.152+0000 7f7274c44700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f72700fbcb0 0x7f7270066c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:18:53.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.152+0000 7f7274c44700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72700fcf60 0x7f7270114a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:18:53.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.152+0000 7f7274c44700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f727010e460 con 0x7f72700fcf60 2024-04-25T17:18:53.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.152+0000 7f7274c44700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7270114fc0 con 0x7f72700fbcb0 2024-04-25T17:18:53.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.152+0000 7f726dd9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72700fcf60 0x7f7270114a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:18:53.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.152+0000 7f726dd9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72700fcf60 0x7f7270114a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37928/0 (socket says 172.21.15.37:37928) 2024-04-25T17:18:53.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.152+0000 7f726dd9b700 1 -- 172.21.15.37:0/3516295316 learned_addr learned my addr 172.21.15.37:0/3516295316 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:18:53.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.152+0000 7f726e59c700 1 --2- 172.21.15.37:0/3516295316 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f72700fbcb0 0x7f7270066c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:18:53.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.153+0000 7f726dd9b700 1 -- 172.21.15.37:0/3516295316 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f72700fbcb0 msgr2=0x7f7270066c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:18:53.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.153+0000 7f726dd9b700 1 --2- 172.21.15.37:0/3516295316 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f72700fbcb0 0x7f7270066c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:53.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.153+0000 7f726dd9b700 1 -- 172.21.15.37:0/3516295316 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7264005040 con 0x7f72700fcf60 2024-04-25T17:18:53.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.153+0000 7f726dd9b700 1 --2- 172.21.15.37:0/3516295316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72700fcf60 0x7f7270114a80 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7264009180 tx=0x7f7264009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:18:53.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.153+0000 7f725effd700 1 -- 172.21.15.37:0/3516295316 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f726400e040 con 0x7f72700fcf60 2024-04-25T17:18:53.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.153+0000 7f725effd700 1 -- 172.21.15.37:0/3516295316 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f726400bcc0 con 0x7f72700fcf60 2024-04-25T17:18:53.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.153+0000 7f7274c44700 1 -- 172.21.15.37:0/3516295316 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7270115160 con 0x7f72700fcf60 2024-04-25T17:18:53.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.153+0000 7f725effd700 1 -- 172.21.15.37:0/3516295316 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f726401c630 con 0x7f72700fcf60 2024-04-25T17:18:53.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.153+0000 7f7274c44700 1 -- 172.21.15.37:0/3516295316 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72701156d0 con 0x7f72700fcf60 2024-04-25T17:18:53.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.154+0000 7f7274c44700 1 -- 172.21.15.37:0/3516295316 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f727004c710 con 0x7f72700fcf60 2024-04-25T17:18:53.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.155+0000 7f725effd700 1 -- 172.21.15.37:0/3516295316 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) v1 ==== 92608+0+0 (secure 0 0 0) 0x7f7264013420 con 0x7f72700fcf60 2024-04-25T17:18:53.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.156+0000 7f725effd700 1 --2- 172.21.15.37:0/3516295316 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f725806fcc0 0x7f7258072170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:18:53.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.156+0000 7f725effd700 1 -- 172.21.15.37:0/3516295316 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f72640903c0 con 0x7f72700fcf60 2024-04-25T17:18:53.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.156+0000 7f726e59c700 1 --2- 172.21.15.37:0/3516295316 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f725806fcc0 0x7f7258072170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:18:53.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.157+0000 7f726e59c700 1 --2- 172.21.15.37:0/3516295316 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f725806fcc0 0x7f7258072170 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7260009fd0 tx=0x7f726000b040 comp rx=0 tx=0).ready entity=mgr.24417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:18:53.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.162+0000 7f725effd700 1 -- 172.21.15.37:0/3516295316 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f7264059820 con 0x7f72700fcf60 2024-04-25T17:18:53.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.443+0000 7f7274c44700 1 -- 172.21.15.37:0/3516295316 --> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7270101230 con 0x7f725806fcc0 2024-04-25T17:18:53.445 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.445+0000 7f725effd700 1 -- 172.21.15.37:0/3516295316 <== mgr.24417 v2:172.21.15.69:6828/2602478 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f7270101230 con 0x7f725806fcc0 2024-04-25T17:18:53.445 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-25T17:18:53.445 INFO:teuthology.orchestra.run.smithi037.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385", 2024-04-25T17:18:53.445 INFO:teuthology.orchestra.run.smithi037.stdout: "in_progress": true, 2024-04-25T17:18:53.445 INFO:teuthology.orchestra.run.smithi037.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-25T17:18:53.445 INFO:teuthology.orchestra.run.smithi037.stdout: "services_complete": [], 2024-04-25T17:18:53.445 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": "1/21 daemons upgraded", 2024-04-25T17:18:53.445 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "", 2024-04-25T17:18:53.445 INFO:teuthology.orchestra.run.smithi037.stdout: "is_paused": false 2024-04-25T17:18:53.445 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-25T17:18:53.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.447+0000 7f7274c44700 1 -- 172.21.15.37:0/3516295316 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f725806fcc0 msgr2=0x7f7258072170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:18:53.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.447+0000 7f7274c44700 1 --2- 172.21.15.37:0/3516295316 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f725806fcc0 0x7f7258072170 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7260009fd0 tx=0x7f726000b040 comp rx=0 tx=0).stop 2024-04-25T17:18:53.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.447+0000 7f7274c44700 1 -- 172.21.15.37:0/3516295316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72700fcf60 msgr2=0x7f7270114a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:18:53.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.447+0000 7f7274c44700 1 --2- 172.21.15.37:0/3516295316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72700fcf60 0x7f7270114a80 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7264009180 tx=0x7f7264009e30 comp rx=0 tx=0).stop 2024-04-25T17:18:53.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.447+0000 7f7274c44700 1 -- 172.21.15.37:0/3516295316 shutdown_connections 2024-04-25T17:18:53.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.447+0000 7f7274c44700 1 --2- 172.21.15.37:0/3516295316 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f725806fcc0 0x7f7258072170 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:53.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.447+0000 7f7274c44700 1 --2- 172.21.15.37:0/3516295316 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f72700fbcb0 0x7f7270066c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:53.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.447+0000 7f7274c44700 1 --2- 172.21.15.37:0/3516295316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72700fcf60 0x7f7270114a80 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:53.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.447+0000 7f7274c44700 1 -- 172.21.15.37:0/3516295316 >> 172.21.15.37:0/3516295316 conn(0x7f72700f7430 msgr2=0x7f72700f8a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:18:53.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.447+0000 7f7274c44700 1 -- 172.21.15.37:0/3516295316 shutdown_connections 2024-04-25T17:18:53.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.447+0000 7f7274c44700 1 -- 172.21.15.37:0/3516295316 wait complete. 2024-04-25T17:18:53.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:53 smithi037 ceph-mon[26472]: from='client.14714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:18:53.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:53 smithi037 ceph-mon[26472]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:18:53.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:53 smithi037 ceph-mon[26472]: pgmap v27: 65 pgs: 65 active+clean; 343 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 2.1 MiB/s rd, 23 MiB/s wr, 373 op/s 2024-04-25T17:18:53.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:53 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/2033299021' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:18:53.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:53 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/1345429970' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T17:18:53.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.572+0000 7f6e55ac8700 1 -- 172.21.15.37:0/616395081 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e50066af0 msgr2=0x7f6e500ffa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:18:53.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.572+0000 7f6e55ac8700 1 --2- 172.21.15.37:0/616395081 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e50066af0 0x7f6e500ffa30 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6e40004940 tx=0x7f6e40009e30 comp rx=0 tx=0).stop 2024-04-25T17:18:53.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.572+0000 7f6e55ac8700 1 -- 172.21.15.37:0/616395081 shutdown_connections 2024-04-25T17:18:53.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.572+0000 7f6e55ac8700 1 --2- 172.21.15.37:0/616395081 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6e500fff70 0x7f6e50102350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:53.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.572+0000 7f6e55ac8700 1 --2- 172.21.15.37:0/616395081 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e50066af0 0x7f6e500ffa30 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:53.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.572+0000 7f6e55ac8700 1 -- 172.21.15.37:0/616395081 >> 172.21.15.37:0/616395081 conn(0x7f6e500f7440 msgr2=0x7f6e500f9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:18:53.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.572+0000 7f6e55ac8700 1 -- 172.21.15.37:0/616395081 shutdown_connections 2024-04-25T17:18:53.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.572+0000 7f6e55ac8700 1 -- 172.21.15.37:0/616395081 wait complete. 2024-04-25T17:18:53.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.573+0000 7f6e55ac8700 1 Processor -- start 2024-04-25T17:18:53.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.573+0000 7f6e55ac8700 1 -- start start 2024-04-25T17:18:53.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.573+0000 7f6e55ac8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e50066af0 0x7f6e5010fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:18:53.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.573+0000 7f6e55ac8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6e500fff70 0x7f6e50110100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:18:53.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.573+0000 7f6e55ac8700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e50110700 con 0x7f6e50066af0 2024-04-25T17:18:53.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.573+0000 7f6e55ac8700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e50110f50 con 0x7f6e500fff70 2024-04-25T17:18:53.574 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.573+0000 7f6e4f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e50066af0 0x7f6e5010fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:18:53.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.573+0000 7f6e4f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e50066af0 0x7f6e5010fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37940/0 (socket says 172.21.15.37:37940) 2024-04-25T17:18:53.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.573+0000 7f6e4f7fe700 1 -- 172.21.15.37:0/573867675 learned_addr learned my addr 172.21.15.37:0/573867675 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:18:53.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.573+0000 7f6e4effd700 1 --2- 172.21.15.37:0/573867675 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6e500fff70 0x7f6e50110100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:18:53.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.574+0000 7f6e4f7fe700 1 -- 172.21.15.37:0/573867675 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6e500fff70 msgr2=0x7f6e50110100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:18:53.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.574+0000 7f6e4f7fe700 1 --2- 172.21.15.37:0/573867675 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6e500fff70 0x7f6e50110100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:53.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.574+0000 7f6e4f7fe700 1 -- 172.21.15.37:0/573867675 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e40005040 con 0x7f6e50066af0 2024-04-25T17:18:53.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.574+0000 7f6e4f7fe700 1 --2- 172.21.15.37:0/573867675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e50066af0 0x7f6e5010fbc0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6e40000c00 tx=0x7f6e40009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:18:53.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.574+0000 7f6e37fff700 1 -- 172.21.15.37:0/573867675 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e4000e070 con 0x7f6e50066af0 2024-04-25T17:18:53.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.574+0000 7f6e37fff700 1 -- 172.21.15.37:0/573867675 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6e4001c400 con 0x7f6e50066af0 2024-04-25T17:18:53.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.574+0000 7f6e55ac8700 1 -- 172.21.15.37:0/573867675 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e501111d0 con 0x7f6e50066af0 2024-04-25T17:18:53.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.574+0000 7f6e37fff700 1 -- 172.21.15.37:0/573867675 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e4000b650 con 0x7f6e50066af0 2024-04-25T17:18:53.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.574+0000 7f6e55ac8700 1 -- 172.21.15.37:0/573867675 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e501116b0 con 0x7f6e50066af0 2024-04-25T17:18:53.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.575+0000 7f6e55ac8700 1 -- 172.21.15.37:0/573867675 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e5005f5c0 con 0x7f6e50066af0 2024-04-25T17:18:53.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.576+0000 7f6e37fff700 1 -- 172.21.15.37:0/573867675 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) v1 ==== 92608+0+0 (secure 0 0 0) 0x7f6e4001c570 con 0x7f6e50066af0 2024-04-25T17:18:53.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.576+0000 7f6e37fff700 1 --2- 172.21.15.37:0/573867675 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f6e3806fcb0 0x7f6e38072160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:18:53.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.577+0000 7f6e37fff700 1 -- 172.21.15.37:0/573867675 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f6e40090dd0 con 0x7f6e50066af0 2024-04-25T17:18:53.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.577+0000 7f6e4effd700 1 --2- 172.21.15.37:0/573867675 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f6e3806fcb0 0x7f6e38072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:18:53.578 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.578+0000 7f6e4effd700 1 --2- 172.21.15.37:0/573867675 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f6e3806fcb0 0x7f6e38072160 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6e44009b80 tx=0x7f6e4400b040 comp rx=0 tx=0).ready entity=mgr.24417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:18:53.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:53.583+0000 7f6e37fff700 1 -- 172.21.15.37:0/573867675 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f6e4005a110 con 0x7f6e50066af0 2024-04-25T17:18:53.653 INFO:tasks.workunit.client.0.smithi037.stdout:0/1: sync 2024-04-25T17:18:53.654 INFO:tasks.workunit.client.0.smithi037.stdout:0/2: stat - no entries 2024-04-25T17:18:53.656 INFO:tasks.workunit.client.0.smithi037.stdout:0/3: creat f0 x:0 0 0 2024-04-25T17:18:53.657 INFO:tasks.workunit.client.0.smithi037.stdout:0/4: mknod c1 0 2024-04-25T17:18:53.658 INFO:tasks.workunit.client.0.smithi037.stdout:0/5: creat f2 x:0 0 0 2024-04-25T17:18:53.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:53 smithi069 ceph-mon[34527]: from='client.14714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:18:53.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:53 smithi069 ceph-mon[34527]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:18:53.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:53 smithi069 ceph-mon[34527]: pgmap v27: 65 pgs: 65 active+clean; 343 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 2.1 MiB/s rd, 23 MiB/s wr, 373 op/s 2024-04-25T17:18:53.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:53 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/2033299021' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:18:53.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:53 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/1345429970' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T17:18:53.670 INFO:tasks.workunit.client.0.smithi037.stdout:0/6: dwrite f0 [0,4194304] 0 2024-04-25T17:18:53.671 INFO:tasks.workunit.client.0.smithi037.stdout:0/7: write f2 [468261,10291] 0 2024-04-25T17:18:53.675 INFO:tasks.workunit.client.0.smithi037.stdout:0/8: symlink l3 0 2024-04-25T17:18:53.675 INFO:tasks.workunit.client.0.smithi037.stdout:0/9: chown c1 830000 1 2024-04-25T17:18:53.679 INFO:tasks.workunit.client.0.smithi037.stdout:0/10: creat f4 x:0 0 0 2024-04-25T17:18:53.680 INFO:tasks.workunit.client.0.smithi037.stdout:0/11: write f4 [255230,1545] 0 2024-04-25T17:18:53.683 INFO:tasks.workunit.client.0.smithi037.stdout:0/12: symlink l5 0 2024-04-25T17:18:53.693 INFO:tasks.workunit.client.0.smithi037.stdout:0/13: dwrite f4 [0,4194304] 0 2024-04-25T17:18:53.697 INFO:tasks.workunit.client.0.smithi037.stdout:0/14: dread f4 [0,4194304] 0 2024-04-25T17:18:53.702 INFO:tasks.workunit.client.0.smithi037.stdout:0/15: dread f2 [0,4194304] 0 2024-04-25T17:18:53.709 INFO:tasks.workunit.client.0.smithi037.stdout:0/16: dwrite f0 [0,4194304] 0 2024-04-25T17:18:53.714 INFO:tasks.workunit.client.0.smithi037.stdout:0/17: rename f0 to f6 0 2024-04-25T17:18:53.724 INFO:tasks.workunit.client.0.smithi037.stdout:0/18: dwrite f4 [0,4194304] 0 2024-04-25T17:18:53.729 INFO:tasks.workunit.client.0.smithi037.stdout:0/19: creat f7 x:0 0 0 2024-04-25T17:18:53.729 INFO:tasks.workunit.client.0.smithi037.stdout:0/20: chown f6 973011762 1 2024-04-25T17:18:53.732 INFO:tasks.workunit.client.0.smithi037.stdout:0/21: mknod c8 0 2024-04-25T17:18:53.735 INFO:tasks.workunit.client.0.smithi037.stdout:0/22: mkdir d9 0 2024-04-25T17:18:53.739 INFO:tasks.workunit.client.0.smithi037.stdout:0/23: unlink c1 0 2024-04-25T17:18:53.741 INFO:tasks.workunit.client.0.smithi037.stdout:0/24: fdatasync f6 0 2024-04-25T17:18:53.746 INFO:tasks.workunit.client.0.smithi037.stdout:0/25: creat d9/fa x:0 0 0 2024-04-25T17:18:53.747 INFO:tasks.workunit.client.0.smithi037.stdout:7/3: sync 2024-04-25T17:18:53.747 INFO:tasks.workunit.client.0.smithi037.stdout:2/11: sync 2024-04-25T17:18:53.747 INFO:tasks.workunit.client.0.smithi037.stdout:8/0: sync 2024-04-25T17:18:53.747 INFO:tasks.workunit.client.0.smithi037.stdout:8/1: fsync - no filename 2024-04-25T17:18:53.747 INFO:tasks.workunit.client.0.smithi037.stdout:8/2: write - no filename 2024-04-25T17:18:53.747 INFO:tasks.workunit.client.0.smithi037.stdout:8/3: link - no file 2024-04-25T17:18:53.751 INFO:tasks.workunit.client.0.smithi037.stdout:0/26: dread f4 [0,4194304] 0 2024-04-25T17:18:53.757 INFO:tasks.workunit.client.0.smithi037.stdout:2/12: creat d0/f2 x:0 0 0 2024-04-25T17:18:53.761 INFO:tasks.workunit.client.0.smithi037.stdout:7/4: creat f0 x:0 0 0 2024-04-25T17:18:53.761 INFO:tasks.workunit.client.0.smithi037.stdout:7/5: rmdir - no directory 2024-04-25T17:18:53.761 INFO:tasks.workunit.client.0.smithi037.stdout:7/6: readlink - no filename 2024-04-25T17:18:53.764 INFO:tasks.workunit.client.0.smithi037.stdout:8/4: creat f0 x:0 0 0 2024-04-25T17:18:53.764 INFO:tasks.workunit.client.0.smithi037.stdout:8/5: chown f0 3 1 2024-04-25T17:18:53.767 INFO:tasks.workunit.client.0.smithi037.stdout:2/13: symlink d0/l3 0 2024-04-25T17:18:53.767 INFO:tasks.workunit.client.0.smithi037.stdout:2/14: truncate d0/f2 357816 0 2024-04-25T17:18:53.769 INFO:tasks.workunit.client.0.smithi037.stdout:7/7: creat f1 x:0 0 0 2024-04-25T17:18:53.771 INFO:tasks.workunit.client.0.smithi037.stdout:8/6: creat f1 x:0 0 0 2024-04-25T17:18:53.777 INFO:tasks.workunit.client.0.smithi037.stdout:8/7: unlink f1 0 2024-04-25T17:18:53.785 INFO:tasks.workunit.client.0.smithi037.stdout:8/8: link f0 f2 0 2024-04-25T17:18:53.789 INFO:tasks.workunit.client.0.smithi037.stdout:8/9: write f0 [493290,21968] 0 2024-04-25T17:18:53.793 INFO:tasks.workunit.client.0.smithi037.stdout:8/10: dread f0 [0,4194304] 0 2024-04-25T17:18:53.801 INFO:tasks.workunit.client.0.smithi037.stdout:8/11: dwrite f2 [0,4194304] 0 2024-04-25T17:18:53.820 INFO:tasks.workunit.client.0.smithi037.stdout:8/12: fdatasync f2 0 2024-04-25T17:18:53.826 INFO:tasks.workunit.client.0.smithi037.stdout:8/13: dwrite f0 [0,4194304] 0 2024-04-25T17:18:53.837 INFO:tasks.workunit.client.0.smithi037.stdout:3/27: sync 2024-04-25T17:18:53.837 INFO:tasks.workunit.client.0.smithi037.stdout:4/121: sync 2024-04-25T17:18:53.837 INFO:tasks.workunit.client.0.smithi037.stdout:5/122: sync 2024-04-25T17:18:53.838 INFO:tasks.workunit.client.0.smithi037.stdout:6/63: sync 2024-04-25T17:18:53.838 INFO:tasks.workunit.client.0.smithi037.stdout:9/145: sync 2024-04-25T17:18:53.838 INFO:tasks.workunit.client.0.smithi037.stdout:1/31: sync 2024-04-25T17:18:53.839 INFO:tasks.workunit.client.0.smithi037.stdout:9/146: chown d1/f13 73893088 1 2024-04-25T17:18:53.839 INFO:tasks.workunit.client.0.smithi037.stdout:4/122: chown d7/c8 215913722 1 2024-04-25T17:18:53.843 INFO:tasks.workunit.client.0.smithi037.stdout:6/64: creat db/f10 x:0 0 0 2024-04-25T17:18:53.845 INFO:tasks.workunit.client.0.smithi037.stdout:1/32: truncate f8 562389 0 2024-04-25T17:18:53.845 INFO:tasks.workunit.client.0.smithi037.stdout:1/33: rmdir - no directory 2024-04-25T17:18:53.847 INFO:tasks.workunit.client.0.smithi037.stdout:9/147: mknod d1/c2f 0 2024-04-25T17:18:53.847 INFO:tasks.workunit.client.0.smithi037.stdout:9/148: chown d1/d21 2 1 2024-04-25T17:18:53.849 INFO:tasks.workunit.client.0.smithi037.stdout:5/123: truncate d7/d18/f29 262821 0 2024-04-25T17:18:53.852 INFO:tasks.workunit.client.0.smithi037.stdout:3/28: truncate f5 1403015 0 2024-04-25T17:18:53.857 INFO:tasks.workunit.client.0.smithi037.stdout:1/34: creat f9 x:0 0 0 2024-04-25T17:18:53.859 INFO:tasks.workunit.client.0.smithi037.stdout:9/149: mknod d1/d5/d19/c30 0 2024-04-25T17:18:53.864 INFO:tasks.workunit.client.0.smithi037.stdout:4/123: symlink d7/d29/d1e/d2b/l2c 0 2024-04-25T17:18:53.866 INFO:tasks.workunit.client.0.smithi037.stdout:3/29: rename d8/fa to d8/fd 0 2024-04-25T17:18:53.873 INFO:tasks.workunit.client.0.smithi037.stdout:4/124: fdatasync d7/f1a 0 2024-04-25T17:18:53.877 INFO:tasks.workunit.client.0.smithi037.stdout:9/150: link d1/d5/dc/f27 d1/d21/f31 0 2024-04-25T17:18:53.880 INFO:tasks.workunit.client.0.smithi037.stdout:4/125: dread - d7/f19 zero size 2024-04-25T17:18:53.881 INFO:tasks.workunit.client.0.smithi037.stdout:4/126: chown d7/d29/l22 34911580 1 2024-04-25T17:18:53.881 INFO:tasks.workunit.client.0.smithi037.stdout:1/35: link f7 fa 0 2024-04-25T17:18:53.883 INFO:tasks.workunit.client.0.smithi037.stdout:9/151: mknod d1/d21/d1c/c32 0 2024-04-25T17:18:53.894 INFO:tasks.workunit.client.0.smithi037.stdout:9/152: mkdir d1/d5/d2e/d33 0 2024-04-25T17:18:53.897 INFO:tasks.workunit.client.0.smithi037.stdout:9/153: rmdir d1/d21 39 2024-04-25T17:18:54.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:54.027+0000 7f6e55ac8700 1 -- 172.21.15.37:0/573867675 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f6e5004bed0 con 0x7f6e50066af0 2024-04-25T17:18:54.027 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:54.027+0000 7f6e37fff700 1 -- 172.21.15.37:0/573867675 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f6e40004490 con 0x7f6e50066af0 2024-04-25T17:18:54.028 INFO:teuthology.orchestra.run.smithi037.stdout:HEALTH_OK 2024-04-25T17:18:54.030 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:54.030+0000 7f6e55ac8700 1 -- 172.21.15.37:0/573867675 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f6e3806fcb0 msgr2=0x7f6e38072160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:18:54.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:54.030+0000 7f6e55ac8700 1 --2- 172.21.15.37:0/573867675 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f6e3806fcb0 0x7f6e38072160 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6e44009b80 tx=0x7f6e4400b040 comp rx=0 tx=0).stop 2024-04-25T17:18:54.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:54.030+0000 7f6e55ac8700 1 -- 172.21.15.37:0/573867675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e50066af0 msgr2=0x7f6e5010fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:18:54.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:54.030+0000 7f6e55ac8700 1 --2- 172.21.15.37:0/573867675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e50066af0 0x7f6e5010fbc0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6e40000c00 tx=0x7f6e40009e30 comp rx=0 tx=0).stop 2024-04-25T17:18:54.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:54.030+0000 7f6e55ac8700 1 -- 172.21.15.37:0/573867675 shutdown_connections 2024-04-25T17:18:54.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:54.030+0000 7f6e55ac8700 1 --2- 172.21.15.37:0/573867675 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f6e3806fcb0 0x7f6e38072160 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:54.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:54.030+0000 7f6e55ac8700 1 --2- 172.21.15.37:0/573867675 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e50066af0 0x7f6e5010fbc0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:54.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:54.030+0000 7f6e55ac8700 1 --2- 172.21.15.37:0/573867675 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6e500fff70 0x7f6e50110100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:18:54.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:54.030+0000 7f6e55ac8700 1 -- 172.21.15.37:0/573867675 >> 172.21.15.37:0/573867675 conn(0x7f6e500f7440 msgr2=0x7f6e500fba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:18:54.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:54.030+0000 7f6e55ac8700 1 -- 172.21.15.37:0/573867675 shutdown_connections 2024-04-25T17:18:54.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:18:54.030+0000 7f6e55ac8700 1 -- 172.21.15.37:0/573867675 wait complete. 2024-04-25T17:18:54.069 INFO:tasks.workunit.client.0.smithi037.stdout:0/27: truncate f2 606749 0 2024-04-25T17:18:54.069 INFO:tasks.workunit.client.0.smithi037.stdout:0/28: stat l3 0 2024-04-25T17:18:54.072 INFO:tasks.workunit.client.0.smithi037.stdout:0/29: rename f4 to d9/fb 0 2024-04-25T17:18:54.078 INFO:tasks.workunit.client.0.smithi037.stdout:0/30: dwrite d9/fa [0,4194304] 0 2024-04-25T17:18:54.079 INFO:tasks.workunit.client.0.smithi037.stdout:0/31: read d9/fa [3201646,59290] 0 2024-04-25T17:18:54.087 INFO:tasks.workunit.client.0.smithi037.stdout:0/32: dwrite f7 [0,4194304] 0 2024-04-25T17:18:54.100 INFO:tasks.workunit.client.0.smithi037.stdout:0/33: dwrite d9/fa [0,4194304] 0 2024-04-25T17:18:54.101 INFO:tasks.workunit.client.0.smithi037.stdout:0/34: chown l5 2 1 2024-04-25T17:18:54.105 INFO:tasks.workunit.client.0.smithi037.stdout:0/35: rename l5 to d9/lc 0 2024-04-25T17:18:54.108 INFO:tasks.workunit.client.0.smithi037.stdout:0/36: symlink d9/ld 0 2024-04-25T17:18:54.111 INFO:tasks.workunit.client.0.smithi037.stdout:0/37: mkdir d9/de 0 2024-04-25T17:18:54.116 INFO:tasks.workunit.client.0.smithi037.stdout:0/38: rename d9/de to d9/df 0 2024-04-25T17:18:54.121 INFO:tasks.workunit.client.0.smithi037.stdout:7/8: getdents . 0 2024-04-25T17:18:54.122 INFO:tasks.workunit.client.0.smithi037.stdout:7/9: truncate f1 471824 0 2024-04-25T17:18:54.129 INFO:tasks.workunit.client.0.smithi037.stdout:2/15: write d0/f1 [229110,130426] 0 2024-04-25T17:18:54.129 INFO:tasks.workunit.client.0.smithi037.stdout:7/10: mknod c2 0 2024-04-25T17:18:54.133 INFO:tasks.workunit.client.0.smithi037.stdout:7/11: creat f3 x:0 0 0 2024-04-25T17:18:54.136 INFO:tasks.workunit.client.0.smithi037.stdout:2/16: mkdir d0/d4 0 2024-04-25T17:18:54.137 INFO:tasks.workunit.client.0.smithi037.stdout:2/17: write d0/f1 [292908,124227] 0 2024-04-25T17:18:54.137 INFO:tasks.workunit.client.0.smithi037.stdout:7/12: creat f4 x:0 0 0 2024-04-25T17:18:54.137 INFO:tasks.workunit.client.0.smithi037.stdout:7/13: rmdir - no directory 2024-04-25T17:18:54.144 INFO:tasks.workunit.client.0.smithi037.stdout:7/14: dwrite f0 [0,4194304] 0 2024-04-25T17:18:54.146 INFO:tasks.workunit.client.0.smithi037.stdout:2/18: rmdir d0/d4 0 2024-04-25T17:18:54.150 INFO:tasks.workunit.client.0.smithi037.stdout:2/19: rename d0/f2 to d0/f5 0 2024-04-25T17:18:54.152 INFO:tasks.workunit.client.0.smithi037.stdout:7/15: dwrite f0 [0,4194304] 0 2024-04-25T17:18:54.153 INFO:tasks.workunit.client.0.smithi037.stdout:2/20: dread d0/f5 [0,4194304] 0 2024-04-25T17:18:54.154 INFO:tasks.workunit.client.0.smithi037.stdout:7/16: write f3 [113446,45641] 0 2024-04-25T17:18:54.156 INFO:tasks.workunit.client.0.smithi037.stdout:2/21: truncate d0/f1 1081533 0 2024-04-25T17:18:54.156 INFO:tasks.workunit.client.0.smithi037.stdout:2/22: chown d0 576 1 2024-04-25T17:18:54.159 INFO:tasks.workunit.client.0.smithi037.stdout:2/23: creat d0/f6 x:0 0 0 2024-04-25T17:18:54.160 INFO:tasks.workunit.client.0.smithi037.stdout:8/14: write f0 [4990492,7419] 0 2024-04-25T17:18:54.162 INFO:tasks.workunit.client.0.smithi037.stdout:2/24: dread d0/f5 [0,4194304] 0 2024-04-25T17:18:54.164 INFO:tasks.workunit.client.0.smithi037.stdout:2/25: dread - d0/f6 zero size 2024-04-25T17:18:54.165 INFO:tasks.workunit.client.0.smithi037.stdout:3/30: sync 2024-04-25T17:18:54.165 INFO:tasks.workunit.client.0.smithi037.stdout:7/17: dwrite f3 [0,4194304] 0 2024-04-25T17:18:54.175 INFO:tasks.workunit.client.0.smithi037.stdout:7/18: dread f3 [0,4194304] 0 2024-04-25T17:18:54.175 INFO:tasks.workunit.client.0.smithi037.stdout:2/26: dwrite d0/f6 [0,4194304] 0 2024-04-25T17:18:54.176 INFO:tasks.workunit.client.0.smithi037.stdout:7/19: write f4 [525838,3128] 0 2024-04-25T17:18:54.178 INFO:tasks.workunit.client.0.smithi037.stdout:2/27: creat d0/f7 x:0 0 0 2024-04-25T17:18:54.180 INFO:tasks.workunit.client.0.smithi037.stdout:7/20: mkdir d5 0 2024-04-25T17:18:54.186 INFO:tasks.workunit.client.0.smithi037.stdout:7/21: dread f4 [0,4194304] 0 2024-04-25T17:18:54.190 INFO:tasks.workunit.client.0.smithi037.stdout:7/22: creat d5/f6 x:0 0 0 2024-04-25T17:18:54.192 INFO:tasks.workunit.client.0.smithi037.stdout:7/23: read f0 [3544853,108241] 0 2024-04-25T17:18:54.200 INFO:tasks.workunit.client.0.smithi037.stdout:7/24: dwrite d5/f6 [0,4194304] 0 2024-04-25T17:18:54.201 INFO:tasks.workunit.client.0.smithi037.stdout:7/25: chown f4 7469 1 2024-04-25T17:18:54.203 INFO:tasks.workunit.client.0.smithi037.stdout:6/65: rmdir db 39 2024-04-25T17:18:54.203 INFO:tasks.workunit.client.0.smithi037.stdout:7/26: write f1 [598031,123789] 0 2024-04-25T17:18:54.219 INFO:tasks.workunit.client.0.smithi037.stdout:6/66: dwrite db/fd [0,4194304] 0 2024-04-25T17:18:54.223 INFO:tasks.workunit.client.0.smithi037.stdout:3/31: fsync d8/fd 0 2024-04-25T17:18:54.225 INFO:tasks.workunit.client.0.smithi037.stdout:5/124: dwrite d7/d12/f19 [0,4194304] 0 2024-04-25T17:18:54.228 INFO:tasks.workunit.client.0.smithi037.stdout:6/67: dread - fa zero size 2024-04-25T17:18:54.230 INFO:tasks.workunit.client.0.smithi037.stdout:3/32: dread - d8/f9 zero size 2024-04-25T17:18:54.232 INFO:tasks.workunit.client.0.smithi037.stdout:5/125: dread d7/d18/f29 [0,4194304] 0 2024-04-25T17:18:54.233 INFO:tasks.workunit.client.0.smithi037.stdout:5/126: chown f0 30 1 2024-04-25T17:18:54.236 INFO:tasks.workunit.client.0.smithi037.stdout:6/68: unlink db/f10 0 2024-04-25T17:18:54.236 INFO:tasks.workunit.client.0.smithi037.stdout:6/69: readlink l2 0 2024-04-25T17:18:54.241 INFO:tasks.workunit.client.0.smithi037.stdout:5/127: fdatasync d7/d12/f23 0 2024-04-25T17:18:54.243 INFO:tasks.workunit.client.0.smithi037.stdout:3/33: rename c6 to d8/ce 0 2024-04-25T17:18:54.244 INFO:tasks.workunit.client.0.smithi037.stdout:3/34: dread - d8/f9 zero size 2024-04-25T17:18:54.249 INFO:tasks.workunit.client.0.smithi037.stdout:1/36: write f5 [4395872,38771] 0 2024-04-25T17:18:54.250 INFO:tasks.workunit.client.0.smithi037.stdout:3/35: creat d8/ff x:0 0 0 2024-04-25T17:18:54.251 INFO:tasks.workunit.client.0.smithi037.stdout:3/36: stat d8 0 2024-04-25T17:18:54.252 INFO:tasks.workunit.client.0.smithi037.stdout:1/37: unlink c6 0 2024-04-25T17:18:54.254 INFO:tasks.workunit.client.0.smithi037.stdout:4/127: dwrite d7/fe [0,4194304] 0 2024-04-25T17:18:54.254 INFO:tasks.workunit.client.0.smithi037.stdout:4/128: readlink d7/l16 0 2024-04-25T17:18:54.255 INFO:tasks.workunit.client.0.smithi037.stdout:4/129: chown d7/d29/d1e/l1f 231 1 2024-04-25T17:18:54.258 INFO:tasks.workunit.client.0.smithi037.stdout:9/154: write d1/f16 [2035834,112413] 0 2024-04-25T17:18:54.259 INFO:tasks.workunit.client.0.smithi037.stdout:4/130: fdatasync d7/fd 0 2024-04-25T17:18:54.263 INFO:tasks.workunit.client.0.smithi037.stdout:9/155: mkdir d1/d5/d2e/d34 0 2024-04-25T17:18:54.268 INFO:tasks.workunit.client.0.smithi037.stdout:1/38: link f7 fb 0 2024-04-25T17:18:54.270 INFO:tasks.workunit.client.0.smithi037.stdout:9/156: creat d1/d21/d1c/f35 x:0 0 0 2024-04-25T17:18:54.271 INFO:tasks.workunit.client.0.smithi037.stdout:9/157: write d1/d21/d1c/f35 [618178,67213] 0 2024-04-25T17:18:54.272 INFO:tasks.workunit.client.0.smithi037.stdout:9/158: chown d1/c17 52704 1 2024-04-25T17:18:54.272 INFO:tasks.workunit.client.0.smithi037.stdout:1/39: mkdir dc 0 2024-04-25T17:18:54.275 INFO:tasks.workunit.client.0.smithi037.stdout:9/159: truncate d1/d5/dc/f23 169931 0 2024-04-25T17:18:54.277 INFO:tasks.workunit.client.0.smithi037.stdout:9/160: truncate d1/fd 528292 0 2024-04-25T17:18:54.281 INFO:tasks.workunit.client.0.smithi037.stdout:1/40: link f8 dc/fd 0 2024-04-25T17:18:54.352 INFO:tasks.workunit.client.0.smithi037.stdout:0/39: fsync d9/fb 0 2024-04-25T17:18:54.355 INFO:tasks.workunit.client.0.smithi037.stdout:0/40: getdents d9/df 0 2024-04-25T17:18:54.388 INFO:tasks.workunit.client.0.smithi037.stdout:8/15: truncate f2 4209414 0 2024-04-25T17:18:54.392 INFO:tasks.workunit.client.0.smithi037.stdout:2/28: getdents d0 0 2024-04-25T17:18:54.395 INFO:tasks.workunit.client.0.smithi037.stdout:2/29: creat d0/f8 x:0 0 0 2024-04-25T17:18:54.395 INFO:tasks.workunit.client.0.smithi037.stdout:2/30: fdatasync d0/f8 0 2024-04-25T17:18:54.397 INFO:tasks.workunit.client.0.smithi037.stdout:2/31: creat d0/f9 x:0 0 0 2024-04-25T17:18:54.397 INFO:tasks.workunit.client.0.smithi037.stdout:7/27: rmdir d5 39 2024-04-25T17:18:54.401 INFO:tasks.workunit.client.0.smithi037.stdout:2/32: unlink d0/f1 0 2024-04-25T17:18:54.403 INFO:tasks.workunit.client.0.smithi037.stdout:7/28: symlink d5/l7 0 2024-04-25T17:18:54.406 INFO:tasks.workunit.client.0.smithi037.stdout:2/33: symlink d0/la 0 2024-04-25T17:18:54.406 INFO:tasks.workunit.client.0.smithi037.stdout:7/29: rmdir d5 39 2024-04-25T17:18:54.410 INFO:tasks.workunit.client.0.smithi037.stdout:7/30: unlink c2 0 2024-04-25T17:18:54.417 INFO:tasks.workunit.client.0.smithi037.stdout:6/70: getdents db 0 2024-04-25T17:18:54.420 INFO:tasks.workunit.client.0.smithi037.stdout:6/71: creat db/f11 x:0 0 0 2024-04-25T17:18:54.421 INFO:tasks.workunit.client.0.smithi037.stdout:6/72: truncate db/ff 557880 0 2024-04-25T17:18:54.424 INFO:tasks.workunit.client.0.smithi037.stdout:6/73: creat db/f12 x:0 0 0 2024-04-25T17:18:54.424 INFO:tasks.workunit.client.0.smithi037.stdout:3/37: fsync d8/ff 0 2024-04-25T17:18:54.425 INFO:tasks.workunit.client.0.smithi037.stdout:3/38: stat d8/lc 0 2024-04-25T17:18:54.426 INFO:tasks.workunit.client.0.smithi037.stdout:3/39: stat d8/ff 0 2024-04-25T17:18:54.429 INFO:tasks.workunit.client.0.smithi037.stdout:5/128: dwrite d7/d12/f24 [0,4194304] 0 2024-04-25T17:18:54.431 INFO:tasks.workunit.client.0.smithi037.stdout:3/40: truncate d8/f9 223650 0 2024-04-25T17:18:54.432 INFO:tasks.workunit.client.0.smithi037.stdout:4/131: write d7/f26 [1103986,105752] 0 2024-04-25T17:18:54.432 INFO:tasks.workunit.client.0.smithi037.stdout:5/129: truncate d7/fc 163833 0 2024-04-25T17:18:54.433 INFO:tasks.workunit.client.0.smithi037.stdout:5/130: stat f0 0 2024-04-25T17:18:54.435 INFO:tasks.workunit.client.0.smithi037.stdout:4/132: rename f1 to d7/f2d 0 2024-04-25T17:18:54.436 INFO:tasks.workunit.client.0.smithi037.stdout:3/41: dread d8/fd [0,4194304] 0 2024-04-25T17:18:54.444 INFO:tasks.workunit.client.0.smithi037.stdout:3/42: creat d8/f10 x:0 0 0 2024-04-25T17:18:54.446 INFO:tasks.workunit.client.0.smithi037.stdout:5/131: link f3 d7/d18/f2a 0 2024-04-25T17:18:54.447 INFO:tasks.workunit.client.0.smithi037.stdout:9/161: write d1/d5/dc/f11 [1725136,68620] 0 2024-04-25T17:18:54.448 INFO:tasks.workunit.client.0.smithi037.stdout:9/162: write d1/f16 [4375911,59417] 0 2024-04-25T17:18:54.449 INFO:tasks.workunit.client.0.smithi037.stdout:1/41: write f1 [3179881,110246] 0 2024-04-25T17:18:54.452 INFO:tasks.workunit.client.0.smithi037.stdout:5/132: creat d7/d25/f2b x:0 0 0 2024-04-25T17:18:54.455 INFO:tasks.workunit.client.0.smithi037.stdout:9/163: unlink d1/d5/c6 0 2024-04-25T17:18:54.458 INFO:tasks.workunit.client.0.smithi037.stdout:9/164: mknod d1/d5/c36 0 2024-04-25T17:18:54.462 INFO:tasks.workunit.client.0.smithi037.stdout:9/165: creat d1/f37 x:0 0 0 2024-04-25T17:18:54.464 INFO:tasks.workunit.client.0.smithi037.stdout:9/166: fsync d1/f13 0 2024-04-25T17:18:54.480 INFO:tasks.workunit.client.0.smithi037.stdout:8/16: fsync f2 0 2024-04-25T17:18:54.480 INFO:tasks.workunit.client.0.smithi037.stdout:0/41: dwrite f2 [0,4194304] 0 2024-04-25T17:18:54.481 INFO:tasks.workunit.client.0.smithi037.stdout:0/42: chown c8 671 1 2024-04-25T17:18:54.483 INFO:tasks.workunit.client.0.smithi037.stdout:8/17: mknod c3 0 2024-04-25T17:18:54.490 INFO:tasks.workunit.client.0.smithi037.stdout:8/18: dwrite f2 [0,4194304] 0 2024-04-25T17:18:54.494 INFO:tasks.workunit.client.0.smithi037.stdout:8/19: rename f0 to f4 0 2024-04-25T17:18:54.495 INFO:tasks.workunit.client.0.smithi037.stdout:2/34: truncate d0/f6 3973950 0 2024-04-25T17:18:54.499 INFO:tasks.workunit.client.0.smithi037.stdout:2/35: unlink d0/f8 0 2024-04-25T17:18:54.501 INFO:tasks.workunit.client.0.smithi037.stdout:7/31: truncate f3 2187019 0 2024-04-25T17:18:54.502 INFO:tasks.workunit.client.0.smithi037.stdout:2/36: symlink d0/lb 0 2024-04-25T17:18:54.504 INFO:tasks.workunit.client.0.smithi037.stdout:7/32: write f4 [422305,113783] 0 2024-04-25T17:18:54.509 INFO:tasks.workunit.client.0.smithi037.stdout:6/74: rmdir db 39 2024-04-25T17:18:54.510 INFO:tasks.workunit.client.0.smithi037.stdout:8/20: fdatasync f2 0 2024-04-25T17:18:54.513 INFO:tasks.workunit.client.0.smithi037.stdout:7/33: creat d5/f8 x:0 0 0 2024-04-25T17:18:54.514 INFO:tasks.workunit.client.0.smithi037.stdout:6/75: fsync f9 0 2024-04-25T17:18:54.516 INFO:tasks.workunit.client.0.smithi037.stdout:8/21: mkdir d5 0 2024-04-25T17:18:54.517 INFO:tasks.workunit.client.0.smithi037.stdout:8/22: chown c3 78030 1 2024-04-25T17:18:54.518 INFO:tasks.workunit.client.0.smithi037.stdout:8/23: read f2 [3837357,130205] 0 2024-04-25T17:18:54.519 INFO:tasks.workunit.client.0.smithi037.stdout:8/24: write f4 [813939,61111] 0 2024-04-25T17:18:54.521 INFO:tasks.workunit.client.0.smithi037.stdout:7/34: creat d5/f9 x:0 0 0 2024-04-25T17:18:54.522 INFO:tasks.workunit.client.0.smithi037.stdout:4/133: dread d7/f2d [0,4194304] 0 2024-04-25T17:18:54.527 INFO:tasks.workunit.client.0.smithi037.stdout:4/134: dread d7/f26 [0,4194304] 0 2024-04-25T17:18:54.529 INFO:tasks.workunit.client.0.smithi037.stdout:7/35: write f0 [2829989,47376] 0 2024-04-25T17:18:54.531 INFO:tasks.workunit.client.0.smithi037.stdout:5/133: write f6 [639058,6753] 0 2024-04-25T17:18:54.532 INFO:tasks.workunit.client.0.smithi037.stdout:5/134: chown d7/d12/f21 5403 1 2024-04-25T17:18:54.533 INFO:tasks.workunit.client.0.smithi037.stdout:8/25: mknod d5/c6 0 2024-04-25T17:18:54.535 INFO:tasks.workunit.client.0.smithi037.stdout:4/135: rename d7/d29/l20 to d7/d29/l2e 0 2024-04-25T17:18:54.537 INFO:tasks.workunit.client.0.smithi037.stdout:7/36: mknod d5/ca 0 2024-04-25T17:18:54.540 INFO:tasks.workunit.client.0.smithi037.stdout:5/135: dread d7/d18/f1e [0,4194304] 0 2024-04-25T17:18:54.542 INFO:tasks.workunit.client.0.smithi037.stdout:8/26: unlink f2 0 2024-04-25T17:18:54.545 INFO:tasks.workunit.client.0.smithi037.stdout:9/167: dwrite d1/d21/f31 [0,4194304] 0 2024-04-25T17:18:54.546 INFO:tasks.workunit.client.0.smithi037.stdout:7/37: creat d5/fb x:0 0 0 2024-04-25T17:18:54.549 INFO:tasks.workunit.client.0.smithi037.stdout:0/43: write f2 [4321897,9740] 0 2024-04-25T17:18:54.551 INFO:tasks.workunit.client.0.smithi037.stdout:0/44: chown d9/df 0 1 2024-04-25T17:18:54.552 INFO:tasks.workunit.client.0.smithi037.stdout:4/136: dwrite d7/f26 [0,4194304] 0 2024-04-25T17:18:54.552 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:54 smithi037 ceph-mon[26472]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:18:54.553 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:54 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/573867675' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T17:18:54.559 INFO:tasks.workunit.client.0.smithi037.stdout:9/168: dread d1/d5/dc/f10 [0,4194304] 0 2024-04-25T17:18:54.559 INFO:tasks.workunit.client.0.smithi037.stdout:0/45: creat d9/df/f10 x:0 0 0 2024-04-25T17:18:54.562 INFO:tasks.workunit.client.0.smithi037.stdout:4/137: unlink d7/fa 0 2024-04-25T17:18:54.563 INFO:tasks.workunit.client.0.smithi037.stdout:4/138: chown f3 5587 1 2024-04-25T17:18:54.565 INFO:tasks.workunit.client.0.smithi037.stdout:2/37: rename d0/f6 to d0/fc 0 2024-04-25T17:18:54.569 INFO:tasks.workunit.client.0.smithi037.stdout:9/169: mkdir d1/d5/dc/d38 0 2024-04-25T17:18:54.570 INFO:tasks.workunit.client.0.smithi037.stdout:9/170: chown d1/d5/d19/c30 338792655 1 2024-04-25T17:18:54.651 INFO:tasks.workunit.client.0.smithi037.stdout:5/136: link d7/fb d7/d12/d15/f2c 0 2024-04-25T17:18:54.651 INFO:tasks.workunit.client.0.smithi037.stdout:0/46: unlink d9/lc 0 2024-04-25T17:18:54.652 INFO:tasks.workunit.client.0.smithi037.stdout:9/171: unlink d1/d5/dc/c20 0 2024-04-25T17:18:54.653 INFO:tasks.workunit.client.0.smithi037.stdout:7/38: rmdir d5 39 2024-04-25T17:18:54.657 INFO:tasks.workunit.client.0.smithi037.stdout:0/47: creat d9/f11 x:0 0 0 2024-04-25T17:18:54.658 INFO:tasks.workunit.client.0.smithi037.stdout:9/172: dread - d1/d21/f22 zero size 2024-04-25T17:18:54.661 INFO:tasks.workunit.client.0.smithi037.stdout:8/27: fsync f4 0 2024-04-25T17:18:54.664 INFO:tasks.workunit.client.0.smithi037.stdout:6/76: dwrite f5 [0,4194304] 0 2024-04-25T17:18:54.667 INFO:tasks.workunit.client.0.smithi037.stdout:2/38: rmdir d0 39 2024-04-25T17:18:54.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:54 smithi069 ceph-mon[34527]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:18:54.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:54 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/573867675' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T17:18:54.668 INFO:tasks.workunit.client.0.smithi037.stdout:7/39: dwrite f4 [0,4194304] 0 2024-04-25T17:18:54.670 INFO:tasks.workunit.client.0.smithi037.stdout:0/48: dread d9/fa [0,4194304] 0 2024-04-25T17:18:54.671 INFO:tasks.workunit.client.0.smithi037.stdout:0/49: chown f6 6917 1 2024-04-25T17:18:54.675 INFO:tasks.workunit.client.0.smithi037.stdout:4/139: write f3 [3647811,13728] 0 2024-04-25T17:18:54.679 INFO:tasks.workunit.client.0.smithi037.stdout:8/28: fdatasync f4 0 2024-04-25T17:18:54.679 INFO:tasks.workunit.client.0.smithi037.stdout:0/50: dwrite f6 [0,4194304] 0 2024-04-25T17:18:54.685 INFO:tasks.workunit.client.0.smithi037.stdout:0/51: dread f7 [0,4194304] 0 2024-04-25T17:18:54.686 INFO:tasks.workunit.client.0.smithi037.stdout:0/52: write f2 [3891853,72006] 0 2024-04-25T17:18:54.694 INFO:tasks.workunit.client.0.smithi037.stdout:0/53: dwrite f7 [0,4194304] 0 2024-04-25T17:18:54.695 INFO:tasks.workunit.client.0.smithi037.stdout:7/40: rename d5 to d5/dc 22 2024-04-25T17:18:54.710 INFO:tasks.workunit.client.0.smithi037.stdout:8/29: mknod d5/c7 0 2024-04-25T17:18:54.716 INFO:tasks.workunit.client.0.smithi037.stdout:6/77: creat db/f13 x:0 0 0 2024-04-25T17:18:54.716 INFO:tasks.workunit.client.0.smithi037.stdout:6/78: stat f5 0 2024-04-25T17:18:54.721 INFO:tasks.workunit.client.0.smithi037.stdout:2/39: creat d0/fd x:0 0 0 2024-04-25T17:18:54.724 INFO:tasks.workunit.client.0.smithi037.stdout:0/54: creat d9/df/f12 x:0 0 0 2024-04-25T17:18:54.727 INFO:tasks.workunit.client.0.smithi037.stdout:7/41: rename d5/fb to d5/fd 0 2024-04-25T17:18:54.734 INFO:tasks.workunit.client.0.smithi037.stdout:8/30: creat d5/f8 x:0 0 0 2024-04-25T17:18:54.743 INFO:tasks.workunit.client.0.smithi037.stdout:0/55: creat d9/df/f13 x:0 0 0 2024-04-25T17:18:54.744 INFO:tasks.workunit.client.0.smithi037.stdout:0/56: readlink d9/ld 0 2024-04-25T17:18:54.747 INFO:tasks.workunit.client.0.smithi037.stdout:7/42: mknod d5/ce 0 2024-04-25T17:18:54.749 INFO:tasks.workunit.client.0.smithi037.stdout:5/137: link d7/fc d7/d12/f2d 0 2024-04-25T17:18:54.750 INFO:tasks.workunit.client.0.smithi037.stdout:9/173: dwrite d1/f13 [0,4194304] 0 2024-04-25T17:18:54.751 INFO:tasks.workunit.client.0.smithi037.stdout:8/31: creat d5/f9 x:0 0 0 2024-04-25T17:18:54.752 INFO:tasks.workunit.client.0.smithi037.stdout:8/32: write d5/f9 [338629,126288] 0 2024-04-25T17:18:54.759 INFO:tasks.workunit.client.0.smithi037.stdout:0/57: mkdir d9/d14 0 2024-04-25T17:18:54.766 INFO:tasks.workunit.client.0.smithi037.stdout:4/140: dwrite d7/d29/f1b [0,4194304] 0 2024-04-25T17:18:54.770 INFO:tasks.workunit.client.0.smithi037.stdout:8/33: mkdir d5/da 0 2024-04-25T17:18:54.778 INFO:tasks.workunit.client.0.smithi037.stdout:0/58: symlink d9/l15 0 2024-04-25T17:18:54.780 INFO:tasks.workunit.client.0.smithi037.stdout:7/43: fsync f3 0 2024-04-25T17:18:54.784 INFO:tasks.workunit.client.0.smithi037.stdout:9/174: getdents d1/d5/dc/d38 0 2024-04-25T17:18:54.786 INFO:tasks.workunit.client.0.smithi037.stdout:4/141: creat d7/f2f x:0 0 0 2024-04-25T17:18:54.790 INFO:tasks.workunit.client.0.smithi037.stdout:6/79: link db/ff db/f14 0 2024-04-25T17:18:54.793 INFO:tasks.workunit.client.0.smithi037.stdout:2/40: getdents d0 0 2024-04-25T17:18:54.793 INFO:tasks.workunit.client.0.smithi037.stdout:2/41: read - d0/fd zero size 2024-04-25T17:18:54.798 INFO:tasks.workunit.client.0.smithi037.stdout:7/44: symlink d5/lf 0 2024-04-25T17:18:54.799 INFO:tasks.workunit.client.0.smithi037.stdout:9/175: creat d1/d21/f39 x:0 0 0 2024-04-25T17:18:54.801 INFO:tasks.workunit.client.0.smithi037.stdout:4/142: creat d7/d29/d1e/f30 x:0 0 0 2024-04-25T17:18:54.804 INFO:tasks.workunit.client.0.smithi037.stdout:6/80: rename f1 to db/f15 0 2024-04-25T17:18:54.807 INFO:tasks.workunit.client.0.smithi037.stdout:2/42: write d0/f5 [214982,38117] 0 2024-04-25T17:18:54.808 INFO:tasks.workunit.client.0.smithi037.stdout:5/138: dwrite f1 [0,4194304] 0 2024-04-25T17:18:54.809 INFO:tasks.workunit.client.0.smithi037.stdout:0/59: creat d9/d14/f16 x:0 0 0 2024-04-25T17:18:54.811 INFO:tasks.workunit.client.0.smithi037.stdout:0/60: write d9/fb [3221729,66147] 0 2024-04-25T17:18:54.841 INFO:tasks.workunit.client.0.smithi037.stdout:4/143: rename d7/c28 to d7/d29/d1e/c31 0 2024-04-25T17:18:54.841 INFO:tasks.workunit.client.0.smithi037.stdout:4/144: chown d7/f2a 27756891 1 2024-04-25T17:18:54.843 INFO:tasks.workunit.client.0.smithi037.stdout:8/34: write f4 [2898307,29842] 0 2024-04-25T17:18:54.844 INFO:tasks.workunit.client.0.smithi037.stdout:5/139: mkdir d7/d12/d15/d2e 0 2024-04-25T17:18:54.844 INFO:tasks.workunit.client.0.smithi037.stdout:8/35: read d5/f9 [356662,61975] 0 2024-04-25T17:18:54.848 INFO:tasks.workunit.client.0.smithi037.stdout:0/61: mkdir d9/df/d17 0 2024-04-25T17:18:54.854 INFO:tasks.workunit.client.0.smithi037.stdout:4/145: dread - d7/d29/f25 zero size 2024-04-25T17:18:54.859 INFO:tasks.workunit.client.0.smithi037.stdout:5/140: symlink d7/d12/d15/l2f 0 2024-04-25T17:18:54.862 INFO:tasks.workunit.client.0.smithi037.stdout:8/36: mkdir d5/db 0 2024-04-25T17:18:54.872 INFO:tasks.workunit.client.0.smithi037.stdout:0/62: dwrite d9/fa [0,4194304] 0 2024-04-25T17:18:54.873 INFO:tasks.workunit.client.0.smithi037.stdout:0/63: fsync f2 0 2024-04-25T17:18:54.874 INFO:tasks.workunit.client.0.smithi037.stdout:2/43: link d0/la d0/le 0 2024-04-25T17:18:54.874 INFO:tasks.workunit.client.0.smithi037.stdout:0/64: chown c8 605041352 1 2024-04-25T17:18:54.875 INFO:tasks.workunit.client.0.smithi037.stdout:2/44: write d0/f5 [958596,121687] 0 2024-04-25T17:18:54.879 INFO:tasks.workunit.client.0.smithi037.stdout:0/65: dread f2 [0,4194304] 0 2024-04-25T17:18:54.881 INFO:tasks.workunit.client.0.smithi037.stdout:0/66: truncate f6 5081948 0 2024-04-25T17:18:54.882 INFO:tasks.workunit.client.0.smithi037.stdout:0/67: truncate f7 4851335 0 2024-04-25T17:18:54.887 INFO:tasks.workunit.client.0.smithi037.stdout:9/176: dwrite d1/d5/f28 [0,4194304] 0 2024-04-25T17:18:54.889 INFO:tasks.workunit.client.0.smithi037.stdout:9/177: fsync d1/d5/dc/f27 0 2024-04-25T17:18:54.889 INFO:tasks.workunit.client.0.smithi037.stdout:9/178: stat d1/d21/l2b 0 2024-04-25T17:18:54.892 INFO:tasks.workunit.client.0.smithi037.stdout:2/45: mknod d0/cf 0 2024-04-25T17:18:54.894 INFO:tasks.workunit.client.0.smithi037.stdout:9/179: dread d1/d5/dc/f27 [0,4194304] 0 2024-04-25T17:18:54.895 INFO:tasks.workunit.client.0.smithi037.stdout:8/37: creat d5/db/fc x:0 0 0 2024-04-25T17:18:54.897 INFO:tasks.workunit.client.0.smithi037.stdout:8/38: write d5/db/fc [133240,85018] 0 2024-04-25T17:18:54.901 INFO:tasks.workunit.client.0.smithi037.stdout:0/68: mknod d9/d14/c18 0 2024-04-25T17:18:54.901 INFO:tasks.workunit.client.0.smithi037.stdout:2/46: dwrite d0/fd [0,4194304] 0 2024-04-25T17:18:54.903 INFO:tasks.workunit.client.0.smithi037.stdout:2/47: truncate d0/f7 487612 0 2024-04-25T17:18:54.908 INFO:tasks.workunit.client.0.smithi037.stdout:4/146: getdents d7/d29 0 2024-04-25T17:18:54.911 INFO:tasks.workunit.client.0.smithi037.stdout:7/45: truncate f0 1341117 0 2024-04-25T17:18:54.915 INFO:tasks.workunit.client.0.smithi037.stdout:9/180: creat d1/d5/dc/d38/f3a x:0 0 0 2024-04-25T17:18:54.916 INFO:tasks.workunit.client.0.smithi037.stdout:9/181: read - d1/d21/f39 zero size 2024-04-25T17:18:55.020 INFO:tasks.workunit.client.0.smithi037.stdout:9/182: mknod d1/d5/c3b 0 2024-04-25T17:18:55.020 INFO:tasks.workunit.client.0.smithi037.stdout:8/39: link c3 d5/da/cd 0 2024-04-25T17:18:55.021 INFO:tasks.workunit.client.0.smithi037.stdout:6/81: dwrite db/ff [0,4194304] 0 2024-04-25T17:18:55.023 INFO:tasks.workunit.client.0.smithi037.stdout:4/147: mknod d7/d29/c32 0 2024-04-25T17:18:55.024 INFO:tasks.workunit.client.0.smithi037.stdout:7/46: truncate f1 13374 0 2024-04-25T17:18:55.026 INFO:tasks.workunit.client.0.smithi037.stdout:7/47: readlink d5/l7 0 2024-04-25T17:18:55.027 INFO:tasks.workunit.client.0.smithi037.stdout:6/82: creat db/f16 x:0 0 0 2024-04-25T17:18:55.030 INFO:tasks.workunit.client.0.smithi037.stdout:9/183: fdatasync d1/d5/dc/f10 0 2024-04-25T17:18:55.033 INFO:tasks.workunit.client.0.smithi037.stdout:2/48: dwrite d0/fc [0,4194304] 0 2024-04-25T17:18:55.035 INFO:tasks.workunit.client.0.smithi037.stdout:8/40: dwrite d5/f8 [0,4194304] 0 2024-04-25T17:18:55.035 INFO:tasks.workunit.client.0.smithi037.stdout:9/184: write d1/f37 [45181,83493] 0 2024-04-25T17:18:55.035 INFO:tasks.workunit.client.0.smithi037.stdout:7/48: rmdir d5 39 2024-04-25T17:18:55.035 INFO:tasks.workunit.client.0.smithi037.stdout:8/41: chown d5/db 200640 1 2024-04-25T17:18:55.037 INFO:tasks.workunit.client.0.smithi037.stdout:8/42: chown d5/f8 1647145 1 2024-04-25T17:18:55.043 INFO:tasks.workunit.client.0.smithi037.stdout:6/83: creat db/f17 x:0 0 0 2024-04-25T17:18:55.043 INFO:tasks.workunit.client.0.smithi037.stdout:6/84: chown db/fd 121590 1 2024-04-25T17:18:55.046 INFO:tasks.workunit.client.0.smithi037.stdout:2/49: rmdir d0 39 2024-04-25T17:18:55.048 INFO:tasks.workunit.client.0.smithi037.stdout:7/49: write d5/f8 [1016513,840] 0 2024-04-25T17:18:55.052 INFO:tasks.workunit.client.0.smithi037.stdout:9/185: mkdir d1/d5/dc/d3c 0 2024-04-25T17:18:55.054 INFO:tasks.workunit.client.0.smithi037.stdout:8/43: creat d5/fe x:0 0 0 2024-04-25T17:18:55.055 INFO:tasks.workunit.client.0.smithi037.stdout:8/44: fsync d5/db/fc 0 2024-04-25T17:18:55.056 INFO:tasks.workunit.client.0.smithi037.stdout:7/50: dwrite d5/f9 [0,4194304] 0 2024-04-25T17:18:55.058 INFO:tasks.workunit.client.0.smithi037.stdout:2/50: dread - d0/f9 zero size 2024-04-25T17:18:55.058 INFO:tasks.workunit.client.0.smithi037.stdout:2/51: dread - d0/f9 zero size 2024-04-25T17:18:55.059 INFO:tasks.workunit.client.0.smithi037.stdout:2/52: fdatasync d0/f7 0 2024-04-25T17:18:55.062 INFO:tasks.workunit.client.0.smithi037.stdout:9/186: mkdir d1/d5/dc/d38/d3d 0 2024-04-25T17:18:55.066 INFO:tasks.workunit.client.0.smithi037.stdout:8/45: chown c3 118854 1 2024-04-25T17:18:55.067 INFO:tasks.workunit.client.0.smithi037.stdout:7/51: symlink d5/l10 0 2024-04-25T17:18:55.071 INFO:tasks.workunit.client.0.smithi037.stdout:2/53: chown d0/le 15625561 1 2024-04-25T17:18:55.073 INFO:tasks.workunit.client.0.smithi037.stdout:2/54: dread d0/f5 [0,4194304] 0 2024-04-25T17:18:55.077 INFO:tasks.workunit.client.0.smithi037.stdout:7/52: unlink d5/lf 0 2024-04-25T17:18:55.081 INFO:tasks.workunit.client.0.smithi037.stdout:2/55: mknod d0/c10 0 2024-04-25T17:18:55.092 INFO:tasks.workunit.client.0.smithi037.stdout:2/56: symlink d0/l11 0 2024-04-25T17:18:55.096 INFO:tasks.workunit.client.0.smithi037.stdout:9/187: getdents d1/d5 0 2024-04-25T17:18:55.103 INFO:tasks.workunit.client.0.smithi037.stdout:2/57: dwrite d0/f5 [0,4194304] 0 2024-04-25T17:18:55.104 INFO:tasks.workunit.client.0.smithi037.stdout:2/58: truncate d0/f9 1019027 0 2024-04-25T17:18:55.105 INFO:tasks.workunit.client.0.smithi037.stdout:2/59: readlink d0/la 0 2024-04-25T17:18:55.110 INFO:tasks.workunit.client.0.smithi037.stdout:2/60: dread d0/f5 [0,4194304] 0 2024-04-25T17:18:55.113 INFO:tasks.workunit.client.0.smithi037.stdout:2/61: dread d0/f5 [0,4194304] 0 2024-04-25T17:18:55.116 INFO:tasks.workunit.client.0.smithi037.stdout:2/62: dread d0/f5 [0,4194304] 0 2024-04-25T17:18:55.119 INFO:tasks.workunit.client.0.smithi037.stdout:2/63: fdatasync d0/f5 0 2024-04-25T17:18:55.186 INFO:tasks.workunit.client.0.smithi037.stdout:3/43: sync 2024-04-25T17:18:55.187 INFO:tasks.workunit.client.0.smithi037.stdout:3/44: dread - d8/ff zero size 2024-04-25T17:18:55.187 INFO:tasks.workunit.client.0.smithi037.stdout:3/45: write d8/f10 [848421,92889] 0 2024-04-25T17:18:55.188 INFO:tasks.workunit.client.0.smithi037.stdout:3/46: stat d8/fd 0 2024-04-25T17:18:55.188 INFO:tasks.workunit.client.0.smithi037.stdout:3/47: chown d8/lc 35281099 1 2024-04-25T17:18:55.190 INFO:tasks.workunit.client.0.smithi037.stdout:3/48: mkdir d8/d11 0 2024-04-25T17:18:55.196 INFO:tasks.workunit.client.0.smithi037.stdout:3/49: dwrite d8/ff [0,4194304] 0 2024-04-25T17:18:55.351 INFO:tasks.workunit.client.0.smithi037.stdout:6/85: getdents db 0 2024-04-25T17:18:55.352 INFO:tasks.workunit.client.0.smithi037.stdout:6/86: dread - db/f11 zero size 2024-04-25T17:18:55.352 INFO:tasks.workunit.client.0.smithi037.stdout:4/148: dwrite d7/ff [0,4194304] 0 2024-04-25T17:18:55.355 INFO:tasks.workunit.client.0.smithi037.stdout:4/149: unlink d7/l14 0 2024-04-25T17:18:55.356 INFO:tasks.workunit.client.0.smithi037.stdout:6/87: mknod db/c18 0 2024-04-25T17:18:55.361 INFO:tasks.workunit.client.0.smithi037.stdout:6/88: creat db/f19 x:0 0 0 2024-04-25T17:18:55.363 INFO:tasks.workunit.client.0.smithi037.stdout:4/150: dwrite f3 [0,4194304] 0 2024-04-25T17:18:55.364 INFO:tasks.workunit.client.0.smithi037.stdout:6/89: creat db/f1a x:0 0 0 2024-04-25T17:18:55.387 INFO:tasks.workunit.client.0.smithi037.stdout:2/64: write d0/f5 [4457007,128928] 0 2024-04-25T17:18:55.389 INFO:tasks.workunit.client.0.smithi037.stdout:2/65: mknod d0/c12 0 2024-04-25T17:18:55.392 INFO:tasks.workunit.client.0.smithi037.stdout:2/66: unlink d0/fc 0 2024-04-25T17:18:55.392 INFO:tasks.workunit.client.0.smithi037.stdout:2/67: readlink d0/l3 0 2024-04-25T17:18:55.393 INFO:tasks.workunit.client.0.smithi037.stdout:2/68: readlink d0/l11 0 2024-04-25T17:18:55.395 INFO:tasks.workunit.client.0.smithi037.stdout:2/69: dread d0/f9 [0,4194304] 0 2024-04-25T17:18:55.415 INFO:tasks.workunit.client.0.smithi037.stdout:7/53: dwrite f1 [0,4194304] 0 2024-04-25T17:18:55.416 INFO:tasks.workunit.client.0.smithi037.stdout:7/54: write d5/f9 [2421463,86888] 0 2024-04-25T17:18:55.422 INFO:tasks.workunit.client.0.smithi037.stdout:6/90: rmdir db 39 2024-04-25T17:18:55.425 INFO:tasks.workunit.client.0.smithi037.stdout:7/55: dwrite f1 [0,4194304] 0 2024-04-25T17:18:55.432 INFO:tasks.workunit.client.0.smithi037.stdout:4/151: dwrite d7/f2a [0,4194304] 0 2024-04-25T17:18:55.432 INFO:tasks.workunit.client.0.smithi037.stdout:7/56: read f0 [647728,54954] 0 2024-04-25T17:18:55.438 INFO:tasks.workunit.client.0.smithi037.stdout:7/57: fdatasync f3 0 2024-04-25T17:18:55.438 INFO:tasks.workunit.client.0.smithi037.stdout:7/58: chown f4 6633 1 2024-04-25T17:18:55.439 INFO:tasks.workunit.client.0.smithi037.stdout:7/59: read f1 [2544700,89490] 0 2024-04-25T17:18:55.440 INFO:tasks.workunit.client.0.smithi037.stdout:4/152: symlink d7/d29/l33 0 2024-04-25T17:18:55.441 INFO:tasks.workunit.client.0.smithi037.stdout:7/60: truncate d5/f8 1023856 0 2024-04-25T17:18:55.444 INFO:tasks.workunit.client.0.smithi037.stdout:4/153: creat d7/f34 x:0 0 0 2024-04-25T17:18:55.451 INFO:tasks.workunit.client.0.smithi037.stdout:4/154: mkdir d7/d29/d1e/d2b/d35 0 2024-04-25T17:18:55.457 INFO:tasks.workunit.client.0.smithi037.stdout:6/91: write db/f15 [8101559,124952] 0 2024-04-25T17:18:55.461 INFO:tasks.workunit.client.0.smithi037.stdout:6/92: creat db/f1b x:0 0 0 2024-04-25T17:18:55.463 INFO:tasks.workunit.client.0.smithi037.stdout:6/93: creat db/f1c x:0 0 0 2024-04-25T17:18:55.469 INFO:tasks.workunit.client.0.smithi037.stdout:7/61: dwrite f3 [0,4194304] 0 2024-04-25T17:18:55.469 INFO:tasks.workunit.client.0.smithi037.stdout:7/62: chown d5 290 1 2024-04-25T17:18:55.470 INFO:tasks.workunit.client.0.smithi037.stdout:4/155: write d7/f10 [393619,6555] 0 2024-04-25T17:18:55.475 INFO:tasks.workunit.client.0.smithi037.stdout:7/63: link d5/l10 d5/l11 0 2024-04-25T17:18:55.477 INFO:tasks.workunit.client.0.smithi037.stdout:4/156: creat d7/d29/d1e/d2b/d35/f36 x:0 0 0 2024-04-25T17:18:55.478 INFO:tasks.workunit.client.0.smithi037.stdout:7/64: read d5/f8 [897523,94774] 0 2024-04-25T17:18:55.478 INFO:tasks.workunit.client.0.smithi037.stdout:4/157: fdatasync d7/d29/f1b 0 2024-04-25T17:18:55.478 INFO:tasks.workunit.client.0.smithi037.stdout:6/94: rmdir db 39 2024-04-25T17:18:55.479 INFO:tasks.workunit.client.0.smithi037.stdout:6/95: chown f3 240854913 1 2024-04-25T17:18:55.486 INFO:tasks.workunit.client.0.smithi037.stdout:7/65: link d5/l7 d5/l12 0 2024-04-25T17:18:55.490 INFO:tasks.workunit.client.0.smithi037.stdout:6/96: dwrite db/f12 [0,4194304] 0 2024-04-25T17:18:55.491 INFO:tasks.workunit.client.0.smithi037.stdout:6/97: write db/f1c [1037794,47618] 0 2024-04-25T17:18:55.492 INFO:tasks.workunit.client.0.smithi037.stdout:7/66: creat d5/f13 x:0 0 0 2024-04-25T17:18:55.495 INFO:tasks.workunit.client.0.smithi037.stdout:7/67: dread f0 [0,4194304] 0 2024-04-25T17:18:55.506 INFO:tasks.workunit.client.0.smithi037.stdout:6/98: dwrite db/f1a [0,4194304] 0 2024-04-25T17:18:55.509 INFO:tasks.workunit.client.0.smithi037.stdout:4/158: dwrite d7/fb [0,4194304] 0 2024-04-25T17:18:55.511 INFO:tasks.workunit.client.0.smithi037.stdout:7/68: dwrite f1 [0,4194304] 0 2024-04-25T17:18:55.514 INFO:tasks.workunit.client.0.smithi037.stdout:1/42: sync 2024-04-25T17:18:55.514 INFO:tasks.workunit.client.0.smithi037.stdout:4/159: mknod d7/d29/d1e/d2b/d35/c37 0 2024-04-25T17:18:55.518 INFO:tasks.workunit.client.0.smithi037.stdout:7/69: mkdir d5/d14 0 2024-04-25T17:18:55.521 INFO:tasks.workunit.client.0.smithi037.stdout:4/160: mkdir d7/d29/d1e/d2b/d38 0 2024-04-25T17:18:55.522 INFO:tasks.workunit.client.0.smithi037.stdout:7/70: readlink d5/l12 0 2024-04-25T17:18:55.524 INFO:tasks.workunit.client.0.smithi037.stdout:1/43: creat dc/fe x:0 0 0 2024-04-25T17:18:55.525 INFO:tasks.workunit.client.0.smithi037.stdout:4/161: mkdir d7/d29/d1e/d2b/d35/d39 0 2024-04-25T17:18:55.527 INFO:tasks.workunit.client.0.smithi037.stdout:4/162: write d7/f2f [977732,67315] 0 2024-04-25T17:18:55.527 INFO:tasks.workunit.client.0.smithi037.stdout:7/71: mkdir d5/d15 0 2024-04-25T17:18:55.529 INFO:tasks.workunit.client.0.smithi037.stdout:1/44: creat dc/ff x:0 0 0 2024-04-25T17:18:55.541 INFO:tasks.workunit.client.0.smithi037.stdout:4/163: rmdir d7/d29/d1e/d2b/d35 39 2024-04-25T17:18:55.545 INFO:tasks.workunit.client.0.smithi037.stdout:1/45: getdents dc 0 2024-04-25T17:18:55.545 INFO:tasks.workunit.client.0.smithi037.stdout:1/46: read - dc/fe zero size 2024-04-25T17:18:55.547 INFO:tasks.workunit.client.0.smithi037.stdout:4/164: rmdir d7/d29/d1e/d2b/d38 0 2024-04-25T17:18:55.547 INFO:tasks.workunit.client.0.smithi037.stdout:4/165: fdatasync d7/f10 0 2024-04-25T17:18:55.548 INFO:tasks.workunit.client.0.smithi037.stdout:7/72: truncate d5/f6 3588174 0 2024-04-25T17:18:55.548 INFO:tasks.workunit.client.0.smithi037.stdout:4/166: write d7/f10 [1455653,64105] 0 2024-04-25T17:18:55.549 INFO:tasks.workunit.client.0.smithi037.stdout:7/73: fsync f1 0 2024-04-25T17:18:55.553 INFO:tasks.workunit.client.0.smithi037.stdout:4/167: dread f3 [0,4194304] 0 2024-04-25T17:18:55.555 INFO:tasks.workunit.client.0.smithi037.stdout:7/74: rename d5/l12 to d5/d15/l16 0 2024-04-25T17:18:55.562 INFO:tasks.workunit.client.0.smithi037.stdout:7/75: mkdir d5/d15/d17 0 2024-04-25T17:18:55.567 INFO:tasks.workunit.client.0.smithi037.stdout:4/168: link d7/f19 d7/d29/d1e/f3a 0 2024-04-25T17:18:55.569 INFO:tasks.workunit.client.0.smithi037.stdout:4/169: write d7/fe [1186151,129122] 0 2024-04-25T17:18:55.569 INFO:tasks.workunit.client.0.smithi037.stdout:7/76: mknod d5/d14/c18 0 2024-04-25T17:18:55.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:55 smithi037 ceph-mon[26472]: pgmap v28: 65 pgs: 65 active+clean; 343 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 22 MiB/s wr, 255 op/s 2024-04-25T17:18:55.575 INFO:tasks.workunit.client.0.smithi037.stdout:1/47: dwrite dc/fd [0,4194304] 0 2024-04-25T17:18:55.582 INFO:tasks.workunit.client.0.smithi037.stdout:4/170: link d7/f10 d7/f3b 0 2024-04-25T17:18:55.586 INFO:tasks.workunit.client.0.smithi037.stdout:1/48: creat dc/f10 x:0 0 0 2024-04-25T17:18:55.586 INFO:tasks.workunit.client.0.smithi037.stdout:7/77: write f0 [626486,1689] 0 2024-04-25T17:18:55.587 INFO:tasks.workunit.client.0.smithi037.stdout:1/49: truncate dc/fe 822504 0 2024-04-25T17:18:55.588 INFO:tasks.workunit.client.0.smithi037.stdout:4/171: dread d7/f1a [0,4194304] 0 2024-04-25T17:18:55.589 INFO:tasks.workunit.client.0.smithi037.stdout:4/172: chown d7/fd 1 1 2024-04-25T17:18:55.590 INFO:tasks.workunit.client.0.smithi037.stdout:1/50: mknod dc/c11 0 2024-04-25T17:18:55.590 INFO:tasks.workunit.client.0.smithi037.stdout:4/173: chown d7/d29/c32 304975 1 2024-04-25T17:18:55.592 INFO:tasks.workunit.client.0.smithi037.stdout:7/78: rename d5/f8 to d5/d15/f19 0 2024-04-25T17:18:55.595 INFO:tasks.workunit.client.0.smithi037.stdout:4/174: rename d7/d29/f1b to d7/d29/f3c 0 2024-04-25T17:18:55.596 INFO:tasks.workunit.client.0.smithi037.stdout:7/79: dread f1 [0,4194304] 0 2024-04-25T17:18:55.598 INFO:tasks.workunit.client.0.smithi037.stdout:1/51: link l4 dc/l12 0 2024-04-25T17:18:55.599 INFO:tasks.workunit.client.0.smithi037.stdout:7/80: symlink d5/d14/l1a 0 2024-04-25T17:18:55.602 INFO:tasks.workunit.client.0.smithi037.stdout:1/52: creat dc/f13 x:0 0 0 2024-04-25T17:18:55.603 INFO:tasks.workunit.client.0.smithi037.stdout:1/53: truncate dc/f13 402683 0 2024-04-25T17:18:55.613 INFO:tasks.workunit.client.0.smithi037.stdout:4/175: write d7/f9 [5240937,122897] 0 2024-04-25T17:18:55.618 INFO:tasks.workunit.client.0.smithi037.stdout:4/176: unlink d7/d29/d1e/c31 0 2024-04-25T17:18:55.621 INFO:tasks.workunit.client.0.smithi037.stdout:7/81: write d5/d15/f19 [1645928,124947] 0 2024-04-25T17:18:55.626 INFO:tasks.workunit.client.0.smithi037.stdout:4/177: write d7/f3b [2545155,98014] 0 2024-04-25T17:18:55.626 INFO:tasks.workunit.client.0.smithi037.stdout:1/54: dwrite fa [0,4194304] 0 2024-04-25T17:18:55.627 INFO:tasks.workunit.client.0.smithi037.stdout:1/55: fdatasync f5 0 2024-04-25T17:18:55.628 INFO:tasks.workunit.client.0.smithi037.stdout:7/82: mkdir d5/d15/d17/d1b 0 2024-04-25T17:18:55.629 INFO:tasks.workunit.client.0.smithi037.stdout:9/188: sync 2024-04-25T17:18:55.629 INFO:tasks.workunit.client.0.smithi037.stdout:0/69: sync 2024-04-25T17:18:55.629 INFO:tasks.workunit.client.0.smithi037.stdout:5/141: sync 2024-04-25T17:18:55.629 INFO:tasks.workunit.client.0.smithi037.stdout:8/46: sync 2024-04-25T17:18:55.631 INFO:tasks.workunit.client.0.smithi037.stdout:9/189: dread - d1/d21/f22 zero size 2024-04-25T17:18:55.631 INFO:tasks.workunit.client.0.smithi037.stdout:0/70: dread - d9/d14/f16 zero size 2024-04-25T17:18:55.632 INFO:tasks.workunit.client.0.smithi037.stdout:4/178: creat d7/d29/f3d x:0 0 0 2024-04-25T17:18:55.634 INFO:tasks.workunit.client.0.smithi037.stdout:7/83: creat d5/d15/d17/f1c x:0 0 0 2024-04-25T17:18:55.635 INFO:tasks.workunit.client.0.smithi037.stdout:5/142: fdatasync d7/f17 0 2024-04-25T17:18:55.637 INFO:tasks.workunit.client.0.smithi037.stdout:1/56: link f5 dc/f14 0 2024-04-25T17:18:55.647 INFO:tasks.workunit.client.0.smithi037.stdout:5/143: creat d7/d12/d15/f30 x:0 0 0 2024-04-25T17:18:55.648 INFO:tasks.workunit.client.0.smithi037.stdout:9/190: write d1/d5/f12 [2078135,120555] 0 2024-04-25T17:18:55.650 INFO:tasks.workunit.client.0.smithi037.stdout:4/179: write d7/f13 [4514906,31897] 0 2024-04-25T17:18:55.653 INFO:tasks.workunit.client.0.smithi037.stdout:0/71: link d9/df/f13 d9/f19 0 2024-04-25T17:18:55.655 INFO:tasks.workunit.client.0.smithi037.stdout:0/72: dread f7 [4194304,4194304] 0 2024-04-25T17:18:55.655 INFO:tasks.workunit.client.0.smithi037.stdout:7/84: link d5/f9 d5/d15/d17/d1b/f1d 0 2024-04-25T17:18:55.658 INFO:tasks.workunit.client.0.smithi037.stdout:5/144: dread d7/d12/f2d [0,4194304] 0 2024-04-25T17:18:55.659 INFO:tasks.workunit.client.0.smithi037.stdout:1/57: rename dc/f14 to dc/f15 0 2024-04-25T17:18:55.660 INFO:tasks.workunit.client.0.smithi037.stdout:7/85: dread f3 [0,4194304] 0 2024-04-25T17:18:55.661 INFO:tasks.workunit.client.0.smithi037.stdout:8/47: getdents d5/db 0 2024-04-25T17:18:55.662 INFO:tasks.workunit.client.0.smithi037.stdout:8/48: fsync d5/fe 0 2024-04-25T17:18:55.666 INFO:tasks.workunit.client.0.smithi037.stdout:8/49: dread d5/f8 [0,4194304] 0 2024-04-25T17:18:55.667 INFO:tasks.workunit.client.0.smithi037.stdout:0/73: creat d9/d14/f1a x:0 0 0 2024-04-25T17:18:55.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:55 smithi069 ceph-mon[34527]: pgmap v28: 65 pgs: 65 active+clean; 343 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 22 MiB/s wr, 255 op/s 2024-04-25T17:18:55.670 INFO:tasks.workunit.client.0.smithi037.stdout:9/191: mkdir d1/d5/dc/d3c/d3e 0 2024-04-25T17:18:55.674 INFO:tasks.workunit.client.0.smithi037.stdout:9/192: write d1/f13 [9283354,18568] 0 2024-04-25T17:18:55.674 INFO:tasks.workunit.client.0.smithi037.stdout:1/58: creat dc/f16 x:0 0 0 2024-04-25T17:18:55.675 INFO:tasks.workunit.client.0.smithi037.stdout:8/50: dwrite d5/fe [0,4194304] 0 2024-04-25T17:18:55.677 INFO:tasks.workunit.client.0.smithi037.stdout:1/59: read fb [3292802,62795] 0 2024-04-25T17:18:55.679 INFO:tasks.workunit.client.0.smithi037.stdout:9/193: write d1/d21/d1c/f35 [1364755,35060] 0 2024-04-25T17:18:55.679 INFO:tasks.workunit.client.0.smithi037.stdout:0/74: dwrite d9/fb [0,4194304] 0 2024-04-25T17:18:55.689 INFO:tasks.workunit.client.0.smithi037.stdout:1/60: symlink dc/l17 0 2024-04-25T17:18:55.694 INFO:tasks.workunit.client.0.smithi037.stdout:5/145: rename d7/fe to d7/d12/f31 0 2024-04-25T17:18:55.694 INFO:tasks.workunit.client.0.smithi037.stdout:7/86: link d5/f9 d5/d15/f1e 0 2024-04-25T17:18:55.698 INFO:tasks.workunit.client.0.smithi037.stdout:8/51: creat d5/da/ff x:0 0 0 2024-04-25T17:18:55.701 INFO:tasks.workunit.client.0.smithi037.stdout:9/194: mkdir d1/d5/dc/d38/d3d/d3f 0 2024-04-25T17:18:55.708 INFO:tasks.workunit.client.0.smithi037.stdout:7/87: creat d5/d15/f1f x:0 0 0 2024-04-25T17:18:55.710 INFO:tasks.workunit.client.0.smithi037.stdout:8/52: symlink d5/da/l10 0 2024-04-25T17:18:55.712 INFO:tasks.workunit.client.0.smithi037.stdout:7/88: dread f3 [0,4194304] 0 2024-04-25T17:18:55.712 INFO:tasks.workunit.client.0.smithi037.stdout:7/89: read - d5/d15/d17/f1c zero size 2024-04-25T17:18:55.714 INFO:tasks.workunit.client.0.smithi037.stdout:0/75: write d9/f19 [461400,97177] 0 2024-04-25T17:18:55.715 INFO:tasks.workunit.client.0.smithi037.stdout:9/195: symlink d1/d5/l40 0 2024-04-25T17:18:55.717 INFO:tasks.workunit.client.0.smithi037.stdout:5/146: truncate d7/d18/f2a 353313 0 2024-04-25T17:18:55.719 INFO:tasks.workunit.client.0.smithi037.stdout:8/53: creat d5/da/f11 x:0 0 0 2024-04-25T17:18:55.721 INFO:tasks.workunit.client.0.smithi037.stdout:8/54: write d5/fe [4233020,64415] 0 2024-04-25T17:18:55.722 INFO:tasks.workunit.client.0.smithi037.stdout:8/55: chown d5/db 8034095 1 2024-04-25T17:18:55.722 INFO:tasks.workunit.client.0.smithi037.stdout:8/56: chown d5 2579 1 2024-04-25T17:18:55.723 INFO:tasks.workunit.client.0.smithi037.stdout:8/57: chown c3 0 1 2024-04-25T17:18:55.723 INFO:tasks.workunit.client.0.smithi037.stdout:5/147: dwrite d7/d12/f19 [0,4194304] 0 2024-04-25T17:18:55.724 INFO:tasks.workunit.client.0.smithi037.stdout:7/90: creat d5/d15/d17/f20 x:0 0 0 2024-04-25T17:18:55.727 INFO:tasks.workunit.client.0.smithi037.stdout:9/196: read - d1/d5/dc/f2d zero size 2024-04-25T17:18:55.728 INFO:tasks.workunit.client.0.smithi037.stdout:1/61: write dc/f15 [783116,71199] 0 2024-04-25T17:18:55.729 INFO:tasks.workunit.client.0.smithi037.stdout:1/62: fdatasync dc/f16 0 2024-04-25T17:18:55.734 INFO:tasks.workunit.client.0.smithi037.stdout:7/91: unlink d5/ce 0 2024-04-25T17:18:55.735 INFO:tasks.workunit.client.0.smithi037.stdout:9/197: dwrite d1/f16 [0,4194304] 0 2024-04-25T17:18:55.738 INFO:tasks.workunit.client.0.smithi037.stdout:8/58: dread d5/f8 [0,4194304] 0 2024-04-25T17:18:55.741 INFO:tasks.workunit.client.0.smithi037.stdout:0/76: mknod d9/df/d17/c1b 0 2024-04-25T17:18:55.744 INFO:tasks.workunit.client.0.smithi037.stdout:1/63: mkdir dc/d18 0 2024-04-25T17:18:55.750 INFO:tasks.workunit.client.0.smithi037.stdout:5/148: link d7/d12/d15/f30 d7/d12/d15/f32 0 2024-04-25T17:18:55.752 INFO:tasks.workunit.client.0.smithi037.stdout:8/59: creat d5/db/f12 x:0 0 0 2024-04-25T17:18:55.753 INFO:tasks.workunit.client.0.smithi037.stdout:8/60: chown d5/da/ff 19609319 1 2024-04-25T17:18:55.753 INFO:tasks.workunit.client.0.smithi037.stdout:0/77: creat d9/d14/f1c x:0 0 0 2024-04-25T17:18:55.757 INFO:tasks.workunit.client.0.smithi037.stdout:1/64: mknod dc/c19 0 2024-04-25T17:18:55.757 INFO:tasks.workunit.client.0.smithi037.stdout:8/61: dread d5/f8 [0,4194304] 0 2024-04-25T17:18:55.758 INFO:tasks.workunit.client.0.smithi037.stdout:1/65: read - dc/f10 zero size 2024-04-25T17:18:55.759 INFO:tasks.workunit.client.0.smithi037.stdout:7/92: fdatasync d5/d15/f1e 0 2024-04-25T17:18:55.760 INFO:tasks.workunit.client.0.smithi037.stdout:1/66: dread - dc/f16 zero size 2024-04-25T17:18:55.761 INFO:tasks.workunit.client.0.smithi037.stdout:7/93: chown d5/ca 0 1 2024-04-25T17:18:55.761 INFO:tasks.workunit.client.0.smithi037.stdout:0/78: dwrite f2 [0,4194304] 0 2024-04-25T17:18:55.766 INFO:tasks.workunit.client.0.smithi037.stdout:1/67: dwrite f8 [0,4194304] 0 2024-04-25T17:18:55.769 INFO:tasks.workunit.client.0.smithi037.stdout:8/62: mkdir d5/d13 0 2024-04-25T17:18:55.771 INFO:tasks.workunit.client.0.smithi037.stdout:8/63: dread - d5/db/f12 zero size 2024-04-25T17:18:55.775 INFO:tasks.workunit.client.0.smithi037.stdout:9/198: dwrite d1/f2 [0,4194304] 0 2024-04-25T17:18:55.778 INFO:tasks.workunit.client.0.smithi037.stdout:7/94: symlink d5/d14/l21 0 2024-04-25T17:18:55.782 INFO:tasks.workunit.client.0.smithi037.stdout:0/79: symlink d9/d14/l1d 0 2024-04-25T17:18:55.783 INFO:tasks.workunit.client.0.smithi037.stdout:8/64: dwrite d5/da/ff [0,4194304] 0 2024-04-25T17:18:55.792 INFO:tasks.workunit.client.0.smithi037.stdout:7/95: unlink d5/d14/l21 0 2024-04-25T17:18:55.795 INFO:tasks.workunit.client.0.smithi037.stdout:0/80: rename f6 to d9/df/d17/f1e 0 2024-04-25T17:18:55.803 INFO:tasks.workunit.client.0.smithi037.stdout:9/199: creat d1/d5/dc/d38/d3d/d3f/f41 x:0 0 0 2024-04-25T17:18:55.803 INFO:tasks.workunit.client.0.smithi037.stdout:3/50: sync 2024-04-25T17:18:55.806 INFO:tasks.workunit.client.0.smithi037.stdout:3/51: dread d8/fd [0,4194304] 0 2024-04-25T17:18:55.807 INFO:tasks.workunit.client.0.smithi037.stdout:8/65: rename d5/da/ff to d5/d13/f14 0 2024-04-25T17:18:55.808 INFO:tasks.workunit.client.0.smithi037.stdout:8/66: fdatasync d5/fe 0 2024-04-25T17:18:55.810 INFO:tasks.workunit.client.0.smithi037.stdout:0/81: mknod d9/c1f 0 2024-04-25T17:18:55.811 INFO:tasks.workunit.client.0.smithi037.stdout:0/82: write d9/df/f10 [188520,59924] 0 2024-04-25T17:18:55.824 INFO:tasks.workunit.client.0.smithi037.stdout:5/149: write f3 [70304,35022] 0 2024-04-25T17:18:55.825 INFO:tasks.workunit.client.0.smithi037.stdout:8/67: symlink d5/l15 0 2024-04-25T17:18:55.826 INFO:tasks.workunit.client.0.smithi037.stdout:1/68: truncate dc/f15 3059383 0 2024-04-25T17:18:55.831 INFO:tasks.workunit.client.0.smithi037.stdout:8/68: dwrite d5/fe [0,4194304] 0 2024-04-25T17:18:55.832 INFO:tasks.workunit.client.0.smithi037.stdout:3/52: getdents d8/d11 0 2024-04-25T17:18:55.840 INFO:tasks.workunit.client.0.smithi037.stdout:9/200: write d1/d21/d1c/f1d [5048911,6126] 0 2024-04-25T17:18:55.841 INFO:tasks.workunit.client.0.smithi037.stdout:3/53: symlink d8/l12 0 2024-04-25T17:18:55.842 INFO:tasks.workunit.client.0.smithi037.stdout:9/201: write d1/d5/dc/f27 [4110934,119665] 0 2024-04-25T17:18:55.853 INFO:tasks.workunit.client.0.smithi037.stdout:0/83: getdents d9/df/d17 0 2024-04-25T17:18:55.855 INFO:tasks.workunit.client.0.smithi037.stdout:3/54: symlink d8/d11/l13 0 2024-04-25T17:18:55.856 INFO:tasks.workunit.client.0.smithi037.stdout:9/202: creat d1/d5/dc/d3c/d3e/f42 x:0 0 0 2024-04-25T17:18:55.858 INFO:tasks.workunit.client.0.smithi037.stdout:9/203: truncate d1/d21/f31 4547352 0 2024-04-25T17:18:55.858 INFO:tasks.workunit.client.0.smithi037.stdout:0/84: creat d9/f20 x:0 0 0 2024-04-25T17:18:55.861 INFO:tasks.workunit.client.0.smithi037.stdout:3/55: symlink d8/l14 0 2024-04-25T17:18:55.864 INFO:tasks.workunit.client.0.smithi037.stdout:9/204: symlink d1/d5/d19/l43 0 2024-04-25T17:18:55.865 INFO:tasks.workunit.client.0.smithi037.stdout:9/205: chown d1/f4 1 1 2024-04-25T17:18:55.866 INFO:tasks.workunit.client.0.smithi037.stdout:3/56: dread d8/ff [0,4194304] 0 2024-04-25T17:18:55.871 INFO:tasks.workunit.client.0.smithi037.stdout:5/150: dwrite d7/d12/d15/f30 [0,4194304] 0 2024-04-25T17:18:55.873 INFO:tasks.workunit.client.0.smithi037.stdout:0/85: link f2 d9/df/f21 0 2024-04-25T17:18:55.873 INFO:tasks.workunit.client.0.smithi037.stdout:0/86: chown d9/fa 32487150 1 2024-04-25T17:18:55.874 INFO:tasks.workunit.client.0.smithi037.stdout:0/87: write d9/df/f10 [819843,89138] 0 2024-04-25T17:18:55.875 INFO:tasks.workunit.client.0.smithi037.stdout:0/88: chown d9/ld 18150 1 2024-04-25T17:18:55.877 INFO:tasks.workunit.client.0.smithi037.stdout:0/89: truncate d9/d14/f16 614239 0 2024-04-25T17:18:55.877 INFO:tasks.workunit.client.0.smithi037.stdout:9/206: mknod d1/d5/dc/d38/c44 0 2024-04-25T17:18:55.877 INFO:tasks.workunit.client.0.smithi037.stdout:0/90: fsync d9/df/f10 0 2024-04-25T17:18:55.878 INFO:tasks.workunit.client.0.smithi037.stdout:0/91: chown d9/df/d17 0 1 2024-04-25T17:18:55.881 INFO:tasks.workunit.client.0.smithi037.stdout:8/69: truncate d5/fe 545989 0 2024-04-25T17:18:55.882 INFO:tasks.workunit.client.0.smithi037.stdout:8/70: read d5/db/fc [154820,116555] 0 2024-04-25T17:18:55.883 INFO:tasks.workunit.client.0.smithi037.stdout:8/71: chown d5/f9 992 1 2024-04-25T17:18:55.883 INFO:tasks.workunit.client.0.smithi037.stdout:8/72: readlink d5/l15 0 2024-04-25T17:18:55.888 INFO:tasks.workunit.client.0.smithi037.stdout:5/151: creat d7/f33 x:0 0 0 2024-04-25T17:18:55.898 INFO:tasks.workunit.client.0.smithi037.stdout:0/92: creat d9/d14/f22 x:0 0 0 2024-04-25T17:18:55.908 INFO:tasks.workunit.client.0.smithi037.stdout:9/207: truncate d1/d5/dc/f23 248920 0 2024-04-25T17:18:55.912 INFO:tasks.workunit.client.0.smithi037.stdout:0/93: rename d9/df/d17 to d9/d14/d23 0 2024-04-25T17:18:55.913 INFO:tasks.workunit.client.0.smithi037.stdout:0/94: truncate d9/d14/f1c 202273 0 2024-04-25T17:18:55.913 INFO:tasks.workunit.client.0.smithi037.stdout:0/95: chown d9/d14/c18 26 1 2024-04-25T17:18:55.915 INFO:tasks.workunit.client.0.smithi037.stdout:0/96: dread d9/d14/f1c [0,4194304] 0 2024-04-25T17:18:55.917 INFO:tasks.workunit.client.0.smithi037.stdout:5/152: creat d7/d12/d15/d2e/f34 x:0 0 0 2024-04-25T17:18:55.923 INFO:tasks.workunit.client.0.smithi037.stdout:5/153: dwrite d7/f33 [0,4194304] 0 2024-04-25T17:18:55.924 INFO:tasks.workunit.client.0.smithi037.stdout:5/154: write d7/d12/d15/d2e/f34 [220436,93581] 0 2024-04-25T17:18:55.925 INFO:tasks.workunit.client.0.smithi037.stdout:0/97: mknod d9/df/c24 0 2024-04-25T17:18:55.927 INFO:tasks.workunit.client.0.smithi037.stdout:3/57: write f5 [861290,15878] 0 2024-04-25T17:18:55.929 INFO:tasks.workunit.client.0.smithi037.stdout:9/208: link d1/d5/f28 d1/d5/d2e/d34/f45 0 2024-04-25T17:18:55.936 INFO:tasks.workunit.client.0.smithi037.stdout:8/73: getdents d5/db 0 2024-04-25T17:18:55.937 INFO:tasks.workunit.client.0.smithi037.stdout:8/74: read d5/d13/f14 [1056425,69314] 0 2024-04-25T17:18:55.937 INFO:tasks.workunit.client.0.smithi037.stdout:9/209: dwrite d1/d5/dc/d38/d3d/d3f/f41 [0,4194304] 0 2024-04-25T17:18:55.938 INFO:tasks.workunit.client.0.smithi037.stdout:0/98: write d9/d14/d23/f1e [3102959,24204] 0 2024-04-25T17:18:55.940 INFO:tasks.workunit.client.0.smithi037.stdout:8/75: truncate d5/da/f11 386295 0 2024-04-25T17:18:55.941 INFO:tasks.workunit.client.0.smithi037.stdout:3/58: symlink d8/l15 0 2024-04-25T17:18:55.948 INFO:tasks.workunit.client.0.smithi037.stdout:9/210: rmdir d1/d5/d2e/d34 39 2024-04-25T17:18:55.952 INFO:tasks.workunit.client.0.smithi037.stdout:9/211: dread d1/d5/dc/fe [0,4194304] 0 2024-04-25T17:18:55.955 INFO:tasks.workunit.client.0.smithi037.stdout:3/59: mknod d8/d11/c16 0 2024-04-25T17:18:55.956 INFO:tasks.workunit.client.0.smithi037.stdout:3/60: fdatasync d8/f10 0 2024-04-25T17:18:55.957 INFO:tasks.workunit.client.0.smithi037.stdout:3/61: readlink d8/l12 0 2024-04-25T17:18:55.957 INFO:tasks.workunit.client.0.smithi037.stdout:3/62: fsync d8/f10 0 2024-04-25T17:18:55.961 INFO:tasks.workunit.client.0.smithi037.stdout:9/212: chown d1/d5/d2e/d34 1521189 1 2024-04-25T17:18:55.965 INFO:tasks.workunit.client.0.smithi037.stdout:0/99: write f2 [3334641,59626] 0 2024-04-25T17:18:55.972 INFO:tasks.workunit.client.0.smithi037.stdout:0/100: rmdir d9/d14 39 2024-04-25T17:18:55.973 INFO:tasks.workunit.client.0.smithi037.stdout:8/76: dwrite d5/f8 [4194304,4194304] 0 2024-04-25T17:18:55.973 INFO:tasks.workunit.client.0.smithi037.stdout:0/101: chown d9/f11 29 1 2024-04-25T17:18:55.975 INFO:tasks.workunit.client.0.smithi037.stdout:9/213: dread d1/f16 [0,4194304] 0 2024-04-25T17:18:55.975 INFO:tasks.workunit.client.0.smithi037.stdout:0/102: write d9/fa [40537,117247] 0 2024-04-25T17:18:55.976 INFO:tasks.workunit.client.0.smithi037.stdout:9/214: fsync d1/d5/dc/f11 0 2024-04-25T17:18:55.977 INFO:tasks.workunit.client.0.smithi037.stdout:0/103: write d9/fb [4851195,42759] 0 2024-04-25T17:18:55.978 INFO:tasks.workunit.client.0.smithi037.stdout:0/104: fsync d9/f11 0 2024-04-25T17:18:55.978 INFO:tasks.workunit.client.0.smithi037.stdout:2/70: sync 2024-04-25T17:18:55.978 INFO:tasks.workunit.client.0.smithi037.stdout:6/99: sync 2024-04-25T17:18:55.979 INFO:tasks.workunit.client.0.smithi037.stdout:9/215: write d1/d21/d1c/f1d [4829219,106943] 0 2024-04-25T17:18:55.981 INFO:tasks.workunit.client.0.smithi037.stdout:8/77: mknod d5/da/c16 0 2024-04-25T17:18:55.981 INFO:tasks.workunit.client.0.smithi037.stdout:2/71: chown d0/l3 130 1 2024-04-25T17:18:55.982 INFO:tasks.workunit.client.0.smithi037.stdout:8/78: chown d5/db 1 1 2024-04-25T17:18:55.982 INFO:tasks.workunit.client.0.smithi037.stdout:2/72: chown d0/f7 1479688408 1 2024-04-25T17:18:55.990 INFO:tasks.workunit.client.0.smithi037.stdout:8/79: dread d5/da/f11 [0,4194304] 0 2024-04-25T17:18:55.999 INFO:tasks.workunit.client.0.smithi037.stdout:0/105: dwrite d9/df/f13 [0,4194304] 0 2024-04-25T17:18:56.001 INFO:tasks.workunit.client.0.smithi037.stdout:6/100: dwrite db/f14 [0,4194304] 0 2024-04-25T17:18:56.002 INFO:tasks.workunit.client.0.smithi037.stdout:9/216: dread d1/d5/dc/fe [0,4194304] 0 2024-04-25T17:18:56.004 INFO:tasks.workunit.client.0.smithi037.stdout:3/63: dwrite d8/ff [0,4194304] 0 2024-04-25T17:18:56.006 INFO:tasks.workunit.client.0.smithi037.stdout:8/80: dread d5/f8 [0,4194304] 0 2024-04-25T17:18:56.014 INFO:tasks.workunit.client.0.smithi037.stdout:6/101: mkdir db/d1d 0 2024-04-25T17:18:56.015 INFO:tasks.workunit.client.0.smithi037.stdout:0/106: dread d9/d14/f16 [0,4194304] 0 2024-04-25T17:18:56.016 INFO:tasks.workunit.client.0.smithi037.stdout:6/102: rename db/d1d to db/d1d/d1e 22 2024-04-25T17:18:56.016 INFO:tasks.workunit.client.0.smithi037.stdout:0/107: dread - d9/d14/f22 zero size 2024-04-25T17:18:56.016 INFO:tasks.workunit.client.0.smithi037.stdout:6/103: stat db/ce 0 2024-04-25T17:18:56.017 INFO:tasks.workunit.client.0.smithi037.stdout:9/217: creat d1/d21/f46 x:0 0 0 2024-04-25T17:18:56.019 INFO:tasks.workunit.client.0.smithi037.stdout:6/104: dread f9 [0,4194304] 0 2024-04-25T17:18:56.020 INFO:tasks.workunit.client.0.smithi037.stdout:6/105: fsync db/f17 0 2024-04-25T17:18:56.021 INFO:tasks.workunit.client.0.smithi037.stdout:6/106: chown db/c18 5980 1 2024-04-25T17:18:56.023 INFO:tasks.workunit.client.0.smithi037.stdout:6/107: write db/f15 [2279896,30105] 0 2024-04-25T17:18:56.025 INFO:tasks.workunit.client.0.smithi037.stdout:2/73: truncate d0/f7 368415 0 2024-04-25T17:18:56.028 INFO:tasks.workunit.client.0.smithi037.stdout:8/81: dwrite d5/d13/f14 [0,4194304] 0 2024-04-25T17:18:56.033 INFO:tasks.workunit.client.0.smithi037.stdout:0/108: mknod d9/d14/c25 0 2024-04-25T17:18:56.033 INFO:tasks.workunit.client.0.smithi037.stdout:0/109: read d9/f19 [1201387,12448] 0 2024-04-25T17:18:56.046 INFO:tasks.workunit.client.0.smithi037.stdout:2/74: truncate d0/f9 324771 0 2024-04-25T17:18:56.050 INFO:tasks.workunit.client.0.smithi037.stdout:8/82: rename d5/l15 to d5/d13/l17 0 2024-04-25T17:18:56.051 INFO:tasks.workunit.client.0.smithi037.stdout:8/83: write f4 [942282,45577] 0 2024-04-25T17:18:56.061 INFO:tasks.workunit.client.0.smithi037.stdout:2/75: mknod d0/c13 0 2024-04-25T17:18:56.065 INFO:tasks.workunit.client.0.smithi037.stdout:9/218: dwrite d1/d21/f22 [0,4194304] 0 2024-04-25T17:18:56.065 INFO:tasks.workunit.client.0.smithi037.stdout:6/108: write f3 [1790422,32662] 0 2024-04-25T17:18:56.069 INFO:tasks.workunit.client.0.smithi037.stdout:3/64: dwrite d8/f9 [0,4194304] 0 2024-04-25T17:18:56.069 INFO:tasks.workunit.client.0.smithi037.stdout:9/219: chown d1/d5/d19/l43 0 1 2024-04-25T17:18:56.069 INFO:tasks.workunit.client.0.smithi037.stdout:8/84: mkdir d5/db/d18 0 2024-04-25T17:18:56.071 INFO:tasks.workunit.client.0.smithi037.stdout:3/65: read d8/ff [2009812,48190] 0 2024-04-25T17:18:56.073 INFO:tasks.workunit.client.0.smithi037.stdout:3/66: chown d8/d11/l13 379434 1 2024-04-25T17:18:56.075 INFO:tasks.workunit.client.0.smithi037.stdout:2/76: dwrite d0/fd [0,4194304] 0 2024-04-25T17:18:56.075 INFO:tasks.workunit.client.0.smithi037.stdout:0/110: getdents d9/d14/d23 0 2024-04-25T17:18:56.089 INFO:tasks.workunit.client.0.smithi037.stdout:9/220: chown d1/d5/dc/f23 49761080 1 2024-04-25T17:18:56.093 INFO:tasks.workunit.client.0.smithi037.stdout:7/96: sync 2024-04-25T17:18:56.093 INFO:tasks.workunit.client.0.smithi037.stdout:4/180: sync 2024-04-25T17:18:56.093 INFO:tasks.workunit.client.0.smithi037.stdout:1/69: sync 2024-04-25T17:18:56.094 INFO:tasks.workunit.client.0.smithi037.stdout:4/181: readlink d7/d29/l22 0 2024-04-25T17:18:56.094 INFO:tasks.workunit.client.0.smithi037.stdout:3/67: creat d8/f17 x:0 0 0 2024-04-25T17:18:56.096 INFO:tasks.workunit.client.0.smithi037.stdout:1/70: write dc/fe [1806711,126641] 0 2024-04-25T17:18:56.099 INFO:tasks.workunit.client.0.smithi037.stdout:2/77: dread d0/f7 [0,4194304] 0 2024-04-25T17:18:56.101 INFO:tasks.workunit.client.0.smithi037.stdout:6/109: creat db/d1d/f1f x:0 0 0 2024-04-25T17:18:56.101 INFO:tasks.workunit.client.0.smithi037.stdout:7/97: dread f3 [0,4194304] 0 2024-04-25T17:18:56.102 INFO:tasks.workunit.client.0.smithi037.stdout:7/98: dread - d5/d15/d17/f1c zero size 2024-04-25T17:18:56.102 INFO:tasks.workunit.client.0.smithi037.stdout:6/110: write db/f19 [143227,129368] 0 2024-04-25T17:18:56.103 INFO:tasks.workunit.client.0.smithi037.stdout:7/99: stat d5/ca 0 2024-04-25T17:18:56.108 INFO:tasks.workunit.client.0.smithi037.stdout:8/85: creat d5/db/d18/f19 x:0 0 0 2024-04-25T17:18:56.119 INFO:tasks.workunit.client.0.smithi037.stdout:2/78: creat d0/f14 x:0 0 0 2024-04-25T17:18:56.119 INFO:tasks.workunit.client.0.smithi037.stdout:2/79: chown d0 13226 1 2024-04-25T17:18:56.122 INFO:tasks.workunit.client.0.smithi037.stdout:6/111: mkdir db/d1d/d20 0 2024-04-25T17:18:56.122 INFO:tasks.workunit.client.0.smithi037.stdout:6/112: fdatasync db/f17 0 2024-04-25T17:18:56.124 INFO:tasks.workunit.client.0.smithi037.stdout:7/100: truncate d5/d15/f1e 4957469 0 2024-04-25T17:18:56.128 INFO:tasks.workunit.client.0.smithi037.stdout:5/155: sync 2024-04-25T17:18:56.130 INFO:tasks.workunit.client.0.smithi037.stdout:4/182: write d7/d29/f25 [243575,58694] 0 2024-04-25T17:18:56.133 INFO:tasks.workunit.client.0.smithi037.stdout:1/71: symlink dc/d18/l1a 0 2024-04-25T17:18:56.134 INFO:tasks.workunit.client.0.smithi037.stdout:1/72: write f1 [2155913,69477] 0 2024-04-25T17:18:56.138 INFO:tasks.workunit.client.0.smithi037.stdout:2/80: mkdir d0/d15 0 2024-04-25T17:18:56.142 INFO:tasks.workunit.client.0.smithi037.stdout:7/101: symlink d5/d15/l22 0 2024-04-25T17:18:56.143 INFO:tasks.workunit.client.0.smithi037.stdout:9/221: truncate d1/d5/dc/f27 240102 0 2024-04-25T17:18:56.148 INFO:tasks.workunit.client.0.smithi037.stdout:3/68: link d8/l14 d8/l18 0 2024-04-25T17:18:56.149 INFO:tasks.workunit.client.0.smithi037.stdout:7/102: dwrite f4 [0,4194304] 0 2024-04-25T17:18:56.152 INFO:tasks.workunit.client.0.smithi037.stdout:8/86: dwrite d5/f8 [0,4194304] 0 2024-04-25T17:18:56.155 INFO:tasks.workunit.client.0.smithi037.stdout:0/111: getdents d9/d14 0 2024-04-25T17:18:56.156 INFO:tasks.workunit.client.0.smithi037.stdout:7/103: dread f3 [0,4194304] 0 2024-04-25T17:18:56.156 INFO:tasks.workunit.client.0.smithi037.stdout:2/81: mkdir d0/d16 0 2024-04-25T17:18:56.160 INFO:tasks.workunit.client.0.smithi037.stdout:6/113: creat db/d1d/d20/f21 x:0 0 0 2024-04-25T17:18:56.168 INFO:tasks.workunit.client.0.smithi037.stdout:4/183: creat d7/d29/d1e/d2b/d35/f3e x:0 0 0 2024-04-25T17:18:56.170 INFO:tasks.workunit.client.0.smithi037.stdout:9/222: dwrite d1/f16 [0,4194304] 0 2024-04-25T17:18:56.171 INFO:tasks.workunit.client.0.smithi037.stdout:9/223: readlink d1/d5/l2a 0 2024-04-25T17:18:56.178 INFO:tasks.workunit.client.0.smithi037.stdout:6/114: fdatasync fa 0 2024-04-25T17:18:56.180 INFO:tasks.workunit.client.0.smithi037.stdout:6/115: fsync db/f1b 0 2024-04-25T17:18:56.184 INFO:tasks.workunit.client.0.smithi037.stdout:8/87: unlink d5/d13/l17 0 2024-04-25T17:18:56.185 INFO:tasks.workunit.client.0.smithi037.stdout:8/88: write d5/db/f12 [683310,129502] 0 2024-04-25T17:18:56.190 INFO:tasks.workunit.client.0.smithi037.stdout:0/112: symlink d9/l26 0 2024-04-25T17:18:56.192 INFO:tasks.workunit.client.0.smithi037.stdout:2/82: symlink d0/d16/l17 0 2024-04-25T17:18:56.202 INFO:tasks.workunit.client.0.smithi037.stdout:8/89: rmdir d5/db 39 2024-04-25T17:18:56.204 INFO:tasks.workunit.client.0.smithi037.stdout:5/156: truncate d7/d12/f24 2016496 0 2024-04-25T17:18:56.207 INFO:tasks.workunit.client.0.smithi037.stdout:0/113: truncate d9/df/f13 4613489 0 2024-04-25T17:18:56.214 INFO:tasks.workunit.client.0.smithi037.stdout:1/73: dwrite f5 [0,4194304] 0 2024-04-25T17:18:56.215 INFO:tasks.workunit.client.0.smithi037.stdout:6/116: link db/f17 db/f22 0 2024-04-25T17:18:56.225 INFO:tasks.workunit.client.0.smithi037.stdout:0/114: unlink d9/c1f 0 2024-04-25T17:18:56.227 INFO:tasks.workunit.client.0.smithi037.stdout:7/104: getdents d5/d15 0 2024-04-25T17:18:56.233 INFO:tasks.workunit.client.0.smithi037.stdout:9/224: dwrite d1/d5/dc/f29 [0,4194304] 0 2024-04-25T17:18:56.235 INFO:tasks.workunit.client.0.smithi037.stdout:6/117: rename f3 to db/f23 0 2024-04-25T17:18:56.236 INFO:tasks.workunit.client.0.smithi037.stdout:7/105: dwrite f4 [0,4194304] 0 2024-04-25T17:18:56.236 INFO:tasks.workunit.client.0.smithi037.stdout:6/118: stat db/d1d/f1f 0 2024-04-25T17:18:56.239 INFO:tasks.workunit.client.0.smithi037.stdout:7/106: read f4 [371360,9472] 0 2024-04-25T17:18:56.240 INFO:tasks.workunit.client.0.smithi037.stdout:8/90: symlink d5/db/l1a 0 2024-04-25T17:18:56.243 INFO:tasks.workunit.client.0.smithi037.stdout:1/74: dread f1 [0,4194304] 0 2024-04-25T17:18:56.246 INFO:tasks.workunit.client.0.smithi037.stdout:4/184: truncate d7/f23 3144186 0 2024-04-25T17:18:56.246 INFO:tasks.workunit.client.0.smithi037.stdout:6/119: dread db/f14 [0,4194304] 0 2024-04-25T17:18:56.248 INFO:tasks.workunit.client.0.smithi037.stdout:4/185: dread - d7/d29/f3d zero size 2024-04-25T17:18:56.249 INFO:tasks.workunit.client.0.smithi037.stdout:1/75: dread dc/f13 [0,4194304] 0 2024-04-25T17:18:56.252 INFO:tasks.workunit.client.0.smithi037.stdout:7/107: dwrite d5/d15/d17/f20 [0,4194304] 0 2024-04-25T17:18:56.261 INFO:tasks.workunit.client.0.smithi037.stdout:7/108: dread d5/d15/f19 [0,4194304] 0 2024-04-25T17:18:56.265 INFO:tasks.workunit.client.0.smithi037.stdout:2/83: dwrite d0/f7 [0,4194304] 0 2024-04-25T17:18:56.266 INFO:tasks.workunit.client.0.smithi037.stdout:2/84: dread - d0/f14 zero size 2024-04-25T17:18:56.267 INFO:tasks.workunit.client.0.smithi037.stdout:0/115: rename d9/df/f21 to d9/d14/f27 0 2024-04-25T17:18:56.270 INFO:tasks.workunit.client.0.smithi037.stdout:2/85: dread d0/f7 [0,4194304] 0 2024-04-25T17:18:56.271 INFO:tasks.workunit.client.0.smithi037.stdout:2/86: read d0/fd [2324738,120958] 0 2024-04-25T17:18:56.272 INFO:tasks.workunit.client.0.smithi037.stdout:2/87: fdatasync d0/fd 0 2024-04-25T17:18:56.276 INFO:tasks.workunit.client.0.smithi037.stdout:8/91: dread d5/f9 [0,4194304] 0 2024-04-25T17:18:56.277 INFO:tasks.workunit.client.0.smithi037.stdout:5/157: link d7/d12/d15/f30 d7/d12/f35 0 2024-04-25T17:18:56.278 INFO:tasks.workunit.client.0.smithi037.stdout:8/92: chown d5/d13/f14 2 1 2024-04-25T17:18:56.278 INFO:tasks.workunit.client.0.smithi037.stdout:5/158: chown d7/d12/f21 15709114 1 2024-04-25T17:18:56.280 INFO:tasks.workunit.client.0.smithi037.stdout:2/88: dwrite d0/fd [4194304,4194304] 0 2024-04-25T17:18:56.283 INFO:tasks.workunit.client.0.smithi037.stdout:6/120: mkdir db/d24 0 2024-04-25T17:18:56.287 INFO:tasks.workunit.client.0.smithi037.stdout:8/93: dread f4 [0,4194304] 0 2024-04-25T17:18:56.290 INFO:tasks.workunit.client.0.smithi037.stdout:4/186: stat d7/f19 0 2024-04-25T17:18:56.292 INFO:tasks.workunit.client.0.smithi037.stdout:2/89: dwrite d0/f5 [0,4194304] 0 2024-04-25T17:18:56.294 INFO:tasks.workunit.client.0.smithi037.stdout:1/76: creat dc/d18/f1b x:0 0 0 2024-04-25T17:18:56.296 INFO:tasks.workunit.client.0.smithi037.stdout:1/77: readlink dc/l17 0 2024-04-25T17:18:56.301 INFO:tasks.workunit.client.0.smithi037.stdout:4/187: dwrite d7/d29/d1e/f30 [0,4194304] 0 2024-04-25T17:18:56.309 INFO:tasks.workunit.client.0.smithi037.stdout:9/225: write d1/ff [2922533,114147] 0 2024-04-25T17:18:56.311 INFO:tasks.workunit.client.0.smithi037.stdout:0/116: mkdir d9/d14/d28 0 2024-04-25T17:18:56.312 INFO:tasks.workunit.client.0.smithi037.stdout:0/117: readlink d9/d14/l1d 0 2024-04-25T17:18:56.315 INFO:tasks.workunit.client.0.smithi037.stdout:9/226: dread d1/d5/dc/d38/d3d/d3f/f41 [0,4194304] 0 2024-04-25T17:18:56.316 INFO:tasks.workunit.client.0.smithi037.stdout:9/227: dread - d1/d5/dc/d38/f3a zero size 2024-04-25T17:18:56.317 INFO:tasks.workunit.client.0.smithi037.stdout:9/228: read - d1/d5/dc/f2d zero size 2024-04-25T17:18:56.318 INFO:tasks.workunit.client.0.smithi037.stdout:9/229: read d1/d5/dc/d38/d3d/d3f/f41 [18259,73867] 0 2024-04-25T17:18:56.319 INFO:tasks.workunit.client.0.smithi037.stdout:9/230: read d1/d5/d2e/d34/f45 [1574950,103940] 0 2024-04-25T17:18:56.325 INFO:tasks.workunit.client.0.smithi037.stdout:5/159: truncate d7/d12/f2d 877265 0 2024-04-25T17:18:56.326 INFO:tasks.workunit.client.0.smithi037.stdout:5/160: dread f0 [0,4194304] 0 2024-04-25T17:18:56.331 INFO:tasks.workunit.client.0.smithi037.stdout:8/94: creat d5/db/f1b x:0 0 0 2024-04-25T17:18:56.332 INFO:tasks.workunit.client.0.smithi037.stdout:8/95: write d5/f8 [4631686,33782] 0 2024-04-25T17:18:56.338 INFO:tasks.workunit.client.0.smithi037.stdout:1/78: mkdir dc/d1c 0 2024-04-25T17:18:56.342 INFO:tasks.workunit.client.0.smithi037.stdout:4/188: rename d7/fd to d7/d29/d1e/d2b/d35/d39/f3f 0 2024-04-25T17:18:56.343 INFO:tasks.workunit.client.0.smithi037.stdout:4/189: stat d7/d29/d1e/l21 0 2024-04-25T17:18:56.343 INFO:tasks.workunit.client.0.smithi037.stdout:4/190: write d7/ff [1526472,31346] 0 2024-04-25T17:18:56.344 INFO:tasks.workunit.client.0.smithi037.stdout:4/191: fsync d7/f3b 0 2024-04-25T17:18:56.359 INFO:tasks.workunit.client.0.smithi037.stdout:6/121: mkdir db/d24/d25 0 2024-04-25T17:18:56.360 INFO:tasks.workunit.client.0.smithi037.stdout:6/122: write db/fd [2166919,4231] 0 2024-04-25T17:18:56.364 INFO:tasks.workunit.client.0.smithi037.stdout:8/96: symlink d5/db/l1c 0 2024-04-25T17:18:56.364 INFO:tasks.workunit.client.0.smithi037.stdout:8/97: readlink d5/db/l1a 0 2024-04-25T17:18:56.366 INFO:tasks.workunit.client.0.smithi037.stdout:6/123: dwrite db/f12 [0,4194304] 0 2024-04-25T17:18:56.368 INFO:tasks.workunit.client.0.smithi037.stdout:1/79: symlink dc/d18/l1d 0 2024-04-25T17:18:56.373 INFO:tasks.workunit.client.0.smithi037.stdout:0/118: rename d9/f11 to d9/d14/d23/f29 0 2024-04-25T17:18:56.382 INFO:tasks.workunit.client.0.smithi037.stdout:6/124: mkdir db/d26 0 2024-04-25T17:18:56.383 INFO:tasks.workunit.client.0.smithi037.stdout:2/90: link d0/d16/l17 d0/l18 0 2024-04-25T17:18:56.385 INFO:tasks.workunit.client.0.smithi037.stdout:2/91: write d0/f5 [3051193,110825] 0 2024-04-25T17:18:56.426 INFO:tasks.workunit.client.0.smithi037.stdout:1/80: fsync f7 0 2024-04-25T17:18:56.427 INFO:tasks.workunit.client.0.smithi037.stdout:9/231: rename d1/f37 to d1/d5/dc/f47 0 2024-04-25T17:18:56.431 INFO:tasks.workunit.client.0.smithi037.stdout:6/125: dwrite db/f15 [8388608,4194304] 0 2024-04-25T17:18:56.434 INFO:tasks.workunit.client.0.smithi037.stdout:0/119: dread d9/df/f13 [0,4194304] 0 2024-04-25T17:18:56.435 INFO:tasks.workunit.client.0.smithi037.stdout:0/120: write d9/df/f10 [1387782,5634] 0 2024-04-25T17:18:56.437 INFO:tasks.workunit.client.0.smithi037.stdout:2/92: rename d0/le to d0/d16/l19 0 2024-04-25T17:18:56.442 INFO:tasks.workunit.client.0.smithi037.stdout:5/161: link d7/fb d7/d12/f36 0 2024-04-25T17:18:56.454 INFO:tasks.workunit.client.0.smithi037.stdout:6/126: creat db/d26/f27 x:0 0 0 2024-04-25T17:18:56.454 INFO:tasks.workunit.client.0.smithi037.stdout:6/127: fdatasync db/f16 0 2024-04-25T17:18:56.456 INFO:tasks.workunit.client.0.smithi037.stdout:0/121: creat d9/d14/d28/f2a x:0 0 0 2024-04-25T17:18:56.457 INFO:tasks.workunit.client.0.smithi037.stdout:0/122: truncate d9/fa 4379161 0 2024-04-25T17:18:56.458 INFO:tasks.workunit.client.0.smithi037.stdout:5/162: chown d7/d12/f36 2030 1 2024-04-25T17:18:56.460 INFO:tasks.workunit.client.0.smithi037.stdout:6/128: symlink db/d1d/d20/l28 0 2024-04-25T17:18:56.463 INFO:tasks.workunit.client.0.smithi037.stdout:5/163: creat d7/d25/f37 x:0 0 0 2024-04-25T17:18:56.464 INFO:tasks.workunit.client.0.smithi037.stdout:0/123: dwrite d9/fa [0,4194304] 0 2024-04-25T17:18:56.464 INFO:tasks.workunit.client.0.smithi037.stdout:0/124: stat l3 0 2024-04-25T17:18:56.465 INFO:tasks.workunit.client.0.smithi037.stdout:0/125: write d9/df/f12 [211571,102945] 0 2024-04-25T17:18:56.466 INFO:tasks.workunit.client.0.smithi037.stdout:6/129: fdatasync db/f14 0 2024-04-25T17:18:56.466 INFO:tasks.workunit.client.0.smithi037.stdout:0/126: read f7 [206347,117330] 0 2024-04-25T17:18:56.471 INFO:tasks.workunit.client.0.smithi037.stdout:6/130: mknod db/d1d/c29 0 2024-04-25T17:18:56.473 INFO:tasks.workunit.client.0.smithi037.stdout:0/127: fsync d9/f19 0 2024-04-25T17:18:56.474 INFO:tasks.workunit.client.0.smithi037.stdout:0/128: dread d9/d14/f1c [0,4194304] 0 2024-04-25T17:18:56.475 INFO:tasks.workunit.client.0.smithi037.stdout:0/129: stat d9/d14 0 2024-04-25T17:18:56.476 INFO:tasks.workunit.client.0.smithi037.stdout:5/164: creat d7/d12/f38 x:0 0 0 2024-04-25T17:18:56.476 INFO:tasks.workunit.client.0.smithi037.stdout:0/130: chown d9/d14/f22 228850571 1 2024-04-25T17:18:56.477 INFO:tasks.workunit.client.0.smithi037.stdout:0/131: write d9/d14/f1a [551735,89452] 0 2024-04-25T17:18:56.478 INFO:tasks.workunit.client.0.smithi037.stdout:4/192: write d7/fe [2523312,21038] 0 2024-04-25T17:18:56.484 INFO:tasks.workunit.client.0.smithi037.stdout:0/132: mknod d9/df/c2b 0 2024-04-25T17:18:56.484 INFO:tasks.workunit.client.0.smithi037.stdout:9/232: write d1/d5/d2e/d34/f45 [4078671,43610] 0 2024-04-25T17:18:56.484 INFO:tasks.workunit.client.0.smithi037.stdout:0/133: readlink d9/l15 0 2024-04-25T17:18:56.486 INFO:tasks.workunit.client.0.smithi037.stdout:4/193: rmdir d7/d29 39 2024-04-25T17:18:56.491 INFO:tasks.workunit.client.0.smithi037.stdout:9/233: dwrite d1/f2 [0,4194304] 0 2024-04-25T17:18:56.491 INFO:tasks.workunit.client.0.smithi037.stdout:5/165: rename d7/d12/f24 to d7/d25/f39 0 2024-04-25T17:18:56.493 INFO:tasks.workunit.client.0.smithi037.stdout:9/234: chown d1/d5/dc/d3c/d3e/f42 4 1 2024-04-25T17:18:56.494 INFO:tasks.workunit.client.0.smithi037.stdout:5/166: dread d7/d18/f1e [0,4194304] 0 2024-04-25T17:18:56.495 INFO:tasks.workunit.client.0.smithi037.stdout:1/81: truncate f5 3036637 0 2024-04-25T17:18:56.496 INFO:tasks.workunit.client.0.smithi037.stdout:1/82: chown dc/f10 1680580809 1 2024-04-25T17:18:56.499 INFO:tasks.workunit.client.0.smithi037.stdout:0/134: rename d9/d14/f1c to d9/df/f2c 0 2024-04-25T17:18:56.499 INFO:tasks.workunit.client.0.smithi037.stdout:0/135: stat d9/l26 0 2024-04-25T17:18:56.500 INFO:tasks.workunit.client.0.smithi037.stdout:2/93: write d0/fd [3134930,110937] 0 2024-04-25T17:18:56.505 INFO:tasks.workunit.client.0.smithi037.stdout:4/194: creat d7/d29/d1e/d2b/d35/f40 x:0 0 0 2024-04-25T17:18:56.507 INFO:tasks.workunit.client.0.smithi037.stdout:0/136: mknod d9/d14/d23/c2d 0 2024-04-25T17:18:56.508 INFO:tasks.workunit.client.0.smithi037.stdout:9/235: mkdir d1/d48 0 2024-04-25T17:18:56.510 INFO:tasks.workunit.client.0.smithi037.stdout:2/94: stat d0/d16/l17 0 2024-04-25T17:18:56.512 INFO:tasks.workunit.client.0.smithi037.stdout:4/195: write d7/d29/f3c [4146333,62964] 0 2024-04-25T17:18:56.513 INFO:tasks.workunit.client.0.smithi037.stdout:0/137: fsync d9/d14/f27 0 2024-04-25T17:18:56.514 INFO:tasks.workunit.client.0.smithi037.stdout:4/196: write d7/d29/f3d [1009969,34653] 0 2024-04-25T17:18:56.518 INFO:tasks.workunit.client.0.smithi037.stdout:9/236: mknod d1/c49 0 2024-04-25T17:18:56.520 INFO:tasks.workunit.client.0.smithi037.stdout:0/138: symlink d9/d14/l2e 0 2024-04-25T17:18:56.522 INFO:tasks.workunit.client.0.smithi037.stdout:2/95: symlink d0/d15/l1a 0 2024-04-25T17:18:56.523 INFO:tasks.workunit.client.0.smithi037.stdout:4/197: creat d7/d29/d1e/f41 x:0 0 0 2024-04-25T17:18:56.528 INFO:tasks.workunit.client.0.smithi037.stdout:4/198: dread d7/f2f [0,4194304] 0 2024-04-25T17:18:56.528 INFO:tasks.workunit.client.0.smithi037.stdout:4/199: read d7/f1a [208493,84736] 0 2024-04-25T17:18:56.529 INFO:tasks.workunit.client.0.smithi037.stdout:4/200: readlink d7/d29/l22 0 2024-04-25T17:18:56.529 INFO:tasks.workunit.client.0.smithi037.stdout:5/167: write d7/f1f [913129,28993] 0 2024-04-25T17:18:56.530 INFO:tasks.workunit.client.0.smithi037.stdout:5/168: stat d7/d18 0 2024-04-25T17:18:56.530 INFO:tasks.workunit.client.0.smithi037.stdout:3/69: sync 2024-04-25T17:18:56.531 INFO:tasks.workunit.client.0.smithi037.stdout:2/96: creat d0/d16/f1b x:0 0 0 2024-04-25T17:18:56.532 INFO:tasks.workunit.client.0.smithi037.stdout:1/83: write f7 [1226506,19698] 0 2024-04-25T17:18:56.534 INFO:tasks.workunit.client.0.smithi037.stdout:2/97: truncate d0/f14 618479 0 2024-04-25T17:18:56.539 INFO:tasks.workunit.client.0.smithi037.stdout:1/84: dwrite dc/f10 [0,4194304] 0 2024-04-25T17:18:56.542 INFO:tasks.workunit.client.0.smithi037.stdout:3/70: symlink d8/d11/l19 0 2024-04-25T17:18:56.546 INFO:tasks.workunit.client.0.smithi037.stdout:2/98: write d0/f7 [3271392,103451] 0 2024-04-25T17:18:56.547 INFO:tasks.workunit.client.0.smithi037.stdout:2/99: chown d0/f7 263668368 1 2024-04-25T17:18:56.548 INFO:tasks.workunit.client.0.smithi037.stdout:3/71: dread d8/f10 [0,4194304] 0 2024-04-25T17:18:56.548 INFO:tasks.workunit.client.0.smithi037.stdout:3/72: chown d8/d11 279517948 1 2024-04-25T17:18:56.549 INFO:tasks.workunit.client.0.smithi037.stdout:9/237: rmdir d1/d5/d2e/d33 0 2024-04-25T17:18:56.550 INFO:tasks.workunit.client.0.smithi037.stdout:0/139: creat d9/f2f x:0 0 0 2024-04-25T17:18:56.557 INFO:tasks.workunit.client.0.smithi037.stdout:2/100: creat d0/f1c x:0 0 0 2024-04-25T17:18:56.558 INFO:tasks.workunit.client.0.smithi037.stdout:3/73: creat d8/d11/f1a x:0 0 0 2024-04-25T17:18:56.560 INFO:tasks.workunit.client.0.smithi037.stdout:5/169: dwrite d7/d18/f29 [0,4194304] 0 2024-04-25T17:18:56.560 INFO:tasks.workunit.client.0.smithi037.stdout:5/170: fdatasync d7/d12/f38 0 2024-04-25T17:18:56.561 INFO:tasks.workunit.client.0.smithi037.stdout:9/238: creat d1/d5/dc/f4a x:0 0 0 2024-04-25T17:18:56.564 INFO:tasks.workunit.client.0.smithi037.stdout:4/201: link d7/f10 d7/d29/d1e/d2b/f42 0 2024-04-25T17:18:56.565 INFO:tasks.workunit.client.0.smithi037.stdout:1/85: mknod dc/d1c/c1e 0 2024-04-25T17:18:56.567 INFO:tasks.workunit.client.0.smithi037.stdout:2/101: chown d0/d16/l19 3928 1 2024-04-25T17:18:56.568 INFO:tasks.workunit.client.0.smithi037.stdout:3/74: mknod d8/c1b 0 2024-04-25T17:18:56.568 INFO:tasks.workunit.client.0.smithi037.stdout:4/202: dread d7/f2a [0,4194304] 0 2024-04-25T17:18:56.569 INFO:tasks.workunit.client.0.smithi037.stdout:3/75: fsync d8/f17 0 2024-04-25T17:18:56.570 INFO:tasks.workunit.client.0.smithi037.stdout:4/203: stat f3 0 2024-04-25T17:18:56.571 INFO:tasks.workunit.client.0.smithi037.stdout:3/76: fdatasync d8/f9 0 2024-04-25T17:18:56.574 INFO:tasks.workunit.client.0.smithi037.stdout:1/86: mkdir dc/d1f 0 2024-04-25T17:18:56.576 INFO:tasks.workunit.client.0.smithi037.stdout:2/102: dwrite d0/fd [0,4194304] 0 2024-04-25T17:18:56.577 INFO:tasks.workunit.client.0.smithi037.stdout:1/87: read - dc/d18/f1b zero size 2024-04-25T17:18:56.581 INFO:tasks.workunit.client.0.smithi037.stdout:3/77: dwrite d8/f9 [0,4194304] 0 2024-04-25T17:18:56.582 INFO:tasks.workunit.client.0.smithi037.stdout:3/78: stat d8/l15 0 2024-04-25T17:18:56.585 INFO:tasks.workunit.client.0.smithi037.stdout:2/103: creat d0/d15/f1d x:0 0 0 2024-04-25T17:18:56.587 INFO:tasks.workunit.client.0.smithi037.stdout:2/104: read d0/fd [7502410,87396] 0 2024-04-25T17:18:56.589 INFO:tasks.workunit.client.0.smithi037.stdout:1/88: creat dc/d1c/f20 x:0 0 0 2024-04-25T17:18:56.591 INFO:tasks.workunit.client.0.smithi037.stdout:5/171: dwrite d7/f17 [0,4194304] 0 2024-04-25T17:18:56.591 INFO:tasks.workunit.client.0.smithi037.stdout:1/89: chown dc/fd 5 1 2024-04-25T17:18:56.593 INFO:tasks.workunit.client.0.smithi037.stdout:0/140: getdents d9/d14 0 2024-04-25T17:18:56.601 INFO:tasks.workunit.client.0.smithi037.stdout:2/105: symlink d0/d16/l1e 0 2024-04-25T17:18:56.608 INFO:tasks.workunit.client.0.smithi037.stdout:4/204: getdents d7 0 2024-04-25T17:18:56.609 INFO:tasks.workunit.client.0.smithi037.stdout:2/106: dwrite d0/f14 [0,4194304] 0 2024-04-25T17:18:56.611 INFO:tasks.workunit.client.0.smithi037.stdout:1/90: link f7 dc/d18/f21 0 2024-04-25T17:18:56.612 INFO:tasks.workunit.client.0.smithi037.stdout:5/172: truncate d7/d12/f35 3387677 0 2024-04-25T17:18:56.615 INFO:tasks.workunit.client.0.smithi037.stdout:3/79: write d8/fd [113315,37457] 0 2024-04-25T17:18:56.617 INFO:tasks.workunit.client.0.smithi037.stdout:3/80: write f5 [1117231,9156] 0 2024-04-25T17:18:56.619 INFO:tasks.workunit.client.0.smithi037.stdout:2/107: mknod d0/d15/c1f 0 2024-04-25T17:18:56.622 INFO:tasks.workunit.client.0.smithi037.stdout:5/173: mknod d7/c3a 0 2024-04-25T17:18:56.625 INFO:tasks.workunit.client.0.smithi037.stdout:3/81: dwrite f5 [0,4194304] 0 2024-04-25T17:18:56.631 INFO:tasks.workunit.client.0.smithi037.stdout:1/91: mkdir dc/d1f/d22 0 2024-04-25T17:18:56.634 INFO:tasks.workunit.client.0.smithi037.stdout:2/108: mkdir d0/d16/d20 0 2024-04-25T17:18:56.640 INFO:tasks.workunit.client.0.smithi037.stdout:3/82: rename d8/l15 to d8/l1c 0 2024-04-25T17:18:56.643 INFO:tasks.workunit.client.0.smithi037.stdout:4/205: write d7/f2d [1450165,83945] 0 2024-04-25T17:18:56.644 INFO:tasks.workunit.client.0.smithi037.stdout:3/83: write d8/f9 [2045118,90195] 0 2024-04-25T17:18:56.646 INFO:tasks.workunit.client.0.smithi037.stdout:2/109: dwrite d0/f1c [0,4194304] 0 2024-04-25T17:18:56.646 INFO:tasks.workunit.client.0.smithi037.stdout:0/141: dwrite d9/df/f2c [0,4194304] 0 2024-04-25T17:18:56.647 INFO:tasks.workunit.client.0.smithi037.stdout:3/84: fsync d8/f10 0 2024-04-25T17:18:56.649 INFO:tasks.workunit.client.0.smithi037.stdout:4/206: chown d7/f26 12 1 2024-04-25T17:18:56.649 INFO:tasks.workunit.client.0.smithi037.stdout:2/110: stat d0/c13 0 2024-04-25T17:18:56.649 INFO:tasks.workunit.client.0.smithi037.stdout:0/142: write d9/df/f2c [4046192,25362] 0 2024-04-25T17:18:56.651 INFO:tasks.workunit.client.0.smithi037.stdout:0/143: write f2 [1634002,26919] 0 2024-04-25T17:18:56.652 INFO:tasks.workunit.client.0.smithi037.stdout:0/144: read - d9/d14/f22 zero size 2024-04-25T17:18:56.656 INFO:tasks.workunit.client.0.smithi037.stdout:0/145: stat d9/f2f 0 2024-04-25T17:18:56.658 INFO:tasks.workunit.client.0.smithi037.stdout:4/207: mknod d7/c43 0 2024-04-25T17:18:56.662 INFO:tasks.workunit.client.0.smithi037.stdout:5/174: dwrite d7/f9 [0,4194304] 0 2024-04-25T17:18:56.665 INFO:tasks.workunit.client.0.smithi037.stdout:2/111: creat d0/d15/f21 x:0 0 0 2024-04-25T17:18:56.665 INFO:tasks.workunit.client.0.smithi037.stdout:5/175: fdatasync d7/d12/d15/d2e/f34 0 2024-04-25T17:18:56.669 INFO:tasks.workunit.client.0.smithi037.stdout:0/146: creat d9/d14/d23/f30 x:0 0 0 2024-04-25T17:18:56.669 INFO:tasks.workunit.client.0.smithi037.stdout:1/92: write f5 [143617,27697] 0 2024-04-25T17:18:56.671 INFO:tasks.workunit.client.0.smithi037.stdout:1/93: read - dc/d18/f1b zero size 2024-04-25T17:18:56.672 INFO:tasks.workunit.client.0.smithi037.stdout:4/208: dwrite d7/f23 [0,4194304] 0 2024-04-25T17:18:56.673 INFO:tasks.workunit.client.0.smithi037.stdout:5/176: dread - d7/d12/d15/f2c zero size 2024-04-25T17:18:56.675 INFO:tasks.workunit.client.0.smithi037.stdout:2/112: rename d0/d15/c1f to d0/d16/d20/c22 0 2024-04-25T17:18:56.703 INFO:tasks.workunit.client.0.smithi037.stdout:7/109: sync 2024-04-25T17:18:56.703 INFO:tasks.workunit.client.0.smithi037.stdout:1/94: symlink dc/d18/l23 0 2024-04-25T17:18:56.704 INFO:tasks.workunit.client.0.smithi037.stdout:4/209: creat d7/d29/d1e/f44 x:0 0 0 2024-04-25T17:18:56.705 INFO:tasks.workunit.client.0.smithi037.stdout:5/177: mknod d7/c3b 0 2024-04-25T17:18:56.706 INFO:tasks.workunit.client.0.smithi037.stdout:4/210: chown d7/f26 318141 1 2024-04-25T17:18:56.707 INFO:tasks.workunit.client.0.smithi037.stdout:5/178: write d7/d18/f29 [3744967,545] 0 2024-04-25T17:18:56.709 INFO:tasks.workunit.client.0.smithi037.stdout:3/85: getdents d8/d11 0 2024-04-25T17:18:56.710 INFO:tasks.workunit.client.0.smithi037.stdout:0/147: dwrite f7 [4194304,4194304] 0 2024-04-25T17:18:56.718 INFO:tasks.workunit.client.0.smithi037.stdout:3/86: dwrite d8/d11/f1a [0,4194304] 0 2024-04-25T17:18:56.719 INFO:tasks.workunit.client.0.smithi037.stdout:3/87: read - d8/f17 zero size 2024-04-25T17:18:56.721 INFO:tasks.workunit.client.0.smithi037.stdout:4/211: mkdir d7/d29/d45 0 2024-04-25T17:18:56.723 INFO:tasks.workunit.client.0.smithi037.stdout:4/212: rename d7/d29 to d7/d29/d1e/d2b/d35/d39/d46 22 2024-04-25T17:18:56.725 INFO:tasks.workunit.client.0.smithi037.stdout:3/88: dread d8/d11/f1a [0,4194304] 0 2024-04-25T17:18:56.725 INFO:tasks.workunit.client.0.smithi037.stdout:3/89: write f5 [3521231,42889] 0 2024-04-25T17:18:56.727 INFO:tasks.workunit.client.0.smithi037.stdout:5/179: creat d7/f3c x:0 0 0 2024-04-25T17:18:56.730 INFO:tasks.workunit.client.0.smithi037.stdout:1/95: write fa [96365,27371] 0 2024-04-25T17:18:56.732 INFO:tasks.workunit.client.0.smithi037.stdout:0/148: write d9/d14/d23/f29 [1043936,39997] 0 2024-04-25T17:18:56.733 INFO:tasks.workunit.client.0.smithi037.stdout:0/149: rename d9/df to d9/df/d31 22 2024-04-25T17:18:56.737 INFO:tasks.workunit.client.0.smithi037.stdout:0/150: dread d9/df/f13 [0,4194304] 0 2024-04-25T17:18:56.744 INFO:tasks.workunit.client.0.smithi037.stdout:5/180: rmdir d7/d25 39 2024-04-25T17:18:56.754 INFO:tasks.workunit.client.0.smithi037.stdout:4/213: creat d7/d29/d45/f47 x:0 0 0 2024-04-25T17:18:56.756 INFO:tasks.workunit.client.0.smithi037.stdout:4/214: dread d7/d29/f25 [0,4194304] 0 2024-04-25T17:18:56.758 INFO:tasks.workunit.client.0.smithi037.stdout:2/113: getdents d0/d15 0 2024-04-25T17:18:56.758 INFO:tasks.workunit.client.0.smithi037.stdout:2/114: write d0/f7 [4423353,41958] 0 2024-04-25T17:18:56.759 INFO:tasks.workunit.client.0.smithi037.stdout:2/115: dread - d0/d15/f21 zero size 2024-04-25T17:18:56.763 INFO:tasks.workunit.client.0.smithi037.stdout:7/110: link d5/l7 d5/d14/l23 0 2024-04-25T17:18:56.777 INFO:tasks.workunit.client.0.smithi037.stdout:5/181: write d7/f1c [611986,65930] 0 2024-04-25T17:18:56.778 INFO:tasks.workunit.client.0.smithi037.stdout:5/182: stat d7/f11 0 2024-04-25T17:18:56.779 INFO:tasks.workunit.client.0.smithi037.stdout:2/116: mkdir d0/d23 0 2024-04-25T17:18:56.780 INFO:tasks.workunit.client.0.smithi037.stdout:2/117: write d0/d15/f1d [954789,86399] 0 2024-04-25T17:18:56.786 INFO:tasks.workunit.client.0.smithi037.stdout:5/183: dwrite d7/d12/f19 [4194304,4194304] 0 2024-04-25T17:18:56.791 INFO:tasks.workunit.client.0.smithi037.stdout:4/215: dwrite d7/d29/d1e/f3a [0,4194304] 0 2024-04-25T17:18:56.793 INFO:tasks.workunit.client.0.smithi037.stdout:3/90: link c0 d8/d11/c1d 0 2024-04-25T17:18:56.799 INFO:tasks.workunit.client.0.smithi037.stdout:2/118: unlink d0/fd 0 2024-04-25T17:18:56.799 INFO:tasks.workunit.client.0.smithi037.stdout:4/216: dwrite d7/d29/f3c [0,4194304] 0 2024-04-25T17:18:56.800 INFO:tasks.workunit.client.0.smithi037.stdout:1/96: getdents dc/d1c 0 2024-04-25T17:18:56.806 INFO:tasks.workunit.client.0.smithi037.stdout:0/151: getdents d9/d14 0 2024-04-25T17:18:56.808 INFO:tasks.workunit.client.0.smithi037.stdout:0/152: read f2 [2952207,76067] 0 2024-04-25T17:18:56.809 INFO:tasks.workunit.client.0.smithi037.stdout:7/111: dread d5/f9 [0,4194304] 0 2024-04-25T17:18:56.810 INFO:tasks.workunit.client.0.smithi037.stdout:1/97: dread dc/fd [0,4194304] 0 2024-04-25T17:18:56.810 INFO:tasks.workunit.client.0.smithi037.stdout:1/98: stat dc/d1f 0 2024-04-25T17:18:56.812 INFO:tasks.workunit.client.0.smithi037.stdout:1/99: fsync f8 0 2024-04-25T17:18:56.812 INFO:tasks.workunit.client.0.smithi037.stdout:7/112: readlink d5/d14/l1a 0 2024-04-25T17:18:56.812 INFO:tasks.workunit.client.0.smithi037.stdout:3/91: rmdir d8/d11 39 2024-04-25T17:18:56.818 INFO:tasks.workunit.client.0.smithi037.stdout:1/100: mkdir dc/d24 0 2024-04-25T17:18:56.819 INFO:tasks.workunit.client.0.smithi037.stdout:7/113: symlink d5/d14/l24 0 2024-04-25T17:18:56.822 INFO:tasks.workunit.client.0.smithi037.stdout:2/119: mknod d0/d23/c24 0 2024-04-25T17:18:56.827 INFO:tasks.workunit.client.0.smithi037.stdout:8/98: sync 2024-04-25T17:18:56.829 INFO:tasks.workunit.client.0.smithi037.stdout:8/99: read d5/db/fc [73216,56321] 0 2024-04-25T17:18:56.829 INFO:tasks.workunit.client.0.smithi037.stdout:1/101: creat dc/d18/f25 x:0 0 0 2024-04-25T17:18:56.830 INFO:tasks.workunit.client.0.smithi037.stdout:8/100: fdatasync d5/db/fc 0 2024-04-25T17:18:56.831 INFO:tasks.workunit.client.0.smithi037.stdout:7/114: mkdir d5/d15/d17/d25 0 2024-04-25T17:18:56.833 INFO:tasks.workunit.client.0.smithi037.stdout:3/92: rmdir d8/d11 39 2024-04-25T17:18:56.838 INFO:tasks.workunit.client.0.smithi037.stdout:5/184: dwrite d7/d12/d15/f2c [0,4194304] 0 2024-04-25T17:18:56.842 INFO:tasks.workunit.client.0.smithi037.stdout:5/185: dread - d7/d12/f38 zero size 2024-04-25T17:18:56.842 INFO:tasks.workunit.client.0.smithi037.stdout:8/101: truncate d5/f9 1273766 0 2024-04-25T17:18:56.843 INFO:tasks.workunit.client.0.smithi037.stdout:8/102: truncate d5/db/f12 1724851 0 2024-04-25T17:18:56.843 INFO:tasks.workunit.client.0.smithi037.stdout:1/102: dwrite f8 [0,4194304] 0 2024-04-25T17:18:56.845 INFO:tasks.workunit.client.0.smithi037.stdout:7/115: mkdir d5/d15/d17/d26 0 2024-04-25T17:18:56.845 INFO:tasks.workunit.client.0.smithi037.stdout:1/103: truncate dc/d1c/f20 310093 0 2024-04-25T17:18:56.845 INFO:tasks.workunit.client.0.smithi037.stdout:8/103: truncate d5/db/d18/f19 988550 0 2024-04-25T17:18:56.847 INFO:tasks.workunit.client.0.smithi037.stdout:3/93: fsync d8/ff 0 2024-04-25T17:18:56.849 INFO:tasks.workunit.client.0.smithi037.stdout:3/94: dread d8/f10 [0,4194304] 0 2024-04-25T17:18:56.857 INFO:tasks.workunit.client.0.smithi037.stdout:5/186: dread - d7/f11 zero size 2024-04-25T17:18:56.858 INFO:tasks.workunit.client.0.smithi037.stdout:4/217: truncate d7/f23 1313254 0 2024-04-25T17:18:56.861 INFO:tasks.workunit.client.0.smithi037.stdout:1/104: creat dc/d1c/f26 x:0 0 0 2024-04-25T17:18:56.862 INFO:tasks.workunit.client.0.smithi037.stdout:5/187: dread d7/d12/d15/f2c [0,4194304] 0 2024-04-25T17:18:56.864 INFO:tasks.workunit.client.0.smithi037.stdout:7/116: rename d5/d15/d17/d26 to d5/d15/d17/d1b/d27 0 2024-04-25T17:18:56.866 INFO:tasks.workunit.client.0.smithi037.stdout:8/104: truncate d5/da/f11 61121 0 2024-04-25T17:18:56.868 INFO:tasks.workunit.client.0.smithi037.stdout:1/105: dwrite dc/d18/f1b [0,4194304] 0 2024-04-25T17:18:56.876 INFO:tasks.workunit.client.0.smithi037.stdout:1/106: dwrite fb [0,4194304] 0 2024-04-25T17:18:56.887 INFO:tasks.workunit.client.0.smithi037.stdout:2/120: truncate d0/f5 4495898 0 2024-04-25T17:18:56.890 INFO:tasks.workunit.client.0.smithi037.stdout:8/105: mkdir d5/d13/d1d 0 2024-04-25T17:18:56.897 INFO:tasks.workunit.client.0.smithi037.stdout:7/117: truncate d5/f6 929891 0 2024-04-25T17:18:56.900 INFO:tasks.workunit.client.0.smithi037.stdout:2/121: symlink d0/d15/l25 0 2024-04-25T17:18:56.900 INFO:tasks.workunit.client.0.smithi037.stdout:2/122: dread - d0/d16/f1b zero size 2024-04-25T17:18:56.906 INFO:tasks.workunit.client.0.smithi037.stdout:7/118: chown d5/l10 13561154 1 2024-04-25T17:18:56.907 INFO:tasks.workunit.client.0.smithi037.stdout:7/119: write d5/f13 [626552,118336] 0 2024-04-25T17:18:56.908 INFO:tasks.workunit.client.0.smithi037.stdout:2/123: mkdir d0/d16/d26 0 2024-04-25T17:18:56.909 INFO:tasks.workunit.client.0.smithi037.stdout:2/124: chown d0/f14 1049274065 1 2024-04-25T17:18:56.910 INFO:tasks.workunit.client.0.smithi037.stdout:2/125: dread - d0/d15/f21 zero size 2024-04-25T17:18:56.911 INFO:tasks.workunit.client.0.smithi037.stdout:3/95: link d8/d11/f1a d8/f1e 0 2024-04-25T17:18:56.913 INFO:tasks.workunit.client.0.smithi037.stdout:5/188: getdents d7/d12 0 2024-04-25T17:18:56.915 INFO:tasks.workunit.client.0.smithi037.stdout:7/120: mknod d5/c28 0 2024-04-25T17:18:56.921 INFO:tasks.workunit.client.0.smithi037.stdout:5/189: rename d7/d12/d15/f2c to d7/d12/d15/d2e/f3d 0 2024-04-25T17:18:56.924 INFO:tasks.workunit.client.0.smithi037.stdout:7/121: truncate d5/f9 58170 0 2024-04-25T17:18:56.929 INFO:tasks.workunit.client.0.smithi037.stdout:5/190: dwrite d7/d12/d15/d2e/f34 [0,4194304] 0 2024-04-25T17:18:56.931 INFO:tasks.workunit.client.0.smithi037.stdout:5/191: write d7/d18/f2a [793786,59896] 0 2024-04-25T17:18:56.932 INFO:tasks.workunit.client.0.smithi037.stdout:5/192: chown d7/c3b 344 1 2024-04-25T17:18:56.934 INFO:tasks.workunit.client.0.smithi037.stdout:2/126: link d0/l11 d0/l27 0 2024-04-25T17:18:56.943 INFO:tasks.workunit.client.0.smithi037.stdout:2/127: rename d0/f1c to d0/d23/f28 0 2024-04-25T17:18:56.943 INFO:tasks.workunit.client.0.smithi037.stdout:2/128: readlink d0/la 0 2024-04-25T17:18:56.947 INFO:tasks.workunit.client.0.smithi037.stdout:7/122: link d5/c28 d5/c29 0 2024-04-25T17:18:56.948 INFO:tasks.workunit.client.0.smithi037.stdout:2/129: dread d0/d15/f1d [0,4194304] 0 2024-04-25T17:18:56.959 INFO:tasks.workunit.client.0.smithi037.stdout:2/130: rmdir d0/d16/d20 39 2024-04-25T17:18:56.972 INFO:tasks.workunit.client.0.smithi037.stdout:2/131: symlink d0/d16/l29 0 2024-04-25T17:18:56.974 INFO:tasks.workunit.client.0.smithi037.stdout:2/132: mkdir d0/d15/d2a 0 2024-04-25T17:18:56.975 INFO:tasks.workunit.client.0.smithi037.stdout:2/133: chown d0/d16/l29 474825618 1 2024-04-25T17:18:56.980 INFO:tasks.workunit.client.0.smithi037.stdout:2/134: creat d0/d15/f2b x:0 0 0 2024-04-25T17:18:56.986 INFO:tasks.workunit.client.0.smithi037.stdout:2/135: creat d0/d16/d26/f2c x:0 0 0 2024-04-25T17:18:56.987 INFO:tasks.workunit.client.0.smithi037.stdout:5/193: truncate d7/d12/d15/d2e/f3d 1214980 0 2024-04-25T17:18:56.990 INFO:tasks.workunit.client.0.smithi037.stdout:2/136: creat d0/f2d x:0 0 0 2024-04-25T17:18:56.993 INFO:tasks.workunit.client.0.smithi037.stdout:5/194: dread - d7/d12/d15/f26 zero size 2024-04-25T17:18:56.997 INFO:tasks.workunit.client.0.smithi037.stdout:2/137: dwrite d0/f14 [4194304,4194304] 0 2024-04-25T17:18:56.997 INFO:tasks.workunit.client.0.smithi037.stdout:5/195: mknod d7/d12/d15/c3e 0 2024-04-25T17:18:57.016 INFO:tasks.workunit.client.0.smithi037.stdout:2/138: chown d0/d16/l17 3215 1 2024-04-25T17:18:57.021 INFO:tasks.workunit.client.0.smithi037.stdout:2/139: symlink d0/d16/d26/l2e 0 2024-04-25T17:18:57.026 INFO:tasks.workunit.client.0.smithi037.stdout:7/123: dwrite d5/f9 [0,4194304] 0 2024-04-25T17:18:57.026 INFO:tasks.workunit.client.0.smithi037.stdout:5/196: dwrite d7/d25/f37 [0,4194304] 0 2024-04-25T17:18:57.029 INFO:tasks.workunit.client.0.smithi037.stdout:5/197: chown d7/f1b 216249612 1 2024-04-25T17:18:57.034 INFO:tasks.workunit.client.0.smithi037.stdout:2/140: dwrite d0/d16/f1b [0,4194304] 0 2024-04-25T17:18:57.038 INFO:tasks.workunit.client.0.smithi037.stdout:7/124: fsync d5/f6 0 2024-04-25T17:18:57.045 INFO:tasks.workunit.client.0.smithi037.stdout:7/125: rename f1 to d5/d15/d17/d1b/d27/f2a 0 2024-04-25T17:18:57.052 INFO:tasks.workunit.client.0.smithi037.stdout:7/126: mkdir d5/d15/d17/d25/d2b 0 2024-04-25T17:18:57.058 INFO:tasks.workunit.client.0.smithi037.stdout:7/127: symlink d5/d15/d17/d25/d2b/l2c 0 2024-04-25T17:18:57.118 INFO:tasks.workunit.client.0.smithi037.stdout:7/128: dread d5/d15/f19 [0,4194304] 0 2024-04-25T17:18:57.118 INFO:tasks.workunit.client.0.smithi037.stdout:7/129: dread f0 [0,4194304] 0 2024-04-25T17:18:57.118 INFO:tasks.workunit.client.0.smithi037.stdout:7/130: chown f0 240085650 1 2024-04-25T17:18:57.119 INFO:tasks.workunit.client.0.smithi037.stdout:7/131: dwrite d5/fd [0,4194304] 0 2024-04-25T17:18:57.119 INFO:tasks.workunit.client.0.smithi037.stdout:7/132: stat d5/d15/l22 0 2024-04-25T17:18:57.119 INFO:tasks.workunit.client.0.smithi037.stdout:7/133: write d5/f13 [637120,25982] 0 2024-04-25T17:18:57.119 INFO:tasks.workunit.client.0.smithi037.stdout:7/134: chown d5/d15 197083 1 2024-04-25T17:18:57.119 INFO:tasks.workunit.client.0.smithi037.stdout:2/141: truncate d0/d16/f1b 121686 0 2024-04-25T17:18:57.119 INFO:tasks.workunit.client.0.smithi037.stdout:2/142: truncate d0/d15/f21 412008 0 2024-04-25T17:18:57.119 INFO:tasks.workunit.client.0.smithi037.stdout:7/135: rename d5/c28 to d5/d15/c2d 0 2024-04-25T17:18:57.119 INFO:tasks.workunit.client.0.smithi037.stdout:7/136: symlink d5/d15/d17/d1b/l2e 0 2024-04-25T17:18:57.119 INFO:tasks.workunit.client.0.smithi037.stdout:2/143: write d0/f9 [945612,82403] 0 2024-04-25T17:18:57.119 INFO:tasks.workunit.client.0.smithi037.stdout:2/144: dread - d0/f2d zero size 2024-04-25T17:18:57.119 INFO:tasks.workunit.client.0.smithi037.stdout:2/145: write d0/f9 [801613,54405] 0 2024-04-25T17:18:57.119 INFO:tasks.workunit.client.0.smithi037.stdout:7/137: write d5/d15/f19 [670601,16154] 0 2024-04-25T17:18:57.121 INFO:tasks.workunit.client.0.smithi037.stdout:2/146: dwrite d0/d16/d26/f2c [0,4194304] 0 2024-04-25T17:18:57.126 INFO:tasks.workunit.client.0.smithi037.stdout:7/138: dwrite d5/d15/f1f [0,4194304] 0 2024-04-25T17:18:57.132 INFO:tasks.workunit.client.0.smithi037.stdout:7/139: symlink d5/d15/d17/d1b/d27/l2f 0 2024-04-25T17:18:57.133 INFO:tasks.workunit.client.0.smithi037.stdout:7/140: write d5/d15/d17/f1c [842915,26254] 0 2024-04-25T17:18:57.137 INFO:tasks.workunit.client.0.smithi037.stdout:2/147: link d0/d15/l1a d0/d15/d2a/l2f 0 2024-04-25T17:18:57.139 INFO:tasks.workunit.client.0.smithi037.stdout:7/141: symlink d5/d15/d17/d1b/l30 0 2024-04-25T17:18:57.142 INFO:tasks.workunit.client.0.smithi037.stdout:7/142: mkdir d5/d14/d31 0 2024-04-25T17:18:57.143 INFO:tasks.workunit.client.0.smithi037.stdout:7/143: write d5/f13 [727120,96236] 0 2024-04-25T17:18:57.145 INFO:tasks.workunit.client.0.smithi037.stdout:2/148: fsync d0/f5 0 2024-04-25T17:18:57.150 INFO:tasks.workunit.client.0.smithi037.stdout:7/144: symlink d5/d14/l32 0 2024-04-25T17:18:57.152 INFO:tasks.workunit.client.0.smithi037.stdout:2/149: dwrite d0/f9 [0,4194304] 0 2024-04-25T17:18:57.156 INFO:tasks.workunit.client.0.smithi037.stdout:7/145: fsync d5/f6 0 2024-04-25T17:18:57.162 INFO:tasks.workunit.client.0.smithi037.stdout:9/239: sync 2024-04-25T17:18:57.162 INFO:tasks.workunit.client.0.smithi037.stdout:6/131: sync 2024-04-25T17:18:57.167 INFO:tasks.workunit.client.0.smithi037.stdout:7/146: dwrite d5/d15/d17/d1b/d27/f2a [0,4194304] 0 2024-04-25T17:18:57.168 INFO:tasks.workunit.client.0.smithi037.stdout:9/240: dread d1/d5/dc/fe [0,4194304] 0 2024-04-25T17:18:57.168 INFO:tasks.workunit.client.0.smithi037.stdout:6/132: truncate f9 741323 0 2024-04-25T17:18:57.169 INFO:tasks.workunit.client.0.smithi037.stdout:9/241: read d1/d5/dc/fe [1366823,27075] 0 2024-04-25T17:18:57.221 INFO:tasks.workunit.client.0.smithi037.stdout:7/147: creat d5/d15/d17/d1b/f33 x:0 0 0 2024-04-25T17:18:57.224 INFO:tasks.workunit.client.0.smithi037.stdout:2/150: link d0/d16/d26/l2e d0/d16/d20/l30 0 2024-04-25T17:18:57.225 INFO:tasks.workunit.client.0.smithi037.stdout:2/151: read d0/f9 [2728096,10595] 0 2024-04-25T17:18:57.227 INFO:tasks.workunit.client.0.smithi037.stdout:7/148: mknod d5/d15/c34 0 2024-04-25T17:18:57.228 INFO:tasks.workunit.client.0.smithi037.stdout:7/149: write d5/f9 [436509,34158] 0 2024-04-25T17:18:57.236 INFO:tasks.workunit.client.0.smithi037.stdout:9/242: rename d1/d5/d19/l2c to d1/l4b 0 2024-04-25T17:18:57.238 INFO:tasks.workunit.client.0.smithi037.stdout:7/150: chown d5/d14/l23 719305 1 2024-04-25T17:18:57.246 INFO:tasks.workunit.client.0.smithi037.stdout:6/133: dwrite fa [0,4194304] 0 2024-04-25T17:18:57.246 INFO:tasks.workunit.client.0.smithi037.stdout:7/151: creat d5/d15/d17/d25/d2b/f35 x:0 0 0 2024-04-25T17:18:57.247 INFO:tasks.workunit.client.0.smithi037.stdout:6/134: fsync db/f16 0 2024-04-25T17:18:57.247 INFO:tasks.workunit.client.0.smithi037.stdout:7/152: chown d5/f9 142296921 1 2024-04-25T17:18:57.252 INFO:tasks.workunit.client.0.smithi037.stdout:6/135: dread db/f14 [0,4194304] 0 2024-04-25T17:18:57.257 INFO:tasks.workunit.client.0.smithi037.stdout:2/152: getdents d0/d15/d2a 0 2024-04-25T17:18:57.258 INFO:tasks.workunit.client.0.smithi037.stdout:2/153: truncate d0/d15/f21 825433 0 2024-04-25T17:18:57.262 INFO:tasks.workunit.client.0.smithi037.stdout:9/243: link d1/d5/dc/f27 d1/d5/d2e/d34/f4c 0 2024-04-25T17:18:57.269 INFO:tasks.workunit.client.0.smithi037.stdout:6/136: dread f5 [0,4194304] 0 2024-04-25T17:18:57.269 INFO:tasks.workunit.client.0.smithi037.stdout:9/244: dread d1/d21/d1c/f35 [0,4194304] 0 2024-04-25T17:18:57.274 INFO:tasks.workunit.client.0.smithi037.stdout:9/245: rename d1/c49 to d1/d5/dc/d38/d3d/d3f/c4d 0 2024-04-25T17:18:57.277 INFO:tasks.workunit.client.0.smithi037.stdout:9/246: mkdir d1/d21/d4e 0 2024-04-25T17:18:57.281 INFO:tasks.workunit.client.0.smithi037.stdout:9/247: rename d1/d5/dc/f10 to d1/d5/dc/d38/d3d/d3f/f4f 0 2024-04-25T17:18:57.284 INFO:tasks.workunit.client.0.smithi037.stdout:9/248: creat d1/d5/d19/f50 x:0 0 0 2024-04-25T17:18:57.284 INFO:tasks.workunit.client.0.smithi037.stdout:7/153: write d5/f6 [1371434,64154] 0 2024-04-25T17:18:57.285 INFO:tasks.workunit.client.0.smithi037.stdout:9/249: fsync d1/d5/dc/d3c/d3e/f42 0 2024-04-25T17:18:57.285 INFO:tasks.workunit.client.0.smithi037.stdout:7/154: write d5/d15/d17/d25/d2b/f35 [678216,92346] 0 2024-04-25T17:18:57.290 INFO:tasks.workunit.client.0.smithi037.stdout:9/250: creat d1/d21/d4e/f51 x:0 0 0 2024-04-25T17:18:57.292 INFO:tasks.workunit.client.0.smithi037.stdout:7/155: link d5/l10 d5/d15/d17/d1b/d27/l36 0 2024-04-25T17:18:57.296 INFO:tasks.workunit.client.0.smithi037.stdout:9/251: creat d1/d5/d2e/f52 x:0 0 0 2024-04-25T17:18:57.298 INFO:tasks.workunit.client.0.smithi037.stdout:9/252: write d1/d21/d4e/f51 [758604,118726] 0 2024-04-25T17:18:57.298 INFO:tasks.workunit.client.0.smithi037.stdout:7/156: dwrite d5/f6 [0,4194304] 0 2024-04-25T17:18:57.299 INFO:tasks.workunit.client.0.smithi037.stdout:7/157: stat d5/fd 0 2024-04-25T17:18:57.301 INFO:tasks.workunit.client.0.smithi037.stdout:7/158: read f3 [3529389,80327] 0 2024-04-25T17:18:57.304 INFO:tasks.workunit.client.0.smithi037.stdout:7/159: write d5/f13 [968864,129648] 0 2024-04-25T17:18:57.305 INFO:tasks.workunit.client.0.smithi037.stdout:7/160: chown d5/d15/d17/d1b/f33 551991731 1 2024-04-25T17:18:57.307 INFO:tasks.workunit.client.0.smithi037.stdout:9/253: link d1/d21/d1c/f1d d1/d48/f53 0 2024-04-25T17:18:57.310 INFO:tasks.workunit.client.0.smithi037.stdout:7/161: dread d5/d15/d17/d1b/d27/f2a [0,4194304] 0 2024-04-25T17:18:57.313 INFO:tasks.workunit.client.0.smithi037.stdout:7/162: dread d5/f9 [0,4194304] 0 2024-04-25T17:18:57.315 INFO:tasks.workunit.client.0.smithi037.stdout:7/163: write d5/d15/d17/d1b/f1d [5241407,11169] 0 2024-04-25T17:18:57.315 INFO:tasks.workunit.client.0.smithi037.stdout:7/164: stat d5/ca 0 2024-04-25T17:18:57.317 INFO:tasks.workunit.client.0.smithi037.stdout:7/165: chown d5/d15/d17/d25/d2b 85537 1 2024-04-25T17:18:57.318 INFO:tasks.workunit.client.0.smithi037.stdout:7/166: creat d5/f37 x:0 0 0 2024-04-25T17:18:57.320 INFO:tasks.workunit.client.0.smithi037.stdout:7/167: creat d5/d15/d17/f38 x:0 0 0 2024-04-25T17:18:57.321 INFO:tasks.workunit.client.0.smithi037.stdout:7/168: chown d5/d15/f1f 1180932133 1 2024-04-25T17:18:57.321 INFO:tasks.workunit.client.0.smithi037.stdout:7/169: stat d5/d15/d17/f20 0 2024-04-25T17:18:57.322 INFO:tasks.workunit.client.0.smithi037.stdout:7/170: stat d5/d15/d17/d25/d2b/f35 0 2024-04-25T17:18:57.322 INFO:tasks.workunit.client.0.smithi037.stdout:7/171: readlink d5/d15/d17/d1b/l2e 0 2024-04-25T17:18:57.323 INFO:tasks.workunit.client.0.smithi037.stdout:7/172: fsync d5/d15/d17/d1b/f33 0 2024-04-25T17:18:57.325 INFO:tasks.workunit.client.0.smithi037.stdout:7/173: mknod d5/d15/c39 0 2024-04-25T17:18:57.328 INFO:tasks.workunit.client.0.smithi037.stdout:7/174: rename d5/d15/l16 to d5/d15/d17/d1b/d27/l3a 0 2024-04-25T17:18:57.329 INFO:tasks.workunit.client.0.smithi037.stdout:7/175: readlink d5/l7 0 2024-04-25T17:18:57.335 INFO:tasks.workunit.client.0.smithi037.stdout:7/176: dwrite d5/fd [0,4194304] 0 2024-04-25T17:18:57.346 INFO:tasks.workunit.client.0.smithi037.stdout:7/177: dwrite d5/d15/d17/d1b/d27/f2a [0,4194304] 0 2024-04-25T17:18:57.350 INFO:tasks.workunit.client.0.smithi037.stdout:7/178: mknod d5/d15/c3b 0 2024-04-25T17:18:57.356 INFO:tasks.workunit.client.0.smithi037.stdout:7/179: dwrite d5/d15/f19 [0,4194304] 0 2024-04-25T17:18:57.379 INFO:tasks.workunit.client.0.smithi037.stdout:4/218: sync 2024-04-25T17:18:57.379 INFO:tasks.workunit.client.0.smithi037.stdout:0/153: sync 2024-04-25T17:18:57.380 INFO:tasks.workunit.client.0.smithi037.stdout:7/180: symlink d5/d15/d17/d1b/d27/l3c 0 2024-04-25T17:18:57.380 INFO:tasks.workunit.client.0.smithi037.stdout:4/219: chown d7/d29/d1e/d2b/d35/c37 7489 1 2024-04-25T17:18:57.383 INFO:tasks.workunit.client.0.smithi037.stdout:0/154: mkdir d9/df/d32 0 2024-04-25T17:18:57.385 INFO:tasks.workunit.client.0.smithi037.stdout:4/220: creat d7/d29/f48 x:0 0 0 2024-04-25T17:18:57.386 INFO:tasks.workunit.client.0.smithi037.stdout:4/221: dread - d7/d29/d1e/d2b/d35/f40 zero size 2024-04-25T17:18:57.388 INFO:tasks.workunit.client.0.smithi037.stdout:7/181: creat d5/d15/d17/d1b/d27/f3d x:0 0 0 2024-04-25T17:18:57.394 INFO:tasks.workunit.client.0.smithi037.stdout:7/182: dwrite d5/d15/d17/d1b/d27/f3d [0,4194304] 0 2024-04-25T17:18:57.398 INFO:tasks.workunit.client.0.smithi037.stdout:0/155: getdents d9 0 2024-04-25T17:18:57.399 INFO:tasks.workunit.client.0.smithi037.stdout:0/156: write d9/df/f10 [927771,4964] 0 2024-04-25T17:18:57.407 INFO:tasks.workunit.client.0.smithi037.stdout:0/157: rename d9/l15 to d9/l33 0 2024-04-25T17:18:57.414 INFO:tasks.workunit.client.0.smithi037.stdout:0/158: symlink d9/l34 0 2024-04-25T17:18:57.421 INFO:tasks.workunit.client.0.smithi037.stdout:0/159: dwrite d9/f20 [0,4194304] 0 2024-04-25T17:18:57.430 INFO:tasks.workunit.client.0.smithi037.stdout:0/160: dwrite d9/f2f [0,4194304] 0 2024-04-25T17:18:57.434 INFO:tasks.workunit.client.0.smithi037.stdout:0/161: write d9/df/f10 [97904,46031] 0 2024-04-25T17:18:57.437 INFO:tasks.workunit.client.0.smithi037.stdout:0/162: mkdir d9/df/d32/d35 0 2024-04-25T17:18:57.439 INFO:tasks.workunit.client.0.smithi037.stdout:7/183: getdents d5 0 2024-04-25T17:18:57.443 INFO:tasks.workunit.client.0.smithi037.stdout:0/163: creat d9/d14/f36 x:0 0 0 2024-04-25T17:18:57.444 INFO:tasks.workunit.client.0.smithi037.stdout:7/184: mknod d5/d14/d31/c3e 0 2024-04-25T17:18:57.447 INFO:tasks.workunit.client.0.smithi037.stdout:0/164: rmdir d9/d14/d28 39 2024-04-25T17:18:57.449 INFO:tasks.workunit.client.0.smithi037.stdout:7/185: rename d5/f9 to d5/d14/d31/f3f 0 2024-04-25T17:18:57.455 INFO:tasks.workunit.client.0.smithi037.stdout:7/186: dwrite d5/d15/d17/d25/d2b/f35 [0,4194304] 0 2024-04-25T17:18:57.457 INFO:tasks.workunit.client.0.smithi037.stdout:0/165: creat d9/d14/d28/f37 x:0 0 0 2024-04-25T17:18:57.460 INFO:tasks.workunit.client.0.smithi037.stdout:7/187: symlink d5/l40 0 2024-04-25T17:18:57.462 INFO:tasks.workunit.client.0.smithi037.stdout:7/188: chown d5/d15/d17/f38 37562 1 2024-04-25T17:18:57.462 INFO:tasks.workunit.client.0.smithi037.stdout:0/166: symlink d9/d14/d28/l38 0 2024-04-25T17:18:57.465 INFO:tasks.workunit.client.0.smithi037.stdout:0/167: mkdir d9/df/d32/d39 0 2024-04-25T17:18:57.466 INFO:tasks.workunit.client.0.smithi037.stdout:7/189: write d5/d15/d17/d1b/f1d [3612921,123244] 0 2024-04-25T17:18:57.467 INFO:tasks.workunit.client.0.smithi037.stdout:7/190: read f3 [3323637,78259] 0 2024-04-25T17:18:57.470 INFO:tasks.workunit.client.0.smithi037.stdout:7/191: chown d5/d14/l23 4513477 1 2024-04-25T17:18:57.471 INFO:tasks.workunit.client.0.smithi037.stdout:7/192: creat d5/d15/d17/f41 x:0 0 0 2024-04-25T17:18:57.472 INFO:tasks.workunit.client.0.smithi037.stdout:7/193: stat d5/d15/f1e 0 2024-04-25T17:18:57.472 INFO:tasks.workunit.client.0.smithi037.stdout:7/194: write d5/fd [3666983,100467] 0 2024-04-25T17:18:57.475 INFO:tasks.workunit.client.0.smithi037.stdout:7/195: dread f0 [0,4194304] 0 2024-04-25T17:18:57.476 INFO:tasks.workunit.client.0.smithi037.stdout:7/196: stat d5/d15/f1e 0 2024-04-25T17:18:57.478 INFO:tasks.workunit.client.0.smithi037.stdout:7/197: creat d5/d15/d17/d1b/d27/f42 x:0 0 0 2024-04-25T17:18:57.509 INFO:tasks.workunit.client.0.smithi037.stdout:7/198: rmdir d5/d15/d17/d1b 39 2024-04-25T17:18:57.511 INFO:tasks.workunit.client.0.smithi037.stdout:7/199: truncate d5/d15/d17/f38 382530 0 2024-04-25T17:18:57.512 INFO:tasks.workunit.client.0.smithi037.stdout:0/168: dwrite d9/df/f13 [0,4194304] 0 2024-04-25T17:18:57.515 INFO:tasks.workunit.client.0.smithi037.stdout:7/200: link d5/f6 d5/f43 0 2024-04-25T17:18:57.516 INFO:tasks.workunit.client.0.smithi037.stdout:0/169: symlink d9/df/d32/d39/l3a 0 2024-04-25T17:18:57.519 INFO:tasks.workunit.client.0.smithi037.stdout:7/201: dread d5/d15/d17/f1c [0,4194304] 0 2024-04-25T17:18:57.520 INFO:tasks.workunit.client.0.smithi037.stdout:7/202: fdatasync d5/d14/d31/f3f 0 2024-04-25T17:18:57.553 INFO:tasks.workunit.client.0.smithi037.stdout:8/106: sync 2024-04-25T17:18:57.553 INFO:tasks.workunit.client.0.smithi037.stdout:1/107: sync 2024-04-25T17:18:57.554 INFO:tasks.workunit.client.0.smithi037.stdout:8/107: fsync d5/db/d18/f19 0 2024-04-25T17:18:57.555 INFO:tasks.workunit.client.0.smithi037.stdout:8/108: fsync d5/f8 0 2024-04-25T17:18:57.555 INFO:tasks.workunit.client.0.smithi037.stdout:0/170: creat d9/d14/f3b x:0 0 0 2024-04-25T17:18:57.557 INFO:tasks.workunit.client.0.smithi037.stdout:7/203: creat d5/d14/d31/f44 x:0 0 0 2024-04-25T17:18:57.558 INFO:tasks.workunit.client.0.smithi037.stdout:1/108: creat dc/f27 x:0 0 0 2024-04-25T17:18:57.569 INFO:tasks.workunit.client.0.smithi037.stdout:8/109: dread d5/f8 [0,4194304] 0 2024-04-25T17:18:57.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:57 smithi037 ceph-mon[26472]: pgmap v29: 65 pgs: 65 active+clean; 443 MiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 2.6 MiB/s rd, 36 MiB/s wr, 382 op/s 2024-04-25T17:18:57.571 INFO:tasks.workunit.client.0.smithi037.stdout:8/110: write d5/fe [1266338,105537] 0 2024-04-25T17:18:57.592 INFO:tasks.workunit.client.0.smithi037.stdout:8/111: write f4 [3856079,56313] 0 2024-04-25T17:18:57.594 INFO:tasks.workunit.client.0.smithi037.stdout:8/112: creat d5/d13/d1d/f1e x:0 0 0 2024-04-25T17:18:57.595 INFO:tasks.workunit.client.0.smithi037.stdout:8/113: write d5/db/f12 [2284332,19802] 0 2024-04-25T17:18:57.601 INFO:tasks.workunit.client.0.smithi037.stdout:8/114: dwrite d5/db/d18/f19 [0,4194304] 0 2024-04-25T17:18:57.613 INFO:tasks.workunit.client.0.smithi037.stdout:8/115: dwrite d5/db/d18/f19 [4194304,4194304] 0 2024-04-25T17:18:57.615 INFO:tasks.workunit.client.0.smithi037.stdout:8/116: creat d5/db/f1f x:0 0 0 2024-04-25T17:18:57.623 INFO:tasks.workunit.client.0.smithi037.stdout:8/117: getdents d5/d13 0 2024-04-25T17:18:57.626 INFO:tasks.workunit.client.0.smithi037.stdout:8/118: mknod d5/db/d18/c20 0 2024-04-25T17:18:57.627 INFO:tasks.workunit.client.0.smithi037.stdout:8/119: dread - d5/d13/d1d/f1e zero size 2024-04-25T17:18:57.629 INFO:tasks.workunit.client.0.smithi037.stdout:8/120: mknod d5/c21 0 2024-04-25T17:18:57.631 INFO:tasks.workunit.client.0.smithi037.stdout:8/121: mknod d5/c22 0 2024-04-25T17:18:57.632 INFO:tasks.workunit.client.0.smithi037.stdout:8/122: write d5/db/fc [898566,82497] 0 2024-04-25T17:18:57.647 INFO:tasks.workunit.client.0.smithi037.stdout:8/123: dread d5/d13/f14 [0,4194304] 0 2024-04-25T17:18:57.653 INFO:tasks.workunit.client.0.smithi037.stdout:8/124: dwrite d5/d13/d1d/f1e [0,4194304] 0 2024-04-25T17:18:57.659 INFO:tasks.workunit.client.0.smithi037.stdout:8/125: rename d5/d13/d1d to d5/db/d23 0 2024-04-25T17:18:57.666 INFO:tasks.workunit.client.0.smithi037.stdout:8/126: dwrite d5/db/f12 [0,4194304] 0 2024-04-25T17:18:57.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:57 smithi069 ceph-mon[34527]: pgmap v29: 65 pgs: 65 active+clean; 443 MiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 2.6 MiB/s rd, 36 MiB/s wr, 382 op/s 2024-04-25T17:18:57.668 INFO:tasks.workunit.client.0.smithi037.stdout:8/127: write d5/db/f12 [3936515,128508] 0 2024-04-25T17:18:57.673 INFO:tasks.workunit.client.0.smithi037.stdout:8/128: rmdir d5 39 2024-04-25T17:18:57.680 INFO:tasks.workunit.client.0.smithi037.stdout:8/129: unlink d5/db/l1c 0 2024-04-25T17:18:57.691 INFO:tasks.workunit.client.0.smithi037.stdout:8/130: dwrite d5/f9 [0,4194304] 0 2024-04-25T17:18:57.692 INFO:tasks.workunit.client.0.smithi037.stdout:8/131: stat d5/db/f1b 0 2024-04-25T17:18:57.699 INFO:tasks.workunit.client.0.smithi037.stdout:8/132: dwrite f4 [4194304,4194304] 0 2024-04-25T17:18:57.700 INFO:tasks.workunit.client.0.smithi037.stdout:3/96: sync 2024-04-25T17:18:57.700 INFO:tasks.workunit.client.0.smithi037.stdout:3/97: chown d8/d11/c1d 3467803 1 2024-04-25T17:18:57.701 INFO:tasks.workunit.client.0.smithi037.stdout:8/133: mknod d5/da/c24 0 2024-04-25T17:18:57.702 INFO:tasks.workunit.client.0.smithi037.stdout:8/134: fsync d5/f8 0 2024-04-25T17:18:57.704 INFO:tasks.workunit.client.0.smithi037.stdout:3/98: dread f5 [0,4194304] 0 2024-04-25T17:18:57.709 INFO:tasks.workunit.client.0.smithi037.stdout:8/135: rename d5/c21 to d5/db/d18/c25 0 2024-04-25T17:18:57.709 INFO:tasks.workunit.client.0.smithi037.stdout:3/99: truncate d8/ff 5208327 0 2024-04-25T17:18:57.711 INFO:tasks.workunit.client.0.smithi037.stdout:8/136: write d5/d13/f14 [1174096,11797] 0 2024-04-25T17:18:57.715 INFO:tasks.workunit.client.0.smithi037.stdout:3/100: getdents d8/d11 0 2024-04-25T17:18:57.715 INFO:tasks.workunit.client.0.smithi037.stdout:3/101: stat d8/lc 0 2024-04-25T17:18:57.721 INFO:tasks.workunit.client.0.smithi037.stdout:3/102: creat d8/f1f x:0 0 0 2024-04-25T17:18:57.724 INFO:tasks.workunit.client.0.smithi037.stdout:3/103: creat d8/d11/f20 x:0 0 0 2024-04-25T17:18:57.725 INFO:tasks.workunit.client.0.smithi037.stdout:3/104: chown d8/lc 105219 1 2024-04-25T17:18:57.732 INFO:tasks.workunit.client.0.smithi037.stdout:8/137: truncate f4 4383961 0 2024-04-25T17:18:57.733 INFO:tasks.workunit.client.0.smithi037.stdout:3/105: creat d8/f21 x:0 0 0 2024-04-25T17:18:57.737 INFO:tasks.workunit.client.0.smithi037.stdout:8/138: mkdir d5/d26 0 2024-04-25T17:18:57.743 INFO:tasks.workunit.client.0.smithi037.stdout:3/106: rename d8/d11/f1a to d8/f22 0 2024-04-25T17:18:57.744 INFO:tasks.workunit.client.0.smithi037.stdout:8/139: dread d5/fe [0,4194304] 0 2024-04-25T17:18:57.747 INFO:tasks.workunit.client.0.smithi037.stdout:8/140: unlink d5/db/l1a 0 2024-04-25T17:18:57.748 INFO:tasks.workunit.client.0.smithi037.stdout:3/107: mkdir d8/d23 0 2024-04-25T17:18:57.752 INFO:tasks.workunit.client.0.smithi037.stdout:8/141: getdents d5/db/d18 0 2024-04-25T17:18:57.901 INFO:tasks.workunit.client.0.smithi037.stdout:5/198: sync 2024-04-25T17:18:57.901 INFO:tasks.workunit.client.0.smithi037.stdout:2/154: sync 2024-04-25T17:18:57.903 INFO:tasks.workunit.client.0.smithi037.stdout:5/199: mknod d7/d12/c3f 0 2024-04-25T17:18:57.904 INFO:tasks.workunit.client.0.smithi037.stdout:2/155: symlink d0/d23/l31 0 2024-04-25T17:18:57.991 INFO:tasks.workunit.client.0.smithi037.stdout:2/156: unlink d0/d15/f21 0 2024-04-25T17:18:57.992 INFO:tasks.workunit.client.0.smithi037.stdout:2/157: write d0/d16/d26/f2c [3962592,46783] 0 2024-04-25T17:18:57.998 INFO:tasks.workunit.client.0.smithi037.stdout:5/200: creat d7/f40 x:0 0 0 2024-04-25T17:18:57.999 INFO:tasks.workunit.client.0.smithi037.stdout:2/158: fdatasync d0/d15/f1d 0 2024-04-25T17:18:58.004 INFO:tasks.workunit.client.0.smithi037.stdout:2/159: creat d0/d15/f32 x:0 0 0 2024-04-25T17:18:58.006 INFO:tasks.workunit.client.0.smithi037.stdout:2/160: fsync d0/d23/f28 0 2024-04-25T17:18:58.007 INFO:tasks.workunit.client.0.smithi037.stdout:2/161: dread d0/d16/f1b [0,4194304] 0 2024-04-25T17:18:58.008 INFO:tasks.workunit.client.0.smithi037.stdout:2/162: fsync d0/f7 0 2024-04-25T17:18:58.009 INFO:tasks.workunit.client.0.smithi037.stdout:6/137: sync 2024-04-25T17:18:58.009 INFO:tasks.workunit.client.0.smithi037.stdout:9/254: sync 2024-04-25T17:18:58.010 INFO:tasks.workunit.client.0.smithi037.stdout:9/255: chown d1/d5/d19/f50 0 1 2024-04-25T17:18:58.012 INFO:tasks.workunit.client.0.smithi037.stdout:2/163: creat d0/f33 x:0 0 0 2024-04-25T17:18:58.013 INFO:tasks.workunit.client.0.smithi037.stdout:2/164: fdatasync d0/f14 0 2024-04-25T17:18:58.013 INFO:tasks.workunit.client.0.smithi037.stdout:2/165: write d0/f7 [1017578,85663] 0 2024-04-25T17:18:58.014 INFO:tasks.workunit.client.0.smithi037.stdout:6/138: symlink db/l2a 0 2024-04-25T17:18:58.017 INFO:tasks.workunit.client.0.smithi037.stdout:9/256: mknod d1/d5/dc/d38/d3d/d3f/c54 0 2024-04-25T17:18:58.022 INFO:tasks.workunit.client.0.smithi037.stdout:2/166: dwrite d0/d15/f32 [0,4194304] 0 2024-04-25T17:18:58.027 INFO:tasks.workunit.client.0.smithi037.stdout:9/257: mknod d1/d5/d2e/c55 0 2024-04-25T17:18:58.028 INFO:tasks.workunit.client.0.smithi037.stdout:9/258: dread - d1/d21/f39 zero size 2024-04-25T17:18:58.030 INFO:tasks.workunit.client.0.smithi037.stdout:2/167: creat d0/d16/d20/f34 x:0 0 0 2024-04-25T17:18:58.031 INFO:tasks.workunit.client.0.smithi037.stdout:6/139: dread db/f23 [0,4194304] 0 2024-04-25T17:18:58.033 INFO:tasks.workunit.client.0.smithi037.stdout:9/259: creat d1/d5/d19/f56 x:0 0 0 2024-04-25T17:18:58.037 INFO:tasks.workunit.client.0.smithi037.stdout:9/260: unlink d1/d5/d2e/d34/f45 0 2024-04-25T17:18:58.039 INFO:tasks.workunit.client.0.smithi037.stdout:9/261: read d1/d21/d4e/f51 [617790,92433] 0 2024-04-25T17:18:58.041 INFO:tasks.workunit.client.0.smithi037.stdout:9/262: truncate d1/d5/dc/d3c/d3e/f42 618329 0 2024-04-25T17:18:58.043 INFO:tasks.workunit.client.0.smithi037.stdout:6/140: dread db/f1c [0,4194304] 0 2024-04-25T17:18:58.050 INFO:tasks.workunit.client.0.smithi037.stdout:6/141: creat db/d26/f2b x:0 0 0 2024-04-25T17:18:58.051 INFO:tasks.workunit.client.0.smithi037.stdout:9/263: creat d1/d21/d26/f57 x:0 0 0 2024-04-25T17:18:58.055 INFO:tasks.workunit.client.0.smithi037.stdout:9/264: creat d1/d5/f58 x:0 0 0 2024-04-25T17:18:58.058 INFO:tasks.workunit.client.0.smithi037.stdout:6/142: unlink f9 0 2024-04-25T17:18:58.059 INFO:tasks.workunit.client.0.smithi037.stdout:6/143: stat l8 0 2024-04-25T17:18:58.059 INFO:tasks.workunit.client.0.smithi037.stdout:9/265: dread d1/f16 [0,4194304] 0 2024-04-25T17:18:58.060 INFO:tasks.workunit.client.0.smithi037.stdout:6/144: write db/fd [3437575,117835] 0 2024-04-25T17:18:58.060 INFO:tasks.workunit.client.0.smithi037.stdout:9/266: chown d1/ff 12 1 2024-04-25T17:18:58.065 INFO:tasks.workunit.client.0.smithi037.stdout:6/145: creat db/d24/f2c x:0 0 0 2024-04-25T17:18:58.066 INFO:tasks.workunit.client.0.smithi037.stdout:9/267: creat d1/d5/dc/d3c/d3e/f59 x:0 0 0 2024-04-25T17:18:58.066 INFO:tasks.workunit.client.0.smithi037.stdout:9/268: chown d1/d21 245875 1 2024-04-25T17:18:58.068 INFO:tasks.workunit.client.0.smithi037.stdout:6/146: mkdir db/d26/d2d 0 2024-04-25T17:18:58.070 INFO:tasks.workunit.client.0.smithi037.stdout:9/269: chown d1/fd 127250222 1 2024-04-25T17:18:58.073 INFO:tasks.workunit.client.0.smithi037.stdout:6/147: rename db/d26/d2d to db/d26/d2e 0 2024-04-25T17:18:58.078 INFO:tasks.workunit.client.0.smithi037.stdout:9/270: dwrite d1/d5/f58 [0,4194304] 0 2024-04-25T17:18:58.083 INFO:tasks.workunit.client.0.smithi037.stdout:6/148: getdents db/d1d/d20 0 2024-04-25T17:18:58.084 INFO:tasks.workunit.client.0.smithi037.stdout:6/149: dread - db/d1d/d20/f21 zero size 2024-04-25T17:18:58.084 INFO:tasks.workunit.client.0.smithi037.stdout:6/150: read - db/f11 zero size 2024-04-25T17:18:58.087 INFO:tasks.workunit.client.0.smithi037.stdout:6/151: mkdir db/d1d/d20/d2f 0 2024-04-25T17:18:58.092 INFO:tasks.workunit.client.0.smithi037.stdout:6/152: mknod db/d1d/c30 0 2024-04-25T17:18:58.093 INFO:tasks.workunit.client.0.smithi037.stdout:9/271: link d1/d5/d2e/d34/f4c d1/d21/f5a 0 2024-04-25T17:18:58.097 INFO:tasks.workunit.client.0.smithi037.stdout:6/153: creat db/d26/d2e/f31 x:0 0 0 2024-04-25T17:18:58.102 INFO:tasks.workunit.client.0.smithi037.stdout:6/154: rename db/d26/d2e/f31 to db/d1d/f32 0 2024-04-25T17:18:58.103 INFO:tasks.workunit.client.0.smithi037.stdout:6/155: dread - db/d24/f2c zero size 2024-04-25T17:18:58.103 INFO:tasks.workunit.client.0.smithi037.stdout:6/156: dread - db/d1d/f1f zero size 2024-04-25T17:18:58.106 INFO:tasks.workunit.client.0.smithi037.stdout:6/157: symlink db/l33 0 2024-04-25T17:18:58.107 INFO:tasks.workunit.client.0.smithi037.stdout:6/158: write db/d26/f2b [149039,67192] 0 2024-04-25T17:18:58.111 INFO:tasks.workunit.client.0.smithi037.stdout:6/159: rename db/f19 to db/d24/f34 0 2024-04-25T17:18:58.111 INFO:tasks.workunit.client.0.smithi037.stdout:6/160: dread - db/d24/f2c zero size 2024-04-25T17:18:58.113 INFO:tasks.workunit.client.0.smithi037.stdout:6/161: dread - db/d1d/d20/f21 zero size 2024-04-25T17:18:58.116 INFO:tasks.workunit.client.0.smithi037.stdout:6/162: creat db/d24/f35 x:0 0 0 2024-04-25T17:18:58.118 INFO:tasks.workunit.client.0.smithi037.stdout:6/163: creat db/f36 x:0 0 0 2024-04-25T17:18:58.121 INFO:tasks.workunit.client.0.smithi037.stdout:6/164: dread db/d24/f34 [0,4194304] 0 2024-04-25T17:18:58.123 INFO:tasks.workunit.client.0.smithi037.stdout:6/165: mknod db/d24/c37 0 2024-04-25T17:18:58.126 INFO:tasks.workunit.client.0.smithi037.stdout:6/166: rename db/f23 to db/d26/d2e/f38 0 2024-04-25T17:18:58.129 INFO:tasks.workunit.client.0.smithi037.stdout:6/167: rename db/fd to db/d26/d2e/f39 0 2024-04-25T17:18:58.130 INFO:tasks.workunit.client.0.smithi037.stdout:6/168: stat db/f12 0 2024-04-25T17:18:58.134 INFO:tasks.workunit.client.0.smithi037.stdout:6/169: link db/f14 db/d1d/d20/f3a 0 2024-04-25T17:18:58.142 INFO:tasks.workunit.client.0.smithi037.stdout:6/170: dwrite db/d24/f34 [0,4194304] 0 2024-04-25T17:18:58.172 INFO:tasks.workunit.client.0.smithi037.stdout:5/201: mkdir d7/d12/d15/d41 0 2024-04-25T17:18:58.175 INFO:tasks.workunit.client.0.smithi037.stdout:5/202: write d7/d12/f19 [2980337,21044] 0 2024-04-25T17:18:58.179 INFO:tasks.workunit.client.0.smithi037.stdout:5/203: fsync d7/d12/d15/d2e/f3d 0 2024-04-25T17:18:58.211 INFO:tasks.workunit.client.0.smithi037.stdout:4/222: sync 2024-04-25T17:18:58.215 INFO:tasks.workunit.client.0.smithi037.stdout:9/272: dwrite d1/d48/f53 [0,4194304] 0 2024-04-25T17:18:58.216 INFO:tasks.workunit.client.0.smithi037.stdout:4/223: truncate d7/f2a 1801866 0 2024-04-25T17:18:58.216 INFO:tasks.workunit.client.0.smithi037.stdout:4/224: stat d7/f9 0 2024-04-25T17:18:58.220 INFO:tasks.workunit.client.0.smithi037.stdout:9/273: chown d1/d5/d2e/d34/f4c 6 1 2024-04-25T17:18:58.222 INFO:tasks.workunit.client.0.smithi037.stdout:4/225: rename d7/f9 to d7/f49 0 2024-04-25T17:18:58.228 INFO:tasks.workunit.client.0.smithi037.stdout:9/274: symlink d1/l5b 0 2024-04-25T17:18:58.237 INFO:tasks.workunit.client.0.smithi037.stdout:9/275: dwrite d1/f16 [0,4194304] 0 2024-04-25T17:18:58.238 INFO:tasks.workunit.client.0.smithi037.stdout:9/276: readlink d1/l5b 0 2024-04-25T17:18:58.243 INFO:tasks.workunit.client.0.smithi037.stdout:9/277: dread d1/fd [0,4194304] 0 2024-04-25T17:18:58.243 INFO:tasks.workunit.client.0.smithi037.stdout:9/278: stat d1/l5b 0 2024-04-25T17:18:58.246 INFO:tasks.workunit.client.0.smithi037.stdout:5/204: rmdir d7/d12/d15 39 2024-04-25T17:18:58.251 INFO:tasks.workunit.client.0.smithi037.stdout:5/205: symlink d7/l42 0 2024-04-25T17:18:58.256 INFO:tasks.workunit.client.0.smithi037.stdout:5/206: dwrite f6 [4194304,4194304] 0 2024-04-25T17:18:58.270 INFO:tasks.workunit.client.0.smithi037.stdout:5/207: rename d7/d12/d15 to d7/d43 0 2024-04-25T17:18:58.271 INFO:tasks.workunit.client.0.smithi037.stdout:5/208: unlink d7/d43/l2f 0 2024-04-25T17:18:58.274 INFO:tasks.workunit.client.0.smithi037.stdout:5/209: mknod d7/d43/c44 0 2024-04-25T17:18:58.277 INFO:tasks.workunit.client.0.smithi037.stdout:5/210: unlink f3 0 2024-04-25T17:18:58.280 INFO:tasks.workunit.client.0.smithi037.stdout:4/226: truncate d7/f26 828489 0 2024-04-25T17:18:58.284 INFO:tasks.workunit.client.0.smithi037.stdout:4/227: unlink d7/d29/d1e/f41 0 2024-04-25T17:18:58.287 INFO:tasks.workunit.client.0.smithi037.stdout:9/279: write d1/d5/dc/d38/d3d/d3f/f4f [431003,114093] 0 2024-04-25T17:18:58.289 INFO:tasks.workunit.client.0.smithi037.stdout:9/280: stat d1/d5/d19/f1b 0 2024-04-25T17:18:58.290 INFO:tasks.workunit.client.0.smithi037.stdout:4/228: dwrite d7/d29/d1e/d2b/d35/f3e [0,4194304] 0 2024-04-25T17:18:58.294 INFO:tasks.workunit.client.0.smithi037.stdout:4/229: rmdir d7/d29/d1e/d2b 39 2024-04-25T17:18:58.298 INFO:tasks.workunit.client.0.smithi037.stdout:4/230: mknod d7/c4a 0 2024-04-25T17:18:58.304 INFO:tasks.workunit.client.0.smithi037.stdout:4/231: dwrite d7/f2d [0,4194304] 0 2024-04-25T17:18:58.312 INFO:tasks.workunit.client.0.smithi037.stdout:4/232: mknod d7/d29/d45/c4b 0 2024-04-25T17:18:58.315 INFO:tasks.workunit.client.0.smithi037.stdout:5/211: dwrite d7/d25/f39 [0,4194304] 0 2024-04-25T17:18:58.320 INFO:tasks.workunit.client.0.smithi037.stdout:4/233: dread d7/d29/d1e/d2b/d35/f3e [0,4194304] 0 2024-04-25T17:18:58.323 INFO:tasks.workunit.client.0.smithi037.stdout:5/212: dwrite d7/d43/d2e/f34 [0,4194304] 0 2024-04-25T17:18:58.334 INFO:tasks.workunit.client.0.smithi037.stdout:4/234: fdatasync d7/f26 0 2024-04-25T17:18:58.339 INFO:tasks.workunit.client.0.smithi037.stdout:4/235: symlink d7/d29/l4c 0 2024-04-25T17:18:58.343 INFO:tasks.workunit.client.0.smithi037.stdout:5/213: link d7/d18/f22 d7/d43/d41/f45 0 2024-04-25T17:18:58.346 INFO:tasks.workunit.client.0.smithi037.stdout:5/214: creat d7/d12/f46 x:0 0 0 2024-04-25T17:18:58.350 INFO:tasks.workunit.client.0.smithi037.stdout:5/215: fdatasync d7/d12/f23 0 2024-04-25T17:18:58.355 INFO:tasks.workunit.client.0.smithi037.stdout:5/216: link f1 d7/d43/f47 0 2024-04-25T17:18:58.359 INFO:tasks.workunit.client.0.smithi037.stdout:4/236: dread f3 [0,4194304] 0 2024-04-25T17:18:58.360 INFO:tasks.workunit.client.0.smithi037.stdout:5/217: unlink d7/d12/f36 0 2024-04-25T17:18:58.362 INFO:tasks.workunit.client.0.smithi037.stdout:4/237: symlink d7/d29/l4d 0 2024-04-25T17:18:58.363 INFO:tasks.workunit.client.0.smithi037.stdout:5/218: creat d7/d43/d2e/f48 x:0 0 0 2024-04-25T17:18:58.364 INFO:tasks.workunit.client.0.smithi037.stdout:5/219: dread - d7/f40 zero size 2024-04-25T17:18:58.365 INFO:tasks.workunit.client.0.smithi037.stdout:4/238: mkdir d7/d29/d4e 0 2024-04-25T17:18:58.370 INFO:tasks.workunit.client.0.smithi037.stdout:4/239: dread d7/d29/d1e/d2b/d35/f3e [0,4194304] 0 2024-04-25T17:18:58.372 INFO:tasks.workunit.client.0.smithi037.stdout:5/220: dwrite d7/d18/f29 [0,4194304] 0 2024-04-25T17:18:58.378 INFO:tasks.workunit.client.0.smithi037.stdout:5/221: dwrite f6 [4194304,4194304] 0 2024-04-25T17:18:58.383 INFO:tasks.workunit.client.0.smithi037.stdout:4/240: write d7/f1a [1262344,127971] 0 2024-04-25T17:18:58.386 INFO:tasks.workunit.client.0.smithi037.stdout:5/222: read d7/d18/f22 [3056194,45698] 0 2024-04-25T17:18:58.388 INFO:tasks.workunit.client.0.smithi037.stdout:4/241: dread d7/d29/f3c [0,4194304] 0 2024-04-25T17:18:58.389 INFO:tasks.workunit.client.0.smithi037.stdout:5/223: chown d7/d12/f2d 3 1 2024-04-25T17:18:58.390 INFO:tasks.workunit.client.0.smithi037.stdout:4/242: mkdir d7/d29/d45/d4f 0 2024-04-25T17:18:58.393 INFO:tasks.workunit.client.0.smithi037.stdout:4/243: symlink d7/d29/d1e/d2b/d35/d39/l50 0 2024-04-25T17:18:58.394 INFO:tasks.workunit.client.0.smithi037.stdout:4/244: chown d7/d29/d1e/d2b/l2c 3 1 2024-04-25T17:18:58.397 INFO:tasks.workunit.client.0.smithi037.stdout:4/245: creat d7/d29/d1e/d2b/f51 x:0 0 0 2024-04-25T17:18:58.398 INFO:tasks.workunit.client.0.smithi037.stdout:4/246: stat d7/d29/d1e/d2b/d35/d39/f3f 0 2024-04-25T17:18:58.400 INFO:tasks.workunit.client.0.smithi037.stdout:4/247: rename d7/d29/d1e/d2b/d35/c37 to d7/d29/c52 0 2024-04-25T17:18:58.401 INFO:tasks.workunit.client.0.smithi037.stdout:4/248: write d7/d29/f48 [263975,126391] 0 2024-04-25T17:18:58.406 INFO:tasks.workunit.client.0.smithi037.stdout:4/249: creat d7/d29/d4e/f53 x:0 0 0 2024-04-25T17:18:58.409 INFO:tasks.workunit.client.0.smithi037.stdout:4/250: unlink d7/f2a 0 2024-04-25T17:18:58.410 INFO:tasks.workunit.client.0.smithi037.stdout:4/251: chown d7/c15 13606 1 2024-04-25T17:18:58.411 INFO:tasks.workunit.client.0.smithi037.stdout:5/224: write f1 [6772826,78543] 0 2024-04-25T17:18:58.412 INFO:tasks.workunit.client.0.smithi037.stdout:4/252: fsync d7/d29/d1e/d2b/d35/d39/f3f 0 2024-04-25T17:18:58.416 INFO:tasks.workunit.client.0.smithi037.stdout:4/253: link d7/d29/d1e/f3a d7/d29/f54 0 2024-04-25T17:18:58.417 INFO:tasks.workunit.client.0.smithi037.stdout:5/225: creat d7/f49 x:0 0 0 2024-04-25T17:18:58.420 INFO:tasks.workunit.client.0.smithi037.stdout:5/226: unlink d7/c3a 0 2024-04-25T17:18:58.423 INFO:tasks.workunit.client.0.smithi037.stdout:4/254: link d7/d29/f3c d7/d29/d45/d4f/f55 0 2024-04-25T17:18:58.428 INFO:tasks.workunit.client.0.smithi037.stdout:5/227: rename d7/d43/d2e to d7/d4a 0 2024-04-25T17:18:58.428 INFO:tasks.workunit.client.0.smithi037.stdout:5/228: write d7/f40 [696428,109468] 0 2024-04-25T17:18:58.435 INFO:tasks.workunit.client.0.smithi037.stdout:4/255: getdents d7/d29/d4e 0 2024-04-25T17:18:58.441 INFO:tasks.workunit.client.0.smithi037.stdout:4/256: rename d7/d29/d1e/d2b/f51 to d7/d29/d1e/f56 0 2024-04-25T17:18:58.443 INFO:tasks.workunit.client.0.smithi037.stdout:4/257: fdatasync d7/d29/f25 0 2024-04-25T17:18:58.444 INFO:tasks.workunit.client.0.smithi037.stdout:4/258: write d7/ff [3927569,24246] 0 2024-04-25T17:18:58.445 INFO:tasks.workunit.client.0.smithi037.stdout:4/259: chown d7/d29/d1e 1 1 2024-04-25T17:18:58.445 INFO:tasks.workunit.client.0.smithi037.stdout:4/260: stat d7/d29/l4c 0 2024-04-25T17:18:58.449 INFO:tasks.workunit.client.0.smithi037.stdout:4/261: creat d7/f57 x:0 0 0 2024-04-25T17:18:58.452 INFO:tasks.workunit.client.0.smithi037.stdout:4/262: mknod d7/d29/d4e/c58 0 2024-04-25T17:18:58.460 INFO:tasks.workunit.client.0.smithi037.stdout:0/171: sync 2024-04-25T17:18:58.465 INFO:tasks.workunit.client.0.smithi037.stdout:4/263: getdents d7/d29/d1e/d2b/d35 0 2024-04-25T17:18:58.465 INFO:tasks.workunit.client.0.smithi037.stdout:5/229: dwrite d7/d43/d41/f45 [0,4194304] 0 2024-04-25T17:18:58.467 INFO:tasks.workunit.client.0.smithi037.stdout:5/230: chown d7 6 1 2024-04-25T17:18:58.470 INFO:tasks.workunit.client.0.smithi037.stdout:0/172: dwrite d9/f19 [4194304,4194304] 0 2024-04-25T17:18:58.473 INFO:tasks.workunit.client.0.smithi037.stdout:5/231: read d7/f33 [2437311,113617] 0 2024-04-25T17:18:58.481 INFO:tasks.workunit.client.0.smithi037.stdout:5/232: dwrite d7/d43/f16 [0,4194304] 0 2024-04-25T17:18:58.483 INFO:tasks.workunit.client.0.smithi037.stdout:0/173: dwrite d9/d14/f27 [0,4194304] 0 2024-04-25T17:18:58.487 INFO:tasks.workunit.client.0.smithi037.stdout:0/174: creat d9/d14/d23/f3c x:0 0 0 2024-04-25T17:18:58.489 INFO:tasks.workunit.client.0.smithi037.stdout:4/264: dread d7/d29/d1e/f30 [0,4194304] 0 2024-04-25T17:18:58.491 INFO:tasks.workunit.client.0.smithi037.stdout:0/175: getdents d9 0 2024-04-25T17:18:58.495 INFO:tasks.workunit.client.0.smithi037.stdout:0/176: rename d9/d14/d28/f37 to d9/d14/f3d 0 2024-04-25T17:18:58.498 INFO:tasks.workunit.client.0.smithi037.stdout:0/177: creat d9/df/d32/f3e x:0 0 0 2024-04-25T17:18:58.503 INFO:tasks.workunit.client.0.smithi037.stdout:4/265: dwrite d7/d29/d1e/d2b/f42 [0,4194304] 0 2024-04-25T17:18:58.505 INFO:tasks.workunit.client.0.smithi037.stdout:0/178: mkdir d9/d14/d3f 0 2024-04-25T17:18:58.506 INFO:tasks.workunit.client.0.smithi037.stdout:4/266: mknod d7/d29/d4e/c59 0 2024-04-25T17:18:58.507 INFO:tasks.workunit.client.0.smithi037.stdout:0/179: write d9/d14/f22 [223398,108438] 0 2024-04-25T17:18:58.508 INFO:tasks.workunit.client.0.smithi037.stdout:0/180: creat d9/df/f40 x:0 0 0 2024-04-25T17:18:58.509 INFO:tasks.workunit.client.0.smithi037.stdout:4/267: creat d7/d29/d45/f5a x:0 0 0 2024-04-25T17:18:58.511 INFO:tasks.workunit.client.0.smithi037.stdout:4/268: truncate d7/d29/d4e/f53 508596 0 2024-04-25T17:18:58.512 INFO:tasks.workunit.client.0.smithi037.stdout:0/181: rename d9/df/d32/d39/l3a to d9/df/d32/d35/l41 0 2024-04-25T17:18:58.514 INFO:tasks.workunit.client.0.smithi037.stdout:4/269: unlink d7/d29/f54 0 2024-04-25T17:18:58.516 INFO:tasks.workunit.client.0.smithi037.stdout:4/270: fsync d7/f2f 0 2024-04-25T17:18:58.519 INFO:tasks.workunit.client.0.smithi037.stdout:4/271: dread d7/d29/d4e/f53 [0,4194304] 0 2024-04-25T17:18:58.520 INFO:tasks.workunit.client.0.smithi037.stdout:0/182: rmdir d9/d14/d3f 0 2024-04-25T17:18:58.520 INFO:tasks.workunit.client.0.smithi037.stdout:0/183: stat f7 0 2024-04-25T17:18:58.526 INFO:tasks.workunit.client.0.smithi037.stdout:4/272: dwrite d7/f34 [0,4194304] 0 2024-04-25T17:18:58.532 INFO:tasks.workunit.client.0.smithi037.stdout:4/273: fsync d7/d29/f25 0 2024-04-25T17:18:58.539 INFO:tasks.workunit.client.0.smithi037.stdout:4/274: dwrite d7/f10 [4194304,4194304] 0 2024-04-25T17:18:58.548 INFO:tasks.workunit.client.0.smithi037.stdout:4/275: dwrite d7/d29/d1e/d2b/d35/f36 [0,4194304] 0 2024-04-25T17:18:58.549 INFO:tasks.workunit.client.0.smithi037.stdout:0/184: truncate d9/df/f10 440204 0 2024-04-25T17:18:58.555 INFO:tasks.workunit.client.0.smithi037.stdout:4/276: read d7/f26 [332896,111811] 0 2024-04-25T17:18:58.558 INFO:tasks.workunit.client.0.smithi037.stdout:0/185: dwrite d9/fa [4194304,4194304] 0 2024-04-25T17:18:58.563 INFO:tasks.workunit.client.0.smithi037.stdout:0/186: mknod d9/d14/d28/c42 0 2024-04-25T17:18:58.564 INFO:tasks.workunit.client.0.smithi037.stdout:0/187: dread - d9/d14/d28/f2a zero size 2024-04-25T17:18:58.571 INFO:tasks.workunit.client.0.smithi037.stdout:4/277: write d7/d29/f25 [160745,55710] 0 2024-04-25T17:18:58.572 INFO:tasks.workunit.client.0.smithi037.stdout:0/188: getdents d9/df 0 2024-04-25T17:18:58.573 INFO:tasks.workunit.client.0.smithi037.stdout:0/189: write d9/d14/f3b [166763,67341] 0 2024-04-25T17:18:58.577 INFO:tasks.workunit.client.0.smithi037.stdout:0/190: symlink d9/df/l43 0 2024-04-25T17:18:58.577 INFO:tasks.workunit.client.0.smithi037.stdout:0/191: chown d9/df/d32 14 1 2024-04-25T17:18:58.579 INFO:tasks.workunit.client.0.smithi037.stdout:0/192: truncate d9/df/d32/f3e 126806 0 2024-04-25T17:18:58.581 INFO:tasks.workunit.client.0.smithi037.stdout:4/278: write d7/f19 [1382887,94249] 0 2024-04-25T17:18:58.582 INFO:tasks.workunit.client.0.smithi037.stdout:0/193: creat d9/d14/f44 x:0 0 0 2024-04-25T17:18:58.584 INFO:tasks.workunit.client.0.smithi037.stdout:4/279: mkdir d7/d29/d5b 0 2024-04-25T17:18:58.586 INFO:tasks.workunit.client.0.smithi037.stdout:4/280: creat d7/d29/f5c x:0 0 0 2024-04-25T17:18:58.589 INFO:tasks.workunit.client.0.smithi037.stdout:0/194: dwrite d9/d14/f22 [0,4194304] 0 2024-04-25T17:18:58.589 INFO:tasks.workunit.client.0.smithi037.stdout:4/281: unlink d7/d29/f5c 0 2024-04-25T17:18:58.592 INFO:tasks.workunit.client.0.smithi037.stdout:0/195: creat d9/df/f45 x:0 0 0 2024-04-25T17:18:58.594 INFO:tasks.workunit.client.0.smithi037.stdout:0/196: mknod d9/c46 0 2024-04-25T17:18:58.598 INFO:tasks.workunit.client.0.smithi037.stdout:0/197: rmdir d9/d14/d23 39 2024-04-25T17:18:58.598 INFO:tasks.workunit.client.0.smithi037.stdout:4/282: dwrite d7/d29/d1e/d2b/d35/f3e [0,4194304] 0 2024-04-25T17:18:58.601 INFO:tasks.workunit.client.0.smithi037.stdout:0/198: creat d9/df/d32/f47 x:0 0 0 2024-04-25T17:18:58.604 INFO:tasks.workunit.client.0.smithi037.stdout:0/199: write d9/d14/d28/f2a [525971,28320] 0 2024-04-25T17:18:58.609 INFO:tasks.workunit.client.0.smithi037.stdout:4/283: dwrite d7/d29/f48 [0,4194304] 0 2024-04-25T17:18:58.610 INFO:tasks.workunit.client.0.smithi037.stdout:4/284: dread - d7/d29/d45/f47 zero size 2024-04-25T17:18:58.610 INFO:tasks.workunit.client.0.smithi037.stdout:0/200: mkdir d9/d14/d28/d48 0 2024-04-25T17:18:58.617 INFO:tasks.workunit.client.0.smithi037.stdout:4/285: dread d7/f3b [0,4194304] 0 2024-04-25T17:18:58.619 INFO:tasks.workunit.client.0.smithi037.stdout:0/201: dwrite d9/d14/f27 [4194304,4194304] 0 2024-04-25T17:18:58.623 INFO:tasks.workunit.client.0.smithi037.stdout:0/202: write d9/d14/d23/f29 [1994163,35597] 0 2024-04-25T17:18:58.625 INFO:tasks.workunit.client.0.smithi037.stdout:4/286: symlink d7/d29/d45/d4f/l5d 0 2024-04-25T17:18:58.630 INFO:tasks.workunit.client.0.smithi037.stdout:4/287: rmdir d7/d29/d1e 39 2024-04-25T17:18:58.631 INFO:tasks.workunit.client.0.smithi037.stdout:0/203: creat d9/d14/d28/d48/f49 x:0 0 0 2024-04-25T17:18:58.709 INFO:tasks.workunit.client.0.smithi037.stdout:0/204: creat d9/d14/d28/f4a x:0 0 0 2024-04-25T17:18:58.710 INFO:tasks.workunit.client.0.smithi037.stdout:7/204: sync 2024-04-25T17:18:58.710 INFO:tasks.workunit.client.0.smithi037.stdout:1/109: sync 2024-04-25T17:18:58.710 INFO:tasks.workunit.client.0.smithi037.stdout:7/205: fsync d5/d15/f1e 0 2024-04-25T17:18:58.715 INFO:tasks.workunit.client.0.smithi037.stdout:1/110: dwrite f5 [0,4194304] 0 2024-04-25T17:18:58.716 INFO:tasks.workunit.client.0.smithi037.stdout:1/111: readlink dc/d18/l1d 0 2024-04-25T17:18:58.738 INFO:tasks.workunit.client.0.smithi037.stdout:4/288: mknod d7/d29/d1e/d2b/c5e 0 2024-04-25T17:18:58.739 INFO:tasks.workunit.client.0.smithi037.stdout:4/289: chown d7/d29/d45/f5a 105699926 1 2024-04-25T17:18:58.742 INFO:tasks.workunit.client.0.smithi037.stdout:7/206: rename f3 to d5/d15/f45 0 2024-04-25T17:18:58.744 INFO:tasks.workunit.client.0.smithi037.stdout:4/290: rmdir d7/d29/d45/d4f 39 2024-04-25T17:18:58.746 INFO:tasks.workunit.client.0.smithi037.stdout:7/207: write d5/d15/d17/d1b/f33 [331193,31938] 0 2024-04-25T17:18:58.747 INFO:tasks.workunit.client.0.smithi037.stdout:7/208: write d5/d15/f1f [2613185,92610] 0 2024-04-25T17:18:58.755 INFO:tasks.workunit.client.0.smithi037.stdout:7/209: creat d5/f46 x:0 0 0 2024-04-25T17:18:58.756 INFO:tasks.workunit.client.0.smithi037.stdout:7/210: read d5/d15/d17/d1b/d27/f2a [3373172,9541] 0 2024-04-25T17:18:58.756 INFO:tasks.workunit.client.0.smithi037.stdout:0/205: getdents d9/d14/d23 0 2024-04-25T17:18:58.760 INFO:tasks.workunit.client.0.smithi037.stdout:0/206: dread d9/f20 [0,4194304] 0 2024-04-25T17:18:58.764 INFO:tasks.workunit.client.0.smithi037.stdout:1/112: truncate dc/d18/f1b 246104 0 2024-04-25T17:18:58.770 INFO:tasks.workunit.client.0.smithi037.stdout:4/291: rename f3 to d7/d29/d1e/d2b/f5f 0 2024-04-25T17:18:58.772 INFO:tasks.workunit.client.0.smithi037.stdout:0/207: creat d9/df/d32/f4b x:0 0 0 2024-04-25T17:18:58.774 INFO:tasks.workunit.client.0.smithi037.stdout:0/208: chown d9/df/d32/f3e 3 1 2024-04-25T17:18:58.774 INFO:tasks.workunit.client.0.smithi037.stdout:0/209: readlink d9/l34 0 2024-04-25T17:18:58.778 INFO:tasks.workunit.client.0.smithi037.stdout:4/292: dwrite d7/d29/d1e/d2b/d35/f36 [4194304,4194304] 0 2024-04-25T17:18:58.778 INFO:tasks.workunit.client.0.smithi037.stdout:1/113: readlink l4 0 2024-04-25T17:18:58.779 INFO:tasks.workunit.client.0.smithi037.stdout:4/293: write d7/f1a [36507,110297] 0 2024-04-25T17:18:58.780 INFO:tasks.workunit.client.0.smithi037.stdout:4/294: chown d7/fb 31116373 1 2024-04-25T17:18:58.785 INFO:tasks.workunit.client.0.smithi037.stdout:7/211: creat d5/d15/d17/f47 x:0 0 0 2024-04-25T17:18:58.787 INFO:tasks.workunit.client.0.smithi037.stdout:0/210: symlink d9/df/d32/d35/l4c 0 2024-04-25T17:18:58.788 INFO:tasks.workunit.client.0.smithi037.stdout:0/211: chown d9/d14/d23/f3c 1 1 2024-04-25T17:18:58.791 INFO:tasks.workunit.client.0.smithi037.stdout:1/114: rename c3 to dc/d18/c28 0 2024-04-25T17:18:58.795 INFO:tasks.workunit.client.0.smithi037.stdout:1/115: read dc/fd [634965,121970] 0 2024-04-25T17:18:58.796 INFO:tasks.workunit.client.0.smithi037.stdout:7/212: mkdir d5/d15/d17/d25/d2b/d48 0 2024-04-25T17:18:58.798 INFO:tasks.workunit.client.0.smithi037.stdout:0/212: symlink d9/d14/d28/d48/l4d 0 2024-04-25T17:18:58.798 INFO:tasks.workunit.client.0.smithi037.stdout:0/213: truncate d9/df/f40 628888 0 2024-04-25T17:18:58.806 INFO:tasks.workunit.client.0.smithi037.stdout:7/213: symlink d5/d15/d17/d25/d2b/l49 0 2024-04-25T17:18:58.806 INFO:tasks.workunit.client.0.smithi037.stdout:4/295: write d7/f2f [1300376,38137] 0 2024-04-25T17:18:58.807 INFO:tasks.workunit.client.0.smithi037.stdout:4/296: chown d7/d29/d1e/l1f 5958997 1 2024-04-25T17:18:58.808 INFO:tasks.workunit.client.0.smithi037.stdout:0/214: creat d9/d14/d28/d48/f4e x:0 0 0 2024-04-25T17:18:58.811 INFO:tasks.workunit.client.0.smithi037.stdout:4/297: dread d7/f10 [4194304,4194304] 0 2024-04-25T17:18:58.812 INFO:tasks.workunit.client.0.smithi037.stdout:7/214: mknod d5/d15/d17/d25/c4a 0 2024-04-25T17:18:58.814 INFO:tasks.workunit.client.0.smithi037.stdout:0/215: symlink d9/d14/d28/l4f 0 2024-04-25T17:18:58.818 INFO:tasks.workunit.client.0.smithi037.stdout:4/298: dwrite d7/d29/f25 [0,4194304] 0 2024-04-25T17:18:58.819 INFO:tasks.workunit.client.0.smithi037.stdout:1/116: dread dc/d18/f1b [0,4194304] 0 2024-04-25T17:18:58.820 INFO:tasks.workunit.client.0.smithi037.stdout:7/215: symlink d5/l4b 0 2024-04-25T17:18:58.824 INFO:tasks.workunit.client.0.smithi037.stdout:1/117: unlink dc/ff 0 2024-04-25T17:18:58.824 INFO:tasks.workunit.client.0.smithi037.stdout:0/216: dwrite d9/d14/d28/d48/f49 [0,4194304] 0 2024-04-25T17:18:58.826 INFO:tasks.workunit.client.0.smithi037.stdout:4/299: dread d7/f2d [0,4194304] 0 2024-04-25T17:18:58.830 INFO:tasks.workunit.client.0.smithi037.stdout:7/216: write d5/d15/d17/f1c [1145496,100626] 0 2024-04-25T17:18:58.836 INFO:tasks.workunit.client.0.smithi037.stdout:0/217: rename d9/fb to d9/d14/d28/d48/f50 0 2024-04-25T17:18:58.838 INFO:tasks.workunit.client.0.smithi037.stdout:7/217: mknod d5/d15/d17/d25/d2b/c4c 0 2024-04-25T17:18:58.840 INFO:tasks.workunit.client.0.smithi037.stdout:0/218: dread d9/d14/f27 [4194304,4194304] 0 2024-04-25T17:18:58.843 INFO:tasks.workunit.client.0.smithi037.stdout:4/300: symlink d7/d29/d1e/l60 0 2024-04-25T17:18:58.848 INFO:tasks.workunit.client.0.smithi037.stdout:7/218: creat d5/d15/d17/d25/f4d x:0 0 0 2024-04-25T17:18:58.848 INFO:tasks.workunit.client.0.smithi037.stdout:7/219: chown d5/d15/f1f 69910082 1 2024-04-25T17:18:58.849 INFO:tasks.workunit.client.0.smithi037.stdout:1/118: link dc/d18/l1a dc/d18/l29 0 2024-04-25T17:18:58.852 INFO:tasks.workunit.client.0.smithi037.stdout:0/219: rename d9/df/l43 to d9/df/d32/d39/l51 0 2024-04-25T17:18:58.857 INFO:tasks.workunit.client.0.smithi037.stdout:1/119: mknod dc/d18/c2a 0 2024-04-25T17:18:58.860 INFO:tasks.workunit.client.0.smithi037.stdout:0/220: rmdir d9 39 2024-04-25T17:18:58.862 INFO:tasks.workunit.client.0.smithi037.stdout:7/220: rename d5/d15/d17/d1b/d27/l2f to d5/d14/l4e 0 2024-04-25T17:18:58.865 INFO:tasks.workunit.client.0.smithi037.stdout:4/301: mknod d7/d29/c61 0 2024-04-25T17:18:58.867 INFO:tasks.workunit.client.0.smithi037.stdout:1/120: unlink dc/d18/l1d 0 2024-04-25T17:18:58.868 INFO:tasks.workunit.client.0.smithi037.stdout:1/121: write dc/fe [2873170,56397] 0 2024-04-25T17:18:58.871 INFO:tasks.workunit.client.0.smithi037.stdout:7/221: unlink d5/d15/c3b 0 2024-04-25T17:18:58.871 INFO:tasks.workunit.client.0.smithi037.stdout:7/222: chown d5/f6 6 1 2024-04-25T17:18:58.872 INFO:tasks.workunit.client.0.smithi037.stdout:7/223: chown d5/d15/d17/d25 64202 1 2024-04-25T17:18:58.873 INFO:tasks.workunit.client.0.smithi037.stdout:4/302: truncate d7/f11 1236691 0 2024-04-25T17:18:58.873 INFO:tasks.workunit.client.0.smithi037.stdout:7/224: chown d5/d15/d17/f1c 1075 1 2024-04-25T17:18:58.876 INFO:tasks.workunit.client.0.smithi037.stdout:1/122: creat dc/d18/f2b x:0 0 0 2024-04-25T17:18:58.882 INFO:tasks.workunit.client.0.smithi037.stdout:4/303: mkdir d7/d29/d1e/d2b/d35/d39/d62 0 2024-04-25T17:18:58.882 INFO:tasks.workunit.client.0.smithi037.stdout:0/221: link d9/d14/f27 d9/df/d32/d39/f52 0 2024-04-25T17:18:58.883 INFO:tasks.workunit.client.0.smithi037.stdout:7/225: mknod d5/d15/d17/d25/d2b/d48/c4f 0 2024-04-25T17:18:58.886 INFO:tasks.workunit.client.0.smithi037.stdout:0/222: fdatasync f2 0 2024-04-25T17:18:58.888 INFO:tasks.workunit.client.0.smithi037.stdout:7/226: dwrite d5/d15/f19 [0,4194304] 0 2024-04-25T17:18:58.890 INFO:tasks.workunit.client.0.smithi037.stdout:3/108: sync 2024-04-25T17:18:58.890 INFO:tasks.workunit.client.0.smithi037.stdout:8/142: sync 2024-04-25T17:18:58.893 INFO:tasks.workunit.client.0.smithi037.stdout:1/123: getdents dc/d1f 0 2024-04-25T17:18:58.899 INFO:tasks.workunit.client.0.smithi037.stdout:4/304: rename d7/d29/d45/f47 to d7/d29/d1e/d2b/f63 0 2024-04-25T17:18:58.900 INFO:tasks.workunit.client.0.smithi037.stdout:3/109: dwrite d8/f1f [0,4194304] 0 2024-04-25T17:18:58.902 INFO:tasks.workunit.client.0.smithi037.stdout:8/143: dwrite d5/db/d23/f1e [4194304,4194304] 0 2024-04-25T17:18:58.903 INFO:tasks.workunit.client.0.smithi037.stdout:8/144: write d5/db/f12 [5049513,18273] 0 2024-04-25T17:18:58.918 INFO:tasks.workunit.client.0.smithi037.stdout:0/223: rename d9/l33 to d9/df/d32/d35/l53 0 2024-04-25T17:18:58.925 INFO:tasks.workunit.client.0.smithi037.stdout:1/124: link dc/f10 dc/d1f/d22/f2c 0 2024-04-25T17:18:58.930 INFO:tasks.workunit.client.0.smithi037.stdout:0/224: symlink d9/df/d32/l54 0 2024-04-25T17:18:58.931 INFO:tasks.workunit.client.0.smithi037.stdout:0/225: stat d9/d14/d23/f30 0 2024-04-25T17:18:58.932 INFO:tasks.workunit.client.0.smithi037.stdout:3/110: creat d8/d23/f24 x:0 0 0 2024-04-25T17:18:58.935 INFO:tasks.workunit.client.0.smithi037.stdout:0/226: creat d9/df/d32/f55 x:0 0 0 2024-04-25T17:18:58.937 INFO:tasks.workunit.client.0.smithi037.stdout:0/227: write d9/d14/d28/f4a [158717,87006] 0 2024-04-25T17:18:58.938 INFO:tasks.workunit.client.0.smithi037.stdout:3/111: chown c4 100 1 2024-04-25T17:18:58.939 INFO:tasks.workunit.client.0.smithi037.stdout:7/227: write d5/f43 [639178,76347] 0 2024-04-25T17:18:58.940 INFO:tasks.workunit.client.0.smithi037.stdout:8/145: creat d5/f27 x:0 0 0 2024-04-25T17:18:58.942 INFO:tasks.workunit.client.0.smithi037.stdout:0/228: dread d9/df/f12 [0,4194304] 0 2024-04-25T17:18:58.943 INFO:tasks.workunit.client.0.smithi037.stdout:0/229: write d9/d14/d23/f30 [123438,112325] 0 2024-04-25T17:18:58.949 INFO:tasks.workunit.client.0.smithi037.stdout:8/146: mknod d5/da/c28 0 2024-04-25T17:18:58.952 INFO:tasks.workunit.client.0.smithi037.stdout:8/147: dread d5/d13/f14 [0,4194304] 0 2024-04-25T17:18:58.953 INFO:tasks.workunit.client.0.smithi037.stdout:0/230: mkdir d9/df/d32/d56 0 2024-04-25T17:18:58.953 INFO:tasks.workunit.client.0.smithi037.stdout:8/148: chown d5/db/d18/c25 122667 1 2024-04-25T17:18:58.954 INFO:tasks.workunit.client.0.smithi037.stdout:0/231: fsync d9/d14/d23/f29 0 2024-04-25T17:18:58.954 INFO:tasks.workunit.client.0.smithi037.stdout:8/149: truncate d5/f27 645661 0 2024-04-25T17:18:58.955 INFO:tasks.workunit.client.0.smithi037.stdout:0/232: readlink d9/d14/d28/d48/l4d 0 2024-04-25T17:18:58.957 INFO:tasks.workunit.client.0.smithi037.stdout:0/233: read d9/fa [209747,89579] 0 2024-04-25T17:18:58.957 INFO:tasks.workunit.client.0.smithi037.stdout:0/234: dread - d9/d14/f3d zero size 2024-04-25T17:18:58.960 INFO:tasks.workunit.client.0.smithi037.stdout:4/305: write d7/d29/d45/d4f/f55 [3357599,33546] 0 2024-04-25T17:18:58.963 INFO:tasks.workunit.client.0.smithi037.stdout:8/150: creat d5/db/d23/f29 x:0 0 0 2024-04-25T17:18:58.964 INFO:tasks.workunit.client.0.smithi037.stdout:8/151: read d5/fe [57279,3157] 0 2024-04-25T17:18:58.965 INFO:tasks.workunit.client.0.smithi037.stdout:7/228: link d5/ca d5/d14/d31/c50 0 2024-04-25T17:18:58.971 INFO:tasks.workunit.client.0.smithi037.stdout:3/112: link d8/d11/l13 d8/l25 0 2024-04-25T17:18:58.976 INFO:tasks.workunit.client.0.smithi037.stdout:4/306: dread d7/fe [0,4194304] 0 2024-04-25T17:18:58.977 INFO:tasks.workunit.client.0.smithi037.stdout:0/235: mknod d9/d14/c57 0 2024-04-25T17:18:58.982 INFO:tasks.workunit.client.0.smithi037.stdout:8/152: truncate d5/da/f11 135781 0 2024-04-25T17:18:58.983 INFO:tasks.workunit.client.0.smithi037.stdout:0/236: dwrite d9/df/f40 [0,4194304] 0 2024-04-25T17:18:58.988 INFO:tasks.workunit.client.0.smithi037.stdout:7/229: link d5/d15/d17/f47 d5/d15/d17/d25/d2b/f51 0 2024-04-25T17:18:58.989 INFO:tasks.workunit.client.0.smithi037.stdout:7/230: write d5/d14/d31/f3f [5505155,104961] 0 2024-04-25T17:18:58.995 INFO:tasks.workunit.client.0.smithi037.stdout:4/307: symlink d7/d29/l64 0 2024-04-25T17:18:58.998 INFO:tasks.workunit.client.0.smithi037.stdout:0/237: mkdir d9/d14/d28/d48/d58 0 2024-04-25T17:18:59.002 INFO:tasks.workunit.client.0.smithi037.stdout:0/238: read d9/f20 [3275948,7332] 0 2024-04-25T17:18:59.002 INFO:tasks.workunit.client.0.smithi037.stdout:7/231: dread d5/d15/d17/d1b/d27/f2a [0,4194304] 0 2024-04-25T17:18:59.003 INFO:tasks.workunit.client.0.smithi037.stdout:4/308: mknod d7/d29/d5b/c65 0 2024-04-25T17:18:59.004 INFO:tasks.workunit.client.0.smithi037.stdout:0/239: truncate d9/d14/f27 9225715 0 2024-04-25T17:18:59.009 INFO:tasks.workunit.client.0.smithi037.stdout:0/240: dwrite f7 [8388608,4194304] 0 2024-04-25T17:18:59.009 INFO:tasks.workunit.client.0.smithi037.stdout:4/309: rmdir d7/d29/d45/d4f 39 2024-04-25T17:18:59.014 INFO:tasks.workunit.client.0.smithi037.stdout:0/241: creat d9/df/d32/d35/f59 x:0 0 0 2024-04-25T17:18:59.018 INFO:tasks.workunit.client.0.smithi037.stdout:3/113: dwrite d8/f22 [4194304,4194304] 0 2024-04-25T17:18:59.023 INFO:tasks.workunit.client.0.smithi037.stdout:0/242: dwrite d9/df/f13 [4194304,4194304] 0 2024-04-25T17:18:59.030 INFO:tasks.workunit.client.0.smithi037.stdout:0/243: fsync f7 0 2024-04-25T17:18:59.031 INFO:tasks.workunit.client.0.smithi037.stdout:0/244: write d9/df/d32/d39/f52 [5204661,5702] 0 2024-04-25T17:18:59.038 INFO:tasks.workunit.client.0.smithi037.stdout:4/310: rename d7/d29/l4d to d7/d29/d1e/d2b/l66 0 2024-04-25T17:18:59.039 INFO:tasks.workunit.client.0.smithi037.stdout:4/311: dread d7/fe [0,4194304] 0 2024-04-25T17:18:59.044 INFO:tasks.workunit.client.0.smithi037.stdout:0/245: rename d9/df/f13 to d9/d14/d28/f5a 0 2024-04-25T17:18:59.046 INFO:tasks.workunit.client.0.smithi037.stdout:4/312: dwrite d7/f1a [0,4194304] 0 2024-04-25T17:18:59.046 INFO:tasks.workunit.client.0.smithi037.stdout:0/246: write d9/d14/d28/d48/f49 [5140487,95619] 0 2024-04-25T17:18:59.047 INFO:tasks.workunit.client.0.smithi037.stdout:4/313: write d7/f19 [3992838,3553] 0 2024-04-25T17:18:59.048 INFO:tasks.workunit.client.0.smithi037.stdout:7/232: truncate d5/d15/d17/d1b/d27/f3d 2077611 0 2024-04-25T17:18:59.048 INFO:tasks.workunit.client.0.smithi037.stdout:0/247: write f2 [9685718,51998] 0 2024-04-25T17:18:59.049 INFO:tasks.workunit.client.0.smithi037.stdout:3/114: rename d8/fd to d8/f26 0 2024-04-25T17:18:59.059 INFO:tasks.workunit.client.0.smithi037.stdout:4/314: mkdir d7/d67 0 2024-04-25T17:18:59.065 INFO:tasks.workunit.client.0.smithi037.stdout:7/233: rename d5/d15/d17/d1b/f33 to d5/d15/d17/d25/d2b/f52 0 2024-04-25T17:18:59.066 INFO:tasks.workunit.client.0.smithi037.stdout:4/315: dwrite d7/d29/d1e/d2b/d35/f40 [0,4194304] 0 2024-04-25T17:18:59.074 INFO:tasks.workunit.client.0.smithi037.stdout:3/115: link d8/f21 d8/d23/f27 0 2024-04-25T17:18:59.075 INFO:tasks.workunit.client.0.smithi037.stdout:3/116: write d8/f9 [1714459,48014] 0 2024-04-25T17:18:59.075 INFO:tasks.workunit.client.0.smithi037.stdout:3/117: read - d8/f17 zero size 2024-04-25T17:18:59.075 INFO:tasks.workunit.client.0.smithi037.stdout:3/118: dread - d8/d11/f20 zero size 2024-04-25T17:18:59.075 INFO:tasks.workunit.client.0.smithi037.stdout:3/119: write d8/f1f [1228294,39099] 0 2024-04-25T17:18:59.076 INFO:tasks.workunit.client.0.smithi037.stdout:3/120: fsync d8/f22 0 2024-04-25T17:18:59.088 INFO:tasks.workunit.client.0.smithi037.stdout:3/121: creat d8/d23/f28 x:0 0 0 2024-04-25T17:18:59.092 INFO:tasks.workunit.client.0.smithi037.stdout:4/316: rename d7/d29/d1e/d2b/c5e to d7/d29/d45/d4f/c68 0 2024-04-25T17:18:59.092 INFO:tasks.workunit.client.0.smithi037.stdout:0/248: write d9/f20 [2176052,985] 0 2024-04-25T17:18:59.094 INFO:tasks.workunit.client.0.smithi037.stdout:3/122: rmdir d8/d11 39 2024-04-25T17:18:59.095 INFO:tasks.workunit.client.0.smithi037.stdout:3/123: write d8/f17 [902394,39211] 0 2024-04-25T17:18:59.096 INFO:tasks.workunit.client.0.smithi037.stdout:7/234: link d5/d15/l22 d5/d15/d17/d1b/l53 0 2024-04-25T17:18:59.098 INFO:tasks.workunit.client.0.smithi037.stdout:4/317: read d7/d29/d4e/f53 [55423,24384] 0 2024-04-25T17:18:59.099 INFO:tasks.workunit.client.0.smithi037.stdout:4/318: fdatasync d7/d29/f48 0 2024-04-25T17:18:59.124 INFO:tasks.workunit.client.0.smithi037.stdout:2/168: sync 2024-04-25T17:18:59.125 INFO:tasks.workunit.client.0.smithi037.stdout:9/281: sync 2024-04-25T17:18:59.125 INFO:tasks.workunit.client.0.smithi037.stdout:6/171: sync 2024-04-25T17:18:59.125 INFO:tasks.workunit.client.0.smithi037.stdout:5/233: sync 2024-04-25T17:18:59.126 INFO:tasks.workunit.client.0.smithi037.stdout:0/249: truncate d9/df/f12 1242007 0 2024-04-25T17:18:59.128 INFO:tasks.workunit.client.0.smithi037.stdout:5/234: chown d7/d12/f23 500 1 2024-04-25T17:18:59.130 INFO:tasks.workunit.client.0.smithi037.stdout:4/319: rename d7/d29/c32 to d7/d29/d45/d4f/c69 0 2024-04-25T17:18:59.130 INFO:tasks.workunit.client.0.smithi037.stdout:5/235: read - d7/d12/f46 zero size 2024-04-25T17:18:59.133 INFO:tasks.workunit.client.0.smithi037.stdout:2/169: rmdir d0/d15/d2a 39 2024-04-25T17:18:59.139 INFO:tasks.workunit.client.0.smithi037.stdout:9/282: symlink d1/d5/dc/d38/l5c 0 2024-04-25T17:18:59.140 INFO:tasks.workunit.client.0.smithi037.stdout:6/172: dwrite db/d24/f35 [0,4194304] 0 2024-04-25T17:18:59.148 INFO:tasks.workunit.client.0.smithi037.stdout:4/320: fsync d7/d29/d1e/f56 0 2024-04-25T17:18:59.148 INFO:tasks.workunit.client.0.smithi037.stdout:0/250: dread d9/d14/d28/d48/f49 [0,4194304] 0 2024-04-25T17:18:59.151 INFO:tasks.workunit.client.0.smithi037.stdout:5/236: dwrite d7/d25/f2b [0,4194304] 0 2024-04-25T17:18:59.152 INFO:tasks.workunit.client.0.smithi037.stdout:4/321: readlink d7/d29/l2e 0 2024-04-25T17:18:59.153 INFO:tasks.workunit.client.0.smithi037.stdout:3/124: dwrite d8/d23/f27 [0,4194304] 0 2024-04-25T17:18:59.156 INFO:tasks.workunit.client.0.smithi037.stdout:9/283: mkdir d1/d5/dc/d38/d3d/d3f/d5d 0 2024-04-25T17:18:59.170 INFO:tasks.workunit.client.0.smithi037.stdout:7/235: getdents d5/d15/d17/d1b 0 2024-04-25T17:18:59.173 INFO:tasks.workunit.client.0.smithi037.stdout:0/251: creat d9/d14/d28/f5b x:0 0 0 2024-04-25T17:18:59.175 INFO:tasks.workunit.client.0.smithi037.stdout:6/173: dwrite db/d26/d2e/f38 [0,4194304] 0 2024-04-25T17:18:59.180 INFO:tasks.workunit.client.0.smithi037.stdout:4/322: creat d7/d29/d5b/f6a x:0 0 0 2024-04-25T17:18:59.181 INFO:tasks.workunit.client.0.smithi037.stdout:4/323: readlink d7/d29/d1e/l1f 0 2024-04-25T17:18:59.183 INFO:tasks.workunit.client.0.smithi037.stdout:5/237: fsync d7/d12/f2d 0 2024-04-25T17:18:59.186 INFO:tasks.workunit.client.0.smithi037.stdout:3/125: mkdir d8/d23/d29 0 2024-04-25T17:18:59.188 INFO:tasks.workunit.client.0.smithi037.stdout:3/126: fsync d8/d23/f27 0 2024-04-25T17:18:59.189 INFO:tasks.workunit.client.0.smithi037.stdout:3/127: fdatasync d8/d23/f24 0 2024-04-25T17:18:59.191 INFO:tasks.workunit.client.0.smithi037.stdout:7/236: mknod d5/d15/d17/d25/c54 0 2024-04-25T17:18:59.193 INFO:tasks.workunit.client.0.smithi037.stdout:7/237: dread - d5/d15/d17/d25/f4d zero size 2024-04-25T17:18:59.194 INFO:tasks.workunit.client.0.smithi037.stdout:0/252: rmdir d9/df/d32/d39 39 2024-04-25T17:18:59.195 INFO:tasks.workunit.client.0.smithi037.stdout:9/284: dwrite d1/d5/dc/d38/d3d/d3f/f41 [0,4194304] 0 2024-04-25T17:18:59.197 INFO:tasks.workunit.client.0.smithi037.stdout:6/174: mknod db/d1d/c3b 0 2024-04-25T17:18:59.201 INFO:tasks.workunit.client.0.smithi037.stdout:2/170: link d0/d23/c24 d0/d16/d26/c35 0 2024-04-25T17:18:59.202 INFO:tasks.workunit.client.0.smithi037.stdout:2/171: chown d0/d15 97116 1 2024-04-25T17:18:59.204 INFO:tasks.workunit.client.0.smithi037.stdout:4/324: write d7/f10 [5081762,41945] 0 2024-04-25T17:18:59.206 INFO:tasks.workunit.client.0.smithi037.stdout:4/325: fdatasync d7/d29/d45/f5a 0 2024-04-25T17:18:59.208 INFO:tasks.workunit.client.0.smithi037.stdout:4/326: read - d7/d29/d1e/f56 zero size 2024-04-25T17:18:59.217 INFO:tasks.workunit.client.0.smithi037.stdout:7/238: creat d5/f55 x:0 0 0 2024-04-25T17:18:59.218 INFO:tasks.workunit.client.0.smithi037.stdout:0/253: dread d9/f2f [0,4194304] 0 2024-04-25T17:18:59.220 INFO:tasks.workunit.client.0.smithi037.stdout:9/285: creat d1/d5/dc/f5e x:0 0 0 2024-04-25T17:18:59.222 INFO:tasks.workunit.client.0.smithi037.stdout:7/239: dread d5/d15/d17/d1b/d27/f2a [0,4194304] 0 2024-04-25T17:18:59.224 INFO:tasks.workunit.client.0.smithi037.stdout:2/172: write d0/d16/f1b [18322,75080] 0 2024-04-25T17:18:59.226 INFO:tasks.workunit.client.0.smithi037.stdout:2/173: write d0/d16/d26/f2c [2391965,28520] 0 2024-04-25T17:18:59.226 INFO:tasks.workunit.client.0.smithi037.stdout:4/327: mknod d7/d29/d1e/d2b/d35/c6b 0 2024-04-25T17:18:59.230 INFO:tasks.workunit.client.0.smithi037.stdout:5/238: rename d7/d12/f38 to d7/d25/f4b 0 2024-04-25T17:18:59.231 INFO:tasks.workunit.client.0.smithi037.stdout:5/239: chown d7/d43/d41 1794 1 2024-04-25T17:18:59.233 INFO:tasks.workunit.client.0.smithi037.stdout:4/328: dwrite d7/f1a [0,4194304] 0 2024-04-25T17:18:59.236 INFO:tasks.workunit.client.0.smithi037.stdout:3/128: truncate d8/f1e 2413764 0 2024-04-25T17:18:59.240 INFO:tasks.workunit.client.0.smithi037.stdout:3/129: dread d8/d23/f27 [0,4194304] 0 2024-04-25T17:18:59.247 INFO:tasks.workunit.client.0.smithi037.stdout:3/130: dread d8/f10 [0,4194304] 0 2024-04-25T17:18:59.251 INFO:tasks.workunit.client.0.smithi037.stdout:3/131: dread d8/d23/f27 [0,4194304] 0 2024-04-25T17:18:59.259 INFO:tasks.workunit.client.0.smithi037.stdout:1/125: sync 2024-04-25T17:18:59.259 INFO:tasks.workunit.client.0.smithi037.stdout:8/153: sync 2024-04-25T17:18:59.260 INFO:tasks.workunit.client.0.smithi037.stdout:4/329: creat d7/d29/d4e/f6c x:0 0 0 2024-04-25T17:18:59.265 INFO:tasks.workunit.client.0.smithi037.stdout:4/330: dwrite d7/d29/f25 [0,4194304] 0 2024-04-25T17:18:59.274 INFO:tasks.workunit.client.0.smithi037.stdout:3/132: rmdir d8 39 2024-04-25T17:18:59.276 INFO:tasks.workunit.client.0.smithi037.stdout:5/240: dwrite d7/fc [0,4194304] 0 2024-04-25T17:18:59.278 INFO:tasks.workunit.client.0.smithi037.stdout:5/241: write d7/fc [95704,38869] 0 2024-04-25T17:18:59.280 INFO:tasks.workunit.client.0.smithi037.stdout:5/242: chown d7/d25/f39 20471 1 2024-04-25T17:18:59.281 INFO:tasks.workunit.client.0.smithi037.stdout:8/154: write f4 [3755963,56442] 0 2024-04-25T17:18:59.285 INFO:tasks.workunit.client.0.smithi037.stdout:0/254: creat d9/df/d32/f5c x:0 0 0 2024-04-25T17:18:59.290 INFO:tasks.workunit.client.0.smithi037.stdout:6/175: getdents db/d24 0 2024-04-25T17:18:59.290 INFO:tasks.workunit.client.0.smithi037.stdout:6/176: readlink l2 0 2024-04-25T17:18:59.290 INFO:tasks.workunit.client.0.smithi037.stdout:6/177: readlink db/l2a 0 2024-04-25T17:18:59.292 INFO:tasks.workunit.client.0.smithi037.stdout:4/331: rmdir d7/d29 39 2024-04-25T17:18:59.292 INFO:tasks.workunit.client.0.smithi037.stdout:8/155: dread d5/db/fc [0,4194304] 0 2024-04-25T17:18:59.293 INFO:tasks.workunit.client.0.smithi037.stdout:0/255: dwrite d9/d14/f22 [0,4194304] 0 2024-04-25T17:18:59.296 INFO:tasks.workunit.client.0.smithi037.stdout:9/286: rmdir d1/d5/dc/d38/d3d/d3f/d5d 0 2024-04-25T17:18:59.297 INFO:tasks.workunit.client.0.smithi037.stdout:9/287: write d1/d5/dc/d38/d3d/d3f/f41 [781287,89663] 0 2024-04-25T17:18:59.299 INFO:tasks.workunit.client.0.smithi037.stdout:9/288: stat d1/d5/dc/d38/c44 0 2024-04-25T17:18:59.303 INFO:tasks.workunit.client.0.smithi037.stdout:2/174: creat d0/d15/f36 x:0 0 0 2024-04-25T17:18:59.306 INFO:tasks.workunit.client.0.smithi037.stdout:1/126: dread f8 [0,4194304] 0 2024-04-25T17:18:59.320 INFO:tasks.workunit.client.0.smithi037.stdout:4/332: write d7/f2d [4937697,72728] 0 2024-04-25T17:18:59.321 INFO:tasks.workunit.client.0.smithi037.stdout:4/333: write d7/f19 [2920427,66716] 0 2024-04-25T17:18:59.322 INFO:tasks.workunit.client.0.smithi037.stdout:8/156: symlink d5/d13/l2a 0 2024-04-25T17:18:59.323 INFO:tasks.workunit.client.0.smithi037.stdout:4/334: chown d7/f2d 3459 1 2024-04-25T17:18:59.326 INFO:tasks.workunit.client.0.smithi037.stdout:0/256: unlink d9/df/c2b 0 2024-04-25T17:18:59.327 INFO:tasks.workunit.client.0.smithi037.stdout:0/257: write d9/d14/f22 [1424952,28736] 0 2024-04-25T17:18:59.327 INFO:tasks.workunit.client.0.smithi037.stdout:4/335: dread d7/f1a [0,4194304] 0 2024-04-25T17:18:59.329 INFO:tasks.workunit.client.0.smithi037.stdout:7/240: link d5/d15/d17/d1b/d27/l36 d5/d15/l56 0 2024-04-25T17:18:59.332 INFO:tasks.workunit.client.0.smithi037.stdout:9/289: symlink d1/d5/dc/d38/d3d/l5f 0 2024-04-25T17:18:59.337 INFO:tasks.workunit.client.0.smithi037.stdout:5/243: mknod d7/d12/c4c 0 2024-04-25T17:18:59.339 INFO:tasks.workunit.client.0.smithi037.stdout:5/244: write d7/ff [4585899,128578] 0 2024-04-25T17:18:59.343 INFO:tasks.workunit.client.0.smithi037.stdout:6/178: symlink db/d1d/d20/d2f/l3c 0 2024-04-25T17:18:59.344 INFO:tasks.workunit.client.0.smithi037.stdout:6/179: dread - db/d1d/f1f zero size 2024-04-25T17:18:59.345 INFO:tasks.workunit.client.0.smithi037.stdout:6/180: dread - db/f17 zero size 2024-04-25T17:18:59.345 INFO:tasks.workunit.client.0.smithi037.stdout:6/181: fdatasync db/d24/f2c 0 2024-04-25T17:18:59.348 INFO:tasks.workunit.client.0.smithi037.stdout:3/133: dread d8/ff [0,4194304] 0 2024-04-25T17:18:59.355 INFO:tasks.workunit.client.0.smithi037.stdout:3/134: dwrite d8/f9 [0,4194304] 0 2024-04-25T17:18:59.355 INFO:tasks.workunit.client.0.smithi037.stdout:2/175: dwrite d0/f5 [0,4194304] 0 2024-04-25T17:18:59.359 INFO:tasks.workunit.client.0.smithi037.stdout:9/290: unlink d1/c8 0 2024-04-25T17:18:59.363 INFO:tasks.workunit.client.0.smithi037.stdout:1/127: creat dc/d1f/d22/f2d x:0 0 0 2024-04-25T17:18:59.363 INFO:tasks.workunit.client.0.smithi037.stdout:1/128: fdatasync dc/d1c/f20 0 2024-04-25T17:18:59.364 INFO:tasks.workunit.client.0.smithi037.stdout:1/129: read dc/f15 [1758820,13093] 0 2024-04-25T17:18:59.371 INFO:tasks.workunit.client.0.smithi037.stdout:1/130: dwrite f7 [4194304,4194304] 0 2024-04-25T17:18:59.371 INFO:tasks.workunit.client.0.smithi037.stdout:1/131: read - dc/f27 zero size 2024-04-25T17:18:59.437 INFO:tasks.workunit.client.0.smithi037.stdout:6/182: rename db/f22 to db/f3d 0 2024-04-25T17:18:59.438 INFO:tasks.workunit.client.0.smithi037.stdout:8/157: truncate d5/f8 3438426 0 2024-04-25T17:18:59.438 INFO:tasks.workunit.client.0.smithi037.stdout:0/258: creat d9/d14/d28/d48/d58/f5d x:0 0 0 2024-04-25T17:18:59.439 INFO:tasks.workunit.client.0.smithi037.stdout:8/158: readlink d5/da/l10 0 2024-04-25T17:18:59.442 INFO:tasks.workunit.client.0.smithi037.stdout:0/259: write d9/df/d32/d35/f59 [646239,40323] 0 2024-04-25T17:18:59.444 INFO:tasks.workunit.client.0.smithi037.stdout:0/260: truncate d9/d14/f36 109430 0 2024-04-25T17:18:59.451 INFO:tasks.workunit.client.0.smithi037.stdout:6/183: rmdir db/d26/d2e 39 2024-04-25T17:18:59.452 INFO:tasks.workunit.client.0.smithi037.stdout:7/241: link d5/l4b d5/d15/l57 0 2024-04-25T17:18:59.460 INFO:tasks.workunit.client.0.smithi037.stdout:0/261: creat d9/d14/d28/d48/d58/f5e x:0 0 0 2024-04-25T17:18:59.462 INFO:tasks.workunit.client.0.smithi037.stdout:4/336: link d7/fe d7/d29/d4e/f6d 0 2024-04-25T17:18:59.464 INFO:tasks.workunit.client.0.smithi037.stdout:3/135: rmdir d8/d23/d29 0 2024-04-25T17:18:59.467 INFO:tasks.workunit.client.0.smithi037.stdout:2/176: rename d0/f7 to d0/d15/f37 0 2024-04-25T17:18:59.468 INFO:tasks.workunit.client.0.smithi037.stdout:8/159: rename d5 to d5/d26/d2b 22 2024-04-25T17:18:59.470 INFO:tasks.workunit.client.0.smithi037.stdout:4/337: dwrite d7/f19 [0,4194304] 0 2024-04-25T17:18:59.472 INFO:tasks.workunit.client.0.smithi037.stdout:1/132: dread fa [0,4194304] 0 2024-04-25T17:18:59.472 INFO:tasks.workunit.client.0.smithi037.stdout:7/242: mkdir d5/d14/d31/d58 0 2024-04-25T17:18:59.479 INFO:tasks.workunit.client.0.smithi037.stdout:3/136: mknod d8/d23/c2a 0 2024-04-25T17:18:59.485 INFO:tasks.workunit.client.0.smithi037.stdout:6/184: rename db/d24 to db/d26/d2e/d3e 0 2024-04-25T17:18:59.485 INFO:tasks.workunit.client.0.smithi037.stdout:6/185: stat db/f12 0 2024-04-25T17:18:59.494 INFO:tasks.workunit.client.0.smithi037.stdout:0/262: symlink d9/d14/l5f 0 2024-04-25T17:18:59.494 INFO:tasks.workunit.client.0.smithi037.stdout:0/263: readlink d9/d14/l2e 0 2024-04-25T17:18:59.494 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:18:59 smithi037 ceph-mon[26472]: pgmap v30: 65 pgs: 65 active+clean; 443 MiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 1.3 MiB/s rd, 21 MiB/s wr, 255 op/s 2024-04-25T17:18:59.498 INFO:tasks.workunit.client.0.smithi037.stdout:6/186: symlink db/d26/d2e/l3f 0 2024-04-25T17:18:59.505 INFO:tasks.workunit.client.0.smithi037.stdout:6/187: unlink db/l2a 0 2024-04-25T17:18:59.510 INFO:tasks.workunit.client.0.smithi037.stdout:3/137: link d8/f10 d8/d11/f2b 0 2024-04-25T17:18:59.512 INFO:tasks.workunit.client.0.smithi037.stdout:2/177: link d0/l18 d0/d15/d2a/l38 0 2024-04-25T17:18:59.514 INFO:tasks.workunit.client.0.smithi037.stdout:2/178: chown d0/d16/d20 279786 1 2024-04-25T17:18:59.514 INFO:tasks.workunit.client.0.smithi037.stdout:1/133: link dc/d18/l29 dc/d1f/l2e 0 2024-04-25T17:18:59.516 INFO:tasks.workunit.client.0.smithi037.stdout:1/134: write dc/d18/f25 [77730,10578] 0 2024-04-25T17:18:59.516 INFO:tasks.workunit.client.0.smithi037.stdout:2/179: write d0/d16/d20/f34 [347687,25961] 0 2024-04-25T17:18:59.518 INFO:tasks.workunit.client.0.smithi037.stdout:0/264: creat d9/df/d32/f60 x:0 0 0 2024-04-25T17:18:59.520 INFO:tasks.workunit.client.0.smithi037.stdout:3/138: dwrite d8/d23/f28 [0,4194304] 0 2024-04-25T17:18:59.527 INFO:tasks.workunit.client.0.smithi037.stdout:0/265: unlink d9/f20 0 2024-04-25T17:18:59.529 INFO:tasks.workunit.client.0.smithi037.stdout:1/135: dread dc/fe [0,4194304] 0 2024-04-25T17:18:59.532 INFO:tasks.workunit.client.0.smithi037.stdout:6/188: rename db/d26/d2e/d3e/c37 to db/d26/c40 0 2024-04-25T17:18:59.535 INFO:tasks.workunit.client.0.smithi037.stdout:5/245: truncate d7/d12/f19 2204046 0 2024-04-25T17:18:59.542 INFO:tasks.workunit.client.0.smithi037.stdout:1/136: creat dc/d18/f2f x:0 0 0 2024-04-25T17:18:59.546 INFO:tasks.workunit.client.0.smithi037.stdout:0/266: dread d9/df/f2c [0,4194304] 0 2024-04-25T17:18:59.547 INFO:tasks.workunit.client.0.smithi037.stdout:0/267: fsync d9/d14/d28/f5b 0 2024-04-25T17:18:59.554 INFO:tasks.workunit.client.0.smithi037.stdout:3/139: creat d8/f2c x:0 0 0 2024-04-25T17:18:59.556 INFO:tasks.workunit.client.0.smithi037.stdout:8/160: write d5/f8 [2465473,56124] 0 2024-04-25T17:18:59.556 INFO:tasks.workunit.client.0.smithi037.stdout:4/338: dwrite d7/d29/d4e/f53 [0,4194304] 0 2024-04-25T17:18:59.560 INFO:tasks.workunit.client.0.smithi037.stdout:2/180: getdents d0 0 2024-04-25T17:18:59.564 INFO:tasks.workunit.client.0.smithi037.stdout:0/268: dwrite d9/d14/d28/f5a [0,4194304] 0 2024-04-25T17:18:59.566 INFO:tasks.workunit.client.0.smithi037.stdout:0/269: truncate d9/d14/d28/d48/f50 5148334 0 2024-04-25T17:18:59.566 INFO:tasks.workunit.client.0.smithi037.stdout:0/270: readlink d9/l26 0 2024-04-25T17:18:59.566 INFO:tasks.workunit.client.0.smithi037.stdout:3/140: creat d8/d23/f2d x:0 0 0 2024-04-25T17:18:59.570 INFO:tasks.workunit.client.0.smithi037.stdout:4/339: unlink d7/d29/d1e/f30 0 2024-04-25T17:18:59.573 INFO:tasks.workunit.client.0.smithi037.stdout:2/181: rename d0/d15/f2b to d0/d16/d20/f39 0 2024-04-25T17:18:59.573 INFO:tasks.workunit.client.0.smithi037.stdout:8/161: symlink d5/d26/l2c 0 2024-04-25T17:18:59.583 INFO:tasks.workunit.client.0.smithi037.stdout:3/141: dwrite d8/d23/f28 [4194304,4194304] 0 2024-04-25T17:18:59.583 INFO:tasks.workunit.client.0.smithi037.stdout:2/182: mknod d0/c3a 0 2024-04-25T17:18:59.585 INFO:tasks.workunit.client.0.smithi037.stdout:8/162: symlink d5/da/l2d 0 2024-04-25T17:18:59.589 INFO:tasks.workunit.client.1.smithi069.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-04-25T17:18:59.589 INFO:tasks.workunit.client.0.smithi037.stdout:0/271: mknod d9/df/d32/c61 0 2024-04-25T17:18:59.589 INFO:tasks.workunit.client.0.smithi037.stdout:5/246: read d7/d12/f19 [345226,83074] 0 2024-04-25T17:18:59.591 INFO:tasks.workunit.client.0.smithi037.stdout:5/247: write d7/fc [5022020,25314] 0 2024-04-25T17:18:59.593 INFO:tasks.workunit.client.0.smithi037.stdout:6/189: write db/f17 [470344,119289] 0 2024-04-25T17:18:59.594 INFO:tasks.workunit.client.0.smithi037.stdout:0/272: creat d9/d14/d28/f62 x:0 0 0 2024-04-25T17:18:59.595 INFO:tasks.workunit.client.1.smithi069.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-04-25T17:18:59.595 INFO:tasks.workunit.client.1.smithi069.stderr:+ make 2024-04-25T17:18:59.601 INFO:tasks.workunit.client.0.smithi037.stdout:1/137: dwrite dc/d1f/d22/f2c [0,4194304] 0 2024-04-25T17:18:59.602 INFO:tasks.workunit.client.0.smithi037.stdout:1/138: fdatasync dc/f16 0 2024-04-25T17:18:59.614 INFO:tasks.workunit.client.0.smithi037.stdout:1/139: dread f1 [0,4194304] 0 2024-04-25T17:18:59.615 INFO:tasks.workunit.client.0.smithi037.stdout:1/140: dread - dc/d18/f2b zero size 2024-04-25T17:18:59.616 INFO:tasks.workunit.client.0.smithi037.stdout:0/273: rename d9/df/d32/d35/f59 to d9/df/d32/d39/f63 0 2024-04-25T17:18:59.618 INFO:tasks.workunit.client.0.smithi037.stdout:0/274: write d9/d14/d28/d48/d58/f5d [488783,114263] 0 2024-04-25T17:18:59.619 INFO:tasks.workunit.client.0.smithi037.stdout:2/183: getdents d0 0 2024-04-25T17:18:59.621 INFO:tasks.workunit.client.0.smithi037.stdout:1/141: dread dc/fd [0,4194304] 0 2024-04-25T17:18:59.621 INFO:tasks.workunit.client.0.smithi037.stdout:1/142: readlink l4 0 2024-04-25T17:18:59.625 INFO:tasks.workunit.client.0.smithi037.stdout:1/143: creat dc/d1f/d22/f30 x:0 0 0 2024-04-25T17:18:59.627 INFO:tasks.workunit.client.0.smithi037.stdout:8/163: truncate d5/db/f12 4340506 0 2024-04-25T17:18:59.629 INFO:tasks.workunit.client.0.smithi037.stdout:8/164: dread - d5/db/f1b zero size 2024-04-25T17:18:59.629 INFO:tasks.workunit.client.0.smithi037.stdout:5/248: truncate d7/d25/f37 1115254 0 2024-04-25T17:18:59.630 INFO:tasks.workunit.client.0.smithi037.stdout:4/340: dwrite d7/fe [0,4194304] 0 2024-04-25T17:18:59.633 INFO:tasks.workunit.client.0.smithi037.stdout:1/144: mknod dc/d1f/d22/c31 0 2024-04-25T17:18:59.637 INFO:tasks.workunit.client.0.smithi037.stdout:2/184: dread d0/f14 [4194304,4194304] 0 2024-04-25T17:18:59.637 INFO:tasks.workunit.client.0.smithi037.stdout:2/185: dread - d0/f2d zero size 2024-04-25T17:18:59.646 INFO:tasks.workunit.client.0.smithi037.stdout:1/145: dwrite f7 [4194304,4194304] 0 2024-04-25T17:18:59.650 INFO:tasks.workunit.client.0.smithi037.stdout:5/249: creat d7/d12/f4d x:0 0 0 2024-04-25T17:18:59.651 INFO:tasks.workunit.client.0.smithi037.stdout:4/341: link d7/c15 d7/d29/d1e/d2b/d35/c6e 0 2024-04-25T17:18:59.655 INFO:tasks.workunit.client.0.smithi037.stdout:8/165: getdents d5/da 0 2024-04-25T17:18:59.658 INFO:tasks.workunit.client.0.smithi037.stdout:4/342: rename d7/c43 to d7/d29/d45/d4f/c6f 0 2024-04-25T17:18:59.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:18:59 smithi069 ceph-mon[34527]: pgmap v30: 65 pgs: 65 active+clean; 443 MiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 1.3 MiB/s rd, 21 MiB/s wr, 255 op/s 2024-04-25T17:18:59.703 INFO:tasks.workunit.client.0.smithi037.stdout:2/186: dread d0/d15/f37 [0,4194304] 0 2024-04-25T17:18:59.703 INFO:tasks.workunit.client.0.smithi037.stdout:1/146: dwrite f5 [0,4194304] 0 2024-04-25T17:18:59.705 INFO:tasks.workunit.client.0.smithi037.stdout:2/187: write d0/f14 [3976445,100167] 0 2024-04-25T17:18:59.706 INFO:tasks.workunit.client.0.smithi037.stdout:2/188: chown d0/l3 208951 1 2024-04-25T17:18:59.707 INFO:tasks.workunit.client.0.smithi037.stdout:4/343: unlink d7/d29/f25 0 2024-04-25T17:18:59.713 INFO:tasks.workunit.client.0.smithi037.stdout:1/147: mknod dc/d1f/c32 0 2024-04-25T17:18:59.713 INFO:tasks.workunit.client.0.smithi037.stdout:1/148: fsync fa 0 2024-04-25T17:18:59.717 INFO:tasks.workunit.client.1.smithi069.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-04-25T17:18:59.718 INFO:tasks.workunit.client.0.smithi037.stdout:2/189: mkdir d0/d16/d3b 0 2024-04-25T17:18:59.720 INFO:tasks.workunit.client.0.smithi037.stdout:4/344: mkdir d7/d29/d1e/d70 0 2024-04-25T17:18:59.720 INFO:tasks.workunit.client.0.smithi037.stdout:2/190: write d0/f2d [1015926,88371] 0 2024-04-25T17:18:59.723 INFO:tasks.workunit.client.0.smithi037.stdout:4/345: write d7/f10 [8861918,24463] 0 2024-04-25T17:18:59.725 INFO:tasks.workunit.client.0.smithi037.stdout:5/250: dwrite f0 [0,4194304] 0 2024-04-25T17:18:59.728 INFO:tasks.workunit.client.0.smithi037.stdout:1/149: getdents dc/d18 0 2024-04-25T17:18:59.728 INFO:tasks.workunit.client.0.smithi037.stdout:2/191: dread d0/f2d [0,4194304] 0 2024-04-25T17:18:59.733 INFO:tasks.workunit.client.0.smithi037.stdout:4/346: rename d7/fb to d7/d29/d4e/f71 0 2024-04-25T17:18:59.734 INFO:tasks.workunit.client.0.smithi037.stdout:4/347: fdatasync d7/f10 0 2024-04-25T17:18:59.741 INFO:tasks.workunit.client.0.smithi037.stdout:4/348: dwrite d7/d29/d4e/f6d [0,4194304] 0 2024-04-25T17:18:59.742 INFO:tasks.workunit.client.0.smithi037.stdout:5/251: symlink d7/d18/l4e 0 2024-04-25T17:18:59.746 INFO:tasks.workunit.client.0.smithi037.stdout:1/150: write f8 [3532487,37333] 0 2024-04-25T17:18:59.746 INFO:tasks.workunit.client.0.smithi037.stdout:1/151: readlink dc/l12 0 2024-04-25T17:18:59.747 INFO:tasks.workunit.client.0.smithi037.stdout:2/192: mkdir d0/d16/d3c 0 2024-04-25T17:18:59.748 INFO:tasks.workunit.client.0.smithi037.stdout:4/349: fsync d7/f12 0 2024-04-25T17:18:59.750 INFO:tasks.workunit.client.0.smithi037.stdout:2/193: dread d0/d16/d20/f34 [0,4194304] 0 2024-04-25T17:18:59.751 INFO:tasks.workunit.client.0.smithi037.stdout:2/194: chown d0/d16 24170 1 2024-04-25T17:18:59.758 INFO:tasks.workunit.client.0.smithi037.stdout:1/152: getdents dc/d24 0 2024-04-25T17:18:59.761 INFO:tasks.workunit.client.0.smithi037.stdout:5/252: truncate d7/f17 367374 0 2024-04-25T17:18:59.764 INFO:tasks.workunit.client.0.smithi037.stdout:1/153: dwrite dc/f27 [0,4194304] 0 2024-04-25T17:18:59.765 INFO:tasks.workunit.client.0.smithi037.stdout:4/350: truncate d7/d29/d1e/d2b/f5f 1352361 0 2024-04-25T17:18:59.769 INFO:tasks.workunit.client.0.smithi037.stdout:2/195: link d0/d16/f1b d0/d16/d20/f3d 0 2024-04-25T17:18:59.770 INFO:tasks.workunit.client.0.smithi037.stdout:2/196: fsync d0/f5 0 2024-04-25T17:18:59.771 INFO:tasks.workunit.client.0.smithi037.stdout:1/154: symlink dc/l33 0 2024-04-25T17:18:59.774 INFO:tasks.workunit.client.0.smithi037.stdout:4/351: dwrite d7/f10 [4194304,4194304] 0 2024-04-25T17:18:59.777 INFO:tasks.workunit.client.0.smithi037.stdout:2/197: mkdir d0/d16/d26/d3e 0 2024-04-25T17:18:59.777 INFO:tasks.workunit.client.0.smithi037.stdout:2/198: dread - d0/f33 zero size 2024-04-25T17:18:59.779 INFO:tasks.workunit.client.0.smithi037.stdout:2/199: chown d0/d16/l29 91 1 2024-04-25T17:18:59.780 INFO:tasks.workunit.client.0.smithi037.stdout:2/200: chown d0/c13 3625 1 2024-04-25T17:18:59.785 INFO:tasks.workunit.client.0.smithi037.stdout:4/352: mknod d7/d29/d5b/c72 0 2024-04-25T17:18:59.786 INFO:tasks.workunit.client.0.smithi037.stdout:2/201: truncate d0/f9 3843159 0 2024-04-25T17:18:59.790 INFO:tasks.workunit.client.0.smithi037.stdout:1/155: link dc/d18/f25 dc/f34 0 2024-04-25T17:18:59.797 INFO:tasks.workunit.client.0.smithi037.stdout:1/156: mknod dc/c35 0 2024-04-25T17:18:59.809 INFO:tasks.workunit.client.0.smithi037.stdout:4/353: getdents d7/d29/d1e/d2b/d35/d39 0 2024-04-25T17:18:59.833 INFO:tasks.workunit.client.0.smithi037.stdout:2/202: dread d0/f9 [0,4194304] 0 2024-04-25T17:18:59.834 INFO:tasks.workunit.client.0.smithi037.stdout:2/203: chown d0/f33 4 1 2024-04-25T17:18:59.840 INFO:tasks.workunit.client.0.smithi037.stdout:2/204: dwrite d0/d16/d26/f2c [0,4194304] 0 2024-04-25T17:18:59.840 INFO:tasks.workunit.client.0.smithi037.stdout:2/205: chown d0/c10 56 1 2024-04-25T17:18:59.845 INFO:tasks.workunit.client.0.smithi037.stdout:2/206: dread d0/f14 [4194304,4194304] 0 2024-04-25T17:18:59.849 INFO:tasks.workunit.client.0.smithi037.stdout:1/157: fsync dc/d18/f25 0 2024-04-25T17:18:59.852 INFO:tasks.workunit.client.0.smithi037.stdout:4/354: link d7/d29/d4e/f6c d7/d29/d5b/f73 0 2024-04-25T17:18:59.852 INFO:tasks.workunit.client.0.smithi037.stdout:1/158: dread f8 [0,4194304] 0 2024-04-25T17:18:59.853 INFO:tasks.workunit.client.0.smithi037.stdout:4/355: write d7/fe [2700947,31032] 0 2024-04-25T17:18:59.854 INFO:tasks.workunit.client.0.smithi037.stdout:1/159: chown dc/d1f/c32 3979 1 2024-04-25T17:18:59.858 INFO:tasks.workunit.client.0.smithi037.stdout:1/160: dread f5 [0,4194304] 0 2024-04-25T17:18:59.866 INFO:tasks.workunit.client.0.smithi037.stdout:1/161: dwrite dc/f15 [0,4194304] 0 2024-04-25T17:18:59.867 INFO:tasks.workunit.client.0.smithi037.stdout:2/207: dwrite d0/d16/d20/f39 [0,4194304] 0 2024-04-25T17:18:59.880 INFO:tasks.workunit.client.0.smithi037.stdout:9/291: sync 2024-04-25T17:18:59.892 INFO:tasks.workunit.client.0.smithi037.stdout:1/162: mkdir dc/d1f/d22/d36 0 2024-04-25T17:18:59.899 INFO:tasks.workunit.client.0.smithi037.stdout:4/356: mknod d7/d29/d1e/c74 0 2024-04-25T17:18:59.905 INFO:tasks.workunit.client.0.smithi037.stdout:4/357: dwrite d7/d29/f3d [0,4194304] 0 2024-04-25T17:18:59.916 INFO:tasks.workunit.client.0.smithi037.stdout:4/358: creat d7/d29/d1e/d2b/f75 x:0 0 0 2024-04-25T17:18:59.924 INFO:tasks.workunit.client.0.smithi037.stdout:4/359: dwrite d7/d29/d5b/f6a [0,4194304] 0 2024-04-25T17:18:59.930 INFO:tasks.workunit.client.0.smithi037.stdout:4/360: mknod d7/d29/d1e/c76 0 2024-04-25T17:18:59.941 INFO:tasks.workunit.client.0.smithi037.stdout:4/361: rmdir d7/d29/d1e/d2b/d35/d39/d62 0 2024-04-25T17:18:59.961 INFO:tasks.workunit.client.0.smithi037.stdout:4/362: dread d7/ff [0,4194304] 0 2024-04-25T17:18:59.966 INFO:tasks.workunit.client.0.smithi037.stdout:4/363: dwrite d7/f19 [0,4194304] 0 2024-04-25T17:18:59.980 INFO:tasks.workunit.client.0.smithi037.stdout:2/208: write d0/d16/d20/f34 [1246644,77871] 0 2024-04-25T17:18:59.984 INFO:tasks.workunit.client.0.smithi037.stdout:2/209: creat d0/d16/d26/f3f x:0 0 0 2024-04-25T17:18:59.985 INFO:tasks.workunit.client.0.smithi037.stdout:2/210: stat d0/c13 0 2024-04-25T17:18:59.991 INFO:tasks.workunit.client.0.smithi037.stdout:2/211: unlink d0/d16/d20/l30 0 2024-04-25T17:18:59.995 INFO:tasks.workunit.client.0.smithi037.stdout:1/163: dwrite dc/d18/f1b [0,4194304] 0 2024-04-25T17:18:59.998 INFO:tasks.workunit.client.0.smithi037.stdout:2/212: mknod d0/d15/d2a/c40 0 2024-04-25T17:19:00.000 INFO:tasks.workunit.client.0.smithi037.stdout:1/164: symlink dc/d1f/l37 0 2024-04-25T17:19:00.003 INFO:tasks.workunit.client.0.smithi037.stdout:2/213: rename d0/d16/d20/f34 to d0/d16/d26/f41 0 2024-04-25T17:19:00.005 INFO:tasks.workunit.client.0.smithi037.stdout:1/165: creat dc/d18/f38 x:0 0 0 2024-04-25T17:19:00.009 INFO:tasks.workunit.client.0.smithi037.stdout:1/166: mkdir dc/d18/d39 0 2024-04-25T17:19:00.012 INFO:tasks.workunit.client.0.smithi037.stdout:2/214: link d0/f33 d0/d16/d3c/f42 0 2024-04-25T17:19:00.013 INFO:tasks.workunit.client.0.smithi037.stdout:1/167: dread dc/d1f/d22/f2c [0,4194304] 0 2024-04-25T17:19:00.014 INFO:tasks.workunit.client.0.smithi037.stdout:1/168: chown dc/d1f/d22/f2c 0 1 2024-04-25T17:19:00.019 INFO:tasks.workunit.client.0.smithi037.stdout:1/169: symlink dc/d18/l3a 0 2024-04-25T17:19:00.019 INFO:tasks.workunit.client.0.smithi037.stdout:2/215: dwrite d0/d15/f36 [0,4194304] 0 2024-04-25T17:19:00.021 INFO:tasks.workunit.client.0.smithi037.stdout:2/216: fdatasync d0/d16/d26/f3f 0 2024-04-25T17:19:00.021 INFO:tasks.workunit.client.0.smithi037.stdout:2/217: stat d0/f2d 0 2024-04-25T17:19:00.023 INFO:tasks.workunit.client.0.smithi037.stdout:1/170: truncate dc/d18/f25 51777 0 2024-04-25T17:19:00.024 INFO:tasks.workunit.client.0.smithi037.stdout:2/218: truncate d0/f9 1988286 0 2024-04-25T17:19:00.029 INFO:tasks.workunit.client.0.smithi037.stdout:1/171: dwrite dc/d18/f1b [0,4194304] 0 2024-04-25T17:19:00.031 INFO:tasks.workunit.client.0.smithi037.stdout:4/364: rmdir d7/d29/d1e 39 2024-04-25T17:19:00.038 INFO:tasks.workunit.client.0.smithi037.stdout:1/172: rename dc/l17 to dc/d1f/d22/d36/l3b 0 2024-04-25T17:19:00.038 INFO:tasks.workunit.client.0.smithi037.stdout:1/173: fdatasync f7 0 2024-04-25T17:19:00.044 INFO:tasks.workunit.client.0.smithi037.stdout:1/174: dwrite dc/d1f/d22/f30 [0,4194304] 0 2024-04-25T17:19:00.047 INFO:tasks.workunit.client.0.smithi037.stdout:4/365: mknod d7/d29/d1e/c77 0 2024-04-25T17:19:00.053 INFO:tasks.workunit.client.0.smithi037.stdout:1/175: dwrite dc/d18/f38 [0,4194304] 0 2024-04-25T17:19:00.060 INFO:tasks.workunit.client.0.smithi037.stdout:4/366: mkdir d7/d78 0 2024-04-25T17:19:00.063 INFO:tasks.workunit.client.0.smithi037.stdout:1/176: rename dc/l12 to dc/d18/d39/l3c 0 2024-04-25T17:19:00.065 INFO:tasks.workunit.client.0.smithi037.stdout:1/177: rename dc/d1c/f26 to dc/f3d 0 2024-04-25T17:19:00.068 INFO:tasks.workunit.client.0.smithi037.stdout:1/178: link dc/d18/f2f dc/d18/f3e 0 2024-04-25T17:19:00.071 INFO:tasks.workunit.client.0.smithi037.stdout:1/179: rename dc/c35 to dc/d1f/c3f 0 2024-04-25T17:19:00.073 INFO:tasks.workunit.client.0.smithi037.stdout:1/180: creat dc/d1f/d22/d36/f40 x:0 0 0 2024-04-25T17:19:00.075 INFO:tasks.workunit.client.0.smithi037.stdout:1/181: creat dc/d1f/d22/d36/f41 x:0 0 0 2024-04-25T17:19:00.081 INFO:tasks.workunit.client.0.smithi037.stdout:1/182: dwrite dc/f16 [0,4194304] 0 2024-04-25T17:19:00.084 INFO:tasks.workunit.client.0.smithi037.stdout:1/183: creat dc/d18/f42 x:0 0 0 2024-04-25T17:19:00.088 INFO:tasks.workunit.client.0.smithi037.stdout:1/184: dread f5 [0,4194304] 0 2024-04-25T17:19:00.091 INFO:tasks.workunit.client.0.smithi037.stdout:1/185: mkdir dc/d1f/d43 0 2024-04-25T17:19:00.094 INFO:tasks.workunit.client.0.smithi037.stdout:1/186: mknod dc/d18/d39/c44 0 2024-04-25T17:19:00.098 INFO:tasks.workunit.client.0.smithi037.stdout:1/187: creat dc/d24/f45 x:0 0 0 2024-04-25T17:19:00.100 INFO:tasks.workunit.client.0.smithi037.stdout:1/188: mknod dc/d1f/c46 0 2024-04-25T17:19:00.106 INFO:tasks.workunit.client.0.smithi037.stdout:1/189: dread dc/fd [0,4194304] 0 2024-04-25T17:19:00.106 INFO:tasks.workunit.client.0.smithi037.stdout:2/219: dwrite d0/f14 [0,4194304] 0 2024-04-25T17:19:00.108 INFO:tasks.workunit.client.0.smithi037.stdout:1/190: creat dc/d24/f47 x:0 0 0 2024-04-25T17:19:00.112 INFO:tasks.workunit.client.0.smithi037.stdout:2/220: unlink d0/d16/d26/l2e 0 2024-04-25T17:19:00.112 INFO:tasks.workunit.client.0.smithi037.stdout:1/191: dread dc/f15 [0,4194304] 0 2024-04-25T17:19:00.116 INFO:tasks.workunit.client.0.smithi037.stdout:1/192: write dc/f15 [5166629,67679] 0 2024-04-25T17:19:00.121 INFO:tasks.workunit.client.0.smithi037.stdout:2/221: dwrite d0/d16/d26/f41 [0,4194304] 0 2024-04-25T17:19:00.121 INFO:tasks.workunit.client.0.smithi037.stdout:1/193: unlink dc/d1c/f20 0 2024-04-25T17:19:00.122 INFO:tasks.workunit.client.1.smithi069.stderr:++ readlink -f fsstress 2024-04-25T17:19:00.122 INFO:tasks.workunit.client.0.smithi037.stdout:1/194: chown f9 0 1 2024-04-25T17:19:00.124 INFO:tasks.workunit.client.1.smithi069.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-04-25T17:19:00.124 INFO:tasks.workunit.client.1.smithi069.stderr:+ popd 2024-04-25T17:19:00.126 INFO:tasks.workunit.client.1.smithi069.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-04-25T17:19:00.126 INFO:tasks.workunit.client.1.smithi069.stderr:+ popd 2024-04-25T17:19:00.127 INFO:tasks.workunit.client.1.smithi069.stdout:~/cephtest/mnt.1/client.1/tmp 2024-04-25T17:19:00.128 INFO:tasks.workunit.client.1.smithi069.stderr:++ mktemp -d -p . 2024-04-25T17:19:00.131 INFO:tasks.workunit.client.1.smithi069.stderr:+ T=./tmp.o33FBP4vLD 2024-04-25T17:19:00.131 INFO:tasks.workunit.client.1.smithi069.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.o33FBP4vLD -l 1 -n 1000 -p 10 -v 2024-04-25T17:19:00.136 INFO:tasks.workunit.client.1.smithi069.stdout:seed = 1713932162 2024-04-25T17:19:00.136 INFO:tasks.workunit.client.0.smithi037.stdout:1/195: getdents dc/d1c 0 2024-04-25T17:19:00.140 INFO:tasks.workunit.client.0.smithi037.stdout:2/222: write d0/d16/d20/f3d [127831,99771] 0 2024-04-25T17:19:00.141 INFO:tasks.workunit.client.1.smithi069.stdout:0/0: truncate - no filename 2024-04-25T17:19:00.141 INFO:tasks.workunit.client.1.smithi069.stdout:0/1: stat - no entries 2024-04-25T17:19:00.143 INFO:tasks.workunit.client.0.smithi037.stdout:2/223: creat d0/d23/f43 x:0 0 0 2024-04-25T17:19:00.143 INFO:tasks.workunit.client.0.smithi037.stdout:1/196: dwrite fa [0,4194304] 0 2024-04-25T17:19:00.144 INFO:tasks.workunit.client.1.smithi069.stdout:1/0: fsync - no filename 2024-04-25T17:19:00.144 INFO:tasks.workunit.client.1.smithi069.stdout:1/1: dwrite - no filename 2024-04-25T17:19:00.144 INFO:tasks.workunit.client.1.smithi069.stdout:1/2: dread - no filename 2024-04-25T17:19:00.144 INFO:tasks.workunit.client.1.smithi069.stdout:1/3: stat - no entries 2024-04-25T17:19:00.144 INFO:tasks.workunit.client.0.smithi037.stdout:1/197: readlink dc/d18/l3a 0 2024-04-25T17:19:00.145 INFO:tasks.workunit.client.1.smithi069.stdout:0/2: mkdir d0 0 2024-04-25T17:19:00.149 INFO:tasks.workunit.client.0.smithi037.stdout:1/198: rename f5 to dc/d24/f48 0 2024-04-25T17:19:00.150 INFO:tasks.workunit.client.1.smithi069.stdout:3/0: dwrite - no filename 2024-04-25T17:19:00.150 INFO:tasks.workunit.client.1.smithi069.stdout:3/1: truncate - no filename 2024-04-25T17:19:00.151 INFO:tasks.workunit.client.1.smithi069.stdout:3/2: readlink - no filename 2024-04-25T17:19:00.151 INFO:tasks.workunit.client.1.smithi069.stdout:3/3: dwrite - no filename 2024-04-25T17:19:00.151 INFO:tasks.workunit.client.1.smithi069.stdout:3/4: dread - no filename 2024-04-25T17:19:00.151 INFO:tasks.workunit.client.1.smithi069.stdout:3/5: dread - no filename 2024-04-25T17:19:00.151 INFO:tasks.workunit.client.1.smithi069.stdout:3/6: write - no filename 2024-04-25T17:19:00.151 INFO:tasks.workunit.client.1.smithi069.stdout:3/7: rename - no filename 2024-04-25T17:19:00.152 INFO:tasks.workunit.client.1.smithi069.stdout:1/4: creat f0 x:0 0 0 2024-04-25T17:19:00.154 INFO:tasks.workunit.client.1.smithi069.stdout:4/0: fsync - no filename 2024-04-25T17:19:00.154 INFO:tasks.workunit.client.1.smithi069.stdout:4/1: fdatasync - no filename 2024-04-25T17:19:00.155 INFO:tasks.workunit.client.0.smithi037.stdout:1/199: truncate dc/fd 2550331 0 2024-04-25T17:19:00.155 INFO:tasks.workunit.client.0.smithi037.stdout:2/224: link d0/d16/d3c/f42 d0/f44 0 2024-04-25T17:19:00.155 INFO:tasks.workunit.client.1.smithi069.stdout:2/0: mkdir d0 0 2024-04-25T17:19:00.155 INFO:tasks.workunit.client.1.smithi069.stdout:2/1: truncate - no filename 2024-04-25T17:19:00.155 INFO:tasks.workunit.client.1.smithi069.stdout:2/2: dwrite - no filename 2024-04-25T17:19:00.155 INFO:tasks.workunit.client.1.smithi069.stdout:2/3: chown d0 6600 1 2024-04-25T17:19:00.156 INFO:tasks.workunit.client.0.smithi037.stdout:2/225: write d0/d23/f43 [466873,50518] 0 2024-04-25T17:19:00.156 INFO:tasks.workunit.client.0.smithi037.stdout:1/200: truncate dc/d18/f2f 904131 0 2024-04-25T17:19:00.156 INFO:tasks.workunit.client.1.smithi069.stdout:1/5: mkdir d1 0 2024-04-25T17:19:00.157 INFO:tasks.workunit.client.1.smithi069.stdout:1/6: write f0 [435916,116680] 0 2024-04-25T17:19:00.158 INFO:tasks.workunit.client.1.smithi069.stdout:1/7: chown f0 10281636 1 2024-04-25T17:19:00.158 INFO:tasks.workunit.client.1.smithi069.stdout:5/0: fdatasync - no filename 2024-04-25T17:19:00.158 INFO:tasks.workunit.client.1.smithi069.stdout:5/1: truncate - no filename 2024-04-25T17:19:00.158 INFO:tasks.workunit.client.1.smithi069.stdout:5/2: write - no filename 2024-04-25T17:19:00.158 INFO:tasks.workunit.client.1.smithi069.stdout:1/8: stat f0 0 2024-04-25T17:19:00.158 INFO:tasks.workunit.client.1.smithi069.stdout:3/8: creat f0 x:0 0 0 2024-04-25T17:19:00.159 INFO:tasks.workunit.client.1.smithi069.stdout:1/9: stat d1 0 2024-04-25T17:19:00.160 INFO:tasks.workunit.client.0.smithi037.stdout:2/226: dread d0/f14 [4194304,4194304] 0 2024-04-25T17:19:00.161 INFO:tasks.workunit.client.1.smithi069.stdout:6/0: write - no filename 2024-04-25T17:19:00.162 INFO:tasks.workunit.client.1.smithi069.stdout:6/1: rename - no filename 2024-04-25T17:19:00.162 INFO:tasks.workunit.client.1.smithi069.stdout:6/2: chown . 242250 1 2024-04-25T17:19:00.162 INFO:tasks.workunit.client.1.smithi069.stdout:6/3: dwrite - no filename 2024-04-25T17:19:00.162 INFO:tasks.workunit.client.1.smithi069.stdout:6/4: rmdir - no directory 2024-04-25T17:19:00.163 INFO:tasks.workunit.client.1.smithi069.stdout:3/9: creat f1 x:0 0 0 2024-04-25T17:19:00.164 INFO:tasks.workunit.client.0.smithi037.stdout:1/201: link dc/d1f/c32 dc/d18/c49 0 2024-04-25T17:19:00.165 INFO:tasks.workunit.client.0.smithi037.stdout:2/227: link d0/d23/f43 d0/d16/d26/f45 0 2024-04-25T17:19:00.166 INFO:tasks.workunit.client.1.smithi069.stdout:4/2: creat f0 x:0 0 0 2024-04-25T17:19:00.167 INFO:tasks.workunit.client.1.smithi069.stdout:4/3: rmdir - no directory 2024-04-25T17:19:00.167 INFO:tasks.workunit.client.1.smithi069.stdout:2/4: mkdir d0/d1 0 2024-04-25T17:19:00.167 INFO:tasks.workunit.client.1.smithi069.stdout:2/5: dwrite - no filename 2024-04-25T17:19:00.168 INFO:tasks.workunit.client.0.smithi037.stdout:2/228: chown d0/d15/d2a/l38 2 1 2024-04-25T17:19:00.168 INFO:tasks.workunit.client.0.smithi037.stdout:2/229: stat d0/d16/d3c 0 2024-04-25T17:19:00.170 INFO:tasks.workunit.client.1.smithi069.stdout:7/0: unlink - no file 2024-04-25T17:19:00.170 INFO:tasks.workunit.client.1.smithi069.stdout:7/1: dwrite - no filename 2024-04-25T17:19:00.172 INFO:tasks.workunit.client.1.smithi069.stdout:5/3: creat f0 x:0 0 0 2024-04-25T17:19:00.172 INFO:tasks.workunit.client.1.smithi069.stdout:5/4: fdatasync f0 0 2024-04-25T17:19:00.174 INFO:tasks.workunit.client.1.smithi069.stdout:3/10: creat f2 x:0 0 0 2024-04-25T17:19:00.175 INFO:tasks.workunit.client.1.smithi069.stdout:4/4: mkdir d1 0 2024-04-25T17:19:00.176 INFO:tasks.workunit.client.0.smithi037.stdout:2/230: symlink d0/d16/d26/d3e/l46 0 2024-04-25T17:19:00.177 INFO:tasks.workunit.client.1.smithi069.stdout:6/5: creat f0 x:0 0 0 2024-04-25T17:19:00.180 INFO:tasks.workunit.client.1.smithi069.stdout:8/0: readlink - no filename 2024-04-25T17:19:00.180 INFO:tasks.workunit.client.1.smithi069.stdout:8/1: dread - no filename 2024-04-25T17:19:00.180 INFO:tasks.workunit.client.1.smithi069.stdout:8/2: dread - no filename 2024-04-25T17:19:00.180 INFO:tasks.workunit.client.1.smithi069.stdout:8/3: stat - no entries 2024-04-25T17:19:00.180 INFO:tasks.workunit.client.1.smithi069.stdout:8/4: dwrite - no filename 2024-04-25T17:19:00.180 INFO:tasks.workunit.client.1.smithi069.stdout:5/5: dwrite f0 [0,4194304] 0 2024-04-25T17:19:00.180 INFO:tasks.workunit.client.1.smithi069.stdout:8/5: chown . 3 1 2024-04-25T17:19:00.180 INFO:tasks.workunit.client.1.smithi069.stdout:8/6: link - no file 2024-04-25T17:19:00.180 INFO:tasks.workunit.client.1.smithi069.stdout:8/7: stat - no entries 2024-04-25T17:19:00.181 INFO:tasks.workunit.client.1.smithi069.stdout:3/11: creat f3 x:0 0 0 2024-04-25T17:19:00.181 INFO:tasks.workunit.client.1.smithi069.stdout:1/10: fsync f0 0 2024-04-25T17:19:00.183 INFO:tasks.workunit.client.1.smithi069.stdout:2/6: getdents d0/d1 0 2024-04-25T17:19:00.185 INFO:tasks.workunit.client.1.smithi069.stdout:6/6: creat f1 x:0 0 0 2024-04-25T17:19:00.187 INFO:tasks.workunit.client.1.smithi069.stdout:9/0: link - no file 2024-04-25T17:19:00.188 INFO:tasks.workunit.client.1.smithi069.stdout:7/2: symlink l0 0 2024-04-25T17:19:00.189 INFO:tasks.workunit.client.1.smithi069.stdout:7/3: rmdir - no directory 2024-04-25T17:19:00.190 INFO:tasks.workunit.client.1.smithi069.stdout:5/6: creat f1 x:0 0 0 2024-04-25T17:19:00.190 INFO:tasks.workunit.client.1.smithi069.stdout:5/7: dread - f1 zero size 2024-04-25T17:19:00.191 INFO:tasks.workunit.client.1.smithi069.stdout:5/8: write f1 [875957,112411] 0 2024-04-25T17:19:00.192 INFO:tasks.workunit.client.1.smithi069.stdout:4/5: creat d1/f2 x:0 0 0 2024-04-25T17:19:00.193 INFO:tasks.workunit.client.0.smithi037.stdout:7/243: sync 2024-04-25T17:19:00.195 INFO:tasks.workunit.client.1.smithi069.stdout:3/12: unlink f2 0 2024-04-25T17:19:00.195 INFO:tasks.workunit.client.1.smithi069.stdout:3/13: stat f3 0 2024-04-25T17:19:00.195 INFO:tasks.workunit.client.1.smithi069.stdout:3/14: stat f3 0 2024-04-25T17:19:00.197 INFO:tasks.workunit.client.0.smithi037.stdout:7/244: mkdir d5/d15/d17/d25/d2b/d59 0 2024-04-25T17:19:00.198 INFO:tasks.workunit.client.0.smithi037.stdout:7/245: chown d5/d15/d17/d1b/l30 10456814 1 2024-04-25T17:19:00.198 INFO:tasks.workunit.client.1.smithi069.stdout:6/7: mkdir d2 0 2024-04-25T17:19:00.199 INFO:tasks.workunit.client.0.smithi037.stdout:7/246: readlink d5/d15/d17/d1b/l2e 0 2024-04-25T17:19:00.200 INFO:tasks.workunit.client.1.smithi069.stdout:8/8: getdents . 0 2024-04-25T17:19:00.200 INFO:tasks.workunit.client.1.smithi069.stdout:8/9: rename - no filename 2024-04-25T17:19:00.200 INFO:tasks.workunit.client.1.smithi069.stdout:8/10: dwrite - no filename 2024-04-25T17:19:00.200 INFO:tasks.workunit.client.1.smithi069.stdout:8/11: write - no filename 2024-04-25T17:19:00.203 INFO:tasks.workunit.client.0.smithi037.stdout:7/247: rename d5/l7 to d5/d14/l5a 0 2024-04-25T17:19:00.204 INFO:tasks.workunit.client.1.smithi069.stdout:2/7: symlink d0/d1/l2 0 2024-04-25T17:19:00.204 INFO:tasks.workunit.client.0.smithi037.stdout:7/248: truncate d5/f46 870034 0 2024-04-25T17:19:00.207 INFO:tasks.workunit.client.1.smithi069.stdout:6/8: unlink f0 0 2024-04-25T17:19:00.207 INFO:tasks.workunit.client.1.smithi069.stdout:6/9: dread - f1 zero size 2024-04-25T17:19:00.207 INFO:tasks.workunit.client.1.smithi069.stdout:9/1: getdents . 0 2024-04-25T17:19:00.209 INFO:tasks.workunit.client.0.smithi037.stdout:1/202: dwrite dc/d18/f25 [0,4194304] 0 2024-04-25T17:19:00.213 INFO:tasks.workunit.client.0.smithi037.stdout:7/249: dwrite d5/d15/f1f [0,4194304] 0 2024-04-25T17:19:00.219 INFO:tasks.workunit.client.1.smithi069.stdout:3/15: link f1 f4 0 2024-04-25T17:19:00.220 INFO:tasks.workunit.client.0.smithi037.stdout:7/250: write d5/d15/f45 [3449533,115727] 0 2024-04-25T17:19:00.221 INFO:tasks.workunit.client.0.smithi037.stdout:7/251: fdatasync d5/d15/d17/d25/f4d 0 2024-04-25T17:19:00.227 INFO:tasks.workunit.client.0.smithi037.stdout:3/142: sync 2024-04-25T17:19:00.227 INFO:tasks.workunit.client.1.smithi069.stdout:3/16: dwrite f3 [0,4194304] 0 2024-04-25T17:19:00.228 INFO:tasks.workunit.client.0.smithi037.stdout:7/252: creat d5/d15/d17/d1b/f5b x:0 0 0 2024-04-25T17:19:00.230 INFO:tasks.workunit.client.1.smithi069.stdout:8/12: mknod c0 0 2024-04-25T17:19:00.231 INFO:tasks.workunit.client.0.smithi037.stdout:1/203: getdents dc/d1f 0 2024-04-25T17:19:00.233 INFO:tasks.workunit.client.0.smithi037.stdout:1/204: truncate dc/d24/f45 388385 0 2024-04-25T17:19:00.235 INFO:tasks.workunit.client.0.smithi037.stdout:3/143: chown d8/d11/l13 13639387 1 2024-04-25T17:19:00.236 INFO:tasks.workunit.client.1.smithi069.stdout:6/10: symlink d2/l3 0 2024-04-25T17:19:00.237 INFO:tasks.workunit.client.1.smithi069.stdout:6/11: write f1 [901819,4528] 0 2024-04-25T17:19:00.238 INFO:tasks.workunit.client.0.smithi037.stdout:1/205: dread fa [4194304,4194304] 0 2024-04-25T17:19:00.239 INFO:tasks.workunit.client.0.smithi037.stdout:1/206: chown dc/d1f/d22/f30 1849259471 1 2024-04-25T17:19:00.241 INFO:tasks.workunit.client.1.smithi069.stdout:9/2: getdents . 0 2024-04-25T17:19:00.241 INFO:tasks.workunit.client.1.smithi069.stdout:9/3: rename - no filename 2024-04-25T17:19:00.242 INFO:tasks.workunit.client.0.smithi037.stdout:3/144: mknod d8/d23/c2e 0 2024-04-25T17:19:00.243 INFO:tasks.workunit.client.1.smithi069.stdout:5/9: getdents . 0 2024-04-25T17:19:00.243 INFO:tasks.workunit.client.1.smithi069.stdout:5/10: rmdir - no directory 2024-04-25T17:19:00.243 INFO:tasks.workunit.client.1.smithi069.stdout:5/11: readlink - no filename 2024-04-25T17:19:00.244 INFO:tasks.workunit.client.1.smithi069.stdout:5/12: write f0 [1953258,122003] 0 2024-04-25T17:19:00.244 INFO:tasks.workunit.client.1.smithi069.stdout:3/17: creat f5 x:0 0 0 2024-04-25T17:19:00.245 INFO:tasks.workunit.client.1.smithi069.stdout:5/13: read f1 [253341,22225] 0 2024-04-25T17:19:00.247 INFO:tasks.workunit.client.1.smithi069.stdout:6/12: symlink d2/l4 0 2024-04-25T17:19:00.247 INFO:tasks.workunit.client.1.smithi069.stdout:6/13: fdatasync f1 0 2024-04-25T17:19:00.250 INFO:tasks.workunit.client.1.smithi069.stdout:5/14: symlink l2 0 2024-04-25T17:19:00.251 INFO:tasks.workunit.client.1.smithi069.stdout:2/8: getdents d0/d1 0 2024-04-25T17:19:00.251 INFO:tasks.workunit.client.1.smithi069.stdout:2/9: truncate - no filename 2024-04-25T17:19:00.251 INFO:tasks.workunit.client.1.smithi069.stdout:2/10: dwrite - no filename 2024-04-25T17:19:00.251 INFO:tasks.workunit.client.1.smithi069.stdout:2/11: write - no filename 2024-04-25T17:19:00.251 INFO:tasks.workunit.client.1.smithi069.stdout:2/12: write - no filename 2024-04-25T17:19:00.252 INFO:tasks.workunit.client.1.smithi069.stdout:9/4: mknod c0 0 2024-04-25T17:19:00.252 INFO:tasks.workunit.client.1.smithi069.stdout:9/5: truncate - no filename 2024-04-25T17:19:00.255 INFO:tasks.workunit.client.1.smithi069.stdout:5/15: symlink l3 0 2024-04-25T17:19:00.256 INFO:tasks.workunit.client.1.smithi069.stdout:2/13: mkdir d0/d3 0 2024-04-25T17:19:00.256 INFO:tasks.workunit.client.1.smithi069.stdout:2/14: dwrite - no filename 2024-04-25T17:19:00.256 INFO:tasks.workunit.client.1.smithi069.stdout:9/6: creat f1 x:0 0 0 2024-04-25T17:19:00.258 INFO:tasks.workunit.client.1.smithi069.stdout:8/13: getdents . 0 2024-04-25T17:19:00.258 INFO:tasks.workunit.client.1.smithi069.stdout:8/14: fsync - no filename 2024-04-25T17:19:00.258 INFO:tasks.workunit.client.1.smithi069.stdout:8/15: truncate - no filename 2024-04-25T17:19:00.259 INFO:tasks.workunit.client.1.smithi069.stdout:5/16: write f1 [1878969,109946] 0 2024-04-25T17:19:00.260 INFO:tasks.workunit.client.1.smithi069.stdout:2/15: creat d0/d1/f4 x:0 0 0 2024-04-25T17:19:00.260 INFO:tasks.workunit.client.1.smithi069.stdout:2/16: chown d0/d1 0 1 2024-04-25T17:19:00.260 INFO:tasks.workunit.client.1.smithi069.stdout:9/7: mkdir d2 0 2024-04-25T17:19:00.262 INFO:tasks.workunit.client.1.smithi069.stdout:3/18: getdents . 0 2024-04-25T17:19:00.263 INFO:tasks.workunit.client.1.smithi069.stdout:9/8: chown f1 760581 1 2024-04-25T17:19:00.263 INFO:tasks.workunit.client.1.smithi069.stdout:3/19: dread - f0 zero size 2024-04-25T17:19:00.263 INFO:tasks.workunit.client.1.smithi069.stdout:8/16: creat f1 x:0 0 0 2024-04-25T17:19:00.263 INFO:tasks.workunit.client.1.smithi069.stdout:6/14: getdents d2 0 2024-04-25T17:19:00.264 INFO:tasks.workunit.client.1.smithi069.stdout:2/17: unlink d0/d1/f4 0 2024-04-25T17:19:00.267 INFO:tasks.workunit.client.1.smithi069.stdout:3/20: creat f6 x:0 0 0 2024-04-25T17:19:00.267 INFO:tasks.workunit.client.1.smithi069.stdout:3/21: read - f5 zero size 2024-04-25T17:19:00.267 INFO:tasks.workunit.client.1.smithi069.stdout:8/17: mknod c2 0 2024-04-25T17:19:00.267 INFO:tasks.workunit.client.1.smithi069.stdout:3/22: stat f5 0 2024-04-25T17:19:00.268 INFO:tasks.workunit.client.1.smithi069.stdout:3/23: write f3 [3178895,20473] 0 2024-04-25T17:19:00.268 INFO:tasks.workunit.client.1.smithi069.stdout:6/15: symlink d2/l5 0 2024-04-25T17:19:00.268 INFO:tasks.workunit.client.1.smithi069.stdout:3/24: fdatasync f6 0 2024-04-25T17:19:00.269 INFO:tasks.workunit.client.1.smithi069.stdout:9/9: creat d2/f3 x:0 0 0 2024-04-25T17:19:00.271 INFO:tasks.workunit.client.1.smithi069.stdout:8/18: link f1 f3 0 2024-04-25T17:19:00.273 INFO:tasks.workunit.client.1.smithi069.stdout:8/19: dread - f3 zero size 2024-04-25T17:19:00.273 INFO:tasks.workunit.client.1.smithi069.stdout:6/16: dread f1 [0,4194304] 0 2024-04-25T17:19:00.273 INFO:tasks.workunit.client.1.smithi069.stdout:9/10: rename d2/f3 to d2/f4 0 2024-04-25T17:19:00.275 INFO:tasks.workunit.client.1.smithi069.stdout:9/11: mknod d2/c5 0 2024-04-25T17:19:00.276 INFO:tasks.workunit.client.1.smithi069.stdout:9/12: dread - d2/f4 zero size 2024-04-25T17:19:00.277 INFO:tasks.workunit.client.1.smithi069.stdout:6/17: unlink d2/l5 0 2024-04-25T17:19:00.277 INFO:tasks.workunit.client.1.smithi069.stdout:6/18: write f1 [5106,103366] 0 2024-04-25T17:19:00.278 INFO:tasks.workunit.client.1.smithi069.stdout:9/13: creat d2/f6 x:0 0 0 2024-04-25T17:19:00.283 INFO:tasks.workunit.client.0.smithi037.stdout:3/145: symlink d8/l2f 0 2024-04-25T17:19:00.284 INFO:tasks.workunit.client.0.smithi037.stdout:3/146: chown d8/lb 1459 1 2024-04-25T17:19:00.285 INFO:tasks.workunit.client.1.smithi069.stdout:8/20: getdents . 0 2024-04-25T17:19:00.286 INFO:tasks.workunit.client.0.smithi037.stdout:3/147: mknod d8/d11/c30 0 2024-04-25T17:19:00.291 INFO:tasks.workunit.client.0.smithi037.stdout:7/253: dread d5/d14/d31/f3f [0,4194304] 0 2024-04-25T17:19:00.292 INFO:tasks.workunit.client.1.smithi069.stdout:6/19: dwrite f1 [0,4194304] 0 2024-04-25T17:19:00.293 INFO:tasks.workunit.client.0.smithi037.stdout:3/148: mkdir d8/d31 0 2024-04-25T17:19:00.293 INFO:tasks.workunit.client.1.smithi069.stdout:9/14: dwrite d2/f6 [0,4194304] 0 2024-04-25T17:19:00.294 INFO:tasks.workunit.client.1.smithi069.stdout:3/25: dwrite f4 [0,4194304] 0 2024-04-25T17:19:00.294 INFO:tasks.workunit.client.1.smithi069.stdout:3/26: rmdir - no directory 2024-04-25T17:19:00.298 INFO:tasks.workunit.client.0.smithi037.stdout:7/254: mknod d5/d15/c5c 0 2024-04-25T17:19:00.303 INFO:tasks.workunit.client.1.smithi069.stdout:8/21: rename f1 to f4 0 2024-04-25T17:19:00.305 INFO:tasks.workunit.client.0.smithi037.stdout:7/255: symlink d5/d15/l5d 0 2024-04-25T17:19:00.306 INFO:tasks.workunit.client.0.smithi037.stdout:7/256: fsync d5/f43 0 2024-04-25T17:19:00.307 INFO:tasks.workunit.client.0.smithi037.stdout:3/149: mkdir d8/d31/d32 0 2024-04-25T17:19:00.309 INFO:tasks.workunit.client.0.smithi037.stdout:3/150: write d8/f21 [5194597,130544] 0 2024-04-25T17:19:00.309 INFO:tasks.workunit.client.1.smithi069.stdout:3/27: rename f3 to f7 0 2024-04-25T17:19:00.310 INFO:tasks.workunit.client.1.smithi069.stdout:3/28: write f0 [427032,107397] 0 2024-04-25T17:19:00.310 INFO:tasks.workunit.client.1.smithi069.stdout:3/29: stat f6 0 2024-04-25T17:19:00.312 INFO:tasks.workunit.client.0.smithi037.stdout:7/257: dread d5/d15/d17/d1b/f1d [0,4194304] 0 2024-04-25T17:19:00.315 INFO:tasks.workunit.client.1.smithi069.stdout:8/22: rename c2 to c5 0 2024-04-25T17:19:00.316 INFO:tasks.workunit.client.1.smithi069.stdout:8/23: chown f3 23 1 2024-04-25T17:19:00.316 INFO:tasks.workunit.client.0.smithi037.stdout:3/151: creat d8/d11/f33 x:0 0 0 2024-04-25T17:19:00.319 INFO:tasks.workunit.client.0.smithi037.stdout:7/258: mkdir d5/d5e 0 2024-04-25T17:19:00.321 INFO:tasks.workunit.client.0.smithi037.stdout:7/259: stat d5/d15/d17/d25/c4a 0 2024-04-25T17:19:00.322 INFO:tasks.workunit.client.1.smithi069.stdout:3/30: mkdir d8 0 2024-04-25T17:19:00.322 INFO:tasks.workunit.client.1.smithi069.stdout:3/31: stat f5 0 2024-04-25T17:19:00.323 INFO:tasks.workunit.client.1.smithi069.stdout:8/24: mknod c6 0 2024-04-25T17:19:00.323 INFO:tasks.workunit.client.1.smithi069.stdout:8/25: dread - f3 zero size 2024-04-25T17:19:00.324 INFO:tasks.workunit.client.1.smithi069.stdout:9/15: link c0 d2/c7 0 2024-04-25T17:19:00.325 INFO:tasks.workunit.client.1.smithi069.stdout:9/16: chown d2/f6 9 1 2024-04-25T17:19:00.325 INFO:tasks.workunit.client.0.smithi037.stdout:3/152: dwrite d8/d11/f20 [0,4194304] 0 2024-04-25T17:19:00.325 INFO:tasks.workunit.client.0.smithi037.stdout:7/260: write d5/d15/d17/d1b/d27/f42 [832416,33005] 0 2024-04-25T17:19:00.325 INFO:tasks.workunit.client.1.smithi069.stdout:9/17: write d2/f6 [163522,105412] 0 2024-04-25T17:19:00.330 INFO:tasks.workunit.client.0.smithi037.stdout:3/153: unlink d8/f21 0 2024-04-25T17:19:00.331 INFO:tasks.workunit.client.1.smithi069.stdout:3/32: mkdir d8/d9 0 2024-04-25T17:19:00.332 INFO:tasks.workunit.client.1.smithi069.stdout:3/33: dread - f6 zero size 2024-04-25T17:19:00.334 INFO:tasks.workunit.client.0.smithi037.stdout:7/261: creat d5/d15/d17/d1b/d27/f5f x:0 0 0 2024-04-25T17:19:00.335 INFO:tasks.workunit.client.0.smithi037.stdout:7/262: write d5/d14/d31/f44 [694743,24887] 0 2024-04-25T17:19:00.337 INFO:tasks.workunit.client.1.smithi069.stdout:8/26: unlink f4 0 2024-04-25T17:19:00.346 INFO:tasks.workunit.client.1.smithi069.stdout:9/18: link f1 d2/f8 0 2024-04-25T17:19:00.353 INFO:tasks.workunit.client.1.smithi069.stdout:3/34: rmdir d8/d9 0 2024-04-25T17:19:00.354 INFO:tasks.workunit.client.1.smithi069.stdout:8/27: link c0 c7 0 2024-04-25T17:19:00.354 INFO:tasks.workunit.client.1.smithi069.stdout:3/35: chown f4 1512144 1 2024-04-25T17:19:00.354 INFO:tasks.workunit.client.1.smithi069.stdout:3/36: fdatasync f0 0 2024-04-25T17:19:00.357 INFO:tasks.workunit.client.1.smithi069.stdout:9/19: dwrite d2/f4 [0,4194304] 0 2024-04-25T17:19:00.360 INFO:tasks.workunit.client.1.smithi069.stdout:3/37: dread f4 [0,4194304] 0 2024-04-25T17:19:00.361 INFO:tasks.workunit.client.1.smithi069.stdout:3/38: chown f6 15 1 2024-04-25T17:19:00.362 INFO:tasks.workunit.client.1.smithi069.stdout:9/20: write f1 [614004,79318] 0 2024-04-25T17:19:00.368 INFO:tasks.workunit.client.1.smithi069.stdout:3/39: mknod d8/ca 0 2024-04-25T17:19:00.370 INFO:tasks.workunit.client.0.smithi037.stdout:3/154: dwrite f5 [0,4194304] 0 2024-04-25T17:19:00.372 INFO:tasks.workunit.client.1.smithi069.stdout:9/21: write d2/f4 [5052361,51020] 0 2024-04-25T17:19:00.373 INFO:tasks.workunit.client.0.smithi037.stdout:3/155: read d8/f26 [3884569,24567] 0 2024-04-25T17:19:00.374 INFO:tasks.workunit.client.0.smithi037.stdout:3/156: readlink d8/l12 0 2024-04-25T17:19:00.375 INFO:tasks.workunit.client.1.smithi069.stdout:3/40: symlink d8/lb 0 2024-04-25T17:19:00.377 INFO:tasks.workunit.client.1.smithi069.stdout:3/41: truncate f5 833532 0 2024-04-25T17:19:00.381 INFO:tasks.workunit.client.1.smithi069.stdout:9/22: symlink d2/l9 0 2024-04-25T17:19:00.381 INFO:tasks.workunit.client.1.smithi069.stdout:9/23: fsync d2/f6 0 2024-04-25T17:19:00.383 INFO:tasks.workunit.client.0.smithi037.stdout:3/157: truncate d8/f10 906118 0 2024-04-25T17:19:00.385 INFO:tasks.workunit.client.1.smithi069.stdout:3/42: rename f1 to d8/fc 0 2024-04-25T17:19:00.385 INFO:tasks.workunit.client.1.smithi069.stdout:3/43: readlink d8/lb 0 2024-04-25T17:19:00.388 INFO:tasks.workunit.client.1.smithi069.stdout:9/24: dwrite d2/f6 [0,4194304] 0 2024-04-25T17:19:00.389 INFO:tasks.workunit.client.1.smithi069.stdout:3/44: creat d8/fd x:0 0 0 2024-04-25T17:19:00.389 INFO:tasks.workunit.client.1.smithi069.stdout:3/45: dread - d8/fd zero size 2024-04-25T17:19:00.389 INFO:tasks.workunit.client.1.smithi069.stdout:3/46: readlink d8/lb 0 2024-04-25T17:19:00.391 INFO:tasks.workunit.client.0.smithi037.stdout:3/158: getdents d8 0 2024-04-25T17:19:00.393 INFO:tasks.workunit.client.1.smithi069.stdout:9/25: mkdir d2/da 0 2024-04-25T17:19:00.396 INFO:tasks.workunit.client.0.smithi037.stdout:3/159: symlink d8/d23/l34 0 2024-04-25T17:19:00.396 INFO:tasks.workunit.client.1.smithi069.stdout:3/47: dwrite f6 [0,4194304] 0 2024-04-25T17:19:00.397 INFO:tasks.workunit.client.0.smithi037.stdout:3/160: dread - d8/f2c zero size 2024-04-25T17:19:00.397 INFO:tasks.workunit.client.1.smithi069.stdout:9/26: stat c0 0 2024-04-25T17:19:00.401 INFO:tasks.workunit.client.0.smithi037.stdout:3/161: mknod d8/d31/d32/c35 0 2024-04-25T17:19:00.401 INFO:tasks.workunit.client.1.smithi069.stdout:9/27: dread d2/f4 [0,4194304] 0 2024-04-25T17:19:00.406 INFO:tasks.workunit.client.1.smithi069.stdout:3/48: rename d8/fd to d8/fe 0 2024-04-25T17:19:00.408 INFO:tasks.workunit.client.1.smithi069.stdout:9/28: rename f1 to d2/fb 0 2024-04-25T17:19:00.410 INFO:tasks.workunit.client.1.smithi069.stdout:3/49: mknod d8/cf 0 2024-04-25T17:19:00.411 INFO:tasks.workunit.client.1.smithi069.stdout:9/29: rename d2/f4 to d2/da/fc 0 2024-04-25T17:19:00.412 INFO:tasks.workunit.client.1.smithi069.stdout:3/50: creat d8/f10 x:0 0 0 2024-04-25T17:19:00.414 INFO:tasks.workunit.client.1.smithi069.stdout:3/51: creat d8/f11 x:0 0 0 2024-04-25T17:19:00.414 INFO:tasks.workunit.client.1.smithi069.stdout:3/52: dread - d8/fe zero size 2024-04-25T17:19:00.420 INFO:tasks.workunit.client.1.smithi069.stdout:9/30: fsync d2/da/fc 0 2024-04-25T17:19:00.420 INFO:tasks.workunit.client.1.smithi069.stdout:9/31: chown d2/da 39908 1 2024-04-25T17:19:00.421 INFO:tasks.workunit.client.1.smithi069.stdout:9/32: read d2/f6 [4008290,11961] 0 2024-04-25T17:19:00.423 INFO:tasks.workunit.client.1.smithi069.stdout:9/33: mkdir d2/da/dd 0 2024-04-25T17:19:00.423 INFO:tasks.workunit.client.1.smithi069.stdout:3/53: rmdir d8 39 2024-04-25T17:19:00.424 INFO:tasks.workunit.client.0.smithi037.stdout:3/162: dwrite d8/f1e [0,4194304] 0 2024-04-25T17:19:00.428 INFO:tasks.workunit.client.0.smithi037.stdout:3/163: fdatasync d8/d23/f24 0 2024-04-25T17:19:00.428 INFO:tasks.workunit.client.1.smithi069.stdout:9/34: mkdir d2/da/dd/de 0 2024-04-25T17:19:00.432 INFO:tasks.workunit.client.0.smithi037.stdout:3/164: rename d8/f1e to d8/d31/d32/f36 0 2024-04-25T17:19:00.433 INFO:tasks.workunit.client.0.smithi037.stdout:3/165: chown f5 175 1 2024-04-25T17:19:00.435 INFO:tasks.workunit.client.1.smithi069.stdout:3/54: link d8/fc d8/f12 0 2024-04-25T17:19:00.436 INFO:tasks.workunit.client.1.smithi069.stdout:9/35: dwrite d2/f6 [0,4194304] 0 2024-04-25T17:19:00.438 INFO:tasks.workunit.client.0.smithi037.stdout:3/166: creat d8/f37 x:0 0 0 2024-04-25T17:19:00.445 INFO:tasks.workunit.client.1.smithi069.stdout:3/55: getdents d8 0 2024-04-25T17:19:00.446 INFO:tasks.workunit.client.1.smithi069.stdout:9/36: dwrite d2/f8 [0,4194304] 0 2024-04-25T17:19:00.448 INFO:tasks.workunit.client.1.smithi069.stdout:3/56: creat d8/f13 x:0 0 0 2024-04-25T17:19:00.453 INFO:tasks.workunit.client.1.smithi069.stdout:9/37: getdents d2/da 0 2024-04-25T17:19:00.460 INFO:tasks.workunit.client.1.smithi069.stdout:3/57: dwrite d8/fe [0,4194304] 0 2024-04-25T17:19:00.462 INFO:tasks.workunit.client.1.smithi069.stdout:3/58: fsync d8/f12 0 2024-04-25T17:19:00.462 INFO:tasks.workunit.client.1.smithi069.stdout:9/38: fsync d2/f6 0 2024-04-25T17:19:00.465 INFO:tasks.workunit.client.1.smithi069.stdout:9/39: symlink d2/da/dd/de/lf 0 2024-04-25T17:19:00.467 INFO:tasks.workunit.client.1.smithi069.stdout:9/40: creat d2/da/f10 x:0 0 0 2024-04-25T17:19:00.467 INFO:tasks.workunit.client.1.smithi069.stdout:9/41: chown d2/da 5732222 1 2024-04-25T17:19:00.470 INFO:tasks.workunit.client.1.smithi069.stdout:9/42: rename d2/fb to d2/da/dd/f11 0 2024-04-25T17:19:00.470 INFO:tasks.workunit.client.1.smithi069.stdout:9/43: chown d2/da/dd/de/lf 42507 1 2024-04-25T17:19:00.487 INFO:tasks.workunit.client.0.smithi037.stdout:6/190: sync 2024-04-25T17:19:00.487 INFO:tasks.workunit.client.0.smithi037.stdout:6/191: stat db/f1a 0 2024-04-25T17:19:00.489 INFO:tasks.workunit.client.1.smithi069.stdout:9/44: creat d2/da/dd/de/f12 x:0 0 0 2024-04-25T17:19:00.489 INFO:tasks.workunit.client.1.smithi069.stdout:9/45: write d2/f6 [5044872,32621] 0 2024-04-25T17:19:00.490 INFO:tasks.workunit.client.0.smithi037.stdout:6/192: symlink db/d26/d2e/d3e/d25/l41 0 2024-04-25T17:19:00.490 INFO:tasks.workunit.client.1.smithi069.stdout:9/46: truncate d2/da/dd/f11 5033796 0 2024-04-25T17:19:00.496 INFO:tasks.workunit.client.0.smithi037.stdout:6/193: dwrite db/d26/f2b [0,4194304] 0 2024-04-25T17:19:00.497 INFO:tasks.workunit.client.1.smithi069.stdout:9/47: dwrite d2/f8 [4194304,4194304] 0 2024-04-25T17:19:00.497 INFO:tasks.workunit.client.0.smithi037.stdout:6/194: write db/d1d/f1f [637917,75827] 0 2024-04-25T17:19:00.498 INFO:tasks.workunit.client.1.smithi069.stdout:9/48: chown d2/da/f10 2 1 2024-04-25T17:19:00.500 INFO:tasks.workunit.client.1.smithi069.stdout:9/49: creat d2/da/f13 x:0 0 0 2024-04-25T17:19:00.501 INFO:tasks.workunit.client.0.smithi037.stdout:6/195: creat db/d26/d2e/f42 x:0 0 0 2024-04-25T17:19:00.503 INFO:tasks.workunit.client.1.smithi069.stdout:9/50: mkdir d2/da/d14 0 2024-04-25T17:19:00.505 INFO:tasks.workunit.client.1.smithi069.stdout:9/51: creat d2/f15 x:0 0 0 2024-04-25T17:19:00.507 INFO:tasks.workunit.client.0.smithi037.stdout:6/196: fsync db/f14 0 2024-04-25T17:19:00.508 INFO:tasks.workunit.client.1.smithi069.stdout:9/52: creat d2/da/f16 x:0 0 0 2024-04-25T17:19:00.510 INFO:tasks.workunit.client.1.smithi069.stdout:9/53: creat d2/f17 x:0 0 0 2024-04-25T17:19:00.512 INFO:tasks.workunit.client.1.smithi069.stdout:9/54: creat d2/da/d14/f18 x:0 0 0 2024-04-25T17:19:00.513 INFO:tasks.workunit.client.1.smithi069.stdout:9/55: creat d2/da/d14/f19 x:0 0 0 2024-04-25T17:19:00.518 INFO:tasks.workunit.client.0.smithi037.stdout:6/197: dread db/f1c [0,4194304] 0 2024-04-25T17:19:00.522 INFO:tasks.workunit.client.0.smithi037.stdout:6/198: dwrite db/f15 [8388608,4194304] 0 2024-04-25T17:19:00.523 INFO:tasks.workunit.client.0.smithi037.stdout:6/199: rename db to db/d26/d2e/d43 22 2024-04-25T17:19:00.525 INFO:tasks.workunit.client.0.smithi037.stdout:6/200: rename l8 to db/d1d/d20/l44 0 2024-04-25T17:19:00.526 INFO:tasks.workunit.client.0.smithi037.stdout:6/201: stat db/d1d/c29 0 2024-04-25T17:19:00.527 INFO:tasks.workunit.client.1.smithi069.stdout:9/56: fsync d2/f8 0 2024-04-25T17:19:00.529 INFO:tasks.workunit.client.1.smithi069.stdout:9/57: mknod d2/c1a 0 2024-04-25T17:19:00.532 INFO:tasks.workunit.client.0.smithi037.stdout:6/202: dwrite db/f1a [0,4194304] 0 2024-04-25T17:19:00.533 INFO:tasks.workunit.client.1.smithi069.stdout:9/58: dread d2/f8 [4194304,4194304] 0 2024-04-25T17:19:00.536 INFO:tasks.workunit.client.1.smithi069.stdout:9/59: creat d2/da/dd/f1b x:0 0 0 2024-04-25T17:19:00.536 INFO:tasks.workunit.client.1.smithi069.stdout:9/60: rename d2 to d2/da/dd/de/d1c 22 2024-04-25T17:19:00.540 INFO:tasks.workunit.client.0.smithi037.stdout:6/203: rename db/f11 to db/d26/d2e/d3e/f45 0 2024-04-25T17:19:00.541 INFO:tasks.workunit.client.1.smithi069.stdout:9/61: symlink d2/da/l1d 0 2024-04-25T17:19:00.544 INFO:tasks.workunit.client.0.smithi037.stdout:6/204: write f5 [129069,107522] 0 2024-04-25T17:19:00.545 INFO:tasks.workunit.client.0.smithi037.stdout:6/205: write db/f17 [129994,77737] 0 2024-04-25T17:19:00.546 INFO:tasks.workunit.client.1.smithi069.stdout:9/62: unlink d2/f15 0 2024-04-25T17:19:00.552 INFO:tasks.workunit.client.0.smithi037.stdout:6/206: dwrite fa [4194304,4194304] 0 2024-04-25T17:19:00.554 INFO:tasks.workunit.client.0.smithi037.stdout:6/207: truncate db/d1d/f1f 1166159 0 2024-04-25T17:19:00.556 INFO:tasks.workunit.client.0.smithi037.stdout:6/208: write db/d26/d2e/f39 [1133100,88392] 0 2024-04-25T17:19:00.557 INFO:tasks.workunit.client.0.smithi037.stdout:6/209: fsync db/d26/f27 0 2024-04-25T17:19:00.558 INFO:tasks.workunit.client.0.smithi037.stdout:6/210: chown db/ce 22 1 2024-04-25T17:19:00.562 INFO:tasks.workunit.client.0.smithi037.stdout:6/211: link db/f1c db/f46 0 2024-04-25T17:19:00.564 INFO:tasks.workunit.client.0.smithi037.stdout:6/212: creat db/d26/d2e/d3e/f47 x:0 0 0 2024-04-25T17:19:00.565 INFO:tasks.workunit.client.0.smithi037.stdout:6/213: read db/f46 [1024670,130235] 0 2024-04-25T17:19:00.677 INFO:tasks.workunit.client.0.smithi037.stdout:8/166: sync 2024-04-25T17:19:00.682 INFO:tasks.workunit.client.0.smithi037.stdout:8/167: write d5/da/f11 [264790,13739] 0 2024-04-25T17:19:00.687 INFO:tasks.workunit.client.0.smithi037.stdout:8/168: dwrite d5/db/d23/f1e [4194304,4194304] 0 2024-04-25T17:19:00.688 INFO:tasks.workunit.client.0.smithi037.stdout:8/169: stat d5/d26/l2c 0 2024-04-25T17:19:00.694 INFO:tasks.workunit.client.0.smithi037.stdout:8/170: dwrite d5/f9 [0,4194304] 0 2024-04-25T17:19:00.695 INFO:tasks.workunit.client.0.smithi037.stdout:8/171: dread - d5/db/f1b zero size 2024-04-25T17:19:00.699 INFO:tasks.workunit.client.0.smithi037.stdout:8/172: dread d5/da/f11 [0,4194304] 0 2024-04-25T17:19:00.706 INFO:tasks.workunit.client.0.smithi037.stdout:8/173: rename d5/d26/l2c to d5/d26/l2e 0 2024-04-25T17:19:00.712 INFO:tasks.workunit.client.0.smithi037.stdout:8/174: truncate d5/db/d18/f19 5591407 0 2024-04-25T17:19:00.713 INFO:tasks.workunit.client.0.smithi037.stdout:8/175: rmdir d5/db/d23 39 2024-04-25T17:19:00.715 INFO:tasks.workunit.client.0.smithi037.stdout:8/176: write d5/db/d23/f1e [4475061,3561] 0 2024-04-25T17:19:00.725 INFO:tasks.workunit.client.0.smithi037.stdout:8/177: dwrite d5/db/fc [0,4194304] 0 2024-04-25T17:19:00.726 INFO:tasks.workunit.client.0.smithi037.stdout:8/178: write d5/db/d23/f1e [7385645,117053] 0 2024-04-25T17:19:00.727 INFO:tasks.workunit.client.0.smithi037.stdout:8/179: write f4 [2525517,188] 0 2024-04-25T17:19:00.735 INFO:tasks.workunit.client.0.smithi037.stdout:8/180: dwrite d5/da/f11 [0,4194304] 0 2024-04-25T17:19:00.738 INFO:tasks.workunit.client.0.smithi037.stdout:8/181: dread d5/f27 [0,4194304] 0 2024-04-25T17:19:00.739 INFO:tasks.workunit.client.0.smithi037.stdout:0/275: sync 2024-04-25T17:19:00.740 INFO:tasks.workunit.client.0.smithi037.stdout:0/276: fsync d9/d14/d28/d48/f4e 0 2024-04-25T17:19:00.743 INFO:tasks.workunit.client.0.smithi037.stdout:0/277: readlink d9/df/d32/d35/l41 0 2024-04-25T17:19:00.744 INFO:tasks.workunit.client.0.smithi037.stdout:0/278: chown d9/df/d32/f4b 18 1 2024-04-25T17:19:00.745 INFO:tasks.workunit.client.0.smithi037.stdout:8/182: getdents d5 0 2024-04-25T17:19:00.746 INFO:tasks.workunit.client.0.smithi037.stdout:0/279: chown d9/df/d32/d35/l4c 777936 1 2024-04-25T17:19:00.747 INFO:tasks.workunit.client.0.smithi037.stdout:0/280: rmdir d9/d14 39 2024-04-25T17:19:00.750 INFO:tasks.workunit.client.0.smithi037.stdout:8/183: rename d5/db/d18/c25 to d5/da/c2f 0 2024-04-25T17:19:00.751 INFO:tasks.workunit.client.0.smithi037.stdout:0/281: creat d9/df/d32/d39/f64 x:0 0 0 2024-04-25T17:19:00.753 INFO:tasks.workunit.client.0.smithi037.stdout:8/184: rename d5/c6 to d5/d13/c30 0 2024-04-25T17:19:00.753 INFO:tasks.workunit.client.0.smithi037.stdout:0/282: chown d9/d14/l1d 6296271 1 2024-04-25T17:19:00.755 INFO:tasks.workunit.client.0.smithi037.stdout:0/283: read d9/d14/d23/f30 [115556,40385] 0 2024-04-25T17:19:00.758 INFO:tasks.workunit.client.0.smithi037.stdout:0/284: creat d9/d14/d23/f65 x:0 0 0 2024-04-25T17:19:00.759 INFO:tasks.workunit.client.0.smithi037.stdout:0/285: readlink l3 0 2024-04-25T17:19:00.763 INFO:tasks.workunit.client.0.smithi037.stdout:0/286: rmdir d9/d14/d28/d48/d58 39 2024-04-25T17:19:00.765 INFO:tasks.workunit.client.0.smithi037.stdout:0/287: mkdir d9/df/d32/d35/d66 0 2024-04-25T17:19:00.770 INFO:tasks.workunit.client.0.smithi037.stdout:0/288: mknod d9/d14/d28/d48/c67 0 2024-04-25T17:19:00.771 INFO:tasks.workunit.client.0.smithi037.stdout:0/289: truncate d9/d14/d23/f29 2712265 0 2024-04-25T17:19:00.772 INFO:tasks.workunit.client.0.smithi037.stdout:8/185: dread d5/f8 [0,4194304] 0 2024-04-25T17:19:00.775 INFO:tasks.workunit.client.0.smithi037.stdout:0/290: mkdir d9/df/d32/d39/d68 0 2024-04-25T17:19:00.776 INFO:tasks.workunit.client.0.smithi037.stdout:0/291: write d9/d14/d28/f62 [650835,1189] 0 2024-04-25T17:19:00.778 INFO:tasks.workunit.client.0.smithi037.stdout:8/186: dread d5/fe [0,4194304] 0 2024-04-25T17:19:00.779 INFO:tasks.workunit.client.0.smithi037.stdout:8/187: write f4 [1006218,122767] 0 2024-04-25T17:19:00.781 INFO:tasks.workunit.client.0.smithi037.stdout:0/292: rename d9/d14/d28/f4a to d9/df/f69 0 2024-04-25T17:19:00.784 INFO:tasks.workunit.client.0.smithi037.stdout:8/188: dread - d5/db/d23/f29 zero size 2024-04-25T17:19:00.785 INFO:tasks.workunit.client.0.smithi037.stdout:0/293: mknod d9/df/d32/d39/c6a 0 2024-04-25T17:19:00.787 INFO:tasks.workunit.client.0.smithi037.stdout:8/189: symlink d5/db/d18/l31 0 2024-04-25T17:19:00.788 INFO:tasks.workunit.client.0.smithi037.stdout:6/214: sync 2024-04-25T17:19:00.788 INFO:tasks.workunit.client.0.smithi037.stdout:4/367: sync 2024-04-25T17:19:00.788 INFO:tasks.workunit.client.0.smithi037.stdout:1/207: sync 2024-04-25T17:19:00.788 INFO:tasks.workunit.client.0.smithi037.stdout:7/263: sync 2024-04-25T17:19:00.788 INFO:tasks.workunit.client.0.smithi037.stdout:2/231: sync 2024-04-25T17:19:00.788 INFO:tasks.workunit.client.0.smithi037.stdout:9/292: sync 2024-04-25T17:19:00.789 INFO:tasks.workunit.client.0.smithi037.stdout:5/253: sync 2024-04-25T17:19:00.789 INFO:tasks.workunit.client.0.smithi037.stdout:3/167: sync 2024-04-25T17:19:00.791 INFO:tasks.workunit.client.0.smithi037.stdout:1/208: chown dc/d18/l23 26 1 2024-04-25T17:19:00.792 INFO:tasks.workunit.client.0.smithi037.stdout:0/294: write d9/d14/d28/d48/d58/f5e [360159,130205] 0 2024-04-25T17:19:00.794 INFO:tasks.workunit.client.0.smithi037.stdout:9/293: fdatasync d1/d21/f39 0 2024-04-25T17:19:00.795 INFO:tasks.workunit.client.0.smithi037.stdout:6/215: write fa [7511163,81607] 0 2024-04-25T17:19:00.798 INFO:tasks.workunit.client.0.smithi037.stdout:6/216: readlink db/d1d/d20/d2f/l3c 0 2024-04-25T17:19:00.798 INFO:tasks.workunit.client.0.smithi037.stdout:0/295: chown d9/df/d32/d39/c6a 790443 1 2024-04-25T17:19:00.800 INFO:tasks.workunit.client.0.smithi037.stdout:2/232: dwrite d0/d15/f32 [0,4194304] 0 2024-04-25T17:19:00.801 INFO:tasks.workunit.client.0.smithi037.stdout:5/254: rename d7/d4a to d7/d25/d4f 0 2024-04-25T17:19:00.806 INFO:tasks.workunit.client.0.smithi037.stdout:4/368: mknod d7/d29/d1e/d2b/c79 0 2024-04-25T17:19:00.808 INFO:tasks.workunit.client.0.smithi037.stdout:0/296: dwrite f7 [8388608,4194304] 0 2024-04-25T17:19:00.810 INFO:tasks.workunit.client.0.smithi037.stdout:9/294: creat d1/d5/dc/d38/d3d/d3f/f60 x:0 0 0 2024-04-25T17:19:00.813 INFO:tasks.workunit.client.0.smithi037.stdout:6/217: symlink db/d1d/d20/l48 0 2024-04-25T17:19:00.815 INFO:tasks.workunit.client.0.smithi037.stdout:4/369: dwrite d7/d29/d1e/d2b/f42 [4194304,4194304] 0 2024-04-25T17:19:00.817 INFO:tasks.workunit.client.0.smithi037.stdout:7/264: rename d5/d14/d31/f44 to d5/d15/d17/d1b/d27/f60 0 2024-04-25T17:19:00.832 INFO:tasks.workunit.client.0.smithi037.stdout:0/297: symlink d9/df/d32/d39/l6b 0 2024-04-25T17:19:00.832 INFO:tasks.workunit.client.0.smithi037.stdout:0/298: chown d9/d14/d28/d48/l4d 585 1 2024-04-25T17:19:00.834 INFO:tasks.workunit.client.0.smithi037.stdout:9/295: creat d1/d5/dc/d3c/d3e/f61 x:0 0 0 2024-04-25T17:19:00.836 INFO:tasks.workunit.client.0.smithi037.stdout:6/218: creat db/d26/d2e/d3e/f49 x:0 0 0 2024-04-25T17:19:00.840 INFO:tasks.workunit.client.0.smithi037.stdout:4/370: mkdir d7/d29/d1e/d2b/d35/d39/d7a 0 2024-04-25T17:19:00.844 INFO:tasks.workunit.client.0.smithi037.stdout:2/233: creat d0/d16/d3b/f47 x:0 0 0 2024-04-25T17:19:00.851 INFO:tasks.workunit.client.0.smithi037.stdout:6/219: dread fa [0,4194304] 0 2024-04-25T17:19:00.854 INFO:tasks.workunit.client.0.smithi037.stdout:4/371: dread d7/f34 [0,4194304] 0 2024-04-25T17:19:00.857 INFO:tasks.workunit.client.0.smithi037.stdout:7/265: creat d5/d5e/f61 x:0 0 0 2024-04-25T17:19:00.861 INFO:tasks.workunit.client.0.smithi037.stdout:0/299: mknod d9/c6c 0 2024-04-25T17:19:00.868 INFO:tasks.workunit.client.0.smithi037.stdout:6/220: rename db/d1d/c30 to db/c4a 0 2024-04-25T17:19:00.874 INFO:tasks.workunit.client.0.smithi037.stdout:8/190: truncate d5/f9 4176372 0 2024-04-25T17:19:00.879 INFO:tasks.workunit.client.0.smithi037.stdout:7/266: creat d5/d14/d31/f62 x:0 0 0 2024-04-25T17:19:00.880 INFO:tasks.workunit.client.0.smithi037.stdout:5/255: write d7/d12/f19 [974471,65054] 0 2024-04-25T17:19:00.884 INFO:tasks.workunit.client.0.smithi037.stdout:7/267: dread d5/d15/d17/f1c [0,4194304] 0 2024-04-25T17:19:00.884 INFO:tasks.workunit.client.0.smithi037.stdout:9/296: link d1/l24 d1/d5/dc/d38/d3d/l62 0 2024-04-25T17:19:00.896 INFO:tasks.workunit.client.0.smithi037.stdout:2/234: creat d0/d15/f48 x:0 0 0 2024-04-25T17:19:00.897 INFO:tasks.workunit.client.0.smithi037.stdout:2/235: readlink d0/d16/l19 0 2024-04-25T17:19:00.901 INFO:tasks.workunit.client.0.smithi037.stdout:0/300: mknod d9/d14/d28/d48/c6d 0 2024-04-25T17:19:00.902 INFO:tasks.workunit.client.0.smithi037.stdout:0/301: read d9/d14/d28/d48/d58/f5e [134190,24783] 0 2024-04-25T17:19:00.904 INFO:tasks.workunit.client.0.smithi037.stdout:9/297: symlink d1/d5/dc/d38/d3d/d3f/l63 0 2024-04-25T17:19:00.905 INFO:tasks.workunit.client.0.smithi037.stdout:8/191: dread d5/db/f12 [0,4194304] 0 2024-04-25T17:19:00.907 INFO:tasks.workunit.client.0.smithi037.stdout:6/221: link db/f36 db/d1d/d20/f4b 0 2024-04-25T17:19:00.912 INFO:tasks.workunit.client.0.smithi037.stdout:6/222: dwrite db/f1b [0,4194304] 0 2024-04-25T17:19:00.917 INFO:tasks.workunit.client.0.smithi037.stdout:7/268: creat d5/d15/d17/d25/d2b/d59/f63 x:0 0 0 2024-04-25T17:19:00.919 INFO:tasks.workunit.client.0.smithi037.stdout:6/223: dwrite db/f12 [0,4194304] 0 2024-04-25T17:19:00.929 INFO:tasks.workunit.client.0.smithi037.stdout:5/256: creat d7/d12/f50 x:0 0 0 2024-04-25T17:19:00.930 INFO:tasks.workunit.client.0.smithi037.stdout:5/257: chown d7/d18/f22 0 1 2024-04-25T17:19:00.935 INFO:tasks.workunit.client.0.smithi037.stdout:4/372: truncate d7/f3b 2964471 0 2024-04-25T17:19:00.936 INFO:tasks.workunit.client.0.smithi037.stdout:0/302: creat d9/df/d32/d39/d68/f6e x:0 0 0 2024-04-25T17:19:00.936 INFO:tasks.workunit.client.0.smithi037.stdout:5/258: dwrite d7/ff [4194304,4194304] 0 2024-04-25T17:19:00.938 INFO:tasks.workunit.client.0.smithi037.stdout:4/373: chown d7/d29/d1e/d2b/f63 3 1 2024-04-25T17:19:00.939 INFO:tasks.workunit.client.0.smithi037.stdout:6/224: rmdir db/d1d/d20/d2f 39 2024-04-25T17:19:00.941 INFO:tasks.workunit.client.0.smithi037.stdout:8/192: unlink d5/da/c16 0 2024-04-25T17:19:00.945 INFO:tasks.workunit.client.0.smithi037.stdout:0/303: dwrite d9/df/d32/f5c [0,4194304] 0 2024-04-25T17:19:00.947 INFO:tasks.workunit.client.0.smithi037.stdout:9/298: truncate d1/d5/dc/f11 854382 0 2024-04-25T17:19:00.950 INFO:tasks.workunit.client.0.smithi037.stdout:7/269: dread d5/f6 [0,4194304] 0 2024-04-25T17:19:00.952 INFO:tasks.workunit.client.0.smithi037.stdout:2/236: rename d0/d16/l29 to d0/d16/l49 0 2024-04-25T17:19:00.957 INFO:tasks.workunit.client.0.smithi037.stdout:5/259: stat d7/d25/d4f/f3d 0 2024-04-25T17:19:00.959 INFO:tasks.workunit.client.0.smithi037.stdout:1/209: sync 2024-04-25T17:19:00.959 INFO:tasks.workunit.client.0.smithi037.stdout:3/168: sync 2024-04-25T17:19:00.960 INFO:tasks.workunit.client.0.smithi037.stdout:5/260: write d7/f3c [651520,41075] 0 2024-04-25T17:19:00.960 INFO:tasks.workunit.client.0.smithi037.stdout:7/270: dread d5/d15/d17/d1b/d27/f42 [0,4194304] 0 2024-04-25T17:19:00.960 INFO:tasks.workunit.client.0.smithi037.stdout:4/374: symlink d7/d29/d45/d4f/l7b 0 2024-04-25T17:19:00.961 INFO:tasks.workunit.client.0.smithi037.stdout:2/237: dwrite d0/d16/d20/f3d [0,4194304] 0 2024-04-25T17:19:00.961 INFO:tasks.workunit.client.0.smithi037.stdout:3/169: dread - d8/f37 zero size 2024-04-25T17:19:00.962 INFO:tasks.workunit.client.0.smithi037.stdout:2/238: chown d0/d16/d20 17028 1 2024-04-25T17:19:00.963 INFO:tasks.workunit.client.0.smithi037.stdout:6/225: creat db/d26/d2e/d3e/f4c x:0 0 0 2024-04-25T17:19:00.967 INFO:tasks.workunit.client.0.smithi037.stdout:6/226: dread - db/d1d/d20/f4b zero size 2024-04-25T17:19:00.967 INFO:tasks.workunit.client.0.smithi037.stdout:8/193: write d5/fe [185348,36681] 0 2024-04-25T17:19:00.971 INFO:tasks.workunit.client.0.smithi037.stdout:2/239: write d0/d16/d26/f41 [1632889,38607] 0 2024-04-25T17:19:00.975 INFO:tasks.workunit.client.0.smithi037.stdout:4/375: dwrite d7/d29/d1e/f56 [0,4194304] 0 2024-04-25T17:19:00.978 INFO:tasks.workunit.client.0.smithi037.stdout:0/304: dread d9/f19 [0,4194304] 0 2024-04-25T17:19:00.978 INFO:tasks.workunit.client.0.smithi037.stdout:1/210: rmdir dc/d1f 39 2024-04-25T17:19:00.981 INFO:tasks.workunit.client.0.smithi037.stdout:7/271: mknod d5/d15/d17/d25/d2b/d59/c64 0 2024-04-25T17:19:00.990 INFO:tasks.workunit.client.0.smithi037.stdout:4/376: dread d7/f49 [0,4194304] 0 2024-04-25T17:19:00.995 INFO:tasks.workunit.client.0.smithi037.stdout:0/305: unlink d9/df/f40 0 2024-04-25T17:19:00.996 INFO:tasks.workunit.client.0.smithi037.stdout:0/306: stat d9/df/d32/f55 0 2024-04-25T17:19:00.996 INFO:tasks.workunit.client.0.smithi037.stdout:5/261: mknod d7/d12/c51 0 2024-04-25T17:19:00.999 INFO:tasks.workunit.client.0.smithi037.stdout:3/170: mkdir d8/d23/d38 0 2024-04-25T17:19:01.001 INFO:tasks.workunit.client.0.smithi037.stdout:6/227: mknod db/d1d/d20/d2f/c4d 0 2024-04-25T17:19:01.003 INFO:tasks.workunit.client.0.smithi037.stdout:1/211: unlink dc/d1f/l37 0 2024-04-25T17:19:01.006 INFO:tasks.workunit.client.0.smithi037.stdout:0/307: creat d9/d14/d23/f6f x:0 0 0 2024-04-25T17:19:01.007 INFO:tasks.workunit.client.0.smithi037.stdout:5/262: creat d7/d43/f52 x:0 0 0 2024-04-25T17:19:01.008 INFO:tasks.workunit.client.0.smithi037.stdout:5/263: write d7/f40 [1190526,102250] 0 2024-04-25T17:19:01.009 INFO:tasks.workunit.client.0.smithi037.stdout:6/228: symlink db/d1d/l4e 0 2024-04-25T17:19:01.009 INFO:tasks.workunit.client.0.smithi037.stdout:5/264: dread - d7/d12/f4d zero size 2024-04-25T17:19:01.010 INFO:tasks.workunit.client.0.smithi037.stdout:6/229: chown db/d1d/d20/l28 153766668 1 2024-04-25T17:19:01.012 INFO:tasks.workunit.client.0.smithi037.stdout:0/308: fsync d9/fa 0 2024-04-25T17:19:01.014 INFO:tasks.workunit.client.0.smithi037.stdout:0/309: write d9/d14/d28/f2a [1072416,71569] 0 2024-04-25T17:19:01.014 INFO:tasks.workunit.client.0.smithi037.stdout:7/272: creat d5/d15/d17/f65 x:0 0 0 2024-04-25T17:19:01.016 INFO:tasks.workunit.client.0.smithi037.stdout:4/377: rename d7/f2d to d7/d29/f7c 0 2024-04-25T17:19:01.017 INFO:tasks.workunit.client.0.smithi037.stdout:4/378: dread - d7/d29/d1e/f44 zero size 2024-04-25T17:19:01.019 INFO:tasks.workunit.client.0.smithi037.stdout:1/212: unlink dc/d1f/d22/d36/l3b 0 2024-04-25T17:19:01.022 INFO:tasks.workunit.client.0.smithi037.stdout:7/273: fsync d5/d15/d17/d1b/d27/f2a 0 2024-04-25T17:19:01.025 INFO:tasks.workunit.client.0.smithi037.stdout:3/171: rename d8/d11/f33 to d8/d31/d32/f39 0 2024-04-25T17:19:01.025 INFO:tasks.workunit.client.0.smithi037.stdout:2/240: write d0/d16/d26/f45 [1490467,82244] 0 2024-04-25T17:19:01.026 INFO:tasks.workunit.client.0.smithi037.stdout:4/379: rmdir d7/d29/d4e 39 2024-04-25T17:19:01.027 INFO:tasks.workunit.client.0.smithi037.stdout:3/172: read f5 [106788,14760] 0 2024-04-25T17:19:01.027 INFO:tasks.workunit.client.0.smithi037.stdout:0/310: dwrite d9/df/f2c [0,4194304] 0 2024-04-25T17:19:01.029 INFO:tasks.workunit.client.0.smithi037.stdout:3/173: fsync d8/f9 0 2024-04-25T17:19:01.031 INFO:tasks.workunit.client.0.smithi037.stdout:0/311: chown d9/df/d32/f60 28684496 1 2024-04-25T17:19:01.033 INFO:tasks.workunit.client.0.smithi037.stdout:9/299: dwrite d1/d5/f28 [0,4194304] 0 2024-04-25T17:19:01.038 INFO:tasks.workunit.client.0.smithi037.stdout:2/241: creat d0/d16/d26/f4a x:0 0 0 2024-04-25T17:19:01.042 INFO:tasks.workunit.client.0.smithi037.stdout:4/380: creat d7/d29/d1e/d2b/d35/f7d x:0 0 0 2024-04-25T17:19:01.042 INFO:tasks.workunit.client.0.smithi037.stdout:3/174: rmdir d8/d23 39 2024-04-25T17:19:01.052 INFO:tasks.workunit.client.0.smithi037.stdout:2/242: write d0/f14 [6568596,50759] 0 2024-04-25T17:19:01.054 INFO:tasks.workunit.client.0.smithi037.stdout:7/274: creat d5/d15/d17/f66 x:0 0 0 2024-04-25T17:19:01.054 INFO:tasks.workunit.client.0.smithi037.stdout:6/230: dwrite db/f46 [0,4194304] 0 2024-04-25T17:19:01.056 INFO:tasks.workunit.client.0.smithi037.stdout:7/275: chown d5/d15/d17/f41 22441 1 2024-04-25T17:19:01.059 INFO:tasks.workunit.client.0.smithi037.stdout:2/243: dread d0/d16/d20/f3d [0,4194304] 0 2024-04-25T17:19:01.060 INFO:tasks.workunit.client.0.smithi037.stdout:5/265: rename d7/ca to d7/d12/c53 0 2024-04-25T17:19:01.062 INFO:tasks.workunit.client.0.smithi037.stdout:6/231: unlink db/f1a 0 2024-04-25T17:19:01.063 INFO:tasks.workunit.client.0.smithi037.stdout:7/276: creat d5/d15/d17/d25/f67 x:0 0 0 2024-04-25T17:19:01.064 INFO:tasks.workunit.client.0.smithi037.stdout:1/213: truncate dc/f34 417248 0 2024-04-25T17:19:01.067 INFO:tasks.workunit.client.0.smithi037.stdout:2/244: mkdir d0/d16/d26/d3e/d4b 0 2024-04-25T17:19:01.068 INFO:tasks.workunit.client.0.smithi037.stdout:3/175: truncate f5 2177305 0 2024-04-25T17:19:01.070 INFO:tasks.workunit.client.0.smithi037.stdout:4/381: write d7/d29/f3d [5127057,9684] 0 2024-04-25T17:19:01.073 INFO:tasks.workunit.client.0.smithi037.stdout:0/312: truncate f2 2117807 0 2024-04-25T17:19:01.073 INFO:tasks.workunit.client.0.smithi037.stdout:7/277: dwrite d5/d15/d17/f20 [0,4194304] 0 2024-04-25T17:19:01.075 INFO:tasks.workunit.client.0.smithi037.stdout:0/313: write f7 [4637071,112114] 0 2024-04-25T17:19:01.075 INFO:tasks.workunit.client.0.smithi037.stdout:9/300: dwrite d1/d5/f12 [0,4194304] 0 2024-04-25T17:19:01.078 INFO:tasks.workunit.client.0.smithi037.stdout:1/214: symlink dc/d1f/d22/l4a 0 2024-04-25T17:19:01.082 INFO:tasks.workunit.client.0.smithi037.stdout:6/232: rmdir db 39 2024-04-25T17:19:01.085 INFO:tasks.workunit.client.0.smithi037.stdout:9/301: mknod d1/d21/c64 0 2024-04-25T17:19:01.091 INFO:tasks.workunit.client.0.smithi037.stdout:2/245: mknod d0/d16/d26/d3e/d4b/c4c 0 2024-04-25T17:19:01.095 INFO:tasks.workunit.client.0.smithi037.stdout:6/233: stat db/d26/d2e/d3e/d25 0 2024-04-25T17:19:01.097 INFO:tasks.workunit.client.0.smithi037.stdout:7/278: truncate d5/f6 2876678 0 2024-04-25T17:19:01.098 INFO:tasks.workunit.client.0.smithi037.stdout:9/302: mknod d1/d5/dc/d38/d3d/c65 0 2024-04-25T17:19:01.100 INFO:tasks.workunit.client.0.smithi037.stdout:5/266: getdents d7 0 2024-04-25T17:19:01.100 INFO:tasks.workunit.client.0.smithi037.stdout:3/176: mkdir d8/d23/d3a 0 2024-04-25T17:19:01.101 INFO:tasks.workunit.client.0.smithi037.stdout:2/246: unlink d0/f5 0 2024-04-25T17:19:01.104 INFO:tasks.workunit.client.0.smithi037.stdout:4/382: rename d7/d29 to d7/d7e 0 2024-04-25T17:19:01.106 INFO:tasks.workunit.client.0.smithi037.stdout:6/234: symlink db/d26/d2e/l4f 0 2024-04-25T17:19:01.107 INFO:tasks.workunit.client.0.smithi037.stdout:5/267: dwrite d7/d12/f50 [0,4194304] 0 2024-04-25T17:19:01.108 INFO:tasks.workunit.client.0.smithi037.stdout:7/279: creat d5/d15/d17/d1b/f68 x:0 0 0 2024-04-25T17:19:01.109 INFO:tasks.workunit.client.0.smithi037.stdout:0/314: creat d9/df/d32/f70 x:0 0 0 2024-04-25T17:19:01.109 INFO:tasks.workunit.client.0.smithi037.stdout:5/268: read - d7/d25/d4f/f48 zero size 2024-04-25T17:19:01.112 INFO:tasks.workunit.client.0.smithi037.stdout:9/303: unlink d1/d48/f53 0 2024-04-25T17:19:01.114 INFO:tasks.workunit.client.0.smithi037.stdout:9/304: fdatasync d1/d5/dc/d38/d3d/d3f/f41 0 2024-04-25T17:19:01.116 INFO:tasks.workunit.client.0.smithi037.stdout:1/215: write dc/d18/f2f [1781390,125998] 0 2024-04-25T17:19:01.120 INFO:tasks.workunit.client.0.smithi037.stdout:6/235: symlink db/d26/d2e/d3e/l50 0 2024-04-25T17:19:01.130 INFO:tasks.workunit.client.0.smithi037.stdout:0/315: dread f7 [0,4194304] 0 2024-04-25T17:19:01.130 INFO:tasks.workunit.client.0.smithi037.stdout:3/177: unlink d8/d23/f27 0 2024-04-25T17:19:01.132 INFO:tasks.workunit.client.0.smithi037.stdout:2/247: rename d0/d15/d2a/l2f to d0/d16/d26/l4d 0 2024-04-25T17:19:01.133 INFO:tasks.workunit.client.0.smithi037.stdout:9/305: creat d1/d5/dc/d38/d3d/f66 x:0 0 0 2024-04-25T17:19:01.135 INFO:tasks.workunit.client.0.smithi037.stdout:1/216: chown f8 0 1 2024-04-25T17:19:01.138 INFO:tasks.workunit.client.0.smithi037.stdout:7/280: unlink d5/d15/d17/d1b/l53 0 2024-04-25T17:19:01.139 INFO:tasks.workunit.client.0.smithi037.stdout:2/248: dwrite d0/d16/d20/f39 [0,4194304] 0 2024-04-25T17:19:01.140 INFO:tasks.workunit.client.0.smithi037.stdout:5/269: creat d7/d43/d41/f54 x:0 0 0 2024-04-25T17:19:01.142 INFO:tasks.workunit.client.0.smithi037.stdout:5/270: truncate d7/d12/f50 5241902 0 2024-04-25T17:19:01.144 INFO:tasks.workunit.client.0.smithi037.stdout:5/271: write d7/f3c [743332,96576] 0 2024-04-25T17:19:01.144 INFO:tasks.workunit.client.0.smithi037.stdout:4/383: rename d7/f57 to d7/d7e/d4e/f7f 0 2024-04-25T17:19:01.147 INFO:tasks.workunit.client.0.smithi037.stdout:2/249: dread d0/d23/f43 [0,4194304] 0 2024-04-25T17:19:01.148 INFO:tasks.workunit.client.0.smithi037.stdout:3/178: symlink d8/d23/d3a/l3b 0 2024-04-25T17:19:01.149 INFO:tasks.workunit.client.0.smithi037.stdout:0/316: mkdir d9/d71 0 2024-04-25T17:19:01.150 INFO:tasks.workunit.client.0.smithi037.stdout:0/317: write d9/d14/d23/f6f [382623,8990] 0 2024-04-25T17:19:01.154 INFO:tasks.workunit.client.0.smithi037.stdout:1/217: rename dc/d1f/d22/f30 to dc/d24/f4b 0 2024-04-25T17:19:01.156 INFO:tasks.workunit.client.0.smithi037.stdout:5/272: symlink d7/l55 0 2024-04-25T17:19:01.157 INFO:tasks.workunit.client.0.smithi037.stdout:6/236: link db/d1d/c29 db/d26/d2e/d3e/d25/c51 0 2024-04-25T17:19:01.158 INFO:tasks.workunit.client.0.smithi037.stdout:0/318: dwrite d9/df/d32/f55 [0,4194304] 0 2024-04-25T17:19:01.160 INFO:tasks.workunit.client.0.smithi037.stdout:3/179: read f5 [886769,70994] 0 2024-04-25T17:19:01.160 INFO:tasks.workunit.client.0.smithi037.stdout:2/250: mknod d0/d15/d2a/c4e 0 2024-04-25T17:19:01.163 INFO:tasks.workunit.client.0.smithi037.stdout:9/306: write d1/d5/d19/f1b [310241,26260] 0 2024-04-25T17:19:01.165 INFO:tasks.workunit.client.0.smithi037.stdout:8/194: sync 2024-04-25T17:19:01.167 INFO:tasks.workunit.client.0.smithi037.stdout:6/237: fsync db/d1d/f32 0 2024-04-25T17:19:01.168 INFO:tasks.workunit.client.0.smithi037.stdout:6/238: chown db/d26/d2e/d3e/f35 91 1 2024-04-25T17:19:01.171 INFO:tasks.workunit.client.0.smithi037.stdout:3/180: write d8/d23/f28 [6910059,74261] 0 2024-04-25T17:19:01.171 INFO:tasks.workunit.client.0.smithi037.stdout:2/251: rmdir d0/d16/d3b 39 2024-04-25T17:19:01.172 INFO:tasks.workunit.client.0.smithi037.stdout:3/181: fsync d8/d11/f20 0 2024-04-25T17:19:01.173 INFO:tasks.workunit.client.0.smithi037.stdout:3/182: rename d8/d11 to d8/d11/d3c 22 2024-04-25T17:19:01.173 INFO:tasks.workunit.client.0.smithi037.stdout:3/183: readlink d8/l1c 0 2024-04-25T17:19:01.174 INFO:tasks.workunit.client.0.smithi037.stdout:4/384: creat d7/f80 x:0 0 0 2024-04-25T17:19:01.176 INFO:tasks.workunit.client.0.smithi037.stdout:8/195: creat d5/da/f32 x:0 0 0 2024-04-25T17:19:01.179 INFO:tasks.workunit.client.0.smithi037.stdout:2/252: dwrite d0/f14 [0,4194304] 0 2024-04-25T17:19:01.179 INFO:tasks.workunit.client.0.smithi037.stdout:7/281: getdents d5/d15/d17/d25/d2b 0 2024-04-25T17:19:01.184 INFO:tasks.workunit.client.0.smithi037.stdout:0/319: write d9/d14/f16 [1274116,34032] 0 2024-04-25T17:19:01.186 INFO:tasks.workunit.client.0.smithi037.stdout:9/307: link d1/d5/dc/f29 d1/d21/d4e/f67 0 2024-04-25T17:19:01.188 INFO:tasks.workunit.client.0.smithi037.stdout:1/218: dwrite f7 [4194304,4194304] 0 2024-04-25T17:19:01.189 INFO:tasks.workunit.client.0.smithi037.stdout:8/196: fsync d5/da/f32 0 2024-04-25T17:19:01.192 INFO:tasks.workunit.client.0.smithi037.stdout:3/184: dread - d8/d23/f2d zero size 2024-04-25T17:19:01.192 INFO:tasks.workunit.client.0.smithi037.stdout:6/239: write db/f14 [288573,102073] 0 2024-04-25T17:19:01.193 INFO:tasks.workunit.client.0.smithi037.stdout:1/219: dread dc/d24/f45 [0,4194304] 0 2024-04-25T17:19:01.194 INFO:tasks.workunit.client.0.smithi037.stdout:1/220: chown dc/d18/f38 83680974 1 2024-04-25T17:19:01.194 INFO:tasks.workunit.client.0.smithi037.stdout:5/273: dread - d7/f1b zero size 2024-04-25T17:19:01.196 INFO:tasks.workunit.client.0.smithi037.stdout:7/282: fsync d5/d15/d17/d1b/f1d 0 2024-04-25T17:19:01.197 INFO:tasks.workunit.client.0.smithi037.stdout:6/240: readlink db/d26/d2e/d3e/d25/l41 0 2024-04-25T17:19:01.197 INFO:tasks.workunit.client.0.smithi037.stdout:1/221: write dc/d24/f47 [946921,99] 0 2024-04-25T17:19:01.197 INFO:tasks.workunit.client.0.smithi037.stdout:9/308: unlink d1/d5/dc/d3c/d3e/f61 0 2024-04-25T17:19:01.201 INFO:tasks.workunit.client.0.smithi037.stdout:3/185: rmdir d8/d11 39 2024-04-25T17:19:01.203 INFO:tasks.workunit.client.0.smithi037.stdout:3/186: chown d8/d23 8 1 2024-04-25T17:19:01.206 INFO:tasks.workunit.client.0.smithi037.stdout:0/320: mkdir d9/d72 0 2024-04-25T17:19:01.208 INFO:tasks.workunit.client.0.smithi037.stdout:4/385: dread d7/d7e/d4e/f53 [0,4194304] 0 2024-04-25T17:19:01.208 INFO:tasks.workunit.client.0.smithi037.stdout:8/197: rmdir d5/d26 39 2024-04-25T17:19:01.210 INFO:tasks.workunit.client.0.smithi037.stdout:7/283: creat d5/d15/d17/d1b/f69 x:0 0 0 2024-04-25T17:19:01.211 INFO:tasks.workunit.client.0.smithi037.stdout:9/309: dread d1/d5/f28 [0,4194304] 0 2024-04-25T17:19:01.212 INFO:tasks.workunit.client.0.smithi037.stdout:6/241: dwrite db/f1c [0,4194304] 0 2024-04-25T17:19:01.212 INFO:tasks.workunit.client.0.smithi037.stdout:1/222: dwrite dc/f16 [4194304,4194304] 0 2024-04-25T17:19:01.212 INFO:tasks.workunit.client.0.smithi037.stdout:2/253: creat d0/d15/f4f x:0 0 0 2024-04-25T17:19:01.216 INFO:tasks.workunit.client.0.smithi037.stdout:4/386: chown d7/d7e/d1e/d2b/d35/c6b 39 1 2024-04-25T17:19:01.216 INFO:tasks.workunit.client.0.smithi037.stdout:2/254: chown d0/d16/d20 573566 1 2024-04-25T17:19:01.218 INFO:tasks.workunit.client.0.smithi037.stdout:7/284: symlink d5/d14/d31/l6a 0 2024-04-25T17:19:01.218 INFO:tasks.workunit.client.0.smithi037.stdout:1/223: creat dc/d1f/d22/d36/f4c x:0 0 0 2024-04-25T17:19:01.220 INFO:tasks.workunit.client.0.smithi037.stdout:9/310: rename d1/d21 to d1/d48/d68 0 2024-04-25T17:19:01.224 INFO:tasks.workunit.client.0.smithi037.stdout:2/255: dread d0/d16/f1b [0,4194304] 0 2024-04-25T17:19:01.224 INFO:tasks.workunit.client.0.smithi037.stdout:6/242: symlink db/d1d/d20/d2f/l52 0 2024-04-25T17:19:01.225 INFO:tasks.workunit.client.0.smithi037.stdout:2/256: dread - d0/d16/d26/f3f zero size 2024-04-25T17:19:01.226 INFO:tasks.workunit.client.0.smithi037.stdout:2/257: readlink d0/d16/d26/d3e/l46 0 2024-04-25T17:19:01.227 INFO:tasks.workunit.client.0.smithi037.stdout:1/224: mkdir dc/d1f/d4d 0 2024-04-25T17:19:01.229 INFO:tasks.workunit.client.0.smithi037.stdout:7/285: fsync d5/d15/d17/d1b/d27/f2a 0 2024-04-25T17:19:01.230 INFO:tasks.workunit.client.0.smithi037.stdout:7/286: write d5/f37 [749193,46688] 0 2024-04-25T17:19:01.232 INFO:tasks.workunit.client.0.smithi037.stdout:0/321: creat d9/f73 x:0 0 0 2024-04-25T17:19:01.233 INFO:tasks.workunit.client.0.smithi037.stdout:5/274: dread d7/d12/f19 [0,4194304] 0 2024-04-25T17:19:01.233 INFO:tasks.workunit.client.0.smithi037.stdout:6/243: mkdir db/d53 0 2024-04-25T17:19:01.235 INFO:tasks.workunit.client.0.smithi037.stdout:1/225: symlink dc/d18/l4e 0 2024-04-25T17:19:01.237 INFO:tasks.workunit.client.0.smithi037.stdout:7/287: creat d5/f6b x:0 0 0 2024-04-25T17:19:01.239 INFO:tasks.workunit.client.0.smithi037.stdout:6/244: unlink db/c18 0 2024-04-25T17:19:01.240 INFO:tasks.workunit.client.0.smithi037.stdout:6/245: write db/d26/d2e/f38 [1418893,100338] 0 2024-04-25T17:19:01.242 INFO:tasks.workunit.client.0.smithi037.stdout:1/226: creat dc/d1f/f4f x:0 0 0 2024-04-25T17:19:01.245 INFO:tasks.workunit.client.0.smithi037.stdout:4/387: write d7/f12 [325489,5117] 0 2024-04-25T17:19:01.246 INFO:tasks.workunit.client.0.smithi037.stdout:4/388: chown d7/c8 51508 1 2024-04-25T17:19:01.250 INFO:tasks.workunit.client.0.smithi037.stdout:9/311: dread d1/f9 [0,4194304] 0 2024-04-25T17:19:01.252 INFO:tasks.workunit.client.0.smithi037.stdout:9/312: chown d1/d5/dc/d38 184 1 2024-04-25T17:19:01.252 INFO:tasks.workunit.client.0.smithi037.stdout:7/288: unlink d5/c29 0 2024-04-25T17:19:01.253 INFO:tasks.workunit.client.0.smithi037.stdout:7/289: chown d5/d15 700 1 2024-04-25T17:19:01.254 INFO:tasks.workunit.client.0.smithi037.stdout:5/275: creat d7/f56 x:0 0 0 2024-04-25T17:19:01.255 INFO:tasks.workunit.client.0.smithi037.stdout:0/322: link d9/df/d32/l54 d9/df/d32/d35/l74 0 2024-04-25T17:19:01.255 INFO:tasks.workunit.client.0.smithi037.stdout:9/313: write d1/d5/dc/f4a [404824,15590] 0 2024-04-25T17:19:01.258 INFO:tasks.workunit.client.0.smithi037.stdout:8/198: dwrite d5/d13/f14 [4194304,4194304] 0 2024-04-25T17:19:01.258 INFO:tasks.workunit.client.0.smithi037.stdout:2/258: write d0/f33 [834203,50168] 0 2024-04-25T17:19:01.262 INFO:tasks.workunit.client.0.smithi037.stdout:5/276: chown d7/d25/f4b 0 1 2024-04-25T17:19:01.265 INFO:tasks.workunit.client.0.smithi037.stdout:6/246: dread db/d26/d2e/d3e/f35 [0,4194304] 0 2024-04-25T17:19:01.266 INFO:tasks.workunit.client.0.smithi037.stdout:7/290: creat d5/d15/d17/d25/d2b/d59/f6c x:0 0 0 2024-04-25T17:19:01.270 INFO:tasks.workunit.client.0.smithi037.stdout:2/259: mknod d0/d16/d26/c50 0 2024-04-25T17:19:01.273 INFO:tasks.workunit.client.0.smithi037.stdout:0/323: dwrite d9/f2f [0,4194304] 0 2024-04-25T17:19:01.274 INFO:tasks.workunit.client.0.smithi037.stdout:8/199: mkdir d5/d26/d33 0 2024-04-25T17:19:01.275 INFO:tasks.workunit.client.0.smithi037.stdout:1/227: dwrite dc/f10 [0,4194304] 0 2024-04-25T17:19:01.276 INFO:tasks.workunit.client.0.smithi037.stdout:1/228: write dc/d18/f2b [299932,103254] 0 2024-04-25T17:19:01.277 INFO:tasks.workunit.client.0.smithi037.stdout:4/389: rename d7/d7e/d45/d4f/c68 to d7/d7e/d1e/c81 0 2024-04-25T17:19:01.280 INFO:tasks.workunit.client.0.smithi037.stdout:6/247: creat db/d53/f54 x:0 0 0 2024-04-25T17:19:01.281 INFO:tasks.workunit.client.0.smithi037.stdout:5/277: stat d7/d12/c53 0 2024-04-25T17:19:01.284 INFO:tasks.workunit.client.0.smithi037.stdout:6/248: readlink db/d26/d2e/d3e/l50 0 2024-04-25T17:19:01.285 INFO:tasks.workunit.client.0.smithi037.stdout:7/291: link d5/d15/c5c d5/d15/d17/d1b/c6d 0 2024-04-25T17:19:01.290 INFO:tasks.workunit.client.0.smithi037.stdout:6/249: symlink db/d1d/l55 0 2024-04-25T17:19:01.290 INFO:tasks.workunit.client.0.smithi037.stdout:9/314: dread d1/d5/dc/d38/d3d/d3f/f4f [0,4194304] 0 2024-04-25T17:19:01.292 INFO:tasks.workunit.client.0.smithi037.stdout:0/324: rename d9/d14/d23/f6f to d9/f75 0 2024-04-25T17:19:01.292 INFO:tasks.workunit.client.0.smithi037.stdout:2/260: dwrite d0/f2d [0,4194304] 0 2024-04-25T17:19:01.295 INFO:tasks.workunit.client.0.smithi037.stdout:5/278: creat d7/f57 x:0 0 0 2024-04-25T17:19:01.296 INFO:tasks.workunit.client.0.smithi037.stdout:6/250: creat db/f56 x:0 0 0 2024-04-25T17:19:01.297 INFO:tasks.workunit.client.0.smithi037.stdout:5/279: write d7/d12/f2d [3391573,68169] 0 2024-04-25T17:19:01.298 INFO:tasks.workunit.client.0.smithi037.stdout:9/315: mknod d1/d48/d68/c69 0 2024-04-25T17:19:01.298 INFO:tasks.workunit.client.0.smithi037.stdout:7/292: dwrite d5/d15/d17/d25/d2b/f35 [0,4194304] 0 2024-04-25T17:19:01.300 INFO:tasks.workunit.client.0.smithi037.stdout:5/280: chown d7/d12/f50 149510 1 2024-04-25T17:19:01.303 INFO:tasks.workunit.client.0.smithi037.stdout:2/261: creat d0/f51 x:0 0 0 2024-04-25T17:19:01.306 INFO:tasks.workunit.client.0.smithi037.stdout:6/251: dread db/f3d [0,4194304] 0 2024-04-25T17:19:01.307 INFO:tasks.workunit.client.0.smithi037.stdout:0/325: fdatasync d9/df/f12 0 2024-04-25T17:19:01.311 INFO:tasks.workunit.client.0.smithi037.stdout:4/390: dread d7/f19 [0,4194304] 0 2024-04-25T17:19:01.311 INFO:tasks.workunit.client.0.smithi037.stdout:9/316: rename d1/d5/dc/d38/d3d/d3f/f4f to d1/d5/dc/d38/d3d/f6a 0 2024-04-25T17:19:01.314 INFO:tasks.workunit.client.0.smithi037.stdout:1/229: truncate dc/f27 1277102 0 2024-04-25T17:19:01.317 INFO:tasks.workunit.client.0.smithi037.stdout:4/391: write d7/d7e/d45/f5a [748497,11061] 0 2024-04-25T17:19:01.317 INFO:tasks.workunit.client.0.smithi037.stdout:5/281: dwrite d7/d25/d4f/f48 [0,4194304] 0 2024-04-25T17:19:01.318 INFO:tasks.workunit.client.0.smithi037.stdout:9/317: read - d1/d5/dc/d3c/d3e/f59 zero size 2024-04-25T17:19:01.325 INFO:tasks.workunit.client.0.smithi037.stdout:1/230: chown dc/f34 15632 1 2024-04-25T17:19:01.325 INFO:tasks.workunit.client.0.smithi037.stdout:0/326: dwrite d9/d14/d23/f65 [0,4194304] 0 2024-04-25T17:19:01.326 INFO:tasks.workunit.client.0.smithi037.stdout:4/392: mknod d7/d67/c82 0 2024-04-25T17:19:01.333 INFO:tasks.workunit.client.0.smithi037.stdout:9/318: symlink d1/d5/dc/d38/d3d/l6b 0 2024-04-25T17:19:01.334 INFO:tasks.workunit.client.0.smithi037.stdout:2/262: write d0/d15/f1d [1880200,77099] 0 2024-04-25T17:19:01.334 INFO:tasks.workunit.client.0.smithi037.stdout:4/393: write d7/d7e/f3c [1251400,59455] 0 2024-04-25T17:19:01.334 INFO:tasks.workunit.client.0.smithi037.stdout:1/231: rmdir dc/d1c 39 2024-04-25T17:19:01.335 INFO:tasks.workunit.client.0.smithi037.stdout:4/394: chown d7/d7e/d1e/d2b/c79 66688188 1 2024-04-25T17:19:01.335 INFO:tasks.workunit.client.0.smithi037.stdout:6/252: dwrite db/d26/d2e/d3e/f45 [0,4194304] 0 2024-04-25T17:19:01.337 INFO:tasks.workunit.client.0.smithi037.stdout:6/253: fdatasync db/d26/f27 0 2024-04-25T17:19:01.338 INFO:tasks.workunit.client.0.smithi037.stdout:2/263: truncate d0/d15/f4f 810993 0 2024-04-25T17:19:01.339 INFO:tasks.workunit.client.0.smithi037.stdout:0/327: creat d9/df/d32/d39/f76 x:0 0 0 2024-04-25T17:19:01.340 INFO:tasks.workunit.client.0.smithi037.stdout:7/293: truncate d5/d15/f1f 169678 0 2024-04-25T17:19:01.341 INFO:tasks.workunit.client.0.smithi037.stdout:2/264: write d0/d16/d26/f2c [2253183,121420] 0 2024-04-25T17:19:01.343 INFO:tasks.workunit.client.0.smithi037.stdout:0/328: chown d9/df/d32/f5c 49 1 2024-04-25T17:19:01.344 INFO:tasks.workunit.client.0.smithi037.stdout:9/319: creat d1/d5/d19/f6c x:0 0 0 2024-04-25T17:19:01.346 INFO:tasks.workunit.client.0.smithi037.stdout:7/294: write d5/d15/f45 [4543852,19871] 0 2024-04-25T17:19:01.347 INFO:tasks.workunit.client.0.smithi037.stdout:1/232: dwrite dc/d1f/d22/d36/f41 [0,4194304] 0 2024-04-25T17:19:01.347 INFO:tasks.workunit.client.0.smithi037.stdout:6/254: creat db/d1d/f57 x:0 0 0 2024-04-25T17:19:01.353 INFO:tasks.workunit.client.0.smithi037.stdout:2/265: symlink d0/d16/d26/l52 0 2024-04-25T17:19:01.354 INFO:tasks.workunit.client.0.smithi037.stdout:5/282: truncate d7/d25/f2b 1315810 0 2024-04-25T17:19:01.356 INFO:tasks.workunit.client.0.smithi037.stdout:9/320: dwrite d1/d5/f12 [4194304,4194304] 0 2024-04-25T17:19:01.357 INFO:tasks.workunit.client.0.smithi037.stdout:0/329: creat d9/d14/d28/d48/d58/f77 x:0 0 0 2024-04-25T17:19:01.360 INFO:tasks.workunit.client.0.smithi037.stdout:1/233: symlink dc/d24/l50 0 2024-04-25T17:19:01.363 INFO:tasks.workunit.client.0.smithi037.stdout:6/255: creat db/d53/f58 x:0 0 0 2024-04-25T17:19:01.363 INFO:tasks.workunit.client.0.smithi037.stdout:1/234: truncate dc/d18/f42 992759 0 2024-04-25T17:19:01.363 INFO:tasks.workunit.client.0.smithi037.stdout:1/235: chown f8 89606 1 2024-04-25T17:19:01.364 INFO:tasks.workunit.client.0.smithi037.stdout:6/256: readlink l2 0 2024-04-25T17:19:01.364 INFO:tasks.workunit.client.0.smithi037.stdout:1/236: write f7 [2247066,62550] 0 2024-04-25T17:19:01.373 INFO:tasks.workunit.client.0.smithi037.stdout:1/237: readlink l4 0 2024-04-25T17:19:01.374 INFO:tasks.workunit.client.0.smithi037.stdout:4/395: dread d7/f1a [0,4194304] 0 2024-04-25T17:19:01.376 INFO:tasks.workunit.client.0.smithi037.stdout:6/257: mknod db/d26/d2e/d3e/d25/c59 0 2024-04-25T17:19:01.377 INFO:tasks.workunit.client.0.smithi037.stdout:2/266: mkdir d0/d15/d53 0 2024-04-25T17:19:01.380 INFO:tasks.workunit.client.0.smithi037.stdout:9/321: symlink d1/l6d 0 2024-04-25T17:19:01.382 INFO:tasks.workunit.client.0.smithi037.stdout:0/330: symlink d9/d14/d28/d48/l78 0 2024-04-25T17:19:01.384 INFO:tasks.workunit.client.0.smithi037.stdout:1/238: fsync f8 0 2024-04-25T17:19:01.385 INFO:tasks.workunit.client.0.smithi037.stdout:7/295: write d5/d15/d17/d1b/d27/f2a [3765691,36219] 0 2024-04-25T17:19:01.387 INFO:tasks.workunit.client.0.smithi037.stdout:4/396: dwrite d7/d7e/d1e/d2b/d35/f40 [0,4194304] 0 2024-04-25T17:19:01.389 INFO:tasks.workunit.client.0.smithi037.stdout:1/239: chown dc/d18/d39 161 1 2024-04-25T17:19:01.389 INFO:tasks.workunit.client.0.smithi037.stdout:2/267: rename d0/d16/d26/d3e/d4b/c4c to d0/d16/d3c/c54 0 2024-04-25T17:19:01.390 INFO:tasks.workunit.client.0.smithi037.stdout:6/258: dwrite db/f1c [0,4194304] 0 2024-04-25T17:19:01.392 INFO:tasks.workunit.client.0.smithi037.stdout:6/259: dread - db/d26/d2e/f42 zero size 2024-04-25T17:19:01.399 INFO:tasks.workunit.client.0.smithi037.stdout:7/296: rmdir d5/d15/d17/d25/d2b 39 2024-04-25T17:19:01.401 INFO:tasks.workunit.client.0.smithi037.stdout:2/268: dread d0/d16/f1b [0,4194304] 0 2024-04-25T17:19:01.402 INFO:tasks.workunit.client.0.smithi037.stdout:5/283: link d7/d12/l27 d7/d12/l58 0 2024-04-25T17:19:01.403 INFO:tasks.workunit.client.0.smithi037.stdout:4/397: chown d7/d7e/d45/d4f/c6f 407 1 2024-04-25T17:19:01.404 INFO:tasks.workunit.client.0.smithi037.stdout:1/240: dread dc/f10 [0,4194304] 0 2024-04-25T17:19:01.404 INFO:tasks.workunit.client.0.smithi037.stdout:6/260: dwrite db/d26/f2b [0,4194304] 0 2024-04-25T17:19:01.406 INFO:tasks.workunit.client.0.smithi037.stdout:0/331: mknod d9/d14/d28/d48/c79 0 2024-04-25T17:19:01.407 INFO:tasks.workunit.client.0.smithi037.stdout:2/269: chown d0/d15/f32 5 1 2024-04-25T17:19:01.408 INFO:tasks.workunit.client.0.smithi037.stdout:5/284: mknod d7/d25/d4f/c59 0 2024-04-25T17:19:01.427 INFO:tasks.workunit.client.0.smithi037.stdout:9/322: getdents d1/d5/dc/d38/d3d 0 2024-04-25T17:19:01.427 INFO:tasks.workunit.client.0.smithi037.stdout:7/297: mknod d5/d15/d17/d25/c6e 0 2024-04-25T17:19:01.429 INFO:tasks.workunit.client.0.smithi037.stdout:9/323: dread - d1/d5/dc/d38/d3d/f66 zero size 2024-04-25T17:19:01.429 INFO:tasks.workunit.client.0.smithi037.stdout:7/298: dread - d5/d15/d17/d25/f4d zero size 2024-04-25T17:19:01.429 INFO:tasks.workunit.client.0.smithi037.stdout:1/241: unlink dc/d18/c28 0 2024-04-25T17:19:01.430 INFO:tasks.workunit.client.0.smithi037.stdout:9/324: stat d1/d48/d68/l2b 0 2024-04-25T17:19:01.431 INFO:tasks.workunit.client.0.smithi037.stdout:4/398: mkdir d7/d7e/d1e/d2b/d35/d39/d83 0 2024-04-25T17:19:01.431 INFO:tasks.workunit.client.0.smithi037.stdout:6/261: dread db/f1c [0,4194304] 0 2024-04-25T17:19:01.431 INFO:tasks.workunit.client.0.smithi037.stdout:0/332: truncate d9/fa 3730012 0 2024-04-25T17:19:01.432 INFO:tasks.workunit.client.0.smithi037.stdout:2/270: mkdir d0/d16/d20/d55 0 2024-04-25T17:19:01.434 INFO:tasks.workunit.client.0.smithi037.stdout:7/299: creat d5/f6f x:0 0 0 2024-04-25T17:19:01.434 INFO:tasks.workunit.client.0.smithi037.stdout:7/300: readlink d5/l11 0 2024-04-25T17:19:01.434 INFO:tasks.workunit.client.0.smithi037.stdout:1/242: creat dc/d18/f51 x:0 0 0 2024-04-25T17:19:01.435 INFO:tasks.workunit.client.0.smithi037.stdout:1/243: chown dc/d24/f4b 16180561 1 2024-04-25T17:19:01.435 INFO:tasks.workunit.client.0.smithi037.stdout:9/325: mkdir d1/d5/d19/d6e 0 2024-04-25T17:19:01.445 INFO:tasks.workunit.client.0.smithi037.stdout:7/301: write d5/d15/d17/d25/d2b/f35 [1982056,114151] 0 2024-04-25T17:19:01.446 INFO:tasks.workunit.client.0.smithi037.stdout:1/244: unlink dc/d1f/d22/l4a 0 2024-04-25T17:19:01.447 INFO:tasks.workunit.client.0.smithi037.stdout:9/326: symlink d1/d48/d68/d26/l6f 0 2024-04-25T17:19:01.448 INFO:tasks.workunit.client.0.smithi037.stdout:4/399: mkdir d7/d7e/d1e/d70/d84 0 2024-04-25T17:19:01.449 INFO:tasks.workunit.client.0.smithi037.stdout:2/271: dwrite d0/d16/d20/f3d [0,4194304] 0 2024-04-25T17:19:01.451 INFO:tasks.workunit.client.0.smithi037.stdout:5/285: rename d7/d12/f2d to d7/d12/f5a 0 2024-04-25T17:19:01.453 INFO:tasks.workunit.client.0.smithi037.stdout:1/245: dread dc/d1f/d22/f2c [0,4194304] 0 2024-04-25T17:19:01.453 INFO:tasks.workunit.client.0.smithi037.stdout:7/302: mkdir d5/d70 0 2024-04-25T17:19:01.456 INFO:tasks.workunit.client.0.smithi037.stdout:5/286: dread - d7/d12/f31 zero size 2024-04-25T17:19:01.457 INFO:tasks.workunit.client.0.smithi037.stdout:7/303: mknod d5/d15/d17/d25/d2b/c71 0 2024-04-25T17:19:01.458 INFO:tasks.workunit.client.0.smithi037.stdout:1/246: mkdir dc/d52 0 2024-04-25T17:19:01.458 INFO:tasks.workunit.client.0.smithi037.stdout:5/287: readlink d7/d12/l27 0 2024-04-25T17:19:01.460 INFO:tasks.workunit.client.0.smithi037.stdout:4/400: dwrite d7/f19 [0,4194304] 0 2024-04-25T17:19:01.463 INFO:tasks.workunit.client.0.smithi037.stdout:1/247: write dc/d1f/d22/f2c [5050443,103976] 0 2024-04-25T17:19:01.463 INFO:tasks.workunit.client.0.smithi037.stdout:4/401: creat d7/d7e/d5b/f85 x:0 0 0 2024-04-25T17:19:01.466 INFO:tasks.workunit.client.0.smithi037.stdout:5/288: creat d7/f5b x:0 0 0 2024-04-25T17:19:01.466 INFO:tasks.workunit.client.0.smithi037.stdout:5/289: chown d7/d25/d4f 32797681 1 2024-04-25T17:19:01.467 INFO:tasks.workunit.client.0.smithi037.stdout:1/248: read fa [820790,7085] 0 2024-04-25T17:19:01.467 INFO:tasks.workunit.client.0.smithi037.stdout:5/290: chown d7/d25/d4f/f34 83593887 1 2024-04-25T17:19:01.470 INFO:tasks.workunit.client.0.smithi037.stdout:1/249: creat dc/d1f/d4d/f53 x:0 0 0 2024-04-25T17:19:01.582 INFO:tasks.workunit.client.0.smithi037.stdout:2/272: getdents d0/d16/d26/d3e/d4b 0 2024-04-25T17:19:01.584 INFO:tasks.workunit.client.0.smithi037.stdout:2/273: fsync d0/d16/f1b 0 2024-04-25T17:19:01.584 INFO:tasks.workunit.client.0.smithi037.stdout:6/262: truncate db/f1c 1282903 0 2024-04-25T17:19:01.584 INFO:tasks.workunit.client.0.smithi037.stdout:4/402: dwrite d7/d7e/d4e/f53 [0,4194304] 0 2024-04-25T17:19:01.585 INFO:tasks.workunit.client.0.smithi037.stdout:0/333: rmdir d9 39 2024-04-25T17:19:01.588 INFO:tasks.workunit.client.0.smithi037.stdout:7/304: dread d5/fd [0,4194304] 0 2024-04-25T17:19:01.590 INFO:tasks.workunit.client.0.smithi037.stdout:1/250: creat dc/d1f/d22/d36/f54 x:0 0 0 2024-04-25T17:19:01.591 INFO:tasks.workunit.client.0.smithi037.stdout:2/274: unlink d0/d16/d26/f45 0 2024-04-25T17:19:01.591 INFO:tasks.workunit.client.0.smithi037.stdout:4/403: rename d7/d7e/d5b/c72 to d7/d7e/d1e/d2b/d35/d39/c86 0 2024-04-25T17:19:01.595 INFO:tasks.workunit.client.0.smithi037.stdout:1/251: symlink dc/d24/l55 0 2024-04-25T17:19:01.597 INFO:tasks.workunit.client.0.smithi037.stdout:7/305: getdents d5/d70 0 2024-04-25T17:19:01.597 INFO:tasks.workunit.client.0.smithi037.stdout:9/327: dwrite d1/f9 [0,4194304] 0 2024-04-25T17:19:01.603 INFO:tasks.workunit.client.0.smithi037.stdout:7/306: chown d5/d15/d17/d1b/f69 1 1 2024-04-25T17:19:01.603 INFO:tasks.workunit.client.0.smithi037.stdout:6/263: dwrite db/f3d [0,4194304] 0 2024-04-25T17:19:01.604 INFO:tasks.workunit.client.0.smithi037.stdout:9/328: mknod d1/d5/dc/d38/d3d/d3f/c70 0 2024-04-25T17:19:01.607 INFO:tasks.workunit.client.0.smithi037.stdout:0/334: dwrite d9/d14/d28/f62 [0,4194304] 0 2024-04-25T17:19:01.609 INFO:tasks.workunit.client.0.smithi037.stdout:0/335: chown d9/df/f12 125 1 2024-04-25T17:19:01.609 INFO:tasks.workunit.client.0.smithi037.stdout:7/307: rmdir d5 39 2024-04-25T17:19:01.611 INFO:tasks.workunit.client.0.smithi037.stdout:6/264: mkdir db/d5a 0 2024-04-25T17:19:01.618 INFO:tasks.workunit.client.0.smithi037.stdout:0/336: mkdir d9/df/d32/d35/d66/d7a 0 2024-04-25T17:19:01.620 INFO:tasks.workunit.client.0.smithi037.stdout:7/308: creat d5/d15/d17/d25/d2b/d48/f72 x:0 0 0 2024-04-25T17:19:01.621 INFO:tasks.workunit.client.0.smithi037.stdout:7/309: write d5/d15/d17/f41 [495430,84687] 0 2024-04-25T17:19:01.623 INFO:tasks.workunit.client.0.smithi037.stdout:6/265: unlink db/d26/d2e/f38 0 2024-04-25T17:19:01.623 INFO:tasks.workunit.client.0.smithi037.stdout:4/404: dread d7/d7e/d4e/f71 [0,4194304] 0 2024-04-25T17:19:01.624 INFO:tasks.workunit.client.0.smithi037.stdout:9/329: link d1/d48/d68/d4e/f51 d1/d5/dc/d38/f71 0 2024-04-25T17:19:01.625 INFO:tasks.workunit.client.0.smithi037.stdout:0/337: mknod d9/df/d32/d35/c7b 0 2024-04-25T17:19:01.625 INFO:tasks.workunit.client.0.smithi037.stdout:2/275: write d0/f9 [2549034,35844] 0 2024-04-25T17:19:01.629 INFO:tasks.workunit.client.0.smithi037.stdout:2/276: truncate d0/d16/d20/f3d 4620482 0 2024-04-25T17:19:01.631 INFO:tasks.workunit.client.0.smithi037.stdout:4/405: mknod d7/d78/c87 0 2024-04-25T17:19:01.632 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:01 smithi037 ceph-mon[26472]: pgmap v31: 65 pgs: 65 active+clean; 540 MiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 2.0 MiB/s rd, 36 MiB/s wr, 276 op/s 2024-04-25T17:19:01.632 INFO:tasks.workunit.client.0.smithi037.stdout:2/277: fdatasync d0/d15/f32 0 2024-04-25T17:19:01.633 INFO:tasks.workunit.client.0.smithi037.stdout:9/330: dwrite d1/d5/dc/d3c/d3e/f42 [0,4194304] 0 2024-04-25T17:19:01.636 INFO:tasks.workunit.client.0.smithi037.stdout:6/266: creat db/d1d/d20/f5b x:0 0 0 2024-04-25T17:19:01.641 INFO:tasks.workunit.client.0.smithi037.stdout:9/331: creat d1/d5/dc/f72 x:0 0 0 2024-04-25T17:19:01.644 INFO:tasks.workunit.client.0.smithi037.stdout:7/310: dread d5/d15/f45 [0,4194304] 0 2024-04-25T17:19:01.646 INFO:tasks.workunit.client.0.smithi037.stdout:6/267: rename fa to db/d1d/f5c 0 2024-04-25T17:19:01.647 INFO:tasks.workunit.client.0.smithi037.stdout:2/278: mkdir d0/d15/d53/d56 0 2024-04-25T17:19:01.647 INFO:tasks.workunit.client.0.smithi037.stdout:2/279: chown d0/l18 73 1 2024-04-25T17:19:01.649 INFO:tasks.workunit.client.0.smithi037.stdout:4/406: creat d7/f88 x:0 0 0 2024-04-25T17:19:01.650 INFO:tasks.workunit.client.0.smithi037.stdout:4/407: rename d7 to d7/d7e/d5b/d89 22 2024-04-25T17:19:01.651 INFO:tasks.workunit.client.0.smithi037.stdout:7/311: mknod d5/d15/c73 0 2024-04-25T17:19:01.652 INFO:tasks.workunit.client.0.smithi037.stdout:6/268: mknod db/d26/d2e/c5d 0 2024-04-25T17:19:01.653 INFO:tasks.workunit.client.0.smithi037.stdout:6/269: stat db/f15 0 2024-04-25T17:19:01.653 INFO:tasks.workunit.client.0.smithi037.stdout:0/338: write d9/df/d32/d39/f52 [1016763,58569] 0 2024-04-25T17:19:01.655 INFO:tasks.workunit.client.0.smithi037.stdout:7/312: truncate d5/d15/d17/d1b/f69 655631 0 2024-04-25T17:19:01.658 INFO:tasks.workunit.client.0.smithi037.stdout:2/280: dread d0/d23/f43 [0,4194304] 0 2024-04-25T17:19:01.659 INFO:tasks.workunit.client.0.smithi037.stdout:0/339: creat d9/df/d32/d39/f7c x:0 0 0 2024-04-25T17:19:01.660 INFO:tasks.workunit.client.0.smithi037.stdout:7/313: mknod d5/d5e/c74 0 2024-04-25T17:19:01.662 INFO:tasks.workunit.client.0.smithi037.stdout:6/270: dread db/d1d/f1f [0,4194304] 0 2024-04-25T17:19:01.665 INFO:tasks.workunit.client.0.smithi037.stdout:7/314: dread d5/f37 [0,4194304] 0 2024-04-25T17:19:01.667 INFO:tasks.workunit.client.0.smithi037.stdout:9/332: dread d1/f2 [4194304,4194304] 0 2024-04-25T17:19:01.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:01 smithi069 ceph-mon[34527]: pgmap v31: 65 pgs: 65 active+clean; 540 MiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 2.0 MiB/s rd, 36 MiB/s wr, 276 op/s 2024-04-25T17:19:01.669 INFO:tasks.workunit.client.0.smithi037.stdout:2/281: dwrite d0/d15/f37 [0,4194304] 0 2024-04-25T17:19:01.670 INFO:tasks.workunit.client.0.smithi037.stdout:7/315: fsync d5/f37 0 2024-04-25T17:19:01.672 INFO:tasks.workunit.client.0.smithi037.stdout:4/408: truncate d7/fe 163042 0 2024-04-25T17:19:01.673 INFO:tasks.workunit.client.0.smithi037.stdout:0/340: getdents d9/d14/d28 0 2024-04-25T17:19:01.674 INFO:tasks.workunit.client.0.smithi037.stdout:4/409: chown d7/d78/c87 1728 1 2024-04-25T17:19:01.676 INFO:tasks.workunit.client.0.smithi037.stdout:0/341: read d9/d14/f36 [21182,43513] 0 2024-04-25T17:19:01.677 INFO:tasks.workunit.client.0.smithi037.stdout:0/342: read d9/d14/d28/f5a [3659189,77558] 0 2024-04-25T17:19:01.681 INFO:tasks.workunit.client.0.smithi037.stdout:4/410: dread d7/d7e/d4e/f53 [0,4194304] 0 2024-04-25T17:19:01.681 INFO:tasks.workunit.client.0.smithi037.stdout:0/343: write d9/d14/d28/d48/d58/f5d [935250,76281] 0 2024-04-25T17:19:01.682 INFO:tasks.workunit.client.0.smithi037.stdout:7/316: rename d5/d15/f45 to d5/d14/d31/f75 0 2024-04-25T17:19:01.687 INFO:tasks.workunit.client.0.smithi037.stdout:2/282: dread d0/f14 [4194304,4194304] 0 2024-04-25T17:19:01.689 INFO:tasks.workunit.client.0.smithi037.stdout:6/271: link db/d26/d2e/l4f db/d26/l5e 0 2024-04-25T17:19:01.690 INFO:tasks.workunit.client.0.smithi037.stdout:9/333: link d1/d5/l2a d1/d5/dc/d38/d3d/l73 0 2024-04-25T17:19:01.690 INFO:tasks.workunit.client.0.smithi037.stdout:0/344: creat d9/df/d32/d39/f7d x:0 0 0 2024-04-25T17:19:01.692 INFO:tasks.workunit.client.0.smithi037.stdout:6/272: creat db/d1d/f5f x:0 0 0 2024-04-25T17:19:01.693 INFO:tasks.workunit.client.0.smithi037.stdout:4/411: mkdir d7/d8a 0 2024-04-25T17:19:01.693 INFO:tasks.workunit.client.0.smithi037.stdout:6/273: fsync db/d1d/f57 0 2024-04-25T17:19:01.694 INFO:tasks.workunit.client.0.smithi037.stdout:4/412: fsync d7/d7e/f48 0 2024-04-25T17:19:01.695 INFO:tasks.workunit.client.0.smithi037.stdout:7/317: unlink d5/f6 0 2024-04-25T17:19:01.696 INFO:tasks.workunit.client.0.smithi037.stdout:7/318: dread - d5/f55 zero size 2024-04-25T17:19:01.696 INFO:tasks.workunit.client.0.smithi037.stdout:9/334: creat d1/d48/d68/f74 x:0 0 0 2024-04-25T17:19:01.697 INFO:tasks.workunit.client.0.smithi037.stdout:4/413: rmdir d7/d7e/d45/d4f 39 2024-04-25T17:19:01.700 INFO:tasks.workunit.client.0.smithi037.stdout:2/283: getdents d0/d16/d3c 0 2024-04-25T17:19:01.703 INFO:tasks.workunit.client.0.smithi037.stdout:0/345: rename d9/f75 to d9/d14/d28/d48/f7e 0 2024-04-25T17:19:01.708 INFO:tasks.workunit.client.0.smithi037.stdout:7/319: dread d5/d15/d17/d25/d2b/f52 [0,4194304] 0 2024-04-25T17:19:01.709 INFO:tasks.workunit.client.0.smithi037.stdout:2/284: fsync d0/d23/f43 0 2024-04-25T17:19:01.711 INFO:tasks.workunit.client.0.smithi037.stdout:0/346: write d9/df/f45 [702365,120349] 0 2024-04-25T17:19:01.711 INFO:tasks.workunit.client.0.smithi037.stdout:7/320: fdatasync d5/d15/d17/f65 0 2024-04-25T17:19:01.713 INFO:tasks.workunit.client.0.smithi037.stdout:9/335: dwrite d1/d5/f58 [0,4194304] 0 2024-04-25T17:19:01.714 INFO:tasks.workunit.client.0.smithi037.stdout:2/285: readlink d0/d16/l17 0 2024-04-25T17:19:01.716 INFO:tasks.workunit.client.0.smithi037.stdout:7/321: dread - d5/d15/d17/d1b/d27/f5f zero size 2024-04-25T17:19:01.717 INFO:tasks.workunit.client.0.smithi037.stdout:9/336: fdatasync d1/f16 0 2024-04-25T17:19:01.719 INFO:tasks.workunit.client.0.smithi037.stdout:9/337: chown d1/fd 32003467 1 2024-04-25T17:19:01.720 INFO:tasks.workunit.client.0.smithi037.stdout:4/414: creat d7/d8a/f8b x:0 0 0 2024-04-25T17:19:01.723 INFO:tasks.workunit.client.0.smithi037.stdout:0/347: dwrite d9/df/f2c [0,4194304] 0 2024-04-25T17:19:01.726 INFO:tasks.workunit.client.0.smithi037.stdout:7/322: mkdir d5/d5e/d76 0 2024-04-25T17:19:01.727 INFO:tasks.workunit.client.0.smithi037.stdout:0/348: dread d9/d14/f3b [0,4194304] 0 2024-04-25T17:19:01.728 INFO:tasks.workunit.client.0.smithi037.stdout:0/349: stat d9/d14/l5f 0 2024-04-25T17:19:01.730 INFO:tasks.workunit.client.0.smithi037.stdout:0/350: chown d9/d14/d28/l4f 253916375 1 2024-04-25T17:19:01.732 INFO:tasks.workunit.client.0.smithi037.stdout:4/415: creat d7/d7e/d5b/f8c x:0 0 0 2024-04-25T17:19:01.733 INFO:tasks.workunit.client.0.smithi037.stdout:6/274: dwrite db/d1d/f1f [0,4194304] 0 2024-04-25T17:19:01.736 INFO:tasks.workunit.client.0.smithi037.stdout:7/323: readlink d5/d14/l23 0 2024-04-25T17:19:01.741 INFO:tasks.workunit.client.0.smithi037.stdout:2/286: mknod d0/d16/d20/d55/c57 0 2024-04-25T17:19:01.741 INFO:tasks.workunit.client.0.smithi037.stdout:2/287: chown d0/d23/f28 8 1 2024-04-25T17:19:01.748 INFO:tasks.workunit.client.0.smithi037.stdout:2/288: dwrite d0/d15/f37 [0,4194304] 0 2024-04-25T17:19:01.751 INFO:tasks.workunit.client.0.smithi037.stdout:0/351: fsync d9/df/f10 0 2024-04-25T17:19:01.754 INFO:tasks.workunit.client.0.smithi037.stdout:2/289: rmdir d0/d16/d26 39 2024-04-25T17:19:01.757 INFO:tasks.workunit.client.0.smithi037.stdout:0/352: write d9/d14/d28/d48/d58/f5d [416464,24811] 0 2024-04-25T17:19:01.759 INFO:tasks.workunit.client.0.smithi037.stdout:9/338: dwrite d1/f4 [4194304,4194304] 0 2024-04-25T17:19:01.760 INFO:tasks.workunit.client.0.smithi037.stdout:4/416: creat d7/d7e/d45/f8d x:0 0 0 2024-04-25T17:19:01.763 INFO:tasks.workunit.client.0.smithi037.stdout:6/275: dread db/d1d/d20/f3a [0,4194304] 0 2024-04-25T17:19:01.766 INFO:tasks.workunit.client.0.smithi037.stdout:0/353: write d9/d14/d23/f30 [781786,112744] 0 2024-04-25T17:19:01.767 INFO:tasks.workunit.client.0.smithi037.stdout:4/417: write d7/d7e/f7c [5043048,80420] 0 2024-04-25T17:19:01.769 INFO:tasks.workunit.client.0.smithi037.stdout:2/290: mknod d0/d16/c58 0 2024-04-25T17:19:01.773 INFO:tasks.workunit.client.0.smithi037.stdout:9/339: dread d1/d48/d68/d4e/f51 [0,4194304] 0 2024-04-25T17:19:01.774 INFO:tasks.workunit.client.0.smithi037.stdout:0/354: symlink d9/df/d32/d39/d68/l7f 0 2024-04-25T17:19:01.778 INFO:tasks.workunit.client.0.smithi037.stdout:6/276: link db/d26/d2e/d3e/f45 db/d1d/f60 0 2024-04-25T17:19:01.783 INFO:tasks.workunit.client.0.smithi037.stdout:4/418: truncate d7/d7e/d1e/d2b/f42 3055565 0 2024-04-25T17:19:01.784 INFO:tasks.workunit.client.0.smithi037.stdout:6/277: dwrite db/d1d/d20/f21 [0,4194304] 0 2024-04-25T17:19:01.792 INFO:tasks.workunit.client.0.smithi037.stdout:6/278: dwrite db/f56 [0,4194304] 0 2024-04-25T17:19:01.793 INFO:tasks.workunit.client.0.smithi037.stdout:6/279: fsync db/f12 0 2024-04-25T17:19:01.861 INFO:tasks.workunit.client.0.smithi037.stdout:7/324: link d5/d15/d17/f65 d5/d5e/d76/f77 0 2024-04-25T17:19:01.862 INFO:tasks.workunit.client.0.smithi037.stdout:9/340: creat d1/d5/d2e/f75 x:0 0 0 2024-04-25T17:19:01.863 INFO:tasks.workunit.client.0.smithi037.stdout:9/341: dread - d1/d5/dc/f2d zero size 2024-04-25T17:19:01.867 INFO:tasks.workunit.client.0.smithi037.stdout:6/280: mkdir db/d26/d2e/d3e/d25/d61 0 2024-04-25T17:19:01.869 INFO:tasks.workunit.client.0.smithi037.stdout:9/342: dread - d1/d5/dc/d38/f3a zero size 2024-04-25T17:19:01.873 INFO:tasks.workunit.client.0.smithi037.stdout:7/325: mkdir d5/d78 0 2024-04-25T17:19:01.876 INFO:tasks.workunit.client.0.smithi037.stdout:6/281: symlink db/d26/d2e/d3e/d25/d61/l62 0 2024-04-25T17:19:01.879 INFO:tasks.workunit.client.0.smithi037.stdout:7/326: rmdir d5/d15/d17/d1b 39 2024-04-25T17:19:01.881 INFO:tasks.workunit.client.0.smithi037.stdout:0/355: truncate d9/df/d32/d39/f52 548140 0 2024-04-25T17:19:01.887 INFO:tasks.workunit.client.0.smithi037.stdout:7/327: stat d5/d15/d17/d1b/d27 0 2024-04-25T17:19:01.888 INFO:tasks.workunit.client.0.smithi037.stdout:7/328: stat d5/d15/d17/d25/c54 0 2024-04-25T17:19:01.889 INFO:tasks.workunit.client.0.smithi037.stdout:7/329: write d5/d15/d17/d25/f67 [362795,90134] 0 2024-04-25T17:19:01.890 INFO:tasks.workunit.client.0.smithi037.stdout:0/356: symlink d9/df/d32/d39/l80 0 2024-04-25T17:19:01.892 INFO:tasks.workunit.client.0.smithi037.stdout:0/357: write d9/f2f [240759,84905] 0 2024-04-25T17:19:01.893 INFO:tasks.workunit.client.0.smithi037.stdout:0/358: dread - d9/d14/f3d zero size 2024-04-25T17:19:01.894 INFO:tasks.workunit.client.0.smithi037.stdout:6/282: mkdir db/d1d/d20/d63 0 2024-04-25T17:19:01.896 INFO:tasks.workunit.client.0.smithi037.stdout:7/330: mknod d5/d15/d17/d25/d2b/d59/c79 0 2024-04-25T17:19:01.897 INFO:tasks.workunit.client.0.smithi037.stdout:9/343: getdents d1/d48/d68/d26 0 2024-04-25T17:19:01.900 INFO:tasks.workunit.client.0.smithi037.stdout:6/283: creat db/d26/d2e/f64 x:0 0 0 2024-04-25T17:19:01.904 INFO:tasks.workunit.client.0.smithi037.stdout:6/284: dread db/f14 [0,4194304] 0 2024-04-25T17:19:01.904 INFO:tasks.workunit.client.0.smithi037.stdout:9/344: mkdir d1/d5/d2e/d34/d76 0 2024-04-25T17:19:01.909 INFO:tasks.workunit.client.0.smithi037.stdout:3/187: sync 2024-04-25T17:19:01.910 INFO:tasks.workunit.client.0.smithi037.stdout:6/285: truncate db/f13 819005 0 2024-04-25T17:19:01.919 INFO:tasks.workunit.client.0.smithi037.stdout:0/359: getdents d9/d14 0 2024-04-25T17:19:01.921 INFO:tasks.workunit.client.0.smithi037.stdout:6/286: mkdir db/d1d/d20/d63/d65 0 2024-04-25T17:19:01.922 INFO:tasks.workunit.client.0.smithi037.stdout:0/360: dread d9/df/f45 [0,4194304] 0 2024-04-25T17:19:01.922 INFO:tasks.workunit.client.0.smithi037.stdout:6/287: dread - db/d53/f54 zero size 2024-04-25T17:19:01.928 INFO:tasks.workunit.client.0.smithi037.stdout:0/361: rename d9/df/d32/d39/f7d to d9/d14/d28/f81 0 2024-04-25T17:19:01.933 INFO:tasks.workunit.client.0.smithi037.stdout:0/362: mknod d9/d14/d28/c82 0 2024-04-25T17:19:01.938 INFO:tasks.workunit.client.0.smithi037.stdout:6/288: link db/c4a db/d5a/c66 0 2024-04-25T17:19:01.940 INFO:tasks.workunit.client.0.smithi037.stdout:6/289: read - db/d26/d2e/f64 zero size 2024-04-25T17:19:01.942 INFO:tasks.workunit.client.0.smithi037.stdout:9/345: write d1/d5/d2e/d34/f4c [444803,45682] 0 2024-04-25T17:19:01.943 INFO:tasks.workunit.client.0.smithi037.stdout:6/290: chown db/d1d/l55 0 1 2024-04-25T17:19:01.945 INFO:tasks.workunit.client.0.smithi037.stdout:0/363: dwrite d9/d14/d28/d48/f50 [4194304,4194304] 0 2024-04-25T17:19:01.946 INFO:tasks.workunit.client.0.smithi037.stdout:3/188: truncate d8/f22 228771 0 2024-04-25T17:19:01.947 INFO:tasks.workunit.client.0.smithi037.stdout:7/331: dwrite d5/d15/d17/f65 [0,4194304] 0 2024-04-25T17:19:01.947 INFO:tasks.workunit.client.0.smithi037.stdout:9/346: creat d1/d48/d68/f77 x:0 0 0 2024-04-25T17:19:01.950 INFO:tasks.workunit.client.0.smithi037.stdout:3/189: write d8/f9 [3146622,31836] 0 2024-04-25T17:19:01.952 INFO:tasks.workunit.client.0.smithi037.stdout:9/347: truncate d1/d5/dc/f4a 440179 0 2024-04-25T17:19:01.952 INFO:tasks.workunit.client.0.smithi037.stdout:3/190: fdatasync d8/d23/f24 0 2024-04-25T17:19:01.954 INFO:tasks.workunit.client.0.smithi037.stdout:7/332: truncate d5/d15/d17/d25/d2b/d59/f63 510624 0 2024-04-25T17:19:01.954 INFO:tasks.workunit.client.0.smithi037.stdout:6/291: creat db/d26/f67 x:0 0 0 2024-04-25T17:19:01.957 INFO:tasks.workunit.client.0.smithi037.stdout:9/348: dread d1/fd [0,4194304] 0 2024-04-25T17:19:01.960 INFO:tasks.workunit.client.0.smithi037.stdout:9/349: write d1/d5/dc/d3c/d3e/f59 [155412,64923] 0 2024-04-25T17:19:01.961 INFO:tasks.workunit.client.0.smithi037.stdout:3/191: dread d8/f10 [0,4194304] 0 2024-04-25T17:19:01.962 INFO:tasks.workunit.client.0.smithi037.stdout:9/350: chown d1/d48/d68/f22 12081425 1 2024-04-25T17:19:01.964 INFO:tasks.workunit.client.0.smithi037.stdout:3/192: write d8/d23/f24 [690673,29819] 0 2024-04-25T17:19:01.965 INFO:tasks.workunit.client.0.smithi037.stdout:0/364: link d9/d14/l1d d9/df/d32/d39/d68/l83 0 2024-04-25T17:19:01.969 INFO:tasks.workunit.client.0.smithi037.stdout:7/333: dwrite d5/d15/d17/d1b/d27/f60 [0,4194304] 0 2024-04-25T17:19:01.971 INFO:tasks.workunit.client.0.smithi037.stdout:9/351: creat d1/d5/d19/d6e/f78 x:0 0 0 2024-04-25T17:19:01.974 INFO:tasks.workunit.client.0.smithi037.stdout:6/292: getdents db/d1d/d20/d2f 0 2024-04-25T17:19:01.974 INFO:tasks.workunit.client.0.smithi037.stdout:7/334: write d5/d15/d17/f38 [181611,950] 0 2024-04-25T17:19:01.976 INFO:tasks.workunit.client.0.smithi037.stdout:8/200: sync 2024-04-25T17:19:01.976 INFO:tasks.workunit.client.0.smithi037.stdout:5/291: sync 2024-04-25T17:19:01.976 INFO:tasks.workunit.client.0.smithi037.stdout:1/252: sync 2024-04-25T17:19:01.977 INFO:tasks.workunit.client.0.smithi037.stdout:9/352: dread d1/d5/d19/f1b [0,4194304] 0 2024-04-25T17:19:01.978 INFO:tasks.workunit.client.0.smithi037.stdout:3/193: rename d8/f10 to d8/d11/f3d 0 2024-04-25T17:19:01.978 INFO:tasks.workunit.client.0.smithi037.stdout:0/365: dwrite d9/d14/d28/d48/d58/f5d [0,4194304] 0 2024-04-25T17:19:01.978 INFO:tasks.workunit.client.0.smithi037.stdout:1/253: chown dc/d18/d39 2693 1 2024-04-25T17:19:01.980 INFO:tasks.workunit.client.0.smithi037.stdout:9/353: chown d1/d48/d68/d1c/f35 11109268 1 2024-04-25T17:19:01.981 INFO:tasks.workunit.client.0.smithi037.stdout:1/254: write dc/d1f/f4f [524070,115787] 0 2024-04-25T17:19:02.026 INFO:tasks.workunit.client.0.smithi037.stdout:3/194: mkdir d8/d31/d32/d3e 0 2024-04-25T17:19:02.027 INFO:tasks.workunit.client.0.smithi037.stdout:6/293: mkdir db/d1d/d20/d63/d65/d68 0 2024-04-25T17:19:02.029 INFO:tasks.workunit.client.0.smithi037.stdout:1/255: mknod dc/d52/c56 0 2024-04-25T17:19:02.029 INFO:tasks.workunit.client.0.smithi037.stdout:6/294: chown c4 300084 1 2024-04-25T17:19:02.031 INFO:tasks.workunit.client.0.smithi037.stdout:3/195: write d8/d23/f2d [291581,83867] 0 2024-04-25T17:19:02.032 INFO:tasks.workunit.client.0.smithi037.stdout:7/335: getdents d5/d15/d17/d1b 0 2024-04-25T17:19:02.033 INFO:tasks.workunit.client.0.smithi037.stdout:0/366: dwrite d9/d14/f44 [0,4194304] 0 2024-04-25T17:19:02.037 INFO:tasks.workunit.client.0.smithi037.stdout:9/354: getdents d1/d5/dc/d3c/d3e 0 2024-04-25T17:19:02.038 INFO:tasks.workunit.client.0.smithi037.stdout:3/196: symlink d8/d31/l3f 0 2024-04-25T17:19:02.038 INFO:tasks.workunit.client.0.smithi037.stdout:5/292: dwrite d7/d18/f29 [0,4194304] 0 2024-04-25T17:19:02.039 INFO:tasks.workunit.client.0.smithi037.stdout:0/367: creat d9/df/f84 x:0 0 0 2024-04-25T17:19:02.040 INFO:tasks.workunit.client.0.smithi037.stdout:5/293: dread - d7/f57 zero size 2024-04-25T17:19:02.040 INFO:tasks.workunit.client.0.smithi037.stdout:7/336: mknod d5/d15/d17/d25/d2b/d59/c7a 0 2024-04-25T17:19:02.040 INFO:tasks.workunit.client.0.smithi037.stdout:3/197: truncate d8/f26 4383353 0 2024-04-25T17:19:02.045 INFO:tasks.workunit.client.0.smithi037.stdout:1/256: rename dc/d1f to dc/d1c/d57 0 2024-04-25T17:19:02.046 INFO:tasks.workunit.client.0.smithi037.stdout:6/295: creat db/d1d/d20/d63/d65/d68/f69 x:0 0 0 2024-04-25T17:19:02.048 INFO:tasks.workunit.client.0.smithi037.stdout:7/337: chown d5/d14/d31/f75 0 1 2024-04-25T17:19:02.048 INFO:tasks.workunit.client.0.smithi037.stdout:0/368: symlink d9/d14/d28/d48/d58/l85 0 2024-04-25T17:19:02.049 INFO:tasks.workunit.client.0.smithi037.stdout:0/369: readlink d9/d14/l5f 0 2024-04-25T17:19:02.050 INFO:tasks.workunit.client.0.smithi037.stdout:9/355: rename d1/d48/d68/f77 to d1/d5/d19/d6e/f79 0 2024-04-25T17:19:02.052 INFO:tasks.workunit.client.0.smithi037.stdout:6/296: unlink db/d1d/f60 0 2024-04-25T17:19:02.053 INFO:tasks.workunit.client.0.smithi037.stdout:6/297: fdatasync db/d1d/f5f 0 2024-04-25T17:19:02.054 INFO:tasks.workunit.client.0.smithi037.stdout:6/298: read db/f17 [3575774,69626] 0 2024-04-25T17:19:02.054 INFO:tasks.workunit.client.0.smithi037.stdout:7/338: rmdir d5/d15/d17/d25/d2b/d48 39 2024-04-25T17:19:02.056 INFO:tasks.workunit.client.0.smithi037.stdout:0/370: creat d9/df/f86 x:0 0 0 2024-04-25T17:19:02.056 INFO:tasks.workunit.client.0.smithi037.stdout:7/339: read d5/d15/d17/d25/d2b/f52 [36426,51977] 0 2024-04-25T17:19:02.057 INFO:tasks.workunit.client.0.smithi037.stdout:7/340: write d5/d15/f1e [1254460,25268] 0 2024-04-25T17:19:02.057 INFO:tasks.workunit.client.0.smithi037.stdout:0/371: read d9/df/d32/f3e [23999,89047] 0 2024-04-25T17:19:02.057 INFO:tasks.workunit.client.0.smithi037.stdout:3/198: rename d8/l25 to d8/d31/d32/l40 0 2024-04-25T17:19:02.059 INFO:tasks.workunit.client.0.smithi037.stdout:9/356: mknod d1/d48/d68/c7a 0 2024-04-25T17:19:02.060 INFO:tasks.workunit.client.0.smithi037.stdout:5/294: truncate d7/d43/f32 3580845 0 2024-04-25T17:19:02.065 INFO:tasks.workunit.client.0.smithi037.stdout:9/357: mkdir d1/d5/dc/d7b 0 2024-04-25T17:19:02.066 INFO:tasks.workunit.client.0.smithi037.stdout:9/358: dread - d1/d5/dc/d38/f3a zero size 2024-04-25T17:19:02.067 INFO:tasks.workunit.client.0.smithi037.stdout:9/359: stat d1/d5/dc/d3c/d3e 0 2024-04-25T17:19:02.068 INFO:tasks.workunit.client.0.smithi037.stdout:9/360: stat d1/d5/dc/f4a 0 2024-04-25T17:19:02.069 INFO:tasks.workunit.client.0.smithi037.stdout:9/361: dread - d1/d5/dc/d38/d3d/f66 zero size 2024-04-25T17:19:02.071 INFO:tasks.workunit.client.0.smithi037.stdout:9/362: read d1/d48/d68/d1c/f35 [1319562,21932] 0 2024-04-25T17:19:02.071 INFO:tasks.workunit.client.0.smithi037.stdout:7/341: write d5/fd [3889773,30285] 0 2024-04-25T17:19:02.075 INFO:tasks.workunit.client.0.smithi037.stdout:1/257: dread dc/d24/f4b [0,4194304] 0 2024-04-25T17:19:02.077 INFO:tasks.workunit.client.0.smithi037.stdout:5/295: dread d7/d12/f50 [0,4194304] 0 2024-04-25T17:19:02.077 INFO:tasks.workunit.client.0.smithi037.stdout:6/299: rename db/d26/d2e/c5d to db/d26/c6a 0 2024-04-25T17:19:02.079 INFO:tasks.workunit.client.0.smithi037.stdout:3/199: creat d8/d23/f41 x:0 0 0 2024-04-25T17:19:02.079 INFO:tasks.workunit.client.0.smithi037.stdout:1/258: write dc/d1c/d57/d22/f2c [4067101,8802] 0 2024-04-25T17:19:02.082 INFO:tasks.workunit.client.0.smithi037.stdout:0/372: link d9/c6c d9/df/d32/d35/c87 0 2024-04-25T17:19:02.082 INFO:tasks.workunit.client.0.smithi037.stdout:7/342: dwrite d5/d5e/d76/f77 [4194304,4194304] 0 2024-04-25T17:19:02.092 INFO:tasks.workunit.client.0.smithi037.stdout:5/296: write d7/fc [1966277,44237] 0 2024-04-25T17:19:02.092 INFO:tasks.workunit.client.0.smithi037.stdout:6/300: dread f5 [0,4194304] 0 2024-04-25T17:19:02.092 INFO:tasks.workunit.client.0.smithi037.stdout:7/343: symlink d5/d14/l7b 0 2024-04-25T17:19:02.093 INFO:tasks.workunit.client.0.smithi037.stdout:9/363: link d1/d48/d68/c69 d1/d5/c7c 0 2024-04-25T17:19:02.094 INFO:tasks.workunit.client.0.smithi037.stdout:3/200: creat d8/d31/d32/d3e/f42 x:0 0 0 2024-04-25T17:19:02.095 INFO:tasks.workunit.client.0.smithi037.stdout:1/259: dread f8 [0,4194304] 0 2024-04-25T17:19:02.096 INFO:tasks.workunit.client.0.smithi037.stdout:7/344: chown d5/f46 188 1 2024-04-25T17:19:02.097 INFO:tasks.workunit.client.0.smithi037.stdout:3/201: dread d8/f26 [4194304,4194304] 0 2024-04-25T17:19:02.097 INFO:tasks.workunit.client.0.smithi037.stdout:9/364: chown d1/d5/dc/f11 130485992 1 2024-04-25T17:19:02.098 INFO:tasks.workunit.client.0.smithi037.stdout:7/345: write d5/d15/d17/d1b/f1d [163489,113699] 0 2024-04-25T17:19:02.099 INFO:tasks.workunit.client.0.smithi037.stdout:0/373: rename d9/d14/d23/f65 to d9/d14/d28/d48/f88 0 2024-04-25T17:19:02.102 INFO:tasks.workunit.client.0.smithi037.stdout:1/260: creat dc/d1c/f58 x:0 0 0 2024-04-25T17:19:02.104 INFO:tasks.workunit.client.0.smithi037.stdout:0/374: dread d9/df/f12 [0,4194304] 0 2024-04-25T17:19:02.105 INFO:tasks.workunit.client.0.smithi037.stdout:9/365: write d1/f2 [5363058,124830] 0 2024-04-25T17:19:02.107 INFO:tasks.workunit.client.0.smithi037.stdout:9/366: write d1/f2 [6192516,68813] 0 2024-04-25T17:19:02.107 INFO:tasks.workunit.client.0.smithi037.stdout:2/291: sync 2024-04-25T17:19:02.108 INFO:tasks.workunit.client.0.smithi037.stdout:4/419: sync 2024-04-25T17:19:02.108 INFO:tasks.workunit.client.0.smithi037.stdout:9/367: readlink d1/d5/d19/l43 0 2024-04-25T17:19:02.111 INFO:tasks.workunit.client.0.smithi037.stdout:1/261: rename dc/d1c/d57/d22/c31 to dc/d1c/d57/d22/c59 0 2024-04-25T17:19:02.114 INFO:tasks.workunit.client.0.smithi037.stdout:3/202: truncate d8/d11/f20 3434266 0 2024-04-25T17:19:02.115 INFO:tasks.workunit.client.0.smithi037.stdout:0/375: fdatasync d9/d14/d28/d48/f49 0 2024-04-25T17:19:02.119 INFO:tasks.workunit.client.0.smithi037.stdout:5/297: dwrite d7/d25/f2b [0,4194304] 0 2024-04-25T17:19:02.119 INFO:tasks.workunit.client.0.smithi037.stdout:6/301: getdents db/d26/d2e/d3e/d25 0 2024-04-25T17:19:02.122 INFO:tasks.workunit.client.0.smithi037.stdout:1/262: dwrite dc/d1c/f58 [0,4194304] 0 2024-04-25T17:19:02.125 INFO:tasks.workunit.client.0.smithi037.stdout:9/368: write d1/ff [1264707,16206] 0 2024-04-25T17:19:02.126 INFO:tasks.workunit.client.0.smithi037.stdout:9/369: chown d1/d48/d68/d4e/f67 5 1 2024-04-25T17:19:02.131 INFO:tasks.workunit.client.0.smithi037.stdout:0/376: mknod d9/d14/d28/c89 0 2024-04-25T17:19:02.131 INFO:tasks.workunit.client.0.smithi037.stdout:4/420: creat d7/d7e/d45/d4f/f8e x:0 0 0 2024-04-25T17:19:02.134 INFO:tasks.workunit.client.0.smithi037.stdout:4/421: chown d7/d78/c87 6 1 2024-04-25T17:19:02.134 INFO:tasks.workunit.client.0.smithi037.stdout:6/302: mknod db/d26/d2e/c6b 0 2024-04-25T17:19:02.135 INFO:tasks.workunit.client.0.smithi037.stdout:7/346: rmdir d5/d70 0 2024-04-25T17:19:02.137 INFO:tasks.workunit.client.0.smithi037.stdout:9/370: creat d1/d5/dc/f7d x:0 0 0 2024-04-25T17:19:02.137 INFO:tasks.workunit.client.0.smithi037.stdout:1/263: dwrite dc/d1c/d57/d22/d36/f4c [0,4194304] 0 2024-04-25T17:19:02.137 INFO:tasks.workunit.client.0.smithi037.stdout:5/298: dread d7/f1f [0,4194304] 0 2024-04-25T17:19:02.139 INFO:tasks.workunit.client.0.smithi037.stdout:2/292: getdents d0 0 2024-04-25T17:19:02.140 INFO:tasks.workunit.client.0.smithi037.stdout:0/377: fsync d9/d14/d28/d48/f88 0 2024-04-25T17:19:02.155 INFO:tasks.workunit.client.0.smithi037.stdout:3/203: write d8/d31/d32/f36 [690083,111843] 0 2024-04-25T17:19:02.157 INFO:tasks.workunit.client.0.smithi037.stdout:7/347: write d5/d14/d31/f75 [3176051,10889] 0 2024-04-25T17:19:02.157 INFO:tasks.workunit.client.0.smithi037.stdout:1/264: write dc/d1c/d57/d22/d36/f41 [4958425,109893] 0 2024-04-25T17:19:02.157 INFO:tasks.workunit.client.0.smithi037.stdout:3/204: fdatasync d8/f17 0 2024-04-25T17:19:02.160 INFO:tasks.workunit.client.0.smithi037.stdout:0/378: mkdir d9/df/d8a 0 2024-04-25T17:19:02.161 INFO:tasks.workunit.client.0.smithi037.stdout:7/348: fsync d5/d15/d17/d25/d2b/d59/f6c 0 2024-04-25T17:19:02.162 INFO:tasks.workunit.client.0.smithi037.stdout:1/265: chown dc/d18/f38 5920540 1 2024-04-25T17:19:02.162 INFO:tasks.workunit.client.0.smithi037.stdout:4/422: dread d7/d7e/d4e/f71 [0,4194304] 0 2024-04-25T17:19:02.162 INFO:tasks.workunit.client.0.smithi037.stdout:2/293: dread d0/f44 [0,4194304] 0 2024-04-25T17:19:02.164 INFO:tasks.workunit.client.0.smithi037.stdout:9/371: link d1/f4 d1/d48/d68/f7e 0 2024-04-25T17:19:02.168 INFO:tasks.workunit.client.0.smithi037.stdout:9/372: mknod d1/d5/dc/d3c/d3e/c7f 0 2024-04-25T17:19:02.173 INFO:tasks.workunit.client.0.smithi037.stdout:3/205: dread f5 [0,4194304] 0 2024-04-25T17:19:02.173 INFO:tasks.workunit.client.0.smithi037.stdout:7/349: creat d5/f7c x:0 0 0 2024-04-25T17:19:02.173 INFO:tasks.workunit.client.0.smithi037.stdout:9/373: chown d1/d5/dc/d3c/d3e/f59 271507696 1 2024-04-25T17:19:02.173 INFO:tasks.workunit.client.0.smithi037.stdout:4/423: mknod d7/d7e/d1e/d2b/d35/d39/d83/c8f 0 2024-04-25T17:19:02.176 INFO:tasks.workunit.client.0.smithi037.stdout:5/299: dwrite d7/d12/f21 [0,4194304] 0 2024-04-25T17:19:02.176 INFO:tasks.workunit.client.0.smithi037.stdout:1/266: dwrite dc/d1c/d57/f4f [0,4194304] 0 2024-04-25T17:19:02.180 INFO:tasks.workunit.client.0.smithi037.stdout:2/294: truncate d0/d16/f1b 2265609 0 2024-04-25T17:19:02.187 INFO:tasks.workunit.client.0.smithi037.stdout:2/295: mkdir d0/d16/d20/d59 0 2024-04-25T17:19:02.187 INFO:tasks.workunit.client.0.smithi037.stdout:1/267: dread dc/fd [0,4194304] 0 2024-04-25T17:19:02.190 INFO:tasks.workunit.client.0.smithi037.stdout:7/350: symlink d5/d14/d31/d58/l7d 0 2024-04-25T17:19:02.190 INFO:tasks.workunit.client.0.smithi037.stdout:9/374: dwrite d1/d48/d68/f31 [0,4194304] 0 2024-04-25T17:19:02.193 INFO:tasks.workunit.client.0.smithi037.stdout:4/424: dwrite d7/d7e/f48 [0,4194304] 0 2024-04-25T17:19:02.199 INFO:tasks.workunit.client.0.smithi037.stdout:7/351: truncate d5/d15/d17/f41 1424289 0 2024-04-25T17:19:02.201 INFO:tasks.workunit.client.0.smithi037.stdout:5/300: creat d7/f5c x:0 0 0 2024-04-25T17:19:02.202 INFO:tasks.workunit.client.0.smithi037.stdout:7/352: fsync d5/f46 0 2024-04-25T17:19:02.204 INFO:tasks.workunit.client.0.smithi037.stdout:4/425: mknod d7/d7e/d5b/c90 0 2024-04-25T17:19:02.206 INFO:tasks.workunit.client.0.smithi037.stdout:5/301: read - d7/d43/f52 zero size 2024-04-25T17:19:02.207 INFO:tasks.workunit.client.0.smithi037.stdout:9/375: dwrite d1/d5/d2e/f75 [0,4194304] 0 2024-04-25T17:19:02.210 INFO:tasks.workunit.client.0.smithi037.stdout:3/206: dwrite d8/d11/f20 [0,4194304] 0 2024-04-25T17:19:02.211 INFO:tasks.workunit.client.0.smithi037.stdout:9/376: truncate d1/f9 4300697 0 2024-04-25T17:19:02.212 INFO:tasks.workunit.client.0.smithi037.stdout:7/353: creat d5/d15/f7e x:0 0 0 2024-04-25T17:19:02.214 INFO:tasks.workunit.client.0.smithi037.stdout:5/302: truncate d7/f1c 1181184 0 2024-04-25T17:19:02.215 INFO:tasks.workunit.client.0.smithi037.stdout:2/296: truncate d0/d15/f36 2569359 0 2024-04-25T17:19:02.219 INFO:tasks.workunit.client.0.smithi037.stdout:9/377: read - d1/d5/dc/d38/d3d/d3f/f60 zero size 2024-04-25T17:19:02.223 INFO:tasks.workunit.client.0.smithi037.stdout:4/426: link d7/c15 d7/d7e/d1e/d70/c91 0 2024-04-25T17:19:02.224 INFO:tasks.workunit.client.0.smithi037.stdout:9/378: readlink d1/d48/d68/l2b 0 2024-04-25T17:19:02.224 INFO:tasks.workunit.client.0.smithi037.stdout:2/297: fsync d0/d16/d26/f4a 0 2024-04-25T17:19:02.225 INFO:tasks.workunit.client.0.smithi037.stdout:3/207: dwrite d8/f37 [0,4194304] 0 2024-04-25T17:19:02.226 INFO:tasks.workunit.client.0.smithi037.stdout:7/354: rename d5/d15/d17/d25/d2b/l49 to d5/d15/l7f 0 2024-04-25T17:19:02.227 INFO:tasks.workunit.client.0.smithi037.stdout:1/268: dread dc/f27 [0,4194304] 0 2024-04-25T17:19:02.227 INFO:tasks.workunit.client.0.smithi037.stdout:4/427: chown d7/d7e/l4c 34240 1 2024-04-25T17:19:02.230 INFO:tasks.workunit.client.0.smithi037.stdout:3/208: write d8/d23/f2d [512089,111172] 0 2024-04-25T17:19:02.231 INFO:tasks.workunit.client.0.smithi037.stdout:5/303: dwrite d7/d18/f29 [0,4194304] 0 2024-04-25T17:19:02.235 INFO:tasks.workunit.client.0.smithi037.stdout:7/355: read d5/d15/d17/d1b/d27/f42 [216390,71382] 0 2024-04-25T17:19:02.236 INFO:tasks.workunit.client.0.smithi037.stdout:2/298: dread d0/d16/d20/f3d [0,4194304] 0 2024-04-25T17:19:02.237 INFO:tasks.workunit.client.0.smithi037.stdout:4/428: fsync d7/f11 0 2024-04-25T17:19:02.237 INFO:tasks.workunit.client.0.smithi037.stdout:2/299: dread - d0/f51 zero size 2024-04-25T17:19:02.240 INFO:tasks.workunit.client.0.smithi037.stdout:3/209: creat d8/d23/d3a/f43 x:0 0 0 2024-04-25T17:19:02.241 INFO:tasks.workunit.client.0.smithi037.stdout:8/201: sync 2024-04-25T17:19:02.243 INFO:tasks.workunit.client.0.smithi037.stdout:7/356: mkdir d5/d15/d17/d1b/d27/d80 0 2024-04-25T17:19:02.244 INFO:tasks.workunit.client.0.smithi037.stdout:1/269: mknod dc/d1c/d57/d43/c5a 0 2024-04-25T17:19:02.245 INFO:tasks.workunit.client.0.smithi037.stdout:2/300: mkdir d0/d15/d2a/d5a 0 2024-04-25T17:19:02.247 INFO:tasks.workunit.client.0.smithi037.stdout:9/379: dwrite d1/d5/dc/f29 [4194304,4194304] 0 2024-04-25T17:19:02.247 INFO:tasks.workunit.client.0.smithi037.stdout:4/429: rename d7/d7e/d1e/d2b/c79 to d7/d7e/d1e/d2b/d35/c92 0 2024-04-25T17:19:02.303 INFO:tasks.workunit.client.0.smithi037.stdout:1/270: creat dc/d52/f5b x:0 0 0 2024-04-25T17:19:02.303 INFO:tasks.workunit.client.0.smithi037.stdout:2/301: truncate d0/d15/f48 244333 0 2024-04-25T17:19:02.304 INFO:tasks.workunit.client.0.smithi037.stdout:5/304: dread d7/fb [0,4194304] 0 2024-04-25T17:19:02.305 INFO:tasks.workunit.client.0.smithi037.stdout:1/271: readlink dc/d24/l55 0 2024-04-25T17:19:02.305 INFO:tasks.workunit.client.0.smithi037.stdout:9/380: write d1/d5/d2e/f52 [596627,51006] 0 2024-04-25T17:19:02.306 INFO:tasks.workunit.client.0.smithi037.stdout:5/305: chown d7/d12/f21 39520047 1 2024-04-25T17:19:02.309 INFO:tasks.workunit.client.0.smithi037.stdout:5/306: dread - d7/d12/f31 zero size 2024-04-25T17:19:02.312 INFO:tasks.workunit.client.0.smithi037.stdout:9/381: chown d1/d5/dc/d38/d3d/l62 0 1 2024-04-25T17:19:02.313 INFO:tasks.workunit.client.0.smithi037.stdout:5/307: write d7/f5b [1032568,27037] 0 2024-04-25T17:19:02.318 INFO:tasks.workunit.client.0.smithi037.stdout:2/302: dwrite d0/d15/f4f [0,4194304] 0 2024-04-25T17:19:02.319 INFO:tasks.workunit.client.0.smithi037.stdout:4/430: dwrite d7/d7e/d5b/f73 [0,4194304] 0 2024-04-25T17:19:02.320 INFO:tasks.workunit.client.0.smithi037.stdout:7/357: dread d5/d14/d31/f3f [0,4194304] 0 2024-04-25T17:19:02.320 INFO:tasks.workunit.client.0.smithi037.stdout:2/303: readlink d0/d16/l17 0 2024-04-25T17:19:02.321 INFO:tasks.workunit.client.0.smithi037.stdout:5/308: mkdir d7/d12/d5d 0 2024-04-25T17:19:02.324 INFO:tasks.workunit.client.0.smithi037.stdout:1/272: dwrite dc/d1c/d57/f4f [0,4194304] 0 2024-04-25T17:19:02.327 INFO:tasks.workunit.client.0.smithi037.stdout:9/382: getdents d1/d48/d68/d1c 0 2024-04-25T17:19:02.328 INFO:tasks.workunit.client.0.smithi037.stdout:5/309: chown d7/d18/f2a 2147393928 1 2024-04-25T17:19:02.330 INFO:tasks.workunit.client.0.smithi037.stdout:4/431: creat d7/d7e/d1e/f93 x:0 0 0 2024-04-25T17:19:02.332 INFO:tasks.workunit.client.0.smithi037.stdout:2/304: creat d0/d16/d3b/f5b x:0 0 0 2024-04-25T17:19:02.333 INFO:tasks.workunit.client.0.smithi037.stdout:2/305: chown d0/d16/d20/f3d 1618 1 2024-04-25T17:19:02.333 INFO:tasks.workunit.client.0.smithi037.stdout:7/358: symlink d5/d15/d17/d25/l81 0 2024-04-25T17:19:02.336 INFO:tasks.workunit.client.0.smithi037.stdout:7/359: write d5/d15/d17/d1b/f68 [972004,63488] 0 2024-04-25T17:19:02.336 INFO:tasks.workunit.client.0.smithi037.stdout:9/383: rename d1/f13 to d1/d48/d68/d26/f80 0 2024-04-25T17:19:02.337 INFO:tasks.workunit.client.0.smithi037.stdout:4/432: symlink d7/d7e/d5b/l94 0 2024-04-25T17:19:02.340 INFO:tasks.workunit.client.0.smithi037.stdout:7/360: chown d5/d15/d17/d25/d2b/d48/f72 14844 1 2024-04-25T17:19:02.342 INFO:tasks.workunit.client.0.smithi037.stdout:2/306: dwrite d0/f51 [0,4194304] 0 2024-04-25T17:19:02.343 INFO:tasks.workunit.client.0.smithi037.stdout:9/384: mkdir d1/d48/d68/d26/d81 0 2024-04-25T17:19:02.346 INFO:tasks.workunit.client.0.smithi037.stdout:5/310: link d7/f49 d7/d12/f5e 0 2024-04-25T17:19:02.349 INFO:tasks.workunit.client.0.smithi037.stdout:2/307: fdatasync d0/d16/f1b 0 2024-04-25T17:19:02.350 INFO:tasks.workunit.client.0.smithi037.stdout:2/308: stat d0/d16/d26 0 2024-04-25T17:19:02.353 INFO:tasks.workunit.client.0.smithi037.stdout:4/433: creat d7/d7e/d45/f95 x:0 0 0 2024-04-25T17:19:02.353 INFO:tasks.workunit.client.0.smithi037.stdout:9/385: dwrite d1/d5/dc/d3c/d3e/f42 [0,4194304] 0 2024-04-25T17:19:02.353 INFO:tasks.workunit.client.0.smithi037.stdout:2/309: write d0/d16/d26/f41 [74892,46448] 0 2024-04-25T17:19:02.355 INFO:tasks.workunit.client.0.smithi037.stdout:4/434: chown d7/d7e/d45/f8d 3176 1 2024-04-25T17:19:02.355 INFO:tasks.workunit.client.0.smithi037.stdout:9/386: stat d1/d5/dc/d3c/d3e 0 2024-04-25T17:19:02.357 INFO:tasks.workunit.client.0.smithi037.stdout:2/310: chown d0/c10 898142 1 2024-04-25T17:19:02.358 INFO:tasks.workunit.client.0.smithi037.stdout:1/273: truncate dc/d18/f42 663363 0 2024-04-25T17:19:02.359 INFO:tasks.workunit.client.0.smithi037.stdout:5/311: read d7/d18/f1e [248882,46599] 0 2024-04-25T17:19:02.366 INFO:tasks.workunit.client.0.smithi037.stdout:9/387: mknod d1/d48/d68/d26/d81/c82 0 2024-04-25T17:19:02.367 INFO:tasks.workunit.client.0.smithi037.stdout:4/435: dwrite d7/ff [0,4194304] 0 2024-04-25T17:19:02.369 INFO:tasks.workunit.client.0.smithi037.stdout:4/436: dread - d7/d8a/f8b zero size 2024-04-25T17:19:02.370 INFO:tasks.workunit.client.0.smithi037.stdout:2/311: link d0/d16/l19 d0/d23/l5c 0 2024-04-25T17:19:02.370 INFO:tasks.workunit.client.0.smithi037.stdout:5/312: write d7/f33 [5092578,6789] 0 2024-04-25T17:19:02.371 INFO:tasks.workunit.client.0.smithi037.stdout:1/274: dwrite fa [4194304,4194304] 0 2024-04-25T17:19:02.374 INFO:tasks.workunit.client.0.smithi037.stdout:9/388: mknod d1/d5/dc/d38/d3d/d3f/c83 0 2024-04-25T17:19:02.376 INFO:tasks.workunit.client.0.smithi037.stdout:7/361: truncate d5/d14/d31/f75 3228507 0 2024-04-25T17:19:02.379 INFO:tasks.workunit.client.0.smithi037.stdout:4/437: rename d7/d7e/f3d to d7/d7e/d45/d4f/f96 0 2024-04-25T17:19:02.380 INFO:tasks.workunit.client.0.smithi037.stdout:2/312: rmdir d0/d15/d53 39 2024-04-25T17:19:02.383 INFO:tasks.workunit.client.0.smithi037.stdout:1/275: symlink dc/d1c/d57/d22/d36/l5c 0 2024-04-25T17:19:02.384 INFO:tasks.workunit.client.0.smithi037.stdout:7/362: dwrite d5/d5e/d76/f77 [4194304,4194304] 0 2024-04-25T17:19:02.390 INFO:tasks.workunit.client.0.smithi037.stdout:5/313: mknod d7/d18/c5f 0 2024-04-25T17:19:02.391 INFO:tasks.workunit.client.0.smithi037.stdout:2/313: dwrite d0/d16/d26/f3f [0,4194304] 0 2024-04-25T17:19:02.391 INFO:tasks.workunit.client.0.smithi037.stdout:9/389: rmdir d1/d5/dc/d38/d3d/d3f 39 2024-04-25T17:19:02.394 INFO:tasks.workunit.client.0.smithi037.stdout:7/363: mknod d5/d15/d17/d1b/d27/c82 0 2024-04-25T17:19:02.400 INFO:tasks.workunit.client.0.smithi037.stdout:1/276: dwrite dc/f3d [0,4194304] 0 2024-04-25T17:19:02.402 INFO:tasks.workunit.client.0.smithi037.stdout:1/277: chown dc/d24/l50 10 1 2024-04-25T17:19:02.403 INFO:tasks.workunit.client.0.smithi037.stdout:7/364: symlink d5/d5e/l83 0 2024-04-25T17:19:02.404 INFO:tasks.workunit.client.0.smithi037.stdout:2/314: dread d0/d15/f1d [0,4194304] 0 2024-04-25T17:19:02.404 INFO:tasks.workunit.client.0.smithi037.stdout:9/390: truncate d1/d5/dc/d38/d3d/d3f/f41 4441054 0 2024-04-25T17:19:02.408 INFO:tasks.workunit.client.0.smithi037.stdout:7/365: stat d5/d15/f1f 0 2024-04-25T17:19:02.408 INFO:tasks.workunit.client.0.smithi037.stdout:7/366: stat d5/d5e 0 2024-04-25T17:19:02.411 INFO:tasks.workunit.client.0.smithi037.stdout:2/315: rename d0/d16/l1e to d0/d15/d2a/d5a/l5d 0 2024-04-25T17:19:02.413 INFO:tasks.workunit.client.0.smithi037.stdout:9/391: unlink d1/d5/dc/d38/d3d/d3f/c83 0 2024-04-25T17:19:02.414 INFO:tasks.workunit.client.0.smithi037.stdout:9/392: write d1/d5/dc/d38/d3d/f66 [239221,124905] 0 2024-04-25T17:19:02.416 INFO:tasks.workunit.client.0.smithi037.stdout:5/314: getdents d7 0 2024-04-25T17:19:02.417 INFO:tasks.workunit.client.0.smithi037.stdout:5/315: write d7/f56 [173003,45835] 0 2024-04-25T17:19:02.419 INFO:tasks.workunit.client.0.smithi037.stdout:9/393: mknod d1/d48/d68/c84 0 2024-04-25T17:19:02.420 INFO:tasks.workunit.client.0.smithi037.stdout:7/367: creat d5/d15/d17/d1b/d27/d80/f84 x:0 0 0 2024-04-25T17:19:02.422 INFO:tasks.workunit.client.0.smithi037.stdout:5/316: fsync d7/f49 0 2024-04-25T17:19:02.422 INFO:tasks.workunit.client.0.smithi037.stdout:5/317: stat d7/d18/f29 0 2024-04-25T17:19:02.424 INFO:tasks.workunit.client.0.smithi037.stdout:1/278: truncate dc/d1c/d57/d22/f2c 1208991 0 2024-04-25T17:19:02.425 INFO:tasks.workunit.client.0.smithi037.stdout:7/368: creat d5/d15/d17/d1b/d27/d80/f85 x:0 0 0 2024-04-25T17:19:02.427 INFO:tasks.workunit.client.0.smithi037.stdout:5/318: dread d7/f3c [0,4194304] 0 2024-04-25T17:19:02.429 INFO:tasks.workunit.client.0.smithi037.stdout:1/279: creat dc/d1c/d57/d22/d36/f5d x:0 0 0 2024-04-25T17:19:02.430 INFO:tasks.workunit.client.0.smithi037.stdout:7/369: creat d5/d15/d17/d1b/d27/d80/f86 x:0 0 0 2024-04-25T17:19:02.430 INFO:tasks.workunit.client.0.smithi037.stdout:5/319: rmdir d7/d25 39 2024-04-25T17:19:02.432 INFO:tasks.workunit.client.0.smithi037.stdout:1/280: rmdir dc/d24 39 2024-04-25T17:19:02.435 INFO:tasks.workunit.client.0.smithi037.stdout:9/394: dwrite d1/d48/d68/f31 [4194304,4194304] 0 2024-04-25T17:19:02.442 INFO:tasks.workunit.client.0.smithi037.stdout:5/320: dread d7/f1f [0,4194304] 0 2024-04-25T17:19:02.442 INFO:tasks.workunit.client.0.smithi037.stdout:1/281: dwrite dc/d18/f1b [0,4194304] 0 2024-04-25T17:19:02.442 INFO:tasks.workunit.client.0.smithi037.stdout:7/370: symlink d5/d5e/d76/l87 0 2024-04-25T17:19:02.443 INFO:tasks.workunit.client.0.smithi037.stdout:9/395: fdatasync d1/d5/f28 0 2024-04-25T17:19:02.451 INFO:tasks.workunit.client.0.smithi037.stdout:1/282: creat dc/d24/f5e x:0 0 0 2024-04-25T17:19:02.452 INFO:tasks.workunit.client.0.smithi037.stdout:1/283: chown dc/d1c/d57/d22/f2d 0 1 2024-04-25T17:19:02.453 INFO:tasks.workunit.client.0.smithi037.stdout:9/396: rmdir d1/d5/dc/d7b 0 2024-04-25T17:19:02.455 INFO:tasks.workunit.client.0.smithi037.stdout:1/284: rename dc/d24/l55 to dc/d1c/d57/l5f 0 2024-04-25T17:19:02.455 INFO:tasks.workunit.client.0.smithi037.stdout:1/285: stat dc/d1c 0 2024-04-25T17:19:02.455 INFO:tasks.workunit.client.0.smithi037.stdout:9/397: creat d1/d48/d68/d4e/f85 x:0 0 0 2024-04-25T17:19:02.456 INFO:tasks.workunit.client.0.smithi037.stdout:1/286: creat dc/f60 x:0 0 0 2024-04-25T17:19:02.457 INFO:tasks.workunit.client.0.smithi037.stdout:1/287: fsync dc/d52/f5b 0 2024-04-25T17:19:02.474 INFO:tasks.workunit.client.0.smithi037.stdout:9/398: rename d1/d48/d68/f22 to d1/d48/d68/d26/d81/f86 0 2024-04-25T17:19:02.475 INFO:tasks.workunit.client.0.smithi037.stdout:9/399: dread - d1/d48/d68/d26/f57 zero size 2024-04-25T17:19:02.475 INFO:tasks.workunit.client.0.smithi037.stdout:1/288: creat dc/d1c/d57/d4d/f61 x:0 0 0 2024-04-25T17:19:02.475 INFO:tasks.workunit.client.0.smithi037.stdout:9/400: read - d1/d5/d19/d6e/f79 zero size 2024-04-25T17:19:02.477 INFO:tasks.workunit.client.0.smithi037.stdout:9/401: read - d1/d48/d68/f39 zero size 2024-04-25T17:19:02.477 INFO:tasks.workunit.client.0.smithi037.stdout:5/321: truncate d7/d25/f2b 2049002 0 2024-04-25T17:19:02.478 INFO:tasks.workunit.client.0.smithi037.stdout:9/402: dread - d1/d5/d19/f50 zero size 2024-04-25T17:19:02.479 INFO:tasks.workunit.client.0.smithi037.stdout:1/289: creat dc/f62 x:0 0 0 2024-04-25T17:19:02.479 INFO:tasks.workunit.client.0.smithi037.stdout:5/322: fdatasync d7/ff 0 2024-04-25T17:19:02.524 INFO:tasks.workunit.client.0.smithi037.stdout:1/290: rename dc/d1c/c1e to dc/d18/c63 0 2024-04-25T17:19:02.525 INFO:tasks.workunit.client.0.smithi037.stdout:5/323: chown d7/d12/c4c 1415 1 2024-04-25T17:19:02.527 INFO:tasks.workunit.client.0.smithi037.stdout:5/324: creat d7/d12/f60 x:0 0 0 2024-04-25T17:19:02.534 INFO:tasks.workunit.client.0.smithi037.stdout:9/403: write d1/d48/d68/d26/f80 [9050016,21706] 0 2024-04-25T17:19:02.536 INFO:tasks.workunit.client.0.smithi037.stdout:9/404: creat d1/d48/d68/d26/d81/f87 x:0 0 0 2024-04-25T17:19:02.543 INFO:tasks.workunit.client.0.smithi037.stdout:5/325: dread d7/d25/d4f/f34 [0,4194304] 0 2024-04-25T17:19:02.543 INFO:tasks.workunit.client.0.smithi037.stdout:9/405: dwrite d1/d5/dc/f5e [0,4194304] 0 2024-04-25T17:19:02.545 INFO:tasks.workunit.client.0.smithi037.stdout:5/326: dread - d7/f11 zero size 2024-04-25T17:19:02.545 INFO:tasks.workunit.client.0.smithi037.stdout:9/406: chown d1/d5/dc/d38/d3d/d3f/c70 409455051 1 2024-04-25T17:19:02.545 INFO:tasks.workunit.client.0.smithi037.stdout:9/407: write d1/f9 [3925994,81523] 0 2024-04-25T17:19:02.549 INFO:tasks.workunit.client.0.smithi037.stdout:5/327: creat d7/d12/d5d/f61 x:0 0 0 2024-04-25T17:19:02.549 INFO:tasks.workunit.client.0.smithi037.stdout:9/408: mknod d1/d5/d19/d6e/c88 0 2024-04-25T17:19:02.551 INFO:tasks.workunit.client.0.smithi037.stdout:9/409: read d1/d48/d68/f7e [818657,90374] 0 2024-04-25T17:19:02.556 INFO:tasks.workunit.client.0.smithi037.stdout:9/410: rename d1/d5/d19/f6c to d1/d5/d2e/d34/f89 0 2024-04-25T17:19:02.559 INFO:tasks.workunit.client.0.smithi037.stdout:9/411: rename d1/d5/l40 to d1/d5/d2e/d34/d76/l8a 0 2024-04-25T17:19:02.560 INFO:tasks.workunit.client.0.smithi037.stdout:9/412: dread - d1/d5/dc/d38/f3a zero size 2024-04-25T17:19:02.563 INFO:tasks.workunit.client.0.smithi037.stdout:9/413: dread d1/d5/dc/f29 [4194304,4194304] 0 2024-04-25T17:19:02.567 INFO:tasks.workunit.client.0.smithi037.stdout:9/414: rename d1/d5/dc/d38/d3d/d3f to d1/d5/dc/d38/d8b 0 2024-04-25T17:19:02.568 INFO:tasks.workunit.client.0.smithi037.stdout:9/415: write d1/d48/d68/f74 [479842,89747] 0 2024-04-25T17:19:02.568 INFO:tasks.workunit.client.0.smithi037.stdout:5/328: dread d7/d25/f39 [0,4194304] 0 2024-04-25T17:19:02.569 INFO:tasks.workunit.client.0.smithi037.stdout:9/416: fsync d1/d48/d68/d26/f80 0 2024-04-25T17:19:02.571 INFO:tasks.workunit.client.0.smithi037.stdout:9/417: read d1/d48/d68/f5a [1870306,22968] 0 2024-04-25T17:19:02.573 INFO:tasks.workunit.client.0.smithi037.stdout:5/329: mkdir d7/d18/d62 0 2024-04-25T17:19:02.573 INFO:tasks.workunit.client.0.smithi037.stdout:5/330: write f6 [5328083,117395] 0 2024-04-25T17:19:02.576 INFO:tasks.workunit.client.0.smithi037.stdout:9/418: link d1/d5/dc/d3c/d3e/f59 d1/d5/d2e/d34/d76/f8c 0 2024-04-25T17:19:02.577 INFO:tasks.workunit.client.0.smithi037.stdout:5/331: mkdir d7/d63 0 2024-04-25T17:19:02.578 INFO:tasks.workunit.client.0.smithi037.stdout:9/419: truncate d1/d5/d19/d6e/f79 52294 0 2024-04-25T17:19:02.584 INFO:tasks.workunit.client.0.smithi037.stdout:9/420: dwrite d1/d5/dc/f7d [0,4194304] 0 2024-04-25T17:19:02.585 INFO:tasks.workunit.client.0.smithi037.stdout:9/421: read d1/fd [516377,24353] 0 2024-04-25T17:19:02.590 INFO:tasks.workunit.client.0.smithi037.stdout:9/422: creat d1/d5/d2e/d34/f8d x:0 0 0 2024-04-25T17:19:02.590 INFO:tasks.workunit.client.0.smithi037.stdout:5/332: dwrite d7/d12/f5e [0,4194304] 0 2024-04-25T17:19:02.593 INFO:tasks.workunit.client.0.smithi037.stdout:9/423: unlink d1/d5/c36 0 2024-04-25T17:19:02.595 INFO:tasks.workunit.client.1.smithi069.stdout:0/3: sync 2024-04-25T17:19:02.595 INFO:tasks.workunit.client.0.smithi037.stdout:5/333: getdents d7/d18 0 2024-04-25T17:19:02.598 INFO:tasks.workunit.client.0.smithi037.stdout:9/424: dread d1/d48/d68/f7e [4194304,4194304] 0 2024-04-25T17:19:02.599 INFO:tasks.workunit.client.1.smithi069.stdout:0/4: creat d0/f1 x:0 0 0 2024-04-25T17:19:02.599 INFO:tasks.workunit.client.1.smithi069.stdout:0/5: dread - d0/f1 zero size 2024-04-25T17:19:02.599 INFO:tasks.workunit.client.0.smithi037.stdout:5/334: creat d7/d18/f64 x:0 0 0 2024-04-25T17:19:02.599 INFO:tasks.workunit.client.1.smithi069.stdout:0/6: rename d0 to d0/d2 22 2024-04-25T17:19:02.600 INFO:tasks.workunit.client.0.smithi037.stdout:9/425: stat d1/d5/dc/d3c/d3e/f59 0 2024-04-25T17:19:02.600 INFO:tasks.workunit.client.1.smithi069.stdout:0/7: write d0/f1 [302267,103150] 0 2024-04-25T17:19:02.602 INFO:tasks.workunit.client.0.smithi037.stdout:9/426: symlink d1/d48/d68/d4e/l8e 0 2024-04-25T17:19:02.603 INFO:tasks.workunit.client.1.smithi069.stdout:0/8: creat d0/f3 x:0 0 0 2024-04-25T17:19:02.604 INFO:tasks.workunit.client.0.smithi037.stdout:9/427: write d1/d5/d2e/f75 [3716183,99125] 0 2024-04-25T17:19:02.606 INFO:tasks.workunit.client.1.smithi069.stdout:0/9: link d0/f3 d0/f4 0 2024-04-25T17:19:02.606 INFO:tasks.workunit.client.0.smithi037.stdout:5/335: dwrite d7/d43/f47 [4194304,4194304] 0 2024-04-25T17:19:02.607 INFO:tasks.workunit.client.0.smithi037.stdout:9/428: creat d1/d5/d19/d6e/f8f x:0 0 0 2024-04-25T17:19:02.610 INFO:tasks.workunit.client.0.smithi037.stdout:5/336: readlink d7/d12/l27 0 2024-04-25T17:19:02.612 INFO:tasks.workunit.client.0.smithi037.stdout:5/337: truncate d7/d12/f4d 431667 0 2024-04-25T17:19:02.612 INFO:tasks.workunit.client.0.smithi037.stdout:9/429: symlink d1/d48/l90 0 2024-04-25T17:19:02.613 INFO:tasks.workunit.client.0.smithi037.stdout:9/430: fsync d1/d5/dc/d3c/d3e/f42 0 2024-04-25T17:19:02.613 INFO:tasks.workunit.client.0.smithi037.stdout:5/338: creat d7/d25/f65 x:0 0 0 2024-04-25T17:19:02.615 INFO:tasks.workunit.client.1.smithi069.stdout:0/10: dwrite d0/f1 [0,4194304] 0 2024-04-25T17:19:02.615 INFO:tasks.workunit.client.1.smithi069.stdout:0/11: dread - d0/f4 zero size 2024-04-25T17:19:02.618 INFO:tasks.workunit.client.0.smithi037.stdout:5/339: dread d7/d25/d4f/f34 [0,4194304] 0 2024-04-25T17:19:02.619 INFO:tasks.workunit.client.0.smithi037.stdout:9/431: link d1/d5/dc/f29 d1/d48/d68/d1c/f91 0 2024-04-25T17:19:02.620 INFO:tasks.workunit.client.0.smithi037.stdout:9/432: stat d1/c2f 0 2024-04-25T17:19:02.626 INFO:tasks.workunit.client.0.smithi037.stdout:9/433: dread d1/d48/d68/f5a [0,4194304] 0 2024-04-25T17:19:02.626 INFO:tasks.workunit.client.1.smithi069.stdout:0/12: dwrite d0/f3 [0,4194304] 0 2024-04-25T17:19:02.627 INFO:tasks.workunit.client.0.smithi037.stdout:5/340: rename d7/d43/d41 to d7/d18/d66 0 2024-04-25T17:19:02.630 INFO:tasks.workunit.client.0.smithi037.stdout:9/434: symlink d1/d48/d68/d26/d81/l92 0 2024-04-25T17:19:02.631 INFO:tasks.workunit.client.0.smithi037.stdout:9/435: read d1/d5/dc/f7d [1496323,13863] 0 2024-04-25T17:19:02.632 INFO:tasks.workunit.client.1.smithi069.stdout:0/13: rename d0/f3 to d0/f5 0 2024-04-25T17:19:02.633 INFO:tasks.workunit.client.0.smithi037.stdout:5/341: write d7/f56 [876166,78904] 0 2024-04-25T17:19:02.634 INFO:tasks.workunit.client.0.smithi037.stdout:5/342: stat d7/d43 0 2024-04-25T17:19:02.635 INFO:tasks.workunit.client.0.smithi037.stdout:5/343: read - d7/d25/f4b zero size 2024-04-25T17:19:02.636 INFO:tasks.workunit.client.1.smithi069.stdout:0/14: creat d0/f6 x:0 0 0 2024-04-25T17:19:02.636 INFO:tasks.workunit.client.1.smithi069.stdout:0/15: chown d0/f1 466500 1 2024-04-25T17:19:02.637 INFO:tasks.workunit.client.0.smithi037.stdout:9/436: rename d1/d5/dc/d38/c44 to d1/d5/c93 0 2024-04-25T17:19:02.638 INFO:tasks.workunit.client.0.smithi037.stdout:9/437: chown d1/d48/d68/c7a 436554291 1 2024-04-25T17:19:02.639 INFO:tasks.workunit.client.0.smithi037.stdout:5/344: write d7/d25/f39 [4747712,75533] 0 2024-04-25T17:19:02.640 INFO:tasks.workunit.client.1.smithi069.stdout:0/16: dread d0/f4 [0,4194304] 0 2024-04-25T17:19:02.643 INFO:tasks.workunit.client.1.smithi069.stdout:0/17: mknod d0/c7 0 2024-04-25T17:19:02.647 INFO:tasks.workunit.client.0.smithi037.stdout:5/345: dwrite d7/f33 [4194304,4194304] 0 2024-04-25T17:19:02.651 INFO:tasks.workunit.client.1.smithi069.stdout:0/18: rename d0/f5 to d0/f8 0 2024-04-25T17:19:02.651 INFO:tasks.workunit.client.1.smithi069.stdout:0/19: rename d0 to d0/d9 22 2024-04-25T17:19:02.659 INFO:tasks.workunit.client.0.smithi037.stdout:9/438: dread d1/d48/d68/d26/d81/f86 [0,4194304] 0 2024-04-25T17:19:02.659 INFO:tasks.workunit.client.0.smithi037.stdout:9/439: readlink d1/d5/d19/l43 0 2024-04-25T17:19:02.660 INFO:tasks.workunit.client.0.smithi037.stdout:9/440: fsync d1/d48/d68/f74 0 2024-04-25T17:19:02.662 INFO:tasks.workunit.client.1.smithi069.stdout:1/11: sync 2024-04-25T17:19:02.662 INFO:tasks.workunit.client.1.smithi069.stdout:7/4: sync 2024-04-25T17:19:02.662 INFO:tasks.workunit.client.1.smithi069.stdout:7/5: rmdir - no directory 2024-04-25T17:19:02.662 INFO:tasks.workunit.client.1.smithi069.stdout:7/6: truncate - no filename 2024-04-25T17:19:02.662 INFO:tasks.workunit.client.1.smithi069.stdout:7/7: truncate - no filename 2024-04-25T17:19:02.662 INFO:tasks.workunit.client.1.smithi069.stdout:7/8: dwrite - no filename 2024-04-25T17:19:02.663 INFO:tasks.workunit.client.1.smithi069.stdout:1/12: read f0 [183654,97659] 0 2024-04-25T17:19:02.664 INFO:tasks.workunit.client.1.smithi069.stdout:1/13: read f0 [77843,128283] 0 2024-04-25T17:19:02.666 INFO:tasks.workunit.client.1.smithi069.stdout:1/14: dread f0 [0,4194304] 0 2024-04-25T17:19:02.666 INFO:tasks.workunit.client.1.smithi069.stdout:1/15: fsync f0 0 2024-04-25T17:19:02.666 INFO:tasks.workunit.client.1.smithi069.stdout:1/16: chown d1 830 1 2024-04-25T17:19:02.703 INFO:tasks.workunit.client.1.smithi069.stdout:9/63: sync 2024-04-25T17:19:02.703 INFO:tasks.workunit.client.1.smithi069.stdout:8/28: sync 2024-04-25T17:19:02.703 INFO:tasks.workunit.client.1.smithi069.stdout:4/6: sync 2024-04-25T17:19:02.703 INFO:tasks.workunit.client.1.smithi069.stdout:5/17: sync 2024-04-25T17:19:02.703 INFO:tasks.workunit.client.1.smithi069.stdout:3/59: sync 2024-04-25T17:19:02.703 INFO:tasks.workunit.client.1.smithi069.stdout:2/18: sync 2024-04-25T17:19:02.703 INFO:tasks.workunit.client.1.smithi069.stdout:6/20: sync 2024-04-25T17:19:02.704 INFO:tasks.workunit.client.1.smithi069.stdout:2/19: stat d0 0 2024-04-25T17:19:02.705 INFO:tasks.workunit.client.1.smithi069.stdout:9/64: truncate d2/da/d14/f18 815519 0 2024-04-25T17:19:02.710 INFO:tasks.workunit.client.0.smithi037.stdout:6/303: sync 2024-04-25T17:19:02.738 INFO:tasks.workunit.client.1.smithi069.stdout:0/20: write d0/f4 [907371,6971] 0 2024-04-25T17:19:02.741 INFO:tasks.workunit.client.0.smithi037.stdout:9/441: symlink d1/d5/dc/d38/l94 0 2024-04-25T17:19:02.742 INFO:tasks.workunit.client.0.smithi037.stdout:9/442: fdatasync d1/f9 0 2024-04-25T17:19:02.744 INFO:tasks.workunit.client.1.smithi069.stdout:0/21: dwrite d0/f1 [0,4194304] 0 2024-04-25T17:19:02.744 INFO:tasks.workunit.client.1.smithi069.stdout:0/22: write d0/f6 [4095,48344] 0 2024-04-25T17:19:02.747 INFO:tasks.workunit.client.1.smithi069.stdout:4/7: unlink d1/f2 0 2024-04-25T17:19:02.749 INFO:tasks.workunit.client.1.smithi069.stdout:5/18: mknod c4 0 2024-04-25T17:19:02.750 INFO:tasks.workunit.client.1.smithi069.stdout:5/19: read f0 [2854575,120473] 0 2024-04-25T17:19:02.751 INFO:tasks.workunit.client.1.smithi069.stdout:6/21: mknod d2/c6 0 2024-04-25T17:19:02.751 INFO:tasks.workunit.client.1.smithi069.stdout:5/20: write f0 [483429,53297] 0 2024-04-25T17:19:02.753 INFO:tasks.workunit.client.0.smithi037.stdout:6/304: creat db/d26/d2e/d3e/d25/f6c x:0 0 0 2024-04-25T17:19:02.753 INFO:tasks.workunit.client.0.smithi037.stdout:6/305: stat db/f16 0 2024-04-25T17:19:02.754 INFO:tasks.workunit.client.1.smithi069.stdout:3/60: truncate d8/fc 426600 0 2024-04-25T17:19:02.754 INFO:tasks.workunit.client.1.smithi069.stdout:4/8: dwrite f0 [0,4194304] 0 2024-04-25T17:19:02.755 INFO:tasks.workunit.client.0.smithi037.stdout:5/346: link d7/d12/c1d d7/d43/c67 0 2024-04-25T17:19:02.755 INFO:tasks.workunit.client.0.smithi037.stdout:6/306: write db/f56 [4129098,11934] 0 2024-04-25T17:19:02.755 INFO:tasks.workunit.client.1.smithi069.stdout:4/9: write f0 [2274395,57120] 0 2024-04-25T17:19:02.756 INFO:tasks.workunit.client.1.smithi069.stdout:9/65: mkdir d2/da/dd/d1e 0 2024-04-25T17:19:02.757 INFO:tasks.workunit.client.1.smithi069.stdout:5/21: dread f0 [0,4194304] 0 2024-04-25T17:19:02.759 INFO:tasks.workunit.client.0.smithi037.stdout:9/443: creat d1/d5/dc/d38/d8b/f95 x:0 0 0 2024-04-25T17:19:02.760 INFO:tasks.workunit.client.0.smithi037.stdout:9/444: write d1/d48/d68/d26/f80 [4075174,21051] 0 2024-04-25T17:19:02.762 INFO:tasks.workunit.client.1.smithi069.stdout:1/17: creat d1/f2 x:0 0 0 2024-04-25T17:19:02.762 INFO:tasks.workunit.client.0.smithi037.stdout:6/307: dread - db/f16 zero size 2024-04-25T17:19:02.764 INFO:tasks.workunit.client.0.smithi037.stdout:5/347: mkdir d7/d18/d66/d68 0 2024-04-25T17:19:02.766 INFO:tasks.workunit.client.0.smithi037.stdout:9/445: symlink d1/d5/dc/l96 0 2024-04-25T17:19:02.767 INFO:tasks.workunit.client.1.smithi069.stdout:0/23: mkdir d0/da 0 2024-04-25T17:19:02.768 INFO:tasks.workunit.client.1.smithi069.stdout:0/24: write d0/f8 [4035809,62440] 0 2024-04-25T17:19:02.769 INFO:tasks.workunit.client.0.smithi037.stdout:5/348: symlink d7/d43/l69 0 2024-04-25T17:19:02.772 INFO:tasks.workunit.client.0.smithi037.stdout:9/446: fdatasync d1/d48/d68/d4e/f67 0 2024-04-25T17:19:02.774 INFO:tasks.workunit.client.1.smithi069.stdout:2/20: mknod d0/d3/c5 0 2024-04-25T17:19:02.774 INFO:tasks.workunit.client.1.smithi069.stdout:6/22: mkdir d2/d7 0 2024-04-25T17:19:02.774 INFO:tasks.workunit.client.1.smithi069.stdout:6/23: fdatasync f1 0 2024-04-25T17:19:02.782 INFO:tasks.workunit.client.0.smithi037.stdout:9/447: creat d1/d48/d68/d26/d81/f97 x:0 0 0 2024-04-25T17:19:02.783 INFO:tasks.workunit.client.0.smithi037.stdout:9/448: truncate d1/ff 4493709 0 2024-04-25T17:19:02.785 INFO:tasks.workunit.client.0.smithi037.stdout:6/308: creat db/d1d/d20/f6d x:0 0 0 2024-04-25T17:19:02.786 INFO:tasks.workunit.client.0.smithi037.stdout:6/309: write db/d26/d2e/d3e/f2c [174002,128372] 0 2024-04-25T17:19:02.787 INFO:tasks.workunit.client.0.smithi037.stdout:6/310: readlink db/d1d/d20/l28 0 2024-04-25T17:19:02.787 INFO:tasks.workunit.client.0.smithi037.stdout:6/311: read - db/d1d/d20/f6d zero size 2024-04-25T17:19:02.789 INFO:tasks.workunit.client.0.smithi037.stdout:6/312: dread - db/d26/d2e/d3e/f47 zero size 2024-04-25T17:19:02.790 INFO:tasks.workunit.client.0.smithi037.stdout:9/449: creat d1/d5/f98 x:0 0 0 2024-04-25T17:19:02.790 INFO:tasks.workunit.client.1.smithi069.stdout:7/9: link l0 l1 0 2024-04-25T17:19:02.791 INFO:tasks.workunit.client.0.smithi037.stdout:5/349: creat d7/d18/d62/f6a x:0 0 0 2024-04-25T17:19:02.793 INFO:tasks.workunit.client.1.smithi069.stdout:1/18: creat d1/f3 x:0 0 0 2024-04-25T17:19:02.793 INFO:tasks.workunit.client.1.smithi069.stdout:1/19: write d1/f2 [1039349,28292] 0 2024-04-25T17:19:02.795 INFO:tasks.workunit.client.0.smithi037.stdout:6/313: creat db/d1d/d20/d2f/f6e x:0 0 0 2024-04-25T17:19:02.796 INFO:tasks.workunit.client.1.smithi069.stdout:8/29: creat f8 x:0 0 0 2024-04-25T17:19:02.797 INFO:tasks.workunit.client.0.smithi037.stdout:9/450: write d1/d5/dc/f47 [310594,52572] 0 2024-04-25T17:19:02.800 INFO:tasks.workunit.client.1.smithi069.stdout:1/20: dwrite d1/f3 [0,4194304] 0 2024-04-25T17:19:02.800 INFO:tasks.workunit.client.0.smithi037.stdout:6/314: write db/d1d/d20/f3a [4414556,12355] 0 2024-04-25T17:19:02.803 INFO:tasks.workunit.client.0.smithi037.stdout:6/315: creat db/d26/d2e/d3e/f6f x:0 0 0 2024-04-25T17:19:02.808 INFO:tasks.workunit.client.0.smithi037.stdout:6/316: symlink db/d26/l70 0 2024-04-25T17:19:02.812 INFO:tasks.workunit.client.0.smithi037.stdout:6/317: creat db/d1d/d20/d63/d65/f71 x:0 0 0 2024-04-25T17:19:02.812 INFO:tasks.workunit.client.0.smithi037.stdout:6/318: truncate db/f1c 1857972 0 2024-04-25T17:19:02.813 INFO:tasks.workunit.client.0.smithi037.stdout:6/319: dread - db/d1d/d20/d63/d65/d68/f69 zero size 2024-04-25T17:19:02.821 INFO:tasks.workunit.client.0.smithi037.stdout:5/350: dwrite d7/d43/f30 [0,4194304] 0 2024-04-25T17:19:02.825 INFO:tasks.workunit.client.0.smithi037.stdout:5/351: creat d7/d18/d62/f6b x:0 0 0 2024-04-25T17:19:02.827 INFO:tasks.workunit.client.0.smithi037.stdout:5/352: mknod d7/d43/c6c 0 2024-04-25T17:19:02.845 INFO:tasks.workunit.client.0.smithi037.stdout:6/320: dread db/f1b [0,4194304] 0 2024-04-25T17:19:02.847 INFO:tasks.workunit.client.0.smithi037.stdout:6/321: mknod db/d26/d2e/d3e/d25/d61/c72 0 2024-04-25T17:19:02.852 INFO:tasks.workunit.client.0.smithi037.stdout:5/353: dread d7/d18/f22 [0,4194304] 0 2024-04-25T17:19:02.855 INFO:tasks.workunit.client.0.smithi037.stdout:5/354: mkdir d7/d63/d6d 0 2024-04-25T17:19:02.857 INFO:tasks.workunit.client.0.smithi037.stdout:5/355: symlink d7/d63/l6e 0 2024-04-25T17:19:02.861 INFO:tasks.workunit.client.0.smithi037.stdout:5/356: rename d7/d18/d66 to d7/d12/d6f 0 2024-04-25T17:19:02.865 INFO:tasks.workunit.client.0.smithi037.stdout:5/357: dwrite d7/d43/f47 [0,4194304] 0 2024-04-25T17:19:02.866 INFO:tasks.workunit.client.1.smithi069.stdout:2/21: rename d0/d3/c5 to d0/d3/c6 0 2024-04-25T17:19:02.866 INFO:tasks.workunit.client.1.smithi069.stdout:2/22: truncate - no filename 2024-04-25T17:19:02.867 INFO:tasks.workunit.client.1.smithi069.stdout:9/66: mknod d2/da/dd/d1e/c1f 0 2024-04-25T17:19:02.869 INFO:tasks.workunit.client.1.smithi069.stdout:5/22: link f0 f5 0 2024-04-25T17:19:02.870 INFO:tasks.workunit.client.0.smithi037.stdout:5/358: symlink d7/d43/l70 0 2024-04-25T17:19:02.873 INFO:tasks.workunit.client.1.smithi069.stdout:5/23: dread f5 [0,4194304] 0 2024-04-25T17:19:02.875 INFO:tasks.workunit.client.1.smithi069.stdout:1/21: mkdir d1/d4 0 2024-04-25T17:19:02.876 INFO:tasks.workunit.client.1.smithi069.stdout:0/25: mkdir d0/da/db 0 2024-04-25T17:19:02.876 INFO:tasks.workunit.client.0.smithi037.stdout:5/359: dwrite d7/d43/f47 [4194304,4194304] 0 2024-04-25T17:19:02.877 INFO:tasks.workunit.client.1.smithi069.stdout:0/26: chown d0/f8 118287163 1 2024-04-25T17:19:02.878 INFO:tasks.workunit.client.1.smithi069.stdout:6/24: creat d2/d7/f8 x:0 0 0 2024-04-25T17:19:02.882 INFO:tasks.workunit.client.1.smithi069.stdout:2/23: creat d0/f7 x:0 0 0 2024-04-25T17:19:02.882 INFO:tasks.workunit.client.1.smithi069.stdout:2/24: chown d0/d3 3145300 1 2024-04-25T17:19:02.882 INFO:tasks.workunit.client.1.smithi069.stdout:3/61: write d8/f12 [1095568,18346] 0 2024-04-25T17:19:02.883 INFO:tasks.workunit.client.0.smithi037.stdout:5/360: write d7/d25/f4b [815289,258] 0 2024-04-25T17:19:02.885 INFO:tasks.workunit.client.1.smithi069.stdout:4/10: rmdir d1 0 2024-04-25T17:19:02.887 INFO:tasks.workunit.client.1.smithi069.stdout:9/67: rename d2/da/dd/f1b to d2/da/f20 0 2024-04-25T17:19:02.889 INFO:tasks.workunit.client.1.smithi069.stdout:4/11: dread f0 [0,4194304] 0 2024-04-25T17:19:02.889 INFO:tasks.workunit.client.1.smithi069.stdout:4/12: stat f0 0 2024-04-25T17:19:02.889 INFO:tasks.workunit.client.1.smithi069.stdout:4/13: write f0 [660647,73247] 0 2024-04-25T17:19:02.890 INFO:tasks.workunit.client.1.smithi069.stdout:4/14: write f0 [3681818,39960] 0 2024-04-25T17:19:02.891 INFO:tasks.workunit.client.1.smithi069.stdout:7/10: rename l1 to l2 0 2024-04-25T17:19:02.895 INFO:tasks.workunit.client.0.smithi037.stdout:5/361: rmdir d7/d63/d6d 0 2024-04-25T17:19:02.896 INFO:tasks.workunit.client.1.smithi069.stdout:5/24: creat f6 x:0 0 0 2024-04-25T17:19:02.897 INFO:tasks.workunit.client.1.smithi069.stdout:4/15: dwrite f0 [0,4194304] 0 2024-04-25T17:19:02.897 INFO:tasks.workunit.client.1.smithi069.stdout:5/25: chown f6 1541081 1 2024-04-25T17:19:02.898 INFO:tasks.workunit.client.0.smithi037.stdout:5/362: symlink d7/d18/d62/l71 0 2024-04-25T17:19:02.902 INFO:tasks.workunit.client.1.smithi069.stdout:6/25: creat d2/f9 x:0 0 0 2024-04-25T17:19:02.904 INFO:tasks.workunit.client.1.smithi069.stdout:6/26: write d2/d7/f8 [952729,99277] 0 2024-04-25T17:19:02.904 INFO:tasks.workunit.client.1.smithi069.stdout:2/25: mkdir d0/d8 0 2024-04-25T17:19:02.905 INFO:tasks.workunit.client.1.smithi069.stdout:2/26: chown d0/d8 221364763 1 2024-04-25T17:19:02.906 INFO:tasks.workunit.client.0.smithi037.stdout:5/363: write d7/d12/f35 [344739,65684] 0 2024-04-25T17:19:02.906 INFO:tasks.workunit.client.1.smithi069.stdout:2/27: write d0/f7 [1426,113535] 0 2024-04-25T17:19:02.907 INFO:tasks.workunit.client.1.smithi069.stdout:3/62: symlink d8/l14 0 2024-04-25T17:19:02.910 INFO:tasks.workunit.client.1.smithi069.stdout:6/27: dread f1 [0,4194304] 0 2024-04-25T17:19:02.910 INFO:tasks.workunit.client.1.smithi069.stdout:5/26: dread f1 [0,4194304] 0 2024-04-25T17:19:02.911 INFO:tasks.workunit.client.0.smithi037.stdout:5/364: rename d7/d43/l69 to d7/d43/l72 0 2024-04-25T17:19:02.911 INFO:tasks.workunit.client.0.smithi037.stdout:5/365: stat d7/d43/c3e 0 2024-04-25T17:19:02.915 INFO:tasks.workunit.client.1.smithi069.stdout:7/11: symlink l3 0 2024-04-25T17:19:02.915 INFO:tasks.workunit.client.1.smithi069.stdout:7/12: dread - no filename 2024-04-25T17:19:02.915 INFO:tasks.workunit.client.1.smithi069.stdout:7/13: fsync - no filename 2024-04-25T17:19:02.915 INFO:tasks.workunit.client.1.smithi069.stdout:7/14: rmdir - no directory 2024-04-25T17:19:02.915 INFO:tasks.workunit.client.1.smithi069.stdout:4/16: fsync f0 0 2024-04-25T17:19:02.917 INFO:tasks.workunit.client.1.smithi069.stdout:1/22: link d1/f2 d1/f5 0 2024-04-25T17:19:02.918 INFO:tasks.workunit.client.1.smithi069.stdout:4/17: dread f0 [0,4194304] 0 2024-04-25T17:19:02.918 INFO:tasks.workunit.client.1.smithi069.stdout:1/23: write f0 [676000,10980] 0 2024-04-25T17:19:02.919 INFO:tasks.workunit.client.0.smithi037.stdout:5/366: fsync d7/d25/f37 0 2024-04-25T17:19:02.921 INFO:tasks.workunit.client.1.smithi069.stdout:4/18: dread f0 [0,4194304] 0 2024-04-25T17:19:02.924 INFO:tasks.workunit.client.1.smithi069.stdout:3/63: symlink d8/l15 0 2024-04-25T17:19:02.924 INFO:tasks.workunit.client.1.smithi069.stdout:3/64: dread - d8/f13 zero size 2024-04-25T17:19:02.927 INFO:tasks.workunit.client.1.smithi069.stdout:7/15: mkdir d4 0 2024-04-25T17:19:02.929 INFO:tasks.workunit.client.1.smithi069.stdout:8/30: rename c5 to c9 0 2024-04-25T17:19:02.931 INFO:tasks.workunit.client.1.smithi069.stdout:3/65: dwrite f5 [0,4194304] 0 2024-04-25T17:19:02.935 INFO:tasks.workunit.client.1.smithi069.stdout:1/24: mkdir d1/d4/d6 0 2024-04-25T17:19:02.936 INFO:tasks.workunit.client.1.smithi069.stdout:3/66: mkdir d8/d16 0 2024-04-25T17:19:02.937 INFO:tasks.workunit.client.1.smithi069.stdout:8/31: mknod ca 0 2024-04-25T17:19:02.938 INFO:tasks.workunit.client.1.smithi069.stdout:4/19: dwrite f0 [0,4194304] 0 2024-04-25T17:19:02.943 INFO:tasks.workunit.client.1.smithi069.stdout:8/32: creat fb x:0 0 0 2024-04-25T17:19:02.948 INFO:tasks.workunit.client.1.smithi069.stdout:8/33: symlink lc 0 2024-04-25T17:19:02.950 INFO:tasks.workunit.client.1.smithi069.stdout:3/67: dwrite d8/f11 [0,4194304] 0 2024-04-25T17:19:02.952 INFO:tasks.workunit.client.1.smithi069.stdout:8/34: fsync f3 0 2024-04-25T17:19:02.953 INFO:tasks.workunit.client.1.smithi069.stdout:4/20: dwrite f0 [0,4194304] 0 2024-04-25T17:19:02.953 INFO:tasks.workunit.client.1.smithi069.stdout:8/35: write fb [903834,77962] 0 2024-04-25T17:19:02.956 INFO:tasks.workunit.client.1.smithi069.stdout:7/16: readlink l2 0 2024-04-25T17:19:02.960 INFO:tasks.workunit.client.1.smithi069.stdout:7/17: unlink l3 0 2024-04-25T17:19:02.963 INFO:tasks.workunit.client.1.smithi069.stdout:8/36: link lc ld 0 2024-04-25T17:19:02.963 INFO:tasks.workunit.client.1.smithi069.stdout:3/68: dwrite f7 [4194304,4194304] 0 2024-04-25T17:19:02.965 INFO:tasks.workunit.client.1.smithi069.stdout:7/18: mknod d4/c5 0 2024-04-25T17:19:02.965 INFO:tasks.workunit.client.1.smithi069.stdout:7/19: dwrite - no filename 2024-04-25T17:19:02.969 INFO:tasks.workunit.client.1.smithi069.stdout:7/20: mkdir d4/d6 0 2024-04-25T17:19:02.969 INFO:tasks.workunit.client.1.smithi069.stdout:7/21: dwrite - no filename 2024-04-25T17:19:02.969 INFO:tasks.workunit.client.1.smithi069.stdout:3/69: symlink d8/d16/l17 0 2024-04-25T17:19:02.969 INFO:tasks.workunit.client.1.smithi069.stdout:1/25: truncate d1/f2 617060 0 2024-04-25T17:19:02.974 INFO:tasks.workunit.client.1.smithi069.stdout:1/26: rename f0 to d1/d4/d6/f7 0 2024-04-25T17:19:02.974 INFO:tasks.workunit.client.1.smithi069.stdout:7/22: mknod d4/d6/c7 0 2024-04-25T17:19:02.976 INFO:tasks.workunit.client.1.smithi069.stdout:0/27: truncate d0/f8 320293 0 2024-04-25T17:19:02.978 INFO:tasks.workunit.client.1.smithi069.stdout:1/27: mknod d1/d4/d6/c8 0 2024-04-25T17:19:02.978 INFO:tasks.workunit.client.0.smithi037.stdout:5/367: write d7/f1b [775621,69116] 0 2024-04-25T17:19:02.979 INFO:tasks.workunit.client.1.smithi069.stdout:7/23: symlink d4/l8 0 2024-04-25T17:19:02.980 INFO:tasks.workunit.client.1.smithi069.stdout:3/70: fsync f7 0 2024-04-25T17:19:02.981 INFO:tasks.workunit.client.1.smithi069.stdout:9/68: sync 2024-04-25T17:19:02.984 INFO:tasks.workunit.client.1.smithi069.stdout:7/24: creat d4/d6/f9 x:0 0 0 2024-04-25T17:19:02.984 INFO:tasks.workunit.client.1.smithi069.stdout:5/27: truncate f1 1564482 0 2024-04-25T17:19:02.985 INFO:tasks.workunit.client.1.smithi069.stdout:0/28: chown d0/f8 912 1 2024-04-25T17:19:02.985 INFO:tasks.workunit.client.0.smithi037.stdout:5/368: fdatasync d7/d25/f2b 0 2024-04-25T17:19:02.986 INFO:tasks.workunit.client.1.smithi069.stdout:3/71: creat d8/f18 x:0 0 0 2024-04-25T17:19:02.989 INFO:tasks.workunit.client.1.smithi069.stdout:9/69: dwrite d2/da/f16 [0,4194304] 0 2024-04-25T17:19:02.993 INFO:tasks.workunit.client.1.smithi069.stdout:3/72: unlink d8/l15 0 2024-04-25T17:19:02.996 INFO:tasks.workunit.client.0.smithi037.stdout:5/369: creat d7/f73 x:0 0 0 2024-04-25T17:19:02.997 INFO:tasks.workunit.client.1.smithi069.stdout:5/28: link l2 l7 0 2024-04-25T17:19:02.998 INFO:tasks.workunit.client.0.smithi037.stdout:5/370: truncate d7/d25/f4b 852206 0 2024-04-25T17:19:02.999 INFO:tasks.workunit.client.1.smithi069.stdout:9/70: rename d2/da/dd/de/lf to d2/da/dd/d1e/l21 0 2024-04-25T17:19:03.001 INFO:tasks.workunit.client.0.smithi037.stdout:5/371: creat d7/d43/f74 x:0 0 0 2024-04-25T17:19:03.002 INFO:tasks.workunit.client.1.smithi069.stdout:3/73: rename d8/f10 to d8/f19 0 2024-04-25T17:19:03.004 INFO:tasks.workunit.client.1.smithi069.stdout:1/28: rename d1/f2 to d1/f9 0 2024-04-25T17:19:03.004 INFO:tasks.workunit.client.1.smithi069.stdout:3/74: readlink d8/lb 0 2024-04-25T17:19:03.005 INFO:tasks.workunit.client.1.smithi069.stdout:8/37: dwrite f3 [0,4194304] 0 2024-04-25T17:19:03.007 INFO:tasks.workunit.client.1.smithi069.stdout:8/38: read f3 [84362,23248] 0 2024-04-25T17:19:03.008 INFO:tasks.workunit.client.1.smithi069.stdout:5/29: fdatasync f0 0 2024-04-25T17:19:03.010 INFO:tasks.workunit.client.1.smithi069.stdout:9/71: dwrite d2/da/f10 [0,4194304] 0 2024-04-25T17:19:03.014 INFO:tasks.workunit.client.1.smithi069.stdout:7/25: fsync d4/d6/f9 0 2024-04-25T17:19:03.015 INFO:tasks.workunit.client.0.smithi037.stdout:0/379: sync 2024-04-25T17:19:03.016 INFO:tasks.workunit.client.1.smithi069.stdout:1/29: symlink d1/la 0 2024-04-25T17:19:03.016 INFO:tasks.workunit.client.0.smithi037.stdout:0/380: read d9/d14/f44 [3058620,69923] 0 2024-04-25T17:19:03.019 INFO:tasks.workunit.client.0.smithi037.stdout:5/372: rename d7/f17 to d7/f75 0 2024-04-25T17:19:03.020 INFO:tasks.workunit.client.1.smithi069.stdout:9/72: dwrite d2/da/f10 [0,4194304] 0 2024-04-25T17:19:03.020 INFO:tasks.workunit.client.0.smithi037.stdout:5/373: readlink d7/l55 0 2024-04-25T17:19:03.021 INFO:tasks.workunit.client.1.smithi069.stdout:9/73: truncate d2/da/d14/f19 382868 0 2024-04-25T17:19:03.021 INFO:tasks.workunit.client.1.smithi069.stdout:3/75: mkdir d8/d16/d1a 0 2024-04-25T17:19:03.022 INFO:tasks.workunit.client.1.smithi069.stdout:3/76: read f5 [419104,52270] 0 2024-04-25T17:19:03.025 INFO:tasks.workunit.client.0.smithi037.stdout:0/381: unlink d9/d14/d28/f5a 0 2024-04-25T17:19:03.025 INFO:tasks.workunit.client.0.smithi037.stdout:0/382: stat l3 0 2024-04-25T17:19:03.028 INFO:tasks.workunit.client.0.smithi037.stdout:5/374: rename d7/f11 to d7/d12/d6f/d68/f76 0 2024-04-25T17:19:03.033 INFO:tasks.workunit.client.0.smithi037.stdout:0/383: creat d9/df/d32/d39/f8b x:0 0 0 2024-04-25T17:19:03.034 INFO:tasks.workunit.client.0.smithi037.stdout:0/384: truncate d9/df/d32/f55 4425202 0 2024-04-25T17:19:03.036 INFO:tasks.workunit.client.1.smithi069.stdout:7/26: unlink d4/d6/f9 0 2024-04-25T17:19:03.036 INFO:tasks.workunit.client.1.smithi069.stdout:7/27: truncate - no filename 2024-04-25T17:19:03.036 INFO:tasks.workunit.client.1.smithi069.stdout:7/28: readlink d4/l8 0 2024-04-25T17:19:03.037 INFO:tasks.workunit.client.1.smithi069.stdout:7/29: dread - no filename 2024-04-25T17:19:03.037 INFO:tasks.workunit.client.1.smithi069.stdout:7/30: read - no filename 2024-04-25T17:19:03.037 INFO:tasks.workunit.client.1.smithi069.stdout:7/31: fsync - no filename 2024-04-25T17:19:03.037 INFO:tasks.workunit.client.1.smithi069.stdout:7/32: chown l0 260880745 1 2024-04-25T17:19:03.037 INFO:tasks.workunit.client.1.smithi069.stdout:0/29: truncate d0/f1 2846968 0 2024-04-25T17:19:03.038 INFO:tasks.workunit.client.0.smithi037.stdout:5/375: chown d7/f49 135098624 1 2024-04-25T17:19:03.039 INFO:tasks.workunit.client.1.smithi069.stdout:1/30: fsync d1/d4/d6/f7 0 2024-04-25T17:19:03.040 INFO:tasks.workunit.client.0.smithi037.stdout:0/385: creat d9/d14/d28/f8c x:0 0 0 2024-04-25T17:19:03.041 INFO:tasks.workunit.client.1.smithi069.stdout:9/74: mknod d2/c22 0 2024-04-25T17:19:03.041 INFO:tasks.workunit.client.0.smithi037.stdout:0/386: truncate d9/df/f86 1020824 0 2024-04-25T17:19:03.042 INFO:tasks.workunit.client.0.smithi037.stdout:0/387: dread - d9/df/d32/d39/f64 zero size 2024-04-25T17:19:03.042 INFO:tasks.workunit.client.1.smithi069.stdout:5/30: dwrite f0 [4194304,4194304] 0 2024-04-25T17:19:03.042 INFO:tasks.workunit.client.1.smithi069.stdout:9/75: truncate d2/da/f13 847435 0 2024-04-25T17:19:03.043 INFO:tasks.workunit.client.1.smithi069.stdout:3/77: symlink d8/l1b 0 2024-04-25T17:19:03.043 INFO:tasks.workunit.client.1.smithi069.stdout:5/31: read - f6 zero size 2024-04-25T17:19:03.049 INFO:tasks.workunit.client.1.smithi069.stdout:9/76: dwrite d2/f6 [0,4194304] 0 2024-04-25T17:19:03.049 INFO:tasks.workunit.client.0.smithi037.stdout:5/376: link d7/d25/d4f/f48 d7/d12/f77 0 2024-04-25T17:19:03.049 INFO:tasks.workunit.client.1.smithi069.stdout:9/77: chown d2/f6 15 1 2024-04-25T17:19:03.051 INFO:tasks.workunit.client.1.smithi069.stdout:7/33: creat d4/d6/fa x:0 0 0 2024-04-25T17:19:03.052 INFO:tasks.workunit.client.1.smithi069.stdout:7/34: read - d4/d6/fa zero size 2024-04-25T17:19:03.054 INFO:tasks.workunit.client.1.smithi069.stdout:0/30: creat d0/fc x:0 0 0 2024-04-25T17:19:03.054 INFO:tasks.workunit.client.1.smithi069.stdout:0/31: fdatasync d0/fc 0 2024-04-25T17:19:03.056 INFO:tasks.workunit.client.0.smithi037.stdout:5/377: dread d7/d18/f29 [0,4194304] 0 2024-04-25T17:19:03.061 INFO:tasks.workunit.client.0.smithi037.stdout:5/378: read d7/d12/f19 [566296,70482] 0 2024-04-25T17:19:03.066 INFO:tasks.workunit.client.0.smithi037.stdout:5/379: symlink d7/d43/l78 0 2024-04-25T17:19:03.068 INFO:tasks.workunit.client.0.smithi037.stdout:5/380: symlink d7/d63/l79 0 2024-04-25T17:19:03.072 INFO:tasks.workunit.client.1.smithi069.stdout:3/78: creat d8/f1c x:0 0 0 2024-04-25T17:19:03.073 INFO:tasks.workunit.client.1.smithi069.stdout:9/78: mkdir d2/da/d14/d23 0 2024-04-25T17:19:03.074 INFO:tasks.workunit.client.1.smithi069.stdout:9/79: stat d2/da/dd/d1e 0 2024-04-25T17:19:03.075 INFO:tasks.workunit.client.1.smithi069.stdout:7/35: rename d4/l8 to d4/d6/lb 0 2024-04-25T17:19:03.078 INFO:tasks.workunit.client.0.smithi037.stdout:5/381: creat d7/d18/f7a x:0 0 0 2024-04-25T17:19:03.081 INFO:tasks.workunit.client.1.smithi069.stdout:5/32: dread f1 [0,4194304] 0 2024-04-25T17:19:03.081 INFO:tasks.workunit.client.0.smithi037.stdout:5/382: mknod d7/d12/c7b 0 2024-04-25T17:19:03.083 INFO:tasks.workunit.client.1.smithi069.stdout:9/80: creat d2/f24 x:0 0 0 2024-04-25T17:19:03.083 INFO:tasks.workunit.client.1.smithi069.stdout:9/81: stat d2/l9 0 2024-04-25T17:19:03.084 INFO:tasks.workunit.client.1.smithi069.stdout:3/79: dread f5 [0,4194304] 0 2024-04-25T17:19:03.084 INFO:tasks.workunit.client.1.smithi069.stdout:0/32: symlink d0/da/db/ld 0 2024-04-25T17:19:03.084 INFO:tasks.workunit.client.1.smithi069.stdout:9/82: read d2/da/fc [5044629,119285] 0 2024-04-25T17:19:03.085 INFO:tasks.workunit.client.1.smithi069.stdout:0/33: chown d0/c7 79272 1 2024-04-25T17:19:03.090 INFO:tasks.workunit.client.1.smithi069.stdout:9/83: fsync d2/da/f20 0 2024-04-25T17:19:03.091 INFO:tasks.workunit.client.1.smithi069.stdout:7/36: unlink d4/d6/lb 0 2024-04-25T17:19:03.091 INFO:tasks.workunit.client.1.smithi069.stdout:3/80: dwrite d8/f11 [0,4194304] 0 2024-04-25T17:19:03.093 INFO:tasks.workunit.client.1.smithi069.stdout:9/84: read d2/f8 [6550568,19277] 0 2024-04-25T17:19:03.095 INFO:tasks.workunit.client.1.smithi069.stdout:2/28: sync 2024-04-25T17:19:03.096 INFO:tasks.workunit.client.1.smithi069.stdout:7/37: mknod d4/d6/cc 0 2024-04-25T17:19:03.096 INFO:tasks.workunit.client.1.smithi069.stdout:0/34: link d0/f8 d0/da/db/fe 0 2024-04-25T17:19:03.097 INFO:tasks.workunit.client.1.smithi069.stdout:2/29: fdatasync d0/f7 0 2024-04-25T17:19:03.097 INFO:tasks.workunit.client.1.smithi069.stdout:1/31: dwrite d1/f5 [0,4194304] 0 2024-04-25T17:19:03.097 INFO:tasks.workunit.client.1.smithi069.stdout:3/81: dread f0 [0,4194304] 0 2024-04-25T17:19:03.098 INFO:tasks.workunit.client.1.smithi069.stdout:0/35: fsync d0/fc 0 2024-04-25T17:19:03.099 INFO:tasks.workunit.client.1.smithi069.stdout:5/33: truncate f5 6734203 0 2024-04-25T17:19:03.099 INFO:tasks.workunit.client.1.smithi069.stdout:1/32: fdatasync d1/f3 0 2024-04-25T17:19:03.100 INFO:tasks.workunit.client.1.smithi069.stdout:1/33: chown d1/f3 569 1 2024-04-25T17:19:03.102 INFO:tasks.workunit.client.1.smithi069.stdout:9/85: dread d2/f6 [0,4194304] 0 2024-04-25T17:19:03.103 INFO:tasks.workunit.client.1.smithi069.stdout:7/38: mknod d4/cd 0 2024-04-25T17:19:03.107 INFO:tasks.workunit.client.1.smithi069.stdout:3/82: rename d8/f1c to d8/f1d 0 2024-04-25T17:19:03.109 INFO:tasks.workunit.client.1.smithi069.stdout:9/86: creat d2/da/d14/f25 x:0 0 0 2024-04-25T17:19:03.109 INFO:tasks.workunit.client.1.smithi069.stdout:2/30: symlink d0/d8/l9 0 2024-04-25T17:19:03.110 INFO:tasks.workunit.client.1.smithi069.stdout:1/34: dwrite d1/d4/d6/f7 [0,4194304] 0 2024-04-25T17:19:03.110 INFO:tasks.workunit.client.1.smithi069.stdout:2/31: chown d0/d1 139107 1 2024-04-25T17:19:03.111 INFO:tasks.workunit.client.1.smithi069.stdout:9/87: chown d2/da/dd/de/f12 236728 1 2024-04-25T17:19:03.138 INFO:tasks.workunit.client.1.smithi069.stdout:8/39: sync 2024-04-25T17:19:03.138 INFO:tasks.workunit.client.1.smithi069.stdout:6/28: sync 2024-04-25T17:19:03.138 INFO:tasks.workunit.client.1.smithi069.stdout:4/21: sync 2024-04-25T17:19:03.144 INFO:tasks.workunit.client.1.smithi069.stdout:4/22: chown f0 414244 1 2024-04-25T17:19:03.146 INFO:tasks.workunit.client.1.smithi069.stdout:3/83: creat d8/d16/f1e x:0 0 0 2024-04-25T17:19:03.146 INFO:tasks.workunit.client.1.smithi069.stdout:6/29: truncate f1 4385776 0 2024-04-25T17:19:03.146 INFO:tasks.workunit.client.1.smithi069.stdout:9/88: write d2/da/dd/f11 [2887102,45128] 0 2024-04-25T17:19:03.147 INFO:tasks.workunit.client.1.smithi069.stdout:5/34: write f1 [676534,82063] 0 2024-04-25T17:19:03.148 INFO:tasks.workunit.client.0.smithi037.stdout:3/210: sync 2024-04-25T17:19:03.148 INFO:tasks.workunit.client.1.smithi069.stdout:6/30: readlink d2/l3 0 2024-04-25T17:19:03.149 INFO:tasks.workunit.client.1.smithi069.stdout:0/36: write d0/f4 [494779,23322] 0 2024-04-25T17:19:03.151 INFO:tasks.workunit.client.1.smithi069.stdout:4/23: mknod c3 0 2024-04-25T17:19:03.152 INFO:tasks.workunit.client.0.smithi037.stdout:3/211: rename d8/l1c to d8/d23/d3a/l44 0 2024-04-25T17:19:03.154 INFO:tasks.workunit.client.1.smithi069.stdout:3/84: creat d8/f1f x:0 0 0 2024-04-25T17:19:03.156 INFO:tasks.workunit.client.1.smithi069.stdout:9/89: creat d2/da/dd/d1e/f26 x:0 0 0 2024-04-25T17:19:03.157 INFO:tasks.workunit.client.1.smithi069.stdout:1/35: dread d1/f9 [0,4194304] 0 2024-04-25T17:19:03.159 INFO:tasks.workunit.client.1.smithi069.stdout:3/85: creat d8/f20 x:0 0 0 2024-04-25T17:19:03.161 INFO:tasks.workunit.client.1.smithi069.stdout:0/37: truncate d0/f1 3534107 0 2024-04-25T17:19:03.162 INFO:tasks.workunit.client.0.smithi037.stdout:3/212: write d8/d11/f2b [823186,95872] 0 2024-04-25T17:19:03.165 INFO:tasks.workunit.client.1.smithi069.stdout:3/86: dread - d8/f13 zero size 2024-04-25T17:19:03.165 INFO:tasks.workunit.client.1.smithi069.stdout:2/32: dwrite d0/f7 [0,4194304] 0 2024-04-25T17:19:03.167 INFO:tasks.workunit.client.0.smithi037.stdout:3/213: chown d8/d23/d3a/l44 1095 1 2024-04-25T17:19:03.167 INFO:tasks.workunit.client.1.smithi069.stdout:6/31: truncate f1 2885222 0 2024-04-25T17:19:03.168 INFO:tasks.workunit.client.1.smithi069.stdout:9/90: write d2/da/dd/d1e/f26 [472653,31349] 0 2024-04-25T17:19:03.168 INFO:tasks.workunit.client.1.smithi069.stdout:5/35: dwrite f6 [0,4194304] 0 2024-04-25T17:19:03.169 INFO:tasks.workunit.client.1.smithi069.stdout:1/36: creat d1/d4/fb x:0 0 0 2024-04-25T17:19:03.170 INFO:tasks.workunit.client.0.smithi037.stdout:3/214: creat d8/d23/d3a/f45 x:0 0 0 2024-04-25T17:19:03.171 INFO:tasks.workunit.client.1.smithi069.stdout:0/38: creat d0/ff x:0 0 0 2024-04-25T17:19:03.172 INFO:tasks.workunit.client.1.smithi069.stdout:8/40: dwrite f3 [0,4194304] 0 2024-04-25T17:19:03.172 INFO:tasks.workunit.client.1.smithi069.stdout:3/87: chown d8/d16/l17 111087 1 2024-04-25T17:19:03.175 INFO:tasks.workunit.client.1.smithi069.stdout:4/24: dwrite f0 [0,4194304] 0 2024-04-25T17:19:03.179 INFO:tasks.workunit.client.0.smithi037.stdout:3/215: dwrite d8/d23/f2d [0,4194304] 0 2024-04-25T17:19:03.179 INFO:tasks.workunit.client.1.smithi069.stdout:8/41: write f3 [3695943,130521] 0 2024-04-25T17:19:03.180 INFO:tasks.workunit.client.0.smithi037.stdout:3/216: chown d8/d11/l19 4752134 1 2024-04-25T17:19:03.184 INFO:tasks.workunit.client.1.smithi069.stdout:3/88: creat d8/d16/f21 x:0 0 0 2024-04-25T17:19:03.184 INFO:tasks.workunit.client.1.smithi069.stdout:8/42: chown ca 131692106 1 2024-04-25T17:19:03.185 INFO:tasks.workunit.client.1.smithi069.stdout:9/91: read d2/da/dd/d1e/f26 [360737,50343] 0 2024-04-25T17:19:03.186 INFO:tasks.workunit.client.0.smithi037.stdout:3/217: symlink d8/d31/d32/l46 0 2024-04-25T17:19:03.187 INFO:tasks.workunit.client.1.smithi069.stdout:3/89: rename d8/d16 to d8/d16/d1a/d22 22 2024-04-25T17:19:03.188 INFO:tasks.workunit.client.0.smithi037.stdout:3/218: write d8/f37 [2571596,77907] 0 2024-04-25T17:19:03.188 INFO:tasks.workunit.client.1.smithi069.stdout:5/36: fdatasync f6 0 2024-04-25T17:19:03.189 INFO:tasks.workunit.client.0.smithi037.stdout:3/219: fsync d8/f2c 0 2024-04-25T17:19:03.189 INFO:tasks.workunit.client.1.smithi069.stdout:7/39: sync 2024-04-25T17:19:03.190 INFO:tasks.workunit.client.1.smithi069.stdout:0/39: creat d0/da/f10 x:0 0 0 2024-04-25T17:19:03.192 INFO:tasks.workunit.client.1.smithi069.stdout:1/37: dwrite d1/d4/d6/f7 [0,4194304] 0 2024-04-25T17:19:03.193 INFO:tasks.workunit.client.1.smithi069.stdout:2/33: dwrite d0/f7 [4194304,4194304] 0 2024-04-25T17:19:03.195 INFO:tasks.workunit.client.1.smithi069.stdout:7/40: chown l2 720002 1 2024-04-25T17:19:03.196 INFO:tasks.workunit.client.0.smithi037.stdout:3/220: unlink d8/d11/l13 0 2024-04-25T17:19:03.196 INFO:tasks.workunit.client.1.smithi069.stdout:8/43: readlink ld 0 2024-04-25T17:19:03.197 INFO:tasks.workunit.client.0.smithi037.stdout:3/221: truncate d8/d23/f24 1266678 0 2024-04-25T17:19:03.197 INFO:tasks.workunit.client.1.smithi069.stdout:3/90: write d8/d16/f1e [528754,127302] 0 2024-04-25T17:19:03.198 INFO:tasks.workunit.client.1.smithi069.stdout:1/38: dread - d1/d4/fb zero size 2024-04-25T17:19:03.198 INFO:tasks.workunit.client.1.smithi069.stdout:5/37: symlink l8 0 2024-04-25T17:19:03.201 INFO:tasks.workunit.client.0.smithi037.stdout:3/222: creat d8/d31/f47 x:0 0 0 2024-04-25T17:19:03.201 INFO:tasks.workunit.client.1.smithi069.stdout:0/40: symlink d0/l11 0 2024-04-25T17:19:03.202 INFO:tasks.workunit.client.0.smithi037.stdout:3/223: fdatasync d8/f17 0 2024-04-25T17:19:03.203 INFO:tasks.workunit.client.1.smithi069.stdout:2/34: mknod d0/ca 0 2024-04-25T17:19:03.203 INFO:tasks.workunit.client.1.smithi069.stdout:4/25: fdatasync f0 0 2024-04-25T17:19:03.204 INFO:tasks.workunit.client.1.smithi069.stdout:3/91: write d8/f20 [744087,11817] 0 2024-04-25T17:19:03.205 INFO:tasks.workunit.client.1.smithi069.stdout:7/41: unlink d4/d6/c7 0 2024-04-25T17:19:03.205 INFO:tasks.workunit.client.1.smithi069.stdout:0/41: fsync d0/f4 0 2024-04-25T17:19:03.206 INFO:tasks.workunit.client.0.smithi037.stdout:3/224: creat d8/d31/f48 x:0 0 0 2024-04-25T17:19:03.208 INFO:tasks.workunit.client.1.smithi069.stdout:3/92: readlink d8/l1b 0 2024-04-25T17:19:03.208 INFO:tasks.workunit.client.1.smithi069.stdout:9/92: dwrite d2/da/d14/f18 [0,4194304] 0 2024-04-25T17:19:03.209 INFO:tasks.workunit.client.1.smithi069.stdout:1/39: mkdir d1/dc 0 2024-04-25T17:19:03.210 INFO:tasks.workunit.client.1.smithi069.stdout:5/38: creat f9 x:0 0 0 2024-04-25T17:19:03.210 INFO:tasks.workunit.client.1.smithi069.stdout:0/42: write d0/ff [870192,34493] 0 2024-04-25T17:19:03.211 INFO:tasks.workunit.client.0.smithi037.stdout:3/225: mknod d8/d31/d32/c49 0 2024-04-25T17:19:03.211 INFO:tasks.workunit.client.1.smithi069.stdout:3/93: dread - d8/f13 zero size 2024-04-25T17:19:03.211 INFO:tasks.workunit.client.1.smithi069.stdout:1/40: fdatasync d1/f3 0 2024-04-25T17:19:03.212 INFO:tasks.workunit.client.0.smithi037.stdout:3/226: chown d8/d31/d32/l46 63138749 1 2024-04-25T17:19:03.212 INFO:tasks.workunit.client.1.smithi069.stdout:9/93: chown d2/da/dd/d1e 83 1 2024-04-25T17:19:03.214 INFO:tasks.workunit.client.1.smithi069.stdout:4/26: creat f4 x:0 0 0 2024-04-25T17:19:03.215 INFO:tasks.workunit.client.1.smithi069.stdout:4/27: chown f0 125 1 2024-04-25T17:19:03.215 INFO:tasks.workunit.client.1.smithi069.stdout:8/44: dwrite fb [0,4194304] 0 2024-04-25T17:19:03.216 INFO:tasks.workunit.client.1.smithi069.stdout:7/42: mknod d4/ce 0 2024-04-25T17:19:03.216 INFO:tasks.workunit.client.1.smithi069.stdout:7/43: stat d4/d6/cc 0 2024-04-25T17:19:03.221 INFO:tasks.workunit.client.1.smithi069.stdout:5/39: creat fa x:0 0 0 2024-04-25T17:19:03.222 INFO:tasks.workunit.client.1.smithi069.stdout:1/41: mknod d1/d4/d6/cd 0 2024-04-25T17:19:03.223 INFO:tasks.workunit.client.1.smithi069.stdout:9/94: rmdir d2/da/dd/de 39 2024-04-25T17:19:03.225 INFO:tasks.workunit.client.1.smithi069.stdout:4/28: creat f5 x:0 0 0 2024-04-25T17:19:03.227 INFO:tasks.workunit.client.1.smithi069.stdout:4/29: write f0 [2457761,37624] 0 2024-04-25T17:19:03.229 INFO:tasks.workunit.client.1.smithi069.stdout:7/44: creat d4/d6/ff x:0 0 0 2024-04-25T17:19:03.232 INFO:tasks.workunit.client.1.smithi069.stdout:9/95: dwrite d2/f24 [0,4194304] 0 2024-04-25T17:19:03.233 INFO:tasks.workunit.client.1.smithi069.stdout:9/96: dread - d2/da/f20 zero size 2024-04-25T17:19:03.237 INFO:tasks.workunit.client.1.smithi069.stdout:3/94: link d8/d16/f1e d8/d16/f23 0 2024-04-25T17:19:03.241 INFO:tasks.workunit.client.1.smithi069.stdout:4/30: creat f6 x:0 0 0 2024-04-25T17:19:03.242 INFO:tasks.workunit.client.1.smithi069.stdout:4/31: write f6 [538534,49744] 0 2024-04-25T17:19:03.242 INFO:tasks.workunit.client.1.smithi069.stdout:0/43: truncate d0/f4 199539 0 2024-04-25T17:19:03.244 INFO:tasks.workunit.client.1.smithi069.stdout:7/45: rename d4/d6/ff to d4/f10 0 2024-04-25T17:19:03.246 INFO:tasks.workunit.client.0.smithi037.stdout:3/227: truncate d8/f1f 72080 0 2024-04-25T17:19:03.247 INFO:tasks.workunit.client.1.smithi069.stdout:6/32: truncate f1 3286855 0 2024-04-25T17:19:03.247 INFO:tasks.workunit.client.0.smithi037.stdout:3/228: write d8/d11/f20 [1794094,5780] 0 2024-04-25T17:19:03.248 INFO:tasks.workunit.client.1.smithi069.stdout:6/33: chown d2/d7 175 1 2024-04-25T17:19:03.249 INFO:tasks.workunit.client.1.smithi069.stdout:3/95: mknod d8/c24 0 2024-04-25T17:19:03.249 INFO:tasks.workunit.client.1.smithi069.stdout:1/42: rmdir d1 39 2024-04-25T17:19:03.251 INFO:tasks.workunit.client.1.smithi069.stdout:2/35: link d0/d3/c6 d0/d8/cb 0 2024-04-25T17:19:03.252 INFO:tasks.workunit.client.1.smithi069.stdout:8/45: creat fe x:0 0 0 2024-04-25T17:19:03.253 INFO:tasks.workunit.client.1.smithi069.stdout:4/32: creat f7 x:0 0 0 2024-04-25T17:19:03.254 INFO:tasks.workunit.client.1.smithi069.stdout:7/46: symlink d4/d6/l11 0 2024-04-25T17:19:03.256 INFO:tasks.workunit.client.1.smithi069.stdout:8/46: dread f3 [0,4194304] 0 2024-04-25T17:19:03.257 INFO:tasks.workunit.client.1.smithi069.stdout:8/47: chown fb 239 1 2024-04-25T17:19:03.258 INFO:tasks.workunit.client.1.smithi069.stdout:6/34: creat d2/d7/fa x:0 0 0 2024-04-25T17:19:03.261 INFO:tasks.workunit.client.1.smithi069.stdout:5/40: truncate f1 693795 0 2024-04-25T17:19:03.261 INFO:tasks.workunit.client.1.smithi069.stdout:3/96: symlink d8/l25 0 2024-04-25T17:19:03.263 INFO:tasks.workunit.client.1.smithi069.stdout:2/36: creat d0/d1/fc x:0 0 0 2024-04-25T17:19:03.264 INFO:tasks.workunit.client.1.smithi069.stdout:7/47: dwrite d4/d6/fa [0,4194304] 0 2024-04-25T17:19:03.266 INFO:tasks.workunit.client.1.smithi069.stdout:4/33: creat f8 x:0 0 0 2024-04-25T17:19:03.270 INFO:tasks.workunit.client.1.smithi069.stdout:1/43: mkdir d1/d4/de 0 2024-04-25T17:19:03.270 INFO:tasks.workunit.client.1.smithi069.stdout:1/44: stat d1/dc 0 2024-04-25T17:19:03.272 INFO:tasks.workunit.client.1.smithi069.stdout:3/97: symlink d8/l26 0 2024-04-25T17:19:03.273 INFO:tasks.workunit.client.1.smithi069.stdout:9/97: truncate d2/f24 4028633 0 2024-04-25T17:19:03.274 INFO:tasks.workunit.client.1.smithi069.stdout:2/37: unlink d0/d1/fc 0 2024-04-25T17:19:03.276 INFO:tasks.workunit.client.1.smithi069.stdout:7/48: mkdir d4/d12 0 2024-04-25T17:19:03.279 INFO:tasks.workunit.client.1.smithi069.stdout:4/34: unlink f4 0 2024-04-25T17:19:03.283 INFO:tasks.workunit.client.1.smithi069.stdout:1/45: rename d1/dc to d1/df 0 2024-04-25T17:19:03.284 INFO:tasks.workunit.client.1.smithi069.stdout:1/46: read d1/f9 [2273138,130405] 0 2024-04-25T17:19:03.285 INFO:tasks.workunit.client.1.smithi069.stdout:3/98: rename f0 to d8/d16/f27 0 2024-04-25T17:19:03.285 INFO:tasks.workunit.client.1.smithi069.stdout:6/35: dread f1 [0,4194304] 0 2024-04-25T17:19:03.286 INFO:tasks.workunit.client.1.smithi069.stdout:6/36: truncate d2/f9 220447 0 2024-04-25T17:19:03.287 INFO:tasks.workunit.client.1.smithi069.stdout:7/49: mkdir d4/d6/d13 0 2024-04-25T17:19:03.288 INFO:tasks.workunit.client.1.smithi069.stdout:8/48: creat ff x:0 0 0 2024-04-25T17:19:03.289 INFO:tasks.workunit.client.0.smithi037.stdout:2/316: sync 2024-04-25T17:19:03.289 INFO:tasks.workunit.client.0.smithi037.stdout:4/438: sync 2024-04-25T17:19:03.289 INFO:tasks.workunit.client.0.smithi037.stdout:8/202: sync 2024-04-25T17:19:03.291 INFO:tasks.workunit.client.1.smithi069.stdout:6/37: dread d2/d7/f8 [0,4194304] 0 2024-04-25T17:19:03.295 INFO:tasks.workunit.client.0.smithi037.stdout:2/317: rename d0/lb to d0/d16/d20/d55/l5e 0 2024-04-25T17:19:03.295 INFO:tasks.workunit.client.0.smithi037.stdout:2/318: chown d0/d23 12934200 1 2024-04-25T17:19:03.298 INFO:tasks.workunit.client.1.smithi069.stdout:5/41: dwrite f0 [0,4194304] 0 2024-04-25T17:19:03.298 INFO:tasks.workunit.client.0.smithi037.stdout:4/439: creat d7/d7e/d1e/d2b/d35/d39/d7a/f97 x:0 0 0 2024-04-25T17:19:03.300 INFO:tasks.workunit.client.0.smithi037.stdout:2/319: readlink d0/l27 0 2024-04-25T17:19:03.301 INFO:tasks.workunit.client.0.smithi037.stdout:2/320: read - d0/d16/d3b/f5b zero size 2024-04-25T17:19:03.301 INFO:tasks.workunit.client.1.smithi069.stdout:3/99: creat d8/d16/f28 x:0 0 0 2024-04-25T17:19:03.304 INFO:tasks.workunit.client.1.smithi069.stdout:3/100: dread f6 [0,4194304] 0 2024-04-25T17:19:03.309 INFO:tasks.workunit.client.1.smithi069.stdout:9/98: truncate d2/da/f16 1738442 0 2024-04-25T17:19:03.310 INFO:tasks.workunit.client.0.smithi037.stdout:8/203: getdents d5/db/d18 0 2024-04-25T17:19:03.311 INFO:tasks.workunit.client.1.smithi069.stdout:2/38: truncate d0/f7 2833966 0 2024-04-25T17:19:03.313 INFO:tasks.workunit.client.1.smithi069.stdout:7/50: rename d4/d12 to d4/d6/d14 0 2024-04-25T17:19:03.314 INFO:tasks.workunit.client.0.smithi037.stdout:2/321: rename d0/c3a to d0/d15/d53/c5f 0 2024-04-25T17:19:03.315 INFO:tasks.workunit.client.1.smithi069.stdout:9/99: dwrite d2/da/d14/f25 [0,4194304] 0 2024-04-25T17:19:03.317 INFO:tasks.workunit.client.1.smithi069.stdout:6/38: mknod d2/cb 0 2024-04-25T17:19:03.318 INFO:tasks.workunit.client.0.smithi037.stdout:2/322: creat d0/d16/d20/d55/f60 x:0 0 0 2024-04-25T17:19:03.319 INFO:tasks.workunit.client.1.smithi069.stdout:8/49: dread f3 [0,4194304] 0 2024-04-25T17:19:03.319 INFO:tasks.workunit.client.1.smithi069.stdout:1/47: creat d1/d4/de/f10 x:0 0 0 2024-04-25T17:19:03.321 INFO:tasks.workunit.client.0.smithi037.stdout:4/440: dread d7/f34 [0,4194304] 0 2024-04-25T17:19:03.322 INFO:tasks.workunit.client.0.smithi037.stdout:2/323: creat d0/d15/d53/f61 x:0 0 0 2024-04-25T17:19:03.323 INFO:tasks.workunit.client.1.smithi069.stdout:3/101: write d8/f19 [237151,18620] 0 2024-04-25T17:19:03.325 INFO:tasks.workunit.client.1.smithi069.stdout:2/39: symlink d0/d8/ld 0 2024-04-25T17:19:03.326 INFO:tasks.workunit.client.0.smithi037.stdout:2/324: creat d0/d15/d53/f62 x:0 0 0 2024-04-25T17:19:03.327 INFO:tasks.workunit.client.1.smithi069.stdout:7/51: unlink l2 0 2024-04-25T17:19:03.327 INFO:tasks.workunit.client.1.smithi069.stdout:4/35: link c3 c9 0 2024-04-25T17:19:03.329 INFO:tasks.workunit.client.0.smithi037.stdout:4/441: dwrite d7/d7e/d5b/f8c [0,4194304] 0 2024-04-25T17:19:03.329 INFO:tasks.workunit.client.1.smithi069.stdout:9/100: symlink d2/da/d14/l27 0 2024-04-25T17:19:03.330 INFO:tasks.workunit.client.1.smithi069.stdout:9/101: chown d2/f8 105278 1 2024-04-25T17:19:03.335 INFO:tasks.workunit.client.0.smithi037.stdout:4/442: rename d7/f88 to d7/d7e/d4e/f98 0 2024-04-25T17:19:03.335 INFO:tasks.workunit.client.0.smithi037.stdout:4/443: stat d7/d7e/l4c 0 2024-04-25T17:19:03.338 INFO:tasks.workunit.client.1.smithi069.stdout:1/48: mkdir d1/d4/de/d11 0 2024-04-25T17:19:03.341 INFO:tasks.workunit.client.0.smithi037.stdout:4/444: dread d7/d7e/d45/f5a [0,4194304] 0 2024-04-25T17:19:03.343 INFO:tasks.workunit.client.0.smithi037.stdout:4/445: write d7/d7e/d5b/f6a [2355650,116439] 0 2024-04-25T17:19:03.347 INFO:tasks.workunit.client.1.smithi069.stdout:4/36: mknod ca 0 2024-04-25T17:19:03.349 INFO:tasks.workunit.client.1.smithi069.stdout:7/52: rename d4/d6/d13 to d4/d6/d14/d15 0 2024-04-25T17:19:03.352 INFO:tasks.workunit.client.0.smithi037.stdout:2/325: link d0/d16/c58 d0/d16/c63 0 2024-04-25T17:19:03.353 INFO:tasks.workunit.client.1.smithi069.stdout:5/42: fsync f1 0 2024-04-25T17:19:03.354 INFO:tasks.workunit.client.1.smithi069.stdout:5/43: chown f6 254565082 1 2024-04-25T17:19:03.356 INFO:tasks.workunit.client.1.smithi069.stdout:1/49: mkdir d1/df/d12 0 2024-04-25T17:19:03.357 INFO:tasks.workunit.client.0.smithi037.stdout:2/326: write d0/f14 [6512229,50677] 0 2024-04-25T17:19:03.360 INFO:tasks.workunit.client.1.smithi069.stdout:3/102: write d8/d16/f1e [1251985,112465] 0 2024-04-25T17:19:03.361 INFO:tasks.workunit.client.1.smithi069.stdout:4/37: mkdir db 0 2024-04-25T17:19:03.362 INFO:tasks.workunit.client.0.smithi037.stdout:4/446: getdents d7/d7e/d1e 0 2024-04-25T17:19:03.363 INFO:tasks.workunit.client.1.smithi069.stdout:3/103: dread d8/f11 [0,4194304] 0 2024-04-25T17:19:03.364 INFO:tasks.workunit.client.0.smithi037.stdout:2/327: mknod d0/d16/c64 0 2024-04-25T17:19:03.365 INFO:tasks.workunit.client.1.smithi069.stdout:3/104: truncate d8/d16/f23 1875259 0 2024-04-25T17:19:03.365 INFO:tasks.workunit.client.0.smithi037.stdout:2/328: readlink d0/d16/d26/d3e/l46 0 2024-04-25T17:19:03.365 INFO:tasks.workunit.client.1.smithi069.stdout:7/53: mknod d4/c16 0 2024-04-25T17:19:03.366 INFO:tasks.workunit.client.0.smithi037.stdout:4/447: creat d7/d7e/d45/d4f/f99 x:0 0 0 2024-04-25T17:19:03.367 INFO:tasks.workunit.client.0.smithi037.stdout:4/448: chown d7/d7e/d1e/c76 0 1 2024-04-25T17:19:03.367 INFO:tasks.workunit.client.1.smithi069.stdout:9/102: symlink d2/da/d14/d23/l28 0 2024-04-25T17:19:03.370 INFO:tasks.workunit.client.1.smithi069.stdout:9/103: write d2/da/f20 [1031189,19650] 0 2024-04-25T17:19:03.370 INFO:tasks.workunit.client.1.smithi069.stdout:8/50: creat f10 x:0 0 0 2024-04-25T17:19:03.370 INFO:tasks.workunit.client.0.smithi037.stdout:4/449: creat d7/d7e/d1e/d2b/d35/d39/d83/f9a x:0 0 0 2024-04-25T17:19:03.372 INFO:tasks.workunit.client.1.smithi069.stdout:7/54: dwrite d4/d6/fa [0,4194304] 0 2024-04-25T17:19:03.387 INFO:tasks.workunit.client.0.smithi037.stdout:2/329: dread d0/f2d [0,4194304] 0 2024-04-25T17:19:03.388 INFO:tasks.workunit.client.0.smithi037.stdout:2/330: write d0/d16/d26/f3f [3823269,86395] 0 2024-04-25T17:19:03.390 INFO:tasks.workunit.client.1.smithi069.stdout:0/44: sync 2024-04-25T17:19:03.442 INFO:tasks.workunit.client.1.smithi069.stdout:5/44: mknod cb 0 2024-04-25T17:19:03.442 INFO:tasks.workunit.client.1.smithi069.stdout:5/45: rmdir - no directory 2024-04-25T17:19:03.443 INFO:tasks.workunit.client.0.smithi037.stdout:4/450: rename d7/d7e/l2e to d7/d7e/d1e/d70/d84/l9b 0 2024-04-25T17:19:03.446 INFO:tasks.workunit.client.1.smithi069.stdout:1/50: creat d1/df/f13 x:0 0 0 2024-04-25T17:19:03.447 INFO:tasks.workunit.client.1.smithi069.stdout:6/39: sync 2024-04-25T17:19:03.448 INFO:tasks.workunit.client.1.smithi069.stdout:6/40: write d2/f9 [811477,48846] 0 2024-04-25T17:19:03.453 INFO:tasks.workunit.client.0.smithi037.stdout:2/331: fsync d0/d15/f36 0 2024-04-25T17:19:03.454 INFO:tasks.workunit.client.1.smithi069.stdout:4/38: chown c3 393015702 1 2024-04-25T17:19:03.456 INFO:tasks.workunit.client.1.smithi069.stdout:3/105: unlink f7 0 2024-04-25T17:19:03.458 INFO:tasks.workunit.client.0.smithi037.stdout:2/332: readlink d0/d16/d20/d55/l5e 0 2024-04-25T17:19:03.461 INFO:tasks.workunit.client.1.smithi069.stdout:9/104: creat d2/f29 x:0 0 0 2024-04-25T17:19:03.462 INFO:tasks.workunit.client.0.smithi037.stdout:4/451: dwrite d7/d7e/d1e/d2b/f42 [0,4194304] 0 2024-04-25T17:19:03.463 INFO:tasks.workunit.client.1.smithi069.stdout:7/55: write d4/f10 [316435,79145] 0 2024-04-25T17:19:03.465 INFO:tasks.workunit.client.1.smithi069.stdout:8/51: write f3 [3422621,114678] 0 2024-04-25T17:19:03.468 INFO:tasks.workunit.client.0.smithi037.stdout:4/452: rmdir d7/d7e/d1e/d2b/d35/d39/d7a 39 2024-04-25T17:19:03.471 INFO:tasks.workunit.client.1.smithi069.stdout:6/41: truncate f1 3590272 0 2024-04-25T17:19:03.472 INFO:tasks.workunit.client.1.smithi069.stdout:2/40: write d0/f7 [3495355,28035] 0 2024-04-25T17:19:03.472 INFO:tasks.workunit.client.0.smithi037.stdout:2/333: dwrite d0/d15/f36 [0,4194304] 0 2024-04-25T17:19:03.475 INFO:tasks.workunit.client.0.smithi037.stdout:4/453: mkdir d7/d7e/d1e/d2b/d35/d39/d9c 0 2024-04-25T17:19:03.476 INFO:tasks.workunit.client.0.smithi037.stdout:2/334: write d0/f2d [757492,102027] 0 2024-04-25T17:19:03.477 INFO:tasks.workunit.client.0.smithi037.stdout:4/454: creat d7/d7e/d5b/f9d x:0 0 0 2024-04-25T17:19:03.478 INFO:tasks.workunit.client.1.smithi069.stdout:9/105: rmdir d2/da 39 2024-04-25T17:19:03.479 INFO:tasks.workunit.client.1.smithi069.stdout:7/56: readlink l0 0 2024-04-25T17:19:03.480 INFO:tasks.workunit.client.0.smithi037.stdout:2/335: creat d0/d16/d26/d3e/f65 x:0 0 0 2024-04-25T17:19:03.481 INFO:tasks.workunit.client.1.smithi069.stdout:0/45: fsync d0/f1 0 2024-04-25T17:19:03.482 INFO:tasks.workunit.client.1.smithi069.stdout:2/41: dread d0/f7 [0,4194304] 0 2024-04-25T17:19:03.483 INFO:tasks.workunit.client.0.smithi037.stdout:4/455: symlink d7/d7e/d1e/l9e 0 2024-04-25T17:19:03.488 INFO:tasks.workunit.client.0.smithi037.stdout:2/336: dwrite d0/d15/d53/f61 [0,4194304] 0 2024-04-25T17:19:03.490 INFO:tasks.workunit.client.1.smithi069.stdout:4/39: getdents db 0 2024-04-25T17:19:03.493 INFO:tasks.workunit.client.1.smithi069.stdout:3/106: symlink d8/d16/d1a/l29 0 2024-04-25T17:19:03.495 INFO:tasks.workunit.client.0.smithi037.stdout:2/337: creat d0/d16/d20/d59/f66 x:0 0 0 2024-04-25T17:19:03.495 INFO:tasks.workunit.client.1.smithi069.stdout:1/51: truncate d1/f5 1499631 0 2024-04-25T17:19:03.495 INFO:tasks.workunit.client.1.smithi069.stdout:1/52: fdatasync d1/df/f13 0 2024-04-25T17:19:03.496 INFO:tasks.workunit.client.1.smithi069.stdout:6/42: write d2/d7/f8 [1021551,82017] 0 2024-04-25T17:19:03.497 INFO:tasks.workunit.client.0.smithi037.stdout:2/338: read d0/f14 [722243,126324] 0 2024-04-25T17:19:03.497 INFO:tasks.workunit.client.1.smithi069.stdout:6/43: chown d2/d7/fa 384 1 2024-04-25T17:19:03.497 INFO:tasks.workunit.client.0.smithi037.stdout:2/339: chown d0/d15/d53/d56 1261293 1 2024-04-25T17:19:03.499 INFO:tasks.workunit.client.0.smithi037.stdout:2/340: write d0/d15/f37 [4537031,86417] 0 2024-04-25T17:19:03.499 INFO:tasks.workunit.client.1.smithi069.stdout:7/57: creat d4/d6/d14/d15/f17 x:0 0 0 2024-04-25T17:19:03.501 INFO:tasks.workunit.client.1.smithi069.stdout:0/46: symlink d0/l12 0 2024-04-25T17:19:03.503 INFO:tasks.workunit.client.1.smithi069.stdout:2/42: creat d0/d1/fe x:0 0 0 2024-04-25T17:19:03.503 INFO:tasks.workunit.client.1.smithi069.stdout:8/52: symlink l11 0 2024-04-25T17:19:03.504 INFO:tasks.workunit.client.0.smithi037.stdout:2/341: dread d0/d23/f43 [0,4194304] 0 2024-04-25T17:19:03.505 INFO:tasks.workunit.client.1.smithi069.stdout:6/44: dwrite d2/f9 [0,4194304] 0 2024-04-25T17:19:03.505 INFO:tasks.workunit.client.1.smithi069.stdout:8/53: write ff [205219,50351] 0 2024-04-25T17:19:03.505 INFO:tasks.workunit.client.0.smithi037.stdout:2/342: stat d0/d16/d3c 0 2024-04-25T17:19:03.507 INFO:tasks.workunit.client.0.smithi037.stdout:4/456: getdents d7/d7e/d1e/d2b/d35/d39/d83 0 2024-04-25T17:19:03.510 INFO:tasks.workunit.client.1.smithi069.stdout:3/107: truncate f5 1936491 0 2024-04-25T17:19:03.512 INFO:tasks.workunit.client.1.smithi069.stdout:2/43: dwrite d0/d1/fe [0,4194304] 0 2024-04-25T17:19:03.516 INFO:tasks.workunit.client.0.smithi037.stdout:2/343: mknod d0/d15/c67 0 2024-04-25T17:19:03.517 INFO:tasks.workunit.client.0.smithi037.stdout:2/344: dread - d0/d16/d3b/f5b zero size 2024-04-25T17:19:03.518 INFO:tasks.workunit.client.1.smithi069.stdout:9/106: mknod d2/da/dd/d1e/c2a 0 2024-04-25T17:19:03.521 INFO:tasks.workunit.client.1.smithi069.stdout:7/58: mkdir d4/d18 0 2024-04-25T17:19:03.523 INFO:tasks.workunit.client.0.smithi037.stdout:2/345: chown d0/d16/d20/c22 17107 1 2024-04-25T17:19:03.525 INFO:tasks.workunit.client.1.smithi069.stdout:0/47: chown d0/f8 25 1 2024-04-25T17:19:03.526 INFO:tasks.workunit.client.0.smithi037.stdout:4/457: dread d7/d7e/d45/d4f/f55 [0,4194304] 0 2024-04-25T17:19:03.528 INFO:tasks.workunit.client.1.smithi069.stdout:5/46: getdents . 0 2024-04-25T17:19:03.530 INFO:tasks.workunit.client.0.smithi037.stdout:4/458: write d7/d7e/f3c [1136394,111230] 0 2024-04-25T17:19:03.531 INFO:tasks.workunit.client.1.smithi069.stdout:6/45: creat d2/d7/fc x:0 0 0 2024-04-25T17:19:03.532 INFO:tasks.workunit.client.1.smithi069.stdout:5/47: dread f5 [0,4194304] 0 2024-04-25T17:19:03.532 INFO:tasks.workunit.client.1.smithi069.stdout:5/48: dread - f9 zero size 2024-04-25T17:19:03.533 INFO:tasks.workunit.client.0.smithi037.stdout:2/346: mkdir d0/d16/d68 0 2024-04-25T17:19:03.534 INFO:tasks.workunit.client.0.smithi037.stdout:2/347: write d0/d23/f28 [1593833,9718] 0 2024-04-25T17:19:03.534 INFO:tasks.workunit.client.1.smithi069.stdout:4/40: symlink db/lc 0 2024-04-25T17:19:03.535 INFO:tasks.workunit.client.1.smithi069.stdout:4/41: stat c3 0 2024-04-25T17:19:03.535 INFO:tasks.workunit.client.1.smithi069.stdout:4/42: rename db to db/dd 22 2024-04-25T17:19:03.539 INFO:tasks.workunit.client.0.smithi037.stdout:4/459: fdatasync d7/d7e/d1e/d2b/f5f 0 2024-04-25T17:19:03.540 INFO:tasks.workunit.client.1.smithi069.stdout:4/43: dwrite f0 [0,4194304] 0 2024-04-25T17:19:03.541 INFO:tasks.workunit.client.1.smithi069.stdout:2/44: unlink d0/ca 0 2024-04-25T17:19:03.541 INFO:tasks.workunit.client.0.smithi037.stdout:2/348: dwrite d0/d16/d3b/f47 [0,4194304] 0 2024-04-25T17:19:03.542 INFO:tasks.workunit.client.1.smithi069.stdout:2/45: fdatasync d0/d1/fe 0 2024-04-25T17:19:03.544 INFO:tasks.workunit.client.1.smithi069.stdout:4/44: dread f6 [0,4194304] 0 2024-04-25T17:19:03.545 INFO:tasks.workunit.client.1.smithi069.stdout:4/45: fsync f5 0 2024-04-25T17:19:03.550 INFO:tasks.workunit.client.1.smithi069.stdout:7/59: symlink d4/d6/l19 0 2024-04-25T17:19:03.550 INFO:tasks.workunit.client.0.smithi037.stdout:2/349: dwrite d0/d16/d20/f39 [4194304,4194304] 0 2024-04-25T17:19:03.550 INFO:tasks.workunit.client.0.smithi037.stdout:7/371: sync 2024-04-25T17:19:03.551 INFO:tasks.workunit.client.1.smithi069.stdout:7/60: write d4/d6/fa [844480,129563] 0 2024-04-25T17:19:03.552 INFO:tasks.workunit.client.0.smithi037.stdout:7/372: read d5/f46 [81562,17276] 0 2024-04-25T17:19:03.554 INFO:tasks.workunit.client.1.smithi069.stdout:0/48: creat d0/da/db/f13 x:0 0 0 2024-04-25T17:19:03.555 INFO:tasks.workunit.client.1.smithi069.stdout:0/49: write d0/ff [1876128,39922] 0 2024-04-25T17:19:03.556 INFO:tasks.workunit.client.0.smithi037.stdout:4/460: mkdir d7/d7e/d1e/d70/d9f 0 2024-04-25T17:19:03.560 INFO:tasks.workunit.client.0.smithi037.stdout:7/373: rename d5/d15/d17/d1b/f69 to d5/d15/d17/d1b/f88 0 2024-04-25T17:19:03.562 INFO:tasks.workunit.client.0.smithi037.stdout:7/374: write d5/fd [223731,28538] 0 2024-04-25T17:19:03.562 INFO:tasks.workunit.client.1.smithi069.stdout:6/46: creat d2/d7/fd x:0 0 0 2024-04-25T17:19:03.565 INFO:tasks.workunit.client.1.smithi069.stdout:6/47: dread d2/f9 [0,4194304] 0 2024-04-25T17:19:03.566 INFO:tasks.workunit.client.1.smithi069.stdout:6/48: write d2/d7/fd [879656,78541] 0 2024-04-25T17:19:03.569 INFO:tasks.workunit.client.0.smithi037.stdout:4/461: creat d7/d7e/d45/fa0 x:0 0 0 2024-04-25T17:19:03.570 INFO:tasks.workunit.client.0.smithi037.stdout:2/350: dread d0/f14 [4194304,4194304] 0 2024-04-25T17:19:03.571 INFO:tasks.workunit.client.0.smithi037.stdout:4/462: chown d7/d7e/d1e/d70/d9f 23797830 1 2024-04-25T17:19:03.571 INFO:tasks.workunit.client.0.smithi037.stdout:2/351: fdatasync d0/f9 0 2024-04-25T17:19:03.572 INFO:tasks.workunit.client.0.smithi037.stdout:4/463: readlink d7/d7e/d1e/d2b/l2c 0 2024-04-25T17:19:03.574 INFO:tasks.workunit.client.1.smithi069.stdout:2/46: dread d0/f7 [0,4194304] 0 2024-04-25T17:19:03.576 INFO:tasks.workunit.client.0.smithi037.stdout:7/375: getdents d5/d15/d17/d1b/d27/d80 0 2024-04-25T17:19:03.577 INFO:tasks.workunit.client.0.smithi037.stdout:7/376: readlink d5/d14/l7b 0 2024-04-25T17:19:03.580 INFO:tasks.workunit.client.0.smithi037.stdout:4/464: dwrite d7/d8a/f8b [0,4194304] 0 2024-04-25T17:19:03.582 INFO:tasks.workunit.client.0.smithi037.stdout:4/465: truncate d7/d7e/d45/f8d 898251 0 2024-04-25T17:19:03.586 INFO:tasks.workunit.client.1.smithi069.stdout:7/61: mkdir d4/d1a 0 2024-04-25T17:19:03.587 INFO:tasks.workunit.client.0.smithi037.stdout:7/377: creat d5/d15/f89 x:0 0 0 2024-04-25T17:19:03.589 INFO:tasks.workunit.client.0.smithi037.stdout:6/322: sync 2024-04-25T17:19:03.589 INFO:tasks.workunit.client.0.smithi037.stdout:1/291: sync 2024-04-25T17:19:03.589 INFO:tasks.workunit.client.0.smithi037.stdout:9/451: sync 2024-04-25T17:19:03.590 INFO:tasks.workunit.client.0.smithi037.stdout:0/388: sync 2024-04-25T17:19:03.592 INFO:tasks.workunit.client.1.smithi069.stdout:0/50: mknod d0/da/c14 0 2024-04-25T17:19:03.593 INFO:tasks.workunit.client.1.smithi069.stdout:0/51: truncate d0/f6 525485 0 2024-04-25T17:19:03.593 INFO:tasks.workunit.client.0.smithi037.stdout:7/378: dread d5/d15/d17/d1b/f68 [0,4194304] 0 2024-04-25T17:19:03.594 INFO:tasks.workunit.client.1.smithi069.stdout:3/108: truncate d8/d16/f23 693150 0 2024-04-25T17:19:03.594 INFO:tasks.workunit.client.1.smithi069.stdout:3/109: write d8/f1f [783863,4407] 0 2024-04-25T17:19:03.594 INFO:tasks.workunit.client.0.smithi037.stdout:2/352: link d0/l3 d0/d23/l69 0 2024-04-25T17:19:03.599 INFO:tasks.workunit.client.1.smithi069.stdout:8/54: creat f12 x:0 0 0 2024-04-25T17:19:03.599 INFO:tasks.workunit.client.1.smithi069.stdout:8/55: chown ff 86 1 2024-04-25T17:19:03.600 INFO:tasks.workunit.client.0.smithi037.stdout:2/353: dread d0/f33 [0,4194304] 0 2024-04-25T17:19:03.602 INFO:tasks.workunit.client.0.smithi037.stdout:7/379: dwrite d5/d15/d17/f66 [0,4194304] 0 2024-04-25T17:19:03.602 INFO:tasks.workunit.client.1.smithi069.stdout:8/56: dread fb [0,4194304] 0 2024-04-25T17:19:03.604 INFO:tasks.workunit.client.0.smithi037.stdout:7/380: chown d5/d15/d17/d1b/d27/d80/f86 13436 1 2024-04-25T17:19:03.606 INFO:tasks.workunit.client.0.smithi037.stdout:7/381: write d5/d15/d17/d25/d2b/d59/f63 [1176736,118996] 0 2024-04-25T17:19:03.608 INFO:tasks.workunit.client.0.smithi037.stdout:7/382: write d5/d15/d17/d1b/d27/f60 [2366166,18450] 0 2024-04-25T17:19:03.611 INFO:tasks.workunit.client.0.smithi037.stdout:1/292: mkdir dc/d18/d64 0 2024-04-25T17:19:03.612 INFO:tasks.workunit.client.1.smithi069.stdout:6/49: dread f1 [0,4194304] 0 2024-04-25T17:19:03.613 INFO:tasks.workunit.client.1.smithi069.stdout:6/50: read f1 [86691,63246] 0 2024-04-25T17:19:03.614 INFO:tasks.workunit.client.0.smithi037.stdout:6/323: rename db/d1d/d20/d63/d65/d68/f69 to db/d26/d2e/d3e/d25/d61/f73 0 2024-04-25T17:19:03.616 INFO:tasks.workunit.client.0.smithi037.stdout:6/324: chown db/d1d/f57 154 1 2024-04-25T17:19:03.616 INFO:tasks.workunit.client.0.smithi037.stdout:7/383: dwrite d5/f7c [0,4194304] 0 2024-04-25T17:19:03.617 INFO:tasks.workunit.client.1.smithi069.stdout:2/47: unlink d0/d8/l9 0 2024-04-25T17:19:03.621 INFO:tasks.workunit.client.1.smithi069.stdout:4/46: unlink f6 0 2024-04-25T17:19:03.624 INFO:tasks.workunit.client.1.smithi069.stdout:9/107: creat d2/da/dd/f2b x:0 0 0 2024-04-25T17:19:03.625 INFO:tasks.workunit.client.1.smithi069.stdout:5/49: truncate f0 6071750 0 2024-04-25T17:19:03.626 INFO:tasks.workunit.client.0.smithi037.stdout:2/354: mkdir d0/d16/d20/d59/d6a 0 2024-04-25T17:19:03.626 INFO:tasks.workunit.client.0.smithi037.stdout:4/466: write d7/d7e/d4e/f6d [185321,32994] 0 2024-04-25T17:19:03.627 INFO:tasks.workunit.client.1.smithi069.stdout:1/53: dwrite d1/f5 [0,4194304] 0 2024-04-25T17:19:03.629 INFO:tasks.workunit.client.1.smithi069.stdout:7/62: rename d4/d6/l19 to d4/d6/d14/l1b 0 2024-04-25T17:19:03.630 INFO:tasks.workunit.client.0.smithi037.stdout:9/452: mknod d1/d5/d2e/c99 0 2024-04-25T17:19:03.630 INFO:tasks.workunit.client.1.smithi069.stdout:7/63: write d4/d6/fa [4352157,49487] 0 2024-04-25T17:19:03.631 INFO:tasks.workunit.client.1.smithi069.stdout:7/64: write d4/f10 [163842,16998] 0 2024-04-25T17:19:03.632 INFO:tasks.workunit.client.1.smithi069.stdout:1/54: dread d1/f5 [0,4194304] 0 2024-04-25T17:19:03.632 INFO:tasks.workunit.client.1.smithi069.stdout:7/65: read - d4/d6/d14/d15/f17 zero size 2024-04-25T17:19:03.633 INFO:tasks.workunit.client.1.smithi069.stdout:0/52: creat d0/da/db/f15 x:0 0 0 2024-04-25T17:19:03.634 INFO:tasks.workunit.client.1.smithi069.stdout:0/53: readlink d0/da/db/ld 0 2024-04-25T17:19:03.634 INFO:tasks.workunit.client.1.smithi069.stdout:0/54: fdatasync d0/da/db/f13 0 2024-04-25T17:19:03.635 INFO:tasks.workunit.client.1.smithi069.stdout:7/66: fsync d4/d6/fa 0 2024-04-25T17:19:03.636 INFO:tasks.workunit.client.1.smithi069.stdout:0/55: readlink d0/da/db/ld 0 2024-04-25T17:19:03.636 INFO:tasks.workunit.client.1.smithi069.stdout:3/110: mkdir d8/d2a 0 2024-04-25T17:19:03.637 INFO:tasks.workunit.client.1.smithi069.stdout:0/56: readlink d0/l12 0 2024-04-25T17:19:03.639 INFO:tasks.workunit.client.1.smithi069.stdout:7/67: dread d4/d6/fa [4194304,4194304] 0 2024-04-25T17:19:03.640 INFO:tasks.workunit.client.1.smithi069.stdout:6/51: creat d2/fe x:0 0 0 2024-04-25T17:19:03.641 INFO:tasks.workunit.client.1.smithi069.stdout:7/68: stat d4/d6 0 2024-04-25T17:19:03.641 INFO:tasks.workunit.client.0.smithi037.stdout:1/293: rename dc/c19 to dc/d1c/c65 0 2024-04-25T17:19:03.642 INFO:tasks.workunit.client.1.smithi069.stdout:7/69: fdatasync d4/d6/d14/d15/f17 0 2024-04-25T17:19:03.642 INFO:tasks.workunit.client.1.smithi069.stdout:2/48: creat d0/d8/ff x:0 0 0 2024-04-25T17:19:03.642 INFO:tasks.workunit.client.1.smithi069.stdout:1/55: dwrite d1/d4/de/f10 [0,4194304] 0 2024-04-25T17:19:03.643 INFO:tasks.workunit.client.1.smithi069.stdout:7/70: chown d4/d18 11824 1 2024-04-25T17:19:03.647 INFO:tasks.workunit.client.1.smithi069.stdout:7/71: write d4/d6/fa [3401097,84437] 0 2024-04-25T17:19:03.649 INFO:tasks.workunit.client.1.smithi069.stdout:7/72: write d4/f10 [1148546,123140] 0 2024-04-25T17:19:03.650 INFO:tasks.workunit.client.0.smithi037.stdout:9/453: fdatasync d1/f4 0 2024-04-25T17:19:03.651 INFO:tasks.workunit.client.1.smithi069.stdout:6/52: dwrite d2/d7/fd [0,4194304] 0 2024-04-25T17:19:03.652 INFO:tasks.workunit.client.1.smithi069.stdout:7/73: dread - d4/d6/d14/d15/f17 zero size 2024-04-25T17:19:03.652 INFO:tasks.workunit.client.0.smithi037.stdout:9/454: read d1/d5/dc/f4a [406956,126569] 0 2024-04-25T17:19:03.653 INFO:tasks.workunit.client.1.smithi069.stdout:7/74: dread - d4/d6/d14/d15/f17 zero size 2024-04-25T17:19:03.654 INFO:tasks.workunit.client.0.smithi037.stdout:9/455: read - d1/d5/d2e/d34/f89 zero size 2024-04-25T17:19:03.654 INFO:tasks.workunit.client.1.smithi069.stdout:7/75: dread - d4/d6/d14/d15/f17 zero size 2024-04-25T17:19:03.655 INFO:tasks.workunit.client.0.smithi037.stdout:9/456: fsync d1/d5/d19/f50 0 2024-04-25T17:19:03.656 INFO:tasks.workunit.client.0.smithi037.stdout:6/325: link db/d26/d2e/d3e/f6f db/d26/d2e/d3e/d25/d61/f74 0 2024-04-25T17:19:03.659 INFO:tasks.workunit.client.0.smithi037.stdout:0/389: creat d9/df/d32/d56/f8d x:0 0 0 2024-04-25T17:19:03.661 INFO:tasks.workunit.client.0.smithi037.stdout:1/294: dread dc/d1c/f58 [0,4194304] 0 2024-04-25T17:19:03.662 INFO:tasks.workunit.client.0.smithi037.stdout:4/467: link d7/d7e/d45/f8d d7/d78/fa1 0 2024-04-25T17:19:03.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:03 smithi069 ceph-mon[34527]: pgmap v32: 65 pgs: 65 active+clean; 810 MiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 9.9 MiB/s rd, 79 MiB/s wr, 344 op/s 2024-04-25T17:19:03.668 INFO:tasks.workunit.client.0.smithi037.stdout:9/457: rmdir d1 39 2024-04-25T17:19:03.669 INFO:tasks.workunit.client.1.smithi069.stdout:3/111: mknod d8/c2b 0 2024-04-25T17:19:03.670 INFO:tasks.workunit.client.1.smithi069.stdout:3/112: chown d8/l1b 1066971484 1 2024-04-25T17:19:03.670 INFO:tasks.workunit.client.1.smithi069.stdout:0/57: symlink d0/l16 0 2024-04-25T17:19:03.672 INFO:tasks.workunit.client.1.smithi069.stdout:3/113: dread d8/f19 [0,4194304] 0 2024-04-25T17:19:03.674 INFO:tasks.workunit.client.1.smithi069.stdout:1/56: rename d1/df/f13 to d1/df/d12/f14 0 2024-04-25T17:19:03.682 INFO:tasks.workunit.client.0.smithi037.stdout:6/326: creat db/d1d/d20/f75 x:0 0 0 2024-04-25T17:19:03.685 INFO:tasks.workunit.client.0.smithi037.stdout:9/458: dread d1/f4 [0,4194304] 0 2024-04-25T17:19:03.685 INFO:tasks.workunit.client.1.smithi069.stdout:6/53: creat d2/d7/ff x:0 0 0 2024-04-25T17:19:03.686 INFO:tasks.workunit.client.0.smithi037.stdout:1/295: write f8 [2948557,53801] 0 2024-04-25T17:19:03.688 INFO:tasks.workunit.client.0.smithi037.stdout:6/327: rmdir db/d26/d2e/d3e/d25/d61 39 2024-04-25T17:19:03.691 INFO:tasks.workunit.client.0.smithi037.stdout:4/468: getdents d7 0 2024-04-25T17:19:03.695 INFO:tasks.workunit.client.0.smithi037.stdout:9/459: rename d1/d48/d68/c84 to d1/d5/dc/d3c/c9a 0 2024-04-25T17:19:03.696 INFO:tasks.workunit.client.0.smithi037.stdout:4/469: dwrite d7/d7e/f48 [0,4194304] 0 2024-04-25T17:19:03.696 INFO:tasks.workunit.client.1.smithi069.stdout:0/58: rmdir d0/da 39 2024-04-25T17:19:03.697 INFO:tasks.workunit.client.1.smithi069.stdout:0/59: readlink d0/l11 0 2024-04-25T17:19:03.697 INFO:tasks.workunit.client.0.smithi037.stdout:4/470: fsync d7/d7e/d4e/f6d 0 2024-04-25T17:19:03.698 INFO:tasks.workunit.client.0.smithi037.stdout:1/296: mkdir dc/d18/d66 0 2024-04-25T17:19:03.699 INFO:tasks.workunit.client.0.smithi037.stdout:4/471: readlink d7/d7e/d1e/d2b/d35/d39/l50 0 2024-04-25T17:19:03.700 INFO:tasks.workunit.client.0.smithi037.stdout:1/297: truncate dc/d24/f47 1305668 0 2024-04-25T17:19:03.700 INFO:tasks.workunit.client.1.smithi069.stdout:8/57: creat f13 x:0 0 0 2024-04-25T17:19:03.701 INFO:tasks.workunit.client.0.smithi037.stdout:6/328: creat db/d1d/d20/d63/f76 x:0 0 0 2024-04-25T17:19:03.703 INFO:tasks.workunit.client.1.smithi069.stdout:3/114: mkdir d8/d16/d1a/d2c 0 2024-04-25T17:19:03.704 INFO:tasks.workunit.client.0.smithi037.stdout:9/460: creat d1/d5/dc/d38/f9b x:0 0 0 2024-04-25T17:19:03.705 INFO:tasks.workunit.client.1.smithi069.stdout:1/57: mknod d1/df/d12/c15 0 2024-04-25T17:19:03.707 INFO:tasks.workunit.client.1.smithi069.stdout:4/47: link c9 db/ce 0 2024-04-25T17:19:03.707 INFO:tasks.workunit.client.0.smithi037.stdout:1/298: fsync dc/d18/f25 0 2024-04-25T17:19:03.708 INFO:tasks.workunit.client.1.smithi069.stdout:8/58: dwrite f8 [0,4194304] 0 2024-04-25T17:19:03.709 INFO:tasks.workunit.client.1.smithi069.stdout:9/108: creat d2/f2c x:0 0 0 2024-04-25T17:19:03.709 INFO:tasks.workunit.client.1.smithi069.stdout:8/59: write f3 [3338710,107255] 0 2024-04-25T17:19:03.714 INFO:tasks.workunit.client.0.smithi037.stdout:9/461: truncate d1/d5/dc/f7d 4090663 0 2024-04-25T17:19:03.715 INFO:tasks.workunit.client.1.smithi069.stdout:6/54: creat d2/f10 x:0 0 0 2024-04-25T17:19:03.715 INFO:tasks.workunit.client.1.smithi069.stdout:6/55: readlink d2/l4 0 2024-04-25T17:19:03.715 INFO:tasks.workunit.client.0.smithi037.stdout:4/472: creat d7/d7e/d1e/d2b/d35/d39/d7a/fa2 x:0 0 0 2024-04-25T17:19:03.715 INFO:tasks.workunit.client.1.smithi069.stdout:7/76: creat d4/d1a/f1c x:0 0 0 2024-04-25T17:19:03.716 INFO:tasks.workunit.client.1.smithi069.stdout:7/77: chown d4/cd 0 1 2024-04-25T17:19:03.718 INFO:tasks.workunit.client.0.smithi037.stdout:6/329: dread db/ff [0,4194304] 0 2024-04-25T17:19:03.719 INFO:tasks.workunit.client.1.smithi069.stdout:0/60: dread - d0/da/db/f15 zero size 2024-04-25T17:19:03.720 INFO:tasks.workunit.client.1.smithi069.stdout:0/61: dread d0/f8 [0,4194304] 0 2024-04-25T17:19:03.720 INFO:tasks.workunit.client.1.smithi069.stdout:0/62: read d0/f8 [48814,21460] 0 2024-04-25T17:19:03.721 INFO:tasks.workunit.client.0.smithi037.stdout:1/299: dwrite dc/d1c/d57/d22/d36/f41 [4194304,4194304] 0 2024-04-25T17:19:03.723 INFO:tasks.workunit.client.1.smithi069.stdout:3/115: mknod d8/d16/c2d 0 2024-04-25T17:19:03.723 INFO:tasks.workunit.client.1.smithi069.stdout:3/116: readlink d8/l26 0 2024-04-25T17:19:03.726 INFO:tasks.workunit.client.1.smithi069.stdout:1/58: creat d1/d4/d6/f16 x:0 0 0 2024-04-25T17:19:03.734 INFO:tasks.workunit.client.1.smithi069.stdout:6/56: mknod d2/c11 0 2024-04-25T17:19:03.735 INFO:tasks.workunit.client.0.smithi037.stdout:4/473: unlink d7/f23 0 2024-04-25T17:19:03.739 INFO:tasks.workunit.client.0.smithi037.stdout:9/462: rename d1/d5/dc/d38/d3d to d1/d48/d68/d26/d81/d9c 0 2024-04-25T17:19:03.740 INFO:tasks.workunit.client.1.smithi069.stdout:3/117: mknod d8/c2e 0 2024-04-25T17:19:03.740 INFO:tasks.workunit.client.0.smithi037.stdout:9/463: truncate d1/d5/d2e/d34/f89 691296 0 2024-04-25T17:19:03.741 INFO:tasks.workunit.client.1.smithi069.stdout:3/118: readlink d8/l26 0 2024-04-25T17:19:03.741 INFO:tasks.workunit.client.1.smithi069.stdout:6/57: dwrite d2/d7/ff [0,4194304] 0 2024-04-25T17:19:03.741 INFO:tasks.workunit.client.0.smithi037.stdout:1/300: mkdir dc/d24/d67 0 2024-04-25T17:19:03.742 INFO:tasks.workunit.client.1.smithi069.stdout:6/58: write d2/fe [28466,94518] 0 2024-04-25T17:19:03.742 INFO:tasks.workunit.client.1.smithi069.stdout:1/59: mkdir d1/df/d17 0 2024-04-25T17:19:03.746 INFO:tasks.workunit.client.1.smithi069.stdout:5/50: truncate f5 5171033 0 2024-04-25T17:19:03.748 INFO:tasks.workunit.client.0.smithi037.stdout:6/330: creat db/d5a/f77 x:0 0 0 2024-04-25T17:19:03.748 INFO:tasks.workunit.client.0.smithi037.stdout:6/331: chown db/f14 13735 1 2024-04-25T17:19:03.750 INFO:tasks.workunit.client.0.smithi037.stdout:6/332: write db/d26/d2e/d3e/f49 [145313,120240] 0 2024-04-25T17:19:03.750 INFO:tasks.workunit.client.1.smithi069.stdout:2/49: sync 2024-04-25T17:19:03.751 INFO:tasks.workunit.client.1.smithi069.stdout:2/50: chown d0/d8/ld 4377 1 2024-04-25T17:19:03.751 INFO:tasks.workunit.client.0.smithi037.stdout:9/464: creat d1/d5/dc/d3c/f9d x:0 0 0 2024-04-25T17:19:03.751 INFO:tasks.workunit.client.0.smithi037.stdout:6/333: dread - db/d1d/f5f zero size 2024-04-25T17:19:03.755 INFO:tasks.workunit.client.1.smithi069.stdout:7/78: symlink d4/d18/l1d 0 2024-04-25T17:19:03.756 INFO:tasks.workunit.client.1.smithi069.stdout:0/63: mkdir d0/d17 0 2024-04-25T17:19:03.756 INFO:tasks.workunit.client.0.smithi037.stdout:6/334: symlink db/d26/d2e/d3e/l78 0 2024-04-25T17:19:03.762 INFO:tasks.workunit.client.1.smithi069.stdout:6/59: rename d2/d7/ff to d2/d7/f12 0 2024-04-25T17:19:03.764 INFO:tasks.workunit.client.0.smithi037.stdout:4/474: dread - d7/d7e/d5b/f9d zero size 2024-04-25T17:19:03.764 INFO:tasks.workunit.client.1.smithi069.stdout:4/48: link db/ce db/cf 0 2024-04-25T17:19:03.765 INFO:tasks.workunit.client.0.smithi037.stdout:9/465: link d1/d5/dc/d38/l5c d1/d48/l9e 0 2024-04-25T17:19:03.769 INFO:tasks.workunit.client.1.smithi069.stdout:9/109: creat d2/da/dd/f2d x:0 0 0 2024-04-25T17:19:03.770 INFO:tasks.workunit.client.1.smithi069.stdout:8/60: truncate f3 1704576 0 2024-04-25T17:19:03.770 INFO:tasks.workunit.client.1.smithi069.stdout:4/49: dwrite f8 [0,4194304] 0 2024-04-25T17:19:03.771 INFO:tasks.workunit.client.1.smithi069.stdout:2/51: unlink d0/d8/ff 0 2024-04-25T17:19:03.772 INFO:tasks.workunit.client.0.smithi037.stdout:1/301: write dc/f34 [981131,61344] 0 2024-04-25T17:19:03.772 INFO:tasks.workunit.client.1.smithi069.stdout:8/61: write f8 [4373934,12344] 0 2024-04-25T17:19:03.780 INFO:tasks.workunit.client.0.smithi037.stdout:4/475: mkdir d7/d7e/d1e/d2b/d35/d39/d9c/da3 0 2024-04-25T17:19:03.780 INFO:tasks.workunit.client.0.smithi037.stdout:1/302: dwrite dc/d18/f21 [4194304,4194304] 0 2024-04-25T17:19:03.782 INFO:tasks.workunit.client.1.smithi069.stdout:7/79: unlink d4/cd 0 2024-04-25T17:19:03.785 INFO:tasks.workunit.client.1.smithi069.stdout:3/119: creat d8/d16/d1a/d2c/f2f x:0 0 0 2024-04-25T17:19:03.788 INFO:tasks.workunit.client.0.smithi037.stdout:6/335: getdents db/d1d/d20/d2f 0 2024-04-25T17:19:03.788 INFO:tasks.workunit.client.1.smithi069.stdout:7/80: dread - d4/d6/d14/d15/f17 zero size 2024-04-25T17:19:03.789 INFO:tasks.workunit.client.0.smithi037.stdout:6/336: stat db/d26/d2e/d3e 0 2024-04-25T17:19:03.789 INFO:tasks.workunit.client.0.smithi037.stdout:6/337: dread - db/d1d/f5f zero size 2024-04-25T17:19:03.790 INFO:tasks.workunit.client.1.smithi069.stdout:6/60: creat d2/d7/f13 x:0 0 0 2024-04-25T17:19:03.793 INFO:tasks.workunit.client.0.smithi037.stdout:6/338: read db/d26/d2e/f39 [2190081,55698] 0 2024-04-25T17:19:03.793 INFO:tasks.workunit.client.1.smithi069.stdout:1/60: creat d1/d4/de/d11/f18 x:0 0 0 2024-04-25T17:19:03.794 INFO:tasks.workunit.client.1.smithi069.stdout:9/110: dwrite d2/da/dd/f2b [0,4194304] 0 2024-04-25T17:19:03.796 INFO:tasks.workunit.client.1.smithi069.stdout:8/62: dwrite fe [0,4194304] 0 2024-04-25T17:19:03.796 INFO:tasks.workunit.client.0.smithi037.stdout:9/466: dwrite d1/d5/dc/f27 [0,4194304] 0 2024-04-25T17:19:03.797 INFO:tasks.workunit.client.1.smithi069.stdout:0/64: dread d0/f1 [0,4194304] 0 2024-04-25T17:19:03.798 INFO:tasks.workunit.client.0.smithi037.stdout:9/467: fdatasync d1/d5/dc/d38/f9b 0 2024-04-25T17:19:03.799 INFO:tasks.workunit.client.1.smithi069.stdout:6/61: dread d2/d7/f8 [0,4194304] 0 2024-04-25T17:19:03.800 INFO:tasks.workunit.client.0.smithi037.stdout:9/468: chown d1/f9 1883432615 1 2024-04-25T17:19:03.800 INFO:tasks.workunit.client.1.smithi069.stdout:1/61: write d1/d4/de/d11/f18 [597712,74158] 0 2024-04-25T17:19:03.801 INFO:tasks.workunit.client.0.smithi037.stdout:1/303: creat dc/d18/d64/f68 x:0 0 0 2024-04-25T17:19:03.801 INFO:tasks.workunit.client.1.smithi069.stdout:9/111: truncate d2/da/dd/f2d 143744 0 2024-04-25T17:19:03.803 INFO:tasks.workunit.client.1.smithi069.stdout:7/81: dwrite d4/d6/fa [0,4194304] 0 2024-04-25T17:19:03.804 INFO:tasks.workunit.client.1.smithi069.stdout:7/82: stat d4/d18/l1d 0 2024-04-25T17:19:03.805 INFO:tasks.workunit.client.0.smithi037.stdout:9/469: write d1/d48/d68/d4e/f85 [152651,116866] 0 2024-04-25T17:19:03.806 INFO:tasks.workunit.client.0.smithi037.stdout:6/339: dwrite db/d1d/d20/f5b [0,4194304] 0 2024-04-25T17:19:03.806 INFO:tasks.workunit.client.1.smithi069.stdout:4/50: creat db/f10 x:0 0 0 2024-04-25T17:19:03.810 INFO:tasks.workunit.client.0.smithi037.stdout:8/204: sync 2024-04-25T17:19:03.810 INFO:tasks.workunit.client.0.smithi037.stdout:5/383: sync 2024-04-25T17:19:03.810 INFO:tasks.workunit.client.0.smithi037.stdout:3/229: sync 2024-04-25T17:19:03.811 INFO:tasks.workunit.client.1.smithi069.stdout:1/62: fdatasync d1/d4/de/d11/f18 0 2024-04-25T17:19:03.812 INFO:tasks.workunit.client.0.smithi037.stdout:8/205: write d5/db/d23/f29 [586457,52354] 0 2024-04-25T17:19:03.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:03 smithi037 ceph-mon[26472]: pgmap v32: 65 pgs: 65 active+clean; 810 MiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 9.9 MiB/s rd, 79 MiB/s wr, 344 op/s 2024-04-25T17:19:03.824 INFO:tasks.workunit.client.0.smithi037.stdout:1/304: dread dc/d18/f3e [0,4194304] 0 2024-04-25T17:19:03.824 INFO:tasks.workunit.client.0.smithi037.stdout:1/305: chown dc/d24/f48 949456836 1 2024-04-25T17:19:03.847 INFO:tasks.workunit.client.0.smithi037.stdout:4/476: link d7/f1a d7/d7e/d45/d4f/fa4 0 2024-04-25T17:19:03.848 INFO:tasks.workunit.client.0.smithi037.stdout:4/477: chown d7/d7e/d5b/c90 10255 1 2024-04-25T17:19:03.849 INFO:tasks.workunit.client.0.smithi037.stdout:4/478: fsync d7/d7e/d5b/f73 0 2024-04-25T17:19:03.850 INFO:tasks.workunit.client.0.smithi037.stdout:5/384: truncate d7/f3c 903036 0 2024-04-25T17:19:03.851 INFO:tasks.workunit.client.0.smithi037.stdout:4/479: chown d7/d7e/d5b/f8c 0 1 2024-04-25T17:19:03.851 INFO:tasks.workunit.client.0.smithi037.stdout:5/385: stat d7/d43/c6c 0 2024-04-25T17:19:03.852 INFO:tasks.workunit.client.0.smithi037.stdout:5/386: chown d7/d12 12984295 1 2024-04-25T17:19:03.852 INFO:tasks.workunit.client.0.smithi037.stdout:4/480: dread - d7/d7e/d1e/d2b/f63 zero size 2024-04-25T17:19:03.853 INFO:tasks.workunit.client.0.smithi037.stdout:4/481: chown d7/d7e/d45/d4f/c6f 3 1 2024-04-25T17:19:03.857 INFO:tasks.workunit.client.1.smithi069.stdout:7/83: fsync d4/d6/fa 0 2024-04-25T17:19:03.858 INFO:tasks.workunit.client.1.smithi069.stdout:2/52: sync 2024-04-25T17:19:03.858 INFO:tasks.workunit.client.1.smithi069.stdout:7/84: write d4/d6/fa [4060414,37142] 0 2024-04-25T17:19:03.863 INFO:tasks.workunit.client.0.smithi037.stdout:9/470: dwrite d1/d5/dc/f29 [4194304,4194304] 0 2024-04-25T17:19:03.864 INFO:tasks.workunit.client.0.smithi037.stdout:9/471: write d1/d5/dc/f72 [955408,68306] 0 2024-04-25T17:19:03.868 INFO:tasks.workunit.client.0.smithi037.stdout:6/340: truncate db/f56 2146206 0 2024-04-25T17:19:03.872 INFO:tasks.workunit.client.0.smithi037.stdout:4/482: mkdir d7/d7e/d4e/da5 0 2024-04-25T17:19:03.875 INFO:tasks.workunit.client.0.smithi037.stdout:3/230: truncate d8/d11/f3d 171997 0 2024-04-25T17:19:03.877 INFO:tasks.workunit.client.0.smithi037.stdout:9/472: symlink d1/d5/l9f 0 2024-04-25T17:19:03.877 INFO:tasks.workunit.client.0.smithi037.stdout:9/473: dread - d1/d5/d19/f50 zero size 2024-04-25T17:19:03.880 INFO:tasks.workunit.client.0.smithi037.stdout:6/341: creat db/d1d/f79 x:0 0 0 2024-04-25T17:19:03.885 INFO:tasks.workunit.client.0.smithi037.stdout:9/474: dwrite d1/d5/dc/d3c/f9d [0,4194304] 0 2024-04-25T17:19:03.896 INFO:tasks.workunit.client.0.smithi037.stdout:9/475: dwrite d1/d48/d68/f5a [0,4194304] 0 2024-04-25T17:19:03.897 INFO:tasks.workunit.client.0.smithi037.stdout:1/306: dwrite dc/d18/f42 [0,4194304] 0 2024-04-25T17:19:03.898 INFO:tasks.workunit.client.0.smithi037.stdout:1/307: stat dc/d1c/d57/f4f 0 2024-04-25T17:19:03.900 INFO:tasks.workunit.client.0.smithi037.stdout:1/308: dread - dc/d1c/d57/d4d/f53 zero size 2024-04-25T17:19:03.903 INFO:tasks.workunit.client.0.smithi037.stdout:4/483: symlink d7/d7e/la6 0 2024-04-25T17:19:03.904 INFO:tasks.workunit.client.0.smithi037.stdout:4/484: chown d7/d7e/d4e/f53 67219 1 2024-04-25T17:19:03.905 INFO:tasks.workunit.client.0.smithi037.stdout:3/231: getdents d8/d23/d38 0 2024-04-25T17:19:03.912 INFO:tasks.workunit.client.0.smithi037.stdout:9/476: rmdir d1/d5/dc/d3c/d3e 39 2024-04-25T17:19:03.914 INFO:tasks.workunit.client.0.smithi037.stdout:5/387: getdents d7/d25/d4f 0 2024-04-25T17:19:03.916 INFO:tasks.workunit.client.0.smithi037.stdout:1/309: creat dc/d1c/f69 x:0 0 0 2024-04-25T17:19:03.917 INFO:tasks.workunit.client.0.smithi037.stdout:1/310: stat dc/d18/d39/c44 0 2024-04-25T17:19:03.918 INFO:tasks.workunit.client.0.smithi037.stdout:4/485: creat d7/d7e/d1e/d2b/d35/fa7 x:0 0 0 2024-04-25T17:19:03.926 INFO:tasks.workunit.client.0.smithi037.stdout:1/311: mkdir dc/d1c/d57/d4d/d6a 0 2024-04-25T17:19:03.927 INFO:tasks.workunit.client.0.smithi037.stdout:1/312: chown fb 7443 1 2024-04-25T17:19:03.931 INFO:tasks.workunit.client.0.smithi037.stdout:6/342: getdents db/d1d/d20/d63/d65 0 2024-04-25T17:19:03.935 INFO:tasks.workunit.client.0.smithi037.stdout:1/313: mkdir dc/d52/d6b 0 2024-04-25T17:19:03.935 INFO:tasks.workunit.client.0.smithi037.stdout:4/486: dread d7/d7e/d1e/d2b/d35/f40 [0,4194304] 0 2024-04-25T17:19:03.938 INFO:tasks.workunit.client.0.smithi037.stdout:3/232: mknod d8/d31/d32/c4a 0 2024-04-25T17:19:03.940 INFO:tasks.workunit.client.0.smithi037.stdout:6/343: symlink db/d1d/d20/d63/l7a 0 2024-04-25T17:19:03.943 INFO:tasks.workunit.client.0.smithi037.stdout:4/487: write d7/d7e/d1e/f3a [409997,35951] 0 2024-04-25T17:19:03.944 INFO:tasks.workunit.client.0.smithi037.stdout:3/233: dread d8/d23/f24 [0,4194304] 0 2024-04-25T17:19:03.944 INFO:tasks.workunit.client.0.smithi037.stdout:9/477: dwrite d1/d5/dc/d38/f71 [0,4194304] 0 2024-04-25T17:19:03.945 INFO:tasks.workunit.client.0.smithi037.stdout:6/344: unlink db/ff 0 2024-04-25T17:19:03.947 INFO:tasks.workunit.client.0.smithi037.stdout:9/478: chown d1/d5/dc/f23 32318 1 2024-04-25T17:19:03.951 INFO:tasks.workunit.client.0.smithi037.stdout:4/488: stat d7/d67 0 2024-04-25T17:19:03.952 INFO:tasks.workunit.client.0.smithi037.stdout:6/345: mknod db/d1d/c7b 0 2024-04-25T17:19:03.955 INFO:tasks.workunit.client.0.smithi037.stdout:9/479: stat d1/d48/d68/d26/d81/d9c/l73 0 2024-04-25T17:19:03.956 INFO:tasks.workunit.client.0.smithi037.stdout:9/480: dread - d1/d5/dc/d38/d8b/f60 zero size 2024-04-25T17:19:03.963 INFO:tasks.workunit.client.0.smithi037.stdout:9/481: rename d1/f16 to d1/d48/d68/d26/fa0 0 2024-04-25T17:19:03.964 INFO:tasks.workunit.client.0.smithi037.stdout:9/482: readlink d1/d5/d19/l43 0 2024-04-25T17:19:03.970 INFO:tasks.workunit.client.0.smithi037.stdout:9/483: rmdir d1/d48/d68/d26/d81/d9c 39 2024-04-25T17:19:03.980 INFO:tasks.workunit.client.0.smithi037.stdout:9/484: mkdir d1/d48/d68/d26/da1 0 2024-04-25T17:19:03.981 INFO:tasks.workunit.client.0.smithi037.stdout:6/346: link db/c4a db/d1d/d20/d63/d65/d68/c7c 0 2024-04-25T17:19:03.981 INFO:tasks.workunit.client.0.smithi037.stdout:7/384: sync 2024-04-25T17:19:03.982 INFO:tasks.workunit.client.0.smithi037.stdout:7/385: write d5/d15/f89 [715356,104868] 0 2024-04-25T17:19:03.983 INFO:tasks.workunit.client.0.smithi037.stdout:3/234: link d8/d11/c16 d8/d31/d32/c4b 0 2024-04-25T17:19:03.987 INFO:tasks.workunit.client.0.smithi037.stdout:9/485: chown d1/d5/dc/d3c/d3e/f59 37 1 2024-04-25T17:19:03.994 INFO:tasks.workunit.client.0.smithi037.stdout:4/489: dread d7/f49 [0,4194304] 0 2024-04-25T17:19:03.994 INFO:tasks.workunit.client.0.smithi037.stdout:7/386: creat d5/d5e/d76/f8a x:0 0 0 2024-04-25T17:19:03.995 INFO:tasks.workunit.client.0.smithi037.stdout:4/490: chown d7/d7e/l64 8 1 2024-04-25T17:19:04.000 INFO:tasks.workunit.client.0.smithi037.stdout:4/491: chown d7/d7e/d1e/f93 63270965 1 2024-04-25T17:19:04.001 INFO:tasks.workunit.client.0.smithi037.stdout:3/235: dread d8/d31/d32/f36 [0,4194304] 0 2024-04-25T17:19:04.002 INFO:tasks.workunit.client.0.smithi037.stdout:7/387: fsync d5/d15/d17/d25/d2b/f51 0 2024-04-25T17:19:04.003 INFO:tasks.workunit.client.0.smithi037.stdout:3/236: read - d8/f2c zero size 2024-04-25T17:19:04.005 INFO:tasks.workunit.client.0.smithi037.stdout:6/347: dwrite db/d53/f54 [0,4194304] 0 2024-04-25T17:19:04.012 INFO:tasks.workunit.client.0.smithi037.stdout:4/492: fdatasync d7/d7e/d1e/d2b/d35/f40 0 2024-04-25T17:19:04.015 INFO:tasks.workunit.client.0.smithi037.stdout:3/237: readlink d8/l18 0 2024-04-25T17:19:04.018 INFO:tasks.workunit.client.0.smithi037.stdout:7/388: creat d5/d15/d17/d1b/d27/f8b x:0 0 0 2024-04-25T17:19:04.021 INFO:tasks.workunit.client.0.smithi037.stdout:9/486: link d1/d5/l9f d1/d48/la2 0 2024-04-25T17:19:04.022 INFO:tasks.workunit.client.0.smithi037.stdout:9/487: dread - d1/d5/f98 zero size 2024-04-25T17:19:04.026 INFO:tasks.workunit.client.0.smithi037.stdout:7/389: creat d5/d15/d17/d25/d2b/d59/f8c x:0 0 0 2024-04-25T17:19:04.056 INFO:tasks.workunit.client.0.smithi037.stdout:7/390: creat d5/d15/d17/d1b/d27/f8d x:0 0 0 2024-04-25T17:19:04.056 INFO:tasks.workunit.client.0.smithi037.stdout:6/348: rename db/d1d/d20/d63 to db/d26/d2e/d7d 0 2024-04-25T17:19:04.058 INFO:tasks.workunit.client.0.smithi037.stdout:3/238: write d8/f1f [483473,95828] 0 2024-04-25T17:19:04.062 INFO:tasks.workunit.client.0.smithi037.stdout:4/493: dwrite d7/d7e/d1e/d2b/d35/d39/f3f [0,4194304] 0 2024-04-25T17:19:04.062 INFO:tasks.workunit.client.0.smithi037.stdout:6/349: rmdir db/d26/d2e/d3e 39 2024-04-25T17:19:04.066 INFO:tasks.workunit.client.0.smithi037.stdout:7/391: symlink d5/d5e/d76/l8e 0 2024-04-25T17:19:04.069 INFO:tasks.workunit.client.0.smithi037.stdout:9/488: creat d1/d48/d68/d26/d81/d9c/fa3 x:0 0 0 2024-04-25T17:19:04.069 INFO:tasks.workunit.client.0.smithi037.stdout:7/392: chown d5/d15/d17/d25/d2b/d59/f63 3 1 2024-04-25T17:19:04.070 INFO:tasks.workunit.client.0.smithi037.stdout:6/350: dwrite db/d1d/d20/f6d [0,4194304] 0 2024-04-25T17:19:04.071 INFO:tasks.workunit.client.0.smithi037.stdout:9/489: dread - d1/d5/d19/d6e/f78 zero size 2024-04-25T17:19:04.080 INFO:tasks.workunit.client.0.smithi037.stdout:7/393: read d5/d15/d17/d1b/f68 [944592,51862] 0 2024-04-25T17:19:04.081 INFO:tasks.workunit.client.0.smithi037.stdout:7/394: chown d5/d15 523179407 1 2024-04-25T17:19:04.087 INFO:tasks.workunit.client.0.smithi037.stdout:3/239: mkdir d8/d4c 0 2024-04-25T17:19:04.105 INFO:tasks.workunit.client.1.smithi069.stdout:6/62: creat d2/f14 x:0 0 0 2024-04-25T17:19:04.106 INFO:tasks.workunit.client.1.smithi069.stdout:6/63: read d2/f9 [3639371,72598] 0 2024-04-25T17:19:04.106 INFO:tasks.workunit.client.1.smithi069.stdout:5/51: dread f5 [0,4194304] 0 2024-04-25T17:19:04.106 INFO:tasks.workunit.client.1.smithi069.stdout:5/52: readlink l3 0 2024-04-25T17:19:04.107 INFO:tasks.workunit.client.1.smithi069.stdout:9/112: mkdir d2/da/dd/d1e/d2e 0 2024-04-25T17:19:04.108 INFO:tasks.workunit.client.1.smithi069.stdout:4/51: creat db/f11 x:0 0 0 2024-04-25T17:19:04.109 INFO:tasks.workunit.client.1.smithi069.stdout:4/52: write f8 [4302732,24780] 0 2024-04-25T17:19:04.109 INFO:tasks.workunit.client.1.smithi069.stdout:1/63: mkdir d1/d19 0 2024-04-25T17:19:04.110 INFO:tasks.workunit.client.0.smithi037.stdout:7/395: rmdir d5/d5e/d76 39 2024-04-25T17:19:04.110 INFO:tasks.workunit.client.1.smithi069.stdout:1/64: write d1/d4/d6/f7 [1575556,52028] 0 2024-04-25T17:19:04.111 INFO:tasks.workunit.client.0.smithi037.stdout:7/396: dread - d5/d15/d17/d1b/f5b zero size 2024-04-25T17:19:04.111 INFO:tasks.workunit.client.1.smithi069.stdout:1/65: stat d1/d4/fb 0 2024-04-25T17:19:04.112 INFO:tasks.workunit.client.1.smithi069.stdout:2/53: rmdir d0/d8 39 2024-04-25T17:19:04.113 INFO:tasks.workunit.client.0.smithi037.stdout:9/490: rmdir d1/d48/d68/d26/d81/d9c 39 2024-04-25T17:19:04.115 INFO:tasks.workunit.client.1.smithi069.stdout:7/85: creat d4/d6/d14/d15/f1e x:0 0 0 2024-04-25T17:19:04.117 INFO:tasks.workunit.client.0.smithi037.stdout:7/397: dwrite d5/d15/d17/d1b/d27/f5f [0,4194304] 0 2024-04-25T17:19:04.119 INFO:tasks.workunit.client.1.smithi069.stdout:2/54: dwrite d0/d1/fe [0,4194304] 0 2024-04-25T17:19:04.120 INFO:tasks.workunit.client.1.smithi069.stdout:0/65: symlink d0/d17/l18 0 2024-04-25T17:19:04.121 INFO:tasks.workunit.client.1.smithi069.stdout:7/86: dread d4/d6/fa [0,4194304] 0 2024-04-25T17:19:04.122 INFO:tasks.workunit.client.1.smithi069.stdout:5/53: unlink l8 0 2024-04-25T17:19:04.128 INFO:tasks.workunit.client.1.smithi069.stdout:4/53: chown db/ce 11577 1 2024-04-25T17:19:04.129 INFO:tasks.workunit.client.1.smithi069.stdout:4/54: write db/f10 [1021340,81817] 0 2024-04-25T17:19:04.129 INFO:tasks.workunit.client.1.smithi069.stdout:4/55: chown f0 12461235 1 2024-04-25T17:19:04.132 INFO:tasks.workunit.client.0.smithi037.stdout:7/398: rename d5/d15/d17/d25/d2b/c4c to d5/d15/d17/c8f 0 2024-04-25T17:19:04.135 INFO:tasks.workunit.client.0.smithi037.stdout:4/494: dwrite d7/f1a [4194304,4194304] 0 2024-04-25T17:19:04.136 INFO:tasks.workunit.client.1.smithi069.stdout:1/66: unlink d1/d4/de/f10 0 2024-04-25T17:19:04.137 INFO:tasks.workunit.client.1.smithi069.stdout:1/67: write d1/d4/d6/f16 [993122,68201] 0 2024-04-25T17:19:04.137 INFO:tasks.workunit.client.1.smithi069.stdout:1/68: stat d1/d19 0 2024-04-25T17:19:04.143 INFO:tasks.workunit.client.1.smithi069.stdout:8/63: creat f14 x:0 0 0 2024-04-25T17:19:04.143 INFO:tasks.workunit.client.1.smithi069.stdout:8/64: dread - f10 zero size 2024-04-25T17:19:04.145 INFO:tasks.workunit.client.0.smithi037.stdout:4/495: creat d7/d7e/d4e/da5/fa8 x:0 0 0 2024-04-25T17:19:04.147 INFO:tasks.workunit.client.0.smithi037.stdout:6/351: dwrite db/d26/d2e/d3e/f45 [4194304,4194304] 0 2024-04-25T17:19:04.147 INFO:tasks.workunit.client.1.smithi069.stdout:0/66: fdatasync d0/f4 0 2024-04-25T17:19:04.149 INFO:tasks.workunit.client.0.smithi037.stdout:6/352: write db/d26/d2e/d3e/d25/f6c [495766,62812] 0 2024-04-25T17:19:04.154 INFO:tasks.workunit.client.0.smithi037.stdout:4/496: fsync d7/f26 0 2024-04-25T17:19:04.155 INFO:tasks.workunit.client.1.smithi069.stdout:7/87: fsync d4/d6/d14/d15/f1e 0 2024-04-25T17:19:04.155 INFO:tasks.workunit.client.0.smithi037.stdout:4/497: readlink d7/d7e/d45/d4f/l7b 0 2024-04-25T17:19:04.156 INFO:tasks.workunit.client.1.smithi069.stdout:4/56: rmdir db 39 2024-04-25T17:19:04.156 INFO:tasks.workunit.client.1.smithi069.stdout:3/120: write d8/d16/f23 [1070824,61250] 0 2024-04-25T17:19:04.157 INFO:tasks.workunit.client.1.smithi069.stdout:1/69: dread d1/d4/d6/f16 [0,4194304] 0 2024-04-25T17:19:04.161 INFO:tasks.workunit.client.0.smithi037.stdout:4/498: rmdir d7/d67 39 2024-04-25T17:19:04.163 INFO:tasks.workunit.client.1.smithi069.stdout:8/65: fdatasync fb 0 2024-04-25T17:19:04.167 INFO:tasks.workunit.client.1.smithi069.stdout:9/113: dwrite d2/da/dd/d1e/f26 [0,4194304] 0 2024-04-25T17:19:04.169 INFO:tasks.workunit.client.1.smithi069.stdout:2/55: rename d0/d3 to d0/d8/d10 0 2024-04-25T17:19:04.169 INFO:tasks.workunit.client.1.smithi069.stdout:2/56: chown d0/d8 49989647 1 2024-04-25T17:19:04.169 INFO:tasks.workunit.client.1.smithi069.stdout:2/57: stat d0/f7 0 2024-04-25T17:19:04.174 INFO:tasks.workunit.client.1.smithi069.stdout:5/54: rename f0 to fc 0 2024-04-25T17:19:04.175 INFO:tasks.workunit.client.0.smithi037.stdout:4/499: chown d7/d7e/d1e/l60 206108 1 2024-04-25T17:19:04.178 INFO:tasks.workunit.client.1.smithi069.stdout:7/88: write d4/d6/fa [1901657,112745] 0 2024-04-25T17:19:04.182 INFO:tasks.workunit.client.1.smithi069.stdout:1/70: unlink d1/la 0 2024-04-25T17:19:04.186 INFO:tasks.workunit.client.1.smithi069.stdout:9/114: creat d2/da/dd/d1e/f2f x:0 0 0 2024-04-25T17:19:04.187 INFO:tasks.workunit.client.1.smithi069.stdout:4/57: dwrite db/f10 [0,4194304] 0 2024-04-25T17:19:04.187 INFO:tasks.workunit.client.1.smithi069.stdout:9/115: fsync d2/f8 0 2024-04-25T17:19:04.187 INFO:tasks.workunit.client.1.smithi069.stdout:3/121: rename d8/c2e to d8/d16/c30 0 2024-04-25T17:19:04.188 INFO:tasks.workunit.client.1.smithi069.stdout:9/116: chown d2/da/d14/d23 1040 1 2024-04-25T17:19:04.188 INFO:tasks.workunit.client.1.smithi069.stdout:9/117: dread - d2/f17 zero size 2024-04-25T17:19:04.189 INFO:tasks.workunit.client.1.smithi069.stdout:2/58: fsync d0/f7 0 2024-04-25T17:19:04.190 INFO:tasks.workunit.client.0.smithi037.stdout:4/500: write d7/d7e/d4e/f53 [4123531,89776] 0 2024-04-25T17:19:04.191 INFO:tasks.workunit.client.1.smithi069.stdout:6/64: getdents d2/d7 0 2024-04-25T17:19:04.191 INFO:tasks.workunit.client.1.smithi069.stdout:2/59: rename d0/d8/d10 to d0/d8/d10/d11 22 2024-04-25T17:19:04.191 INFO:tasks.workunit.client.1.smithi069.stdout:6/65: dread - d2/d7/f13 zero size 2024-04-25T17:19:04.193 INFO:tasks.workunit.client.1.smithi069.stdout:6/66: dread - d2/f10 zero size 2024-04-25T17:19:04.196 INFO:tasks.workunit.client.1.smithi069.stdout:3/122: dread d8/f1f [0,4194304] 0 2024-04-25T17:19:04.200 INFO:tasks.workunit.client.1.smithi069.stdout:2/60: dread d0/f7 [0,4194304] 0 2024-04-25T17:19:04.200 INFO:tasks.workunit.client.1.smithi069.stdout:8/66: symlink l15 0 2024-04-25T17:19:04.201 INFO:tasks.workunit.client.0.smithi037.stdout:4/501: dwrite d7/f3b [0,4194304] 0 2024-04-25T17:19:04.203 INFO:tasks.workunit.client.1.smithi069.stdout:8/67: truncate f12 237992 0 2024-04-25T17:19:04.203 INFO:tasks.workunit.client.1.smithi069.stdout:9/118: rmdir d2/da/d14 39 2024-04-25T17:19:04.204 INFO:tasks.workunit.client.1.smithi069.stdout:6/67: dwrite d2/f14 [0,4194304] 0 2024-04-25T17:19:04.207 INFO:tasks.workunit.client.1.smithi069.stdout:7/89: link d4/d6/d14/d15/f17 d4/d18/f1f 0 2024-04-25T17:19:04.208 INFO:tasks.workunit.client.1.smithi069.stdout:3/123: mkdir d8/d16/d31 0 2024-04-25T17:19:04.209 INFO:tasks.workunit.client.1.smithi069.stdout:6/68: chown d2/d7/fd 2684 1 2024-04-25T17:19:04.212 INFO:tasks.workunit.client.1.smithi069.stdout:4/58: link f0 db/f12 0 2024-04-25T17:19:04.212 INFO:tasks.workunit.client.1.smithi069.stdout:1/71: dwrite d1/f9 [0,4194304] 0 2024-04-25T17:19:04.213 INFO:tasks.workunit.client.1.smithi069.stdout:2/61: symlink d0/d1/l12 0 2024-04-25T17:19:04.214 INFO:tasks.workunit.client.1.smithi069.stdout:0/67: getdents d0/da/db 0 2024-04-25T17:19:04.215 INFO:tasks.workunit.client.1.smithi069.stdout:6/69: write d2/fe [493238,29168] 0 2024-04-25T17:19:04.216 INFO:tasks.workunit.client.1.smithi069.stdout:7/90: truncate d4/f10 1716750 0 2024-04-25T17:19:04.217 INFO:tasks.workunit.client.1.smithi069.stdout:5/55: dwrite f5 [0,4194304] 0 2024-04-25T17:19:04.217 INFO:tasks.workunit.client.1.smithi069.stdout:4/59: write db/f11 [822798,55464] 0 2024-04-25T17:19:04.218 INFO:tasks.workunit.client.1.smithi069.stdout:0/68: dread - d0/da/db/f13 zero size 2024-04-25T17:19:04.221 INFO:tasks.workunit.client.0.smithi037.stdout:4/502: dread d7/d7e/d1e/d2b/d35/f36 [0,4194304] 0 2024-04-25T17:19:04.222 INFO:tasks.workunit.client.1.smithi069.stdout:6/70: mknod d2/d7/c15 0 2024-04-25T17:19:04.226 INFO:tasks.workunit.client.1.smithi069.stdout:5/56: dread fc [0,4194304] 0 2024-04-25T17:19:04.227 INFO:tasks.workunit.client.1.smithi069.stdout:3/124: dwrite d8/d16/d1a/d2c/f2f [0,4194304] 0 2024-04-25T17:19:04.227 INFO:tasks.workunit.client.1.smithi069.stdout:2/62: dread d0/f7 [0,4194304] 0 2024-04-25T17:19:04.227 INFO:tasks.workunit.client.1.smithi069.stdout:5/57: stat l3 0 2024-04-25T17:19:04.228 INFO:tasks.workunit.client.1.smithi069.stdout:5/58: chown cb 32 1 2024-04-25T17:19:04.228 INFO:tasks.workunit.client.1.smithi069.stdout:3/125: chown f6 136092821 1 2024-04-25T17:19:04.229 INFO:tasks.workunit.client.1.smithi069.stdout:7/91: rmdir d4/d6/d14 39 2024-04-25T17:19:04.229 INFO:tasks.workunit.client.0.smithi037.stdout:4/503: dwrite d7/d7e/f3c [0,4194304] 0 2024-04-25T17:19:04.230 INFO:tasks.workunit.client.1.smithi069.stdout:5/59: readlink l3 0 2024-04-25T17:19:04.230 INFO:tasks.workunit.client.1.smithi069.stdout:2/63: write d0/d1/fe [3969335,14275] 0 2024-04-25T17:19:04.231 INFO:tasks.workunit.client.1.smithi069.stdout:3/126: chown d8/d16/f28 177 1 2024-04-25T17:19:04.231 INFO:tasks.workunit.client.1.smithi069.stdout:7/92: stat d4/d1a/f1c 0 2024-04-25T17:19:04.232 INFO:tasks.workunit.client.1.smithi069.stdout:5/60: fsync fa 0 2024-04-25T17:19:04.233 INFO:tasks.workunit.client.1.smithi069.stdout:7/93: stat d4/d1a/f1c 0 2024-04-25T17:19:04.236 INFO:tasks.workunit.client.0.smithi037.stdout:4/504: rmdir d7/d7e/d5b 39 2024-04-25T17:19:04.238 INFO:tasks.workunit.client.1.smithi069.stdout:1/72: dwrite d1/d4/de/d11/f18 [0,4194304] 0 2024-04-25T17:19:04.238 INFO:tasks.workunit.client.1.smithi069.stdout:4/60: write db/f12 [4063088,28514] 0 2024-04-25T17:19:04.241 INFO:tasks.workunit.client.1.smithi069.stdout:6/71: symlink d2/l16 0 2024-04-25T17:19:04.243 INFO:tasks.workunit.client.0.smithi037.stdout:4/505: mknod d7/d7e/d45/d4f/ca9 0 2024-04-25T17:19:04.248 INFO:tasks.workunit.client.1.smithi069.stdout:5/61: dwrite fa [0,4194304] 0 2024-04-25T17:19:04.250 INFO:tasks.workunit.client.1.smithi069.stdout:5/62: write f6 [3360516,98661] 0 2024-04-25T17:19:04.251 INFO:tasks.workunit.client.1.smithi069.stdout:9/119: creat d2/f30 x:0 0 0 2024-04-25T17:19:04.253 INFO:tasks.workunit.client.1.smithi069.stdout:9/120: fdatasync d2/da/dd/f2d 0 2024-04-25T17:19:04.256 INFO:tasks.workunit.client.1.smithi069.stdout:0/69: write d0/f4 [1227477,29403] 0 2024-04-25T17:19:04.256 INFO:tasks.workunit.client.1.smithi069.stdout:7/94: mknod d4/d1a/c20 0 2024-04-25T17:19:04.258 INFO:tasks.workunit.client.1.smithi069.stdout:8/68: getdents . 0 2024-04-25T17:19:04.258 INFO:tasks.workunit.client.1.smithi069.stdout:4/61: mknod db/c13 0 2024-04-25T17:19:04.259 INFO:tasks.workunit.client.1.smithi069.stdout:1/73: creat d1/d4/de/f1a x:0 0 0 2024-04-25T17:19:04.261 INFO:tasks.workunit.client.1.smithi069.stdout:6/72: creat d2/f17 x:0 0 0 2024-04-25T17:19:04.261 INFO:tasks.workunit.client.1.smithi069.stdout:8/69: dread ff [0,4194304] 0 2024-04-25T17:19:04.261 INFO:tasks.workunit.client.1.smithi069.stdout:5/63: creat fd x:0 0 0 2024-04-25T17:19:04.262 INFO:tasks.workunit.client.1.smithi069.stdout:5/64: write fd [779717,37311] 0 2024-04-25T17:19:04.264 INFO:tasks.workunit.client.1.smithi069.stdout:3/127: mknod d8/d16/d31/c32 0 2024-04-25T17:19:04.265 INFO:tasks.workunit.client.0.smithi037.stdout:2/355: sync 2024-04-25T17:19:04.265 INFO:tasks.workunit.client.1.smithi069.stdout:3/128: stat d8/f1f 0 2024-04-25T17:19:04.268 INFO:tasks.workunit.client.1.smithi069.stdout:4/62: creat db/f14 x:0 0 0 2024-04-25T17:19:04.270 INFO:tasks.workunit.client.1.smithi069.stdout:8/70: mknod c16 0 2024-04-25T17:19:04.270 INFO:tasks.workunit.client.1.smithi069.stdout:1/74: dwrite d1/d4/de/f1a [0,4194304] 0 2024-04-25T17:19:04.270 INFO:tasks.workunit.client.1.smithi069.stdout:6/73: creat d2/f18 x:0 0 0 2024-04-25T17:19:04.271 INFO:tasks.workunit.client.1.smithi069.stdout:4/63: write db/f10 [2881443,70046] 0 2024-04-25T17:19:04.272 INFO:tasks.workunit.client.0.smithi037.stdout:2/356: link d0/c10 d0/d16/d20/d59/c6b 0 2024-04-25T17:19:04.273 INFO:tasks.workunit.client.1.smithi069.stdout:5/65: unlink c4 0 2024-04-25T17:19:04.273 INFO:tasks.workunit.client.1.smithi069.stdout:2/64: link d0/f7 d0/d8/f13 0 2024-04-25T17:19:04.280 INFO:tasks.workunit.client.0.smithi037.stdout:2/357: dwrite d0/d16/d20/d59/f66 [0,4194304] 0 2024-04-25T17:19:04.280 INFO:tasks.workunit.client.1.smithi069.stdout:0/70: mkdir d0/d19 0 2024-04-25T17:19:04.281 INFO:tasks.workunit.client.1.smithi069.stdout:3/129: creat d8/d16/d31/f33 x:0 0 0 2024-04-25T17:19:04.281 INFO:tasks.workunit.client.1.smithi069.stdout:9/121: rmdir d2 39 2024-04-25T17:19:04.284 INFO:tasks.workunit.client.1.smithi069.stdout:1/75: dread d1/d4/d6/f7 [0,4194304] 0 2024-04-25T17:19:04.286 INFO:tasks.workunit.client.1.smithi069.stdout:1/76: write d1/f3 [291101,24790] 0 2024-04-25T17:19:04.288 INFO:tasks.workunit.client.0.smithi037.stdout:4/506: dwrite d7/d7e/d4e/f6d [0,4194304] 0 2024-04-25T17:19:04.289 INFO:tasks.workunit.client.1.smithi069.stdout:6/74: rename d2/c11 to d2/d7/c19 0 2024-04-25T17:19:04.289 INFO:tasks.workunit.client.0.smithi037.stdout:4/507: chown d7/d7e/d1e/d2b/d35/f40 9824322 1 2024-04-25T17:19:04.294 INFO:tasks.workunit.client.1.smithi069.stdout:4/64: mkdir db/d15 0 2024-04-25T17:19:04.295 INFO:tasks.workunit.client.0.smithi037.stdout:2/358: symlink d0/d16/d68/l6c 0 2024-04-25T17:19:04.296 INFO:tasks.workunit.client.1.smithi069.stdout:0/71: dread d0/f4 [0,4194304] 0 2024-04-25T17:19:04.297 INFO:tasks.workunit.client.1.smithi069.stdout:5/66: unlink fc 0 2024-04-25T17:19:04.300 INFO:tasks.workunit.client.1.smithi069.stdout:2/65: mknod d0/d8/c14 0 2024-04-25T17:19:04.305 INFO:tasks.workunit.client.0.smithi037.stdout:4/508: dwrite d7/f80 [0,4194304] 0 2024-04-25T17:19:04.306 INFO:tasks.workunit.client.0.smithi037.stdout:4/509: chown d7/d7e/d45/d4f/f96 265 1 2024-04-25T17:19:04.307 INFO:tasks.workunit.client.0.smithi037.stdout:4/510: chown d7/d7e/d1e/d2b/d35/fa7 3316661 1 2024-04-25T17:19:04.309 INFO:tasks.workunit.client.1.smithi069.stdout:3/130: dread d8/f1f [0,4194304] 0 2024-04-25T17:19:04.309 INFO:tasks.workunit.client.0.smithi037.stdout:4/511: dread - d7/d7e/d4e/f7f zero size 2024-04-25T17:19:04.310 INFO:tasks.workunit.client.1.smithi069.stdout:3/131: chown d8/fc 321 1 2024-04-25T17:19:04.310 INFO:tasks.workunit.client.1.smithi069.stdout:8/71: mknod c17 0 2024-04-25T17:19:04.310 INFO:tasks.workunit.client.1.smithi069.stdout:3/132: chown d8/d16/f1e 18715827 1 2024-04-25T17:19:04.312 INFO:tasks.workunit.client.1.smithi069.stdout:1/77: mkdir d1/d4/de/d11/d1b 0 2024-04-25T17:19:04.313 INFO:tasks.workunit.client.1.smithi069.stdout:6/75: mknod d2/c1a 0 2024-04-25T17:19:04.314 INFO:tasks.workunit.client.1.smithi069.stdout:7/95: write d4/d6/d14/d15/f17 [423413,18443] 0 2024-04-25T17:19:04.315 INFO:tasks.workunit.client.1.smithi069.stdout:3/133: dread d8/f12 [0,4194304] 0 2024-04-25T17:19:04.317 INFO:tasks.workunit.client.1.smithi069.stdout:8/72: dread f8 [0,4194304] 0 2024-04-25T17:19:04.320 INFO:tasks.workunit.client.1.smithi069.stdout:5/67: mknod ce 0 2024-04-25T17:19:04.321 INFO:tasks.workunit.client.1.smithi069.stdout:1/78: dwrite d1/d4/de/f1a [4194304,4194304] 0 2024-04-25T17:19:04.331 INFO:tasks.workunit.client.1.smithi069.stdout:6/76: rename d2/l4 to d2/l1b 0 2024-04-25T17:19:04.332 INFO:tasks.workunit.client.0.smithi037.stdout:4/512: write d7/d7e/d45/f8d [1646308,61438] 0 2024-04-25T17:19:04.334 INFO:tasks.workunit.client.1.smithi069.stdout:4/65: rename db/f10 to db/f16 0 2024-04-25T17:19:04.335 INFO:tasks.workunit.client.1.smithi069.stdout:3/134: creat d8/f34 x:0 0 0 2024-04-25T17:19:04.335 INFO:tasks.workunit.client.1.smithi069.stdout:3/135: chown f4 9 1 2024-04-25T17:19:04.336 INFO:tasks.workunit.client.0.smithi037.stdout:4/513: mknod d7/d7e/d1e/d70/caa 0 2024-04-25T17:19:04.339 INFO:tasks.workunit.client.0.smithi037.stdout:4/514: creat d7/d7e/d4e/da5/fab x:0 0 0 2024-04-25T17:19:04.342 INFO:tasks.workunit.client.1.smithi069.stdout:1/79: rmdir d1/d4/de/d11 39 2024-04-25T17:19:04.345 INFO:tasks.workunit.client.1.smithi069.stdout:5/68: readlink l7 0 2024-04-25T17:19:04.351 INFO:tasks.workunit.client.0.smithi037.stdout:4/515: creat d7/d7e/d1e/d2b/d35/d39/fac x:0 0 0 2024-04-25T17:19:04.352 INFO:tasks.workunit.client.0.smithi037.stdout:4/516: read d7/f3b [3179287,51602] 0 2024-04-25T17:19:04.352 INFO:tasks.workunit.client.0.smithi037.stdout:4/517: write d7/d7e/d45/f8d [2243078,124440] 0 2024-04-25T17:19:04.354 INFO:tasks.workunit.client.1.smithi069.stdout:7/96: mkdir d4/d6/d21 0 2024-04-25T17:19:04.355 INFO:tasks.workunit.client.1.smithi069.stdout:2/66: dwrite d0/d8/f13 [0,4194304] 0 2024-04-25T17:19:04.357 INFO:tasks.workunit.client.1.smithi069.stdout:6/77: rename d2/d7/f13 to d2/f1c 0 2024-04-25T17:19:04.360 INFO:tasks.workunit.client.1.smithi069.stdout:3/136: write d8/f12 [91072,54063] 0 2024-04-25T17:19:04.361 INFO:tasks.workunit.client.1.smithi069.stdout:3/137: stat d8/d16/d1a/l29 0 2024-04-25T17:19:04.362 INFO:tasks.workunit.client.1.smithi069.stdout:3/138: write d8/d16/f28 [711104,91265] 0 2024-04-25T17:19:04.362 INFO:tasks.workunit.client.1.smithi069.stdout:8/73: unlink ca 0 2024-04-25T17:19:04.362 INFO:tasks.workunit.client.1.smithi069.stdout:8/74: rmdir - no directory 2024-04-25T17:19:04.362 INFO:tasks.workunit.client.1.smithi069.stdout:8/75: rmdir - no directory 2024-04-25T17:19:04.365 INFO:tasks.workunit.client.1.smithi069.stdout:0/72: link d0/fc d0/f1a 0 2024-04-25T17:19:04.365 INFO:tasks.workunit.client.1.smithi069.stdout:0/73: write d0/da/db/f15 [429399,27493] 0 2024-04-25T17:19:04.368 INFO:tasks.workunit.client.1.smithi069.stdout:1/80: unlink d1/f3 0 2024-04-25T17:19:04.368 INFO:tasks.workunit.client.1.smithi069.stdout:1/81: fdatasync d1/f5 0 2024-04-25T17:19:04.372 INFO:tasks.workunit.client.0.smithi037.stdout:4/518: dread d7/d7e/d1e/f3a [0,4194304] 0 2024-04-25T17:19:04.373 INFO:tasks.workunit.client.1.smithi069.stdout:6/78: mknod d2/d7/c1d 0 2024-04-25T17:19:04.373 INFO:tasks.workunit.client.1.smithi069.stdout:6/79: stat d2/cb 0 2024-04-25T17:19:04.375 INFO:tasks.workunit.client.1.smithi069.stdout:8/76: write fe [4288552,110713] 0 2024-04-25T17:19:04.377 INFO:tasks.workunit.client.0.smithi037.stdout:4/519: rmdir d7/d7e/d1e/d2b/d35/d39/d7a 39 2024-04-25T17:19:04.378 INFO:tasks.workunit.client.0.smithi037.stdout:4/520: chown d7/d7e/d4e/f6c 192 1 2024-04-25T17:19:04.379 INFO:tasks.workunit.client.1.smithi069.stdout:3/139: rename d8/f34 to d8/d16/d1a/d2c/f35 0 2024-04-25T17:19:04.381 INFO:tasks.workunit.client.1.smithi069.stdout:9/122: truncate d2/da/d14/f25 1028771 0 2024-04-25T17:19:04.384 INFO:tasks.workunit.client.0.smithi037.stdout:4/521: write d7/f49 [1842042,75146] 0 2024-04-25T17:19:04.388 INFO:tasks.workunit.client.0.smithi037.stdout:4/522: mknod d7/cad 0 2024-04-25T17:19:04.391 INFO:tasks.workunit.client.0.smithi037.stdout:4/523: read d7/f34 [2594032,26806] 0 2024-04-25T17:19:04.393 INFO:tasks.workunit.client.0.smithi037.stdout:4/524: mkdir d7/d7e/d1e/dae 0 2024-04-25T17:19:04.395 INFO:tasks.workunit.client.0.smithi037.stdout:4/525: rmdir d7/d67 39 2024-04-25T17:19:04.396 INFO:tasks.workunit.client.0.smithi037.stdout:4/526: mknod d7/d7e/d5b/caf 0 2024-04-25T17:19:04.398 INFO:tasks.workunit.client.0.smithi037.stdout:4/527: mkdir d7/d7e/d1e/dae/db0 0 2024-04-25T17:19:04.400 INFO:tasks.workunit.client.0.smithi037.stdout:4/528: unlink d7/d7e/d4e/f6c 0 2024-04-25T17:19:04.401 INFO:tasks.workunit.client.1.smithi069.stdout:4/66: link db/f16 db/d15/f17 0 2024-04-25T17:19:04.402 INFO:tasks.workunit.client.0.smithi037.stdout:4/529: write d7/ff [3592068,127403] 0 2024-04-25T17:19:04.402 INFO:tasks.workunit.client.1.smithi069.stdout:3/140: mknod d8/d16/d31/c36 0 2024-04-25T17:19:04.406 INFO:tasks.workunit.client.0.smithi037.stdout:4/530: creat d7/fb1 x:0 0 0 2024-04-25T17:19:04.408 INFO:tasks.workunit.client.1.smithi069.stdout:2/67: getdents d0/d1 0 2024-04-25T17:19:04.408 INFO:tasks.workunit.client.1.smithi069.stdout:7/97: getdents d4/d6/d14 0 2024-04-25T17:19:04.409 INFO:tasks.workunit.client.1.smithi069.stdout:1/82: dread d1/d4/d6/f7 [0,4194304] 0 2024-04-25T17:19:04.409 INFO:tasks.workunit.client.0.smithi037.stdout:4/531: truncate d7/f3b 2855188 0 2024-04-25T17:19:04.410 INFO:tasks.workunit.client.1.smithi069.stdout:6/80: dwrite d2/d7/fd [4194304,4194304] 0 2024-04-25T17:19:04.411 INFO:tasks.workunit.client.1.smithi069.stdout:9/123: creat d2/da/dd/f31 x:0 0 0 2024-04-25T17:19:04.412 INFO:tasks.workunit.client.1.smithi069.stdout:5/69: getdents . 0 2024-04-25T17:19:04.413 INFO:tasks.workunit.client.0.smithi037.stdout:4/532: dread d7/d7e/d45/f5a [0,4194304] 0 2024-04-25T17:19:04.415 INFO:tasks.workunit.client.1.smithi069.stdout:8/77: rename c6 to c18 0 2024-04-25T17:19:04.419 INFO:tasks.workunit.client.0.smithi037.stdout:4/533: fsync d7/d7e/d1e/d2b/d35/fa7 0 2024-04-25T17:19:04.422 INFO:tasks.workunit.client.1.smithi069.stdout:6/81: mkdir d2/d1e 0 2024-04-25T17:19:04.424 INFO:tasks.workunit.client.0.smithi037.stdout:8/206: sync 2024-04-25T17:19:04.424 INFO:tasks.workunit.client.0.smithi037.stdout:0/390: sync 2024-04-25T17:19:04.426 INFO:tasks.workunit.client.1.smithi069.stdout:2/68: dwrite d0/d8/f13 [0,4194304] 0 2024-04-25T17:19:04.427 INFO:tasks.workunit.client.1.smithi069.stdout:5/70: mknod cf 0 2024-04-25T17:19:04.432 INFO:tasks.workunit.client.1.smithi069.stdout:7/98: dwrite d4/d6/d14/d15/f17 [0,4194304] 0 2024-04-25T17:19:04.432 INFO:tasks.workunit.client.1.smithi069.stdout:4/67: dwrite db/f16 [4194304,4194304] 0 2024-04-25T17:19:04.434 INFO:tasks.workunit.client.0.smithi037.stdout:8/207: dwrite d5/db/d23/f29 [0,4194304] 0 2024-04-25T17:19:04.435 INFO:tasks.workunit.client.1.smithi069.stdout:3/141: dwrite d8/f19 [0,4194304] 0 2024-04-25T17:19:04.437 INFO:tasks.workunit.client.1.smithi069.stdout:4/68: write db/d15/f17 [6866879,32562] 0 2024-04-25T17:19:04.439 INFO:tasks.workunit.client.1.smithi069.stdout:1/83: truncate d1/f5 629893 0 2024-04-25T17:19:04.440 INFO:tasks.workunit.client.1.smithi069.stdout:7/99: write d4/d6/d14/d15/f17 [2140885,57089] 0 2024-04-25T17:19:04.442 INFO:tasks.workunit.client.1.smithi069.stdout:4/69: write db/f16 [4975146,92127] 0 2024-04-25T17:19:04.443 INFO:tasks.workunit.client.1.smithi069.stdout:7/100: chown d4/ce 0 1 2024-04-25T17:19:04.444 INFO:tasks.workunit.client.1.smithi069.stdout:6/82: write d2/f1c [943393,125209] 0 2024-04-25T17:19:04.448 INFO:tasks.workunit.client.1.smithi069.stdout:2/69: dread d0/d8/f13 [0,4194304] 0 2024-04-25T17:19:04.452 INFO:tasks.workunit.client.0.smithi037.stdout:8/208: rename d5/fe to d5/d26/d33/f34 0 2024-04-25T17:19:04.453 INFO:tasks.workunit.client.1.smithi069.stdout:9/124: truncate d2/da/dd/f11 7657717 0 2024-04-25T17:19:04.454 INFO:tasks.workunit.client.1.smithi069.stdout:7/101: dwrite d4/f10 [0,4194304] 0 2024-04-25T17:19:04.456 INFO:tasks.workunit.client.1.smithi069.stdout:3/142: creat d8/f37 x:0 0 0 2024-04-25T17:19:04.461 INFO:tasks.workunit.client.0.smithi037.stdout:0/391: rename d9/d14/d23/f30 to d9/d71/f8e 0 2024-04-25T17:19:04.461 INFO:tasks.workunit.client.0.smithi037.stdout:4/534: dread d7/d7e/d5b/f6a [0,4194304] 0 2024-04-25T17:19:04.466 INFO:tasks.workunit.client.1.smithi069.stdout:1/84: write d1/df/d12/f14 [520306,109005] 0 2024-04-25T17:19:04.467 INFO:tasks.workunit.client.0.smithi037.stdout:8/209: creat d5/f35 x:0 0 0 2024-04-25T17:19:04.469 INFO:tasks.workunit.client.1.smithi069.stdout:6/83: creat d2/f1f x:0 0 0 2024-04-25T17:19:04.469 INFO:tasks.workunit.client.1.smithi069.stdout:6/84: stat d2/l3 0 2024-04-25T17:19:04.472 INFO:tasks.workunit.client.0.smithi037.stdout:8/210: creat d5/d26/d33/f36 x:0 0 0 2024-04-25T17:19:04.472 INFO:tasks.workunit.client.0.smithi037.stdout:8/211: readlink d5/db/d18/l31 0 2024-04-25T17:19:04.473 INFO:tasks.workunit.client.0.smithi037.stdout:0/392: symlink d9/df/d32/l8f 0 2024-04-25T17:19:04.474 INFO:tasks.workunit.client.1.smithi069.stdout:9/125: symlink d2/da/dd/d1e/l32 0 2024-04-25T17:19:04.477 INFO:tasks.workunit.client.1.smithi069.stdout:7/102: rename d4/d1a/c20 to d4/d6/d14/c22 0 2024-04-25T17:19:04.478 INFO:tasks.workunit.client.1.smithi069.stdout:7/103: readlink d4/d6/l11 0 2024-04-25T17:19:04.480 INFO:tasks.workunit.client.1.smithi069.stdout:4/70: creat db/d15/f18 x:0 0 0 2024-04-25T17:19:04.481 INFO:tasks.workunit.client.1.smithi069.stdout:4/71: stat db/d15 0 2024-04-25T17:19:04.487 INFO:tasks.workunit.client.1.smithi069.stdout:6/85: rename d2/d7/f8 to d2/f20 0 2024-04-25T17:19:04.488 INFO:tasks.workunit.client.1.smithi069.stdout:6/86: dread - d2/f17 zero size 2024-04-25T17:19:04.489 INFO:tasks.workunit.client.1.smithi069.stdout:5/71: rename cb to c10 0 2024-04-25T17:19:04.491 INFO:tasks.workunit.client.1.smithi069.stdout:4/72: mknod db/d15/c19 0 2024-04-25T17:19:04.494 INFO:tasks.workunit.client.0.smithi037.stdout:4/535: fsync d7/f3b 0 2024-04-25T17:19:04.494 INFO:tasks.workunit.client.1.smithi069.stdout:8/78: link l15 l19 0 2024-04-25T17:19:04.494 INFO:tasks.workunit.client.1.smithi069.stdout:8/79: rmdir - no directory 2024-04-25T17:19:04.496 INFO:tasks.workunit.client.1.smithi069.stdout:2/70: creat d0/f15 x:0 0 0 2024-04-25T17:19:04.497 INFO:tasks.workunit.client.1.smithi069.stdout:2/71: readlink d0/d1/l12 0 2024-04-25T17:19:04.499 INFO:tasks.workunit.client.1.smithi069.stdout:7/104: mkdir d4/d6/d21/d23 0 2024-04-25T17:19:04.501 INFO:tasks.workunit.client.0.smithi037.stdout:4/536: mkdir d7/d7e/d1e/d2b/d35/d39/d7a/db2 0 2024-04-25T17:19:04.507 INFO:tasks.workunit.client.1.smithi069.stdout:1/85: symlink d1/d4/de/d11/d1b/l1c 0 2024-04-25T17:19:04.511 INFO:tasks.workunit.client.1.smithi069.stdout:6/87: dwrite d2/f9 [0,4194304] 0 2024-04-25T17:19:04.515 INFO:tasks.workunit.client.0.smithi037.stdout:0/393: write d9/d14/d28/f62 [4733000,50242] 0 2024-04-25T17:19:04.516 INFO:tasks.workunit.client.0.smithi037.stdout:0/394: write d9/df/d32/f70 [926081,96696] 0 2024-04-25T17:19:04.517 INFO:tasks.workunit.client.0.smithi037.stdout:8/212: write d5/f9 [4049532,120399] 0 2024-04-25T17:19:04.518 INFO:tasks.workunit.client.0.smithi037.stdout:0/395: fdatasync d9/df/d32/d39/f7c 0 2024-04-25T17:19:04.519 INFO:tasks.workunit.client.1.smithi069.stdout:7/105: unlink d4/d6/d14/d15/f1e 0 2024-04-25T17:19:04.520 INFO:tasks.workunit.client.1.smithi069.stdout:7/106: stat l0 0 2024-04-25T17:19:04.522 INFO:tasks.workunit.client.1.smithi069.stdout:2/72: dwrite d0/f7 [0,4194304] 0 2024-04-25T17:19:04.524 INFO:tasks.workunit.client.1.smithi069.stdout:5/72: chown c10 600464135 1 2024-04-25T17:19:04.525 INFO:tasks.workunit.client.1.smithi069.stdout:4/73: rmdir db/d15 39 2024-04-25T17:19:04.525 INFO:tasks.workunit.client.1.smithi069.stdout:4/74: dread - db/f14 zero size 2024-04-25T17:19:04.530 INFO:tasks.workunit.client.0.smithi037.stdout:0/396: dread d9/df/f45 [0,4194304] 0 2024-04-25T17:19:04.530 INFO:tasks.workunit.client.1.smithi069.stdout:9/126: truncate d2/f6 1418853 0 2024-04-25T17:19:04.531 INFO:tasks.workunit.client.1.smithi069.stdout:7/107: creat d4/d1a/f24 x:0 0 0 2024-04-25T17:19:04.532 INFO:tasks.workunit.client.1.smithi069.stdout:2/73: rmdir d0/d1 39 2024-04-25T17:19:04.534 INFO:tasks.workunit.client.1.smithi069.stdout:5/73: readlink l2 0 2024-04-25T17:19:04.535 INFO:tasks.workunit.client.1.smithi069.stdout:7/108: dread d4/d6/fa [0,4194304] 0 2024-04-25T17:19:04.536 INFO:tasks.workunit.client.0.smithi037.stdout:4/537: truncate d7/d7e/d5b/f6a 4164168 0 2024-04-25T17:19:04.537 INFO:tasks.workunit.client.1.smithi069.stdout:7/109: write d4/d6/d14/d15/f17 [1082922,106743] 0 2024-04-25T17:19:04.537 INFO:tasks.workunit.client.0.smithi037.stdout:8/213: write d5/db/f12 [3281051,86933] 0 2024-04-25T17:19:04.540 INFO:tasks.workunit.client.1.smithi069.stdout:6/88: link d2/d7/fc d2/f21 0 2024-04-25T17:19:04.540 INFO:tasks.workunit.client.0.smithi037.stdout:4/538: symlink d7/d7e/d1e/d2b/d35/lb3 0 2024-04-25T17:19:04.541 INFO:tasks.workunit.client.1.smithi069.stdout:6/89: write d2/f17 [397826,58316] 0 2024-04-25T17:19:04.544 INFO:tasks.workunit.client.1.smithi069.stdout:7/110: dwrite d4/f10 [0,4194304] 0 2024-04-25T17:19:04.546 INFO:tasks.workunit.client.0.smithi037.stdout:0/397: truncate d9/d14/d28/d48/f50 1221593 0 2024-04-25T17:19:04.547 INFO:tasks.workunit.client.0.smithi037.stdout:8/214: mknod d5/c37 0 2024-04-25T17:19:04.549 INFO:tasks.workunit.client.0.smithi037.stdout:4/539: creat d7/d7e/d1e/dae/db0/fb4 x:0 0 0 2024-04-25T17:19:04.552 INFO:tasks.workunit.client.0.smithi037.stdout:0/398: rmdir d9/d14 39 2024-04-25T17:19:04.556 INFO:tasks.workunit.client.0.smithi037.stdout:0/399: dread - d9/df/d32/f47 zero size 2024-04-25T17:19:04.557 INFO:tasks.workunit.client.0.smithi037.stdout:4/540: dwrite d7/d7e/d1e/dae/db0/fb4 [0,4194304] 0 2024-04-25T17:19:04.560 INFO:tasks.workunit.client.1.smithi069.stdout:8/80: rename l11 to l1a 0 2024-04-25T17:19:04.565 INFO:tasks.workunit.client.1.smithi069.stdout:0/74: sync 2024-04-25T17:19:04.568 INFO:tasks.workunit.client.1.smithi069.stdout:7/111: unlink d4/ce 0 2024-04-25T17:19:04.568 INFO:tasks.workunit.client.1.smithi069.stdout:7/112: readlink d4/d6/l11 0 2024-04-25T17:19:04.570 INFO:tasks.workunit.client.1.smithi069.stdout:2/74: symlink d0/l16 0 2024-04-25T17:19:04.571 INFO:tasks.workunit.client.0.smithi037.stdout:4/541: symlink d7/d7e/d1e/d70/lb5 0 2024-04-25T17:19:04.573 INFO:tasks.workunit.client.1.smithi069.stdout:7/113: dwrite d4/f10 [0,4194304] 0 2024-04-25T17:19:04.573 INFO:tasks.workunit.client.1.smithi069.stdout:7/114: chown d4/c16 10476305 1 2024-04-25T17:19:04.574 INFO:tasks.workunit.client.1.smithi069.stdout:7/115: chown d4/d6/cc 5823 1 2024-04-25T17:19:04.574 INFO:tasks.workunit.client.1.smithi069.stdout:5/74: unlink f1 0 2024-04-25T17:19:04.575 INFO:tasks.workunit.client.0.smithi037.stdout:8/215: dread d5/da/f11 [0,4194304] 0 2024-04-25T17:19:04.576 INFO:tasks.workunit.client.1.smithi069.stdout:1/86: getdents d1/d4/de 0 2024-04-25T17:19:04.578 INFO:tasks.workunit.client.0.smithi037.stdout:0/400: getdents d9/d71 0 2024-04-25T17:19:04.580 INFO:tasks.workunit.client.0.smithi037.stdout:4/542: mknod d7/d7e/d1e/d2b/d35/d39/cb6 0 2024-04-25T17:19:04.580 INFO:tasks.workunit.client.1.smithi069.stdout:8/81: dread ff [0,4194304] 0 2024-04-25T17:19:04.581 INFO:tasks.workunit.client.1.smithi069.stdout:6/90: link d2/f1f d2/d7/f22 0 2024-04-25T17:19:04.582 INFO:tasks.workunit.client.1.smithi069.stdout:6/91: dread - d2/f1f zero size 2024-04-25T17:19:04.582 INFO:tasks.workunit.client.1.smithi069.stdout:9/127: creat d2/f33 x:0 0 0 2024-04-25T17:19:04.582 INFO:tasks.workunit.client.1.smithi069.stdout:6/92: write d2/f1c [2032657,101668] 0 2024-04-25T17:19:04.583 INFO:tasks.workunit.client.0.smithi037.stdout:0/401: chown d9/df/d32/d35/c87 824 1 2024-04-25T17:19:04.584 INFO:tasks.workunit.client.1.smithi069.stdout:6/93: read - d2/d7/fa zero size 2024-04-25T17:19:04.585 INFO:tasks.workunit.client.1.smithi069.stdout:6/94: chown d2/f18 998576504 1 2024-04-25T17:19:04.585 INFO:tasks.workunit.client.1.smithi069.stdout:0/75: dread d0/f4 [0,4194304] 0 2024-04-25T17:19:04.589 INFO:tasks.workunit.client.1.smithi069.stdout:9/128: dwrite d2/da/f13 [0,4194304] 0 2024-04-25T17:19:04.590 INFO:tasks.workunit.client.1.smithi069.stdout:9/129: read - d2/f29 zero size 2024-04-25T17:19:04.596 INFO:tasks.workunit.client.1.smithi069.stdout:9/130: dwrite d2/da/dd/d1e/f26 [0,4194304] 0 2024-04-25T17:19:04.598 INFO:tasks.workunit.client.1.smithi069.stdout:9/131: read d2/da/f20 [806448,81079] 0 2024-04-25T17:19:04.600 INFO:tasks.workunit.client.1.smithi069.stdout:3/143: sync 2024-04-25T17:19:04.605 INFO:tasks.workunit.client.0.smithi037.stdout:4/543: dread d7/d7e/d4e/f71 [0,4194304] 0 2024-04-25T17:19:04.633 INFO:tasks.workunit.client.0.smithi037.stdout:5/388: sync 2024-04-25T17:19:04.635 INFO:tasks.workunit.client.1.smithi069.stdout:7/116: mknod d4/d6/d14/c25 0 2024-04-25T17:19:04.638 INFO:tasks.workunit.client.0.smithi037.stdout:0/402: unlink d9/f2f 0 2024-04-25T17:19:04.640 INFO:tasks.workunit.client.0.smithi037.stdout:4/544: rmdir d7/d7e/d1e/d2b/d35/d39/d7a 39 2024-04-25T17:19:04.641 INFO:tasks.workunit.client.1.smithi069.stdout:4/75: link c9 db/d15/c1a 0 2024-04-25T17:19:04.647 INFO:tasks.workunit.client.0.smithi037.stdout:0/403: truncate d9/d14/d28/d48/d58/f77 279268 0 2024-04-25T17:19:04.648 INFO:tasks.workunit.client.0.smithi037.stdout:8/216: truncate f4 129304 0 2024-04-25T17:19:04.650 INFO:tasks.workunit.client.0.smithi037.stdout:5/389: mkdir d7/d18/d7c 0 2024-04-25T17:19:04.653 INFO:tasks.workunit.client.1.smithi069.stdout:1/87: write d1/d4/d6/f16 [1670425,120575] 0 2024-04-25T17:19:04.654 INFO:tasks.workunit.client.1.smithi069.stdout:1/88: chown d1/df/d12/c15 12039 1 2024-04-25T17:19:04.654 INFO:tasks.workunit.client.1.smithi069.stdout:1/89: fsync d1/d4/de/f1a 0 2024-04-25T17:19:04.654 INFO:tasks.workunit.client.0.smithi037.stdout:0/404: creat d9/df/d32/d35/f90 x:0 0 0 2024-04-25T17:19:04.656 INFO:tasks.workunit.client.0.smithi037.stdout:0/405: dread - d9/d14/d28/f5b zero size 2024-04-25T17:19:04.656 INFO:tasks.workunit.client.0.smithi037.stdout:5/390: dwrite d7/d43/f30 [0,4194304] 0 2024-04-25T17:19:04.657 INFO:tasks.workunit.client.1.smithi069.stdout:1/90: fdatasync d1/d4/d6/f16 0 2024-04-25T17:19:04.660 INFO:tasks.workunit.client.0.smithi037.stdout:4/545: rename d7/d7e/l22 to d7/d7e/d1e/lb7 0 2024-04-25T17:19:04.661 INFO:tasks.workunit.client.0.smithi037.stdout:4/546: write d7/d7e/f3c [161837,45095] 0 2024-04-25T17:19:04.662 INFO:tasks.workunit.client.0.smithi037.stdout:5/391: read d7/d18/f22 [419251,6232] 0 2024-04-25T17:19:04.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:04 smithi069 ceph-mon[34527]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:19:04.668 INFO:tasks.workunit.client.0.smithi037.stdout:5/392: dread d7/f56 [0,4194304] 0 2024-04-25T17:19:04.669 INFO:tasks.workunit.client.0.smithi037.stdout:5/393: stat d7/d12/f50 0 2024-04-25T17:19:04.671 INFO:tasks.workunit.client.1.smithi069.stdout:3/144: truncate d8/f1f 1668041 0 2024-04-25T17:19:04.672 INFO:tasks.workunit.client.0.smithi037.stdout:8/217: getdents d5/d26/d33 0 2024-04-25T17:19:04.673 INFO:tasks.workunit.client.1.smithi069.stdout:7/117: creat d4/d6/d14/d15/f26 x:0 0 0 2024-04-25T17:19:04.675 INFO:tasks.workunit.client.1.smithi069.stdout:5/75: unlink l3 0 2024-04-25T17:19:04.677 INFO:tasks.workunit.client.0.smithi037.stdout:0/406: write d9/d14/d23/f3c [1003526,21488] 0 2024-04-25T17:19:04.681 INFO:tasks.workunit.client.0.smithi037.stdout:8/218: rename d5/db/fc to d5/db/d23/f38 0 2024-04-25T17:19:04.682 INFO:tasks.workunit.client.1.smithi069.stdout:8/82: symlink l1b 0 2024-04-25T17:19:04.684 INFO:tasks.workunit.client.0.smithi037.stdout:5/394: symlink d7/l7d 0 2024-04-25T17:19:04.686 INFO:tasks.workunit.client.1.smithi069.stdout:2/75: creat d0/f17 x:0 0 0 2024-04-25T17:19:04.687 INFO:tasks.workunit.client.1.smithi069.stdout:1/91: mkdir d1/df/d12/d1d 0 2024-04-25T17:19:04.688 INFO:tasks.workunit.client.0.smithi037.stdout:8/219: symlink d5/d26/l39 0 2024-04-25T17:19:04.689 INFO:tasks.workunit.client.1.smithi069.stdout:8/83: dwrite fe [0,4194304] 0 2024-04-25T17:19:04.689 INFO:tasks.workunit.client.0.smithi037.stdout:8/220: fdatasync d5/db/d23/f1e 0 2024-04-25T17:19:04.691 INFO:tasks.workunit.client.0.smithi037.stdout:4/547: creat d7/d7e/d1e/d2b/d35/d39/fb8 x:0 0 0 2024-04-25T17:19:04.692 INFO:tasks.workunit.client.1.smithi069.stdout:0/76: getdents d0/da/db 0 2024-04-25T17:19:04.692 INFO:tasks.workunit.client.1.smithi069.stdout:0/77: readlink d0/l12 0 2024-04-25T17:19:04.693 INFO:tasks.workunit.client.1.smithi069.stdout:0/78: chown d0/f6 0 1 2024-04-25T17:19:04.696 INFO:tasks.workunit.client.1.smithi069.stdout:9/132: creat d2/da/dd/d1e/d2e/f34 x:0 0 0 2024-04-25T17:19:04.699 INFO:tasks.workunit.client.1.smithi069.stdout:3/145: mkdir d8/d16/d1a/d38 0 2024-04-25T17:19:04.701 INFO:tasks.workunit.client.1.smithi069.stdout:0/79: dwrite d0/da/f10 [0,4194304] 0 2024-04-25T17:19:04.702 INFO:tasks.workunit.client.0.smithi037.stdout:8/221: symlink d5/l3a 0 2024-04-25T17:19:04.705 INFO:tasks.workunit.client.1.smithi069.stdout:2/76: creat d0/d8/f18 x:0 0 0 2024-04-25T17:19:04.705 INFO:tasks.workunit.client.1.smithi069.stdout:2/77: readlink d0/l16 0 2024-04-25T17:19:04.708 INFO:tasks.workunit.client.0.smithi037.stdout:8/222: write d5/da/f11 [1886512,76787] 0 2024-04-25T17:19:04.710 INFO:tasks.workunit.client.0.smithi037.stdout:8/223: read d5/da/f11 [4142244,71767] 0 2024-04-25T17:19:04.711 INFO:tasks.workunit.client.1.smithi069.stdout:8/84: dread fb [0,4194304] 0 2024-04-25T17:19:04.712 INFO:tasks.workunit.client.0.smithi037.stdout:0/407: truncate d9/df/d32/f5c 1692318 0 2024-04-25T17:19:04.713 INFO:tasks.workunit.client.1.smithi069.stdout:9/133: dread d2/f6 [0,4194304] 0 2024-04-25T17:19:04.713 INFO:tasks.workunit.client.1.smithi069.stdout:7/118: creat d4/d6/d21/d23/f27 x:0 0 0 2024-04-25T17:19:04.714 INFO:tasks.workunit.client.0.smithi037.stdout:5/395: dwrite d7/f1f [0,4194304] 0 2024-04-25T17:19:04.714 INFO:tasks.workunit.client.1.smithi069.stdout:7/119: read - d4/d6/d14/d15/f26 zero size 2024-04-25T17:19:04.715 INFO:tasks.workunit.client.1.smithi069.stdout:3/146: mkdir d8/d39 0 2024-04-25T17:19:04.716 INFO:tasks.workunit.client.1.smithi069.stdout:3/147: stat d8/d16/d1a/d38 0 2024-04-25T17:19:04.727 INFO:tasks.workunit.client.0.smithi037.stdout:5/396: dwrite d7/d18/f7a [0,4194304] 0 2024-04-25T17:19:04.728 INFO:tasks.workunit.client.1.smithi069.stdout:2/78: chown d0/d1/fe 15330401 1 2024-04-25T17:19:04.728 INFO:tasks.workunit.client.1.smithi069.stdout:2/79: readlink d0/d1/l12 0 2024-04-25T17:19:04.728 INFO:tasks.workunit.client.0.smithi037.stdout:8/224: dwrite d5/db/d23/f38 [0,4194304] 0 2024-04-25T17:19:04.731 INFO:tasks.workunit.client.1.smithi069.stdout:1/92: unlink d1/d4/de/f1a 0 2024-04-25T17:19:04.734 INFO:tasks.workunit.client.1.smithi069.stdout:6/95: getdents d2/d7 0 2024-04-25T17:19:04.736 INFO:tasks.workunit.client.1.smithi069.stdout:8/85: readlink l15 0 2024-04-25T17:19:04.737 INFO:tasks.workunit.client.1.smithi069.stdout:9/134: mkdir d2/da/dd/d1e/d2e/d35 0 2024-04-25T17:19:04.738 INFO:tasks.workunit.client.0.smithi037.stdout:5/397: dread d7/d25/d4f/f3d [0,4194304] 0 2024-04-25T17:19:04.739 INFO:tasks.workunit.client.0.smithi037.stdout:0/408: dwrite d9/df/f45 [0,4194304] 0 2024-04-25T17:19:04.739 INFO:tasks.workunit.client.1.smithi069.stdout:7/120: creat d4/d6/d14/d15/f28 x:0 0 0 2024-04-25T17:19:04.742 INFO:tasks.workunit.client.0.smithi037.stdout:0/409: chown d9/d14/d23/f3c 3679767 1 2024-04-25T17:19:04.742 INFO:tasks.workunit.client.0.smithi037.stdout:8/225: dwrite d5/f35 [0,4194304] 0 2024-04-25T17:19:04.744 INFO:tasks.workunit.client.1.smithi069.stdout:5/76: rename l7 to l11 0 2024-04-25T17:19:04.746 INFO:tasks.workunit.client.1.smithi069.stdout:7/121: dwrite d4/d18/f1f [0,4194304] 0 2024-04-25T17:19:04.747 INFO:tasks.workunit.client.1.smithi069.stdout:4/76: rename c9 to db/c1b 0 2024-04-25T17:19:04.749 INFO:tasks.workunit.client.1.smithi069.stdout:4/77: write db/f12 [2710921,110947] 0 2024-04-25T17:19:04.750 INFO:tasks.workunit.client.1.smithi069.stdout:0/80: mknod d0/c1b 0 2024-04-25T17:19:04.751 INFO:tasks.workunit.client.1.smithi069.stdout:0/81: chown d0/d19 151596331 1 2024-04-25T17:19:04.753 INFO:tasks.workunit.client.1.smithi069.stdout:2/80: creat d0/d1/f19 x:0 0 0 2024-04-25T17:19:04.753 INFO:tasks.workunit.client.1.smithi069.stdout:1/93: truncate d1/d4/d6/f7 3798257 0 2024-04-25T17:19:04.758 INFO:tasks.workunit.client.1.smithi069.stdout:3/148: mknod d8/d2a/c3a 0 2024-04-25T17:19:04.758 INFO:tasks.workunit.client.0.smithi037.stdout:5/398: creat d7/d18/d62/f7e x:0 0 0 2024-04-25T17:19:04.759 INFO:tasks.workunit.client.1.smithi069.stdout:9/135: write d2/da/dd/de/f12 [331694,4639] 0 2024-04-25T17:19:04.759 INFO:tasks.workunit.client.1.smithi069.stdout:4/78: dread db/f11 [0,4194304] 0 2024-04-25T17:19:04.760 INFO:tasks.workunit.client.1.smithi069.stdout:7/122: dwrite d4/d6/d14/d15/f26 [0,4194304] 0 2024-04-25T17:19:04.763 INFO:tasks.workunit.client.1.smithi069.stdout:4/79: dread db/f11 [0,4194304] 0 2024-04-25T17:19:04.763 INFO:tasks.workunit.client.1.smithi069.stdout:6/96: rename d2/f1f to d2/d1e/f23 0 2024-04-25T17:19:04.768 INFO:tasks.workunit.client.0.smithi037.stdout:5/399: link d7/d12/f19 d7/d12/d5d/f7f 0 2024-04-25T17:19:04.768 INFO:tasks.workunit.client.0.smithi037.stdout:5/400: readlink d7/d43/l70 0 2024-04-25T17:19:04.772 INFO:tasks.workunit.client.0.smithi037.stdout:5/401: write d7/f40 [307969,95572] 0 2024-04-25T17:19:04.778 INFO:tasks.workunit.client.1.smithi069.stdout:9/136: stat d2/da/d14/f25 0 2024-04-25T17:19:04.780 INFO:tasks.workunit.client.0.smithi037.stdout:0/410: dread d9/d14/d28/d48/f50 [0,4194304] 0 2024-04-25T17:19:04.782 INFO:tasks.workunit.client.0.smithi037.stdout:5/402: link d7/f49 d7/d12/d5d/f80 0 2024-04-25T17:19:04.787 INFO:tasks.workunit.client.1.smithi069.stdout:7/123: rmdir d4/d1a 39 2024-04-25T17:19:04.787 INFO:tasks.workunit.client.1.smithi069.stdout:5/77: mknod c12 0 2024-04-25T17:19:04.792 INFO:tasks.workunit.client.0.smithi037.stdout:5/403: dwrite d7/f1c [0,4194304] 0 2024-04-25T17:19:04.792 INFO:tasks.workunit.client.0.smithi037.stdout:0/411: dread d9/df/d32/d39/f52 [0,4194304] 0 2024-04-25T17:19:04.795 INFO:tasks.workunit.client.1.smithi069.stdout:8/86: rename l15 to l1c 0 2024-04-25T17:19:04.795 INFO:tasks.workunit.client.1.smithi069.stdout:6/97: dwrite d2/d7/f22 [0,4194304] 0 2024-04-25T17:19:04.798 INFO:tasks.workunit.client.0.smithi037.stdout:5/404: dwrite d7/ff [0,4194304] 0 2024-04-25T17:19:04.802 INFO:tasks.workunit.client.1.smithi069.stdout:3/149: symlink d8/d16/d1a/d38/l3b 0 2024-04-25T17:19:04.803 INFO:tasks.workunit.client.0.smithi037.stdout:5/405: creat d7/d12/d5d/f81 x:0 0 0 2024-04-25T17:19:04.805 INFO:tasks.workunit.client.1.smithi069.stdout:6/98: dwrite d2/f10 [0,4194304] 0 2024-04-25T17:19:04.806 INFO:tasks.workunit.client.0.smithi037.stdout:5/406: creat d7/d25/d4f/f82 x:0 0 0 2024-04-25T17:19:04.807 INFO:tasks.workunit.client.1.smithi069.stdout:6/99: write d2/d7/fa [1004916,29381] 0 2024-04-25T17:19:04.807 INFO:tasks.workunit.client.0.smithi037.stdout:5/407: truncate d7/d18/f64 1038754 0 2024-04-25T17:19:04.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:04 smithi037 ceph-mon[26472]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:19:04.854 INFO:tasks.workunit.client.0.smithi037.stdout:5/408: dread - d7/d12/f46 zero size 2024-04-25T17:19:04.855 INFO:tasks.workunit.client.0.smithi037.stdout:5/409: readlink d7/d12/l58 0 2024-04-25T17:19:04.858 INFO:tasks.workunit.client.0.smithi037.stdout:5/410: mknod d7/d25/d4f/c83 0 2024-04-25T17:19:04.858 INFO:tasks.workunit.client.0.smithi037.stdout:5/411: chown d7/d12/d6f 1255 1 2024-04-25T17:19:04.860 INFO:tasks.workunit.client.0.smithi037.stdout:5/412: chown d7/d12/f5a 142215 1 2024-04-25T17:19:04.860 INFO:tasks.workunit.client.0.smithi037.stdout:0/412: dwrite d9/d14/f44 [0,4194304] 0 2024-04-25T17:19:04.864 INFO:tasks.workunit.client.0.smithi037.stdout:0/413: read d9/d14/d28/f2a [457253,118647] 0 2024-04-25T17:19:04.865 INFO:tasks.workunit.client.0.smithi037.stdout:0/414: readlink d9/df/d32/d35/l41 0 2024-04-25T17:19:04.865 INFO:tasks.workunit.client.0.smithi037.stdout:0/415: chown d9/df/d32/d39/l6b 10925466 1 2024-04-25T17:19:04.877 INFO:tasks.workunit.client.0.smithi037.stdout:0/416: mknod d9/c91 0 2024-04-25T17:19:04.878 INFO:tasks.workunit.client.0.smithi037.stdout:5/413: getdents d7/d25 0 2024-04-25T17:19:04.886 INFO:tasks.workunit.client.0.smithi037.stdout:0/417: dwrite d9/d14/f3d [0,4194304] 0 2024-04-25T17:19:04.892 INFO:tasks.workunit.client.0.smithi037.stdout:0/418: dread d9/d71/f8e [0,4194304] 0 2024-04-25T17:19:04.893 INFO:tasks.workunit.client.0.smithi037.stdout:0/419: chown d9/d14/d28/c42 435550051 1 2024-04-25T17:19:04.896 INFO:tasks.workunit.client.0.smithi037.stdout:0/420: creat d9/d71/f92 x:0 0 0 2024-04-25T17:19:04.900 INFO:tasks.workunit.client.0.smithi037.stdout:0/421: creat d9/df/d32/d39/d68/f93 x:0 0 0 2024-04-25T17:19:04.905 INFO:tasks.workunit.client.0.smithi037.stdout:0/422: dread d9/df/f45 [0,4194304] 0 2024-04-25T17:19:04.909 INFO:tasks.workunit.client.0.smithi037.stdout:0/423: truncate d9/df/f12 2060888 0 2024-04-25T17:19:04.912 INFO:tasks.workunit.client.1.smithi069.stdout:7/124: mknod d4/d6/d14/d15/c29 0 2024-04-25T17:19:04.912 INFO:tasks.workunit.client.1.smithi069.stdout:7/125: stat d4/d18 0 2024-04-25T17:19:04.914 INFO:tasks.workunit.client.1.smithi069.stdout:0/82: rmdir d0/d19 0 2024-04-25T17:19:04.915 INFO:tasks.workunit.client.1.smithi069.stdout:0/83: rename d0/da/db to d0/da/db/d1c 22 2024-04-25T17:19:04.916 INFO:tasks.workunit.client.1.smithi069.stdout:8/87: truncate f12 1221089 0 2024-04-25T17:19:04.916 INFO:tasks.workunit.client.1.smithi069.stdout:2/81: link d0/d8/f13 d0/f1a 0 2024-04-25T17:19:04.918 INFO:tasks.workunit.client.1.smithi069.stdout:1/94: creat d1/d4/de/d11/f1e x:0 0 0 2024-04-25T17:19:04.919 INFO:tasks.workunit.client.1.smithi069.stdout:1/95: chown d1/df/d12/f14 744 1 2024-04-25T17:19:04.919 INFO:tasks.workunit.client.1.smithi069.stdout:9/137: symlink d2/da/dd/l36 0 2024-04-25T17:19:04.920 INFO:tasks.workunit.client.1.smithi069.stdout:9/138: chown d2/da/dd/d1e/c1f 36517112 1 2024-04-25T17:19:04.921 INFO:tasks.workunit.client.1.smithi069.stdout:9/139: dread - d2/f2c zero size 2024-04-25T17:19:04.922 INFO:tasks.workunit.client.1.smithi069.stdout:5/78: mkdir d13 0 2024-04-25T17:19:04.923 INFO:tasks.workunit.client.1.smithi069.stdout:3/150: dread d8/f11 [0,4194304] 0 2024-04-25T17:19:04.925 INFO:tasks.workunit.client.1.smithi069.stdout:4/80: creat db/f1c x:0 0 0 2024-04-25T17:19:04.925 INFO:tasks.workunit.client.1.smithi069.stdout:0/84: mkdir d0/da/db/d1d 0 2024-04-25T17:19:04.925 INFO:tasks.workunit.client.1.smithi069.stdout:4/81: fsync f8 0 2024-04-25T17:19:04.926 INFO:tasks.workunit.client.1.smithi069.stdout:4/82: chown db 719079 1 2024-04-25T17:19:04.927 INFO:tasks.workunit.client.1.smithi069.stdout:2/82: mknod d0/d8/d10/c1b 0 2024-04-25T17:19:04.929 INFO:tasks.workunit.client.1.smithi069.stdout:0/85: write d0/da/db/f15 [1388885,32184] 0 2024-04-25T17:19:04.929 INFO:tasks.workunit.client.1.smithi069.stdout:1/96: chown d1/f9 5 1 2024-04-25T17:19:04.930 INFO:tasks.workunit.client.1.smithi069.stdout:9/140: unlink d2/da/dd/f2b 0 2024-04-25T17:19:04.931 INFO:tasks.workunit.client.1.smithi069.stdout:3/151: dwrite d8/f37 [0,4194304] 0 2024-04-25T17:19:04.931 INFO:tasks.workunit.client.1.smithi069.stdout:9/141: read - d2/f17 zero size 2024-04-25T17:19:04.932 INFO:tasks.workunit.client.1.smithi069.stdout:3/152: write d8/f13 [274848,53245] 0 2024-04-25T17:19:04.932 INFO:tasks.workunit.client.1.smithi069.stdout:3/153: stat d8/f11 0 2024-04-25T17:19:04.933 INFO:tasks.workunit.client.1.smithi069.stdout:7/126: unlink d4/d6/d14/c22 0 2024-04-25T17:19:04.934 INFO:tasks.workunit.client.1.smithi069.stdout:7/127: chown d4/d6/d14/d15/f28 352584 1 2024-04-25T17:19:04.935 INFO:tasks.workunit.client.1.smithi069.stdout:8/88: mknod c1d 0 2024-04-25T17:19:04.935 INFO:tasks.workunit.client.1.smithi069.stdout:8/89: rmdir - no directory 2024-04-25T17:19:04.938 INFO:tasks.workunit.client.1.smithi069.stdout:7/128: dread d4/d18/f1f [0,4194304] 0 2024-04-25T17:19:04.939 INFO:tasks.workunit.client.1.smithi069.stdout:6/100: link d2/cb d2/d7/c24 0 2024-04-25T17:19:04.939 INFO:tasks.workunit.client.1.smithi069.stdout:6/101: stat d2/d7/f12 0 2024-04-25T17:19:04.942 INFO:tasks.workunit.client.1.smithi069.stdout:6/102: dread d2/f14 [0,4194304] 0 2024-04-25T17:19:04.943 INFO:tasks.workunit.client.1.smithi069.stdout:1/97: creat d1/f1f x:0 0 0 2024-04-25T17:19:04.943 INFO:tasks.workunit.client.1.smithi069.stdout:1/98: dread - d1/d4/fb zero size 2024-04-25T17:19:04.944 INFO:tasks.workunit.client.1.smithi069.stdout:1/99: dread - d1/d4/de/d11/f1e zero size 2024-04-25T17:19:04.944 INFO:tasks.workunit.client.1.smithi069.stdout:5/79: mknod d13/c14 0 2024-04-25T17:19:04.945 INFO:tasks.workunit.client.1.smithi069.stdout:1/100: write d1/df/d12/f14 [5336,100852] 0 2024-04-25T17:19:04.946 INFO:tasks.workunit.client.1.smithi069.stdout:1/101: chown d1/df/d12/c15 608479 1 2024-04-25T17:19:04.946 INFO:tasks.workunit.client.1.smithi069.stdout:1/102: readlink d1/d4/de/d11/d1b/l1c 0 2024-04-25T17:19:04.950 INFO:tasks.workunit.client.1.smithi069.stdout:4/83: link db/f12 db/d15/f1d 0 2024-04-25T17:19:04.953 INFO:tasks.workunit.client.0.smithi037.stdout:5/414: dwrite d7/d12/f31 [0,4194304] 0 2024-04-25T17:19:04.955 INFO:tasks.workunit.client.0.smithi037.stdout:5/415: dread d7/d25/d4f/f3d [0,4194304] 0 2024-04-25T17:19:04.956 INFO:tasks.workunit.client.1.smithi069.stdout:5/80: chown f5 0 1 2024-04-25T17:19:04.956 INFO:tasks.workunit.client.1.smithi069.stdout:5/81: chown c10 3 1 2024-04-25T17:19:04.960 INFO:tasks.workunit.client.1.smithi069.stdout:9/142: link d2/da/d14/f19 d2/da/d14/f37 0 2024-04-25T17:19:04.960 INFO:tasks.workunit.client.1.smithi069.stdout:9/143: chown d2/f33 1527 1 2024-04-25T17:19:04.961 INFO:tasks.workunit.client.1.smithi069.stdout:3/154: creat d8/d39/f3c x:0 0 0 2024-04-25T17:19:04.962 INFO:tasks.workunit.client.0.smithi037.stdout:5/416: unlink d7/f5b 0 2024-04-25T17:19:04.966 INFO:tasks.workunit.client.1.smithi069.stdout:1/103: mknod d1/df/d12/c20 0 2024-04-25T17:19:04.967 INFO:tasks.workunit.client.1.smithi069.stdout:8/90: truncate fb 3303811 0 2024-04-25T17:19:04.967 INFO:tasks.workunit.client.1.smithi069.stdout:8/91: rmdir - no directory 2024-04-25T17:19:04.968 INFO:tasks.workunit.client.0.smithi037.stdout:0/424: creat d9/df/f94 x:0 0 0 2024-04-25T17:19:04.969 INFO:tasks.workunit.client.1.smithi069.stdout:4/84: mknod db/d15/c1e 0 2024-04-25T17:19:04.972 INFO:tasks.workunit.client.0.smithi037.stdout:0/425: write d9/d71/f8e [1337222,130190] 0 2024-04-25T17:19:04.974 INFO:tasks.workunit.client.0.smithi037.stdout:5/417: link d7/c3b d7/d18/d62/c84 0 2024-04-25T17:19:04.974 INFO:tasks.workunit.client.1.smithi069.stdout:6/103: fdatasync d2/f20 0 2024-04-25T17:19:04.977 INFO:tasks.workunit.client.0.smithi037.stdout:5/418: rename d7/d12/l27 to d7/d12/d6f/l85 0 2024-04-25T17:19:04.978 INFO:tasks.workunit.client.0.smithi037.stdout:5/419: dread - d7/d18/d62/f7e zero size 2024-04-25T17:19:04.978 INFO:tasks.workunit.client.1.smithi069.stdout:5/82: rename d13/c14 to d13/c15 0 2024-04-25T17:19:04.980 INFO:tasks.workunit.client.1.smithi069.stdout:9/144: write d2/da/d14/f37 [1271564,9329] 0 2024-04-25T17:19:04.980 INFO:tasks.workunit.client.1.smithi069.stdout:9/145: stat d2/da/fc 0 2024-04-25T17:19:04.982 INFO:tasks.workunit.client.1.smithi069.stdout:1/104: symlink d1/d4/l21 0 2024-04-25T17:19:04.984 INFO:tasks.workunit.client.1.smithi069.stdout:7/129: creat d4/f2a x:0 0 0 2024-04-25T17:19:04.985 INFO:tasks.workunit.client.1.smithi069.stdout:7/130: read d4/d6/d14/d15/f26 [3319056,82906] 0 2024-04-25T17:19:04.985 INFO:tasks.workunit.client.1.smithi069.stdout:4/85: rename db/d15/c19 to db/d15/c1f 0 2024-04-25T17:19:04.988 INFO:tasks.workunit.client.1.smithi069.stdout:2/83: getdents d0/d1 0 2024-04-25T17:19:04.989 INFO:tasks.workunit.client.0.smithi037.stdout:5/420: link d7/f49 d7/d12/f86 0 2024-04-25T17:19:04.990 INFO:tasks.workunit.client.1.smithi069.stdout:4/86: dwrite db/d15/f17 [4194304,4194304] 0 2024-04-25T17:19:04.991 INFO:tasks.workunit.client.1.smithi069.stdout:6/104: rename d2/d7/f22 to d2/d7/f25 0 2024-04-25T17:19:04.991 INFO:tasks.workunit.client.1.smithi069.stdout:4/87: chown db/f1c 27 1 2024-04-25T17:19:04.992 INFO:tasks.workunit.client.1.smithi069.stdout:0/86: link d0/l11 d0/l1e 0 2024-04-25T17:19:04.993 INFO:tasks.workunit.client.0.smithi037.stdout:1/314: sync 2024-04-25T17:19:04.994 INFO:tasks.workunit.client.0.smithi037.stdout:3/240: sync 2024-04-25T17:19:04.994 INFO:tasks.workunit.client.0.smithi037.stdout:9/491: sync 2024-04-25T17:19:04.995 INFO:tasks.workunit.client.1.smithi069.stdout:5/83: creat d13/f16 x:0 0 0 2024-04-25T17:19:04.998 INFO:tasks.workunit.client.1.smithi069.stdout:9/146: readlink d2/da/dd/d1e/l21 0 2024-04-25T17:19:05.001 INFO:tasks.workunit.client.1.smithi069.stdout:1/105: mknod d1/df/c22 0 2024-04-25T17:19:05.004 INFO:tasks.workunit.client.1.smithi069.stdout:4/88: fsync db/d15/f17 0 2024-04-25T17:19:05.005 INFO:tasks.workunit.client.1.smithi069.stdout:4/89: stat db/f1c 0 2024-04-25T17:19:05.005 INFO:tasks.workunit.client.1.smithi069.stdout:9/147: dwrite d2/f29 [0,4194304] 0 2024-04-25T17:19:05.006 INFO:tasks.workunit.client.0.smithi037.stdout:0/426: link d9/df/d32/d39/f76 d9/d14/f95 0 2024-04-25T17:19:05.006 INFO:tasks.workunit.client.1.smithi069.stdout:4/90: dread - f7 zero size 2024-04-25T17:19:05.006 INFO:tasks.workunit.client.1.smithi069.stdout:9/148: fdatasync d2/f30 0 2024-04-25T17:19:05.006 INFO:tasks.workunit.client.1.smithi069.stdout:9/149: fsync d2/da/f10 0 2024-04-25T17:19:05.010 INFO:tasks.workunit.client.1.smithi069.stdout:7/131: dread d4/d6/fa [0,4194304] 0 2024-04-25T17:19:05.010 INFO:tasks.workunit.client.1.smithi069.stdout:2/84: fdatasync d0/d8/f13 0 2024-04-25T17:19:05.012 INFO:tasks.workunit.client.0.smithi037.stdout:0/427: symlink d9/df/l96 0 2024-04-25T17:19:05.012 INFO:tasks.workunit.client.1.smithi069.stdout:2/85: dread - d0/f17 zero size 2024-04-25T17:19:05.013 INFO:tasks.workunit.client.0.smithi037.stdout:0/428: chown d9/df/d32/d35/c87 1 1 2024-04-25T17:19:05.013 INFO:tasks.workunit.client.1.smithi069.stdout:7/132: stat d4/d6/d14/l1b 0 2024-04-25T17:19:05.013 INFO:tasks.workunit.client.1.smithi069.stdout:9/150: dread d2/da/f10 [0,4194304] 0 2024-04-25T17:19:05.016 INFO:tasks.workunit.client.1.smithi069.stdout:6/105: fdatasync d2/d7/f12 0 2024-04-25T17:19:05.021 INFO:tasks.workunit.client.0.smithi037.stdout:9/492: dread d1/d48/d68/d4e/f67 [0,4194304] 0 2024-04-25T17:19:05.024 INFO:tasks.workunit.client.1.smithi069.stdout:5/84: dwrite fa [0,4194304] 0 2024-04-25T17:19:05.024 INFO:tasks.workunit.client.1.smithi069.stdout:4/91: mkdir db/d15/d20 0 2024-04-25T17:19:05.028 INFO:tasks.workunit.client.1.smithi069.stdout:7/133: write d4/d6/d14/d15/f26 [1130521,19567] 0 2024-04-25T17:19:05.029 INFO:tasks.workunit.client.1.smithi069.stdout:9/151: rmdir d2/da/d14 39 2024-04-25T17:19:05.031 INFO:tasks.workunit.client.1.smithi069.stdout:6/106: symlink d2/d1e/l26 0 2024-04-25T17:19:05.032 INFO:tasks.workunit.client.1.smithi069.stdout:0/87: symlink d0/da/db/d1d/l1f 0 2024-04-25T17:19:05.034 INFO:tasks.workunit.client.1.smithi069.stdout:3/155: getdents d8/d16/d31 0 2024-04-25T17:19:05.036 INFO:tasks.workunit.client.1.smithi069.stdout:5/85: mkdir d13/d17 0 2024-04-25T17:19:05.038 INFO:tasks.workunit.client.1.smithi069.stdout:2/86: symlink d0/l1c 0 2024-04-25T17:19:05.041 INFO:tasks.workunit.client.1.smithi069.stdout:6/107: symlink d2/d1e/l27 0 2024-04-25T17:19:05.042 INFO:tasks.workunit.client.1.smithi069.stdout:6/108: write d2/d7/fd [1660973,94393] 0 2024-04-25T17:19:05.043 INFO:tasks.workunit.client.1.smithi069.stdout:3/156: mknod d8/d2a/c3d 0 2024-04-25T17:19:05.045 INFO:tasks.workunit.client.1.smithi069.stdout:5/86: symlink d13/l18 0 2024-04-25T17:19:05.046 INFO:tasks.workunit.client.1.smithi069.stdout:5/87: read fa [2495794,127836] 0 2024-04-25T17:19:05.047 INFO:tasks.workunit.client.1.smithi069.stdout:2/87: mkdir d0/d1/d1d 0 2024-04-25T17:19:05.048 INFO:tasks.workunit.client.1.smithi069.stdout:8/92: write ff [737084,107146] 0 2024-04-25T17:19:05.048 INFO:tasks.workunit.client.1.smithi069.stdout:2/88: dread - d0/d1/f19 zero size 2024-04-25T17:19:05.048 INFO:tasks.workunit.client.1.smithi069.stdout:9/152: creat d2/da/dd/d1e/d2e/d35/f38 x:0 0 0 2024-04-25T17:19:05.049 INFO:tasks.workunit.client.1.smithi069.stdout:2/89: write d0/d8/f18 [95840,11349] 0 2024-04-25T17:19:05.051 INFO:tasks.workunit.client.1.smithi069.stdout:6/109: mknod d2/c28 0 2024-04-25T17:19:05.053 INFO:tasks.workunit.client.0.smithi037.stdout:5/421: write d7/d12/d5d/f80 [475060,15284] 0 2024-04-25T17:19:05.054 INFO:tasks.workunit.client.0.smithi037.stdout:1/315: write dc/d24/f45 [117857,120893] 0 2024-04-25T17:19:05.054 INFO:tasks.workunit.client.0.smithi037.stdout:5/422: dread - d7/d18/d62/f7e zero size 2024-04-25T17:19:05.054 INFO:tasks.workunit.client.1.smithi069.stdout:4/92: creat db/f21 x:0 0 0 2024-04-25T17:19:05.056 INFO:tasks.workunit.client.0.smithi037.stdout:1/316: chown dc/d1c/d57/d4d/d6a 26 1 2024-04-25T17:19:05.056 INFO:tasks.workunit.client.1.smithi069.stdout:4/93: fdatasync db/f21 0 2024-04-25T17:19:05.056 INFO:tasks.workunit.client.1.smithi069.stdout:5/88: chown d13/c15 697766 1 2024-04-25T17:19:05.058 INFO:tasks.workunit.client.1.smithi069.stdout:6/110: dwrite d2/f17 [0,4194304] 0 2024-04-25T17:19:05.058 INFO:tasks.workunit.client.1.smithi069.stdout:6/111: chown d2/l3 0 1 2024-04-25T17:19:05.060 INFO:tasks.workunit.client.0.smithi037.stdout:1/317: creat dc/d18/d39/f6c x:0 0 0 2024-04-25T17:19:05.069 INFO:tasks.workunit.client.0.smithi037.stdout:5/423: rename d7/d12/f19 to d7/f87 0 2024-04-25T17:19:05.070 INFO:tasks.workunit.client.0.smithi037.stdout:0/429: mknod d9/d14/d23/c97 0 2024-04-25T17:19:05.073 INFO:tasks.workunit.client.1.smithi069.stdout:1/106: write d1/d4/d6/f7 [2942746,37251] 0 2024-04-25T17:19:05.074 INFO:tasks.workunit.client.0.smithi037.stdout:5/424: symlink d7/d12/d5d/l88 0 2024-04-25T17:19:05.075 INFO:tasks.workunit.client.1.smithi069.stdout:2/90: symlink d0/l1e 0 2024-04-25T17:19:05.076 INFO:tasks.workunit.client.1.smithi069.stdout:7/134: write d4/d6/fa [5243694,24371] 0 2024-04-25T17:19:05.076 INFO:tasks.workunit.client.0.smithi037.stdout:0/430: fdatasync d9/d14/d28/d48/f4e 0 2024-04-25T17:19:05.078 INFO:tasks.workunit.client.1.smithi069.stdout:5/89: dwrite fa [0,4194304] 0 2024-04-25T17:19:05.079 INFO:tasks.workunit.client.0.smithi037.stdout:0/431: dread d9/df/f86 [0,4194304] 0 2024-04-25T17:19:05.079 INFO:tasks.workunit.client.0.smithi037.stdout:1/318: rmdir dc/d24/d67 0 2024-04-25T17:19:05.079 INFO:tasks.workunit.client.0.smithi037.stdout:1/319: readlink dc/d24/l50 0 2024-04-25T17:19:05.081 INFO:tasks.workunit.client.1.smithi069.stdout:4/94: mkdir db/d22 0 2024-04-25T17:19:05.082 INFO:tasks.workunit.client.0.smithi037.stdout:5/425: write d7/fc [5886145,35838] 0 2024-04-25T17:19:05.083 INFO:tasks.workunit.client.0.smithi037.stdout:5/426: stat d7/d43/f30 0 2024-04-25T17:19:05.084 INFO:tasks.workunit.client.1.smithi069.stdout:0/88: dwrite d0/f1 [0,4194304] 0 2024-04-25T17:19:05.084 INFO:tasks.workunit.client.1.smithi069.stdout:8/93: rename c1d to c1e 0 2024-04-25T17:19:05.085 INFO:tasks.workunit.client.1.smithi069.stdout:0/89: write d0/f6 [1382775,41848] 0 2024-04-25T17:19:05.087 INFO:tasks.workunit.client.1.smithi069.stdout:0/90: chown d0/da/db/f15 53 1 2024-04-25T17:19:05.088 INFO:tasks.workunit.client.1.smithi069.stdout:0/91: read d0/f1 [2142854,36570] 0 2024-04-25T17:19:05.088 INFO:tasks.workunit.client.0.smithi037.stdout:0/432: unlink d9/d14/d28/d48/c79 0 2024-04-25T17:19:05.090 INFO:tasks.workunit.client.1.smithi069.stdout:0/92: dread d0/da/db/fe [0,4194304] 0 2024-04-25T17:19:05.091 INFO:tasks.workunit.client.0.smithi037.stdout:1/320: unlink dc/f27 0 2024-04-25T17:19:05.094 INFO:tasks.workunit.client.1.smithi069.stdout:3/157: getdents d8/d39 0 2024-04-25T17:19:05.096 INFO:tasks.workunit.client.0.smithi037.stdout:5/427: symlink d7/d12/d6f/d68/l89 0 2024-04-25T17:19:05.100 INFO:tasks.workunit.client.1.smithi069.stdout:2/91: rename d0/f1a to d0/d1/f1f 0 2024-04-25T17:19:05.100 INFO:tasks.workunit.client.1.smithi069.stdout:9/153: write d2/f8 [6557691,75696] 0 2024-04-25T17:19:05.102 INFO:tasks.workunit.client.1.smithi069.stdout:9/154: dread d2/da/dd/f2d [0,4194304] 0 2024-04-25T17:19:05.104 INFO:tasks.workunit.client.0.smithi037.stdout:5/428: creat d7/d25/f8a x:0 0 0 2024-04-25T17:19:05.107 INFO:tasks.workunit.client.0.smithi037.stdout:5/429: rename d7/d12/c4c to d7/d43/c8b 0 2024-04-25T17:19:05.108 INFO:tasks.workunit.client.1.smithi069.stdout:6/112: link d2/l3 d2/l29 0 2024-04-25T17:19:05.108 INFO:tasks.workunit.client.1.smithi069.stdout:9/155: dwrite d2/da/f13 [0,4194304] 0 2024-04-25T17:19:05.109 INFO:tasks.workunit.client.0.smithi037.stdout:1/321: dread dc/d18/f1b [0,4194304] 0 2024-04-25T17:19:05.111 INFO:tasks.workunit.client.1.smithi069.stdout:1/107: mknod d1/df/d17/c23 0 2024-04-25T17:19:05.111 INFO:tasks.workunit.client.1.smithi069.stdout:1/108: chown d1/d4/d6/f7 1036810 1 2024-04-25T17:19:05.116 INFO:tasks.workunit.client.1.smithi069.stdout:7/135: symlink d4/d1a/l2b 0 2024-04-25T17:19:05.117 INFO:tasks.workunit.client.0.smithi037.stdout:0/433: dread d9/d14/f22 [0,4194304] 0 2024-04-25T17:19:05.121 INFO:tasks.workunit.client.0.smithi037.stdout:1/322: creat dc/d1c/d57/d22/f6d x:0 0 0 2024-04-25T17:19:05.121 INFO:tasks.workunit.client.0.smithi037.stdout:1/323: chown dc/d18/f2f 112 1 2024-04-25T17:19:05.122 INFO:tasks.workunit.client.1.smithi069.stdout:0/93: rename d0/f1a to d0/da/db/d1d/f20 0 2024-04-25T17:19:05.123 INFO:tasks.workunit.client.1.smithi069.stdout:5/90: mkdir d13/d17/d19 0 2024-04-25T17:19:05.124 INFO:tasks.workunit.client.1.smithi069.stdout:4/95: symlink db/d15/d20/l23 0 2024-04-25T17:19:05.125 INFO:tasks.workunit.client.1.smithi069.stdout:4/96: chown f8 75013 1 2024-04-25T17:19:05.126 INFO:tasks.workunit.client.0.smithi037.stdout:0/434: rename d9/df/d32/f70 to d9/df/f98 0 2024-04-25T17:19:05.126 INFO:tasks.workunit.client.1.smithi069.stdout:4/97: dread - db/f21 zero size 2024-04-25T17:19:05.127 INFO:tasks.workunit.client.0.smithi037.stdout:0/435: fdatasync d9/d14/d28/d48/d58/f77 0 2024-04-25T17:19:05.128 INFO:tasks.workunit.client.1.smithi069.stdout:0/94: dwrite d0/da/db/f13 [0,4194304] 0 2024-04-25T17:19:05.129 INFO:tasks.workunit.client.1.smithi069.stdout:8/94: symlink l1f 0 2024-04-25T17:19:05.130 INFO:tasks.workunit.client.0.smithi037.stdout:1/324: rename dc/f3d to dc/d52/d6b/f6e 0 2024-04-25T17:19:05.131 INFO:tasks.workunit.client.0.smithi037.stdout:1/325: read - dc/d18/d64/f68 zero size 2024-04-25T17:19:05.133 INFO:tasks.workunit.client.1.smithi069.stdout:0/95: dread d0/da/db/f13 [0,4194304] 0 2024-04-25T17:19:05.133 INFO:tasks.workunit.client.1.smithi069.stdout:6/113: creat d2/f2a x:0 0 0 2024-04-25T17:19:05.134 INFO:tasks.workunit.client.1.smithi069.stdout:6/114: readlink d2/d1e/l26 0 2024-04-25T17:19:05.137 INFO:tasks.workunit.client.1.smithi069.stdout:9/156: chown d2/da/d14/d23 3 1 2024-04-25T17:19:05.138 INFO:tasks.workunit.client.0.smithi037.stdout:5/430: truncate d7/d12/f5e 1897479 0 2024-04-25T17:19:05.140 INFO:tasks.workunit.client.1.smithi069.stdout:1/109: unlink d1/df/d17/c23 0 2024-04-25T17:19:05.143 INFO:tasks.workunit.client.0.smithi037.stdout:5/431: unlink d7/d12/d6f/f45 0 2024-04-25T17:19:05.148 INFO:tasks.workunit.client.1.smithi069.stdout:1/110: dwrite d1/d4/fb [0,4194304] 0 2024-04-25T17:19:05.148 INFO:tasks.workunit.client.0.smithi037.stdout:1/326: link dc/c11 dc/d18/d64/c6f 0 2024-04-25T17:19:05.149 INFO:tasks.workunit.client.0.smithi037.stdout:5/432: dwrite d7/ff [4194304,4194304] 0 2024-04-25T17:19:05.154 INFO:tasks.workunit.client.1.smithi069.stdout:1/111: dread d1/d4/d6/f16 [0,4194304] 0 2024-04-25T17:19:05.155 INFO:tasks.workunit.client.1.smithi069.stdout:5/91: dread f6 [0,4194304] 0 2024-04-25T17:19:05.155 INFO:tasks.workunit.client.1.smithi069.stdout:3/158: truncate d8/d16/d1a/d2c/f2f 2509459 0 2024-04-25T17:19:05.157 INFO:tasks.workunit.client.1.smithi069.stdout:3/159: dread - d8/d16/d31/f33 zero size 2024-04-25T17:19:05.157 INFO:tasks.workunit.client.0.smithi037.stdout:5/433: creat d7/d18/d62/f8c x:0 0 0 2024-04-25T17:19:05.158 INFO:tasks.workunit.client.0.smithi037.stdout:5/434: fsync d7/f1b 0 2024-04-25T17:19:05.160 INFO:tasks.workunit.client.1.smithi069.stdout:7/136: write d4/d18/f1f [207052,39334] 0 2024-04-25T17:19:05.162 INFO:tasks.workunit.client.1.smithi069.stdout:3/160: dread d8/f37 [0,4194304] 0 2024-04-25T17:19:05.164 INFO:tasks.workunit.client.0.smithi037.stdout:5/435: dwrite f0 [0,4194304] 0 2024-04-25T17:19:05.165 INFO:tasks.workunit.client.1.smithi069.stdout:8/95: symlink l20 0 2024-04-25T17:19:05.166 INFO:tasks.workunit.client.1.smithi069.stdout:5/92: readlink l2 0 2024-04-25T17:19:05.168 INFO:tasks.workunit.client.0.smithi037.stdout:5/436: creat d7/d63/f8d x:0 0 0 2024-04-25T17:19:05.169 INFO:tasks.workunit.client.0.smithi037.stdout:1/327: dread dc/d18/f21 [0,4194304] 0 2024-04-25T17:19:05.171 INFO:tasks.workunit.client.1.smithi069.stdout:1/112: fdatasync d1/f5 0 2024-04-25T17:19:05.179 INFO:tasks.workunit.client.1.smithi069.stdout:3/161: mkdir d8/d16/d1a/d3e 0 2024-04-25T17:19:05.181 INFO:tasks.workunit.client.1.smithi069.stdout:5/93: creat d13/f1a x:0 0 0 2024-04-25T17:19:05.181 INFO:tasks.workunit.client.1.smithi069.stdout:0/96: link d0/f8 d0/da/db/f21 0 2024-04-25T17:19:05.185 INFO:tasks.workunit.client.1.smithi069.stdout:9/157: creat d2/f39 x:0 0 0 2024-04-25T17:19:05.188 INFO:tasks.workunit.client.1.smithi069.stdout:3/162: rename d8/d2a/c3a to d8/d16/d1a/d38/c3f 0 2024-04-25T17:19:05.188 INFO:tasks.workunit.client.1.smithi069.stdout:3/163: rename d8/d16 to d8/d16/d40 22 2024-04-25T17:19:05.190 INFO:tasks.workunit.client.1.smithi069.stdout:5/94: creat d13/d17/f1b x:0 0 0 2024-04-25T17:19:05.191 INFO:tasks.workunit.client.1.smithi069.stdout:0/97: mknod d0/d17/c22 0 2024-04-25T17:19:05.193 INFO:tasks.workunit.client.1.smithi069.stdout:1/113: link d1/df/d12/f14 d1/df/d17/f24 0 2024-04-25T17:19:05.194 INFO:tasks.workunit.client.1.smithi069.stdout:1/114: write d1/f1f [748422,112912] 0 2024-04-25T17:19:05.195 INFO:tasks.workunit.client.1.smithi069.stdout:9/158: chown d2/da/f16 463 1 2024-04-25T17:19:05.197 INFO:tasks.workunit.client.1.smithi069.stdout:8/96: creat f21 x:0 0 0 2024-04-25T17:19:05.197 INFO:tasks.workunit.client.1.smithi069.stdout:1/115: dread d1/df/d12/f14 [0,4194304] 0 2024-04-25T17:19:05.198 INFO:tasks.workunit.client.1.smithi069.stdout:8/97: write f21 [818837,46625] 0 2024-04-25T17:19:05.199 INFO:tasks.workunit.client.1.smithi069.stdout:3/164: mknod d8/d16/d1a/c41 0 2024-04-25T17:19:05.200 INFO:tasks.workunit.client.1.smithi069.stdout:5/95: write f5 [608852,66278] 0 2024-04-25T17:19:05.218 INFO:tasks.workunit.client.0.smithi037.stdout:1/328: mkdir dc/d1c/d57/d22/d70 0 2024-04-25T17:19:05.218 INFO:tasks.workunit.client.0.smithi037.stdout:7/399: sync 2024-04-25T17:19:05.219 INFO:tasks.workunit.client.0.smithi037.stdout:5/437: creat d7/d18/f8e x:0 0 0 2024-04-25T17:19:05.220 INFO:tasks.workunit.client.0.smithi037.stdout:1/329: creat dc/d24/f71 x:0 0 0 2024-04-25T17:19:05.221 INFO:tasks.workunit.client.0.smithi037.stdout:7/400: dread d5/d15/d17/d1b/f68 [0,4194304] 0 2024-04-25T17:19:05.221 INFO:tasks.workunit.client.0.smithi037.stdout:5/438: unlink l4 0 2024-04-25T17:19:05.221 INFO:tasks.workunit.client.0.smithi037.stdout:5/439: stat d7/d43 0 2024-04-25T17:19:05.222 INFO:tasks.workunit.client.0.smithi037.stdout:1/330: symlink dc/d1c/d57/d22/l72 0 2024-04-25T17:19:05.223 INFO:tasks.workunit.client.0.smithi037.stdout:5/440: write d7/d12/d5d/f61 [523652,86825] 0 2024-04-25T17:19:05.253 INFO:tasks.workunit.client.1.smithi069.stdout:7/137: getdents d4/d6/d21/d23 0 2024-04-25T17:19:05.256 INFO:tasks.workunit.client.1.smithi069.stdout:1/116: truncate d1/df/d12/f14 639813 0 2024-04-25T17:19:05.260 INFO:tasks.workunit.client.1.smithi069.stdout:3/165: dwrite d8/fe [0,4194304] 0 2024-04-25T17:19:05.262 INFO:tasks.workunit.client.1.smithi069.stdout:5/96: dwrite d13/f1a [0,4194304] 0 2024-04-25T17:19:05.265 INFO:tasks.workunit.client.1.smithi069.stdout:8/98: dwrite f13 [0,4194304] 0 2024-04-25T17:19:05.266 INFO:tasks.workunit.client.1.smithi069.stdout:1/117: dread d1/d4/fb [0,4194304] 0 2024-04-25T17:19:05.334 INFO:tasks.workunit.client.0.smithi037.stdout:7/401: symlink d5/d15/d17/l90 0 2024-04-25T17:19:05.338 INFO:tasks.workunit.client.0.smithi037.stdout:1/331: rename dc/d1c/c65 to dc/d24/c73 0 2024-04-25T17:19:05.342 INFO:tasks.workunit.client.0.smithi037.stdout:1/332: dread dc/d18/f2f [0,4194304] 0 2024-04-25T17:19:05.342 INFO:tasks.workunit.client.0.smithi037.stdout:7/402: dwrite d5/d14/d31/f62 [0,4194304] 0 2024-04-25T17:19:05.342 INFO:tasks.workunit.client.1.smithi069.stdout:2/92: sync 2024-04-25T17:19:05.345 INFO:tasks.workunit.client.0.smithi037.stdout:5/441: getdents d7/d12/d5d 0 2024-04-25T17:19:05.348 INFO:tasks.workunit.client.0.smithi037.stdout:7/403: stat d5/d15/l7f 0 2024-04-25T17:19:05.350 INFO:tasks.workunit.client.1.smithi069.stdout:8/99: write f10 [623313,11094] 0 2024-04-25T17:19:05.350 INFO:tasks.workunit.client.0.smithi037.stdout:7/404: dread - d5/d15/d17/d25/d2b/d59/f8c zero size 2024-04-25T17:19:05.351 INFO:tasks.workunit.client.0.smithi037.stdout:1/333: rmdir dc/d52/d6b 39 2024-04-25T17:19:05.352 INFO:tasks.workunit.client.1.smithi069.stdout:1/118: rmdir d1/d4/de/d11/d1b 39 2024-04-25T17:19:05.353 INFO:tasks.workunit.client.0.smithi037.stdout:5/442: dwrite d7/fc [0,4194304] 0 2024-04-25T17:19:05.355 INFO:tasks.workunit.client.0.smithi037.stdout:5/443: write d7/d12/d5d/f61 [927421,61822] 0 2024-04-25T17:19:05.358 INFO:tasks.workunit.client.0.smithi037.stdout:7/405: dread d5/d15/d17/d1b/d27/f5f [0,4194304] 0 2024-04-25T17:19:05.359 INFO:tasks.workunit.client.0.smithi037.stdout:1/334: mkdir dc/d1c/d57/d22/d36/d74 0 2024-04-25T17:19:05.361 INFO:tasks.workunit.client.1.smithi069.stdout:0/98: getdents d0 0 2024-04-25T17:19:05.363 INFO:tasks.workunit.client.1.smithi069.stdout:3/166: mkdir d8/d16/d1a/d3e/d42 0 2024-04-25T17:19:05.363 INFO:tasks.workunit.client.1.smithi069.stdout:3/167: fsync d8/f18 0 2024-04-25T17:19:05.365 INFO:tasks.workunit.client.0.smithi037.stdout:7/406: dwrite d5/d15/d17/f38 [0,4194304] 0 2024-04-25T17:19:05.366 INFO:tasks.workunit.client.1.smithi069.stdout:5/97: mkdir d13/d17/d19/d1c 0 2024-04-25T17:19:05.366 INFO:tasks.workunit.client.1.smithi069.stdout:5/98: chown d13/f16 15501906 1 2024-04-25T17:19:05.367 INFO:tasks.workunit.client.1.smithi069.stdout:5/99: write f5 [3162128,12011] 0 2024-04-25T17:19:05.371 INFO:tasks.workunit.client.1.smithi069.stdout:9/159: getdents d2/da/dd 0 2024-04-25T17:19:05.372 INFO:tasks.workunit.client.1.smithi069.stdout:7/138: creat d4/d6/f2c x:0 0 0 2024-04-25T17:19:05.372 INFO:tasks.workunit.client.1.smithi069.stdout:9/160: write d2/f8 [5151398,47951] 0 2024-04-25T17:19:05.373 INFO:tasks.workunit.client.0.smithi037.stdout:1/335: link dc/d18/l4e dc/d18/d64/l75 0 2024-04-25T17:19:05.373 INFO:tasks.workunit.client.0.smithi037.stdout:7/407: dwrite d5/d15/d17/f38 [0,4194304] 0 2024-04-25T17:19:05.376 INFO:tasks.workunit.client.0.smithi037.stdout:7/408: dread - d5/d15/d17/d25/d2b/d59/f6c zero size 2024-04-25T17:19:05.377 INFO:tasks.workunit.client.0.smithi037.stdout:1/336: dread - f9 zero size 2024-04-25T17:19:05.377 INFO:tasks.workunit.client.0.smithi037.stdout:7/409: write d5/d15/d17/d25/d2b/d59/f6c [481037,7274] 0 2024-04-25T17:19:05.380 INFO:tasks.workunit.client.1.smithi069.stdout:5/100: read fd [786642,107653] 0 2024-04-25T17:19:05.381 INFO:tasks.workunit.client.1.smithi069.stdout:8/100: mknod c22 0 2024-04-25T17:19:05.381 INFO:tasks.workunit.client.1.smithi069.stdout:5/101: chown cf 2415 1 2024-04-25T17:19:05.381 INFO:tasks.workunit.client.1.smithi069.stdout:1/119: getdents d1/df/d12/d1d 0 2024-04-25T17:19:05.382 INFO:tasks.workunit.client.1.smithi069.stdout:1/120: chown d1/df/d17 0 1 2024-04-25T17:19:05.384 INFO:tasks.workunit.client.0.smithi037.stdout:5/444: dwrite d7/d18/f2a [0,4194304] 0 2024-04-25T17:19:05.385 INFO:tasks.workunit.client.0.smithi037.stdout:1/337: symlink dc/l76 0 2024-04-25T17:19:05.386 INFO:tasks.workunit.client.1.smithi069.stdout:8/101: dread f10 [0,4194304] 0 2024-04-25T17:19:05.388 INFO:tasks.workunit.client.1.smithi069.stdout:7/139: creat d4/d6/d14/d15/f2d x:0 0 0 2024-04-25T17:19:05.388 INFO:tasks.workunit.client.1.smithi069.stdout:2/93: write d0/d8/f13 [38932,102538] 0 2024-04-25T17:19:05.389 INFO:tasks.workunit.client.1.smithi069.stdout:7/140: chown d4/d18 3875 1 2024-04-25T17:19:05.390 INFO:tasks.workunit.client.1.smithi069.stdout:9/161: mknod d2/da/dd/de/c3a 0 2024-04-25T17:19:05.391 INFO:tasks.workunit.client.1.smithi069.stdout:7/141: fdatasync d4/d6/d14/d15/f26 0 2024-04-25T17:19:05.392 INFO:tasks.workunit.client.1.smithi069.stdout:9/162: write d2/da/dd/f2d [964338,1263] 0 2024-04-25T17:19:05.393 INFO:tasks.workunit.client.0.smithi037.stdout:7/410: unlink d5/ca 0 2024-04-25T17:19:05.393 INFO:tasks.workunit.client.1.smithi069.stdout:7/142: truncate d4/d1a/f1c 104470 0 2024-04-25T17:19:05.394 INFO:tasks.workunit.client.1.smithi069.stdout:0/99: rename d0/da/db/f21 to d0/da/db/f23 0 2024-04-25T17:19:05.397 INFO:tasks.workunit.client.1.smithi069.stdout:7/143: dread d4/d18/f1f [0,4194304] 0 2024-04-25T17:19:05.398 INFO:tasks.workunit.client.1.smithi069.stdout:5/102: write f9 [378506,22424] 0 2024-04-25T17:19:05.399 INFO:tasks.workunit.client.1.smithi069.stdout:5/103: chown c10 477 1 2024-04-25T17:19:05.399 INFO:tasks.workunit.client.0.smithi037.stdout:1/338: creat dc/d18/d66/f77 x:0 0 0 2024-04-25T17:19:05.402 INFO:tasks.workunit.client.0.smithi037.stdout:7/411: rmdir d5/d5e/d76 39 2024-04-25T17:19:05.404 INFO:tasks.workunit.client.0.smithi037.stdout:7/412: stat d5/d5e/d76/l87 0 2024-04-25T17:19:05.407 INFO:tasks.workunit.client.0.smithi037.stdout:7/413: mknod d5/d78/c91 0 2024-04-25T17:19:05.408 INFO:tasks.workunit.client.1.smithi069.stdout:7/144: symlink d4/d18/l2e 0 2024-04-25T17:19:05.412 INFO:tasks.workunit.client.1.smithi069.stdout:1/121: mknod d1/d4/de/d11/c25 0 2024-04-25T17:19:05.413 INFO:tasks.workunit.client.1.smithi069.stdout:1/122: chown d1/d4/d6/f16 189989 1 2024-04-25T17:19:05.414 INFO:tasks.workunit.client.0.smithi037.stdout:7/414: dwrite d5/f37 [0,4194304] 0 2024-04-25T17:19:05.415 INFO:tasks.workunit.client.1.smithi069.stdout:5/104: dwrite fd [0,4194304] 0 2024-04-25T17:19:05.415 INFO:tasks.workunit.client.1.smithi069.stdout:8/102: symlink l23 0 2024-04-25T17:19:05.416 INFO:tasks.workunit.client.0.smithi037.stdout:5/445: truncate d7/ff 7954844 0 2024-04-25T17:19:05.418 INFO:tasks.workunit.client.0.smithi037.stdout:1/339: write f1 [1363845,32355] 0 2024-04-25T17:19:05.420 INFO:tasks.workunit.client.1.smithi069.stdout:9/163: write d2/da/f16 [1799185,39088] 0 2024-04-25T17:19:05.420 INFO:tasks.workunit.client.0.smithi037.stdout:4/548: sync 2024-04-25T17:19:05.420 INFO:tasks.workunit.client.0.smithi037.stdout:8/226: sync 2024-04-25T17:19:05.420 INFO:tasks.workunit.client.0.smithi037.stdout:6/353: sync 2024-04-25T17:19:05.420 INFO:tasks.workunit.client.0.smithi037.stdout:2/359: sync 2024-04-25T17:19:05.422 INFO:tasks.workunit.client.1.smithi069.stdout:9/164: readlink d2/da/d14/d23/l28 0 2024-04-25T17:19:05.423 INFO:tasks.workunit.client.0.smithi037.stdout:7/415: dwrite d5/d15/d17/d1b/d27/f8b [0,4194304] 0 2024-04-25T17:19:05.423 INFO:tasks.workunit.client.0.smithi037.stdout:8/227: write d5/db/d23/f1e [3824973,88350] 0 2024-04-25T17:19:05.424 INFO:tasks.workunit.client.1.smithi069.stdout:5/105: dwrite f9 [0,4194304] 0 2024-04-25T17:19:05.425 INFO:tasks.workunit.client.0.smithi037.stdout:4/549: chown d7/d7e/d45/d4f/c6f 10313 1 2024-04-25T17:19:05.431 INFO:tasks.workunit.client.0.smithi037.stdout:1/340: mknod dc/d1c/d57/d4d/c78 0 2024-04-25T17:19:05.431 INFO:tasks.workunit.client.1.smithi069.stdout:5/106: dwrite f5 [0,4194304] 0 2024-04-25T17:19:05.434 INFO:tasks.workunit.client.0.smithi037.stdout:7/416: dwrite d5/d15/d17/f20 [4194304,4194304] 0 2024-04-25T17:19:05.440 INFO:tasks.workunit.client.1.smithi069.stdout:7/145: creat d4/d1a/f2f x:0 0 0 2024-04-25T17:19:05.447 INFO:tasks.workunit.client.1.smithi069.stdout:2/94: truncate d0/d1/fe 3763933 0 2024-04-25T17:19:05.448 INFO:tasks.workunit.client.1.smithi069.stdout:2/95: dread - d0/f17 zero size 2024-04-25T17:19:05.448 INFO:tasks.workunit.client.1.smithi069.stdout:2/96: readlink d0/d1/l2 0 2024-04-25T17:19:05.451 INFO:tasks.workunit.client.1.smithi069.stdout:0/100: truncate d0/f6 648791 0 2024-04-25T17:19:05.452 INFO:tasks.workunit.client.1.smithi069.stdout:1/123: dread d1/df/d12/f14 [0,4194304] 0 2024-04-25T17:19:05.453 INFO:tasks.workunit.client.0.smithi037.stdout:8/228: mkdir d5/db/d18/d3b 0 2024-04-25T17:19:05.454 INFO:tasks.workunit.client.0.smithi037.stdout:8/229: dread - d5/d26/d33/f36 zero size 2024-04-25T17:19:05.454 INFO:tasks.workunit.client.1.smithi069.stdout:1/124: dread d1/f5 [0,4194304] 0 2024-04-25T17:19:05.455 INFO:tasks.workunit.client.1.smithi069.stdout:1/125: chown d1/d4/de 28 1 2024-04-25T17:19:05.455 INFO:tasks.workunit.client.0.smithi037.stdout:8/230: truncate d5/d26/d33/f34 2418542 0 2024-04-25T17:19:05.456 INFO:tasks.workunit.client.0.smithi037.stdout:1/341: mknod dc/d18/d64/c79 0 2024-04-25T17:19:05.456 INFO:tasks.workunit.client.0.smithi037.stdout:6/354: write db/d26/d2e/d3e/f34 [2158711,95199] 0 2024-04-25T17:19:05.458 INFO:tasks.workunit.client.1.smithi069.stdout:9/165: rename d2/da/f16 to d2/da/d14/d23/f3b 0 2024-04-25T17:19:05.458 INFO:tasks.workunit.client.1.smithi069.stdout:0/101: dwrite d0/da/f10 [0,4194304] 0 2024-04-25T17:19:05.460 INFO:tasks.workunit.client.1.smithi069.stdout:6/115: sync 2024-04-25T17:19:05.460 INFO:tasks.workunit.client.1.smithi069.stdout:4/98: sync 2024-04-25T17:19:05.460 INFO:tasks.workunit.client.0.smithi037.stdout:2/360: unlink d0/d15/d53/c5f 0 2024-04-25T17:19:05.461 INFO:tasks.workunit.client.1.smithi069.stdout:6/116: dread - d2/f21 zero size 2024-04-25T17:19:05.461 INFO:tasks.workunit.client.1.smithi069.stdout:7/146: symlink d4/d6/d14/d15/l30 0 2024-04-25T17:19:05.461 INFO:tasks.workunit.client.0.smithi037.stdout:5/446: getdents d7/d18/d62 0 2024-04-25T17:19:05.464 INFO:tasks.workunit.client.1.smithi069.stdout:2/97: creat d0/d1/f20 x:0 0 0 2024-04-25T17:19:05.464 INFO:tasks.workunit.client.1.smithi069.stdout:2/98: read d0/f7 [33024,121369] 0 2024-04-25T17:19:05.470 INFO:tasks.workunit.client.1.smithi069.stdout:8/103: dwrite f10 [0,4194304] 0 2024-04-25T17:19:05.474 INFO:tasks.workunit.client.0.smithi037.stdout:6/355: rename db/d1d/d20/f6d to db/d26/d2e/d7d/d65/f7e 0 2024-04-25T17:19:05.479 INFO:tasks.workunit.client.0.smithi037.stdout:7/417: symlink d5/l92 0 2024-04-25T17:19:05.481 INFO:tasks.workunit.client.0.smithi037.stdout:2/361: creat d0/d15/d2a/d5a/f6d x:0 0 0 2024-04-25T17:19:05.482 INFO:tasks.workunit.client.1.smithi069.stdout:9/166: mknod d2/da/dd/d1e/d2e/d35/c3c 0 2024-04-25T17:19:05.484 INFO:tasks.workunit.client.0.smithi037.stdout:4/550: creat d7/d7e/d45/fb9 x:0 0 0 2024-04-25T17:19:05.487 INFO:tasks.workunit.client.0.smithi037.stdout:1/342: mknod dc/d52/c7a 0 2024-04-25T17:19:05.487 INFO:tasks.workunit.client.1.smithi069.stdout:1/126: write d1/df/d12/f14 [255242,7076] 0 2024-04-25T17:19:05.488 INFO:tasks.workunit.client.0.smithi037.stdout:1/343: write dc/f62 [459561,76312] 0 2024-04-25T17:19:05.490 INFO:tasks.workunit.client.1.smithi069.stdout:6/117: creat d2/d1e/f2b x:0 0 0 2024-04-25T17:19:05.494 INFO:tasks.workunit.client.1.smithi069.stdout:6/118: dread d2/d7/fa [0,4194304] 0 2024-04-25T17:19:05.494 INFO:tasks.workunit.client.1.smithi069.stdout:6/119: chown d2/d7 0 1 2024-04-25T17:19:05.494 INFO:tasks.workunit.client.1.smithi069.stdout:6/120: chown d2/f18 1350 1 2024-04-25T17:19:05.496 INFO:tasks.workunit.client.0.smithi037.stdout:1/344: dwrite dc/d1c/d57/d22/f6d [0,4194304] 0 2024-04-25T17:19:05.498 INFO:tasks.workunit.client.0.smithi037.stdout:2/362: symlink d0/d16/d3b/l6e 0 2024-04-25T17:19:05.499 INFO:tasks.workunit.client.0.smithi037.stdout:5/447: dread d7/f33 [0,4194304] 0 2024-04-25T17:19:05.499 INFO:tasks.workunit.client.1.smithi069.stdout:2/99: rename d0/d1/l12 to d0/d1/l21 0 2024-04-25T17:19:05.500 INFO:tasks.workunit.client.1.smithi069.stdout:6/121: dwrite d2/f1c [0,4194304] 0 2024-04-25T17:19:05.501 INFO:tasks.workunit.client.0.smithi037.stdout:3/241: sync 2024-04-25T17:19:05.504 INFO:tasks.workunit.client.0.smithi037.stdout:7/418: dwrite d5/f55 [0,4194304] 0 2024-04-25T17:19:05.505 INFO:tasks.workunit.client.1.smithi069.stdout:8/104: stat l19 0 2024-04-25T17:19:05.506 INFO:tasks.workunit.client.0.smithi037.stdout:7/419: chown d5/d15/d17/d1b/l30 1 1 2024-04-25T17:19:05.511 INFO:tasks.workunit.client.1.smithi069.stdout:9/167: fsync d2/da/f20 0 2024-04-25T17:19:05.512 INFO:tasks.workunit.client.1.smithi069.stdout:9/168: fdatasync d2/f2c 0 2024-04-25T17:19:05.512 INFO:tasks.workunit.client.1.smithi069.stdout:4/99: mkdir db/d22/d24 0 2024-04-25T17:19:05.513 INFO:tasks.workunit.client.1.smithi069.stdout:4/100: truncate db/f21 941333 0 2024-04-25T17:19:05.513 INFO:tasks.workunit.client.1.smithi069.stdout:4/101: fdatasync db/f21 0 2024-04-25T17:19:05.514 INFO:tasks.workunit.client.0.smithi037.stdout:2/363: creat d0/d16/d20/d55/f6f x:0 0 0 2024-04-25T17:19:05.514 INFO:tasks.workunit.client.1.smithi069.stdout:7/147: mknod d4/c31 0 2024-04-25T17:19:05.515 INFO:tasks.workunit.client.0.smithi037.stdout:5/448: fsync d7/d12/d5d/f7f 0 2024-04-25T17:19:05.516 INFO:tasks.workunit.client.1.smithi069.stdout:1/127: mknod d1/df/d12/c26 0 2024-04-25T17:19:05.517 INFO:tasks.workunit.client.0.smithi037.stdout:8/231: getdents d5/db/d23 0 2024-04-25T17:19:05.520 INFO:tasks.workunit.client.0.smithi037.stdout:3/242: chown d8/d31/d32/c4b 20 1 2024-04-25T17:19:05.522 INFO:tasks.workunit.client.0.smithi037.stdout:4/551: write d7/f3b [1162620,121257] 0 2024-04-25T17:19:05.523 INFO:tasks.workunit.client.0.smithi037.stdout:4/552: write d7/d7e/d4e/da5/fa8 [858841,79097] 0 2024-04-25T17:19:05.528 INFO:tasks.workunit.client.0.smithi037.stdout:2/364: unlink d0/d16/d68/l6c 0 2024-04-25T17:19:05.530 INFO:tasks.workunit.client.1.smithi069.stdout:0/102: dwrite d0/da/db/f23 [0,4194304] 0 2024-04-25T17:19:05.536 INFO:tasks.workunit.client.1.smithi069.stdout:4/102: creat db/d15/d20/f25 x:0 0 0 2024-04-25T17:19:05.537 INFO:tasks.workunit.client.0.smithi037.stdout:8/232: dread d5/da/f11 [0,4194304] 0 2024-04-25T17:19:05.539 INFO:tasks.workunit.client.0.smithi037.stdout:8/233: write d5/d26/d33/f36 [747763,8626] 0 2024-04-25T17:19:05.539 INFO:tasks.workunit.client.0.smithi037.stdout:3/243: rename d8/l12 to d8/d23/d3a/l4d 0 2024-04-25T17:19:05.540 INFO:tasks.workunit.client.0.smithi037.stdout:8/234: read d5/da/f11 [298611,108374] 0 2024-04-25T17:19:05.541 INFO:tasks.workunit.client.0.smithi037.stdout:8/235: chown d5/d26/d33/f34 387 1 2024-04-25T17:19:05.542 INFO:tasks.workunit.client.0.smithi037.stdout:8/236: fsync d5/db/f12 0 2024-04-25T17:19:05.542 INFO:tasks.workunit.client.1.smithi069.stdout:1/128: fsync d1/f5 0 2024-04-25T17:19:05.543 INFO:tasks.workunit.client.0.smithi037.stdout:8/237: readlink d5/da/l10 0 2024-04-25T17:19:05.543 INFO:tasks.workunit.client.1.smithi069.stdout:6/122: write d2/f14 [4617758,82246] 0 2024-04-25T17:19:05.545 INFO:tasks.workunit.client.0.smithi037.stdout:1/345: truncate fb 5620526 0 2024-04-25T17:19:05.546 INFO:tasks.workunit.client.0.smithi037.stdout:4/553: dread d7/d7e/d1e/f3a [0,4194304] 0 2024-04-25T17:19:05.546 INFO:tasks.workunit.client.0.smithi037.stdout:6/356: link db/d26/d2e/d3e/d25/d61/f74 db/d1d/f7f 0 2024-04-25T17:19:05.546 INFO:tasks.workunit.client.1.smithi069.stdout:1/129: dread d1/d4/d6/f16 [0,4194304] 0 2024-04-25T17:19:05.547 INFO:tasks.workunit.client.1.smithi069.stdout:1/130: chown d1/df 9668 1 2024-04-25T17:19:05.547 INFO:tasks.workunit.client.1.smithi069.stdout:2/100: creat d0/d1/d1d/f22 x:0 0 0 2024-04-25T17:19:05.549 INFO:tasks.workunit.client.0.smithi037.stdout:2/365: symlink d0/d16/d68/l70 0 2024-04-25T17:19:05.550 INFO:tasks.workunit.client.1.smithi069.stdout:6/123: dwrite d2/d7/fd [8388608,4194304] 0 2024-04-25T17:19:05.551 INFO:tasks.workunit.client.0.smithi037.stdout:5/449: symlink d7/d18/l8f 0 2024-04-25T17:19:05.552 INFO:tasks.workunit.client.1.smithi069.stdout:8/105: symlink l24 0 2024-04-25T17:19:05.555 INFO:tasks.workunit.client.0.smithi037.stdout:3/244: chown d8/d31/d32/c35 2846 1 2024-04-25T17:19:05.557 INFO:tasks.workunit.client.0.smithi037.stdout:7/420: write d5/d15/d17/d1b/d27/f3d [2855951,75095] 0 2024-04-25T17:19:05.558 INFO:tasks.workunit.client.0.smithi037.stdout:2/366: dwrite d0/d16/d26/f4a [0,4194304] 0 2024-04-25T17:19:05.560 INFO:tasks.workunit.client.0.smithi037.stdout:2/367: write d0/d16/d26/f4a [2055941,72205] 0 2024-04-25T17:19:05.564 INFO:tasks.workunit.client.0.smithi037.stdout:8/238: dread d5/db/d23/f1e [0,4194304] 0 2024-04-25T17:19:05.564 INFO:tasks.workunit.client.1.smithi069.stdout:4/103: mkdir db/d15/d26 0 2024-04-25T17:19:05.568 INFO:tasks.workunit.client.0.smithi037.stdout:5/450: chown d7/l42 28 1 2024-04-25T17:19:05.572 INFO:tasks.workunit.client.1.smithi069.stdout:2/101: creat d0/d8/f23 x:0 0 0 2024-04-25T17:19:05.574 INFO:tasks.workunit.client.1.smithi069.stdout:2/102: stat d0/d8/d10/c1b 0 2024-04-25T17:19:05.575 INFO:tasks.workunit.client.1.smithi069.stdout:6/124: symlink d2/d7/l2c 0 2024-04-25T17:19:05.576 INFO:tasks.workunit.client.0.smithi037.stdout:3/245: dwrite d8/f26 [0,4194304] 0 2024-04-25T17:19:05.577 INFO:tasks.workunit.client.1.smithi069.stdout:1/131: dwrite d1/d4/fb [0,4194304] 0 2024-04-25T17:19:05.582 INFO:tasks.workunit.client.0.smithi037.stdout:5/451: unlink d7/d63/l6e 0 2024-04-25T17:19:05.583 INFO:tasks.workunit.client.1.smithi069.stdout:7/148: link d4/d6/d14/d15/c29 d4/d6/d14/c32 0 2024-04-25T17:19:05.585 INFO:tasks.workunit.client.1.smithi069.stdout:2/103: dwrite d0/d1/f20 [0,4194304] 0 2024-04-25T17:19:05.586 INFO:tasks.workunit.client.1.smithi069.stdout:7/149: dread d4/d1a/f1c [0,4194304] 0 2024-04-25T17:19:05.588 INFO:tasks.workunit.client.1.smithi069.stdout:6/125: chown d2/l3 0 1 2024-04-25T17:19:05.590 INFO:tasks.workunit.client.0.smithi037.stdout:7/421: dwrite f0 [0,4194304] 0 2024-04-25T17:19:05.592 INFO:tasks.workunit.client.1.smithi069.stdout:1/132: unlink d1/d4/de/d11/f1e 0 2024-04-25T17:19:05.594 INFO:tasks.workunit.client.0.smithi037.stdout:2/368: dread d0/d15/f4f [0,4194304] 0 2024-04-25T17:19:05.595 INFO:tasks.workunit.client.0.smithi037.stdout:2/369: chown d0/d16/d20/f3d 1910 1 2024-04-25T17:19:05.596 INFO:tasks.workunit.client.0.smithi037.stdout:6/357: rename f5 to db/d26/d2e/f80 0 2024-04-25T17:19:05.597 INFO:tasks.workunit.client.1.smithi069.stdout:0/103: truncate d0/f1 897154 0 2024-04-25T17:19:05.599 INFO:tasks.workunit.client.1.smithi069.stdout:0/104: write d0/da/db/f23 [4727551,3470] 0 2024-04-25T17:19:05.600 INFO:tasks.workunit.client.0.smithi037.stdout:5/452: mkdir d7/d12/d5d/d90 0 2024-04-25T17:19:05.603 INFO:tasks.workunit.client.1.smithi069.stdout:2/104: mknod d0/d1/c24 0 2024-04-25T17:19:05.603 INFO:tasks.workunit.client.0.smithi037.stdout:7/422: truncate d5/d15/f1f 437512 0 2024-04-25T17:19:05.604 INFO:tasks.workunit.client.1.smithi069.stdout:2/105: readlink d0/l1e 0 2024-04-25T17:19:05.606 INFO:tasks.workunit.client.1.smithi069.stdout:4/104: dwrite db/d15/f1d [4194304,4194304] 0 2024-04-25T17:19:05.606 INFO:tasks.workunit.client.1.smithi069.stdout:8/106: creat f25 x:0 0 0 2024-04-25T17:19:05.606 INFO:tasks.workunit.client.0.smithi037.stdout:5/453: rmdir d7/d43 39 2024-04-25T17:19:05.608 INFO:tasks.workunit.client.1.smithi069.stdout:1/133: write d1/f5 [1639986,5758] 0 2024-04-25T17:19:05.609 INFO:tasks.workunit.client.0.smithi037.stdout:3/246: rename d8/f17 to d8/f4e 0 2024-04-25T17:19:05.609 INFO:tasks.workunit.client.1.smithi069.stdout:3/168: sync 2024-04-25T17:19:05.609 INFO:tasks.workunit.client.1.smithi069.stdout:5/107: sync 2024-04-25T17:19:05.612 INFO:tasks.workunit.client.1.smithi069.stdout:3/169: chown d8/d16/f27 6 1 2024-04-25T17:19:05.612 INFO:tasks.workunit.client.0.smithi037.stdout:7/423: fdatasync d5/f6f 0 2024-04-25T17:19:05.612 INFO:tasks.workunit.client.1.smithi069.stdout:0/105: mkdir d0/da/d24 0 2024-04-25T17:19:05.613 INFO:tasks.workunit.client.0.smithi037.stdout:2/370: symlink d0/d15/l71 0 2024-04-25T17:19:05.613 INFO:tasks.workunit.client.0.smithi037.stdout:5/454: dwrite d7/d12/f4d [0,4194304] 0 2024-04-25T17:19:05.617 INFO:tasks.workunit.client.1.smithi069.stdout:4/105: dwrite db/f12 [4194304,4194304] 0 2024-04-25T17:19:05.619 INFO:tasks.workunit.client.1.smithi069.stdout:5/108: dwrite fd [0,4194304] 0 2024-04-25T17:19:05.619 INFO:tasks.workunit.client.1.smithi069.stdout:5/109: fdatasync f5 0 2024-04-25T17:19:05.622 INFO:tasks.workunit.client.0.smithi037.stdout:5/455: dwrite d7/d25/f4b [0,4194304] 0 2024-04-25T17:19:05.622 INFO:tasks.workunit.client.1.smithi069.stdout:1/134: unlink d1/f1f 0 2024-04-25T17:19:05.624 INFO:tasks.workunit.client.1.smithi069.stdout:1/135: truncate d1/f5 1876085 0 2024-04-25T17:19:05.626 INFO:tasks.workunit.client.0.smithi037.stdout:4/554: rename d7/d7e/d1e/dae/db0 to d7/d7e/d1e/d2b/d35/d39/dba 0 2024-04-25T17:19:05.627 INFO:tasks.workunit.client.1.smithi069.stdout:1/136: dread d1/df/d12/f14 [0,4194304] 0 2024-04-25T17:19:05.629 INFO:tasks.workunit.client.1.smithi069.stdout:0/106: chown d0/l11 17 1 2024-04-25T17:19:05.631 INFO:tasks.workunit.client.0.smithi037.stdout:2/371: creat d0/d15/d2a/f72 x:0 0 0 2024-04-25T17:19:05.632 INFO:tasks.workunit.client.1.smithi069.stdout:7/150: rename d4/f2a to d4/d6/f33 0 2024-04-25T17:19:05.633 INFO:tasks.workunit.client.1.smithi069.stdout:2/106: rename d0/d1 to d0/d1/d1d/d25 22 2024-04-25T17:19:05.634 INFO:tasks.workunit.client.1.smithi069.stdout:2/107: truncate d0/d8/f18 1087163 0 2024-04-25T17:19:05.638 INFO:tasks.workunit.client.1.smithi069.stdout:4/106: mknod db/d15/d20/c27 0 2024-04-25T17:19:05.647 INFO:tasks.workunit.client.0.smithi037.stdout:8/239: rename d5/db/f12 to d5/d26/f3c 0 2024-04-25T17:19:05.651 INFO:tasks.workunit.client.0.smithi037.stdout:7/424: truncate d5/d14/d31/f75 2644469 0 2024-04-25T17:19:05.653 INFO:tasks.workunit.client.1.smithi069.stdout:3/170: rename d8/d16/f1e to d8/d2a/f43 0 2024-04-25T17:19:05.653 INFO:tasks.workunit.client.1.smithi069.stdout:9/169: sync 2024-04-25T17:19:05.654 INFO:tasks.workunit.client.1.smithi069.stdout:2/108: rmdir d0/d1 39 2024-04-25T17:19:05.655 INFO:tasks.workunit.client.1.smithi069.stdout:3/171: truncate d8/d16/f21 139678 0 2024-04-25T17:19:05.656 INFO:tasks.workunit.client.1.smithi069.stdout:6/126: getdents d2/d1e 0 2024-04-25T17:19:05.656 INFO:tasks.workunit.client.1.smithi069.stdout:2/109: write d0/d8/f18 [961828,59178] 0 2024-04-25T17:19:05.656 INFO:tasks.workunit.client.1.smithi069.stdout:3/172: dread - d8/f18 zero size 2024-04-25T17:19:05.658 INFO:tasks.workunit.client.1.smithi069.stdout:4/107: fsync db/f12 0 2024-04-25T17:19:05.659 INFO:tasks.workunit.client.1.smithi069.stdout:8/107: rename f21 to f26 0 2024-04-25T17:19:05.659 INFO:tasks.workunit.client.1.smithi069.stdout:8/108: rmdir - no directory 2024-04-25T17:19:05.660 INFO:tasks.workunit.client.0.smithi037.stdout:8/240: write d5/f27 [326405,47592] 0 2024-04-25T17:19:05.661 INFO:tasks.workunit.client.1.smithi069.stdout:8/109: write f10 [2647922,70981] 0 2024-04-25T17:19:05.661 INFO:tasks.workunit.client.0.smithi037.stdout:6/358: write db/f16 [157848,107853] 0 2024-04-25T17:19:05.663 INFO:tasks.workunit.client.0.smithi037.stdout:8/241: write d5/f9 [4017538,111477] 0 2024-04-25T17:19:05.663 INFO:tasks.workunit.client.0.smithi037.stdout:6/359: write db/d26/d2e/d7d/d65/f71 [58290,22040] 0 2024-04-25T17:19:05.664 INFO:tasks.workunit.client.1.smithi069.stdout:9/170: dwrite d2/da/dd/f11 [8388608,4194304] 0 2024-04-25T17:19:05.666 INFO:tasks.workunit.client.0.smithi037.stdout:3/247: write d8/d31/d32/f36 [475125,72524] 0 2024-04-25T17:19:05.668 INFO:tasks.workunit.client.0.smithi037.stdout:5/456: dread d7/d25/d4f/f48 [0,4194304] 0 2024-04-25T17:19:05.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:05 smithi069 ceph-mon[34527]: pgmap v33: 65 pgs: 65 active+clean; 810 MiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 9.5 MiB/s rd, 73 MiB/s wr, 254 op/s 2024-04-25T17:19:05.669 INFO:tasks.workunit.client.0.smithi037.stdout:5/457: write d7/d12/f35 [827264,109704] 0 2024-04-25T17:19:05.675 INFO:tasks.workunit.client.0.smithi037.stdout:3/248: creat d8/d23/d3a/f4f x:0 0 0 2024-04-25T17:19:05.684 INFO:tasks.workunit.client.0.smithi037.stdout:5/458: creat d7/d25/f91 x:0 0 0 2024-04-25T17:19:05.684 INFO:tasks.workunit.client.1.smithi069.stdout:3/173: dread d8/d16/d1a/d2c/f2f [0,4194304] 0 2024-04-25T17:19:05.685 INFO:tasks.workunit.client.1.smithi069.stdout:3/174: chown d8/f37 89 1 2024-04-25T17:19:05.687 INFO:tasks.workunit.client.0.smithi037.stdout:8/242: symlink d5/l3d 0 2024-04-25T17:19:05.688 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:05 smithi037 ceph-mon[26472]: pgmap v33: 65 pgs: 65 active+clean; 810 MiB data, 4.1 GiB used, 532 GiB / 536 GiB avail; 9.5 MiB/s rd, 73 MiB/s wr, 254 op/s 2024-04-25T17:19:05.688 INFO:tasks.workunit.client.0.smithi037.stdout:9/493: sync 2024-04-25T17:19:05.688 INFO:tasks.workunit.client.0.smithi037.stdout:0/436: sync 2024-04-25T17:19:05.689 INFO:tasks.workunit.client.0.smithi037.stdout:2/372: dwrite d0/d23/f43 [0,4194304] 0 2024-04-25T17:19:05.690 INFO:tasks.workunit.client.1.smithi069.stdout:4/108: dread db/f11 [0,4194304] 0 2024-04-25T17:19:05.690 INFO:tasks.workunit.client.0.smithi037.stdout:8/243: chown d5/db/f1f 1038 1 2024-04-25T17:19:05.694 INFO:tasks.workunit.client.0.smithi037.stdout:2/373: fdatasync d0/f2d 0 2024-04-25T17:19:05.694 INFO:tasks.workunit.client.0.smithi037.stdout:2/374: stat d0/d16/d26/d3e/l46 0 2024-04-25T17:19:05.695 INFO:tasks.workunit.client.1.smithi069.stdout:5/110: truncate fd 3262366 0 2024-04-25T17:19:05.695 INFO:tasks.workunit.client.1.smithi069.stdout:5/111: write d13/d17/f1b [587372,87785] 0 2024-04-25T17:19:05.698 INFO:tasks.workunit.client.0.smithi037.stdout:4/555: dwrite d7/f13 [0,4194304] 0 2024-04-25T17:19:05.699 INFO:tasks.workunit.client.0.smithi037.stdout:6/360: rename db/d26/c6a to db/d26/d2e/d7d/d65/c81 0 2024-04-25T17:19:05.699 INFO:tasks.workunit.client.0.smithi037.stdout:3/249: creat d8/d23/d3a/f50 x:0 0 0 2024-04-25T17:19:05.699 INFO:tasks.workunit.client.0.smithi037.stdout:2/375: read d0/d15/d53/f61 [3171898,86879] 0 2024-04-25T17:19:05.700 INFO:tasks.workunit.client.1.smithi069.stdout:9/171: creat d2/da/dd/d1e/d2e/d35/f3d x:0 0 0 2024-04-25T17:19:05.700 INFO:tasks.workunit.client.1.smithi069.stdout:5/112: dread d13/f1a [0,4194304] 0 2024-04-25T17:19:05.700 INFO:tasks.workunit.client.1.smithi069.stdout:5/113: readlink d13/l18 0 2024-04-25T17:19:05.700 INFO:tasks.workunit.client.0.smithi037.stdout:5/459: dwrite d7/d25/f65 [0,4194304] 0 2024-04-25T17:19:05.703 INFO:tasks.workunit.client.0.smithi037.stdout:7/425: link d5/d15/f1f d5/d14/d31/f93 0 2024-04-25T17:19:05.704 INFO:tasks.workunit.client.0.smithi037.stdout:5/460: chown d7/d12/c7b 4110 1 2024-04-25T17:19:05.707 INFO:tasks.workunit.client.0.smithi037.stdout:0/437: write d9/d14/f16 [315954,69962] 0 2024-04-25T17:19:05.708 INFO:tasks.workunit.client.0.smithi037.stdout:9/494: dread d1/d5/dc/f11 [0,4194304] 0 2024-04-25T17:19:05.710 INFO:tasks.workunit.client.1.smithi069.stdout:2/110: write d0/f7 [4531549,19011] 0 2024-04-25T17:19:05.717 INFO:tasks.workunit.client.1.smithi069.stdout:3/175: creat d8/d16/d31/f44 x:0 0 0 2024-04-25T17:19:05.718 INFO:tasks.workunit.client.1.smithi069.stdout:2/111: dwrite d0/f7 [4194304,4194304] 0 2024-04-25T17:19:05.719 INFO:tasks.workunit.client.1.smithi069.stdout:2/112: fdatasync d0/d8/f23 0 2024-04-25T17:19:05.722 INFO:tasks.workunit.client.0.smithi037.stdout:3/250: fdatasync d8/d23/f24 0 2024-04-25T17:19:05.723 INFO:tasks.workunit.client.0.smithi037.stdout:2/376: rename d0/d16/d26/f3f to d0/d16/d68/f73 0 2024-04-25T17:19:05.724 INFO:tasks.workunit.client.0.smithi037.stdout:2/377: read - d0/d16/d3b/f5b zero size 2024-04-25T17:19:05.727 INFO:tasks.workunit.client.1.smithi069.stdout:9/172: unlink d2/f30 0 2024-04-25T17:19:05.727 INFO:tasks.workunit.client.1.smithi069.stdout:9/173: chown d2/c1a 2570448 1 2024-04-25T17:19:05.728 INFO:tasks.workunit.client.1.smithi069.stdout:9/174: chown d2/da/dd/d1e/c2a 103 1 2024-04-25T17:19:05.728 INFO:tasks.workunit.client.1.smithi069.stdout:9/175: chown d2 922957218 1 2024-04-25T17:19:05.731 INFO:tasks.workunit.client.1.smithi069.stdout:5/114: truncate f6 2051098 0 2024-04-25T17:19:05.731 INFO:tasks.workunit.client.0.smithi037.stdout:8/244: dread d5/f8 [0,4194304] 0 2024-04-25T17:19:05.733 INFO:tasks.workunit.client.1.smithi069.stdout:0/107: getdents d0/da/db 0 2024-04-25T17:19:05.735 INFO:tasks.workunit.client.0.smithi037.stdout:0/438: creat d9/d71/f99 x:0 0 0 2024-04-25T17:19:05.736 INFO:tasks.workunit.client.1.smithi069.stdout:7/151: getdents d4 0 2024-04-25T17:19:05.737 INFO:tasks.workunit.client.0.smithi037.stdout:7/426: mkdir d5/d15/d17/d1b/d94 0 2024-04-25T17:19:05.738 INFO:tasks.workunit.client.1.smithi069.stdout:7/152: chown d4/d6/d21/d23/f27 111590 1 2024-04-25T17:19:05.739 INFO:tasks.workunit.client.1.smithi069.stdout:7/153: read - d4/d6/f33 zero size 2024-04-25T17:19:05.739 INFO:tasks.workunit.client.1.smithi069.stdout:0/108: dwrite d0/da/db/f23 [0,4194304] 0 2024-04-25T17:19:05.740 INFO:tasks.workunit.client.1.smithi069.stdout:1/137: rename d1/d4/d6/cd to d1/d4/de/c27 0 2024-04-25T17:19:05.740 INFO:tasks.workunit.client.1.smithi069.stdout:7/154: write d4/d6/d14/d15/f2d [789256,89055] 0 2024-04-25T17:19:05.752 INFO:tasks.workunit.client.0.smithi037.stdout:7/427: dread d5/d15/d17/d1b/d27/f2a [0,4194304] 0 2024-04-25T17:19:05.759 INFO:tasks.workunit.client.1.smithi069.stdout:6/127: sync 2024-04-25T17:19:05.800 INFO:tasks.workunit.client.1.smithi069.stdout:3/176: creat d8/d16/d1a/d2c/f45 x:0 0 0 2024-04-25T17:19:05.800 INFO:tasks.workunit.client.1.smithi069.stdout:4/109: creat db/d15/d26/f28 x:0 0 0 2024-04-25T17:19:05.801 INFO:tasks.workunit.client.1.smithi069.stdout:4/110: dread - db/d15/d26/f28 zero size 2024-04-25T17:19:05.801 INFO:tasks.workunit.client.1.smithi069.stdout:4/111: chown db/f21 152208924 1 2024-04-25T17:19:05.803 INFO:tasks.workunit.client.1.smithi069.stdout:8/110: rename f25 to f27 0 2024-04-25T17:19:05.806 INFO:tasks.workunit.client.1.smithi069.stdout:9/176: mkdir d2/da/dd/d1e/d2e/d3e 0 2024-04-25T17:19:05.807 INFO:tasks.workunit.client.1.smithi069.stdout:9/177: write d2/f39 [708961,7651] 0 2024-04-25T17:19:05.808 INFO:tasks.workunit.client.1.smithi069.stdout:9/178: write d2/da/dd/f11 [2944958,85969] 0 2024-04-25T17:19:05.809 INFO:tasks.workunit.client.0.smithi037.stdout:6/361: unlink db/ce 0 2024-04-25T17:19:05.811 INFO:tasks.workunit.client.1.smithi069.stdout:1/138: rmdir d1/df 39 2024-04-25T17:19:05.812 INFO:tasks.workunit.client.1.smithi069.stdout:7/155: mkdir d4/d1a/d34 0 2024-04-25T17:19:05.812 INFO:tasks.workunit.client.0.smithi037.stdout:2/378: write d0/d15/f4f [4068226,130098] 0 2024-04-25T17:19:05.813 INFO:tasks.workunit.client.1.smithi069.stdout:7/156: dread - d4/d6/d21/d23/f27 zero size 2024-04-25T17:19:05.813 INFO:tasks.workunit.client.1.smithi069.stdout:6/128: creat d2/f2d x:0 0 0 2024-04-25T17:19:05.815 INFO:tasks.workunit.client.1.smithi069.stdout:6/129: truncate d2/f2a 280249 0 2024-04-25T17:19:05.817 INFO:tasks.workunit.client.0.smithi037.stdout:8/245: dread - d5/db/f1f zero size 2024-04-25T17:19:05.818 INFO:tasks.workunit.client.1.smithi069.stdout:1/139: dwrite d1/d4/d6/f7 [0,4194304] 0 2024-04-25T17:19:05.818 INFO:tasks.workunit.client.0.smithi037.stdout:8/246: truncate d5/f9 4242466 0 2024-04-25T17:19:05.819 INFO:tasks.workunit.client.1.smithi069.stdout:3/177: symlink d8/d16/l46 0 2024-04-25T17:19:05.820 INFO:tasks.workunit.client.0.smithi037.stdout:5/461: fsync d7/d12/f20 0 2024-04-25T17:19:05.821 INFO:tasks.workunit.client.1.smithi069.stdout:3/178: dread d8/d16/f21 [0,4194304] 0 2024-04-25T17:19:05.822 INFO:tasks.workunit.client.1.smithi069.stdout:4/112: creat db/d15/d26/f29 x:0 0 0 2024-04-25T17:19:05.826 INFO:tasks.workunit.client.0.smithi037.stdout:5/462: dwrite d7/d12/f35 [0,4194304] 0 2024-04-25T17:19:05.828 INFO:tasks.workunit.client.0.smithi037.stdout:7/428: creat d5/d15/d17/d25/d2b/d48/f95 x:0 0 0 2024-04-25T17:19:05.831 INFO:tasks.workunit.client.0.smithi037.stdout:6/362: fdatasync db/d26/d2e/d3e/d25/d61/f73 0 2024-04-25T17:19:05.832 INFO:tasks.workunit.client.1.smithi069.stdout:8/111: dread fb [0,4194304] 0 2024-04-25T17:19:05.832 INFO:tasks.workunit.client.1.smithi069.stdout:8/112: readlink l1b 0 2024-04-25T17:19:05.835 INFO:tasks.workunit.client.0.smithi037.stdout:2/379: mknod d0/d16/d20/c74 0 2024-04-25T17:19:05.837 INFO:tasks.workunit.client.1.smithi069.stdout:8/113: dread f10 [0,4194304] 0 2024-04-25T17:19:05.837 INFO:tasks.workunit.client.0.smithi037.stdout:4/556: link d7/d7e/d1e/d2b/f5f d7/d7e/d1e/dae/fbb 0 2024-04-25T17:19:05.837 INFO:tasks.workunit.client.1.smithi069.stdout:8/114: read f10 [3242117,56627] 0 2024-04-25T17:19:05.840 INFO:tasks.workunit.client.0.smithi037.stdout:4/557: truncate d7/d7e/d45/f95 466119 0 2024-04-25T17:19:05.840 INFO:tasks.workunit.client.0.smithi037.stdout:8/247: mkdir d5/d26/d33/d3e 0 2024-04-25T17:19:05.842 INFO:tasks.workunit.client.1.smithi069.stdout:7/157: unlink d4/d6/f33 0 2024-04-25T17:19:05.843 INFO:tasks.workunit.client.0.smithi037.stdout:2/380: dwrite d0/d15/d53/f62 [0,4194304] 0 2024-04-25T17:19:05.845 INFO:tasks.workunit.client.1.smithi069.stdout:6/130: mkdir d2/d2e 0 2024-04-25T17:19:05.846 INFO:tasks.workunit.client.0.smithi037.stdout:4/558: dread d7/f13 [0,4194304] 0 2024-04-25T17:19:05.846 INFO:tasks.workunit.client.1.smithi069.stdout:6/131: chown d2/fe 101378555 1 2024-04-25T17:19:05.850 INFO:tasks.workunit.client.1.smithi069.stdout:3/179: chown f5 1 1 2024-04-25T17:19:05.853 INFO:tasks.workunit.client.0.smithi037.stdout:9/495: mkdir d1/d48/d68/d26/d81/d9c/da4 0 2024-04-25T17:19:05.853 INFO:tasks.workunit.client.0.smithi037.stdout:4/559: dwrite d7/d7e/d1e/d2b/d35/d39/fac [0,4194304] 0 2024-04-25T17:19:05.856 INFO:tasks.workunit.client.0.smithi037.stdout:5/463: unlink d7/d25/d4f/c59 0 2024-04-25T17:19:05.859 INFO:tasks.workunit.client.1.smithi069.stdout:0/109: write d0/f1 [723212,52894] 0 2024-04-25T17:19:05.862 INFO:tasks.workunit.client.0.smithi037.stdout:3/251: creat d8/d31/d32/f51 x:0 0 0 2024-04-25T17:19:05.866 INFO:tasks.workunit.client.1.smithi069.stdout:5/115: dwrite f6 [0,4194304] 0 2024-04-25T17:19:05.867 INFO:tasks.workunit.client.1.smithi069.stdout:8/115: write f14 [416111,38632] 0 2024-04-25T17:19:05.867 INFO:tasks.workunit.client.1.smithi069.stdout:5/116: write f6 [3352311,61971] 0 2024-04-25T17:19:05.868 INFO:tasks.workunit.client.0.smithi037.stdout:8/248: write d5/d26/f3c [259758,22010] 0 2024-04-25T17:19:05.868 INFO:tasks.workunit.client.0.smithi037.stdout:8/249: chown d5/f35 52291516 1 2024-04-25T17:19:05.869 INFO:tasks.workunit.client.1.smithi069.stdout:5/117: chown d13/d17/f1b 160850755 1 2024-04-25T17:19:05.870 INFO:tasks.workunit.client.0.smithi037.stdout:8/250: write d5/f9 [1491799,88994] 0 2024-04-25T17:19:05.871 INFO:tasks.workunit.client.0.smithi037.stdout:8/251: chown d5/d26/f3c 432048 1 2024-04-25T17:19:05.872 INFO:tasks.workunit.client.0.smithi037.stdout:2/381: mkdir d0/d15/d2a/d5a/d75 0 2024-04-25T17:19:05.872 INFO:tasks.workunit.client.1.smithi069.stdout:8/116: dread f13 [0,4194304] 0 2024-04-25T17:19:05.875 INFO:tasks.workunit.client.1.smithi069.stdout:6/132: rename f1 to d2/f2f 0 2024-04-25T17:19:05.877 INFO:tasks.workunit.client.0.smithi037.stdout:9/496: creat d1/d5/dc/fa5 x:0 0 0 2024-04-25T17:19:05.878 INFO:tasks.workunit.client.1.smithi069.stdout:8/117: dwrite f14 [0,4194304] 0 2024-04-25T17:19:05.878 INFO:tasks.workunit.client.1.smithi069.stdout:3/180: mknod d8/d16/d1a/d2c/c47 0 2024-04-25T17:19:05.879 INFO:tasks.workunit.client.0.smithi037.stdout:9/497: write d1/d5/d2e/f52 [777574,81400] 0 2024-04-25T17:19:05.880 INFO:tasks.workunit.client.1.smithi069.stdout:4/113: mknod db/d22/d24/c2a 0 2024-04-25T17:19:05.881 INFO:tasks.workunit.client.0.smithi037.stdout:5/464: creat d7/d63/f92 x:0 0 0 2024-04-25T17:19:05.883 INFO:tasks.workunit.client.1.smithi069.stdout:2/113: getdents d0 0 2024-04-25T17:19:05.885 INFO:tasks.workunit.client.0.smithi037.stdout:6/363: mkdir db/d26/d2e/d82 0 2024-04-25T17:19:05.885 INFO:tasks.workunit.client.1.smithi069.stdout:2/114: read d0/d1/f20 [2803647,95190] 0 2024-04-25T17:19:05.886 INFO:tasks.workunit.client.0.smithi037.stdout:9/498: dwrite d1/d48/d68/f5a [0,4194304] 0 2024-04-25T17:19:05.888 INFO:tasks.workunit.client.1.smithi069.stdout:7/158: dwrite d4/d18/f1f [0,4194304] 0 2024-04-25T17:19:05.888 INFO:tasks.workunit.client.1.smithi069.stdout:8/118: dwrite fe [0,4194304] 0 2024-04-25T17:19:05.890 INFO:tasks.workunit.client.0.smithi037.stdout:3/252: rename d8/d23/f24 to d8/d31/f52 0 2024-04-25T17:19:05.892 INFO:tasks.workunit.client.0.smithi037.stdout:3/253: chown d8/f4e 332 1 2024-04-25T17:19:05.893 INFO:tasks.workunit.client.1.smithi069.stdout:8/119: dread f14 [0,4194304] 0 2024-04-25T17:19:05.893 INFO:tasks.workunit.client.1.smithi069.stdout:1/140: sync 2024-04-25T17:19:05.894 INFO:tasks.workunit.client.0.smithi037.stdout:3/254: write d8/f22 [1636298,86894] 0 2024-04-25T17:19:05.898 INFO:tasks.workunit.client.0.smithi037.stdout:6/364: dwrite db/d26/d2e/d3e/f2c [0,4194304] 0 2024-04-25T17:19:05.902 INFO:tasks.workunit.client.0.smithi037.stdout:8/252: creat d5/d13/f3f x:0 0 0 2024-04-25T17:19:05.909 INFO:tasks.workunit.client.0.smithi037.stdout:8/253: read d5/f9 [2297595,55581] 0 2024-04-25T17:19:05.910 INFO:tasks.workunit.client.0.smithi037.stdout:4/560: mknod d7/d7e/d1e/d2b/d35/d39/d9c/da3/cbc 0 2024-04-25T17:19:05.911 INFO:tasks.workunit.client.0.smithi037.stdout:4/561: readlink d7/d7e/la6 0 2024-04-25T17:19:05.911 INFO:tasks.workunit.client.1.smithi069.stdout:5/118: creat d13/d17/f1d x:0 0 0 2024-04-25T17:19:05.913 INFO:tasks.workunit.client.0.smithi037.stdout:8/254: read d5/d13/f14 [8157850,1364] 0 2024-04-25T17:19:05.914 INFO:tasks.workunit.client.0.smithi037.stdout:7/429: creat d5/f96 x:0 0 0 2024-04-25T17:19:05.916 INFO:tasks.workunit.client.0.smithi037.stdout:7/430: write d5/d15/d17/f38 [851603,44865] 0 2024-04-25T17:19:05.918 INFO:tasks.workunit.client.1.smithi069.stdout:6/133: stat d2/l1b 0 2024-04-25T17:19:05.919 INFO:tasks.workunit.client.1.smithi069.stdout:6/134: write d2/f18 [637960,14410] 0 2024-04-25T17:19:05.923 INFO:tasks.workunit.client.0.smithi037.stdout:2/382: rename d0/d23/l31 to d0/l76 0 2024-04-25T17:19:05.924 INFO:tasks.workunit.client.1.smithi069.stdout:3/181: mknod d8/d16/d1a/d3e/c48 0 2024-04-25T17:19:05.924 INFO:tasks.workunit.client.0.smithi037.stdout:7/431: dwrite d5/d15/d17/d25/d2b/d59/f6c [0,4194304] 0 2024-04-25T17:19:05.926 INFO:tasks.workunit.client.1.smithi069.stdout:6/135: dwrite d2/f17 [0,4194304] 0 2024-04-25T17:19:05.927 INFO:tasks.workunit.client.1.smithi069.stdout:4/114: symlink db/d15/l2b 0 2024-04-25T17:19:05.928 INFO:tasks.workunit.client.0.smithi037.stdout:3/255: mknod d8/d23/d3a/c53 0 2024-04-25T17:19:05.931 INFO:tasks.workunit.client.0.smithi037.stdout:6/365: symlink db/d1d/d20/d2f/l83 0 2024-04-25T17:19:05.937 INFO:tasks.workunit.client.1.smithi069.stdout:2/115: rename d0/d8 to d0/d26 0 2024-04-25T17:19:05.938 INFO:tasks.workunit.client.1.smithi069.stdout:7/159: creat d4/d1a/f35 x:0 0 0 2024-04-25T17:19:05.938 INFO:tasks.workunit.client.1.smithi069.stdout:7/160: readlink d4/d6/d14/d15/l30 0 2024-04-25T17:19:05.939 INFO:tasks.workunit.client.0.smithi037.stdout:4/562: stat d7/d7e/d1e/f93 0 2024-04-25T17:19:05.939 INFO:tasks.workunit.client.1.smithi069.stdout:7/161: write d4/d6/d14/d15/f26 [571045,40698] 0 2024-04-25T17:19:05.943 INFO:tasks.workunit.client.1.smithi069.stdout:9/179: getdents d2/da/d14/d23 0 2024-04-25T17:19:05.947 INFO:tasks.workunit.client.1.smithi069.stdout:5/119: mkdir d13/d17/d19/d1e 0 2024-04-25T17:19:05.947 INFO:tasks.workunit.client.0.smithi037.stdout:7/432: rmdir d5/d15/d17/d1b 39 2024-04-25T17:19:05.948 INFO:tasks.workunit.client.0.smithi037.stdout:7/433: chown d5/d5e/l83 6963998 1 2024-04-25T17:19:05.951 INFO:tasks.workunit.client.0.smithi037.stdout:6/366: rmdir db/d26 39 2024-04-25T17:19:05.952 INFO:tasks.workunit.client.1.smithi069.stdout:4/115: creat db/d15/d26/f2c x:0 0 0 2024-04-25T17:19:05.955 INFO:tasks.workunit.client.1.smithi069.stdout:0/110: link d0/d17/l18 d0/da/d24/l25 0 2024-04-25T17:19:05.959 INFO:tasks.workunit.client.0.smithi037.stdout:5/465: rename d7/l55 to d7/l93 0 2024-04-25T17:19:05.959 INFO:tasks.workunit.client.0.smithi037.stdout:5/466: fdatasync d7/d12/f35 0 2024-04-25T17:19:05.963 INFO:tasks.workunit.client.0.smithi037.stdout:7/434: unlink d5/d15/d17/f66 0 2024-04-25T17:19:05.964 INFO:tasks.workunit.client.1.smithi069.stdout:9/180: mknod d2/da/dd/d1e/d2e/c3f 0 2024-04-25T17:19:05.968 INFO:tasks.workunit.client.1.smithi069.stdout:5/120: mknod d13/c1f 0 2024-04-25T17:19:05.968 INFO:tasks.workunit.client.1.smithi069.stdout:5/121: truncate d13/f16 928344 0 2024-04-25T17:19:05.971 INFO:tasks.workunit.client.1.smithi069.stdout:4/116: creat db/d22/d24/f2d x:0 0 0 2024-04-25T17:19:05.972 INFO:tasks.workunit.client.1.smithi069.stdout:0/111: mknod d0/d17/c26 0 2024-04-25T17:19:05.973 INFO:tasks.workunit.client.0.smithi037.stdout:4/563: mkdir d7/d7e/d1e/d2b/dbd 0 2024-04-25T17:19:05.973 INFO:tasks.workunit.client.0.smithi037.stdout:1/346: sync 2024-04-25T17:19:05.973 INFO:tasks.workunit.client.0.smithi037.stdout:8/255: link d5/l3a d5/da/l40 0 2024-04-25T17:19:05.974 INFO:tasks.workunit.client.0.smithi037.stdout:9/499: rename d1/d5/l2a to d1/la6 0 2024-04-25T17:19:05.975 INFO:tasks.workunit.client.1.smithi069.stdout:2/116: symlink d0/d1/l27 0 2024-04-25T17:19:05.977 INFO:tasks.workunit.client.1.smithi069.stdout:3/182: dread f5 [0,4194304] 0 2024-04-25T17:19:05.978 INFO:tasks.workunit.client.1.smithi069.stdout:8/120: rename c22 to c28 0 2024-04-25T17:19:05.978 INFO:tasks.workunit.client.1.smithi069.stdout:4/117: dwrite db/d15/d26/f2c [0,4194304] 0 2024-04-25T17:19:05.979 INFO:tasks.workunit.client.0.smithi037.stdout:8/256: dread d5/da/f11 [0,4194304] 0 2024-04-25T17:19:05.979 INFO:tasks.workunit.client.0.smithi037.stdout:8/257: chown d5/d13/f3f 280 1 2024-04-25T17:19:05.979 INFO:tasks.workunit.client.1.smithi069.stdout:3/183: dread - d8/d39/f3c zero size 2024-04-25T17:19:05.979 INFO:tasks.workunit.client.1.smithi069.stdout:3/184: chown d8/d16 64654 1 2024-04-25T17:19:05.979 INFO:tasks.workunit.client.1.smithi069.stdout:4/118: stat db/d22/d24/c2a 0 2024-04-25T17:19:05.980 INFO:tasks.workunit.client.0.smithi037.stdout:8/258: fsync d5/db/d23/f29 0 2024-04-25T17:19:05.980 INFO:tasks.workunit.client.0.smithi037.stdout:8/259: readlink d5/da/l2d 0 2024-04-25T17:19:05.980 INFO:tasks.workunit.client.1.smithi069.stdout:9/181: mkdir d2/da/dd/d1e/d40 0 2024-04-25T17:19:05.981 INFO:tasks.workunit.client.1.smithi069.stdout:3/185: dread d8/f12 [0,4194304] 0 2024-04-25T17:19:05.981 INFO:tasks.workunit.client.0.smithi037.stdout:3/256: creat d8/d23/f54 x:0 0 0 2024-04-25T17:19:05.982 INFO:tasks.workunit.client.0.smithi037.stdout:3/257: readlink d8/l18 0 2024-04-25T17:19:05.982 INFO:tasks.workunit.client.1.smithi069.stdout:1/141: rmdir d1/d4/de/d11/d1b 39 2024-04-25T17:19:05.985 INFO:tasks.workunit.client.0.smithi037.stdout:8/260: dwrite d5/d26/f3c [0,4194304] 0 2024-04-25T17:19:05.987 INFO:tasks.workunit.client.1.smithi069.stdout:5/122: mkdir d13/d17/d19/d20 0 2024-04-25T17:19:05.989 INFO:tasks.workunit.client.0.smithi037.stdout:1/347: mknod dc/d1c/d57/c7b 0 2024-04-25T17:19:05.990 INFO:tasks.workunit.client.1.smithi069.stdout:5/123: dread fa [0,4194304] 0 2024-04-25T17:19:05.993 INFO:tasks.workunit.client.0.smithi037.stdout:9/500: creat d1/d48/d68/d1c/fa7 x:0 0 0 2024-04-25T17:19:05.996 INFO:tasks.workunit.client.1.smithi069.stdout:2/117: mkdir d0/d1/d1d/d28 0 2024-04-25T17:19:05.997 INFO:tasks.workunit.client.0.smithi037.stdout:7/435: write d5/d15/d17/d1b/f1d [154837,127577] 0 2024-04-25T17:19:05.998 INFO:tasks.workunit.client.0.smithi037.stdout:7/436: stat d5/d15/c34 0 2024-04-25T17:19:06.002 INFO:tasks.workunit.client.0.smithi037.stdout:5/467: dwrite d7/d12/f20 [0,4194304] 0 2024-04-25T17:19:06.004 INFO:tasks.workunit.client.0.smithi037.stdout:7/437: dread d5/d15/d17/d25/d2b/f52 [0,4194304] 0 2024-04-25T17:19:06.005 INFO:tasks.workunit.client.1.smithi069.stdout:0/112: write d0/da/db/d1d/f20 [960560,95386] 0 2024-04-25T17:19:06.005 INFO:tasks.workunit.client.0.smithi037.stdout:3/258: truncate d8/d31/d32/f39 390468 0 2024-04-25T17:19:06.007 INFO:tasks.workunit.client.0.smithi037.stdout:6/367: creat db/f84 x:0 0 0 2024-04-25T17:19:06.009 INFO:tasks.workunit.client.1.smithi069.stdout:9/182: creat d2/da/d14/f41 x:0 0 0 2024-04-25T17:19:06.010 INFO:tasks.workunit.client.1.smithi069.stdout:0/113: dread d0/da/db/f23 [0,4194304] 0 2024-04-25T17:19:06.010 INFO:tasks.workunit.client.1.smithi069.stdout:9/183: dread - d2/da/dd/d1e/f2f zero size 2024-04-25T17:19:06.011 INFO:tasks.workunit.client.1.smithi069.stdout:3/186: fdatasync f5 0 2024-04-25T17:19:06.011 INFO:tasks.workunit.client.0.smithi037.stdout:1/348: mknod dc/d1c/d57/d4d/c7c 0 2024-04-25T17:19:06.012 INFO:tasks.workunit.client.1.smithi069.stdout:9/184: write d2/f8 [11401460,57663] 0 2024-04-25T17:19:06.013 INFO:tasks.workunit.client.1.smithi069.stdout:1/142: chown d1/df/d12/c26 22 1 2024-04-25T17:19:06.013 INFO:tasks.workunit.client.0.smithi037.stdout:4/564: symlink d7/d7e/d1e/d2b/d35/d39/lbe 0 2024-04-25T17:19:06.016 INFO:tasks.workunit.client.1.smithi069.stdout:6/136: getdents d2 0 2024-04-25T17:19:06.018 INFO:tasks.workunit.client.1.smithi069.stdout:3/187: dwrite d8/f19 [0,4194304] 0 2024-04-25T17:19:06.019 INFO:tasks.workunit.client.1.smithi069.stdout:5/124: rename cf to d13/d17/d19/c21 0 2024-04-25T17:19:06.022 INFO:tasks.workunit.client.0.smithi037.stdout:7/438: creat d5/d14/f97 x:0 0 0 2024-04-25T17:19:06.023 INFO:tasks.workunit.client.1.smithi069.stdout:2/118: creat d0/d1/d1d/f29 x:0 0 0 2024-04-25T17:19:06.024 INFO:tasks.workunit.client.0.smithi037.stdout:3/259: symlink d8/d11/l55 0 2024-04-25T17:19:06.025 INFO:tasks.workunit.client.1.smithi069.stdout:7/162: getdents d4/d1a 0 2024-04-25T17:19:06.026 INFO:tasks.workunit.client.1.smithi069.stdout:8/121: symlink l29 0 2024-04-25T17:19:06.027 INFO:tasks.workunit.client.0.smithi037.stdout:8/261: truncate f4 302150 0 2024-04-25T17:19:06.029 INFO:tasks.workunit.client.0.smithi037.stdout:1/349: creat dc/d18/f7d x:0 0 0 2024-04-25T17:19:06.034 INFO:tasks.workunit.client.1.smithi069.stdout:8/122: dwrite ff [0,4194304] 0 2024-04-25T17:19:06.034 INFO:tasks.workunit.client.0.smithi037.stdout:9/501: mknod d1/d48/d68/d26/da1/ca8 0 2024-04-25T17:19:06.034 INFO:tasks.workunit.client.0.smithi037.stdout:6/368: dread db/d26/d2e/d3e/d25/f6c [0,4194304] 0 2024-04-25T17:19:06.034 INFO:tasks.workunit.client.0.smithi037.stdout:9/502: chown d1/d5/dc/d38/f71 29 1 2024-04-25T17:19:06.034 INFO:tasks.workunit.client.1.smithi069.stdout:0/114: mkdir d0/da/db/d1d/d27 0 2024-04-25T17:19:06.035 INFO:tasks.workunit.client.0.smithi037.stdout:6/369: read db/d26/f2b [1005755,83115] 0 2024-04-25T17:19:06.040 INFO:tasks.workunit.client.0.smithi037.stdout:9/503: dwrite d1/f2 [0,4194304] 0 2024-04-25T17:19:06.041 INFO:tasks.workunit.client.0.smithi037.stdout:8/262: symlink d5/d13/l41 0 2024-04-25T17:19:06.042 INFO:tasks.workunit.client.0.smithi037.stdout:9/504: chown d1/d48/d68/d26/d81/l92 0 1 2024-04-25T17:19:06.043 INFO:tasks.workunit.client.1.smithi069.stdout:1/143: chown d1/d4/de/c27 565595 1 2024-04-25T17:19:06.043 INFO:tasks.workunit.client.1.smithi069.stdout:1/144: stat d1/d4/de 0 2024-04-25T17:19:06.047 INFO:tasks.workunit.client.1.smithi069.stdout:6/137: creat d2/d7/f30 x:0 0 0 2024-04-25T17:19:06.048 INFO:tasks.workunit.client.1.smithi069.stdout:6/138: readlink d2/l1b 0 2024-04-25T17:19:06.050 INFO:tasks.workunit.client.1.smithi069.stdout:3/188: unlink d8/d16/f23 0 2024-04-25T17:19:06.052 INFO:tasks.workunit.client.0.smithi037.stdout:7/439: symlink d5/d14/d31/l98 0 2024-04-25T17:19:06.052 INFO:tasks.workunit.client.0.smithi037.stdout:5/468: truncate d7/f33 5684016 0 2024-04-25T17:19:06.054 INFO:tasks.workunit.client.0.smithi037.stdout:3/260: mknod d8/d23/d38/c56 0 2024-04-25T17:19:06.056 INFO:tasks.workunit.client.1.smithi069.stdout:2/119: dread d0/f7 [4194304,4194304] 0 2024-04-25T17:19:06.057 INFO:tasks.workunit.client.0.smithi037.stdout:8/263: mkdir d5/db/d23/d42 0 2024-04-25T17:19:06.058 INFO:tasks.workunit.client.1.smithi069.stdout:4/119: link db/f11 db/d15/d20/f2e 0 2024-04-25T17:19:06.058 INFO:tasks.workunit.client.1.smithi069.stdout:4/120: dread - db/d15/d26/f29 zero size 2024-04-25T17:19:06.059 INFO:tasks.workunit.client.0.smithi037.stdout:1/350: fsync dc/d1c/d57/d22/f2c 0 2024-04-25T17:19:06.060 INFO:tasks.workunit.client.1.smithi069.stdout:4/121: write db/f16 [968122,99990] 0 2024-04-25T17:19:06.060 INFO:tasks.workunit.client.0.smithi037.stdout:1/351: fsync dc/d1c/d57/d4d/f53 0 2024-04-25T17:19:06.060 INFO:tasks.workunit.client.1.smithi069.stdout:4/122: stat db/f1c 0 2024-04-25T17:19:06.061 INFO:tasks.workunit.client.1.smithi069.stdout:0/115: symlink d0/da/db/l28 0 2024-04-25T17:19:06.062 INFO:tasks.workunit.client.1.smithi069.stdout:0/116: fdatasync d0/da/db/d1d/f20 0 2024-04-25T17:19:06.065 INFO:tasks.workunit.client.1.smithi069.stdout:1/145: chown d1/d4/de/d11/d1b 3466 1 2024-04-25T17:19:06.065 INFO:tasks.workunit.client.1.smithi069.stdout:1/146: chown d1/df/d12/c20 745 1 2024-04-25T17:19:06.066 INFO:tasks.workunit.client.1.smithi069.stdout:1/147: fsync d1/d4/de/d11/f18 0 2024-04-25T17:19:06.067 INFO:tasks.workunit.client.0.smithi037.stdout:5/469: unlink d7/d25/d4f/c83 0 2024-04-25T17:19:06.068 INFO:tasks.workunit.client.0.smithi037.stdout:5/470: fdatasync d7/d25/f4b 0 2024-04-25T17:19:06.068 INFO:tasks.workunit.client.1.smithi069.stdout:6/139: symlink d2/l31 0 2024-04-25T17:19:06.069 INFO:tasks.workunit.client.0.smithi037.stdout:3/261: readlink d8/d23/d3a/l4d 0 2024-04-25T17:19:06.072 INFO:tasks.workunit.client.0.smithi037.stdout:6/370: write db/f14 [3728979,47209] 0 2024-04-25T17:19:06.074 INFO:tasks.workunit.client.1.smithi069.stdout:5/125: creat d13/d17/d19/d20/f22 x:0 0 0 2024-04-25T17:19:06.080 INFO:tasks.workunit.client.1.smithi069.stdout:2/120: symlink d0/d1/l2a 0 2024-04-25T17:19:06.083 INFO:tasks.workunit.client.0.smithi037.stdout:1/352: rename dc/d18/f25 to dc/d1c/d57/d4d/f7e 0 2024-04-25T17:19:06.084 INFO:tasks.workunit.client.0.smithi037.stdout:1/353: dread - dc/d24/f71 zero size 2024-04-25T17:19:06.084 INFO:tasks.workunit.client.0.smithi037.stdout:1/354: fsync dc/d1c/d57/d22/f6d 0 2024-04-25T17:19:06.085 INFO:tasks.workunit.client.0.smithi037.stdout:7/440: symlink d5/d14/d31/l99 0 2024-04-25T17:19:06.086 INFO:tasks.workunit.client.0.smithi037.stdout:1/355: dread - dc/d18/d66/f77 zero size 2024-04-25T17:19:06.088 INFO:tasks.workunit.client.0.smithi037.stdout:6/371: dread db/d1d/d20/f21 [0,4194304] 0 2024-04-25T17:19:06.089 INFO:tasks.workunit.client.0.smithi037.stdout:5/471: mkdir d7/d12/d6f/d94 0 2024-04-25T17:19:06.091 INFO:tasks.workunit.client.1.smithi069.stdout:9/185: creat d2/f42 x:0 0 0 2024-04-25T17:19:06.092 INFO:tasks.workunit.client.0.smithi037.stdout:7/441: dwrite d5/d15/d17/d25/d2b/d59/f6c [0,4194304] 0 2024-04-25T17:19:06.093 INFO:tasks.workunit.client.1.smithi069.stdout:9/186: write d2/da/dd/d1e/d2e/d35/f3d [171244,85239] 0 2024-04-25T17:19:06.093 INFO:tasks.workunit.client.1.smithi069.stdout:0/117: mkdir d0/da/d29 0 2024-04-25T17:19:06.094 INFO:tasks.workunit.client.1.smithi069.stdout:3/189: dwrite f6 [0,4194304] 0 2024-04-25T17:19:06.095 INFO:tasks.workunit.client.1.smithi069.stdout:3/190: read - d8/f18 zero size 2024-04-25T17:19:06.096 INFO:tasks.workunit.client.1.smithi069.stdout:3/191: write f6 [1271327,9728] 0 2024-04-25T17:19:06.098 INFO:tasks.workunit.client.0.smithi037.stdout:8/264: creat d5/db/d23/d42/f43 x:0 0 0 2024-04-25T17:19:06.100 INFO:tasks.workunit.client.0.smithi037.stdout:4/565: getdents d7/d78 0 2024-04-25T17:19:06.101 INFO:tasks.workunit.client.0.smithi037.stdout:4/566: stat d7/d7e/d1e/f93 0 2024-04-25T17:19:06.103 INFO:tasks.workunit.client.1.smithi069.stdout:3/192: dwrite f6 [0,4194304] 0 2024-04-25T17:19:06.110 INFO:tasks.workunit.client.1.smithi069.stdout:2/121: chown d0/l16 358989 1 2024-04-25T17:19:06.111 INFO:tasks.workunit.client.0.smithi037.stdout:1/356: dwrite dc/d24/f4b [0,4194304] 0 2024-04-25T17:19:06.113 INFO:tasks.workunit.client.0.smithi037.stdout:3/262: mkdir d8/d57 0 2024-04-25T17:19:06.113 INFO:tasks.workunit.client.0.smithi037.stdout:1/357: dread - dc/d1c/d57/d4d/f53 zero size 2024-04-25T17:19:06.115 INFO:tasks.workunit.client.0.smithi037.stdout:1/358: write dc/d24/f5e [697510,29570] 0 2024-04-25T17:19:06.115 INFO:tasks.workunit.client.0.smithi037.stdout:7/442: symlink d5/d15/d17/d1b/d27/l9a 0 2024-04-25T17:19:06.118 INFO:tasks.workunit.client.0.smithi037.stdout:8/265: rename d5/f8 to d5/db/d18/d3b/f44 0 2024-04-25T17:19:06.119 INFO:tasks.workunit.client.0.smithi037.stdout:8/266: chown d5/l3d 804 1 2024-04-25T17:19:06.121 INFO:tasks.workunit.client.0.smithi037.stdout:3/263: read d8/f9 [1187709,105011] 0 2024-04-25T17:19:06.121 INFO:tasks.workunit.client.0.smithi037.stdout:8/267: dread - d5/d13/f3f zero size 2024-04-25T17:19:06.122 INFO:tasks.workunit.client.0.smithi037.stdout:6/372: mkdir db/d1d/d20/d85 0 2024-04-25T17:19:06.123 INFO:tasks.workunit.client.1.smithi069.stdout:6/140: unlink d2/cb 0 2024-04-25T17:19:06.123 INFO:tasks.workunit.client.0.smithi037.stdout:3/264: fsync d8/d31/f47 0 2024-04-25T17:19:06.123 INFO:tasks.workunit.client.0.smithi037.stdout:5/472: getdents d7/d12/d6f/d94 0 2024-04-25T17:19:06.123 INFO:tasks.workunit.client.0.smithi037.stdout:1/359: dwrite dc/d1c/d57/d22/d36/f54 [0,4194304] 0 2024-04-25T17:19:06.124 INFO:tasks.workunit.client.1.smithi069.stdout:3/193: fdatasync d8/f1d 0 2024-04-25T17:19:06.127 INFO:tasks.workunit.client.1.smithi069.stdout:7/163: getdents d4/d18 0 2024-04-25T17:19:06.127 INFO:tasks.workunit.client.1.smithi069.stdout:7/164: chown d4/d18 0 1 2024-04-25T17:19:06.129 INFO:tasks.workunit.client.0.smithi037.stdout:4/567: fdatasync d7/f19 0 2024-04-25T17:19:06.131 INFO:tasks.workunit.client.0.smithi037.stdout:5/473: dwrite d7/d12/f21 [0,4194304] 0 2024-04-25T17:19:06.133 INFO:tasks.workunit.client.1.smithi069.stdout:8/123: rename lc to l2a 0 2024-04-25T17:19:06.135 INFO:tasks.workunit.client.1.smithi069.stdout:4/123: creat db/f2f x:0 0 0 2024-04-25T17:19:06.136 INFO:tasks.workunit.client.0.smithi037.stdout:1/360: mknod dc/d18/d66/c7f 0 2024-04-25T17:19:06.138 INFO:tasks.workunit.client.1.smithi069.stdout:0/118: write d0/f4 [2669489,101881] 0 2024-04-25T17:19:06.139 INFO:tasks.workunit.client.1.smithi069.stdout:0/119: read d0/f8 [3623796,48676] 0 2024-04-25T17:19:06.140 INFO:tasks.workunit.client.1.smithi069.stdout:9/187: link d2/da/dd/f11 d2/da/d14/d23/f43 0 2024-04-25T17:19:06.143 INFO:tasks.workunit.client.1.smithi069.stdout:1/148: creat d1/f28 x:0 0 0 2024-04-25T17:19:06.145 INFO:tasks.workunit.client.1.smithi069.stdout:6/141: creat d2/d1e/f32 x:0 0 0 2024-04-25T17:19:06.147 INFO:tasks.workunit.client.1.smithi069.stdout:3/194: read f5 [4980,2977] 0 2024-04-25T17:19:06.148 INFO:tasks.workunit.client.1.smithi069.stdout:6/142: dread d2/d7/fd [4194304,4194304] 0 2024-04-25T17:19:06.149 INFO:tasks.workunit.client.1.smithi069.stdout:5/126: rmdir d13/d17/d19/d1e 0 2024-04-25T17:19:06.149 INFO:tasks.workunit.client.1.smithi069.stdout:6/143: chown d2/c6 2085 1 2024-04-25T17:19:06.149 INFO:tasks.workunit.client.1.smithi069.stdout:6/144: readlink d2/d1e/l26 0 2024-04-25T17:19:06.151 INFO:tasks.workunit.client.0.smithi037.stdout:1/361: dread f7 [4194304,4194304] 0 2024-04-25T17:19:06.151 INFO:tasks.workunit.client.0.smithi037.stdout:6/373: mknod db/d26/d2e/d82/c86 0 2024-04-25T17:19:06.152 INFO:tasks.workunit.client.0.smithi037.stdout:1/362: chown dc/d1c/d57/d22/f2c 882049077 1 2024-04-25T17:19:06.152 INFO:tasks.workunit.client.1.smithi069.stdout:5/127: dread f6 [0,4194304] 0 2024-04-25T17:19:06.152 INFO:tasks.workunit.client.0.smithi037.stdout:4/568: symlink d7/d7e/lbf 0 2024-04-25T17:19:06.153 INFO:tasks.workunit.client.0.smithi037.stdout:1/363: chown dc/d1c/d57/c7b 76680 1 2024-04-25T17:19:06.153 INFO:tasks.workunit.client.1.smithi069.stdout:8/124: stat l1a 0 2024-04-25T17:19:06.154 INFO:tasks.workunit.client.1.smithi069.stdout:4/124: creat db/d15/f30 x:0 0 0 2024-04-25T17:19:06.155 INFO:tasks.workunit.client.0.smithi037.stdout:5/474: symlink d7/d18/d7c/l95 0 2024-04-25T17:19:06.156 INFO:tasks.workunit.client.0.smithi037.stdout:6/374: mkdir db/d26/d2e/d7d/d65/d68/d87 0 2024-04-25T17:19:06.157 INFO:tasks.workunit.client.1.smithi069.stdout:0/120: mkdir d0/da/db/d2a 0 2024-04-25T17:19:06.157 INFO:tasks.workunit.client.1.smithi069.stdout:4/125: dread db/d15/d26/f2c [0,4194304] 0 2024-04-25T17:19:06.158 INFO:tasks.workunit.client.0.smithi037.stdout:1/364: unlink dc/d1c/d57/d22/d36/f41 0 2024-04-25T17:19:06.160 INFO:tasks.workunit.client.0.smithi037.stdout:4/569: creat d7/d7e/d1e/d2b/d35/d39/d9c/da3/fc0 x:0 0 0 2024-04-25T17:19:06.161 INFO:tasks.workunit.client.1.smithi069.stdout:1/149: fdatasync d1/df/d17/f24 0 2024-04-25T17:19:06.162 INFO:tasks.workunit.client.1.smithi069.stdout:1/150: fsync d1/d4/d6/f7 0 2024-04-25T17:19:06.163 INFO:tasks.workunit.client.0.smithi037.stdout:6/375: dwrite db/d26/f27 [0,4194304] 0 2024-04-25T17:19:06.164 INFO:tasks.workunit.client.1.smithi069.stdout:1/151: dread d1/df/d12/f14 [0,4194304] 0 2024-04-25T17:19:06.165 INFO:tasks.workunit.client.0.smithi037.stdout:1/365: symlink dc/d1c/d57/d4d/l80 0 2024-04-25T17:19:06.171 INFO:tasks.workunit.client.1.smithi069.stdout:3/195: mkdir d8/d16/d1a/d2c/d49 0 2024-04-25T17:19:06.173 INFO:tasks.workunit.client.0.smithi037.stdout:8/268: write f4 [82410,31349] 0 2024-04-25T17:19:06.177 INFO:tasks.workunit.client.0.smithi037.stdout:1/366: symlink dc/d1c/d57/d22/d36/l81 0 2024-04-25T17:19:06.178 INFO:tasks.workunit.client.0.smithi037.stdout:4/570: mkdir d7/d7e/d1e/dc1 0 2024-04-25T17:19:06.180 INFO:tasks.workunit.client.0.smithi037.stdout:6/376: mknod db/d5a/c88 0 2024-04-25T17:19:06.185 INFO:tasks.workunit.client.0.smithi037.stdout:1/367: symlink dc/d18/d66/l82 0 2024-04-25T17:19:06.185 INFO:tasks.workunit.client.0.smithi037.stdout:4/571: dwrite d7/d7e/d45/fa0 [0,4194304] 0 2024-04-25T17:19:06.191 INFO:tasks.workunit.client.1.smithi069.stdout:6/145: rmdir d2 39 2024-04-25T17:19:06.194 INFO:tasks.workunit.client.1.smithi069.stdout:0/121: chown d0/f6 1771 1 2024-04-25T17:19:06.196 INFO:tasks.workunit.client.0.smithi037.stdout:1/368: creat dc/d1c/d57/f83 x:0 0 0 2024-04-25T17:19:06.197 INFO:tasks.workunit.client.1.smithi069.stdout:7/165: truncate d4/d6/fa 4849369 0 2024-04-25T17:19:06.199 INFO:tasks.workunit.client.0.smithi037.stdout:4/572: chown d7/d7e/d1e/c76 17281 1 2024-04-25T17:19:06.200 INFO:tasks.workunit.client.0.smithi037.stdout:4/573: write d7/d7e/d1e/f3a [3098605,114016] 0 2024-04-25T17:19:06.200 INFO:tasks.workunit.client.1.smithi069.stdout:0/122: dwrite d0/fc [0,4194304] 0 2024-04-25T17:19:06.202 INFO:tasks.workunit.client.1.smithi069.stdout:9/188: link d2/da/dd/d1e/f26 d2/da/dd/d1e/d40/f44 0 2024-04-25T17:19:06.202 INFO:tasks.workunit.client.1.smithi069.stdout:8/125: write f8 [2120452,114177] 0 2024-04-25T17:19:06.203 INFO:tasks.workunit.client.1.smithi069.stdout:8/126: rmdir - no directory 2024-04-25T17:19:06.204 INFO:tasks.workunit.client.1.smithi069.stdout:9/189: chown d2/da/dd/d1e/l32 2 1 2024-04-25T17:19:06.210 INFO:tasks.workunit.client.1.smithi069.stdout:9/190: dwrite d2/da/f10 [4194304,4194304] 0 2024-04-25T17:19:06.212 INFO:tasks.workunit.client.1.smithi069.stdout:2/122: getdents d0/d1/d1d 0 2024-04-25T17:19:06.216 INFO:tasks.workunit.client.1.smithi069.stdout:6/146: write d2/d1e/f32 [413009,100157] 0 2024-04-25T17:19:06.217 INFO:tasks.workunit.client.1.smithi069.stdout:4/126: link db/f12 db/d22/d24/f31 0 2024-04-25T17:19:06.219 INFO:tasks.workunit.client.1.smithi069.stdout:9/191: dwrite d2/da/dd/d1e/d2e/d35/f3d [0,4194304] 0 2024-04-25T17:19:06.220 INFO:tasks.workunit.client.1.smithi069.stdout:7/166: mkdir d4/d18/d36 0 2024-04-25T17:19:06.221 INFO:tasks.workunit.client.1.smithi069.stdout:7/167: readlink d4/d6/d14/d15/l30 0 2024-04-25T17:19:06.224 INFO:tasks.workunit.client.1.smithi069.stdout:8/127: write f26 [1741686,83618] 0 2024-04-25T17:19:06.226 INFO:tasks.workunit.client.1.smithi069.stdout:1/152: mkdir d1/d29 0 2024-04-25T17:19:06.228 INFO:tasks.workunit.client.1.smithi069.stdout:8/128: dread f14 [0,4194304] 0 2024-04-25T17:19:06.229 INFO:tasks.workunit.client.1.smithi069.stdout:3/196: truncate d8/f1f 126430 0 2024-04-25T17:19:06.233 INFO:tasks.workunit.client.1.smithi069.stdout:2/123: creat d0/d26/f2b x:0 0 0 2024-04-25T17:19:06.234 INFO:tasks.workunit.client.1.smithi069.stdout:4/127: symlink db/d15/d26/l32 0 2024-04-25T17:19:06.234 INFO:tasks.workunit.client.1.smithi069.stdout:4/128: fdatasync db/f14 0 2024-04-25T17:19:06.234 INFO:tasks.workunit.client.1.smithi069.stdout:9/192: creat d2/da/dd/d1e/d2e/f45 x:0 0 0 2024-04-25T17:19:06.235 INFO:tasks.workunit.client.1.smithi069.stdout:0/123: creat d0/da/d29/f2b x:0 0 0 2024-04-25T17:19:06.235 INFO:tasks.workunit.client.1.smithi069.stdout:7/168: mkdir d4/d37 0 2024-04-25T17:19:06.248 INFO:tasks.workunit.client.0.smithi037.stdout:0/439: sync 2024-04-25T17:19:06.249 INFO:tasks.workunit.client.1.smithi069.stdout:1/153: rmdir d1/df/d17 39 2024-04-25T17:19:06.249 INFO:tasks.workunit.client.0.smithi037.stdout:8/269: link d5/db/d18/l31 d5/d26/d33/l45 0 2024-04-25T17:19:06.251 INFO:tasks.workunit.client.0.smithi037.stdout:4/574: truncate d7/d7e/d1e/d2b/d35/d39/d83/f9a 730562 0 2024-04-25T17:19:06.251 INFO:tasks.workunit.client.0.smithi037.stdout:0/440: read d9/d14/d28/d48/f7e [49729,29378] 0 2024-04-25T17:19:06.251 INFO:tasks.workunit.client.0.smithi037.stdout:1/369: rename dc/d1c/d57/d22/d36/l5c to dc/d18/d39/l84 0 2024-04-25T17:19:06.253 INFO:tasks.workunit.client.0.smithi037.stdout:4/575: stat d7/d7e/d45/d4f/f96 0 2024-04-25T17:19:06.253 INFO:tasks.workunit.client.0.smithi037.stdout:1/370: dread - dc/d18/f7d zero size 2024-04-25T17:19:06.253 INFO:tasks.workunit.client.1.smithi069.stdout:5/128: getdents d13 0 2024-04-25T17:19:06.257 INFO:tasks.workunit.client.0.smithi037.stdout:6/377: link db/d26/d2e/d3e/d25/d61/c72 db/d1d/d20/d2f/c89 0 2024-04-25T17:19:06.258 INFO:tasks.workunit.client.1.smithi069.stdout:6/147: link d2/fe d2/d1e/f33 0 2024-04-25T17:19:06.259 INFO:tasks.workunit.client.1.smithi069.stdout:6/148: rename d2 to d2/d2e/d34 22 2024-04-25T17:19:06.260 INFO:tasks.workunit.client.1.smithi069.stdout:2/124: symlink d0/d26/l2c 0 2024-04-25T17:19:06.261 INFO:tasks.workunit.client.1.smithi069.stdout:2/125: fsync d0/d1/d1d/f29 0 2024-04-25T17:19:06.263 INFO:tasks.workunit.client.1.smithi069.stdout:0/124: rmdir d0/da/db 39 2024-04-25T17:19:06.269 INFO:tasks.workunit.client.0.smithi037.stdout:8/270: rmdir d5/d26/d33/d3e 0 2024-04-25T17:19:06.271 INFO:tasks.workunit.client.1.smithi069.stdout:2/126: dwrite d0/d26/f2b [0,4194304] 0 2024-04-25T17:19:06.271 INFO:tasks.workunit.client.0.smithi037.stdout:4/576: link d7/d7e/d1e/d2b/d35/f7d d7/d7e/d1e/d2b/d35/d39/dba/fc2 0 2024-04-25T17:19:06.272 INFO:tasks.workunit.client.1.smithi069.stdout:2/127: read d0/d26/f13 [5423487,8895] 0 2024-04-25T17:19:06.273 INFO:tasks.workunit.client.0.smithi037.stdout:6/378: symlink db/d26/d2e/l8a 0 2024-04-25T17:19:06.276 INFO:tasks.workunit.client.0.smithi037.stdout:8/271: dwrite d5/d26/f3c [0,4194304] 0 2024-04-25T17:19:06.276 INFO:tasks.workunit.client.0.smithi037.stdout:0/441: link d9/df/d32/d39/f63 d9/d14/f9a 0 2024-04-25T17:19:06.281 INFO:tasks.workunit.client.0.smithi037.stdout:6/379: dwrite db/f84 [0,4194304] 0 2024-04-25T17:19:06.283 INFO:tasks.workunit.client.1.smithi069.stdout:7/169: link d4/d6/d21/d23/f27 d4/d1a/d34/f38 0 2024-04-25T17:19:06.285 INFO:tasks.workunit.client.1.smithi069.stdout:8/129: creat f2b x:0 0 0 2024-04-25T17:19:06.285 INFO:tasks.workunit.client.0.smithi037.stdout:4/577: truncate d7/d7e/d1e/d2b/f5f 1063991 0 2024-04-25T17:19:06.287 INFO:tasks.workunit.client.0.smithi037.stdout:8/272: rename d5/l3a to d5/db/d23/l46 0 2024-04-25T17:19:06.289 INFO:tasks.workunit.client.0.smithi037.stdout:6/380: mkdir db/d26/d2e/d7d/d65/d8b 0 2024-04-25T17:19:06.290 INFO:tasks.workunit.client.1.smithi069.stdout:2/128: rename d0/d26/l2c to d0/d26/l2d 0 2024-04-25T17:19:06.292 INFO:tasks.workunit.client.0.smithi037.stdout:0/442: creat d9/df/d32/d35/d66/d7a/f9b x:0 0 0 2024-04-25T17:19:06.294 INFO:tasks.workunit.client.1.smithi069.stdout:3/197: dwrite d8/f1f [0,4194304] 0 2024-04-25T17:19:06.296 INFO:tasks.workunit.client.0.smithi037.stdout:8/273: write d5/db/d18/d3b/f44 [2392234,40777] 0 2024-04-25T17:19:06.297 INFO:tasks.workunit.client.1.smithi069.stdout:9/193: link d2/da/dd/d1e/d40/f44 d2/da/d14/f46 0 2024-04-25T17:19:06.298 INFO:tasks.workunit.client.0.smithi037.stdout:6/381: dwrite db/d1d/f5f [0,4194304] 0 2024-04-25T17:19:06.301 INFO:tasks.workunit.client.1.smithi069.stdout:0/125: write d0/da/db/f23 [1856841,91386] 0 2024-04-25T17:19:06.302 INFO:tasks.workunit.client.1.smithi069.stdout:0/126: readlink d0/da/db/ld 0 2024-04-25T17:19:06.306 INFO:tasks.workunit.client.0.smithi037.stdout:0/443: symlink d9/df/d32/d39/d68/l9c 0 2024-04-25T17:19:06.307 INFO:tasks.workunit.client.1.smithi069.stdout:5/129: link f6 d13/d17/f23 0 2024-04-25T17:19:06.308 INFO:tasks.workunit.client.1.smithi069.stdout:5/130: chown fa 233 1 2024-04-25T17:19:06.308 INFO:tasks.workunit.client.1.smithi069.stdout:5/131: chown f5 1313 1 2024-04-25T17:19:06.309 INFO:tasks.workunit.client.1.smithi069.stdout:0/127: dwrite d0/da/db/fe [0,4194304] 0 2024-04-25T17:19:06.317 INFO:tasks.workunit.client.0.smithi037.stdout:0/444: unlink d9/df/d32/d39/l6b 0 2024-04-25T17:19:06.319 INFO:tasks.workunit.client.1.smithi069.stdout:4/129: getdents db/d15/d20 0 2024-04-25T17:19:06.323 INFO:tasks.workunit.client.1.smithi069.stdout:3/198: mknod d8/d16/d1a/d3e/c4a 0 2024-04-25T17:19:06.324 INFO:tasks.workunit.client.1.smithi069.stdout:3/199: write d8/f19 [1382872,127820] 0 2024-04-25T17:19:06.326 INFO:tasks.workunit.client.0.smithi037.stdout:4/578: dread d7/d7e/d1e/f56 [0,4194304] 0 2024-04-25T17:19:06.330 INFO:tasks.workunit.client.0.smithi037.stdout:8/274: link d5/d26/d33/f36 d5/f47 0 2024-04-25T17:19:06.333 INFO:tasks.workunit.client.1.smithi069.stdout:5/132: creat d13/d17/d19/d20/f24 x:0 0 0 2024-04-25T17:19:06.335 INFO:tasks.workunit.client.1.smithi069.stdout:0/128: mkdir d0/da/db/d2c 0 2024-04-25T17:19:06.338 INFO:tasks.workunit.client.1.smithi069.stdout:5/133: dwrite d13/f16 [0,4194304] 0 2024-04-25T17:19:06.338 INFO:tasks.workunit.client.1.smithi069.stdout:6/149: getdents d2/d1e 0 2024-04-25T17:19:06.341 INFO:tasks.workunit.client.0.smithi037.stdout:8/275: rename d5/db/d18/d3b/f44 to d5/db/d18/d3b/f48 0 2024-04-25T17:19:06.341 INFO:tasks.workunit.client.0.smithi037.stdout:6/382: write db/f17 [2540550,22641] 0 2024-04-25T17:19:06.345 INFO:tasks.workunit.client.0.smithi037.stdout:0/445: rename d9/df/d32/d39/d68/l9c to d9/l9d 0 2024-04-25T17:19:06.350 INFO:tasks.workunit.client.1.smithi069.stdout:4/130: creat db/d22/f33 x:0 0 0 2024-04-25T17:19:06.350 INFO:tasks.workunit.client.1.smithi069.stdout:4/131: fsync db/d22/d24/f2d 0 2024-04-25T17:19:06.351 INFO:tasks.workunit.client.1.smithi069.stdout:3/200: mkdir d8/d16/d4b 0 2024-04-25T17:19:06.352 INFO:tasks.workunit.client.1.smithi069.stdout:4/132: write db/f16 [5734252,90386] 0 2024-04-25T17:19:06.353 INFO:tasks.workunit.client.1.smithi069.stdout:3/201: read - d8/f18 zero size 2024-04-25T17:19:06.353 INFO:tasks.workunit.client.1.smithi069.stdout:9/194: truncate d2/da/dd/d1e/f26 3547568 0 2024-04-25T17:19:06.353 INFO:tasks.workunit.client.1.smithi069.stdout:8/130: dwrite f3 [0,4194304] 0 2024-04-25T17:19:06.355 INFO:tasks.workunit.client.1.smithi069.stdout:9/195: read - d2/da/d14/f41 zero size 2024-04-25T17:19:06.356 INFO:tasks.workunit.client.0.smithi037.stdout:0/446: symlink d9/d71/l9e 0 2024-04-25T17:19:06.357 INFO:tasks.workunit.client.1.smithi069.stdout:9/196: write d2/f42 [761359,96264] 0 2024-04-25T17:19:06.357 INFO:tasks.workunit.client.1.smithi069.stdout:2/129: truncate d0/d26/f2b 3905263 0 2024-04-25T17:19:06.359 INFO:tasks.workunit.client.0.smithi037.stdout:4/579: creat d7/d7e/d1e/d2b/d35/d39/d7a/db2/fc3 x:0 0 0 2024-04-25T17:19:06.360 INFO:tasks.workunit.client.1.smithi069.stdout:3/202: dread f6 [0,4194304] 0 2024-04-25T17:19:06.361 INFO:tasks.workunit.client.0.smithi037.stdout:8/276: mknod d5/db/c49 0 2024-04-25T17:19:06.361 INFO:tasks.workunit.client.1.smithi069.stdout:8/131: dwrite f3 [0,4194304] 0 2024-04-25T17:19:06.362 INFO:tasks.workunit.client.1.smithi069.stdout:8/132: chown f8 507912348 1 2024-04-25T17:19:06.365 INFO:tasks.workunit.client.0.smithi037.stdout:0/447: chown d9/c6c 1035825 1 2024-04-25T17:19:06.372 INFO:tasks.workunit.client.0.smithi037.stdout:6/383: rename db/d26/d2e/d7d/d65/f7e to db/d1d/d20/f8c 0 2024-04-25T17:19:06.378 INFO:tasks.workunit.client.0.smithi037.stdout:4/580: mknod d7/d7e/d1e/d2b/cc4 0 2024-04-25T17:19:06.380 INFO:tasks.workunit.client.0.smithi037.stdout:4/581: readlink d7/d7e/lbf 0 2024-04-25T17:19:06.381 INFO:tasks.workunit.client.0.smithi037.stdout:6/384: dwrite db/d26/d2e/d3e/f4c [0,4194304] 0 2024-04-25T17:19:06.381 INFO:tasks.workunit.client.0.smithi037.stdout:4/582: chown d7 962 1 2024-04-25T17:19:06.383 INFO:tasks.workunit.client.1.smithi069.stdout:2/130: write d0/f15 [583894,107791] 0 2024-04-25T17:19:06.383 INFO:tasks.workunit.client.0.smithi037.stdout:8/277: dwrite d5/d26/d33/f34 [0,4194304] 0 2024-04-25T17:19:06.384 INFO:tasks.workunit.client.1.smithi069.stdout:2/131: chown d0/d1/d1d/f29 47 1 2024-04-25T17:19:06.384 INFO:tasks.workunit.client.0.smithi037.stdout:6/385: dread - db/d26/d2e/d3e/f47 zero size 2024-04-25T17:19:06.385 INFO:tasks.workunit.client.1.smithi069.stdout:6/150: mkdir d2/d2e/d35 0 2024-04-25T17:19:06.386 INFO:tasks.workunit.client.1.smithi069.stdout:6/151: stat d2/l16 0 2024-04-25T17:19:06.386 INFO:tasks.workunit.client.0.smithi037.stdout:6/386: fdatasync db/d26/d2e/f64 0 2024-04-25T17:19:06.389 INFO:tasks.workunit.client.0.smithi037.stdout:4/583: truncate d7/d7e/d1e/d2b/d35/d39/d7a/db2/fc3 267418 0 2024-04-25T17:19:06.392 INFO:tasks.workunit.client.1.smithi069.stdout:5/134: rename d13/d17/f23 to d13/d17/d19/f25 0 2024-04-25T17:19:06.393 INFO:tasks.workunit.client.1.smithi069.stdout:6/152: dwrite d2/f17 [4194304,4194304] 0 2024-04-25T17:19:06.395 INFO:tasks.workunit.client.1.smithi069.stdout:4/133: dread db/d15/f17 [0,4194304] 0 2024-04-25T17:19:06.397 INFO:tasks.workunit.client.0.smithi037.stdout:6/387: symlink db/d26/l8d 0 2024-04-25T17:19:06.399 INFO:tasks.workunit.client.0.smithi037.stdout:6/388: write db/d1d/d20/d2f/f6e [806333,62715] 0 2024-04-25T17:19:06.400 INFO:tasks.workunit.client.1.smithi069.stdout:6/153: read d2/f2f [3144970,16645] 0 2024-04-25T17:19:06.402 INFO:tasks.workunit.client.0.smithi037.stdout:4/584: dwrite d7/d8a/f8b [0,4194304] 0 2024-04-25T17:19:06.406 INFO:tasks.workunit.client.1.smithi069.stdout:8/133: mknod c2c 0 2024-04-25T17:19:06.406 INFO:tasks.workunit.client.0.smithi037.stdout:4/585: chown d7/d7e/d1e/d2b/d35/d39/dba/fb4 217700791 1 2024-04-25T17:19:06.408 INFO:tasks.workunit.client.1.smithi069.stdout:5/135: creat d13/f26 x:0 0 0 2024-04-25T17:19:06.408 INFO:tasks.workunit.client.1.smithi069.stdout:5/136: chown d13/l18 3 1 2024-04-25T17:19:06.410 INFO:tasks.workunit.client.1.smithi069.stdout:1/154: sync 2024-04-25T17:19:06.411 INFO:tasks.workunit.client.0.smithi037.stdout:6/389: dwrite db/d26/d2e/f42 [0,4194304] 0 2024-04-25T17:19:06.414 INFO:tasks.workunit.client.0.smithi037.stdout:4/586: mknod d7/d7e/d1e/d2b/d35/d39/d7a/db2/cc5 0 2024-04-25T17:19:06.415 INFO:tasks.workunit.client.0.smithi037.stdout:8/278: dread d5/db/d23/f29 [0,4194304] 0 2024-04-25T17:19:06.418 INFO:tasks.workunit.client.0.smithi037.stdout:6/390: chown db/f13 2686596 1 2024-04-25T17:19:06.420 INFO:tasks.workunit.client.0.smithi037.stdout:8/279: dread d5/f27 [0,4194304] 0 2024-04-25T17:19:06.421 INFO:tasks.workunit.client.1.smithi069.stdout:5/137: creat d13/d17/d19/f27 x:0 0 0 2024-04-25T17:19:06.422 INFO:tasks.workunit.client.1.smithi069.stdout:5/138: write d13/d17/f1d [671703,116691] 0 2024-04-25T17:19:06.423 INFO:tasks.workunit.client.0.smithi037.stdout:8/280: write d5/da/f32 [762271,80706] 0 2024-04-25T17:19:06.426 INFO:tasks.workunit.client.0.smithi037.stdout:4/587: dwrite d7/d7e/d45/fb9 [0,4194304] 0 2024-04-25T17:19:06.426 INFO:tasks.workunit.client.1.smithi069.stdout:4/134: truncate f8 3576686 0 2024-04-25T17:19:06.426 INFO:tasks.workunit.client.1.smithi069.stdout:4/135: stat db/f11 0 2024-04-25T17:19:06.430 INFO:tasks.workunit.client.1.smithi069.stdout:3/203: getdents d8/d16/d1a/d3e 0 2024-04-25T17:19:06.433 INFO:tasks.workunit.client.1.smithi069.stdout:5/139: creat d13/d17/d19/f28 x:0 0 0 2024-04-25T17:19:06.434 INFO:tasks.workunit.client.1.smithi069.stdout:6/154: dwrite d2/d1e/f33 [0,4194304] 0 2024-04-25T17:19:06.435 INFO:tasks.workunit.client.1.smithi069.stdout:9/197: rename d2/da/dd/d1e/d40/f44 to d2/da/dd/d1e/d2e/f47 0 2024-04-25T17:19:06.436 INFO:tasks.workunit.client.1.smithi069.stdout:5/140: truncate d13/d17/d19/f27 1007583 0 2024-04-25T17:19:06.438 INFO:tasks.workunit.client.1.smithi069.stdout:4/136: write db/d15/d26/f2c [2288909,85096] 0 2024-04-25T17:19:06.438 INFO:tasks.workunit.client.1.smithi069.stdout:9/198: chown d2/da/dd/f11 3467846 1 2024-04-25T17:19:06.439 INFO:tasks.workunit.client.1.smithi069.stdout:3/204: dwrite d8/f19 [0,4194304] 0 2024-04-25T17:19:06.440 INFO:tasks.workunit.client.1.smithi069.stdout:4/137: chown db/f16 0 1 2024-04-25T17:19:06.442 INFO:tasks.workunit.client.1.smithi069.stdout:5/141: mkdir d13/d17/d29 0 2024-04-25T17:19:06.445 INFO:tasks.workunit.client.1.smithi069.stdout:8/134: getdents . 0 2024-04-25T17:19:06.445 INFO:tasks.workunit.client.1.smithi069.stdout:8/135: stat fb 0 2024-04-25T17:19:06.447 INFO:tasks.workunit.client.1.smithi069.stdout:4/138: dread f0 [4194304,4194304] 0 2024-04-25T17:19:06.447 INFO:tasks.workunit.client.1.smithi069.stdout:3/205: rename d8/d16/d31/f33 to d8/d16/d1a/d38/f4c 0 2024-04-25T17:19:06.448 INFO:tasks.workunit.client.1.smithi069.stdout:1/155: getdents d1/df/d12 0 2024-04-25T17:19:06.449 INFO:tasks.workunit.client.1.smithi069.stdout:3/206: write d8/f1f [1737575,127634] 0 2024-04-25T17:19:06.451 INFO:tasks.workunit.client.1.smithi069.stdout:8/136: dread fb [0,4194304] 0 2024-04-25T17:19:06.451 INFO:tasks.workunit.client.1.smithi069.stdout:3/207: write d8/d16/d1a/d2c/f45 [366709,24004] 0 2024-04-25T17:19:06.451 INFO:tasks.workunit.client.1.smithi069.stdout:8/137: chown f10 855992 1 2024-04-25T17:19:06.452 INFO:tasks.workunit.client.1.smithi069.stdout:7/170: sync 2024-04-25T17:19:06.453 INFO:tasks.workunit.client.1.smithi069.stdout:4/139: dread db/f16 [0,4194304] 0 2024-04-25T17:19:06.454 INFO:tasks.workunit.client.1.smithi069.stdout:4/140: write db/d22/d24/f2d [296950,87336] 0 2024-04-25T17:19:06.456 INFO:tasks.workunit.client.1.smithi069.stdout:8/138: read f8 [1690050,53377] 0 2024-04-25T17:19:06.464 INFO:tasks.workunit.client.0.smithi037.stdout:2/383: sync 2024-04-25T17:19:06.467 INFO:tasks.workunit.client.1.smithi069.stdout:5/142: creat d13/d17/d19/d20/f2a x:0 0 0 2024-04-25T17:19:06.467 INFO:tasks.workunit.client.0.smithi037.stdout:4/588: read d7/d7e/d1e/d2b/d35/d39/dba/fb4 [318556,102125] 0 2024-04-25T17:19:06.467 INFO:tasks.workunit.client.1.smithi069.stdout:6/155: link d2/f21 d2/d2e/f36 0 2024-04-25T17:19:06.471 INFO:tasks.workunit.client.0.smithi037.stdout:6/391: dwrite db/d1d/d20/f21 [0,4194304] 0 2024-04-25T17:19:06.474 INFO:tasks.workunit.client.0.smithi037.stdout:2/384: write d0/d16/d3c/f42 [817099,38457] 0 2024-04-25T17:19:06.475 INFO:tasks.workunit.client.1.smithi069.stdout:9/199: link d2/da/d14/f25 d2/da/dd/de/f48 0 2024-04-25T17:19:06.479 INFO:tasks.workunit.client.0.smithi037.stdout:8/281: link d5/db/f1b d5/da/f4a 0 2024-04-25T17:19:06.482 INFO:tasks.workunit.client.1.smithi069.stdout:2/132: dread d0/d1/fe [0,4194304] 0 2024-04-25T17:19:06.482 INFO:tasks.workunit.client.1.smithi069.stdout:3/208: creat d8/d16/d1a/d2c/f4d x:0 0 0 2024-04-25T17:19:06.483 INFO:tasks.workunit.client.1.smithi069.stdout:7/171: symlink d4/d1a/l39 0 2024-04-25T17:19:06.484 INFO:tasks.workunit.client.0.smithi037.stdout:2/385: mkdir d0/d16/d77 0 2024-04-25T17:19:06.485 INFO:tasks.workunit.client.1.smithi069.stdout:4/141: creat db/d15/d26/f34 x:0 0 0 2024-04-25T17:19:06.485 INFO:tasks.workunit.client.1.smithi069.stdout:8/139: mknod c2d 0 2024-04-25T17:19:06.487 INFO:tasks.workunit.client.0.smithi037.stdout:2/386: rmdir d0/d16/d20 39 2024-04-25T17:19:06.488 INFO:tasks.workunit.client.0.smithi037.stdout:2/387: write d0/d23/f43 [1253014,58056] 0 2024-04-25T17:19:06.489 INFO:tasks.workunit.client.1.smithi069.stdout:6/156: write d2/d1e/f23 [3079371,45488] 0 2024-04-25T17:19:06.489 INFO:tasks.workunit.client.1.smithi069.stdout:9/200: mkdir d2/da/dd/d1e/d2e/d49 0 2024-04-25T17:19:06.494 INFO:tasks.workunit.client.0.smithi037.stdout:2/388: write d0/d16/d20/d55/f60 [176571,99911] 0 2024-04-25T17:19:06.495 INFO:tasks.workunit.client.1.smithi069.stdout:2/133: mknod d0/d26/c2e 0 2024-04-25T17:19:06.495 INFO:tasks.workunit.client.0.smithi037.stdout:8/282: write d5/da/f11 [1319841,58509] 0 2024-04-25T17:19:06.496 INFO:tasks.workunit.client.1.smithi069.stdout:3/209: creat d8/d16/d1a/d2c/f4e x:0 0 0 2024-04-25T17:19:06.498 INFO:tasks.workunit.client.1.smithi069.stdout:9/201: dwrite d2/f39 [0,4194304] 0 2024-04-25T17:19:06.498 INFO:tasks.workunit.client.1.smithi069.stdout:3/210: chown d8/d16/d1a/l29 239 1 2024-04-25T17:19:06.498 INFO:tasks.workunit.client.1.smithi069.stdout:3/211: fdatasync d8/f19 0 2024-04-25T17:19:06.498 INFO:tasks.workunit.client.0.smithi037.stdout:2/389: dread d0/d15/f4f [0,4194304] 0 2024-04-25T17:19:06.499 INFO:tasks.workunit.client.1.smithi069.stdout:9/202: write d2/da/f13 [455175,115590] 0 2024-04-25T17:19:06.501 INFO:tasks.workunit.client.1.smithi069.stdout:7/172: rename d4/d6/d14/c32 to d4/d1a/c3a 0 2024-04-25T17:19:06.501 INFO:tasks.workunit.client.0.smithi037.stdout:6/392: dread db/f15 [0,4194304] 0 2024-04-25T17:19:06.501 INFO:tasks.workunit.client.1.smithi069.stdout:7/173: stat d4/d1a/d34/f38 0 2024-04-25T17:19:06.502 INFO:tasks.workunit.client.0.smithi037.stdout:6/393: fsync db/d26/f67 0 2024-04-25T17:19:06.502 INFO:tasks.workunit.client.0.smithi037.stdout:8/283: symlink d5/d13/l4b 0 2024-04-25T17:19:06.504 INFO:tasks.workunit.client.1.smithi069.stdout:4/142: mkdir db/d15/d20/d35 0 2024-04-25T17:19:06.508 INFO:tasks.workunit.client.0.smithi037.stdout:8/284: chown d5/db/f1b 224188 1 2024-04-25T17:19:06.508 INFO:tasks.workunit.client.1.smithi069.stdout:5/143: creat d13/d17/d29/f2b x:0 0 0 2024-04-25T17:19:06.510 INFO:tasks.workunit.client.0.smithi037.stdout:6/394: dwrite db/d26/d2e/f64 [0,4194304] 0 2024-04-25T17:19:06.512 INFO:tasks.workunit.client.1.smithi069.stdout:2/134: creat d0/d26/f2f x:0 0 0 2024-04-25T17:19:06.513 INFO:tasks.workunit.client.1.smithi069.stdout:5/144: dread - d13/d17/d29/f2b zero size 2024-04-25T17:19:06.515 INFO:tasks.workunit.client.1.smithi069.stdout:4/143: dwrite db/f14 [0,4194304] 0 2024-04-25T17:19:06.517 INFO:tasks.workunit.client.1.smithi069.stdout:3/212: creat d8/d16/d1a/f4f x:0 0 0 2024-04-25T17:19:06.518 INFO:tasks.workunit.client.1.smithi069.stdout:1/156: dwrite d1/df/d17/f24 [0,4194304] 0 2024-04-25T17:19:06.519 INFO:tasks.workunit.client.1.smithi069.stdout:8/140: dwrite f12 [0,4194304] 0 2024-04-25T17:19:06.522 INFO:tasks.workunit.client.1.smithi069.stdout:8/141: chown f8 231209812 1 2024-04-25T17:19:06.523 INFO:tasks.workunit.client.1.smithi069.stdout:7/174: creat d4/d6/d21/d23/f3b x:0 0 0 2024-04-25T17:19:06.525 INFO:tasks.workunit.client.1.smithi069.stdout:7/175: write d4/d1a/f24 [152763,113910] 0 2024-04-25T17:19:06.526 INFO:tasks.workunit.client.1.smithi069.stdout:3/213: dread d8/d16/d1a/d2c/f2f [0,4194304] 0 2024-04-25T17:19:06.528 INFO:tasks.workunit.client.1.smithi069.stdout:3/214: stat d8/d16/f28 0 2024-04-25T17:19:06.528 INFO:tasks.workunit.client.0.smithi037.stdout:8/285: write d5/f9 [1198578,31496] 0 2024-04-25T17:19:06.529 INFO:tasks.workunit.client.1.smithi069.stdout:5/145: mknod d13/c2c 0 2024-04-25T17:19:06.529 INFO:tasks.workunit.client.1.smithi069.stdout:2/135: mknod d0/d26/d10/c30 0 2024-04-25T17:19:06.531 INFO:tasks.workunit.client.1.smithi069.stdout:1/157: creat d1/d4/f2a x:0 0 0 2024-04-25T17:19:06.532 INFO:tasks.workunit.client.1.smithi069.stdout:4/144: rename db/d22/d24/c2a to db/d15/d20/c36 0 2024-04-25T17:19:06.533 INFO:tasks.workunit.client.1.smithi069.stdout:4/145: fsync db/d15/d26/f2c 0 2024-04-25T17:19:06.534 INFO:tasks.workunit.client.0.smithi037.stdout:8/286: symlink d5/db/d18/d3b/l4c 0 2024-04-25T17:19:06.535 INFO:tasks.workunit.client.1.smithi069.stdout:5/146: mkdir d13/d17/d19/d20/d2d 0 2024-04-25T17:19:06.536 INFO:tasks.workunit.client.1.smithi069.stdout:5/147: fsync d13/d17/f1d 0 2024-04-25T17:19:06.536 INFO:tasks.workunit.client.0.smithi037.stdout:8/287: creat d5/d26/d33/f4d x:0 0 0 2024-04-25T17:19:06.538 INFO:tasks.workunit.client.0.smithi037.stdout:8/288: write d5/d26/d33/f34 [790437,28784] 0 2024-04-25T17:19:06.541 INFO:tasks.workunit.client.1.smithi069.stdout:4/146: creat db/d15/f37 x:0 0 0 2024-04-25T17:19:06.542 INFO:tasks.workunit.client.0.smithi037.stdout:6/395: truncate db/d26/d2e/d3e/f45 1160804 0 2024-04-25T17:19:06.542 INFO:tasks.workunit.client.1.smithi069.stdout:3/215: dwrite d8/d16/d1a/d38/f4c [0,4194304] 0 2024-04-25T17:19:06.543 INFO:tasks.workunit.client.0.smithi037.stdout:6/396: readlink db/d26/d2e/l8a 0 2024-04-25T17:19:06.544 INFO:tasks.workunit.client.1.smithi069.stdout:8/142: mknod c2e 0 2024-04-25T17:19:06.547 INFO:tasks.workunit.client.1.smithi069.stdout:7/176: rename d4/d6/d21 to d4/d6/d14/d15/d3c 0 2024-04-25T17:19:06.548 INFO:tasks.workunit.client.0.smithi037.stdout:8/289: dwrite d5/f27 [0,4194304] 0 2024-04-25T17:19:06.551 INFO:tasks.workunit.client.1.smithi069.stdout:2/136: mkdir d0/d1/d1d/d28/d31 0 2024-04-25T17:19:06.553 INFO:tasks.workunit.client.1.smithi069.stdout:5/148: mkdir d13/d17/d29/d2e 0 2024-04-25T17:19:06.553 INFO:tasks.workunit.client.0.smithi037.stdout:8/290: creat d5/db/d23/f4e x:0 0 0 2024-04-25T17:19:06.554 INFO:tasks.workunit.client.1.smithi069.stdout:5/149: write d13/d17/d29/f2b [288260,119515] 0 2024-04-25T17:19:06.554 INFO:tasks.workunit.client.0.smithi037.stdout:8/291: fdatasync d5/db/d23/f4e 0 2024-04-25T17:19:06.555 INFO:tasks.workunit.client.1.smithi069.stdout:0/129: sync 2024-04-25T17:19:06.557 INFO:tasks.workunit.client.1.smithi069.stdout:5/150: dread - d13/d17/d19/d20/f22 zero size 2024-04-25T17:19:06.557 INFO:tasks.workunit.client.1.smithi069.stdout:0/130: read d0/ff [983144,104449] 0 2024-04-25T17:19:06.558 INFO:tasks.workunit.client.0.smithi037.stdout:6/397: link db/d26/d2e/d3e/f34 db/d1d/d20/d2f/f8e 0 2024-04-25T17:19:06.559 INFO:tasks.workunit.client.1.smithi069.stdout:5/151: dread - d13/d17/d19/d20/f24 zero size 2024-04-25T17:19:06.559 INFO:tasks.workunit.client.1.smithi069.stdout:0/131: write d0/da/db/f23 [975145,47023] 0 2024-04-25T17:19:06.561 INFO:tasks.workunit.client.0.smithi037.stdout:8/292: creat d5/db/d23/d42/f4f x:0 0 0 2024-04-25T17:19:06.563 INFO:tasks.workunit.client.1.smithi069.stdout:4/147: mkdir db/d15/d20/d38 0 2024-04-25T17:19:06.564 INFO:tasks.workunit.client.1.smithi069.stdout:4/148: chown db/d15 864556 1 2024-04-25T17:19:06.565 INFO:tasks.workunit.client.0.smithi037.stdout:8/293: mkdir d5/db/d18/d3b/d50 0 2024-04-25T17:19:06.565 INFO:tasks.workunit.client.1.smithi069.stdout:0/132: dwrite d0/da/d29/f2b [0,4194304] 0 2024-04-25T17:19:06.567 INFO:tasks.workunit.client.1.smithi069.stdout:3/216: read d8/f37 [3158658,77172] 0 2024-04-25T17:19:06.567 INFO:tasks.workunit.client.1.smithi069.stdout:9/203: link d2/da/dd/d1e/d2e/f47 d2/da/dd/de/f4a 0 2024-04-25T17:19:06.569 INFO:tasks.workunit.client.1.smithi069.stdout:7/177: mkdir d4/d6/d14/d3d 0 2024-04-25T17:19:06.572 INFO:tasks.workunit.client.1.smithi069.stdout:2/137: creat d0/d1/d1d/f32 x:0 0 0 2024-04-25T17:19:06.573 INFO:tasks.workunit.client.1.smithi069.stdout:4/149: dwrite db/d22/d24/f2d [0,4194304] 0 2024-04-25T17:19:06.573 INFO:tasks.workunit.client.0.smithi037.stdout:8/294: mkdir d5/db/d18/d3b/d50/d51 0 2024-04-25T17:19:06.574 INFO:tasks.workunit.client.1.smithi069.stdout:2/138: write d0/d1/d1d/f22 [595800,29104] 0 2024-04-25T17:19:06.574 INFO:tasks.workunit.client.1.smithi069.stdout:4/150: readlink db/d15/d20/l23 0 2024-04-25T17:19:06.574 INFO:tasks.workunit.client.0.smithi037.stdout:8/295: chown d5/da/f11 336 1 2024-04-25T17:19:06.575 INFO:tasks.workunit.client.0.smithi037.stdout:8/296: write d5/db/d23/d42/f4f [824097,15380] 0 2024-04-25T17:19:06.577 INFO:tasks.workunit.client.1.smithi069.stdout:5/152: symlink d13/d17/d19/l2f 0 2024-04-25T17:19:06.578 INFO:tasks.workunit.client.1.smithi069.stdout:1/158: truncate d1/df/d12/f14 2402362 0 2024-04-25T17:19:06.607 INFO:tasks.workunit.client.1.smithi069.stdout:6/157: sync 2024-04-25T17:19:06.644 INFO:tasks.workunit.client.0.smithi037.stdout:9/505: sync 2024-04-25T17:19:06.662 INFO:tasks.workunit.client.1.smithi069.stdout:9/204: sync 2024-04-25T17:19:06.673 INFO:tasks.workunit.client.0.smithi037.stdout:8/297: symlink d5/db/d18/d3b/l52 0 2024-04-25T17:19:06.674 INFO:tasks.workunit.client.1.smithi069.stdout:0/133: mknod d0/da/db/c2d 0 2024-04-25T17:19:06.675 INFO:tasks.workunit.client.0.smithi037.stdout:9/506: mkdir d1/d5/dc/da9 0 2024-04-25T17:19:06.676 INFO:tasks.workunit.client.0.smithi037.stdout:8/298: mknod d5/d13/c53 0 2024-04-25T17:19:06.678 INFO:tasks.workunit.client.1.smithi069.stdout:3/217: creat d8/d16/d1a/d38/f50 x:0 0 0 2024-04-25T17:19:06.680 INFO:tasks.workunit.client.0.smithi037.stdout:9/507: rename d1/d5/dc/d38/d8b/c70 to d1/d48/caa 0 2024-04-25T17:19:06.681 INFO:tasks.workunit.client.1.smithi069.stdout:7/178: mkdir d4/d3e 0 2024-04-25T17:19:06.685 INFO:tasks.workunit.client.1.smithi069.stdout:2/139: mkdir d0/d1/d1d/d33 0 2024-04-25T17:19:06.685 INFO:tasks.workunit.client.0.smithi037.stdout:9/508: symlink d1/d5/lab 0 2024-04-25T17:19:06.687 INFO:tasks.workunit.client.0.smithi037.stdout:9/509: truncate d1/d5/dc/d38/d8b/f60 134927 0 2024-04-25T17:19:06.688 INFO:tasks.workunit.client.1.smithi069.stdout:5/153: mkdir d13/d17/d29/d30 0 2024-04-25T17:19:06.690 INFO:tasks.workunit.client.1.smithi069.stdout:1/159: rmdir d1 39 2024-04-25T17:19:06.691 INFO:tasks.workunit.client.1.smithi069.stdout:6/158: creat d2/d1e/f37 x:0 0 0 2024-04-25T17:19:06.692 INFO:tasks.workunit.client.0.smithi037.stdout:9/510: symlink d1/d48/lac 0 2024-04-25T17:19:06.693 INFO:tasks.workunit.client.1.smithi069.stdout:9/205: mknod d2/da/dd/c4b 0 2024-04-25T17:19:06.694 INFO:tasks.workunit.client.1.smithi069.stdout:9/206: write d2/f17 [154257,82932] 0 2024-04-25T17:19:06.694 INFO:tasks.workunit.client.1.smithi069.stdout:0/134: creat d0/da/d29/f2e x:0 0 0 2024-04-25T17:19:06.696 INFO:tasks.workunit.client.1.smithi069.stdout:8/143: creat f2f x:0 0 0 2024-04-25T17:19:06.697 INFO:tasks.workunit.client.1.smithi069.stdout:3/218: truncate f5 711023 0 2024-04-25T17:19:06.699 INFO:tasks.workunit.client.0.smithi037.stdout:9/511: unlink d1/d5/c7c 0 2024-04-25T17:19:06.702 INFO:tasks.workunit.client.1.smithi069.stdout:7/179: rename d4/d37 to d4/d18/d3f 0 2024-04-25T17:19:06.702 INFO:tasks.workunit.client.0.smithi037.stdout:8/299: dwrite d5/db/f1b [0,4194304] 0 2024-04-25T17:19:06.702 INFO:tasks.workunit.client.0.smithi037.stdout:8/300: chown d5/db/d23/f1e 612919840 1 2024-04-25T17:19:06.703 INFO:tasks.workunit.client.1.smithi069.stdout:4/151: mknod db/c39 0 2024-04-25T17:19:06.705 INFO:tasks.workunit.client.1.smithi069.stdout:2/140: creat d0/d1/d1d/f34 x:0 0 0 2024-04-25T17:19:06.707 INFO:tasks.workunit.client.1.smithi069.stdout:7/180: dwrite d4/d6/d14/d15/f17 [0,4194304] 0 2024-04-25T17:19:06.708 INFO:tasks.workunit.client.0.smithi037.stdout:9/512: unlink d1/d48/l90 0 2024-04-25T17:19:06.709 INFO:tasks.workunit.client.1.smithi069.stdout:5/154: creat d13/d17/f31 x:0 0 0 2024-04-25T17:19:06.711 INFO:tasks.workunit.client.0.smithi037.stdout:8/301: creat d5/d13/f54 x:0 0 0 2024-04-25T17:19:06.713 INFO:tasks.workunit.client.1.smithi069.stdout:5/155: dread d13/d17/f1d [0,4194304] 0 2024-04-25T17:19:06.716 INFO:tasks.workunit.client.1.smithi069.stdout:6/159: dread - d2/d2e/f36 zero size 2024-04-25T17:19:06.716 INFO:tasks.workunit.client.0.smithi037.stdout:8/302: mknod d5/d26/c55 0 2024-04-25T17:19:06.717 INFO:tasks.workunit.client.0.smithi037.stdout:8/303: fsync d5/da/f4a 0 2024-04-25T17:19:06.718 INFO:tasks.workunit.client.1.smithi069.stdout:9/207: symlink d2/da/d14/l4c 0 2024-04-25T17:19:06.723 INFO:tasks.workunit.client.0.smithi037.stdout:9/513: link d1/d48/d68/d26/f80 d1/d5/d2e/d34/d76/fad 0 2024-04-25T17:19:06.723 INFO:tasks.workunit.client.1.smithi069.stdout:6/160: dwrite d2/f17 [0,4194304] 0 2024-04-25T17:19:06.726 INFO:tasks.workunit.client.0.smithi037.stdout:8/304: dwrite d5/db/d23/d42/f4f [0,4194304] 0 2024-04-25T17:19:06.729 INFO:tasks.workunit.client.1.smithi069.stdout:7/181: dread d4/d6/d14/d15/f26 [0,4194304] 0 2024-04-25T17:19:06.731 INFO:tasks.workunit.client.1.smithi069.stdout:5/156: read f6 [4000620,42722] 0 2024-04-25T17:19:06.731 INFO:tasks.workunit.client.1.smithi069.stdout:7/182: read d4/d1a/f1c [30914,55210] 0 2024-04-25T17:19:06.732 INFO:tasks.workunit.client.1.smithi069.stdout:1/160: write d1/df/d12/f14 [3323338,121317] 0 2024-04-25T17:19:06.732 INFO:tasks.workunit.client.1.smithi069.stdout:7/183: read d4/d6/d14/d15/f17 [646113,86977] 0 2024-04-25T17:19:06.737 INFO:tasks.workunit.client.1.smithi069.stdout:5/157: dread d13/d17/d19/f25 [0,4194304] 0 2024-04-25T17:19:06.750 INFO:tasks.workunit.client.1.smithi069.stdout:1/161: dread d1/df/d12/f14 [0,4194304] 0 2024-04-25T17:19:06.752 INFO:tasks.workunit.client.1.smithi069.stdout:1/162: dread d1/df/d17/f24 [0,4194304] 0 2024-04-25T17:19:06.762 INFO:tasks.workunit.client.1.smithi069.stdout:2/141: sync 2024-04-25T17:19:06.770 INFO:tasks.workunit.client.0.smithi037.stdout:7/443: sync 2024-04-25T17:19:06.770 INFO:tasks.workunit.client.0.smithi037.stdout:3/265: sync 2024-04-25T17:19:06.783 INFO:tasks.workunit.client.1.smithi069.stdout:6/161: symlink d2/d1e/l38 0 2024-04-25T17:19:06.786 INFO:tasks.workunit.client.1.smithi069.stdout:8/144: symlink l30 0 2024-04-25T17:19:06.787 INFO:tasks.workunit.client.1.smithi069.stdout:6/162: dwrite d2/fe [0,4194304] 0 2024-04-25T17:19:06.801 INFO:tasks.workunit.client.1.smithi069.stdout:3/219: write d8/fc [286846,108773] 0 2024-04-25T17:19:06.803 INFO:tasks.workunit.client.1.smithi069.stdout:3/220: chown d8/d16/d31/c32 1 1 2024-04-25T17:19:06.806 INFO:tasks.workunit.client.1.smithi069.stdout:5/158: fdatasync fd 0 2024-04-25T17:19:06.808 INFO:tasks.workunit.client.1.smithi069.stdout:9/208: dwrite d2/da/dd/de/f12 [0,4194304] 0 2024-04-25T17:19:06.809 INFO:tasks.workunit.client.1.smithi069.stdout:9/209: fsync d2/da/d14/f37 0 2024-04-25T17:19:06.816 INFO:tasks.workunit.client.1.smithi069.stdout:0/135: truncate d0/da/db/f13 1338823 0 2024-04-25T17:19:06.816 INFO:tasks.workunit.client.1.smithi069.stdout:6/163: rmdir d2 39 2024-04-25T17:19:06.829 INFO:tasks.workunit.client.0.smithi037.stdout:8/305: creat d5/db/d18/d3b/d50/f56 x:0 0 0 2024-04-25T17:19:06.830 INFO:tasks.workunit.client.1.smithi069.stdout:7/184: creat d4/d1a/d34/f40 x:0 0 0 2024-04-25T17:19:06.832 INFO:tasks.workunit.client.0.smithi037.stdout:7/444: mknod d5/d15/d17/d25/d2b/d59/c9b 0 2024-04-25T17:19:06.837 INFO:tasks.workunit.client.0.smithi037.stdout:3/266: dwrite d8/d31/d32/f39 [0,4194304] 0 2024-04-25T17:19:06.839 INFO:tasks.workunit.client.0.smithi037.stdout:7/445: dread - d5/d5e/f61 zero size 2024-04-25T17:19:06.842 INFO:tasks.workunit.client.0.smithi037.stdout:3/267: dread d8/f26 [0,4194304] 0 2024-04-25T17:19:06.843 INFO:tasks.workunit.client.0.smithi037.stdout:3/268: write d8/f2c [395573,129285] 0 2024-04-25T17:19:06.844 INFO:tasks.workunit.client.1.smithi069.stdout:1/163: mknod d1/d4/de/d11/c2b 0 2024-04-25T17:19:06.845 INFO:tasks.workunit.client.0.smithi037.stdout:8/306: creat d5/db/d18/d3b/d50/d51/f57 x:0 0 0 2024-04-25T17:19:06.845 INFO:tasks.workunit.client.1.smithi069.stdout:1/164: readlink d1/d4/de/d11/d1b/l1c 0 2024-04-25T17:19:06.846 INFO:tasks.workunit.client.1.smithi069.stdout:2/142: mknod d0/d1/d1d/d28/d31/c35 0 2024-04-25T17:19:06.847 INFO:tasks.workunit.client.1.smithi069.stdout:2/143: chown d0/d26/ld 1622388 1 2024-04-25T17:19:06.850 INFO:tasks.workunit.client.0.smithi037.stdout:7/446: creat d5/d5e/d76/f9c x:0 0 0 2024-04-25T17:19:06.854 INFO:tasks.workunit.client.1.smithi069.stdout:2/144: dwrite d0/d26/f18 [0,4194304] 0 2024-04-25T17:19:06.854 INFO:tasks.workunit.client.0.smithi037.stdout:9/514: getdents d1/d48/d68 0 2024-04-25T17:19:06.855 INFO:tasks.workunit.client.1.smithi069.stdout:4/152: getdents db/d22/d24 0 2024-04-25T17:19:06.856 INFO:tasks.workunit.client.0.smithi037.stdout:8/307: mkdir d5/db/d23/d58 0 2024-04-25T17:19:06.857 INFO:tasks.workunit.client.1.smithi069.stdout:9/210: write d2/f8 [13291658,129654] 0 2024-04-25T17:19:06.858 INFO:tasks.workunit.client.1.smithi069.stdout:2/145: dread d0/f15 [0,4194304] 0 2024-04-25T17:19:06.858 INFO:tasks.workunit.client.1.smithi069.stdout:4/153: fdatasync db/d15/d26/f2c 0 2024-04-25T17:19:06.860 INFO:tasks.workunit.client.1.smithi069.stdout:7/185: read d4/d6/fa [1823317,13214] 0 2024-04-25T17:19:06.860 INFO:tasks.workunit.client.1.smithi069.stdout:3/221: mknod d8/d16/d1a/d3e/d42/c51 0 2024-04-25T17:19:06.863 INFO:tasks.workunit.client.1.smithi069.stdout:5/159: mknod d13/d17/d29/d2e/c32 0 2024-04-25T17:19:06.864 INFO:tasks.workunit.client.0.smithi037.stdout:9/515: readlink d1/l4b 0 2024-04-25T17:19:06.864 INFO:tasks.workunit.client.1.smithi069.stdout:5/160: write d13/d17/f1d [1768054,53189] 0 2024-04-25T17:19:06.865 INFO:tasks.workunit.client.0.smithi037.stdout:7/447: dread d5/fd [0,4194304] 0 2024-04-25T17:19:06.866 INFO:tasks.workunit.client.1.smithi069.stdout:0/136: write d0/ff [1457873,105987] 0 2024-04-25T17:19:06.867 INFO:tasks.workunit.client.1.smithi069.stdout:1/165: rename d1/d4/fb to d1/d4/de/d11/d1b/f2c 0 2024-04-25T17:19:06.868 INFO:tasks.workunit.client.1.smithi069.stdout:3/222: dwrite d8/f12 [0,4194304] 0 2024-04-25T17:19:06.869 INFO:tasks.workunit.client.1.smithi069.stdout:0/137: fdatasync d0/da/db/fe 0 2024-04-25T17:19:06.869 INFO:tasks.workunit.client.0.smithi037.stdout:3/269: creat d8/f58 x:0 0 0 2024-04-25T17:19:06.870 INFO:tasks.workunit.client.0.smithi037.stdout:9/516: fdatasync d1/d48/d68/d26/fa0 0 2024-04-25T17:19:06.873 INFO:tasks.workunit.client.0.smithi037.stdout:8/308: mkdir d5/db/d59 0 2024-04-25T17:19:06.874 INFO:tasks.workunit.client.1.smithi069.stdout:0/138: read d0/da/db/fe [4110458,37023] 0 2024-04-25T17:19:06.875 INFO:tasks.workunit.client.1.smithi069.stdout:2/146: mkdir d0/d26/d36 0 2024-04-25T17:19:06.875 INFO:tasks.workunit.client.1.smithi069.stdout:8/145: dwrite f10 [0,4194304] 0 2024-04-25T17:19:06.876 INFO:tasks.workunit.client.1.smithi069.stdout:3/223: dread d8/d16/d1a/d2c/f45 [0,4194304] 0 2024-04-25T17:19:06.877 INFO:tasks.workunit.client.1.smithi069.stdout:0/139: chown d0/c7 100 1 2024-04-25T17:19:06.877 INFO:tasks.workunit.client.1.smithi069.stdout:4/154: symlink db/d15/d26/l3a 0 2024-04-25T17:19:06.879 INFO:tasks.workunit.client.0.smithi037.stdout:5/475: sync 2024-04-25T17:19:06.879 INFO:tasks.workunit.client.0.smithi037.stdout:1/371: sync 2024-04-25T17:19:06.881 INFO:tasks.workunit.client.0.smithi037.stdout:8/309: mknod d5/db/d18/d3b/d50/d51/c5a 0 2024-04-25T17:19:06.881 INFO:tasks.workunit.client.1.smithi069.stdout:1/166: dwrite d1/d4/d6/f7 [0,4194304] 0 2024-04-25T17:19:06.886 INFO:tasks.workunit.client.1.smithi069.stdout:7/186: rename d4/d1a/d34/f38 to d4/d3e/f41 0 2024-04-25T17:19:06.887 INFO:tasks.workunit.client.0.smithi037.stdout:1/372: dwrite dc/d24/f71 [0,4194304] 0 2024-04-25T17:19:06.894 INFO:tasks.workunit.client.0.smithi037.stdout:9/517: creat d1/d5/dc/d3c/fae x:0 0 0 2024-04-25T17:19:06.897 INFO:tasks.workunit.client.0.smithi037.stdout:8/310: rename c3 to d5/d26/d33/c5b 0 2024-04-25T17:19:06.898 INFO:tasks.workunit.client.1.smithi069.stdout:9/211: symlink d2/da/l4d 0 2024-04-25T17:19:06.901 INFO:tasks.workunit.client.1.smithi069.stdout:8/146: stat c28 0 2024-04-25T17:19:06.902 INFO:tasks.workunit.client.0.smithi037.stdout:1/373: mknod dc/d1c/d57/d43/c85 0 2024-04-25T17:19:06.903 INFO:tasks.workunit.client.0.smithi037.stdout:1/374: chown dc/d18/f3e 1714373 1 2024-04-25T17:19:06.904 INFO:tasks.workunit.client.1.smithi069.stdout:0/140: rename d0/ff to d0/f2f 0 2024-04-25T17:19:06.904 INFO:tasks.workunit.client.0.smithi037.stdout:8/311: dwrite d5/db/f1b [4194304,4194304] 0 2024-04-25T17:19:06.905 INFO:tasks.workunit.client.1.smithi069.stdout:6/164: dwrite d2/f21 [0,4194304] 0 2024-04-25T17:19:06.905 INFO:tasks.workunit.client.0.smithi037.stdout:1/375: stat dc/d1c/d57/d4d 0 2024-04-25T17:19:06.905 INFO:tasks.workunit.client.1.smithi069.stdout:6/165: chown d2/f1c 7806 1 2024-04-25T17:19:06.906 INFO:tasks.workunit.client.0.smithi037.stdout:1/376: read - dc/d1c/f69 zero size 2024-04-25T17:19:06.906 INFO:tasks.workunit.client.1.smithi069.stdout:2/147: symlink d0/d26/d10/l37 0 2024-04-25T17:19:06.907 INFO:tasks.workunit.client.0.smithi037.stdout:7/448: write d5/f13 [1780953,60257] 0 2024-04-25T17:19:06.910 INFO:tasks.workunit.client.0.smithi037.stdout:9/518: mkdir d1/d5/d2e/d34/daf 0 2024-04-25T17:19:06.910 INFO:tasks.workunit.client.0.smithi037.stdout:1/377: read dc/d18/f3e [247852,8303] 0 2024-04-25T17:19:06.910 INFO:tasks.workunit.client.1.smithi069.stdout:0/141: dwrite d0/da/db/d1d/f20 [0,4194304] 0 2024-04-25T17:19:06.913 INFO:tasks.workunit.client.0.smithi037.stdout:9/519: write d1/d5/dc/d3c/fae [957603,28357] 0 2024-04-25T17:19:06.915 INFO:tasks.workunit.client.0.smithi037.stdout:5/476: dwrite d7/d18/f22 [0,4194304] 0 2024-04-25T17:19:06.917 INFO:tasks.workunit.client.1.smithi069.stdout:1/167: creat d1/df/d17/f2d x:0 0 0 2024-04-25T17:19:06.918 INFO:tasks.workunit.client.0.smithi037.stdout:3/270: truncate d8/d31/d32/f36 1636389 0 2024-04-25T17:19:06.918 INFO:tasks.workunit.client.0.smithi037.stdout:8/312: mknod d5/d26/d33/c5c 0 2024-04-25T17:19:06.919 INFO:tasks.workunit.client.1.smithi069.stdout:1/168: fdatasync d1/d4/f2a 0 2024-04-25T17:19:06.922 INFO:tasks.workunit.client.1.smithi069.stdout:0/142: dwrite d0/da/f10 [4194304,4194304] 0 2024-04-25T17:19:06.924 INFO:tasks.workunit.client.1.smithi069.stdout:0/143: write d0/da/d29/f2b [2231502,798] 0 2024-04-25T17:19:06.925 INFO:tasks.workunit.client.1.smithi069.stdout:0/144: chown d0/da/db/f15 90 1 2024-04-25T17:19:06.926 INFO:tasks.workunit.client.0.smithi037.stdout:3/271: dread d8/f4e [0,4194304] 0 2024-04-25T17:19:06.928 INFO:tasks.workunit.client.0.smithi037.stdout:3/272: stat d8/d23/d3a/l4d 0 2024-04-25T17:19:06.928 INFO:tasks.workunit.client.1.smithi069.stdout:9/212: dread - d2/da/dd/d1e/d2e/d35/f38 zero size 2024-04-25T17:19:06.929 INFO:tasks.workunit.client.1.smithi069.stdout:9/213: fsync d2/f33 0 2024-04-25T17:19:06.930 INFO:tasks.workunit.client.0.smithi037.stdout:9/520: mkdir d1/d48/d68/d26/da1/db0 0 2024-04-25T17:19:06.931 INFO:tasks.workunit.client.1.smithi069.stdout:8/147: chown c18 246201866 1 2024-04-25T17:19:06.931 INFO:tasks.workunit.client.1.smithi069.stdout:8/148: rmdir - no directory 2024-04-25T17:19:06.936 INFO:tasks.workunit.client.0.smithi037.stdout:1/378: mkdir dc/d1c/d57/d4d/d6a/d86 0 2024-04-25T17:19:06.940 INFO:tasks.workunit.client.0.smithi037.stdout:3/273: symlink d8/d31/l59 0 2024-04-25T17:19:06.942 INFO:tasks.workunit.client.1.smithi069.stdout:2/148: read d0/d26/f2b [2460553,33822] 0 2024-04-25T17:19:06.943 INFO:tasks.workunit.client.1.smithi069.stdout:2/149: truncate d0/d1/d1d/f29 375754 0 2024-04-25T17:19:06.944 INFO:tasks.workunit.client.0.smithi037.stdout:7/449: rename d5/d78 to d5/d15/d17/d9d 0 2024-04-25T17:19:06.947 INFO:tasks.workunit.client.1.smithi069.stdout:4/155: getdents db/d22/d24 0 2024-04-25T17:19:06.948 INFO:tasks.workunit.client.1.smithi069.stdout:4/156: write db/d15/d26/f2c [2085640,72876] 0 2024-04-25T17:19:06.949 INFO:tasks.workunit.client.1.smithi069.stdout:7/187: getdents d4/d18/d3f 0 2024-04-25T17:19:06.950 INFO:tasks.workunit.client.1.smithi069.stdout:4/157: write db/d22/d24/f2d [616434,88545] 0 2024-04-25T17:19:06.950 INFO:tasks.workunit.client.1.smithi069.stdout:7/188: dread - d4/d1a/d34/f40 zero size 2024-04-25T17:19:06.951 INFO:tasks.workunit.client.1.smithi069.stdout:4/158: write db/d15/d26/f29 [140379,17481] 0 2024-04-25T17:19:06.952 INFO:tasks.workunit.client.1.smithi069.stdout:4/159: chown db/d22/d24 639 1 2024-04-25T17:19:06.952 INFO:tasks.workunit.client.0.smithi037.stdout:7/450: dwrite d5/d15/d17/d25/d2b/d48/f95 [0,4194304] 0 2024-04-25T17:19:06.957 INFO:tasks.workunit.client.1.smithi069.stdout:0/145: creat d0/d17/f30 x:0 0 0 2024-04-25T17:19:06.959 INFO:tasks.workunit.client.0.smithi037.stdout:5/477: getdents d7/d63 0 2024-04-25T17:19:06.959 INFO:tasks.workunit.client.1.smithi069.stdout:4/160: dwrite db/d15/d26/f28 [0,4194304] 0 2024-04-25T17:19:06.960 INFO:tasks.workunit.client.0.smithi037.stdout:7/451: dwrite d5/d15/d17/d1b/d27/f3d [0,4194304] 0 2024-04-25T17:19:06.962 INFO:tasks.workunit.client.1.smithi069.stdout:8/149: chown l24 837 1 2024-04-25T17:19:06.966 INFO:tasks.workunit.client.1.smithi069.stdout:0/146: dread d0/fc [0,4194304] 0 2024-04-25T17:19:06.966 INFO:tasks.workunit.client.0.smithi037.stdout:8/313: rename d5/c7 to d5/db/d23/c5d 0 2024-04-25T17:19:06.968 INFO:tasks.workunit.client.1.smithi069.stdout:2/150: fsync d0/f7 0 2024-04-25T17:19:06.971 INFO:tasks.workunit.client.1.smithi069.stdout:5/161: sync 2024-04-25T17:19:06.971 INFO:tasks.workunit.client.0.smithi037.stdout:7/452: dread d5/f13 [0,4194304] 0 2024-04-25T17:19:06.974 INFO:tasks.workunit.client.0.smithi037.stdout:9/521: getdents d1/d48/d68/d26/d81/d9c 0 2024-04-25T17:19:06.974 INFO:tasks.workunit.client.0.smithi037.stdout:7/453: chown d5/d15/d17/d25/d2b/d48/f72 1 1 2024-04-25T17:19:06.976 INFO:tasks.workunit.client.0.smithi037.stdout:8/314: mkdir d5/db/d18/d3b/d50/d51/d5e 0 2024-04-25T17:19:06.977 INFO:tasks.workunit.client.1.smithi069.stdout:7/189: truncate d4/d6/fa 3609925 0 2024-04-25T17:19:06.979 INFO:tasks.workunit.client.0.smithi037.stdout:1/379: write dc/d18/f51 [793836,78446] 0 2024-04-25T17:19:06.980 INFO:tasks.workunit.client.0.smithi037.stdout:7/454: symlink d5/d15/d17/d1b/d27/l9e 0 2024-04-25T17:19:06.985 INFO:tasks.workunit.client.0.smithi037.stdout:9/522: rename d1/d48/d68/d26/fa0 to d1/d5/dc/da9/fb1 0 2024-04-25T17:19:06.988 INFO:tasks.workunit.client.0.smithi037.stdout:1/380: creat dc/d1c/d57/d4d/f87 x:0 0 0 2024-04-25T17:19:06.991 INFO:tasks.workunit.client.0.smithi037.stdout:7/455: dwrite d5/d15/d17/d25/d2b/d59/f8c [0,4194304] 0 2024-04-25T17:19:06.992 INFO:tasks.workunit.client.0.smithi037.stdout:5/478: dread d7/d12/f23 [0,4194304] 0 2024-04-25T17:19:06.994 INFO:tasks.workunit.client.0.smithi037.stdout:6/398: sync 2024-04-25T17:19:06.995 INFO:tasks.workunit.client.0.smithi037.stdout:4/589: sync 2024-04-25T17:19:06.995 INFO:tasks.workunit.client.0.smithi037.stdout:2/390: sync 2024-04-25T17:19:06.995 INFO:tasks.workunit.client.0.smithi037.stdout:0/448: sync 2024-04-25T17:19:06.996 INFO:tasks.workunit.client.0.smithi037.stdout:5/479: dread d7/d18/f64 [0,4194304] 0 2024-04-25T17:19:06.999 INFO:tasks.workunit.client.0.smithi037.stdout:2/391: chown d0/d16/d3b 12043 1 2024-04-25T17:19:07.000 INFO:tasks.workunit.client.1.smithi069.stdout:0/147: creat d0/da/db/f31 x:0 0 0 2024-04-25T17:19:07.003 INFO:tasks.workunit.client.1.smithi069.stdout:2/151: creat d0/d1/d1d/d28/d31/f38 x:0 0 0 2024-04-25T17:19:07.003 INFO:tasks.workunit.client.0.smithi037.stdout:4/590: dwrite d7/d7e/f3c [0,4194304] 0 2024-04-25T17:19:07.004 INFO:tasks.workunit.client.1.smithi069.stdout:2/152: write d0/d26/f23 [473203,119426] 0 2024-04-25T17:19:07.005 INFO:tasks.workunit.client.1.smithi069.stdout:2/153: chown d0/d26/f23 12685983 1 2024-04-25T17:19:07.006 INFO:tasks.workunit.client.1.smithi069.stdout:2/154: write d0/d1/f1f [7224640,57652] 0 2024-04-25T17:19:07.007 INFO:tasks.workunit.client.1.smithi069.stdout:5/162: creat d13/d17/f33 x:0 0 0 2024-04-25T17:19:07.009 INFO:tasks.workunit.client.0.smithi037.stdout:8/315: dread d5/db/d23/f1e [0,4194304] 0 2024-04-25T17:19:07.011 INFO:tasks.workunit.client.0.smithi037.stdout:1/381: creat dc/d18/f88 x:0 0 0 2024-04-25T17:19:07.011 INFO:tasks.workunit.client.0.smithi037.stdout:8/316: write d5/f27 [2740402,108574] 0 2024-04-25T17:19:07.011 INFO:tasks.workunit.client.1.smithi069.stdout:4/161: write db/f11 [310329,65529] 0 2024-04-25T17:19:07.012 INFO:tasks.workunit.client.1.smithi069.stdout:1/169: rmdir d1/d29 0 2024-04-25T17:19:07.012 INFO:tasks.workunit.client.1.smithi069.stdout:3/224: sync 2024-04-25T17:19:07.013 INFO:tasks.workunit.client.0.smithi037.stdout:8/317: chown d5/db/d23/f38 34 1 2024-04-25T17:19:07.015 INFO:tasks.workunit.client.1.smithi069.stdout:5/163: dwrite d13/d17/d29/f2b [0,4194304] 0 2024-04-25T17:19:07.015 INFO:tasks.workunit.client.0.smithi037.stdout:9/523: dread d1/d48/d68/d4e/f51 [0,4194304] 0 2024-04-25T17:19:07.017 INFO:tasks.workunit.client.0.smithi037.stdout:9/524: stat d1/d5/dc/d38/f9b 0 2024-04-25T17:19:07.020 INFO:tasks.workunit.client.0.smithi037.stdout:6/399: truncate db/f12 4689605 0 2024-04-25T17:19:07.021 INFO:tasks.workunit.client.1.smithi069.stdout:9/214: creat d2/da/f4e x:0 0 0 2024-04-25T17:19:07.022 INFO:tasks.workunit.client.0.smithi037.stdout:8/318: dwrite d5/da/f4a [0,4194304] 0 2024-04-25T17:19:07.024 INFO:tasks.workunit.client.1.smithi069.stdout:6/166: getdents d2/d2e 0 2024-04-25T17:19:07.025 INFO:tasks.workunit.client.1.smithi069.stdout:6/167: write d2/f18 [916158,26968] 0 2024-04-25T17:19:07.028 INFO:tasks.workunit.client.0.smithi037.stdout:4/591: mkdir d7/d7e/d1e/dae/dc6 0 2024-04-25T17:19:07.032 INFO:tasks.workunit.client.0.smithi037.stdout:1/382: rename dc/d18/d64/c79 to dc/d1c/d57/d43/c89 0 2024-04-25T17:19:07.033 INFO:tasks.workunit.client.0.smithi037.stdout:1/383: chown dc/fd 152450 1 2024-04-25T17:19:07.033 INFO:tasks.workunit.client.1.smithi069.stdout:4/162: creat db/d15/d26/f3b x:0 0 0 2024-04-25T17:19:07.036 INFO:tasks.workunit.client.1.smithi069.stdout:4/163: dread db/f21 [0,4194304] 0 2024-04-25T17:19:07.036 INFO:tasks.workunit.client.1.smithi069.stdout:7/190: mknod d4/d6/c42 0 2024-04-25T17:19:07.040 INFO:tasks.workunit.client.1.smithi069.stdout:5/164: fdatasync d13/d17/d19/f25 0 2024-04-25T17:19:07.041 INFO:tasks.workunit.client.0.smithi037.stdout:5/480: getdents d7/d18/d62 0 2024-04-25T17:19:07.042 INFO:tasks.workunit.client.0.smithi037.stdout:9/525: dwrite d1/d5/dc/fe [0,4194304] 0 2024-04-25T17:19:07.043 INFO:tasks.workunit.client.0.smithi037.stdout:9/526: stat d1/d5/d19/d6e 0 2024-04-25T17:19:07.043 INFO:tasks.workunit.client.1.smithi069.stdout:9/215: rename d2/da/d14/l27 to d2/da/d14/d23/l4f 0 2024-04-25T17:19:07.047 INFO:tasks.workunit.client.1.smithi069.stdout:2/155: write d0/d26/f2b [4593366,59717] 0 2024-04-25T17:19:07.051 INFO:tasks.workunit.client.0.smithi037.stdout:6/400: dread db/f56 [0,4194304] 0 2024-04-25T17:19:07.051 INFO:tasks.workunit.client.0.smithi037.stdout:4/592: rmdir d7/d7e/d1e/d2b 39 2024-04-25T17:19:07.052 INFO:tasks.workunit.client.0.smithi037.stdout:9/527: dwrite d1/d48/d68/f5a [0,4194304] 0 2024-04-25T17:19:07.053 INFO:tasks.workunit.client.0.smithi037.stdout:4/593: chown d7/d7e/d45/d4f/fa4 107584076 1 2024-04-25T17:19:07.054 INFO:tasks.workunit.client.0.smithi037.stdout:6/401: truncate db/d26/d2e/f80 4826579 0 2024-04-25T17:19:07.056 INFO:tasks.workunit.client.0.smithi037.stdout:6/402: chown db/f13 65037 1 2024-04-25T17:19:07.056 INFO:tasks.workunit.client.0.smithi037.stdout:7/456: creat d5/d14/d31/f9f x:0 0 0 2024-04-25T17:19:07.058 INFO:tasks.workunit.client.0.smithi037.stdout:1/384: chown dc/d18/c49 8 1 2024-04-25T17:19:07.059 INFO:tasks.workunit.client.1.smithi069.stdout:3/225: dwrite d8/f37 [0,4194304] 0 2024-04-25T17:19:07.062 INFO:tasks.workunit.client.0.smithi037.stdout:6/403: dread db/d26/d2e/f42 [0,4194304] 0 2024-04-25T17:19:07.062 INFO:tasks.workunit.client.0.smithi037.stdout:2/392: link d0/d15/l25 d0/d16/d68/l78 0 2024-04-25T17:19:07.063 INFO:tasks.workunit.client.1.smithi069.stdout:4/164: unlink db/lc 0 2024-04-25T17:19:07.065 INFO:tasks.workunit.client.1.smithi069.stdout:3/226: read d8/f13 [189919,126304] 0 2024-04-25T17:19:07.066 INFO:tasks.workunit.client.1.smithi069.stdout:3/227: chown d8/f13 1604 1 2024-04-25T17:19:07.067 INFO:tasks.workunit.client.1.smithi069.stdout:3/228: chown d8/f19 65837 1 2024-04-25T17:19:07.067 INFO:tasks.workunit.client.1.smithi069.stdout:3/229: readlink d8/l14 0 2024-04-25T17:19:07.070 INFO:tasks.workunit.client.1.smithi069.stdout:7/191: unlink d4/d6/d14/d15/d3c/d23/f3b 0 2024-04-25T17:19:07.073 INFO:tasks.workunit.client.0.smithi037.stdout:9/528: symlink d1/d5/d2e/d34/d76/lb2 0 2024-04-25T17:19:07.073 INFO:tasks.workunit.client.0.smithi037.stdout:5/481: write d7/d25/f2b [1031177,451] 0 2024-04-25T17:19:07.074 INFO:tasks.workunit.client.0.smithi037.stdout:9/529: chown d1/d5/f98 1518070505 1 2024-04-25T17:19:07.074 INFO:tasks.workunit.client.1.smithi069.stdout:5/165: mknod d13/d17/d19/d20/c34 0 2024-04-25T17:19:07.075 INFO:tasks.workunit.client.1.smithi069.stdout:5/166: truncate f5 6197521 0 2024-04-25T17:19:07.075 INFO:tasks.workunit.client.1.smithi069.stdout:0/148: dwrite d0/da/db/f13 [0,4194304] 0 2024-04-25T17:19:07.077 INFO:tasks.workunit.client.1.smithi069.stdout:9/216: write d2/da/d14/d23/f3b [2284974,18675] 0 2024-04-25T17:19:07.078 INFO:tasks.workunit.client.1.smithi069.stdout:9/217: chown d2/da/dd/de/f12 38987 1 2024-04-25T17:19:07.078 INFO:tasks.workunit.client.1.smithi069.stdout:9/218: chown d2/da/d14/f18 509946947 1 2024-04-25T17:19:07.079 INFO:tasks.workunit.client.0.smithi037.stdout:8/319: truncate d5/db/f1b 8183140 0 2024-04-25T17:19:07.080 INFO:tasks.workunit.client.1.smithi069.stdout:9/219: truncate d2/da/dd/d1e/d2e/f45 861909 0 2024-04-25T17:19:07.080 INFO:tasks.workunit.client.1.smithi069.stdout:9/220: fsync d2/da/dd/d1e/d2e/f45 0 2024-04-25T17:19:07.082 INFO:tasks.workunit.client.0.smithi037.stdout:5/482: dwrite d7/d12/f20 [0,4194304] 0 2024-04-25T17:19:07.082 INFO:tasks.workunit.client.1.smithi069.stdout:8/150: rename l20 to l31 0 2024-04-25T17:19:07.084 INFO:tasks.workunit.client.0.smithi037.stdout:7/457: rmdir d5/d15/d17/d25/d2b 39 2024-04-25T17:19:07.086 INFO:tasks.workunit.client.0.smithi037.stdout:1/385: rename f9 to dc/d24/f8a 0 2024-04-25T17:19:07.087 INFO:tasks.workunit.client.1.smithi069.stdout:6/168: rmdir d2/d7 39 2024-04-25T17:19:07.091 INFO:tasks.workunit.client.0.smithi037.stdout:2/393: symlink d0/d15/d2a/d5a/l79 0 2024-04-25T17:19:07.092 INFO:tasks.workunit.client.0.smithi037.stdout:2/394: write d0/d16/d3b/f47 [2949091,116211] 0 2024-04-25T17:19:07.095 INFO:tasks.workunit.client.1.smithi069.stdout:1/170: creat d1/f2e x:0 0 0 2024-04-25T17:19:07.097 INFO:tasks.workunit.client.0.smithi037.stdout:4/594: read d7/d7e/d1e/d2b/f5f [66556,115453] 0 2024-04-25T17:19:07.098 INFO:tasks.workunit.client.1.smithi069.stdout:7/192: rename d4/c5 to d4/c43 0 2024-04-25T17:19:07.101 INFO:tasks.workunit.client.0.smithi037.stdout:5/483: creat d7/d12/d6f/f96 x:0 0 0 2024-04-25T17:19:07.104 INFO:tasks.workunit.client.0.smithi037.stdout:1/386: mknod dc/d18/c8b 0 2024-04-25T17:19:07.105 INFO:tasks.workunit.client.1.smithi069.stdout:5/167: dread d13/d17/d19/f25 [0,4194304] 0 2024-04-25T17:19:07.108 INFO:tasks.workunit.client.1.smithi069.stdout:2/156: creat d0/d1/d1d/d33/f39 x:0 0 0 2024-04-25T17:19:07.114 INFO:tasks.workunit.client.1.smithi069.stdout:3/230: creat d8/d16/d4b/f52 x:0 0 0 2024-04-25T17:19:07.114 INFO:tasks.workunit.client.1.smithi069.stdout:3/231: chown f4 316004 1 2024-04-25T17:19:07.115 INFO:tasks.workunit.client.1.smithi069.stdout:3/232: read d8/d16/d1a/d2c/f2f [1797924,116896] 0 2024-04-25T17:19:07.116 INFO:tasks.workunit.client.1.smithi069.stdout:3/233: chown d8/f1d 118609 1 2024-04-25T17:19:07.118 INFO:tasks.workunit.client.1.smithi069.stdout:0/149: symlink d0/da/l32 0 2024-04-25T17:19:07.122 INFO:tasks.workunit.client.1.smithi069.stdout:8/151: fsync f13 0 2024-04-25T17:19:07.128 INFO:tasks.workunit.client.1.smithi069.stdout:3/234: creat d8/d2a/f53 x:0 0 0 2024-04-25T17:19:07.131 INFO:tasks.workunit.client.1.smithi069.stdout:9/221: link d2/da/f13 d2/da/dd/f50 0 2024-04-25T17:19:07.132 INFO:tasks.workunit.client.1.smithi069.stdout:5/168: mknod d13/d17/d19/d1c/c35 0 2024-04-25T17:19:07.132 INFO:tasks.workunit.client.1.smithi069.stdout:6/169: truncate d2/f1c 886745 0 2024-04-25T17:19:07.134 INFO:tasks.workunit.client.0.smithi037.stdout:2/395: creat d0/d16/d26/d3e/d4b/f7a x:0 0 0 2024-04-25T17:19:07.135 INFO:tasks.workunit.client.1.smithi069.stdout:1/171: link d1/df/d12/f14 d1/df/d17/f2f 0 2024-04-25T17:19:07.135 INFO:tasks.workunit.client.0.smithi037.stdout:5/484: creat d7/d12/d6f/f97 x:0 0 0 2024-04-25T17:19:07.136 INFO:tasks.workunit.client.0.smithi037.stdout:6/404: truncate db/f17 170719 0 2024-04-25T17:19:07.136 INFO:tasks.workunit.client.0.smithi037.stdout:7/458: symlink d5/d14/d31/d58/la0 0 2024-04-25T17:19:07.136 INFO:tasks.workunit.client.1.smithi069.stdout:7/193: write d4/d6/fa [3504385,68417] 0 2024-04-25T17:19:07.136 INFO:tasks.workunit.client.1.smithi069.stdout:5/169: write d13/d17/d19/d20/f24 [450569,110517] 0 2024-04-25T17:19:07.137 INFO:tasks.workunit.client.1.smithi069.stdout:3/235: dwrite d8/d16/d1a/d38/f50 [0,4194304] 0 2024-04-25T17:19:07.138 INFO:tasks.workunit.client.0.smithi037.stdout:7/459: chown d5/f13 72344212 1 2024-04-25T17:19:07.139 INFO:tasks.workunit.client.1.smithi069.stdout:5/170: read - d13/d17/d19/d20/f2a zero size 2024-04-25T17:19:07.140 INFO:tasks.workunit.client.0.smithi037.stdout:1/387: mkdir dc/d1c/d57/d22/d36/d8c 0 2024-04-25T17:19:07.141 INFO:tasks.workunit.client.0.smithi037.stdout:9/530: link d1/d5/d19/c30 d1/d5/d19/d6e/cb3 0 2024-04-25T17:19:07.141 INFO:tasks.workunit.client.1.smithi069.stdout:6/170: dread d2/d2e/f36 [0,4194304] 0 2024-04-25T17:19:07.141 INFO:tasks.workunit.client.0.smithi037.stdout:2/396: mknod d0/c7b 0 2024-04-25T17:19:07.145 INFO:tasks.workunit.client.0.smithi037.stdout:2/397: chown d0/d15 269305 1 2024-04-25T17:19:07.145 INFO:tasks.workunit.client.0.smithi037.stdout:8/320: dwrite d5/d13/f14 [4194304,4194304] 0 2024-04-25T17:19:07.148 INFO:tasks.workunit.client.0.smithi037.stdout:5/485: write d7/d43/f32 [864877,49656] 0 2024-04-25T17:19:07.151 INFO:tasks.workunit.client.0.smithi037.stdout:2/398: truncate d0/f33 1464881 0 2024-04-25T17:19:07.151 INFO:tasks.workunit.client.0.smithi037.stdout:4/595: dwrite d7/d7e/d1e/d2b/d35/d39/dba/fb4 [4194304,4194304] 0 2024-04-25T17:19:07.151 INFO:tasks.workunit.client.0.smithi037.stdout:5/486: fdatasync d7/d18/f7a 0 2024-04-25T17:19:07.153 INFO:tasks.workunit.client.0.smithi037.stdout:1/388: mknod dc/d1c/d57/d22/d36/c8d 0 2024-04-25T17:19:07.156 INFO:tasks.workunit.client.0.smithi037.stdout:9/531: mkdir d1/d5/d2e/d34/d76/db4 0 2024-04-25T17:19:07.158 INFO:tasks.workunit.client.1.smithi069.stdout:7/194: mkdir d4/d6/d14/d44 0 2024-04-25T17:19:07.160 INFO:tasks.workunit.client.1.smithi069.stdout:7/195: truncate d4/d6/d14/d15/d3c/d23/f27 696409 0 2024-04-25T17:19:07.160 INFO:tasks.workunit.client.1.smithi069.stdout:8/152: creat f32 x:0 0 0 2024-04-25T17:19:07.163 INFO:tasks.workunit.client.1.smithi069.stdout:6/171: mknod d2/d1e/c39 0 2024-04-25T17:19:07.164 INFO:tasks.workunit.client.0.smithi037.stdout:9/532: dwrite d1/d5/dc/d38/d8b/f41 [4194304,4194304] 0 2024-04-25T17:19:07.164 INFO:tasks.workunit.client.1.smithi069.stdout:4/165: sync 2024-04-25T17:19:07.164 INFO:tasks.workunit.client.1.smithi069.stdout:2/157: getdents d0/d1/d1d/d33 0 2024-04-25T17:19:07.165 INFO:tasks.workunit.client.0.smithi037.stdout:9/533: stat d1/d5/dc/d38/d8b/f41 0 2024-04-25T17:19:07.166 INFO:tasks.workunit.client.1.smithi069.stdout:4/166: write db/d15/d20/f2e [602283,100314] 0 2024-04-25T17:19:07.167 INFO:tasks.workunit.client.0.smithi037.stdout:4/596: chown d7/f1a 244760 1 2024-04-25T17:19:07.168 INFO:tasks.workunit.client.0.smithi037.stdout:2/399: mkdir d0/d7c 0 2024-04-25T17:19:07.168 INFO:tasks.workunit.client.1.smithi069.stdout:4/167: write db/d22/d24/f2d [906722,17050] 0 2024-04-25T17:19:07.169 INFO:tasks.workunit.client.0.smithi037.stdout:4/597: readlink d7/d7e/d1e/d2b/d35/d39/l50 0 2024-04-25T17:19:07.169 INFO:tasks.workunit.client.0.smithi037.stdout:5/487: fsync d7/d18/f29 0 2024-04-25T17:19:07.170 INFO:tasks.workunit.client.1.smithi069.stdout:3/236: dread d8/fe [0,4194304] 0 2024-04-25T17:19:07.173 INFO:tasks.workunit.client.0.smithi037.stdout:8/321: creat d5/db/d59/f5f x:0 0 0 2024-04-25T17:19:07.175 INFO:tasks.workunit.client.1.smithi069.stdout:7/196: symlink d4/d1a/d34/l45 0 2024-04-25T17:19:07.176 INFO:tasks.workunit.client.0.smithi037.stdout:9/534: mknod d1/d5/d2e/d34/d76/cb5 0 2024-04-25T17:19:07.177 INFO:tasks.workunit.client.0.smithi037.stdout:4/598: stat d7/f2f 0 2024-04-25T17:19:07.177 INFO:tasks.workunit.client.0.smithi037.stdout:4/599: chown d7/f80 118667 1 2024-04-25T17:19:07.180 INFO:tasks.workunit.client.0.smithi037.stdout:1/389: unlink dc/d1c/d57/l2e 0 2024-04-25T17:19:07.180 INFO:tasks.workunit.client.0.smithi037.stdout:9/535: dread d1/d5/dc/da9/fb1 [0,4194304] 0 2024-04-25T17:19:07.181 INFO:tasks.workunit.client.0.smithi037.stdout:1/390: chown dc/d18/d66/l82 43 1 2024-04-25T17:19:07.182 INFO:tasks.workunit.client.0.smithi037.stdout:2/400: rename d0/d15/d53 to d0/d23/d7d 0 2024-04-25T17:19:07.183 INFO:tasks.workunit.client.1.smithi069.stdout:6/172: dwrite d2/f21 [4194304,4194304] 0 2024-04-25T17:19:07.183 INFO:tasks.workunit.client.1.smithi069.stdout:2/158: rmdir d0/d1/d1d/d33 39 2024-04-25T17:19:07.184 INFO:tasks.workunit.client.0.smithi037.stdout:8/322: mknod d5/d13/c60 0 2024-04-25T17:19:07.184 INFO:tasks.workunit.client.1.smithi069.stdout:2/159: dread - d0/d26/f2f zero size 2024-04-25T17:19:07.184 INFO:tasks.workunit.client.0.smithi037.stdout:7/460: link d5/d15/d17/f1c d5/d14/d31/fa1 0 2024-04-25T17:19:07.186 INFO:tasks.workunit.client.1.smithi069.stdout:1/172: creat d1/df/f30 x:0 0 0 2024-04-25T17:19:07.188 INFO:tasks.workunit.client.1.smithi069.stdout:9/222: getdents d2/da/d14/d23 0 2024-04-25T17:19:07.189 INFO:tasks.workunit.client.0.smithi037.stdout:4/600: symlink d7/d7e/d1e/d2b/d35/d39/d9c/lc7 0 2024-04-25T17:19:07.195 INFO:tasks.workunit.client.1.smithi069.stdout:7/197: symlink d4/d6/d14/d15/d3c/l46 0 2024-04-25T17:19:07.197 INFO:tasks.workunit.client.0.smithi037.stdout:8/323: mknod d5/da/c61 0 2024-04-25T17:19:07.198 INFO:tasks.workunit.client.1.smithi069.stdout:7/198: chown d4/d6/d14/d15/d3c 16523 1 2024-04-25T17:19:07.198 INFO:tasks.workunit.client.1.smithi069.stdout:5/171: dwrite fa [0,4194304] 0 2024-04-25T17:19:07.200 INFO:tasks.workunit.client.1.smithi069.stdout:3/237: dwrite d8/d16/d1a/d2c/f35 [0,4194304] 0 2024-04-25T17:19:07.201 INFO:tasks.workunit.client.1.smithi069.stdout:1/173: write d1/d4/de/d11/d1b/f2c [4812658,25465] 0 2024-04-25T17:19:07.203 INFO:tasks.workunit.client.1.smithi069.stdout:4/168: mkdir db/d15/d20/d38/d3c 0 2024-04-25T17:19:07.204 INFO:tasks.workunit.client.1.smithi069.stdout:8/153: creat f33 x:0 0 0 2024-04-25T17:19:07.208 INFO:tasks.workunit.client.0.smithi037.stdout:2/401: getdents d0/d16/d3c 0 2024-04-25T17:19:07.210 INFO:tasks.workunit.client.0.smithi037.stdout:2/402: truncate d0/d16/d20/d55/f60 908125 0 2024-04-25T17:19:07.211 INFO:tasks.workunit.client.0.smithi037.stdout:8/324: creat d5/db/d18/f62 x:0 0 0 2024-04-25T17:19:07.213 INFO:tasks.workunit.client.0.smithi037.stdout:8/325: write d5/d26/d33/f34 [2945580,122964] 0 2024-04-25T17:19:07.213 INFO:tasks.workunit.client.1.smithi069.stdout:6/173: dwrite d2/d7/f25 [0,4194304] 0 2024-04-25T17:19:07.216 INFO:tasks.workunit.client.0.smithi037.stdout:8/326: read d5/f27 [624712,127546] 0 2024-04-25T17:19:07.218 INFO:tasks.workunit.client.1.smithi069.stdout:5/172: mknod d13/d17/d19/d1c/c36 0 2024-04-25T17:19:07.218 INFO:tasks.workunit.client.0.smithi037.stdout:8/327: write d5/d13/f3f [922402,13637] 0 2024-04-25T17:19:07.220 INFO:tasks.workunit.client.0.smithi037.stdout:8/328: read d5/d26/d33/f34 [3638379,31588] 0 2024-04-25T17:19:07.221 INFO:tasks.workunit.client.0.smithi037.stdout:9/536: dwrite d1/d48/d68/d26/f80 [4194304,4194304] 0 2024-04-25T17:19:07.221 INFO:tasks.workunit.client.0.smithi037.stdout:5/488: rename d7/d12/f77 to d7/d18/f98 0 2024-04-25T17:19:07.223 INFO:tasks.workunit.client.0.smithi037.stdout:8/329: truncate d5/f47 1769445 0 2024-04-25T17:19:07.224 INFO:tasks.workunit.client.1.smithi069.stdout:3/238: creat d8/d16/d1a/f54 x:0 0 0 2024-04-25T17:19:07.224 INFO:tasks.workunit.client.1.smithi069.stdout:5/173: dwrite d13/d17/f1d [0,4194304] 0 2024-04-25T17:19:07.224 INFO:tasks.workunit.client.0.smithi037.stdout:2/403: fdatasync d0/d23/d7d/f61 0 2024-04-25T17:19:07.227 INFO:tasks.workunit.client.1.smithi069.stdout:1/174: creat d1/d4/d6/f31 x:0 0 0 2024-04-25T17:19:07.230 INFO:tasks.workunit.client.1.smithi069.stdout:3/239: write d8/d16/d1a/d2c/f35 [5160178,122622] 0 2024-04-25T17:19:07.233 INFO:tasks.workunit.client.0.smithi037.stdout:1/391: getdents dc/d1c/d57/d22 0 2024-04-25T17:19:07.235 INFO:tasks.workunit.client.1.smithi069.stdout:1/175: dwrite d1/d4/de/d11/d1b/f2c [0,4194304] 0 2024-04-25T17:19:07.235 INFO:tasks.workunit.client.0.smithi037.stdout:1/392: write dc/d1c/d57/d22/d36/f54 [2673199,49517] 0 2024-04-25T17:19:07.236 INFO:tasks.workunit.client.1.smithi069.stdout:0/150: sync 2024-04-25T17:19:07.237 INFO:tasks.workunit.client.1.smithi069.stdout:7/199: dwrite d4/d1a/f1c [0,4194304] 0 2024-04-25T17:19:07.238 INFO:tasks.workunit.client.1.smithi069.stdout:0/151: readlink d0/da/db/l28 0 2024-04-25T17:19:07.238 INFO:tasks.workunit.client.0.smithi037.stdout:7/461: rename d5/d5e to d5/d15/d17/d1b/da2 0 2024-04-25T17:19:07.240 INFO:tasks.workunit.client.0.smithi037.stdout:7/462: chown d5/d15/d17/d1b/da2/f61 1 1 2024-04-25T17:19:07.240 INFO:tasks.workunit.client.1.smithi069.stdout:7/200: fsync d4/d6/d14/d15/f2d 0 2024-04-25T17:19:07.241 INFO:tasks.workunit.client.1.smithi069.stdout:7/201: read - d4/d6/d14/d15/f28 zero size 2024-04-25T17:19:07.242 INFO:tasks.workunit.client.1.smithi069.stdout:1/176: read d1/d4/d6/f16 [1786762,111726] 0 2024-04-25T17:19:07.246 INFO:tasks.workunit.client.0.smithi037.stdout:2/404: mknod d0/d16/d3c/c7e 0 2024-04-25T17:19:07.247 INFO:tasks.workunit.client.1.smithi069.stdout:5/174: rmdir d13/d17/d19/d20 39 2024-04-25T17:19:07.249 INFO:tasks.workunit.client.0.smithi037.stdout:4/601: getdents d7/d7e/d1e/d70 0 2024-04-25T17:19:07.249 INFO:tasks.workunit.client.1.smithi069.stdout:5/175: write d13/d17/f33 [428714,14938] 0 2024-04-25T17:19:07.249 INFO:tasks.workunit.client.0.smithi037.stdout:5/489: read d7/d43/f16 [1573436,12967] 0 2024-04-25T17:19:07.251 INFO:tasks.workunit.client.0.smithi037.stdout:7/463: dread d5/d15/d17/d1b/f68 [0,4194304] 0 2024-04-25T17:19:07.252 INFO:tasks.workunit.client.1.smithi069.stdout:3/240: creat d8/d2a/f55 x:0 0 0 2024-04-25T17:19:07.252 INFO:tasks.workunit.client.1.smithi069.stdout:3/241: stat d8/d2a 0 2024-04-25T17:19:07.253 INFO:tasks.workunit.client.0.smithi037.stdout:7/464: chown d5/d15/d17/d1b/da2/d76/l87 23154 1 2024-04-25T17:19:07.253 INFO:tasks.workunit.client.0.smithi037.stdout:1/393: readlink dc/d18/l4e 0 2024-04-25T17:19:07.255 INFO:tasks.workunit.client.1.smithi069.stdout:6/174: getdents d2/d2e/d35 0 2024-04-25T17:19:07.257 INFO:tasks.workunit.client.1.smithi069.stdout:2/160: link d0/d26/cb d0/d1/d1d/d28/c3a 0 2024-04-25T17:19:07.259 INFO:tasks.workunit.client.1.smithi069.stdout:3/242: dwrite d8/d39/f3c [0,4194304] 0 2024-04-25T17:19:07.260 INFO:tasks.workunit.client.1.smithi069.stdout:3/243: chown d8/d16/d1a/d38/f4c 183728323 1 2024-04-25T17:19:07.261 INFO:tasks.workunit.client.1.smithi069.stdout:3/244: dread - d8/f1d zero size 2024-04-25T17:19:07.262 INFO:tasks.workunit.client.1.smithi069.stdout:1/177: mkdir d1/d4/de/d11/d1b/d32 0 2024-04-25T17:19:07.262 INFO:tasks.workunit.client.0.smithi037.stdout:2/405: dwrite d0/d16/d68/f73 [0,4194304] 0 2024-04-25T17:19:07.263 INFO:tasks.workunit.client.1.smithi069.stdout:9/223: sync 2024-04-25T17:19:07.265 INFO:tasks.workunit.client.1.smithi069.stdout:1/178: readlink d1/d4/l21 0 2024-04-25T17:19:07.266 INFO:tasks.workunit.client.1.smithi069.stdout:2/161: dwrite d0/d1/d1d/f29 [0,4194304] 0 2024-04-25T17:19:07.268 INFO:tasks.workunit.client.0.smithi037.stdout:9/537: link d1/d5/dc/l96 d1/d5/d2e/d34/d76/db4/lb6 0 2024-04-25T17:19:07.269 INFO:tasks.workunit.client.0.smithi037.stdout:9/538: dread - d1/d5/d19/d6e/f8f zero size 2024-04-25T17:19:07.270 INFO:tasks.workunit.client.1.smithi069.stdout:8/154: creat f34 x:0 0 0 2024-04-25T17:19:07.271 INFO:tasks.workunit.client.0.smithi037.stdout:4/602: symlink d7/d7e/lc8 0 2024-04-25T17:19:07.271 INFO:tasks.workunit.client.0.smithi037.stdout:9/539: write d1/d48/d68/f74 [124064,109429] 0 2024-04-25T17:19:07.272 INFO:tasks.workunit.client.1.smithi069.stdout:8/155: stat f33 0 2024-04-25T17:19:07.273 INFO:tasks.workunit.client.0.smithi037.stdout:4/603: write d7/d7e/d1e/d2b/f42 [3049095,69609] 0 2024-04-25T17:19:07.274 INFO:tasks.workunit.client.0.smithi037.stdout:5/490: symlink d7/d18/l99 0 2024-04-25T17:19:07.274 INFO:tasks.workunit.client.0.smithi037.stdout:9/540: write d1/d5/dc/d38/d8b/f60 [986014,24581] 0 2024-04-25T17:19:07.275 INFO:tasks.workunit.client.1.smithi069.stdout:9/224: dwrite d2/da/dd/d1e/d2e/f45 [0,4194304] 0 2024-04-25T17:19:07.276 INFO:tasks.workunit.client.0.smithi037.stdout:8/330: write d5/da/f4a [3787945,62749] 0 2024-04-25T17:19:07.277 INFO:tasks.workunit.client.1.smithi069.stdout:7/202: mkdir d4/d6/d14/d3d/d47 0 2024-04-25T17:19:07.279 INFO:tasks.workunit.client.1.smithi069.stdout:5/176: symlink d13/d17/d29/d30/l37 0 2024-04-25T17:19:07.280 INFO:tasks.workunit.client.0.smithi037.stdout:1/394: mknod dc/d1c/d57/d22/d36/d8c/c8e 0 2024-04-25T17:19:07.281 INFO:tasks.workunit.client.0.smithi037.stdout:1/395: dread - dc/d1c/d57/d22/d36/f5d zero size 2024-04-25T17:19:07.285 INFO:tasks.workunit.client.1.smithi069.stdout:4/169: getdents db 0 2024-04-25T17:19:07.286 INFO:tasks.workunit.client.1.smithi069.stdout:5/177: dwrite f5 [4194304,4194304] 0 2024-04-25T17:19:07.289 INFO:tasks.workunit.client.0.smithi037.stdout:7/465: creat d5/fa3 x:0 0 0 2024-04-25T17:19:07.293 INFO:tasks.workunit.client.0.smithi037.stdout:9/541: symlink d1/d5/d2e/d34/d76/lb7 0 2024-04-25T17:19:07.295 INFO:tasks.workunit.client.0.smithi037.stdout:1/396: dwrite dc/fd [0,4194304] 0 2024-04-25T17:19:07.296 INFO:tasks.workunit.client.0.smithi037.stdout:1/397: readlink dc/d18/d66/l82 0 2024-04-25T17:19:07.297 INFO:tasks.workunit.client.1.smithi069.stdout:6/175: mknod d2/d7/c3a 0 2024-04-25T17:19:07.299 INFO:tasks.workunit.client.0.smithi037.stdout:8/331: rmdir d5/db/d23/d42 39 2024-04-25T17:19:07.300 INFO:tasks.workunit.client.0.smithi037.stdout:7/466: dwrite d5/d15/d17/f20 [4194304,4194304] 0 2024-04-25T17:19:07.304 INFO:tasks.workunit.client.0.smithi037.stdout:1/398: dread dc/d1c/d57/d22/d36/f54 [0,4194304] 0 2024-04-25T17:19:07.305 INFO:tasks.workunit.client.1.smithi069.stdout:6/176: dwrite d2/f2d [0,4194304] 0 2024-04-25T17:19:07.305 INFO:tasks.workunit.client.0.smithi037.stdout:1/399: dread - dc/d18/f88 zero size 2024-04-25T17:19:07.311 INFO:tasks.workunit.client.1.smithi069.stdout:9/225: truncate d2/da/fc 5473454 0 2024-04-25T17:19:07.312 INFO:tasks.workunit.client.1.smithi069.stdout:9/226: fsync d2/da/d14/f18 0 2024-04-25T17:19:07.317 INFO:tasks.workunit.client.1.smithi069.stdout:3/245: symlink d8/d16/d1a/d2c/d49/l56 0 2024-04-25T17:19:07.317 INFO:tasks.workunit.client.1.smithi069.stdout:3/246: fdatasync d8/d16/d4b/f52 0 2024-04-25T17:19:07.319 INFO:tasks.workunit.client.0.smithi037.stdout:5/491: dread d7/ff [4194304,4194304] 0 2024-04-25T17:19:07.320 INFO:tasks.workunit.client.1.smithi069.stdout:4/170: creat db/d15/d26/f3d x:0 0 0 2024-04-25T17:19:07.322 INFO:tasks.workunit.client.0.smithi037.stdout:2/406: link d0/d15/d2a/c40 d0/d23/d7d/c7f 0 2024-04-25T17:19:07.324 INFO:tasks.workunit.client.0.smithi037.stdout:8/332: dread d5/d26/d33/f34 [0,4194304] 0 2024-04-25T17:19:07.326 INFO:tasks.workunit.client.1.smithi069.stdout:2/162: mknod d0/d1/d1d/d33/c3b 0 2024-04-25T17:19:07.327 INFO:tasks.workunit.client.1.smithi069.stdout:0/152: getdents d0/da/db/d1d 0 2024-04-25T17:19:07.327 INFO:tasks.workunit.client.0.smithi037.stdout:8/333: write d5/db/d23/f29 [2626640,61785] 0 2024-04-25T17:19:07.328 INFO:tasks.workunit.client.1.smithi069.stdout:0/153: dread - d0/d17/f30 zero size 2024-04-25T17:19:07.330 INFO:tasks.workunit.client.0.smithi037.stdout:5/492: symlink d7/d18/d7c/l9a 0 2024-04-25T17:19:07.333 INFO:tasks.workunit.client.1.smithi069.stdout:3/247: mknod d8/c57 0 2024-04-25T17:19:07.334 INFO:tasks.workunit.client.1.smithi069.stdout:3/248: write d8/d16/d31/f44 [1048133,63264] 0 2024-04-25T17:19:07.335 INFO:tasks.workunit.client.0.smithi037.stdout:4/604: getdents d7/d7e/d1e/d2b/d35/d39/dba 0 2024-04-25T17:19:07.335 INFO:tasks.workunit.client.1.smithi069.stdout:4/171: mknod db/d15/c3e 0 2024-04-25T17:19:07.336 INFO:tasks.workunit.client.1.smithi069.stdout:4/172: dread - f7 zero size 2024-04-25T17:19:07.337 INFO:tasks.workunit.client.1.smithi069.stdout:4/173: readlink db/d15/d26/l3a 0 2024-04-25T17:19:07.338 INFO:tasks.workunit.client.1.smithi069.stdout:1/179: creat d1/df/f33 x:0 0 0 2024-04-25T17:19:07.338 INFO:tasks.workunit.client.1.smithi069.stdout:8/156: write fb [2446691,5723] 0 2024-04-25T17:19:07.342 INFO:tasks.workunit.client.1.smithi069.stdout:5/178: mknod d13/d17/d19/d20/c38 0 2024-04-25T17:19:07.344 INFO:tasks.workunit.client.0.smithi037.stdout:7/467: rename d5/d14/d31/l99 to d5/d15/d17/la4 0 2024-04-25T17:19:07.346 INFO:tasks.workunit.client.0.smithi037.stdout:5/493: dread d7/f87 [0,4194304] 0 2024-04-25T17:19:07.348 INFO:tasks.workunit.client.1.smithi069.stdout:2/163: dread d0/d1/f1f [0,4194304] 0 2024-04-25T17:19:07.348 INFO:tasks.workunit.client.0.smithi037.stdout:8/334: creat d5/db/d23/d42/f63 x:0 0 0 2024-04-25T17:19:07.354 INFO:tasks.workunit.client.1.smithi069.stdout:3/249: creat d8/d16/d1a/d38/f58 x:0 0 0 2024-04-25T17:19:07.356 INFO:tasks.workunit.client.1.smithi069.stdout:9/227: write d2/da/dd/de/f4a [401899,99947] 0 2024-04-25T17:19:07.358 INFO:tasks.workunit.client.1.smithi069.stdout:9/228: fsync d2/da/d14/d23/f3b 0 2024-04-25T17:19:07.358 INFO:tasks.workunit.client.1.smithi069.stdout:0/154: creat d0/da/db/d2c/f33 x:0 0 0 2024-04-25T17:19:07.359 INFO:tasks.workunit.client.1.smithi069.stdout:0/155: fsync d0/da/db/f15 0 2024-04-25T17:19:07.359 INFO:tasks.workunit.client.1.smithi069.stdout:2/164: creat d0/d1/d1d/d28/f3c x:0 0 0 2024-04-25T17:19:07.360 INFO:tasks.workunit.client.1.smithi069.stdout:6/177: link d2/d1e/l38 d2/d1e/l3b 0 2024-04-25T17:19:07.361 INFO:tasks.workunit.client.1.smithi069.stdout:3/250: mkdir d8/d16/d1a/d2c/d49/d59 0 2024-04-25T17:19:07.361 INFO:tasks.workunit.client.1.smithi069.stdout:6/178: write d2/d1e/f33 [2517750,13398] 0 2024-04-25T17:19:07.361 INFO:tasks.workunit.client.1.smithi069.stdout:6/179: stat d2/f17 0 2024-04-25T17:19:07.362 INFO:tasks.workunit.client.1.smithi069.stdout:1/180: truncate d1/d4/de/d11/f18 281565 0 2024-04-25T17:19:07.363 INFO:tasks.workunit.client.1.smithi069.stdout:5/179: mkdir d13/d17/d19/d20/d2d/d39 0 2024-04-25T17:19:07.363 INFO:tasks.workunit.client.1.smithi069.stdout:1/181: fsync d1/f5 0 2024-04-25T17:19:07.364 INFO:tasks.workunit.client.1.smithi069.stdout:5/180: chown l11 3 1 2024-04-25T17:19:07.364 INFO:tasks.workunit.client.1.smithi069.stdout:2/165: rmdir d0/d1 39 2024-04-25T17:19:07.364 INFO:tasks.workunit.client.1.smithi069.stdout:5/181: stat d13/d17/f1b 0 2024-04-25T17:19:07.365 INFO:tasks.workunit.client.1.smithi069.stdout:5/182: chown fa 10 1 2024-04-25T17:19:07.365 INFO:tasks.workunit.client.1.smithi069.stdout:0/156: unlink d0/da/d29/f2e 0 2024-04-25T17:19:07.366 INFO:tasks.workunit.client.1.smithi069.stdout:5/183: dread - d13/d17/d19/d20/f22 zero size 2024-04-25T17:19:07.367 INFO:tasks.workunit.client.1.smithi069.stdout:8/157: creat f35 x:0 0 0 2024-04-25T17:19:07.368 INFO:tasks.workunit.client.1.smithi069.stdout:3/251: creat d8/d39/f5a x:0 0 0 2024-04-25T17:19:07.370 INFO:tasks.workunit.client.1.smithi069.stdout:6/180: rename d2/d1e/f37 to d2/d1e/f3c 0 2024-04-25T17:19:07.372 INFO:tasks.workunit.client.1.smithi069.stdout:9/229: mkdir d2/d51 0 2024-04-25T17:19:07.374 INFO:tasks.workunit.client.1.smithi069.stdout:1/182: unlink d1/d4/d6/c8 0 2024-04-25T17:19:07.374 INFO:tasks.workunit.client.1.smithi069.stdout:3/252: dwrite d8/d16/d31/f44 [0,4194304] 0 2024-04-25T17:19:07.376 INFO:tasks.workunit.client.1.smithi069.stdout:3/253: write d8/d16/d1a/d38/f4c [398622,96743] 0 2024-04-25T17:19:07.377 INFO:tasks.workunit.client.1.smithi069.stdout:0/157: rename d0/l11 to d0/da/db/d2c/l34 0 2024-04-25T17:19:07.378 INFO:tasks.workunit.client.1.smithi069.stdout:5/184: rmdir d13/d17/d19/d20/d2d 39 2024-04-25T17:19:07.379 INFO:tasks.workunit.client.1.smithi069.stdout:8/158: chown c2c 681814 1 2024-04-25T17:19:07.381 INFO:tasks.workunit.client.1.smithi069.stdout:3/254: mknod d8/d16/d1a/c5b 0 2024-04-25T17:19:07.382 INFO:tasks.workunit.client.1.smithi069.stdout:5/185: chown d13/d17/d19/d20/f24 118155 1 2024-04-25T17:19:07.382 INFO:tasks.workunit.client.1.smithi069.stdout:7/203: sync 2024-04-25T17:19:07.382 INFO:tasks.workunit.client.1.smithi069.stdout:2/166: creat d0/d1/d1d/d28/d31/f3d x:0 0 0 2024-04-25T17:19:07.383 INFO:tasks.workunit.client.1.smithi069.stdout:8/159: fsync f26 0 2024-04-25T17:19:07.384 INFO:tasks.workunit.client.1.smithi069.stdout:9/230: mknod d2/da/dd/d1e/d2e/d3e/c52 0 2024-04-25T17:19:07.385 INFO:tasks.workunit.client.1.smithi069.stdout:7/204: unlink d4/c31 0 2024-04-25T17:19:07.387 INFO:tasks.workunit.client.0.smithi037.stdout:2/407: link d0/d16/d20/f3d d0/d16/d20/d55/f80 0 2024-04-25T17:19:07.387 INFO:tasks.workunit.client.1.smithi069.stdout:5/186: dread - d13/d17/d19/d20/f22 zero size 2024-04-25T17:19:07.387 INFO:tasks.workunit.client.1.smithi069.stdout:1/183: dwrite d1/f9 [0,4194304] 0 2024-04-25T17:19:07.387 INFO:tasks.workunit.client.0.smithi037.stdout:1/400: dwrite dc/d24/f8a [0,4194304] 0 2024-04-25T17:19:07.389 INFO:tasks.workunit.client.1.smithi069.stdout:9/231: chown d2/da/d14/f46 1 1 2024-04-25T17:19:07.389 INFO:tasks.workunit.client.1.smithi069.stdout:8/160: stat l19 0 2024-04-25T17:19:07.389 INFO:tasks.workunit.client.1.smithi069.stdout:2/167: chown d0/d26/d10/c30 10207 1 2024-04-25T17:19:07.389 INFO:tasks.workunit.client.0.smithi037.stdout:4/605: write d7/f13 [900760,96017] 0 2024-04-25T17:19:07.390 INFO:tasks.workunit.client.1.smithi069.stdout:7/205: truncate d4/d1a/f2f 912077 0 2024-04-25T17:19:07.391 INFO:tasks.workunit.client.1.smithi069.stdout:5/187: rmdir d13/d17/d19/d1c 39 2024-04-25T17:19:07.393 INFO:tasks.workunit.client.0.smithi037.stdout:5/494: truncate d7/d12/d5d/f7f 512858 0 2024-04-25T17:19:07.395 INFO:tasks.workunit.client.1.smithi069.stdout:5/188: write d13/d17/f1b [1682823,128059] 0 2024-04-25T17:19:07.397 INFO:tasks.workunit.client.1.smithi069.stdout:3/255: dwrite f4 [0,4194304] 0 2024-04-25T17:19:07.397 INFO:tasks.workunit.client.1.smithi069.stdout:4/174: sync 2024-04-25T17:19:07.401 INFO:tasks.workunit.client.0.smithi037.stdout:8/335: dwrite d5/db/d23/f29 [0,4194304] 0 2024-04-25T17:19:07.401 INFO:tasks.workunit.client.1.smithi069.stdout:5/189: chown d13/d17/f1b 3 1 2024-04-25T17:19:07.403 INFO:tasks.workunit.client.0.smithi037.stdout:2/408: dwrite d0/d15/f37 [0,4194304] 0 2024-04-25T17:19:07.404 INFO:tasks.workunit.client.1.smithi069.stdout:1/184: dwrite d1/d4/f2a [0,4194304] 0 2024-04-25T17:19:07.405 INFO:tasks.workunit.client.1.smithi069.stdout:4/175: chown db/d15/d26/f34 2661 1 2024-04-25T17:19:07.407 INFO:tasks.workunit.client.0.smithi037.stdout:5/495: dwrite d7/d12/f35 [0,4194304] 0 2024-04-25T17:19:07.410 INFO:tasks.workunit.client.1.smithi069.stdout:1/185: write d1/d4/d6/f16 [1609183,43802] 0 2024-04-25T17:19:07.411 INFO:tasks.workunit.client.1.smithi069.stdout:8/161: dwrite f12 [0,4194304] 0 2024-04-25T17:19:07.414 INFO:tasks.workunit.client.1.smithi069.stdout:9/232: dwrite d2/f8 [8388608,4194304] 0 2024-04-25T17:19:07.420 INFO:tasks.workunit.client.1.smithi069.stdout:9/233: dread - d2/da/dd/d1e/d2e/f34 zero size 2024-04-25T17:19:07.420 INFO:tasks.workunit.client.1.smithi069.stdout:8/162: dread fb [0,4194304] 0 2024-04-25T17:19:07.422 INFO:tasks.workunit.client.0.smithi037.stdout:2/409: read d0/f51 [1031775,63886] 0 2024-04-25T17:19:07.423 INFO:tasks.workunit.client.0.smithi037.stdout:2/410: truncate d0/d15/f1d 2157207 0 2024-04-25T17:19:07.431 INFO:tasks.workunit.client.0.smithi037.stdout:2/411: dwrite d0/d16/d20/d55/f6f [0,4194304] 0 2024-04-25T17:19:07.539 INFO:tasks.workunit.client.1.smithi069.stdout:2/168: rmdir d0 39 2024-04-25T17:19:07.539 INFO:tasks.workunit.client.0.smithi037.stdout:1/401: mkdir dc/d1c/d57/d4d/d6a/d8f 0 2024-04-25T17:19:07.543 INFO:tasks.workunit.client.1.smithi069.stdout:0/158: rmdir d0/da/db 39 2024-04-25T17:19:07.547 INFO:tasks.workunit.client.1.smithi069.stdout:3/256: symlink d8/d16/d1a/d2c/d49/l5c 0 2024-04-25T17:19:07.547 INFO:tasks.workunit.client.1.smithi069.stdout:3/257: fsync d8/d2a/f55 0 2024-04-25T17:19:07.548 INFO:tasks.workunit.client.1.smithi069.stdout:4/176: creat db/d15/f3f x:0 0 0 2024-04-25T17:19:07.549 INFO:tasks.workunit.client.1.smithi069.stdout:0/159: dwrite d0/f1 [0,4194304] 0 2024-04-25T17:19:07.549 INFO:tasks.workunit.client.1.smithi069.stdout:3/258: dread - d8/f18 zero size 2024-04-25T17:19:07.550 INFO:tasks.workunit.client.1.smithi069.stdout:4/177: fsync f5 0 2024-04-25T17:19:07.551 INFO:tasks.workunit.client.0.smithi037.stdout:2/412: rmdir d0/d16/d3b 39 2024-04-25T17:19:07.552 INFO:tasks.workunit.client.1.smithi069.stdout:6/181: truncate d2/d7/fd 8589233 0 2024-04-25T17:19:07.557 INFO:tasks.workunit.client.0.smithi037.stdout:8/336: mknod d5/db/c64 0 2024-04-25T17:19:07.557 INFO:tasks.workunit.client.1.smithi069.stdout:8/163: fdatasync fe 0 2024-04-25T17:19:07.564 INFO:tasks.workunit.client.0.smithi037.stdout:7/468: link d5/d15/d17/d25/d2b/d59/c7a d5/ca5 0 2024-04-25T17:19:07.565 INFO:tasks.workunit.client.0.smithi037.stdout:7/469: fdatasync d5/d15/d17/d1b/d27/f3d 0 2024-04-25T17:19:07.565 INFO:tasks.workunit.client.0.smithi037.stdout:7/470: readlink d5/d14/l5a 0 2024-04-25T17:19:07.569 INFO:tasks.workunit.client.1.smithi069.stdout:3/259: creat d8/d16/d1a/f5d x:0 0 0 2024-04-25T17:19:07.569 INFO:tasks.workunit.client.1.smithi069.stdout:3/260: fsync f4 0 2024-04-25T17:19:07.570 INFO:tasks.workunit.client.0.smithi037.stdout:1/402: truncate dc/d24/f48 4227861 0 2024-04-25T17:19:07.570 INFO:tasks.workunit.client.0.smithi037.stdout:1/403: readlink dc/d18/l3a 0 2024-04-25T17:19:07.571 INFO:tasks.workunit.client.0.smithi037.stdout:1/404: fsync dc/f60 0 2024-04-25T17:19:07.571 INFO:tasks.workunit.client.1.smithi069.stdout:4/178: creat db/d15/d26/f40 x:0 0 0 2024-04-25T17:19:07.571 INFO:tasks.workunit.client.1.smithi069.stdout:9/234: dread d2/da/d14/f25 [0,4194304] 0 2024-04-25T17:19:07.572 INFO:tasks.workunit.client.0.smithi037.stdout:7/471: fdatasync f4 0 2024-04-25T17:19:07.573 INFO:tasks.workunit.client.0.smithi037.stdout:7/472: read - d5/d15/d17/d1b/d27/d80/f86 zero size 2024-04-25T17:19:07.575 INFO:tasks.workunit.client.0.smithi037.stdout:2/413: creat d0/d15/f81 x:0 0 0 2024-04-25T17:19:07.575 INFO:tasks.workunit.client.0.smithi037.stdout:1/405: dread dc/d24/f5e [0,4194304] 0 2024-04-25T17:19:07.577 INFO:tasks.workunit.client.0.smithi037.stdout:2/414: write d0/d23/d7d/f61 [1992218,93290] 0 2024-04-25T17:19:07.578 INFO:tasks.workunit.client.0.smithi037.stdout:2/415: write d0/d15/f36 [747667,93847] 0 2024-04-25T17:19:07.578 INFO:tasks.workunit.client.1.smithi069.stdout:5/190: rename d13/d17/d19/c21 to d13/d17/d29/d30/c3a 0 2024-04-25T17:19:07.581 INFO:tasks.workunit.client.1.smithi069.stdout:8/164: fdatasync fb 0 2024-04-25T17:19:07.582 INFO:tasks.workunit.client.0.smithi037.stdout:8/337: rename d5/d26/f3c to d5/f65 0 2024-04-25T17:19:07.584 INFO:tasks.workunit.client.0.smithi037.stdout:1/406: creat dc/d18/d66/f90 x:0 0 0 2024-04-25T17:19:07.587 INFO:tasks.workunit.client.1.smithi069.stdout:2/169: dwrite d0/d1/f20 [0,4194304] 0 2024-04-25T17:19:07.588 INFO:tasks.workunit.client.0.smithi037.stdout:2/416: fsync d0/d16/d20/f3d 0 2024-04-25T17:19:07.593 INFO:tasks.workunit.client.1.smithi069.stdout:4/179: mkdir db/d22/d24/d41 0 2024-04-25T17:19:07.593 INFO:tasks.workunit.client.1.smithi069.stdout:4/180: dread - f7 zero size 2024-04-25T17:19:07.595 INFO:tasks.workunit.client.1.smithi069.stdout:9/235: rmdir d2/da/d14/d23 39 2024-04-25T17:19:07.598 INFO:tasks.workunit.client.1.smithi069.stdout:1/186: creat d1/df/f34 x:0 0 0 2024-04-25T17:19:07.599 INFO:tasks.workunit.client.0.smithi037.stdout:8/338: stat d5/db/d23/l46 0 2024-04-25T17:19:07.600 INFO:tasks.workunit.client.0.smithi037.stdout:8/339: dread - d5/db/d18/d3b/d50/f56 zero size 2024-04-25T17:19:07.601 INFO:tasks.workunit.client.1.smithi069.stdout:3/261: rename d8/d16/d1a/d2c/f4d to d8/d39/f5e 0 2024-04-25T17:19:07.604 INFO:tasks.workunit.client.0.smithi037.stdout:8/340: dread f4 [0,4194304] 0 2024-04-25T17:19:07.604 INFO:tasks.workunit.client.0.smithi037.stdout:1/407: mkdir dc/d1c/d57/d4d/d6a/d86/d91 0 2024-04-25T17:19:07.604 INFO:tasks.workunit.client.1.smithi069.stdout:7/206: getdents d4/d3e 0 2024-04-25T17:19:07.606 INFO:tasks.workunit.client.1.smithi069.stdout:0/160: creat d0/da/f35 x:0 0 0 2024-04-25T17:19:07.608 INFO:tasks.workunit.client.0.smithi037.stdout:2/417: dwrite d0/d16/d20/f3d [0,4194304] 0 2024-04-25T17:19:07.610 INFO:tasks.workunit.client.1.smithi069.stdout:4/181: mkdir db/d15/d42 0 2024-04-25T17:19:07.613 INFO:tasks.workunit.client.0.smithi037.stdout:8/341: truncate d5/db/f1f 511700 0 2024-04-25T17:19:07.614 INFO:tasks.workunit.client.0.smithi037.stdout:8/342: read - d5/db/d18/f62 zero size 2024-04-25T17:19:07.617 INFO:tasks.workunit.client.0.smithi037.stdout:2/418: creat d0/d16/d20/d59/d6a/f82 x:0 0 0 2024-04-25T17:19:07.619 INFO:tasks.workunit.client.0.smithi037.stdout:8/343: creat d5/d13/f66 x:0 0 0 2024-04-25T17:19:07.619 INFO:tasks.workunit.client.0.smithi037.stdout:8/344: dread - d5/db/d23/d42/f43 zero size 2024-04-25T17:19:07.621 INFO:tasks.workunit.client.0.smithi037.stdout:2/419: symlink d0/d23/l83 0 2024-04-25T17:19:07.623 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:07 smithi037 ceph-mon[26472]: pgmap v34: 65 pgs: 65 active+clean; 1.3 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 32 MiB/s rd, 156 MiB/s wr, 409 op/s 2024-04-25T17:19:07.623 INFO:tasks.workunit.client.1.smithi069.stdout:8/165: symlink l36 0 2024-04-25T17:19:07.626 INFO:tasks.workunit.client.1.smithi069.stdout:3/262: rename d8/d16/d1a/d38/f50 to d8/d16/d1a/d2c/f5f 0 2024-04-25T17:19:07.628 INFO:tasks.workunit.client.0.smithi037.stdout:1/408: rmdir dc/d1c 39 2024-04-25T17:19:07.630 INFO:tasks.workunit.client.1.smithi069.stdout:7/207: creat d4/d6/d14/f48 x:0 0 0 2024-04-25T17:19:07.634 INFO:tasks.workunit.client.0.smithi037.stdout:2/420: creat d0/d16/d3b/f84 x:0 0 0 2024-04-25T17:19:07.635 INFO:tasks.workunit.client.0.smithi037.stdout:2/421: fsync d0/d15/d2a/d5a/f6d 0 2024-04-25T17:19:07.637 INFO:tasks.workunit.client.0.smithi037.stdout:2/422: truncate d0/d16/d20/d55/f80 4569644 0 2024-04-25T17:19:07.638 INFO:tasks.workunit.client.0.smithi037.stdout:1/409: stat dc/d1c/d57/d4d/d6a 0 2024-04-25T17:19:07.638 INFO:tasks.workunit.client.0.smithi037.stdout:1/410: readlink dc/d1c/d57/d4d/l80 0 2024-04-25T17:19:07.641 INFO:tasks.workunit.client.1.smithi069.stdout:9/236: dwrite d2/da/f20 [0,4194304] 0 2024-04-25T17:19:07.641 INFO:tasks.workunit.client.1.smithi069.stdout:6/182: rename d2/d7/c1d to d2/d7/c3d 0 2024-04-25T17:19:07.642 INFO:tasks.workunit.client.1.smithi069.stdout:6/183: dread - d2/d1e/f2b zero size 2024-04-25T17:19:07.642 INFO:tasks.workunit.client.1.smithi069.stdout:6/184: fsync d2/f10 0 2024-04-25T17:19:07.651 INFO:tasks.workunit.client.0.smithi037.stdout:1/411: mkdir dc/d1c/d57/d22/d36/d92 0 2024-04-25T17:19:07.651 INFO:tasks.workunit.client.1.smithi069.stdout:3/263: fsync f6 0 2024-04-25T17:19:07.653 INFO:tasks.workunit.client.1.smithi069.stdout:2/170: truncate d0/d26/f13 454741 0 2024-04-25T17:19:07.655 INFO:tasks.workunit.client.1.smithi069.stdout:0/161: rename d0/da/d29 to d0/d36 0 2024-04-25T17:19:07.657 INFO:tasks.workunit.client.0.smithi037.stdout:1/412: chown dc/d18/d39/l84 7 1 2024-04-25T17:19:07.657 INFO:tasks.workunit.client.1.smithi069.stdout:1/187: write d1/d4/de/d11/f18 [898943,100221] 0 2024-04-25T17:19:07.660 INFO:tasks.workunit.client.1.smithi069.stdout:4/182: mkdir db/d15/d20/d38/d3c/d43 0 2024-04-25T17:19:07.661 INFO:tasks.workunit.client.1.smithi069.stdout:1/188: dread d1/df/d12/f14 [0,4194304] 0 2024-04-25T17:19:07.664 INFO:tasks.workunit.client.0.smithi037.stdout:2/423: getdents d0/d16/d20/d59/d6a 0 2024-04-25T17:19:07.667 INFO:tasks.workunit.client.1.smithi069.stdout:7/208: write d4/d6/d14/d15/f17 [2795515,112448] 0 2024-04-25T17:19:07.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:07 smithi069 ceph-mon[34527]: pgmap v34: 65 pgs: 65 active+clean; 1.3 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 32 MiB/s rd, 156 MiB/s wr, 409 op/s 2024-04-25T17:19:07.668 INFO:tasks.workunit.client.0.smithi037.stdout:1/413: creat dc/d1c/d57/d4d/d6a/d86/d91/f93 x:0 0 0 2024-04-25T17:19:07.669 INFO:tasks.workunit.client.0.smithi037.stdout:1/414: fdatasync dc/d18/f7d 0 2024-04-25T17:19:07.669 INFO:tasks.workunit.client.1.smithi069.stdout:9/237: symlink d2/da/dd/d1e/d40/l53 0 2024-04-25T17:19:07.674 INFO:tasks.workunit.client.0.smithi037.stdout:2/424: rename d0/d15/d2a/d5a/f6d to d0/d16/d3b/f85 0 2024-04-25T17:19:07.674 INFO:tasks.workunit.client.1.smithi069.stdout:9/238: write d2/da/f20 [5184157,88896] 0 2024-04-25T17:19:07.675 INFO:tasks.workunit.client.1.smithi069.stdout:5/191: sync 2024-04-25T17:19:07.675 INFO:tasks.workunit.client.1.smithi069.stdout:8/166: mkdir d37 0 2024-04-25T17:19:07.676 INFO:tasks.workunit.client.1.smithi069.stdout:6/185: unlink d2/d2e/f36 0 2024-04-25T17:19:07.678 INFO:tasks.workunit.client.1.smithi069.stdout:5/192: dwrite fa [0,4194304] 0 2024-04-25T17:19:07.678 INFO:tasks.workunit.client.0.smithi037.stdout:2/425: symlink d0/d23/l86 0 2024-04-25T17:19:07.679 INFO:tasks.workunit.client.0.smithi037.stdout:1/415: dwrite dc/f34 [0,4194304] 0 2024-04-25T17:19:07.686 INFO:tasks.workunit.client.1.smithi069.stdout:3/264: symlink d8/d16/d1a/d3e/d42/l60 0 2024-04-25T17:19:07.687 INFO:tasks.workunit.client.0.smithi037.stdout:2/426: creat d0/d16/d26/d3e/f87 x:0 0 0 2024-04-25T17:19:07.687 INFO:tasks.workunit.client.1.smithi069.stdout:3/265: dread - d8/d16/d4b/f52 zero size 2024-04-25T17:19:07.690 INFO:tasks.workunit.client.0.smithi037.stdout:2/427: symlink d0/d23/l88 0 2024-04-25T17:19:07.691 INFO:tasks.workunit.client.0.smithi037.stdout:1/416: symlink dc/d52/l94 0 2024-04-25T17:19:07.692 INFO:tasks.workunit.client.1.smithi069.stdout:0/162: dread d0/fc [0,4194304] 0 2024-04-25T17:19:07.695 INFO:tasks.workunit.client.0.smithi037.stdout:1/417: creat dc/d1c/d57/d4d/d6a/f95 x:0 0 0 2024-04-25T17:19:07.698 INFO:tasks.workunit.client.1.smithi069.stdout:7/209: dwrite d4/d6/d14/d15/f26 [4194304,4194304] 0 2024-04-25T17:19:07.701 INFO:tasks.workunit.client.1.smithi069.stdout:6/186: mkdir d2/d1e/d3e 0 2024-04-25T17:19:07.701 INFO:tasks.workunit.client.1.smithi069.stdout:2/171: getdents d0/d26/d36 0 2024-04-25T17:19:07.702 INFO:tasks.workunit.client.1.smithi069.stdout:6/187: read d2/f18 [196224,21056] 0 2024-04-25T17:19:07.702 INFO:tasks.workunit.client.1.smithi069.stdout:5/193: dread d13/f1a [0,4194304] 0 2024-04-25T17:19:07.702 INFO:tasks.workunit.client.1.smithi069.stdout:3/266: rmdir d8/d16/d4b 39 2024-04-25T17:19:07.704 INFO:tasks.workunit.client.1.smithi069.stdout:6/188: write d2/f2a [310457,126030] 0 2024-04-25T17:19:07.708 INFO:tasks.workunit.client.1.smithi069.stdout:8/167: unlink f3 0 2024-04-25T17:19:07.712 INFO:tasks.workunit.client.1.smithi069.stdout:2/172: mknod d0/d26/d10/c3e 0 2024-04-25T17:19:07.712 INFO:tasks.workunit.client.1.smithi069.stdout:6/189: dread d2/d1e/f33 [0,4194304] 0 2024-04-25T17:19:07.713 INFO:tasks.workunit.client.1.smithi069.stdout:5/194: dwrite d13/d17/d19/f28 [0,4194304] 0 2024-04-25T17:19:07.713 INFO:tasks.workunit.client.1.smithi069.stdout:2/173: chown d0/d26/d10/c30 414833183 1 2024-04-25T17:19:07.714 INFO:tasks.workunit.client.1.smithi069.stdout:6/190: write d2/d7/f25 [2175902,30697] 0 2024-04-25T17:19:07.715 INFO:tasks.workunit.client.1.smithi069.stdout:1/189: rename d1/df/d12 to d1/d4/de/d11/d35 0 2024-04-25T17:19:07.716 INFO:tasks.workunit.client.1.smithi069.stdout:3/267: symlink d8/d2a/l61 0 2024-04-25T17:19:07.717 INFO:tasks.workunit.client.1.smithi069.stdout:9/239: truncate d2/f42 793607 0 2024-04-25T17:19:07.717 INFO:tasks.workunit.client.1.smithi069.stdout:3/268: fsync d8/f1d 0 2024-04-25T17:19:07.719 INFO:tasks.workunit.client.1.smithi069.stdout:1/190: truncate d1/df/f33 87051 0 2024-04-25T17:19:07.721 INFO:tasks.workunit.client.1.smithi069.stdout:7/210: mknod d4/d6/d14/d3d/d47/c49 0 2024-04-25T17:19:07.721 INFO:tasks.workunit.client.1.smithi069.stdout:4/183: dwrite f8 [0,4194304] 0 2024-04-25T17:19:07.724 INFO:tasks.workunit.client.1.smithi069.stdout:4/184: write db/f21 [691558,112076] 0 2024-04-25T17:19:07.726 INFO:tasks.workunit.client.1.smithi069.stdout:5/195: symlink d13/d17/d29/d30/l3b 0 2024-04-25T17:19:07.726 INFO:tasks.workunit.client.1.smithi069.stdout:4/185: truncate db/d15/d26/f3d 905712 0 2024-04-25T17:19:07.728 INFO:tasks.workunit.client.1.smithi069.stdout:4/186: truncate db/d15/f18 109200 0 2024-04-25T17:19:07.729 INFO:tasks.workunit.client.1.smithi069.stdout:7/211: dwrite d4/f10 [0,4194304] 0 2024-04-25T17:19:07.730 INFO:tasks.workunit.client.0.smithi037.stdout:1/418: dread dc/f15 [0,4194304] 0 2024-04-25T17:19:07.730 INFO:tasks.workunit.client.0.smithi037.stdout:1/419: stat dc/d24/f48 0 2024-04-25T17:19:07.730 INFO:tasks.workunit.client.1.smithi069.stdout:7/212: write d4/d1a/f35 [930669,65253] 0 2024-04-25T17:19:07.731 INFO:tasks.workunit.client.1.smithi069.stdout:6/191: mkdir d2/d1e/d3f 0 2024-04-25T17:19:07.740 INFO:tasks.workunit.client.1.smithi069.stdout:2/174: dread d0/d1/fe [0,4194304] 0 2024-04-25T17:19:07.743 INFO:tasks.workunit.client.1.smithi069.stdout:9/240: dread d2/da/d14/d23/f43 [8388608,4194304] 0 2024-04-25T17:19:07.746 INFO:tasks.workunit.client.1.smithi069.stdout:8/168: mknod d37/c38 0 2024-04-25T17:19:07.746 INFO:tasks.workunit.client.1.smithi069.stdout:9/241: write d2/da/dd/d1e/d2e/f45 [4333602,51656] 0 2024-04-25T17:19:07.747 INFO:tasks.workunit.client.1.smithi069.stdout:2/175: dwrite d0/d1/d1d/d28/f3c [0,4194304] 0 2024-04-25T17:19:07.750 INFO:tasks.workunit.client.1.smithi069.stdout:7/213: creat d4/f4a x:0 0 0 2024-04-25T17:19:07.753 INFO:tasks.workunit.client.1.smithi069.stdout:0/163: link d0/c7 d0/da/c37 0 2024-04-25T17:19:07.754 INFO:tasks.workunit.client.0.smithi037.stdout:3/274: sync 2024-04-25T17:19:07.755 INFO:tasks.workunit.client.1.smithi069.stdout:4/187: dwrite db/d15/f17 [4194304,4194304] 0 2024-04-25T17:19:07.757 INFO:tasks.workunit.client.1.smithi069.stdout:4/188: chown db/d22/d24/f31 33827508 1 2024-04-25T17:19:07.758 INFO:tasks.workunit.client.1.smithi069.stdout:3/269: rename d8/d16/d4b/f52 to d8/d16/d4b/f62 0 2024-04-25T17:19:07.762 INFO:tasks.workunit.client.1.smithi069.stdout:0/164: dwrite d0/f1 [0,4194304] 0 2024-04-25T17:19:07.767 INFO:tasks.workunit.client.1.smithi069.stdout:8/169: mkdir d37/d39 0 2024-04-25T17:19:07.767 INFO:tasks.workunit.client.1.smithi069.stdout:9/242: creat d2/da/dd/d1e/d2e/d3e/f54 x:0 0 0 2024-04-25T17:19:07.767 INFO:tasks.workunit.client.1.smithi069.stdout:5/196: mknod d13/d17/d19/d20/d2d/c3c 0 2024-04-25T17:19:07.769 INFO:tasks.workunit.client.1.smithi069.stdout:7/214: creat d4/d6/d14/d15/d3c/d23/f4b x:0 0 0 2024-04-25T17:19:07.772 INFO:tasks.workunit.client.1.smithi069.stdout:7/215: dread d4/d3e/f41 [0,4194304] 0 2024-04-25T17:19:07.773 INFO:tasks.workunit.client.1.smithi069.stdout:3/270: creat d8/d16/d1a/d2c/f63 x:0 0 0 2024-04-25T17:19:07.774 INFO:tasks.workunit.client.1.smithi069.stdout:3/271: write d8/d39/f3c [4293178,102079] 0 2024-04-25T17:19:07.775 INFO:tasks.workunit.client.1.smithi069.stdout:0/165: mkdir d0/d38 0 2024-04-25T17:19:07.782 INFO:tasks.workunit.client.1.smithi069.stdout:1/191: getdents d1/df 0 2024-04-25T17:19:07.782 INFO:tasks.workunit.client.1.smithi069.stdout:1/192: chown d1/df/d17 305 1 2024-04-25T17:19:07.784 INFO:tasks.workunit.client.1.smithi069.stdout:7/216: mkdir d4/d4c 0 2024-04-25T17:19:07.785 INFO:tasks.workunit.client.1.smithi069.stdout:7/217: chown d4/d18/l1d 873740296 1 2024-04-25T17:19:07.786 INFO:tasks.workunit.client.1.smithi069.stdout:1/193: dread d1/df/d17/f2f [0,4194304] 0 2024-04-25T17:19:07.787 INFO:tasks.workunit.client.0.smithi037.stdout:1/420: symlink dc/d18/d64/l96 0 2024-04-25T17:19:07.788 INFO:tasks.workunit.client.1.smithi069.stdout:4/189: dread db/d22/d24/f31 [0,4194304] 0 2024-04-25T17:19:07.789 INFO:tasks.workunit.client.1.smithi069.stdout:5/197: symlink d13/d17/d19/d1c/l3d 0 2024-04-25T17:19:07.790 INFO:tasks.workunit.client.1.smithi069.stdout:7/218: symlink d4/d6/d14/d15/d3c/d23/l4d 0 2024-04-25T17:19:07.790 INFO:tasks.workunit.client.1.smithi069.stdout:3/272: dread f5 [0,4194304] 0 2024-04-25T17:19:07.790 INFO:tasks.workunit.client.1.smithi069.stdout:5/198: fdatasync d13/d17/f33 0 2024-04-25T17:19:07.794 INFO:tasks.workunit.client.1.smithi069.stdout:0/166: mknod d0/da/db/d1d/c39 0 2024-04-25T17:19:07.794 INFO:tasks.workunit.client.1.smithi069.stdout:8/170: rmdir d37/d39 0 2024-04-25T17:19:07.795 INFO:tasks.workunit.client.0.smithi037.stdout:1/421: getdents dc/d1c/d57 0 2024-04-25T17:19:07.796 INFO:tasks.workunit.client.1.smithi069.stdout:4/190: mknod db/d15/d20/d38/d3c/d43/c44 0 2024-04-25T17:19:07.797 INFO:tasks.workunit.client.1.smithi069.stdout:3/273: chown d8/d16/d1a/d2c/f45 2102 1 2024-04-25T17:19:07.797 INFO:tasks.workunit.client.1.smithi069.stdout:7/219: creat d4/d18/d3f/f4e x:0 0 0 2024-04-25T17:19:07.798 INFO:tasks.workunit.client.0.smithi037.stdout:1/422: rmdir dc/d18/d66 39 2024-04-25T17:19:07.800 INFO:tasks.workunit.client.1.smithi069.stdout:1/194: dwrite d1/df/d17/f2d [0,4194304] 0 2024-04-25T17:19:07.803 INFO:tasks.workunit.client.1.smithi069.stdout:1/195: chown d1/d4/de/d11/d35/c26 24473477 1 2024-04-25T17:19:07.805 INFO:tasks.workunit.client.1.smithi069.stdout:1/196: chown d1/d4/l21 7612373 1 2024-04-25T17:19:07.805 INFO:tasks.workunit.client.1.smithi069.stdout:8/171: unlink d37/c38 0 2024-04-25T17:19:07.805 INFO:tasks.workunit.client.1.smithi069.stdout:5/199: dwrite d13/d17/f1b [0,4194304] 0 2024-04-25T17:19:07.805 INFO:tasks.workunit.client.1.smithi069.stdout:1/197: dread - d1/f28 zero size 2024-04-25T17:19:07.805 INFO:tasks.workunit.client.1.smithi069.stdout:5/200: chown d13/d17/d29/f2b 1150637 1 2024-04-25T17:19:07.810 INFO:tasks.workunit.client.0.smithi037.stdout:1/423: link dc/d1c/d57/d22/d36/f4c dc/d1c/d57/d4d/d6a/d86/f97 0 2024-04-25T17:19:07.812 INFO:tasks.workunit.client.1.smithi069.stdout:7/220: creat d4/d18/f4f x:0 0 0 2024-04-25T17:19:07.814 INFO:tasks.workunit.client.1.smithi069.stdout:7/221: write d4/d18/f4f [878422,115942] 0 2024-04-25T17:19:07.815 INFO:tasks.workunit.client.0.smithi037.stdout:1/424: mknod dc/d1c/d57/d22/d36/d92/c98 0 2024-04-25T17:19:07.816 INFO:tasks.workunit.client.1.smithi069.stdout:3/274: dwrite d8/d39/f5e [0,4194304] 0 2024-04-25T17:19:07.816 INFO:tasks.workunit.client.1.smithi069.stdout:7/222: chown d4/d6/d14/d15/l30 83 1 2024-04-25T17:19:07.817 INFO:tasks.workunit.client.1.smithi069.stdout:4/191: creat db/d15/d42/f45 x:0 0 0 2024-04-25T17:19:07.819 INFO:tasks.workunit.client.1.smithi069.stdout:4/192: write db/d15/d26/f28 [2486141,101172] 0 2024-04-25T17:19:07.822 INFO:tasks.workunit.client.1.smithi069.stdout:1/198: symlink d1/d4/de/d11/l36 0 2024-04-25T17:19:07.822 INFO:tasks.workunit.client.1.smithi069.stdout:4/193: read db/f16 [2312589,52749] 0 2024-04-25T17:19:07.823 INFO:tasks.workunit.client.1.smithi069.stdout:5/201: symlink d13/d17/d19/l3e 0 2024-04-25T17:19:07.824 INFO:tasks.workunit.client.1.smithi069.stdout:7/223: mknod d4/d3e/c50 0 2024-04-25T17:19:07.825 INFO:tasks.workunit.client.1.smithi069.stdout:1/199: read d1/d4/de/d11/d35/f14 [1073780,97064] 0 2024-04-25T17:19:07.826 INFO:tasks.workunit.client.1.smithi069.stdout:5/202: write d13/d17/d19/d20/f22 [541465,16974] 0 2024-04-25T17:19:07.827 INFO:tasks.workunit.client.1.smithi069.stdout:1/200: dread - d1/f28 zero size 2024-04-25T17:19:07.827 INFO:tasks.workunit.client.1.smithi069.stdout:6/192: write d2/f21 [8154345,1477] 0 2024-04-25T17:19:07.828 INFO:tasks.workunit.client.1.smithi069.stdout:8/172: dwrite f14 [0,4194304] 0 2024-04-25T17:19:07.829 INFO:tasks.workunit.client.1.smithi069.stdout:4/194: unlink db/d15/d20/c27 0 2024-04-25T17:19:07.830 INFO:tasks.workunit.client.1.smithi069.stdout:1/201: dread - d1/d4/d6/f31 zero size 2024-04-25T17:19:07.833 INFO:tasks.workunit.client.1.smithi069.stdout:4/195: truncate db/f1c 455384 0 2024-04-25T17:19:07.833 INFO:tasks.workunit.client.1.smithi069.stdout:3/275: rename d8/d16/d1a/d38/c3f to d8/d16/d1a/d2c/d49/d59/c64 0 2024-04-25T17:19:07.833 INFO:tasks.workunit.client.1.smithi069.stdout:4/196: readlink db/d15/l2b 0 2024-04-25T17:19:07.834 INFO:tasks.workunit.client.1.smithi069.stdout:8/173: creat d37/f3a x:0 0 0 2024-04-25T17:19:07.836 INFO:tasks.workunit.client.1.smithi069.stdout:1/202: creat d1/d4/de/d11/d35/f37 x:0 0 0 2024-04-25T17:19:07.836 INFO:tasks.workunit.client.1.smithi069.stdout:5/203: dread d13/d17/d29/f2b [0,4194304] 0 2024-04-25T17:19:07.838 INFO:tasks.workunit.client.0.smithi037.stdout:1/425: dread dc/d18/f1b [0,4194304] 0 2024-04-25T17:19:07.839 INFO:tasks.workunit.client.1.smithi069.stdout:3/276: fsync d8/f13 0 2024-04-25T17:19:07.840 INFO:tasks.workunit.client.0.smithi037.stdout:1/426: write dc/d18/f51 [1025988,25004] 0 2024-04-25T17:19:07.842 INFO:tasks.workunit.client.1.smithi069.stdout:4/197: creat db/d15/d20/f46 x:0 0 0 2024-04-25T17:19:07.845 INFO:tasks.workunit.client.1.smithi069.stdout:8/174: mknod d37/c3b 0 2024-04-25T17:19:07.847 INFO:tasks.workunit.client.1.smithi069.stdout:2/176: write d0/d1/f1f [620403,2175] 0 2024-04-25T17:19:07.848 INFO:tasks.workunit.client.1.smithi069.stdout:2/177: chown d0/d26/f13 2 1 2024-04-25T17:19:07.852 INFO:tasks.workunit.client.1.smithi069.stdout:9/243: write d2/da/dd/de/f48 [1175636,24702] 0 2024-04-25T17:19:07.854 INFO:tasks.workunit.client.1.smithi069.stdout:9/244: dread - d2/da/d14/f41 zero size 2024-04-25T17:19:07.854 INFO:tasks.workunit.client.1.smithi069.stdout:3/277: creat d8/d16/d1a/d2c/d49/d59/f65 x:0 0 0 2024-04-25T17:19:07.855 INFO:tasks.workunit.client.1.smithi069.stdout:7/224: dwrite d4/d3e/f41 [0,4194304] 0 2024-04-25T17:19:07.855 INFO:tasks.workunit.client.1.smithi069.stdout:8/175: mknod d37/c3c 0 2024-04-25T17:19:07.856 INFO:tasks.workunit.client.1.smithi069.stdout:7/225: fdatasync d4/d1a/f1c 0 2024-04-25T17:19:07.857 INFO:tasks.workunit.client.1.smithi069.stdout:5/204: mknod d13/d17/d19/d20/d2d/d39/c3f 0 2024-04-25T17:19:07.858 INFO:tasks.workunit.client.1.smithi069.stdout:6/193: link d2/l31 d2/d7/l40 0 2024-04-25T17:19:07.861 INFO:tasks.workunit.client.1.smithi069.stdout:4/198: creat db/d22/d24/d41/f47 x:0 0 0 2024-04-25T17:19:07.862 INFO:tasks.workunit.client.1.smithi069.stdout:9/245: creat d2/da/d14/d23/f55 x:0 0 0 2024-04-25T17:19:07.865 INFO:tasks.workunit.client.1.smithi069.stdout:3/278: creat d8/d16/d1a/d38/f66 x:0 0 0 2024-04-25T17:19:07.866 INFO:tasks.workunit.client.1.smithi069.stdout:2/178: dwrite d0/f17 [0,4194304] 0 2024-04-25T17:19:07.867 INFO:tasks.workunit.client.1.smithi069.stdout:8/176: dwrite f34 [0,4194304] 0 2024-04-25T17:19:07.867 INFO:tasks.workunit.client.1.smithi069.stdout:3/279: chown d8/f1f 17 1 2024-04-25T17:19:07.869 INFO:tasks.workunit.client.1.smithi069.stdout:2/179: chown d0/d1/d1d/d28/f3c 129481 1 2024-04-25T17:19:07.873 INFO:tasks.workunit.client.1.smithi069.stdout:5/205: symlink d13/d17/l40 0 2024-04-25T17:19:07.874 INFO:tasks.workunit.client.1.smithi069.stdout:0/167: getdents d0/da/db/d1d 0 2024-04-25T17:19:07.875 INFO:tasks.workunit.client.1.smithi069.stdout:2/180: dread d0/f7 [0,4194304] 0 2024-04-25T17:19:07.876 INFO:tasks.workunit.client.1.smithi069.stdout:5/206: chown d13/d17/d29/d30 235 1 2024-04-25T17:19:07.877 INFO:tasks.workunit.client.1.smithi069.stdout:6/194: write d2/d7/f12 [4348337,110648] 0 2024-04-25T17:19:07.880 INFO:tasks.workunit.client.1.smithi069.stdout:3/280: dread d8/d16/f28 [0,4194304] 0 2024-04-25T17:19:07.882 INFO:tasks.workunit.client.1.smithi069.stdout:4/199: dwrite db/d15/d20/f2e [0,4194304] 0 2024-04-25T17:19:07.883 INFO:tasks.workunit.client.1.smithi069.stdout:3/281: fdatasync d8/d2a/f53 0 2024-04-25T17:19:07.883 INFO:tasks.workunit.client.1.smithi069.stdout:4/200: chown db/d15/d42 30455 1 2024-04-25T17:19:07.884 INFO:tasks.workunit.client.1.smithi069.stdout:9/246: mknod d2/da/d14/c56 0 2024-04-25T17:19:07.888 INFO:tasks.workunit.client.1.smithi069.stdout:0/168: dwrite d0/d17/f30 [0,4194304] 0 2024-04-25T17:19:07.889 INFO:tasks.workunit.client.1.smithi069.stdout:0/169: write d0/f8 [813948,84877] 0 2024-04-25T17:19:07.890 INFO:tasks.workunit.client.1.smithi069.stdout:6/195: rename d2/f17 to d2/d2e/f41 0 2024-04-25T17:19:07.894 INFO:tasks.workunit.client.1.smithi069.stdout:7/226: getdents d4/d3e 0 2024-04-25T17:19:07.896 INFO:tasks.workunit.client.1.smithi069.stdout:2/181: creat d0/d26/d36/f3f x:0 0 0 2024-04-25T17:19:07.897 INFO:tasks.workunit.client.1.smithi069.stdout:2/182: chown d0/d1/d1d/f32 1 1 2024-04-25T17:19:07.897 INFO:tasks.workunit.client.1.smithi069.stdout:2/183: readlink d0/d1/l2 0 2024-04-25T17:19:07.900 INFO:tasks.workunit.client.1.smithi069.stdout:5/207: mknod d13/d17/d19/c41 0 2024-04-25T17:19:07.900 INFO:tasks.workunit.client.1.smithi069.stdout:3/282: dread d8/d16/f21 [0,4194304] 0 2024-04-25T17:19:07.902 INFO:tasks.workunit.client.1.smithi069.stdout:4/201: mkdir db/d15/d20/d38/d3c/d43/d48 0 2024-04-25T17:19:07.902 INFO:tasks.workunit.client.1.smithi069.stdout:3/283: dread d8/d16/f28 [0,4194304] 0 2024-04-25T17:19:07.903 INFO:tasks.workunit.client.1.smithi069.stdout:0/170: mkdir d0/da/db/d3a 0 2024-04-25T17:19:07.906 INFO:tasks.workunit.client.1.smithi069.stdout:9/247: rename d2/c22 to d2/da/dd/d1e/d40/c57 0 2024-04-25T17:19:07.907 INFO:tasks.workunit.client.1.smithi069.stdout:7/227: mknod d4/d3e/c51 0 2024-04-25T17:19:07.908 INFO:tasks.workunit.client.1.smithi069.stdout:2/184: write d0/f7 [1094975,25711] 0 2024-04-25T17:19:07.909 INFO:tasks.workunit.client.1.smithi069.stdout:0/171: dwrite d0/f8 [0,4194304] 0 2024-04-25T17:19:07.909 INFO:tasks.workunit.client.1.smithi069.stdout:5/208: creat d13/d17/f42 x:0 0 0 2024-04-25T17:19:07.911 INFO:tasks.workunit.client.1.smithi069.stdout:2/185: write d0/d26/f2b [1480028,20548] 0 2024-04-25T17:19:07.911 INFO:tasks.workunit.client.0.smithi037.stdout:1/427: dwrite dc/d1c/d57/d22/f2c [0,4194304] 0 2024-04-25T17:19:07.914 INFO:tasks.workunit.client.0.smithi037.stdout:1/428: write dc/d1c/d57/d4d/d6a/d86/d91/f93 [123946,23675] 0 2024-04-25T17:19:07.914 INFO:tasks.workunit.client.1.smithi069.stdout:1/203: dwrite d1/f9 [4194304,4194304] 0 2024-04-25T17:19:07.915 INFO:tasks.workunit.client.0.smithi037.stdout:1/429: fdatasync dc/d24/f8a 0 2024-04-25T17:19:07.918 INFO:tasks.workunit.client.1.smithi069.stdout:6/196: mknod d2/c42 0 2024-04-25T17:19:07.919 INFO:tasks.workunit.client.1.smithi069.stdout:9/248: symlink d2/da/dd/d1e/d2e/d3e/l58 0 2024-04-25T17:19:07.924 INFO:tasks.workunit.client.1.smithi069.stdout:4/202: mkdir db/d15/d20/d38/d3c/d43/d48/d49 0 2024-04-25T17:19:07.926 INFO:tasks.workunit.client.0.smithi037.stdout:1/430: link dc/d1c/d57/d4d/d6a/f95 dc/d1c/d57/d4d/f99 0 2024-04-25T17:19:07.927 INFO:tasks.workunit.client.1.smithi069.stdout:5/209: creat d13/d17/d29/f43 x:0 0 0 2024-04-25T17:19:07.930 INFO:tasks.workunit.client.1.smithi069.stdout:2/186: dwrite d0/f17 [4194304,4194304] 0 2024-04-25T17:19:07.935 INFO:tasks.workunit.client.0.smithi037.stdout:6/405: sync 2024-04-25T17:19:07.935 INFO:tasks.workunit.client.0.smithi037.stdout:0/449: sync 2024-04-25T17:19:07.935 INFO:tasks.workunit.client.0.smithi037.stdout:1/431: write dc/d24/f8a [4614989,57727] 0 2024-04-25T17:19:07.935 INFO:tasks.workunit.client.0.smithi037.stdout:1/432: readlink dc/d18/l4e 0 2024-04-25T17:19:07.937 INFO:tasks.workunit.client.0.smithi037.stdout:6/406: chown db/d1d/c3b 30410 1 2024-04-25T17:19:07.938 INFO:tasks.workunit.client.1.smithi069.stdout:1/204: rmdir d1/d4/de/d11/d1b 39 2024-04-25T17:19:07.938 INFO:tasks.workunit.client.1.smithi069.stdout:1/205: write d1/d4/d6/f7 [2716718,75010] 0 2024-04-25T17:19:07.939 INFO:tasks.workunit.client.1.smithi069.stdout:1/206: chown d1/df/f33 1573208 1 2024-04-25T17:19:07.940 INFO:tasks.workunit.client.1.smithi069.stdout:6/197: mkdir d2/d1e/d43 0 2024-04-25T17:19:07.941 INFO:tasks.workunit.client.1.smithi069.stdout:9/249: mkdir d2/da/dd/de/d59 0 2024-04-25T17:19:07.948 INFO:tasks.workunit.client.1.smithi069.stdout:4/203: chown db/d15/c1a 26 1 2024-04-25T17:19:07.949 INFO:tasks.workunit.client.0.smithi037.stdout:6/407: mknod db/d26/d2e/d82/c8f 0 2024-04-25T17:19:07.950 INFO:tasks.workunit.client.1.smithi069.stdout:3/284: link d8/c2b d8/d16/d1a/d2c/d49/c67 0 2024-04-25T17:19:07.953 INFO:tasks.workunit.client.0.smithi037.stdout:0/450: dwrite d9/d14/d28/f62 [0,4194304] 0 2024-04-25T17:19:07.953 INFO:tasks.workunit.client.0.smithi037.stdout:1/433: rename dc/f60 to dc/d52/d6b/f9a 0 2024-04-25T17:19:07.954 INFO:tasks.workunit.client.0.smithi037.stdout:1/434: chown dc/d18/c49 6470 1 2024-04-25T17:19:07.956 INFO:tasks.workunit.client.1.smithi069.stdout:0/172: creat d0/da/db/d2a/f3b x:0 0 0 2024-04-25T17:19:07.958 INFO:tasks.workunit.client.1.smithi069.stdout:8/177: dread ff [0,4194304] 0 2024-04-25T17:19:07.959 INFO:tasks.workunit.client.0.smithi037.stdout:0/451: dread d9/d14/d28/d48/f7e [0,4194304] 0 2024-04-25T17:19:07.960 INFO:tasks.workunit.client.1.smithi069.stdout:5/210: rename d13/c15 to d13/c44 0 2024-04-25T17:19:07.962 INFO:tasks.workunit.client.1.smithi069.stdout:2/187: symlink d0/d1/d1d/d28/l40 0 2024-04-25T17:19:07.963 INFO:tasks.workunit.client.1.smithi069.stdout:2/188: write d0/d26/f18 [795660,103677] 0 2024-04-25T17:19:07.964 INFO:tasks.workunit.client.1.smithi069.stdout:2/189: chown d0/d1/d1d/f22 153 1 2024-04-25T17:19:07.965 INFO:tasks.workunit.client.0.smithi037.stdout:1/435: mkdir dc/d1c/d57/d4d/d6a/d86/d9b 0 2024-04-25T17:19:07.966 INFO:tasks.workunit.client.1.smithi069.stdout:2/190: truncate d0/d26/f23 1222336 0 2024-04-25T17:19:07.969 INFO:tasks.workunit.client.0.smithi037.stdout:0/452: truncate d9/df/d32/f4b 118905 0 2024-04-25T17:19:07.969 INFO:tasks.workunit.client.1.smithi069.stdout:6/198: fdatasync d2/fe 0 2024-04-25T17:19:07.970 INFO:tasks.workunit.client.1.smithi069.stdout:6/199: write d2/f2a [38588,16924] 0 2024-04-25T17:19:07.971 INFO:tasks.workunit.client.0.smithi037.stdout:6/408: symlink db/d26/d2e/d7d/d65/d8b/l90 0 2024-04-25T17:19:07.973 INFO:tasks.workunit.client.1.smithi069.stdout:9/250: fdatasync d2/f8 0 2024-04-25T17:19:07.975 INFO:tasks.workunit.client.1.smithi069.stdout:6/200: dread d2/d1e/f32 [0,4194304] 0 2024-04-25T17:19:07.976 INFO:tasks.workunit.client.0.smithi037.stdout:1/436: dread dc/f13 [0,4194304] 0 2024-04-25T17:19:07.976 INFO:tasks.workunit.client.1.smithi069.stdout:6/201: chown d2/d7/f12 252046054 1 2024-04-25T17:19:07.978 INFO:tasks.workunit.client.1.smithi069.stdout:4/204: chown db/d15/d20/c36 4430460 1 2024-04-25T17:19:07.981 INFO:tasks.workunit.client.1.smithi069.stdout:3/285: creat d8/d16/d1a/d2c/d49/f68 x:0 0 0 2024-04-25T17:19:07.981 INFO:tasks.workunit.client.1.smithi069.stdout:3/286: stat d8/d16/d1a/d3e/c48 0 2024-04-25T17:19:07.982 INFO:tasks.workunit.client.1.smithi069.stdout:3/287: dread - d8/d39/f5a zero size 2024-04-25T17:19:07.982 INFO:tasks.workunit.client.1.smithi069.stdout:3/288: fsync d8/d16/d1a/d38/f66 0 2024-04-25T17:19:07.983 INFO:tasks.workunit.client.1.smithi069.stdout:0/173: mknod d0/da/db/c3c 0 2024-04-25T17:19:07.983 INFO:tasks.workunit.client.1.smithi069.stdout:0/174: fdatasync d0/da/db/f13 0 2024-04-25T17:19:07.984 INFO:tasks.workunit.client.1.smithi069.stdout:8/178: symlink d37/l3d 0 2024-04-25T17:19:07.985 INFO:tasks.workunit.client.1.smithi069.stdout:0/175: read d0/f2f [1594885,94947] 0 2024-04-25T17:19:07.985 INFO:tasks.workunit.client.1.smithi069.stdout:8/179: dread - f2f zero size 2024-04-25T17:19:07.986 INFO:tasks.workunit.client.0.smithi037.stdout:0/453: creat d9/d72/f9f x:0 0 0 2024-04-25T17:19:07.987 INFO:tasks.workunit.client.1.smithi069.stdout:5/211: creat d13/d17/d19/d1c/f45 x:0 0 0 2024-04-25T17:19:07.987 INFO:tasks.workunit.client.0.smithi037.stdout:0/454: truncate d9/d71/f92 337882 0 2024-04-25T17:19:07.987 INFO:tasks.workunit.client.0.smithi037.stdout:0/455: chown d9/d14/f95 36 1 2024-04-25T17:19:07.988 INFO:tasks.workunit.client.1.smithi069.stdout:1/207: mkdir d1/d19/d38 0 2024-04-25T17:19:07.989 INFO:tasks.workunit.client.1.smithi069.stdout:1/208: chown d1/f9 236771678 1 2024-04-25T17:19:07.989 INFO:tasks.workunit.client.1.smithi069.stdout:2/191: mkdir d0/d26/d36/d41 0 2024-04-25T17:19:07.990 INFO:tasks.workunit.client.1.smithi069.stdout:0/176: dwrite d0/da/db/f23 [0,4194304] 0 2024-04-25T17:19:07.990 INFO:tasks.workunit.client.1.smithi069.stdout:2/192: fsync d0/d1/f19 0 2024-04-25T17:19:07.991 INFO:tasks.workunit.client.1.smithi069.stdout:2/193: readlink d0/d1/l2 0 2024-04-25T17:19:07.994 INFO:tasks.workunit.client.0.smithi037.stdout:0/456: dwrite d9/d71/f92 [0,4194304] 0 2024-04-25T17:19:07.998 INFO:tasks.workunit.client.1.smithi069.stdout:7/228: getdents d4/d1a/d34 0 2024-04-25T17:19:07.998 INFO:tasks.workunit.client.1.smithi069.stdout:7/229: write d4/d6/d14/d15/f17 [738228,11267] 0 2024-04-25T17:19:07.999 INFO:tasks.workunit.client.1.smithi069.stdout:6/202: readlink d2/d7/l2c 0 2024-04-25T17:19:08.000 INFO:tasks.workunit.client.1.smithi069.stdout:6/203: chown d2/d7/f25 259 1 2024-04-25T17:19:08.001 INFO:tasks.workunit.client.0.smithi037.stdout:0/457: dread - d9/df/d32/d39/d68/f6e zero size 2024-04-25T17:19:08.002 INFO:tasks.workunit.client.1.smithi069.stdout:4/205: symlink db/d15/d42/l4a 0 2024-04-25T17:19:08.003 INFO:tasks.workunit.client.1.smithi069.stdout:3/289: symlink d8/d16/d1a/l69 0 2024-04-25T17:19:08.004 INFO:tasks.workunit.client.1.smithi069.stdout:4/206: truncate f7 34279 0 2024-04-25T17:19:08.010 INFO:tasks.workunit.client.1.smithi069.stdout:1/209: mknod d1/df/d17/c39 0 2024-04-25T17:19:08.010 INFO:tasks.workunit.client.0.smithi037.stdout:6/409: write db/d1d/f57 [406051,83609] 0 2024-04-25T17:19:08.015 INFO:tasks.workunit.client.0.smithi037.stdout:6/410: unlink db/d1d/l4e 0 2024-04-25T17:19:08.017 INFO:tasks.workunit.client.0.smithi037.stdout:0/458: dread d9/d14/d23/f29 [0,4194304] 0 2024-04-25T17:19:08.018 INFO:tasks.workunit.client.1.smithi069.stdout:7/230: unlink d4/d6/d14/d15/f26 0 2024-04-25T17:19:08.020 INFO:tasks.workunit.client.0.smithi037.stdout:6/411: mknod db/d5a/c91 0 2024-04-25T17:19:08.022 INFO:tasks.workunit.client.1.smithi069.stdout:4/207: mkdir db/d4b 0 2024-04-25T17:19:08.023 INFO:tasks.workunit.client.1.smithi069.stdout:3/290: rmdir d8/d16/d1a/d2c/d49 39 2024-04-25T17:19:08.027 INFO:tasks.workunit.client.0.smithi037.stdout:6/412: mknod db/d26/d2e/d7d/d65/d68/c92 0 2024-04-25T17:19:08.028 INFO:tasks.workunit.client.1.smithi069.stdout:8/180: truncate f26 569083 0 2024-04-25T17:19:08.028 INFO:tasks.workunit.client.1.smithi069.stdout:8/181: stat f2f 0 2024-04-25T17:19:08.029 INFO:tasks.workunit.client.1.smithi069.stdout:8/182: dread - f35 zero size 2024-04-25T17:19:08.032 INFO:tasks.workunit.client.0.smithi037.stdout:0/459: rmdir d9/df/d8a 0 2024-04-25T17:19:08.034 INFO:tasks.workunit.client.1.smithi069.stdout:2/194: unlink d0/d26/l2d 0 2024-04-25T17:19:08.035 INFO:tasks.workunit.client.1.smithi069.stdout:2/195: truncate d0/d26/f18 5104080 0 2024-04-25T17:19:08.039 INFO:tasks.workunit.client.0.smithi037.stdout:6/413: creat db/d26/f93 x:0 0 0 2024-04-25T17:19:08.043 INFO:tasks.workunit.client.0.smithi037.stdout:6/414: mknod db/d26/d2e/d7d/d65/d8b/c94 0 2024-04-25T17:19:08.044 INFO:tasks.workunit.client.0.smithi037.stdout:6/415: fdatasync db/d1d/d20/d2f/f6e 0 2024-04-25T17:19:08.046 INFO:tasks.workunit.client.1.smithi069.stdout:3/291: mknod d8/d2a/c6a 0 2024-04-25T17:19:08.048 INFO:tasks.workunit.client.1.smithi069.stdout:8/183: symlink d37/l3e 0 2024-04-25T17:19:08.048 INFO:tasks.workunit.client.0.smithi037.stdout:0/460: link d9/d14/f1a d9/d72/fa0 0 2024-04-25T17:19:08.049 INFO:tasks.workunit.client.1.smithi069.stdout:8/184: truncate f2f 608607 0 2024-04-25T17:19:08.049 INFO:tasks.workunit.client.0.smithi037.stdout:0/461: chown d9/d72/f9f 91167155 1 2024-04-25T17:19:08.051 INFO:tasks.workunit.client.1.smithi069.stdout:3/292: dwrite d8/d16/d1a/f4f [0,4194304] 0 2024-04-25T17:19:08.052 INFO:tasks.workunit.client.1.smithi069.stdout:9/251: getdents d2/da/dd/d1e/d2e/d3e 0 2024-04-25T17:19:08.053 INFO:tasks.workunit.client.1.smithi069.stdout:9/252: write d2/f17 [190782,32900] 0 2024-04-25T17:19:08.056 INFO:tasks.workunit.client.0.smithi037.stdout:0/462: dwrite d9/d71/f8e [0,4194304] 0 2024-04-25T17:19:08.057 INFO:tasks.workunit.client.1.smithi069.stdout:3/293: dwrite d8/f1f [0,4194304] 0 2024-04-25T17:19:08.060 INFO:tasks.workunit.client.1.smithi069.stdout:5/212: getdents d13/d17/d19/d20/d2d 0 2024-04-25T17:19:08.064 INFO:tasks.workunit.client.1.smithi069.stdout:5/213: dread d13/f1a [0,4194304] 0 2024-04-25T17:19:08.064 INFO:tasks.workunit.client.0.smithi037.stdout:6/416: dwrite db/d1d/f1f [0,4194304] 0 2024-04-25T17:19:08.065 INFO:tasks.workunit.client.1.smithi069.stdout:8/185: creat d37/f3f x:0 0 0 2024-04-25T17:19:08.068 INFO:tasks.workunit.client.1.smithi069.stdout:1/210: creat d1/d4/de/d11/f3a x:0 0 0 2024-04-25T17:19:08.069 INFO:tasks.workunit.client.0.smithi037.stdout:0/463: dwrite d9/d71/f8e [0,4194304] 0 2024-04-25T17:19:08.069 INFO:tasks.workunit.client.1.smithi069.stdout:1/211: write d1/d4/d6/f16 [1275306,81439] 0 2024-04-25T17:19:08.070 INFO:tasks.workunit.client.1.smithi069.stdout:1/212: stat d1/d4 0 2024-04-25T17:19:08.070 INFO:tasks.workunit.client.1.smithi069.stdout:0/177: link d0/da/db/l28 d0/da/l3d 0 2024-04-25T17:19:08.071 INFO:tasks.workunit.client.1.smithi069.stdout:0/178: fdatasync d0/da/db/f23 0 2024-04-25T17:19:08.071 INFO:tasks.workunit.client.1.smithi069.stdout:0/179: chown d0/d36 2680019 1 2024-04-25T17:19:08.074 INFO:tasks.workunit.client.0.smithi037.stdout:6/417: symlink db/d26/d2e/d7d/d65/d8b/l95 0 2024-04-25T17:19:08.076 INFO:tasks.workunit.client.0.smithi037.stdout:0/464: unlink d9/df/d32/d39/f7c 0 2024-04-25T17:19:08.079 INFO:tasks.workunit.client.1.smithi069.stdout:7/231: creat d4/d6/f52 x:0 0 0 2024-04-25T17:19:08.080 INFO:tasks.workunit.client.1.smithi069.stdout:7/232: chown d4/d6/d14/d15/d3c/d23/f4b 614 1 2024-04-25T17:19:08.081 INFO:tasks.workunit.client.1.smithi069.stdout:9/253: rename d2/da/dd/d1e/d2e/d35/f3d to d2/da/dd/d1e/d2e/d35/f5a 0 2024-04-25T17:19:08.081 INFO:tasks.workunit.client.1.smithi069.stdout:7/233: fdatasync d4/d1a/d34/f40 0 2024-04-25T17:19:08.082 INFO:tasks.workunit.client.0.smithi037.stdout:6/418: dwrite db/d26/d2e/d3e/f47 [0,4194304] 0 2024-04-25T17:19:08.082 INFO:tasks.workunit.client.1.smithi069.stdout:9/254: readlink d2/da/l4d 0 2024-04-25T17:19:08.082 INFO:tasks.workunit.client.1.smithi069.stdout:7/234: chown d4/d18/f1f 31 1 2024-04-25T17:19:08.086 INFO:tasks.workunit.client.1.smithi069.stdout:6/204: getdents d2/d1e 0 2024-04-25T17:19:08.088 INFO:tasks.workunit.client.1.smithi069.stdout:4/208: mknod db/d15/d42/c4c 0 2024-04-25T17:19:08.090 INFO:tasks.workunit.client.1.smithi069.stdout:7/235: dwrite d4/d6/d14/d15/f17 [0,4194304] 0 2024-04-25T17:19:08.092 INFO:tasks.workunit.client.1.smithi069.stdout:5/214: rename d13/d17/f31 to d13/d17/d19/d20/d2d/f46 0 2024-04-25T17:19:08.094 INFO:tasks.workunit.client.1.smithi069.stdout:1/213: creat d1/df/d17/f3b x:0 0 0 2024-04-25T17:19:08.094 INFO:tasks.workunit.client.0.smithi037.stdout:6/419: getdents db/d26/d2e/d3e/d25/d61 0 2024-04-25T17:19:08.095 INFO:tasks.workunit.client.1.smithi069.stdout:6/205: dwrite d2/f21 [0,4194304] 0 2024-04-25T17:19:08.095 INFO:tasks.workunit.client.1.smithi069.stdout:1/214: write d1/f28 [788757,84474] 0 2024-04-25T17:19:08.097 INFO:tasks.workunit.client.0.smithi037.stdout:6/420: fsync db/d26/f2b 0 2024-04-25T17:19:08.100 INFO:tasks.workunit.client.0.smithi037.stdout:6/421: read db/f16 [13012,120192] 0 2024-04-25T17:19:08.103 INFO:tasks.workunit.client.1.smithi069.stdout:4/209: write db/d15/f1d [414103,82200] 0 2024-04-25T17:19:08.104 INFO:tasks.workunit.client.0.smithi037.stdout:6/422: dread db/d26/d2e/f42 [0,4194304] 0 2024-04-25T17:19:08.104 INFO:tasks.workunit.client.1.smithi069.stdout:4/210: chown db/d15/f18 64009 1 2024-04-25T17:19:08.105 INFO:tasks.workunit.client.1.smithi069.stdout:0/180: rename d0/d17/c26 to d0/da/db/d2c/c3e 0 2024-04-25T17:19:08.108 INFO:tasks.workunit.client.0.smithi037.stdout:6/423: creat db/d1d/f96 x:0 0 0 2024-04-25T17:19:08.109 INFO:tasks.workunit.client.1.smithi069.stdout:8/186: dwrite f27 [0,4194304] 0 2024-04-25T17:19:08.111 INFO:tasks.workunit.client.1.smithi069.stdout:5/215: mknod d13/d17/d19/d20/c47 0 2024-04-25T17:19:08.112 INFO:tasks.workunit.client.0.smithi037.stdout:6/424: read db/d1d/d20/f21 [2947983,122278] 0 2024-04-25T17:19:08.112 INFO:tasks.workunit.client.1.smithi069.stdout:3/294: rename d8/fc to d8/d16/d1a/d2c/d49/d59/f6b 0 2024-04-25T17:19:08.114 INFO:tasks.workunit.client.0.smithi037.stdout:6/425: readlink db/l33 0 2024-04-25T17:19:08.114 INFO:tasks.workunit.client.1.smithi069.stdout:3/295: truncate d8/f18 518066 0 2024-04-25T17:19:08.115 INFO:tasks.workunit.client.1.smithi069.stdout:4/211: chown db/f14 0 1 2024-04-25T17:19:08.115 INFO:tasks.workunit.client.0.smithi037.stdout:6/426: stat db/d1d/f1f 0 2024-04-25T17:19:08.116 INFO:tasks.workunit.client.1.smithi069.stdout:3/296: truncate d8/d16/d1a/d38/f66 439313 0 2024-04-25T17:19:08.118 INFO:tasks.workunit.client.1.smithi069.stdout:9/255: creat d2/f5b x:0 0 0 2024-04-25T17:19:08.118 INFO:tasks.workunit.client.1.smithi069.stdout:9/256: fdatasync d2/da/f10 0 2024-04-25T17:19:08.119 INFO:tasks.workunit.client.1.smithi069.stdout:9/257: chown d2/da/dd/d1e/d2e/d35 19853047 1 2024-04-25T17:19:08.119 INFO:tasks.workunit.client.1.smithi069.stdout:9/258: stat d2/da/dd/d1e/d2e/d3e/f54 0 2024-04-25T17:19:08.120 INFO:tasks.workunit.client.1.smithi069.stdout:9/259: chown d2/f29 0 1 2024-04-25T17:19:08.122 INFO:tasks.workunit.client.1.smithi069.stdout:7/236: rename d4/d18/d3f/f4e to d4/d6/d14/d15/d3c/f53 0 2024-04-25T17:19:08.123 INFO:tasks.workunit.client.1.smithi069.stdout:7/237: write d4/d1a/d34/f40 [797776,76692] 0 2024-04-25T17:19:08.123 INFO:tasks.workunit.client.0.smithi037.stdout:6/427: getdents db/d26/d2e/d7d/d65 0 2024-04-25T17:19:08.124 INFO:tasks.workunit.client.1.smithi069.stdout:4/212: chown db/d22/d24/f31 326310 1 2024-04-25T17:19:08.124 INFO:tasks.workunit.client.1.smithi069.stdout:7/238: chown d4/d6/d14/d15/f17 1 1 2024-04-25T17:19:08.125 INFO:tasks.workunit.client.1.smithi069.stdout:6/206: creat d2/d7/f44 x:0 0 0 2024-04-25T17:19:08.125 INFO:tasks.workunit.client.1.smithi069.stdout:7/239: read d4/d18/f1f [579915,28644] 0 2024-04-25T17:19:08.126 INFO:tasks.workunit.client.0.smithi037.stdout:6/428: mknod db/d5a/c97 0 2024-04-25T17:19:08.128 INFO:tasks.workunit.client.1.smithi069.stdout:9/260: creat d2/da/dd/d1e/d40/f5c x:0 0 0 2024-04-25T17:19:08.128 INFO:tasks.workunit.client.1.smithi069.stdout:9/261: stat d2/da/dd/d1e/l32 0 2024-04-25T17:19:08.129 INFO:tasks.workunit.client.0.smithi037.stdout:6/429: write db/d1d/d20/f21 [1452245,48861] 0 2024-04-25T17:19:08.130 INFO:tasks.workunit.client.0.smithi037.stdout:6/430: chown c4 3492 1 2024-04-25T17:19:08.131 INFO:tasks.workunit.client.0.smithi037.stdout:6/431: chown db/d1d/l55 896378 1 2024-04-25T17:19:08.131 INFO:tasks.workunit.client.1.smithi069.stdout:0/181: rename d0/da/db/f31 to d0/da/db/d2a/f3f 0 2024-04-25T17:19:08.132 INFO:tasks.workunit.client.0.smithi037.stdout:6/432: chown db/d1d/f57 1365 1 2024-04-25T17:19:08.133 INFO:tasks.workunit.client.1.smithi069.stdout:4/213: symlink db/d22/d24/l4d 0 2024-04-25T17:19:08.134 INFO:tasks.workunit.client.1.smithi069.stdout:3/297: mkdir d8/d16/d1a/d2c/d6c 0 2024-04-25T17:19:08.137 INFO:tasks.workunit.client.1.smithi069.stdout:6/207: rmdir d2/d1e 39 2024-04-25T17:19:08.139 INFO:tasks.workunit.client.1.smithi069.stdout:1/215: getdents d1/d4/de/d11 0 2024-04-25T17:19:08.143 INFO:tasks.workunit.client.1.smithi069.stdout:2/196: truncate d0/d26/f18 4953324 0 2024-04-25T17:19:08.144 INFO:tasks.workunit.client.1.smithi069.stdout:1/216: dwrite d1/df/f34 [0,4194304] 0 2024-04-25T17:19:08.144 INFO:tasks.workunit.client.1.smithi069.stdout:0/182: mkdir d0/d17/d40 0 2024-04-25T17:19:08.145 INFO:tasks.workunit.client.1.smithi069.stdout:0/183: fdatasync d0/da/db/f15 0 2024-04-25T17:19:08.146 INFO:tasks.workunit.client.1.smithi069.stdout:1/217: truncate d1/d4/d6/f16 1813934 0 2024-04-25T17:19:08.146 INFO:tasks.workunit.client.1.smithi069.stdout:0/184: write d0/f8 [1897945,19223] 0 2024-04-25T17:19:08.147 INFO:tasks.workunit.client.1.smithi069.stdout:3/298: symlink d8/d16/d1a/d3e/d42/l6d 0 2024-04-25T17:19:08.148 INFO:tasks.workunit.client.1.smithi069.stdout:6/208: creat d2/d2e/f45 x:0 0 0 2024-04-25T17:19:08.151 INFO:tasks.workunit.client.1.smithi069.stdout:4/214: dread db/f11 [0,4194304] 0 2024-04-25T17:19:08.151 INFO:tasks.workunit.client.1.smithi069.stdout:7/240: unlink d4/c43 0 2024-04-25T17:19:08.153 INFO:tasks.workunit.client.1.smithi069.stdout:5/216: getdents d13 0 2024-04-25T17:19:08.153 INFO:tasks.workunit.client.1.smithi069.stdout:0/185: dwrite d0/da/f10 [4194304,4194304] 0 2024-04-25T17:19:08.154 INFO:tasks.workunit.client.1.smithi069.stdout:5/217: chown d13/d17/l40 1 1 2024-04-25T17:19:08.154 INFO:tasks.workunit.client.0.smithi037.stdout:0/465: dwrite d9/df/d32/d39/d68/f6e [0,4194304] 0 2024-04-25T17:19:08.156 INFO:tasks.workunit.client.0.smithi037.stdout:0/466: chown d9/df/d32/d35/l41 1234 1 2024-04-25T17:19:08.160 INFO:tasks.workunit.client.1.smithi069.stdout:7/241: dwrite d4/d6/d14/f48 [0,4194304] 0 2024-04-25T17:19:08.160 INFO:tasks.workunit.client.0.smithi037.stdout:0/467: fdatasync d9/df/f86 0 2024-04-25T17:19:08.163 INFO:tasks.workunit.client.1.smithi069.stdout:0/186: dwrite d0/da/db/f13 [0,4194304] 0 2024-04-25T17:19:08.167 INFO:tasks.workunit.client.0.smithi037.stdout:0/468: rmdir d9/df/d32/d39/d68 39 2024-04-25T17:19:08.168 INFO:tasks.workunit.client.0.smithi037.stdout:0/469: truncate d9/d14/d28/f8c 403131 0 2024-04-25T17:19:08.170 INFO:tasks.workunit.client.1.smithi069.stdout:3/299: dwrite d8/d16/d1a/d2c/f5f [0,4194304] 0 2024-04-25T17:19:08.171 INFO:tasks.workunit.client.1.smithi069.stdout:4/215: rmdir db/d15 39 2024-04-25T17:19:08.171 INFO:tasks.workunit.client.1.smithi069.stdout:3/300: dread - d8/f1d zero size 2024-04-25T17:19:08.173 INFO:tasks.workunit.client.1.smithi069.stdout:9/262: creat d2/da/dd/f5d x:0 0 0 2024-04-25T17:19:08.173 INFO:tasks.workunit.client.1.smithi069.stdout:9/263: stat d2/da/d14/f25 0 2024-04-25T17:19:08.177 INFO:tasks.workunit.client.1.smithi069.stdout:2/197: unlink d0/d1/d1d/d28/c3a 0 2024-04-25T17:19:08.177 INFO:tasks.workunit.client.0.smithi037.stdout:9/542: sync 2024-04-25T17:19:08.177 INFO:tasks.workunit.client.1.smithi069.stdout:2/198: dread - d0/d1/f19 zero size 2024-04-25T17:19:08.180 INFO:tasks.workunit.client.1.smithi069.stdout:7/242: symlink d4/d1a/d34/l54 0 2024-04-25T17:19:08.181 INFO:tasks.workunit.client.1.smithi069.stdout:7/243: readlink d4/d18/l1d 0 2024-04-25T17:19:08.187 INFO:tasks.workunit.client.1.smithi069.stdout:8/187: dwrite f8 [0,4194304] 0 2024-04-25T17:19:08.189 INFO:tasks.workunit.client.0.smithi037.stdout:9/543: mknod d1/d5/d19/d6e/cb8 0 2024-04-25T17:19:08.192 INFO:tasks.workunit.client.0.smithi037.stdout:0/470: dwrite d9/d14/f16 [0,4194304] 0 2024-04-25T17:19:08.195 INFO:tasks.workunit.client.0.smithi037.stdout:0/471: truncate d9/df/d32/d56/f8d 618678 0 2024-04-25T17:19:08.225 INFO:tasks.workunit.client.1.smithi069.stdout:5/218: dread f9 [0,4194304] 0 2024-04-25T17:19:08.227 INFO:tasks.workunit.client.1.smithi069.stdout:5/219: truncate d13/d17/d19/d20/d2d/f46 90041 0 2024-04-25T17:19:08.344 INFO:tasks.workunit.client.1.smithi069.stdout:6/209: sync 2024-04-25T17:19:08.344 INFO:tasks.workunit.client.1.smithi069.stdout:6/210: stat d2/d2e/d35 0 2024-04-25T17:19:08.345 INFO:tasks.workunit.client.1.smithi069.stdout:6/211: fdatasync d2/d2e/f45 0 2024-04-25T17:19:08.355 INFO:tasks.workunit.client.1.smithi069.stdout:4/216: chown db/cf 160748 1 2024-04-25T17:19:08.356 INFO:tasks.workunit.client.1.smithi069.stdout:3/301: truncate d8/d16/d1a/d2c/f2f 1457576 0 2024-04-25T17:19:08.358 INFO:tasks.workunit.client.0.smithi037.stdout:9/544: mknod d1/d48/d68/d26/cb9 0 2024-04-25T17:19:08.360 INFO:tasks.workunit.client.0.smithi037.stdout:0/472: rmdir d9/df/d32/d35 39 2024-04-25T17:19:08.362 INFO:tasks.workunit.client.1.smithi069.stdout:9/264: rename d2/da/d14/f41 to d2/da/dd/d1e/f5e 0 2024-04-25T17:19:08.364 INFO:tasks.workunit.client.0.smithi037.stdout:9/545: creat d1/d5/dc/fba x:0 0 0 2024-04-25T17:19:08.364 INFO:tasks.workunit.client.0.smithi037.stdout:6/433: write db/f56 [1917025,120334] 0 2024-04-25T17:19:08.366 INFO:tasks.workunit.client.1.smithi069.stdout:1/218: link d1/d4/de/d11/d1b/l1c d1/df/l3c 0 2024-04-25T17:19:08.367 INFO:tasks.workunit.client.0.smithi037.stdout:0/473: dwrite d9/df/d32/d39/f64 [0,4194304] 0 2024-04-25T17:19:08.371 INFO:tasks.workunit.client.1.smithi069.stdout:8/188: readlink l23 0 2024-04-25T17:19:08.373 INFO:tasks.workunit.client.1.smithi069.stdout:1/219: dwrite d1/d4/d6/f31 [0,4194304] 0 2024-04-25T17:19:08.374 INFO:tasks.workunit.client.0.smithi037.stdout:9/546: mkdir d1/d5/dc/d3c/d3e/dbb 0 2024-04-25T17:19:08.382 INFO:tasks.workunit.client.1.smithi069.stdout:3/302: mknod d8/d16/d1a/d2c/d49/d59/c6e 0 2024-04-25T17:19:08.382 INFO:tasks.workunit.client.0.smithi037.stdout:9/547: dwrite d1/d48/d68/f31 [8388608,4194304] 0 2024-04-25T17:19:08.386 INFO:tasks.workunit.client.0.smithi037.stdout:6/434: creat db/f98 x:0 0 0 2024-04-25T17:19:08.388 INFO:tasks.workunit.client.0.smithi037.stdout:5/496: sync 2024-04-25T17:19:08.389 INFO:tasks.workunit.client.0.smithi037.stdout:4/606: sync 2024-04-25T17:19:08.390 INFO:tasks.workunit.client.1.smithi069.stdout:2/199: link d0/d26/f13 d0/d26/f42 0 2024-04-25T17:19:08.391 INFO:tasks.workunit.client.1.smithi069.stdout:0/187: write d0/f6 [781034,94942] 0 2024-04-25T17:19:08.391 INFO:tasks.workunit.client.0.smithi037.stdout:9/548: symlink d1/d5/lbc 0 2024-04-25T17:19:08.394 INFO:tasks.workunit.client.0.smithi037.stdout:6/435: mknod db/d26/d2e/d7d/d65/c99 0 2024-04-25T17:19:08.396 INFO:tasks.workunit.client.0.smithi037.stdout:6/436: truncate db/d26/d2e/d3e/d25/d61/f73 584972 0 2024-04-25T17:19:08.399 INFO:tasks.workunit.client.1.smithi069.stdout:8/189: symlink d37/l40 0 2024-04-25T17:19:08.406 INFO:tasks.workunit.client.0.smithi037.stdout:5/497: truncate d7/d12/f5e 1397047 0 2024-04-25T17:19:08.406 INFO:tasks.workunit.client.0.smithi037.stdout:0/474: write d9/f73 [265788,94570] 0 2024-04-25T17:19:08.407 INFO:tasks.workunit.client.0.smithi037.stdout:0/475: chown d9/d14/d28/c89 1249 1 2024-04-25T17:19:08.407 INFO:tasks.workunit.client.1.smithi069.stdout:3/303: creat d8/d16/d1a/d3e/f6f x:0 0 0 2024-04-25T17:19:08.411 INFO:tasks.workunit.client.1.smithi069.stdout:9/265: mkdir d2/da/d5f 0 2024-04-25T17:19:08.412 INFO:tasks.workunit.client.1.smithi069.stdout:2/200: mkdir d0/d26/d10/d43 0 2024-04-25T17:19:08.413 INFO:tasks.workunit.client.1.smithi069.stdout:2/201: dread - d0/d1/d1d/f32 zero size 2024-04-25T17:19:08.413 INFO:tasks.workunit.client.1.smithi069.stdout:3/304: dwrite d8/d16/d1a/f4f [0,4194304] 0 2024-04-25T17:19:08.414 INFO:tasks.workunit.client.1.smithi069.stdout:2/202: stat d0/d1/d1d/d33 0 2024-04-25T17:19:08.414 INFO:tasks.workunit.client.1.smithi069.stdout:0/188: rename d0/da/db/f23 to d0/da/db/d1d/f41 0 2024-04-25T17:19:08.415 INFO:tasks.workunit.client.1.smithi069.stdout:5/220: sync 2024-04-25T17:19:08.415 INFO:tasks.workunit.client.1.smithi069.stdout:3/305: chown d8/c24 0 1 2024-04-25T17:19:08.415 INFO:tasks.workunit.client.1.smithi069.stdout:2/203: readlink d0/d1/l27 0 2024-04-25T17:19:08.416 INFO:tasks.workunit.client.1.smithi069.stdout:2/204: chown d0/d26/d10/c1b 189947 1 2024-04-25T17:19:08.418 INFO:tasks.workunit.client.0.smithi037.stdout:6/437: dread db/d1d/d20/d2f/f8e [0,4194304] 0 2024-04-25T17:19:08.419 INFO:tasks.workunit.client.1.smithi069.stdout:8/190: creat d37/f41 x:0 0 0 2024-04-25T17:19:08.420 INFO:tasks.workunit.client.1.smithi069.stdout:3/306: dread d8/d16/d1a/d38/f66 [0,4194304] 0 2024-04-25T17:19:08.421 INFO:tasks.workunit.client.0.smithi037.stdout:0/476: mknod d9/d71/ca1 0 2024-04-25T17:19:08.422 INFO:tasks.workunit.client.0.smithi037.stdout:6/438: dread db/d26/d2e/d3e/d25/d61/f73 [0,4194304] 0 2024-04-25T17:19:08.424 INFO:tasks.workunit.client.1.smithi069.stdout:3/307: dread d8/d16/d1a/d38/f66 [0,4194304] 0 2024-04-25T17:19:08.425 INFO:tasks.workunit.client.0.smithi037.stdout:9/549: rmdir d1/d5/dc/d3c/d3e/dbb 0 2024-04-25T17:19:08.425 INFO:tasks.workunit.client.1.smithi069.stdout:1/220: dwrite d1/d4/de/d11/d35/f14 [0,4194304] 0 2024-04-25T17:19:08.427 INFO:tasks.workunit.client.0.smithi037.stdout:5/498: fdatasync d7/d12/d5d/f7f 0 2024-04-25T17:19:08.428 INFO:tasks.workunit.client.0.smithi037.stdout:5/499: read d7/d43/f30 [1845377,41659] 0 2024-04-25T17:19:08.428 INFO:tasks.workunit.client.0.smithi037.stdout:4/607: truncate d7/d7e/d1e/d2b/d35/d39/dba/fb4 4183211 0 2024-04-25T17:19:08.430 INFO:tasks.workunit.client.1.smithi069.stdout:6/212: mknod d2/d1e/d43/c46 0 2024-04-25T17:19:08.430 INFO:tasks.workunit.client.0.smithi037.stdout:0/477: dread d9/df/f98 [0,4194304] 0 2024-04-25T17:19:08.430 INFO:tasks.workunit.client.0.smithi037.stdout:5/500: write d7/d12/f31 [5035524,75092] 0 2024-04-25T17:19:08.432 INFO:tasks.workunit.client.1.smithi069.stdout:4/217: mkdir db/d15/d20/d38/d3c/d43/d48/d49/d4e 0 2024-04-25T17:19:08.434 INFO:tasks.workunit.client.1.smithi069.stdout:2/205: dread d0/d26/f2b [0,4194304] 0 2024-04-25T17:19:08.435 INFO:tasks.workunit.client.1.smithi069.stdout:2/206: chown d0/d26/f13 4865008 1 2024-04-25T17:19:08.437 INFO:tasks.workunit.client.0.smithi037.stdout:9/550: rename d1/d5/dc/fe to d1/d5/dc/d38/fbd 0 2024-04-25T17:19:08.438 INFO:tasks.workunit.client.1.smithi069.stdout:4/218: dwrite db/d15/d42/f45 [0,4194304] 0 2024-04-25T17:19:08.439 INFO:tasks.workunit.client.1.smithi069.stdout:9/266: symlink d2/da/dd/d1e/d2e/l60 0 2024-04-25T17:19:08.446 INFO:tasks.workunit.client.1.smithi069.stdout:7/244: getdents d4/d18 0 2024-04-25T17:19:08.447 INFO:tasks.workunit.client.1.smithi069.stdout:7/245: write d4/d6/d14/d15/d3c/d23/f4b [87345,3748] 0 2024-04-25T17:19:08.451 INFO:tasks.workunit.client.1.smithi069.stdout:5/221: creat d13/d17/d19/d20/d2d/d39/f48 x:0 0 0 2024-04-25T17:19:08.451 INFO:tasks.workunit.client.1.smithi069.stdout:5/222: chown fd 8564380 1 2024-04-25T17:19:08.458 INFO:tasks.workunit.client.1.smithi069.stdout:3/308: symlink d8/d16/d1a/d3e/d42/l70 0 2024-04-25T17:19:08.459 INFO:tasks.workunit.client.1.smithi069.stdout:3/309: chown d8/fe 0 1 2024-04-25T17:19:08.459 INFO:tasks.workunit.client.1.smithi069.stdout:8/191: dread fb [0,4194304] 0 2024-04-25T17:19:08.459 INFO:tasks.workunit.client.1.smithi069.stdout:6/213: symlink d2/d1e/d43/l47 0 2024-04-25T17:19:08.460 INFO:tasks.workunit.client.1.smithi069.stdout:2/207: unlink d0/d26/c2e 0 2024-04-25T17:19:08.463 INFO:tasks.workunit.client.1.smithi069.stdout:9/267: truncate d2/f8 13755100 0 2024-04-25T17:19:08.464 INFO:tasks.workunit.client.1.smithi069.stdout:0/189: creat d0/da/d24/f42 x:0 0 0 2024-04-25T17:19:08.465 INFO:tasks.workunit.client.1.smithi069.stdout:3/310: dwrite d8/d16/d1a/d2c/d49/d59/f65 [0,4194304] 0 2024-04-25T17:19:08.466 INFO:tasks.workunit.client.1.smithi069.stdout:5/223: truncate d13/d17/d29/f2b 1254194 0 2024-04-25T17:19:08.467 INFO:tasks.workunit.client.1.smithi069.stdout:3/311: write d8/d2a/f53 [390198,112061] 0 2024-04-25T17:19:08.467 INFO:tasks.workunit.client.1.smithi069.stdout:5/224: fdatasync d13/d17/f33 0 2024-04-25T17:19:08.470 INFO:tasks.workunit.client.1.smithi069.stdout:4/219: rename db/f1c to db/d22/d24/d41/f4f 0 2024-04-25T17:19:08.472 INFO:tasks.workunit.client.1.smithi069.stdout:4/220: readlink db/d15/d42/l4a 0 2024-04-25T17:19:08.472 INFO:tasks.workunit.client.1.smithi069.stdout:4/221: symlink db/d4b/l50 2 2024-04-25T17:19:08.474 INFO:tasks.workunit.client.1.smithi069.stdout:7/246: mknod d4/d6/c55 0 2024-04-25T17:19:08.476 INFO:tasks.workunit.client.1.smithi069.stdout:1/221: dwrite d1/df/f33 [0,4194304] 0 2024-04-25T17:19:08.476 INFO:tasks.workunit.client.1.smithi069.stdout:3/312: dread d8/f20 [0,4194304] 0 2024-04-25T17:19:08.477 INFO:tasks.workunit.client.1.smithi069.stdout:9/268: creat d2/da/dd/d1e/d40/f61 x:0 0 0 2024-04-25T17:19:08.479 INFO:tasks.workunit.client.1.smithi069.stdout:6/214: dwrite d2/d7/f30 [0,4194304] 0 2024-04-25T17:19:08.482 INFO:tasks.workunit.client.1.smithi069.stdout:9/269: truncate d2/da/f20 6227699 0 2024-04-25T17:19:08.483 INFO:tasks.workunit.client.1.smithi069.stdout:8/192: truncate f26 146851 0 2024-04-25T17:19:08.485 INFO:tasks.workunit.client.1.smithi069.stdout:9/270: write d2/da/d14/f18 [1049359,70191] 0 2024-04-25T17:19:08.488 INFO:tasks.workunit.client.1.smithi069.stdout:9/271: fsync d2/da/d14/f46 0 2024-04-25T17:19:08.488 INFO:tasks.workunit.client.1.smithi069.stdout:0/190: dwrite d0/f4 [0,4194304] 0 2024-04-25T17:19:08.488 INFO:tasks.workunit.client.1.smithi069.stdout:4/222: symlink db/d15/d26/l51 0 2024-04-25T17:19:08.490 INFO:tasks.workunit.client.1.smithi069.stdout:7/247: mknod d4/d3e/c56 0 2024-04-25T17:19:08.490 INFO:tasks.workunit.client.1.smithi069.stdout:0/191: chown d0/da/db/f15 7633 1 2024-04-25T17:19:08.493 INFO:tasks.workunit.client.0.smithi037.stdout:0/478: write d9/d14/d28/d48/d58/f5d [4735011,25064] 0 2024-04-25T17:19:08.493 INFO:tasks.workunit.client.1.smithi069.stdout:3/313: mkdir d8/d71 0 2024-04-25T17:19:08.495 INFO:tasks.workunit.client.0.smithi037.stdout:0/479: dread - d9/df/d32/d39/f76 zero size 2024-04-25T17:19:08.497 INFO:tasks.workunit.client.1.smithi069.stdout:5/225: symlink d13/d17/d19/d20/l49 0 2024-04-25T17:19:08.499 INFO:tasks.workunit.client.0.smithi037.stdout:9/551: dwrite d1/d5/dc/d38/d8b/f60 [0,4194304] 0 2024-04-25T17:19:08.499 INFO:tasks.workunit.client.1.smithi069.stdout:1/222: symlink d1/d4/de/d11/d1b/l3d 0 2024-04-25T17:19:08.501 INFO:tasks.workunit.client.1.smithi069.stdout:1/223: write d1/d4/de/d11/d1b/f2c [4605036,110480] 0 2024-04-25T17:19:08.502 INFO:tasks.workunit.client.1.smithi069.stdout:1/224: chown d1/d4/f2a 2113 1 2024-04-25T17:19:08.502 INFO:tasks.workunit.client.1.smithi069.stdout:1/225: chown d1/df 4 1 2024-04-25T17:19:08.504 INFO:tasks.workunit.client.1.smithi069.stdout:1/226: write d1/d4/de/d11/d35/f14 [2706550,114261] 0 2024-04-25T17:19:08.505 INFO:tasks.workunit.client.0.smithi037.stdout:5/501: unlink d7/c3b 0 2024-04-25T17:19:08.506 INFO:tasks.workunit.client.0.smithi037.stdout:5/502: dread - d7/d12/d5d/f81 zero size 2024-04-25T17:19:08.508 INFO:tasks.workunit.client.1.smithi069.stdout:2/208: creat d0/f44 x:0 0 0 2024-04-25T17:19:08.510 INFO:tasks.workunit.client.0.smithi037.stdout:4/608: dread d7/d7e/d1e/d2b/d35/d39/fac [0,4194304] 0 2024-04-25T17:19:08.511 INFO:tasks.workunit.client.1.smithi069.stdout:8/193: rename f2f to d37/f42 0 2024-04-25T17:19:08.517 INFO:tasks.workunit.client.0.smithi037.stdout:5/503: creat d7/d43/f9b x:0 0 0 2024-04-25T17:19:08.518 INFO:tasks.workunit.client.1.smithi069.stdout:9/272: symlink d2/da/dd/d1e/d2e/d35/l62 0 2024-04-25T17:19:08.519 INFO:tasks.workunit.client.0.smithi037.stdout:4/609: mkdir d7/d7e/d1e/d70/d84/dc9 0 2024-04-25T17:19:08.520 INFO:tasks.workunit.client.1.smithi069.stdout:0/192: mkdir d0/da/d24/d43 0 2024-04-25T17:19:08.521 INFO:tasks.workunit.client.1.smithi069.stdout:4/223: dwrite db/f2f [0,4194304] 0 2024-04-25T17:19:08.522 INFO:tasks.workunit.client.1.smithi069.stdout:7/248: mknod d4/d6/d14/d3d/d47/c57 0 2024-04-25T17:19:08.523 INFO:tasks.workunit.client.1.smithi069.stdout:6/215: write d2/d1e/f33 [4000492,16595] 0 2024-04-25T17:19:08.524 INFO:tasks.workunit.client.1.smithi069.stdout:3/314: creat d8/d2a/f72 x:0 0 0 2024-04-25T17:19:08.527 INFO:tasks.workunit.client.1.smithi069.stdout:5/226: creat d13/d17/f4a x:0 0 0 2024-04-25T17:19:08.528 INFO:tasks.workunit.client.1.smithi069.stdout:5/227: stat d13/d17/d19/d20/f2a 0 2024-04-25T17:19:08.528 INFO:tasks.workunit.client.1.smithi069.stdout:0/193: dwrite d0/d36/f2b [4194304,4194304] 0 2024-04-25T17:19:08.529 INFO:tasks.workunit.client.1.smithi069.stdout:5/228: fdatasync d13/d17/d29/f43 0 2024-04-25T17:19:08.532 INFO:tasks.workunit.client.0.smithi037.stdout:4/610: dwrite d7/fe [0,4194304] 0 2024-04-25T17:19:08.535 INFO:tasks.workunit.client.0.smithi037.stdout:4/611: chown d7/d7e/d45/fb9 1505770895 1 2024-04-25T17:19:08.541 INFO:tasks.workunit.client.0.smithi037.stdout:5/504: dread f6 [0,4194304] 0 2024-04-25T17:19:08.543 INFO:tasks.workunit.client.0.smithi037.stdout:5/505: write d7/d12/d5d/f61 [1304300,95967] 0 2024-04-25T17:19:08.544 INFO:tasks.workunit.client.1.smithi069.stdout:1/227: mknod d1/d4/de/d11/d1b/c3e 0 2024-04-25T17:19:08.544 INFO:tasks.workunit.client.0.smithi037.stdout:9/552: write d1/d48/d68/d1c/f35 [1138793,44015] 0 2024-04-25T17:19:08.549 INFO:tasks.workunit.client.0.smithi037.stdout:4/612: rmdir d7/d67 39 2024-04-25T17:19:08.550 INFO:tasks.workunit.client.0.smithi037.stdout:4/613: chown d7/d78/fa1 806298 1 2024-04-25T17:19:08.551 INFO:tasks.workunit.client.0.smithi037.stdout:4/614: chown d7/d7e/l33 836901 1 2024-04-25T17:19:08.552 INFO:tasks.workunit.client.0.smithi037.stdout:5/506: rmdir d7/d18/d7c 39 2024-04-25T17:19:08.553 INFO:tasks.workunit.client.0.smithi037.stdout:5/507: fsync d7/d12/d6f/f96 0 2024-04-25T17:19:08.554 INFO:tasks.workunit.client.0.smithi037.stdout:5/508: write d7/d18/f8e [680452,31388] 0 2024-04-25T17:19:08.556 INFO:tasks.workunit.client.1.smithi069.stdout:9/273: rename d2/da/d14/l4c to d2/da/dd/d1e/d2e/l63 0 2024-04-25T17:19:08.557 INFO:tasks.workunit.client.1.smithi069.stdout:9/274: chown d2/da/d14/d23/l4f 206 1 2024-04-25T17:19:08.558 INFO:tasks.workunit.client.1.smithi069.stdout:9/275: fdatasync d2/da/dd/d1e/d2e/f47 0 2024-04-25T17:19:08.558 INFO:tasks.workunit.client.1.smithi069.stdout:7/249: creat d4/f58 x:0 0 0 2024-04-25T17:19:08.559 INFO:tasks.workunit.client.1.smithi069.stdout:0/194: fdatasync d0/d36/f2b 0 2024-04-25T17:19:08.563 INFO:tasks.workunit.client.0.smithi037.stdout:4/615: getdents d7/d7e/d1e/d2b 0 2024-04-25T17:19:08.563 INFO:tasks.workunit.client.1.smithi069.stdout:9/276: dwrite d2/da/dd/d1e/f26 [0,4194304] 0 2024-04-25T17:19:08.564 INFO:tasks.workunit.client.0.smithi037.stdout:4/616: stat d7/d7e/d4e/f53 0 2024-04-25T17:19:08.565 INFO:tasks.workunit.client.0.smithi037.stdout:4/617: chown d7/d7e/d1e/l9e 910785816 1 2024-04-25T17:19:08.565 INFO:tasks.workunit.client.1.smithi069.stdout:5/229: mknod d13/d17/d29/d2e/c4b 0 2024-04-25T17:19:08.573 INFO:tasks.workunit.client.0.smithi037.stdout:9/553: dread d1/d5/dc/f29 [0,4194304] 0 2024-04-25T17:19:08.574 INFO:tasks.workunit.client.1.smithi069.stdout:0/195: mknod d0/da/d24/c44 0 2024-04-25T17:19:08.574 INFO:tasks.workunit.client.1.smithi069.stdout:2/209: write d0/d26/f13 [1037265,102645] 0 2024-04-25T17:19:08.575 INFO:tasks.workunit.client.1.smithi069.stdout:0/196: write d0/da/db/f15 [1049622,27588] 0 2024-04-25T17:19:08.575 INFO:tasks.workunit.client.1.smithi069.stdout:2/210: chown d0/d1/fe 656719 1 2024-04-25T17:19:08.576 INFO:tasks.workunit.client.1.smithi069.stdout:3/315: symlink d8/d16/d1a/d2c/l73 0 2024-04-25T17:19:08.578 INFO:tasks.workunit.client.1.smithi069.stdout:9/277: mkdir d2/da/dd/de/d64 0 2024-04-25T17:19:08.580 INFO:tasks.workunit.client.1.smithi069.stdout:5/230: creat d13/d17/d19/d20/d2d/f4c x:0 0 0 2024-04-25T17:19:08.581 INFO:tasks.workunit.client.1.smithi069.stdout:2/211: dwrite d0/d1/f19 [0,4194304] 0 2024-04-25T17:19:08.581 INFO:tasks.workunit.client.1.smithi069.stdout:5/231: fsync d13/d17/f42 0 2024-04-25T17:19:08.582 INFO:tasks.workunit.client.1.smithi069.stdout:5/232: fdatasync d13/f16 0 2024-04-25T17:19:08.582 INFO:tasks.workunit.client.0.smithi037.stdout:5/509: truncate d7/d12/f20 2724091 0 2024-04-25T17:19:08.583 INFO:tasks.workunit.client.1.smithi069.stdout:8/194: link c16 d37/c43 0 2024-04-25T17:19:08.584 INFO:tasks.workunit.client.1.smithi069.stdout:4/224: creat db/f52 x:0 0 0 2024-04-25T17:19:08.585 INFO:tasks.workunit.client.1.smithi069.stdout:7/250: getdents d4/d18/d36 0 2024-04-25T17:19:08.585 INFO:tasks.workunit.client.0.smithi037.stdout:9/554: dread d1/d5/dc/f29 [4194304,4194304] 0 2024-04-25T17:19:08.586 INFO:tasks.workunit.client.1.smithi069.stdout:5/233: dread d13/d17/d19/f27 [0,4194304] 0 2024-04-25T17:19:08.587 INFO:tasks.workunit.client.1.smithi069.stdout:5/234: truncate d13/d17/f4a 778006 0 2024-04-25T17:19:08.589 INFO:tasks.workunit.client.0.smithi037.stdout:4/618: truncate d7/d7e/d45/fb9 3171088 0 2024-04-25T17:19:08.590 INFO:tasks.workunit.client.0.smithi037.stdout:4/619: chown d7/d7e/d4e/f7f 903152 1 2024-04-25T17:19:08.591 INFO:tasks.workunit.client.0.smithi037.stdout:5/510: chown d7/d18/d62/c84 1568976045 1 2024-04-25T17:19:08.591 INFO:tasks.workunit.client.0.smithi037.stdout:4/620: stat d7/d7e/d1e/d2b/d35/f36 0 2024-04-25T17:19:08.592 INFO:tasks.workunit.client.0.smithi037.stdout:9/555: mknod d1/d48/d68/d4e/cbe 0 2024-04-25T17:19:08.601 INFO:tasks.workunit.client.0.smithi037.stdout:5/511: creat d7/d12/d6f/d94/f9c x:0 0 0 2024-04-25T17:19:08.602 INFO:tasks.workunit.client.0.smithi037.stdout:5/512: dread - d7/d25/d4f/f82 zero size 2024-04-25T17:19:08.604 INFO:tasks.workunit.client.0.smithi037.stdout:9/556: symlink d1/d48/d68/d26/d81/lbf 0 2024-04-25T17:19:08.605 INFO:tasks.workunit.client.0.smithi037.stdout:9/557: chown d1/d48/d68/f74 624 1 2024-04-25T17:19:08.606 INFO:tasks.workunit.client.0.smithi037.stdout:9/558: rename d1 to d1/d48/d68/d26/dc0 22 2024-04-25T17:19:08.608 INFO:tasks.workunit.client.0.smithi037.stdout:5/513: mknod d7/d43/c9d 0 2024-04-25T17:19:08.613 INFO:tasks.workunit.client.0.smithi037.stdout:4/621: dread d7/f49 [0,4194304] 0 2024-04-25T17:19:08.616 INFO:tasks.workunit.client.0.smithi037.stdout:9/559: dwrite d1/d48/d68/d26/d81/f97 [0,4194304] 0 2024-04-25T17:19:08.617 INFO:tasks.workunit.client.0.smithi037.stdout:5/514: dread d7/d43/f30 [0,4194304] 0 2024-04-25T17:19:08.618 INFO:tasks.workunit.client.1.smithi069.stdout:9/278: mkdir d2/da/d14/d23/d65 0 2024-04-25T17:19:08.618 INFO:tasks.workunit.client.1.smithi069.stdout:8/195: symlink d37/l44 0 2024-04-25T17:19:08.619 INFO:tasks.workunit.client.1.smithi069.stdout:5/235: dread - d13/d17/d19/d20/d2d/d39/f48 zero size 2024-04-25T17:19:08.621 INFO:tasks.workunit.client.1.smithi069.stdout:8/196: chown d37/f42 0 1 2024-04-25T17:19:08.621 INFO:tasks.workunit.client.1.smithi069.stdout:9/279: chown d2/da/dd/d1e/c2a 2057121 1 2024-04-25T17:19:08.621 INFO:tasks.workunit.client.1.smithi069.stdout:3/316: dread d8/d16/d31/f44 [0,4194304] 0 2024-04-25T17:19:08.622 INFO:tasks.workunit.client.1.smithi069.stdout:0/197: creat d0/da/db/d1d/d27/f45 x:0 0 0 2024-04-25T17:19:08.622 INFO:tasks.workunit.client.1.smithi069.stdout:8/197: fsync f13 0 2024-04-25T17:19:08.624 INFO:tasks.workunit.client.1.smithi069.stdout:3/317: fdatasync d8/f19 0 2024-04-25T17:19:08.625 INFO:tasks.workunit.client.0.smithi037.stdout:4/622: write d7/d7e/d1e/f93 [400543,41545] 0 2024-04-25T17:19:08.625 INFO:tasks.workunit.client.1.smithi069.stdout:1/228: link d1/df/c22 d1/d19/c3f 0 2024-04-25T17:19:08.625 INFO:tasks.workunit.client.1.smithi069.stdout:4/225: dwrite db/d15/d26/f29 [0,4194304] 0 2024-04-25T17:19:08.625 INFO:tasks.workunit.client.0.smithi037.stdout:4/623: readlink d7/d7e/d1e/d2b/d35/d39/l50 0 2024-04-25T17:19:08.627 INFO:tasks.workunit.client.1.smithi069.stdout:5/236: unlink d13/d17/d19/d20/c38 0 2024-04-25T17:19:08.627 INFO:tasks.workunit.client.1.smithi069.stdout:5/237: chown d13/d17/d19/d20 1079746 1 2024-04-25T17:19:08.629 INFO:tasks.workunit.client.0.smithi037.stdout:9/560: creat d1/d48/d68/d26/d81/d9c/da4/fc1 x:0 0 0 2024-04-25T17:19:08.630 INFO:tasks.workunit.client.1.smithi069.stdout:0/198: creat d0/d17/f46 x:0 0 0 2024-04-25T17:19:08.633 INFO:tasks.workunit.client.0.smithi037.stdout:9/561: dread d1/d5/dc/d3c/d3e/f59 [0,4194304] 0 2024-04-25T17:19:08.639 INFO:tasks.workunit.client.0.smithi037.stdout:5/515: dwrite d7/d12/d5d/f80 [0,4194304] 0 2024-04-25T17:19:08.640 INFO:tasks.workunit.client.1.smithi069.stdout:7/251: rename d4/d1a/d34/f40 to d4/d6/f59 0 2024-04-25T17:19:08.642 INFO:tasks.workunit.client.1.smithi069.stdout:1/229: mknod d1/d4/c40 0 2024-04-25T17:19:08.643 INFO:tasks.workunit.client.1.smithi069.stdout:7/252: dread d4/d3e/f41 [0,4194304] 0 2024-04-25T17:19:08.644 INFO:tasks.workunit.client.1.smithi069.stdout:3/318: mknod d8/d16/d31/c74 0 2024-04-25T17:19:08.646 INFO:tasks.workunit.client.1.smithi069.stdout:3/319: write d8/d39/f5a [43296,38544] 0 2024-04-25T17:19:08.647 INFO:tasks.workunit.client.1.smithi069.stdout:4/226: mkdir db/d15/d42/d53 0 2024-04-25T17:19:08.647 INFO:tasks.workunit.client.0.smithi037.stdout:5/516: symlink d7/d12/d6f/l9e 0 2024-04-25T17:19:08.649 INFO:tasks.workunit.client.0.smithi037.stdout:5/517: dread - d7/d25/d4f/f82 zero size 2024-04-25T17:19:08.649 INFO:tasks.workunit.client.1.smithi069.stdout:9/280: mknod d2/da/d14/c66 0 2024-04-25T17:19:08.650 INFO:tasks.workunit.client.1.smithi069.stdout:6/216: sync 2024-04-25T17:19:08.651 INFO:tasks.workunit.client.1.smithi069.stdout:5/238: fsync d13/d17/d19/f25 0 2024-04-25T17:19:08.652 INFO:tasks.workunit.client.1.smithi069.stdout:7/253: dwrite d4/d6/d14/d15/d3c/d23/f4b [0,4194304] 0 2024-04-25T17:19:08.652 INFO:tasks.workunit.client.0.smithi037.stdout:4/624: dwrite d7/d7e/d5b/f73 [0,4194304] 0 2024-04-25T17:19:08.653 INFO:tasks.workunit.client.1.smithi069.stdout:8/198: link f33 d37/f45 0 2024-04-25T17:19:08.654 INFO:tasks.workunit.client.0.smithi037.stdout:5/518: mkdir d7/d43/d9f 0 2024-04-25T17:19:08.656 INFO:tasks.workunit.client.1.smithi069.stdout:5/239: dread d13/d17/d19/d20/f22 [0,4194304] 0 2024-04-25T17:19:08.660 INFO:tasks.workunit.client.1.smithi069.stdout:1/230: creat d1/d19/f41 x:0 0 0 2024-04-25T17:19:08.661 INFO:tasks.workunit.client.0.smithi037.stdout:5/519: mknod d7/d43/ca0 0 2024-04-25T17:19:08.663 INFO:tasks.workunit.client.1.smithi069.stdout:4/227: truncate db/d15/d20/f2e 4640964 0 2024-04-25T17:19:08.665 INFO:tasks.workunit.client.1.smithi069.stdout:5/240: dwrite d13/d17/f4a [0,4194304] 0 2024-04-25T17:19:08.666 INFO:tasks.workunit.client.1.smithi069.stdout:6/217: rmdir d2 39 2024-04-25T17:19:08.674 INFO:tasks.workunit.client.1.smithi069.stdout:7/254: mkdir d4/d6/d14/d5a 0 2024-04-25T17:19:08.674 INFO:tasks.workunit.client.1.smithi069.stdout:7/255: readlink d4/d18/l1d 0 2024-04-25T17:19:08.678 INFO:tasks.workunit.client.0.smithi037.stdout:4/625: dread d7/f34 [0,4194304] 0 2024-04-25T17:19:08.679 INFO:tasks.workunit.client.1.smithi069.stdout:3/320: write d8/d2a/f43 [1240174,77379] 0 2024-04-25T17:19:08.680 INFO:tasks.workunit.client.0.smithi037.stdout:5/520: truncate d7/f40 417005 0 2024-04-25T17:19:08.680 INFO:tasks.workunit.client.1.smithi069.stdout:1/231: dread d1/df/f34 [0,4194304] 0 2024-04-25T17:19:08.681 INFO:tasks.workunit.client.0.smithi037.stdout:5/521: fsync d7/f1b 0 2024-04-25T17:19:08.682 INFO:tasks.workunit.client.1.smithi069.stdout:4/228: rename db/d15/d42/l4a to db/d22/d24/d41/l54 0 2024-04-25T17:19:08.682 INFO:tasks.workunit.client.1.smithi069.stdout:4/229: chown db/d15/f1d 200927 1 2024-04-25T17:19:08.683 INFO:tasks.workunit.client.0.smithi037.stdout:4/626: creat d7/d7e/d1e/d2b/d35/d39/d9c/fca x:0 0 0 2024-04-25T17:19:08.684 INFO:tasks.workunit.client.0.smithi037.stdout:4/627: fsync d7/d7e/d1e/d2b/d35/d39/fb8 0 2024-04-25T17:19:08.686 INFO:tasks.workunit.client.1.smithi069.stdout:5/241: symlink d13/d17/d19/d20/d2d/d39/l4d 0 2024-04-25T17:19:08.687 INFO:tasks.workunit.client.0.smithi037.stdout:5/522: mkdir d7/da1 0 2024-04-25T17:19:08.689 INFO:tasks.workunit.client.0.smithi037.stdout:5/523: mknod d7/d12/d6f/d68/ca2 0 2024-04-25T17:19:08.690 INFO:tasks.workunit.client.0.smithi037.stdout:5/524: chown d7/d43/f52 26 1 2024-04-25T17:19:08.694 INFO:tasks.workunit.client.0.smithi037.stdout:4/628: dwrite d7/d7e/d4e/f71 [0,4194304] 0 2024-04-25T17:19:08.698 INFO:tasks.workunit.client.0.smithi037.stdout:4/629: symlink d7/d7e/d1e/d70/d84/lcb 0 2024-04-25T17:19:08.701 INFO:tasks.workunit.client.0.smithi037.stdout:5/525: dread d7/d25/d4f/f3d [0,4194304] 0 2024-04-25T17:19:08.708 INFO:tasks.workunit.client.0.smithi037.stdout:5/526: dwrite d7/f49 [0,4194304] 0 2024-04-25T17:19:08.708 INFO:tasks.workunit.client.0.smithi037.stdout:4/630: rmdir d7/d7e/d1e/d70/d9f 0 2024-04-25T17:19:08.709 INFO:tasks.workunit.client.0.smithi037.stdout:4/631: write d7/d78/fa1 [960891,69530] 0 2024-04-25T17:19:08.711 INFO:tasks.workunit.client.1.smithi069.stdout:3/321: dread d8/f12 [0,4194304] 0 2024-04-25T17:19:08.711 INFO:tasks.workunit.client.1.smithi069.stdout:4/230: symlink db/d15/d26/l55 0 2024-04-25T17:19:08.711 INFO:tasks.workunit.client.1.smithi069.stdout:8/199: truncate f8 4081317 0 2024-04-25T17:19:08.712 INFO:tasks.workunit.client.1.smithi069.stdout:6/218: rmdir d2 39 2024-04-25T17:19:08.712 INFO:tasks.workunit.client.1.smithi069.stdout:5/242: symlink d13/l4e 0 2024-04-25T17:19:08.713 INFO:tasks.workunit.client.1.smithi069.stdout:7/256: dwrite d4/d6/d14/d15/d3c/f53 [0,4194304] 0 2024-04-25T17:19:08.713 INFO:tasks.workunit.client.1.smithi069.stdout:3/322: fsync d8/d39/f3c 0 2024-04-25T17:19:08.713 INFO:tasks.workunit.client.1.smithi069.stdout:9/281: link c0 d2/da/c67 0 2024-04-25T17:19:08.714 INFO:tasks.workunit.client.0.smithi037.stdout:4/632: dread d7/d7e/d45/f95 [0,4194304] 0 2024-04-25T17:19:08.715 INFO:tasks.workunit.client.1.smithi069.stdout:9/282: fdatasync d2/f5b 0 2024-04-25T17:19:08.717 INFO:tasks.workunit.client.0.smithi037.stdout:5/527: dwrite d7/d12/d5d/f61 [0,4194304] 0 2024-04-25T17:19:08.721 INFO:tasks.workunit.client.1.smithi069.stdout:8/200: mknod d37/c46 0 2024-04-25T17:19:08.723 INFO:tasks.workunit.client.1.smithi069.stdout:4/231: dread db/f21 [0,4194304] 0 2024-04-25T17:19:08.724 INFO:tasks.workunit.client.1.smithi069.stdout:7/257: dwrite d4/d6/d14/d15/f28 [0,4194304] 0 2024-04-25T17:19:08.726 INFO:tasks.workunit.client.1.smithi069.stdout:7/258: chown d4/d6/d14/d15/f17 5343433 1 2024-04-25T17:19:08.731 INFO:tasks.workunit.client.1.smithi069.stdout:8/201: dwrite f27 [0,4194304] 0 2024-04-25T17:19:08.733 INFO:tasks.workunit.client.1.smithi069.stdout:4/232: dread db/d22/d24/f31 [0,4194304] 0 2024-04-25T17:19:08.733 INFO:tasks.workunit.client.1.smithi069.stdout:9/283: mkdir d2/da/dd/d1e/d2e/d68 0 2024-04-25T17:19:08.734 INFO:tasks.workunit.client.1.smithi069.stdout:6/219: truncate d2/d7/fc 8801809 0 2024-04-25T17:19:08.734 INFO:tasks.workunit.client.1.smithi069.stdout:4/233: read f0 [3157601,24264] 0 2024-04-25T17:19:08.740 INFO:tasks.workunit.client.1.smithi069.stdout:5/243: mknod d13/d17/d19/c4f 0 2024-04-25T17:19:08.747 INFO:tasks.workunit.client.1.smithi069.stdout:7/259: getdents d4/d6/d14/d5a 0 2024-04-25T17:19:08.749 INFO:tasks.workunit.client.1.smithi069.stdout:5/244: rmdir d13/d17/d19/d1c 39 2024-04-25T17:19:08.753 INFO:tasks.workunit.client.1.smithi069.stdout:9/284: symlink d2/da/dd/l69 0 2024-04-25T17:19:08.754 INFO:tasks.workunit.client.1.smithi069.stdout:6/220: mkdir d2/d2e/d35/d48 0 2024-04-25T17:19:08.755 INFO:tasks.workunit.client.0.smithi037.stdout:7/473: sync 2024-04-25T17:19:08.755 INFO:tasks.workunit.client.0.smithi037.stdout:3/275: sync 2024-04-25T17:19:08.755 INFO:tasks.workunit.client.0.smithi037.stdout:1/437: sync 2024-04-25T17:19:08.755 INFO:tasks.workunit.client.0.smithi037.stdout:8/345: sync 2024-04-25T17:19:08.755 INFO:tasks.workunit.client.0.smithi037.stdout:2/428: sync 2024-04-25T17:19:08.755 INFO:tasks.workunit.client.1.smithi069.stdout:6/221: write d2/d2e/f45 [814184,34505] 0 2024-04-25T17:19:08.757 INFO:tasks.workunit.client.0.smithi037.stdout:2/429: read - d0/d16/d20/d59/d6a/f82 zero size 2024-04-25T17:19:08.757 INFO:tasks.workunit.client.1.smithi069.stdout:6/222: read d2/d7/fc [6502367,127032] 0 2024-04-25T17:19:08.759 INFO:tasks.workunit.client.1.smithi069.stdout:7/260: mkdir d4/d6/d14/d3d/d5b 0 2024-04-25T17:19:08.762 INFO:tasks.workunit.client.1.smithi069.stdout:5/245: unlink d13/d17/d19/d20/d2d/f4c 0 2024-04-25T17:19:08.763 INFO:tasks.workunit.client.0.smithi037.stdout:4/633: truncate d7/d7e/d45/fa0 2861585 0 2024-04-25T17:19:08.763 INFO:tasks.workunit.client.1.smithi069.stdout:2/212: sync 2024-04-25T17:19:08.764 INFO:tasks.workunit.client.1.smithi069.stdout:1/232: sync 2024-04-25T17:19:08.764 INFO:tasks.workunit.client.1.smithi069.stdout:0/199: sync 2024-04-25T17:19:08.765 INFO:tasks.workunit.client.1.smithi069.stdout:3/323: getdents d8 0 2024-04-25T17:19:08.765 INFO:tasks.workunit.client.1.smithi069.stdout:0/200: write d0/d17/f46 [454144,35636] 0 2024-04-25T17:19:08.771 INFO:tasks.workunit.client.1.smithi069.stdout:6/223: dread d2/fe [0,4194304] 0 2024-04-25T17:19:08.772 INFO:tasks.workunit.client.1.smithi069.stdout:6/224: stat d2/d1e/l26 0 2024-04-25T17:19:08.775 INFO:tasks.workunit.client.1.smithi069.stdout:7/261: rename d4/d6/d14/d15/d3c/d23/f4b to d4/d1a/f5c 0 2024-04-25T17:19:08.780 INFO:tasks.workunit.client.1.smithi069.stdout:7/262: dwrite d4/d6/f2c [0,4194304] 0 2024-04-25T17:19:08.781 INFO:tasks.workunit.client.1.smithi069.stdout:8/202: write f26 [140244,32096] 0 2024-04-25T17:19:08.782 INFO:tasks.workunit.client.1.smithi069.stdout:8/203: read fb [818606,85411] 0 2024-04-25T17:19:08.782 INFO:tasks.workunit.client.1.smithi069.stdout:8/204: fsync f34 0 2024-04-25T17:19:08.786 INFO:tasks.workunit.client.0.smithi037.stdout:5/528: rename d7/d12/c7b to d7/d18/ca3 0 2024-04-25T17:19:08.790 INFO:tasks.workunit.client.0.smithi037.stdout:5/529: chown d7/d12/f21 1128880 1 2024-04-25T17:19:08.790 INFO:tasks.workunit.client.1.smithi069.stdout:4/234: truncate f0 7279540 0 2024-04-25T17:19:08.790 INFO:tasks.workunit.client.1.smithi069.stdout:4/235: readlink db/d15/d26/l3a 0 2024-04-25T17:19:08.790 INFO:tasks.workunit.client.1.smithi069.stdout:6/225: readlink d2/d7/l40 0 2024-04-25T17:19:08.790 INFO:tasks.workunit.client.1.smithi069.stdout:6/226: write d2/d7/f12 [2937162,46532] 0 2024-04-25T17:19:08.791 INFO:tasks.workunit.client.0.smithi037.stdout:3/276: creat d8/d23/d38/f5a x:0 0 0 2024-04-25T17:19:08.796 INFO:tasks.workunit.client.0.smithi037.stdout:2/430: truncate d0/d16/d26/f2c 3816803 0 2024-04-25T17:19:08.799 INFO:tasks.workunit.client.1.smithi069.stdout:7/263: mkdir d4/d6/d14/d3d/d5d 0 2024-04-25T17:19:08.801 INFO:tasks.workunit.client.0.smithi037.stdout:0/480: sync 2024-04-25T17:19:08.801 INFO:tasks.workunit.client.0.smithi037.stdout:6/439: sync 2024-04-25T17:19:08.802 INFO:tasks.workunit.client.0.smithi037.stdout:2/431: dread d0/d16/d3c/f42 [0,4194304] 0 2024-04-25T17:19:08.806 INFO:tasks.workunit.client.0.smithi037.stdout:4/634: dwrite d7/d7e/d4e/f98 [0,4194304] 0 2024-04-25T17:19:08.807 INFO:tasks.workunit.client.1.smithi069.stdout:3/324: truncate d8/f19 2059163 0 2024-04-25T17:19:08.808 INFO:tasks.workunit.client.1.smithi069.stdout:3/325: dread - d8/d16/d4b/f62 zero size 2024-04-25T17:19:08.809 INFO:tasks.workunit.client.1.smithi069.stdout:3/326: truncate d8/d16/d1a/d2c/f63 536039 0 2024-04-25T17:19:08.809 INFO:tasks.workunit.client.0.smithi037.stdout:3/277: rename d8/d31/l3f to d8/d11/l5b 0 2024-04-25T17:19:08.812 INFO:tasks.workunit.client.1.smithi069.stdout:8/205: stat c1e 0 2024-04-25T17:19:08.814 INFO:tasks.workunit.client.0.smithi037.stdout:1/438: symlink dc/d1c/d57/d4d/d6a/d86/d9b/l9c 0 2024-04-25T17:19:08.818 INFO:tasks.workunit.client.1.smithi069.stdout:4/236: creat db/d15/d20/d38/d3c/d43/d48/d49/f56 x:0 0 0 2024-04-25T17:19:08.822 INFO:tasks.workunit.client.1.smithi069.stdout:5/246: creat d13/d17/d19/f50 x:0 0 0 2024-04-25T17:19:08.823 INFO:tasks.workunit.client.1.smithi069.stdout:5/247: chown d13/d17/f1d 102984 1 2024-04-25T17:19:08.823 INFO:tasks.workunit.client.1.smithi069.stdout:5/248: fsync d13/d17/d19/d20/f24 0 2024-04-25T17:19:08.824 INFO:tasks.workunit.client.1.smithi069.stdout:9/285: sync 2024-04-25T17:19:08.824 INFO:tasks.workunit.client.1.smithi069.stdout:2/213: link d0/d1/d1d/d28/l40 d0/d26/l45 0 2024-04-25T17:19:08.826 INFO:tasks.workunit.client.1.smithi069.stdout:9/286: truncate d2/da/dd/d1e/d40/f5c 413064 0 2024-04-25T17:19:08.827 INFO:tasks.workunit.client.1.smithi069.stdout:2/214: dread d0/d26/f42 [0,4194304] 0 2024-04-25T17:19:08.828 INFO:tasks.workunit.client.1.smithi069.stdout:2/215: readlink d0/d1/l2a 0 2024-04-25T17:19:08.828 INFO:tasks.workunit.client.0.smithi037.stdout:4/635: truncate d7/d7e/d1e/d2b/f5f 1775022 0 2024-04-25T17:19:08.830 INFO:tasks.workunit.client.1.smithi069.stdout:1/233: link d1/d4/de/d11/d35/f37 d1/df/f42 0 2024-04-25T17:19:08.834 INFO:tasks.workunit.client.1.smithi069.stdout:8/206: dread fe [0,4194304] 0 2024-04-25T17:19:08.835 INFO:tasks.workunit.client.1.smithi069.stdout:8/207: chown c17 89 1 2024-04-25T17:19:08.836 INFO:tasks.workunit.client.0.smithi037.stdout:1/439: creat dc/d1c/d57/d4d/d6a/f9d x:0 0 0 2024-04-25T17:19:08.838 INFO:tasks.workunit.client.1.smithi069.stdout:3/327: fdatasync d8/f12 0 2024-04-25T17:19:08.838 INFO:tasks.workunit.client.1.smithi069.stdout:3/328: chown d8/d39/f5e 684 1 2024-04-25T17:19:08.839 INFO:tasks.workunit.client.1.smithi069.stdout:5/249: dread d13/f16 [0,4194304] 0 2024-04-25T17:19:08.840 INFO:tasks.workunit.client.1.smithi069.stdout:5/250: readlink d13/d17/d19/d20/l49 0 2024-04-25T17:19:08.840 INFO:tasks.workunit.client.1.smithi069.stdout:4/237: rmdir db/d22/d24/d41 39 2024-04-25T17:19:08.842 INFO:tasks.workunit.client.0.smithi037.stdout:5/530: creat d7/d18/fa4 x:0 0 0 2024-04-25T17:19:08.844 INFO:tasks.workunit.client.0.smithi037.stdout:7/474: dwrite d5/d15/d17/d1b/f68 [0,4194304] 0 2024-04-25T17:19:08.845 INFO:tasks.workunit.client.1.smithi069.stdout:6/227: creat d2/d1e/d3f/f49 x:0 0 0 2024-04-25T17:19:08.845 INFO:tasks.workunit.client.0.smithi037.stdout:7/475: dread - d5/d14/f97 zero size 2024-04-25T17:19:08.848 INFO:tasks.workunit.client.1.smithi069.stdout:1/234: dread d1/d4/d6/f7 [0,4194304] 0 2024-04-25T17:19:08.851 INFO:tasks.workunit.client.0.smithi037.stdout:3/278: rmdir d8/d31 39 2024-04-25T17:19:08.852 INFO:tasks.workunit.client.0.smithi037.stdout:8/346: getdents d5/db/d59 0 2024-04-25T17:19:08.854 INFO:tasks.workunit.client.1.smithi069.stdout:9/287: creat d2/da/dd/d1e/f6a x:0 0 0 2024-04-25T17:19:08.856 INFO:tasks.workunit.client.1.smithi069.stdout:0/201: getdents d0 0 2024-04-25T17:19:08.857 INFO:tasks.workunit.client.1.smithi069.stdout:2/216: rmdir d0/d1/d1d/d33 39 2024-04-25T17:19:08.858 INFO:tasks.workunit.client.0.smithi037.stdout:9/562: sync 2024-04-25T17:19:08.859 INFO:tasks.workunit.client.0.smithi037.stdout:1/440: unlink dc/l76 0 2024-04-25T17:19:08.862 INFO:tasks.workunit.client.1.smithi069.stdout:7/264: mkdir d4/d6/d14/d5a/d5e 0 2024-04-25T17:19:08.864 INFO:tasks.workunit.client.1.smithi069.stdout:7/265: write d4/d6/f2c [4355455,43062] 0 2024-04-25T17:19:08.865 INFO:tasks.workunit.client.0.smithi037.stdout:0/481: dwrite d9/d14/d23/f29 [0,4194304] 0 2024-04-25T17:19:08.866 INFO:tasks.workunit.client.0.smithi037.stdout:0/482: readlink d9/df/d32/d39/l80 0 2024-04-25T17:19:08.867 INFO:tasks.workunit.client.1.smithi069.stdout:8/208: mkdir d37/d47 0 2024-04-25T17:19:08.867 INFO:tasks.workunit.client.1.smithi069.stdout:8/209: chown d37/l40 54521 1 2024-04-25T17:19:08.869 INFO:tasks.workunit.client.1.smithi069.stdout:3/329: fdatasync d8/d16/f28 0 2024-04-25T17:19:08.869 INFO:tasks.workunit.client.1.smithi069.stdout:3/330: fdatasync d8/d2a/f53 0 2024-04-25T17:19:08.871 INFO:tasks.workunit.client.1.smithi069.stdout:4/238: unlink db/d15/f30 0 2024-04-25T17:19:08.872 INFO:tasks.workunit.client.1.smithi069.stdout:4/239: chown db/d15/d20/d38 653897 1 2024-04-25T17:19:08.873 INFO:tasks.workunit.client.1.smithi069.stdout:4/240: read db/f2f [198409,65763] 0 2024-04-25T17:19:08.874 INFO:tasks.workunit.client.0.smithi037.stdout:8/347: symlink d5/db/d23/d42/l67 0 2024-04-25T17:19:08.875 INFO:tasks.workunit.client.0.smithi037.stdout:8/348: chown d5/db/d18 159 1 2024-04-25T17:19:08.876 INFO:tasks.workunit.client.0.smithi037.stdout:8/349: write d5/db/d23/f38 [5222386,126064] 0 2024-04-25T17:19:08.877 INFO:tasks.workunit.client.0.smithi037.stdout:4/636: unlink d7/c4a 0 2024-04-25T17:19:08.881 INFO:tasks.workunit.client.0.smithi037.stdout:6/440: rename c4 to db/d26/d2e/d3e/d25/c9a 0 2024-04-25T17:19:08.882 INFO:tasks.workunit.client.0.smithi037.stdout:8/350: dwrite d5/db/d18/f62 [0,4194304] 0 2024-04-25T17:19:08.882 INFO:tasks.workunit.client.0.smithi037.stdout:2/432: truncate d0/d16/d3c/f42 215551 0 2024-04-25T17:19:08.884 INFO:tasks.workunit.client.0.smithi037.stdout:8/351: dread - d5/db/d23/d42/f63 zero size 2024-04-25T17:19:08.884 INFO:tasks.workunit.client.0.smithi037.stdout:9/563: dread - d1/d48/d68/d26/f57 zero size 2024-04-25T17:19:08.885 INFO:tasks.workunit.client.0.smithi037.stdout:8/352: stat d5/db/d18/d3b/d50/d51/f57 0 2024-04-25T17:19:08.887 INFO:tasks.workunit.client.0.smithi037.stdout:1/441: creat dc/d18/d64/f9e x:0 0 0 2024-04-25T17:19:08.889 INFO:tasks.workunit.client.1.smithi069.stdout:0/202: symlink d0/da/db/d2a/l47 0 2024-04-25T17:19:08.890 INFO:tasks.workunit.client.1.smithi069.stdout:0/203: dread - d0/da/db/d2a/f3f zero size 2024-04-25T17:19:08.890 INFO:tasks.workunit.client.1.smithi069.stdout:2/217: mknod d0/d26/d10/c46 0 2024-04-25T17:19:08.898 INFO:tasks.workunit.client.0.smithi037.stdout:7/476: dwrite d5/d15/d17/d25/d2b/d59/f63 [0,4194304] 0 2024-04-25T17:19:08.905 INFO:tasks.workunit.client.0.smithi037.stdout:3/279: dwrite d8/d11/f20 [0,4194304] 0 2024-04-25T17:19:08.915 INFO:tasks.workunit.client.0.smithi037.stdout:5/531: write d7/f75 [298203,100091] 0 2024-04-25T17:19:08.915 INFO:tasks.workunit.client.0.smithi037.stdout:2/433: dread d0/d23/d7d/f62 [0,4194304] 0 2024-04-25T17:19:08.918 INFO:tasks.workunit.client.0.smithi037.stdout:6/441: symlink db/d26/d2e/d7d/d65/d68/l9b 0 2024-04-25T17:19:08.920 INFO:tasks.workunit.client.0.smithi037.stdout:9/564: mknod d1/d5/dc/da9/cc2 0 2024-04-25T17:19:08.922 INFO:tasks.workunit.client.0.smithi037.stdout:1/442: mknod dc/d1c/d57/d22/d36/c9f 0 2024-04-25T17:19:08.923 INFO:tasks.workunit.client.1.smithi069.stdout:6/228: mknod d2/c4a 0 2024-04-25T17:19:08.923 INFO:tasks.workunit.client.1.smithi069.stdout:8/210: chown f8 20 1 2024-04-25T17:19:08.923 INFO:tasks.workunit.client.1.smithi069.stdout:9/288: symlink d2/da/d14/d23/d65/l6b 0 2024-04-25T17:19:08.923 INFO:tasks.workunit.client.0.smithi037.stdout:1/443: chown fb 121847065 1 2024-04-25T17:19:08.924 INFO:tasks.workunit.client.1.smithi069.stdout:6/229: truncate d2/f2a 628063 0 2024-04-25T17:19:08.925 INFO:tasks.workunit.client.0.smithi037.stdout:0/483: mknod d9/df/d32/d39/d68/ca2 0 2024-04-25T17:19:08.925 INFO:tasks.workunit.client.0.smithi037.stdout:1/444: write f8 [2924338,122399] 0 2024-04-25T17:19:08.929 INFO:tasks.workunit.client.1.smithi069.stdout:2/218: rmdir d0/d26 39 2024-04-25T17:19:08.929 INFO:tasks.workunit.client.0.smithi037.stdout:9/565: dwrite d1/d5/d2e/f52 [0,4194304] 0 2024-04-25T17:19:08.929 INFO:tasks.workunit.client.1.smithi069.stdout:9/289: dwrite d2/da/dd/d1e/d2e/f34 [0,4194304] 0 2024-04-25T17:19:08.937 INFO:tasks.workunit.client.1.smithi069.stdout:1/235: rename d1/d4/de/d11 to d1/d43 0 2024-04-25T17:19:08.939 INFO:tasks.workunit.client.1.smithi069.stdout:0/204: mknod d0/d17/d40/c48 0 2024-04-25T17:19:08.940 INFO:tasks.workunit.client.1.smithi069.stdout:1/236: read d1/f5 [3561213,49816] 0 2024-04-25T17:19:08.941 INFO:tasks.workunit.client.0.smithi037.stdout:2/434: truncate d0/d15/f32 3229631 0 2024-04-25T17:19:08.942 INFO:tasks.workunit.client.1.smithi069.stdout:6/230: write d2/d1e/f33 [1139179,25683] 0 2024-04-25T17:19:08.945 INFO:tasks.workunit.client.1.smithi069.stdout:4/241: fsync db/f12 0 2024-04-25T17:19:08.947 INFO:tasks.workunit.client.1.smithi069.stdout:4/242: fdatasync db/d15/d26/f40 0 2024-04-25T17:19:08.948 INFO:tasks.workunit.client.1.smithi069.stdout:1/237: dwrite d1/f28 [0,4194304] 0 2024-04-25T17:19:08.949 INFO:tasks.workunit.client.1.smithi069.stdout:2/219: fdatasync d0/d26/f2f 0 2024-04-25T17:19:08.951 INFO:tasks.workunit.client.1.smithi069.stdout:9/290: write d2/da/dd/f2d [1135495,73526] 0 2024-04-25T17:19:08.952 INFO:tasks.workunit.client.0.smithi037.stdout:1/445: creat dc/d18/d64/fa0 x:0 0 0 2024-04-25T17:19:08.955 INFO:tasks.workunit.client.0.smithi037.stdout:1/446: readlink dc/d18/d64/l96 0 2024-04-25T17:19:08.956 INFO:tasks.workunit.client.0.smithi037.stdout:9/566: dread d1/d48/d68/d26/f80 [0,4194304] 0 2024-04-25T17:19:08.958 INFO:tasks.workunit.client.1.smithi069.stdout:8/211: mkdir d37/d47/d48 0 2024-04-25T17:19:08.959 INFO:tasks.workunit.client.1.smithi069.stdout:9/291: dwrite d2/da/dd/de/f4a [0,4194304] 0 2024-04-25T17:19:08.964 INFO:tasks.workunit.client.0.smithi037.stdout:4/637: write d7/d7e/d5b/f8c [2640122,62243] 0 2024-04-25T17:19:08.965 INFO:tasks.workunit.client.0.smithi037.stdout:4/638: fdatasync d7/d7e/d45/d4f/f55 0 2024-04-25T17:19:08.968 INFO:tasks.workunit.client.1.smithi069.stdout:3/331: getdents d8/d16/d1a/d3e 0 2024-04-25T17:19:08.972 INFO:tasks.workunit.client.1.smithi069.stdout:5/251: sync 2024-04-25T17:19:08.974 INFO:tasks.workunit.client.0.smithi037.stdout:8/353: creat d5/db/f68 x:0 0 0 2024-04-25T17:19:08.974 INFO:tasks.workunit.client.1.smithi069.stdout:1/238: write d1/df/f30 [739372,35287] 0 2024-04-25T17:19:08.976 INFO:tasks.workunit.client.0.smithi037.stdout:1/447: mknod dc/d18/d39/ca1 0 2024-04-25T17:19:08.977 INFO:tasks.workunit.client.1.smithi069.stdout:5/252: dwrite f6 [0,4194304] 0 2024-04-25T17:19:08.978 INFO:tasks.workunit.client.0.smithi037.stdout:8/354: dread d5/d26/d33/f34 [0,4194304] 0 2024-04-25T17:19:08.983 INFO:tasks.workunit.client.1.smithi069.stdout:9/292: dread - d2/da/dd/f31 zero size 2024-04-25T17:19:08.987 INFO:tasks.workunit.client.0.smithi037.stdout:3/280: creat d8/f5c x:0 0 0 2024-04-25T17:19:08.989 INFO:tasks.workunit.client.0.smithi037.stdout:0/484: dwrite d9/d14/d28/d48/d58/f5e [0,4194304] 0 2024-04-25T17:19:08.990 INFO:tasks.workunit.client.1.smithi069.stdout:0/205: creat d0/d38/f49 x:0 0 0 2024-04-25T17:19:08.992 INFO:tasks.workunit.client.1.smithi069.stdout:7/266: sync 2024-04-25T17:19:08.999 INFO:tasks.workunit.client.1.smithi069.stdout:4/243: fdatasync db/d22/d24/d41/f4f 0 2024-04-25T17:19:09.000 INFO:tasks.workunit.client.0.smithi037.stdout:1/448: creat dc/d1c/d57/d22/d36/d8c/fa2 x:0 0 0 2024-04-25T17:19:09.000 INFO:tasks.workunit.client.1.smithi069.stdout:6/231: dwrite d2/f2f [0,4194304] 0 2024-04-25T17:19:09.001 INFO:tasks.workunit.client.1.smithi069.stdout:2/220: mkdir d0/d26/d10/d43/d47 0 2024-04-25T17:19:09.001 INFO:tasks.workunit.client.0.smithi037.stdout:1/449: truncate dc/d1c/f69 756300 0 2024-04-25T17:19:09.003 INFO:tasks.workunit.client.0.smithi037.stdout:1/450: chown dc/d1c/d57/d4d/l80 115885 1 2024-04-25T17:19:09.006 INFO:tasks.workunit.client.0.smithi037.stdout:7/477: rename d5/d14/d31/f75 to d5/d15/d17/d1b/da2/fa6 0 2024-04-25T17:19:09.007 INFO:tasks.workunit.client.1.smithi069.stdout:9/293: creat d2/da/dd/d1e/d2e/d35/f6c x:0 0 0 2024-04-25T17:19:09.008 INFO:tasks.workunit.client.1.smithi069.stdout:1/239: dwrite d1/f9 [4194304,4194304] 0 2024-04-25T17:19:09.009 INFO:tasks.workunit.client.0.smithi037.stdout:8/355: truncate d5/d26/d33/f34 166557 0 2024-04-25T17:19:09.010 INFO:tasks.workunit.client.1.smithi069.stdout:5/253: dread d13/d17/d19/f28 [0,4194304] 0 2024-04-25T17:19:09.010 INFO:tasks.workunit.client.0.smithi037.stdout:8/356: readlink d5/d26/l39 0 2024-04-25T17:19:09.010 INFO:tasks.workunit.client.1.smithi069.stdout:5/254: chown d13/f16 101791497 1 2024-04-25T17:19:09.013 INFO:tasks.workunit.client.1.smithi069.stdout:8/212: link fe d37/d47/d48/f49 0 2024-04-25T17:19:09.014 INFO:tasks.workunit.client.0.smithi037.stdout:1/451: dwrite dc/d18/d64/f9e [0,4194304] 0 2024-04-25T17:19:09.015 INFO:tasks.workunit.client.1.smithi069.stdout:8/213: read f27 [1125075,25714] 0 2024-04-25T17:19:09.017 INFO:tasks.workunit.client.1.smithi069.stdout:1/240: dwrite d1/d43/d1b/f2c [0,4194304] 0 2024-04-25T17:19:09.019 INFO:tasks.workunit.client.1.smithi069.stdout:7/267: rename d4/d1a/d34/l54 to d4/d6/d14/d5a/l5f 0 2024-04-25T17:19:09.021 INFO:tasks.workunit.client.0.smithi037.stdout:3/281: dread d8/d11/f2b [0,4194304] 0 2024-04-25T17:19:09.021 INFO:tasks.workunit.client.1.smithi069.stdout:7/268: readlink d4/d18/l1d 0 2024-04-25T17:19:09.026 INFO:tasks.workunit.client.1.smithi069.stdout:3/332: dwrite d8/d16/f21 [0,4194304] 0 2024-04-25T17:19:09.026 INFO:tasks.workunit.client.0.smithi037.stdout:9/567: dwrite d1/d48/d68/d26/d81/f86 [0,4194304] 0 2024-04-25T17:19:09.027 INFO:tasks.workunit.client.0.smithi037.stdout:7/478: dwrite d5/d15/f1e [0,4194304] 0 2024-04-25T17:19:09.027 INFO:tasks.workunit.client.0.smithi037.stdout:4/639: fsync d7/d7e/d5b/f6a 0 2024-04-25T17:19:09.032 INFO:tasks.workunit.client.0.smithi037.stdout:2/435: fsync d0/d15/f32 0 2024-04-25T17:19:09.036 INFO:tasks.workunit.client.0.smithi037.stdout:6/442: getdents db/d26/d2e 0 2024-04-25T17:19:09.036 INFO:tasks.workunit.client.0.smithi037.stdout:6/443: fsync db/d1d/d20/f3a 0 2024-04-25T17:19:09.042 INFO:tasks.workunit.client.0.smithi037.stdout:5/532: rename f6 to d7/da1/fa5 0 2024-04-25T17:19:09.044 INFO:tasks.workunit.client.0.smithi037.stdout:8/357: creat d5/db/d18/d3b/d50/d51/f69 x:0 0 0 2024-04-25T17:19:09.045 INFO:tasks.workunit.client.1.smithi069.stdout:8/214: symlink d37/l4a 0 2024-04-25T17:19:09.045 INFO:tasks.workunit.client.1.smithi069.stdout:0/206: getdents d0/da/d24/d43 0 2024-04-25T17:19:09.045 INFO:tasks.workunit.client.0.smithi037.stdout:0/485: dread d9/d72/fa0 [0,4194304] 0 2024-04-25T17:19:09.046 INFO:tasks.workunit.client.0.smithi037.stdout:1/452: creat dc/d1c/d57/d22/fa3 x:0 0 0 2024-04-25T17:19:09.047 INFO:tasks.workunit.client.0.smithi037.stdout:0/486: write d9/d14/d23/f3c [1748241,61911] 0 2024-04-25T17:19:09.048 INFO:tasks.workunit.client.1.smithi069.stdout:6/232: rename d2/d1e/f3c to d2/d2e/d35/f4b 0 2024-04-25T17:19:09.050 INFO:tasks.workunit.client.1.smithi069.stdout:7/269: rmdir d4/d6/d14/d15 39 2024-04-25T17:19:09.050 INFO:tasks.workunit.client.1.smithi069.stdout:8/215: read f12 [1542654,123342] 0 2024-04-25T17:19:09.054 INFO:tasks.workunit.client.0.smithi037.stdout:4/640: write d7/d7e/d1e/d2b/d35/f36 [9332233,5507] 0 2024-04-25T17:19:09.055 INFO:tasks.workunit.client.0.smithi037.stdout:7/479: creat d5/d14/d31/d58/fa7 x:0 0 0 2024-04-25T17:19:09.057 INFO:tasks.workunit.client.1.smithi069.stdout:9/294: creat d2/da/d5f/f6d x:0 0 0 2024-04-25T17:19:09.058 INFO:tasks.workunit.client.1.smithi069.stdout:5/255: mkdir d13/d17/d19/d20/d51 0 2024-04-25T17:19:09.059 INFO:tasks.workunit.client.1.smithi069.stdout:1/241: fsync d1/d43/d1b/f2c 0 2024-04-25T17:19:09.060 INFO:tasks.workunit.client.1.smithi069.stdout:1/242: chown d1/d43/d1b/f2c 462 1 2024-04-25T17:19:09.060 INFO:tasks.workunit.client.0.smithi037.stdout:6/444: dread db/f17 [0,4194304] 0 2024-04-25T17:19:09.061 INFO:tasks.workunit.client.1.smithi069.stdout:1/243: fdatasync d1/d43/f3a 0 2024-04-25T17:19:09.062 INFO:tasks.workunit.client.0.smithi037.stdout:3/282: rename d8/d11 to d8/d23/d3a/d5d 0 2024-04-25T17:19:09.063 INFO:tasks.workunit.client.1.smithi069.stdout:0/207: creat d0/d17/f4a x:0 0 0 2024-04-25T17:19:09.063 INFO:tasks.workunit.client.1.smithi069.stdout:0/208: fdatasync d0/d36/f2b 0 2024-04-25T17:19:09.065 INFO:tasks.workunit.client.1.smithi069.stdout:1/244: dread d1/df/f30 [0,4194304] 0 2024-04-25T17:19:09.066 INFO:tasks.workunit.client.1.smithi069.stdout:7/270: write d4/d1a/f5c [316167,75442] 0 2024-04-25T17:19:09.066 INFO:tasks.workunit.client.1.smithi069.stdout:3/333: unlink d8/d16/d1a/d2c/f2f 0 2024-04-25T17:19:09.067 INFO:tasks.workunit.client.0.smithi037.stdout:1/453: unlink fb 0 2024-04-25T17:19:09.068 INFO:tasks.workunit.client.1.smithi069.stdout:3/334: write d8/d16/d1a/d2c/d49/f68 [782111,95872] 0 2024-04-25T17:19:09.068 INFO:tasks.workunit.client.0.smithi037.stdout:1/454: chown dc/d1c/d57/c46 266102796 1 2024-04-25T17:19:09.069 INFO:tasks.workunit.client.1.smithi069.stdout:5/256: mknod d13/d17/d19/d20/d2d/c52 0 2024-04-25T17:19:09.069 INFO:tasks.workunit.client.1.smithi069.stdout:5/257: chown d13/d17/d29/d30/l3b 70 1 2024-04-25T17:19:09.070 INFO:tasks.workunit.client.1.smithi069.stdout:4/244: write f0 [7380182,37769] 0 2024-04-25T17:19:09.070 INFO:tasks.workunit.client.1.smithi069.stdout:5/258: readlink d13/l4e 0 2024-04-25T17:19:09.071 INFO:tasks.workunit.client.0.smithi037.stdout:4/641: mkdir d7/d7e/d1e/d2b/d35/d39/d7a/dcc 0 2024-04-25T17:19:09.071 INFO:tasks.workunit.client.1.smithi069.stdout:5/259: fsync fd 0 2024-04-25T17:19:09.073 INFO:tasks.workunit.client.1.smithi069.stdout:0/209: symlink d0/l4b 0 2024-04-25T17:19:09.073 INFO:tasks.workunit.client.0.smithi037.stdout:2/436: mknod d0/d16/c89 0 2024-04-25T17:19:09.075 INFO:tasks.workunit.client.1.smithi069.stdout:6/233: truncate d2/d7/fd 3669911 0 2024-04-25T17:19:09.076 INFO:tasks.workunit.client.0.smithi037.stdout:1/455: dread dc/f62 [0,4194304] 0 2024-04-25T17:19:09.078 INFO:tasks.workunit.client.1.smithi069.stdout:8/216: rename c16 to d37/c4b 0 2024-04-25T17:19:09.079 INFO:tasks.workunit.client.0.smithi037.stdout:6/445: creat db/d26/d2e/d7d/d65/f9c x:0 0 0 2024-04-25T17:19:09.080 INFO:tasks.workunit.client.1.smithi069.stdout:6/234: dwrite d2/d7/f30 [0,4194304] 0 2024-04-25T17:19:09.084 INFO:tasks.workunit.client.1.smithi069.stdout:3/335: unlink d8/f1d 0 2024-04-25T17:19:09.085 INFO:tasks.workunit.client.1.smithi069.stdout:3/336: fdatasync d8/d16/d1a/d2c/f5f 0 2024-04-25T17:19:09.088 INFO:tasks.workunit.client.1.smithi069.stdout:4/245: unlink db/d15/d26/f40 0 2024-04-25T17:19:09.089 INFO:tasks.workunit.client.0.smithi037.stdout:9/568: write d1/d48/d68/d26/d81/d9c/f66 [199034,1855] 0 2024-04-25T17:19:09.089 INFO:tasks.workunit.client.1.smithi069.stdout:4/246: write db/d15/d26/f28 [3897633,28051] 0 2024-04-25T17:19:09.091 INFO:tasks.workunit.client.1.smithi069.stdout:4/247: chown db/d15/d26/f34 35 1 2024-04-25T17:19:09.092 INFO:tasks.workunit.client.1.smithi069.stdout:0/210: unlink d0/d17/f30 0 2024-04-25T17:19:09.093 INFO:tasks.workunit.client.1.smithi069.stdout:0/211: write d0/da/f35 [1020872,123155] 0 2024-04-25T17:19:09.093 INFO:tasks.workunit.client.0.smithi037.stdout:4/642: unlink d7/d7e/d45/f95 0 2024-04-25T17:19:09.097 INFO:tasks.workunit.client.0.smithi037.stdout:2/437: symlink d0/d16/d20/d59/d6a/l8a 0 2024-04-25T17:19:09.097 INFO:tasks.workunit.client.0.smithi037.stdout:9/569: dwrite d1/d5/d19/d6e/f8f [0,4194304] 0 2024-04-25T17:19:09.100 INFO:tasks.workunit.client.1.smithi069.stdout:8/217: unlink f27 0 2024-04-25T17:19:09.102 INFO:tasks.workunit.client.0.smithi037.stdout:7/480: mkdir d5/d15/d17/d1b/d94/da8 0 2024-04-25T17:19:09.102 INFO:tasks.workunit.client.0.smithi037.stdout:0/487: dread d9/d14/d23/f1e [0,4194304] 0 2024-04-25T17:19:09.103 INFO:tasks.workunit.client.1.smithi069.stdout:1/245: mkdir d1/d4/de/d44 0 2024-04-25T17:19:09.104 INFO:tasks.workunit.client.1.smithi069.stdout:1/246: chown d1/d43/d35/c26 7149 1 2024-04-25T17:19:09.104 INFO:tasks.workunit.client.0.smithi037.stdout:1/456: rename dc/d1c/d57/d4d/l80 to dc/d52/d6b/la4 0 2024-04-25T17:19:09.105 INFO:tasks.workunit.client.1.smithi069.stdout:1/247: dread - d1/f2e zero size 2024-04-25T17:19:09.105 INFO:tasks.workunit.client.1.smithi069.stdout:7/271: creat d4/d6/d14/d5a/d5e/f60 x:0 0 0 2024-04-25T17:19:09.108 INFO:tasks.workunit.client.0.smithi037.stdout:6/446: creat db/d26/d2e/d3e/f9d x:0 0 0 2024-04-25T17:19:09.110 INFO:tasks.workunit.client.0.smithi037.stdout:3/283: creat d8/d57/f5e x:0 0 0 2024-04-25T17:19:09.113 INFO:tasks.workunit.client.0.smithi037.stdout:8/358: rename d5/d13 to d5/d6a 0 2024-04-25T17:19:09.114 INFO:tasks.workunit.client.0.smithi037.stdout:8/359: chown d5/db/d23/d42/f4f 24 1 2024-04-25T17:19:09.121 INFO:tasks.workunit.client.0.smithi037.stdout:5/533: truncate d7/f1c 2752564 0 2024-04-25T17:19:09.121 INFO:tasks.workunit.client.1.smithi069.stdout:2/221: sync 2024-04-25T17:19:09.121 INFO:tasks.workunit.client.0.smithi037.stdout:5/534: stat d7/ff 0 2024-04-25T17:19:09.127 INFO:tasks.workunit.client.0.smithi037.stdout:2/438: dwrite d0/d16/d3b/f85 [0,4194304] 0 2024-04-25T17:19:09.127 INFO:tasks.workunit.client.1.smithi069.stdout:5/260: rename ce to d13/d17/d19/d20/d2d/c53 0 2024-04-25T17:19:09.128 INFO:tasks.workunit.client.0.smithi037.stdout:2/439: write d0/d16/d26/d3e/f87 [977239,122579] 0 2024-04-25T17:19:09.130 INFO:tasks.workunit.client.0.smithi037.stdout:2/440: readlink d0/d16/d20/d59/d6a/l8a 0 2024-04-25T17:19:09.131 INFO:tasks.workunit.client.1.smithi069.stdout:8/218: symlink d37/l4c 0 2024-04-25T17:19:09.131 INFO:tasks.workunit.client.1.smithi069.stdout:8/219: chown d37/f45 15184348 1 2024-04-25T17:19:09.133 INFO:tasks.workunit.client.0.smithi037.stdout:1/457: mkdir dc/d24/da5 0 2024-04-25T17:19:09.136 INFO:tasks.workunit.client.0.smithi037.stdout:6/447: symlink db/d26/d2e/l9e 0 2024-04-25T17:19:09.137 INFO:tasks.workunit.client.1.smithi069.stdout:8/220: dwrite f13 [0,4194304] 0 2024-04-25T17:19:09.139 INFO:tasks.workunit.client.1.smithi069.stdout:7/272: creat d4/d6/d14/d3d/d47/f61 x:0 0 0 2024-04-25T17:19:09.143 INFO:tasks.workunit.client.1.smithi069.stdout:3/337: creat d8/d71/f75 x:0 0 0 2024-04-25T17:19:09.144 INFO:tasks.workunit.client.0.smithi037.stdout:4/643: fsync d7/d7e/d5b/f85 0 2024-04-25T17:19:09.146 INFO:tasks.workunit.client.1.smithi069.stdout:2/222: creat d0/d1/d1d/d28/d31/f48 x:0 0 0 2024-04-25T17:19:09.147 INFO:tasks.workunit.client.1.smithi069.stdout:8/221: dwrite d37/f41 [0,4194304] 0 2024-04-25T17:19:09.147 INFO:tasks.workunit.client.1.smithi069.stdout:3/338: truncate d8/d16/f28 920305 0 2024-04-25T17:19:09.148 INFO:tasks.workunit.client.0.smithi037.stdout:5/535: symlink d7/d12/d6f/d68/la6 0 2024-04-25T17:19:09.149 INFO:tasks.workunit.client.1.smithi069.stdout:2/223: dread - d0/d1/d1d/f32 zero size 2024-04-25T17:19:09.152 INFO:tasks.workunit.client.1.smithi069.stdout:7/273: dwrite d4/d6/d14/d3d/d47/f61 [0,4194304] 0 2024-04-25T17:19:09.153 INFO:tasks.workunit.client.1.smithi069.stdout:7/274: dread - d4/d6/f52 zero size 2024-04-25T17:19:09.155 INFO:tasks.workunit.client.1.smithi069.stdout:4/248: rename db/d15/c1a to db/d15/d20/d38/d3c/d43/d48/d49/d4e/c57 0 2024-04-25T17:19:09.156 INFO:tasks.workunit.client.1.smithi069.stdout:4/249: write db/d15/f37 [134246,99683] 0 2024-04-25T17:19:09.157 INFO:tasks.workunit.client.0.smithi037.stdout:7/481: symlink d5/d15/d17/d25/la9 0 2024-04-25T17:19:09.157 INFO:tasks.workunit.client.1.smithi069.stdout:4/250: fdatasync db/d15/d26/f2c 0 2024-04-25T17:19:09.158 INFO:tasks.workunit.client.1.smithi069.stdout:4/251: write f5 [30176,103379] 0 2024-04-25T17:19:09.160 INFO:tasks.workunit.client.1.smithi069.stdout:4/252: read - db/d15/d20/f46 zero size 2024-04-25T17:19:09.163 INFO:tasks.workunit.client.0.smithi037.stdout:0/488: symlink d9/df/d32/d39/la3 0 2024-04-25T17:19:09.164 INFO:tasks.workunit.client.1.smithi069.stdout:1/248: mknod d1/df/d17/c45 0 2024-04-25T17:19:09.164 INFO:tasks.workunit.client.0.smithi037.stdout:7/482: dwrite d5/d15/d17/f38 [0,4194304] 0 2024-04-25T17:19:09.166 INFO:tasks.workunit.client.0.smithi037.stdout:2/441: dread - d0/d16/d26/d3e/f65 zero size 2024-04-25T17:19:09.167 INFO:tasks.workunit.client.0.smithi037.stdout:2/442: chown d0/d16/d68 117250 1 2024-04-25T17:19:09.167 INFO:tasks.workunit.client.0.smithi037.stdout:2/443: stat d0/d16/d20/d59 0 2024-04-25T17:19:09.168 INFO:tasks.workunit.client.1.smithi069.stdout:9/295: sync 2024-04-25T17:19:09.174 INFO:tasks.workunit.client.1.smithi069.stdout:8/222: stat d37/c43 0 2024-04-25T17:19:09.175 INFO:tasks.workunit.client.0.smithi037.stdout:2/444: dwrite d0/d16/d3b/f47 [0,4194304] 0 2024-04-25T17:19:09.177 INFO:tasks.workunit.client.0.smithi037.stdout:8/360: mknod d5/db/d23/d58/c6b 0 2024-04-25T17:19:09.178 INFO:tasks.workunit.client.0.smithi037.stdout:3/284: dwrite d8/d23/f41 [0,4194304] 0 2024-04-25T17:19:09.180 INFO:tasks.workunit.client.1.smithi069.stdout:8/223: dwrite d37/f3f [0,4194304] 0 2024-04-25T17:19:09.180 INFO:tasks.workunit.client.1.smithi069.stdout:0/212: truncate d0/f6 618692 0 2024-04-25T17:19:09.182 INFO:tasks.workunit.client.1.smithi069.stdout:0/213: dread - d0/d17/f4a zero size 2024-04-25T17:19:09.183 INFO:tasks.workunit.client.1.smithi069.stdout:2/224: dread d0/d26/f13 [0,4194304] 0 2024-04-25T17:19:09.188 INFO:tasks.workunit.client.1.smithi069.stdout:7/275: creat d4/d3e/f62 x:0 0 0 2024-04-25T17:19:09.195 INFO:tasks.workunit.client.0.smithi037.stdout:6/448: dwrite db/f15 [0,4194304] 0 2024-04-25T17:19:09.197 INFO:tasks.workunit.client.1.smithi069.stdout:7/276: dwrite d4/d6/fa [0,4194304] 0 2024-04-25T17:19:09.197 INFO:tasks.workunit.client.0.smithi037.stdout:1/458: mkdir dc/d1c/d57/d22/d36/d74/da6 0 2024-04-25T17:19:09.197 INFO:tasks.workunit.client.0.smithi037.stdout:1/459: readlink dc/d18/l4e 0 2024-04-25T17:19:09.198 INFO:tasks.workunit.client.0.smithi037.stdout:1/460: write dc/d18/d64/f68 [761043,40503] 0 2024-04-25T17:19:09.204 INFO:tasks.workunit.client.0.smithi037.stdout:8/361: creat d5/db/d59/f6c x:0 0 0 2024-04-25T17:19:09.206 INFO:tasks.workunit.client.0.smithi037.stdout:3/285: truncate d8/f26 1617082 0 2024-04-25T17:19:09.206 INFO:tasks.workunit.client.1.smithi069.stdout:6/235: getdents d2/d2e/d35 0 2024-04-25T17:19:09.207 INFO:tasks.workunit.client.1.smithi069.stdout:3/339: creat d8/d16/d1a/d2c/d6c/f76 x:0 0 0 2024-04-25T17:19:09.207 INFO:tasks.workunit.client.1.smithi069.stdout:7/277: dread d4/d6/d14/d3d/d47/f61 [0,4194304] 0 2024-04-25T17:19:09.207 INFO:tasks.workunit.client.1.smithi069.stdout:3/340: stat d8/f12 0 2024-04-25T17:19:09.212 INFO:tasks.workunit.client.0.smithi037.stdout:9/570: getdents d1/d5/dc/d3c/d3e 0 2024-04-25T17:19:09.217 INFO:tasks.workunit.client.0.smithi037.stdout:7/483: dwrite d5/d15/d17/d1b/d27/f2a [0,4194304] 0 2024-04-25T17:19:09.219 INFO:tasks.workunit.client.1.smithi069.stdout:8/224: dread f14 [0,4194304] 0 2024-04-25T17:19:09.220 INFO:tasks.workunit.client.0.smithi037.stdout:6/449: dread - db/f36 zero size 2024-04-25T17:19:09.220 INFO:tasks.workunit.client.1.smithi069.stdout:9/296: link d2/da/dd/d1e/d2e/d35/f6c d2/da/dd/de/d64/f6e 0 2024-04-25T17:19:09.222 INFO:tasks.workunit.client.0.smithi037.stdout:8/362: read d5/f27 [2448006,2294] 0 2024-04-25T17:19:09.223 INFO:tasks.workunit.client.0.smithi037.stdout:7/484: truncate d5/d15/f89 1435007 0 2024-04-25T17:19:09.223 INFO:tasks.workunit.client.1.smithi069.stdout:0/214: link d0/da/f35 d0/da/db/d3a/f4c 0 2024-04-25T17:19:09.224 INFO:tasks.workunit.client.0.smithi037.stdout:4/644: link d7/d7e/l33 d7/d7e/d45/d4f/lcd 0 2024-04-25T17:19:09.226 INFO:tasks.workunit.client.0.smithi037.stdout:8/363: write d5/f9 [1242994,95135] 0 2024-04-25T17:19:09.229 INFO:tasks.workunit.client.1.smithi069.stdout:7/278: unlink d4/d6/l11 0 2024-04-25T17:19:09.230 INFO:tasks.workunit.client.0.smithi037.stdout:1/461: dwrite dc/d18/d66/f77 [0,4194304] 0 2024-04-25T17:19:09.231 INFO:tasks.workunit.client.1.smithi069.stdout:3/341: mkdir d8/d16/d4b/d77 0 2024-04-25T17:19:09.235 INFO:tasks.workunit.client.1.smithi069.stdout:5/261: getdents d13/d17/d19/d20/d2d/d39 0 2024-04-25T17:19:09.236 INFO:tasks.workunit.client.1.smithi069.stdout:1/249: dwrite d1/d43/d35/f37 [0,4194304] 0 2024-04-25T17:19:09.236 INFO:tasks.workunit.client.0.smithi037.stdout:7/485: dwrite d5/d14/d31/d58/fa7 [0,4194304] 0 2024-04-25T17:19:09.237 INFO:tasks.workunit.client.1.smithi069.stdout:1/250: write d1/d43/f3a [117485,73416] 0 2024-04-25T17:19:09.239 INFO:tasks.workunit.client.1.smithi069.stdout:1/251: chown d1/d43/d1b/l3d 438421 1 2024-04-25T17:19:09.240 INFO:tasks.workunit.client.1.smithi069.stdout:1/252: chown d1/d43/d1b 2811082 1 2024-04-25T17:19:09.241 INFO:tasks.workunit.client.1.smithi069.stdout:1/253: chown d1/d43/d35/c20 27 1 2024-04-25T17:19:09.243 INFO:tasks.workunit.client.1.smithi069.stdout:6/236: dread d2/d1e/f23 [0,4194304] 0 2024-04-25T17:19:09.246 INFO:tasks.workunit.client.1.smithi069.stdout:2/225: write d0/f15 [41590,7066] 0 2024-04-25T17:19:09.247 INFO:tasks.workunit.client.1.smithi069.stdout:8/225: rmdir d37/d47 39 2024-04-25T17:19:09.249 INFO:tasks.workunit.client.1.smithi069.stdout:9/297: mknod d2/da/d14/d23/c6f 0 2024-04-25T17:19:09.252 INFO:tasks.workunit.client.1.smithi069.stdout:2/226: chown d0/d26/f13 414 1 2024-04-25T17:19:09.253 INFO:tasks.workunit.client.1.smithi069.stdout:1/254: dwrite d1/f28 [0,4194304] 0 2024-04-25T17:19:09.254 INFO:tasks.workunit.client.1.smithi069.stdout:2/227: chown d0/d26/d10/d43 1359832953 1 2024-04-25T17:19:09.255 INFO:tasks.workunit.client.0.smithi037.stdout:9/571: mknod d1/d5/d2e/cc3 0 2024-04-25T17:19:09.255 INFO:tasks.workunit.client.0.smithi037.stdout:0/489: dwrite d9/d14/f36 [0,4194304] 0 2024-04-25T17:19:09.255 INFO:tasks.workunit.client.1.smithi069.stdout:2/228: chown d0/d26/d10/d43 11859585 1 2024-04-25T17:19:09.257 INFO:tasks.workunit.client.1.smithi069.stdout:1/255: write d1/d4/d6/f31 [3430592,29751] 0 2024-04-25T17:19:09.258 INFO:tasks.workunit.client.1.smithi069.stdout:8/226: dwrite f32 [0,4194304] 0 2024-04-25T17:19:09.260 INFO:tasks.workunit.client.0.smithi037.stdout:1/462: dread - dc/d1c/d57/d22/d36/f40 zero size 2024-04-25T17:19:09.261 INFO:tasks.workunit.client.0.smithi037.stdout:1/463: dread - dc/d52/d6b/f9a zero size 2024-04-25T17:19:09.267 INFO:tasks.workunit.client.0.smithi037.stdout:7/486: mknod d5/d15/d17/d9d/caa 0 2024-04-25T17:19:09.270 INFO:tasks.workunit.client.1.smithi069.stdout:3/342: unlink d8/d16/d1a/d2c/l73 0 2024-04-25T17:19:09.271 INFO:tasks.workunit.client.1.smithi069.stdout:5/262: fdatasync d13/d17/d19/d20/d2d/f46 0 2024-04-25T17:19:09.272 INFO:tasks.workunit.client.1.smithi069.stdout:6/237: dread d2/f20 [0,4194304] 0 2024-04-25T17:19:09.274 INFO:tasks.workunit.client.0.smithi037.stdout:3/286: rename d8/d23/f41 to d8/d31/f5f 0 2024-04-25T17:19:09.275 INFO:tasks.workunit.client.0.smithi037.stdout:3/287: chown d8/d23/d3a/c53 44480 1 2024-04-25T17:19:09.276 INFO:tasks.workunit.client.0.smithi037.stdout:3/288: stat d8/d23/d3a/f4f 0 2024-04-25T17:19:09.276 INFO:tasks.workunit.client.0.smithi037.stdout:8/364: mknod d5/db/d18/d3b/d50/d51/d5e/c6d 0 2024-04-25T17:19:09.277 INFO:tasks.workunit.client.0.smithi037.stdout:3/289: fdatasync d8/d23/d3a/d5d/f20 0 2024-04-25T17:19:09.278 INFO:tasks.workunit.client.1.smithi069.stdout:4/253: getdents db 0 2024-04-25T17:19:09.278 INFO:tasks.workunit.client.0.smithi037.stdout:3/290: truncate d8/d23/f54 693222 0 2024-04-25T17:19:09.279 INFO:tasks.workunit.client.1.smithi069.stdout:3/343: dwrite d8/d16/d1a/f4f [0,4194304] 0 2024-04-25T17:19:09.281 INFO:tasks.workunit.client.1.smithi069.stdout:3/344: read - d8/d2a/f72 zero size 2024-04-25T17:19:09.281 INFO:tasks.workunit.client.1.smithi069.stdout:5/263: dread d13/d17/d19/f25 [0,4194304] 0 2024-04-25T17:19:09.282 INFO:tasks.workunit.client.0.smithi037.stdout:9/572: fsync d1/d5/d2e/d34/d76/f8c 0 2024-04-25T17:19:09.284 INFO:tasks.workunit.client.0.smithi037.stdout:1/464: creat dc/d1c/d57/d22/d36/d8c/fa7 x:0 0 0 2024-04-25T17:19:09.286 INFO:tasks.workunit.client.1.smithi069.stdout:4/254: dwrite db/d22/d24/d41/f4f [0,4194304] 0 2024-04-25T17:19:09.287 INFO:tasks.workunit.client.1.smithi069.stdout:4/255: fsync db/f14 0 2024-04-25T17:19:09.287 INFO:tasks.workunit.client.1.smithi069.stdout:1/256: creat d1/df/d17/f46 x:0 0 0 2024-04-25T17:19:09.288 INFO:tasks.workunit.client.0.smithi037.stdout:5/536: truncate d7/f1c 1302745 0 2024-04-25T17:19:09.289 INFO:tasks.workunit.client.0.smithi037.stdout:6/450: creat db/d1d/d20/f9f x:0 0 0 2024-04-25T17:19:09.292 INFO:tasks.workunit.client.0.smithi037.stdout:0/490: dwrite d9/d14/f44 [4194304,4194304] 0 2024-04-25T17:19:09.294 INFO:tasks.workunit.client.1.smithi069.stdout:4/256: dwrite db/d15/f37 [0,4194304] 0 2024-04-25T17:19:09.296 INFO:tasks.workunit.client.0.smithi037.stdout:4/645: rename d7/d7e/la6 to d7/d7e/d1e/d2b/d35/lce 0 2024-04-25T17:19:09.296 INFO:tasks.workunit.client.0.smithi037.stdout:9/573: dwrite d1/d48/d68/f31 [0,4194304] 0 2024-04-25T17:19:09.306 INFO:tasks.workunit.client.0.smithi037.stdout:8/365: creat d5/db/d23/d58/f6e x:0 0 0 2024-04-25T17:19:09.308 INFO:tasks.workunit.client.0.smithi037.stdout:8/366: write d5/d6a/f66 [100876,11105] 0 2024-04-25T17:19:09.310 INFO:tasks.workunit.client.0.smithi037.stdout:3/291: truncate f5 2872535 0 2024-04-25T17:19:09.311 INFO:tasks.workunit.client.1.smithi069.stdout:5/264: creat d13/f54 x:0 0 0 2024-04-25T17:19:09.318 INFO:tasks.workunit.client.1.smithi069.stdout:1/257: creat d1/d19/f47 x:0 0 0 2024-04-25T17:19:09.319 INFO:tasks.workunit.client.0.smithi037.stdout:1/465: mknod dc/d52/d6b/ca8 0 2024-04-25T17:19:09.321 INFO:tasks.workunit.client.0.smithi037.stdout:6/451: unlink db/d1d/f5f 0 2024-04-25T17:19:09.324 INFO:tasks.workunit.client.1.smithi069.stdout:7/279: link d4/d1a/f24 d4/d6/d14/d15/f63 0 2024-04-25T17:19:09.324 INFO:tasks.workunit.client.1.smithi069.stdout:1/258: dwrite d1/f9 [8388608,4194304] 0 2024-04-25T17:19:09.325 INFO:tasks.workunit.client.0.smithi037.stdout:7/487: mknod d5/d15/d17/d25/d2b/cab 0 2024-04-25T17:19:09.325 INFO:tasks.workunit.client.1.smithi069.stdout:1/259: fdatasync d1/d43/d1b/f2c 0 2024-04-25T17:19:09.325 INFO:tasks.workunit.client.1.smithi069.stdout:7/280: write d4/f10 [2791067,73925] 0 2024-04-25T17:19:09.326 INFO:tasks.workunit.client.1.smithi069.stdout:7/281: dread - d4/f4a zero size 2024-04-25T17:19:09.326 INFO:tasks.workunit.client.1.smithi069.stdout:1/260: truncate d1/d43/f3a 545011 0 2024-04-25T17:19:09.328 INFO:tasks.workunit.client.1.smithi069.stdout:1/261: read d1/d43/d35/f14 [524634,51690] 0 2024-04-25T17:19:09.329 INFO:tasks.workunit.client.1.smithi069.stdout:4/257: chown db/d15/d20/f2e 0 1 2024-04-25T17:19:09.329 INFO:tasks.workunit.client.0.smithi037.stdout:9/574: dread - d1/d5/d19/f56 zero size 2024-04-25T17:19:09.330 INFO:tasks.workunit.client.1.smithi069.stdout:4/258: stat db/f52 0 2024-04-25T17:19:09.330 INFO:tasks.workunit.client.1.smithi069.stdout:1/262: write d1/df/d17/f46 [122074,75536] 0 2024-04-25T17:19:09.332 INFO:tasks.workunit.client.0.smithi037.stdout:9/575: chown d1/d48/d68/d26/cb9 7879994 1 2024-04-25T17:19:09.332 INFO:tasks.workunit.client.0.smithi037.stdout:7/488: dwrite f0 [4194304,4194304] 0 2024-04-25T17:19:09.333 INFO:tasks.workunit.client.0.smithi037.stdout:8/367: rmdir d5/da 39 2024-04-25T17:19:09.337 INFO:tasks.workunit.client.1.smithi069.stdout:0/215: getdents d0/d17/d40 0 2024-04-25T17:19:09.338 INFO:tasks.workunit.client.1.smithi069.stdout:0/216: fdatasync d0/d38/f49 0 2024-04-25T17:19:09.338 INFO:tasks.workunit.client.0.smithi037.stdout:1/466: mknod dc/d1c/d57/d43/ca9 0 2024-04-25T17:19:09.341 INFO:tasks.workunit.client.1.smithi069.stdout:5/265: mkdir d13/d17/d29/d30/d55 0 2024-04-25T17:19:09.342 INFO:tasks.workunit.client.1.smithi069.stdout:6/238: dwrite d2/f20 [0,4194304] 0 2024-04-25T17:19:09.343 INFO:tasks.workunit.client.1.smithi069.stdout:8/227: sync 2024-04-25T17:19:09.343 INFO:tasks.workunit.client.1.smithi069.stdout:5/266: dread - d13/d17/d29/f43 zero size 2024-04-25T17:19:09.343 INFO:tasks.workunit.client.1.smithi069.stdout:3/345: sync 2024-04-25T17:19:09.343 INFO:tasks.workunit.client.1.smithi069.stdout:2/229: sync 2024-04-25T17:19:09.344 INFO:tasks.workunit.client.1.smithi069.stdout:5/267: fdatasync f5 0 2024-04-25T17:19:09.346 INFO:tasks.workunit.client.1.smithi069.stdout:6/239: chown d2/d1e/d43/l47 3177 1 2024-04-25T17:19:09.346 INFO:tasks.workunit.client.1.smithi069.stdout:3/346: fsync d8/d16/d1a/d2c/d49/f68 0 2024-04-25T17:19:09.349 INFO:tasks.workunit.client.1.smithi069.stdout:6/240: chown d2/f21 53826195 1 2024-04-25T17:19:09.349 INFO:tasks.workunit.client.1.smithi069.stdout:5/268: stat d13/d17/d19/d20/d2d/d39/f48 0 2024-04-25T17:19:09.350 INFO:tasks.workunit.client.0.smithi037.stdout:0/491: mkdir d9/df/d32/d35/d66/d7a/da4 0 2024-04-25T17:19:09.350 INFO:tasks.workunit.client.0.smithi037.stdout:3/292: dread d8/f26 [0,4194304] 0 2024-04-25T17:19:09.351 INFO:tasks.workunit.client.0.smithi037.stdout:3/293: stat d8/d23/d38/f5a 0 2024-04-25T17:19:09.351 INFO:tasks.workunit.client.1.smithi069.stdout:7/282: rmdir d4/d6/d14/d15/d3c 39 2024-04-25T17:19:09.352 INFO:tasks.workunit.client.1.smithi069.stdout:9/298: dwrite d2/da/fc [4194304,4194304] 0 2024-04-25T17:19:09.355 INFO:tasks.workunit.client.0.smithi037.stdout:7/489: dread - d5/d15/d17/d25/d2b/d48/f72 zero size 2024-04-25T17:19:09.355 INFO:tasks.workunit.client.1.smithi069.stdout:4/259: rmdir db/d15/d20/d38/d3c/d43/d48 39 2024-04-25T17:19:09.356 INFO:tasks.workunit.client.0.smithi037.stdout:0/492: dread d9/df/d32/d39/f63 [0,4194304] 0 2024-04-25T17:19:09.359 INFO:tasks.workunit.client.0.smithi037.stdout:1/467: rmdir dc/d1c/d57/d43 39 2024-04-25T17:19:09.360 INFO:tasks.workunit.client.1.smithi069.stdout:3/347: dwrite d8/d16/d1a/d2c/f35 [4194304,4194304] 0 2024-04-25T17:19:09.366 INFO:tasks.workunit.client.1.smithi069.stdout:4/260: dwrite db/d15/d26/f34 [0,4194304] 0 2024-04-25T17:19:09.376 INFO:tasks.workunit.client.0.smithi037.stdout:7/490: creat d5/d15/d17/d9d/fac x:0 0 0 2024-04-25T17:19:09.378 INFO:tasks.workunit.client.0.smithi037.stdout:9/576: symlink d1/d5/d2e/d34/d76/db4/lc4 0 2024-04-25T17:19:09.380 INFO:tasks.workunit.client.0.smithi037.stdout:6/452: truncate db/d53/f54 1395395 0 2024-04-25T17:19:09.381 INFO:tasks.workunit.client.1.smithi069.stdout:5/269: creat d13/d17/d19/d20/d2d/f56 x:0 0 0 2024-04-25T17:19:09.381 INFO:tasks.workunit.client.1.smithi069.stdout:8/228: write f12 [507948,32962] 0 2024-04-25T17:19:09.382 INFO:tasks.workunit.client.0.smithi037.stdout:8/368: dwrite f4 [0,4194304] 0 2024-04-25T17:19:09.384 INFO:tasks.workunit.client.1.smithi069.stdout:1/263: mknod d1/d43/d35/d1d/c48 0 2024-04-25T17:19:09.387 INFO:tasks.workunit.client.0.smithi037.stdout:1/468: dread dc/f10 [0,4194304] 0 2024-04-25T17:19:09.387 INFO:tasks.workunit.client.0.smithi037.stdout:1/469: chown dc/d18/d39 534633089 1 2024-04-25T17:19:09.390 INFO:tasks.workunit.client.0.smithi037.stdout:3/294: mknod d8/d31/d32/c60 0 2024-04-25T17:19:09.395 INFO:tasks.workunit.client.0.smithi037.stdout:7/491: truncate d5/d15/d17/d1b/d27/f60 2234292 0 2024-04-25T17:19:09.396 INFO:tasks.workunit.client.0.smithi037.stdout:7/492: chown d5/d15/d17/d25/d2b 15991 1 2024-04-25T17:19:09.401 INFO:tasks.workunit.client.1.smithi069.stdout:8/229: dread ff [0,4194304] 0 2024-04-25T17:19:09.401 INFO:tasks.workunit.client.1.smithi069.stdout:2/230: link d0/f15 d0/d26/d10/f49 0 2024-04-25T17:19:09.402 INFO:tasks.workunit.client.1.smithi069.stdout:6/241: mknod d2/d1e/d3e/c4c 0 2024-04-25T17:19:09.405 INFO:tasks.workunit.client.1.smithi069.stdout:1/264: creat d1/d19/f49 x:0 0 0 2024-04-25T17:19:09.406 INFO:tasks.workunit.client.1.smithi069.stdout:0/217: truncate d0/f4 1716578 0 2024-04-25T17:19:09.410 INFO:tasks.workunit.client.1.smithi069.stdout:9/299: rename d2/f42 to d2/da/dd/d1e/d2e/f70 0 2024-04-25T17:19:09.412 INFO:tasks.workunit.client.1.smithi069.stdout:8/230: fdatasync fb 0 2024-04-25T17:19:09.414 INFO:tasks.workunit.client.0.smithi037.stdout:7/493: creat d5/d15/d17/d1b/d27/fad x:0 0 0 2024-04-25T17:19:09.415 INFO:tasks.workunit.client.1.smithi069.stdout:2/231: read - d0/d1/d1d/d33/f39 zero size 2024-04-25T17:19:09.416 INFO:tasks.workunit.client.1.smithi069.stdout:2/232: write d0/d1/f19 [1362113,44519] 0 2024-04-25T17:19:09.417 INFO:tasks.workunit.client.0.smithi037.stdout:9/577: dwrite d1/d5/dc/f2d [0,4194304] 0 2024-04-25T17:19:09.420 INFO:tasks.workunit.client.1.smithi069.stdout:6/242: symlink d2/d2e/l4d 0 2024-04-25T17:19:09.420 INFO:tasks.workunit.client.0.smithi037.stdout:9/578: truncate d1/d5/dc/fa5 69997 0 2024-04-25T17:19:09.421 INFO:tasks.workunit.client.0.smithi037.stdout:8/369: dwrite d5/db/d23/d42/f4f [4194304,4194304] 0 2024-04-25T17:19:09.425 INFO:tasks.workunit.client.0.smithi037.stdout:8/370: truncate d5/db/d23/d42/f63 794615 0 2024-04-25T17:19:09.431 INFO:tasks.workunit.client.1.smithi069.stdout:0/218: rmdir d0 39 2024-04-25T17:19:09.432 INFO:tasks.workunit.client.0.smithi037.stdout:8/371: dwrite d5/db/d23/d42/f4f [0,4194304] 0 2024-04-25T17:19:09.432 INFO:tasks.workunit.client.0.smithi037.stdout:9/579: dwrite d1/d48/d68/d26/d81/f97 [0,4194304] 0 2024-04-25T17:19:09.438 INFO:tasks.workunit.client.0.smithi037.stdout:0/493: getdents d9/df 0 2024-04-25T17:19:09.439 INFO:tasks.workunit.client.0.smithi037.stdout:1/470: dwrite dc/d1c/d57/d4d/d6a/d86/f97 [4194304,4194304] 0 2024-04-25T17:19:09.441 INFO:tasks.workunit.client.0.smithi037.stdout:1/471: dread - dc/d52/d6b/f9a zero size 2024-04-25T17:19:09.442 INFO:tasks.workunit.client.1.smithi069.stdout:3/348: rename d8/cf to d8/d16/d1a/d2c/d6c/c78 0 2024-04-25T17:19:09.447 INFO:tasks.workunit.client.0.smithi037.stdout:1/472: read dc/d1c/d57/d4d/d6a/d86/d91/f93 [65896,9191] 0 2024-04-25T17:19:09.448 INFO:tasks.workunit.client.0.smithi037.stdout:1/473: dread - dc/d1c/d57/d4d/f87 zero size 2024-04-25T17:19:09.452 INFO:tasks.workunit.client.1.smithi069.stdout:2/233: mknod d0/d26/c4a 0 2024-04-25T17:19:09.454 INFO:tasks.workunit.client.1.smithi069.stdout:5/270: creat d13/d17/d19/d20/f57 x:0 0 0 2024-04-25T17:19:09.455 INFO:tasks.workunit.client.0.smithi037.stdout:1/474: dread dc/d1c/d57/d4d/d6a/d86/d91/f93 [0,4194304] 0 2024-04-25T17:19:09.456 INFO:tasks.workunit.client.1.smithi069.stdout:1/265: mkdir d1/d43/d1b/d32/d4a 0 2024-04-25T17:19:09.456 INFO:tasks.workunit.client.1.smithi069.stdout:1/266: fdatasync d1/f2e 0 2024-04-25T17:19:09.458 INFO:tasks.workunit.client.0.smithi037.stdout:9/580: mknod d1/d5/d19/d6e/cc5 0 2024-04-25T17:19:09.459 INFO:tasks.workunit.client.1.smithi069.stdout:0/219: stat d0/da/db/d1d/d27/f45 0 2024-04-25T17:19:09.460 INFO:tasks.workunit.client.1.smithi069.stdout:7/283: getdents d4/d6/d14/d3d/d47 0 2024-04-25T17:19:09.460 INFO:tasks.workunit.client.0.smithi037.stdout:0/494: chown d9/df/d32/f5c 808 1 2024-04-25T17:19:09.461 INFO:tasks.workunit.client.1.smithi069.stdout:9/300: mknod d2/c71 0 2024-04-25T17:19:09.462 INFO:tasks.workunit.client.0.smithi037.stdout:7/494: mknod d5/d15/d17/d1b/da2/cae 0 2024-04-25T17:19:09.465 INFO:tasks.workunit.client.0.smithi037.stdout:3/295: getdents d8/d57 0 2024-04-25T17:19:09.466 INFO:tasks.workunit.client.1.smithi069.stdout:7/284: dread d4/d6/d14/d15/f2d [0,4194304] 0 2024-04-25T17:19:09.467 INFO:tasks.workunit.client.1.smithi069.stdout:7/285: read d4/d3e/f41 [1044444,72994] 0 2024-04-25T17:19:09.468 INFO:tasks.workunit.client.1.smithi069.stdout:9/301: dwrite d2/da/d14/d23/f55 [0,4194304] 0 2024-04-25T17:19:09.469 INFO:tasks.workunit.client.0.smithi037.stdout:1/475: rename dc/d1c/d57/d22/d36/c9f to dc/d18/d39/caa 0 2024-04-25T17:19:09.471 INFO:tasks.workunit.client.0.smithi037.stdout:1/476: write dc/d1c/d57/d4d/f87 [823962,68889] 0 2024-04-25T17:19:09.471 INFO:tasks.workunit.client.1.smithi069.stdout:8/231: symlink d37/d47/l4d 0 2024-04-25T17:19:09.472 INFO:tasks.workunit.client.0.smithi037.stdout:9/581: mknod d1/d48/d68/cc6 0 2024-04-25T17:19:09.472 INFO:tasks.workunit.client.0.smithi037.stdout:1/477: chown dc/f34 1 1 2024-04-25T17:19:09.474 INFO:tasks.workunit.client.0.smithi037.stdout:1/478: truncate dc/d18/d66/f90 856005 0 2024-04-25T17:19:09.478 INFO:tasks.workunit.client.0.smithi037.stdout:1/479: dread dc/d1c/d57/d4d/f87 [0,4194304] 0 2024-04-25T17:19:09.478 INFO:tasks.workunit.client.1.smithi069.stdout:5/271: unlink d13/d17/d19/d20/l49 0 2024-04-25T17:19:09.481 INFO:tasks.workunit.client.0.smithi037.stdout:3/296: mknod d8/d23/d3a/c61 0 2024-04-25T17:19:09.481 INFO:tasks.workunit.client.1.smithi069.stdout:0/220: chown d0/f6 2670 1 2024-04-25T17:19:09.482 INFO:tasks.workunit.client.0.smithi037.stdout:8/372: creat d5/f6f x:0 0 0 2024-04-25T17:19:09.483 INFO:tasks.workunit.client.1.smithi069.stdout:5/272: dwrite d13/f16 [0,4194304] 0 2024-04-25T17:19:09.485 INFO:tasks.workunit.client.1.smithi069.stdout:4/261: rename db/d15/d20/d38/d3c/d43/d48/d49/d4e/c57 to db/d15/d20/d38/c58 0 2024-04-25T17:19:09.486 INFO:tasks.workunit.client.1.smithi069.stdout:3/349: link f4 d8/d16/d4b/f79 0 2024-04-25T17:19:09.488 INFO:tasks.workunit.client.1.smithi069.stdout:3/350: chown d8/d16/d1a/d3e/c4a 1499830 1 2024-04-25T17:19:09.489 INFO:tasks.workunit.client.1.smithi069.stdout:7/286: rmdir d4/d6/d14/d3d/d47 39 2024-04-25T17:19:09.490 INFO:tasks.workunit.client.1.smithi069.stdout:9/302: dread d2/da/dd/f50 [0,4194304] 0 2024-04-25T17:19:09.494 INFO:tasks.workunit.client.1.smithi069.stdout:3/351: dwrite d8/f1f [0,4194304] 0 2024-04-25T17:19:09.497 INFO:tasks.workunit.client.1.smithi069.stdout:2/234: unlink d0/d1/f19 0 2024-04-25T17:19:09.497 INFO:tasks.workunit.client.1.smithi069.stdout:2/235: stat d0/d1/d1d/f29 0 2024-04-25T17:19:09.498 INFO:tasks.workunit.client.0.smithi037.stdout:8/373: mknod d5/db/d18/c70 0 2024-04-25T17:19:09.500 INFO:tasks.workunit.client.1.smithi069.stdout:1/267: mkdir d1/d43/d1b/d32/d4a/d4b 0 2024-04-25T17:19:09.501 INFO:tasks.workunit.client.1.smithi069.stdout:0/221: stat d0/f4 0 2024-04-25T17:19:09.503 INFO:tasks.workunit.client.1.smithi069.stdout:3/352: dwrite d8/d16/d1a/f54 [0,4194304] 0 2024-04-25T17:19:09.505 INFO:tasks.workunit.client.1.smithi069.stdout:3/353: truncate d8/d2a/f55 437298 0 2024-04-25T17:19:09.506 INFO:tasks.workunit.client.1.smithi069.stdout:3/354: fsync d8/d39/f3c 0 2024-04-25T17:19:09.510 INFO:tasks.workunit.client.1.smithi069.stdout:3/355: fsync d8/d16/d1a/d3e/f6f 0 2024-04-25T17:19:09.510 INFO:tasks.workunit.client.1.smithi069.stdout:7/287: symlink d4/d6/d14/d5a/l64 0 2024-04-25T17:19:09.512 INFO:tasks.workunit.client.0.smithi037.stdout:9/582: dwrite d1/d5/d2e/f75 [4194304,4194304] 0 2024-04-25T17:19:09.512 INFO:tasks.workunit.client.0.smithi037.stdout:8/374: creat d5/d6a/f71 x:0 0 0 2024-04-25T17:19:09.514 INFO:tasks.workunit.client.0.smithi037.stdout:7/495: rename d5/d15/d17/d1b/d27 to d5/d15/d17/d1b/da2/daf 0 2024-04-25T17:19:09.516 INFO:tasks.workunit.client.1.smithi069.stdout:1/268: creat d1/d4/f4c x:0 0 0 2024-04-25T17:19:09.517 INFO:tasks.workunit.client.0.smithi037.stdout:0/495: dwrite d9/d14/f22 [0,4194304] 0 2024-04-25T17:19:09.517 INFO:tasks.workunit.client.1.smithi069.stdout:1/269: fdatasync d1/df/d17/f2d 0 2024-04-25T17:19:09.518 INFO:tasks.workunit.client.0.smithi037.stdout:1/480: rename dc/d1c/d57/l5f to dc/d1c/d57/lab 0 2024-04-25T17:19:09.519 INFO:tasks.workunit.client.0.smithi037.stdout:0/496: chown d9/df/d32/d35/d66/d7a 22 1 2024-04-25T17:19:09.519 INFO:tasks.workunit.client.0.smithi037.stdout:3/297: creat d8/d23/f62 x:0 0 0 2024-04-25T17:19:09.521 INFO:tasks.workunit.client.0.smithi037.stdout:0/497: chown d9/df/d32/d39/d68/f93 7121 1 2024-04-25T17:19:09.522 INFO:tasks.workunit.client.0.smithi037.stdout:3/298: truncate d8/d23/d3a/f4f 1003122 0 2024-04-25T17:19:09.522 INFO:tasks.workunit.client.1.smithi069.stdout:0/222: creat d0/da/db/d2c/f4d x:0 0 0 2024-04-25T17:19:09.528 INFO:tasks.workunit.client.0.smithi037.stdout:3/299: dread d8/f2c [0,4194304] 0 2024-04-25T17:19:09.529 INFO:tasks.workunit.client.1.smithi069.stdout:3/356: creat d8/d16/d1a/d3e/f7a x:0 0 0 2024-04-25T17:19:09.530 INFO:tasks.workunit.client.0.smithi037.stdout:8/375: rename d5/db/c64 to d5/db/d18/d3b/d50/d51/d5e/c72 0 2024-04-25T17:19:09.531 INFO:tasks.workunit.client.0.smithi037.stdout:8/376: write d5/db/d59/f6c [206740,28758] 0 2024-04-25T17:19:09.532 INFO:tasks.workunit.client.0.smithi037.stdout:8/377: stat d5/d6a/c60 0 2024-04-25T17:19:09.533 INFO:tasks.workunit.client.0.smithi037.stdout:8/378: chown d5/db/f68 969952 1 2024-04-25T17:19:09.534 INFO:tasks.workunit.client.0.smithi037.stdout:7/496: unlink d5/d15/c73 0 2024-04-25T17:19:09.537 INFO:tasks.workunit.client.0.smithi037.stdout:1/481: unlink dc/d1c/d57/d4d/f61 0 2024-04-25T17:19:09.537 INFO:tasks.workunit.client.1.smithi069.stdout:3/357: read d8/d16/d31/f44 [944818,128561] 0 2024-04-25T17:19:09.538 INFO:tasks.workunit.client.0.smithi037.stdout:1/482: stat dc/d18/f38 0 2024-04-25T17:19:09.538 INFO:tasks.workunit.client.1.smithi069.stdout:1/270: mkdir d1/d43/d35/d4d 0 2024-04-25T17:19:09.543 INFO:tasks.workunit.client.1.smithi069.stdout:0/223: creat d0/da/db/f4e x:0 0 0 2024-04-25T17:19:09.544 INFO:tasks.workunit.client.1.smithi069.stdout:1/271: dwrite d1/df/f33 [0,4194304] 0 2024-04-25T17:19:09.545 INFO:tasks.workunit.client.1.smithi069.stdout:6/243: rename d2/d7/f30 to d2/f4e 0 2024-04-25T17:19:09.549 INFO:tasks.workunit.client.0.smithi037.stdout:8/379: mkdir d5/db/d18/d3b/d73 0 2024-04-25T17:19:09.550 INFO:tasks.workunit.client.1.smithi069.stdout:3/358: creat d8/d16/d1a/d2c/d6c/f7b x:0 0 0 2024-04-25T17:19:09.551 INFO:tasks.workunit.client.0.smithi037.stdout:9/583: dwrite d1/d5/d2e/d34/f8d [0,4194304] 0 2024-04-25T17:19:09.552 INFO:tasks.workunit.client.0.smithi037.stdout:7/497: creat d5/d15/d17/d1b/da2/d76/fb0 x:0 0 0 2024-04-25T17:19:09.554 INFO:tasks.workunit.client.1.smithi069.stdout:7/288: dwrite d4/d6/d14/d15/f63 [0,4194304] 0 2024-04-25T17:19:09.557 INFO:tasks.workunit.client.1.smithi069.stdout:5/273: link d13/d17/d29/d2e/c32 d13/d17/d19/c58 0 2024-04-25T17:19:09.558 INFO:tasks.workunit.client.0.smithi037.stdout:0/498: write d9/df/d32/f5c [754566,9813] 0 2024-04-25T17:19:09.563 INFO:tasks.workunit.client.1.smithi069.stdout:0/224: rmdir d0/da/db/d2c 39 2024-04-25T17:19:09.564 INFO:tasks.workunit.client.0.smithi037.stdout:0/499: read d9/d71/f92 [478852,17121] 0 2024-04-25T17:19:09.564 INFO:tasks.workunit.client.0.smithi037.stdout:1/483: dread dc/d24/f48 [0,4194304] 0 2024-04-25T17:19:09.566 INFO:tasks.workunit.client.1.smithi069.stdout:1/272: readlink d1/df/l3c 0 2024-04-25T17:19:09.567 INFO:tasks.workunit.client.0.smithi037.stdout:3/300: write d8/f26 [735539,84450] 0 2024-04-25T17:19:09.567 INFO:tasks.workunit.client.1.smithi069.stdout:1/273: readlink d1/df/l3c 0 2024-04-25T17:19:09.567 INFO:tasks.workunit.client.1.smithi069.stdout:1/274: chown d1/d4/c40 574115490 1 2024-04-25T17:19:09.570 INFO:tasks.workunit.client.1.smithi069.stdout:8/232: rename d37/f42 to d37/d47/d48/f4e 0 2024-04-25T17:19:09.572 INFO:tasks.workunit.client.0.smithi037.stdout:9/584: rmdir d1/d48 39 2024-04-25T17:19:09.575 INFO:tasks.workunit.client.1.smithi069.stdout:6/244: read d2/d7/fa [882690,123989] 0 2024-04-25T17:19:09.576 INFO:tasks.workunit.client.0.smithi037.stdout:7/498: rename d5/d14/d31/d58 to d5/d14/db1 0 2024-04-25T17:19:09.579 INFO:tasks.workunit.client.1.smithi069.stdout:7/289: creat d4/d1a/d34/f65 x:0 0 0 2024-04-25T17:19:09.579 INFO:tasks.workunit.client.0.smithi037.stdout:9/585: dwrite d1/d5/d19/f50 [0,4194304] 0 2024-04-25T17:19:09.586 INFO:tasks.workunit.client.0.smithi037.stdout:0/500: mknod d9/df/d32/d35/d66/d7a/ca5 0 2024-04-25T17:19:09.590 INFO:tasks.workunit.client.1.smithi069.stdout:0/225: creat d0/d36/f4f x:0 0 0 2024-04-25T17:19:09.590 INFO:tasks.workunit.client.1.smithi069.stdout:0/226: chown d0/da/db/d1d 2 1 2024-04-25T17:19:09.590 INFO:tasks.workunit.client.0.smithi037.stdout:8/380: mknod d5/da/c74 0 2024-04-25T17:19:09.592 INFO:tasks.workunit.client.1.smithi069.stdout:1/275: unlink d1/df/d17/f46 0 2024-04-25T17:19:09.593 INFO:tasks.workunit.client.1.smithi069.stdout:1/276: stat d1/d19/c3f 0 2024-04-25T17:19:09.595 INFO:tasks.workunit.client.0.smithi037.stdout:1/484: rename l4 to dc/d1c/d57/d4d/lac 0 2024-04-25T17:19:09.595 INFO:tasks.workunit.client.1.smithi069.stdout:8/233: fsync f14 0 2024-04-25T17:19:09.596 INFO:tasks.workunit.client.0.smithi037.stdout:1/485: read dc/d18/d66/f90 [578619,57339] 0 2024-04-25T17:19:09.596 INFO:tasks.workunit.client.1.smithi069.stdout:0/227: dwrite d0/d36/f4f [0,4194304] 0 2024-04-25T17:19:09.597 INFO:tasks.workunit.client.1.smithi069.stdout:0/228: chown d0/l4b 63517 1 2024-04-25T17:19:09.598 INFO:tasks.workunit.client.1.smithi069.stdout:1/277: dread d1/f28 [0,4194304] 0 2024-04-25T17:19:09.598 INFO:tasks.workunit.client.1.smithi069.stdout:4/262: rename db/d15/d20/l23 to db/d15/d20/d38/d3c/d43/d48/d49/d4e/l59 0 2024-04-25T17:19:09.599 INFO:tasks.workunit.client.1.smithi069.stdout:1/278: dread - d1/d19/f49 zero size 2024-04-25T17:19:09.603 INFO:tasks.workunit.client.1.smithi069.stdout:9/303: sync 2024-04-25T17:19:09.603 INFO:tasks.workunit.client.0.smithi037.stdout:8/381: rename d5/db/d18/d3b/d73 to d5/db/d18/d3b/d75 0 2024-04-25T17:19:09.604 INFO:tasks.workunit.client.1.smithi069.stdout:9/304: stat d2/da/dd/d1e/f6a 0 2024-04-25T17:19:09.604 INFO:tasks.workunit.client.0.smithi037.stdout:0/501: dread d9/d71/f8e [0,4194304] 0 2024-04-25T17:19:09.605 INFO:tasks.workunit.client.0.smithi037.stdout:0/502: stat d9/d14/d28/f5b 0 2024-04-25T17:19:09.605 INFO:tasks.workunit.client.1.smithi069.stdout:9/305: truncate d2/da/dd/f5d 713032 0 2024-04-25T17:19:09.605 INFO:tasks.workunit.client.1.smithi069.stdout:5/274: truncate d13/d17/d29/f2b 936295 0 2024-04-25T17:19:09.606 INFO:tasks.workunit.client.1.smithi069.stdout:5/275: chown d13/c2c 104470 1 2024-04-25T17:19:09.607 INFO:tasks.workunit.client.0.smithi037.stdout:0/503: write d9/df/d32/d56/f8d [865094,13093] 0 2024-04-25T17:19:09.607 INFO:tasks.workunit.client.0.smithi037.stdout:7/499: symlink d5/d14/d31/lb2 0 2024-04-25T17:19:09.614 INFO:tasks.workunit.client.0.smithi037.stdout:8/382: dwrite d5/d6a/f3f [0,4194304] 0 2024-04-25T17:19:09.615 INFO:tasks.workunit.client.1.smithi069.stdout:2/236: rename d0/d1/d1d/f22 to d0/d26/d10/d43/f4b 0 2024-04-25T17:19:09.615 INFO:tasks.workunit.client.0.smithi037.stdout:8/383: fdatasync d5/db/d18/d3b/d50/f56 0 2024-04-25T17:19:09.617 INFO:tasks.workunit.client.1.smithi069.stdout:1/279: dread d1/d4/f2a [0,4194304] 0 2024-04-25T17:19:09.620 INFO:tasks.workunit.client.1.smithi069.stdout:6/245: link d2/f9 d2/d2e/d35/d48/f4f 0 2024-04-25T17:19:09.621 INFO:tasks.workunit.client.0.smithi037.stdout:8/384: dread d5/db/d23/d42/f4f [4194304,4194304] 0 2024-04-25T17:19:09.621 INFO:tasks.workunit.client.1.smithi069.stdout:9/306: dread d2/da/dd/d1e/d2e/d35/f5a [0,4194304] 0 2024-04-25T17:19:09.625 INFO:tasks.workunit.client.1.smithi069.stdout:7/290: link d4/d6/f59 d4/d1a/d34/f66 0 2024-04-25T17:19:09.626 INFO:tasks.workunit.client.1.smithi069.stdout:7/291: fsync d4/d1a/f2f 0 2024-04-25T17:19:09.626 INFO:tasks.workunit.client.0.smithi037.stdout:0/504: symlink d9/df/d32/d35/la6 0 2024-04-25T17:19:09.629 INFO:tasks.workunit.client.1.smithi069.stdout:5/276: creat d13/d17/d29/d2e/f59 x:0 0 0 2024-04-25T17:19:09.630 INFO:tasks.workunit.client.0.smithi037.stdout:3/301: getdents d8/d31 0 2024-04-25T17:19:09.638 INFO:tasks.workunit.client.0.smithi037.stdout:1/486: dwrite dc/d1c/d57/d22/d36/f54 [0,4194304] 0 2024-04-25T17:19:09.639 INFO:tasks.workunit.client.1.smithi069.stdout:3/359: rename d8/d16/d1a/d2c/d6c/f7b to d8/d2a/f7c 0 2024-04-25T17:19:09.643 INFO:tasks.workunit.client.0.smithi037.stdout:0/505: mkdir d9/df/d32/d39/d68/da7 0 2024-04-25T17:19:09.644 INFO:tasks.workunit.client.0.smithi037.stdout:0/506: chown d9/df/d32/d39/f64 9005038 1 2024-04-25T17:19:09.644 INFO:tasks.workunit.client.0.smithi037.stdout:0/507: stat d9/df/d32/f60 0 2024-04-25T17:19:09.651 INFO:tasks.workunit.client.0.smithi037.stdout:1/487: rmdir dc/d1c/d57/d22/d36/d8c 39 2024-04-25T17:19:09.653 INFO:tasks.workunit.client.0.smithi037.stdout:8/385: getdents d5/db/d18/d3b/d75 0 2024-04-25T17:19:09.653 INFO:tasks.workunit.client.0.smithi037.stdout:1/488: dread dc/d1c/f69 [0,4194304] 0 2024-04-25T17:19:09.659 INFO:tasks.workunit.client.0.smithi037.stdout:7/500: dwrite d5/d15/d17/d1b/da2/daf/d80/f85 [0,4194304] 0 2024-04-25T17:19:09.660 INFO:tasks.workunit.client.0.smithi037.stdout:3/302: write d8/d23/d3a/d5d/f2b [1137437,79036] 0 2024-04-25T17:19:09.662 INFO:tasks.workunit.client.1.smithi069.stdout:8/234: rename d37/l40 to d37/d47/d48/l4f 0 2024-04-25T17:19:09.663 INFO:tasks.workunit.client.0.smithi037.stdout:1/489: dwrite dc/d1c/d57/d22/f6d [0,4194304] 0 2024-04-25T17:19:09.664 INFO:tasks.workunit.client.0.smithi037.stdout:8/386: creat d5/db/d18/d3b/d50/d51/d5e/f76 x:0 0 0 2024-04-25T17:19:09.664 INFO:tasks.workunit.client.1.smithi069.stdout:8/235: write f26 [583893,26793] 0 2024-04-25T17:19:09.664 INFO:tasks.workunit.client.1.smithi069.stdout:2/237: symlink d0/d26/d10/d43/d47/l4c 0 2024-04-25T17:19:09.665 INFO:tasks.workunit.client.0.smithi037.stdout:1/490: write dc/d18/f51 [155506,77301] 0 2024-04-25T17:19:09.665 INFO:tasks.workunit.client.0.smithi037.stdout:8/387: chown d5/db/d18/d3b/l52 31 1 2024-04-25T17:19:09.666 INFO:tasks.workunit.client.1.smithi069.stdout:7/292: write d4/d18/f1f [2200542,104140] 0 2024-04-25T17:19:09.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:09 smithi069 ceph-mon[34527]: pgmap v35: 65 pgs: 65 active+clean; 1.3 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 31 MiB/s rd, 142 MiB/s wr, 282 op/s 2024-04-25T17:19:09.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:09 smithi069 ceph-mon[34527]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:19:09.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:09 smithi069 ceph-mon[34527]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:19:09.668 INFO:tasks.workunit.client.1.smithi069.stdout:1/280: symlink d1/l4e 0 2024-04-25T17:19:09.670 INFO:tasks.workunit.client.1.smithi069.stdout:6/246: dwrite d2/f9 [4194304,4194304] 0 2024-04-25T17:19:09.671 INFO:tasks.workunit.client.0.smithi037.stdout:7/501: chown d5/d14/d31/f93 42 1 2024-04-25T17:19:09.672 INFO:tasks.workunit.client.1.smithi069.stdout:9/307: creat d2/da/dd/d1e/d2e/d68/f72 x:0 0 0 2024-04-25T17:19:09.672 INFO:tasks.workunit.client.0.smithi037.stdout:3/303: mkdir d8/d23/d3a/d63 0 2024-04-25T17:19:09.673 INFO:tasks.workunit.client.0.smithi037.stdout:3/304: chown d8/d31/d32/c4a 453 1 2024-04-25T17:19:09.676 INFO:tasks.workunit.client.1.smithi069.stdout:9/308: write d2/da/dd/de/f48 [2097207,91955] 0 2024-04-25T17:19:09.677 INFO:tasks.workunit.client.0.smithi037.stdout:1/491: creat dc/d1c/d57/d4d/d6a/d86/fad x:0 0 0 2024-04-25T17:19:09.678 INFO:tasks.workunit.client.1.smithi069.stdout:7/293: dwrite d4/f4a [0,4194304] 0 2024-04-25T17:19:09.680 INFO:tasks.workunit.client.1.smithi069.stdout:4/263: rename db/d15/d26/f3d to db/d15/d20/d38/d3c/d43/d48/d49/f5a 0 2024-04-25T17:19:09.683 INFO:tasks.workunit.client.1.smithi069.stdout:9/309: dread d2/da/dd/d1e/d2e/f34 [0,4194304] 0 2024-04-25T17:19:09.683 INFO:tasks.workunit.client.0.smithi037.stdout:7/502: creat d5/d15/d17/d1b/da2/d76/fb3 x:0 0 0 2024-04-25T17:19:09.684 INFO:tasks.workunit.client.1.smithi069.stdout:9/310: dread - d2/da/d5f/f6d zero size 2024-04-25T17:19:09.686 INFO:tasks.workunit.client.0.smithi037.stdout:8/388: symlink d5/db/d23/l77 0 2024-04-25T17:19:09.689 INFO:tasks.workunit.client.1.smithi069.stdout:1/281: mkdir d1/d4/d6/d4f 0 2024-04-25T17:19:09.689 INFO:tasks.workunit.client.0.smithi037.stdout:0/508: link d9/d14/c25 d9/df/ca8 0 2024-04-25T17:19:09.690 INFO:tasks.workunit.client.1.smithi069.stdout:9/311: dwrite d2/da/d5f/f6d [0,4194304] 0 2024-04-25T17:19:09.692 INFO:tasks.workunit.client.0.smithi037.stdout:3/305: symlink d8/d31/d32/d3e/l64 0 2024-04-25T17:19:09.694 INFO:tasks.workunit.client.0.smithi037.stdout:3/306: chown d8/d23/d3a/d5d/c1d 52976076 1 2024-04-25T17:19:09.694 INFO:tasks.workunit.client.1.smithi069.stdout:0/229: link d0/da/db/d2c/l34 d0/da/db/d1d/d27/l50 0 2024-04-25T17:19:09.699 INFO:tasks.workunit.client.1.smithi069.stdout:7/294: write d4/d3e/f41 [4507678,8262] 0 2024-04-25T17:19:09.702 INFO:tasks.workunit.client.0.smithi037.stdout:3/307: dwrite d8/d23/f54 [0,4194304] 0 2024-04-25T17:19:09.702 INFO:tasks.workunit.client.0.smithi037.stdout:8/389: mkdir d5/db/d23/d78 0 2024-04-25T17:19:09.704 INFO:tasks.workunit.client.1.smithi069.stdout:2/238: mknod d0/c4d 0 2024-04-25T17:19:09.705 INFO:tasks.workunit.client.1.smithi069.stdout:2/239: write d0/f17 [9025744,95398] 0 2024-04-25T17:19:09.707 INFO:tasks.workunit.client.0.smithi037.stdout:7/503: creat d5/d14/d31/fb4 x:0 0 0 2024-04-25T17:19:09.710 INFO:tasks.workunit.client.1.smithi069.stdout:1/282: rename d1/d4/l21 to d1/d43/d35/l50 0 2024-04-25T17:19:09.714 INFO:tasks.workunit.client.1.smithi069.stdout:7/295: symlink d4/d18/d3f/l67 0 2024-04-25T17:19:09.715 INFO:tasks.workunit.client.0.smithi037.stdout:3/308: creat d8/d23/d3a/d5d/f65 x:0 0 0 2024-04-25T17:19:09.715 INFO:tasks.workunit.client.0.smithi037.stdout:3/309: write d8/d23/d3a/f50 [152913,77853] 0 2024-04-25T17:19:09.715 INFO:tasks.workunit.client.0.smithi037.stdout:3/310: read - d8/d31/f47 zero size 2024-04-25T17:19:09.716 INFO:tasks.workunit.client.1.smithi069.stdout:0/230: dread d0/da/db/fe [0,4194304] 0 2024-04-25T17:19:09.716 INFO:tasks.workunit.client.1.smithi069.stdout:8/236: creat d37/f50 x:0 0 0 2024-04-25T17:19:09.719 INFO:tasks.workunit.client.0.smithi037.stdout:8/390: link f4 d5/db/d23/d58/f79 0 2024-04-25T17:19:09.720 INFO:tasks.workunit.client.1.smithi069.stdout:2/240: symlink d0/d1/d1d/d28/l4e 0 2024-04-25T17:19:09.721 INFO:tasks.workunit.client.0.smithi037.stdout:3/311: mkdir d8/d23/d38/d66 0 2024-04-25T17:19:09.723 INFO:tasks.workunit.client.1.smithi069.stdout:9/312: rename d2/da/d14/f46 to d2/da/d14/d23/d65/f73 0 2024-04-25T17:19:09.725 INFO:tasks.workunit.client.1.smithi069.stdout:1/283: symlink d1/d4/d6/l51 0 2024-04-25T17:19:09.726 INFO:tasks.workunit.client.1.smithi069.stdout:1/284: truncate d1/d19/f47 623497 0 2024-04-25T17:19:09.727 INFO:tasks.workunit.client.1.smithi069.stdout:7/296: rmdir d4/d1a 39 2024-04-25T17:19:09.727 INFO:tasks.workunit.client.1.smithi069.stdout:9/313: dread d2/da/dd/d1e/f26 [0,4194304] 0 2024-04-25T17:19:09.727 INFO:tasks.workunit.client.1.smithi069.stdout:7/297: fdatasync d4/d3e/f62 0 2024-04-25T17:19:09.728 INFO:tasks.workunit.client.0.smithi037.stdout:3/312: symlink d8/d23/d3a/l67 0 2024-04-25T17:19:09.728 INFO:tasks.workunit.client.1.smithi069.stdout:1/285: write d1/df/d17/f2d [5101250,16394] 0 2024-04-25T17:19:09.728 INFO:tasks.workunit.client.0.smithi037.stdout:3/313: fdatasync d8/d57/f5e 0 2024-04-25T17:19:09.731 INFO:tasks.workunit.client.1.smithi069.stdout:0/231: rmdir d0/da/db/d2c 39 2024-04-25T17:19:09.733 INFO:tasks.workunit.client.1.smithi069.stdout:2/241: creat d0/d1/f4f x:0 0 0 2024-04-25T17:19:09.734 INFO:tasks.workunit.client.1.smithi069.stdout:2/242: read - d0/f44 zero size 2024-04-25T17:19:09.735 INFO:tasks.workunit.client.1.smithi069.stdout:5/277: sync 2024-04-25T17:19:09.737 INFO:tasks.workunit.client.0.smithi037.stdout:3/314: creat d8/d4c/f68 x:0 0 0 2024-04-25T17:19:09.738 INFO:tasks.workunit.client.0.smithi037.stdout:3/315: write d8/d23/d3a/f4f [278182,73959] 0 2024-04-25T17:19:09.738 INFO:tasks.workunit.client.1.smithi069.stdout:6/247: dwrite d2/d7/fc [4194304,4194304] 0 2024-04-25T17:19:09.738 INFO:tasks.workunit.client.1.smithi069.stdout:7/298: unlink d4/d18/l2e 0 2024-04-25T17:19:09.740 INFO:tasks.workunit.client.1.smithi069.stdout:7/299: write d4/d6/d14/f48 [664164,17933] 0 2024-04-25T17:19:09.741 INFO:tasks.workunit.client.1.smithi069.stdout:9/314: mkdir d2/da/dd/de/d74 0 2024-04-25T17:19:09.742 INFO:tasks.workunit.client.1.smithi069.stdout:9/315: chown d2/da/dd/d1e/d40/l53 15582057 1 2024-04-25T17:19:09.742 INFO:tasks.workunit.client.0.smithi037.stdout:1/492: truncate dc/f10 3985760 0 2024-04-25T17:19:09.744 INFO:tasks.workunit.client.0.smithi037.stdout:3/316: dwrite d8/d23/f54 [0,4194304] 0 2024-04-25T17:19:09.744 INFO:tasks.workunit.client.1.smithi069.stdout:8/237: unlink ld 0 2024-04-25T17:19:09.745 INFO:tasks.workunit.client.1.smithi069.stdout:4/264: write db/d15/d20/f2e [2016899,41971] 0 2024-04-25T17:19:09.747 INFO:tasks.workunit.client.1.smithi069.stdout:4/265: fdatasync db/d15/d20/d38/d3c/d43/d48/d49/f56 0 2024-04-25T17:19:09.750 INFO:tasks.workunit.client.1.smithi069.stdout:0/232: readlink d0/da/db/l28 0 2024-04-25T17:19:09.753 INFO:tasks.workunit.client.1.smithi069.stdout:2/243: creat d0/d1/d1d/d28/f50 x:0 0 0 2024-04-25T17:19:09.758 INFO:tasks.workunit.client.1.smithi069.stdout:6/248: creat d2/d2e/d35/f50 x:0 0 0 2024-04-25T17:19:09.758 INFO:tasks.workunit.client.0.smithi037.stdout:0/509: truncate d9/d14/f3d 3998480 0 2024-04-25T17:19:09.759 INFO:tasks.workunit.client.1.smithi069.stdout:6/249: truncate d2/d7/f44 2423 0 2024-04-25T17:19:09.759 INFO:tasks.workunit.client.0.smithi037.stdout:7/504: write d5/f46 [929429,14634] 0 2024-04-25T17:19:09.763 INFO:tasks.workunit.client.1.smithi069.stdout:9/316: write d2/da/d14/d23/d65/f73 [4245634,40642] 0 2024-04-25T17:19:09.769 INFO:tasks.workunit.client.1.smithi069.stdout:4/266: unlink db/d15/d26/f28 0 2024-04-25T17:19:09.770 INFO:tasks.workunit.client.0.smithi037.stdout:8/391: truncate d5/db/d23/f1e 7180655 0 2024-04-25T17:19:09.773 INFO:tasks.workunit.client.1.smithi069.stdout:5/278: mknod d13/d17/d29/d30/d55/c5a 0 2024-04-25T17:19:09.774 INFO:tasks.workunit.client.0.smithi037.stdout:8/392: dread d5/d6a/f3f [0,4194304] 0 2024-04-25T17:19:09.777 INFO:tasks.workunit.client.1.smithi069.stdout:7/300: creat d4/d1a/d34/f68 x:0 0 0 2024-04-25T17:19:09.780 INFO:tasks.workunit.client.1.smithi069.stdout:9/317: creat d2/da/d14/d23/d65/f75 x:0 0 0 2024-04-25T17:19:09.780 INFO:tasks.workunit.client.0.smithi037.stdout:2/445: sync 2024-04-25T17:19:09.780 INFO:tasks.workunit.client.1.smithi069.stdout:7/301: dread d4/d1a/f24 [0,4194304] 0 2024-04-25T17:19:09.780 INFO:tasks.workunit.client.1.smithi069.stdout:9/318: fdatasync d2/da/d14/f18 0 2024-04-25T17:19:09.781 INFO:tasks.workunit.client.0.smithi037.stdout:2/446: truncate d0/d16/d3b/f84 657837 0 2024-04-25T17:19:09.786 INFO:tasks.workunit.client.1.smithi069.stdout:4/267: symlink db/d15/d20/d38/d3c/d43/d48/d49/l5b 0 2024-04-25T17:19:09.788 INFO:tasks.workunit.client.1.smithi069.stdout:0/233: rename d0/da/db/d1d/d27/l50 to d0/da/d24/l51 0 2024-04-25T17:19:09.792 INFO:tasks.workunit.client.1.smithi069.stdout:4/268: dwrite db/d22/d24/d41/f4f [0,4194304] 0 2024-04-25T17:19:09.793 INFO:tasks.workunit.client.1.smithi069.stdout:6/250: mkdir d2/d51 0 2024-04-25T17:19:09.806 INFO:tasks.workunit.client.1.smithi069.stdout:9/319: mkdir d2/da/d5f/d76 0 2024-04-25T17:19:09.806 INFO:tasks.workunit.client.1.smithi069.stdout:1/286: getdents d1/d4 0 2024-04-25T17:19:09.806 INFO:tasks.workunit.client.1.smithi069.stdout:8/238: dwrite f33 [0,4194304] 0 2024-04-25T17:19:09.807 INFO:tasks.workunit.client.1.smithi069.stdout:1/287: write d1/d43/d1b/f2c [3632569,125369] 0 2024-04-25T17:19:09.809 INFO:tasks.workunit.client.1.smithi069.stdout:1/288: dread - d1/d4/f4c zero size 2024-04-25T17:19:09.811 INFO:tasks.workunit.client.1.smithi069.stdout:2/244: rename d0/d26/f13 to d0/d1/d1d/d33/f51 0 2024-04-25T17:19:09.812 INFO:tasks.workunit.client.1.smithi069.stdout:2/245: write d0/d1/d1d/f32 [352624,111836] 0 2024-04-25T17:19:09.815 INFO:tasks.workunit.client.1.smithi069.stdout:0/234: mkdir d0/d17/d52 0 2024-04-25T17:19:09.817 INFO:tasks.workunit.client.1.smithi069.stdout:5/279: symlink d13/d17/d19/d1c/l5b 0 2024-04-25T17:19:09.818 INFO:tasks.workunit.client.1.smithi069.stdout:5/280: read - d13/d17/d19/d1c/f45 zero size 2024-04-25T17:19:09.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:09 smithi037 ceph-mon[26472]: pgmap v35: 65 pgs: 65 active+clean; 1.3 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 31 MiB/s rd, 142 MiB/s wr, 282 op/s 2024-04-25T17:19:09.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:09 smithi037 ceph-mon[26472]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:19:09.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:09 smithi037 ceph-mon[26472]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:19:09.827 INFO:tasks.workunit.client.0.smithi037.stdout:7/505: mkdir d5/d15/d17/d1b/da2/daf/d80/db5 0 2024-04-25T17:19:09.828 INFO:tasks.workunit.client.0.smithi037.stdout:7/506: write d5/f55 [2174679,127244] 0 2024-04-25T17:19:09.830 INFO:tasks.workunit.client.1.smithi069.stdout:8/239: creat d37/d47/d48/f51 x:0 0 0 2024-04-25T17:19:09.830 INFO:tasks.workunit.client.1.smithi069.stdout:8/240: chown f13 15554 1 2024-04-25T17:19:09.833 INFO:tasks.workunit.client.1.smithi069.stdout:6/251: dread d2/f21 [0,4194304] 0 2024-04-25T17:19:09.833 INFO:tasks.workunit.client.1.smithi069.stdout:6/252: chown d2/d2e/d35/d48 42 1 2024-04-25T17:19:09.834 INFO:tasks.workunit.client.1.smithi069.stdout:6/253: write d2/fe [4773770,52870] 0 2024-04-25T17:19:09.837 INFO:tasks.workunit.client.1.smithi069.stdout:2/246: dread d0/d1/fe [0,4194304] 0 2024-04-25T17:19:09.851 INFO:tasks.workunit.client.1.smithi069.stdout:3/360: sync 2024-04-25T17:19:09.857 INFO:tasks.workunit.client.1.smithi069.stdout:6/254: dread d2/f14 [0,4194304] 0 2024-04-25T17:19:09.876 INFO:tasks.workunit.client.1.smithi069.stdout:6/255: dread d2/d7/f12 [0,4194304] 0 2024-04-25T17:19:09.895 INFO:tasks.workunit.client.0.smithi037.stdout:8/393: creat d5/d6a/f7a x:0 0 0 2024-04-25T17:19:09.905 INFO:tasks.workunit.client.1.smithi069.stdout:4/269: sync 2024-04-25T17:19:09.905 INFO:tasks.workunit.client.1.smithi069.stdout:4/270: truncate db/f21 1314936 0 2024-04-25T17:19:09.911 INFO:tasks.workunit.client.0.smithi037.stdout:0/510: mkdir d9/d14/d28/d48/da9 0 2024-04-25T17:19:09.912 INFO:tasks.workunit.client.1.smithi069.stdout:2/247: mknod d0/d26/d10/d43/d47/c52 0 2024-04-25T17:19:09.913 INFO:tasks.workunit.client.1.smithi069.stdout:2/248: fdatasync d0/d1/f20 0 2024-04-25T17:19:09.914 INFO:tasks.workunit.client.1.smithi069.stdout:2/249: chown d0/d1/l27 83 1 2024-04-25T17:19:09.922 INFO:tasks.workunit.client.0.smithi037.stdout:8/394: symlink d5/db/d18/d3b/d50/d51/l7b 0 2024-04-25T17:19:09.923 INFO:tasks.workunit.client.1.smithi069.stdout:0/235: symlink d0/da/db/d2c/l53 0 2024-04-25T17:19:09.925 INFO:tasks.workunit.client.0.smithi037.stdout:2/447: unlink d0/la 0 2024-04-25T17:19:09.926 INFO:tasks.workunit.client.1.smithi069.stdout:7/302: getdents d4/d6/d14/d5a/d5e 0 2024-04-25T17:19:09.927 INFO:tasks.workunit.client.1.smithi069.stdout:7/303: fdatasync d4/d1a/d34/f68 0 2024-04-25T17:19:09.934 INFO:tasks.workunit.client.0.smithi037.stdout:3/317: dwrite d8/f37 [0,4194304] 0 2024-04-25T17:19:09.935 INFO:tasks.workunit.client.0.smithi037.stdout:0/511: symlink d9/df/d32/d35/d66/d7a/laa 0 2024-04-25T17:19:09.941 INFO:tasks.workunit.client.0.smithi037.stdout:8/395: rmdir d5/db/d18/d3b/d50/d51/d5e 39 2024-04-25T17:19:09.941 INFO:tasks.workunit.client.0.smithi037.stdout:8/396: fsync d5/db/d23/d42/f43 0 2024-04-25T17:19:09.944 INFO:tasks.workunit.client.1.smithi069.stdout:2/250: dread d0/d1/d1d/d33/f51 [0,4194304] 0 2024-04-25T17:19:09.947 INFO:tasks.workunit.client.1.smithi069.stdout:7/304: dread d4/d6/d14/d15/f17 [0,4194304] 0 2024-04-25T17:19:09.949 INFO:tasks.workunit.client.0.smithi037.stdout:1/493: getdents dc/d1c/d57/d4d/d6a/d86/d91 0 2024-04-25T17:19:09.956 INFO:tasks.workunit.client.0.smithi037.stdout:1/494: dwrite dc/f34 [0,4194304] 0 2024-04-25T17:19:09.958 INFO:tasks.workunit.client.1.smithi069.stdout:4/271: getdents db/d4b 0 2024-04-25T17:19:09.976 INFO:tasks.workunit.client.1.smithi069.stdout:4/272: truncate db/f14 3781725 0 2024-04-25T17:19:09.977 INFO:tasks.workunit.client.1.smithi069.stdout:4/273: write db/d15/d26/f3b [768004,62287] 0 2024-04-25T17:19:09.978 INFO:tasks.workunit.client.0.smithi037.stdout:3/318: mkdir d8/d31/d32/d69 0 2024-04-25T17:19:09.978 INFO:tasks.workunit.client.1.smithi069.stdout:4/274: truncate db/f52 555731 0 2024-04-25T17:19:09.979 INFO:tasks.workunit.client.1.smithi069.stdout:4/275: write db/d15/d42/f45 [5202975,62030] 0 2024-04-25T17:19:09.981 INFO:tasks.workunit.client.1.smithi069.stdout:7/305: creat d4/d6/d14/d3d/f69 x:0 0 0 2024-04-25T17:19:09.983 INFO:tasks.workunit.client.0.smithi037.stdout:3/319: truncate d8/d31/d32/d3e/f42 910165 0 2024-04-25T17:19:09.984 INFO:tasks.workunit.client.0.smithi037.stdout:3/320: fdatasync d8/f58 0 2024-04-25T17:19:09.986 INFO:tasks.workunit.client.1.smithi069.stdout:4/276: rmdir db/d15/d26 39 2024-04-25T17:19:09.989 INFO:tasks.workunit.client.1.smithi069.stdout:4/277: unlink db/d15/d20/d38/d3c/d43/c44 0 2024-04-25T17:19:09.990 INFO:tasks.workunit.client.0.smithi037.stdout:8/397: rename d5/d26/l39 to d5/d6a/l7c 0 2024-04-25T17:19:09.991 INFO:tasks.workunit.client.0.smithi037.stdout:3/321: truncate f5 704423 0 2024-04-25T17:19:09.993 INFO:tasks.workunit.client.1.smithi069.stdout:4/278: write db/d15/d26/f29 [2720956,48082] 0 2024-04-25T17:19:09.995 INFO:tasks.workunit.client.0.smithi037.stdout:3/322: dread d8/d23/d3a/f4f [0,4194304] 0 2024-04-25T17:19:09.998 INFO:tasks.workunit.client.0.smithi037.stdout:8/398: stat d5/db/d18/d3b/d50/d51/d5e 0 2024-04-25T17:19:10.002 INFO:tasks.workunit.client.0.smithi037.stdout:3/323: dwrite d8/d23/d3a/d5d/f20 [0,4194304] 0 2024-04-25T17:19:10.003 INFO:tasks.workunit.client.0.smithi037.stdout:3/324: chown d8/d31/f48 2 1 2024-04-25T17:19:10.004 INFO:tasks.workunit.client.0.smithi037.stdout:8/399: creat d5/db/d18/d3b/d50/f7d x:0 0 0 2024-04-25T17:19:10.004 INFO:tasks.workunit.client.0.smithi037.stdout:3/325: readlink d8/d23/d3a/l4d 0 2024-04-25T17:19:10.006 INFO:tasks.workunit.client.0.smithi037.stdout:8/400: read d5/f27 [3140729,64973] 0 2024-04-25T17:19:10.008 INFO:tasks.workunit.client.0.smithi037.stdout:8/401: dread - d5/db/d18/d3b/d50/f56 zero size 2024-04-25T17:19:10.013 INFO:tasks.workunit.client.0.smithi037.stdout:3/326: dwrite d8/d23/d3a/d5d/f65 [0,4194304] 0 2024-04-25T17:19:10.017 INFO:tasks.workunit.client.0.smithi037.stdout:5/537: sync 2024-04-25T17:19:10.019 INFO:tasks.workunit.client.0.smithi037.stdout:8/402: rename d5/db/d18/d3b/d50/d51/d5e to d5/db/d7e 0 2024-04-25T17:19:10.020 INFO:tasks.workunit.client.0.smithi037.stdout:3/327: creat d8/d23/d38/d66/f6a x:0 0 0 2024-04-25T17:19:10.025 INFO:tasks.workunit.client.0.smithi037.stdout:8/403: rename d5/da/l40 to d5/db/d59/l7f 0 2024-04-25T17:19:10.032 INFO:tasks.workunit.client.1.smithi069.stdout:3/361: mknod d8/d16/d1a/c7d 0 2024-04-25T17:19:10.035 INFO:tasks.workunit.client.1.smithi069.stdout:3/362: creat d8/d16/d1a/d3e/d42/f7e x:0 0 0 2024-04-25T17:19:10.036 INFO:tasks.workunit.client.1.smithi069.stdout:9/320: rename d2/da/d14/c66 to d2/da/dd/de/c77 0 2024-04-25T17:19:10.039 INFO:tasks.workunit.client.1.smithi069.stdout:5/281: rename d13/d17/d19/d20/d2d/d39 to d13/d17/d29/d30/d5c 0 2024-04-25T17:19:10.041 INFO:tasks.workunit.client.1.smithi069.stdout:5/282: truncate d13/d17/d19/d20/f2a 632990 0 2024-04-25T17:19:10.042 INFO:tasks.workunit.client.1.smithi069.stdout:9/321: dwrite d2/da/dd/d1e/d2e/d35/f38 [0,4194304] 0 2024-04-25T17:19:10.042 INFO:tasks.workunit.client.1.smithi069.stdout:5/283: write fd [2843591,21677] 0 2024-04-25T17:19:10.044 INFO:tasks.workunit.client.0.smithi037.stdout:6/453: sync 2024-04-25T17:19:10.044 INFO:tasks.workunit.client.0.smithi037.stdout:4/646: sync 2024-04-25T17:19:10.044 INFO:tasks.workunit.client.0.smithi037.stdout:9/586: sync 2024-04-25T17:19:10.045 INFO:tasks.workunit.client.1.smithi069.stdout:8/241: rename c17 to d37/c52 0 2024-04-25T17:19:10.046 INFO:tasks.workunit.client.0.smithi037.stdout:6/454: dread - db/f98 zero size 2024-04-25T17:19:10.050 INFO:tasks.workunit.client.1.smithi069.stdout:6/256: rename d2/d1e/l3b to d2/d51/l52 0 2024-04-25T17:19:10.052 INFO:tasks.workunit.client.1.smithi069.stdout:6/257: write d2/fe [4258241,19537] 0 2024-04-25T17:19:10.052 INFO:tasks.workunit.client.1.smithi069.stdout:8/242: dwrite d37/d47/d48/f51 [0,4194304] 0 2024-04-25T17:19:10.054 INFO:tasks.workunit.client.1.smithi069.stdout:9/322: creat d2/da/dd/de/d74/f78 x:0 0 0 2024-04-25T17:19:10.054 INFO:tasks.workunit.client.1.smithi069.stdout:9/323: read - d2/f5b zero size 2024-04-25T17:19:10.057 INFO:tasks.workunit.client.1.smithi069.stdout:9/324: truncate d2/da/dd/de/d74/f78 328251 0 2024-04-25T17:19:10.058 INFO:tasks.workunit.client.0.smithi037.stdout:6/455: symlink db/d1d/d20/d85/la0 0 2024-04-25T17:19:10.062 INFO:tasks.workunit.client.0.smithi037.stdout:4/647: creat d7/d7e/d1e/fcf x:0 0 0 2024-04-25T17:19:10.062 INFO:tasks.workunit.client.1.smithi069.stdout:9/325: dwrite d2/f5b [0,4194304] 0 2024-04-25T17:19:10.065 INFO:tasks.workunit.client.0.smithi037.stdout:6/456: dwrite db/d1d/f1f [0,4194304] 0 2024-04-25T17:19:10.066 INFO:tasks.workunit.client.1.smithi069.stdout:8/243: chown f2b 955681011 1 2024-04-25T17:19:10.067 INFO:tasks.workunit.client.0.smithi037.stdout:6/457: truncate db/d26/f93 432008 0 2024-04-25T17:19:10.069 INFO:tasks.workunit.client.0.smithi037.stdout:4/648: readlink d7/d7e/d45/d4f/lcd 0 2024-04-25T17:19:10.069 INFO:tasks.workunit.client.1.smithi069.stdout:9/326: dwrite d2/da/dd/de/f4a [0,4194304] 0 2024-04-25T17:19:10.070 INFO:tasks.workunit.client.0.smithi037.stdout:4/649: chown d7/d7e/d1e/d2b/d35/lb3 29 1 2024-04-25T17:19:10.076 INFO:tasks.workunit.client.1.smithi069.stdout:5/284: dread d13/d17/f1b [0,4194304] 0 2024-04-25T17:19:10.078 INFO:tasks.workunit.client.1.smithi069.stdout:6/258: dwrite d2/f4e [4194304,4194304] 0 2024-04-25T17:19:10.079 INFO:tasks.workunit.client.0.smithi037.stdout:6/458: mknod db/d1d/d20/ca1 0 2024-04-25T17:19:10.086 INFO:tasks.workunit.client.0.smithi037.stdout:4/650: rename d7/d7e/d1e/d2b/d35/d39/f3f to d7/d7e/d1e/dae/fd0 0 2024-04-25T17:19:10.098 INFO:tasks.workunit.client.0.smithi037.stdout:8/404: fsync d5/db/d23/f1e 0 2024-04-25T17:19:10.098 INFO:tasks.workunit.client.1.smithi069.stdout:6/259: stat d2/d7/c15 0 2024-04-25T17:19:10.099 INFO:tasks.workunit.client.0.smithi037.stdout:8/405: chown d5/db/d18/c70 30282 1 2024-04-25T17:19:10.101 INFO:tasks.workunit.client.0.smithi037.stdout:7/507: sync 2024-04-25T17:19:10.108 INFO:tasks.workunit.client.0.smithi037.stdout:2/448: dwrite d0/f9 [0,4194304] 0 2024-04-25T17:19:10.109 INFO:tasks.workunit.client.0.smithi037.stdout:2/449: chown d0/f51 468728 1 2024-04-25T17:19:10.110 INFO:tasks.workunit.client.0.smithi037.stdout:8/406: mknod d5/db/d59/c80 0 2024-04-25T17:19:10.114 INFO:tasks.workunit.client.1.smithi069.stdout:8/244: link l24 d37/l53 0 2024-04-25T17:19:10.115 INFO:tasks.workunit.client.0.smithi037.stdout:0/512: write d9/d14/f9a [75731,36738] 0 2024-04-25T17:19:10.115 INFO:tasks.workunit.client.1.smithi069.stdout:8/245: read - d37/f3a zero size 2024-04-25T17:19:10.116 INFO:tasks.workunit.client.0.smithi037.stdout:6/459: dread - db/d26/d2e/d7d/f76 zero size 2024-04-25T17:19:10.118 INFO:tasks.workunit.client.1.smithi069.stdout:0/236: dwrite d0/f6 [0,4194304] 0 2024-04-25T17:19:10.119 INFO:tasks.workunit.client.0.smithi037.stdout:8/407: dwrite d5/f6f [0,4194304] 0 2024-04-25T17:19:10.120 INFO:tasks.workunit.client.1.smithi069.stdout:9/327: rename d2/da/dd/d1e/d2e/f70 to d2/da/d14/f79 0 2024-04-25T17:19:10.120 INFO:tasks.workunit.client.0.smithi037.stdout:8/408: write d5/db/d59/f5f [434381,69225] 0 2024-04-25T17:19:10.121 INFO:tasks.workunit.client.0.smithi037.stdout:2/450: creat d0/d16/d20/d59/f8b x:0 0 0 2024-04-25T17:19:10.126 INFO:tasks.workunit.client.1.smithi069.stdout:6/260: truncate d2/f10 4153784 0 2024-04-25T17:19:10.129 INFO:tasks.workunit.client.0.smithi037.stdout:0/513: mknod d9/df/cab 0 2024-04-25T17:19:10.130 INFO:tasks.workunit.client.0.smithi037.stdout:0/514: chown d9/c91 5224 1 2024-04-25T17:19:10.131 INFO:tasks.workunit.client.1.smithi069.stdout:8/246: mkdir d37/d47/d54 0 2024-04-25T17:19:10.135 INFO:tasks.workunit.client.1.smithi069.stdout:9/328: creat d2/da/dd/d1e/d2e/d35/f7a x:0 0 0 2024-04-25T17:19:10.136 INFO:tasks.workunit.client.0.smithi037.stdout:2/451: unlink d0/d16/d20/d55/l5e 0 2024-04-25T17:19:10.138 INFO:tasks.workunit.client.0.smithi037.stdout:2/452: read d0/d16/f1b [1528284,99684] 0 2024-04-25T17:19:10.139 INFO:tasks.workunit.client.1.smithi069.stdout:6/261: creat d2/d1e/d43/f53 x:0 0 0 2024-04-25T17:19:10.142 INFO:tasks.workunit.client.0.smithi037.stdout:2/453: write d0/d16/d68/f73 [1445968,67971] 0 2024-04-25T17:19:10.144 INFO:tasks.workunit.client.1.smithi069.stdout:8/247: unlink d37/d47/d48/f51 0 2024-04-25T17:19:10.144 INFO:tasks.workunit.client.1.smithi069.stdout:8/248: chown f8 83 1 2024-04-25T17:19:10.144 INFO:tasks.workunit.client.0.smithi037.stdout:1/495: dwrite dc/d18/f2b [0,4194304] 0 2024-04-25T17:19:10.145 INFO:tasks.workunit.client.0.smithi037.stdout:2/454: write d0/d16/d20/f3d [1354796,122677] 0 2024-04-25T17:19:10.146 INFO:tasks.workunit.client.0.smithi037.stdout:1/496: write dc/d24/f8a [2489370,103257] 0 2024-04-25T17:19:10.147 INFO:tasks.workunit.client.1.smithi069.stdout:8/249: dread f14 [0,4194304] 0 2024-04-25T17:19:10.147 INFO:tasks.workunit.client.0.smithi037.stdout:2/455: write d0/d15/f36 [377476,111086] 0 2024-04-25T17:19:10.149 INFO:tasks.workunit.client.1.smithi069.stdout:0/237: mkdir d0/da/d54 0 2024-04-25T17:19:10.156 INFO:tasks.workunit.client.0.smithi037.stdout:1/497: dread dc/d1c/d57/d4d/f7e [0,4194304] 0 2024-04-25T17:19:10.156 INFO:tasks.workunit.client.1.smithi069.stdout:6/262: creat d2/d51/f54 x:0 0 0 2024-04-25T17:19:10.158 INFO:tasks.workunit.client.1.smithi069.stdout:6/263: write d2/d2e/d35/d48/f4f [8278844,9821] 0 2024-04-25T17:19:10.159 INFO:tasks.workunit.client.1.smithi069.stdout:1/289: symlink d1/d4/l52 0 2024-04-25T17:19:10.159 INFO:tasks.workunit.client.0.smithi037.stdout:2/456: dwrite d0/f2d [0,4194304] 0 2024-04-25T17:19:10.159 INFO:tasks.workunit.client.0.smithi037.stdout:2/457: chown d0/d16/d3b/f84 21 1 2024-04-25T17:19:10.160 INFO:tasks.workunit.client.1.smithi069.stdout:1/290: truncate d1/d19/f49 2582 0 2024-04-25T17:19:10.163 INFO:tasks.workunit.client.1.smithi069.stdout:1/291: read d1/f9 [1765594,116522] 0 2024-04-25T17:19:10.164 INFO:tasks.workunit.client.1.smithi069.stdout:1/292: write d1/d43/f3a [1141422,100591] 0 2024-04-25T17:19:10.169 INFO:tasks.workunit.client.0.smithi037.stdout:2/458: dwrite d0/d16/d20/d55/f6f [4194304,4194304] 0 2024-04-25T17:19:10.171 INFO:tasks.workunit.client.0.smithi037.stdout:2/459: truncate d0/d16/d3b/f5b 747789 0 2024-04-25T17:19:10.171 INFO:tasks.workunit.client.0.smithi037.stdout:0/515: dread d9/fa [0,4194304] 0 2024-04-25T17:19:10.175 INFO:tasks.workunit.client.1.smithi069.stdout:6/264: symlink d2/d2e/d35/l55 0 2024-04-25T17:19:10.175 INFO:tasks.workunit.client.1.smithi069.stdout:6/265: fdatasync d2/f20 0 2024-04-25T17:19:10.176 INFO:tasks.workunit.client.1.smithi069.stdout:4/279: truncate db/d15/d20/f2e 4442588 0 2024-04-25T17:19:10.181 INFO:tasks.workunit.client.1.smithi069.stdout:8/250: mknod d37/c55 0 2024-04-25T17:19:10.182 INFO:tasks.workunit.client.0.smithi037.stdout:9/587: mknod d1/d5/cc7 0 2024-04-25T17:19:10.182 INFO:tasks.workunit.client.0.smithi037.stdout:2/460: stat d0/d16/l49 0 2024-04-25T17:19:10.185 INFO:tasks.workunit.client.0.smithi037.stdout:1/498: unlink dc/c11 0 2024-04-25T17:19:10.186 INFO:tasks.workunit.client.1.smithi069.stdout:1/293: creat d1/d43/d35/f53 x:0 0 0 2024-04-25T17:19:10.188 INFO:tasks.workunit.client.0.smithi037.stdout:0/516: creat d9/d14/d28/d48/d58/fac x:0 0 0 2024-04-25T17:19:10.189 INFO:tasks.workunit.client.0.smithi037.stdout:9/588: truncate d1/d5/f58 1128289 0 2024-04-25T17:19:10.189 INFO:tasks.workunit.client.0.smithi037.stdout:5/538: write d7/d43/f16 [3168976,16484] 0 2024-04-25T17:19:10.192 INFO:tasks.workunit.client.0.smithi037.stdout:2/461: creat d0/d16/d20/d59/d6a/f8c x:0 0 0 2024-04-25T17:19:10.196 INFO:tasks.workunit.client.1.smithi069.stdout:6/266: mkdir d2/d1e/d3f/d56 0 2024-04-25T17:19:10.197 INFO:tasks.workunit.client.0.smithi037.stdout:3/328: truncate d8/f26 941023 0 2024-04-25T17:19:10.197 INFO:tasks.workunit.client.0.smithi037.stdout:5/539: dwrite d7/d25/d4f/f82 [0,4194304] 0 2024-04-25T17:19:10.201 INFO:tasks.workunit.client.0.smithi037.stdout:0/517: unlink d9/df/d32/d39/la3 0 2024-04-25T17:19:10.202 INFO:tasks.workunit.client.0.smithi037.stdout:9/589: readlink d1/d48/d68/d26/d81/d9c/l6b 0 2024-04-25T17:19:10.203 INFO:tasks.workunit.client.0.smithi037.stdout:9/590: chown d1/d48/d68/d4e/f67 13035 1 2024-04-25T17:19:10.203 INFO:tasks.workunit.client.1.smithi069.stdout:8/251: readlink l2a 0 2024-04-25T17:19:10.204 INFO:tasks.workunit.client.0.smithi037.stdout:9/591: chown d1/d5/dc/d3c/d3e/f59 0 1 2024-04-25T17:19:10.205 INFO:tasks.workunit.client.0.smithi037.stdout:2/462: creat d0/d16/d20/f8d x:0 0 0 2024-04-25T17:19:10.205 INFO:tasks.workunit.client.0.smithi037.stdout:9/592: chown d1/d48/d68/d26/cb9 362973 1 2024-04-25T17:19:10.206 INFO:tasks.workunit.client.1.smithi069.stdout:1/294: symlink d1/d43/d1b/d32/d4a/l54 0 2024-04-25T17:19:10.208 INFO:tasks.workunit.client.0.smithi037.stdout:9/593: dread d1/d5/dc/fa5 [0,4194304] 0 2024-04-25T17:19:10.209 INFO:tasks.workunit.client.1.smithi069.stdout:8/252: dwrite f33 [0,4194304] 0 2024-04-25T17:19:10.210 INFO:tasks.workunit.client.1.smithi069.stdout:8/253: dread - d37/f50 zero size 2024-04-25T17:19:10.210 INFO:tasks.workunit.client.1.smithi069.stdout:9/329: getdents d2/da/dd/d1e/d40 0 2024-04-25T17:19:10.213 INFO:tasks.workunit.client.0.smithi037.stdout:1/499: rename dc/d18/d64/c6f to dc/d1c/d57/d4d/d6a/d86/d9b/cae 0 2024-04-25T17:19:10.214 INFO:tasks.workunit.client.1.smithi069.stdout:3/363: truncate d8/d2a/f43 348628 0 2024-04-25T17:19:10.214 INFO:tasks.workunit.client.1.smithi069.stdout:3/364: dread - d8/d2a/f7c zero size 2024-04-25T17:19:10.215 INFO:tasks.workunit.client.1.smithi069.stdout:3/365: stat d8/d16/d1a/d2c/f63 0 2024-04-25T17:19:10.215 INFO:tasks.workunit.client.1.smithi069.stdout:6/267: creat d2/d1e/d43/f57 x:0 0 0 2024-04-25T17:19:10.217 INFO:tasks.workunit.client.1.smithi069.stdout:6/268: truncate d2/d1e/f2b 573834 0 2024-04-25T17:19:10.218 INFO:tasks.workunit.client.0.smithi037.stdout:5/540: mkdir d7/d25/d4f/da7 0 2024-04-25T17:19:10.218 INFO:tasks.workunit.client.1.smithi069.stdout:6/269: read d2/d7/f44 [2121,22236] 0 2024-04-25T17:19:10.218 INFO:tasks.workunit.client.1.smithi069.stdout:6/270: chown d2/d1e/d3f/d56 7 1 2024-04-25T17:19:10.224 INFO:tasks.workunit.client.0.smithi037.stdout:9/594: stat d1/d48/l9e 0 2024-04-25T17:19:10.227 INFO:tasks.workunit.client.0.smithi037.stdout:0/518: rename d9/df/d32/d35/d66 to d9/d71/dad 0 2024-04-25T17:19:10.228 INFO:tasks.workunit.client.1.smithi069.stdout:3/366: creat d8/d16/d1a/d3e/f7f x:0 0 0 2024-04-25T17:19:10.229 INFO:tasks.workunit.client.1.smithi069.stdout:2/251: creat d0/f53 x:0 0 0 2024-04-25T17:19:10.230 INFO:tasks.workunit.client.1.smithi069.stdout:2/252: chown d0/d26/f2b 179901 1 2024-04-25T17:19:10.230 INFO:tasks.workunit.client.0.smithi037.stdout:1/500: mkdir dc/d1c/d57/d22/d36/d74/daf 0 2024-04-25T17:19:10.232 INFO:tasks.workunit.client.1.smithi069.stdout:6/271: mkdir d2/d2e/d58 0 2024-04-25T17:19:10.234 INFO:tasks.workunit.client.1.smithi069.stdout:3/367: dwrite d8/d39/f5e [0,4194304] 0 2024-04-25T17:19:10.236 INFO:tasks.workunit.client.0.smithi037.stdout:9/595: mkdir d1/d5/dc/da9/dc8 0 2024-04-25T17:19:10.238 INFO:tasks.workunit.client.1.smithi069.stdout:1/295: dread d1/f9 [4194304,4194304] 0 2024-04-25T17:19:10.238 INFO:tasks.workunit.client.0.smithi037.stdout:0/519: symlink d9/d71/dad/lae 0 2024-04-25T17:19:10.239 INFO:tasks.workunit.client.0.smithi037.stdout:0/520: chown d9/df/d32/d39/d68/f93 8438637 1 2024-04-25T17:19:10.241 INFO:tasks.workunit.client.0.smithi037.stdout:1/501: creat dc/d1c/fb0 x:0 0 0 2024-04-25T17:19:10.242 INFO:tasks.workunit.client.1.smithi069.stdout:2/253: creat d0/d26/f54 x:0 0 0 2024-04-25T17:19:10.243 INFO:tasks.workunit.client.0.smithi037.stdout:5/541: mkdir d7/d12/da8 0 2024-04-25T17:19:10.245 INFO:tasks.workunit.client.1.smithi069.stdout:8/254: rename d37/l3e to d37/l56 0 2024-04-25T17:19:10.245 INFO:tasks.workunit.client.1.smithi069.stdout:8/255: fsync d37/f41 0 2024-04-25T17:19:10.246 INFO:tasks.workunit.client.0.smithi037.stdout:9/596: creat d1/d5/dc/d38/d8b/fc9 x:0 0 0 2024-04-25T17:19:10.248 INFO:tasks.workunit.client.1.smithi069.stdout:6/272: rename d2/d1e/c39 to d2/d2e/d35/d48/c59 0 2024-04-25T17:19:10.249 INFO:tasks.workunit.client.1.smithi069.stdout:7/306: creat d4/f6a x:0 0 0 2024-04-25T17:19:10.249 INFO:tasks.workunit.client.0.smithi037.stdout:0/521: rmdir d9 39 2024-04-25T17:19:10.250 INFO:tasks.workunit.client.1.smithi069.stdout:7/307: write d4/f58 [309607,116134] 0 2024-04-25T17:19:10.250 INFO:tasks.workunit.client.1.smithi069.stdout:9/330: link d2/da/d14/d23/c6f d2/da/d14/d23/c7b 0 2024-04-25T17:19:10.254 INFO:tasks.workunit.client.0.smithi037.stdout:1/502: unlink dc/d1c/d57/d4d/f87 0 2024-04-25T17:19:10.254 INFO:tasks.workunit.client.1.smithi069.stdout:5/285: dwrite f6 [0,4194304] 0 2024-04-25T17:19:10.255 INFO:tasks.workunit.client.1.smithi069.stdout:3/368: symlink d8/d16/d31/l80 0 2024-04-25T17:19:10.257 INFO:tasks.workunit.client.1.smithi069.stdout:1/296: creat d1/d19/f55 x:0 0 0 2024-04-25T17:19:10.257 INFO:tasks.workunit.client.1.smithi069.stdout:3/369: dread d8/d39/f5a [0,4194304] 0 2024-04-25T17:19:10.258 INFO:tasks.workunit.client.1.smithi069.stdout:3/370: write d8/d16/d1a/d2c/f35 [16940,8614] 0 2024-04-25T17:19:10.261 INFO:tasks.workunit.client.1.smithi069.stdout:2/254: mknod d0/d1/d1d/d28/d31/c55 0 2024-04-25T17:19:10.265 INFO:tasks.workunit.client.0.smithi037.stdout:5/542: dwrite d7/d18/d62/f7e [0,4194304] 0 2024-04-25T17:19:10.270 INFO:tasks.workunit.client.0.smithi037.stdout:4/651: dwrite d7/d7e/d45/fa0 [0,4194304] 0 2024-04-25T17:19:10.273 INFO:tasks.workunit.client.0.smithi037.stdout:9/597: mkdir d1/d5/dc/d3c/dca 0 2024-04-25T17:19:10.277 INFO:tasks.workunit.client.1.smithi069.stdout:6/273: readlink d2/d1e/l38 0 2024-04-25T17:19:10.279 INFO:tasks.workunit.client.0.smithi037.stdout:0/522: mkdir d9/d71/dad/d7a/daf 0 2024-04-25T17:19:10.280 INFO:tasks.workunit.client.1.smithi069.stdout:9/331: stat d2/da/c67 0 2024-04-25T17:19:10.282 INFO:tasks.workunit.client.0.smithi037.stdout:8/409: write d5/db/d18/f19 [1488584,63799] 0 2024-04-25T17:19:10.287 INFO:tasks.workunit.client.0.smithi037.stdout:6/460: write db/d26/d2e/f39 [2401731,79315] 0 2024-04-25T17:19:10.287 INFO:tasks.workunit.client.0.smithi037.stdout:5/543: dread d7/ff [0,4194304] 0 2024-04-25T17:19:10.288 INFO:tasks.workunit.client.0.smithi037.stdout:4/652: mkdir d7/d7e/d1e/dd1 0 2024-04-25T17:19:10.290 INFO:tasks.workunit.client.1.smithi069.stdout:1/297: symlink d1/d4/d6/l56 0 2024-04-25T17:19:10.290 INFO:tasks.workunit.client.0.smithi037.stdout:4/653: chown d7/d7e/d1e/d2b/d35/d39/fac 66106 1 2024-04-25T17:19:10.290 INFO:tasks.workunit.client.0.smithi037.stdout:5/544: write d7/d18/d62/f7e [832670,97470] 0 2024-04-25T17:19:10.291 INFO:tasks.workunit.client.1.smithi069.stdout:1/298: chown d1/d4/de/c27 66521060 1 2024-04-25T17:19:10.291 INFO:tasks.workunit.client.0.smithi037.stdout:9/598: mkdir d1/d5/d2e/d34/daf/dcb 0 2024-04-25T17:19:10.294 INFO:tasks.workunit.client.0.smithi037.stdout:8/410: mkdir d5/d26/d81 0 2024-04-25T17:19:10.296 INFO:tasks.workunit.client.0.smithi037.stdout:8/411: write d5/db/d23/d58/f6e [364799,73794] 0 2024-04-25T17:19:10.298 INFO:tasks.workunit.client.1.smithi069.stdout:3/371: rename d8/f13 to d8/d71/f81 0 2024-04-25T17:19:10.303 INFO:tasks.workunit.client.0.smithi037.stdout:5/545: truncate d7/d18/d62/f8c 299845 0 2024-04-25T17:19:10.305 INFO:tasks.workunit.client.0.smithi037.stdout:9/599: fsync d1/d5/d19/f56 0 2024-04-25T17:19:10.307 INFO:tasks.workunit.client.1.smithi069.stdout:0/238: dwrite d0/da/db/d1d/f20 [0,4194304] 0 2024-04-25T17:19:10.307 INFO:tasks.workunit.client.0.smithi037.stdout:8/412: mknod d5/db/d18/d3b/d50/c82 0 2024-04-25T17:19:10.308 INFO:tasks.workunit.client.0.smithi037.stdout:6/461: dread db/f14 [0,4194304] 0 2024-04-25T17:19:10.313 INFO:tasks.workunit.client.0.smithi037.stdout:0/523: rename d9/df/d32/d35/la6 to d9/lb0 0 2024-04-25T17:19:10.315 INFO:tasks.workunit.client.1.smithi069.stdout:3/372: dread d8/d16/d4b/f79 [0,4194304] 0 2024-04-25T17:19:10.317 INFO:tasks.workunit.client.1.smithi069.stdout:2/255: dread d0/d26/f2b [0,4194304] 0 2024-04-25T17:19:10.318 INFO:tasks.workunit.client.1.smithi069.stdout:2/256: read d0/f15 [185853,16555] 0 2024-04-25T17:19:10.323 INFO:tasks.workunit.client.1.smithi069.stdout:8/256: creat d37/f57 x:0 0 0 2024-04-25T17:19:10.328 INFO:tasks.workunit.client.1.smithi069.stdout:6/274: symlink d2/d7/l5a 0 2024-04-25T17:19:10.330 INFO:tasks.workunit.client.0.smithi037.stdout:5/546: unlink d7/d12/c1d 0 2024-04-25T17:19:10.331 INFO:tasks.workunit.client.1.smithi069.stdout:9/332: getdents d2/da/dd/de/d59 0 2024-04-25T17:19:10.331 INFO:tasks.workunit.client.0.smithi037.stdout:5/547: chown d7/d43/c3e 1269188872 1 2024-04-25T17:19:10.331 INFO:tasks.workunit.client.1.smithi069.stdout:9/333: write d2/da/d14/f19 [1381453,97031] 0 2024-04-25T17:19:10.332 INFO:tasks.workunit.client.0.smithi037.stdout:8/413: creat d5/db/d23/d78/f83 x:0 0 0 2024-04-25T17:19:10.336 INFO:tasks.workunit.client.0.smithi037.stdout:8/414: dread d5/da/f32 [0,4194304] 0 2024-04-25T17:19:10.337 INFO:tasks.workunit.client.1.smithi069.stdout:3/373: rmdir d8/d16/d1a/d38 39 2024-04-25T17:19:10.342 INFO:tasks.workunit.client.0.smithi037.stdout:8/415: dwrite d5/db/d23/f38 [0,4194304] 0 2024-04-25T17:19:10.345 INFO:tasks.workunit.client.1.smithi069.stdout:1/299: creat d1/d43/d35/d4d/f57 x:0 0 0 2024-04-25T17:19:10.346 INFO:tasks.workunit.client.1.smithi069.stdout:1/300: chown d1/d4/d6/f16 12 1 2024-04-25T17:19:10.350 INFO:tasks.workunit.client.1.smithi069.stdout:1/301: dread d1/d4/f2a [0,4194304] 0 2024-04-25T17:19:10.356 INFO:tasks.workunit.client.0.smithi037.stdout:2/463: truncate d0/d16/d20/f3d 21402 0 2024-04-25T17:19:10.356 INFO:tasks.workunit.client.0.smithi037.stdout:2/464: chown d0/d7c 136504 1 2024-04-25T17:19:10.358 INFO:tasks.workunit.client.1.smithi069.stdout:9/334: creat d2/da/dd/de/f7c x:0 0 0 2024-04-25T17:19:10.360 INFO:tasks.workunit.client.0.smithi037.stdout:6/462: rename db/d26/d2e/d82/c8f to db/d26/ca2 0 2024-04-25T17:19:10.364 INFO:tasks.workunit.client.1.smithi069.stdout:3/374: rmdir d8/d16/d1a/d2c/d49/d59 39 2024-04-25T17:19:10.365 INFO:tasks.workunit.client.1.smithi069.stdout:3/375: dread d8/d2a/f55 [0,4194304] 0 2024-04-25T17:19:10.367 INFO:tasks.workunit.client.0.smithi037.stdout:2/465: creat d0/d16/d26/d3e/f8e x:0 0 0 2024-04-25T17:19:10.370 INFO:tasks.workunit.client.0.smithi037.stdout:6/463: rename db/f17 to db/d1d/d20/d85/fa3 0 2024-04-25T17:19:10.371 INFO:tasks.workunit.client.0.smithi037.stdout:1/503: rmdir dc 39 2024-04-25T17:19:10.371 INFO:tasks.workunit.client.1.smithi069.stdout:1/302: creat d1/d43/d1b/d32/d4a/f58 x:0 0 0 2024-04-25T17:19:10.372 INFO:tasks.workunit.client.1.smithi069.stdout:1/303: dread - d1/d4/f4c zero size 2024-04-25T17:19:10.374 INFO:tasks.workunit.client.1.smithi069.stdout:8/257: mknod d37/c58 0 2024-04-25T17:19:10.375 INFO:tasks.workunit.client.1.smithi069.stdout:8/258: truncate f14 4901867 0 2024-04-25T17:19:10.379 INFO:tasks.workunit.client.1.smithi069.stdout:4/280: sync 2024-04-25T17:19:10.379 INFO:tasks.workunit.client.1.smithi069.stdout:5/286: write d13/d17/d19/d20/f22 [77077,17899] 0 2024-04-25T17:19:10.380 INFO:tasks.workunit.client.1.smithi069.stdout:4/281: stat db/d15/d20/d38/d3c/d43/d48/d49 0 2024-04-25T17:19:10.380 INFO:tasks.workunit.client.1.smithi069.stdout:0/239: rmdir d0/d17/d52 0 2024-04-25T17:19:10.381 INFO:tasks.workunit.client.1.smithi069.stdout:8/259: dread f26 [0,4194304] 0 2024-04-25T17:19:10.386 INFO:tasks.workunit.client.1.smithi069.stdout:3/376: creat d8/d2a/f82 x:0 0 0 2024-04-25T17:19:10.386 INFO:tasks.workunit.client.1.smithi069.stdout:3/377: chown d8/d16/d1a/d2c/f35 14609162 1 2024-04-25T17:19:10.387 INFO:tasks.workunit.client.0.smithi037.stdout:6/464: creat db/d26/d2e/d7d/d65/d68/d87/fa4 x:0 0 0 2024-04-25T17:19:10.388 INFO:tasks.workunit.client.1.smithi069.stdout:1/304: chown d1/d43/d35/l50 2 1 2024-04-25T17:19:10.389 INFO:tasks.workunit.client.0.smithi037.stdout:4/654: write d7/d7e/d1e/d2b/f75 [664044,37349] 0 2024-04-25T17:19:10.389 INFO:tasks.workunit.client.0.smithi037.stdout:1/504: mknod dc/d24/cb1 0 2024-04-25T17:19:10.390 INFO:tasks.workunit.client.0.smithi037.stdout:4/655: write d7/d7e/d1e/d2b/f42 [790386,118284] 0 2024-04-25T17:19:10.391 INFO:tasks.workunit.client.0.smithi037.stdout:4/656: chown d7/f13 0 1 2024-04-25T17:19:10.391 INFO:tasks.workunit.client.1.smithi069.stdout:3/378: dwrite d8/d2a/f72 [0,4194304] 0 2024-04-25T17:19:10.393 INFO:tasks.workunit.client.1.smithi069.stdout:3/379: fsync d8/d16/d1a/d2c/d49/f68 0 2024-04-25T17:19:10.394 INFO:tasks.workunit.client.1.smithi069.stdout:7/308: truncate d4/d6/f2c 3625560 0 2024-04-25T17:19:10.400 INFO:tasks.workunit.client.1.smithi069.stdout:5/287: creat d13/d17/d19/d20/d2d/f5d x:0 0 0 2024-04-25T17:19:10.402 INFO:tasks.workunit.client.1.smithi069.stdout:4/282: creat db/d15/d20/d38/d3c/f5c x:0 0 0 2024-04-25T17:19:10.404 INFO:tasks.workunit.client.0.smithi037.stdout:2/466: getdents d0/d16/d20 0 2024-04-25T17:19:10.409 INFO:tasks.workunit.client.0.smithi037.stdout:1/505: dwrite dc/d52/d6b/f9a [0,4194304] 0 2024-04-25T17:19:10.413 INFO:tasks.workunit.client.0.smithi037.stdout:1/506: dread - dc/d1c/fb0 zero size 2024-04-25T17:19:10.415 INFO:tasks.workunit.client.0.smithi037.stdout:0/524: dwrite d9/d14/d23/f1e [0,4194304] 0 2024-04-25T17:19:10.416 INFO:tasks.workunit.client.0.smithi037.stdout:2/467: dwrite d0/d16/d3b/f47 [0,4194304] 0 2024-04-25T17:19:10.429 INFO:tasks.workunit.client.0.smithi037.stdout:5/548: write d7/d12/d6f/d68/f76 [718802,92444] 0 2024-04-25T17:19:10.430 INFO:tasks.workunit.client.0.smithi037.stdout:6/465: creat db/d26/fa5 x:0 0 0 2024-04-25T17:19:10.431 INFO:tasks.workunit.client.1.smithi069.stdout:1/305: dread d1/d4/d6/f7 [0,4194304] 0 2024-04-25T17:19:10.431 INFO:tasks.workunit.client.1.smithi069.stdout:9/335: link d2/c1a d2/da/d5f/d76/c7d 0 2024-04-25T17:19:10.432 INFO:tasks.workunit.client.1.smithi069.stdout:9/336: dread - d2/f2c zero size 2024-04-25T17:19:10.436 INFO:tasks.workunit.client.1.smithi069.stdout:5/288: symlink d13/d17/d19/d1c/l5e 0 2024-04-25T17:19:10.437 INFO:tasks.workunit.client.1.smithi069.stdout:5/289: stat d13/d17/d19 0 2024-04-25T17:19:10.438 INFO:tasks.workunit.client.0.smithi037.stdout:8/416: truncate d5/db/d59/f5f 3435 0 2024-04-25T17:19:10.439 INFO:tasks.workunit.client.0.smithi037.stdout:1/507: truncate dc/d24/f47 461774 0 2024-04-25T17:19:10.439 INFO:tasks.workunit.client.1.smithi069.stdout:2/257: truncate d0/d1/d1d/f29 1776702 0 2024-04-25T17:19:10.441 INFO:tasks.workunit.client.0.smithi037.stdout:0/525: stat d9/d14/f27 0 2024-04-25T17:19:10.442 INFO:tasks.workunit.client.1.smithi069.stdout:9/337: dread d2/da/f20 [4194304,4194304] 0 2024-04-25T17:19:10.442 INFO:tasks.workunit.client.1.smithi069.stdout:9/338: chown d2/f39 224283999 1 2024-04-25T17:19:10.443 INFO:tasks.workunit.client.1.smithi069.stdout:9/339: chown d2/da/l1d 2076807315 1 2024-04-25T17:19:10.443 INFO:tasks.workunit.client.1.smithi069.stdout:9/340: readlink d2/da/d14/d23/l4f 0 2024-04-25T17:19:10.448 INFO:tasks.workunit.client.1.smithi069.stdout:8/260: truncate f34 1370980 0 2024-04-25T17:19:10.449 INFO:tasks.workunit.client.1.smithi069.stdout:6/275: dwrite d2/d7/fd [0,4194304] 0 2024-04-25T17:19:10.450 INFO:tasks.workunit.client.1.smithi069.stdout:8/261: truncate d37/d47/d48/f49 5033886 0 2024-04-25T17:19:10.458 INFO:tasks.workunit.client.1.smithi069.stdout:1/306: mknod d1/d43/d35/d4d/c59 0 2024-04-25T17:19:10.459 INFO:tasks.workunit.client.1.smithi069.stdout:0/240: write d0/da/db/d3a/f4c [1915504,114665] 0 2024-04-25T17:19:10.460 INFO:tasks.workunit.client.1.smithi069.stdout:1/307: fdatasync d1/d19/f47 0 2024-04-25T17:19:10.460 INFO:tasks.workunit.client.0.smithi037.stdout:6/466: creat db/d26/d2e/d3e/fa6 x:0 0 0 2024-04-25T17:19:10.461 INFO:tasks.workunit.client.1.smithi069.stdout:3/380: dread d8/d16/d1a/d38/f4c [0,4194304] 0 2024-04-25T17:19:10.463 INFO:tasks.workunit.client.1.smithi069.stdout:5/290: rename d13/c44 to d13/d17/d29/d30/d55/c5f 0 2024-04-25T17:19:10.465 INFO:tasks.workunit.client.1.smithi069.stdout:4/283: mknod db/d15/c5d 0 2024-04-25T17:19:10.466 INFO:tasks.workunit.client.1.smithi069.stdout:4/284: write f8 [4288731,116821] 0 2024-04-25T17:19:10.467 INFO:tasks.workunit.client.1.smithi069.stdout:5/291: truncate d13/d17/d29/f43 101463 0 2024-04-25T17:19:10.467 INFO:tasks.workunit.client.0.smithi037.stdout:4/657: truncate d7/d8a/f8b 366312 0 2024-04-25T17:19:10.468 INFO:tasks.workunit.client.0.smithi037.stdout:2/468: symlink d0/d23/l8f 0 2024-04-25T17:19:10.469 INFO:tasks.workunit.client.1.smithi069.stdout:3/381: dwrite d8/f1f [0,4194304] 0 2024-04-25T17:19:10.470 INFO:tasks.workunit.client.1.smithi069.stdout:7/309: write d4/d6/d14/d15/f17 [2740376,119263] 0 2024-04-25T17:19:10.470 INFO:tasks.workunit.client.1.smithi069.stdout:5/292: read - d13/f54 zero size 2024-04-25T17:19:10.470 INFO:tasks.workunit.client.0.smithi037.stdout:1/508: creat dc/d52/fb2 x:0 0 0 2024-04-25T17:19:10.472 INFO:tasks.workunit.client.0.smithi037.stdout:1/509: chown dc/d1c/d57/d4d/d6a/d86/d91/f93 78483 1 2024-04-25T17:19:10.473 INFO:tasks.workunit.client.1.smithi069.stdout:7/310: read d4/d6/fa [1761991,120155] 0 2024-04-25T17:19:10.477 INFO:tasks.workunit.client.1.smithi069.stdout:0/241: creat d0/da/d24/f55 x:0 0 0 2024-04-25T17:19:10.478 INFO:tasks.workunit.client.1.smithi069.stdout:0/242: fdatasync d0/f6 0 2024-04-25T17:19:10.526 INFO:tasks.workunit.client.0.smithi037.stdout:4/658: dread d7/d7e/d1e/d2b/d35/d39/dba/fb4 [0,4194304] 0 2024-04-25T17:19:10.527 INFO:tasks.workunit.client.0.smithi037.stdout:4/659: dread - d7/d7e/d1e/d2b/d35/d39/d9c/fca zero size 2024-04-25T17:19:10.528 INFO:tasks.workunit.client.0.smithi037.stdout:4/660: read d7/d7e/d45/fa0 [3084871,30985] 0 2024-04-25T17:19:10.565 INFO:tasks.workunit.client.0.smithi037.stdout:7/508: sync 2024-04-25T17:19:10.583 INFO:tasks.workunit.client.0.smithi037.stdout:8/417: link d5/db/d18/d3b/l4c d5/db/d18/d3b/d50/d51/l84 0 2024-04-25T17:19:10.583 INFO:tasks.workunit.client.0.smithi037.stdout:8/418: stat d5/db/d18/d3b/f48 0 2024-04-25T17:19:10.584 INFO:tasks.workunit.client.0.smithi037.stdout:8/419: chown d5/db/d23/d58 14989605 1 2024-04-25T17:19:10.585 INFO:tasks.workunit.client.0.smithi037.stdout:8/420: chown d5/db/d18/d3b/d50 1 1 2024-04-25T17:19:10.591 INFO:tasks.workunit.client.0.smithi037.stdout:0/526: truncate d9/d14/f36 2028474 0 2024-04-25T17:19:10.591 INFO:tasks.workunit.client.0.smithi037.stdout:8/421: dwrite d5/d6a/f7a [0,4194304] 0 2024-04-25T17:19:10.595 INFO:tasks.workunit.client.0.smithi037.stdout:8/422: truncate d5/db/d18/d3b/d50/d51/f57 335205 0 2024-04-25T17:19:10.597 INFO:tasks.workunit.client.1.smithi069.stdout:4/285: creat db/d15/d20/d38/d3c/d43/d48/f5e x:0 0 0 2024-04-25T17:19:10.599 INFO:tasks.workunit.client.0.smithi037.stdout:8/423: dread d5/db/d23/d58/f79 [0,4194304] 0 2024-04-25T17:19:10.600 INFO:tasks.workunit.client.0.smithi037.stdout:8/424: fdatasync d5/f35 0 2024-04-25T17:19:10.600 INFO:tasks.workunit.client.1.smithi069.stdout:5/293: creat d13/f60 x:0 0 0 2024-04-25T17:19:10.602 INFO:tasks.workunit.client.1.smithi069.stdout:5/294: write d13/d17/d19/d1c/f45 [482593,1027] 0 2024-04-25T17:19:10.605 INFO:tasks.workunit.client.1.smithi069.stdout:3/382: chown d8/d16/d1a/d2c/d49/d59/f65 1020515 1 2024-04-25T17:19:10.605 INFO:tasks.workunit.client.1.smithi069.stdout:4/286: dwrite db/d15/d20/f25 [0,4194304] 0 2024-04-25T17:19:10.607 INFO:tasks.workunit.client.0.smithi037.stdout:4/661: mknod d7/d7e/d5b/cd2 0 2024-04-25T17:19:10.607 INFO:tasks.workunit.client.0.smithi037.stdout:4/662: chown d7/d7e/f7c 20 1 2024-04-25T17:19:10.608 INFO:tasks.workunit.client.0.smithi037.stdout:4/663: readlink d7/d7e/d1e/l9e 0 2024-04-25T17:19:10.613 INFO:tasks.workunit.client.1.smithi069.stdout:0/243: unlink d0/da/f35 0 2024-04-25T17:19:10.613 INFO:tasks.workunit.client.1.smithi069.stdout:0/244: chown d0/l4b 6275329 1 2024-04-25T17:19:10.615 INFO:tasks.workunit.client.0.smithi037.stdout:7/509: creat d5/d15/d17/d1b/da2/daf/d80/db5/fb6 x:0 0 0 2024-04-25T17:19:10.616 INFO:tasks.workunit.client.0.smithi037.stdout:7/510: readlink d5/d15/d17/d1b/da2/daf/l3c 0 2024-04-25T17:19:10.617 INFO:tasks.workunit.client.0.smithi037.stdout:6/467: getdents db/d26/d2e/d7d/d65/d68/d87 0 2024-04-25T17:19:10.619 INFO:tasks.workunit.client.0.smithi037.stdout:2/469: write d0/d16/d3c/f42 [316595,27669] 0 2024-04-25T17:19:10.624 INFO:tasks.workunit.client.1.smithi069.stdout:9/341: rmdir d2/da/dd/d1e/d2e/d49 0 2024-04-25T17:19:10.626 INFO:tasks.workunit.client.1.smithi069.stdout:8/262: creat d37/f59 x:0 0 0 2024-04-25T17:19:10.629 INFO:tasks.workunit.client.0.smithi037.stdout:4/664: dread - d7/fb1 zero size 2024-04-25T17:19:10.632 INFO:tasks.workunit.client.1.smithi069.stdout:5/295: rmdir d13 39 2024-04-25T17:19:10.632 INFO:tasks.workunit.client.0.smithi037.stdout:0/527: write d9/df/f2c [3892943,85779] 0 2024-04-25T17:19:10.637 INFO:tasks.workunit.client.1.smithi069.stdout:7/311: creat d4/d6/d14/d15/d3c/d23/f6b x:0 0 0 2024-04-25T17:19:10.639 INFO:tasks.workunit.client.1.smithi069.stdout:4/287: readlink db/d22/d24/d41/l54 0 2024-04-25T17:19:10.640 INFO:tasks.workunit.client.1.smithi069.stdout:4/288: readlink db/d15/d20/d38/d3c/d43/d48/d49/l5b 0 2024-04-25T17:19:10.640 INFO:tasks.workunit.client.0.smithi037.stdout:2/470: mknod d0/d16/d3c/c90 0 2024-04-25T17:19:10.641 INFO:tasks.workunit.client.1.smithi069.stdout:4/289: dread - db/d22/d24/d41/f47 zero size 2024-04-25T17:19:10.641 INFO:tasks.workunit.client.0.smithi037.stdout:7/511: dread d5/d15/d17/f41 [0,4194304] 0 2024-04-25T17:19:10.644 INFO:tasks.workunit.client.0.smithi037.stdout:4/665: dread d7/f13 [0,4194304] 0 2024-04-25T17:19:10.645 INFO:tasks.workunit.client.1.smithi069.stdout:4/290: dwrite db/d15/d26/f2c [0,4194304] 0 2024-04-25T17:19:10.646 INFO:tasks.workunit.client.1.smithi069.stdout:4/291: truncate f5 891123 0 2024-04-25T17:19:10.647 INFO:tasks.workunit.client.1.smithi069.stdout:1/308: creat d1/f5a x:0 0 0 2024-04-25T17:19:10.648 INFO:tasks.workunit.client.0.smithi037.stdout:0/528: rmdir d9/df/d32/d39/d68 39 2024-04-25T17:19:10.652 INFO:tasks.workunit.client.1.smithi069.stdout:2/258: rename d0/d26/d10/d43/d47 to d0/d56 0 2024-04-25T17:19:10.653 INFO:tasks.workunit.client.1.smithi069.stdout:2/259: write d0/d1/d1d/d28/d31/f38 [101836,31415] 0 2024-04-25T17:19:10.655 INFO:tasks.workunit.client.1.smithi069.stdout:8/263: creat d37/d47/f5a x:0 0 0 2024-04-25T17:19:10.657 INFO:tasks.workunit.client.0.smithi037.stdout:3/329: sync 2024-04-25T17:19:10.657 INFO:tasks.workunit.client.0.smithi037.stdout:4/666: dread d7/d7e/f3c [0,4194304] 0 2024-04-25T17:19:10.657 INFO:tasks.workunit.client.1.smithi069.stdout:5/296: write d13/d17/f42 [366167,76952] 0 2024-04-25T17:19:10.658 INFO:tasks.workunit.client.1.smithi069.stdout:0/245: write d0/f8 [1829280,44536] 0 2024-04-25T17:19:10.658 INFO:tasks.workunit.client.1.smithi069.stdout:5/297: stat d13/d17 0 2024-04-25T17:19:10.662 INFO:tasks.workunit.client.1.smithi069.stdout:7/312: write d4/d6/fa [439179,49188] 0 2024-04-25T17:19:10.664 INFO:tasks.workunit.client.1.smithi069.stdout:7/313: truncate d4/d1a/d34/f65 1038130 0 2024-04-25T17:19:10.664 INFO:tasks.workunit.client.0.smithi037.stdout:6/468: write db/f46 [2506695,79575] 0 2024-04-25T17:19:10.666 INFO:tasks.workunit.client.0.smithi037.stdout:8/425: creat d5/db/d18/d3b/d50/d51/f85 x:0 0 0 2024-04-25T17:19:10.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:10 smithi069 ceph-mon[34527]: Reconfiguring node-exporter.smithi069 (dependencies changed)... 2024-04-25T17:19:10.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:10 smithi069 ceph-mon[34527]: Reconfiguring daemon node-exporter.smithi069 on smithi069 2024-04-25T17:19:10.668 INFO:tasks.workunit.client.1.smithi069.stdout:4/292: truncate db/d15/f17 923505 0 2024-04-25T17:19:10.669 INFO:tasks.workunit.client.0.smithi037.stdout:2/471: write d0/d16/d26/d3e/f65 [530465,97703] 0 2024-04-25T17:19:10.670 INFO:tasks.workunit.client.0.smithi037.stdout:8/426: dread d5/f6f [0,4194304] 0 2024-04-25T17:19:10.673 INFO:tasks.workunit.client.1.smithi069.stdout:6/276: rename d2/d2e/l4d to d2/d1e/d3f/l5b 0 2024-04-25T17:19:10.676 INFO:tasks.workunit.client.0.smithi037.stdout:2/472: dwrite d0/d16/d3b/f47 [0,4194304] 0 2024-04-25T17:19:10.677 INFO:tasks.workunit.client.1.smithi069.stdout:1/309: write d1/d4/d6/f7 [4550320,129270] 0 2024-04-25T17:19:10.677 INFO:tasks.workunit.client.0.smithi037.stdout:3/330: readlink l1 0 2024-04-25T17:19:10.682 INFO:tasks.workunit.client.1.smithi069.stdout:1/310: dwrite d1/d43/d1b/f2c [0,4194304] 0 2024-04-25T17:19:10.685 INFO:tasks.workunit.client.1.smithi069.stdout:7/314: creat d4/d6/d14/d5a/f6c x:0 0 0 2024-04-25T17:19:10.686 INFO:tasks.workunit.client.1.smithi069.stdout:4/293: creat db/d15/d42/f5f x:0 0 0 2024-04-25T17:19:10.687 INFO:tasks.workunit.client.0.smithi037.stdout:6/469: creat db/d26/d2e/d7d/d65/fa7 x:0 0 0 2024-04-25T17:19:10.688 INFO:tasks.workunit.client.0.smithi037.stdout:6/470: dread - db/d26/d2e/d7d/d65/f9c zero size 2024-04-25T17:19:10.690 INFO:tasks.workunit.client.1.smithi069.stdout:6/277: dread d2/d7/f44 [0,4194304] 0 2024-04-25T17:19:10.690 INFO:tasks.workunit.client.0.smithi037.stdout:0/529: mkdir d9/d71/dad/d7a/daf/db1 0 2024-04-25T17:19:10.691 INFO:tasks.workunit.client.1.smithi069.stdout:6/278: chown d2/d1e/d3e 16365 1 2024-04-25T17:19:10.691 INFO:tasks.workunit.client.0.smithi037.stdout:0/530: truncate d9/d14/d28/d48/f4e 766051 0 2024-04-25T17:19:10.692 INFO:tasks.workunit.client.0.smithi037.stdout:8/427: unlink d5/db/d23/d42/f63 0 2024-04-25T17:19:10.694 INFO:tasks.workunit.client.0.smithi037.stdout:2/473: creat d0/d16/d26/d3e/d4b/f91 x:0 0 0 2024-04-25T17:19:10.694 INFO:tasks.workunit.client.0.smithi037.stdout:8/428: read d5/db/d59/f6c [58818,87759] 0 2024-04-25T17:19:10.695 INFO:tasks.workunit.client.0.smithi037.stdout:3/331: creat d8/d23/d38/f6b x:0 0 0 2024-04-25T17:19:10.695 INFO:tasks.workunit.client.0.smithi037.stdout:1/510: sync 2024-04-25T17:19:10.695 INFO:tasks.workunit.client.0.smithi037.stdout:9/600: sync 2024-04-25T17:19:10.695 INFO:tasks.workunit.client.0.smithi037.stdout:5/549: sync 2024-04-25T17:19:10.695 INFO:tasks.workunit.client.0.smithi037.stdout:0/531: dread d9/df/f86 [0,4194304] 0 2024-04-25T17:19:10.697 INFO:tasks.workunit.client.0.smithi037.stdout:4/667: creat d7/d67/fd3 x:0 0 0 2024-04-25T17:19:10.697 INFO:tasks.workunit.client.1.smithi069.stdout:0/246: mkdir d0/da/db/d56 0 2024-04-25T17:19:10.698 INFO:tasks.workunit.client.0.smithi037.stdout:0/532: chown d9/d14/d28/d48/f49 57812 1 2024-04-25T17:19:10.700 INFO:tasks.workunit.client.1.smithi069.stdout:1/311: creat d1/d43/f5b x:0 0 0 2024-04-25T17:19:10.700 INFO:tasks.workunit.client.1.smithi069.stdout:1/312: readlink d1/d43/d1b/l3d 0 2024-04-25T17:19:10.701 INFO:tasks.workunit.client.1.smithi069.stdout:1/313: truncate d1/df/d17/f2d 5764408 0 2024-04-25T17:19:10.702 INFO:tasks.workunit.client.1.smithi069.stdout:4/294: creat db/d15/d20/d38/d3c/f60 x:0 0 0 2024-04-25T17:19:10.702 INFO:tasks.workunit.client.1.smithi069.stdout:1/314: chown d1/d4/de/d44 233727646 1 2024-04-25T17:19:10.704 INFO:tasks.workunit.client.0.smithi037.stdout:8/429: dwrite d5/d6a/f71 [0,4194304] 0 2024-04-25T17:19:10.704 INFO:tasks.workunit.client.1.smithi069.stdout:9/342: rename d2/da/dd/de/c77 to d2/da/dd/de/d59/c7e 0 2024-04-25T17:19:10.705 INFO:tasks.workunit.client.1.smithi069.stdout:9/343: fsync d2/da/dd/de/f12 0 2024-04-25T17:19:10.707 INFO:tasks.workunit.client.0.smithi037.stdout:7/512: truncate d5/d15/d17/d25/d2b/d48/f95 50382 0 2024-04-25T17:19:10.707 INFO:tasks.workunit.client.0.smithi037.stdout:0/533: dwrite d9/df/d32/f5c [0,4194304] 0 2024-04-25T17:19:10.708 INFO:tasks.workunit.client.1.smithi069.stdout:2/260: creat d0/f57 x:0 0 0 2024-04-25T17:19:10.710 INFO:tasks.workunit.client.0.smithi037.stdout:0/534: write d9/d14/f9a [1292109,117449] 0 2024-04-25T17:19:10.710 INFO:tasks.workunit.client.0.smithi037.stdout:2/474: creat d0/d16/d3c/f92 x:0 0 0 2024-04-25T17:19:10.712 INFO:tasks.workunit.client.0.smithi037.stdout:8/430: dread d5/db/d23/f38 [0,4194304] 0 2024-04-25T17:19:10.714 INFO:tasks.workunit.client.1.smithi069.stdout:8/264: creat d37/f5b x:0 0 0 2024-04-25T17:19:10.715 INFO:tasks.workunit.client.1.smithi069.stdout:8/265: fsync f33 0 2024-04-25T17:19:10.722 INFO:tasks.workunit.client.0.smithi037.stdout:6/471: link db/d26/d2e/d7d/d65/f9c db/d26/d2e/d7d/fa8 0 2024-04-25T17:19:10.722 INFO:tasks.workunit.client.0.smithi037.stdout:6/472: fsync db/d26/fa5 0 2024-04-25T17:19:10.724 INFO:tasks.workunit.client.0.smithi037.stdout:3/332: rename d8/d23/d3a/d5d/c1d to d8/d23/d3a/d63/c6c 0 2024-04-25T17:19:10.728 INFO:tasks.workunit.client.1.smithi069.stdout:1/315: rename d1/f5a to d1/d4/de/d44/f5c 0 2024-04-25T17:19:10.731 INFO:tasks.workunit.client.1.smithi069.stdout:9/344: mkdir d2/da/dd/de/d59/d7f 0 2024-04-25T17:19:10.732 INFO:tasks.workunit.client.0.smithi037.stdout:5/550: mknod d7/ca9 0 2024-04-25T17:19:10.740 INFO:tasks.workunit.client.0.smithi037.stdout:1/511: write dc/d1c/d57/d22/d36/f40 [676665,107439] 0 2024-04-25T17:19:10.740 INFO:tasks.workunit.client.0.smithi037.stdout:7/513: chown d5/d15/d17/d1b/c6d 1276639 1 2024-04-25T17:19:10.741 INFO:tasks.workunit.client.0.smithi037.stdout:0/535: readlink d9/df/d32/l54 0 2024-04-25T17:19:10.742 INFO:tasks.workunit.client.1.smithi069.stdout:0/247: creat d0/da/d24/d43/f57 x:0 0 0 2024-04-25T17:19:10.743 INFO:tasks.workunit.client.0.smithi037.stdout:2/475: mknod d0/d16/d20/d59/c93 0 2024-04-25T17:19:10.745 INFO:tasks.workunit.client.1.smithi069.stdout:5/298: getdents d13/d17/d19/d20 0 2024-04-25T17:19:10.746 INFO:tasks.workunit.client.1.smithi069.stdout:5/299: write fa [1479667,17070] 0 2024-04-25T17:19:10.746 INFO:tasks.workunit.client.1.smithi069.stdout:0/248: dread d0/d36/f4f [0,4194304] 0 2024-04-25T17:19:10.747 INFO:tasks.workunit.client.1.smithi069.stdout:4/295: mknod db/d15/d20/d38/d3c/d43/c61 0 2024-04-25T17:19:10.747 INFO:tasks.workunit.client.1.smithi069.stdout:5/300: readlink d13/d17/d29/d30/l3b 0 2024-04-25T17:19:10.748 INFO:tasks.workunit.client.0.smithi037.stdout:8/431: creat d5/db/d18/f86 x:0 0 0 2024-04-25T17:19:10.752 INFO:tasks.workunit.client.1.smithi069.stdout:5/301: dread d13/d17/f1b [0,4194304] 0 2024-04-25T17:19:10.753 INFO:tasks.workunit.client.1.smithi069.stdout:6/279: write d2/f10 [4996573,120786] 0 2024-04-25T17:19:10.753 INFO:tasks.workunit.client.1.smithi069.stdout:4/296: dwrite db/f52 [0,4194304] 0 2024-04-25T17:19:10.754 INFO:tasks.workunit.client.0.smithi037.stdout:6/473: truncate db/d26/d2e/d3e/f35 1686562 0 2024-04-25T17:19:10.755 INFO:tasks.workunit.client.1.smithi069.stdout:6/280: chown d2/d2e/d35 3 1 2024-04-25T17:19:10.755 INFO:tasks.workunit.client.1.smithi069.stdout:5/302: write d13/d17/f42 [397443,124192] 0 2024-04-25T17:19:10.755 INFO:tasks.workunit.client.1.smithi069.stdout:2/261: symlink d0/l58 0 2024-04-25T17:19:10.756 INFO:tasks.workunit.client.1.smithi069.stdout:6/281: chown d2/d7/f44 18123124 1 2024-04-25T17:19:10.757 INFO:tasks.workunit.client.1.smithi069.stdout:5/303: readlink d13/d17/d29/d30/l37 0 2024-04-25T17:19:10.758 INFO:tasks.workunit.client.0.smithi037.stdout:5/551: dread - d7/f5c zero size 2024-04-25T17:19:10.758 INFO:tasks.workunit.client.1.smithi069.stdout:2/262: truncate d0/f57 661846 0 2024-04-25T17:19:10.760 INFO:tasks.workunit.client.1.smithi069.stdout:2/263: chown d0/d26/d10/l37 635128 1 2024-04-25T17:19:10.761 INFO:tasks.workunit.client.1.smithi069.stdout:2/264: write d0/d1/f20 [877469,41717] 0 2024-04-25T17:19:10.765 INFO:tasks.workunit.client.0.smithi037.stdout:3/333: write d8/d31/f52 [1048367,11270] 0 2024-04-25T17:19:10.766 INFO:tasks.workunit.client.0.smithi037.stdout:4/668: dwrite d7/d7e/d5b/f9d [0,4194304] 0 2024-04-25T17:19:10.767 INFO:tasks.workunit.client.1.smithi069.stdout:9/345: dwrite d2/f6 [0,4194304] 0 2024-04-25T17:19:10.767 INFO:tasks.workunit.client.1.smithi069.stdout:8/266: truncate d37/f3f 3456180 0 2024-04-25T17:19:10.768 INFO:tasks.workunit.client.1.smithi069.stdout:8/267: write f12 [2042953,81284] 0 2024-04-25T17:19:10.769 INFO:tasks.workunit.client.0.smithi037.stdout:4/669: chown d7/d7e/d1e/d2b/d35/d39/dba/fb4 7016787 1 2024-04-25T17:19:10.769 INFO:tasks.workunit.client.1.smithi069.stdout:9/346: write d2/da/dd/de/d74/f78 [509857,16225] 0 2024-04-25T17:19:10.769 INFO:tasks.workunit.client.1.smithi069.stdout:0/249: rmdir d0/d17 39 2024-04-25T17:19:10.770 INFO:tasks.workunit.client.1.smithi069.stdout:9/347: read d2/da/dd/d1e/d2e/d35/f38 [2449996,73037] 0 2024-04-25T17:19:10.773 INFO:tasks.workunit.client.1.smithi069.stdout:9/348: dread d2/da/dd/f5d [0,4194304] 0 2024-04-25T17:19:10.776 INFO:tasks.workunit.client.1.smithi069.stdout:1/316: dread d1/df/d17/f24 [0,4194304] 0 2024-04-25T17:19:10.778 INFO:tasks.workunit.client.1.smithi069.stdout:3/383: sync 2024-04-25T17:19:10.781 INFO:tasks.workunit.client.1.smithi069.stdout:4/297: creat db/d15/d26/f62 x:0 0 0 2024-04-25T17:19:10.781 INFO:tasks.workunit.client.1.smithi069.stdout:9/349: dwrite d2/da/d14/d23/d65/f73 [0,4194304] 0 2024-04-25T17:19:10.783 INFO:tasks.workunit.client.1.smithi069.stdout:6/282: write d2/d7/f25 [1918665,118624] 0 2024-04-25T17:19:10.785 INFO:tasks.workunit.client.1.smithi069.stdout:5/304: mknod d13/d17/d29/d2e/c61 0 2024-04-25T17:19:10.788 INFO:tasks.workunit.client.1.smithi069.stdout:2/265: creat d0/d26/d36/f59 x:0 0 0 2024-04-25T17:19:10.796 INFO:tasks.workunit.client.1.smithi069.stdout:8/268: creat d37/d47/d48/f5c x:0 0 0 2024-04-25T17:19:10.797 INFO:tasks.workunit.client.1.smithi069.stdout:8/269: fdatasync f10 0 2024-04-25T17:19:10.800 INFO:tasks.workunit.client.1.smithi069.stdout:0/250: chown d0/da/db/d3a 2 1 2024-04-25T17:19:10.801 INFO:tasks.workunit.client.1.smithi069.stdout:0/251: chown d0/d38 620292 1 2024-04-25T17:19:10.805 INFO:tasks.workunit.client.1.smithi069.stdout:3/384: rename d8/d16/d1a/d2c/f35 to d8/d16/d1a/d38/f83 0 2024-04-25T17:19:10.806 INFO:tasks.workunit.client.1.smithi069.stdout:0/252: dwrite d0/da/db/d2a/f3b [0,4194304] 0 2024-04-25T17:19:10.808 INFO:tasks.workunit.client.1.smithi069.stdout:0/253: write d0/da/f10 [1090428,79739] 0 2024-04-25T17:19:10.808 INFO:tasks.workunit.client.1.smithi069.stdout:0/254: readlink d0/da/db/l28 0 2024-04-25T17:19:10.810 INFO:tasks.workunit.client.1.smithi069.stdout:5/305: mkdir d13/d17/d62 0 2024-04-25T17:19:10.814 INFO:tasks.workunit.client.0.smithi037.stdout:1/512: rename dc/d1c/fb0 to dc/d52/d6b/fb3 0 2024-04-25T17:19:10.816 INFO:tasks.workunit.client.0.smithi037.stdout:0/536: fsync d9/d14/d28/f2a 0 2024-04-25T17:19:10.818 INFO:tasks.workunit.client.0.smithi037.stdout:2/476: rmdir d0/d16/d20/d55 39 2024-04-25T17:19:10.818 INFO:tasks.workunit.client.0.smithi037.stdout:2/477: stat d0/d16/d68 0 2024-04-25T17:19:10.819 INFO:tasks.workunit.client.0.smithi037.stdout:2/478: chown d0/d15/d2a/d5a 350686 1 2024-04-25T17:19:10.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:10 smithi037 ceph-mon[26472]: Reconfiguring node-exporter.smithi069 (dependencies changed)... 2024-04-25T17:19:10.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:10 smithi037 ceph-mon[26472]: Reconfiguring daemon node-exporter.smithi069 on smithi069 2024-04-25T17:19:10.821 INFO:tasks.workunit.client.0.smithi037.stdout:8/432: symlink d5/db/d18/l87 0 2024-04-25T17:19:10.827 INFO:tasks.workunit.client.0.smithi037.stdout:6/474: truncate db/d53/f58 982670 0 2024-04-25T17:19:10.833 INFO:tasks.workunit.client.1.smithi069.stdout:6/283: rename d2/d51/l52 to d2/d1e/d3f/l5c 0 2024-04-25T17:19:10.834 INFO:tasks.workunit.client.1.smithi069.stdout:6/284: truncate d2/d7/f25 4403320 0 2024-04-25T17:19:10.838 INFO:tasks.workunit.client.0.smithi037.stdout:7/514: symlink d5/d15/d17/d1b/da2/lb7 0 2024-04-25T17:19:10.840 INFO:tasks.workunit.client.1.smithi069.stdout:2/266: dwrite d0/d1/f1f [0,4194304] 0 2024-04-25T17:19:10.841 INFO:tasks.workunit.client.1.smithi069.stdout:6/285: dwrite d2/f4e [0,4194304] 0 2024-04-25T17:19:10.842 INFO:tasks.workunit.client.0.smithi037.stdout:1/513: creat dc/d18/d66/fb4 x:0 0 0 2024-04-25T17:19:10.844 INFO:tasks.workunit.client.1.smithi069.stdout:1/317: truncate d1/d4/d6/f16 685617 0 2024-04-25T17:19:10.846 INFO:tasks.workunit.client.1.smithi069.stdout:5/306: creat d13/d17/f63 x:0 0 0 2024-04-25T17:19:10.847 INFO:tasks.workunit.client.0.smithi037.stdout:0/537: mknod d9/d71/cb2 0 2024-04-25T17:19:10.848 INFO:tasks.workunit.client.1.smithi069.stdout:2/267: dwrite d0/d26/f54 [0,4194304] 0 2024-04-25T17:19:10.849 INFO:tasks.workunit.client.0.smithi037.stdout:9/601: getdents d1/d5/dc/d38 0 2024-04-25T17:19:10.849 INFO:tasks.workunit.client.0.smithi037.stdout:3/334: write d8/d23/f2d [4581594,74268] 0 2024-04-25T17:19:10.852 INFO:tasks.workunit.client.0.smithi037.stdout:2/479: creat d0/d15/d2a/f94 x:0 0 0 2024-04-25T17:19:10.853 INFO:tasks.workunit.client.1.smithi069.stdout:8/270: symlink d37/l5d 0 2024-04-25T17:19:10.854 INFO:tasks.workunit.client.0.smithi037.stdout:2/480: fdatasync d0/d16/d20/d59/d6a/f8c 0 2024-04-25T17:19:10.855 INFO:tasks.workunit.client.1.smithi069.stdout:8/271: write d37/d47/d48/f5c [355414,122534] 0 2024-04-25T17:19:10.858 INFO:tasks.workunit.client.1.smithi069.stdout:4/298: dwrite db/d15/d20/f2e [0,4194304] 0 2024-04-25T17:19:10.859 INFO:tasks.workunit.client.1.smithi069.stdout:4/299: fsync db/f12 0 2024-04-25T17:19:10.859 INFO:tasks.workunit.client.0.smithi037.stdout:8/433: creat d5/db/d59/f88 x:0 0 0 2024-04-25T17:19:10.859 INFO:tasks.workunit.client.0.smithi037.stdout:6/475: symlink db/d26/d2e/d82/la9 0 2024-04-25T17:19:10.859 INFO:tasks.workunit.client.1.smithi069.stdout:3/385: symlink d8/d16/d1a/d2c/l84 0 2024-04-25T17:19:10.860 INFO:tasks.workunit.client.0.smithi037.stdout:8/434: chown d5/d6a/f54 769428705 1 2024-04-25T17:19:10.860 INFO:tasks.workunit.client.0.smithi037.stdout:2/481: dread d0/f9 [0,4194304] 0 2024-04-25T17:19:10.860 INFO:tasks.workunit.client.0.smithi037.stdout:4/670: truncate d7/d7e/d1e/dae/fbb 1871205 0 2024-04-25T17:19:10.866 INFO:tasks.workunit.client.0.smithi037.stdout:1/514: rename dc/d1c/d57/d4d/f99 to dc/d18/d66/fb5 0 2024-04-25T17:19:10.866 INFO:tasks.workunit.client.1.smithi069.stdout:0/255: mknod d0/d17/c58 0 2024-04-25T17:19:10.870 INFO:tasks.workunit.client.1.smithi069.stdout:5/307: mknod d13/d17/d19/d1c/c64 0 2024-04-25T17:19:10.872 INFO:tasks.workunit.client.1.smithi069.stdout:0/256: dwrite d0/fc [0,4194304] 0 2024-04-25T17:19:10.873 INFO:tasks.workunit.client.1.smithi069.stdout:0/257: dread - d0/da/db/d2a/f3f zero size 2024-04-25T17:19:10.875 INFO:tasks.workunit.client.0.smithi037.stdout:6/476: unlink db/d26/l8d 0 2024-04-25T17:19:10.875 INFO:tasks.workunit.client.0.smithi037.stdout:0/538: dwrite d9/d14/d28/d48/f7e [0,4194304] 0 2024-04-25T17:19:10.878 INFO:tasks.workunit.client.0.smithi037.stdout:8/435: chown d5/c22 33079 1 2024-04-25T17:19:10.880 INFO:tasks.workunit.client.1.smithi069.stdout:4/300: rename db/d15/d20/d38/d3c to db/d15/d20/d35/d63 0 2024-04-25T17:19:10.883 INFO:tasks.workunit.client.0.smithi037.stdout:2/482: creat d0/d16/d68/f95 x:0 0 0 2024-04-25T17:19:10.883 INFO:tasks.workunit.client.1.smithi069.stdout:3/386: creat d8/d71/f85 x:0 0 0 2024-04-25T17:19:10.884 INFO:tasks.workunit.client.0.smithi037.stdout:4/671: fsync d7/d7e/d1e/d2b/d35/d39/fac 0 2024-04-25T17:19:10.885 INFO:tasks.workunit.client.1.smithi069.stdout:9/350: getdents d2/da/dd/d1e/d2e/d68 0 2024-04-25T17:19:10.890 INFO:tasks.workunit.client.0.smithi037.stdout:3/335: symlink d8/l6d 0 2024-04-25T17:19:10.892 INFO:tasks.workunit.client.1.smithi069.stdout:5/308: symlink d13/d17/d19/d20/d2d/l65 0 2024-04-25T17:19:10.892 INFO:tasks.workunit.client.1.smithi069.stdout:5/309: write d13/f54 [814393,109453] 0 2024-04-25T17:19:10.895 INFO:tasks.workunit.client.1.smithi069.stdout:0/258: rmdir d0/da/db/d3a 39 2024-04-25T17:19:10.896 INFO:tasks.workunit.client.1.smithi069.stdout:0/259: dread - d0/da/d24/d43/f57 zero size 2024-04-25T17:19:10.899 INFO:tasks.workunit.client.0.smithi037.stdout:1/515: dread dc/fd [0,4194304] 0 2024-04-25T17:19:10.902 INFO:tasks.workunit.client.0.smithi037.stdout:6/477: unlink db/d1d/c7b 0 2024-04-25T17:19:10.903 INFO:tasks.workunit.client.0.smithi037.stdout:6/478: dread - db/d26/d2e/d3e/d25/d61/f74 zero size 2024-04-25T17:19:10.903 INFO:tasks.workunit.client.1.smithi069.stdout:4/301: mkdir db/d15/d42/d64 0 2024-04-25T17:19:10.907 INFO:tasks.workunit.client.1.smithi069.stdout:3/387: creat d8/d71/f86 x:0 0 0 2024-04-25T17:19:10.907 INFO:tasks.workunit.client.1.smithi069.stdout:2/268: write d0/f7 [4839882,34889] 0 2024-04-25T17:19:10.908 INFO:tasks.workunit.client.1.smithi069.stdout:3/388: stat d8/d16/d1a/f4f 0 2024-04-25T17:19:10.908 INFO:tasks.workunit.client.1.smithi069.stdout:2/269: write d0/d1/f20 [3810262,10673] 0 2024-04-25T17:19:10.909 INFO:tasks.workunit.client.1.smithi069.stdout:3/389: chown d8/d16/c2d 25020 1 2024-04-25T17:19:10.909 INFO:tasks.workunit.client.1.smithi069.stdout:2/270: chown d0/d1/d1d/d28/d31 147446440 1 2024-04-25T17:19:10.909 INFO:tasks.workunit.client.1.smithi069.stdout:3/390: readlink d8/l26 0 2024-04-25T17:19:10.910 INFO:tasks.workunit.client.0.smithi037.stdout:2/483: chown d0/d16/d26/f2c 1040886 1 2024-04-25T17:19:10.910 INFO:tasks.workunit.client.1.smithi069.stdout:5/310: dread d13/f16 [0,4194304] 0 2024-04-25T17:19:10.910 INFO:tasks.workunit.client.1.smithi069.stdout:3/391: stat d8/lb 0 2024-04-25T17:19:10.910 INFO:tasks.workunit.client.1.smithi069.stdout:2/271: write d0/f7 [238874,46817] 0 2024-04-25T17:19:10.911 INFO:tasks.workunit.client.1.smithi069.stdout:2/272: fsync d0/f17 0 2024-04-25T17:19:10.912 INFO:tasks.workunit.client.1.smithi069.stdout:2/273: chown d0/f17 882845865 1 2024-04-25T17:19:10.914 INFO:tasks.workunit.client.0.smithi037.stdout:7/515: dwrite d5/f7c [0,4194304] 0 2024-04-25T17:19:10.915 INFO:tasks.workunit.client.1.smithi069.stdout:5/311: dwrite fa [0,4194304] 0 2024-04-25T17:19:10.916 INFO:tasks.workunit.client.0.smithi037.stdout:7/516: write d5/d15/d17/d1b/da2/d76/fb3 [547862,4595] 0 2024-04-25T17:19:10.917 INFO:tasks.workunit.client.0.smithi037.stdout:7/517: chown d5/fd 5 1 2024-04-25T17:19:10.920 INFO:tasks.workunit.client.0.smithi037.stdout:9/602: write d1/d48/d68/d26/d81/f87 [818855,85573] 0 2024-04-25T17:19:10.923 INFO:tasks.workunit.client.1.smithi069.stdout:4/302: creat db/d15/d20/d35/d63/d43/d48/d49/f65 x:0 0 0 2024-04-25T17:19:10.924 INFO:tasks.workunit.client.0.smithi037.stdout:6/479: dread - db/d1d/d20/f75 zero size 2024-04-25T17:19:10.925 INFO:tasks.workunit.client.1.smithi069.stdout:5/312: dread d13/d17/d19/d20/f24 [0,4194304] 0 2024-04-25T17:19:10.928 INFO:tasks.workunit.client.1.smithi069.stdout:9/351: mkdir d2/da/dd/d80 0 2024-04-25T17:19:10.933 INFO:tasks.workunit.client.1.smithi069.stdout:9/352: dread d2/da/dd/de/d74/f78 [0,4194304] 0 2024-04-25T17:19:10.934 INFO:tasks.workunit.client.1.smithi069.stdout:1/318: getdents d1/d43/d35/d1d 0 2024-04-25T17:19:10.935 INFO:tasks.workunit.client.1.smithi069.stdout:1/319: dread - d1/d43/f5b zero size 2024-04-25T17:19:10.938 INFO:tasks.workunit.client.0.smithi037.stdout:5/552: sync 2024-04-25T17:19:10.938 INFO:tasks.workunit.client.1.smithi069.stdout:1/320: dread d1/d43/d35/f14 [0,4194304] 0 2024-04-25T17:19:10.939 INFO:tasks.workunit.client.0.smithi037.stdout:4/672: unlink d7/d7e/d45/d4f/c69 0 2024-04-25T17:19:10.944 INFO:tasks.workunit.client.0.smithi037.stdout:7/518: truncate d5/d15/d17/d25/f67 1000811 0 2024-04-25T17:19:10.945 INFO:tasks.workunit.client.1.smithi069.stdout:2/274: mknod d0/d1/d1d/d33/c5a 0 2024-04-25T17:19:10.945 INFO:tasks.workunit.client.1.smithi069.stdout:2/275: chown d0/d26/d36/f3f 910388 1 2024-04-25T17:19:10.947 INFO:tasks.workunit.client.0.smithi037.stdout:1/516: mknod dc/d1c/d57/cb6 0 2024-04-25T17:19:10.949 INFO:tasks.workunit.client.0.smithi037.stdout:1/517: stat dc/d1c/d57/f83 0 2024-04-25T17:19:10.949 INFO:tasks.workunit.client.0.smithi037.stdout:9/603: symlink d1/d48/d68/d4e/lcc 0 2024-04-25T17:19:10.949 INFO:tasks.workunit.client.0.smithi037.stdout:6/480: dread db/d1d/f5c [0,4194304] 0 2024-04-25T17:19:10.950 INFO:tasks.workunit.client.1.smithi069.stdout:7/315: sync 2024-04-25T17:19:10.950 INFO:tasks.workunit.client.1.smithi069.stdout:2/276: dwrite d0/d1/f20 [0,4194304] 0 2024-04-25T17:19:10.952 INFO:tasks.workunit.client.1.smithi069.stdout:8/272: getdents d37 0 2024-04-25T17:19:10.952 INFO:tasks.workunit.client.1.smithi069.stdout:7/316: write d4/f58 [667806,73216] 0 2024-04-25T17:19:10.952 INFO:tasks.workunit.client.0.smithi037.stdout:0/539: dwrite d9/d14/d28/d48/d58/f77 [0,4194304] 0 2024-04-25T17:19:10.953 INFO:tasks.workunit.client.0.smithi037.stdout:1/518: chown dc/d1c/d57/d22/d36/d92/c98 0 1 2024-04-25T17:19:10.953 INFO:tasks.workunit.client.1.smithi069.stdout:0/260: mkdir d0/da/d59 0 2024-04-25T17:19:10.954 INFO:tasks.workunit.client.0.smithi037.stdout:0/540: readlink d9/d71/dad/lae 0 2024-04-25T17:19:10.956 INFO:tasks.workunit.client.1.smithi069.stdout:4/303: creat db/d15/d20/d35/f66 x:0 0 0 2024-04-25T17:19:10.959 INFO:tasks.workunit.client.1.smithi069.stdout:2/277: dwrite d0/f7 [0,4194304] 0 2024-04-25T17:19:10.960 INFO:tasks.workunit.client.0.smithi037.stdout:5/553: creat d7/d12/d5d/faa x:0 0 0 2024-04-25T17:19:10.961 INFO:tasks.workunit.client.1.smithi069.stdout:7/317: dwrite d4/d6/d14/d15/d3c/f53 [0,4194304] 0 2024-04-25T17:19:10.962 INFO:tasks.workunit.client.1.smithi069.stdout:5/313: symlink d13/d17/d29/d2e/l66 0 2024-04-25T17:19:10.963 INFO:tasks.workunit.client.1.smithi069.stdout:7/318: truncate d4/d1a/d34/f65 1044716 0 2024-04-25T17:19:10.964 INFO:tasks.workunit.client.0.smithi037.stdout:4/673: creat d7/d7e/d1e/d2b/d35/d39/d7a/fd4 x:0 0 0 2024-04-25T17:19:10.964 INFO:tasks.workunit.client.1.smithi069.stdout:7/319: dread - d4/d6/d14/d3d/f69 zero size 2024-04-25T17:19:10.967 INFO:tasks.workunit.client.1.smithi069.stdout:7/320: truncate d4/d3e/f62 664665 0 2024-04-25T17:19:10.968 INFO:tasks.workunit.client.0.smithi037.stdout:7/519: truncate d5/d15/d17/d1b/f5b 983205 0 2024-04-25T17:19:10.973 INFO:tasks.workunit.client.1.smithi069.stdout:1/321: creat d1/d4/de/d44/f5d x:0 0 0 2024-04-25T17:19:10.974 INFO:tasks.workunit.client.0.smithi037.stdout:9/604: stat d1/d48/caa 0 2024-04-25T17:19:10.976 INFO:tasks.workunit.client.1.smithi069.stdout:3/392: mkdir d8/d16/d1a/d2c/d49/d87 0 2024-04-25T17:19:10.978 INFO:tasks.workunit.client.0.smithi037.stdout:8/436: getdents d5/db/d59 0 2024-04-25T17:19:10.980 INFO:tasks.workunit.client.0.smithi037.stdout:6/481: rename db/d1d/d20/d2f/f8e to db/d5a/faa 0 2024-04-25T17:19:10.980 INFO:tasks.workunit.client.1.smithi069.stdout:1/322: dwrite d1/df/f33 [0,4194304] 0 2024-04-25T17:19:10.982 INFO:tasks.workunit.client.0.smithi037.stdout:2/484: creat d0/d16/f96 x:0 0 0 2024-04-25T17:19:10.986 INFO:tasks.workunit.client.1.smithi069.stdout:3/393: dread d8/d16/d1a/d2c/d49/f68 [0,4194304] 0 2024-04-25T17:19:10.986 INFO:tasks.workunit.client.0.smithi037.stdout:0/541: creat d9/df/fb3 x:0 0 0 2024-04-25T17:19:10.988 INFO:tasks.workunit.client.0.smithi037.stdout:0/542: write d9/d14/d23/f29 [4576822,572] 0 2024-04-25T17:19:10.988 INFO:tasks.workunit.client.0.smithi037.stdout:3/336: write d8/d31/d32/d3e/f42 [992747,113953] 0 2024-04-25T17:19:10.990 INFO:tasks.workunit.client.0.smithi037.stdout:3/337: readlink d8/d23/d3a/l67 0 2024-04-25T17:19:10.991 INFO:tasks.workunit.client.0.smithi037.stdout:3/338: dread - d8/d31/d32/f51 zero size 2024-04-25T17:19:10.991 INFO:tasks.workunit.client.0.smithi037.stdout:4/674: readlink d7/d7e/d1e/l1f 0 2024-04-25T17:19:10.993 INFO:tasks.workunit.client.1.smithi069.stdout:4/304: unlink db/d22/f33 0 2024-04-25T17:19:10.995 INFO:tasks.workunit.client.0.smithi037.stdout:7/520: mknod d5/d14/cb8 0 2024-04-25T17:19:10.995 INFO:tasks.workunit.client.0.smithi037.stdout:3/339: dread d8/f37 [0,4194304] 0 2024-04-25T17:19:10.996 INFO:tasks.workunit.client.1.smithi069.stdout:2/278: readlink d0/l1c 0 2024-04-25T17:19:10.998 INFO:tasks.workunit.client.0.smithi037.stdout:9/605: creat d1/d48/d68/d1c/fcd x:0 0 0 2024-04-25T17:19:11.000 INFO:tasks.workunit.client.1.smithi069.stdout:7/321: dread d4/d6/d14/d15/f28 [0,4194304] 0 2024-04-25T17:19:11.000 INFO:tasks.workunit.client.0.smithi037.stdout:8/437: creat d5/d6a/f89 x:0 0 0 2024-04-25T17:19:11.002 INFO:tasks.workunit.client.0.smithi037.stdout:6/482: rename db/f16 to db/d26/d2e/d3e/fab 0 2024-04-25T17:19:11.005 INFO:tasks.workunit.client.1.smithi069.stdout:9/353: write d2/da/dd/d1e/d2e/d35/f6c [632549,120244] 0 2024-04-25T17:19:11.006 INFO:tasks.workunit.client.1.smithi069.stdout:5/314: dread d13/d17/d19/f28 [0,4194304] 0 2024-04-25T17:19:11.006 INFO:tasks.workunit.client.1.smithi069.stdout:7/322: dwrite d4/f10 [4194304,4194304] 0 2024-04-25T17:19:11.007 INFO:tasks.workunit.client.1.smithi069.stdout:6/286: sync 2024-04-25T17:19:11.009 INFO:tasks.workunit.client.1.smithi069.stdout:7/323: write d4/f6a [1040098,72301] 0 2024-04-25T17:19:11.011 INFO:tasks.workunit.client.1.smithi069.stdout:8/273: link d37/f3a d37/d47/d54/f5e 0 2024-04-25T17:19:11.012 INFO:tasks.workunit.client.0.smithi037.stdout:5/554: mkdir d7/d25/d4f/da7/dab 0 2024-04-25T17:19:11.013 INFO:tasks.workunit.client.0.smithi037.stdout:1/519: dwrite dc/d18/d64/f68 [0,4194304] 0 2024-04-25T17:19:11.015 INFO:tasks.workunit.client.1.smithi069.stdout:9/354: dwrite d2/da/d14/f18 [0,4194304] 0 2024-04-25T17:19:11.017 INFO:tasks.workunit.client.1.smithi069.stdout:0/261: getdents d0/da/db/d56 0 2024-04-25T17:19:11.019 INFO:tasks.workunit.client.0.smithi037.stdout:1/520: read dc/d52/d6b/f6e [486325,2575] 0 2024-04-25T17:19:11.020 INFO:tasks.workunit.client.1.smithi069.stdout:7/324: dwrite d4/d1a/d34/f68 [0,4194304] 0 2024-04-25T17:19:11.021 INFO:tasks.workunit.client.0.smithi037.stdout:2/485: dread d0/d16/d26/f4a [0,4194304] 0 2024-04-25T17:19:11.023 INFO:tasks.workunit.client.1.smithi069.stdout:7/325: chown d4/d6/d14/d3d/d5d 2511 1 2024-04-25T17:19:11.025 INFO:tasks.workunit.client.0.smithi037.stdout:4/675: mknod d7/d7e/d4e/cd5 0 2024-04-25T17:19:11.028 INFO:tasks.workunit.client.1.smithi069.stdout:0/262: dwrite d0/da/db/d2c/f4d [0,4194304] 0 2024-04-25T17:19:11.028 INFO:tasks.workunit.client.1.smithi069.stdout:2/279: rename d0/d1/d1d to d0/d1/d5b 0 2024-04-25T17:19:11.032 INFO:tasks.workunit.client.1.smithi069.stdout:0/263: write d0/da/db/d1d/d27/f45 [755916,18389] 0 2024-04-25T17:19:11.034 INFO:tasks.workunit.client.0.smithi037.stdout:3/340: rename d8/d23/f54 to d8/d31/d32/d3e/f6e 0 2024-04-25T17:19:11.038 INFO:tasks.workunit.client.0.smithi037.stdout:9/606: dread d1/d5/dc/f72 [0,4194304] 0 2024-04-25T17:19:11.039 INFO:tasks.workunit.client.0.smithi037.stdout:0/543: dread d9/d14/f3d [0,4194304] 0 2024-04-25T17:19:11.039 INFO:tasks.workunit.client.1.smithi069.stdout:5/315: symlink d13/d17/l67 0 2024-04-25T17:19:11.039 INFO:tasks.workunit.client.0.smithi037.stdout:0/544: chown l3 23 1 2024-04-25T17:19:11.042 INFO:tasks.workunit.client.1.smithi069.stdout:6/287: creat d2/d2e/d35/d48/f5d x:0 0 0 2024-04-25T17:19:11.044 INFO:tasks.workunit.client.1.smithi069.stdout:1/323: dwrite d1/d43/d35/f14 [0,4194304] 0 2024-04-25T17:19:11.045 INFO:tasks.workunit.client.1.smithi069.stdout:8/274: mknod d37/d47/d48/c5f 0 2024-04-25T17:19:11.046 INFO:tasks.workunit.client.1.smithi069.stdout:8/275: chown d37/f3a 65 1 2024-04-25T17:19:11.048 INFO:tasks.workunit.client.0.smithi037.stdout:8/438: rename d5/db/d18/d3b/d50/d51/c5a to d5/d6a/c8a 0 2024-04-25T17:19:11.051 INFO:tasks.workunit.client.1.smithi069.stdout:9/355: rename d2/da/dd/d1e/d2e/l60 to d2/da/dd/d1e/d2e/l81 0 2024-04-25T17:19:11.052 INFO:tasks.workunit.client.1.smithi069.stdout:4/305: fsync db/f14 0 2024-04-25T17:19:11.053 INFO:tasks.workunit.client.0.smithi037.stdout:5/555: dread d7/d25/f4b [0,4194304] 0 2024-04-25T17:19:11.053 INFO:tasks.workunit.client.0.smithi037.stdout:9/607: creat d1/d5/dc/da9/fce x:0 0 0 2024-04-25T17:19:11.056 INFO:tasks.workunit.client.1.smithi069.stdout:2/280: creat d0/d26/d10/f5c x:0 0 0 2024-04-25T17:19:11.058 INFO:tasks.workunit.client.0.smithi037.stdout:8/439: creat d5/db/d23/d58/f8b x:0 0 0 2024-04-25T17:19:11.059 INFO:tasks.workunit.client.1.smithi069.stdout:6/288: fdatasync d2/d7/f44 0 2024-04-25T17:19:11.061 INFO:tasks.workunit.client.0.smithi037.stdout:5/556: dread d7/f75 [0,4194304] 0 2024-04-25T17:19:11.061 INFO:tasks.workunit.client.1.smithi069.stdout:1/324: rename d1/d19/f47 to d1/d43/d35/d1d/f5e 0 2024-04-25T17:19:11.062 INFO:tasks.workunit.client.1.smithi069.stdout:8/276: creat d37/d47/f60 x:0 0 0 2024-04-25T17:19:11.063 INFO:tasks.workunit.client.0.smithi037.stdout:9/608: mknod d1/d5/dc/d38/d8b/ccf 0 2024-04-25T17:19:11.065 INFO:tasks.workunit.client.0.smithi037.stdout:4/676: creat d7/d7e/d5b/fd6 x:0 0 0 2024-04-25T17:19:11.066 INFO:tasks.workunit.client.1.smithi069.stdout:9/356: creat d2/da/dd/d1e/d2e/f82 x:0 0 0 2024-04-25T17:19:11.066 INFO:tasks.workunit.client.1.smithi069.stdout:9/357: chown d2/da/d14/d23/d65/f75 1443 1 2024-04-25T17:19:11.068 INFO:tasks.workunit.client.0.smithi037.stdout:8/440: creat d5/d6a/f8c x:0 0 0 2024-04-25T17:19:11.074 INFO:tasks.workunit.client.0.smithi037.stdout:9/609: creat d1/d48/d68/d26/d81/d9c/fd0 x:0 0 0 2024-04-25T17:19:11.076 INFO:tasks.workunit.client.0.smithi037.stdout:9/610: chown d1/d5/dc/d38/f71 2629 1 2024-04-25T17:19:11.076 INFO:tasks.workunit.client.1.smithi069.stdout:6/289: dread d2/f9 [0,4194304] 0 2024-04-25T17:19:11.076 INFO:tasks.workunit.client.1.smithi069.stdout:6/290: chown d2/d2e/d35/f50 382046 1 2024-04-25T17:19:11.077 INFO:tasks.workunit.client.0.smithi037.stdout:6/483: rename db/d26/d2e/d3e/d25/f6c to db/d1d/d20/fac 0 2024-04-25T17:19:11.078 INFO:tasks.workunit.client.0.smithi037.stdout:3/341: write d8/ff [4931811,54641] 0 2024-04-25T17:19:11.079 INFO:tasks.workunit.client.0.smithi037.stdout:3/342: chown d8/d23/d3a/f4f 39 1 2024-04-25T17:19:11.081 INFO:tasks.workunit.client.0.smithi037.stdout:4/677: creat d7/d7e/d1e/d2b/d35/d39/d9c/da3/fd7 x:0 0 0 2024-04-25T17:19:11.082 INFO:tasks.workunit.client.0.smithi037.stdout:4/678: chown d7/d78/c87 242114 1 2024-04-25T17:19:11.084 INFO:tasks.workunit.client.0.smithi037.stdout:8/441: creat d5/db/d18/d3b/f8d x:0 0 0 2024-04-25T17:19:11.087 INFO:tasks.workunit.client.1.smithi069.stdout:1/325: mkdir d1/d43/d5f 0 2024-04-25T17:19:11.087 INFO:tasks.workunit.client.0.smithi037.stdout:4/679: dwrite d7/d7e/d5b/f73 [0,4194304] 0 2024-04-25T17:19:11.088 INFO:tasks.workunit.client.0.smithi037.stdout:9/611: mknod d1/d48/cd1 0 2024-04-25T17:19:11.090 INFO:tasks.workunit.client.1.smithi069.stdout:8/277: unlink c18 0 2024-04-25T17:19:11.090 INFO:tasks.workunit.client.0.smithi037.stdout:9/612: truncate d1/d5/dc/d3c/fae 1177177 0 2024-04-25T17:19:11.093 INFO:tasks.workunit.client.0.smithi037.stdout:2/486: rename d0/d16/d68/f95 to d0/d16/d20/d59/f97 0 2024-04-25T17:19:11.093 INFO:tasks.workunit.client.0.smithi037.stdout:0/545: write d9/df/d32/f4b [1131908,29680] 0 2024-04-25T17:19:11.094 INFO:tasks.workunit.client.1.smithi069.stdout:3/394: getdents d8/d16/d1a 0 2024-04-25T17:19:11.095 INFO:tasks.workunit.client.0.smithi037.stdout:2/487: fdatasync d0/d16/d3b/f84 0 2024-04-25T17:19:11.097 INFO:tasks.workunit.client.1.smithi069.stdout:9/358: truncate d2/da/dd/d1e/d2e/d35/f38 3182778 0 2024-04-25T17:19:11.098 INFO:tasks.workunit.client.0.smithi037.stdout:9/613: dwrite d1/d5/d19/d6e/f8f [0,4194304] 0 2024-04-25T17:19:11.099 INFO:tasks.workunit.client.1.smithi069.stdout:4/306: creat db/d15/d42/d64/f67 x:0 0 0 2024-04-25T17:19:11.100 INFO:tasks.workunit.client.1.smithi069.stdout:4/307: chown db/d22/d24/d41 1142121 1 2024-04-25T17:19:11.103 INFO:tasks.workunit.client.1.smithi069.stdout:7/326: truncate d4/d6/d14/f48 1088483 0 2024-04-25T17:19:11.103 INFO:tasks.workunit.client.0.smithi037.stdout:5/557: symlink d7/d43/lac 0 2024-04-25T17:19:11.106 INFO:tasks.workunit.client.0.smithi037.stdout:8/442: creat d5/db/d18/d3b/d50/f8e x:0 0 0 2024-04-25T17:19:11.114 INFO:tasks.workunit.client.0.smithi037.stdout:4/680: dwrite d7/f10 [0,4194304] 0 2024-04-25T17:19:11.116 INFO:tasks.workunit.client.0.smithi037.stdout:4/681: fdatasync d7/d7e/d1e/d2b/d35/d39/fac 0 2024-04-25T17:19:11.118 INFO:tasks.workunit.client.1.smithi069.stdout:3/395: rename d8/d16/d1a/d2c/f5f to d8/d16/d1a/d38/f88 0 2024-04-25T17:19:11.118 INFO:tasks.workunit.client.0.smithi037.stdout:3/343: write d8/d31/f5f [2541010,57590] 0 2024-04-25T17:19:11.120 INFO:tasks.workunit.client.1.smithi069.stdout:0/264: creat d0/da/db/d3a/f5a x:0 0 0 2024-04-25T17:19:11.123 INFO:tasks.workunit.client.0.smithi037.stdout:2/488: creat d0/d16/d26/f98 x:0 0 0 2024-04-25T17:19:11.125 INFO:tasks.workunit.client.1.smithi069.stdout:5/316: getdents d13/d17/d19/d20/d2d 0 2024-04-25T17:19:11.126 INFO:tasks.workunit.client.1.smithi069.stdout:6/291: creat d2/d1e/d3f/d56/f5e x:0 0 0 2024-04-25T17:19:11.127 INFO:tasks.workunit.client.1.smithi069.stdout:8/278: write f26 [751452,45748] 0 2024-04-25T17:19:11.130 INFO:tasks.workunit.client.1.smithi069.stdout:0/265: dwrite d0/da/db/d2a/f3b [4194304,4194304] 0 2024-04-25T17:19:11.130 INFO:tasks.workunit.client.0.smithi037.stdout:5/558: unlink d7/d12/d6f/d68/la6 0 2024-04-25T17:19:11.130 INFO:tasks.workunit.client.0.smithi037.stdout:8/443: read d5/d6a/f3f [994328,26529] 0 2024-04-25T17:19:11.131 INFO:tasks.workunit.client.1.smithi069.stdout:4/308: dread db/d22/d24/f31 [4194304,4194304] 0 2024-04-25T17:19:11.131 INFO:tasks.workunit.client.1.smithi069.stdout:0/266: truncate d0/da/d24/f42 579084 0 2024-04-25T17:19:11.134 INFO:tasks.workunit.client.1.smithi069.stdout:9/359: rename d2/da/dd/d1e/d40/f61 to d2/da/d14/d23/f83 0 2024-04-25T17:19:11.135 INFO:tasks.workunit.client.0.smithi037.stdout:4/682: chown d7/d7e/d5b/c65 101772917 1 2024-04-25T17:19:11.138 INFO:tasks.workunit.client.1.smithi069.stdout:3/396: unlink d8/d2a/f53 0 2024-04-25T17:19:11.139 INFO:tasks.workunit.client.0.smithi037.stdout:4/683: dread d7/d7e/f3c [0,4194304] 0 2024-04-25T17:19:11.141 INFO:tasks.workunit.client.0.smithi037.stdout:3/344: unlink d8/d23/d3a/d5d/f65 0 2024-04-25T17:19:11.143 INFO:tasks.workunit.client.0.smithi037.stdout:6/484: creat db/d26/d2e/d3e/d25/fad x:0 0 0 2024-04-25T17:19:11.145 INFO:tasks.workunit.client.0.smithi037.stdout:2/489: creat d0/d16/d20/d59/d6a/f99 x:0 0 0 2024-04-25T17:19:11.145 INFO:tasks.workunit.client.0.smithi037.stdout:4/684: dwrite d7/d7e/f3c [0,4194304] 0 2024-04-25T17:19:11.147 INFO:tasks.workunit.client.1.smithi069.stdout:7/327: dwrite d4/d1a/f24 [0,4194304] 0 2024-04-25T17:19:11.148 INFO:tasks.workunit.client.1.smithi069.stdout:1/326: truncate d1/df/d17/f2d 4716472 0 2024-04-25T17:19:11.152 INFO:tasks.workunit.client.1.smithi069.stdout:1/327: dread d1/d43/d35/d1d/f5e [0,4194304] 0 2024-04-25T17:19:11.152 INFO:tasks.workunit.client.0.smithi037.stdout:9/614: dwrite d1/d5/d2e/d34/f89 [0,4194304] 0 2024-04-25T17:19:11.153 INFO:tasks.workunit.client.1.smithi069.stdout:6/292: unlink d2/d1e/f23 0 2024-04-25T17:19:11.154 INFO:tasks.workunit.client.0.smithi037.stdout:5/559: creat d7/d12/d6f/d94/fad x:0 0 0 2024-04-25T17:19:11.156 INFO:tasks.workunit.client.1.smithi069.stdout:8/279: mkdir d37/d61 0 2024-04-25T17:19:11.158 INFO:tasks.workunit.client.0.smithi037.stdout:8/444: symlink d5/db/d23/d42/l8f 0 2024-04-25T17:19:11.161 INFO:tasks.workunit.client.0.smithi037.stdout:0/546: mkdir d9/df/d32/d39/d68/da7/db4 0 2024-04-25T17:19:11.163 INFO:tasks.workunit.client.1.smithi069.stdout:0/267: symlink d0/d17/l5b 0 2024-04-25T17:19:11.164 INFO:tasks.workunit.client.0.smithi037.stdout:6/485: mkdir db/d26/d2e/d7d/d65/d68/dae 0 2024-04-25T17:19:11.166 INFO:tasks.workunit.client.1.smithi069.stdout:9/360: rename d2/da/dd/d1e/d2e/c3f to d2/da/dd/d1e/d2e/d35/c84 0 2024-04-25T17:19:11.167 INFO:tasks.workunit.client.1.smithi069.stdout:9/361: fdatasync d2/da/dd/d1e/d2e/f45 0 2024-04-25T17:19:11.171 INFO:tasks.workunit.client.1.smithi069.stdout:5/317: mknod d13/d17/d19/c68 0 2024-04-25T17:19:11.171 INFO:tasks.workunit.client.0.smithi037.stdout:5/560: dread - d7/d63/f8d zero size 2024-04-25T17:19:11.172 INFO:tasks.workunit.client.0.smithi037.stdout:5/561: read d7/ff [1832066,56176] 0 2024-04-25T17:19:11.173 INFO:tasks.workunit.client.0.smithi037.stdout:8/445: mknod d5/d26/d33/c90 0 2024-04-25T17:19:11.173 INFO:tasks.workunit.client.1.smithi069.stdout:5/318: write d13/f26 [335929,130768] 0 2024-04-25T17:19:11.174 INFO:tasks.workunit.client.0.smithi037.stdout:5/562: truncate d7/d18/fa4 199093 0 2024-04-25T17:19:11.175 INFO:tasks.workunit.client.0.smithi037.stdout:0/547: creat d9/df/fb5 x:0 0 0 2024-04-25T17:19:11.175 INFO:tasks.workunit.client.1.smithi069.stdout:9/362: dwrite d2/f17 [0,4194304] 0 2024-04-25T17:19:11.176 INFO:tasks.workunit.client.0.smithi037.stdout:0/548: chown d9/df/d32/d39/f8b 55 1 2024-04-25T17:19:11.177 INFO:tasks.workunit.client.1.smithi069.stdout:5/319: write d13/d17/d19/d20/d2d/f5d [858159,60017] 0 2024-04-25T17:19:11.177 INFO:tasks.workunit.client.1.smithi069.stdout:2/281: sync 2024-04-25T17:19:11.180 INFO:tasks.workunit.client.1.smithi069.stdout:6/293: symlink d2/d1e/d43/l5f 0 2024-04-25T17:19:11.182 INFO:tasks.workunit.client.1.smithi069.stdout:8/280: unlink c28 0 2024-04-25T17:19:11.184 INFO:tasks.workunit.client.0.smithi037.stdout:9/615: symlink d1/d5/d2e/d34/daf/dcb/ld2 0 2024-04-25T17:19:11.185 INFO:tasks.workunit.client.1.smithi069.stdout:6/294: dwrite d2/fe [0,4194304] 0 2024-04-25T17:19:11.185 INFO:tasks.workunit.client.0.smithi037.stdout:8/446: mknod d5/db/d59/c91 0 2024-04-25T17:19:11.191 INFO:tasks.workunit.client.0.smithi037.stdout:0/549: rename d9/d14/f95 to d9/d14/d28/d48/da9/fb6 0 2024-04-25T17:19:11.192 INFO:tasks.workunit.client.0.smithi037.stdout:0/550: fsync d9/d14/d23/f3c 0 2024-04-25T17:19:11.193 INFO:tasks.workunit.client.0.smithi037.stdout:6/486: truncate db/d53/f58 601750 0 2024-04-25T17:19:11.195 INFO:tasks.workunit.client.1.smithi069.stdout:1/328: rmdir d1/df/d17 39 2024-04-25T17:19:11.202 INFO:tasks.workunit.client.0.smithi037.stdout:9/616: creat d1/d5/dc/d38/d8b/fd3 x:0 0 0 2024-04-25T17:19:11.203 INFO:tasks.workunit.client.1.smithi069.stdout:5/320: write d13/d17/f1b [2896399,42981] 0 2024-04-25T17:19:11.203 INFO:tasks.workunit.client.0.smithi037.stdout:9/617: chown d1/d5/d19/d6e 145655 1 2024-04-25T17:19:11.204 INFO:tasks.workunit.client.0.smithi037.stdout:8/447: mknod d5/d26/c92 0 2024-04-25T17:19:11.205 INFO:tasks.workunit.client.0.smithi037.stdout:9/618: read d1/fd [239995,66663] 0 2024-04-25T17:19:11.206 INFO:tasks.workunit.client.0.smithi037.stdout:5/563: dread d7/f49 [0,4194304] 0 2024-04-25T17:19:11.210 INFO:tasks.workunit.client.0.smithi037.stdout:4/685: write d7/d7e/d1e/d2b/d35/d39/dba/fb4 [2981886,94806] 0 2024-04-25T17:19:11.210 INFO:tasks.workunit.client.1.smithi069.stdout:8/281: chown d37 6456 1 2024-04-25T17:19:11.211 INFO:tasks.workunit.client.0.smithi037.stdout:4/686: write d7/d7e/d1e/fcf [1046222,52582] 0 2024-04-25T17:19:11.215 INFO:tasks.workunit.client.1.smithi069.stdout:0/268: creat d0/da/d54/f5c x:0 0 0 2024-04-25T17:19:11.216 INFO:tasks.workunit.client.1.smithi069.stdout:0/269: write d0/da/d24/f42 [1598801,28774] 0 2024-04-25T17:19:11.217 INFO:tasks.workunit.client.1.smithi069.stdout:6/295: rename d2/l31 to d2/d51/l60 0 2024-04-25T17:19:11.220 INFO:tasks.workunit.client.1.smithi069.stdout:0/270: dread d0/da/db/d1d/f20 [0,4194304] 0 2024-04-25T17:19:11.224 INFO:tasks.workunit.client.1.smithi069.stdout:9/363: creat d2/da/d5f/d76/f85 x:0 0 0 2024-04-25T17:19:11.231 INFO:tasks.workunit.client.0.smithi037.stdout:9/619: rename d1/d5/dc/c1e to d1/d48/d68/d26/da1/cd4 0 2024-04-25T17:19:11.233 INFO:tasks.workunit.client.1.smithi069.stdout:5/321: creat d13/d17/d29/d30/d5c/f69 x:0 0 0 2024-04-25T17:19:11.236 INFO:tasks.workunit.client.0.smithi037.stdout:0/551: mkdir d9/d14/d28/d48/db7 0 2024-04-25T17:19:11.239 INFO:tasks.workunit.client.1.smithi069.stdout:4/309: getdents db/d15/d42 0 2024-04-25T17:19:11.241 INFO:tasks.workunit.client.0.smithi037.stdout:2/490: getdents d0/d23 0 2024-04-25T17:19:11.246 INFO:tasks.workunit.client.0.smithi037.stdout:5/564: dwrite d7/d25/f39 [0,4194304] 0 2024-04-25T17:19:11.248 INFO:tasks.workunit.client.1.smithi069.stdout:6/296: symlink d2/d51/l61 0 2024-04-25T17:19:11.248 INFO:tasks.workunit.client.0.smithi037.stdout:1/521: sync 2024-04-25T17:19:11.248 INFO:tasks.workunit.client.0.smithi037.stdout:7/521: sync 2024-04-25T17:19:11.248 INFO:tasks.workunit.client.0.smithi037.stdout:3/345: sync 2024-04-25T17:19:11.249 INFO:tasks.workunit.client.1.smithi069.stdout:2/282: write d0/d1/d5b/f29 [2034082,64624] 0 2024-04-25T17:19:11.250 INFO:tasks.workunit.client.1.smithi069.stdout:3/397: getdents d8/d16/d31 0 2024-04-25T17:19:11.251 INFO:tasks.workunit.client.0.smithi037.stdout:3/346: write d8/d23/d3a/f50 [1037799,38664] 0 2024-04-25T17:19:11.253 INFO:tasks.workunit.client.0.smithi037.stdout:8/448: truncate d5/d6a/f71 3845070 0 2024-04-25T17:19:11.256 INFO:tasks.workunit.client.0.smithi037.stdout:4/687: mkdir d7/d7e/d1e/d2b/d35/d39/dd8 0 2024-04-25T17:19:11.258 INFO:tasks.workunit.client.0.smithi037.stdout:8/449: chown d5/db/d23/d58/f79 73 1 2024-04-25T17:19:11.258 INFO:tasks.workunit.client.0.smithi037.stdout:6/487: dwrite db/d26/d2e/d3e/f45 [0,4194304] 0 2024-04-25T17:19:11.259 INFO:tasks.workunit.client.1.smithi069.stdout:0/271: mknod d0/da/d54/c5d 0 2024-04-25T17:19:11.259 INFO:tasks.workunit.client.1.smithi069.stdout:7/328: link d4/d1a/c3a d4/d6/d14/d15/d3c/d23/c6d 0 2024-04-25T17:19:11.259 INFO:tasks.workunit.client.0.smithi037.stdout:4/688: dread - d7/d7e/d1e/d2b/d35/d39/d9c/da3/fc0 zero size 2024-04-25T17:19:11.262 INFO:tasks.workunit.client.1.smithi069.stdout:9/364: creat d2/da/d5f/f86 x:0 0 0 2024-04-25T17:19:11.265 INFO:tasks.workunit.client.1.smithi069.stdout:1/329: truncate d1/d43/d35/f14 2171696 0 2024-04-25T17:19:11.267 INFO:tasks.workunit.client.1.smithi069.stdout:5/322: rmdir d13 39 2024-04-25T17:19:11.269 INFO:tasks.workunit.client.0.smithi037.stdout:7/522: creat d5/d15/d17/d1b/da2/daf/fb9 x:0 0 0 2024-04-25T17:19:11.271 INFO:tasks.workunit.client.1.smithi069.stdout:8/282: mkdir d37/d62 0 2024-04-25T17:19:11.273 INFO:tasks.workunit.client.1.smithi069.stdout:4/310: creat db/d15/d20/d38/f68 x:0 0 0 2024-04-25T17:19:11.274 INFO:tasks.workunit.client.0.smithi037.stdout:3/347: creat d8/d23/d38/d66/f6f x:0 0 0 2024-04-25T17:19:11.276 INFO:tasks.workunit.client.1.smithi069.stdout:6/297: rename d2/f10 to d2/d1e/f62 0 2024-04-25T17:19:11.277 INFO:tasks.workunit.client.1.smithi069.stdout:2/283: readlink d0/d1/d5b/d28/l40 0 2024-04-25T17:19:11.278 INFO:tasks.workunit.client.0.smithi037.stdout:3/348: dread d8/d23/d3a/d5d/f20 [0,4194304] 0 2024-04-25T17:19:11.280 INFO:tasks.workunit.client.1.smithi069.stdout:3/398: creat d8/d39/f89 x:0 0 0 2024-04-25T17:19:11.282 INFO:tasks.workunit.client.1.smithi069.stdout:2/284: dread d0/d1/d5b/d33/f51 [0,4194304] 0 2024-04-25T17:19:11.282 INFO:tasks.workunit.client.0.smithi037.stdout:8/450: mkdir d5/db/d23/d78/d93 0 2024-04-25T17:19:11.283 INFO:tasks.workunit.client.0.smithi037.stdout:8/451: read d5/db/d59/f5f [670,84624] 0 2024-04-25T17:19:11.285 INFO:tasks.workunit.client.0.smithi037.stdout:4/689: rename d7/f3b to d7/d7e/d1e/d2b/d35/fd9 0 2024-04-25T17:19:11.285 INFO:tasks.workunit.client.0.smithi037.stdout:8/452: truncate d5/db/d23/d58/f6e 819372 0 2024-04-25T17:19:11.286 INFO:tasks.workunit.client.1.smithi069.stdout:1/330: symlink d1/d4/l60 0 2024-04-25T17:19:11.287 INFO:tasks.workunit.client.0.smithi037.stdout:8/453: write d5/d6a/f66 [575332,101014] 0 2024-04-25T17:19:11.292 INFO:tasks.workunit.client.1.smithi069.stdout:4/311: symlink db/d15/d20/d35/d63/d43/d48/d49/l69 0 2024-04-25T17:19:11.296 INFO:tasks.workunit.client.0.smithi037.stdout:1/522: creat dc/d1c/d57/d22/d36/d74/da6/fb7 x:0 0 0 2024-04-25T17:19:11.298 INFO:tasks.workunit.client.0.smithi037.stdout:0/552: dwrite d9/f19 [0,4194304] 0 2024-04-25T17:19:11.302 INFO:tasks.workunit.client.0.smithi037.stdout:2/491: truncate d0/d23/d7d/f62 452078 0 2024-04-25T17:19:11.303 INFO:tasks.workunit.client.0.smithi037.stdout:3/349: symlink d8/d23/d3a/d5d/l70 0 2024-04-25T17:19:11.303 INFO:tasks.workunit.client.0.smithi037.stdout:2/492: stat d0/d16/d20/d59/d6a/f8c 0 2024-04-25T17:19:11.304 INFO:tasks.workunit.client.0.smithi037.stdout:2/493: chown d0/d16/d26/d3e/f8e 2715 1 2024-04-25T17:19:11.305 INFO:tasks.workunit.client.0.smithi037.stdout:7/523: write d5/d15/f7e [998441,109767] 0 2024-04-25T17:19:11.307 INFO:tasks.workunit.client.0.smithi037.stdout:6/488: mkdir db/d26/d2e/daf 0 2024-04-25T17:19:11.307 INFO:tasks.workunit.client.0.smithi037.stdout:7/524: chown d5/d15/d17/d1b/da2/daf/f2a 20172 1 2024-04-25T17:19:11.310 INFO:tasks.workunit.client.1.smithi069.stdout:2/285: symlink d0/d26/d36/l5d 0 2024-04-25T17:19:11.311 INFO:tasks.workunit.client.1.smithi069.stdout:2/286: fsync d0/d1/d5b/d33/f39 0 2024-04-25T17:19:11.312 INFO:tasks.workunit.client.1.smithi069.stdout:1/331: mknod d1/d19/c61 0 2024-04-25T17:19:11.313 INFO:tasks.workunit.client.1.smithi069.stdout:5/323: mknod d13/c6a 0 2024-04-25T17:19:11.316 INFO:tasks.workunit.client.1.smithi069.stdout:8/283: rmdir d37 39 2024-04-25T17:19:11.316 INFO:tasks.workunit.client.1.smithi069.stdout:8/284: fsync f26 0 2024-04-25T17:19:11.317 INFO:tasks.workunit.client.0.smithi037.stdout:8/454: creat d5/db/d18/d3b/d50/f94 x:0 0 0 2024-04-25T17:19:11.318 INFO:tasks.workunit.client.1.smithi069.stdout:7/329: truncate d4/d1a/f5c 2790860 0 2024-04-25T17:19:11.319 INFO:tasks.workunit.client.1.smithi069.stdout:4/312: creat db/d15/d20/d38/f6a x:0 0 0 2024-04-25T17:19:11.319 INFO:tasks.workunit.client.1.smithi069.stdout:7/330: chown d4/d6/d14/d3d/d5b 1008073 1 2024-04-25T17:19:11.320 INFO:tasks.workunit.client.1.smithi069.stdout:5/324: dwrite d13/d17/f63 [0,4194304] 0 2024-04-25T17:19:11.320 INFO:tasks.workunit.client.1.smithi069.stdout:4/313: fsync db/d15/f18 0 2024-04-25T17:19:11.320 INFO:tasks.workunit.client.0.smithi037.stdout:5/565: creat d7/d18/d62/fae x:0 0 0 2024-04-25T17:19:11.321 INFO:tasks.workunit.client.1.smithi069.stdout:4/314: chown db/d15/f18 392128859 1 2024-04-25T17:19:11.321 INFO:tasks.workunit.client.1.smithi069.stdout:7/331: dread - d4/d6/d14/d5a/d5e/f60 zero size 2024-04-25T17:19:11.322 INFO:tasks.workunit.client.1.smithi069.stdout:5/325: dread d13/d17/d19/d20/f24 [0,4194304] 0 2024-04-25T17:19:11.322 INFO:tasks.workunit.client.0.smithi037.stdout:1/523: dread - dc/d52/f5b zero size 2024-04-25T17:19:11.323 INFO:tasks.workunit.client.0.smithi037.stdout:1/524: write dc/d24/f8a [332929,85030] 0 2024-04-25T17:19:11.323 INFO:tasks.workunit.client.1.smithi069.stdout:5/326: chown d13/d17/d29/d2e/c4b 1353957 1 2024-04-25T17:19:11.324 INFO:tasks.workunit.client.0.smithi037.stdout:1/525: chown dc/d18/d39/l84 713264899 1 2024-04-25T17:19:11.325 INFO:tasks.workunit.client.1.smithi069.stdout:6/298: fsync d2/f1c 0 2024-04-25T17:19:11.325 INFO:tasks.workunit.client.0.smithi037.stdout:9/620: link d1/d5/dc/l96 d1/d5/dc/d38/ld5 0 2024-04-25T17:19:11.326 INFO:tasks.workunit.client.0.smithi037.stdout:1/526: write dc/d24/f8a [361150,98887] 0 2024-04-25T17:19:11.328 INFO:tasks.workunit.client.0.smithi037.stdout:0/553: creat d9/df/d32/d35/fb8 x:0 0 0 2024-04-25T17:19:11.328 INFO:tasks.workunit.client.1.smithi069.stdout:5/327: dread d13/d17/d29/f43 [0,4194304] 0 2024-04-25T17:19:11.329 INFO:tasks.workunit.client.1.smithi069.stdout:3/399: mkdir d8/d16/d1a/d2c/d49/d87/d8a 0 2024-04-25T17:19:11.330 INFO:tasks.workunit.client.1.smithi069.stdout:4/315: dwrite db/d15/d26/f62 [0,4194304] 0 2024-04-25T17:19:11.335 INFO:tasks.workunit.client.1.smithi069.stdout:2/287: creat d0/d56/f5e x:0 0 0 2024-04-25T17:19:11.340 INFO:tasks.workunit.client.0.smithi037.stdout:7/525: rmdir d5/d15/d17/d9d 39 2024-04-25T17:19:11.342 INFO:tasks.workunit.client.0.smithi037.stdout:7/526: chown d5/d15/d17/d1b/da2/lb7 3208753 1 2024-04-25T17:19:11.342 INFO:tasks.workunit.client.0.smithi037.stdout:6/489: dwrite db/d5a/faa [0,4194304] 0 2024-04-25T17:19:11.351 INFO:tasks.workunit.client.1.smithi069.stdout:0/272: rename d0/da/d24/l25 to d0/l5e 0 2024-04-25T17:19:11.352 INFO:tasks.workunit.client.1.smithi069.stdout:7/332: truncate d4/d6/d14/d15/f28 1742717 0 2024-04-25T17:19:11.353 INFO:tasks.workunit.client.0.smithi037.stdout:9/621: creat d1/d5/d19/d6e/fd6 x:0 0 0 2024-04-25T17:19:11.354 INFO:tasks.workunit.client.1.smithi069.stdout:7/333: read - d4/d6/d14/d5a/f6c zero size 2024-04-25T17:19:11.354 INFO:tasks.workunit.client.1.smithi069.stdout:7/334: stat d4/d1a/d34/f65 0 2024-04-25T17:19:11.354 INFO:tasks.workunit.client.1.smithi069.stdout:7/335: stat d4/d1a/f24 0 2024-04-25T17:19:11.355 INFO:tasks.workunit.client.1.smithi069.stdout:6/299: unlink d2/f2a 0 2024-04-25T17:19:11.357 INFO:tasks.workunit.client.0.smithi037.stdout:2/494: rename d0/d16/d26/c35 to d0/d16/d68/c9a 0 2024-04-25T17:19:11.357 INFO:tasks.workunit.client.0.smithi037.stdout:4/690: link d7/d7e/d1e/d2b/d35/d39/dba/fc2 d7/d7e/d1e/d2b/d35/d39/d9c/fda 0 2024-04-25T17:19:11.359 INFO:tasks.workunit.client.1.smithi069.stdout:3/400: mkdir d8/d8b 0 2024-04-25T17:19:11.359 INFO:tasks.workunit.client.0.smithi037.stdout:6/490: stat db/d1d/d20/d85/fa3 0 2024-04-25T17:19:11.360 INFO:tasks.workunit.client.1.smithi069.stdout:4/316: rmdir db 39 2024-04-25T17:19:11.361 INFO:tasks.workunit.client.0.smithi037.stdout:7/527: mknod d5/d15/d17/d1b/da2/daf/d80/cba 0 2024-04-25T17:19:11.361 INFO:tasks.workunit.client.0.smithi037.stdout:7/528: stat d5/d15/d17/f65 0 2024-04-25T17:19:11.362 INFO:tasks.workunit.client.0.smithi037.stdout:8/455: symlink d5/d26/d81/l95 0 2024-04-25T17:19:11.363 INFO:tasks.workunit.client.0.smithi037.stdout:8/456: chown d5/db/d7e/f76 2111859427 1 2024-04-25T17:19:11.363 INFO:tasks.workunit.client.1.smithi069.stdout:9/365: getdents d2/da/dd/d1e/d2e/d35 0 2024-04-25T17:19:11.363 INFO:tasks.workunit.client.1.smithi069.stdout:2/288: fsync d0/d1/d5b/d33/f51 0 2024-04-25T17:19:11.365 INFO:tasks.workunit.client.0.smithi037.stdout:9/622: creat d1/d48/d68/d4e/fd7 x:0 0 0 2024-04-25T17:19:11.366 INFO:tasks.workunit.client.1.smithi069.stdout:1/332: mknod d1/df/c62 0 2024-04-25T17:19:11.368 INFO:tasks.workunit.client.0.smithi037.stdout:5/566: rename d7/d18/fa4 to d7/d12/d6f/d68/faf 0 2024-04-25T17:19:11.371 INFO:tasks.workunit.client.1.smithi069.stdout:0/273: mkdir d0/da/db/d1d/d5f 0 2024-04-25T17:19:11.383 INFO:tasks.workunit.client.0.smithi037.stdout:0/554: creat d9/fb9 x:0 0 0 2024-04-25T17:19:11.384 INFO:tasks.workunit.client.1.smithi069.stdout:3/401: creat d8/d16/d1a/d2c/d6c/f8c x:0 0 0 2024-04-25T17:19:11.387 INFO:tasks.workunit.client.0.smithi037.stdout:8/457: rename d5/d6a/c53 to d5/db/d18/d3b/d75/c96 0 2024-04-25T17:19:11.389 INFO:tasks.workunit.client.1.smithi069.stdout:5/328: link f5 d13/d17/d19/d20/d51/f6b 0 2024-04-25T17:19:11.390 INFO:tasks.workunit.client.0.smithi037.stdout:5/567: mkdir d7/da1/db0 0 2024-04-25T17:19:11.390 INFO:tasks.workunit.client.0.smithi037.stdout:5/568: readlink d7/d18/l8f 0 2024-04-25T17:19:11.391 INFO:tasks.workunit.client.1.smithi069.stdout:9/366: creat d2/da/d14/d23/d65/f87 x:0 0 0 2024-04-25T17:19:11.392 INFO:tasks.workunit.client.0.smithi037.stdout:2/495: mknod d0/d15/d2a/d5a/d75/c9b 0 2024-04-25T17:19:11.393 INFO:tasks.workunit.client.1.smithi069.stdout:6/300: write d2/f14 [1585293,20614] 0 2024-04-25T17:19:11.396 INFO:tasks.workunit.client.1.smithi069.stdout:2/289: unlink d0/f15 0 2024-04-25T17:19:11.396 INFO:tasks.workunit.client.0.smithi037.stdout:7/529: dwrite d5/d15/d17/f47 [0,4194304] 0 2024-04-25T17:19:11.397 INFO:tasks.workunit.client.0.smithi037.stdout:6/491: mkdir db/d26/d2e/d3e/d25/db0 0 2024-04-25T17:19:11.399 INFO:tasks.workunit.client.0.smithi037.stdout:6/492: write db/d26/f67 [723152,102961] 0 2024-04-25T17:19:11.399 INFO:tasks.workunit.client.1.smithi069.stdout:8/285: creat d37/d62/f63 x:0 0 0 2024-04-25T17:19:11.402 INFO:tasks.workunit.client.1.smithi069.stdout:0/274: rename d0/da/db/d2a/f3b to d0/da/d24/d43/f60 0 2024-04-25T17:19:11.402 INFO:tasks.workunit.client.0.smithi037.stdout:9/623: read - d1/d48/d68/d26/d81/d9c/fa3 zero size 2024-04-25T17:19:11.404 INFO:tasks.workunit.client.0.smithi037.stdout:8/458: symlink d5/db/d23/d42/l97 0 2024-04-25T17:19:11.406 INFO:tasks.workunit.client.1.smithi069.stdout:3/402: mkdir d8/d71/d8d 0 2024-04-25T17:19:11.408 INFO:tasks.workunit.client.1.smithi069.stdout:0/275: dwrite d0/da/f10 [8388608,4194304] 0 2024-04-25T17:19:11.410 INFO:tasks.workunit.client.0.smithi037.stdout:4/691: creat d7/d7e/d1e/d2b/d35/d39/fdb x:0 0 0 2024-04-25T17:19:11.410 INFO:tasks.workunit.client.1.smithi069.stdout:5/329: mkdir d13/d17/d19/d1c/d6c 0 2024-04-25T17:19:11.411 INFO:tasks.workunit.client.0.smithi037.stdout:1/527: getdents dc/d1c/d57/d43 0 2024-04-25T17:19:11.413 INFO:tasks.workunit.client.0.smithi037.stdout:8/459: dwrite d5/db/d59/f88 [0,4194304] 0 2024-04-25T17:19:11.413 INFO:tasks.workunit.client.0.smithi037.stdout:1/528: chown dc/d1c/d57/d22 526 1 2024-04-25T17:19:11.413 INFO:tasks.workunit.client.0.smithi037.stdout:6/493: mkdir db/d1d/db1 0 2024-04-25T17:19:11.415 INFO:tasks.workunit.client.0.smithi037.stdout:6/494: fsync db/f84 0 2024-04-25T17:19:11.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:11 smithi069 ceph-mon[34527]: pgmap v36: 65 pgs: 65 active+clean; 1.5 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 42 MiB/s rd, 177 MiB/s wr, 359 op/s 2024-04-25T17:19:11.421 INFO:tasks.workunit.client.1.smithi069.stdout:2/290: unlink d0/d26/f42 0 2024-04-25T17:19:11.421 INFO:tasks.workunit.client.0.smithi037.stdout:4/692: dwrite d7/d7e/d1e/d2b/d35/d39/fb8 [0,4194304] 0 2024-04-25T17:19:11.422 INFO:tasks.workunit.client.0.smithi037.stdout:4/693: readlink d7/d7e/lbf 0 2024-04-25T17:19:11.423 INFO:tasks.workunit.client.1.smithi069.stdout:1/333: mkdir d1/d4/de/d63 0 2024-04-25T17:19:11.428 INFO:tasks.workunit.client.1.smithi069.stdout:2/291: dwrite d0/d26/d10/f5c [0,4194304] 0 2024-04-25T17:19:11.433 INFO:tasks.workunit.client.1.smithi069.stdout:9/367: rename d2/da/dd/d1e/d2e/d3e to d2/da/d14/d23/d65/d88 0 2024-04-25T17:19:11.439 INFO:tasks.workunit.client.0.smithi037.stdout:2/496: write d0/f14 [5461104,118062] 0 2024-04-25T17:19:11.439 INFO:tasks.workunit.client.1.smithi069.stdout:9/368: dwrite d2/da/dd/de/d64/f6e [0,4194304] 0 2024-04-25T17:19:11.442 INFO:tasks.workunit.client.0.smithi037.stdout:1/529: rmdir dc/d1c/d57/d4d/d6a/d86 39 2024-04-25T17:19:11.444 INFO:tasks.workunit.client.0.smithi037.stdout:1/530: stat dc/d1c/d57/d22/c59 0 2024-04-25T17:19:11.444 INFO:tasks.workunit.client.0.smithi037.stdout:0/555: link d9/df/d32/f55 d9/d71/dad/fba 0 2024-04-25T17:19:11.446 INFO:tasks.workunit.client.1.smithi069.stdout:4/317: mknod db/d15/d42/d53/c6b 0 2024-04-25T17:19:11.447 INFO:tasks.workunit.client.0.smithi037.stdout:2/497: dwrite d0/d16/d3c/f42 [0,4194304] 0 2024-04-25T17:19:11.453 INFO:tasks.workunit.client.1.smithi069.stdout:5/330: symlink d13/d17/l6d 0 2024-04-25T17:19:11.455 INFO:tasks.workunit.client.0.smithi037.stdout:9/624: mknod d1/d5/dc/d3c/dca/cd8 0 2024-04-25T17:19:11.456 INFO:tasks.workunit.client.1.smithi069.stdout:8/286: dread d37/f41 [0,4194304] 0 2024-04-25T17:19:11.457 INFO:tasks.workunit.client.0.smithi037.stdout:4/694: creat d7/d7e/d4e/da5/fdc x:0 0 0 2024-04-25T17:19:11.459 INFO:tasks.workunit.client.1.smithi069.stdout:1/334: fsync d1/f9 0 2024-04-25T17:19:11.460 INFO:tasks.workunit.client.0.smithi037.stdout:8/460: write d5/f6f [1417087,107618] 0 2024-04-25T17:19:11.465 INFO:tasks.workunit.client.1.smithi069.stdout:2/292: rename d0/d26/d36/d41 to d0/d56/d5f 0 2024-04-25T17:19:11.467 INFO:tasks.workunit.client.0.smithi037.stdout:6/495: write db/d26/f2b [3930253,95855] 0 2024-04-25T17:19:11.467 INFO:tasks.workunit.client.0.smithi037.stdout:0/556: symlink d9/d72/lbb 0 2024-04-25T17:19:11.468 INFO:tasks.workunit.client.1.smithi069.stdout:2/293: dread d0/d26/f54 [0,4194304] 0 2024-04-25T17:19:11.473 INFO:tasks.workunit.client.0.smithi037.stdout:1/531: mkdir dc/d1c/d57/d22/d36/d92/db8 0 2024-04-25T17:19:11.474 INFO:tasks.workunit.client.0.smithi037.stdout:0/557: dwrite d9/f73 [0,4194304] 0 2024-04-25T17:19:11.474 INFO:tasks.workunit.client.1.smithi069.stdout:7/336: link d4/d18/l1d d4/d6/d14/l6e 0 2024-04-25T17:19:11.474 INFO:tasks.workunit.client.1.smithi069.stdout:2/294: dwrite d0/d1/d5b/d28/f50 [0,4194304] 0 2024-04-25T17:19:11.477 INFO:tasks.workunit.client.0.smithi037.stdout:2/498: creat d0/d16/d26/f9c x:0 0 0 2024-04-25T17:19:11.478 INFO:tasks.workunit.client.1.smithi069.stdout:3/403: mkdir d8/d16/d1a/d2c/d49/d87/d8a/d8e 0 2024-04-25T17:19:11.479 INFO:tasks.workunit.client.1.smithi069.stdout:3/404: write d8/d71/f85 [205294,109287] 0 2024-04-25T17:19:11.482 INFO:tasks.workunit.client.1.smithi069.stdout:4/318: mkdir db/d15/d20/d35/d63/d43/d48/d6c 0 2024-04-25T17:19:11.484 INFO:tasks.workunit.client.0.smithi037.stdout:1/532: dwrite dc/d52/fb2 [0,4194304] 0 2024-04-25T17:19:11.485 INFO:tasks.workunit.client.0.smithi037.stdout:5/569: dwrite d7/d43/f47 [0,4194304] 0 2024-04-25T17:19:11.487 INFO:tasks.workunit.client.0.smithi037.stdout:5/570: fdatasync d7/d12/d6f/f97 0 2024-04-25T17:19:11.493 INFO:tasks.workunit.client.1.smithi069.stdout:8/287: truncate fb 574971 0 2024-04-25T17:19:11.494 INFO:tasks.workunit.client.0.smithi037.stdout:6/496: truncate db/d26/d2e/d3e/f6f 601901 0 2024-04-25T17:19:11.495 INFO:tasks.workunit.client.1.smithi069.stdout:1/335: creat d1/d43/d35/f64 x:0 0 0 2024-04-25T17:19:11.496 INFO:tasks.workunit.client.1.smithi069.stdout:1/336: chown d1/d4/l52 455 1 2024-04-25T17:19:11.496 INFO:tasks.workunit.client.1.smithi069.stdout:1/337: stat d1/d43/d1b/l3d 0 2024-04-25T17:19:11.497 INFO:tasks.workunit.client.1.smithi069.stdout:1/338: readlink d1/d43/d1b/d32/d4a/l54 0 2024-04-25T17:19:11.499 INFO:tasks.workunit.client.0.smithi037.stdout:9/625: write d1/d48/d68/f46 [198389,74745] 0 2024-04-25T17:19:11.500 INFO:tasks.workunit.client.0.smithi037.stdout:2/499: creat d0/d16/d26/d3e/f9d x:0 0 0 2024-04-25T17:19:11.503 INFO:tasks.workunit.client.0.smithi037.stdout:4/695: link d7/d67/fd3 d7/d7e/d4e/fdd 0 2024-04-25T17:19:11.505 INFO:tasks.workunit.client.1.smithi069.stdout:2/295: creat d0/d26/f60 x:0 0 0 2024-04-25T17:19:11.506 INFO:tasks.workunit.client.1.smithi069.stdout:2/296: read d0/d1/d5b/d28/f50 [1845928,37891] 0 2024-04-25T17:19:11.507 INFO:tasks.workunit.client.1.smithi069.stdout:3/405: rmdir d8/d16/d1a/d2c/d49 39 2024-04-25T17:19:11.508 INFO:tasks.workunit.client.0.smithi037.stdout:9/626: dwrite d1/d48/d68/d4e/fd7 [0,4194304] 0 2024-04-25T17:19:11.509 INFO:tasks.workunit.client.1.smithi069.stdout:4/319: symlink db/d22/l6d 0 2024-04-25T17:19:11.510 INFO:tasks.workunit.client.0.smithi037.stdout:6/497: mknod db/d26/d2e/d7d/cb2 0 2024-04-25T17:19:11.511 INFO:tasks.workunit.client.1.smithi069.stdout:4/320: write db/d22/d24/f2d [1857658,109705] 0 2024-04-25T17:19:11.511 INFO:tasks.workunit.client.0.smithi037.stdout:2/500: mkdir d0/d16/d26/d9e 0 2024-04-25T17:19:11.515 INFO:tasks.workunit.client.0.smithi037.stdout:5/571: mkdir d7/d12/d5d/d90/db1 0 2024-04-25T17:19:11.517 INFO:tasks.workunit.client.1.smithi069.stdout:6/301: dwrite d2/d7/f12 [0,4194304] 0 2024-04-25T17:19:11.519 INFO:tasks.workunit.client.0.smithi037.stdout:6/498: dwrite db/d1d/f1f [4194304,4194304] 0 2024-04-25T17:19:11.522 INFO:tasks.workunit.client.0.smithi037.stdout:4/696: truncate d7/d7e/d45/d4f/f8e 441104 0 2024-04-25T17:19:11.523 INFO:tasks.workunit.client.0.smithi037.stdout:2/501: dwrite d0/d16/d20/d59/f8b [0,4194304] 0 2024-04-25T17:19:11.525 INFO:tasks.workunit.client.0.smithi037.stdout:4/697: chown d7/d7e/d5b/f9d 244287605 1 2024-04-25T17:19:11.526 INFO:tasks.workunit.client.1.smithi069.stdout:1/339: unlink d1/d19/c3f 0 2024-04-25T17:19:11.527 INFO:tasks.workunit.client.0.smithi037.stdout:9/627: mknod d1/d5/d2e/d34/daf/cd9 0 2024-04-25T17:19:11.532 INFO:tasks.workunit.client.1.smithi069.stdout:9/369: rename d2/f8 to d2/da/dd/de/d59/d7f/f89 0 2024-04-25T17:19:11.536 INFO:tasks.workunit.client.1.smithi069.stdout:7/337: mknod d4/d6/d14/d3d/d5b/c6f 0 2024-04-25T17:19:11.538 INFO:tasks.workunit.client.0.smithi037.stdout:0/558: dwrite d9/df/f12 [0,4194304] 0 2024-04-25T17:19:11.538 INFO:tasks.workunit.client.1.smithi069.stdout:7/338: write d4/d18/f4f [1028163,28250] 0 2024-04-25T17:19:11.539 INFO:tasks.workunit.client.0.smithi037.stdout:5/572: unlink d7/d12/f5a 0 2024-04-25T17:19:11.542 INFO:tasks.workunit.client.1.smithi069.stdout:2/297: rmdir d0/d1/d5b 39 2024-04-25T17:19:11.543 INFO:tasks.workunit.client.0.smithi037.stdout:9/628: dwrite d1/f2 [0,4194304] 0 2024-04-25T17:19:11.545 INFO:tasks.workunit.client.0.smithi037.stdout:8/461: dwrite d5/d6a/f71 [0,4194304] 0 2024-04-25T17:19:11.547 INFO:tasks.workunit.client.0.smithi037.stdout:2/502: mknod d0/d16/d68/c9f 0 2024-04-25T17:19:11.548 INFO:tasks.workunit.client.1.smithi069.stdout:0/276: getdents d0/da/db 0 2024-04-25T17:19:11.554 INFO:tasks.workunit.client.0.smithi037.stdout:8/462: read d5/da/f4a [1955059,115267] 0 2024-04-25T17:19:11.554 INFO:tasks.workunit.client.0.smithi037.stdout:0/559: rmdir d9/d72 39 2024-04-25T17:19:11.560 INFO:tasks.workunit.client.0.smithi037.stdout:8/463: dread d5/db/d23/d58/f79 [0,4194304] 0 2024-04-25T17:19:11.560 INFO:tasks.workunit.client.0.smithi037.stdout:9/629: unlink d1/d5/dc/d38/f9b 0 2024-04-25T17:19:11.567 INFO:tasks.workunit.client.0.smithi037.stdout:0/560: chown d9/d14/l1d 125089961 1 2024-04-25T17:19:11.567 INFO:tasks.workunit.client.0.smithi037.stdout:9/630: dwrite d1/d48/d68/f46 [0,4194304] 0 2024-04-25T17:19:11.568 INFO:tasks.workunit.client.0.smithi037.stdout:6/499: dread db/d26/f27 [0,4194304] 0 2024-04-25T17:19:11.576 INFO:tasks.workunit.client.0.smithi037.stdout:8/464: creat d5/db/d18/d3b/d50/f98 x:0 0 0 2024-04-25T17:19:11.579 INFO:tasks.workunit.client.0.smithi037.stdout:3/350: sync 2024-04-25T17:19:11.580 INFO:tasks.workunit.client.0.smithi037.stdout:3/351: chown d8/lc 149292 1 2024-04-25T17:19:11.580 INFO:tasks.workunit.client.1.smithi069.stdout:3/406: creat d8/d71/d8d/f8f x:0 0 0 2024-04-25T17:19:11.581 INFO:tasks.workunit.client.0.smithi037.stdout:2/503: mkdir d0/d16/d20/d55/da0 0 2024-04-25T17:19:11.584 INFO:tasks.workunit.client.1.smithi069.stdout:4/321: creat db/d4b/f6e x:0 0 0 2024-04-25T17:19:11.585 INFO:tasks.workunit.client.0.smithi037.stdout:9/631: symlink d1/d5/d19/d6e/lda 0 2024-04-25T17:19:11.587 INFO:tasks.workunit.client.1.smithi069.stdout:5/331: getdents d13/d17 0 2024-04-25T17:19:11.587 INFO:tasks.workunit.client.0.smithi037.stdout:9/632: chown d1/d5/dc/d38/d8b/f60 46817436 1 2024-04-25T17:19:11.587 INFO:tasks.workunit.client.0.smithi037.stdout:5/573: dwrite d7/d18/d62/f6b [0,4194304] 0 2024-04-25T17:19:11.590 INFO:tasks.workunit.client.0.smithi037.stdout:8/465: mknod d5/db/d18/c99 0 2024-04-25T17:19:11.594 INFO:tasks.workunit.client.1.smithi069.stdout:1/340: mknod d1/df/d17/c65 0 2024-04-25T17:19:11.594 INFO:tasks.workunit.client.1.smithi069.stdout:8/288: truncate d37/d47/d48/f5c 317366 0 2024-04-25T17:19:11.594 INFO:tasks.workunit.client.1.smithi069.stdout:1/341: dread - d1/d43/d35/f64 zero size 2024-04-25T17:19:11.596 INFO:tasks.workunit.client.0.smithi037.stdout:2/504: creat d0/d16/d20/d55/fa1 x:0 0 0 2024-04-25T17:19:11.597 INFO:tasks.workunit.client.0.smithi037.stdout:0/561: dwrite d9/d14/f27 [0,4194304] 0 2024-04-25T17:19:11.600 INFO:tasks.workunit.client.1.smithi069.stdout:2/298: mkdir d0/d1/d5b/d28/d31/d61 0 2024-04-25T17:19:11.600 INFO:tasks.workunit.client.0.smithi037.stdout:2/505: write d0/d16/d20/d55/f6f [6002214,61842] 0 2024-04-25T17:19:11.601 INFO:tasks.workunit.client.0.smithi037.stdout:6/500: symlink db/d1d/db1/lb3 0 2024-04-25T17:19:11.601 INFO:tasks.workunit.client.1.smithi069.stdout:3/407: write d8/d16/d31/f44 [1496344,98508] 0 2024-04-25T17:19:11.602 INFO:tasks.workunit.client.0.smithi037.stdout:9/633: creat d1/d5/fdb x:0 0 0 2024-04-25T17:19:11.603 INFO:tasks.workunit.client.0.smithi037.stdout:9/634: chown d1/d48/d68/d26 390633 1 2024-04-25T17:19:11.605 INFO:tasks.workunit.client.1.smithi069.stdout:0/277: link d0/da/db/d2a/f3f d0/da/d59/f61 0 2024-04-25T17:19:11.605 INFO:tasks.workunit.client.0.smithi037.stdout:5/574: truncate d7/d12/d5d/f7f 375583 0 2024-04-25T17:19:11.607 INFO:tasks.workunit.client.0.smithi037.stdout:8/466: creat d5/d6a/f9a x:0 0 0 2024-04-25T17:19:11.609 INFO:tasks.workunit.client.0.smithi037.stdout:8/467: write d5/db/d23/f29 [953864,99209] 0 2024-04-25T17:19:11.612 INFO:tasks.workunit.client.0.smithi037.stdout:3/352: dread d8/d23/f28 [0,4194304] 0 2024-04-25T17:19:11.614 INFO:tasks.workunit.client.0.smithi037.stdout:3/353: chown d8/d31/f47 755 1 2024-04-25T17:19:11.614 INFO:tasks.workunit.client.1.smithi069.stdout:6/302: creat d2/f63 x:0 0 0 2024-04-25T17:19:11.616 INFO:tasks.workunit.client.1.smithi069.stdout:5/332: dwrite d13/d17/d19/f28 [0,4194304] 0 2024-04-25T17:19:11.617 INFO:tasks.workunit.client.0.smithi037.stdout:8/468: dwrite d5/db/d23/d58/f6e [0,4194304] 0 2024-04-25T17:19:11.618 INFO:tasks.workunit.client.1.smithi069.stdout:1/342: symlink d1/d4/d6/l66 0 2024-04-25T17:19:11.621 INFO:tasks.workunit.client.1.smithi069.stdout:7/339: link d4/d3e/c50 d4/d18/d36/c70 0 2024-04-25T17:19:11.626 INFO:tasks.workunit.client.0.smithi037.stdout:6/501: dread db/d26/d2e/d3e/f49 [0,4194304] 0 2024-04-25T17:19:11.627 INFO:tasks.workunit.client.1.smithi069.stdout:5/333: dwrite d13/d17/d19/d1c/f45 [0,4194304] 0 2024-04-25T17:19:11.627 INFO:tasks.workunit.client.1.smithi069.stdout:8/289: dwrite d37/f50 [0,4194304] 0 2024-04-25T17:19:11.631 INFO:tasks.workunit.client.1.smithi069.stdout:6/303: creat d2/d1e/f64 x:0 0 0 2024-04-25T17:19:11.631 INFO:tasks.workunit.client.0.smithi037.stdout:3/354: creat d8/d57/f71 x:0 0 0 2024-04-25T17:19:11.633 INFO:tasks.workunit.client.0.smithi037.stdout:6/502: dwrite db/f15 [4194304,4194304] 0 2024-04-25T17:19:11.634 INFO:tasks.workunit.client.1.smithi069.stdout:9/370: getdents d2/da/d14/d23/d65 0 2024-04-25T17:19:11.634 INFO:tasks.workunit.client.1.smithi069.stdout:8/290: dread d37/d47/d48/f4e [0,4194304] 0 2024-04-25T17:19:11.635 INFO:tasks.workunit.client.1.smithi069.stdout:9/371: dread - d2/f2c zero size 2024-04-25T17:19:11.636 INFO:tasks.workunit.client.1.smithi069.stdout:9/372: fsync d2/f39 0 2024-04-25T17:19:11.636 INFO:tasks.workunit.client.1.smithi069.stdout:9/373: chown d2/f39 7663 1 2024-04-25T17:19:11.646 INFO:tasks.workunit.client.0.smithi037.stdout:3/355: fsync d8/d23/d3a/f4f 0 2024-04-25T17:19:11.647 INFO:tasks.workunit.client.1.smithi069.stdout:6/304: symlink d2/d2e/l65 0 2024-04-25T17:19:11.648 INFO:tasks.workunit.client.1.smithi069.stdout:6/305: read d2/d1e/f2b [137751,50200] 0 2024-04-25T17:19:11.651 INFO:tasks.workunit.client.0.smithi037.stdout:8/469: truncate d5/db/f1f 1355295 0 2024-04-25T17:19:11.651 INFO:tasks.workunit.client.0.smithi037.stdout:8/470: chown d5/f47 0 1 2024-04-25T17:19:11.653 INFO:tasks.workunit.client.0.smithi037.stdout:8/471: truncate d5/db/d18/d3b/d50/d51/f57 1246986 0 2024-04-25T17:19:11.654 INFO:tasks.workunit.client.0.smithi037.stdout:2/506: rmdir d0/d16/d77 0 2024-04-25T17:19:11.658 INFO:tasks.workunit.client.0.smithi037.stdout:0/562: dwrite d9/df/f86 [0,4194304] 0 2024-04-25T17:19:11.661 INFO:tasks.workunit.client.1.smithi069.stdout:7/340: fdatasync d4/d6/d14/d3d/d47/f61 0 2024-04-25T17:19:11.662 INFO:tasks.workunit.client.0.smithi037.stdout:5/575: write d7/d12/f46 [310585,43147] 0 2024-04-25T17:19:11.663 INFO:tasks.workunit.client.0.smithi037.stdout:8/472: creat d5/db/d18/d3b/f9b x:0 0 0 2024-04-25T17:19:11.665 INFO:tasks.workunit.client.0.smithi037.stdout:7/530: sync 2024-04-25T17:19:11.665 INFO:tasks.workunit.client.0.smithi037.stdout:1/533: sync 2024-04-25T17:19:11.665 INFO:tasks.workunit.client.0.smithi037.stdout:4/698: sync 2024-04-25T17:19:11.666 INFO:tasks.workunit.client.0.smithi037.stdout:1/534: chown dc/d18/f1b 3637 1 2024-04-25T17:19:11.668 INFO:tasks.workunit.client.1.smithi069.stdout:4/322: write db/d15/f17 [1540552,71360] 0 2024-04-25T17:19:11.669 INFO:tasks.workunit.client.0.smithi037.stdout:9/635: getdents d1/d5/dc 0 2024-04-25T17:19:11.669 INFO:tasks.workunit.client.0.smithi037.stdout:3/356: read d8/f2c [131137,62560] 0 2024-04-25T17:19:11.671 INFO:tasks.workunit.client.1.smithi069.stdout:3/408: dwrite d8/d16/d4b/f79 [0,4194304] 0 2024-04-25T17:19:11.671 INFO:tasks.workunit.client.0.smithi037.stdout:3/357: dread - d8/d57/f5e zero size 2024-04-25T17:19:11.672 INFO:tasks.workunit.client.1.smithi069.stdout:4/323: chown db/d15/d20/d35/d63/d43/d48/d49/l5b 43 1 2024-04-25T17:19:11.672 INFO:tasks.workunit.client.1.smithi069.stdout:3/409: fsync d8/d16/f21 0 2024-04-25T17:19:11.673 INFO:tasks.workunit.client.0.smithi037.stdout:2/507: rename d0/d16/d3b/f85 to d0/fa2 0 2024-04-25T17:19:11.673 INFO:tasks.workunit.client.1.smithi069.stdout:4/324: write db/d15/d26/f62 [5050657,116840] 0 2024-04-25T17:19:11.674 INFO:tasks.workunit.client.1.smithi069.stdout:2/299: getdents d0/d26 0 2024-04-25T17:19:11.675 INFO:tasks.workunit.client.0.smithi037.stdout:2/508: read - d0/d16/f96 zero size 2024-04-25T17:19:11.675 INFO:tasks.workunit.client.0.smithi037.stdout:0/563: dread - d9/df/d32/d39/d68/f93 zero size 2024-04-25T17:19:11.677 INFO:tasks.workunit.client.1.smithi069.stdout:6/306: mknod d2/d1e/d3f/d56/c66 0 2024-04-25T17:19:11.679 INFO:tasks.workunit.client.0.smithi037.stdout:8/473: readlink d5/db/d18/d3b/l4c 0 2024-04-25T17:19:11.679 INFO:tasks.workunit.client.0.smithi037.stdout:0/564: write d9/d14/d28/f62 [2241442,63603] 0 2024-04-25T17:19:11.681 INFO:tasks.workunit.client.0.smithi037.stdout:3/358: dwrite d8/d31/d32/f51 [0,4194304] 0 2024-04-25T17:19:11.681 INFO:tasks.workunit.client.1.smithi069.stdout:8/291: unlink d37/d47/d48/f5c 0 2024-04-25T17:19:11.683 INFO:tasks.workunit.client.0.smithi037.stdout:5/576: truncate d7/d12/d6f/f54 1030422 0 2024-04-25T17:19:11.683 INFO:tasks.workunit.client.0.smithi037.stdout:6/503: write db/f36 [207506,28802] 0 2024-04-25T17:19:11.684 INFO:tasks.workunit.client.1.smithi069.stdout:1/343: link d1/d43/d1b/c3e d1/d43/d1b/d32/c67 0 2024-04-25T17:19:11.686 INFO:tasks.workunit.client.0.smithi037.stdout:1/535: unlink dc/fe 0 2024-04-25T17:19:11.691 INFO:tasks.workunit.client.0.smithi037.stdout:7/531: creat d5/d15/d17/d1b/da2/daf/d80/fbb x:0 0 0 2024-04-25T17:19:11.692 INFO:tasks.workunit.client.1.smithi069.stdout:1/344: dread d1/d43/f3a [0,4194304] 0 2024-04-25T17:19:11.696 INFO:tasks.workunit.client.0.smithi037.stdout:2/509: creat d0/d15/d2a/d5a/fa3 x:0 0 0 2024-04-25T17:19:11.697 INFO:tasks.workunit.client.1.smithi069.stdout:5/334: dwrite d13/d17/d29/f2b [0,4194304] 0 2024-04-25T17:19:11.700 INFO:tasks.workunit.client.1.smithi069.stdout:9/374: truncate d2/da/d14/f25 957653 0 2024-04-25T17:19:11.702 INFO:tasks.workunit.client.1.smithi069.stdout:9/375: write d2/f17 [1172963,107290] 0 2024-04-25T17:19:11.702 INFO:tasks.workunit.client.1.smithi069.stdout:3/410: stat d8/d16/d1a/d2c/d49/l5c 0 2024-04-25T17:19:11.705 INFO:tasks.workunit.client.1.smithi069.stdout:8/292: rmdir d37/d47/d48 39 2024-04-25T17:19:11.706 INFO:tasks.workunit.client.0.smithi037.stdout:0/565: fdatasync d9/df/d32/d39/f8b 0 2024-04-25T17:19:11.707 INFO:tasks.workunit.client.0.smithi037.stdout:0/566: fsync d9/d14/f22 0 2024-04-25T17:19:11.709 INFO:tasks.workunit.client.0.smithi037.stdout:5/577: mkdir d7/d63/db2 0 2024-04-25T17:19:11.710 INFO:tasks.workunit.client.1.smithi069.stdout:7/341: link d4/f10 d4/d18/d3f/f71 0 2024-04-25T17:19:11.712 INFO:tasks.workunit.client.1.smithi069.stdout:7/342: write d4/d6/d14/d15/f17 [1286569,119332] 0 2024-04-25T17:19:11.712 INFO:tasks.workunit.client.1.smithi069.stdout:1/345: mkdir d1/d4/de/d44/d68 0 2024-04-25T17:19:11.713 INFO:tasks.workunit.client.1.smithi069.stdout:7/343: chown d4/d1a/c3a 1 1 2024-04-25T17:19:11.717 INFO:tasks.workunit.client.1.smithi069.stdout:5/335: fsync d13/d17/d19/d20/d51/f6b 0 2024-04-25T17:19:11.721 INFO:tasks.workunit.client.0.smithi037.stdout:7/532: dread d5/d14/db1/fa7 [0,4194304] 0 2024-04-25T17:19:11.722 INFO:tasks.workunit.client.1.smithi069.stdout:9/376: mkdir d2/da/dd/de/d74/d8a 0 2024-04-25T17:19:11.723 INFO:tasks.workunit.client.0.smithi037.stdout:2/510: rename d0/d23/l83 to d0/d7c/la4 0 2024-04-25T17:19:11.725 INFO:tasks.workunit.client.1.smithi069.stdout:3/411: mknod d8/d16/d1a/d38/c90 0 2024-04-25T17:19:11.727 INFO:tasks.workunit.client.0.smithi037.stdout:2/511: dread d0/d16/d20/d59/f8b [0,4194304] 0 2024-04-25T17:19:11.728 INFO:tasks.workunit.client.0.smithi037.stdout:2/512: fsync d0/d16/d20/d55/f60 0 2024-04-25T17:19:11.729 INFO:tasks.workunit.client.0.smithi037.stdout:6/504: write db/d1d/f79 [426716,62408] 0 2024-04-25T17:19:11.730 INFO:tasks.workunit.client.0.smithi037.stdout:6/505: readlink db/d1d/d20/d2f/l83 0 2024-04-25T17:19:11.735 INFO:tasks.workunit.client.0.smithi037.stdout:0/567: symlink d9/d14/d28/lbc 0 2024-04-25T17:19:11.736 INFO:tasks.workunit.client.0.smithi037.stdout:9/636: truncate d1/d48/d68/d4e/fd7 642945 0 2024-04-25T17:19:11.737 INFO:tasks.workunit.client.0.smithi037.stdout:5/578: fsync d7/d25/d4f/f34 0 2024-04-25T17:19:11.739 INFO:tasks.workunit.client.0.smithi037.stdout:5/579: truncate d7/d18/d62/f8c 1267987 0 2024-04-25T17:19:11.742 INFO:tasks.workunit.client.1.smithi069.stdout:3/412: dread d8/d16/d1a/d38/f88 [0,4194304] 0 2024-04-25T17:19:11.742 INFO:tasks.workunit.client.1.smithi069.stdout:3/413: stat d8/d71/d8d 0 2024-04-25T17:19:11.743 INFO:tasks.workunit.client.1.smithi069.stdout:5/336: rename d13/l4e to d13/d17/d29/d2e/l6e 0 2024-04-25T17:19:11.744 INFO:tasks.workunit.client.1.smithi069.stdout:1/346: truncate d1/d43/f3a 1780449 0 2024-04-25T17:19:11.744 INFO:tasks.workunit.client.1.smithi069.stdout:5/337: chown d13/d17/d62 11604 1 2024-04-25T17:19:11.746 INFO:tasks.workunit.client.0.smithi037.stdout:4/699: creat d7/d7e/d1e/fde x:0 0 0 2024-04-25T17:19:11.747 INFO:tasks.workunit.client.1.smithi069.stdout:8/293: dread d37/f45 [0,4194304] 0 2024-04-25T17:19:11.750 INFO:tasks.workunit.client.1.smithi069.stdout:3/414: dwrite d8/d16/d1a/d3e/f6f [0,4194304] 0 2024-04-25T17:19:11.751 INFO:tasks.workunit.client.0.smithi037.stdout:7/533: rename d5/d15/l7f to d5/d14/db1/lbc 0 2024-04-25T17:19:11.752 INFO:tasks.workunit.client.0.smithi037.stdout:8/474: dwrite d5/db/f1f [0,4194304] 0 2024-04-25T17:19:11.753 INFO:tasks.workunit.client.0.smithi037.stdout:8/475: chown d5/db/d18/c20 1563997 1 2024-04-25T17:19:11.762 INFO:tasks.workunit.client.1.smithi069.stdout:9/377: creat d2/d51/f8b x:0 0 0 2024-04-25T17:19:11.763 INFO:tasks.workunit.client.1.smithi069.stdout:9/378: chown d2/da/dd/de/d59/d7f 30 1 2024-04-25T17:19:11.763 INFO:tasks.workunit.client.0.smithi037.stdout:2/513: dread - d0/d15/d2a/f72 zero size 2024-04-25T17:19:11.766 INFO:tasks.workunit.client.1.smithi069.stdout:6/307: getdents d2/d1e/d3f/d56 0 2024-04-25T17:19:11.766 INFO:tasks.workunit.client.1.smithi069.stdout:7/344: truncate d4/f6a 435587 0 2024-04-25T17:19:11.767 INFO:tasks.workunit.client.1.smithi069.stdout:6/308: stat d2/f2f 0 2024-04-25T17:19:11.768 INFO:tasks.workunit.client.1.smithi069.stdout:1/347: dread d1/df/d17/f24 [0,4194304] 0 2024-04-25T17:19:11.769 INFO:tasks.workunit.client.0.smithi037.stdout:2/514: dread d0/d16/d20/d55/f60 [0,4194304] 0 2024-04-25T17:19:11.769 INFO:tasks.workunit.client.0.smithi037.stdout:2/515: fsync d0/d16/f96 0 2024-04-25T17:19:11.769 INFO:tasks.workunit.client.1.smithi069.stdout:5/338: creat d13/d17/d29/d30/d55/f6f x:0 0 0 2024-04-25T17:19:11.769 INFO:tasks.workunit.client.1.smithi069.stdout:1/348: dread - d1/d43/f5b zero size 2024-04-25T17:19:11.771 INFO:tasks.workunit.client.0.smithi037.stdout:9/637: symlink d1/d5/d2e/d34/daf/ldc 0 2024-04-25T17:19:11.771 INFO:tasks.workunit.client.1.smithi069.stdout:4/325: link db/d15/d20/d35/d63/d43/d48/d49/d4e/l59 db/d15/d20/d35/d63/l6f 0 2024-04-25T17:19:11.772 INFO:tasks.workunit.client.1.smithi069.stdout:4/326: chown db/d15/d26/l51 149 1 2024-04-25T17:19:11.774 INFO:tasks.workunit.client.1.smithi069.stdout:4/327: dread db/d15/d20/f2e [4194304,4194304] 0 2024-04-25T17:19:11.775 INFO:tasks.workunit.client.1.smithi069.stdout:4/328: write db/d15/d20/d38/f68 [31550,21624] 0 2024-04-25T17:19:11.777 INFO:tasks.workunit.client.1.smithi069.stdout:1/349: creat d1/d4/de/d44/f69 x:0 0 0 2024-04-25T17:19:11.777 INFO:tasks.workunit.client.1.smithi069.stdout:1/350: dread - d1/d43/d35/f53 zero size 2024-04-25T17:19:11.778 INFO:tasks.workunit.client.1.smithi069.stdout:3/415: mknod d8/d16/d1a/d2c/d49/d87/d8a/d8e/c91 0 2024-04-25T17:19:11.779 INFO:tasks.workunit.client.1.smithi069.stdout:3/416: write d8/f12 [2629322,98521] 0 2024-04-25T17:19:11.788 INFO:tasks.workunit.client.1.smithi069.stdout:4/329: mkdir db/d15/d20/d35/d63/d70 0 2024-04-25T17:19:11.788 INFO:tasks.workunit.client.0.smithi037.stdout:0/568: dwrite d9/df/d32/f5c [4194304,4194304] 0 2024-04-25T17:19:11.792 INFO:tasks.workunit.client.1.smithi069.stdout:1/351: symlink d1/d19/l6a 0 2024-04-25T17:19:11.798 INFO:tasks.workunit.client.1.smithi069.stdout:9/379: write d2/da/d14/f79 [1001753,127242] 0 2024-04-25T17:19:11.799 INFO:tasks.workunit.client.1.smithi069.stdout:9/380: chown d2/f17 108368769 1 2024-04-25T17:19:11.799 INFO:tasks.workunit.client.1.smithi069.stdout:9/381: chown d2/da/dd/de/f4a 100062324 1 2024-04-25T17:19:11.800 INFO:tasks.workunit.client.1.smithi069.stdout:7/345: write d4/d6/d14/f48 [1823741,27683] 0 2024-04-25T17:19:11.804 INFO:tasks.workunit.client.1.smithi069.stdout:5/339: creat d13/d17/d19/f70 x:0 0 0 2024-04-25T17:19:11.805 INFO:tasks.workunit.client.1.smithi069.stdout:5/340: readlink d13/d17/d19/l3e 0 2024-04-25T17:19:11.805 INFO:tasks.workunit.client.1.smithi069.stdout:4/330: rename db/d15/d42/f45 to db/d22/f71 0 2024-04-25T17:19:11.807 INFO:tasks.workunit.client.0.smithi037.stdout:1/536: link dc/d24/f71 dc/d1c/d57/fb9 0 2024-04-25T17:19:11.809 INFO:tasks.workunit.client.0.smithi037.stdout:4/700: mkdir d7/d7e/d1e/d70/d84/ddf 0 2024-04-25T17:19:11.810 INFO:tasks.workunit.client.1.smithi069.stdout:5/341: dwrite d13/d17/f1b [4194304,4194304] 0 2024-04-25T17:19:11.812 INFO:tasks.workunit.client.1.smithi069.stdout:3/417: fdatasync d8/d71/f81 0 2024-04-25T17:19:11.813 INFO:tasks.workunit.client.0.smithi037.stdout:7/534: rmdir d5/d15/d17/d1b/da2/daf 39 2024-04-25T17:19:11.815 INFO:tasks.workunit.client.1.smithi069.stdout:9/382: read d2/f29 [2814536,16773] 0 2024-04-25T17:19:11.817 INFO:tasks.workunit.client.0.smithi037.stdout:8/476: mkdir d5/db/d23/d78/d9c 0 2024-04-25T17:19:11.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:11 smithi037 ceph-mon[26472]: pgmap v36: 65 pgs: 65 active+clean; 1.5 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 42 MiB/s rd, 177 MiB/s wr, 359 op/s 2024-04-25T17:19:11.822 INFO:tasks.workunit.client.0.smithi037.stdout:3/359: getdents d8/d23/d3a 0 2024-04-25T17:19:11.822 INFO:tasks.workunit.client.1.smithi069.stdout:9/383: dwrite d2/da/dd/d1e/f6a [0,4194304] 0 2024-04-25T17:19:11.823 INFO:tasks.workunit.client.0.smithi037.stdout:3/360: chown d8/d31/f52 133203 1 2024-04-25T17:19:11.823 INFO:tasks.workunit.client.0.smithi037.stdout:6/506: symlink db/d26/d2e/d3e/d25/db0/lb4 0 2024-04-25T17:19:11.823 INFO:tasks.workunit.client.1.smithi069.stdout:9/384: write d2/da/dd/d1e/f26 [65882,117580] 0 2024-04-25T17:19:11.824 INFO:tasks.workunit.client.0.smithi037.stdout:3/361: write d8/d31/f47 [1025893,103880] 0 2024-04-25T17:19:11.825 INFO:tasks.workunit.client.0.smithi037.stdout:2/516: mkdir d0/d16/d20/d59/d6a/da5 0 2024-04-25T17:19:11.827 INFO:tasks.workunit.client.1.smithi069.stdout:6/309: getdents d2/d2e/d35/d48 0 2024-04-25T17:19:11.829 INFO:tasks.workunit.client.0.smithi037.stdout:9/638: creat d1/d5/d2e/d34/fdd x:0 0 0 2024-04-25T17:19:11.831 INFO:tasks.workunit.client.0.smithi037.stdout:9/639: dread d1/d5/dc/fa5 [0,4194304] 0 2024-04-25T17:19:11.831 INFO:tasks.workunit.client.1.smithi069.stdout:0/278: sync 2024-04-25T17:19:11.832 INFO:tasks.workunit.client.1.smithi069.stdout:9/385: dwrite d2/da/d14/d23/f3b [0,4194304] 0 2024-04-25T17:19:11.835 INFO:tasks.workunit.client.1.smithi069.stdout:4/331: rmdir db/d15/d20/d35 39 2024-04-25T17:19:11.836 INFO:tasks.workunit.client.1.smithi069.stdout:8/294: getdents d37/d47/d48 0 2024-04-25T17:19:11.837 INFO:tasks.workunit.client.0.smithi037.stdout:0/569: mkdir d9/df/dbd 0 2024-04-25T17:19:11.838 INFO:tasks.workunit.client.0.smithi037.stdout:1/537: unlink dc/d1c/d57/cb6 0 2024-04-25T17:19:11.840 INFO:tasks.workunit.client.1.smithi069.stdout:1/352: mknod d1/d4/de/d44/d68/c6b 0 2024-04-25T17:19:11.840 INFO:tasks.workunit.client.0.smithi037.stdout:1/538: write dc/d18/f88 [284318,125781] 0 2024-04-25T17:19:11.841 INFO:tasks.workunit.client.1.smithi069.stdout:9/386: dwrite d2/da/dd/d1e/d2e/d35/f7a [0,4194304] 0 2024-04-25T17:19:11.842 INFO:tasks.workunit.client.0.smithi037.stdout:4/701: rename d7/d7e/d4e/f53 to d7/d7e/d1e/d70/fe0 0 2024-04-25T17:19:11.844 INFO:tasks.workunit.client.1.smithi069.stdout:5/342: creat d13/d17/d19/d1c/f71 x:0 0 0 2024-04-25T17:19:11.846 INFO:tasks.workunit.client.1.smithi069.stdout:5/343: write d13/d17/d19/d20/f22 [97946,8543] 0 2024-04-25T17:19:11.846 INFO:tasks.workunit.client.0.smithi037.stdout:8/477: creat d5/db/d7e/f9d x:0 0 0 2024-04-25T17:19:11.847 INFO:tasks.workunit.client.1.smithi069.stdout:3/418: write d8/d16/f27 [1014190,18414] 0 2024-04-25T17:19:11.848 INFO:tasks.workunit.client.1.smithi069.stdout:3/419: chown d8/d16/d1a/d2c/l84 1096544 1 2024-04-25T17:19:11.849 INFO:tasks.workunit.client.0.smithi037.stdout:6/507: mknod db/d53/cb5 0 2024-04-25T17:19:11.849 INFO:tasks.workunit.client.0.smithi037.stdout:6/508: write db/f84 [4429859,95652] 0 2024-04-25T17:19:11.855 INFO:tasks.workunit.client.0.smithi037.stdout:2/517: unlink d0/d16/d3b/f84 0 2024-04-25T17:19:11.856 INFO:tasks.workunit.client.1.smithi069.stdout:3/420: dwrite d8/d16/d1a/d3e/f7a [0,4194304] 0 2024-04-25T17:19:11.856 INFO:tasks.workunit.client.1.smithi069.stdout:6/310: mkdir d2/d1e/d3e/d67 0 2024-04-25T17:19:11.857 INFO:tasks.workunit.client.1.smithi069.stdout:3/421: dread - d8/d16/d1a/d38/f58 zero size 2024-04-25T17:19:11.857 INFO:tasks.workunit.client.0.smithi037.stdout:6/509: dwrite db/f84 [0,4194304] 0 2024-04-25T17:19:11.858 INFO:tasks.workunit.client.0.smithi037.stdout:9/640: mkdir d1/d5/d19/dde 0 2024-04-25T17:19:11.858 INFO:tasks.workunit.client.1.smithi069.stdout:3/422: write d8/d16/d1a/d3e/f6f [3723506,64430] 0 2024-04-25T17:19:11.859 INFO:tasks.workunit.client.0.smithi037.stdout:5/580: dwrite d7/d12/f20 [0,4194304] 0 2024-04-25T17:19:11.859 INFO:tasks.workunit.client.1.smithi069.stdout:3/423: chown d8/d16/d1a 1936 1 2024-04-25T17:19:11.861 INFO:tasks.workunit.client.0.smithi037.stdout:5/581: write d7/d43/f47 [8065391,77276] 0 2024-04-25T17:19:11.862 INFO:tasks.workunit.client.0.smithi037.stdout:5/582: write d7/d25/d4f/f82 [2760378,14192] 0 2024-04-25T17:19:11.866 INFO:tasks.workunit.client.0.smithi037.stdout:1/539: rename dc/d18/d39/l84 to dc/d18/d66/lba 0 2024-04-25T17:19:11.868 INFO:tasks.workunit.client.1.smithi069.stdout:8/295: creat d37/d47/d48/f64 x:0 0 0 2024-04-25T17:19:11.870 INFO:tasks.workunit.client.1.smithi069.stdout:3/424: dwrite d8/d39/f5e [4194304,4194304] 0 2024-04-25T17:19:11.870 INFO:tasks.workunit.client.0.smithi037.stdout:7/535: symlink d5/d15/d17/d1b/d94/da8/lbd 0 2024-04-25T17:19:11.872 INFO:tasks.workunit.client.0.smithi037.stdout:8/478: fdatasync d5/db/d59/f6c 0 2024-04-25T17:19:11.880 INFO:tasks.workunit.client.1.smithi069.stdout:6/311: symlink d2/d2e/d35/l68 0 2024-04-25T17:19:11.881 INFO:tasks.workunit.client.1.smithi069.stdout:6/312: readlink d2/l3 0 2024-04-25T17:19:11.883 INFO:tasks.workunit.client.1.smithi069.stdout:5/344: dwrite d13/f1a [4194304,4194304] 0 2024-04-25T17:19:11.884 INFO:tasks.workunit.client.1.smithi069.stdout:7/346: creat d4/d6/f72 x:0 0 0 2024-04-25T17:19:11.886 INFO:tasks.workunit.client.0.smithi037.stdout:9/641: unlink d1/f4 0 2024-04-25T17:19:11.887 INFO:tasks.workunit.client.0.smithi037.stdout:9/642: chown d1/d5/f98 49959514 1 2024-04-25T17:19:11.893 INFO:tasks.workunit.client.1.smithi069.stdout:0/279: symlink d0/da/db/d56/l62 0 2024-04-25T17:19:11.896 INFO:tasks.workunit.client.1.smithi069.stdout:4/332: mkdir db/d15/d20/d35/d63/d43/d48/d49/d72 0 2024-04-25T17:19:11.897 INFO:tasks.workunit.client.1.smithi069.stdout:4/333: chown db/d15/c1e 35 1 2024-04-25T17:19:11.898 INFO:tasks.workunit.client.0.smithi037.stdout:5/583: dread - d7/d43/f26 zero size 2024-04-25T17:19:11.899 INFO:tasks.workunit.client.1.smithi069.stdout:3/425: write d8/d16/d1a/d38/f83 [4104496,92636] 0 2024-04-25T17:19:11.902 INFO:tasks.workunit.client.0.smithi037.stdout:1/540: creat dc/d1c/d57/d43/fbb x:0 0 0 2024-04-25T17:19:11.903 INFO:tasks.workunit.client.0.smithi037.stdout:4/702: mkdir d7/d7e/d1e/de1 0 2024-04-25T17:19:11.903 INFO:tasks.workunit.client.1.smithi069.stdout:8/296: dwrite d37/f5b [0,4194304] 0 2024-04-25T17:19:11.905 INFO:tasks.workunit.client.0.smithi037.stdout:3/362: truncate d8/d23/d3a/f50 1052506 0 2024-04-25T17:19:11.906 INFO:tasks.workunit.client.0.smithi037.stdout:3/363: readlink d8/d23/d3a/l44 0 2024-04-25T17:19:11.907 INFO:tasks.workunit.client.0.smithi037.stdout:3/364: truncate d8/d31/f52 1383369 0 2024-04-25T17:19:11.911 INFO:tasks.workunit.client.0.smithi037.stdout:8/479: creat d5/db/d18/d3b/d75/f9e x:0 0 0 2024-04-25T17:19:11.912 INFO:tasks.workunit.client.1.smithi069.stdout:6/313: dwrite d2/d2e/f41 [0,4194304] 0 2024-04-25T17:19:11.912 INFO:tasks.workunit.client.1.smithi069.stdout:5/345: creat d13/d17/d19/d20/d2d/f72 x:0 0 0 2024-04-25T17:19:11.916 INFO:tasks.workunit.client.1.smithi069.stdout:4/334: symlink db/d15/d42/d53/l73 0 2024-04-25T17:19:11.917 INFO:tasks.workunit.client.0.smithi037.stdout:9/643: read - d1/d48/d68/d26/d81/d9c/da4/fc1 zero size 2024-04-25T17:19:11.919 INFO:tasks.workunit.client.1.smithi069.stdout:3/426: mkdir d8/d71/d8d/d92 0 2024-04-25T17:19:11.923 INFO:tasks.workunit.client.0.smithi037.stdout:0/570: creat d9/d14/fbe x:0 0 0 2024-04-25T17:19:11.924 INFO:tasks.workunit.client.0.smithi037.stdout:0/571: chown d9/d14/d28/d48/f7e 0 1 2024-04-25T17:19:11.925 INFO:tasks.workunit.client.0.smithi037.stdout:5/584: rmdir d7/d12/d6f/d68 39 2024-04-25T17:19:11.926 INFO:tasks.workunit.client.0.smithi037.stdout:5/585: chown d7/d18/f7a 9 1 2024-04-25T17:19:11.927 INFO:tasks.workunit.client.1.smithi069.stdout:9/387: creat d2/da/f8c x:0 0 0 2024-04-25T17:19:11.928 INFO:tasks.workunit.client.0.smithi037.stdout:1/541: readlink dc/d1c/d57/d4d/lac 0 2024-04-25T17:19:11.929 INFO:tasks.workunit.client.0.smithi037.stdout:1/542: readlink dc/d1c/d57/d22/l72 0 2024-04-25T17:19:11.930 INFO:tasks.workunit.client.0.smithi037.stdout:1/543: chown dc/d1c/d57/d22/f6d 7469 1 2024-04-25T17:19:11.930 INFO:tasks.workunit.client.0.smithi037.stdout:1/544: chown dc/d18/d64 4392 1 2024-04-25T17:19:11.931 INFO:tasks.workunit.client.1.smithi069.stdout:8/297: stat fb 0 2024-04-25T17:19:11.932 INFO:tasks.workunit.client.1.smithi069.stdout:2/300: sync 2024-04-25T17:19:11.932 INFO:tasks.workunit.client.0.smithi037.stdout:1/545: dread dc/f13 [0,4194304] 0 2024-04-25T17:19:11.933 INFO:tasks.workunit.client.1.smithi069.stdout:7/347: truncate d4/f6a 1375417 0 2024-04-25T17:19:11.933 INFO:tasks.workunit.client.1.smithi069.stdout:2/301: readlink d0/d1/d5b/d28/l4e 0 2024-04-25T17:19:11.934 INFO:tasks.workunit.client.1.smithi069.stdout:7/348: dread - d4/d6/d14/d5a/f6c zero size 2024-04-25T17:19:11.934 INFO:tasks.workunit.client.0.smithi037.stdout:7/536: rename d5/d15/d17/d25/d2b/d48/f95 to d5/d15/d17/d1b/d94/da8/fbe 0 2024-04-25T17:19:11.935 INFO:tasks.workunit.client.0.smithi037.stdout:7/537: chown d5/d15/d17/d1b 0 1 2024-04-25T17:19:11.936 INFO:tasks.workunit.client.1.smithi069.stdout:5/346: symlink d13/d17/d19/d20/l73 0 2024-04-25T17:19:11.937 INFO:tasks.workunit.client.0.smithi037.stdout:6/510: write db/f1b [938996,76036] 0 2024-04-25T17:19:11.939 INFO:tasks.workunit.client.1.smithi069.stdout:0/280: mknod d0/da/d59/c63 0 2024-04-25T17:19:11.941 INFO:tasks.workunit.client.1.smithi069.stdout:6/314: dwrite d2/f9 [4194304,4194304] 0 2024-04-25T17:19:11.942 INFO:tasks.workunit.client.0.smithi037.stdout:9/644: creat d1/d5/d19/d6e/fdf x:0 0 0 2024-04-25T17:19:11.943 INFO:tasks.workunit.client.0.smithi037.stdout:9/645: dread d1/d5/dc/fa5 [0,4194304] 0 2024-04-25T17:19:11.946 INFO:tasks.workunit.client.0.smithi037.stdout:0/572: symlink d9/df/d32/d39/d68/lbf 0 2024-04-25T17:19:11.947 INFO:tasks.workunit.client.0.smithi037.stdout:0/573: dread - d9/df/d32/f47 zero size 2024-04-25T17:19:11.948 INFO:tasks.workunit.client.1.smithi069.stdout:2/302: mkdir d0/d56/d5f/d62 0 2024-04-25T17:19:11.948 INFO:tasks.workunit.client.0.smithi037.stdout:0/574: stat d9/d14/d23/c97 0 2024-04-25T17:19:11.953 INFO:tasks.workunit.client.1.smithi069.stdout:5/347: creat d13/d17/d29/d2e/f74 x:0 0 0 2024-04-25T17:19:11.956 INFO:tasks.workunit.client.0.smithi037.stdout:4/703: rename d7/d7e/d45/d4f/f55 to d7/d78/fe2 0 2024-04-25T17:19:11.957 INFO:tasks.workunit.client.1.smithi069.stdout:4/335: creat db/d15/d20/d35/d63/d70/f74 x:0 0 0 2024-04-25T17:19:11.958 INFO:tasks.workunit.client.0.smithi037.stdout:7/538: rmdir d5/d15/d17/d1b/d94 39 2024-04-25T17:19:11.958 INFO:tasks.workunit.client.1.smithi069.stdout:4/336: dread - db/d15/d20/d35/d63/d43/d48/f5e zero size 2024-04-25T17:19:11.958 INFO:tasks.workunit.client.0.smithi037.stdout:3/365: dwrite d8/d23/d3a/f43 [0,4194304] 0 2024-04-25T17:19:11.959 INFO:tasks.workunit.client.0.smithi037.stdout:3/366: fdatasync d8/d23/f2d 0 2024-04-25T17:19:11.960 INFO:tasks.workunit.client.0.smithi037.stdout:3/367: chown d8/d31 45 1 2024-04-25T17:19:11.960 INFO:tasks.workunit.client.1.smithi069.stdout:0/281: creat d0/da/db/f64 x:0 0 0 2024-04-25T17:19:11.965 INFO:tasks.workunit.client.1.smithi069.stdout:3/427: mkdir d8/d16/d1a/d2c/d93 0 2024-04-25T17:19:11.966 INFO:tasks.workunit.client.1.smithi069.stdout:3/428: chown d8/d16/d1a/d2c/f4e 288843 1 2024-04-25T17:19:11.966 INFO:tasks.workunit.client.0.smithi037.stdout:8/480: unlink d5/d26/d33/l45 0 2024-04-25T17:19:11.972 INFO:tasks.workunit.client.1.smithi069.stdout:9/388: rename d2/da/dd/d1e/d2e/l81 to d2/da/d5f/d76/l8d 0 2024-04-25T17:19:11.973 INFO:tasks.workunit.client.0.smithi037.stdout:2/518: getdents d0 0 2024-04-25T17:19:11.975 INFO:tasks.workunit.client.1.smithi069.stdout:2/303: mknod d0/d26/d36/c63 0 2024-04-25T17:19:11.977 INFO:tasks.workunit.client.0.smithi037.stdout:0/575: dread d9/d14/f44 [4194304,4194304] 0 2024-04-25T17:19:11.978 INFO:tasks.workunit.client.0.smithi037.stdout:5/586: mkdir d7/d12/d5d/d90/db1/db3 0 2024-04-25T17:19:11.978 INFO:tasks.workunit.client.1.smithi069.stdout:5/348: dread d13/d17/d19/f25 [0,4194304] 0 2024-04-25T17:19:11.979 INFO:tasks.workunit.client.0.smithi037.stdout:5/587: truncate d7/d12/d6f/f97 237136 0 2024-04-25T17:19:11.980 INFO:tasks.workunit.client.0.smithi037.stdout:0/576: dread d9/df/f69 [0,4194304] 0 2024-04-25T17:19:11.981 INFO:tasks.workunit.client.0.smithi037.stdout:5/588: truncate d7/d18/f8e 1623818 0 2024-04-25T17:19:11.984 INFO:tasks.workunit.client.1.smithi069.stdout:4/337: mkdir db/d15/d20/d35/d63/d75 0 2024-04-25T17:19:11.987 INFO:tasks.workunit.client.1.smithi069.stdout:0/282: mknod d0/da/d54/c65 0 2024-04-25T17:19:11.988 INFO:tasks.workunit.client.0.smithi037.stdout:9/646: dwrite d1/d5/d19/d6e/f79 [0,4194304] 0 2024-04-25T17:19:11.989 INFO:tasks.workunit.client.1.smithi069.stdout:6/315: truncate d2/d7/f44 364905 0 2024-04-25T17:19:11.991 INFO:tasks.workunit.client.0.smithi037.stdout:0/577: dwrite d9/df/fb5 [0,4194304] 0 2024-04-25T17:19:11.992 INFO:tasks.workunit.client.0.smithi037.stdout:5/589: dwrite d7/d43/f47 [4194304,4194304] 0 2024-04-25T17:19:11.994 INFO:tasks.workunit.client.1.smithi069.stdout:3/429: rename d8/d16/d1a/d38/c90 to d8/d16/d31/c94 0 2024-04-25T17:19:11.995 INFO:tasks.workunit.client.1.smithi069.stdout:3/430: write d8/d39/f89 [328758,103630] 0 2024-04-25T17:19:11.995 INFO:tasks.workunit.client.0.smithi037.stdout:1/546: truncate dc/d18/f3e 1673677 0 2024-04-25T17:19:11.996 INFO:tasks.workunit.client.1.smithi069.stdout:3/431: chown d8/l1b 5391 1 2024-04-25T17:19:11.999 INFO:tasks.workunit.client.0.smithi037.stdout:4/704: read d7/d7e/d1e/f3a [3804284,98767] 0 2024-04-25T17:19:12.001 INFO:tasks.workunit.client.0.smithi037.stdout:7/539: rename d5/d15/d17/l90 to d5/d15/d17/d25/d2b/d48/lbf 0 2024-04-25T17:19:12.003 INFO:tasks.workunit.client.1.smithi069.stdout:2/304: mknod d0/d1/d5b/d28/c64 0 2024-04-25T17:19:12.005 INFO:tasks.workunit.client.0.smithi037.stdout:1/547: dwrite dc/d18/f88 [0,4194304] 0 2024-04-25T17:19:12.006 INFO:tasks.workunit.client.1.smithi069.stdout:5/349: symlink d13/d17/d29/d30/d55/l75 0 2024-04-25T17:19:12.009 INFO:tasks.workunit.client.1.smithi069.stdout:4/338: rmdir db/d15/d20/d38 39 2024-04-25T17:19:12.011 INFO:tasks.workunit.client.0.smithi037.stdout:2/519: dread d0/d16/f1b [0,4194304] 0 2024-04-25T17:19:12.012 INFO:tasks.workunit.client.1.smithi069.stdout:2/305: dread d0/d1/d5b/f32 [0,4194304] 0 2024-04-25T17:19:12.012 INFO:tasks.workunit.client.1.smithi069.stdout:6/316: truncate d2/f18 1412392 0 2024-04-25T17:19:12.013 INFO:tasks.workunit.client.1.smithi069.stdout:2/306: fsync d0/f53 0 2024-04-25T17:19:12.015 INFO:tasks.workunit.client.1.smithi069.stdout:3/432: mkdir d8/d16/d1a/d2c/d49/d87/d8a/d8e/d95 0 2024-04-25T17:19:12.016 INFO:tasks.workunit.client.1.smithi069.stdout:3/433: write d8/f1f [1970055,82356] 0 2024-04-25T17:19:12.017 INFO:tasks.workunit.client.1.smithi069.stdout:8/298: getdents d37/d62 0 2024-04-25T17:19:12.020 INFO:tasks.workunit.client.1.smithi069.stdout:7/349: getdents d4/d6/d14/d3d 0 2024-04-25T17:19:12.023 INFO:tasks.workunit.client.0.smithi037.stdout:3/368: mkdir d8/d23/d72 0 2024-04-25T17:19:12.024 INFO:tasks.workunit.client.1.smithi069.stdout:5/350: mkdir d13/d17/d29/d2e/d76 0 2024-04-25T17:19:12.024 INFO:tasks.workunit.client.1.smithi069.stdout:7/350: read d4/f10 [3127492,117483] 0 2024-04-25T17:19:12.026 INFO:tasks.workunit.client.1.smithi069.stdout:7/351: dread - d4/d6/d14/d3d/f69 zero size 2024-04-25T17:19:12.027 INFO:tasks.workunit.client.1.smithi069.stdout:4/339: write db/d15/d20/d38/f6a [365131,51213] 0 2024-04-25T17:19:12.028 INFO:tasks.workunit.client.0.smithi037.stdout:0/578: rename d9/d71/cb2 to d9/d14/d23/cc0 0 2024-04-25T17:19:12.029 INFO:tasks.workunit.client.1.smithi069.stdout:7/352: dread - d4/d6/d14/d5a/d5e/f60 zero size 2024-04-25T17:19:12.030 INFO:tasks.workunit.client.0.smithi037.stdout:3/369: dread d8/f4e [0,4194304] 0 2024-04-25T17:19:12.030 INFO:tasks.workunit.client.1.smithi069.stdout:9/389: dwrite d2/da/dd/d1e/d2e/f34 [0,4194304] 0 2024-04-25T17:19:12.031 INFO:tasks.workunit.client.0.smithi037.stdout:8/481: link d5/d6a/f9a d5/d6a/f9f 0 2024-04-25T17:19:12.031 INFO:tasks.workunit.client.1.smithi069.stdout:7/353: write d4/d6/d14/d15/f63 [185864,81086] 0 2024-04-25T17:19:12.032 INFO:tasks.workunit.client.1.smithi069.stdout:9/390: write d2/da/d14/d23/f3b [3208356,96561] 0 2024-04-25T17:19:12.034 INFO:tasks.workunit.client.0.smithi037.stdout:8/482: read - d5/db/d18/d3b/d50/f98 zero size 2024-04-25T17:19:12.035 INFO:tasks.workunit.client.0.smithi037.stdout:6/511: dwrite db/d53/f58 [0,4194304] 0 2024-04-25T17:19:12.036 INFO:tasks.workunit.client.1.smithi069.stdout:1/353: sync 2024-04-25T17:19:12.041 INFO:tasks.workunit.client.0.smithi037.stdout:2/520: creat d0/d16/d20/d55/fa6 x:0 0 0 2024-04-25T17:19:12.043 INFO:tasks.workunit.client.0.smithi037.stdout:9/647: chown d1/d48/d68/d26/d81 21 1 2024-04-25T17:19:12.047 INFO:tasks.workunit.client.0.smithi037.stdout:4/705: mknod d7/d7e/d1e/d70/d84/ddf/ce3 0 2024-04-25T17:19:12.051 INFO:tasks.workunit.client.1.smithi069.stdout:0/283: symlink d0/da/db/d56/l66 0 2024-04-25T17:19:12.052 INFO:tasks.workunit.client.0.smithi037.stdout:8/483: mkdir d5/db/d18/d3b/d50/da0 0 2024-04-25T17:19:12.054 INFO:tasks.workunit.client.0.smithi037.stdout:6/512: creat db/d26/d2e/d3e/fb6 x:0 0 0 2024-04-25T17:19:12.056 INFO:tasks.workunit.client.0.smithi037.stdout:3/370: dwrite d8/d31/d32/d3e/f6e [4194304,4194304] 0 2024-04-25T17:19:12.056 INFO:tasks.workunit.client.0.smithi037.stdout:1/548: mkdir dc/d1c/d57/d22/d36/d92/db8/dbc 0 2024-04-25T17:19:12.057 INFO:tasks.workunit.client.1.smithi069.stdout:3/434: dread d8/f19 [0,4194304] 0 2024-04-25T17:19:12.057 INFO:tasks.workunit.client.1.smithi069.stdout:3/435: write d8/d39/f89 [1074799,110476] 0 2024-04-25T17:19:12.064 INFO:tasks.workunit.client.0.smithi037.stdout:5/590: write d7/d18/d62/f6a [880751,16980] 0 2024-04-25T17:19:12.068 INFO:tasks.workunit.client.0.smithi037.stdout:0/579: mkdir d9/df/dbd/dc1 0 2024-04-25T17:19:12.072 INFO:tasks.workunit.client.0.smithi037.stdout:7/540: creat d5/d15/d17/d1b/da2/fc0 x:0 0 0 2024-04-25T17:19:12.078 INFO:tasks.workunit.client.0.smithi037.stdout:6/513: creat db/d1d/d20/d2f/fb7 x:0 0 0 2024-04-25T17:19:12.079 INFO:tasks.workunit.client.0.smithi037.stdout:8/484: dread d5/f6f [0,4194304] 0 2024-04-25T17:19:12.082 INFO:tasks.workunit.client.1.smithi069.stdout:7/354: dwrite d4/d18/d3f/f71 [4194304,4194304] 0 2024-04-25T17:19:12.084 INFO:tasks.workunit.client.1.smithi069.stdout:6/317: rmdir d2/d2e/d58 0 2024-04-25T17:19:12.088 INFO:tasks.workunit.client.1.smithi069.stdout:2/307: dwrite d0/d26/d10/f49 [0,4194304] 0 2024-04-25T17:19:12.088 INFO:tasks.workunit.client.0.smithi037.stdout:2/521: write d0/d23/f43 [1388741,113370] 0 2024-04-25T17:19:12.088 INFO:tasks.workunit.client.0.smithi037.stdout:8/485: dwrite d5/db/d23/d58/f8b [0,4194304] 0 2024-04-25T17:19:12.089 INFO:tasks.workunit.client.0.smithi037.stdout:5/591: readlink d7/d43/l70 0 2024-04-25T17:19:12.091 INFO:tasks.workunit.client.0.smithi037.stdout:4/706: truncate d7/f26 1722881 0 2024-04-25T17:19:12.091 INFO:tasks.workunit.client.1.smithi069.stdout:1/354: dwrite d1/df/d17/f24 [0,4194304] 0 2024-04-25T17:19:12.092 INFO:tasks.workunit.client.1.smithi069.stdout:6/318: write d2/fe [2859553,128537] 0 2024-04-25T17:19:12.092 INFO:tasks.workunit.client.0.smithi037.stdout:7/541: dread f0 [4194304,4194304] 0 2024-04-25T17:19:12.092 INFO:tasks.workunit.client.0.smithi037.stdout:0/580: truncate d9/df/d32/f47 341922 0 2024-04-25T17:19:12.094 INFO:tasks.workunit.client.0.smithi037.stdout:0/581: write d9/d14/f9a [2289417,46302] 0 2024-04-25T17:19:12.094 INFO:tasks.workunit.client.1.smithi069.stdout:8/299: dwrite f34 [0,4194304] 0 2024-04-25T17:19:12.097 INFO:tasks.workunit.client.1.smithi069.stdout:2/308: chown d0/d1/d5b/d28/c64 106 1 2024-04-25T17:19:12.098 INFO:tasks.workunit.client.1.smithi069.stdout:4/340: rename db/d15/f17 to db/d15/d20/f76 0 2024-04-25T17:19:12.099 INFO:tasks.workunit.client.0.smithi037.stdout:6/514: creat db/d26/d2e/d7d/d65/fb8 x:0 0 0 2024-04-25T17:19:12.100 INFO:tasks.workunit.client.0.smithi037.stdout:1/549: truncate dc/d1c/d57/d4d/d6a/d86/d91/f93 1115937 0 2024-04-25T17:19:12.102 INFO:tasks.workunit.client.0.smithi037.stdout:1/550: chown dc/d1c/d57/d22/d36 92719576 1 2024-04-25T17:19:12.103 INFO:tasks.workunit.client.1.smithi069.stdout:3/436: creat d8/d16/d1a/d2c/d93/f96 x:0 0 0 2024-04-25T17:19:12.105 INFO:tasks.workunit.client.1.smithi069.stdout:7/355: rmdir d4/d6/d14/d3d 39 2024-04-25T17:19:12.105 INFO:tasks.workunit.client.1.smithi069.stdout:0/284: dread d0/da/db/f13 [0,4194304] 0 2024-04-25T17:19:12.105 INFO:tasks.workunit.client.0.smithi037.stdout:3/371: link d8/d31/f5f d8/d23/d38/f73 0 2024-04-25T17:19:12.108 INFO:tasks.workunit.client.0.smithi037.stdout:2/522: readlink d0/d23/l5c 0 2024-04-25T17:19:12.109 INFO:tasks.workunit.client.0.smithi037.stdout:2/523: rename d0 to d0/d16/d20/d59/da7 22 2024-04-25T17:19:12.110 INFO:tasks.workunit.client.0.smithi037.stdout:3/372: read d8/d31/d32/f39 [2488634,121486] 0 2024-04-25T17:19:12.112 INFO:tasks.workunit.client.0.smithi037.stdout:8/486: fdatasync d5/da/f32 0 2024-04-25T17:19:12.112 INFO:tasks.workunit.client.1.smithi069.stdout:5/351: getdents d13/d17/d29/d30/d5c 0 2024-04-25T17:19:12.113 INFO:tasks.workunit.client.0.smithi037.stdout:8/487: chown d5/db/d18/c70 21282621 1 2024-04-25T17:19:12.114 INFO:tasks.workunit.client.0.smithi037.stdout:4/707: rmdir d7/d7e/d45 39 2024-04-25T17:19:12.116 INFO:tasks.workunit.client.1.smithi069.stdout:2/309: creat d0/d56/d5f/f65 x:0 0 0 2024-04-25T17:19:12.117 INFO:tasks.workunit.client.1.smithi069.stdout:8/300: mknod d37/d62/c65 0 2024-04-25T17:19:12.120 INFO:tasks.workunit.client.1.smithi069.stdout:4/341: creat db/d15/d20/d35/d63/f77 x:0 0 0 2024-04-25T17:19:12.121 INFO:tasks.workunit.client.0.smithi037.stdout:6/515: creat db/d26/d2e/d3e/fb9 x:0 0 0 2024-04-25T17:19:12.122 INFO:tasks.workunit.client.0.smithi037.stdout:6/516: write db/d1d/d20/f4b [923767,116761] 0 2024-04-25T17:19:12.122 INFO:tasks.workunit.client.0.smithi037.stdout:1/551: creat dc/d24/fbd x:0 0 0 2024-04-25T17:19:12.123 INFO:tasks.workunit.client.1.smithi069.stdout:8/301: dwrite f32 [4194304,4194304] 0 2024-04-25T17:19:12.125 INFO:tasks.workunit.client.0.smithi037.stdout:1/552: read dc/d18/f1b [1564689,126615] 0 2024-04-25T17:19:12.126 INFO:tasks.workunit.client.1.smithi069.stdout:0/285: mkdir d0/da/d24/d67 0 2024-04-25T17:19:12.126 INFO:tasks.workunit.client.1.smithi069.stdout:7/356: symlink d4/d6/d14/d5a/l73 0 2024-04-25T17:19:12.128 INFO:tasks.workunit.client.1.smithi069.stdout:1/355: mkdir d1/df/d6c 0 2024-04-25T17:19:12.129 INFO:tasks.workunit.client.0.smithi037.stdout:2/524: readlink d0/l3 0 2024-04-25T17:19:12.130 INFO:tasks.workunit.client.1.smithi069.stdout:7/357: chown d4/d6/d14/d5a 27218539 1 2024-04-25T17:19:12.131 INFO:tasks.workunit.client.0.smithi037.stdout:6/517: dwrite db/d1d/d20/f4b [0,4194304] 0 2024-04-25T17:19:12.132 INFO:tasks.workunit.client.1.smithi069.stdout:4/342: dwrite db/d15/d42/d64/f67 [0,4194304] 0 2024-04-25T17:19:12.137 INFO:tasks.workunit.client.1.smithi069.stdout:3/437: link d8/d16/d1a/d2c/d49/f68 d8/d71/d8d/d92/f97 0 2024-04-25T17:19:12.137 INFO:tasks.workunit.client.0.smithi037.stdout:8/488: truncate d5/d6a/f3f 3400586 0 2024-04-25T17:19:12.138 INFO:tasks.workunit.client.1.smithi069.stdout:3/438: dread - d8/d2a/f82 zero size 2024-04-25T17:19:12.139 INFO:tasks.workunit.client.1.smithi069.stdout:3/439: stat d8/d39 0 2024-04-25T17:19:12.140 INFO:tasks.workunit.client.1.smithi069.stdout:6/319: dread d2/d7/fc [0,4194304] 0 2024-04-25T17:19:12.141 INFO:tasks.workunit.client.0.smithi037.stdout:7/542: mkdir d5/dc1 0 2024-04-25T17:19:12.143 INFO:tasks.workunit.client.1.smithi069.stdout:0/286: creat d0/d17/d40/f68 x:0 0 0 2024-04-25T17:19:12.148 INFO:tasks.workunit.client.1.smithi069.stdout:3/440: dwrite d8/d71/d8d/f8f [0,4194304] 0 2024-04-25T17:19:12.151 INFO:tasks.workunit.client.0.smithi037.stdout:9/648: getdents d1/d48/d68/d4e 0 2024-04-25T17:19:12.152 INFO:tasks.workunit.client.1.smithi069.stdout:7/358: chown d4/d6/d14/d15/f28 71470933 1 2024-04-25T17:19:12.155 INFO:tasks.workunit.client.1.smithi069.stdout:4/343: unlink db/d15/d20/d35/d63/d43/d48/d49/f65 0 2024-04-25T17:19:12.158 INFO:tasks.workunit.client.1.smithi069.stdout:8/302: mkdir d37/d66 0 2024-04-25T17:19:12.159 INFO:tasks.workunit.client.0.smithi037.stdout:2/525: truncate d0/f51 4485814 0 2024-04-25T17:19:12.161 INFO:tasks.workunit.client.1.smithi069.stdout:6/320: rename d2/d1e/f64 to d2/d1e/d3e/d67/f69 0 2024-04-25T17:19:12.161 INFO:tasks.workunit.client.1.smithi069.stdout:0/287: rename d0/da/d54 to d0/da/d54/d69 22 2024-04-25T17:19:12.164 INFO:tasks.workunit.client.0.smithi037.stdout:3/373: fdatasync f5 0 2024-04-25T17:19:12.166 INFO:tasks.workunit.client.0.smithi037.stdout:6/518: creat db/d26/d2e/d3e/d25/db0/fba x:0 0 0 2024-04-25T17:19:12.167 INFO:tasks.workunit.client.1.smithi069.stdout:7/359: mknod d4/d1a/c74 0 2024-04-25T17:19:12.168 INFO:tasks.workunit.client.1.smithi069.stdout:7/360: readlink d4/d18/d3f/l67 0 2024-04-25T17:19:12.169 INFO:tasks.workunit.client.1.smithi069.stdout:7/361: fdatasync d4/d6/d14/f48 0 2024-04-25T17:19:12.169 INFO:tasks.workunit.client.0.smithi037.stdout:4/708: creat d7/d7e/d1e/d2b/d35/d39/d7a/dcc/fe4 x:0 0 0 2024-04-25T17:19:12.170 INFO:tasks.workunit.client.1.smithi069.stdout:1/356: dread d1/df/d17/f2d [0,4194304] 0 2024-04-25T17:19:12.171 INFO:tasks.workunit.client.1.smithi069.stdout:1/357: stat d1/d4/de/d44/f69 0 2024-04-25T17:19:12.171 INFO:tasks.workunit.client.0.smithi037.stdout:4/709: dread - d7/d7e/d4e/fdd zero size 2024-04-25T17:19:12.171 INFO:tasks.workunit.client.1.smithi069.stdout:1/358: fsync d1/d43/f5b 0 2024-04-25T17:19:12.173 INFO:tasks.workunit.client.0.smithi037.stdout:8/489: rename d5/db/d23/d42/l97 to d5/d26/d81/la1 0 2024-04-25T17:19:12.174 INFO:tasks.workunit.client.0.smithi037.stdout:0/582: dwrite d9/df/f45 [0,4194304] 0 2024-04-25T17:19:12.174 INFO:tasks.workunit.client.0.smithi037.stdout:4/710: truncate d7/d7e/d1e/fde 388549 0 2024-04-25T17:19:12.175 INFO:tasks.workunit.client.1.smithi069.stdout:7/362: dread d4/f58 [0,4194304] 0 2024-04-25T17:19:12.175 INFO:tasks.workunit.client.1.smithi069.stdout:4/344: mkdir db/d4b/d78 0 2024-04-25T17:19:12.175 INFO:tasks.workunit.client.0.smithi037.stdout:2/526: dread d0/d16/d20/d55/f6f [4194304,4194304] 0 2024-04-25T17:19:12.175 INFO:tasks.workunit.client.1.smithi069.stdout:4/345: fsync db/d15/d26/f3b 0 2024-04-25T17:19:12.176 INFO:tasks.workunit.client.1.smithi069.stdout:9/391: sync 2024-04-25T17:19:12.176 INFO:tasks.workunit.client.0.smithi037.stdout:4/711: read - d7/d7e/d4e/da5/fdc zero size 2024-04-25T17:19:12.179 INFO:tasks.workunit.client.1.smithi069.stdout:5/352: write d13/f16 [1907278,60136] 0 2024-04-25T17:19:12.179 INFO:tasks.workunit.client.0.smithi037.stdout:4/712: fsync d7/d7e/d1e/d2b/d35/d39/dba/fb4 0 2024-04-25T17:19:12.180 INFO:tasks.workunit.client.1.smithi069.stdout:5/353: chown d13/d17/d29/d30/d5c/f48 13 1 2024-04-25T17:19:12.187 INFO:tasks.workunit.client.1.smithi069.stdout:5/354: dwrite d13/d17/d19/d20/d2d/f5d [0,4194304] 0 2024-04-25T17:19:12.189 INFO:tasks.workunit.client.0.smithi037.stdout:0/583: dwrite d9/d14/f22 [0,4194304] 0 2024-04-25T17:19:12.193 INFO:tasks.workunit.client.0.smithi037.stdout:2/527: dwrite d0/d16/d20/d55/fa6 [0,4194304] 0 2024-04-25T17:19:12.197 INFO:tasks.workunit.client.0.smithi037.stdout:5/592: dwrite d7/d43/f32 [4194304,4194304] 0 2024-04-25T17:19:12.199 INFO:tasks.workunit.client.1.smithi069.stdout:2/310: write d0/d1/f1f [4182671,118087] 0 2024-04-25T17:19:12.199 INFO:tasks.workunit.client.0.smithi037.stdout:3/374: dread d8/d23/d38/f73 [0,4194304] 0 2024-04-25T17:19:12.203 INFO:tasks.workunit.client.0.smithi037.stdout:3/375: write d8/d23/d38/f6b [884954,69806] 0 2024-04-25T17:19:12.208 INFO:tasks.workunit.client.0.smithi037.stdout:2/528: dwrite d0/f44 [0,4194304] 0 2024-04-25T17:19:12.212 INFO:tasks.workunit.client.0.smithi037.stdout:3/376: write d8/d23/d38/f5a [132809,122223] 0 2024-04-25T17:19:12.215 INFO:tasks.workunit.client.0.smithi037.stdout:2/529: dread d0/d16/d3b/f5b [0,4194304] 0 2024-04-25T17:19:12.217 INFO:tasks.workunit.client.0.smithi037.stdout:1/553: dwrite dc/d24/f5e [0,4194304] 0 2024-04-25T17:19:12.218 INFO:tasks.workunit.client.0.smithi037.stdout:8/490: fdatasync d5/f47 0 2024-04-25T17:19:12.219 INFO:tasks.workunit.client.1.smithi069.stdout:8/303: mknod d37/d47/c67 0 2024-04-25T17:19:12.220 INFO:tasks.workunit.client.0.smithi037.stdout:7/543: mknod d5/d15/d17/d1b/cc2 0 2024-04-25T17:19:12.225 INFO:tasks.workunit.client.1.smithi069.stdout:3/441: rename d8/d16/c30 to d8/d2a/c98 0 2024-04-25T17:19:12.229 INFO:tasks.workunit.client.1.smithi069.stdout:0/288: creat d0/da/d24/d67/f6a x:0 0 0 2024-04-25T17:19:12.232 INFO:tasks.workunit.client.0.smithi037.stdout:9/649: dwrite d1/ff [4194304,4194304] 0 2024-04-25T17:19:12.234 INFO:tasks.workunit.client.1.smithi069.stdout:3/442: dwrite d8/d16/d4b/f79 [0,4194304] 0 2024-04-25T17:19:12.234 INFO:tasks.workunit.client.1.smithi069.stdout:6/321: dwrite d2/d1e/f32 [0,4194304] 0 2024-04-25T17:19:12.236 INFO:tasks.workunit.client.1.smithi069.stdout:6/322: write d2/d1e/f33 [5812993,59885] 0 2024-04-25T17:19:12.237 INFO:tasks.workunit.client.1.smithi069.stdout:7/363: mknod d4/c75 0 2024-04-25T17:19:12.237 INFO:tasks.workunit.client.1.smithi069.stdout:6/323: write d2/f63 [596782,126715] 0 2024-04-25T17:19:12.240 INFO:tasks.workunit.client.1.smithi069.stdout:6/324: truncate d2/d1e/d3e/d67/f69 320986 0 2024-04-25T17:19:12.240 INFO:tasks.workunit.client.0.smithi037.stdout:5/593: rmdir d7/d12 39 2024-04-25T17:19:12.242 INFO:tasks.workunit.client.1.smithi069.stdout:4/346: mkdir db/d4b/d78/d79 0 2024-04-25T17:19:12.243 INFO:tasks.workunit.client.1.smithi069.stdout:6/325: dread d2/d1e/d3e/d67/f69 [0,4194304] 0 2024-04-25T17:19:12.244 INFO:tasks.workunit.client.1.smithi069.stdout:1/359: dwrite d1/f28 [0,4194304] 0 2024-04-25T17:19:12.249 INFO:tasks.workunit.client.0.smithi037.stdout:6/519: mknod db/d1d/d20/cbb 0 2024-04-25T17:19:12.250 INFO:tasks.workunit.client.1.smithi069.stdout:2/311: getdents d0/d56/d5f/d62 0 2024-04-25T17:19:12.251 INFO:tasks.workunit.client.1.smithi069.stdout:2/312: write d0/d56/f5e [479133,40404] 0 2024-04-25T17:19:12.252 INFO:tasks.workunit.client.1.smithi069.stdout:2/313: write d0/d1/d5b/f29 [275870,61410] 0 2024-04-25T17:19:12.252 INFO:tasks.workunit.client.1.smithi069.stdout:2/314: readlink d0/l1c 0 2024-04-25T17:19:12.255 INFO:tasks.workunit.client.0.smithi037.stdout:3/377: creat d8/d23/d38/f74 x:0 0 0 2024-04-25T17:19:12.257 INFO:tasks.workunit.client.1.smithi069.stdout:3/443: mkdir d8/d16/d1a/d99 0 2024-04-25T17:19:12.257 INFO:tasks.workunit.client.0.smithi037.stdout:3/378: truncate d8/d23/d38/d66/f6f 447323 0 2024-04-25T17:19:12.259 INFO:tasks.workunit.client.1.smithi069.stdout:5/355: dwrite d13/d17/d29/f43 [0,4194304] 0 2024-04-25T17:19:12.260 INFO:tasks.workunit.client.1.smithi069.stdout:5/356: fdatasync d13/d17/d19/d1c/f45 0 2024-04-25T17:19:12.261 INFO:tasks.workunit.client.1.smithi069.stdout:5/357: truncate d13/f60 424635 0 2024-04-25T17:19:12.262 INFO:tasks.workunit.client.1.smithi069.stdout:4/347: creat db/d15/d26/f7a x:0 0 0 2024-04-25T17:19:12.263 INFO:tasks.workunit.client.0.smithi037.stdout:7/544: chown d5/d15/l22 7038 1 2024-04-25T17:19:12.264 INFO:tasks.workunit.client.0.smithi037.stdout:4/713: mknod d7/d7e/d45/d4f/ce5 0 2024-04-25T17:19:12.265 INFO:tasks.workunit.client.0.smithi037.stdout:4/714: chown d7/f10 3143 1 2024-04-25T17:19:12.266 INFO:tasks.workunit.client.1.smithi069.stdout:1/360: mknod d1/d43/d35/c6d 0 2024-04-25T17:19:12.267 INFO:tasks.workunit.client.0.smithi037.stdout:0/584: mknod d9/df/d32/d39/cc2 0 2024-04-25T17:19:12.278 INFO:tasks.workunit.client.0.smithi037.stdout:6/520: mknod db/d26/d2e/d7d/cbc 0 2024-04-25T17:19:12.279 INFO:tasks.workunit.client.0.smithi037.stdout:2/530: mknod d0/d16/d26/d9e/ca8 0 2024-04-25T17:19:12.282 INFO:tasks.workunit.client.0.smithi037.stdout:1/554: mkdir dc/d1c/d57/d22/d36/dbe 0 2024-04-25T17:19:12.282 INFO:tasks.workunit.client.0.smithi037.stdout:1/555: stat dc/d18/c2a 0 2024-04-25T17:19:12.284 INFO:tasks.workunit.client.1.smithi069.stdout:6/326: link d2/d2e/f41 d2/d1e/f6a 0 2024-04-25T17:19:12.285 INFO:tasks.workunit.client.0.smithi037.stdout:3/379: creat d8/d23/d38/d66/f75 x:0 0 0 2024-04-25T17:19:12.287 INFO:tasks.workunit.client.0.smithi037.stdout:8/491: mkdir d5/db/da2 0 2024-04-25T17:19:12.288 INFO:tasks.workunit.client.1.smithi069.stdout:7/364: dwrite d4/d1a/d34/f66 [0,4194304] 0 2024-04-25T17:19:12.290 INFO:tasks.workunit.client.0.smithi037.stdout:7/545: rename d5/fa3 to d5/d15/d17/d1b/da2/d76/fc3 0 2024-04-25T17:19:12.292 INFO:tasks.workunit.client.1.smithi069.stdout:5/358: link d13/d17/f63 d13/d17/d19/d20/f77 0 2024-04-25T17:19:12.293 INFO:tasks.workunit.client.1.smithi069.stdout:0/289: write d0/da/db/d1d/f20 [2047415,98062] 0 2024-04-25T17:19:12.294 INFO:tasks.workunit.client.1.smithi069.stdout:6/327: mknod d2/d2e/d35/c6b 0 2024-04-25T17:19:12.297 INFO:tasks.workunit.client.1.smithi069.stdout:4/348: symlink db/d15/d20/d35/d63/d75/l7b 0 2024-04-25T17:19:12.297 INFO:tasks.workunit.client.1.smithi069.stdout:7/365: dwrite d4/d6/d14/d5a/d5e/f60 [0,4194304] 0 2024-04-25T17:19:12.298 INFO:tasks.workunit.client.0.smithi037.stdout:7/546: dwrite d5/d15/d17/d1b/f68 [0,4194304] 0 2024-04-25T17:19:12.298 INFO:tasks.workunit.client.0.smithi037.stdout:9/650: getdents d1/d48/d68/d4e 0 2024-04-25T17:19:12.300 INFO:tasks.workunit.client.0.smithi037.stdout:5/594: creat d7/d12/d5d/d90/fb4 x:0 0 0 2024-04-25T17:19:12.301 INFO:tasks.workunit.client.1.smithi069.stdout:5/359: dwrite fd [0,4194304] 0 2024-04-25T17:19:12.304 INFO:tasks.workunit.client.1.smithi069.stdout:5/360: write d13/d17/d19/f28 [1877395,109899] 0 2024-04-25T17:19:12.304 INFO:tasks.workunit.client.1.smithi069.stdout:2/315: rename d0/d1/c24 to d0/d1/d5b/c66 0 2024-04-25T17:19:12.313 INFO:tasks.workunit.client.1.smithi069.stdout:6/328: mknod d2/d1e/d3f/c6c 0 2024-04-25T17:19:12.314 INFO:tasks.workunit.client.1.smithi069.stdout:2/316: dwrite d0/d1/d5b/d33/f51 [0,4194304] 0 2024-04-25T17:19:12.315 INFO:tasks.workunit.client.1.smithi069.stdout:2/317: fsync d0/d26/f60 0 2024-04-25T17:19:12.316 INFO:tasks.workunit.client.1.smithi069.stdout:4/349: unlink db/f2f 0 2024-04-25T17:19:12.319 INFO:tasks.workunit.client.1.smithi069.stdout:7/366: rmdir d4/d6/d14/d15 39 2024-04-25T17:19:12.319 INFO:tasks.workunit.client.1.smithi069.stdout:4/350: dread - db/d15/d20/d35/d63/f60 zero size 2024-04-25T17:19:12.321 INFO:tasks.workunit.client.0.smithi037.stdout:8/492: fdatasync d5/d6a/f9f 0 2024-04-25T17:19:12.322 INFO:tasks.workunit.client.1.smithi069.stdout:6/329: dwrite d2/d2e/d35/d48/f4f [0,4194304] 0 2024-04-25T17:19:12.326 INFO:tasks.workunit.client.0.smithi037.stdout:3/380: dwrite d8/d23/d38/f73 [4194304,4194304] 0 2024-04-25T17:19:12.327 INFO:tasks.workunit.client.0.smithi037.stdout:3/381: chown d8/lb 1627268440 1 2024-04-25T17:19:12.328 INFO:tasks.workunit.client.1.smithi069.stdout:7/367: dwrite d4/d1a/d34/f66 [0,4194304] 0 2024-04-25T17:19:12.331 INFO:tasks.workunit.client.1.smithi069.stdout:3/444: rename d8/lb to d8/d71/d8d/d92/l9a 0 2024-04-25T17:19:12.331 INFO:tasks.workunit.client.1.smithi069.stdout:1/361: rename d1/d4 to d1/d4/d6/d4f/d6e 22 2024-04-25T17:19:12.332 INFO:tasks.workunit.client.0.smithi037.stdout:0/585: write d9/d14/f1a [108633,24818] 0 2024-04-25T17:19:12.333 INFO:tasks.workunit.client.1.smithi069.stdout:5/361: mknod d13/d17/d29/c78 0 2024-04-25T17:19:12.333 INFO:tasks.workunit.client.0.smithi037.stdout:0/586: chown d9/df/d32/d39/d68/ca2 53 1 2024-04-25T17:19:12.334 INFO:tasks.workunit.client.0.smithi037.stdout:4/715: mkdir d7/d7e/d1e/d2b/d35/d39/de6 0 2024-04-25T17:19:12.344 INFO:tasks.workunit.client.1.smithi069.stdout:4/351: creat db/d15/d20/d35/d63/d43/d48/f7c x:0 0 0 2024-04-25T17:19:12.344 INFO:tasks.workunit.client.0.smithi037.stdout:2/531: write d0/d16/d26/f2c [226980,30772] 0 2024-04-25T17:19:12.345 INFO:tasks.workunit.client.0.smithi037.stdout:6/521: dwrite db/d5a/f77 [0,4194304] 0 2024-04-25T17:19:12.349 INFO:tasks.workunit.client.1.smithi069.stdout:0/290: rename d0/da/d54/c5d to d0/da/d24/c6b 0 2024-04-25T17:19:12.349 INFO:tasks.workunit.client.1.smithi069.stdout:2/318: dread d0/d26/f18 [0,4194304] 0 2024-04-25T17:19:12.350 INFO:tasks.workunit.client.0.smithi037.stdout:1/556: symlink dc/d1c/d57/d22/d36/lbf 0 2024-04-25T17:19:12.352 INFO:tasks.workunit.client.1.smithi069.stdout:1/362: fsync d1/d4/f2a 0 2024-04-25T17:19:12.353 INFO:tasks.workunit.client.1.smithi069.stdout:5/362: mkdir d13/d17/d19/d1c/d79 0 2024-04-25T17:19:12.354 INFO:tasks.workunit.client.0.smithi037.stdout:8/493: symlink d5/db/d23/d58/la3 0 2024-04-25T17:19:12.355 INFO:tasks.workunit.client.1.smithi069.stdout:1/363: truncate d1/d4/de/d44/f5c 101982 0 2024-04-25T17:19:12.355 INFO:tasks.workunit.client.1.smithi069.stdout:5/363: stat d13/d17/d19/d20/d51/f6b 0 2024-04-25T17:19:12.356 INFO:tasks.workunit.client.1.smithi069.stdout:0/291: dread d0/da/d24/f42 [0,4194304] 0 2024-04-25T17:19:12.358 INFO:tasks.workunit.client.1.smithi069.stdout:0/292: write d0/da/d24/d67/f6a [191224,18114] 0 2024-04-25T17:19:12.359 INFO:tasks.workunit.client.0.smithi037.stdout:0/587: mknod d9/d14/d28/d48/da9/cc3 0 2024-04-25T17:19:12.360 INFO:tasks.workunit.client.1.smithi069.stdout:0/293: truncate d0/da/d24/f55 312893 0 2024-04-25T17:19:12.363 INFO:tasks.workunit.client.1.smithi069.stdout:2/319: creat d0/d1/d5b/d33/f67 x:0 0 0 2024-04-25T17:19:12.364 INFO:tasks.workunit.client.1.smithi069.stdout:5/364: dwrite d13/d17/d29/d30/d5c/f69 [0,4194304] 0 2024-04-25T17:19:12.364 INFO:tasks.workunit.client.0.smithi037.stdout:9/651: creat d1/d5/d19/dde/fe0 x:0 0 0 2024-04-25T17:19:12.367 INFO:tasks.workunit.client.0.smithi037.stdout:7/547: unlink d5/d15/d17/d1b/da2/fa6 0 2024-04-25T17:19:12.369 INFO:tasks.workunit.client.1.smithi069.stdout:1/364: mknod d1/d4/de/d44/d68/c6f 0 2024-04-25T17:19:12.370 INFO:tasks.workunit.client.1.smithi069.stdout:0/294: dwrite d0/d38/f49 [0,4194304] 0 2024-04-25T17:19:12.371 INFO:tasks.workunit.client.0.smithi037.stdout:5/595: mknod d7/d12/d6f/cb5 0 2024-04-25T17:19:12.373 INFO:tasks.workunit.client.0.smithi037.stdout:2/532: mkdir d0/d16/d26/d9e/da9 0 2024-04-25T17:19:12.374 INFO:tasks.workunit.client.0.smithi037.stdout:2/533: read d0/f44 [111769,64605] 0 2024-04-25T17:19:12.375 INFO:tasks.workunit.client.0.smithi037.stdout:6/522: mkdir db/d26/d2e/d7d/d65/d68/d87/dbd 0 2024-04-25T17:19:12.378 INFO:tasks.workunit.client.0.smithi037.stdout:1/557: truncate dc/d18/d66/f90 760506 0 2024-04-25T17:19:12.378 INFO:tasks.workunit.client.1.smithi069.stdout:5/365: dwrite d13/d17/d19/d20/f22 [0,4194304] 0 2024-04-25T17:19:12.379 INFO:tasks.workunit.client.0.smithi037.stdout:1/558: chown dc/d24/fbd 0 1 2024-04-25T17:19:12.380 INFO:tasks.workunit.client.0.smithi037.stdout:8/494: creat d5/db/d18/d3b/d50/fa4 x:0 0 0 2024-04-25T17:19:12.381 INFO:tasks.workunit.client.0.smithi037.stdout:8/495: stat d5/db/d18/d3b/l52 0 2024-04-25T17:19:12.382 INFO:tasks.workunit.client.0.smithi037.stdout:3/382: creat d8/d23/d72/f76 x:0 0 0 2024-04-25T17:19:12.382 INFO:tasks.workunit.client.0.smithi037.stdout:8/496: dread - d5/db/d18/d3b/d50/d51/f69 zero size 2024-04-25T17:19:12.383 INFO:tasks.workunit.client.1.smithi069.stdout:1/365: dwrite d1/d4/f2a [0,4194304] 0 2024-04-25T17:19:12.383 INFO:tasks.workunit.client.1.smithi069.stdout:6/330: dwrite d2/d1e/f2b [0,4194304] 0 2024-04-25T17:19:12.384 INFO:tasks.workunit.client.1.smithi069.stdout:5/366: write d13/d17/d29/d2e/f74 [362506,4626] 0 2024-04-25T17:19:12.385 INFO:tasks.workunit.client.0.smithi037.stdout:0/588: mkdir d9/d14/d28/d48/d58/dc4 0 2024-04-25T17:19:12.389 INFO:tasks.workunit.client.0.smithi037.stdout:3/383: dread d8/d23/d38/f73 [0,4194304] 0 2024-04-25T17:19:12.389 INFO:tasks.workunit.client.1.smithi069.stdout:3/445: rename d8/d16/d4b/d77 to d8/d16/d9b 0 2024-04-25T17:19:12.389 INFO:tasks.workunit.client.0.smithi037.stdout:4/716: symlink d7/d7e/d1e/dae/dc6/le7 0 2024-04-25T17:19:12.393 INFO:tasks.workunit.client.1.smithi069.stdout:6/331: dread d2/d1e/f6a [0,4194304] 0 2024-04-25T17:19:12.393 INFO:tasks.workunit.client.0.smithi037.stdout:8/497: dwrite d5/d6a/f7a [4194304,4194304] 0 2024-04-25T17:19:12.395 INFO:tasks.workunit.client.1.smithi069.stdout:4/352: link db/d15/d20/d38/c58 db/d15/d20/d35/d63/d75/c7d 0 2024-04-25T17:19:12.396 INFO:tasks.workunit.client.0.smithi037.stdout:8/498: read - d5/d6a/f89 zero size 2024-04-25T17:19:12.396 INFO:tasks.workunit.client.1.smithi069.stdout:4/353: chown db/c13 425 1 2024-04-25T17:19:12.397 INFO:tasks.workunit.client.1.smithi069.stdout:4/354: fsync db/d15/d20/d35/d63/d70/f74 0 2024-04-25T17:19:12.398 INFO:tasks.workunit.client.0.smithi037.stdout:7/548: creat d5/d15/d17/d25/d2b/d59/fc4 x:0 0 0 2024-04-25T17:19:12.399 INFO:tasks.workunit.client.0.smithi037.stdout:0/589: dwrite d9/df/d32/d35/fb8 [0,4194304] 0 2024-04-25T17:19:12.399 INFO:tasks.workunit.client.0.smithi037.stdout:8/499: chown d5/db/d23/f4e 886917914 1 2024-04-25T17:19:12.400 INFO:tasks.workunit.client.0.smithi037.stdout:5/596: fsync d7/f56 0 2024-04-25T17:19:12.402 INFO:tasks.workunit.client.0.smithi037.stdout:0/590: write d9/f19 [4299306,121337] 0 2024-04-25T17:19:12.402 INFO:tasks.workunit.client.0.smithi037.stdout:8/500: dread - d5/db/d18/d3b/d50/f8e zero size 2024-04-25T17:19:12.405 INFO:tasks.workunit.client.0.smithi037.stdout:8/501: write d5/db/d18/f62 [145043,85227] 0 2024-04-25T17:19:12.408 INFO:tasks.workunit.client.0.smithi037.stdout:2/534: creat d0/d15/d2a/d5a/faa x:0 0 0 2024-04-25T17:19:12.412 INFO:tasks.workunit.client.1.smithi069.stdout:5/367: creat d13/d17/d19/d20/f7a x:0 0 0 2024-04-25T17:19:12.421 INFO:tasks.workunit.client.0.smithi037.stdout:3/384: unlink d8/d23/d3a/d5d/l70 0 2024-04-25T17:19:12.488 INFO:tasks.workunit.client.0.smithi037.stdout:9/652: write d1/d5/dc/d38/f3a [449664,21369] 0 2024-04-25T17:19:12.488 INFO:tasks.workunit.client.0.smithi037.stdout:9/653: dwrite d1/d5/fdb [0,4194304] 0 2024-04-25T17:19:12.488 INFO:tasks.workunit.client.0.smithi037.stdout:1/559: dread dc/f10 [0,4194304] 0 2024-04-25T17:19:12.488 INFO:tasks.workunit.client.0.smithi037.stdout:7/549: dwrite d5/d15/d17/d1b/da2/daf/fb9 [0,4194304] 0 2024-04-25T17:19:12.488 INFO:tasks.workunit.client.0.smithi037.stdout:4/717: dwrite d7/f80 [0,4194304] 0 2024-04-25T17:19:12.488 INFO:tasks.workunit.client.0.smithi037.stdout:2/535: symlink d0/d16/d26/d3e/d4b/lab 0 2024-04-25T17:19:12.488 INFO:tasks.workunit.client.0.smithi037.stdout:6/523: link db/f98 db/d26/d2e/d3e/d25/db0/fbe 0 2024-04-25T17:19:12.488 INFO:tasks.workunit.client.0.smithi037.stdout:3/385: rename d8/d31/l59 to d8/d31/l77 0 2024-04-25T17:19:12.488 INFO:tasks.workunit.client.0.smithi037.stdout:0/591: write d9/d14/d28/d48/f50 [1390889,88547] 0 2024-04-25T17:19:12.488 INFO:tasks.workunit.client.0.smithi037.stdout:9/654: rmdir d1/d5/d2e/d34/d76 39 2024-04-25T17:19:12.488 INFO:tasks.workunit.client.0.smithi037.stdout:5/597: creat d7/d12/d6f/d68/fb6 x:0 0 0 2024-04-25T17:19:12.488 INFO:tasks.workunit.client.0.smithi037.stdout:4/718: mkdir d7/d7e/d1e/d2b/d35/d39/d7a/de8 0 2024-04-25T17:19:12.488 INFO:tasks.workunit.client.0.smithi037.stdout:8/502: mknod d5/db/d23/ca5 0 2024-04-25T17:19:12.489 INFO:tasks.workunit.client.0.smithi037.stdout:8/503: dread d5/db/d18/d3b/d50/d51/f57 [0,4194304] 0 2024-04-25T17:19:12.489 INFO:tasks.workunit.client.1.smithi069.stdout:6/332: readlink d2/d1e/d3f/l5c 0 2024-04-25T17:19:12.489 INFO:tasks.workunit.client.1.smithi069.stdout:2/320: link d0/d1/d5b/d28/d31/c55 d0/d56/c68 0 2024-04-25T17:19:12.489 INFO:tasks.workunit.client.1.smithi069.stdout:2/321: write d0/d26/d10/f49 [1233971,72175] 0 2024-04-25T17:19:12.489 INFO:tasks.workunit.client.1.smithi069.stdout:2/322: read d0/d1/d5b/d28/d31/f38 [117629,126393] 0 2024-04-25T17:19:12.489 INFO:tasks.workunit.client.1.smithi069.stdout:5/368: creat d13/d17/d29/d30/d55/f7b x:0 0 0 2024-04-25T17:19:12.489 INFO:tasks.workunit.client.1.smithi069.stdout:5/369: readlink d13/d17/d19/d20/d2d/l65 0 2024-04-25T17:19:12.490 INFO:tasks.workunit.client.1.smithi069.stdout:2/323: unlink d0/d1/d5b/f29 0 2024-04-25T17:19:12.490 INFO:tasks.workunit.client.1.smithi069.stdout:1/366: dwrite d1/d43/f3a [0,4194304] 0 2024-04-25T17:19:12.490 INFO:tasks.workunit.client.1.smithi069.stdout:3/446: mkdir d8/d16/d1a/d2c/d6c/d9c 0 2024-04-25T17:19:12.490 INFO:tasks.workunit.client.1.smithi069.stdout:3/447: write d8/f37 [3608201,70603] 0 2024-04-25T17:19:12.490 INFO:tasks.workunit.client.1.smithi069.stdout:0/295: rename d0/d17/f46 to d0/da/db/d3a/f6c 0 2024-04-25T17:19:12.490 INFO:tasks.workunit.client.1.smithi069.stdout:0/296: stat d0/da/db/d1d/d27/f45 0 2024-04-25T17:19:12.490 INFO:tasks.workunit.client.1.smithi069.stdout:0/297: dwrite d0/f1 [0,4194304] 0 2024-04-25T17:19:12.490 INFO:tasks.workunit.client.1.smithi069.stdout:1/367: fdatasync d1/d4/de/d44/f5c 0 2024-04-25T17:19:12.490 INFO:tasks.workunit.client.1.smithi069.stdout:5/370: creat d13/d17/d19/d1c/d6c/f7c x:0 0 0 2024-04-25T17:19:12.490 INFO:tasks.workunit.client.1.smithi069.stdout:6/333: rename d2/c42 to d2/d1e/d43/c6d 0 2024-04-25T17:19:12.490 INFO:tasks.workunit.client.1.smithi069.stdout:6/334: dread d2/d1e/f6a [0,4194304] 0 2024-04-25T17:19:12.490 INFO:tasks.workunit.client.1.smithi069.stdout:4/355: getdents db/d22 0 2024-04-25T17:19:12.490 INFO:tasks.workunit.client.1.smithi069.stdout:6/335: stat d2/d1e/d43/f57 0 2024-04-25T17:19:12.490 INFO:tasks.workunit.client.1.smithi069.stdout:6/336: readlink d2/d2e/l65 0 2024-04-25T17:19:12.491 INFO:tasks.workunit.client.0.smithi037.stdout:8/504: dread d5/d6a/f71 [0,4194304] 0 2024-04-25T17:19:12.491 INFO:tasks.workunit.client.1.smithi069.stdout:0/298: creat d0/da/d24/f6d x:0 0 0 2024-04-25T17:19:12.491 INFO:tasks.workunit.client.1.smithi069.stdout:2/324: creat d0/d56/d5f/d62/f69 x:0 0 0 2024-04-25T17:19:12.492 INFO:tasks.workunit.client.0.smithi037.stdout:5/598: write d7/d12/d6f/d68/faf [66686,68529] 0 2024-04-25T17:19:12.492 INFO:tasks.workunit.client.1.smithi069.stdout:1/368: chown d1/d43/d1b/d32/c67 79102 1 2024-04-25T17:19:12.493 INFO:tasks.workunit.client.1.smithi069.stdout:1/369: chown d1/d43/d5f 0 1 2024-04-25T17:19:12.494 INFO:tasks.workunit.client.0.smithi037.stdout:2/536: write d0/d15/f48 [1240264,125653] 0 2024-04-25T17:19:12.494 INFO:tasks.workunit.client.1.smithi069.stdout:5/371: symlink d13/d17/l7d 0 2024-04-25T17:19:12.496 INFO:tasks.workunit.client.1.smithi069.stdout:3/448: mknod d8/d16/c9d 0 2024-04-25T17:19:12.496 INFO:tasks.workunit.client.1.smithi069.stdout:4/356: mknod db/d15/d20/d38/c7e 0 2024-04-25T17:19:12.497 INFO:tasks.workunit.client.1.smithi069.stdout:4/357: fsync db/d15/d26/f62 0 2024-04-25T17:19:12.497 INFO:tasks.workunit.client.1.smithi069.stdout:6/337: symlink d2/d51/l6e 0 2024-04-25T17:19:12.499 INFO:tasks.workunit.client.0.smithi037.stdout:3/386: mknod d8/d31/d32/c78 0 2024-04-25T17:19:12.500 INFO:tasks.workunit.client.1.smithi069.stdout:2/325: creat d0/d1/d5b/d28/d31/f6a x:0 0 0 2024-04-25T17:19:12.501 INFO:tasks.workunit.client.1.smithi069.stdout:1/370: rename d1/df/d17/f2d to d1/df/d17/f70 0 2024-04-25T17:19:12.502 INFO:tasks.workunit.client.0.smithi037.stdout:9/655: symlink d1/le1 0 2024-04-25T17:19:12.504 INFO:tasks.workunit.client.1.smithi069.stdout:5/372: rename d13/d17/d19/d1c/c64 to d13/c7e 0 2024-04-25T17:19:12.505 INFO:tasks.workunit.client.1.smithi069.stdout:3/449: mkdir d8/d16/d4b/d9e 0 2024-04-25T17:19:12.507 INFO:tasks.workunit.client.1.smithi069.stdout:3/450: dread d8/f18 [0,4194304] 0 2024-04-25T17:19:12.507 INFO:tasks.workunit.client.0.smithi037.stdout:4/719: symlink d7/d7e/d1e/dd1/le9 0 2024-04-25T17:19:12.508 INFO:tasks.workunit.client.1.smithi069.stdout:6/338: creat d2/d2e/f6f x:0 0 0 2024-04-25T17:19:12.509 INFO:tasks.workunit.client.1.smithi069.stdout:4/358: mkdir db/d15/d42/d64/d7f 0 2024-04-25T17:19:12.509 INFO:tasks.workunit.client.0.smithi037.stdout:4/720: write d7/d7e/d1e/d2b/d35/d39/fb8 [1646953,40719] 0 2024-04-25T17:19:12.510 INFO:tasks.workunit.client.1.smithi069.stdout:0/299: mkdir d0/da/d6e 0 2024-04-25T17:19:12.513 INFO:tasks.workunit.client.1.smithi069.stdout:5/373: creat d13/d17/f7f x:0 0 0 2024-04-25T17:19:12.513 INFO:tasks.workunit.client.0.smithi037.stdout:0/592: creat d9/fc5 x:0 0 0 2024-04-25T17:19:12.514 INFO:tasks.workunit.client.0.smithi037.stdout:0/593: chown d9/d14/d28/d48/d58/fac 0 1 2024-04-25T17:19:12.515 INFO:tasks.workunit.client.1.smithi069.stdout:0/300: dwrite d0/d38/f49 [0,4194304] 0 2024-04-25T17:19:12.522 INFO:tasks.workunit.client.1.smithi069.stdout:6/339: rename d2/d2e/f41 to d2/d1e/d43/f70 0 2024-04-25T17:19:12.522 INFO:tasks.workunit.client.1.smithi069.stdout:6/340: stat d2/l1b 0 2024-04-25T17:19:12.522 INFO:tasks.workunit.client.1.smithi069.stdout:6/341: write d2/f9 [1636837,26089] 0 2024-04-25T17:19:12.523 INFO:tasks.workunit.client.1.smithi069.stdout:6/342: chown d2/d2e/d35/f4b 5590 1 2024-04-25T17:19:12.524 INFO:tasks.workunit.client.1.smithi069.stdout:4/359: creat db/d15/d42/d64/f80 x:0 0 0 2024-04-25T17:19:12.525 INFO:tasks.workunit.client.1.smithi069.stdout:4/360: fsync db/d15/d20/d38/f6a 0 2024-04-25T17:19:12.525 INFO:tasks.workunit.client.1.smithi069.stdout:4/361: truncate f7 522323 0 2024-04-25T17:19:12.527 INFO:tasks.workunit.client.0.smithi037.stdout:1/560: link dc/d52/d6b/fb3 dc/d1c/d57/d4d/d6a/d86/d9b/fc0 0 2024-04-25T17:19:12.531 INFO:tasks.workunit.client.1.smithi069.stdout:5/374: creat d13/f80 x:0 0 0 2024-04-25T17:19:12.532 INFO:tasks.workunit.client.1.smithi069.stdout:3/451: symlink d8/d16/d1a/d2c/l9f 0 2024-04-25T17:19:12.534 INFO:tasks.workunit.client.1.smithi069.stdout:5/375: write d13/d17/d29/d30/d5c/f48 [990920,75025] 0 2024-04-25T17:19:12.534 INFO:tasks.workunit.client.1.smithi069.stdout:2/326: dwrite d0/d26/f2b [0,4194304] 0 2024-04-25T17:19:12.537 INFO:tasks.workunit.client.1.smithi069.stdout:0/301: rename d0/da/db/d1d/f41 to d0/da/db/d1d/f6f 0 2024-04-25T17:19:12.537 INFO:tasks.workunit.client.1.smithi069.stdout:2/327: fsync d0/f57 0 2024-04-25T17:19:12.540 INFO:tasks.workunit.client.0.smithi037.stdout:2/537: rename d0/d16/d26/d3e to d0/d23/dac 0 2024-04-25T17:19:12.542 INFO:tasks.workunit.client.1.smithi069.stdout:6/343: creat d2/d1e/f71 x:0 0 0 2024-04-25T17:19:12.543 INFO:tasks.workunit.client.0.smithi037.stdout:9/656: dwrite d1/d5/dc/d38/d8b/f95 [0,4194304] 0 2024-04-25T17:19:12.543 INFO:tasks.workunit.client.1.smithi069.stdout:6/344: write d2/d1e/f71 [676802,86256] 0 2024-04-25T17:19:12.545 INFO:tasks.workunit.client.0.smithi037.stdout:3/387: creat d8/f79 x:0 0 0 2024-04-25T17:19:12.545 INFO:tasks.workunit.client.0.smithi037.stdout:2/538: write d0/d15/d2a/d5a/fa3 [667727,55680] 0 2024-04-25T17:19:12.552 INFO:tasks.workunit.client.0.smithi037.stdout:1/561: mknod dc/d1c/d57/d22/d36/d8c/cc1 0 2024-04-25T17:19:12.553 INFO:tasks.workunit.client.1.smithi069.stdout:3/452: fsync d8/d2a/f55 0 2024-04-25T17:19:12.553 INFO:tasks.workunit.client.0.smithi037.stdout:2/539: dwrite d0/d23/f43 [0,4194304] 0 2024-04-25T17:19:12.558 INFO:tasks.workunit.client.0.smithi037.stdout:0/594: rename d9/d14/d28/f5b to d9/d71/dad/d7a/daf/fc6 0 2024-04-25T17:19:12.560 INFO:tasks.workunit.client.1.smithi069.stdout:5/376: mknod d13/d17/d19/d1c/c81 0 2024-04-25T17:19:12.564 INFO:tasks.workunit.client.0.smithi037.stdout:0/595: dwrite f2 [0,4194304] 0 2024-04-25T17:19:12.566 INFO:tasks.workunit.client.1.smithi069.stdout:0/302: dread d0/da/d24/f42 [0,4194304] 0 2024-04-25T17:19:12.569 INFO:tasks.workunit.client.0.smithi037.stdout:5/599: link d7/l93 d7/d43/d9f/lb7 0 2024-04-25T17:19:12.571 INFO:tasks.workunit.client.1.smithi069.stdout:3/453: chown d8/d16/d1a/d3e/d42/l60 809 1 2024-04-25T17:19:12.572 INFO:tasks.workunit.client.1.smithi069.stdout:5/377: symlink d13/d17/l82 0 2024-04-25T17:19:12.577 INFO:tasks.workunit.client.0.smithi037.stdout:1/562: rename dc/d18/d66/f77 to dc/d1c/d57/d22/d36/d92/db8/fc2 0 2024-04-25T17:19:12.578 INFO:tasks.workunit.client.0.smithi037.stdout:9/657: write d1/d5/dc/f11 [1438929,28020] 0 2024-04-25T17:19:12.578 INFO:tasks.workunit.client.1.smithi069.stdout:5/378: dwrite d13/d17/f1d [0,4194304] 0 2024-04-25T17:19:12.580 INFO:tasks.workunit.client.0.smithi037.stdout:9/658: dread - d1/d5/dc/d38/d8b/fd3 zero size 2024-04-25T17:19:12.580 INFO:tasks.workunit.client.1.smithi069.stdout:5/379: write d13/d17/d19/d20/d2d/f56 [239326,44066] 0 2024-04-25T17:19:12.581 INFO:tasks.workunit.client.1.smithi069.stdout:0/303: dread d0/f4 [0,4194304] 0 2024-04-25T17:19:12.581 INFO:tasks.workunit.client.1.smithi069.stdout:3/454: rename d8/d16/c2d to d8/d8b/ca0 0 2024-04-25T17:19:12.582 INFO:tasks.workunit.client.1.smithi069.stdout:0/304: chown d0/da/db/d1d/d5f 7071 1 2024-04-25T17:19:12.585 INFO:tasks.workunit.client.0.smithi037.stdout:5/600: write d7/d12/d5d/f80 [724966,113267] 0 2024-04-25T17:19:12.588 INFO:tasks.workunit.client.0.smithi037.stdout:1/563: dwrite dc/d1c/d57/d22/d36/d74/da6/fb7 [0,4194304] 0 2024-04-25T17:19:12.588 INFO:tasks.workunit.client.1.smithi069.stdout:3/455: dwrite d8/d16/d1a/d3e/f6f [0,4194304] 0 2024-04-25T17:19:12.589 INFO:tasks.workunit.client.1.smithi069.stdout:3/456: write d8/d16/f28 [1431812,123309] 0 2024-04-25T17:19:12.590 INFO:tasks.workunit.client.1.smithi069.stdout:5/380: creat d13/d17/d29/d2e/f83 x:0 0 0 2024-04-25T17:19:12.592 INFO:tasks.workunit.client.0.smithi037.stdout:0/596: rename d9/d14/d28/d48/d58/l85 to d9/d14/d23/lc7 0 2024-04-25T17:19:12.597 INFO:tasks.workunit.client.1.smithi069.stdout:2/328: getdents d0/d1/d5b/d33 0 2024-04-25T17:19:12.598 INFO:tasks.workunit.client.1.smithi069.stdout:2/329: write d0/d56/d5f/d62/f69 [486983,40658] 0 2024-04-25T17:19:12.600 INFO:tasks.workunit.client.0.smithi037.stdout:2/540: creat d0/d16/fad x:0 0 0 2024-04-25T17:19:12.601 INFO:tasks.workunit.client.1.smithi069.stdout:3/457: readlink d8/d16/d1a/l69 0 2024-04-25T17:19:12.603 INFO:tasks.workunit.client.0.smithi037.stdout:0/597: mknod d9/d14/d28/d48/d58/cc8 0 2024-04-25T17:19:12.605 INFO:tasks.workunit.client.0.smithi037.stdout:9/659: rename d1/d5/d2e/d34/d76/cb5 to d1/d48/d68/d4e/ce2 0 2024-04-25T17:19:12.606 INFO:tasks.workunit.client.0.smithi037.stdout:3/388: getdents d8/d23/d3a/d63 0 2024-04-25T17:19:12.607 INFO:tasks.workunit.client.0.smithi037.stdout:1/564: dread dc/d24/f45 [0,4194304] 0 2024-04-25T17:19:12.607 INFO:tasks.workunit.client.1.smithi069.stdout:2/330: dread d0/d1/d5b/d28/d31/f38 [0,4194304] 0 2024-04-25T17:19:12.607 INFO:tasks.workunit.client.1.smithi069.stdout:3/458: truncate d8/d16/d1a/d2c/f45 326915 0 2024-04-25T17:19:12.608 INFO:tasks.workunit.client.0.smithi037.stdout:1/565: chown dc/d52/c7a 24736161 1 2024-04-25T17:19:12.608 INFO:tasks.workunit.client.1.smithi069.stdout:5/381: dread d13/d17/d19/d20/f77 [0,4194304] 0 2024-04-25T17:19:12.610 INFO:tasks.workunit.client.0.smithi037.stdout:0/598: creat d9/d71/dad/d7a/fc9 x:0 0 0 2024-04-25T17:19:12.611 INFO:tasks.workunit.client.1.smithi069.stdout:0/305: getdents d0/da/db/d2a 0 2024-04-25T17:19:12.614 INFO:tasks.workunit.client.0.smithi037.stdout:2/541: mkdir d0/d23/d7d/dae 0 2024-04-25T17:19:12.616 INFO:tasks.workunit.client.0.smithi037.stdout:1/566: dwrite dc/d1c/d57/d22/d36/f4c [8388608,4194304] 0 2024-04-25T17:19:12.616 INFO:tasks.workunit.client.1.smithi069.stdout:2/331: creat d0/d1/d5b/d28/d31/f6b x:0 0 0 2024-04-25T17:19:12.617 INFO:tasks.workunit.client.0.smithi037.stdout:1/567: chown dc/d1c/d57/d22/d36/d8c/fa2 2659447 1 2024-04-25T17:19:12.619 INFO:tasks.workunit.client.0.smithi037.stdout:9/660: symlink d1/d48/d68/d26/da1/db0/le3 0 2024-04-25T17:19:12.619 INFO:tasks.workunit.client.0.smithi037.stdout:1/568: rename dc/d1c to dc/d1c/d57/d22/d36/d74/da6/dc3 22 2024-04-25T17:19:12.620 INFO:tasks.workunit.client.1.smithi069.stdout:3/459: dwrite d8/d16/d1a/f4f [0,4194304] 0 2024-04-25T17:19:12.621 INFO:tasks.workunit.client.1.smithi069.stdout:5/382: chown d13/d17/d29/d2e/l6e 49 1 2024-04-25T17:19:12.621 INFO:tasks.workunit.client.0.smithi037.stdout:1/569: dread - dc/d1c/d57/d22/d36/d8c/fa2 zero size 2024-04-25T17:19:12.622 INFO:tasks.workunit.client.1.smithi069.stdout:5/383: fsync d13/d17/f33 0 2024-04-25T17:19:12.622 INFO:tasks.workunit.client.1.smithi069.stdout:5/384: chown d13 9553 1 2024-04-25T17:19:12.624 INFO:tasks.workunit.client.1.smithi069.stdout:0/306: mkdir d0/d38/d70 0 2024-04-25T17:19:12.627 INFO:tasks.workunit.client.0.smithi037.stdout:2/542: mknod d0/d7c/caf 0 2024-04-25T17:19:12.629 INFO:tasks.workunit.client.0.smithi037.stdout:5/601: dread d7/d25/d4f/f34 [0,4194304] 0 2024-04-25T17:19:12.632 INFO:tasks.workunit.client.1.smithi069.stdout:2/332: creat d0/d1/d5b/d28/d31/f6c x:0 0 0 2024-04-25T17:19:12.633 INFO:tasks.workunit.client.1.smithi069.stdout:2/333: write d0/f17 [6590949,61521] 0 2024-04-25T17:19:12.635 INFO:tasks.workunit.client.0.smithi037.stdout:1/570: creat dc/d1c/d57/d22/d36/d92/fc4 x:0 0 0 2024-04-25T17:19:12.636 INFO:tasks.workunit.client.1.smithi069.stdout:3/460: creat d8/d16/d31/fa1 x:0 0 0 2024-04-25T17:19:12.636 INFO:tasks.workunit.client.1.smithi069.stdout:0/307: dread - d0/da/db/d2c/f33 zero size 2024-04-25T17:19:12.637 INFO:tasks.workunit.client.0.smithi037.stdout:2/543: unlink d0/d15/c67 0 2024-04-25T17:19:12.638 INFO:tasks.workunit.client.1.smithi069.stdout:0/308: write d0/da/db/d3a/f5a [453074,19748] 0 2024-04-25T17:19:12.638 INFO:tasks.workunit.client.1.smithi069.stdout:2/334: stat d0/d26/d10/c6 0 2024-04-25T17:19:12.641 INFO:tasks.workunit.client.0.smithi037.stdout:9/661: fsync d1/d5/dc/da9/fb1 0 2024-04-25T17:19:12.645 INFO:tasks.workunit.client.0.smithi037.stdout:3/389: getdents d8/d31 0 2024-04-25T17:19:12.647 INFO:tasks.workunit.client.0.smithi037.stdout:0/599: dread d9/d71/f8e [0,4194304] 0 2024-04-25T17:19:12.652 INFO:tasks.workunit.client.1.smithi069.stdout:3/461: dwrite d8/d16/d1a/d38/f88 [0,4194304] 0 2024-04-25T17:19:12.654 INFO:tasks.workunit.client.1.smithi069.stdout:0/309: truncate d0/f6 1400891 0 2024-04-25T17:19:12.655 INFO:tasks.workunit.client.1.smithi069.stdout:2/335: dread d0/d26/d10/f5c [0,4194304] 0 2024-04-25T17:19:12.655 INFO:tasks.workunit.client.1.smithi069.stdout:0/310: chown d0/d17/d40/c48 639 1 2024-04-25T17:19:12.656 INFO:tasks.workunit.client.0.smithi037.stdout:9/662: creat d1/d5/d19/dde/fe4 x:0 0 0 2024-04-25T17:19:12.659 INFO:tasks.workunit.client.1.smithi069.stdout:9/392: sync 2024-04-25T17:19:12.659 INFO:tasks.workunit.client.1.smithi069.stdout:8/304: sync 2024-04-25T17:19:12.659 INFO:tasks.workunit.client.1.smithi069.stdout:7/368: sync 2024-04-25T17:19:12.659 INFO:tasks.workunit.client.0.smithi037.stdout:1/571: creat dc/d1c/d57/d4d/d6a/d8f/fc5 x:0 0 0 2024-04-25T17:19:12.665 INFO:tasks.workunit.client.0.smithi037.stdout:5/602: creat d7/d12/d6f/fb8 x:0 0 0 2024-04-25T17:19:12.665 INFO:tasks.workunit.client.0.smithi037.stdout:2/544: dwrite d0/f9 [0,4194304] 0 2024-04-25T17:19:12.666 INFO:tasks.workunit.client.0.smithi037.stdout:2/545: stat d0/d16/d20/d55/f6f 0 2024-04-25T17:19:12.666 INFO:tasks.workunit.client.0.smithi037.stdout:2/546: stat d0/d16/d26/d9e/da9 0 2024-04-25T17:19:12.668 INFO:tasks.workunit.client.1.smithi069.stdout:8/305: chown d37/l56 1961 1 2024-04-25T17:19:12.669 INFO:tasks.workunit.client.0.smithi037.stdout:1/572: creat dc/d1c/d57/d22/d36/d92/fc6 x:0 0 0 2024-04-25T17:19:12.670 INFO:tasks.workunit.client.1.smithi069.stdout:9/393: creat d2/da/d5f/d76/f8e x:0 0 0 2024-04-25T17:19:12.671 INFO:tasks.workunit.client.0.smithi037.stdout:9/663: mknod d1/d5/d2e/d34/ce5 0 2024-04-25T17:19:12.673 INFO:tasks.workunit.client.1.smithi069.stdout:7/369: dread d4/f6a [0,4194304] 0 2024-04-25T17:19:12.674 INFO:tasks.workunit.client.1.smithi069.stdout:0/311: symlink d0/d38/d70/l71 0 2024-04-25T17:19:12.675 INFO:tasks.workunit.client.1.smithi069.stdout:0/312: chown d0/da/db/d2c 61 1 2024-04-25T17:19:12.675 INFO:tasks.workunit.client.1.smithi069.stdout:0/313: fdatasync d0/d17/d40/f68 0 2024-04-25T17:19:12.677 INFO:tasks.workunit.client.1.smithi069.stdout:2/336: rename d0/d1/l2a to d0/d26/d10/d43/l6d 0 2024-04-25T17:19:12.678 INFO:tasks.workunit.client.0.smithi037.stdout:3/390: truncate d8/ff 440510 0 2024-04-25T17:19:12.678 INFO:tasks.workunit.client.1.smithi069.stdout:2/337: truncate d0/d1/d5b/d28/d31/f48 964653 0 2024-04-25T17:19:12.680 INFO:tasks.workunit.client.0.smithi037.stdout:9/664: write d1/d48/d68/d26/f80 [2013769,115149] 0 2024-04-25T17:19:12.681 INFO:tasks.workunit.client.0.smithi037.stdout:3/391: write d8/d57/f5e [446963,2908] 0 2024-04-25T17:19:12.681 INFO:tasks.workunit.client.1.smithi069.stdout:9/394: mkdir d2/da/dd/d1e/d2e/d68/d8f 0 2024-04-25T17:19:12.681 INFO:tasks.workunit.client.0.smithi037.stdout:2/547: dwrite d0/d15/f1d [0,4194304] 0 2024-04-25T17:19:12.682 INFO:tasks.workunit.client.0.smithi037.stdout:3/392: dread - d8/d31/f48 zero size 2024-04-25T17:19:12.685 INFO:tasks.workunit.client.1.smithi069.stdout:3/462: creat d8/d16/d1a/d2c/d49/fa2 x:0 0 0 2024-04-25T17:19:12.690 INFO:tasks.workunit.client.0.smithi037.stdout:2/548: mkdir d0/d16/d3b/db0 0 2024-04-25T17:19:12.695 INFO:tasks.workunit.client.1.smithi069.stdout:2/338: unlink d0/l58 0 2024-04-25T17:19:12.695 INFO:tasks.workunit.client.1.smithi069.stdout:2/339: chown d0/d56/d5f 120 1 2024-04-25T17:19:12.696 INFO:tasks.workunit.client.1.smithi069.stdout:2/340: read - d0/f53 zero size 2024-04-25T17:19:12.697 INFO:tasks.workunit.client.1.smithi069.stdout:8/306: creat d37/d47/d54/f68 x:0 0 0 2024-04-25T17:19:12.698 INFO:tasks.workunit.client.0.smithi037.stdout:5/603: getdents d7/d12/d6f/d94 0 2024-04-25T17:19:12.698 INFO:tasks.workunit.client.0.smithi037.stdout:5/604: chown d7/f75 6058536 1 2024-04-25T17:19:12.699 INFO:tasks.workunit.client.0.smithi037.stdout:5/605: fsync d7/d12/d5d/f80 0 2024-04-25T17:19:12.700 INFO:tasks.workunit.client.0.smithi037.stdout:1/573: rename dc/d1c/d57/d22/d36/d92/fc6 to dc/d18/fc7 0 2024-04-25T17:19:12.702 INFO:tasks.workunit.client.1.smithi069.stdout:3/463: rename d8/d39/f5e to d8/d16/d1a/d3e/fa3 0 2024-04-25T17:19:12.702 INFO:tasks.workunit.client.1.smithi069.stdout:3/464: readlink d8/d16/d1a/d3e/d42/l60 0 2024-04-25T17:19:12.703 INFO:tasks.workunit.client.0.smithi037.stdout:2/549: mknod d0/d16/d20/d55/cb1 0 2024-04-25T17:19:12.704 INFO:tasks.workunit.client.1.smithi069.stdout:7/370: mknod d4/d6/d14/d44/c76 0 2024-04-25T17:19:12.704 INFO:tasks.workunit.client.1.smithi069.stdout:7/371: fdatasync d4/d1a/d34/f65 0 2024-04-25T17:19:12.705 INFO:tasks.workunit.client.1.smithi069.stdout:7/372: fsync d4/d3e/f41 0 2024-04-25T17:19:12.711 INFO:tasks.workunit.client.1.smithi069.stdout:9/395: dwrite d2/da/f13 [0,4194304] 0 2024-04-25T17:19:12.712 INFO:tasks.workunit.client.1.smithi069.stdout:9/396: fdatasync d2/da/dd/d1e/d2e/f47 0 2024-04-25T17:19:12.712 INFO:tasks.workunit.client.0.smithi037.stdout:1/574: dread dc/d18/d66/f90 [0,4194304] 0 2024-04-25T17:19:12.712 INFO:tasks.workunit.client.0.smithi037.stdout:2/550: rmdir d0/d16/d20 39 2024-04-25T17:19:12.714 INFO:tasks.workunit.client.1.smithi069.stdout:9/397: read d2/da/dd/d1e/d40/f5c [38516,18226] 0 2024-04-25T17:19:12.714 INFO:tasks.workunit.client.1.smithi069.stdout:3/465: symlink d8/d39/la4 0 2024-04-25T17:19:12.715 INFO:tasks.workunit.client.1.smithi069.stdout:9/398: write d2/da/d14/d23/f3b [1694491,74135] 0 2024-04-25T17:19:12.715 INFO:tasks.workunit.client.0.smithi037.stdout:9/665: truncate d1/d5/dc/f11 521623 0 2024-04-25T17:19:12.718 INFO:tasks.workunit.client.0.smithi037.stdout:9/666: write d1/d5/dc/d38/d8b/f41 [6044764,51311] 0 2024-04-25T17:19:12.722 INFO:tasks.workunit.client.0.smithi037.stdout:2/551: rename d0/d16/c89 to d0/d15/d2a/cb2 0 2024-04-25T17:19:12.723 INFO:tasks.workunit.client.0.smithi037.stdout:2/552: stat d0/d16/d3b/f47 0 2024-04-25T17:19:12.724 INFO:tasks.workunit.client.0.smithi037.stdout:2/553: chown d0/d15/d2a/d5a/fa3 151 1 2024-04-25T17:19:12.725 INFO:tasks.workunit.client.0.smithi037.stdout:2/554: stat d0/d16/d3c/c7e 0 2024-04-25T17:19:12.725 INFO:tasks.workunit.client.0.smithi037.stdout:3/393: getdents d8/d4c 0 2024-04-25T17:19:12.729 INFO:tasks.workunit.client.0.smithi037.stdout:1/575: rename dc/d1c/d57/d4d/d6a/d86/fad to dc/d1c/d57/d22/d36/d92/fc8 0 2024-04-25T17:19:12.730 INFO:tasks.workunit.client.1.smithi069.stdout:8/307: symlink d37/d47/l69 0 2024-04-25T17:19:12.732 INFO:tasks.workunit.client.0.smithi037.stdout:2/555: fsync d0/d16/d20/d55/f60 0 2024-04-25T17:19:12.733 INFO:tasks.workunit.client.0.smithi037.stdout:3/394: dwrite d8/d23/d38/d66/f6f [0,4194304] 0 2024-04-25T17:19:12.733 INFO:tasks.workunit.client.0.smithi037.stdout:2/556: chown d0/f33 22 1 2024-04-25T17:19:12.738 INFO:tasks.workunit.client.0.smithi037.stdout:3/395: dread d8/d23/d38/f6b [0,4194304] 0 2024-04-25T17:19:12.738 INFO:tasks.workunit.client.1.smithi069.stdout:0/314: truncate d0/da/db/fe 1714539 0 2024-04-25T17:19:12.742 INFO:tasks.workunit.client.0.smithi037.stdout:2/557: stat d0/d15/l1a 0 2024-04-25T17:19:12.744 INFO:tasks.workunit.client.1.smithi069.stdout:8/308: dread - f2b zero size 2024-04-25T17:19:12.745 INFO:tasks.workunit.client.1.smithi069.stdout:8/309: write d37/d47/d48/f64 [265350,81245] 0 2024-04-25T17:19:12.747 INFO:tasks.workunit.client.1.smithi069.stdout:0/315: creat d0/da/d24/f72 x:0 0 0 2024-04-25T17:19:12.750 INFO:tasks.workunit.client.0.smithi037.stdout:9/667: rename d1/d5/dc/d38/d8b/c4d to d1/d5/d19/d6e/ce6 0 2024-04-25T17:19:12.750 INFO:tasks.workunit.client.1.smithi069.stdout:2/341: getdents d0/d1/d5b/d28 0 2024-04-25T17:19:12.753 INFO:tasks.workunit.client.1.smithi069.stdout:0/316: dwrite d0/d36/f2b [4194304,4194304] 0 2024-04-25T17:19:12.754 INFO:tasks.workunit.client.1.smithi069.stdout:9/399: rmdir d2/da/dd/d80 0 2024-04-25T17:19:12.757 INFO:tasks.workunit.client.1.smithi069.stdout:7/373: getdents d4 0 2024-04-25T17:19:12.760 INFO:tasks.workunit.client.1.smithi069.stdout:8/310: mknod d37/d47/c6a 0 2024-04-25T17:19:12.763 INFO:tasks.workunit.client.1.smithi069.stdout:2/342: unlink d0/d1/d5b/d28/f3c 0 2024-04-25T17:19:12.766 INFO:tasks.workunit.client.1.smithi069.stdout:2/343: write d0/d1/d5b/d28/d31/f6a [152860,33923] 0 2024-04-25T17:19:12.766 INFO:tasks.workunit.client.1.smithi069.stdout:8/311: dwrite d37/d47/d48/f64 [0,4194304] 0 2024-04-25T17:19:12.767 INFO:tasks.workunit.client.1.smithi069.stdout:2/344: chown d0/d56/d5f/d62 36527 1 2024-04-25T17:19:12.781 INFO:tasks.workunit.client.1.smithi069.stdout:0/317: rename d0/d38/d70 to d0/da/db/d73 0 2024-04-25T17:19:12.786 INFO:tasks.workunit.client.1.smithi069.stdout:7/374: link l0 d4/d3e/l77 0 2024-04-25T17:19:12.787 INFO:tasks.workunit.client.1.smithi069.stdout:8/312: rename d37/d61 to d37/d66/d6b 0 2024-04-25T17:19:12.789 INFO:tasks.workunit.client.1.smithi069.stdout:9/400: link d2/da/dd/de/d74/f78 d2/da/dd/f90 0 2024-04-25T17:19:12.790 INFO:tasks.workunit.client.1.smithi069.stdout:2/345: creat d0/d1/d5b/f6e x:0 0 0 2024-04-25T17:19:12.791 INFO:tasks.workunit.client.0.smithi037.stdout:1/576: rename dc/d1c/d57/d43/ca9 to dc/d1c/d57/d22/d36/d92/db8/dbc/cc9 0 2024-04-25T17:19:12.792 INFO:tasks.workunit.client.0.smithi037.stdout:9/668: mknod d1/d5/d2e/d34/d76/ce7 0 2024-04-25T17:19:12.792 INFO:tasks.workunit.client.0.smithi037.stdout:1/577: dread - dc/d1c/d57/d22/fa3 zero size 2024-04-25T17:19:12.793 INFO:tasks.workunit.client.0.smithi037.stdout:2/558: creat d0/d15/fb3 x:0 0 0 2024-04-25T17:19:12.793 INFO:tasks.workunit.client.0.smithi037.stdout:9/669: fsync d1/d5/d19/d6e/f79 0 2024-04-25T17:19:12.795 INFO:tasks.workunit.client.1.smithi069.stdout:7/375: rename d4/d18/d3f/f71 to d4/d6/d14/d5a/f78 0 2024-04-25T17:19:12.798 INFO:tasks.workunit.client.1.smithi069.stdout:2/346: unlink d0/d26/f18 0 2024-04-25T17:19:12.799 INFO:tasks.workunit.client.1.smithi069.stdout:2/347: write d0/f44 [491546,88918] 0 2024-04-25T17:19:12.800 INFO:tasks.workunit.client.0.smithi037.stdout:2/559: chown d0/d23/f28 21644 1 2024-04-25T17:19:12.800 INFO:tasks.workunit.client.1.smithi069.stdout:2/348: fdatasync d0/d56/f5e 0 2024-04-25T17:19:12.800 INFO:tasks.workunit.client.1.smithi069.stdout:2/349: dread - d0/d1/d5b/f6e zero size 2024-04-25T17:19:12.801 INFO:tasks.workunit.client.1.smithi069.stdout:8/313: symlink d37/l6c 0 2024-04-25T17:19:12.802 INFO:tasks.workunit.client.1.smithi069.stdout:2/350: chown d0/d26/d10/d43/f4b 1747552 1 2024-04-25T17:19:12.803 INFO:tasks.workunit.client.0.smithi037.stdout:2/560: dread d0/d15/d2a/d5a/fa3 [0,4194304] 0 2024-04-25T17:19:12.809 INFO:tasks.workunit.client.1.smithi069.stdout:8/314: dwrite f34 [4194304,4194304] 0 2024-04-25T17:19:12.810 INFO:tasks.workunit.client.1.smithi069.stdout:8/315: chown d37/d62 6568 1 2024-04-25T17:19:12.811 INFO:tasks.workunit.client.1.smithi069.stdout:2/351: creat d0/d56/f6f x:0 0 0 2024-04-25T17:19:12.813 INFO:tasks.workunit.client.1.smithi069.stdout:2/352: read d0/d1/f20 [639270,85515] 0 2024-04-25T17:19:12.814 INFO:tasks.workunit.client.0.smithi037.stdout:9/670: getdents d1/d5/dc/d3c 0 2024-04-25T17:19:12.822 INFO:tasks.workunit.client.0.smithi037.stdout:9/671: mkdir d1/d48/d68/d1c/de8 0 2024-04-25T17:19:12.823 INFO:tasks.workunit.client.0.smithi037.stdout:2/561: truncate d0/d15/f81 902046 0 2024-04-25T17:19:12.828 INFO:tasks.workunit.client.0.smithi037.stdout:2/562: dread d0/d23/dac/f87 [0,4194304] 0 2024-04-25T17:19:12.829 INFO:tasks.workunit.client.0.smithi037.stdout:9/672: dwrite d1/d48/d68/d26/d81/d9c/da4/fc1 [0,4194304] 0 2024-04-25T17:19:12.834 INFO:tasks.workunit.client.1.smithi069.stdout:0/318: link d0/da/db/d1d/d27/f45 d0/da/db/d2c/f74 0 2024-04-25T17:19:12.837 INFO:tasks.workunit.client.1.smithi069.stdout:7/376: rename d4/d6/d14/d15/d3c to d4/d6/d14/d44/d79 0 2024-04-25T17:19:12.838 INFO:tasks.workunit.client.1.smithi069.stdout:7/377: chown d4/d6/d14/d15/f17 34 1 2024-04-25T17:19:12.839 INFO:tasks.workunit.client.0.smithi037.stdout:9/673: mknod d1/d5/dc/d3c/dca/ce9 0 2024-04-25T17:19:12.840 INFO:tasks.workunit.client.1.smithi069.stdout:8/316: creat d37/d62/f6d x:0 0 0 2024-04-25T17:19:12.841 INFO:tasks.workunit.client.0.smithi037.stdout:1/578: dwrite dc/d24/f45 [0,4194304] 0 2024-04-25T17:19:12.843 INFO:tasks.workunit.client.0.smithi037.stdout:2/563: symlink d0/d16/d20/d55/da0/lb4 0 2024-04-25T17:19:12.845 INFO:tasks.workunit.client.1.smithi069.stdout:2/353: mknod d0/d56/c70 0 2024-04-25T17:19:12.851 INFO:tasks.workunit.client.1.smithi069.stdout:7/378: rename d4/d6/d14/d5a/d5e/f60 to d4/d6/d14/d5a/d5e/f7a 0 2024-04-25T17:19:12.851 INFO:tasks.workunit.client.0.smithi037.stdout:2/564: creat d0/d23/dac/d4b/fb5 x:0 0 0 2024-04-25T17:19:12.852 INFO:tasks.workunit.client.1.smithi069.stdout:8/317: rmdir d37 39 2024-04-25T17:19:12.857 INFO:tasks.workunit.client.1.smithi069.stdout:0/319: rmdir d0/da/db/d3a 39 2024-04-25T17:19:12.863 INFO:tasks.workunit.client.1.smithi069.stdout:0/320: dwrite d0/da/db/d2c/f33 [0,4194304] 0 2024-04-25T17:19:12.863 INFO:tasks.workunit.client.1.smithi069.stdout:7/379: link d4/d6/d14/d5a/f6c d4/d6/d14/d5a/f7b 0 2024-04-25T17:19:12.866 INFO:tasks.workunit.client.1.smithi069.stdout:6/345: sync 2024-04-25T17:19:12.866 INFO:tasks.workunit.client.1.smithi069.stdout:4/362: sync 2024-04-25T17:19:12.866 INFO:tasks.workunit.client.1.smithi069.stdout:1/371: sync 2024-04-25T17:19:12.866 INFO:tasks.workunit.client.1.smithi069.stdout:5/385: sync 2024-04-25T17:19:12.867 INFO:tasks.workunit.client.0.smithi037.stdout:2/565: creat d0/d15/fb6 x:0 0 0 2024-04-25T17:19:12.868 INFO:tasks.workunit.client.1.smithi069.stdout:4/363: write f5 [1303028,68220] 0 2024-04-25T17:19:12.868 INFO:tasks.workunit.client.1.smithi069.stdout:1/372: dread - d1/d43/d35/f64 zero size 2024-04-25T17:19:12.869 INFO:tasks.workunit.client.1.smithi069.stdout:6/346: write d2/d1e/f32 [3184727,119623] 0 2024-04-25T17:19:12.869 INFO:tasks.workunit.client.1.smithi069.stdout:0/321: rmdir d0/da/db/d73 39 2024-04-25T17:19:12.874 INFO:tasks.workunit.client.1.smithi069.stdout:6/347: dread d2/d1e/d3e/d67/f69 [0,4194304] 0 2024-04-25T17:19:12.874 INFO:tasks.workunit.client.1.smithi069.stdout:4/364: chown db/d15/d42/d64/f67 13466602 1 2024-04-25T17:19:12.874 INFO:tasks.workunit.client.1.smithi069.stdout:1/373: chown d1/d43/d35/f14 233 1 2024-04-25T17:19:12.875 INFO:tasks.workunit.client.0.smithi037.stdout:2/566: mknod d0/d16/d20/d59/d6a/da5/cb7 0 2024-04-25T17:19:12.876 INFO:tasks.workunit.client.1.smithi069.stdout:8/318: dwrite d37/f57 [0,4194304] 0 2024-04-25T17:19:12.876 INFO:tasks.workunit.client.1.smithi069.stdout:6/348: chown d2/d1e/d3e/c4c 0 1 2024-04-25T17:19:12.876 INFO:tasks.workunit.client.1.smithi069.stdout:4/365: write db/d15/d20/d38/f6a [1338310,80220] 0 2024-04-25T17:19:12.878 INFO:tasks.workunit.client.0.smithi037.stdout:1/579: dwrite dc/d18/f38 [0,4194304] 0 2024-04-25T17:19:12.884 INFO:tasks.workunit.client.0.smithi037.stdout:1/580: read dc/d1c/d57/d4d/d6a/d86/f97 [8031221,81983] 0 2024-04-25T17:19:12.884 INFO:tasks.workunit.client.1.smithi069.stdout:5/386: dread d13/f16 [0,4194304] 0 2024-04-25T17:19:12.885 INFO:tasks.workunit.client.0.smithi037.stdout:9/674: dwrite d1/d48/d68/d26/d81/d9c/f6a [0,4194304] 0 2024-04-25T17:19:12.889 INFO:tasks.workunit.client.0.smithi037.stdout:2/567: fsync d0/d23/d7d/f62 0 2024-04-25T17:19:12.890 INFO:tasks.workunit.client.0.smithi037.stdout:2/568: stat d0/d23/d7d 0 2024-04-25T17:19:12.895 INFO:tasks.workunit.client.1.smithi069.stdout:5/387: symlink d13/d17/d29/d30/d5c/l84 0 2024-04-25T17:19:12.897 INFO:tasks.workunit.client.1.smithi069.stdout:5/388: chown d13/d17/d29/d30/l3b 30676 1 2024-04-25T17:19:12.898 INFO:tasks.workunit.client.1.smithi069.stdout:4/366: mknod db/d15/d20/d35/d63/d43/d48/d49/d72/c81 0 2024-04-25T17:19:12.900 INFO:tasks.workunit.client.1.smithi069.stdout:1/374: getdents d1/d43/d35 0 2024-04-25T17:19:12.901 INFO:tasks.workunit.client.1.smithi069.stdout:4/367: read - db/d15/d20/d35/d63/d43/d48/d49/f56 zero size 2024-04-25T17:19:12.902 INFO:tasks.workunit.client.1.smithi069.stdout:5/389: symlink d13/d17/d62/l85 0 2024-04-25T17:19:12.903 INFO:tasks.workunit.client.1.smithi069.stdout:4/368: read - db/d15/d20/d35/d63/f5c zero size 2024-04-25T17:19:12.905 INFO:tasks.workunit.client.1.smithi069.stdout:7/380: dwrite d4/d6/f2c [0,4194304] 0 2024-04-25T17:19:12.906 INFO:tasks.workunit.client.1.smithi069.stdout:1/375: link d1/d43/l36 d1/d4/l71 0 2024-04-25T17:19:12.906 INFO:tasks.workunit.client.1.smithi069.stdout:7/381: stat d4/d6/d14/d15/f63 0 2024-04-25T17:19:12.907 INFO:tasks.workunit.client.1.smithi069.stdout:4/369: mkdir db/d15/d82 0 2024-04-25T17:19:12.909 INFO:tasks.workunit.client.1.smithi069.stdout:5/390: link d13/d17/d19/d1c/d6c/f7c d13/d17/f86 0 2024-04-25T17:19:12.909 INFO:tasks.workunit.client.1.smithi069.stdout:5/391: stat d13/d17/d29/d30/d5c 0 2024-04-25T17:19:12.912 INFO:tasks.workunit.client.1.smithi069.stdout:4/370: unlink db/f14 0 2024-04-25T17:19:12.914 INFO:tasks.workunit.client.1.smithi069.stdout:1/376: mknod d1/d43/d5f/c72 0 2024-04-25T17:19:12.915 INFO:tasks.workunit.client.1.smithi069.stdout:1/377: write d1/d43/d35/f64 [636257,2189] 0 2024-04-25T17:19:12.916 INFO:tasks.workunit.client.1.smithi069.stdout:5/392: getdents d13/d17/d29/d2e/d76 0 2024-04-25T17:19:12.917 INFO:tasks.workunit.client.1.smithi069.stdout:1/378: read d1/d43/d35/d1d/f5e [431147,20425] 0 2024-04-25T17:19:12.918 INFO:tasks.workunit.client.1.smithi069.stdout:8/319: write d37/f3f [3023148,30915] 0 2024-04-25T17:19:12.920 INFO:tasks.workunit.client.1.smithi069.stdout:8/320: chown c2e 2 1 2024-04-25T17:19:12.921 INFO:tasks.workunit.client.1.smithi069.stdout:6/349: dread d2/f20 [0,4194304] 0 2024-04-25T17:19:12.923 INFO:tasks.workunit.client.1.smithi069.stdout:1/379: fdatasync d1/f5 0 2024-04-25T17:19:12.925 INFO:tasks.workunit.client.1.smithi069.stdout:5/393: rename d13/d17/d19/d20/d51/f6b to d13/d17/d29/d2e/d76/f87 0 2024-04-25T17:19:12.925 INFO:tasks.workunit.client.1.smithi069.stdout:1/380: write d1/d43/d1b/d32/d4a/f58 [1034780,52153] 0 2024-04-25T17:19:12.928 INFO:tasks.workunit.client.1.smithi069.stdout:6/350: chown d2/d51/l60 1807 1 2024-04-25T17:19:12.929 INFO:tasks.workunit.client.1.smithi069.stdout:8/321: dread f26 [0,4194304] 0 2024-04-25T17:19:12.933 INFO:tasks.workunit.client.1.smithi069.stdout:8/322: mkdir d37/d47/d54/d6e 0 2024-04-25T17:19:12.935 INFO:tasks.workunit.client.1.smithi069.stdout:6/351: symlink d2/d7/l72 0 2024-04-25T17:19:12.936 INFO:tasks.workunit.client.1.smithi069.stdout:4/371: dread db/d15/d26/f62 [0,4194304] 0 2024-04-25T17:19:12.936 INFO:tasks.workunit.client.1.smithi069.stdout:1/381: creat d1/d4/de/f73 x:0 0 0 2024-04-25T17:19:12.937 INFO:tasks.workunit.client.1.smithi069.stdout:1/382: chown d1/d4/l52 2443664 1 2024-04-25T17:19:12.938 INFO:tasks.workunit.client.0.smithi037.stdout:9/675: dwrite d1/d5/d19/d6e/fd6 [0,4194304] 0 2024-04-25T17:19:12.938 INFO:tasks.workunit.client.1.smithi069.stdout:1/383: dread - d1/d43/d35/d4d/f57 zero size 2024-04-25T17:19:12.939 INFO:tasks.workunit.client.1.smithi069.stdout:8/323: creat d37/d66/f6f x:0 0 0 2024-04-25T17:19:12.941 INFO:tasks.workunit.client.1.smithi069.stdout:6/352: mkdir d2/d2e/d35/d48/d73 0 2024-04-25T17:19:12.942 INFO:tasks.workunit.client.1.smithi069.stdout:5/394: getdents d13/d17/d29/d30/d55 0 2024-04-25T17:19:12.942 INFO:tasks.workunit.client.0.smithi037.stdout:2/569: dwrite d0/d16/d3c/f92 [0,4194304] 0 2024-04-25T17:19:12.943 INFO:tasks.workunit.client.0.smithi037.stdout:1/581: dwrite dc/d18/d39/f6c [0,4194304] 0 2024-04-25T17:19:12.944 INFO:tasks.workunit.client.0.smithi037.stdout:1/582: chown dc/d1c/d57/d4d/d6a/f95 249 1 2024-04-25T17:19:12.946 INFO:tasks.workunit.client.1.smithi069.stdout:7/382: dwrite d4/d1a/f5c [0,4194304] 0 2024-04-25T17:19:12.948 INFO:tasks.workunit.client.1.smithi069.stdout:4/372: rename db/d15/d26/f7a to db/d15/d42/d64/f83 0 2024-04-25T17:19:12.949 INFO:tasks.workunit.client.1.smithi069.stdout:4/373: stat db/d15/d20/d35 0 2024-04-25T17:19:12.950 INFO:tasks.workunit.client.1.smithi069.stdout:5/395: unlink d13/d17/d19/c4f 0 2024-04-25T17:19:12.952 INFO:tasks.workunit.client.0.smithi037.stdout:9/676: symlink d1/d5/d19/dde/lea 0 2024-04-25T17:19:12.954 INFO:tasks.workunit.client.0.smithi037.stdout:2/570: mknod d0/d16/d20/d55/da0/cb8 0 2024-04-25T17:19:12.956 INFO:tasks.workunit.client.1.smithi069.stdout:4/374: dread db/d15/d42/d64/f67 [0,4194304] 0 2024-04-25T17:19:12.959 INFO:tasks.workunit.client.1.smithi069.stdout:1/384: rename d1/d19/l6a to d1/d43/d35/d1d/l74 0 2024-04-25T17:19:12.961 INFO:tasks.workunit.client.0.smithi037.stdout:9/677: fsync d1/d48/d68/d4e/f51 0 2024-04-25T17:19:12.964 INFO:tasks.workunit.client.1.smithi069.stdout:5/396: symlink d13/d17/d29/d30/d5c/l88 0 2024-04-25T17:19:12.966 INFO:tasks.workunit.client.1.smithi069.stdout:7/383: unlink d4/d6/d14/d3d/d47/c57 0 2024-04-25T17:19:12.966 INFO:tasks.workunit.client.1.smithi069.stdout:8/324: dread f8 [0,4194304] 0 2024-04-25T17:19:12.967 INFO:tasks.workunit.client.1.smithi069.stdout:8/325: write d37/d47/f60 [248452,22864] 0 2024-04-25T17:19:12.969 INFO:tasks.workunit.client.1.smithi069.stdout:4/375: mkdir db/d15/d20/d35/d63/d43/d48/d49/d72/d84 0 2024-04-25T17:19:12.971 INFO:tasks.workunit.client.0.smithi037.stdout:9/678: truncate d1/d48/d68/f5a 12958898 0 2024-04-25T17:19:12.972 INFO:tasks.workunit.client.0.smithi037.stdout:9/679: write d1/d5/d19/dde/fe0 [464145,51693] 0 2024-04-25T17:19:12.973 INFO:tasks.workunit.client.0.smithi037.stdout:2/571: mkdir d0/d16/d20/db9 0 2024-04-25T17:19:12.974 INFO:tasks.workunit.client.1.smithi069.stdout:3/466: sync 2024-04-25T17:19:12.975 INFO:tasks.workunit.client.0.smithi037.stdout:9/680: creat d1/d5/dc/d3c/d3e/feb x:0 0 0 2024-04-25T17:19:12.977 INFO:tasks.workunit.client.0.smithi037.stdout:2/572: rename d0/d16/d26/f41 to d0/d7c/fba 0 2024-04-25T17:19:12.977 INFO:tasks.workunit.client.0.smithi037.stdout:9/681: truncate d1/d5/d19/d6e/fdf 586693 0 2024-04-25T17:19:12.979 INFO:tasks.workunit.client.1.smithi069.stdout:6/353: rename d2/d2e/d35 to d2/d1e/d3e/d74 0 2024-04-25T17:19:12.980 INFO:tasks.workunit.client.0.smithi037.stdout:9/682: rmdir d1/d5/dc/d3c 39 2024-04-25T17:19:12.980 INFO:tasks.workunit.client.1.smithi069.stdout:4/376: readlink db/d15/d20/d35/d63/l6f 0 2024-04-25T17:19:12.983 INFO:tasks.workunit.client.1.smithi069.stdout:7/384: dwrite d4/d18/f4f [0,4194304] 0 2024-04-25T17:19:12.985 INFO:tasks.workunit.client.1.smithi069.stdout:4/377: chown db/d15/d20/d35 4 1 2024-04-25T17:19:12.986 INFO:tasks.workunit.client.1.smithi069.stdout:6/354: readlink d2/d1e/d3f/l5b 0 2024-04-25T17:19:12.986 INFO:tasks.workunit.client.0.smithi037.stdout:2/573: dwrite d0/d16/d20/f8d [0,4194304] 0 2024-04-25T17:19:12.986 INFO:tasks.workunit.client.1.smithi069.stdout:8/326: dwrite d37/f45 [0,4194304] 0 2024-04-25T17:19:12.987 INFO:tasks.workunit.client.1.smithi069.stdout:8/327: readlink d37/d47/l69 0 2024-04-25T17:19:12.987 INFO:tasks.workunit.client.1.smithi069.stdout:8/328: fdatasync d37/d62/f6d 0 2024-04-25T17:19:12.987 INFO:tasks.workunit.client.0.smithi037.stdout:1/583: dwrite dc/d1c/d57/d4d/d6a/d86/f97 [8388608,4194304] 0 2024-04-25T17:19:12.988 INFO:tasks.workunit.client.0.smithi037.stdout:9/683: creat d1/d5/d2e/d34/daf/dcb/fec x:0 0 0 2024-04-25T17:19:12.989 INFO:tasks.workunit.client.1.smithi069.stdout:8/329: write d37/f5b [4182716,108469] 0 2024-04-25T17:19:12.989 INFO:tasks.workunit.client.1.smithi069.stdout:6/355: symlink d2/d1e/l75 0 2024-04-25T17:19:12.990 INFO:tasks.workunit.client.0.smithi037.stdout:9/684: dread - d1/d48/d68/d1c/fcd zero size 2024-04-25T17:19:12.991 INFO:tasks.workunit.client.1.smithi069.stdout:8/330: write f26 [1225935,9668] 0 2024-04-25T17:19:12.992 INFO:tasks.workunit.client.1.smithi069.stdout:8/331: read d37/d47/f60 [169513,63329] 0 2024-04-25T17:19:12.993 INFO:tasks.workunit.client.0.smithi037.stdout:2/574: symlink d0/d15/d2a/lbb 0 2024-04-25T17:19:12.997 INFO:tasks.workunit.client.1.smithi069.stdout:3/467: mkdir d8/d16/d4b/d9e/da5 0 2024-04-25T17:19:13.001 INFO:tasks.workunit.client.1.smithi069.stdout:7/385: mkdir d4/d6/d14/d44/d7c 0 2024-04-25T17:19:13.002 INFO:tasks.workunit.client.1.smithi069.stdout:7/386: chown d4/d6/d14 6811 1 2024-04-25T17:19:13.005 INFO:tasks.workunit.client.0.smithi037.stdout:2/575: creat d0/d16/d3c/fbc x:0 0 0 2024-04-25T17:19:13.006 INFO:tasks.workunit.client.0.smithi037.stdout:2/576: write d0/d15/f48 [1911835,56228] 0 2024-04-25T17:19:13.008 INFO:tasks.workunit.client.1.smithi069.stdout:7/387: dwrite d4/d1a/f24 [0,4194304] 0 2024-04-25T17:19:13.008 INFO:tasks.workunit.client.0.smithi037.stdout:2/577: write d0/d23/dac/f65 [846623,38729] 0 2024-04-25T17:19:13.008 INFO:tasks.workunit.client.0.smithi037.stdout:2/578: chown d0/d15/d2a/d5a 1 1 2024-04-25T17:19:13.009 INFO:tasks.workunit.client.1.smithi069.stdout:8/332: readlink d37/l4c 0 2024-04-25T17:19:13.009 INFO:tasks.workunit.client.1.smithi069.stdout:8/333: rename d37/d62 to d37/d62/d70 22 2024-04-25T17:19:13.010 INFO:tasks.workunit.client.0.smithi037.stdout:2/579: dread d0/d16/d20/d55/f80 [0,4194304] 0 2024-04-25T17:19:13.010 INFO:tasks.workunit.client.1.smithi069.stdout:3/468: mknod d8/d71/d8d/ca6 0 2024-04-25T17:19:13.011 INFO:tasks.workunit.client.1.smithi069.stdout:8/334: truncate d37/d62/f6d 942963 0 2024-04-25T17:19:13.012 INFO:tasks.workunit.client.1.smithi069.stdout:6/356: symlink d2/d7/l76 0 2024-04-25T17:19:13.013 INFO:tasks.workunit.client.0.smithi037.stdout:2/580: truncate d0/d23/f28 800295 0 2024-04-25T17:19:13.015 INFO:tasks.workunit.client.1.smithi069.stdout:7/388: creat d4/d6/d14/d44/d79/d23/f7d x:0 0 0 2024-04-25T17:19:13.015 INFO:tasks.workunit.client.1.smithi069.stdout:4/378: link db/d22/l6d db/d15/d20/d35/d63/l85 0 2024-04-25T17:19:13.018 INFO:tasks.workunit.client.0.smithi037.stdout:2/581: rename d0/d16/d26/d9e to d0/d16/d20/d59/d6a/da5/dbd 0 2024-04-25T17:19:13.018 INFO:tasks.workunit.client.1.smithi069.stdout:8/335: creat d37/d47/d48/f71 x:0 0 0 2024-04-25T17:19:13.019 INFO:tasks.workunit.client.1.smithi069.stdout:3/469: creat d8/d16/d1a/d99/fa7 x:0 0 0 2024-04-25T17:19:13.020 INFO:tasks.workunit.client.0.smithi037.stdout:2/582: fdatasync d0/d16/d20/d59/f8b 0 2024-04-25T17:19:13.021 INFO:tasks.workunit.client.0.smithi037.stdout:2/583: chown d0/d16/d20/d55/fa6 14141 1 2024-04-25T17:19:13.022 INFO:tasks.workunit.client.1.smithi069.stdout:6/357: getdents d2/d1e/d3f/d56 0 2024-04-25T17:19:13.023 INFO:tasks.workunit.client.1.smithi069.stdout:8/336: mknod d37/d47/d54/c72 0 2024-04-25T17:19:13.024 INFO:tasks.workunit.client.1.smithi069.stdout:3/470: mknod d8/d16/d1a/d3e/d42/ca8 0 2024-04-25T17:19:13.025 INFO:tasks.workunit.client.0.smithi037.stdout:2/584: dread d0/d15/f1d [0,4194304] 0 2024-04-25T17:19:13.026 INFO:tasks.workunit.client.1.smithi069.stdout:5/397: dread d13/d17/d19/f25 [0,4194304] 0 2024-04-25T17:19:13.027 INFO:tasks.workunit.client.1.smithi069.stdout:7/389: truncate d4/d1a/f2f 221857 0 2024-04-25T17:19:13.028 INFO:tasks.workunit.client.1.smithi069.stdout:5/398: write d13/d17/d19/d1c/f45 [2389028,80192] 0 2024-04-25T17:19:13.028 INFO:tasks.workunit.client.1.smithi069.stdout:7/390: write d4/d6/f52 [817468,65489] 0 2024-04-25T17:19:13.031 INFO:tasks.workunit.client.0.smithi037.stdout:1/584: write dc/d1c/d57/f83 [421948,23587] 0 2024-04-25T17:19:13.032 INFO:tasks.workunit.client.1.smithi069.stdout:8/337: dread d37/d47/f60 [0,4194304] 0 2024-04-25T17:19:13.033 INFO:tasks.workunit.client.1.smithi069.stdout:5/399: truncate d13/d17/d29/d30/d55/f7b 197478 0 2024-04-25T17:19:13.033 INFO:tasks.workunit.client.0.smithi037.stdout:2/585: dwrite d0/d16/d20/d55/f60 [0,4194304] 0 2024-04-25T17:19:13.034 INFO:tasks.workunit.client.1.smithi069.stdout:8/338: chown d37/d47/d54/c72 193 1 2024-04-25T17:19:13.035 INFO:tasks.workunit.client.0.smithi037.stdout:9/685: write d1/d5/dc/d38/fbd [4297880,12074] 0 2024-04-25T17:19:13.035 INFO:tasks.workunit.client.1.smithi069.stdout:8/339: chown d37/l4c 0 1 2024-04-25T17:19:13.036 INFO:tasks.workunit.client.0.smithi037.stdout:9/686: dread - d1/d5/dc/d38/d8b/fd3 zero size 2024-04-25T17:19:13.036 INFO:tasks.workunit.client.0.smithi037.stdout:1/585: fsync dc/d24/f71 0 2024-04-25T17:19:13.037 INFO:tasks.workunit.client.1.smithi069.stdout:6/358: dwrite d2/d1e/f6a [4194304,4194304] 0 2024-04-25T17:19:13.039 INFO:tasks.workunit.client.0.smithi037.stdout:2/586: mkdir d0/d16/d20/d59/d6a/dbe 0 2024-04-25T17:19:13.043 INFO:tasks.workunit.client.0.smithi037.stdout:1/586: write dc/d18/d64/f9e [1207231,58140] 0 2024-04-25T17:19:13.044 INFO:tasks.workunit.client.1.smithi069.stdout:7/391: dwrite d4/d6/d14/d5a/f78 [0,4194304] 0 2024-04-25T17:19:13.045 INFO:tasks.workunit.client.0.smithi037.stdout:1/587: chown dc/d1c/d57/d22/fa3 53005951 1 2024-04-25T17:19:13.046 INFO:tasks.workunit.client.1.smithi069.stdout:8/340: stat c0 0 2024-04-25T17:19:13.048 INFO:tasks.workunit.client.0.smithi037.stdout:9/687: rename d1/d48/caa to d1/d48/d68/d1c/de8/ced 0 2024-04-25T17:19:13.051 INFO:tasks.workunit.client.1.smithi069.stdout:6/359: creat d2/d1e/d3e/d74/d48/f77 x:0 0 0 2024-04-25T17:19:13.052 INFO:tasks.workunit.client.1.smithi069.stdout:5/400: dread d13/f54 [0,4194304] 0 2024-04-25T17:19:13.053 INFO:tasks.workunit.client.1.smithi069.stdout:5/401: chown d13/d17/l40 1534 1 2024-04-25T17:19:13.055 INFO:tasks.workunit.client.1.smithi069.stdout:7/392: mknod d4/d1a/d34/c7e 0 2024-04-25T17:19:13.057 INFO:tasks.workunit.client.0.smithi037.stdout:1/588: write dc/d18/d64/fa0 [42177,92895] 0 2024-04-25T17:19:13.058 INFO:tasks.workunit.client.1.smithi069.stdout:8/341: mknod d37/d66/c73 0 2024-04-25T17:19:13.059 INFO:tasks.workunit.client.1.smithi069.stdout:3/471: rename d8/d16/d1a/d3e to d8/d16/d1a/d2c/d6c/d9c/da9 0 2024-04-25T17:19:13.060 INFO:tasks.workunit.client.0.smithi037.stdout:2/587: mknod d0/d16/d3b/db0/cbf 0 2024-04-25T17:19:13.061 INFO:tasks.workunit.client.1.smithi069.stdout:3/472: stat d8/d39/f5a 0 2024-04-25T17:19:13.063 INFO:tasks.workunit.client.1.smithi069.stdout:4/379: dwrite db/d15/f3f [0,4194304] 0 2024-04-25T17:19:13.063 INFO:tasks.workunit.client.1.smithi069.stdout:7/393: dwrite d4/d1a/d34/f68 [0,4194304] 0 2024-04-25T17:19:13.065 INFO:tasks.workunit.client.1.smithi069.stdout:8/342: creat d37/d66/f74 x:0 0 0 2024-04-25T17:19:13.066 INFO:tasks.workunit.client.0.smithi037.stdout:2/588: fdatasync d0/d15/f37 0 2024-04-25T17:19:13.073 INFO:tasks.workunit.client.0.smithi037.stdout:9/688: dread d1/d48/d68/d4e/f67 [4194304,4194304] 0 2024-04-25T17:19:13.074 INFO:tasks.workunit.client.1.smithi069.stdout:3/473: creat d8/d71/d8d/d92/faa x:0 0 0 2024-04-25T17:19:13.074 INFO:tasks.workunit.client.1.smithi069.stdout:3/474: dread - d8/d16/d1a/d2c/d49/fa2 zero size 2024-04-25T17:19:13.077 INFO:tasks.workunit.client.1.smithi069.stdout:7/394: rmdir d4/d6/d14/d3d/d47 39 2024-04-25T17:19:13.080 INFO:tasks.workunit.client.1.smithi069.stdout:6/360: link d2/d1e/d43/c46 d2/d1e/d3e/d74/d48/c78 0 2024-04-25T17:19:13.083 INFO:tasks.workunit.client.1.smithi069.stdout:3/475: mkdir d8/d16/d1a/d99/dab 0 2024-04-25T17:19:13.087 INFO:tasks.workunit.client.0.smithi037.stdout:2/589: getdents d0/d16/d20/d59/d6a 0 2024-04-25T17:19:13.091 INFO:tasks.workunit.client.0.smithi037.stdout:1/589: write dc/d1c/d57/d4d/d6a/d86/d9b/fc0 [440821,122018] 0 2024-04-25T17:19:13.094 INFO:tasks.workunit.client.0.smithi037.stdout:1/590: fsync dc/d1c/d57/d4d/d6a/d86/d9b/fc0 0 2024-04-25T17:19:13.094 INFO:tasks.workunit.client.0.smithi037.stdout:2/590: rename d0/d23/c24 to d0/d23/d7d/cc0 0 2024-04-25T17:19:13.096 INFO:tasks.workunit.client.0.smithi037.stdout:1/591: truncate dc/f10 462133 0 2024-04-25T17:19:13.098 INFO:tasks.workunit.client.0.smithi037.stdout:9/689: write d1/d5/f58 [1944531,22956] 0 2024-04-25T17:19:13.098 INFO:tasks.workunit.client.0.smithi037.stdout:1/592: write dc/d18/d66/fb4 [509558,108485] 0 2024-04-25T17:19:13.099 INFO:tasks.workunit.client.0.smithi037.stdout:9/690: write d1/d48/d68/d1c/fcd [32519,52779] 0 2024-04-25T17:19:13.102 INFO:tasks.workunit.client.0.smithi037.stdout:1/593: mknod dc/d1c/d57/d22/d36/d92/db8/dbc/cca 0 2024-04-25T17:19:13.103 INFO:tasks.workunit.client.0.smithi037.stdout:1/594: truncate dc/d18/d66/fb5 663448 0 2024-04-25T17:19:13.105 INFO:tasks.workunit.client.0.smithi037.stdout:1/595: rmdir dc/d1c/d57/d22/d36/d8c 39 2024-04-25T17:19:13.106 INFO:tasks.workunit.client.0.smithi037.stdout:1/596: chown dc/d18/l29 9155075 1 2024-04-25T17:19:13.108 INFO:tasks.workunit.client.1.smithi069.stdout:9/401: sync 2024-04-25T17:19:13.109 INFO:tasks.workunit.client.0.smithi037.stdout:1/597: write dc/fd [914916,82523] 0 2024-04-25T17:19:13.109 INFO:tasks.workunit.client.0.smithi037.stdout:2/591: dread d0/d16/d3b/f47 [0,4194304] 0 2024-04-25T17:19:13.109 INFO:tasks.workunit.client.1.smithi069.stdout:7/395: unlink d4/d18/d36/c70 0 2024-04-25T17:19:13.109 INFO:tasks.workunit.client.1.smithi069.stdout:8/343: mknod d37/d47/c75 0 2024-04-25T17:19:13.109 INFO:tasks.workunit.client.1.smithi069.stdout:6/361: creat d2/d1e/d3e/d67/f79 x:0 0 0 2024-04-25T17:19:13.110 INFO:tasks.workunit.client.1.smithi069.stdout:9/402: readlink d2/da/d14/d23/d65/l6b 0 2024-04-25T17:19:13.111 INFO:tasks.workunit.client.1.smithi069.stdout:6/362: fsync d2/d1e/d3f/f49 0 2024-04-25T17:19:13.111 INFO:tasks.workunit.client.0.smithi037.stdout:2/592: symlink d0/d16/d68/lc1 0 2024-04-25T17:19:13.112 INFO:tasks.workunit.client.1.smithi069.stdout:9/403: fdatasync d2/da/dd/d1e/d2e/d35/f7a 0 2024-04-25T17:19:13.113 INFO:tasks.workunit.client.1.smithi069.stdout:8/344: rename d37/d47/d54/c72 to d37/d47/d48/c76 0 2024-04-25T17:19:13.114 INFO:tasks.workunit.client.0.smithi037.stdout:9/691: dread d1/d5/d2e/d34/f4c [4194304,4194304] 0 2024-04-25T17:19:13.114 INFO:tasks.workunit.client.1.smithi069.stdout:8/345: stat d37/f45 0 2024-04-25T17:19:13.115 INFO:tasks.workunit.client.1.smithi069.stdout:8/346: fdatasync f12 0 2024-04-25T17:19:13.117 INFO:tasks.workunit.client.0.smithi037.stdout:2/593: symlink d0/d15/d2a/d5a/d75/lc2 0 2024-04-25T17:19:13.117 INFO:tasks.workunit.client.1.smithi069.stdout:7/396: dwrite d4/d1a/d34/f65 [0,4194304] 0 2024-04-25T17:19:13.117 INFO:tasks.workunit.client.1.smithi069.stdout:3/476: getdents d8/d16/d31 0 2024-04-25T17:19:13.118 INFO:tasks.workunit.client.0.smithi037.stdout:9/692: truncate d1/d5/f98 664804 0 2024-04-25T17:19:13.119 INFO:tasks.workunit.client.1.smithi069.stdout:7/397: dread - d4/d6/d14/d44/d79/d23/f6b zero size 2024-04-25T17:19:13.119 INFO:tasks.workunit.client.1.smithi069.stdout:9/404: read d2/da/dd/d1e/d2e/f45 [1120995,108936] 0 2024-04-25T17:19:13.121 INFO:tasks.workunit.client.0.smithi037.stdout:2/594: read d0/d23/d7d/f61 [1379305,22510] 0 2024-04-25T17:19:13.124 INFO:tasks.workunit.client.1.smithi069.stdout:6/363: mknod d2/d1e/d3e/d74/d48/d73/c7a 0 2024-04-25T17:19:13.127 INFO:tasks.workunit.client.1.smithi069.stdout:3/477: fsync d8/d16/d4b/f62 0 2024-04-25T17:19:13.128 INFO:tasks.workunit.client.0.smithi037.stdout:2/595: mkdir d0/d16/d3b/db0/dc3 0 2024-04-25T17:19:13.129 INFO:tasks.workunit.client.0.smithi037.stdout:2/596: dread - d0/d16/d26/f9c zero size 2024-04-25T17:19:13.130 INFO:tasks.workunit.client.1.smithi069.stdout:7/398: creat d4/d6/d14/d5a/f7f x:0 0 0 2024-04-25T17:19:13.130 INFO:tasks.workunit.client.0.smithi037.stdout:2/597: dread - d0/d16/d20/d59/d6a/f99 zero size 2024-04-25T17:19:13.131 INFO:tasks.workunit.client.1.smithi069.stdout:7/399: read d4/f6a [378866,82287] 0 2024-04-25T17:19:13.131 INFO:tasks.workunit.client.1.smithi069.stdout:7/400: chown d4/d18/l1d 904108 1 2024-04-25T17:19:13.132 INFO:tasks.workunit.client.0.smithi037.stdout:1/598: truncate dc/d18/d64/f68 2174661 0 2024-04-25T17:19:13.133 INFO:tasks.workunit.client.1.smithi069.stdout:9/405: creat d2/da/dd/d1e/d40/f91 x:0 0 0 2024-04-25T17:19:13.135 INFO:tasks.workunit.client.1.smithi069.stdout:6/364: creat d2/d2e/f7b x:0 0 0 2024-04-25T17:19:13.135 INFO:tasks.workunit.client.0.smithi037.stdout:9/693: getdents d1/d5/d2e/d34 0 2024-04-25T17:19:13.136 INFO:tasks.workunit.client.0.smithi037.stdout:9/694: dread - d1/d5/d19/f56 zero size 2024-04-25T17:19:13.137 INFO:tasks.workunit.client.1.smithi069.stdout:8/347: mknod d37/d47/c77 0 2024-04-25T17:19:13.137 INFO:tasks.workunit.client.1.smithi069.stdout:8/348: chown d37/d66/c73 830 1 2024-04-25T17:19:13.138 INFO:tasks.workunit.client.0.smithi037.stdout:2/598: write d0/d16/d3b/f47 [4779461,16700] 0 2024-04-25T17:19:13.139 INFO:tasks.workunit.client.1.smithi069.stdout:3/478: mkdir d8/d2a/dac 0 2024-04-25T17:19:13.143 INFO:tasks.workunit.client.1.smithi069.stdout:7/401: creat d4/d3e/f80 x:0 0 0 2024-04-25T17:19:13.143 INFO:tasks.workunit.client.0.smithi037.stdout:9/695: dwrite d1/d5/d19/d6e/fdf [0,4194304] 0 2024-04-25T17:19:13.144 INFO:tasks.workunit.client.1.smithi069.stdout:3/479: dwrite d8/d16/f27 [0,4194304] 0 2024-04-25T17:19:13.145 INFO:tasks.workunit.client.1.smithi069.stdout:9/406: creat d2/da/dd/d1e/f92 x:0 0 0 2024-04-25T17:19:13.145 INFO:tasks.workunit.client.0.smithi037.stdout:1/599: mknod dc/d18/ccb 0 2024-04-25T17:19:13.148 INFO:tasks.workunit.client.0.smithi037.stdout:2/599: truncate d0/d16/d26/f4a 1839640 0 2024-04-25T17:19:13.151 INFO:tasks.workunit.client.1.smithi069.stdout:7/402: mknod d4/d18/d3f/c81 0 2024-04-25T17:19:13.152 INFO:tasks.workunit.client.0.smithi037.stdout:9/696: creat d1/d48/fee x:0 0 0 2024-04-25T17:19:13.153 INFO:tasks.workunit.client.1.smithi069.stdout:7/403: write d4/d1a/f1c [1943659,58344] 0 2024-04-25T17:19:13.160 INFO:tasks.workunit.client.0.smithi037.stdout:9/697: dwrite d1/d5/d19/d6e/f8f [4194304,4194304] 0 2024-04-25T17:19:13.163 INFO:tasks.workunit.client.0.smithi037.stdout:1/600: rename dc/d18/d66/lba to dc/d24/lcc 0 2024-04-25T17:19:13.172 INFO:tasks.workunit.client.1.smithi069.stdout:9/407: link d2/da/d14/d23/d65/f87 d2/da/f93 0 2024-04-25T17:19:13.172 INFO:tasks.workunit.client.1.smithi069.stdout:8/349: dwrite d37/d47/f60 [0,4194304] 0 2024-04-25T17:19:13.173 INFO:tasks.workunit.client.1.smithi069.stdout:9/408: dread - d2/da/d5f/d76/f85 zero size 2024-04-25T17:19:13.174 INFO:tasks.workunit.client.1.smithi069.stdout:8/350: dread - d37/d66/f74 zero size 2024-04-25T17:19:13.174 INFO:tasks.workunit.client.1.smithi069.stdout:7/404: mknod d4/d6/d14/d3d/c82 0 2024-04-25T17:19:13.177 INFO:tasks.workunit.client.0.smithi037.stdout:2/600: getdents d0/d7c 0 2024-04-25T17:19:13.179 INFO:tasks.workunit.client.1.smithi069.stdout:7/405: mkdir d4/d83 0 2024-04-25T17:19:13.180 INFO:tasks.workunit.client.1.smithi069.stdout:8/351: mkdir d37/d47/d78 0 2024-04-25T17:19:13.181 INFO:tasks.workunit.client.0.smithi037.stdout:9/698: write d1/d5/dc/f5e [2028937,84877] 0 2024-04-25T17:19:13.182 INFO:tasks.workunit.client.1.smithi069.stdout:3/480: dwrite d8/d16/d1a/d38/f66 [0,4194304] 0 2024-04-25T17:19:13.182 INFO:tasks.workunit.client.0.smithi037.stdout:9/699: chown d1/d5/dc/d38/d8b/c54 2006355 1 2024-04-25T17:19:13.185 INFO:tasks.workunit.client.0.smithi037.stdout:2/601: rename d0/d16/d20/d55/da0 to d0/d16/d3b/dc4 0 2024-04-25T17:19:13.189 INFO:tasks.workunit.client.1.smithi069.stdout:8/352: symlink d37/d62/l79 0 2024-04-25T17:19:13.190 INFO:tasks.workunit.client.1.smithi069.stdout:8/353: chown d37/d66/f6f 0 1 2024-04-25T17:19:13.193 INFO:tasks.workunit.client.0.smithi037.stdout:1/601: dwrite dc/d1c/d57/d4d/f7e [4194304,4194304] 0 2024-04-25T17:19:13.193 INFO:tasks.workunit.client.0.smithi037.stdout:2/602: fdatasync d0/d23/dac/d4b/f7a 0 2024-04-25T17:19:13.194 INFO:tasks.workunit.client.0.smithi037.stdout:2/603: chown d0/d16/d26 27849 1 2024-04-25T17:19:13.194 INFO:tasks.workunit.client.0.smithi037.stdout:1/602: chown dc/d1c/d57/f83 109 1 2024-04-25T17:19:13.194 INFO:tasks.workunit.client.0.smithi037.stdout:9/700: mknod d1/d48/d68/d26/d81/d9c/cef 0 2024-04-25T17:19:13.195 INFO:tasks.workunit.client.1.smithi069.stdout:9/409: dread d2/da/d14/d23/d65/f73 [0,4194304] 0 2024-04-25T17:19:13.196 INFO:tasks.workunit.client.1.smithi069.stdout:9/410: chown d2/da/dd/f2d 2 1 2024-04-25T17:19:13.196 INFO:tasks.workunit.client.1.smithi069.stdout:9/411: chown d2 6721500 1 2024-04-25T17:19:13.199 INFO:tasks.workunit.client.1.smithi069.stdout:8/354: creat d37/d47/d54/f7a x:0 0 0 2024-04-25T17:19:13.200 INFO:tasks.workunit.client.1.smithi069.stdout:8/355: dread - d37/d47/d54/f5e zero size 2024-04-25T17:19:13.206 INFO:tasks.workunit.client.1.smithi069.stdout:8/356: dwrite d37/d62/f63 [0,4194304] 0 2024-04-25T17:19:13.207 INFO:tasks.workunit.client.1.smithi069.stdout:8/357: dread - d37/d47/d54/f68 zero size 2024-04-25T17:19:13.207 INFO:tasks.workunit.client.0.smithi037.stdout:1/603: creat dc/d1c/d57/d22/d36/d92/db8/dbc/fcd x:0 0 0 2024-04-25T17:19:13.208 INFO:tasks.workunit.client.1.smithi069.stdout:8/358: dread - f35 zero size 2024-04-25T17:19:13.209 INFO:tasks.workunit.client.1.smithi069.stdout:8/359: write f35 [274572,52721] 0 2024-04-25T17:19:13.209 INFO:tasks.workunit.client.1.smithi069.stdout:8/360: stat l30 0 2024-04-25T17:19:13.212 INFO:tasks.workunit.client.1.smithi069.stdout:3/481: getdents d8/d71 0 2024-04-25T17:19:13.214 INFO:tasks.workunit.client.1.smithi069.stdout:9/412: mknod d2/da/c94 0 2024-04-25T17:19:13.214 INFO:tasks.workunit.client.0.smithi037.stdout:9/701: write d1/d5/dc/f7d [4079433,17394] 0 2024-04-25T17:19:13.217 INFO:tasks.workunit.client.1.smithi069.stdout:0/322: sync 2024-04-25T17:19:13.217 INFO:tasks.workunit.client.1.smithi069.stdout:5/402: sync 2024-04-25T17:19:13.218 INFO:tasks.workunit.client.1.smithi069.stdout:1/385: sync 2024-04-25T17:19:13.218 INFO:tasks.workunit.client.1.smithi069.stdout:2/354: sync 2024-04-25T17:19:13.218 INFO:tasks.workunit.client.0.smithi037.stdout:2/604: getdents d0/d16/d3b 0 2024-04-25T17:19:13.219 INFO:tasks.workunit.client.1.smithi069.stdout:2/355: chown d0/d26/d36/f3f 1 1 2024-04-25T17:19:13.219 INFO:tasks.workunit.client.1.smithi069.stdout:5/403: readlink d13/d17/d29/d30/l3b 0 2024-04-25T17:19:13.220 INFO:tasks.workunit.client.1.smithi069.stdout:3/482: creat d8/d2a/fad x:0 0 0 2024-04-25T17:19:13.220 INFO:tasks.workunit.client.1.smithi069.stdout:5/404: dread - d13/d17/f86 zero size 2024-04-25T17:19:13.224 INFO:tasks.workunit.client.0.smithi037.stdout:1/604: link dc/d24/c73 dc/d18/d66/cce 0 2024-04-25T17:19:13.225 INFO:tasks.workunit.client.0.smithi037.stdout:9/702: dread d1/d48/d68/d4e/fd7 [0,4194304] 0 2024-04-25T17:19:13.226 INFO:tasks.workunit.client.1.smithi069.stdout:8/361: write fb [16308,63440] 0 2024-04-25T17:19:13.227 INFO:tasks.workunit.client.1.smithi069.stdout:0/323: mkdir d0/d38/d75 0 2024-04-25T17:19:13.227 INFO:tasks.workunit.client.1.smithi069.stdout:8/362: fdatasync d37/f5b 0 2024-04-25T17:19:13.230 INFO:tasks.workunit.client.1.smithi069.stdout:8/363: dread f26 [0,4194304] 0 2024-04-25T17:19:13.232 INFO:tasks.workunit.client.1.smithi069.stdout:2/356: creat d0/d56/d5f/f71 x:0 0 0 2024-04-25T17:19:13.235 INFO:tasks.workunit.client.1.smithi069.stdout:2/357: truncate d0/d26/f2b 5436183 0 2024-04-25T17:19:13.236 INFO:tasks.workunit.client.0.smithi037.stdout:2/605: dread d0/f2d [0,4194304] 0 2024-04-25T17:19:13.236 INFO:tasks.workunit.client.1.smithi069.stdout:9/413: dwrite d2/da/dd/d1e/d2e/d35/f38 [0,4194304] 0 2024-04-25T17:19:13.237 INFO:tasks.workunit.client.1.smithi069.stdout:1/386: dread d1/d43/d35/f14 [0,4194304] 0 2024-04-25T17:19:13.237 INFO:tasks.workunit.client.1.smithi069.stdout:5/405: unlink d13/d17/d29/d30/d55/l75 0 2024-04-25T17:19:13.239 INFO:tasks.workunit.client.0.smithi037.stdout:9/703: getdents d1/d5 0 2024-04-25T17:19:13.242 INFO:tasks.workunit.client.0.smithi037.stdout:9/704: read - d1/d5/dc/d38/d8b/fc9 zero size 2024-04-25T17:19:13.244 INFO:tasks.workunit.client.0.smithi037.stdout:1/605: dwrite dc/d1c/d57/d4d/d6a/f95 [0,4194304] 0 2024-04-25T17:19:13.245 INFO:tasks.workunit.client.1.smithi069.stdout:5/406: dwrite d13/d17/d19/d20/f7a [0,4194304] 0 2024-04-25T17:19:13.246 INFO:tasks.workunit.client.0.smithi037.stdout:2/606: write d0/f44 [375539,44258] 0 2024-04-25T17:19:13.247 INFO:tasks.workunit.client.1.smithi069.stdout:5/407: write d13/d17/d19/d20/d2d/f5d [3048131,55405] 0 2024-04-25T17:19:13.248 INFO:tasks.workunit.client.1.smithi069.stdout:0/324: rename d0/da/db/d2c/l53 to d0/da/db/d1d/d5f/l76 0 2024-04-25T17:19:13.251 INFO:tasks.workunit.client.0.smithi037.stdout:1/606: truncate dc/d52/f5b 729982 0 2024-04-25T17:19:13.252 INFO:tasks.workunit.client.1.smithi069.stdout:8/364: fsync d37/d47/d48/f4e 0 2024-04-25T17:19:13.253 INFO:tasks.workunit.client.0.smithi037.stdout:1/607: fsync dc/d1c/d57/d4d/d6a/d86/d9b/fc0 0 2024-04-25T17:19:13.253 INFO:tasks.workunit.client.1.smithi069.stdout:2/358: read - d0/d1/d5b/f34 zero size 2024-04-25T17:19:13.254 INFO:tasks.workunit.client.0.smithi037.stdout:1/608: readlink dc/d1c/d57/d4d/lac 0 2024-04-25T17:19:13.256 INFO:tasks.workunit.client.0.smithi037.stdout:9/705: symlink d1/d5/dc/d3c/lf0 0 2024-04-25T17:19:13.257 INFO:tasks.workunit.client.1.smithi069.stdout:0/325: dwrite d0/da/db/d2c/f4d [4194304,4194304] 0 2024-04-25T17:19:13.258 INFO:tasks.workunit.client.1.smithi069.stdout:0/326: write d0/fc [4756234,110999] 0 2024-04-25T17:19:13.258 INFO:tasks.workunit.client.0.smithi037.stdout:9/706: truncate d1/d5/d19/f50 5215712 0 2024-04-25T17:19:13.261 INFO:tasks.workunit.client.1.smithi069.stdout:7/406: creat d4/d6/d14/d3d/f84 x:0 0 0 2024-04-25T17:19:13.263 INFO:tasks.workunit.client.0.smithi037.stdout:9/707: creat d1/d5/d19/d6e/ff1 x:0 0 0 2024-04-25T17:19:13.263 INFO:tasks.workunit.client.1.smithi069.stdout:9/414: dread d2/da/fc [0,4194304] 0 2024-04-25T17:19:13.265 INFO:tasks.workunit.client.0.smithi037.stdout:1/609: rename dc/d52/d6b/la4 to dc/d1c/d57/d22/lcf 0 2024-04-25T17:19:13.268 INFO:tasks.workunit.client.0.smithi037.stdout:1/610: mknod dc/d1c/d57/d4d/cd0 0 2024-04-25T17:19:13.269 INFO:tasks.workunit.client.0.smithi037.stdout:7/550: sync 2024-04-25T17:19:13.273 INFO:tasks.workunit.client.1.smithi069.stdout:2/359: mkdir d0/d1/d5b/d28/d72 0 2024-04-25T17:19:13.273 INFO:tasks.workunit.client.0.smithi037.stdout:9/708: dwrite d1/d48/d68/f46 [0,4194304] 0 2024-04-25T17:19:13.274 INFO:tasks.workunit.client.1.smithi069.stdout:2/360: chown d0/d1/d5b/d28/f50 12128 1 2024-04-25T17:19:13.275 INFO:tasks.workunit.client.0.smithi037.stdout:1/611: write dc/d1c/d57/d22/d36/d92/db8/fc2 [876652,107664] 0 2024-04-25T17:19:13.275 INFO:tasks.workunit.client.0.smithi037.stdout:9/709: chown d1/d5/d2e/d34/d76/lb7 156075093 1 2024-04-25T17:19:13.280 INFO:tasks.workunit.client.0.smithi037.stdout:9/710: symlink d1/d48/d68/d1c/de8/lf2 0 2024-04-25T17:19:13.283 INFO:tasks.workunit.client.1.smithi069.stdout:9/415: unlink c0 0 2024-04-25T17:19:13.287 INFO:tasks.workunit.client.1.smithi069.stdout:2/361: creat d0/d56/d5f/d62/f73 x:0 0 0 2024-04-25T17:19:13.288 INFO:tasks.workunit.client.1.smithi069.stdout:1/387: dwrite d1/df/f34 [0,4194304] 0 2024-04-25T17:19:13.290 INFO:tasks.workunit.client.0.smithi037.stdout:2/607: dwrite d0/d15/f81 [0,4194304] 0 2024-04-25T17:19:13.291 INFO:tasks.workunit.client.1.smithi069.stdout:0/327: rename d0/d17/l18 to d0/da/d59/l77 0 2024-04-25T17:19:13.291 INFO:tasks.workunit.client.1.smithi069.stdout:4/380: sync 2024-04-25T17:19:13.291 INFO:tasks.workunit.client.1.smithi069.stdout:6/365: sync 2024-04-25T17:19:13.292 INFO:tasks.workunit.client.1.smithi069.stdout:4/381: chown f7 30652 1 2024-04-25T17:19:13.300 INFO:tasks.workunit.client.1.smithi069.stdout:2/362: creat d0/d26/d10/d43/f74 x:0 0 0 2024-04-25T17:19:13.300 INFO:tasks.workunit.client.0.smithi037.stdout:1/612: getdents dc/d52 0 2024-04-25T17:19:13.302 INFO:tasks.workunit.client.0.smithi037.stdout:2/608: mknod d0/d16/d20/d55/cc5 0 2024-04-25T17:19:13.303 INFO:tasks.workunit.client.0.smithi037.stdout:2/609: stat d0/l18 0 2024-04-25T17:19:13.305 INFO:tasks.workunit.client.1.smithi069.stdout:7/407: rename d4/d6/d14/d3d/f84 to d4/d6/d14/d5a/f85 0 2024-04-25T17:19:13.306 INFO:tasks.workunit.client.0.smithi037.stdout:1/613: mknod dc/d1c/d57/d22/d36/d92/db8/dbc/cd1 0 2024-04-25T17:19:13.306 INFO:tasks.workunit.client.1.smithi069.stdout:8/365: dwrite d37/d47/d54/f5e [0,4194304] 0 2024-04-25T17:19:13.307 INFO:tasks.workunit.client.0.smithi037.stdout:7/551: dwrite d5/d15/d17/d1b/da2/daf/d80/f84 [0,4194304] 0 2024-04-25T17:19:13.308 INFO:tasks.workunit.client.0.smithi037.stdout:1/614: fsync dc/d1c/d57/d22/d36/f40 0 2024-04-25T17:19:13.309 INFO:tasks.workunit.client.0.smithi037.stdout:2/610: symlink d0/d16/d3b/db0/lc6 0 2024-04-25T17:19:13.310 INFO:tasks.workunit.client.1.smithi069.stdout:1/388: dwrite d1/d43/d35/f14 [4194304,4194304] 0 2024-04-25T17:19:13.313 INFO:tasks.workunit.client.1.smithi069.stdout:4/382: creat db/d15/d20/d35/d63/d70/f86 x:0 0 0 2024-04-25T17:19:13.314 INFO:tasks.workunit.client.0.smithi037.stdout:9/711: dwrite d1/d5/d19/f56 [0,4194304] 0 2024-04-25T17:19:13.314 INFO:tasks.workunit.client.1.smithi069.stdout:5/408: getdents d13/d17/d29/d30 0 2024-04-25T17:19:13.315 INFO:tasks.workunit.client.0.smithi037.stdout:1/615: mknod dc/d24/cd2 0 2024-04-25T17:19:13.316 INFO:tasks.workunit.client.1.smithi069.stdout:6/366: read d2/d7/fd [4062793,68307] 0 2024-04-25T17:19:13.316 INFO:tasks.workunit.client.1.smithi069.stdout:9/416: truncate d2/da/dd/f90 147518 0 2024-04-25T17:19:13.320 INFO:tasks.workunit.client.1.smithi069.stdout:6/367: read d2/d1e/d43/f70 [2039780,42690] 0 2024-04-25T17:19:13.322 INFO:tasks.workunit.client.0.smithi037.stdout:9/712: symlink d1/d48/d68/d4e/lf3 0 2024-04-25T17:19:13.323 INFO:tasks.workunit.client.1.smithi069.stdout:6/368: write d2/d1e/f71 [1065901,57174] 0 2024-04-25T17:19:13.325 INFO:tasks.workunit.client.0.smithi037.stdout:2/611: dwrite d0/d15/f1d [0,4194304] 0 2024-04-25T17:19:13.326 INFO:tasks.workunit.client.1.smithi069.stdout:5/409: dwrite d13/d17/d19/d20/d2d/f5d [0,4194304] 0 2024-04-25T17:19:13.328 INFO:tasks.workunit.client.1.smithi069.stdout:5/410: write d13/d17/f7f [1043174,85215] 0 2024-04-25T17:19:13.330 INFO:tasks.workunit.client.1.smithi069.stdout:1/389: creat d1/d4/de/d44/d68/f75 x:0 0 0 2024-04-25T17:19:13.332 INFO:tasks.workunit.client.0.smithi037.stdout:9/713: dwrite d1/d48/d68/d26/f80 [4194304,4194304] 0 2024-04-25T17:19:13.334 INFO:tasks.workunit.client.1.smithi069.stdout:0/328: creat d0/da/db/d56/f78 x:0 0 0 2024-04-25T17:19:13.336 INFO:tasks.workunit.client.1.smithi069.stdout:4/383: creat db/d22/d24/d41/f87 x:0 0 0 2024-04-25T17:19:13.341 INFO:tasks.workunit.client.1.smithi069.stdout:0/329: dwrite d0/da/d24/f6d [0,4194304] 0 2024-04-25T17:19:13.342 INFO:tasks.workunit.client.1.smithi069.stdout:4/384: truncate db/d15/d20/d35/d63/d43/d48/f5e 720726 0 2024-04-25T17:19:13.343 INFO:tasks.workunit.client.1.smithi069.stdout:0/330: write d0/da/d24/f6d [2759629,69607] 0 2024-04-25T17:19:13.344 INFO:tasks.workunit.client.1.smithi069.stdout:6/369: creat d2/d1e/d3e/d74/d48/d73/f7c x:0 0 0 2024-04-25T17:19:13.346 INFO:tasks.workunit.client.0.smithi037.stdout:2/612: creat d0/d15/fc7 x:0 0 0 2024-04-25T17:19:13.353 INFO:tasks.workunit.client.0.smithi037.stdout:2/613: mkdir d0/d16/d20/d55/dc8 0 2024-04-25T17:19:13.356 INFO:tasks.workunit.client.0.smithi037.stdout:9/714: fdatasync d1/d5/dc/d3c/d3e/f59 0 2024-04-25T17:19:13.357 INFO:tasks.workunit.client.1.smithi069.stdout:6/370: dread d2/d1e/f71 [0,4194304] 0 2024-04-25T17:19:13.358 INFO:tasks.workunit.client.1.smithi069.stdout:6/371: stat d2/d1e/d3e/c4c 0 2024-04-25T17:19:13.358 INFO:tasks.workunit.client.0.smithi037.stdout:2/614: creat d0/d16/d20/d59/fc9 x:0 0 0 2024-04-25T17:19:13.360 INFO:tasks.workunit.client.0.smithi037.stdout:2/615: write d0/d15/fb3 [129851,62493] 0 2024-04-25T17:19:13.362 INFO:tasks.workunit.client.1.smithi069.stdout:4/385: read db/f11 [764369,24638] 0 2024-04-25T17:19:13.364 INFO:tasks.workunit.client.1.smithi069.stdout:3/483: sync 2024-04-25T17:19:13.368 INFO:tasks.workunit.client.0.smithi037.stdout:2/616: dwrite d0/d16/d20/d55/f60 [0,4194304] 0 2024-04-25T17:19:13.368 INFO:tasks.workunit.client.1.smithi069.stdout:4/386: dwrite db/d15/f1d [4194304,4194304] 0 2024-04-25T17:19:13.370 INFO:tasks.workunit.client.0.smithi037.stdout:1/616: dwrite dc/f62 [0,4194304] 0 2024-04-25T17:19:13.375 INFO:tasks.workunit.client.1.smithi069.stdout:4/387: creat db/d15/d20/d35/d63/d43/d48/d49/f88 x:0 0 0 2024-04-25T17:19:13.376 INFO:tasks.workunit.client.0.smithi037.stdout:2/617: mkdir d0/d16/d3b/dca 0 2024-04-25T17:19:13.376 INFO:tasks.workunit.client.1.smithi069.stdout:0/331: fsync d0/da/db/f13 0 2024-04-25T17:19:13.377 INFO:tasks.workunit.client.1.smithi069.stdout:4/388: readlink db/d15/d26/l51 0 2024-04-25T17:19:13.387 INFO:tasks.workunit.client.0.smithi037.stdout:2/618: mkdir d0/d15/dcb 0 2024-04-25T17:19:13.390 INFO:tasks.workunit.client.0.smithi037.stdout:1/617: rename dc/d18/f38 to dc/d1c/d57/d4d/d6a/d86/d9b/fd3 0 2024-04-25T17:19:13.391 INFO:tasks.workunit.client.1.smithi069.stdout:4/389: creat db/d4b/f89 x:0 0 0 2024-04-25T17:19:13.393 INFO:tasks.workunit.client.0.smithi037.stdout:2/619: dwrite d0/d16/d20/d55/f60 [0,4194304] 0 2024-04-25T17:19:13.394 INFO:tasks.workunit.client.1.smithi069.stdout:0/332: unlink d0/da/db/d1d/c39 0 2024-04-25T17:19:13.394 INFO:tasks.workunit.client.1.smithi069.stdout:0/333: stat d0/da/db/d56/f78 0 2024-04-25T17:19:13.395 INFO:tasks.workunit.client.1.smithi069.stdout:5/411: link f5 d13/d17/d19/d1c/f89 0 2024-04-25T17:19:13.396 INFO:tasks.workunit.client.1.smithi069.stdout:8/366: truncate f14 1103828 0 2024-04-25T17:19:13.396 INFO:tasks.workunit.client.1.smithi069.stdout:8/367: readlink d37/l6c 0 2024-04-25T17:19:13.397 INFO:tasks.workunit.client.1.smithi069.stdout:8/368: dread - d37/d47/d48/f71 zero size 2024-04-25T17:19:13.399 INFO:tasks.workunit.client.1.smithi069.stdout:1/390: getdents d1/d43 0 2024-04-25T17:19:13.399 INFO:tasks.workunit.client.0.smithi037.stdout:1/618: chown dc/d18/d66/cce 6803 1 2024-04-25T17:19:13.400 INFO:tasks.workunit.client.0.smithi037.stdout:2/620: dwrite d0/d23/f43 [0,4194304] 0 2024-04-25T17:19:13.405 INFO:tasks.workunit.client.0.smithi037.stdout:1/619: truncate dc/d1c/d57/d22/d36/d8c/fa2 854566 0 2024-04-25T17:19:13.406 INFO:tasks.workunit.client.0.smithi037.stdout:2/621: mknod d0/d23/dac/ccc 0 2024-04-25T17:19:13.407 INFO:tasks.workunit.client.0.smithi037.stdout:9/715: truncate d1/d48/d68/d1c/f91 2659153 0 2024-04-25T17:19:13.409 INFO:tasks.workunit.client.0.smithi037.stdout:9/716: write d1/d5/d19/d6e/fd6 [583251,79008] 0 2024-04-25T17:19:13.409 INFO:tasks.workunit.client.1.smithi069.stdout:4/390: mkdir db/d15/d20/d35/d63/d70/d8a 0 2024-04-25T17:19:13.409 INFO:tasks.workunit.client.1.smithi069.stdout:7/408: truncate d4/f10 6372409 0 2024-04-25T17:19:13.413 INFO:tasks.workunit.client.1.smithi069.stdout:8/369: rename d37/d62/f63 to d37/d47/d48/f7b 0 2024-04-25T17:19:13.414 INFO:tasks.workunit.client.1.smithi069.stdout:8/370: fdatasync d37/f50 0 2024-04-25T17:19:13.416 INFO:tasks.workunit.client.1.smithi069.stdout:9/417: mknod d2/c95 0 2024-04-25T17:19:13.417 INFO:tasks.workunit.client.1.smithi069.stdout:7/409: dwrite d4/d6/fa [0,4194304] 0 2024-04-25T17:19:13.418 INFO:tasks.workunit.client.1.smithi069.stdout:3/484: getdents d8/d39 0 2024-04-25T17:19:13.419 INFO:tasks.workunit.client.1.smithi069.stdout:4/391: creat db/d4b/d78/f8b x:0 0 0 2024-04-25T17:19:13.419 INFO:tasks.workunit.client.0.smithi037.stdout:2/622: symlink d0/d23/d7d/d56/lcd 0 2024-04-25T17:19:13.420 INFO:tasks.workunit.client.1.smithi069.stdout:3/485: write d8/d71/d8d/f8f [446336,111316] 0 2024-04-25T17:19:13.421 INFO:tasks.workunit.client.0.smithi037.stdout:2/623: write d0/d16/d3c/fbc [341493,29515] 0 2024-04-25T17:19:13.421 INFO:tasks.workunit.client.1.smithi069.stdout:3/486: dread - d8/d2a/fad zero size 2024-04-25T17:19:13.422 INFO:tasks.workunit.client.1.smithi069.stdout:3/487: chown d8/c24 2373 1 2024-04-25T17:19:13.422 INFO:tasks.workunit.client.0.smithi037.stdout:2/624: fdatasync d0/d16/d20/d59/d6a/f8c 0 2024-04-25T17:19:13.423 INFO:tasks.workunit.client.0.smithi037.stdout:2/625: readlink d0/d16/d26/l52 0 2024-04-25T17:19:13.424 INFO:tasks.workunit.client.0.smithi037.stdout:9/717: rename d1/d5/d2e/d34/d76/lb7 to d1/d48/d68/d26/d81/d9c/lf4 0 2024-04-25T17:19:13.425 INFO:tasks.workunit.client.0.smithi037.stdout:2/626: write d0/d16/d20/d59/d6a/f8c [460466,30622] 0 2024-04-25T17:19:13.428 INFO:tasks.workunit.client.1.smithi069.stdout:8/371: truncate d37/f59 715480 0 2024-04-25T17:19:13.432 INFO:tasks.workunit.client.0.smithi037.stdout:2/627: unlink d0/d16/d20/f8d 0 2024-04-25T17:19:13.436 INFO:tasks.workunit.client.1.smithi069.stdout:0/334: creat d0/f79 x:0 0 0 2024-04-25T17:19:13.436 INFO:tasks.workunit.client.1.smithi069.stdout:6/372: write d2/d7/f44 [1347887,120591] 0 2024-04-25T17:19:13.438 INFO:tasks.workunit.client.0.smithi037.stdout:2/628: dwrite d0/d15/d2a/d5a/faa [0,4194304] 0 2024-04-25T17:19:13.442 INFO:tasks.workunit.client.1.smithi069.stdout:4/392: creat db/d15/d20/d35/f8c x:0 0 0 2024-04-25T17:19:13.443 INFO:tasks.workunit.client.1.smithi069.stdout:4/393: readlink db/d15/d20/d35/d63/l6f 0 2024-04-25T17:19:13.444 INFO:tasks.workunit.client.0.smithi037.stdout:2/629: creat d0/d16/d20/d59/d6a/da5/fce x:0 0 0 2024-04-25T17:19:13.445 INFO:tasks.workunit.client.1.smithi069.stdout:4/394: truncate db/d15/d20/d35/f8c 932144 0 2024-04-25T17:19:13.450 INFO:tasks.workunit.client.1.smithi069.stdout:6/373: mkdir d2/d1e/d43/d7d 0 2024-04-25T17:19:13.454 INFO:tasks.workunit.client.1.smithi069.stdout:4/395: mkdir db/d22/d8d 0 2024-04-25T17:19:13.456 INFO:tasks.workunit.client.0.smithi037.stdout:2/630: dwrite d0/d23/dac/f87 [0,4194304] 0 2024-04-25T17:19:13.456 INFO:tasks.workunit.client.1.smithi069.stdout:7/410: fsync d4/f10 0 2024-04-25T17:19:13.457 INFO:tasks.workunit.client.0.smithi037.stdout:2/631: write d0/d15/f48 [2114863,31518] 0 2024-04-25T17:19:13.458 INFO:tasks.workunit.client.1.smithi069.stdout:4/396: dread db/d15/d20/d35/d63/d43/d48/f5e [0,4194304] 0 2024-04-25T17:19:13.459 INFO:tasks.workunit.client.1.smithi069.stdout:8/372: rmdir d37/d47/d48 39 2024-04-25T17:19:13.459 INFO:tasks.workunit.client.1.smithi069.stdout:8/373: chown d37/d47/l69 881433216 1 2024-04-25T17:19:13.461 INFO:tasks.workunit.client.1.smithi069.stdout:6/374: stat d2/d1e/d3e/d74/d48/c78 0 2024-04-25T17:19:13.461 INFO:tasks.workunit.client.1.smithi069.stdout:7/411: read d4/d6/f59 [3107136,37336] 0 2024-04-25T17:19:13.462 INFO:tasks.workunit.client.1.smithi069.stdout:7/412: fsync d4/d6/d14/d5a/f7f 0 2024-04-25T17:19:13.462 INFO:tasks.workunit.client.1.smithi069.stdout:7/413: stat d4/d6/c55 0 2024-04-25T17:19:13.464 INFO:tasks.workunit.client.0.smithi037.stdout:1/620: truncate dc/d18/d64/f9e 3454547 0 2024-04-25T17:19:13.466 INFO:tasks.workunit.client.0.smithi037.stdout:2/632: symlink d0/d23/d7d/lcf 0 2024-04-25T17:19:13.471 INFO:tasks.workunit.client.0.smithi037.stdout:2/633: unlink d0/d16/d20/d59/f97 0 2024-04-25T17:19:13.475 INFO:tasks.workunit.client.1.smithi069.stdout:4/397: symlink db/d15/d42/l8e 0 2024-04-25T17:19:13.479 INFO:tasks.workunit.client.1.smithi069.stdout:1/391: dwrite d1/df/d17/f70 [4194304,4194304] 0 2024-04-25T17:19:13.481 INFO:tasks.workunit.client.0.smithi037.stdout:9/718: dwrite d1/d5/dc/f23 [0,4194304] 0 2024-04-25T17:19:13.482 INFO:tasks.workunit.client.1.smithi069.stdout:1/392: write d1/d43/d35/f64 [350849,92915] 0 2024-04-25T17:19:13.482 INFO:tasks.workunit.client.1.smithi069.stdout:0/335: link d0/da/d59/f61 d0/d38/f7a 0 2024-04-25T17:19:13.482 INFO:tasks.workunit.client.1.smithi069.stdout:8/374: dwrite ff [0,4194304] 0 2024-04-25T17:19:13.484 INFO:tasks.workunit.client.0.smithi037.stdout:6/524: sync 2024-04-25T17:19:13.491 INFO:tasks.workunit.client.1.smithi069.stdout:1/393: dwrite d1/d43/d35/d4d/f57 [0,4194304] 0 2024-04-25T17:19:13.491 INFO:tasks.workunit.client.1.smithi069.stdout:4/398: write db/d15/d20/d35/d63/d43/d48/f5e [852913,76731] 0 2024-04-25T17:19:13.493 INFO:tasks.workunit.client.1.smithi069.stdout:4/399: dread - db/d22/d24/d41/f47 zero size 2024-04-25T17:19:13.497 INFO:tasks.workunit.client.1.smithi069.stdout:6/375: dread d2/f2d [0,4194304] 0 2024-04-25T17:19:13.507 INFO:tasks.workunit.client.0.smithi037.stdout:1/621: write dc/d18/d66/f90 [59577,26601] 0 2024-04-25T17:19:13.507 INFO:tasks.workunit.client.1.smithi069.stdout:7/414: creat d4/f86 x:0 0 0 2024-04-25T17:19:13.507 INFO:tasks.workunit.client.1.smithi069.stdout:1/394: fsync d1/d43/d35/d1d/f5e 0 2024-04-25T17:19:13.508 INFO:tasks.workunit.client.0.smithi037.stdout:1/622: chown dc/d1c/d57/d4d/d6a/d8f/fc5 15126727 1 2024-04-25T17:19:13.513 INFO:tasks.workunit.client.1.smithi069.stdout:2/363: sync 2024-04-25T17:19:13.513 INFO:tasks.workunit.client.1.smithi069.stdout:6/376: mkdir d2/d1e/d3f/d56/d7e 0 2024-04-25T17:19:13.515 INFO:tasks.workunit.client.0.smithi037.stdout:2/634: truncate d0/d16/d3c/fbc 41537 0 2024-04-25T17:19:13.519 INFO:tasks.workunit.client.1.smithi069.stdout:2/364: dwrite d0/d56/f5e [0,4194304] 0 2024-04-25T17:19:13.520 INFO:tasks.workunit.client.0.smithi037.stdout:2/635: mknod d0/d15/d2a/cd0 0 2024-04-25T17:19:13.520 INFO:tasks.workunit.client.1.smithi069.stdout:2/365: dread - d0/d1/d5b/d28/d31/f6b zero size 2024-04-25T17:19:13.521 INFO:tasks.workunit.client.1.smithi069.stdout:2/366: chown d0/d26/d10/f5c 180860290 1 2024-04-25T17:19:13.521 INFO:tasks.workunit.client.1.smithi069.stdout:2/367: chown d0/d1/d5b/d33/c3b 6 1 2024-04-25T17:19:13.522 INFO:tasks.workunit.client.1.smithi069.stdout:4/400: symlink db/d15/d20/l8f 0 2024-04-25T17:19:13.523 INFO:tasks.workunit.client.1.smithi069.stdout:4/401: fsync db/d15/d20/d35/f66 0 2024-04-25T17:19:13.524 INFO:tasks.workunit.client.1.smithi069.stdout:8/375: creat d37/f7c x:0 0 0 2024-04-25T17:19:13.526 INFO:tasks.workunit.client.1.smithi069.stdout:8/376: read f13 [1995886,41453] 0 2024-04-25T17:19:13.526 INFO:tasks.workunit.client.1.smithi069.stdout:9/418: link d2/da/dd/de/c3a d2/da/dd/de/d59/d7f/c96 0 2024-04-25T17:19:13.533 INFO:tasks.workunit.client.0.smithi037.stdout:1/623: rename dc/d18/d64/f9e to dc/d1c/d57/d4d/d6a/d86/d91/fd4 0 2024-04-25T17:19:13.536 INFO:tasks.workunit.client.1.smithi069.stdout:0/336: dwrite d0/f8 [0,4194304] 0 2024-04-25T17:19:13.537 INFO:tasks.workunit.client.1.smithi069.stdout:0/337: read - d0/f79 zero size 2024-04-25T17:19:13.537 INFO:tasks.workunit.client.0.smithi037.stdout:1/624: unlink dc/d1c/d57/d4d/c78 0 2024-04-25T17:19:13.539 INFO:tasks.workunit.client.1.smithi069.stdout:7/415: mkdir d4/d6/d87 0 2024-04-25T17:19:13.540 INFO:tasks.workunit.client.1.smithi069.stdout:1/395: creat d1/d4/de/f76 x:0 0 0 2024-04-25T17:19:13.540 INFO:tasks.workunit.client.1.smithi069.stdout:1/396: dread - d1/d43/f5b zero size 2024-04-25T17:19:13.541 INFO:tasks.workunit.client.1.smithi069.stdout:2/368: creat d0/d1/d5b/d28/d31/d61/f75 x:0 0 0 2024-04-25T17:19:13.543 INFO:tasks.workunit.client.1.smithi069.stdout:8/377: dread d37/f41 [0,4194304] 0 2024-04-25T17:19:13.550 INFO:tasks.workunit.client.1.smithi069.stdout:0/338: fdatasync d0/da/db/d1d/d27/f45 0 2024-04-25T17:19:13.551 INFO:tasks.workunit.client.1.smithi069.stdout:9/419: dread d2/f39 [0,4194304] 0 2024-04-25T17:19:13.552 INFO:tasks.workunit.client.1.smithi069.stdout:7/416: write d4/d1a/d34/f65 [66030,73913] 0 2024-04-25T17:19:13.552 INFO:tasks.workunit.client.0.smithi037.stdout:1/625: creat dc/d1c/d57/d4d/d6a/d86/d9b/fd5 x:0 0 0 2024-04-25T17:19:13.552 INFO:tasks.workunit.client.1.smithi069.stdout:1/397: readlink d1/d4/l71 0 2024-04-25T17:19:13.553 INFO:tasks.workunit.client.1.smithi069.stdout:9/420: write d2/da/dd/d1e/f26 [155619,8148] 0 2024-04-25T17:19:13.555 INFO:tasks.workunit.client.1.smithi069.stdout:9/421: chown d2/da/dd/de/f4a 3149 1 2024-04-25T17:19:13.555 INFO:tasks.workunit.client.1.smithi069.stdout:7/417: truncate d4/d6/d14/d5a/f6c 72973 0 2024-04-25T17:19:13.555 INFO:tasks.workunit.client.0.smithi037.stdout:1/626: creat dc/d1c/d57/d4d/d6a/d8f/fd6 x:0 0 0 2024-04-25T17:19:13.556 INFO:tasks.workunit.client.1.smithi069.stdout:9/422: stat d2/da/dd/d1e/d2e/d35/f5a 0 2024-04-25T17:19:13.557 INFO:tasks.workunit.client.1.smithi069.stdout:6/377: getdents d2/d1e/d3f/d56 0 2024-04-25T17:19:13.559 INFO:tasks.workunit.client.0.smithi037.stdout:1/627: unlink dc/d1c/d57/d43/c89 0 2024-04-25T17:19:13.562 INFO:tasks.workunit.client.1.smithi069.stdout:6/378: dwrite d2/fe [4194304,4194304] 0 2024-04-25T17:19:13.566 INFO:tasks.workunit.client.1.smithi069.stdout:1/398: rmdir d1/d43/d1b/d32/d4a 39 2024-04-25T17:19:13.568 INFO:tasks.workunit.client.1.smithi069.stdout:2/369: dwrite d0/d1/fe [0,4194304] 0 2024-04-25T17:19:13.569 INFO:tasks.workunit.client.1.smithi069.stdout:2/370: chown d0/d1/d5b/d28/l40 6 1 2024-04-25T17:19:13.570 INFO:tasks.workunit.client.1.smithi069.stdout:2/371: dread - d0/d1/d5b/d28/d31/d61/f75 zero size 2024-04-25T17:19:13.572 INFO:tasks.workunit.client.1.smithi069.stdout:2/372: chown d0/d1/d5b/d28/d31/f6a 888203127 1 2024-04-25T17:19:13.574 INFO:tasks.workunit.client.0.smithi037.stdout:1/628: rename dc/d1c/d57/d4d/d6a/d86/d9b/cae to dc/d1c/d57/d22/d36/d92/cd7 0 2024-04-25T17:19:13.578 INFO:tasks.workunit.client.0.smithi037.stdout:1/629: mkdir dc/d18/d66/dd8 0 2024-04-25T17:19:13.579 INFO:tasks.workunit.client.1.smithi069.stdout:4/402: link db/d15/d20/d38/c58 db/d15/d42/d53/c90 0 2024-04-25T17:19:13.580 INFO:tasks.workunit.client.1.smithi069.stdout:9/423: rename d2/da/dd/d1e/d2e/d35/l62 to d2/da/dd/de/d59/d7f/l97 0 2024-04-25T17:19:13.581 INFO:tasks.workunit.client.1.smithi069.stdout:6/379: mknod d2/d1e/d43/c7f 0 2024-04-25T17:19:13.582 INFO:tasks.workunit.client.1.smithi069.stdout:8/378: dwrite d37/d47/d48/f7b [4194304,4194304] 0 2024-04-25T17:19:13.584 INFO:tasks.workunit.client.1.smithi069.stdout:1/399: stat d1/d43/d1b/d32/d4a 0 2024-04-25T17:19:13.585 INFO:tasks.workunit.client.1.smithi069.stdout:1/400: fsync d1/df/d17/f2f 0 2024-04-25T17:19:13.585 INFO:tasks.workunit.client.1.smithi069.stdout:2/373: symlink d0/d56/d5f/d62/l76 0 2024-04-25T17:19:13.587 INFO:tasks.workunit.client.1.smithi069.stdout:9/424: creat d2/da/dd/d1e/d2e/d35/f98 x:0 0 0 2024-04-25T17:19:13.588 INFO:tasks.workunit.client.1.smithi069.stdout:0/339: link d0/da/d24/f42 d0/d38/d75/f7b 0 2024-04-25T17:19:13.591 INFO:tasks.workunit.client.0.smithi037.stdout:1/630: rename dc/d1c/d57 to dc/d52/d6b/dd9 0 2024-04-25T17:19:13.593 INFO:tasks.workunit.client.1.smithi069.stdout:7/418: rename d4/d6/d14/d3d/d5b to d4/d6/d14/d44/d88 0 2024-04-25T17:19:13.596 INFO:tasks.workunit.client.0.smithi037.stdout:1/631: creat dc/d24/da5/fda x:0 0 0 2024-04-25T17:19:13.598 INFO:tasks.workunit.client.1.smithi069.stdout:8/379: creat d37/d47/d54/d6e/f7d x:0 0 0 2024-04-25T17:19:13.598 INFO:tasks.workunit.client.1.smithi069.stdout:8/380: chown d37/d47/c67 8320218 1 2024-04-25T17:19:13.600 INFO:tasks.workunit.client.1.smithi069.stdout:2/374: mkdir d0/d77 0 2024-04-25T17:19:13.601 INFO:tasks.workunit.client.1.smithi069.stdout:7/419: rename d4/d6/d87 to d4/d6/d14/d5a/d5e/d89 0 2024-04-25T17:19:13.602 INFO:tasks.workunit.client.1.smithi069.stdout:6/380: creat d2/d7/f80 x:0 0 0 2024-04-25T17:19:13.604 INFO:tasks.workunit.client.1.smithi069.stdout:6/381: dread d2/d1e/d3e/d67/f69 [0,4194304] 0 2024-04-25T17:19:13.604 INFO:tasks.workunit.client.1.smithi069.stdout:8/381: creat d37/d66/d6b/f7e x:0 0 0 2024-04-25T17:19:13.604 INFO:tasks.workunit.client.1.smithi069.stdout:6/382: fsync d2/f9 0 2024-04-25T17:19:13.605 INFO:tasks.workunit.client.1.smithi069.stdout:9/425: truncate d2/f24 1476168 0 2024-04-25T17:19:13.606 INFO:tasks.workunit.client.1.smithi069.stdout:2/375: mknod d0/d56/d5f/d62/c78 0 2024-04-25T17:19:13.607 INFO:tasks.workunit.client.1.smithi069.stdout:7/420: unlink d4/f86 0 2024-04-25T17:19:13.608 INFO:tasks.workunit.client.1.smithi069.stdout:1/401: link d1/d43/d35/c6d d1/d43/d1b/d32/d4a/d4b/c77 0 2024-04-25T17:19:13.611 INFO:tasks.workunit.client.1.smithi069.stdout:8/382: symlink d37/d66/l7f 0 2024-04-25T17:19:13.613 INFO:tasks.workunit.client.1.smithi069.stdout:6/383: symlink d2/d1e/d3e/d74/d48/l81 0 2024-04-25T17:19:13.614 INFO:tasks.workunit.client.1.smithi069.stdout:8/383: dread d37/d47/d48/f7b [4194304,4194304] 0 2024-04-25T17:19:13.614 INFO:tasks.workunit.client.0.smithi037.stdout:1/632: dread dc/d1c/f58 [0,4194304] 0 2024-04-25T17:19:13.620 INFO:tasks.workunit.client.0.smithi037.stdout:1/633: truncate dc/d52/d6b/dd9/fb9 684855 0 2024-04-25T17:19:13.624 INFO:tasks.workunit.client.1.smithi069.stdout:9/426: rename d2/c71 to d2/da/dd/d1e/d40/c99 0 2024-04-25T17:19:13.626 INFO:tasks.workunit.client.0.smithi037.stdout:1/634: unlink dc/d52/d6b/dd9/d4d/d6a/f95 0 2024-04-25T17:19:13.626 INFO:tasks.workunit.client.1.smithi069.stdout:0/340: dwrite d0/da/d59/f61 [0,4194304] 0 2024-04-25T17:19:13.628 INFO:tasks.workunit.client.1.smithi069.stdout:0/341: write d0/da/db/d2c/f4d [5953387,72109] 0 2024-04-25T17:19:13.629 INFO:tasks.workunit.client.1.smithi069.stdout:7/421: write d4/d6/d14/d15/f28 [490392,30611] 0 2024-04-25T17:19:13.634 INFO:tasks.workunit.client.1.smithi069.stdout:1/402: rename d1/d4/de/d44/d68/c6b to d1/df/d17/c78 0 2024-04-25T17:19:13.636 INFO:tasks.workunit.client.1.smithi069.stdout:2/376: rmdir d0/d77 0 2024-04-25T17:19:13.639 INFO:tasks.workunit.client.1.smithi069.stdout:1/403: dread d1/df/d17/f2f [0,4194304] 0 2024-04-25T17:19:13.639 INFO:tasks.workunit.client.1.smithi069.stdout:7/422: chown l0 148 1 2024-04-25T17:19:13.640 INFO:tasks.workunit.client.1.smithi069.stdout:6/384: rename d2/d1e/d3e/d74/d48/c78 to d2/d1e/d3f/c82 0 2024-04-25T17:19:13.642 INFO:tasks.workunit.client.1.smithi069.stdout:1/404: write d1/d19/f41 [1022595,122378] 0 2024-04-25T17:19:13.642 INFO:tasks.workunit.client.1.smithi069.stdout:8/384: link d37/l3d d37/d66/d6b/l80 0 2024-04-25T17:19:13.644 INFO:tasks.workunit.client.1.smithi069.stdout:8/385: fsync d37/d66/d6b/f7e 0 2024-04-25T17:19:13.644 INFO:tasks.workunit.client.1.smithi069.stdout:7/423: unlink d4/d1a/c74 0 2024-04-25T17:19:13.644 INFO:tasks.workunit.client.1.smithi069.stdout:2/377: dwrite d0/d1/d5b/f6e [0,4194304] 0 2024-04-25T17:19:13.646 INFO:tasks.workunit.client.1.smithi069.stdout:2/378: stat d0/d26/l45 0 2024-04-25T17:19:13.647 INFO:tasks.workunit.client.1.smithi069.stdout:2/379: dread - d0/d56/d5f/f71 zero size 2024-04-25T17:19:13.651 INFO:tasks.workunit.client.1.smithi069.stdout:9/427: truncate d2/da/dd/d1e/f5e 427373 0 2024-04-25T17:19:13.651 INFO:tasks.workunit.client.1.smithi069.stdout:0/342: creat d0/f7c x:0 0 0 2024-04-25T17:19:13.653 INFO:tasks.workunit.client.1.smithi069.stdout:6/385: mknod d2/d1e/d3e/d74/d48/c83 0 2024-04-25T17:19:13.654 INFO:tasks.workunit.client.1.smithi069.stdout:8/386: dwrite d37/d47/f60 [0,4194304] 0 2024-04-25T17:19:13.655 INFO:tasks.workunit.client.1.smithi069.stdout:6/386: chown d2/d2e/f7b 1557821762 1 2024-04-25T17:19:13.656 INFO:tasks.workunit.client.1.smithi069.stdout:8/387: write d37/d66/f74 [141049,21550] 0 2024-04-25T17:19:13.656 INFO:tasks.workunit.client.1.smithi069.stdout:2/380: symlink d0/d56/d5f/d62/l79 0 2024-04-25T17:19:13.659 INFO:tasks.workunit.client.1.smithi069.stdout:5/412: sync 2024-04-25T17:19:13.660 INFO:tasks.workunit.client.1.smithi069.stdout:3/488: sync 2024-04-25T17:19:13.660 INFO:tasks.workunit.client.1.smithi069.stdout:0/343: mkdir d0/da/d54/d7d 0 2024-04-25T17:19:13.660 INFO:tasks.workunit.client.1.smithi069.stdout:3/489: fsync d8/d2a/f82 0 2024-04-25T17:19:13.662 INFO:tasks.workunit.client.1.smithi069.stdout:6/387: mkdir d2/d1e/d3f/d56/d84 0 2024-04-25T17:19:13.662 INFO:tasks.workunit.client.1.smithi069.stdout:3/490: dread d8/d2a/f55 [0,4194304] 0 2024-04-25T17:19:13.665 INFO:tasks.workunit.client.1.smithi069.stdout:8/388: stat d37/c46 0 2024-04-25T17:19:13.665 INFO:tasks.workunit.client.1.smithi069.stdout:8/389: dread - d37/d47/d54/f7a zero size 2024-04-25T17:19:13.667 INFO:tasks.workunit.client.1.smithi069.stdout:7/424: truncate d4/d6/d14/f48 447296 0 2024-04-25T17:19:13.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:13 smithi069 ceph-mon[34527]: pgmap v37: 65 pgs: 65 active+clean; 1.9 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 57 MiB/s rd, 236 MiB/s wr, 441 op/s 2024-04-25T17:19:13.668 INFO:tasks.workunit.client.1.smithi069.stdout:9/428: mknod d2/da/dd/de/d64/c9a 0 2024-04-25T17:19:13.669 INFO:tasks.workunit.client.1.smithi069.stdout:7/425: dread - d4/d6/d14/d44/d79/d23/f7d zero size 2024-04-25T17:19:13.672 INFO:tasks.workunit.client.1.smithi069.stdout:8/390: dwrite f12 [0,4194304] 0 2024-04-25T17:19:13.675 INFO:tasks.workunit.client.1.smithi069.stdout:7/426: write d4/d6/d14/d3d/f69 [703702,23294] 0 2024-04-25T17:19:13.678 INFO:tasks.workunit.client.1.smithi069.stdout:9/429: dwrite d2/da/d5f/f6d [0,4194304] 0 2024-04-25T17:19:13.678 INFO:tasks.workunit.client.1.smithi069.stdout:9/430: chown d2/da/dd/de/d74/d8a 20124 1 2024-04-25T17:19:13.679 INFO:tasks.workunit.client.1.smithi069.stdout:5/413: rename d13/d17/d29/d30/d55 to d13/d17/d19/d8a 0 2024-04-25T17:19:13.710 INFO:tasks.workunit.client.0.smithi037.stdout:4/721: sync 2024-04-25T17:19:13.710 INFO:tasks.workunit.client.0.smithi037.stdout:8/505: sync 2024-04-25T17:19:13.713 INFO:tasks.workunit.client.0.smithi037.stdout:4/722: symlink d7/d7e/d1e/d2b/dbd/lea 0 2024-04-25T17:19:13.714 INFO:tasks.workunit.client.0.smithi037.stdout:4/723: chown d7/d7e/d1e/d2b/d35/d39/d7a/dcc/fe4 3014361 1 2024-04-25T17:19:13.720 INFO:tasks.workunit.client.1.smithi069.stdout:2/381: truncate d0/f7 4167078 0 2024-04-25T17:19:13.720 INFO:tasks.workunit.client.1.smithi069.stdout:8/391: mknod d37/d47/d54/c81 0 2024-04-25T17:19:13.721 INFO:tasks.workunit.client.1.smithi069.stdout:8/392: stat d37/d47/c6a 0 2024-04-25T17:19:13.722 INFO:tasks.workunit.client.1.smithi069.stdout:2/382: write d0/d1/d5b/d28/d31/f48 [986081,83850] 0 2024-04-25T17:19:13.733 INFO:tasks.workunit.client.1.smithi069.stdout:5/414: dread d13/d17/f1d [0,4194304] 0 2024-04-25T17:19:13.745 INFO:tasks.workunit.client.0.smithi037.stdout:4/724: mknod d7/d7e/d1e/d2b/ceb 0 2024-04-25T17:19:13.746 INFO:tasks.workunit.client.0.smithi037.stdout:8/506: write d5/f27 [1624103,57240] 0 2024-04-25T17:19:13.748 INFO:tasks.workunit.client.1.smithi069.stdout:6/388: rename d2/d2e to d2/d51/d85 0 2024-04-25T17:19:13.749 INFO:tasks.workunit.client.1.smithi069.stdout:9/431: symlink d2/da/d5f/d76/l9b 0 2024-04-25T17:19:13.753 INFO:tasks.workunit.client.1.smithi069.stdout:4/403: sync 2024-04-25T17:19:13.758 INFO:tasks.workunit.client.1.smithi069.stdout:5/415: creat d13/f8b x:0 0 0 2024-04-25T17:19:13.762 INFO:tasks.workunit.client.1.smithi069.stdout:2/383: write d0/d1/f20 [1460772,64024] 0 2024-04-25T17:19:13.762 INFO:tasks.workunit.client.1.smithi069.stdout:9/432: dread - d2/d51/f8b zero size 2024-04-25T17:19:13.763 INFO:tasks.workunit.client.1.smithi069.stdout:2/384: fsync d0/d1/d5b/d33/f39 0 2024-04-25T17:19:13.764 INFO:tasks.workunit.client.1.smithi069.stdout:2/385: truncate d0/d56/d5f/f71 226000 0 2024-04-25T17:19:13.766 INFO:tasks.workunit.client.1.smithi069.stdout:7/427: creat d4/d6/f8a x:0 0 0 2024-04-25T17:19:13.769 INFO:tasks.workunit.client.1.smithi069.stdout:5/416: creat d13/f8c x:0 0 0 2024-04-25T17:19:13.770 INFO:tasks.workunit.client.1.smithi069.stdout:3/491: rename d8/d16/d1a/d2c/d6c/c78 to d8/d39/cae 0 2024-04-25T17:19:13.774 INFO:tasks.workunit.client.1.smithi069.stdout:4/404: link db/d22/d24/d41/f47 db/d15/d26/f91 0 2024-04-25T17:19:13.775 INFO:tasks.workunit.client.1.smithi069.stdout:7/428: creat d4/d6/d14/d44/f8b x:0 0 0 2024-04-25T17:19:13.789 INFO:tasks.workunit.client.0.smithi037.stdout:8/507: mkdir d5/db/d18/d3b/d50/da0/da6 0 2024-04-25T17:19:13.803 INFO:tasks.workunit.client.0.smithi037.stdout:8/508: dwrite d5/d6a/f3f [0,4194304] 0 2024-04-25T17:19:13.803 INFO:tasks.workunit.client.0.smithi037.stdout:4/725: dread d7/d7e/d1e/d2b/d35/f3e [0,4194304] 0 2024-04-25T17:19:13.805 INFO:tasks.workunit.client.0.smithi037.stdout:8/509: mknod d5/db/ca7 0 2024-04-25T17:19:13.809 INFO:tasks.workunit.client.0.smithi037.stdout:8/510: mkdir d5/db/d18/d3b/d50/da0/da6/da8 0 2024-04-25T17:19:13.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:13 smithi037 ceph-mon[26472]: pgmap v37: 65 pgs: 65 active+clean; 1.9 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 57 MiB/s rd, 236 MiB/s wr, 441 op/s 2024-04-25T17:19:13.827 INFO:tasks.workunit.client.0.smithi037.stdout:0/600: sync 2024-04-25T17:19:13.828 INFO:tasks.workunit.client.1.smithi069.stdout:8/393: link d37/d47/d48/c5f d37/d66/d6b/c82 0 2024-04-25T17:19:13.828 INFO:tasks.workunit.client.1.smithi069.stdout:5/417: mknod d13/d17/d29/c8d 0 2024-04-25T17:19:13.828 INFO:tasks.workunit.client.1.smithi069.stdout:3/492: creat d8/d71/faf x:0 0 0 2024-04-25T17:19:13.829 INFO:tasks.workunit.client.1.smithi069.stdout:3/493: stat d8 0 2024-04-25T17:19:13.831 INFO:tasks.workunit.client.1.smithi069.stdout:4/405: dread f0 [4194304,4194304] 0 2024-04-25T17:19:13.831 INFO:tasks.workunit.client.0.smithi037.stdout:8/511: rename d5/c37 to d5/db/d23/d42/ca9 0 2024-04-25T17:19:13.833 INFO:tasks.workunit.client.0.smithi037.stdout:4/726: dwrite d7/d7e/d1e/dae/fd0 [4194304,4194304] 0 2024-04-25T17:19:13.833 INFO:tasks.workunit.client.1.smithi069.stdout:5/418: dread d13/d17/d19/d20/d2d/f56 [0,4194304] 0 2024-04-25T17:19:13.836 INFO:tasks.workunit.client.0.smithi037.stdout:8/512: truncate d5/db/d18/d3b/d50/f7d 450657 0 2024-04-25T17:19:13.836 INFO:tasks.workunit.client.0.smithi037.stdout:0/601: rename d9/df/d32/d35/fb8 to d9/d14/d28/d48/d58/dc4/fca 0 2024-04-25T17:19:13.836 INFO:tasks.workunit.client.1.smithi069.stdout:7/429: fdatasync d4/d1a/f35 0 2024-04-25T17:19:13.837 INFO:tasks.workunit.client.1.smithi069.stdout:6/389: getdents d2/d1e/d3e/d74/d48/d73 0 2024-04-25T17:19:13.838 INFO:tasks.workunit.client.1.smithi069.stdout:7/430: write d4/d6/d14/d15/f63 [24302,116340] 0 2024-04-25T17:19:13.840 INFO:tasks.workunit.client.0.smithi037.stdout:4/727: symlink d7/d7e/d1e/d2b/d35/d39/d83/lec 0 2024-04-25T17:19:13.842 INFO:tasks.workunit.client.1.smithi069.stdout:8/394: rename d37/d47/d48/f4e to d37/d47/d48/f83 0 2024-04-25T17:19:13.843 INFO:tasks.workunit.client.0.smithi037.stdout:8/513: readlink d5/d26/l2e 0 2024-04-25T17:19:13.845 INFO:tasks.workunit.client.1.smithi069.stdout:4/406: mkdir db/d22/d24/d41/d92 0 2024-04-25T17:19:13.848 INFO:tasks.workunit.client.1.smithi069.stdout:2/386: dread d0/f7 [0,4194304] 0 2024-04-25T17:19:13.848 INFO:tasks.workunit.client.0.smithi037.stdout:8/514: dread d5/d26/d33/f34 [0,4194304] 0 2024-04-25T17:19:13.848 INFO:tasks.workunit.client.1.smithi069.stdout:5/419: rename d13/f80 to d13/d17/d19/d8a/f8e 0 2024-04-25T17:19:13.851 INFO:tasks.workunit.client.1.smithi069.stdout:1/405: sync 2024-04-25T17:19:13.852 INFO:tasks.workunit.client.1.smithi069.stdout:1/406: write d1/d43/d35/f53 [501988,77470] 0 2024-04-25T17:19:13.853 INFO:tasks.workunit.client.1.smithi069.stdout:6/390: mkdir d2/d1e/d3f/d86 0 2024-04-25T17:19:13.856 INFO:tasks.workunit.client.1.smithi069.stdout:1/407: dread d1/d43/d35/f14 [4194304,4194304] 0 2024-04-25T17:19:13.856 INFO:tasks.workunit.client.0.smithi037.stdout:4/728: creat d7/d7e/d45/fed x:0 0 0 2024-04-25T17:19:13.858 INFO:tasks.workunit.client.0.smithi037.stdout:8/515: mkdir d5/db/d23/daa 0 2024-04-25T17:19:13.862 INFO:tasks.workunit.client.0.smithi037.stdout:8/516: fsync d5/da/f11 0 2024-04-25T17:19:13.864 INFO:tasks.workunit.client.0.smithi037.stdout:8/517: write d5/d6a/f7a [2075416,62546] 0 2024-04-25T17:19:13.866 INFO:tasks.workunit.client.1.smithi069.stdout:4/407: symlink db/d4b/l93 0 2024-04-25T17:19:13.870 INFO:tasks.workunit.client.1.smithi069.stdout:2/387: creat d0/d26/d10/d43/f7a x:0 0 0 2024-04-25T17:19:13.870 INFO:tasks.workunit.client.0.smithi037.stdout:4/729: write d7/d7e/d4e/f6d [3839532,75813] 0 2024-04-25T17:19:13.871 INFO:tasks.workunit.client.1.smithi069.stdout:6/391: dread d2/d7/f12 [0,4194304] 0 2024-04-25T17:19:13.872 INFO:tasks.workunit.client.1.smithi069.stdout:5/420: creat d13/d17/d29/d30/d5c/f8f x:0 0 0 2024-04-25T17:19:13.872 INFO:tasks.workunit.client.0.smithi037.stdout:4/730: dread - d7/d7e/d1e/d2b/d35/d39/d7a/dcc/fe4 zero size 2024-04-25T17:19:13.876 INFO:tasks.workunit.client.1.smithi069.stdout:7/431: dwrite d4/d6/d14/d5a/f6c [0,4194304] 0 2024-04-25T17:19:13.876 INFO:tasks.workunit.client.0.smithi037.stdout:8/518: creat d5/db/d23/fab x:0 0 0 2024-04-25T17:19:13.876 INFO:tasks.workunit.client.0.smithi037.stdout:8/519: fsync d5/f9 0 2024-04-25T17:19:13.877 INFO:tasks.workunit.client.1.smithi069.stdout:4/408: dwrite db/d15/d20/d35/d63/f5c [0,4194304] 0 2024-04-25T17:19:13.878 INFO:tasks.workunit.client.1.smithi069.stdout:8/395: creat d37/d47/d78/f84 x:0 0 0 2024-04-25T17:19:13.879 INFO:tasks.workunit.client.1.smithi069.stdout:7/432: truncate d4/d6/d14/d5a/f7f 307356 0 2024-04-25T17:19:13.881 INFO:tasks.workunit.client.1.smithi069.stdout:0/344: sync 2024-04-25T17:19:13.883 INFO:tasks.workunit.client.1.smithi069.stdout:1/408: write d1/f5 [7723013,14134] 0 2024-04-25T17:19:13.885 INFO:tasks.workunit.client.1.smithi069.stdout:1/409: write d1/d43/f3a [241221,249] 0 2024-04-25T17:19:13.886 INFO:tasks.workunit.client.1.smithi069.stdout:4/409: dwrite db/d15/d26/f62 [0,4194304] 0 2024-04-25T17:19:13.888 INFO:tasks.workunit.client.1.smithi069.stdout:5/421: symlink d13/l90 0 2024-04-25T17:19:13.888 INFO:tasks.workunit.client.1.smithi069.stdout:5/422: chown d13/d17/d62 3 1 2024-04-25T17:19:13.892 INFO:tasks.workunit.client.0.smithi037.stdout:8/520: creat d5/db/d18/d3b/d50/d51/fac x:0 0 0 2024-04-25T17:19:13.893 INFO:tasks.workunit.client.1.smithi069.stdout:1/410: dwrite d1/d4/d6/f7 [0,4194304] 0 2024-04-25T17:19:13.898 INFO:tasks.workunit.client.0.smithi037.stdout:4/731: dread d7/d7e/d5b/f8c [0,4194304] 0 2024-04-25T17:19:13.899 INFO:tasks.workunit.client.1.smithi069.stdout:4/410: mknod db/d15/d20/d35/d63/c94 0 2024-04-25T17:19:13.900 INFO:tasks.workunit.client.1.smithi069.stdout:2/388: link d0/d26/f54 d0/d26/d36/f7b 0 2024-04-25T17:19:13.900 INFO:tasks.workunit.client.0.smithi037.stdout:4/732: readlink d7/d7e/d1e/d2b/d35/d39/lbe 0 2024-04-25T17:19:13.901 INFO:tasks.workunit.client.1.smithi069.stdout:2/389: write d0/f57 [131133,76878] 0 2024-04-25T17:19:13.902 INFO:tasks.workunit.client.1.smithi069.stdout:3/494: link d8/d16/d1a/c7d d8/d16/d1a/d2c/d49/cb0 0 2024-04-25T17:19:13.902 INFO:tasks.workunit.client.1.smithi069.stdout:5/423: rename d13/d17/d19/d20/d2d/l65 to d13/d17/d29/l91 0 2024-04-25T17:19:13.904 INFO:tasks.workunit.client.0.smithi037.stdout:4/733: dread - d7/d7e/d1e/d2b/d35/d39/d7a/f97 zero size 2024-04-25T17:19:13.906 INFO:tasks.workunit.client.1.smithi069.stdout:8/396: unlink f14 0 2024-04-25T17:19:13.907 INFO:tasks.workunit.client.1.smithi069.stdout:8/397: chown l23 94 1 2024-04-25T17:19:13.907 INFO:tasks.workunit.client.1.smithi069.stdout:8/398: fsync fb 0 2024-04-25T17:19:13.907 INFO:tasks.workunit.client.1.smithi069.stdout:0/345: mkdir d0/da/db/d7e 0 2024-04-25T17:19:13.908 INFO:tasks.workunit.client.0.smithi037.stdout:4/734: creat d7/d7e/d1e/de1/fee x:0 0 0 2024-04-25T17:19:13.909 INFO:tasks.workunit.client.1.smithi069.stdout:5/424: write d13/d17/d19/d8a/f8e [768162,60264] 0 2024-04-25T17:19:13.910 INFO:tasks.workunit.client.0.smithi037.stdout:4/735: write d7/d7e/d1e/d2b/d35/d39/d7a/fd4 [408509,40581] 0 2024-04-25T17:19:13.911 INFO:tasks.workunit.client.1.smithi069.stdout:2/390: rename d0/d1/d5b/d28/d31/f6b to d0/d1/d5b/d28/d31/f7c 0 2024-04-25T17:19:13.912 INFO:tasks.workunit.client.1.smithi069.stdout:2/391: write d0/d56/d5f/f71 [684448,118100] 0 2024-04-25T17:19:13.916 INFO:tasks.workunit.client.0.smithi037.stdout:4/736: mknod d7/d7e/d1e/d2b/dbd/cef 0 2024-04-25T17:19:13.917 INFO:tasks.workunit.client.1.smithi069.stdout:6/392: getdents d2/d51/d85 0 2024-04-25T17:19:13.918 INFO:tasks.workunit.client.1.smithi069.stdout:6/393: chown d2/d1e/d3e/d74 28632 1 2024-04-25T17:19:13.918 INFO:tasks.workunit.client.1.smithi069.stdout:6/394: fdatasync d2/d1e/d43/f57 0 2024-04-25T17:19:13.925 INFO:tasks.workunit.client.1.smithi069.stdout:7/433: dwrite d4/d6/f59 [4194304,4194304] 0 2024-04-25T17:19:13.927 INFO:tasks.workunit.client.1.smithi069.stdout:1/411: link d1/df/d17/f70 d1/f79 0 2024-04-25T17:19:13.928 INFO:tasks.workunit.client.1.smithi069.stdout:1/412: write d1/d4/d6/f7 [3001988,104364] 0 2024-04-25T17:19:13.933 INFO:tasks.workunit.client.1.smithi069.stdout:5/425: link d13/d17/f42 d13/f92 0 2024-04-25T17:19:13.938 INFO:tasks.workunit.client.1.smithi069.stdout:1/413: creat d1/d43/d35/d4d/f7a x:0 0 0 2024-04-25T17:19:13.939 INFO:tasks.workunit.client.1.smithi069.stdout:3/495: getdents d8/d16/d1a/d2c/d6c 0 2024-04-25T17:19:13.940 INFO:tasks.workunit.client.1.smithi069.stdout:6/395: creat d2/d1e/d43/d7d/f87 x:0 0 0 2024-04-25T17:19:13.940 INFO:tasks.workunit.client.1.smithi069.stdout:5/426: mkdir d13/d17/d19/d20/d2d/d93 0 2024-04-25T17:19:13.941 INFO:tasks.workunit.client.1.smithi069.stdout:5/427: chown d13/d17 0 1 2024-04-25T17:19:13.941 INFO:tasks.workunit.client.1.smithi069.stdout:7/434: getdents d4/d6/d14/d44/d7c 0 2024-04-25T17:19:13.942 INFO:tasks.workunit.client.1.smithi069.stdout:8/399: getdents d37/d47/d48 0 2024-04-25T17:19:13.943 INFO:tasks.workunit.client.1.smithi069.stdout:1/414: fdatasync d1/df/f30 0 2024-04-25T17:19:13.944 INFO:tasks.workunit.client.1.smithi069.stdout:6/396: creat d2/d51/f88 x:0 0 0 2024-04-25T17:19:13.944 INFO:tasks.workunit.client.1.smithi069.stdout:5/428: symlink d13/d17/l94 0 2024-04-25T17:19:13.945 INFO:tasks.workunit.client.1.smithi069.stdout:7/435: chown d4/d6/d14/d44/d79/l46 16356424 1 2024-04-25T17:19:13.946 INFO:tasks.workunit.client.0.smithi037.stdout:4/737: truncate d7/d7e/d1e/d2b/d35/d39/d7a/fd4 438368 0 2024-04-25T17:19:13.947 INFO:tasks.workunit.client.1.smithi069.stdout:5/429: truncate d13/f60 777480 0 2024-04-25T17:19:13.947 INFO:tasks.workunit.client.1.smithi069.stdout:7/436: chown d4/d6/f52 41 1 2024-04-25T17:19:13.948 INFO:tasks.workunit.client.1.smithi069.stdout:3/496: dwrite d8/d16/d1a/d99/fa7 [0,4194304] 0 2024-04-25T17:19:13.948 INFO:tasks.workunit.client.1.smithi069.stdout:6/397: rmdir d2/d1e/d3e/d74/d48 39 2024-04-25T17:19:13.949 INFO:tasks.workunit.client.1.smithi069.stdout:5/430: readlink d13/d17/d19/d20/l73 0 2024-04-25T17:19:13.950 INFO:tasks.workunit.client.1.smithi069.stdout:0/346: truncate d0/d36/f4f 2755299 0 2024-04-25T17:19:13.951 INFO:tasks.workunit.client.0.smithi037.stdout:4/738: write d7/d7e/d1e/d2b/d35/fd9 [5046534,80936] 0 2024-04-25T17:19:13.951 INFO:tasks.workunit.client.1.smithi069.stdout:3/497: chown d8/d16/d1a/d2c/d6c/d9c/da9/d42 4840455 1 2024-04-25T17:19:13.952 INFO:tasks.workunit.client.1.smithi069.stdout:6/398: mkdir d2/d51/d89 0 2024-04-25T17:19:13.953 INFO:tasks.workunit.client.1.smithi069.stdout:6/399: fsync d2/d1e/f2b 0 2024-04-25T17:19:13.956 INFO:tasks.workunit.client.1.smithi069.stdout:2/392: dwrite d0/d26/f54 [0,4194304] 0 2024-04-25T17:19:13.958 INFO:tasks.workunit.client.1.smithi069.stdout:2/393: chown d0/d56 14219 1 2024-04-25T17:19:13.959 INFO:tasks.workunit.client.1.smithi069.stdout:0/347: dread d0/da/d24/f6d [0,4194304] 0 2024-04-25T17:19:13.959 INFO:tasks.workunit.client.1.smithi069.stdout:1/415: dread d1/df/f30 [0,4194304] 0 2024-04-25T17:19:13.959 INFO:tasks.workunit.client.1.smithi069.stdout:5/431: creat d13/d17/d19/d8a/f95 x:0 0 0 2024-04-25T17:19:13.960 INFO:tasks.workunit.client.0.smithi037.stdout:4/739: dwrite d7/fe [4194304,4194304] 0 2024-04-25T17:19:13.961 INFO:tasks.workunit.client.1.smithi069.stdout:5/432: write d13/d17/d19/d20/d2d/f72 [883692,94792] 0 2024-04-25T17:19:13.961 INFO:tasks.workunit.client.1.smithi069.stdout:0/348: truncate d0/da/d54/f5c 455705 0 2024-04-25T17:19:13.962 INFO:tasks.workunit.client.1.smithi069.stdout:7/437: rename d4/d6/d14/d44/d88/c6f to d4/d1a/d34/c8c 0 2024-04-25T17:19:13.963 INFO:tasks.workunit.client.1.smithi069.stdout:0/349: fdatasync d0/da/db/f13 0 2024-04-25T17:19:13.964 INFO:tasks.workunit.client.1.smithi069.stdout:0/350: chown d0/l16 92 1 2024-04-25T17:19:13.967 INFO:tasks.workunit.client.1.smithi069.stdout:8/400: getdents d37/d47/d78 0 2024-04-25T17:19:13.972 INFO:tasks.workunit.client.1.smithi069.stdout:3/498: creat d8/d16/d1a/d2c/d49/d87/d8a/d8e/fb1 x:0 0 0 2024-04-25T17:19:13.973 INFO:tasks.workunit.client.0.smithi037.stdout:5/606: sync 2024-04-25T17:19:13.973 INFO:tasks.workunit.client.0.smithi037.stdout:3/396: sync 2024-04-25T17:19:13.973 INFO:tasks.workunit.client.1.smithi069.stdout:6/400: creat d2/d1e/d43/d7d/f8a x:0 0 0 2024-04-25T17:19:13.979 INFO:tasks.workunit.client.0.smithi037.stdout:3/397: rename d8/d23/d38/d66/f6f to d8/d23/d72/f7a 0 2024-04-25T17:19:13.980 INFO:tasks.workunit.client.0.smithi037.stdout:3/398: fdatasync d8/d23/d38/f5a 0 2024-04-25T17:19:13.980 INFO:tasks.workunit.client.0.smithi037.stdout:5/607: mknod d7/d43/cb9 0 2024-04-25T17:19:13.981 INFO:tasks.workunit.client.1.smithi069.stdout:5/433: rmdir d13/d17/d62 39 2024-04-25T17:19:13.981 INFO:tasks.workunit.client.1.smithi069.stdout:5/434: chown d13/f8c 42510926 1 2024-04-25T17:19:13.983 INFO:tasks.workunit.client.0.smithi037.stdout:3/399: symlink d8/d4c/l7b 0 2024-04-25T17:19:13.984 INFO:tasks.workunit.client.0.smithi037.stdout:3/400: write d8/d23/d38/d66/f6a [154427,92644] 0 2024-04-25T17:19:13.985 INFO:tasks.workunit.client.1.smithi069.stdout:0/351: creat d0/da/d24/d43/f7f x:0 0 0 2024-04-25T17:19:13.985 INFO:tasks.workunit.client.1.smithi069.stdout:8/401: mkdir d37/d62/d85 0 2024-04-25T17:19:13.987 INFO:tasks.workunit.client.1.smithi069.stdout:8/402: read f32 [1971986,120538] 0 2024-04-25T17:19:13.987 INFO:tasks.workunit.client.1.smithi069.stdout:9/433: sync 2024-04-25T17:19:13.989 INFO:tasks.workunit.client.1.smithi069.stdout:2/394: dread d0/f17 [4194304,4194304] 0 2024-04-25T17:19:13.994 INFO:tasks.workunit.client.1.smithi069.stdout:9/434: dwrite d2/da/dd/d1e/d40/f91 [0,4194304] 0 2024-04-25T17:19:13.994 INFO:tasks.workunit.client.0.smithi037.stdout:4/740: dwrite d7/d7e/d1e/d2b/f5f [0,4194304] 0 2024-04-25T17:19:13.995 INFO:tasks.workunit.client.0.smithi037.stdout:4/741: stat d7/d7e/d45/d4f/f99 0 2024-04-25T17:19:14.004 INFO:tasks.workunit.client.1.smithi069.stdout:4/411: sync 2024-04-25T17:19:14.004 INFO:tasks.workunit.client.1.smithi069.stdout:4/412: fsync db/d15/d20/d35/f8c 0 2024-04-25T17:19:14.005 INFO:tasks.workunit.client.1.smithi069.stdout:6/401: mkdir d2/d8b 0 2024-04-25T17:19:14.007 INFO:tasks.workunit.client.1.smithi069.stdout:1/416: creat d1/df/f7b x:0 0 0 2024-04-25T17:19:14.008 INFO:tasks.workunit.client.1.smithi069.stdout:5/435: mkdir d13/d17/d19/d96 0 2024-04-25T17:19:14.008 INFO:tasks.workunit.client.1.smithi069.stdout:1/417: dread - d1/d4/de/d44/f5d zero size 2024-04-25T17:19:14.011 INFO:tasks.workunit.client.1.smithi069.stdout:7/438: rename d4/d6/d14/d44/d79/d23/f7d to d4/d6/d14/d15/f8d 0 2024-04-25T17:19:14.013 INFO:tasks.workunit.client.1.smithi069.stdout:3/499: write d8/d39/f5a [933995,10557] 0 2024-04-25T17:19:14.015 INFO:tasks.workunit.client.1.smithi069.stdout:3/500: chown d8/d16/d1a/d2c/d6c/d9c/da9/d42/c51 10 1 2024-04-25T17:19:14.015 INFO:tasks.workunit.client.1.smithi069.stdout:3/501: stat d8/d71/d8d/d92/f97 0 2024-04-25T17:19:14.017 INFO:tasks.workunit.client.1.smithi069.stdout:6/402: write d2/d1e/f62 [4362668,129386] 0 2024-04-25T17:19:14.017 INFO:tasks.workunit.client.1.smithi069.stdout:4/413: mknod db/d15/d20/d35/d63/d43/d48/c95 0 2024-04-25T17:19:14.019 INFO:tasks.workunit.client.1.smithi069.stdout:5/436: creat d13/d17/d19/d20/d51/f97 x:0 0 0 2024-04-25T17:19:14.020 INFO:tasks.workunit.client.1.smithi069.stdout:5/437: chown d13/d17/d29/d2e/c4b 169 1 2024-04-25T17:19:14.021 INFO:tasks.workunit.client.1.smithi069.stdout:2/395: rename d0/d1/d5b/d28 to d0/d56/d5f/d62/d7d 0 2024-04-25T17:19:14.022 INFO:tasks.workunit.client.1.smithi069.stdout:7/439: mknod d4/d6/d14/d5a/d5e/d89/c8e 0 2024-04-25T17:19:14.023 INFO:tasks.workunit.client.1.smithi069.stdout:2/396: write d0/f57 [1656014,84522] 0 2024-04-25T17:19:14.024 INFO:tasks.workunit.client.1.smithi069.stdout:8/403: dwrite f13 [0,4194304] 0 2024-04-25T17:19:14.025 INFO:tasks.workunit.client.1.smithi069.stdout:2/397: chown d0/d1/d5b/f32 2844240 1 2024-04-25T17:19:14.025 INFO:tasks.workunit.client.1.smithi069.stdout:3/502: mkdir d8/d8b/db2 0 2024-04-25T17:19:14.027 INFO:tasks.workunit.client.1.smithi069.stdout:8/404: dread - d37/d47/d54/f68 zero size 2024-04-25T17:19:14.027 INFO:tasks.workunit.client.1.smithi069.stdout:5/438: creat d13/d17/d19/d1c/d6c/f98 x:0 0 0 2024-04-25T17:19:14.028 INFO:tasks.workunit.client.1.smithi069.stdout:0/352: truncate d0/da/f10 7166692 0 2024-04-25T17:19:14.029 INFO:tasks.workunit.client.1.smithi069.stdout:1/418: rename d1/d43/d35 to d1/d19/d7c 0 2024-04-25T17:19:14.030 INFO:tasks.workunit.client.1.smithi069.stdout:1/419: readlink d1/d4/d6/l66 0 2024-04-25T17:19:14.032 INFO:tasks.workunit.client.1.smithi069.stdout:9/435: link d2/da/d14/c56 d2/da/d5f/c9c 0 2024-04-25T17:19:14.033 INFO:tasks.workunit.client.1.smithi069.stdout:7/440: dread d4/d3e/f62 [0,4194304] 0 2024-04-25T17:19:14.034 INFO:tasks.workunit.client.1.smithi069.stdout:6/403: mknod d2/d1e/d3e/d74/d48/c8c 0 2024-04-25T17:19:14.034 INFO:tasks.workunit.client.1.smithi069.stdout:6/404: fsync d2/d51/f54 0 2024-04-25T17:19:14.035 INFO:tasks.workunit.client.1.smithi069.stdout:3/503: truncate f5 931114 0 2024-04-25T17:19:14.038 INFO:tasks.workunit.client.1.smithi069.stdout:8/405: mknod d37/d66/c86 0 2024-04-25T17:19:14.039 INFO:tasks.workunit.client.1.smithi069.stdout:8/406: write d37/f3f [1901378,61834] 0 2024-04-25T17:19:14.039 INFO:tasks.workunit.client.1.smithi069.stdout:9/436: dread d2/da/d14/f79 [0,4194304] 0 2024-04-25T17:19:14.045 INFO:tasks.workunit.client.0.smithi037.stdout:3/401: dwrite d8/d23/d3a/f45 [0,4194304] 0 2024-04-25T17:19:14.047 INFO:tasks.workunit.client.0.smithi037.stdout:4/742: dwrite d7/d7e/d1e/d2b/f75 [0,4194304] 0 2024-04-25T17:19:14.049 INFO:tasks.workunit.client.0.smithi037.stdout:4/743: stat d7/d7e/d1e/d70/d84/ddf/ce3 0 2024-04-25T17:19:14.050 INFO:tasks.workunit.client.1.smithi069.stdout:4/414: truncate db/d22/d24/f2d 3683640 0 2024-04-25T17:19:14.052 INFO:tasks.workunit.client.1.smithi069.stdout:5/439: write d13/d17/d19/f25 [498686,56349] 0 2024-04-25T17:19:14.056 INFO:tasks.workunit.client.0.smithi037.stdout:3/402: fdatasync d8/d31/d32/f39 0 2024-04-25T17:19:14.060 INFO:tasks.workunit.client.0.smithi037.stdout:3/403: fdatasync d8/f37 0 2024-04-25T17:19:14.061 INFO:tasks.workunit.client.1.smithi069.stdout:1/420: mkdir d1/d4/de/d63/d7d 0 2024-04-25T17:19:14.062 INFO:tasks.workunit.client.1.smithi069.stdout:1/421: readlink d1/l4e 0 2024-04-25T17:19:14.063 INFO:tasks.workunit.client.1.smithi069.stdout:4/415: rmdir db/d15/d26 39 2024-04-25T17:19:14.064 INFO:tasks.workunit.client.1.smithi069.stdout:4/416: truncate db/d22/d24/d41/f47 421778 0 2024-04-25T17:19:14.065 INFO:tasks.workunit.client.1.smithi069.stdout:4/417: dread - db/d15/d20/d35/d63/f77 zero size 2024-04-25T17:19:14.066 INFO:tasks.workunit.client.1.smithi069.stdout:7/441: creat d4/d83/f8f x:0 0 0 2024-04-25T17:19:14.066 INFO:tasks.workunit.client.0.smithi037.stdout:3/404: dwrite d8/d31/f47 [0,4194304] 0 2024-04-25T17:19:14.070 INFO:tasks.workunit.client.1.smithi069.stdout:2/398: rename d0/f17 to d0/d26/d10/f7e 0 2024-04-25T17:19:14.071 INFO:tasks.workunit.client.1.smithi069.stdout:4/418: dwrite db/d15/f18 [0,4194304] 0 2024-04-25T17:19:14.071 INFO:tasks.workunit.client.1.smithi069.stdout:5/440: fsync d13/d17/d29/d2e/d76/f87 0 2024-04-25T17:19:14.074 INFO:tasks.workunit.client.1.smithi069.stdout:8/407: rmdir d37/d62/d85 0 2024-04-25T17:19:14.076 INFO:tasks.workunit.client.1.smithi069.stdout:8/408: write d37/d47/d54/f5e [4633265,15212] 0 2024-04-25T17:19:14.077 INFO:tasks.workunit.client.1.smithi069.stdout:6/405: getdents d2/d1e 0 2024-04-25T17:19:14.078 INFO:tasks.workunit.client.1.smithi069.stdout:8/409: chown d37/d47/d54/d6e 933111193 1 2024-04-25T17:19:14.078 INFO:tasks.workunit.client.1.smithi069.stdout:0/353: rename d0/da/db/d1d/d27 to d0/da/db/d7e/d80 0 2024-04-25T17:19:14.085 INFO:tasks.workunit.client.1.smithi069.stdout:5/441: dwrite d13/d17/d19/d8a/f8e [0,4194304] 0 2024-04-25T17:19:14.087 INFO:tasks.workunit.client.1.smithi069.stdout:6/406: unlink d2/d1e/d3e/d74/d48/d73/c7a 0 2024-04-25T17:19:14.088 INFO:tasks.workunit.client.1.smithi069.stdout:4/419: mkdir db/d15/d20/d35/d63/d70/d8a/d96 0 2024-04-25T17:19:14.090 INFO:tasks.workunit.client.1.smithi069.stdout:7/442: rename d4/d6/d14/d15/f2d to d4/d6/d14/d15/f90 0 2024-04-25T17:19:14.091 INFO:tasks.workunit.client.1.smithi069.stdout:7/443: dread - d4/d6/f8a zero size 2024-04-25T17:19:14.091 INFO:tasks.workunit.client.1.smithi069.stdout:5/442: mknod d13/c99 0 2024-04-25T17:19:14.093 INFO:tasks.workunit.client.1.smithi069.stdout:5/443: write d13/d17/d19/d1c/d6c/f98 [235503,87610] 0 2024-04-25T17:19:14.095 INFO:tasks.workunit.client.1.smithi069.stdout:5/444: readlink d13/d17/l7d 0 2024-04-25T17:19:14.097 INFO:tasks.workunit.client.0.smithi037.stdout:3/405: dread d8/d23/f28 [4194304,4194304] 0 2024-04-25T17:19:14.098 INFO:tasks.workunit.client.1.smithi069.stdout:4/420: write db/d22/d24/f31 [1188950,87094] 0 2024-04-25T17:19:14.099 INFO:tasks.workunit.client.1.smithi069.stdout:7/444: dwrite d4/d6/d14/d44/d79/f53 [0,4194304] 0 2024-04-25T17:19:14.101 INFO:tasks.workunit.client.1.smithi069.stdout:3/504: rename d8/d16/d31/c74 to d8/d16/d1a/cb3 0 2024-04-25T17:19:14.102 INFO:tasks.workunit.client.1.smithi069.stdout:6/407: truncate d2/f18 2218726 0 2024-04-25T17:19:14.103 INFO:tasks.workunit.client.0.smithi037.stdout:3/406: dwrite d8/d31/d32/d3e/f6e [0,4194304] 0 2024-04-25T17:19:14.103 INFO:tasks.workunit.client.1.smithi069.stdout:2/399: getdents d0/d1/d5b 0 2024-04-25T17:19:14.105 INFO:tasks.workunit.client.0.smithi037.stdout:3/407: dread - d8/d4c/f68 zero size 2024-04-25T17:19:14.105 INFO:tasks.workunit.client.1.smithi069.stdout:7/445: dwrite d4/d1a/d34/f65 [0,4194304] 0 2024-04-25T17:19:14.107 INFO:tasks.workunit.client.1.smithi069.stdout:3/505: symlink d8/d71/lb4 0 2024-04-25T17:19:14.107 INFO:tasks.workunit.client.0.smithi037.stdout:9/719: sync 2024-04-25T17:19:14.107 INFO:tasks.workunit.client.0.smithi037.stdout:7/552: sync 2024-04-25T17:19:14.111 INFO:tasks.workunit.client.0.smithi037.stdout:3/408: symlink d8/d23/d3a/l7c 0 2024-04-25T17:19:14.112 INFO:tasks.workunit.client.1.smithi069.stdout:5/445: link d13/d17/d19/d8a/f95 d13/d17/d19/d20/f9a 0 2024-04-25T17:19:14.113 INFO:tasks.workunit.client.1.smithi069.stdout:6/408: mkdir d2/d1e/d3e/d67/d8d 0 2024-04-25T17:19:14.113 INFO:tasks.workunit.client.1.smithi069.stdout:5/446: write d13/d17/d19/d20/d2d/f72 [1650201,36295] 0 2024-04-25T17:19:14.114 INFO:tasks.workunit.client.1.smithi069.stdout:6/409: chown d2/d7/l72 395 1 2024-04-25T17:19:14.116 INFO:tasks.workunit.client.0.smithi037.stdout:7/553: mkdir d5/d15/d17/d1b/da2/daf/dc5 0 2024-04-25T17:19:14.118 INFO:tasks.workunit.client.0.smithi037.stdout:3/409: mkdir d8/d31/d32/d3e/d7d 0 2024-04-25T17:19:14.120 INFO:tasks.workunit.client.0.smithi037.stdout:3/410: write d8/d23/d3a/f45 [922467,123944] 0 2024-04-25T17:19:14.120 INFO:tasks.workunit.client.0.smithi037.stdout:9/720: getdents d1/d5/dc/da9/dc8 0 2024-04-25T17:19:14.120 INFO:tasks.workunit.client.1.smithi069.stdout:8/410: dread f33 [0,4194304] 0 2024-04-25T17:19:14.121 INFO:tasks.workunit.client.1.smithi069.stdout:3/506: symlink d8/d71/lb5 0 2024-04-25T17:19:14.121 INFO:tasks.workunit.client.1.smithi069.stdout:8/411: truncate f12 5194301 0 2024-04-25T17:19:14.122 INFO:tasks.workunit.client.0.smithi037.stdout:3/411: write d8/d23/d3a/f4f [1464520,31840] 0 2024-04-25T17:19:14.122 INFO:tasks.workunit.client.0.smithi037.stdout:7/554: rmdir d5/d14/db1 39 2024-04-25T17:19:14.123 INFO:tasks.workunit.client.0.smithi037.stdout:3/412: chown d8/d23/d3a/d5d/f2b 58269294 1 2024-04-25T17:19:14.123 INFO:tasks.workunit.client.0.smithi037.stdout:7/555: write d5/d15/d17/d1b/da2/daf/d80/f84 [1571789,83068] 0 2024-04-25T17:19:14.124 INFO:tasks.workunit.client.1.smithi069.stdout:5/447: symlink d13/d17/d29/d2e/l9b 0 2024-04-25T17:19:14.127 INFO:tasks.workunit.client.0.smithi037.stdout:7/556: fsync d5/fd 0 2024-04-25T17:19:14.128 INFO:tasks.workunit.client.0.smithi037.stdout:7/557: readlink d5/d15/d17/d1b/da2/daf/l9e 0 2024-04-25T17:19:14.128 INFO:tasks.workunit.client.1.smithi069.stdout:7/446: creat d4/d18/d3f/f91 x:0 0 0 2024-04-25T17:19:14.129 INFO:tasks.workunit.client.0.smithi037.stdout:3/413: creat d8/d23/d3a/d5d/f7e x:0 0 0 2024-04-25T17:19:14.129 INFO:tasks.workunit.client.1.smithi069.stdout:7/447: write d4/d18/f1f [3692632,36631] 0 2024-04-25T17:19:14.133 INFO:tasks.workunit.client.1.smithi069.stdout:3/507: mkdir d8/d71/d8d/d92/db6 0 2024-04-25T17:19:14.133 INFO:tasks.workunit.client.1.smithi069.stdout:3/508: stat d8 0 2024-04-25T17:19:14.134 INFO:tasks.workunit.client.1.smithi069.stdout:5/448: mkdir d13/d17/d29/d30/d9c 0 2024-04-25T17:19:14.135 INFO:tasks.workunit.client.1.smithi069.stdout:6/410: getdents d2/d1e/d3f/d86 0 2024-04-25T17:19:14.136 INFO:tasks.workunit.client.0.smithi037.stdout:7/558: chown d5/l4b 17 1 2024-04-25T17:19:14.136 INFO:tasks.workunit.client.0.smithi037.stdout:3/414: symlink d8/d23/d3a/d63/l7f 0 2024-04-25T17:19:14.138 INFO:tasks.workunit.client.1.smithi069.stdout:9/437: rename d2/da/dd/de/d59/d7f/l97 to d2/da/l9d 0 2024-04-25T17:19:14.139 INFO:tasks.workunit.client.1.smithi069.stdout:5/449: dwrite d13/d17/d19/d20/f57 [0,4194304] 0 2024-04-25T17:19:14.140 INFO:tasks.workunit.client.1.smithi069.stdout:5/450: fsync d13/d17/d19/d20/f2a 0 2024-04-25T17:19:14.150 INFO:tasks.workunit.client.1.smithi069.stdout:6/411: creat d2/d51/f8e x:0 0 0 2024-04-25T17:19:14.150 INFO:tasks.workunit.client.1.smithi069.stdout:6/412: fsync d2/d51/d85/f7b 0 2024-04-25T17:19:14.152 INFO:tasks.workunit.client.1.smithi069.stdout:0/354: rename d0/da/c14 to d0/da/db/d7e/d80/c81 0 2024-04-25T17:19:14.154 INFO:tasks.workunit.client.1.smithi069.stdout:4/421: truncate db/f16 175656 0 2024-04-25T17:19:14.155 INFO:tasks.workunit.client.1.smithi069.stdout:8/412: creat d37/f87 x:0 0 0 2024-04-25T17:19:14.157 INFO:tasks.workunit.client.1.smithi069.stdout:3/509: truncate d8/d16/d1a/d2c/f45 541382 0 2024-04-25T17:19:14.160 INFO:tasks.workunit.client.1.smithi069.stdout:2/400: rename d0/d56/d5f/d62/d7d/c64 to d0/d1/d5b/c7f 0 2024-04-25T17:19:14.161 INFO:tasks.workunit.client.1.smithi069.stdout:5/451: mkdir d13/d17/d19/d96/d9d 0 2024-04-25T17:19:14.163 INFO:tasks.workunit.client.1.smithi069.stdout:3/510: dwrite d8/d16/d4b/f79 [0,4194304] 0 2024-04-25T17:19:14.163 INFO:tasks.workunit.client.1.smithi069.stdout:4/422: chown db/d15/d26/l3a 1680 1 2024-04-25T17:19:14.164 INFO:tasks.workunit.client.1.smithi069.stdout:4/423: dread - db/d15/d42/f5f zero size 2024-04-25T17:19:14.164 INFO:tasks.workunit.client.0.smithi037.stdout:9/721: write d1/d48/d68/d1c/f91 [1603819,105050] 0 2024-04-25T17:19:14.165 INFO:tasks.workunit.client.1.smithi069.stdout:3/511: truncate d8/d71/f75 330986 0 2024-04-25T17:19:14.172 INFO:tasks.workunit.client.1.smithi069.stdout:8/413: dwrite d37/f45 [0,4194304] 0 2024-04-25T17:19:14.172 INFO:tasks.workunit.client.0.smithi037.stdout:7/559: write d5/d15/d17/d25/d2b/d59/f8c [741418,75332] 0 2024-04-25T17:19:14.173 INFO:tasks.workunit.client.0.smithi037.stdout:3/415: truncate d8/d31/d32/d3e/f42 423867 0 2024-04-25T17:19:14.174 INFO:tasks.workunit.client.1.smithi069.stdout:1/422: sync 2024-04-25T17:19:14.175 INFO:tasks.workunit.client.1.smithi069.stdout:3/512: dwrite d8/d16/d1a/d2c/d49/d59/f6b [0,4194304] 0 2024-04-25T17:19:14.175 INFO:tasks.workunit.client.1.smithi069.stdout:2/401: write d0/d56/d5f/d62/d7d/f50 [2854535,49731] 0 2024-04-25T17:19:14.180 INFO:tasks.workunit.client.0.smithi037.stdout:9/722: dread d1/d5/d19/f50 [0,4194304] 0 2024-04-25T17:19:14.181 INFO:tasks.workunit.client.1.smithi069.stdout:6/413: rmdir d2/d1e/d3f/d56/d84 0 2024-04-25T17:19:14.181 INFO:tasks.workunit.client.0.smithi037.stdout:9/723: dread - d1/d5/d19/d6e/ff1 zero size 2024-04-25T17:19:14.182 INFO:tasks.workunit.client.0.smithi037.stdout:3/416: symlink d8/d23/d3a/d5d/l80 0 2024-04-25T17:19:14.184 INFO:tasks.workunit.client.1.smithi069.stdout:3/513: dwrite d8/d16/d31/fa1 [0,4194304] 0 2024-04-25T17:19:14.190 INFO:tasks.workunit.client.0.smithi037.stdout:3/417: mkdir d8/d23/d3a/d81 0 2024-04-25T17:19:14.191 INFO:tasks.workunit.client.0.smithi037.stdout:3/418: write d8/d23/d3a/f4f [870446,74470] 0 2024-04-25T17:19:14.193 INFO:tasks.workunit.client.1.smithi069.stdout:9/438: rename d2/f33 to d2/da/dd/de/d74/d8a/f9e 0 2024-04-25T17:19:14.196 INFO:tasks.workunit.client.0.smithi037.stdout:3/419: rmdir d8/d23 39 2024-04-25T17:19:14.197 INFO:tasks.workunit.client.1.smithi069.stdout:7/448: link d4/d1a/f2f d4/d6/f92 0 2024-04-25T17:19:14.198 INFO:tasks.workunit.client.0.smithi037.stdout:6/525: sync 2024-04-25T17:19:14.198 INFO:tasks.workunit.client.0.smithi037.stdout:2/636: sync 2024-04-25T17:19:14.201 INFO:tasks.workunit.client.0.smithi037.stdout:3/420: read d8/d23/d38/f73 [6545182,71073] 0 2024-04-25T17:19:14.202 INFO:tasks.workunit.client.0.smithi037.stdout:2/637: mkdir d0/d16/d20/d55/dd1 0 2024-04-25T17:19:14.202 INFO:tasks.workunit.client.1.smithi069.stdout:0/355: link d0/c7 d0/da/db/d1d/c82 0 2024-04-25T17:19:14.203 INFO:tasks.workunit.client.1.smithi069.stdout:0/356: write d0/f7c [794167,104900] 0 2024-04-25T17:19:14.205 INFO:tasks.workunit.client.1.smithi069.stdout:8/414: unlink l1c 0 2024-04-25T17:19:14.205 INFO:tasks.workunit.client.0.smithi037.stdout:7/560: dread d5/d15/d17/f38 [0,4194304] 0 2024-04-25T17:19:14.206 INFO:tasks.workunit.client.0.smithi037.stdout:3/421: mknod d8/d23/d38/c82 0 2024-04-25T17:19:14.206 INFO:tasks.workunit.client.1.smithi069.stdout:5/452: dread d13/f1a [4194304,4194304] 0 2024-04-25T17:19:14.213 INFO:tasks.workunit.client.0.smithi037.stdout:3/422: stat d8/f22 0 2024-04-25T17:19:14.214 INFO:tasks.workunit.client.1.smithi069.stdout:7/449: symlink d4/d18/l93 0 2024-04-25T17:19:14.215 INFO:tasks.workunit.client.1.smithi069.stdout:7/450: write d4/d6/d14/d15/f17 [1633818,116441] 0 2024-04-25T17:19:14.216 INFO:tasks.workunit.client.1.smithi069.stdout:6/414: mknod d2/d51/d89/c8f 0 2024-04-25T17:19:14.217 INFO:tasks.workunit.client.0.smithi037.stdout:9/724: write d1/d5/dc/fba [651845,99299] 0 2024-04-25T17:19:14.218 INFO:tasks.workunit.client.0.smithi037.stdout:7/561: symlink d5/lc6 0 2024-04-25T17:19:14.218 INFO:tasks.workunit.client.0.smithi037.stdout:6/526: dread db/d26/d2e/d3e/f47 [0,4194304] 0 2024-04-25T17:19:14.222 INFO:tasks.workunit.client.1.smithi069.stdout:4/424: creat db/d15/d20/d35/d63/d43/f97 x:0 0 0 2024-04-25T17:19:14.225 INFO:tasks.workunit.client.0.smithi037.stdout:7/562: chown d5/d14/db1/la0 918469403 1 2024-04-25T17:19:14.226 INFO:tasks.workunit.client.1.smithi069.stdout:8/415: chown d37/c4b 235 1 2024-04-25T17:19:14.230 INFO:tasks.workunit.client.0.smithi037.stdout:2/638: write d0/d16/d20/d59/f66 [904009,80004] 0 2024-04-25T17:19:14.231 INFO:tasks.workunit.client.1.smithi069.stdout:2/402: truncate d0/d56/d5f/d62/d7d/f50 101934 0 2024-04-25T17:19:14.232 INFO:tasks.workunit.client.0.smithi037.stdout:2/639: write d0/d15/d2a/f94 [1042447,94634] 0 2024-04-25T17:19:14.232 INFO:tasks.workunit.client.1.smithi069.stdout:8/416: dwrite d37/d47/d54/d6e/f7d [0,4194304] 0 2024-04-25T17:19:14.233 INFO:tasks.workunit.client.0.smithi037.stdout:9/725: mkdir d1/d5/dc/d3c/dca/df5 0 2024-04-25T17:19:14.235 INFO:tasks.workunit.client.0.smithi037.stdout:6/527: dread db/d1d/d20/f8c [0,4194304] 0 2024-04-25T17:19:14.236 INFO:tasks.workunit.client.0.smithi037.stdout:7/563: creat d5/d15/fc7 x:0 0 0 2024-04-25T17:19:14.240 INFO:tasks.workunit.client.1.smithi069.stdout:7/451: mkdir d4/d3e/d94 0 2024-04-25T17:19:14.242 INFO:tasks.workunit.client.1.smithi069.stdout:7/452: write d4/d18/d3f/f91 [100909,25910] 0 2024-04-25T17:19:14.242 INFO:tasks.workunit.client.0.smithi037.stdout:3/423: truncate d8/d23/d3a/d5d/f2b 18278 0 2024-04-25T17:19:14.243 INFO:tasks.workunit.client.0.smithi037.stdout:3/424: dread - d8/d23/d38/f74 zero size 2024-04-25T17:19:14.246 INFO:tasks.workunit.client.1.smithi069.stdout:0/357: dwrite d0/da/db/d7e/d80/f45 [0,4194304] 0 2024-04-25T17:19:14.246 INFO:tasks.workunit.client.1.smithi069.stdout:3/514: creat d8/d16/d1a/fb7 x:0 0 0 2024-04-25T17:19:14.247 INFO:tasks.workunit.client.1.smithi069.stdout:0/358: stat d0/da/d24/f6d 0 2024-04-25T17:19:14.248 INFO:tasks.workunit.client.0.smithi037.stdout:7/564: mkdir d5/d15/d17/d1b/da2/daf/dc8 0 2024-04-25T17:19:14.249 INFO:tasks.workunit.client.1.smithi069.stdout:9/439: fdatasync d2/da/dd/d1e/f26 0 2024-04-25T17:19:14.251 INFO:tasks.workunit.client.0.smithi037.stdout:3/425: unlink d8/d23/d3a/c61 0 2024-04-25T17:19:14.251 INFO:tasks.workunit.client.0.smithi037.stdout:2/640: dread d0/d23/f28 [0,4194304] 0 2024-04-25T17:19:14.251 INFO:tasks.workunit.client.1.smithi069.stdout:1/423: getdents d1/d19/d7c 0 2024-04-25T17:19:14.254 INFO:tasks.workunit.client.0.smithi037.stdout:7/565: rmdir d5/d15/d17/d1b/da2/daf 39 2024-04-25T17:19:14.256 INFO:tasks.workunit.client.1.smithi069.stdout:0/359: dwrite d0/da/d24/d67/f6a [0,4194304] 0 2024-04-25T17:19:14.256 INFO:tasks.workunit.client.0.smithi037.stdout:2/641: symlink d0/d16/d20/d59/ld2 0 2024-04-25T17:19:14.258 INFO:tasks.workunit.client.0.smithi037.stdout:2/642: write d0/f9 [3154052,122452] 0 2024-04-25T17:19:14.258 INFO:tasks.workunit.client.0.smithi037.stdout:9/726: dread d1/d48/d68/d26/f80 [0,4194304] 0 2024-04-25T17:19:14.258 INFO:tasks.workunit.client.0.smithi037.stdout:0/602: sync 2024-04-25T17:19:14.258 INFO:tasks.workunit.client.0.smithi037.stdout:5/608: sync 2024-04-25T17:19:14.258 INFO:tasks.workunit.client.0.smithi037.stdout:1/635: sync 2024-04-25T17:19:14.258 INFO:tasks.workunit.client.0.smithi037.stdout:8/521: sync 2024-04-25T17:19:14.258 INFO:tasks.workunit.client.0.smithi037.stdout:4/744: sync 2024-04-25T17:19:14.261 INFO:tasks.workunit.client.1.smithi069.stdout:2/403: creat d0/d26/d10/d43/f80 x:0 0 0 2024-04-25T17:19:14.262 INFO:tasks.workunit.client.1.smithi069.stdout:2/404: readlink d0/d26/ld 0 2024-04-25T17:19:14.262 INFO:tasks.workunit.client.0.smithi037.stdout:9/727: chown d1/d48/d68/d26/da1 115 1 2024-04-25T17:19:14.264 INFO:tasks.workunit.client.0.smithi037.stdout:9/728: fdatasync d1/f2 0 2024-04-25T17:19:14.265 INFO:tasks.workunit.client.0.smithi037.stdout:6/528: rmdir db/d26/d2e/daf 0 2024-04-25T17:19:14.267 INFO:tasks.workunit.client.0.smithi037.stdout:7/566: rmdir d5/d15/d17/d1b/da2/d76 39 2024-04-25T17:19:14.270 INFO:tasks.workunit.client.1.smithi069.stdout:7/453: creat d4/d6/d14/d5a/d5e/f95 x:0 0 0 2024-04-25T17:19:14.270 INFO:tasks.workunit.client.0.smithi037.stdout:4/745: dwrite d7/d7e/d1e/d2b/d35/d39/d9c/da3/fd7 [0,4194304] 0 2024-04-25T17:19:14.270 INFO:tasks.workunit.client.1.smithi069.stdout:7/454: chown d4/d6/d14/d5a 39855 1 2024-04-25T17:19:14.271 INFO:tasks.workunit.client.1.smithi069.stdout:8/417: read d37/d47/d48/f49 [1637528,47769] 0 2024-04-25T17:19:14.272 INFO:tasks.workunit.client.0.smithi037.stdout:4/746: stat d7/d7e/d1e/dae/dc6/le7 0 2024-04-25T17:19:14.273 INFO:tasks.workunit.client.0.smithi037.stdout:4/747: write d7/d7e/d1e/dae/fd0 [4691546,35427] 0 2024-04-25T17:19:14.273 INFO:tasks.workunit.client.1.smithi069.stdout:8/418: truncate d37/d47/d54/f68 1025348 0 2024-04-25T17:19:14.273 INFO:tasks.workunit.client.1.smithi069.stdout:8/419: readlink d37/d66/l7f 0 2024-04-25T17:19:14.278 INFO:tasks.workunit.client.0.smithi037.stdout:5/609: symlink d7/d63/lba 0 2024-04-25T17:19:14.279 INFO:tasks.workunit.client.0.smithi037.stdout:5/610: truncate d7/f75 1403550 0 2024-04-25T17:19:14.280 INFO:tasks.workunit.client.1.smithi069.stdout:3/515: creat d8/d16/d1a/d99/fb8 x:0 0 0 2024-04-25T17:19:14.280 INFO:tasks.workunit.client.0.smithi037.stdout:5/611: dread - d7/d12/d6f/fb8 zero size 2024-04-25T17:19:14.283 INFO:tasks.workunit.client.1.smithi069.stdout:5/453: truncate d13/d17/d19/f25 1413289 0 2024-04-25T17:19:14.286 INFO:tasks.workunit.client.0.smithi037.stdout:0/603: fdatasync d9/df/d32/d39/d68/f93 0 2024-04-25T17:19:14.288 INFO:tasks.workunit.client.1.smithi069.stdout:5/454: dwrite d13/d17/d29/f2b [0,4194304] 0 2024-04-25T17:19:14.290 INFO:tasks.workunit.client.1.smithi069.stdout:9/440: mknod d2/da/dd/d1e/d2e/d35/c9f 0 2024-04-25T17:19:14.293 INFO:tasks.workunit.client.1.smithi069.stdout:1/424: symlink d1/d43/l7e 0 2024-04-25T17:19:14.296 INFO:tasks.workunit.client.1.smithi069.stdout:1/425: readlink d1/d43/d1b/l1c 0 2024-04-25T17:19:14.297 INFO:tasks.workunit.client.1.smithi069.stdout:0/360: mkdir d0/d17/d83 0 2024-04-25T17:19:14.297 INFO:tasks.workunit.client.1.smithi069.stdout:7/455: dread d4/d3e/f41 [0,4194304] 0 2024-04-25T17:19:14.298 INFO:tasks.workunit.client.0.smithi037.stdout:6/529: mknod db/d26/d2e/d3e/cbf 0 2024-04-25T17:19:14.298 INFO:tasks.workunit.client.1.smithi069.stdout:5/455: dwrite d13/d17/d29/d30/d5c/f69 [4194304,4194304] 0 2024-04-25T17:19:14.299 INFO:tasks.workunit.client.1.smithi069.stdout:2/405: readlink d0/d26/d10/l37 0 2024-04-25T17:19:14.302 INFO:tasks.workunit.client.1.smithi069.stdout:5/456: fsync d13/d17/d19/d20/d2d/f72 0 2024-04-25T17:19:14.305 INFO:tasks.workunit.client.1.smithi069.stdout:6/415: dwrite d2/d7/f25 [0,4194304] 0 2024-04-25T17:19:14.306 INFO:tasks.workunit.client.1.smithi069.stdout:5/457: stat d13/d17/d19/d20/d2d/d93 0 2024-04-25T17:19:14.307 INFO:tasks.workunit.client.1.smithi069.stdout:7/456: dread d4/d6/f59 [4194304,4194304] 0 2024-04-25T17:19:14.311 INFO:tasks.workunit.client.1.smithi069.stdout:7/457: chown d4/d6/d14/d5a/d5e 30014597 1 2024-04-25T17:19:14.311 INFO:tasks.workunit.client.1.smithi069.stdout:2/406: dwrite d0/d1/f4f [0,4194304] 0 2024-04-25T17:19:14.312 INFO:tasks.workunit.client.0.smithi037.stdout:8/522: dwrite d5/db/d18/d3b/d50/d51/f57 [0,4194304] 0 2024-04-25T17:19:14.313 INFO:tasks.workunit.client.1.smithi069.stdout:8/420: rename d37/d47/d48/f64 to d37/d47/d78/f88 0 2024-04-25T17:19:14.313 INFO:tasks.workunit.client.1.smithi069.stdout:2/407: chown d0/d56/d5f/d62/d7d/d31/c35 892 1 2024-04-25T17:19:14.314 INFO:tasks.workunit.client.0.smithi037.stdout:2/643: unlink d0/d16/c58 0 2024-04-25T17:19:14.318 INFO:tasks.workunit.client.0.smithi037.stdout:3/426: rename d8/d23/d38/c56 to d8/d31/d32/c83 0 2024-04-25T17:19:14.320 INFO:tasks.workunit.client.1.smithi069.stdout:4/425: link db/d15/c1e db/d15/d82/c98 0 2024-04-25T17:19:14.321 INFO:tasks.workunit.client.0.smithi037.stdout:5/612: mkdir d7/da1/dbb 0 2024-04-25T17:19:14.321 INFO:tasks.workunit.client.0.smithi037.stdout:9/729: write d1/d5/dc/f4a [787310,45122] 0 2024-04-25T17:19:14.321 INFO:tasks.workunit.client.1.smithi069.stdout:4/426: dread f7 [0,4194304] 0 2024-04-25T17:19:14.325 INFO:tasks.workunit.client.0.smithi037.stdout:9/730: write d1/d5/d2e/d34/fdd [185283,77724] 0 2024-04-25T17:19:14.327 INFO:tasks.workunit.client.1.smithi069.stdout:9/441: symlink d2/da/dd/de/d74/la0 0 2024-04-25T17:19:14.329 INFO:tasks.workunit.client.0.smithi037.stdout:1/636: mknod dc/d52/d6b/dd9/d22/d36/cdb 0 2024-04-25T17:19:14.329 INFO:tasks.workunit.client.0.smithi037.stdout:5/613: dwrite d7/d12/d6f/d94/fad [0,4194304] 0 2024-04-25T17:19:14.331 INFO:tasks.workunit.client.0.smithi037.stdout:1/637: chown dc/d52/d6b/dd9/d22/d36/l81 1618336 1 2024-04-25T17:19:14.336 INFO:tasks.workunit.client.1.smithi069.stdout:6/416: creat d2/d51/d89/f90 x:0 0 0 2024-04-25T17:19:14.337 INFO:tasks.workunit.client.0.smithi037.stdout:5/614: dread d7/d12/d6f/d68/faf [0,4194304] 0 2024-04-25T17:19:14.339 INFO:tasks.workunit.client.0.smithi037.stdout:4/748: write d7/d78/fa1 [3133606,84912] 0 2024-04-25T17:19:14.340 INFO:tasks.workunit.client.0.smithi037.stdout:4/749: chown d7/d67 1038839 1 2024-04-25T17:19:14.340 INFO:tasks.workunit.client.0.smithi037.stdout:8/523: symlink d5/d26/d33/lad 0 2024-04-25T17:19:14.344 INFO:tasks.workunit.client.0.smithi037.stdout:2/644: symlink d0/ld3 0 2024-04-25T17:19:14.348 INFO:tasks.workunit.client.1.smithi069.stdout:5/458: dread fd [0,4194304] 0 2024-04-25T17:19:14.348 INFO:tasks.workunit.client.0.smithi037.stdout:3/427: rmdir d8/d4c 39 2024-04-25T17:19:14.349 INFO:tasks.workunit.client.1.smithi069.stdout:8/421: fsync d37/d47/d48/f83 0 2024-04-25T17:19:14.350 INFO:tasks.workunit.client.1.smithi069.stdout:8/422: write d37/d47/d54/f5e [634411,109327] 0 2024-04-25T17:19:14.350 INFO:tasks.workunit.client.1.smithi069.stdout:3/516: symlink d8/d71/d8d/d92/db6/lb9 0 2024-04-25T17:19:14.351 INFO:tasks.workunit.client.0.smithi037.stdout:9/731: fdatasync d1/d5/dc/fa5 0 2024-04-25T17:19:14.355 INFO:tasks.workunit.client.0.smithi037.stdout:9/732: dread d1/d5/d19/d6e/f8f [4194304,4194304] 0 2024-04-25T17:19:14.356 INFO:tasks.workunit.client.0.smithi037.stdout:9/733: write d1/d48/fee [92769,47390] 0 2024-04-25T17:19:14.358 INFO:tasks.workunit.client.1.smithi069.stdout:2/408: dread d0/d26/f2b [0,4194304] 0 2024-04-25T17:19:14.360 INFO:tasks.workunit.client.0.smithi037.stdout:7/567: dread d5/d15/d17/d1b/da2/daf/f5f [0,4194304] 0 2024-04-25T17:19:14.365 INFO:tasks.workunit.client.0.smithi037.stdout:4/750: mkdir d7/d7e/d1e/d70/d84/ddf/df0 0 2024-04-25T17:19:14.367 INFO:tasks.workunit.client.1.smithi069.stdout:6/417: creat d2/d51/f91 x:0 0 0 2024-04-25T17:19:14.367 INFO:tasks.workunit.client.0.smithi037.stdout:8/524: symlink d5/db/d18/d3b/d50/da0/da6/lae 0 2024-04-25T17:19:14.368 INFO:tasks.workunit.client.1.smithi069.stdout:7/458: fdatasync d4/d6/f92 0 2024-04-25T17:19:14.369 INFO:tasks.workunit.client.0.smithi037.stdout:8/525: read d5/da/f11 [1181914,48112] 0 2024-04-25T17:19:14.370 INFO:tasks.workunit.client.0.smithi037.stdout:2/645: write d0/f2d [4415157,22816] 0 2024-04-25T17:19:14.372 INFO:tasks.workunit.client.0.smithi037.stdout:8/526: read d5/db/d23/d58/f8b [104869,56326] 0 2024-04-25T17:19:14.374 INFO:tasks.workunit.client.1.smithi069.stdout:5/459: creat d13/d17/d19/d8a/f9e x:0 0 0 2024-04-25T17:19:14.375 INFO:tasks.workunit.client.0.smithi037.stdout:6/530: dwrite db/d1d/d20/fac [0,4194304] 0 2024-04-25T17:19:14.376 INFO:tasks.workunit.client.0.smithi037.stdout:3/428: creat d8/d23/d3a/d5d/f84 x:0 0 0 2024-04-25T17:19:14.379 INFO:tasks.workunit.client.0.smithi037.stdout:3/429: read - d8/d23/d3a/d5d/f84 zero size 2024-04-25T17:19:14.382 INFO:tasks.workunit.client.0.smithi037.stdout:5/615: dwrite d7/f1b [0,4194304] 0 2024-04-25T17:19:14.383 INFO:tasks.workunit.client.0.smithi037.stdout:5/616: chown d7/d63/f92 0 1 2024-04-25T17:19:14.384 INFO:tasks.workunit.client.0.smithi037.stdout:5/617: chown d7/d25/f91 223651815 1 2024-04-25T17:19:14.385 INFO:tasks.workunit.client.1.smithi069.stdout:8/423: dwrite f10 [4194304,4194304] 0 2024-04-25T17:19:14.389 INFO:tasks.workunit.client.1.smithi069.stdout:4/427: symlink db/d15/d42/d64/d7f/l99 0 2024-04-25T17:19:14.390 INFO:tasks.workunit.client.0.smithi037.stdout:0/604: creat d9/df/d32/d39/fcb x:0 0 0 2024-04-25T17:19:14.393 INFO:tasks.workunit.client.1.smithi069.stdout:2/409: rename d0/d26/d36/f3f to d0/d56/d5f/d62/d7d/d31/f81 0 2024-04-25T17:19:14.393 INFO:tasks.workunit.client.1.smithi069.stdout:5/460: rename d13/d17 to d13/d17/d19/d96/d9f 22 2024-04-25T17:19:14.394 INFO:tasks.workunit.client.0.smithi037.stdout:1/638: unlink dc/d18/d64/l75 0 2024-04-25T17:19:14.395 INFO:tasks.workunit.client.1.smithi069.stdout:5/461: truncate d13/d17/d29/d30/d5c/f8f 527606 0 2024-04-25T17:19:14.396 INFO:tasks.workunit.client.0.smithi037.stdout:0/605: dread d9/df/d32/d56/f8d [0,4194304] 0 2024-04-25T17:19:14.396 INFO:tasks.workunit.client.1.smithi069.stdout:1/426: creat d1/d43/d1b/d32/f7f x:0 0 0 2024-04-25T17:19:14.399 INFO:tasks.workunit.client.0.smithi037.stdout:1/639: dread dc/d52/d6b/dd9/d22/d36/f4c [8388608,4194304] 0 2024-04-25T17:19:14.400 INFO:tasks.workunit.client.1.smithi069.stdout:5/462: dread d13/f92 [0,4194304] 0 2024-04-25T17:19:14.402 INFO:tasks.workunit.client.1.smithi069.stdout:7/459: write d4/d6/d14/d5a/d5e/f7a [1789377,98974] 0 2024-04-25T17:19:14.402 INFO:tasks.workunit.client.0.smithi037.stdout:2/646: rmdir d0/d15/d2a 39 2024-04-25T17:19:14.403 INFO:tasks.workunit.client.1.smithi069.stdout:7/460: chown d4/d6/c55 68811 1 2024-04-25T17:19:14.405 INFO:tasks.workunit.client.1.smithi069.stdout:6/418: dwrite d2/f21 [4194304,4194304] 0 2024-04-25T17:19:14.405 INFO:tasks.workunit.client.0.smithi037.stdout:4/751: read d7/ff [455556,111738] 0 2024-04-25T17:19:14.405 INFO:tasks.workunit.client.0.smithi037.stdout:8/527: rename d5/db/d23/fab to d5/db/d18/d3b/d75/faf 0 2024-04-25T17:19:14.406 INFO:tasks.workunit.client.1.smithi069.stdout:6/419: chown d2/fe 3 1 2024-04-25T17:19:14.407 INFO:tasks.workunit.client.0.smithi037.stdout:8/528: dread - d5/db/f68 zero size 2024-04-25T17:19:14.407 INFO:tasks.workunit.client.1.smithi069.stdout:4/428: symlink db/d15/d20/d35/l9a 0 2024-04-25T17:19:14.408 INFO:tasks.workunit.client.0.smithi037.stdout:8/529: chown d5/db/f1b 166 1 2024-04-25T17:19:14.408 INFO:tasks.workunit.client.1.smithi069.stdout:4/429: stat db/d15/d26/f91 0 2024-04-25T17:19:14.410 INFO:tasks.workunit.client.1.smithi069.stdout:2/410: creat d0/d26/f82 x:0 0 0 2024-04-25T17:19:14.410 INFO:tasks.workunit.client.1.smithi069.stdout:4/430: dread - db/d15/d20/d35/d63/d43/d48/d49/f56 zero size 2024-04-25T17:19:14.411 INFO:tasks.workunit.client.1.smithi069.stdout:2/411: truncate d0/d26/f2f 179780 0 2024-04-25T17:19:14.412 INFO:tasks.workunit.client.1.smithi069.stdout:2/412: chown d0/l16 100297349 1 2024-04-25T17:19:14.417 INFO:tasks.workunit.client.0.smithi037.stdout:9/734: symlink d1/d48/d68/d26/d81/d9c/da4/lf6 0 2024-04-25T17:19:14.423 INFO:tasks.workunit.client.1.smithi069.stdout:7/461: unlink d4/d6/d14/d5a/f78 0 2024-04-25T17:19:14.424 INFO:tasks.workunit.client.0.smithi037.stdout:6/531: dread db/d26/d2e/d3e/f35 [0,4194304] 0 2024-04-25T17:19:14.425 INFO:tasks.workunit.client.1.smithi069.stdout:9/442: link d2/f39 d2/fa1 0 2024-04-25T17:19:14.428 INFO:tasks.workunit.client.1.smithi069.stdout:6/420: creat d2/d1e/d3e/d74/d48/f92 x:0 0 0 2024-04-25T17:19:14.428 INFO:tasks.workunit.client.0.smithi037.stdout:1/640: mkdir dc/d52/d6b/dd9/d4d/d6a/d8f/ddc 0 2024-04-25T17:19:14.430 INFO:tasks.workunit.client.1.smithi069.stdout:4/431: creat db/d15/d20/d35/d63/d75/f9b x:0 0 0 2024-04-25T17:19:14.436 INFO:tasks.workunit.client.0.smithi037.stdout:3/430: rename d8/d23/d3a/d5d/l19 to d8/d31/d32/d69/l85 0 2024-04-25T17:19:14.437 INFO:tasks.workunit.client.1.smithi069.stdout:5/463: symlink d13/d17/d19/la0 0 2024-04-25T17:19:14.438 INFO:tasks.workunit.client.0.smithi037.stdout:4/752: mkdir d7/d7e/d1e/d2b/d35/d39/d83/df1 0 2024-04-25T17:19:14.438 INFO:tasks.workunit.client.1.smithi069.stdout:5/464: chown d13/d17/d19/d1c/c36 0 1 2024-04-25T17:19:14.439 INFO:tasks.workunit.client.1.smithi069.stdout:5/465: readlink d13/d17/l7d 0 2024-04-25T17:19:14.439 INFO:tasks.workunit.client.1.smithi069.stdout:8/424: creat d37/d47/f89 x:0 0 0 2024-04-25T17:19:14.439 INFO:tasks.workunit.client.0.smithi037.stdout:8/530: mkdir d5/d6a/db0 0 2024-04-25T17:19:14.440 INFO:tasks.workunit.client.1.smithi069.stdout:5/466: truncate d13/d17/d19/d20/d2d/f72 2123241 0 2024-04-25T17:19:14.440 INFO:tasks.workunit.client.0.smithi037.stdout:5/618: mkdir d7/d12/d6f/dbc 0 2024-04-25T17:19:14.441 INFO:tasks.workunit.client.1.smithi069.stdout:5/467: dread - d13/d17/d19/f70 zero size 2024-04-25T17:19:14.442 INFO:tasks.workunit.client.1.smithi069.stdout:9/443: write d2/f5b [2508965,70974] 0 2024-04-25T17:19:14.443 INFO:tasks.workunit.client.1.smithi069.stdout:1/427: link d1/d19/d7c/l50 d1/d43/d1b/d32/d4a/l80 0 2024-04-25T17:19:14.444 INFO:tasks.workunit.client.0.smithi037.stdout:7/568: creat d5/fc9 x:0 0 0 2024-04-25T17:19:14.445 INFO:tasks.workunit.client.0.smithi037.stdout:0/606: mknod d9/df/d32/d39/ccc 0 2024-04-25T17:19:14.446 INFO:tasks.workunit.client.1.smithi069.stdout:7/462: dwrite d4/d6/d14/d5a/f85 [0,4194304] 0 2024-04-25T17:19:14.447 INFO:tasks.workunit.client.0.smithi037.stdout:1/641: truncate dc/d1c/f69 189422 0 2024-04-25T17:19:14.449 INFO:tasks.workunit.client.1.smithi069.stdout:7/463: dread d4/d6/d14/d5a/f7f [0,4194304] 0 2024-04-25T17:19:14.449 INFO:tasks.workunit.client.0.smithi037.stdout:1/642: fdatasync dc/d18/f2b 0 2024-04-25T17:19:14.450 INFO:tasks.workunit.client.0.smithi037.stdout:2/647: write d0/d16/d20/d59/d6a/f99 [697447,59020] 0 2024-04-25T17:19:14.453 INFO:tasks.workunit.client.1.smithi069.stdout:9/444: truncate d2/da/dd/d1e/d2e/d68/f72 590244 0 2024-04-25T17:19:14.454 INFO:tasks.workunit.client.0.smithi037.stdout:0/607: dwrite d9/d14/d23/f3c [0,4194304] 0 2024-04-25T17:19:14.454 INFO:tasks.workunit.client.0.smithi037.stdout:4/753: rename d7/d7e/d4e/f98 to d7/d7e/d4e/da5/ff2 0 2024-04-25T17:19:14.456 INFO:tasks.workunit.client.0.smithi037.stdout:0/608: write d9/df/fb5 [1678503,118850] 0 2024-04-25T17:19:14.458 INFO:tasks.workunit.client.0.smithi037.stdout:0/609: fsync d9/d14/d28/d48/f7e 0 2024-04-25T17:19:14.458 INFO:tasks.workunit.client.1.smithi069.stdout:2/413: mknod d0/d1/d5b/c83 0 2024-04-25T17:19:14.462 INFO:tasks.workunit.client.0.smithi037.stdout:9/735: symlink d1/d5/dc/d3c/dca/df5/lf7 0 2024-04-25T17:19:14.464 INFO:tasks.workunit.client.1.smithi069.stdout:1/428: mkdir d1/d4/d6/d81 0 2024-04-25T17:19:14.464 INFO:tasks.workunit.client.0.smithi037.stdout:5/619: dread - d7/d12/d5d/f81 zero size 2024-04-25T17:19:14.466 INFO:tasks.workunit.client.1.smithi069.stdout:1/429: dread d1/df/f30 [0,4194304] 0 2024-04-25T17:19:14.469 INFO:tasks.workunit.client.0.smithi037.stdout:9/736: dwrite d1/d5/d19/dde/fe0 [0,4194304] 0 2024-04-25T17:19:14.474 INFO:tasks.workunit.client.1.smithi069.stdout:5/468: mknod d13/d17/ca1 0 2024-04-25T17:19:14.478 INFO:tasks.workunit.client.1.smithi069.stdout:1/430: dread d1/d43/f18 [0,4194304] 0 2024-04-25T17:19:14.480 INFO:tasks.workunit.client.1.smithi069.stdout:1/431: dread d1/df/f30 [0,4194304] 0 2024-04-25T17:19:14.481 INFO:tasks.workunit.client.1.smithi069.stdout:7/464: chown d4/d6/d14/d3d/d47/f61 1830812 1 2024-04-25T17:19:14.482 INFO:tasks.workunit.client.1.smithi069.stdout:1/432: dread d1/d43/f18 [0,4194304] 0 2024-04-25T17:19:14.483 INFO:tasks.workunit.client.1.smithi069.stdout:9/445: symlink d2/da/dd/d1e/d2e/la2 0 2024-04-25T17:19:14.484 INFO:tasks.workunit.client.0.smithi037.stdout:2/648: creat d0/d23/dac/fd4 x:0 0 0 2024-04-25T17:19:14.484 INFO:tasks.workunit.client.1.smithi069.stdout:9/446: read d2/da/dd/d1e/d2e/d35/f5a [1022931,101537] 0 2024-04-25T17:19:14.485 INFO:tasks.workunit.client.0.smithi037.stdout:2/649: dread - d0/d15/fb6 zero size 2024-04-25T17:19:14.485 INFO:tasks.workunit.client.0.smithi037.stdout:2/650: fdatasync d0/d16/d20/d59/f8b 0 2024-04-25T17:19:14.487 INFO:tasks.workunit.client.0.smithi037.stdout:2/651: read d0/fa2 [3843763,116154] 0 2024-04-25T17:19:14.493 INFO:tasks.workunit.client.0.smithi037.stdout:3/431: dwrite d8/d31/d32/f39 [0,4194304] 0 2024-04-25T17:19:14.499 INFO:tasks.workunit.client.0.smithi037.stdout:7/569: write d5/d15/d17/d1b/da2/daf/f8b [1419001,38500] 0 2024-04-25T17:19:14.500 INFO:tasks.workunit.client.0.smithi037.stdout:0/610: dread - d9/d71/f99 zero size 2024-04-25T17:19:14.501 INFO:tasks.workunit.client.1.smithi069.stdout:6/421: getdents d2/d51/d89 0 2024-04-25T17:19:14.504 INFO:tasks.workunit.client.1.smithi069.stdout:5/469: rename d13/d17/d19/f28 to d13/d17/d19/d96/fa2 0 2024-04-25T17:19:14.505 INFO:tasks.workunit.client.1.smithi069.stdout:5/470: stat d13/d17/d19/d20/d2d/c3c 0 2024-04-25T17:19:14.506 INFO:tasks.workunit.client.1.smithi069.stdout:1/433: dread d1/f28 [0,4194304] 0 2024-04-25T17:19:14.508 INFO:tasks.workunit.client.0.smithi037.stdout:9/737: symlink d1/d5/dc/d3c/dca/df5/lf8 0 2024-04-25T17:19:14.509 INFO:tasks.workunit.client.1.smithi069.stdout:4/432: link db/d15/d20/d35/d63/d75/c7d db/d22/d24/c9c 0 2024-04-25T17:19:14.511 INFO:tasks.workunit.client.0.smithi037.stdout:1/643: mkdir dc/d52/d6b/dd9/d22/d36/d74/daf/ddd 0 2024-04-25T17:19:14.514 INFO:tasks.workunit.client.1.smithi069.stdout:7/465: mknod d4/d6/d14/d5a/d5e/d89/c96 0 2024-04-25T17:19:14.519 INFO:tasks.workunit.client.0.smithi037.stdout:1/644: dwrite dc/d24/da5/fda [0,4194304] 0 2024-04-25T17:19:14.521 INFO:tasks.workunit.client.0.smithi037.stdout:3/432: mkdir d8/d23/d3a/d63/d86 0 2024-04-25T17:19:14.522 INFO:tasks.workunit.client.0.smithi037.stdout:1/645: write dc/d52/d6b/dd9/d22/d36/d92/fc4 [763935,115223] 0 2024-04-25T17:19:14.523 INFO:tasks.workunit.client.1.smithi069.stdout:9/447: chown d2/da/l9d 4 1 2024-04-25T17:19:14.526 INFO:tasks.workunit.client.1.smithi069.stdout:8/425: link l30 d37/d66/l8a 0 2024-04-25T17:19:14.526 INFO:tasks.workunit.client.1.smithi069.stdout:0/361: sync 2024-04-25T17:19:14.527 INFO:tasks.workunit.client.1.smithi069.stdout:8/426: chown d37/d47/d78/f84 13 1 2024-04-25T17:19:14.529 INFO:tasks.workunit.client.0.smithi037.stdout:5/620: mknod d7/da1/dbb/cbd 0 2024-04-25T17:19:14.530 INFO:tasks.workunit.client.1.smithi069.stdout:4/433: dread db/d15/d20/f25 [0,4194304] 0 2024-04-25T17:19:14.531 INFO:tasks.workunit.client.0.smithi037.stdout:3/433: dwrite d8/d31/d32/f39 [4194304,4194304] 0 2024-04-25T17:19:14.532 INFO:tasks.workunit.client.0.smithi037.stdout:9/738: fsync d1/d5/d2e/d34/f4c 0 2024-04-25T17:19:14.533 INFO:tasks.workunit.client.1.smithi069.stdout:5/471: mknod d13/d17/d19/d8a/ca3 0 2024-04-25T17:19:14.535 INFO:tasks.workunit.client.0.smithi037.stdout:2/652: dread d0/d16/d26/f2c [0,4194304] 0 2024-04-25T17:19:14.535 INFO:tasks.workunit.client.0.smithi037.stdout:6/532: getdents db/d1d/db1 0 2024-04-25T17:19:14.537 INFO:tasks.workunit.client.0.smithi037.stdout:2/653: read - d0/d16/d26/f98 zero size 2024-04-25T17:19:14.538 INFO:tasks.workunit.client.0.smithi037.stdout:8/531: getdents d5/db/d18/d3b/d50/d51 0 2024-04-25T17:19:14.540 INFO:tasks.workunit.client.0.smithi037.stdout:8/532: truncate d5/db/d7e/f9d 795580 0 2024-04-25T17:19:14.542 INFO:tasks.workunit.client.1.smithi069.stdout:9/448: symlink d2/da/dd/d1e/d2e/la3 0 2024-04-25T17:19:14.544 INFO:tasks.workunit.client.0.smithi037.stdout:4/754: link d7/d7e/lbf d7/d7e/d1e/d2b/d35/lf3 0 2024-04-25T17:19:14.548 INFO:tasks.workunit.client.1.smithi069.stdout:8/427: rmdir d37/d47/d78 39 2024-04-25T17:19:14.548 INFO:tasks.workunit.client.1.smithi069.stdout:8/428: stat d37/d47/f5a 0 2024-04-25T17:19:14.552 INFO:tasks.workunit.client.0.smithi037.stdout:7/570: mkdir d5/d15/d17/d1b/da2/daf/dc8/dca 0 2024-04-25T17:19:14.555 INFO:tasks.workunit.client.0.smithi037.stdout:0/611: creat d9/d14/d28/d48/db7/fcd x:0 0 0 2024-04-25T17:19:14.556 INFO:tasks.workunit.client.0.smithi037.stdout:0/612: write d9/df/f45 [1317953,35239] 0 2024-04-25T17:19:14.556 INFO:tasks.workunit.client.1.smithi069.stdout:5/472: mkdir d13/d17/d19/d1c/da4 0 2024-04-25T17:19:14.557 INFO:tasks.workunit.client.0.smithi037.stdout:0/613: chown d9/df/d32/d39/f63 42593 1 2024-04-25T17:19:14.559 INFO:tasks.workunit.client.0.smithi037.stdout:0/614: chown d9/df/d32/d39/d68/f6e 29319248 1 2024-04-25T17:19:14.559 INFO:tasks.workunit.client.1.smithi069.stdout:7/466: dread d4/f4a [0,4194304] 0 2024-04-25T17:19:14.559 INFO:tasks.workunit.client.1.smithi069.stdout:7/467: rename d4 to d4/d18/d36/d97 22 2024-04-25T17:19:14.560 INFO:tasks.workunit.client.1.smithi069.stdout:1/434: link d1/d19/d7c/d1d/f5e d1/d19/d7c/f82 0 2024-04-25T17:19:14.562 INFO:tasks.workunit.client.0.smithi037.stdout:1/646: write dc/d52/d6b/dd9/d22/f2d [368119,90887] 0 2024-04-25T17:19:14.567 INFO:tasks.workunit.client.0.smithi037.stdout:6/533: dread db/d26/d2e/d7d/d65/f71 [0,4194304] 0 2024-04-25T17:19:14.567 INFO:tasks.workunit.client.1.smithi069.stdout:0/362: creat d0/da/d6e/f84 x:0 0 0 2024-04-25T17:19:14.569 INFO:tasks.workunit.client.0.smithi037.stdout:5/621: write d7/d25/f8a [335259,54756] 0 2024-04-25T17:19:14.570 INFO:tasks.workunit.client.1.smithi069.stdout:2/414: dwrite d0/d1/d5b/d33/f51 [0,4194304] 0 2024-04-25T17:19:14.570 INFO:tasks.workunit.client.0.smithi037.stdout:5/622: dread - d7/d12/d5d/faa zero size 2024-04-25T17:19:14.574 INFO:tasks.workunit.client.0.smithi037.stdout:8/533: creat d5/db/d18/d3b/d50/da0/da6/fb1 x:0 0 0 2024-04-25T17:19:14.575 INFO:tasks.workunit.client.0.smithi037.stdout:8/534: dread - d5/db/f68 zero size 2024-04-25T17:19:14.575 INFO:tasks.workunit.client.1.smithi069.stdout:4/434: dwrite db/d22/d24/d41/f47 [0,4194304] 0 2024-04-25T17:19:14.577 INFO:tasks.workunit.client.0.smithi037.stdout:8/535: dread - d5/db/d18/d3b/d50/f8e zero size 2024-04-25T17:19:14.578 INFO:tasks.workunit.client.0.smithi037.stdout:2/654: write d0/d15/f4f [1565266,41396] 0 2024-04-25T17:19:14.579 INFO:tasks.workunit.client.1.smithi069.stdout:5/473: write d13/f1a [3611074,37836] 0 2024-04-25T17:19:14.579 INFO:tasks.workunit.client.1.smithi069.stdout:8/429: dread fb [0,4194304] 0 2024-04-25T17:19:14.580 INFO:tasks.workunit.client.1.smithi069.stdout:7/468: symlink d4/d18/l98 0 2024-04-25T17:19:14.581 INFO:tasks.workunit.client.1.smithi069.stdout:5/474: write d13/d17/f1b [4743016,46191] 0 2024-04-25T17:19:14.582 INFO:tasks.workunit.client.0.smithi037.stdout:4/755: dread d7/f12 [0,4194304] 0 2024-04-25T17:19:14.584 INFO:tasks.workunit.client.0.smithi037.stdout:7/571: fdatasync d5/d15/d17/d1b/da2/daf/f5f 0 2024-04-25T17:19:14.585 INFO:tasks.workunit.client.0.smithi037.stdout:0/615: symlink d9/d14/d23/lce 0 2024-04-25T17:19:14.586 INFO:tasks.workunit.client.0.smithi037.stdout:0/616: stat d9/df/d32/d39/ccc 0 2024-04-25T17:19:14.588 INFO:tasks.workunit.client.1.smithi069.stdout:0/363: chown d0/da/db/d7e/d80/c81 3 1 2024-04-25T17:19:14.588 INFO:tasks.workunit.client.1.smithi069.stdout:5/475: dwrite d13/f60 [0,4194304] 0 2024-04-25T17:19:14.588 INFO:tasks.workunit.client.0.smithi037.stdout:3/434: mkdir d8/d31/d32/d87 0 2024-04-25T17:19:14.589 INFO:tasks.workunit.client.1.smithi069.stdout:5/476: chown d13/d17/d29/d30 4838 1 2024-04-25T17:19:14.589 INFO:tasks.workunit.client.0.smithi037.stdout:3/435: chown d8/d23/d3a/d5d/c16 100294403 1 2024-04-25T17:19:14.590 INFO:tasks.workunit.client.1.smithi069.stdout:2/415: unlink d0/d1/d5b/d33/c3b 0 2024-04-25T17:19:14.592 INFO:tasks.workunit.client.0.smithi037.stdout:9/739: mknod d1/d48/d68/d26/d81/cf9 0 2024-04-25T17:19:14.596 INFO:tasks.workunit.client.0.smithi037.stdout:6/534: symlink db/d26/d2e/d7d/d65/d8b/lc0 0 2024-04-25T17:19:14.597 INFO:tasks.workunit.client.1.smithi069.stdout:7/469: symlink d4/d83/l99 0 2024-04-25T17:19:14.598 INFO:tasks.workunit.client.0.smithi037.stdout:5/623: dread - d7/f57 zero size 2024-04-25T17:19:14.598 INFO:tasks.workunit.client.1.smithi069.stdout:1/435: getdents d1/df/d6c 0 2024-04-25T17:19:14.599 INFO:tasks.workunit.client.1.smithi069.stdout:1/436: fsync d1/df/d17/f24 0 2024-04-25T17:19:14.600 INFO:tasks.workunit.client.1.smithi069.stdout:1/437: write d1/d19/d7c/f64 [900852,28867] 0 2024-04-25T17:19:14.604 INFO:tasks.workunit.client.1.smithi069.stdout:9/449: write d2/da/dd/de/d74/d8a/f9e [1034249,77682] 0 2024-04-25T17:19:14.605 INFO:tasks.workunit.client.0.smithi037.stdout:5/624: dwrite d7/d12/f5e [0,4194304] 0 2024-04-25T17:19:14.606 INFO:tasks.workunit.client.1.smithi069.stdout:0/364: write d0/da/db/f4e [582681,80081] 0 2024-04-25T17:19:14.612 INFO:tasks.workunit.client.1.smithi069.stdout:2/416: rmdir d0/d1/d5b/d33 39 2024-04-25T17:19:14.613 INFO:tasks.workunit.client.1.smithi069.stdout:2/417: fdatasync d0/d56/d5f/d62/f73 0 2024-04-25T17:19:14.614 INFO:tasks.workunit.client.1.smithi069.stdout:4/435: mknod db/d15/d20/d35/d63/d43/d48/d49/d72/d84/c9d 0 2024-04-25T17:19:14.614 INFO:tasks.workunit.client.1.smithi069.stdout:4/436: readlink db/d4b/l93 0 2024-04-25T17:19:14.619 INFO:tasks.workunit.client.1.smithi069.stdout:9/450: dread d2/da/dd/d1e/d2e/d35/f38 [0,4194304] 0 2024-04-25T17:19:14.620 INFO:tasks.workunit.client.0.smithi037.stdout:7/572: dread d5/d15/d17/d1b/da2/d76/fb3 [0,4194304] 0 2024-04-25T17:19:14.620 INFO:tasks.workunit.client.0.smithi037.stdout:0/617: rename d9/df/d32/d35/l41 to d9/d71/dad/d7a/da4/lcf 0 2024-04-25T17:19:14.621 INFO:tasks.workunit.client.0.smithi037.stdout:8/536: write d5/da/f4a [3969740,113529] 0 2024-04-25T17:19:14.621 INFO:tasks.workunit.client.1.smithi069.stdout:4/437: dwrite db/d22/d24/d41/f87 [0,4194304] 0 2024-04-25T17:19:14.623 INFO:tasks.workunit.client.1.smithi069.stdout:3/517: sync 2024-04-25T17:19:14.625 INFO:tasks.workunit.client.1.smithi069.stdout:3/518: write d8/d71/d8d/f8f [4673178,122980] 0 2024-04-25T17:19:14.628 INFO:tasks.workunit.client.1.smithi069.stdout:7/470: dwrite d4/f4a [0,4194304] 0 2024-04-25T17:19:14.629 INFO:tasks.workunit.client.1.smithi069.stdout:3/519: write d8/d39/f3c [4462380,105350] 0 2024-04-25T17:19:14.630 INFO:tasks.workunit.client.0.smithi037.stdout:0/618: dread d9/df/d32/f4b [0,4194304] 0 2024-04-25T17:19:14.632 INFO:tasks.workunit.client.0.smithi037.stdout:6/535: symlink db/d53/lc1 0 2024-04-25T17:19:14.632 INFO:tasks.workunit.client.1.smithi069.stdout:7/471: dread - d4/d6/d14/d44/f8b zero size 2024-04-25T17:19:14.633 INFO:tasks.workunit.client.1.smithi069.stdout:3/520: read - d8/d16/d1a/d2c/d93/f96 zero size 2024-04-25T17:19:14.635 INFO:tasks.workunit.client.1.smithi069.stdout:4/438: dwrite db/d15/d20/d35/d63/d43/d48/f5e [0,4194304] 0 2024-04-25T17:19:14.637 INFO:tasks.workunit.client.1.smithi069.stdout:4/439: chown db/d15/d20/f25 0 1 2024-04-25T17:19:14.638 INFO:tasks.workunit.client.1.smithi069.stdout:8/430: dwrite f2b [0,4194304] 0 2024-04-25T17:19:14.640 INFO:tasks.workunit.client.0.smithi037.stdout:2/655: mknod d0/d16/d3b/cd5 0 2024-04-25T17:19:14.644 INFO:tasks.workunit.client.1.smithi069.stdout:7/472: dwrite d4/d6/d14/d44/d79/d23/f6b [0,4194304] 0 2024-04-25T17:19:14.644 INFO:tasks.workunit.client.0.smithi037.stdout:4/756: symlink d7/d7e/d1e/lf4 0 2024-04-25T17:19:14.648 INFO:tasks.workunit.client.1.smithi069.stdout:1/438: creat d1/d4/d6/d4f/f83 x:0 0 0 2024-04-25T17:19:14.649 INFO:tasks.workunit.client.0.smithi037.stdout:6/536: dwrite db/f14 [4194304,4194304] 0 2024-04-25T17:19:14.649 INFO:tasks.workunit.client.0.smithi037.stdout:6/537: chown db/f15 131277297 1 2024-04-25T17:19:14.650 INFO:tasks.workunit.client.0.smithi037.stdout:6/538: fsync db/d26/d2e/d3e/d25/db0/fba 0 2024-04-25T17:19:14.653 INFO:tasks.workunit.client.0.smithi037.stdout:3/436: mkdir d8/d23/d3a/d63/d86/d88 0 2024-04-25T17:19:14.654 INFO:tasks.workunit.client.0.smithi037.stdout:8/537: creat d5/db/d18/d3b/fb2 x:0 0 0 2024-04-25T17:19:14.656 INFO:tasks.workunit.client.0.smithi037.stdout:8/538: write d5/db/d18/d3b/d50/f56 [888850,124292] 0 2024-04-25T17:19:14.659 INFO:tasks.workunit.client.1.smithi069.stdout:0/365: write d0/da/d24/f6d [2516767,70485] 0 2024-04-25T17:19:14.659 INFO:tasks.workunit.client.1.smithi069.stdout:0/366: readlink d0/l12 0 2024-04-25T17:19:14.660 INFO:tasks.workunit.client.1.smithi069.stdout:0/367: truncate d0/d38/f7a 4976172 0 2024-04-25T17:19:14.661 INFO:tasks.workunit.client.1.smithi069.stdout:4/440: mkdir db/d22/d24/d41/d9e 0 2024-04-25T17:19:14.661 INFO:tasks.workunit.client.0.smithi037.stdout:0/619: stat d9/df/d32/f47 0 2024-04-25T17:19:14.665 INFO:tasks.workunit.client.1.smithi069.stdout:0/368: dwrite d0/f8 [0,4194304] 0 2024-04-25T17:19:14.666 INFO:tasks.workunit.client.0.smithi037.stdout:2/656: mkdir d0/d16/d20/d59/d6a/da5/dbd/dd6 0 2024-04-25T17:19:14.669 INFO:tasks.workunit.client.1.smithi069.stdout:9/451: mkdir d2/da4 0 2024-04-25T17:19:14.670 INFO:tasks.workunit.client.0.smithi037.stdout:0/620: dwrite d9/fc5 [0,4194304] 0 2024-04-25T17:19:14.670 INFO:tasks.workunit.client.0.smithi037.stdout:4/757: symlink d7/d7e/d1e/d2b/d35/d39/dba/lf5 0 2024-04-25T17:19:14.671 INFO:tasks.workunit.client.1.smithi069.stdout:6/422: sync 2024-04-25T17:19:14.672 INFO:tasks.workunit.client.1.smithi069.stdout:5/477: dwrite d13/d17/d19/f25 [0,4194304] 0 2024-04-25T17:19:14.673 INFO:tasks.workunit.client.1.smithi069.stdout:5/478: chown d13/d17/f42 24999188 1 2024-04-25T17:19:14.673 INFO:tasks.workunit.client.0.smithi037.stdout:7/573: mkdir d5/d15/d17/d25/d2b/dcb 0 2024-04-25T17:19:14.674 INFO:tasks.workunit.client.1.smithi069.stdout:1/439: fsync d1/df/f30 0 2024-04-25T17:19:14.676 INFO:tasks.workunit.client.0.smithi037.stdout:6/539: rmdir db/d26/d2e/d7d/d65/d68 39 2024-04-25T17:19:14.677 INFO:tasks.workunit.client.1.smithi069.stdout:8/431: mknod d37/c8b 0 2024-04-25T17:19:14.679 INFO:tasks.workunit.client.0.smithi037.stdout:1/647: creat dc/d18/d66/fde x:0 0 0 2024-04-25T17:19:14.683 INFO:tasks.workunit.client.1.smithi069.stdout:4/441: write db/d22/f71 [1547619,23679] 0 2024-04-25T17:19:14.685 INFO:tasks.workunit.client.1.smithi069.stdout:8/432: dwrite d37/d47/d48/f71 [0,4194304] 0 2024-04-25T17:19:14.685 INFO:tasks.workunit.client.1.smithi069.stdout:3/521: dread d8/d16/f27 [0,4194304] 0 2024-04-25T17:19:14.689 INFO:tasks.workunit.client.0.smithi037.stdout:9/740: truncate d1/d5/d19/dde/fe0 2527584 0 2024-04-25T17:19:14.690 INFO:tasks.workunit.client.0.smithi037.stdout:9/741: chown d1/d5/fdb 234322 1 2024-04-25T17:19:14.691 INFO:tasks.workunit.client.1.smithi069.stdout:0/369: creat d0/da/d59/f85 x:0 0 0 2024-04-25T17:19:14.692 INFO:tasks.workunit.client.0.smithi037.stdout:5/625: link d7/d12/c51 d7/d12/d6f/d68/cbe 0 2024-04-25T17:19:14.696 INFO:tasks.workunit.client.1.smithi069.stdout:7/473: symlink d4/d6/d14/l9a 0 2024-04-25T17:19:14.697 INFO:tasks.workunit.client.1.smithi069.stdout:7/474: chown d4/d83/f8f 3 1 2024-04-25T17:19:14.698 INFO:tasks.workunit.client.1.smithi069.stdout:9/452: creat d2/da/dd/d1e/d2e/d35/fa5 x:0 0 0 2024-04-25T17:19:14.698 INFO:tasks.workunit.client.1.smithi069.stdout:7/475: write d4/d6/d14/d44/d79/d23/f6b [4571858,119992] 0 2024-04-25T17:19:14.703 INFO:tasks.workunit.client.1.smithi069.stdout:9/453: dwrite d2/da/dd/de/d64/f6e [0,4194304] 0 2024-04-25T17:19:14.706 INFO:tasks.workunit.client.1.smithi069.stdout:1/440: symlink d1/d4/l84 0 2024-04-25T17:19:14.707 INFO:tasks.workunit.client.0.smithi037.stdout:8/539: write d5/db/d23/d58/f6e [4694560,125149] 0 2024-04-25T17:19:14.708 INFO:tasks.workunit.client.0.smithi037.stdout:3/437: creat d8/d31/d32/d87/f89 x:0 0 0 2024-04-25T17:19:14.710 INFO:tasks.workunit.client.0.smithi037.stdout:7/574: dread d5/d15/d17/d25/f67 [0,4194304] 0 2024-04-25T17:19:14.711 INFO:tasks.workunit.client.0.smithi037.stdout:1/648: symlink dc/d52/d6b/dd9/d22/d36/d74/daf/ldf 0 2024-04-25T17:19:14.713 INFO:tasks.workunit.client.0.smithi037.stdout:0/621: dread d9/d14/d28/d48/d58/f5e [0,4194304] 0 2024-04-25T17:19:14.713 INFO:tasks.workunit.client.1.smithi069.stdout:2/418: rename d0/d1/d5b/f34 to d0/d1/d5b/d33/f84 0 2024-04-25T17:19:14.715 INFO:tasks.workunit.client.0.smithi037.stdout:0/622: chown d9/df/d32/d39/ccc 540865333 1 2024-04-25T17:19:14.715 INFO:tasks.workunit.client.1.smithi069.stdout:2/419: read d0/d56/d5f/d62/d7d/d31/f48 [907727,32068] 0 2024-04-25T17:19:14.715 INFO:tasks.workunit.client.1.smithi069.stdout:8/433: mknod d37/d47/d54/c8c 0 2024-04-25T17:19:14.716 INFO:tasks.workunit.client.1.smithi069.stdout:8/434: write d37/f50 [3434873,5670] 0 2024-04-25T17:19:14.716 INFO:tasks.workunit.client.1.smithi069.stdout:2/420: dread d0/d26/f2f [0,4194304] 0 2024-04-25T17:19:14.717 INFO:tasks.workunit.client.1.smithi069.stdout:2/421: stat d0/d1/d5b/d33/c5a 0 2024-04-25T17:19:14.718 INFO:tasks.workunit.client.0.smithi037.stdout:2/657: creat d0/d15/dcb/fd7 x:0 0 0 2024-04-25T17:19:14.725 INFO:tasks.workunit.client.0.smithi037.stdout:6/540: symlink db/d26/d2e/d7d/d65/lc2 0 2024-04-25T17:19:14.727 INFO:tasks.workunit.client.1.smithi069.stdout:7/476: creat d4/d3e/f9b x:0 0 0 2024-04-25T17:19:14.732 INFO:tasks.workunit.client.1.smithi069.stdout:9/454: symlink d2/da/d5f/la6 0 2024-04-25T17:19:14.733 INFO:tasks.workunit.client.1.smithi069.stdout:9/455: stat d2/da/dd/d1e/c2a 0 2024-04-25T17:19:14.734 INFO:tasks.workunit.client.0.smithi037.stdout:4/758: dwrite d7/d8a/f8b [0,4194304] 0 2024-04-25T17:19:14.737 INFO:tasks.workunit.client.0.smithi037.stdout:4/759: write d7/d7e/d1e/dae/fd0 [5299196,130183] 0 2024-04-25T17:19:14.739 INFO:tasks.workunit.client.0.smithi037.stdout:4/760: chown d7/d7e/d45/d4f/lcd 226291 1 2024-04-25T17:19:14.740 INFO:tasks.workunit.client.0.smithi037.stdout:9/742: mkdir d1/d5/dc/dfa 0 2024-04-25T17:19:14.741 INFO:tasks.workunit.client.0.smithi037.stdout:0/623: chown d9/d72 1327 1 2024-04-25T17:19:14.742 INFO:tasks.workunit.client.0.smithi037.stdout:5/626: mkdir d7/d12/d6f/dbf 0 2024-04-25T17:19:14.744 INFO:tasks.workunit.client.1.smithi069.stdout:3/522: link d8/d16/d1a/d2c/d6c/d9c/da9/d42/f7e d8/d16/d1a/d38/fba 0 2024-04-25T17:19:14.745 INFO:tasks.workunit.client.0.smithi037.stdout:3/438: dwrite f5 [0,4194304] 0 2024-04-25T17:19:14.746 INFO:tasks.workunit.client.1.smithi069.stdout:3/523: dread - d8/d16/d1a/d2c/d93/f96 zero size 2024-04-25T17:19:14.747 INFO:tasks.workunit.client.1.smithi069.stdout:8/435: dwrite f33 [0,4194304] 0 2024-04-25T17:19:14.747 INFO:tasks.workunit.client.0.smithi037.stdout:3/439: truncate d8/d23/d72/f7a 4452392 0 2024-04-25T17:19:14.747 INFO:tasks.workunit.client.1.smithi069.stdout:2/422: creat d0/d56/d5f/d62/d7d/d31/d61/f85 x:0 0 0 2024-04-25T17:19:14.748 INFO:tasks.workunit.client.1.smithi069.stdout:8/436: dread - d37/d66/f6f zero size 2024-04-25T17:19:14.748 INFO:tasks.workunit.client.0.smithi037.stdout:1/649: write dc/d52/d6b/dd9/d4d/d6a/d86/f97 [9489837,37990] 0 2024-04-25T17:19:14.755 INFO:tasks.workunit.client.1.smithi069.stdout:8/437: dwrite d37/d47/f5a [0,4194304] 0 2024-04-25T17:19:14.764 INFO:tasks.workunit.client.1.smithi069.stdout:8/438: dwrite d37/d47/d54/f68 [0,4194304] 0 2024-04-25T17:19:14.766 INFO:tasks.workunit.client.1.smithi069.stdout:0/370: truncate d0/da/d24/f6d 3744308 0 2024-04-25T17:19:14.767 INFO:tasks.workunit.client.1.smithi069.stdout:0/371: write d0/d38/f49 [2463808,105991] 0 2024-04-25T17:19:14.769 INFO:tasks.workunit.client.1.smithi069.stdout:0/372: truncate d0/da/d6e/f84 590774 0 2024-04-25T17:19:14.770 INFO:tasks.workunit.client.1.smithi069.stdout:0/373: stat d0/da/db/d56/l66 0 2024-04-25T17:19:14.770 INFO:tasks.workunit.client.1.smithi069.stdout:3/524: symlink d8/lbb 0 2024-04-25T17:19:14.771 INFO:tasks.workunit.client.1.smithi069.stdout:2/423: fsync d0/d26/d10/f5c 0 2024-04-25T17:19:14.774 INFO:tasks.workunit.client.1.smithi069.stdout:6/423: getdents d2 0 2024-04-25T17:19:14.774 INFO:tasks.workunit.client.0.smithi037.stdout:5/627: read d7/f33 [577223,127271] 0 2024-04-25T17:19:14.776 INFO:tasks.workunit.client.0.smithi037.stdout:5/628: read d7/d25/f4b [979184,48361] 0 2024-04-25T17:19:14.776 INFO:tasks.workunit.client.1.smithi069.stdout:7/477: symlink d4/d6/d14/l9c 0 2024-04-25T17:19:14.778 INFO:tasks.workunit.client.1.smithi069.stdout:5/479: getdents d13/d17/d19/d8a 0 2024-04-25T17:19:14.779 INFO:tasks.workunit.client.1.smithi069.stdout:0/374: dwrite d0/da/d24/d43/f57 [0,4194304] 0 2024-04-25T17:19:14.780 INFO:tasks.workunit.client.1.smithi069.stdout:9/456: mkdir d2/da4/da7 0 2024-04-25T17:19:14.781 INFO:tasks.workunit.client.1.smithi069.stdout:0/375: chown d0/d17 245265 1 2024-04-25T17:19:14.782 INFO:tasks.workunit.client.0.smithi037.stdout:1/650: mknod dc/d52/d6b/dd9/d22/d36/d92/db8/dbc/ce0 0 2024-04-25T17:19:14.783 INFO:tasks.workunit.client.1.smithi069.stdout:2/424: dwrite d0/d1/d5b/d33/f39 [0,4194304] 0 2024-04-25T17:19:14.784 INFO:tasks.workunit.client.0.smithi037.stdout:6/541: creat db/d26/d2e/d7d/d65/d68/d87/fc3 x:0 0 0 2024-04-25T17:19:14.788 INFO:tasks.workunit.client.0.smithi037.stdout:8/540: rename d5/db/f1b to d5/db/fb3 0 2024-04-25T17:19:14.788 INFO:tasks.workunit.client.0.smithi037.stdout:6/542: write db/d26/d2e/d7d/d65/d68/d87/fa4 [661261,86340] 0 2024-04-25T17:19:14.791 INFO:tasks.workunit.client.1.smithi069.stdout:1/441: dwrite d1/d4/d6/f16 [0,4194304] 0 2024-04-25T17:19:14.796 INFO:tasks.workunit.client.1.smithi069.stdout:2/425: dwrite d0/d26/d10/f49 [0,4194304] 0 2024-04-25T17:19:14.799 INFO:tasks.workunit.client.1.smithi069.stdout:2/426: readlink d0/d26/l45 0 2024-04-25T17:19:14.801 INFO:tasks.workunit.client.1.smithi069.stdout:3/525: write d8/d16/d1a/d2c/d6c/d9c/da9/fa3 [5764652,89424] 0 2024-04-25T17:19:14.802 INFO:tasks.workunit.client.1.smithi069.stdout:1/442: dwrite d1/d4/d6/f16 [0,4194304] 0 2024-04-25T17:19:14.803 INFO:tasks.workunit.client.0.smithi037.stdout:8/541: dwrite d5/db/d23/d42/f43 [0,4194304] 0 2024-04-25T17:19:14.803 INFO:tasks.workunit.client.0.smithi037.stdout:3/440: dwrite d8/d23/d38/f73 [0,4194304] 0 2024-04-25T17:19:14.805 INFO:tasks.workunit.client.1.smithi069.stdout:2/427: read d0/d26/d10/f7e [1285870,51780] 0 2024-04-25T17:19:14.807 INFO:tasks.workunit.client.1.smithi069.stdout:6/424: creat d2/d51/f93 x:0 0 0 2024-04-25T17:19:14.808 INFO:tasks.workunit.client.1.smithi069.stdout:6/425: chown d2/c6 121305 1 2024-04-25T17:19:14.809 INFO:tasks.workunit.client.1.smithi069.stdout:9/457: dread d2/da/d14/d23/d65/f73 [0,4194304] 0 2024-04-25T17:19:14.826 INFO:tasks.workunit.client.1.smithi069.stdout:4/442: sync 2024-04-25T17:19:14.900 INFO:tasks.workunit.client.1.smithi069.stdout:1/443: mknod d1/d4/de/c85 0 2024-04-25T17:19:14.901 INFO:tasks.workunit.client.1.smithi069.stdout:1/444: write d1/d4/de/d44/f5c [401949,55772] 0 2024-04-25T17:19:14.902 INFO:tasks.workunit.client.1.smithi069.stdout:2/428: mknod d0/d56/d5f/d62/d7d/d72/c86 0 2024-04-25T17:19:14.904 INFO:tasks.workunit.client.1.smithi069.stdout:2/429: dread - d0/d56/d5f/d62/d7d/d31/d61/f85 zero size 2024-04-25T17:19:14.904 INFO:tasks.workunit.client.1.smithi069.stdout:2/430: dread - d0/d56/f6f zero size 2024-04-25T17:19:14.919 INFO:tasks.workunit.client.0.smithi037.stdout:9/743: fsync d1/d48/d68/f7e 0 2024-04-25T17:19:14.922 INFO:tasks.workunit.client.0.smithi037.stdout:0/624: creat d9/df/d32/d39/d68/da7/db4/fd0 x:0 0 0 2024-04-25T17:19:14.926 INFO:tasks.workunit.client.0.smithi037.stdout:5/629: creat d7/da1/dbb/fc0 x:0 0 0 2024-04-25T17:19:14.927 INFO:tasks.workunit.client.0.smithi037.stdout:5/630: stat d7/d25/f39 0 2024-04-25T17:19:14.929 INFO:tasks.workunit.client.0.smithi037.stdout:2/658: rmdir d0/d16/d3b/db0/dc3 0 2024-04-25T17:19:14.930 INFO:tasks.workunit.client.0.smithi037.stdout:2/659: write d0/f14 [5126170,102219] 0 2024-04-25T17:19:14.932 INFO:tasks.workunit.client.1.smithi069.stdout:9/458: sync 2024-04-25T17:19:14.936 INFO:tasks.workunit.client.0.smithi037.stdout:1/651: unlink dc/d52/d6b/dd9/d22/d36/d8c/c8e 0 2024-04-25T17:19:14.948 INFO:tasks.workunit.client.0.smithi037.stdout:3/441: mknod d8/d31/d32/d3e/c8a 0 2024-04-25T17:19:14.953 INFO:tasks.workunit.client.0.smithi037.stdout:0/625: readlink d9/l9d 0 2024-04-25T17:19:14.955 INFO:tasks.workunit.client.0.smithi037.stdout:4/761: link d7/d7e/d1e/d2b/d35/f40 d7/d7e/d1e/d2b/d35/d39/d83/df1/ff6 0 2024-04-25T17:19:14.958 INFO:tasks.workunit.client.1.smithi069.stdout:7/478: link d4/d18/l93 d4/d18/d36/l9d 0 2024-04-25T17:19:14.959 INFO:tasks.workunit.client.1.smithi069.stdout:7/479: write d4/d6/d14/d15/f63 [894841,75202] 0 2024-04-25T17:19:14.967 INFO:tasks.workunit.client.0.smithi037.stdout:3/442: read d8/ff [377920,118465] 0 2024-04-25T17:19:14.970 INFO:tasks.workunit.client.0.smithi037.stdout:0/626: unlink d9/d14/d28/d48/d58/dc4/fca 0 2024-04-25T17:19:14.972 INFO:tasks.workunit.client.1.smithi069.stdout:6/426: rename d2/f4e to d2/d7/f94 0 2024-04-25T17:19:14.973 INFO:tasks.workunit.client.0.smithi037.stdout:3/443: dwrite d8/d23/d38/f73 [4194304,4194304] 0 2024-04-25T17:19:14.974 INFO:tasks.workunit.client.0.smithi037.stdout:5/631: symlink d7/d12/lc1 0 2024-04-25T17:19:14.976 INFO:tasks.workunit.client.1.smithi069.stdout:9/459: symlink d2/da/dd/d1e/la8 0 2024-04-25T17:19:14.979 INFO:tasks.workunit.client.0.smithi037.stdout:1/652: truncate fa 690056 0 2024-04-25T17:19:14.983 INFO:tasks.workunit.client.1.smithi069.stdout:7/480: truncate d4/d1a/f35 444668 0 2024-04-25T17:19:14.987 INFO:tasks.workunit.client.1.smithi069.stdout:1/445: unlink d1/d43/d1b/d32/d4a/l80 0 2024-04-25T17:19:14.988 INFO:tasks.workunit.client.1.smithi069.stdout:1/446: chown d1/d19/d7c/c15 0 1 2024-04-25T17:19:14.991 INFO:tasks.workunit.client.0.smithi037.stdout:5/632: rmdir d7/d25 39 2024-04-25T17:19:14.994 INFO:tasks.workunit.client.0.smithi037.stdout:1/653: truncate dc/d24/f4b 1435907 0 2024-04-25T17:19:14.995 INFO:tasks.workunit.client.0.smithi037.stdout:1/654: fdatasync dc/d52/d6b/dd9/d4d/d6a/d86/f97 0 2024-04-25T17:19:14.997 INFO:tasks.workunit.client.0.smithi037.stdout:3/444: symlink d8/d23/d3a/d81/l8b 0 2024-04-25T17:19:14.999 INFO:tasks.workunit.client.1.smithi069.stdout:9/460: rename d2/da/dd/de/d64/c9a to d2/da/d5f/d76/ca9 0 2024-04-25T17:19:15.005 INFO:tasks.workunit.client.1.smithi069.stdout:3/526: mkdir d8/d16/d1a/d2c/d49/dbc 0 2024-04-25T17:19:15.011 INFO:tasks.workunit.client.0.smithi037.stdout:1/655: dread dc/d18/f2f [0,4194304] 0 2024-04-25T17:19:15.016 INFO:tasks.workunit.client.0.smithi037.stdout:5/633: dread d7/d43/f30 [0,4194304] 0 2024-04-25T17:19:15.018 INFO:tasks.workunit.client.0.smithi037.stdout:5/634: write d7/d12/f46 [1284022,99159] 0 2024-04-25T17:19:15.019 INFO:tasks.workunit.client.0.smithi037.stdout:5/635: readlink d7/l7d 0 2024-04-25T17:19:15.020 INFO:tasks.workunit.client.0.smithi037.stdout:1/656: symlink dc/d52/d6b/le1 0 2024-04-25T17:19:15.020 INFO:tasks.workunit.client.1.smithi069.stdout:3/527: dread d8/d16/d1a/d2c/f45 [0,4194304] 0 2024-04-25T17:19:15.021 INFO:tasks.workunit.client.1.smithi069.stdout:8/439: creat d37/d47/f8d x:0 0 0 2024-04-25T17:19:15.022 INFO:tasks.workunit.client.1.smithi069.stdout:2/431: getdents d0/d1 0 2024-04-25T17:19:15.024 INFO:tasks.workunit.client.1.smithi069.stdout:9/461: truncate d2/da/dd/f90 1139671 0 2024-04-25T17:19:15.025 INFO:tasks.workunit.client.0.smithi037.stdout:5/636: dwrite d7/d18/d62/f8c [0,4194304] 0 2024-04-25T17:19:15.027 INFO:tasks.workunit.client.0.smithi037.stdout:5/637: truncate d7/d12/d6f/d68/fb6 823213 0 2024-04-25T17:19:15.028 INFO:tasks.workunit.client.1.smithi069.stdout:3/528: dwrite d8/d16/d1a/d2c/d6c/d9c/da9/fa3 [4194304,4194304] 0 2024-04-25T17:19:15.031 INFO:tasks.workunit.client.1.smithi069.stdout:2/432: dwrite d0/d56/d5f/d62/d7d/d31/f6a [0,4194304] 0 2024-04-25T17:19:15.031 INFO:tasks.workunit.client.1.smithi069.stdout:2/433: rename d0/d26 to d0/d26/d36/d87 22 2024-04-25T17:19:15.032 INFO:tasks.workunit.client.1.smithi069.stdout:8/440: mkdir d37/d47/d48/d8e 0 2024-04-25T17:19:15.033 INFO:tasks.workunit.client.1.smithi069.stdout:2/434: write d0/d26/d10/f5c [5147011,121074] 0 2024-04-25T17:19:15.040 INFO:tasks.workunit.client.1.smithi069.stdout:0/376: truncate d0/da/d24/d67/f6a 3910339 0 2024-04-25T17:19:15.041 INFO:tasks.workunit.client.0.smithi037.stdout:5/638: chown d7/d12/d6f/l85 2510962 1 2024-04-25T17:19:15.043 INFO:tasks.workunit.client.1.smithi069.stdout:9/462: readlink d2/l9 0 2024-04-25T17:19:15.046 INFO:tasks.workunit.client.1.smithi069.stdout:3/529: creat d8/d16/d1a/d2c/d49/d87/d8a/fbd x:0 0 0 2024-04-25T17:19:15.050 INFO:tasks.workunit.client.1.smithi069.stdout:8/441: creat d37/d62/f8f x:0 0 0 2024-04-25T17:19:15.053 INFO:tasks.workunit.client.1.smithi069.stdout:0/377: chown d0/da/db/d1d/c82 32463 1 2024-04-25T17:19:15.057 INFO:tasks.workunit.client.1.smithi069.stdout:2/435: mknod d0/d1/d5b/c88 0 2024-04-25T17:19:15.061 INFO:tasks.workunit.client.1.smithi069.stdout:2/436: dread d0/f7 [0,4194304] 0 2024-04-25T17:19:15.062 INFO:tasks.workunit.client.0.smithi037.stdout:5/639: getdents d7/d25/d4f/da7 0 2024-04-25T17:19:15.062 INFO:tasks.workunit.client.1.smithi069.stdout:2/437: write d0/d56/d5f/d62/d7d/d31/f6a [330711,34754] 0 2024-04-25T17:19:15.066 INFO:tasks.workunit.client.1.smithi069.stdout:3/530: mknod d8/d16/d1a/cbe 0 2024-04-25T17:19:15.071 INFO:tasks.workunit.client.1.smithi069.stdout:8/442: creat d37/d47/d78/f90 x:0 0 0 2024-04-25T17:19:15.072 INFO:tasks.workunit.client.1.smithi069.stdout:9/463: dread d2/f5b [0,4194304] 0 2024-04-25T17:19:15.074 INFO:tasks.workunit.client.1.smithi069.stdout:2/438: creat d0/d56/d5f/f89 x:0 0 0 2024-04-25T17:19:15.076 INFO:tasks.workunit.client.1.smithi069.stdout:0/378: rename d0/d36/f4f to d0/da/db/d1d/f86 0 2024-04-25T17:19:15.079 INFO:tasks.workunit.client.1.smithi069.stdout:2/439: symlink d0/d56/d5f/d62/d7d/d31/d61/l8a 0 2024-04-25T17:19:15.080 INFO:tasks.workunit.client.1.smithi069.stdout:2/440: write d0/d1/d5b/d33/f67 [481251,22417] 0 2024-04-25T17:19:15.082 INFO:tasks.workunit.client.1.smithi069.stdout:3/531: rename d8/d16/d4b/f79 to d8/d16/d1a/d2c/d6c/d9c/da9/fbf 0 2024-04-25T17:19:15.088 INFO:tasks.workunit.client.1.smithi069.stdout:3/532: mknod d8/d16/d9b/cc0 0 2024-04-25T17:19:15.089 INFO:tasks.workunit.client.1.smithi069.stdout:3/533: stat d8/d16/d1a/d2c/d6c/d9c/da9/c48 0 2024-04-25T17:19:15.089 INFO:tasks.workunit.client.1.smithi069.stdout:0/379: mknod d0/d17/d83/c87 0 2024-04-25T17:19:15.091 INFO:tasks.workunit.client.1.smithi069.stdout:9/464: creat d2/da/faa x:0 0 0 2024-04-25T17:19:15.094 INFO:tasks.workunit.client.1.smithi069.stdout:3/534: fsync d8/f19 0 2024-04-25T17:19:15.097 INFO:tasks.workunit.client.1.smithi069.stdout:9/465: dwrite d2/da/dd/de/f12 [0,4194304] 0 2024-04-25T17:19:15.106 INFO:tasks.workunit.client.1.smithi069.stdout:2/441: unlink d0/d56/d5f/d62/d7d/f50 0 2024-04-25T17:19:15.110 INFO:tasks.workunit.client.1.smithi069.stdout:4/443: mknod db/d15/d20/c9f 0 2024-04-25T17:19:15.116 INFO:tasks.workunit.client.1.smithi069.stdout:0/380: link d0/da/db/d1d/f20 d0/d17/f88 0 2024-04-25T17:19:15.117 INFO:tasks.workunit.client.1.smithi069.stdout:1/447: rmdir d1/d19/d7c/d1d 39 2024-04-25T17:19:15.117 INFO:tasks.workunit.client.1.smithi069.stdout:1/448: chown d1/f5 1261 1 2024-04-25T17:19:15.120 INFO:tasks.workunit.client.1.smithi069.stdout:1/449: unlink d1/d19/d7c/c15 0 2024-04-25T17:19:15.122 INFO:tasks.workunit.client.1.smithi069.stdout:0/381: dwrite d0/da/db/d3a/f5a [0,4194304] 0 2024-04-25T17:19:15.123 INFO:tasks.workunit.client.1.smithi069.stdout:1/450: truncate d1/df/f42 4228183 0 2024-04-25T17:19:15.124 INFO:tasks.workunit.client.1.smithi069.stdout:1/451: fdatasync d1/d19/d7c/d4d/f7a 0 2024-04-25T17:19:15.125 INFO:tasks.workunit.client.0.smithi037.stdout:6/543: dwrite db/d26/d2e/d3e/f6f [0,4194304] 0 2024-04-25T17:19:15.127 INFO:tasks.workunit.client.1.smithi069.stdout:0/382: mkdir d0/da/db/d1d/d89 0 2024-04-25T17:19:15.132 INFO:tasks.workunit.client.0.smithi037.stdout:6/544: read db/d53/f54 [140863,103236] 0 2024-04-25T17:19:15.133 INFO:tasks.workunit.client.0.smithi037.stdout:6/545: write db/f15 [5633874,20565] 0 2024-04-25T17:19:15.135 INFO:tasks.workunit.client.1.smithi069.stdout:1/452: mknod d1/d4/de/d63/d7d/c86 0 2024-04-25T17:19:15.136 INFO:tasks.workunit.client.1.smithi069.stdout:1/453: chown d1/d4/f4c 30377 1 2024-04-25T17:19:15.136 INFO:tasks.workunit.client.1.smithi069.stdout:5/480: mkdir d13/d17/da5 0 2024-04-25T17:19:15.140 INFO:tasks.workunit.client.1.smithi069.stdout:1/454: symlink d1/d4/d6/d4f/l87 0 2024-04-25T17:19:15.141 INFO:tasks.workunit.client.0.smithi037.stdout:6/546: creat db/d26/d2e/d7d/d65/d68/d87/dbd/fc4 x:0 0 0 2024-04-25T17:19:15.141 INFO:tasks.workunit.client.1.smithi069.stdout:5/481: truncate d13/d17/d19/f50 751757 0 2024-04-25T17:19:15.145 INFO:tasks.workunit.client.1.smithi069.stdout:5/482: mknod d13/d17/d29/d30/ca6 0 2024-04-25T17:19:15.149 INFO:tasks.workunit.client.0.smithi037.stdout:8/542: rmdir d5/db/d18/d3b/d75 39 2024-04-25T17:19:15.151 INFO:tasks.workunit.client.0.smithi037.stdout:8/543: write d5/db/d18/d3b/d50/f98 [874855,62877] 0 2024-04-25T17:19:15.153 INFO:tasks.workunit.client.1.smithi069.stdout:7/481: rename d4/d18/l93 to d4/d18/l9e 0 2024-04-25T17:19:15.153 INFO:tasks.workunit.client.0.smithi037.stdout:3/445: write d8/f26 [404790,13900] 0 2024-04-25T17:19:15.157 INFO:tasks.workunit.client.0.smithi037.stdout:3/446: creat d8/d4c/f8c x:0 0 0 2024-04-25T17:19:15.158 INFO:tasks.workunit.client.1.smithi069.stdout:7/482: dread d4/f58 [0,4194304] 0 2024-04-25T17:19:15.158 INFO:tasks.workunit.client.0.smithi037.stdout:3/447: write d8/d23/d38/d66/f6a [12043,59618] 0 2024-04-25T17:19:15.159 INFO:tasks.workunit.client.1.smithi069.stdout:7/483: readlink d4/d6/d14/l9c 0 2024-04-25T17:19:15.163 INFO:tasks.workunit.client.0.smithi037.stdout:3/448: unlink d8/d23/f28 0 2024-04-25T17:19:15.171 INFO:tasks.workunit.client.0.smithi037.stdout:1/657: dwrite dc/d18/f3e [0,4194304] 0 2024-04-25T17:19:15.181 INFO:tasks.workunit.client.0.smithi037.stdout:5/640: truncate d7/d18/d62/f6b 4040040 0 2024-04-25T17:19:15.186 INFO:tasks.workunit.client.0.smithi037.stdout:7/575: rename d5/d15/c2d to d5/d15/d17/d1b/ccc 0 2024-04-25T17:19:15.188 INFO:tasks.workunit.client.1.smithi069.stdout:3/535: rename d8/d16/d1a/d2c/d6c/d9c/da9 to d8/d71/d8d/d92/db6/dc1 0 2024-04-25T17:19:15.189 INFO:tasks.workunit.client.0.smithi037.stdout:9/744: rename d1/d5/f98 to d1/d5/d2e/d34/d76/ffb 0 2024-04-25T17:19:15.190 INFO:tasks.workunit.client.0.smithi037.stdout:9/745: readlink d1/l24 0 2024-04-25T17:19:15.191 INFO:tasks.workunit.client.0.smithi037.stdout:7/576: unlink d5/d14/l32 0 2024-04-25T17:19:15.194 INFO:tasks.workunit.client.1.smithi069.stdout:0/383: rename d0/da/d54/c65 to d0/da/db/d1d/c8a 0 2024-04-25T17:19:15.197 INFO:tasks.workunit.client.1.smithi069.stdout:8/443: truncate f35 95468 0 2024-04-25T17:19:15.198 INFO:tasks.workunit.client.1.smithi069.stdout:0/384: mkdir d0/da/d59/d8b 0 2024-04-25T17:19:15.199 INFO:tasks.workunit.client.0.smithi037.stdout:4/762: rename d7/c8 to d7/d7e/d1e/d2b/d35/d39/d9c/da3/cf7 0 2024-04-25T17:19:15.201 INFO:tasks.workunit.client.1.smithi069.stdout:0/385: rmdir d0/da/db/d1d/d5f 39 2024-04-25T17:19:15.202 INFO:tasks.workunit.client.1.smithi069.stdout:8/444: dwrite d37/d47/f60 [0,4194304] 0 2024-04-25T17:19:15.205 INFO:tasks.workunit.client.0.smithi037.stdout:7/577: creat d5/d15/d17/d1b/fcd x:0 0 0 2024-04-25T17:19:15.206 INFO:tasks.workunit.client.0.smithi037.stdout:7/578: chown d5/d14/l1a 102 1 2024-04-25T17:19:15.210 INFO:tasks.workunit.client.1.smithi069.stdout:2/442: dwrite d0/d26/f2b [0,4194304] 0 2024-04-25T17:19:15.210 INFO:tasks.workunit.client.1.smithi069.stdout:0/386: fsync d0/da/db/f15 0 2024-04-25T17:19:15.212 INFO:tasks.workunit.client.1.smithi069.stdout:4/444: dwrite db/d15/d20/f76 [0,4194304] 0 2024-04-25T17:19:15.212 INFO:tasks.workunit.client.1.smithi069.stdout:2/443: dread - d0/d26/f82 zero size 2024-04-25T17:19:15.212 INFO:tasks.workunit.client.1.smithi069.stdout:0/387: chown d0/da/l32 880002 1 2024-04-25T17:19:15.214 INFO:tasks.workunit.client.0.smithi037.stdout:7/579: dread d5/d15/d17/f41 [0,4194304] 0 2024-04-25T17:19:15.217 INFO:tasks.workunit.client.0.smithi037.stdout:0/627: rename d9/d71/dad to d9/df/d32/dd1 0 2024-04-25T17:19:15.223 INFO:tasks.workunit.client.1.smithi069.stdout:5/483: getdents d13/d17 0 2024-04-25T17:19:15.223 INFO:tasks.workunit.client.1.smithi069.stdout:6/427: dwrite d2/d1e/d43/f70 [0,4194304] 0 2024-04-25T17:19:15.226 INFO:tasks.workunit.client.0.smithi037.stdout:6/547: rename db/d1d/d20/f8c to db/d26/d2e/d7d/d65/d68/dae/fc5 0 2024-04-25T17:19:15.232 INFO:tasks.workunit.client.1.smithi069.stdout:4/445: symlink db/d15/d20/d35/d63/d70/d8a/la0 0 2024-04-25T17:19:15.235 INFO:tasks.workunit.client.0.smithi037.stdout:8/544: rename d5/db/d23/f38 to d5/da/fb4 0 2024-04-25T17:19:15.237 INFO:tasks.workunit.client.1.smithi069.stdout:2/444: mkdir d0/d56/d5f/d62/d7d/d31/d61/d8b 0 2024-04-25T17:19:15.237 INFO:tasks.workunit.client.0.smithi037.stdout:6/548: dread - db/d1d/f32 zero size 2024-04-25T17:19:15.237 INFO:tasks.workunit.client.1.smithi069.stdout:9/466: write d2/da/dd/f90 [102244,105075] 0 2024-04-25T17:19:15.238 INFO:tasks.workunit.client.1.smithi069.stdout:4/446: dwrite db/d15/d20/d38/f6a [0,4194304] 0 2024-04-25T17:19:15.239 INFO:tasks.workunit.client.0.smithi037.stdout:6/549: write db/d26/d2e/d7d/d65/fa7 [995444,120316] 0 2024-04-25T17:19:15.239 INFO:tasks.workunit.client.1.smithi069.stdout:2/445: chown d0/d56/d5f/d62/l76 45723716 1 2024-04-25T17:19:15.240 INFO:tasks.workunit.client.1.smithi069.stdout:4/447: dread - db/d15/d42/d64/f83 zero size 2024-04-25T17:19:15.241 INFO:tasks.workunit.client.1.smithi069.stdout:5/484: rename d13/f54 to d13/d17/d19/d96/d9d/fa7 0 2024-04-25T17:19:15.244 INFO:tasks.workunit.client.1.smithi069.stdout:2/446: dread d0/d1/d5b/d33/f39 [0,4194304] 0 2024-04-25T17:19:15.247 INFO:tasks.workunit.client.0.smithi037.stdout:6/550: read db/d26/d2e/d7d/d65/fa7 [480717,51965] 0 2024-04-25T17:19:15.249 INFO:tasks.workunit.client.1.smithi069.stdout:0/388: fsync d0/d38/d75/f7b 0 2024-04-25T17:19:15.250 INFO:tasks.workunit.client.0.smithi037.stdout:3/449: dwrite d8/f22 [0,4194304] 0 2024-04-25T17:19:15.253 INFO:tasks.workunit.client.0.smithi037.stdout:1/658: write dc/d52/d6b/dd9/d4d/d6a/d86/d91/fd4 [909236,119844] 0 2024-04-25T17:19:15.256 INFO:tasks.workunit.client.0.smithi037.stdout:5/641: write d7/d25/f65 [3007876,79454] 0 2024-04-25T17:19:15.264 INFO:tasks.workunit.client.1.smithi069.stdout:3/536: write d8/f11 [1408015,20340] 0 2024-04-25T17:19:15.268 INFO:tasks.workunit.client.0.smithi037.stdout:3/450: unlink d8/d23/d3a/f45 0 2024-04-25T17:19:15.268 INFO:tasks.workunit.client.0.smithi037.stdout:9/746: write d1/d5/dc/d38/d8b/f60 [4816935,108500] 0 2024-04-25T17:19:15.269 INFO:tasks.workunit.client.1.smithi069.stdout:4/448: mknod db/d22/ca1 0 2024-04-25T17:19:15.273 INFO:tasks.workunit.client.0.smithi037.stdout:7/580: rename d5/d15/f7e to d5/d15/d17/d1b/da2/fce 0 2024-04-25T17:19:15.276 INFO:tasks.workunit.client.0.smithi037.stdout:9/747: dwrite d1/d48/d68/d1c/fcd [0,4194304] 0 2024-04-25T17:19:15.281 INFO:tasks.workunit.client.1.smithi069.stdout:6/428: truncate d2/d1e/d3e/d74/d48/f4f 3058646 0 2024-04-25T17:19:15.281 INFO:tasks.workunit.client.0.smithi037.stdout:4/763: truncate d7/d7e/d1e/fcf 345671 0 2024-04-25T17:19:15.285 INFO:tasks.workunit.client.1.smithi069.stdout:2/447: mknod d0/d56/d5f/d62/d7d/d72/c8c 0 2024-04-25T17:19:15.285 INFO:tasks.workunit.client.1.smithi069.stdout:1/455: write d1/d19/d7c/f37 [3710623,127551] 0 2024-04-25T17:19:15.287 INFO:tasks.workunit.client.1.smithi069.stdout:8/445: truncate d37/d47/d54/f5e 2903520 0 2024-04-25T17:19:15.298 INFO:tasks.workunit.client.1.smithi069.stdout:9/467: mknod d2/da/dd/cab 0 2024-04-25T17:19:15.298 INFO:tasks.workunit.client.0.smithi037.stdout:9/748: symlink d1/d5/d2e/d34/lfc 0 2024-04-25T17:19:15.301 INFO:tasks.workunit.client.1.smithi069.stdout:7/484: sync 2024-04-25T17:19:15.302 INFO:tasks.workunit.client.0.smithi037.stdout:5/642: dread d7/f9 [0,4194304] 0 2024-04-25T17:19:15.306 INFO:tasks.workunit.client.1.smithi069.stdout:4/449: creat db/d15/d20/d35/d63/fa2 x:0 0 0 2024-04-25T17:19:15.309 INFO:tasks.workunit.client.0.smithi037.stdout:8/545: write d5/d26/d33/f36 [784707,117745] 0 2024-04-25T17:19:15.310 INFO:tasks.workunit.client.0.smithi037.stdout:8/546: chown d5/db/d59/c80 4467 1 2024-04-25T17:19:15.310 INFO:tasks.workunit.client.0.smithi037.stdout:4/764: mknod d7/d7e/d1e/d70/d84/dc9/cf8 0 2024-04-25T17:19:15.314 INFO:tasks.workunit.client.0.smithi037.stdout:9/749: dread d1/d5/d19/d6e/f79 [0,4194304] 0 2024-04-25T17:19:15.315 INFO:tasks.workunit.client.0.smithi037.stdout:0/628: rename d9/df/c24 to d9/df/d32/d39/cd2 0 2024-04-25T17:19:15.317 INFO:tasks.workunit.client.0.smithi037.stdout:0/629: truncate d9/d14/d28/d48/f4e 821901 0 2024-04-25T17:19:15.317 INFO:tasks.workunit.client.1.smithi069.stdout:2/448: symlink d0/d56/d5f/d62/d7d/d31/d61/l8d 0 2024-04-25T17:19:15.318 INFO:tasks.workunit.client.1.smithi069.stdout:4/450: dread db/f11 [0,4194304] 0 2024-04-25T17:19:15.318 INFO:tasks.workunit.client.1.smithi069.stdout:2/449: dread - d0/d56/d5f/d62/d7d/d31/d61/f75 zero size 2024-04-25T17:19:15.319 INFO:tasks.workunit.client.1.smithi069.stdout:8/446: creat d37/d47/d54/f91 x:0 0 0 2024-04-25T17:19:15.319 INFO:tasks.workunit.client.1.smithi069.stdout:2/450: chown d0/d56/d5f/d62/d7d/d31 1948512 1 2024-04-25T17:19:15.320 INFO:tasks.workunit.client.1.smithi069.stdout:2/451: chown d0/d1/d5b/c88 1440897 1 2024-04-25T17:19:15.321 INFO:tasks.workunit.client.0.smithi037.stdout:4/765: symlink d7/d7e/d45/d4f/lf9 0 2024-04-25T17:19:15.321 INFO:tasks.workunit.client.1.smithi069.stdout:2/452: chown d0/d1/fe 17275341 1 2024-04-25T17:19:15.322 INFO:tasks.workunit.client.1.smithi069.stdout:0/389: rmdir d0/da/db/d2a 39 2024-04-25T17:19:15.326 INFO:tasks.workunit.client.0.smithi037.stdout:5/643: mkdir d7/d12/d6f/dbf/dc2 0 2024-04-25T17:19:15.329 INFO:tasks.workunit.client.1.smithi069.stdout:2/453: dwrite d0/d56/d5f/d62/f69 [0,4194304] 0 2024-04-25T17:19:15.330 INFO:tasks.workunit.client.1.smithi069.stdout:5/485: dwrite d13/d17/f86 [0,4194304] 0 2024-04-25T17:19:15.331 INFO:tasks.workunit.client.0.smithi037.stdout:4/766: dread d7/d7e/d45/f8d [0,4194304] 0 2024-04-25T17:19:15.332 INFO:tasks.workunit.client.1.smithi069.stdout:2/454: stat d0/d56/d5f/d62/d7d/l4e 0 2024-04-25T17:19:15.332 INFO:tasks.workunit.client.0.smithi037.stdout:3/451: write d8/d23/f62 [32810,35039] 0 2024-04-25T17:19:15.334 INFO:tasks.workunit.client.0.smithi037.stdout:6/551: rename db/d1d/d20/f9f to db/d1d/fc6 0 2024-04-25T17:19:15.336 INFO:tasks.workunit.client.1.smithi069.stdout:6/429: unlink d2/l16 0 2024-04-25T17:19:15.337 INFO:tasks.workunit.client.1.smithi069.stdout:4/451: dread db/d22/d24/f31 [4194304,4194304] 0 2024-04-25T17:19:15.339 INFO:tasks.workunit.client.0.smithi037.stdout:3/452: dread d8/d31/d32/f36 [0,4194304] 0 2024-04-25T17:19:15.347 INFO:tasks.workunit.client.1.smithi069.stdout:8/447: creat d37/d47/d54/f92 x:0 0 0 2024-04-25T17:19:15.352 INFO:tasks.workunit.client.0.smithi037.stdout:1/659: rename dc/d52/d6b/dd9/d22/f6d to dc/d52/d6b/dd9/d4d/d6a/d8f/ddc/fe2 0 2024-04-25T17:19:15.353 INFO:tasks.workunit.client.0.smithi037.stdout:7/581: write d5/d14/d31/fa1 [784819,17523] 0 2024-04-25T17:19:15.354 INFO:tasks.workunit.client.0.smithi037.stdout:6/552: mkdir db/d1d/db1/dc7 0 2024-04-25T17:19:15.355 INFO:tasks.workunit.client.0.smithi037.stdout:7/582: chown d5/d15/d17/d25/d2b/d59/f63 300730 1 2024-04-25T17:19:15.357 INFO:tasks.workunit.client.0.smithi037.stdout:0/630: mkdir d9/df/d32/d39/dd3 0 2024-04-25T17:19:15.358 INFO:tasks.workunit.client.0.smithi037.stdout:0/631: read - d9/df/d32/dd1/d7a/fc9 zero size 2024-04-25T17:19:15.359 INFO:tasks.workunit.client.0.smithi037.stdout:3/453: mkdir d8/d31/d8d 0 2024-04-25T17:19:15.361 INFO:tasks.workunit.client.0.smithi037.stdout:3/454: write d8/d31/d32/f39 [575018,23279] 0 2024-04-25T17:19:15.361 INFO:tasks.workunit.client.1.smithi069.stdout:7/485: mkdir d4/d6/d14/d44/d7c/d9f 0 2024-04-25T17:19:15.362 INFO:tasks.workunit.client.1.smithi069.stdout:7/486: stat d4/d1a/f5c 0 2024-04-25T17:19:15.366 INFO:tasks.workunit.client.1.smithi069.stdout:5/486: symlink d13/d17/d19/d1c/la8 0 2024-04-25T17:19:15.369 INFO:tasks.workunit.client.1.smithi069.stdout:3/537: link d8/d16/d1a/d2c/d49/l56 d8/d16/d1a/d2c/d93/lc2 0 2024-04-25T17:19:15.370 INFO:tasks.workunit.client.1.smithi069.stdout:9/468: dwrite d2/da/f10 [0,4194304] 0 2024-04-25T17:19:15.373 INFO:tasks.workunit.client.1.smithi069.stdout:2/455: symlink d0/d56/d5f/d62/d7d/d31/l8e 0 2024-04-25T17:19:15.374 INFO:tasks.workunit.client.1.smithi069.stdout:3/538: dread d8/f20 [0,4194304] 0 2024-04-25T17:19:15.376 INFO:tasks.workunit.client.1.smithi069.stdout:4/452: symlink db/d15/d20/d38/la3 0 2024-04-25T17:19:15.378 INFO:tasks.workunit.client.1.smithi069.stdout:1/456: creat d1/f88 x:0 0 0 2024-04-25T17:19:15.382 INFO:tasks.workunit.client.0.smithi037.stdout:6/553: mkdir db/d26/d2e/d7d/d65/d8b/dc8 0 2024-04-25T17:19:15.384 INFO:tasks.workunit.client.1.smithi069.stdout:0/390: mkdir d0/da/db/d2a/d8c 0 2024-04-25T17:19:15.384 INFO:tasks.workunit.client.0.smithi037.stdout:6/554: write db/d26/d2e/d7d/d65/d68/d87/dbd/fc4 [658846,76864] 0 2024-04-25T17:19:15.385 INFO:tasks.workunit.client.0.smithi037.stdout:0/632: creat d9/df/d32/dd1/d7a/da4/fd4 x:0 0 0 2024-04-25T17:19:15.389 INFO:tasks.workunit.client.1.smithi069.stdout:0/391: dwrite d0/f8 [0,4194304] 0 2024-04-25T17:19:15.391 INFO:tasks.workunit.client.0.smithi037.stdout:4/767: rmdir d7/d7e/d1e/d2b/d35/d39/dd8 0 2024-04-25T17:19:15.394 INFO:tasks.workunit.client.1.smithi069.stdout:0/392: dwrite d0/da/d6e/f84 [0,4194304] 0 2024-04-25T17:19:15.396 INFO:tasks.workunit.client.1.smithi069.stdout:0/393: truncate d0/da/db/d56/f78 935511 0 2024-04-25T17:19:15.398 INFO:tasks.workunit.client.0.smithi037.stdout:1/660: mkdir dc/d52/d6b/dd9/d4d/d6a/de3 0 2024-04-25T17:19:15.399 INFO:tasks.workunit.client.1.smithi069.stdout:2/456: rmdir d0/d56/d5f/d62/d7d/d72 39 2024-04-25T17:19:15.400 INFO:tasks.workunit.client.1.smithi069.stdout:2/457: write d0/d56/d5f/d62/f73 [941307,37315] 0 2024-04-25T17:19:15.401 INFO:tasks.workunit.client.1.smithi069.stdout:2/458: write d0/d56/d5f/d62/d7d/d31/d61/f85 [1039043,31705] 0 2024-04-25T17:19:15.402 INFO:tasks.workunit.client.1.smithi069.stdout:2/459: fsync d0/d26/d10/f5c 0 2024-04-25T17:19:15.402 INFO:tasks.workunit.client.1.smithi069.stdout:2/460: stat d0/f57 0 2024-04-25T17:19:15.403 INFO:tasks.workunit.client.0.smithi037.stdout:7/583: mkdir d5/d14/dcf 0 2024-04-25T17:19:15.406 INFO:tasks.workunit.client.1.smithi069.stdout:6/430: fsync d2/d51/d85/f45 0 2024-04-25T17:19:15.409 INFO:tasks.workunit.client.1.smithi069.stdout:3/539: mkdir d8/d16/d9b/dc3 0 2024-04-25T17:19:15.410 INFO:tasks.workunit.client.1.smithi069.stdout:3/540: read - d8/d71/d8d/d92/db6/dc1/f7f zero size 2024-04-25T17:19:15.411 INFO:tasks.workunit.client.1.smithi069.stdout:4/453: mknod db/d15/d26/ca4 0 2024-04-25T17:19:15.415 INFO:tasks.workunit.client.0.smithi037.stdout:8/547: rename d5/l3d to d5/db/d18/d3b/lb5 0 2024-04-25T17:19:15.420 INFO:tasks.workunit.client.0.smithi037.stdout:6/555: write db/d26/d2e/d7d/fa8 [89232,96744] 0 2024-04-25T17:19:15.421 INFO:tasks.workunit.client.1.smithi069.stdout:5/487: mkdir d13/d17/d19/d1c/da4/da9 0 2024-04-25T17:19:15.422 INFO:tasks.workunit.client.0.smithi037.stdout:8/548: dwrite d5/f47 [0,4194304] 0 2024-04-25T17:19:15.426 INFO:tasks.workunit.client.1.smithi069.stdout:9/469: getdents d2/da/d14/d23/d65/d88 0 2024-04-25T17:19:15.430 INFO:tasks.workunit.client.0.smithi037.stdout:3/455: creat d8/d23/f8e x:0 0 0 2024-04-25T17:19:15.431 INFO:tasks.workunit.client.1.smithi069.stdout:1/457: dwrite d1/f2e [0,4194304] 0 2024-04-25T17:19:15.431 INFO:tasks.workunit.client.1.smithi069.stdout:1/458: chown d1/d4/d6/d4f 5 1 2024-04-25T17:19:15.433 INFO:tasks.workunit.client.1.smithi069.stdout:7/487: write d4/f10 [5446858,25257] 0 2024-04-25T17:19:15.435 INFO:tasks.workunit.client.0.smithi037.stdout:6/556: dwrite db/d26/d2e/d7d/d65/f9c [0,4194304] 0 2024-04-25T17:19:15.435 INFO:tasks.workunit.client.1.smithi069.stdout:0/394: rename d0/da/db/d1d/l1f to d0/da/db/d7e/d80/l8d 0 2024-04-25T17:19:15.436 INFO:tasks.workunit.client.0.smithi037.stdout:0/633: dwrite d9/d14/d28/f2a [0,4194304] 0 2024-04-25T17:19:15.442 INFO:tasks.workunit.client.0.smithi037.stdout:5/644: rename d7/d12/d6f/f96 to d7/d25/d4f/da7/dab/fc3 0 2024-04-25T17:19:15.443 INFO:tasks.workunit.client.1.smithi069.stdout:0/395: dwrite d0/da/db/f4e [0,4194304] 0 2024-04-25T17:19:15.444 INFO:tasks.workunit.client.0.smithi037.stdout:5/645: stat d7/d43/f32 0 2024-04-25T17:19:15.447 INFO:tasks.workunit.client.0.smithi037.stdout:7/584: dwrite d5/d15/d17/d25/d2b/d59/f63 [0,4194304] 0 2024-04-25T17:19:15.451 INFO:tasks.workunit.client.1.smithi069.stdout:2/461: dwrite d0/d1/d5b/f6e [0,4194304] 0 2024-04-25T17:19:15.455 INFO:tasks.workunit.client.1.smithi069.stdout:7/488: rmdir d4/d6/d14/d5a/d5e 39 2024-04-25T17:19:15.456 INFO:tasks.workunit.client.1.smithi069.stdout:2/462: read d0/d26/f54 [738215,103572] 0 2024-04-25T17:19:15.456 INFO:tasks.workunit.client.0.smithi037.stdout:0/634: truncate d9/d14/d28/d48/f49 2563095 0 2024-04-25T17:19:15.458 INFO:tasks.workunit.client.1.smithi069.stdout:1/459: rename d1/d19/f41 to d1/d4/f89 0 2024-04-25T17:19:15.461 INFO:tasks.workunit.client.1.smithi069.stdout:1/460: write d1/d43/d1b/d32/d4a/f58 [250625,82224] 0 2024-04-25T17:19:15.461 INFO:tasks.workunit.client.0.smithi037.stdout:8/549: link d5/db/d18/d3b/d50/d51/f85 d5/db/d23/d78/d9c/fb6 0 2024-04-25T17:19:15.466 INFO:tasks.workunit.client.1.smithi069.stdout:6/431: symlink d2/d1e/l95 0 2024-04-25T17:19:15.467 INFO:tasks.workunit.client.0.smithi037.stdout:7/585: truncate d5/d15/d17/d1b/da2/daf/f3d 4299894 0 2024-04-25T17:19:15.469 INFO:tasks.workunit.client.1.smithi069.stdout:4/454: mkdir db/d4b/d78/d79/da5 0 2024-04-25T17:19:15.469 INFO:tasks.workunit.client.0.smithi037.stdout:6/557: mknod db/d26/d2e/d7d/d65/d8b/dc8/cc9 0 2024-04-25T17:19:15.470 INFO:tasks.workunit.client.1.smithi069.stdout:4/455: write db/f52 [249184,44583] 0 2024-04-25T17:19:15.470 INFO:tasks.workunit.client.1.smithi069.stdout:3/541: truncate f5 647806 0 2024-04-25T17:19:15.470 INFO:tasks.workunit.client.0.smithi037.stdout:6/558: fsync db/d53/f58 0 2024-04-25T17:19:15.471 INFO:tasks.workunit.client.1.smithi069.stdout:4/456: stat db/d15/d42/d64/d7f 0 2024-04-25T17:19:15.472 INFO:tasks.workunit.client.0.smithi037.stdout:6/559: chown db/d26/d2e/d3e/f2c 2 1 2024-04-25T17:19:15.472 INFO:tasks.workunit.client.1.smithi069.stdout:3/542: chown d8/d71/d8d/d92/db6/dc1/f6f 242258410 1 2024-04-25T17:19:15.472 INFO:tasks.workunit.client.1.smithi069.stdout:4/457: chown db/d15/d20/d35/d63/d70/d8a/la0 47943 1 2024-04-25T17:19:15.472 INFO:tasks.workunit.client.0.smithi037.stdout:9/750: rename d1/d5/d19/d6e/ce6 to d1/d5/d2e/d34/d76/cfd 0 2024-04-25T17:19:15.473 INFO:tasks.workunit.client.1.smithi069.stdout:5/488: mkdir d13/d17/d19/d1c/da4/da9/daa 0 2024-04-25T17:19:15.475 INFO:tasks.workunit.client.0.smithi037.stdout:8/550: creat d5/db/d7e/fb7 x:0 0 0 2024-04-25T17:19:15.476 INFO:tasks.workunit.client.1.smithi069.stdout:9/470: symlink d2/lac 0 2024-04-25T17:19:15.476 INFO:tasks.workunit.client.0.smithi037.stdout:4/768: link d7/d7e/d1e/d2b/cc4 d7/d7e/d5b/cfa 0 2024-04-25T17:19:15.478 INFO:tasks.workunit.client.1.smithi069.stdout:7/489: fsync d4/d6/d14/d5a/d5e/f7a 0 2024-04-25T17:19:15.478 INFO:tasks.workunit.client.1.smithi069.stdout:7/490: fdatasync d4/d3e/f41 0 2024-04-25T17:19:15.480 INFO:tasks.workunit.client.1.smithi069.stdout:8/448: sync 2024-04-25T17:19:15.489 INFO:tasks.workunit.client.1.smithi069.stdout:0/396: mkdir d0/da/d54/d7d/d8e 0 2024-04-25T17:19:15.490 INFO:tasks.workunit.client.1.smithi069.stdout:1/461: dread d1/d4/d6/f7 [0,4194304] 0 2024-04-25T17:19:15.490 INFO:tasks.workunit.client.1.smithi069.stdout:0/397: fdatasync d0/da/db/d56/f78 0 2024-04-25T17:19:15.490 INFO:tasks.workunit.client.1.smithi069.stdout:1/462: readlink d1/d4/d6/l51 0 2024-04-25T17:19:15.491 INFO:tasks.workunit.client.0.smithi037.stdout:1/661: dwrite f7 [0,4194304] 0 2024-04-25T17:19:15.492 INFO:tasks.workunit.client.1.smithi069.stdout:0/398: chown d0/d17/d40/f68 129605096 1 2024-04-25T17:19:15.492 INFO:tasks.workunit.client.1.smithi069.stdout:1/463: fdatasync d1/d19/d7c/f37 0 2024-04-25T17:19:15.492 INFO:tasks.workunit.client.1.smithi069.stdout:0/399: readlink d0/d17/l5b 0 2024-04-25T17:19:15.496 INFO:tasks.workunit.client.0.smithi037.stdout:9/751: dread d1/d48/d68/d1c/f91 [0,4194304] 0 2024-04-25T17:19:15.497 INFO:tasks.workunit.client.1.smithi069.stdout:6/432: dread d2/d7/f44 [0,4194304] 0 2024-04-25T17:19:15.500 INFO:tasks.workunit.client.0.smithi037.stdout:5/646: getdents d7/d12/d6f/dbf 0 2024-04-25T17:19:15.502 INFO:tasks.workunit.client.0.smithi037.stdout:5/647: write d7/d25/f4b [2361793,121197] 0 2024-04-25T17:19:15.502 INFO:tasks.workunit.client.1.smithi069.stdout:4/458: rename db/d15/d26/l32 to db/d15/d20/d38/la6 0 2024-04-25T17:19:15.504 INFO:tasks.workunit.client.0.smithi037.stdout:3/456: write d8/d23/d3a/f50 [1200411,58994] 0 2024-04-25T17:19:15.509 INFO:tasks.workunit.client.0.smithi037.stdout:8/551: unlink d5/db/d7e/c72 0 2024-04-25T17:19:15.513 INFO:tasks.workunit.client.0.smithi037.stdout:1/662: mkdir dc/d52/d6b/dd9/d22/d36/d74/de4 0 2024-04-25T17:19:15.515 INFO:tasks.workunit.client.1.smithi069.stdout:9/471: dwrite d2/f6 [0,4194304] 0 2024-04-25T17:19:15.517 INFO:tasks.workunit.client.1.smithi069.stdout:7/491: unlink d4/d6/d14/d5a/f85 0 2024-04-25T17:19:15.519 INFO:tasks.workunit.client.1.smithi069.stdout:8/449: mkdir d37/d47/d78/d93 0 2024-04-25T17:19:15.520 INFO:tasks.workunit.client.1.smithi069.stdout:8/450: dread fb [0,4194304] 0 2024-04-25T17:19:15.521 INFO:tasks.workunit.client.1.smithi069.stdout:2/463: symlink d0/d56/d5f/d62/d7d/d72/l8f 0 2024-04-25T17:19:15.522 INFO:tasks.workunit.client.0.smithi037.stdout:5/648: read d7/f87 [86990,100660] 0 2024-04-25T17:19:15.523 INFO:tasks.workunit.client.0.smithi037.stdout:3/457: fdatasync d8/ff 0 2024-04-25T17:19:15.525 INFO:tasks.workunit.client.0.smithi037.stdout:3/458: fdatasync d8/d31/d32/f39 0 2024-04-25T17:19:15.528 INFO:tasks.workunit.client.0.smithi037.stdout:3/459: write d8/d31/d32/f51 [531810,105423] 0 2024-04-25T17:19:15.529 INFO:tasks.workunit.client.0.smithi037.stdout:6/560: dwrite db/d1d/d20/f21 [0,4194304] 0 2024-04-25T17:19:15.531 INFO:tasks.workunit.client.0.smithi037.stdout:6/561: write db/f14 [2961657,112715] 0 2024-04-25T17:19:15.531 INFO:tasks.workunit.client.0.smithi037.stdout:6/562: readlink db/d26/d2e/d3e/l78 0 2024-04-25T17:19:15.534 INFO:tasks.workunit.client.0.smithi037.stdout:4/769: rename d7/d7e/d1e/d2b/dbd to d7/d7e/d45/dfb 0 2024-04-25T17:19:15.537 INFO:tasks.workunit.client.0.smithi037.stdout:1/663: dread dc/d52/d6b/dd9/d4d/d6a/d86/d9b/fc0 [0,4194304] 0 2024-04-25T17:19:15.540 INFO:tasks.workunit.client.0.smithi037.stdout:5/649: symlink d7/d12/d6f/dbf/lc4 0 2024-04-25T17:19:15.541 INFO:tasks.workunit.client.1.smithi069.stdout:3/543: dwrite d8/d16/d1a/d2c/f4e [0,4194304] 0 2024-04-25T17:19:15.542 INFO:tasks.workunit.client.1.smithi069.stdout:6/433: creat d2/d1e/d3f/f96 x:0 0 0 2024-04-25T17:19:15.549 INFO:tasks.workunit.client.1.smithi069.stdout:5/489: creat d13/d17/da5/fab x:0 0 0 2024-04-25T17:19:15.552 INFO:tasks.workunit.client.0.smithi037.stdout:3/460: creat d8/d23/d3a/d63/d86/f8f x:0 0 0 2024-04-25T17:19:15.555 INFO:tasks.workunit.client.0.smithi037.stdout:6/563: chown db/d26/d2e/l8a 274177162 1 2024-04-25T17:19:15.555 INFO:tasks.workunit.client.0.smithi037.stdout:6/564: chown db/f1b 8 1 2024-04-25T17:19:15.559 INFO:tasks.workunit.client.1.smithi069.stdout:2/464: stat d0/d26/d10/d43/l6d 0 2024-04-25T17:19:15.560 INFO:tasks.workunit.client.0.smithi037.stdout:9/752: creat d1/d5/dc/ffe x:0 0 0 2024-04-25T17:19:15.561 INFO:tasks.workunit.client.0.smithi037.stdout:9/753: stat d1/d5/dc/f47 0 2024-04-25T17:19:15.562 INFO:tasks.workunit.client.1.smithi069.stdout:1/464: link d1/d19/d7c/f64 d1/d43/f8a 0 2024-04-25T17:19:15.562 INFO:tasks.workunit.client.1.smithi069.stdout:1/465: dread - d1/d4/f4c zero size 2024-04-25T17:19:15.563 INFO:tasks.workunit.client.1.smithi069.stdout:0/400: symlink d0/da/db/d1d/d5f/l8f 0 2024-04-25T17:19:15.565 INFO:tasks.workunit.client.0.smithi037.stdout:5/650: truncate d7/f3c 292785 0 2024-04-25T17:19:15.566 INFO:tasks.workunit.client.0.smithi037.stdout:5/651: write d7/d12/f5e [509543,48925] 0 2024-04-25T17:19:15.568 INFO:tasks.workunit.client.0.smithi037.stdout:3/461: symlink d8/d23/d3a/d63/l90 0 2024-04-25T17:19:15.570 INFO:tasks.workunit.client.0.smithi037.stdout:4/770: dread d7/d7e/d45/fa0 [0,4194304] 0 2024-04-25T17:19:15.570 INFO:tasks.workunit.client.1.smithi069.stdout:3/544: dread - d8/d16/d1a/d2c/d6c/f76 zero size 2024-04-25T17:19:15.575 INFO:tasks.workunit.client.0.smithi037.stdout:3/462: dwrite d8/d23/d38/d66/f75 [0,4194304] 0 2024-04-25T17:19:15.577 INFO:tasks.workunit.client.0.smithi037.stdout:9/754: unlink d1/d48/d68/d4e/f85 0 2024-04-25T17:19:15.578 INFO:tasks.workunit.client.0.smithi037.stdout:1/664: mknod dc/d52/d6b/dd9/d22/d36/dbe/ce5 0 2024-04-25T17:19:15.583 INFO:tasks.workunit.client.1.smithi069.stdout:5/490: fdatasync d13/d17/d19/d1c/f89 0 2024-04-25T17:19:15.586 INFO:tasks.workunit.client.0.smithi037.stdout:8/552: rename d5/db/d23/d58/f6e to d5/db/fb8 0 2024-04-25T17:19:15.587 INFO:tasks.workunit.client.1.smithi069.stdout:4/459: truncate db/d15/d26/f2c 2092993 0 2024-04-25T17:19:15.588 INFO:tasks.workunit.client.1.smithi069.stdout:8/451: creat d37/d47/d78/d93/f94 x:0 0 0 2024-04-25T17:19:15.588 INFO:tasks.workunit.client.1.smithi069.stdout:8/452: fsync fb 0 2024-04-25T17:19:15.589 INFO:tasks.workunit.client.0.smithi037.stdout:6/565: write db/d1d/fc6 [808210,97659] 0 2024-04-25T17:19:15.590 INFO:tasks.workunit.client.1.smithi069.stdout:2/465: mknod d0/d56/d5f/d62/d7d/d72/c90 0 2024-04-25T17:19:15.592 INFO:tasks.workunit.client.1.smithi069.stdout:2/466: truncate d0/d26/d10/d43/f74 338652 0 2024-04-25T17:19:15.593 INFO:tasks.workunit.client.0.smithi037.stdout:9/755: unlink d1/d5/dc/f7d 0 2024-04-25T17:19:15.594 INFO:tasks.workunit.client.1.smithi069.stdout:0/401: mkdir d0/da/d6e/d90 0 2024-04-25T17:19:15.595 INFO:tasks.workunit.client.1.smithi069.stdout:0/402: write d0/da/db/f4e [3218898,68306] 0 2024-04-25T17:19:15.597 INFO:tasks.workunit.client.1.smithi069.stdout:8/453: dread d37/d47/d48/f49 [4194304,4194304] 0 2024-04-25T17:19:15.599 INFO:tasks.workunit.client.1.smithi069.stdout:6/434: mkdir d2/d1e/d3e/d74/d97 0 2024-04-25T17:19:15.600 INFO:tasks.workunit.client.1.smithi069.stdout:1/466: write d1/df/d17/f70 [3559004,83346] 0 2024-04-25T17:19:15.601 INFO:tasks.workunit.client.1.smithi069.stdout:1/467: write d1/d4/de/f73 [979876,93881] 0 2024-04-25T17:19:15.606 INFO:tasks.workunit.client.1.smithi069.stdout:5/491: rename d13/d17/d19/c68 to d13/d17/d62/cac 0 2024-04-25T17:19:15.607 INFO:tasks.workunit.client.1.smithi069.stdout:1/468: dwrite d1/d19/d7c/f14 [8388608,4194304] 0 2024-04-25T17:19:15.607 INFO:tasks.workunit.client.0.smithi037.stdout:5/652: rename d7/f1f to d7/d12/d6f/dbf/fc5 0 2024-04-25T17:19:15.610 INFO:tasks.workunit.client.0.smithi037.stdout:6/566: creat db/d26/d2e/d3e/d25/db0/fca x:0 0 0 2024-04-25T17:19:15.612 INFO:tasks.workunit.client.1.smithi069.stdout:2/467: symlink d0/d56/d5f/d62/l91 0 2024-04-25T17:19:15.618 INFO:tasks.workunit.client.0.smithi037.stdout:1/665: mkdir dc/d18/d64/de6 0 2024-04-25T17:19:15.619 INFO:tasks.workunit.client.1.smithi069.stdout:8/454: symlink d37/d66/l95 0 2024-04-25T17:19:15.620 INFO:tasks.workunit.client.0.smithi037.stdout:4/771: creat d7/d7e/d1e/d2b/d35/d39/d7a/ffc x:0 0 0 2024-04-25T17:19:15.621 INFO:tasks.workunit.client.0.smithi037.stdout:5/653: dread - d7/d43/f74 zero size 2024-04-25T17:19:15.623 INFO:tasks.workunit.client.1.smithi069.stdout:7/492: getdents d4 0 2024-04-25T17:19:15.626 INFO:tasks.workunit.client.0.smithi037.stdout:6/567: dread db/d26/f27 [0,4194304] 0 2024-04-25T17:19:15.627 INFO:tasks.workunit.client.0.smithi037.stdout:3/463: link d8/d31/d32/d3e/f6e d8/d23/f91 0 2024-04-25T17:19:15.628 INFO:tasks.workunit.client.1.smithi069.stdout:5/492: symlink d13/d17/da5/lad 0 2024-04-25T17:19:15.628 INFO:tasks.workunit.client.0.smithi037.stdout:9/756: write d1/d5/dc/d3c/d3e/f59 [158839,103105] 0 2024-04-25T17:19:15.629 INFO:tasks.workunit.client.1.smithi069.stdout:5/493: write d13/f26 [1152518,59073] 0 2024-04-25T17:19:15.630 INFO:tasks.workunit.client.1.smithi069.stdout:1/469: mknod d1/d4/de/d63/c8b 0 2024-04-25T17:19:15.630 INFO:tasks.workunit.client.1.smithi069.stdout:5/494: fsync d13/d17/f7f 0 2024-04-25T17:19:15.631 INFO:tasks.workunit.client.1.smithi069.stdout:4/460: mkdir db/d15/d82/da7 0 2024-04-25T17:19:15.632 INFO:tasks.workunit.client.1.smithi069.stdout:4/461: chown db/d15 41858231 1 2024-04-25T17:19:15.632 INFO:tasks.workunit.client.0.smithi037.stdout:4/772: fsync d7/d7e/f48 0 2024-04-25T17:19:15.635 INFO:tasks.workunit.client.0.smithi037.stdout:8/553: link d5/db/d18/d3b/d50/d51/f85 d5/db/d23/d78/d93/fb9 0 2024-04-25T17:19:15.635 INFO:tasks.workunit.client.0.smithi037.stdout:1/666: dread dc/d52/d6b/dd9/fb9 [0,4194304] 0 2024-04-25T17:19:15.637 INFO:tasks.workunit.client.1.smithi069.stdout:3/545: creat d8/d16/d1a/d2c/d49/fc4 x:0 0 0 2024-04-25T17:19:15.638 INFO:tasks.workunit.client.1.smithi069.stdout:3/546: write d8/d39/f89 [941728,109545] 0 2024-04-25T17:19:15.639 INFO:tasks.workunit.client.0.smithi037.stdout:6/568: symlink db/d26/d2e/d3e/lcb 0 2024-04-25T17:19:15.640 INFO:tasks.workunit.client.0.smithi037.stdout:9/757: rmdir d1/d48/d68/d26/da1 39 2024-04-25T17:19:15.642 INFO:tasks.workunit.client.0.smithi037.stdout:3/464: dread d8/f37 [0,4194304] 0 2024-04-25T17:19:15.646 INFO:tasks.workunit.client.0.smithi037.stdout:5/654: mkdir d7/d12/d6f/dbc/dc6 0 2024-04-25T17:19:15.649 INFO:tasks.workunit.client.0.smithi037.stdout:9/758: dwrite d1/d5/d19/d6e/ff1 [0,4194304] 0 2024-04-25T17:19:15.649 INFO:tasks.workunit.client.1.smithi069.stdout:9/472: sync 2024-04-25T17:19:15.649 INFO:tasks.workunit.client.0.smithi037.stdout:4/773: mknod d7/d7e/d1e/dae/dc6/cfd 0 2024-04-25T17:19:15.654 INFO:tasks.workunit.client.1.smithi069.stdout:1/470: rename d1/d4/de/f73 to d1/df/d6c/f8c 0 2024-04-25T17:19:15.655 INFO:tasks.workunit.client.0.smithi037.stdout:6/569: mkdir db/d1d/dcc 0 2024-04-25T17:19:15.656 INFO:tasks.workunit.client.0.smithi037.stdout:3/465: symlink d8/d31/d32/d69/l92 0 2024-04-25T17:19:15.657 INFO:tasks.workunit.client.1.smithi069.stdout:0/403: link d0/da/d59/c63 d0/da/d59/c91 0 2024-04-25T17:19:15.658 INFO:tasks.workunit.client.0.smithi037.stdout:3/466: write d8/d23/d3a/f50 [1520713,97920] 0 2024-04-25T17:19:15.660 INFO:tasks.workunit.client.1.smithi069.stdout:3/547: write d8/f12 [3851969,41263] 0 2024-04-25T17:19:15.660 INFO:tasks.workunit.client.0.smithi037.stdout:5/655: dread d7/d18/f64 [0,4194304] 0 2024-04-25T17:19:15.663 INFO:tasks.workunit.client.1.smithi069.stdout:7/493: symlink d4/d4c/la0 0 2024-04-25T17:19:15.665 INFO:tasks.workunit.client.0.smithi037.stdout:8/554: mknod d5/db/d23/d78/d93/cba 0 2024-04-25T17:19:15.667 INFO:tasks.workunit.client.1.smithi069.stdout:9/473: unlink d2/da/dd/d1e/d2e/d35/c3c 0 2024-04-25T17:19:15.670 INFO:tasks.workunit.client.0.smithi037.stdout:6/570: creat db/d1d/d20/d2f/fcd x:0 0 0 2024-04-25T17:19:15.674 INFO:tasks.workunit.client.0.smithi037.stdout:5/656: mkdir d7/d25/d4f/da7/dab/dc7 0 2024-04-25T17:19:15.674 INFO:tasks.workunit.client.1.smithi069.stdout:4/462: dread db/d15/f1d [0,4194304] 0 2024-04-25T17:19:15.676 INFO:tasks.workunit.client.1.smithi069.stdout:1/471: creat d1/df/d6c/f8d x:0 0 0 2024-04-25T17:19:15.677 INFO:tasks.workunit.client.1.smithi069.stdout:5/495: dwrite d13/d17/d29/d2e/d76/f87 [4194304,4194304] 0 2024-04-25T17:19:15.678 INFO:tasks.workunit.client.1.smithi069.stdout:2/468: creat d0/f92 x:0 0 0 2024-04-25T17:19:15.682 INFO:tasks.workunit.client.1.smithi069.stdout:0/404: creat d0/da/d24/d43/f92 x:0 0 0 2024-04-25T17:19:15.682 INFO:tasks.workunit.client.1.smithi069.stdout:1/472: dwrite d1/d43/f3a [0,4194304] 0 2024-04-25T17:19:15.684 INFO:tasks.workunit.client.1.smithi069.stdout:9/474: dread d2/da/d14/d23/f3b [0,4194304] 0 2024-04-25T17:19:15.684 INFO:tasks.workunit.client.1.smithi069.stdout:9/475: write d2/da/d14/f18 [657826,115415] 0 2024-04-25T17:19:15.685 INFO:tasks.workunit.client.0.smithi037.stdout:8/555: chown d5/db/d23/d42/ca9 517601339 1 2024-04-25T17:19:15.688 INFO:tasks.workunit.client.0.smithi037.stdout:9/759: dwrite d1/d48/d68/d4e/f51 [0,4194304] 0 2024-04-25T17:19:15.689 INFO:tasks.workunit.client.0.smithi037.stdout:1/667: link dc/d52/d6b/dd9/d4d/d6a/d8f/fd6 dc/d52/d6b/dd9/d4d/d6a/d86/d9b/fe7 0 2024-04-25T17:19:15.690 INFO:tasks.workunit.client.1.smithi069.stdout:3/548: mknod d8/d16/d4b/d9e/cc5 0 2024-04-25T17:19:15.690 INFO:tasks.workunit.client.0.smithi037.stdout:6/571: creat db/d26/d2e/d82/fce x:0 0 0 2024-04-25T17:19:15.692 INFO:tasks.workunit.client.1.smithi069.stdout:6/435: sync 2024-04-25T17:19:15.696 INFO:tasks.workunit.client.0.smithi037.stdout:5/657: write d7/f75 [1255932,88750] 0 2024-04-25T17:19:15.696 INFO:tasks.workunit.client.1.smithi069.stdout:7/494: rename d4/d18/d3f to d4/d3e/d94/da1 0 2024-04-25T17:19:15.697 INFO:tasks.workunit.client.1.smithi069.stdout:6/436: dwrite d2/d1e/f32 [0,4194304] 0 2024-04-25T17:19:15.698 INFO:tasks.workunit.client.1.smithi069.stdout:7/495: write d4/d1a/d34/f68 [2148115,28226] 0 2024-04-25T17:19:15.699 INFO:tasks.workunit.client.1.smithi069.stdout:7/496: chown d4/d3e/f9b 85 1 2024-04-25T17:19:15.700 INFO:tasks.workunit.client.0.smithi037.stdout:5/658: read - d7/d12/d5d/f81 zero size 2024-04-25T17:19:15.700 INFO:tasks.workunit.client.1.smithi069.stdout:7/497: readlink d4/d3e/d94/da1/l67 0 2024-04-25T17:19:15.701 INFO:tasks.workunit.client.0.smithi037.stdout:9/760: dwrite d1/d5/d19/f56 [0,4194304] 0 2024-04-25T17:19:15.701 INFO:tasks.workunit.client.0.smithi037.stdout:4/774: rename d7/d7e/d1e/d2b/d35 to d7/d7e/d5b/dfe 0 2024-04-25T17:19:15.706 INFO:tasks.workunit.client.1.smithi069.stdout:4/463: symlink db/d15/d42/d64/la8 0 2024-04-25T17:19:15.706 INFO:tasks.workunit.client.0.smithi037.stdout:8/556: truncate d5/db/d23/f4e 505959 0 2024-04-25T17:19:15.708 INFO:tasks.workunit.client.0.smithi037.stdout:6/572: dread db/d26/d2e/d7d/fa8 [0,4194304] 0 2024-04-25T17:19:15.710 INFO:tasks.workunit.client.0.smithi037.stdout:6/573: stat db/d1d/d20/cbb 0 2024-04-25T17:19:15.714 INFO:tasks.workunit.client.0.smithi037.stdout:1/668: rename dc/d52/d6b/dd9/d22/d36/d92/db8/dbc/cca to dc/d52/d6b/dd9/d43/ce8 0 2024-04-25T17:19:15.715 INFO:tasks.workunit.client.0.smithi037.stdout:1/669: chown dc/d24/fbd 2692156 1 2024-04-25T17:19:15.716 INFO:tasks.workunit.client.1.smithi069.stdout:2/469: unlink d0/d26/d36/f7b 0 2024-04-25T17:19:15.717 INFO:tasks.workunit.client.1.smithi069.stdout:2/470: chown d0/d26/d10/d43/f4b 2 1 2024-04-25T17:19:15.719 INFO:tasks.workunit.client.1.smithi069.stdout:0/405: creat d0/da/db/d1d/d5f/f93 x:0 0 0 2024-04-25T17:19:15.721 INFO:tasks.workunit.client.1.smithi069.stdout:1/473: rmdir d1/d43/d1b/d32/d4a 39 2024-04-25T17:19:15.722 INFO:tasks.workunit.client.0.smithi037.stdout:4/775: dread d7/d7e/d45/f8d [0,4194304] 0 2024-04-25T17:19:15.726 INFO:tasks.workunit.client.1.smithi069.stdout:1/474: dwrite d1/d4/f2a [0,4194304] 0 2024-04-25T17:19:15.728 INFO:tasks.workunit.client.1.smithi069.stdout:8/455: truncate ff 1801809 0 2024-04-25T17:19:15.732 INFO:tasks.workunit.client.1.smithi069.stdout:1/475: dwrite d1/df/f34 [0,4194304] 0 2024-04-25T17:19:15.733 INFO:tasks.workunit.client.0.smithi037.stdout:1/670: fsync f1 0 2024-04-25T17:19:15.735 INFO:tasks.workunit.client.0.smithi037.stdout:1/671: stat dc/d52/d6b/dd9/d4d/d6a/d8f/fc5 0 2024-04-25T17:19:15.739 INFO:tasks.workunit.client.0.smithi037.stdout:4/776: rmdir d7/d7e/d5b 39 2024-04-25T17:19:15.745 INFO:tasks.workunit.client.0.smithi037.stdout:5/659: rename d7/d12/c51 to d7/da1/db0/cc8 0 2024-04-25T17:19:15.746 INFO:tasks.workunit.client.0.smithi037.stdout:5/660: write d7/d43/f47 [2108576,51106] 0 2024-04-25T17:19:15.747 INFO:tasks.workunit.client.1.smithi069.stdout:7/498: rmdir d4/d3e 39 2024-04-25T17:19:15.747 INFO:tasks.workunit.client.1.smithi069.stdout:6/437: dread d2/f1c [0,4194304] 0 2024-04-25T17:19:15.748 INFO:tasks.workunit.client.0.smithi037.stdout:9/761: write d1/d48/d68/f5a [8644510,51400] 0 2024-04-25T17:19:15.754 INFO:tasks.workunit.client.1.smithi069.stdout:5/496: creat d13/d17/d19/d1c/da4/da9/daa/fae x:0 0 0 2024-04-25T17:19:15.755 INFO:tasks.workunit.client.1.smithi069.stdout:3/549: write d8/d16/d1a/d2c/d49/d59/f65 [3287427,48586] 0 2024-04-25T17:19:15.755 INFO:tasks.workunit.client.0.smithi037.stdout:8/557: dwrite d5/db/d23/d58/f79 [0,4194304] 0 2024-04-25T17:19:15.756 INFO:tasks.workunit.client.1.smithi069.stdout:5/497: dread - d13/d17/d19/d1c/f71 zero size 2024-04-25T17:19:15.757 INFO:tasks.workunit.client.1.smithi069.stdout:2/471: creat d0/d26/f93 x:0 0 0 2024-04-25T17:19:15.758 INFO:tasks.workunit.client.1.smithi069.stdout:2/472: fdatasync d0/d26/f2b 0 2024-04-25T17:19:15.759 INFO:tasks.workunit.client.0.smithi037.stdout:8/558: truncate d5/db/d18/d3b/f8d 866054 0 2024-04-25T17:19:15.764 INFO:tasks.workunit.client.0.smithi037.stdout:8/559: dread d5/f47 [0,4194304] 0 2024-04-25T17:19:15.783 INFO:tasks.workunit.client.0.smithi037.stdout:4/777: dread d7/d7e/d5b/f8c [0,4194304] 0 2024-04-25T17:19:15.789 INFO:tasks.workunit.client.0.smithi037.stdout:4/778: dwrite d7/d7e/d5b/dfe/d39/fdb [0,4194304] 0 2024-04-25T17:19:15.790 INFO:tasks.workunit.client.0.smithi037.stdout:4/779: write d7/d7e/d1e/dae/fd0 [8182206,66122] 0 2024-04-25T17:19:15.794 INFO:tasks.workunit.client.0.smithi037.stdout:4/780: dread d7/d7e/d5b/f8c [0,4194304] 0 2024-04-25T17:19:15.796 INFO:tasks.workunit.client.1.smithi069.stdout:0/406: chown d0/da/db/d7e/d80/l8d 229343 1 2024-04-25T17:19:15.801 INFO:tasks.workunit.client.0.smithi037.stdout:5/661: creat d7/da1/fc9 x:0 0 0 2024-04-25T17:19:15.803 INFO:tasks.workunit.client.1.smithi069.stdout:9/476: rmdir d2/d51 39 2024-04-25T17:19:15.804 INFO:tasks.workunit.client.1.smithi069.stdout:8/456: creat d37/d66/d6b/f96 x:0 0 0 2024-04-25T17:19:15.805 INFO:tasks.workunit.client.1.smithi069.stdout:8/457: truncate d37/d66/f6f 73101 0 2024-04-25T17:19:15.806 INFO:tasks.workunit.client.1.smithi069.stdout:1/476: rmdir d1/d4/de/d63/d7d 39 2024-04-25T17:19:15.806 INFO:tasks.workunit.client.1.smithi069.stdout:8/458: chown d37/f57 1905 1 2024-04-25T17:19:15.807 INFO:tasks.workunit.client.1.smithi069.stdout:8/459: write d37/f59 [988865,52531] 0 2024-04-25T17:19:15.809 INFO:tasks.workunit.client.1.smithi069.stdout:6/438: read d2/f18 [1496846,88395] 0 2024-04-25T17:19:15.813 INFO:tasks.workunit.client.1.smithi069.stdout:8/460: dwrite d37/d47/f60 [0,4194304] 0 2024-04-25T17:19:15.816 INFO:tasks.workunit.client.1.smithi069.stdout:0/407: mkdir d0/da/d54/d7d/d94 0 2024-04-25T17:19:15.818 INFO:tasks.workunit.client.1.smithi069.stdout:9/477: rmdir d2/da/d5f 39 2024-04-25T17:19:15.821 INFO:tasks.workunit.client.1.smithi069.stdout:1/477: mkdir d1/d43/d5f/d8e 0 2024-04-25T17:19:15.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:15 smithi037 ceph-mon[26472]: pgmap v38: 65 pgs: 65 active+clean; 1.9 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 49 MiB/s rd, 192 MiB/s wr, 333 op/s 2024-04-25T17:19:15.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:15 smithi037 ceph-mon[26472]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:19:15.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:15 smithi037 ceph-mon[26472]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:19:15.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:15 smithi037 ceph-mon[26472]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-25T17:19:15.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:15 smithi037 ceph-mon[26472]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi037.front.sepia.ceph.com:9093"}]: dispatch 2024-04-25T17:19:15.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:15 smithi037 ceph-mon[26472]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:19:15.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:15 smithi037 ceph-mon[26472]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-25T17:19:15.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:15 smithi037 ceph-mon[26472]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi037.front.sepia.ceph.com:3000"}]: dispatch 2024-04-25T17:19:15.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:15 smithi037 ceph-mon[26472]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:19:15.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:15 smithi037 ceph-mon[26472]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-25T17:19:15.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:15 smithi037 ceph-mon[26472]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi037.front.sepia.ceph.com:9095"}]: dispatch 2024-04-25T17:19:15.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:15 smithi037 ceph-mon[26472]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:19:15.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:15 smithi037 ceph-mon[26472]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:19:15.825 INFO:tasks.workunit.client.1.smithi069.stdout:7/499: chown d4/d1a/f2f 2876 1 2024-04-25T17:19:15.825 INFO:tasks.workunit.client.1.smithi069.stdout:7/500: chown d4/d1a/d34/l45 57691981 1 2024-04-25T17:19:15.829 INFO:tasks.workunit.client.1.smithi069.stdout:2/473: dwrite d0/d1/d5b/d33/f51 [0,4194304] 0 2024-04-25T17:19:15.830 INFO:tasks.workunit.client.1.smithi069.stdout:2/474: chown d0/d56/d5f/d62/c78 32027 1 2024-04-25T17:19:15.831 INFO:tasks.workunit.client.1.smithi069.stdout:2/475: read d0/d56/d5f/d62/f69 [1005049,68430] 0 2024-04-25T17:19:15.834 INFO:tasks.workunit.client.1.smithi069.stdout:8/461: creat d37/d66/f97 x:0 0 0 2024-04-25T17:19:15.835 INFO:tasks.workunit.client.1.smithi069.stdout:2/476: write d0/d26/d10/f49 [1773326,27691] 0 2024-04-25T17:19:15.836 INFO:tasks.workunit.client.1.smithi069.stdout:8/462: write d37/d47/d48/f71 [327433,23712] 0 2024-04-25T17:19:15.840 INFO:tasks.workunit.client.1.smithi069.stdout:9/478: rename d2/da/dd/f90 to d2/da/dd/d1e/d2e/d68/d8f/fad 0 2024-04-25T17:19:15.841 INFO:tasks.workunit.client.0.smithi037.stdout:8/560: readlink d5/db/d18/l31 0 2024-04-25T17:19:15.841 INFO:tasks.workunit.client.1.smithi069.stdout:1/478: write d1/df/d6c/f8c [235861,95458] 0 2024-04-25T17:19:15.842 INFO:tasks.workunit.client.1.smithi069.stdout:7/501: mkdir d4/d83/da2 0 2024-04-25T17:19:15.843 INFO:tasks.workunit.client.1.smithi069.stdout:8/463: dwrite d37/d47/f89 [0,4194304] 0 2024-04-25T17:19:15.843 INFO:tasks.workunit.client.1.smithi069.stdout:4/464: link db/d15/d20/f2e db/d15/fa9 0 2024-04-25T17:19:15.844 INFO:tasks.workunit.client.1.smithi069.stdout:8/464: readlink d37/d47/l4d 0 2024-04-25T17:19:15.845 INFO:tasks.workunit.client.1.smithi069.stdout:6/439: mkdir d2/d1e/d3e/d74/d97/d98 0 2024-04-25T17:19:15.845 INFO:tasks.workunit.client.1.smithi069.stdout:6/440: dread - d2/d1e/d3e/d74/f4b zero size 2024-04-25T17:19:15.845 INFO:tasks.workunit.client.0.smithi037.stdout:4/781: creat d7/d7e/d45/dfb/fff x:0 0 0 2024-04-25T17:19:15.848 INFO:tasks.workunit.client.0.smithi037.stdout:5/662: truncate d7/f87 653812 0 2024-04-25T17:19:15.854 INFO:tasks.workunit.client.0.smithi037.stdout:1/672: rename dc/d18/f88 to dc/d18/d66/dd8/fe9 0 2024-04-25T17:19:15.857 INFO:tasks.workunit.client.0.smithi037.stdout:8/561: creat d5/db/d7e/fbb x:0 0 0 2024-04-25T17:19:15.860 INFO:tasks.workunit.client.0.smithi037.stdout:4/782: symlink d7/d7e/d5b/dfe/d39/d9c/l100 0 2024-04-25T17:19:15.860 INFO:tasks.workunit.client.0.smithi037.stdout:4/783: fdatasync d7/f80 0 2024-04-25T17:19:15.869 INFO:tasks.workunit.client.0.smithi037.stdout:4/784: creat d7/d78/f101 x:0 0 0 2024-04-25T17:19:15.872 INFO:tasks.workunit.client.0.smithi037.stdout:8/562: mkdir d5/dbc 0 2024-04-25T17:19:15.872 INFO:tasks.workunit.client.1.smithi069.stdout:3/550: link d8/c24 d8/d8b/db2/cc6 0 2024-04-25T17:19:15.873 INFO:tasks.workunit.client.1.smithi069.stdout:3/551: dread - d8/d16/d1a/d38/fba zero size 2024-04-25T17:19:15.875 INFO:tasks.workunit.client.0.smithi037.stdout:9/762: truncate d1/d5/dc/f5e 638376 0 2024-04-25T17:19:15.876 INFO:tasks.workunit.client.0.smithi037.stdout:9/763: write d1/d5/dc/ffe [916101,78325] 0 2024-04-25T17:19:15.881 INFO:tasks.workunit.client.0.smithi037.stdout:1/673: rename dc/d18/d66 to dc/d52/d6b/dd9/d4d/d6a/dea 0 2024-04-25T17:19:15.885 INFO:tasks.workunit.client.0.smithi037.stdout:9/764: creat d1/d5/d2e/d34/d76/db4/fff x:0 0 0 2024-04-25T17:19:15.885 INFO:tasks.workunit.client.0.smithi037.stdout:8/563: dread d5/f9 [0,4194304] 0 2024-04-25T17:19:15.887 INFO:tasks.workunit.client.0.smithi037.stdout:9/765: truncate d1/d5/dc/d38/d8b/fd3 400986 0 2024-04-25T17:19:15.887 INFO:tasks.workunit.client.0.smithi037.stdout:9/766: chown d1/d5/d2e/f52 454919 1 2024-04-25T17:19:15.888 INFO:tasks.workunit.client.0.smithi037.stdout:9/767: readlink d1/d5/d19/dde/lea 0 2024-04-25T17:19:15.888 INFO:tasks.workunit.client.0.smithi037.stdout:1/674: creat dc/d52/d6b/dd9/d4d/d6a/d8f/ddc/feb x:0 0 0 2024-04-25T17:19:15.889 INFO:tasks.workunit.client.0.smithi037.stdout:8/564: read - d5/db/d18/f86 zero size 2024-04-25T17:19:15.891 INFO:tasks.workunit.client.0.smithi037.stdout:4/785: getdents d7/d7e/d1e/dae/dc6 0 2024-04-25T17:19:15.894 INFO:tasks.workunit.client.1.smithi069.stdout:1/479: read d1/df/f30 [639001,45252] 0 2024-04-25T17:19:15.895 INFO:tasks.workunit.client.0.smithi037.stdout:1/675: creat dc/d52/d6b/dd9/d4d/d6a/d86/d91/fec x:0 0 0 2024-04-25T17:19:15.895 INFO:tasks.workunit.client.0.smithi037.stdout:1/676: readlink dc/l33 0 2024-04-25T17:19:15.899 INFO:tasks.workunit.client.1.smithi069.stdout:4/465: unlink db/f16 0 2024-04-25T17:19:15.900 INFO:tasks.workunit.client.0.smithi037.stdout:4/786: creat d7/d7e/d1e/de1/f102 x:0 0 0 2024-04-25T17:19:15.900 INFO:tasks.workunit.client.1.smithi069.stdout:1/480: dwrite d1/d43/f5b [0,4194304] 0 2024-04-25T17:19:15.902 INFO:tasks.workunit.client.1.smithi069.stdout:8/465: mkdir d37/d47/d54/d6e/d98 0 2024-04-25T17:19:15.908 INFO:tasks.workunit.client.0.smithi037.stdout:1/677: creat dc/d52/d6b/dd9/d22/d36/d74/daf/fed x:0 0 0 2024-04-25T17:19:15.911 INFO:tasks.workunit.client.0.smithi037.stdout:4/787: mkdir d7/d7e/d5b/dfe/d39/d9c/d103 0 2024-04-25T17:19:15.912 INFO:tasks.workunit.client.0.smithi037.stdout:4/788: chown d7/d7e/d5b/dfe/d39/d7a 19279854 1 2024-04-25T17:19:15.913 INFO:tasks.workunit.client.1.smithi069.stdout:5/498: getdents d13/d17/da5 0 2024-04-25T17:19:15.914 INFO:tasks.workunit.client.0.smithi037.stdout:1/678: mkdir dc/d52/d6b/dd9/d4d/d6a/d8f/ddc/dee 0 2024-04-25T17:19:15.915 INFO:tasks.workunit.client.0.smithi037.stdout:8/565: getdents d5/db/d23/d78/d93 0 2024-04-25T17:19:15.917 INFO:tasks.workunit.client.1.smithi069.stdout:5/499: dread d13/d17/d19/d96/d9d/fa7 [0,4194304] 0 2024-04-25T17:19:15.917 INFO:tasks.workunit.client.1.smithi069.stdout:9/479: creat d2/da/d5f/fae x:0 0 0 2024-04-25T17:19:15.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:15 smithi069 ceph-mon[34527]: pgmap v38: 65 pgs: 65 active+clean; 1.9 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 49 MiB/s rd, 192 MiB/s wr, 333 op/s 2024-04-25T17:19:15.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:15 smithi069 ceph-mon[34527]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:19:15.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:15 smithi069 ceph-mon[34527]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:19:15.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:15 smithi069 ceph-mon[34527]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-25T17:19:15.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:15 smithi069 ceph-mon[34527]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi037.front.sepia.ceph.com:9093"}]: dispatch 2024-04-25T17:19:15.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:15 smithi069 ceph-mon[34527]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:19:15.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:15 smithi069 ceph-mon[34527]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-25T17:19:15.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:15 smithi069 ceph-mon[34527]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi037.front.sepia.ceph.com:3000"}]: dispatch 2024-04-25T17:19:15.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:15 smithi069 ceph-mon[34527]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:19:15.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:15 smithi069 ceph-mon[34527]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-25T17:19:15.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:15 smithi069 ceph-mon[34527]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi037.front.sepia.ceph.com:9095"}]: dispatch 2024-04-25T17:19:15.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:15 smithi069 ceph-mon[34527]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:19:15.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:15 smithi069 ceph-mon[34527]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:19:15.919 INFO:tasks.workunit.client.1.smithi069.stdout:5/500: dread - d13/d17/d29/d2e/f83 zero size 2024-04-25T17:19:15.920 INFO:tasks.workunit.client.0.smithi037.stdout:4/789: chown d7/d7e/d1e/d70/d84/l9b 1697 1 2024-04-25T17:19:15.921 INFO:tasks.workunit.client.1.smithi069.stdout:7/502: symlink d4/d6/d14/d44/d79/d23/la3 0 2024-04-25T17:19:15.921 INFO:tasks.workunit.client.1.smithi069.stdout:9/480: dread d2/da/dd/d1e/f26 [0,4194304] 0 2024-04-25T17:19:15.922 INFO:tasks.workunit.client.0.smithi037.stdout:9/768: write d1/d48/d68/d1c/f1d [5150684,80733] 0 2024-04-25T17:19:15.923 INFO:tasks.workunit.client.0.smithi037.stdout:8/566: dwrite d5/db/d18/d3b/d50/f7d [0,4194304] 0 2024-04-25T17:19:15.929 INFO:tasks.workunit.client.0.smithi037.stdout:4/790: rmdir d7/d7e/d1e/de1 39 2024-04-25T17:19:15.931 INFO:tasks.workunit.client.1.smithi069.stdout:1/481: mkdir d1/d19/d7c/d4d/d8f 0 2024-04-25T17:19:15.932 INFO:tasks.workunit.client.1.smithi069.stdout:1/482: readlink d1/d4/d6/d4f/l87 0 2024-04-25T17:19:15.932 INFO:tasks.workunit.client.1.smithi069.stdout:1/483: stat d1/d19/d38 0 2024-04-25T17:19:15.933 INFO:tasks.workunit.client.0.smithi037.stdout:1/679: rename dc/d18/l4e to dc/d52/d6b/dd9/d4d/d6a/dea/dd8/lef 0 2024-04-25T17:19:15.933 INFO:tasks.workunit.client.1.smithi069.stdout:1/484: dread - d1/d4/d6/d4f/f83 zero size 2024-04-25T17:19:15.934 INFO:tasks.workunit.client.1.smithi069.stdout:8/466: chown c2c 8 1 2024-04-25T17:19:15.934 INFO:tasks.workunit.client.0.smithi037.stdout:1/680: chown dc/d52/d6b/ca8 132787084 1 2024-04-25T17:19:15.934 INFO:tasks.workunit.client.0.smithi037.stdout:9/769: chown d1/d48/d68/f31 61 1 2024-04-25T17:19:15.935 INFO:tasks.workunit.client.1.smithi069.stdout:6/441: symlink d2/d1e/d3f/d86/l99 0 2024-04-25T17:19:15.935 INFO:tasks.workunit.client.0.smithi037.stdout:9/770: stat d1/d5/dc/ffe 0 2024-04-25T17:19:15.936 INFO:tasks.workunit.client.0.smithi037.stdout:4/791: creat d7/d7e/d5b/dfe/d39/d7a/f104 x:0 0 0 2024-04-25T17:19:15.939 INFO:tasks.workunit.client.1.smithi069.stdout:3/552: link d8/d16/d1a/f4f d8/d16/d1a/d2c/d6c/d9c/fc7 0 2024-04-25T17:19:15.942 INFO:tasks.workunit.client.1.smithi069.stdout:0/408: getdents d0/da/d54/d7d 0 2024-04-25T17:19:15.944 INFO:tasks.workunit.client.0.smithi037.stdout:9/771: dread d1/d5/dc/f4a [0,4194304] 0 2024-04-25T17:19:15.945 INFO:tasks.workunit.client.0.smithi037.stdout:9/772: fsync d1/d5/f58 0 2024-04-25T17:19:15.948 INFO:tasks.workunit.client.0.smithi037.stdout:8/567: rename d5/db/d59/l7f to d5/d26/d81/lbd 0 2024-04-25T17:19:15.959 INFO:tasks.workunit.client.0.smithi037.stdout:4/792: rename d7/d7e/d45/d4f/fa4 to d7/d7e/d5b/dfe/d39/d7a/dcc/f105 0 2024-04-25T17:19:15.960 INFO:tasks.workunit.client.0.smithi037.stdout:4/793: dread - d7/d7e/d4e/fdd zero size 2024-04-25T17:19:15.960 INFO:tasks.workunit.client.0.smithi037.stdout:8/568: mknod d5/db/d59/cbe 0 2024-04-25T17:19:15.961 INFO:tasks.workunit.client.1.smithi069.stdout:1/485: dread - d1/df/d17/f3b zero size 2024-04-25T17:19:15.962 INFO:tasks.workunit.client.0.smithi037.stdout:1/681: fsync dc/d52/d6b/dd9/d4d/d6a/d86/d9b/fd3 0 2024-04-25T17:19:15.962 INFO:tasks.workunit.client.1.smithi069.stdout:1/486: write d1/d43/f5b [4031415,80230] 0 2024-04-25T17:19:15.963 INFO:tasks.workunit.client.0.smithi037.stdout:1/682: write dc/f62 [209702,45949] 0 2024-04-25T17:19:15.968 INFO:tasks.workunit.client.0.smithi037.stdout:4/794: creat d7/d7e/d5b/dfe/d39/d83/f106 x:0 0 0 2024-04-25T17:19:15.968 INFO:tasks.workunit.client.0.smithi037.stdout:4/795: chown d7/f19 9 1 2024-04-25T17:19:15.969 INFO:tasks.workunit.client.1.smithi069.stdout:7/503: dread d4/d6/d14/d3d/d47/f61 [0,4194304] 0 2024-04-25T17:19:15.969 INFO:tasks.workunit.client.1.smithi069.stdout:0/409: mkdir d0/d17/d95 0 2024-04-25T17:19:15.970 INFO:tasks.workunit.client.1.smithi069.stdout:7/504: chown d4/d6/f8a 3990274 1 2024-04-25T17:19:15.970 INFO:tasks.workunit.client.1.smithi069.stdout:2/477: getdents d0/d56/d5f/d62/d7d 0 2024-04-25T17:19:15.971 INFO:tasks.workunit.client.0.smithi037.stdout:1/683: fdatasync f1 0 2024-04-25T17:19:15.977 INFO:tasks.workunit.client.1.smithi069.stdout:8/467: mknod d37/c99 0 2024-04-25T17:19:15.980 INFO:tasks.workunit.client.1.smithi069.stdout:4/466: truncate db/d22/d24/d41/f47 2378307 0 2024-04-25T17:19:15.981 INFO:tasks.workunit.client.1.smithi069.stdout:9/481: dwrite d2/da/f20 [4194304,4194304] 0 2024-04-25T17:19:15.983 INFO:tasks.workunit.client.0.smithi037.stdout:9/773: write d1/d5/dc/f11 [1102971,64802] 0 2024-04-25T17:19:15.987 INFO:tasks.workunit.client.0.smithi037.stdout:1/684: getdents dc/d52 0 2024-04-25T17:19:15.988 INFO:tasks.workunit.client.1.smithi069.stdout:2/478: mkdir d0/d56/d94 0 2024-04-25T17:19:15.990 INFO:tasks.workunit.client.0.smithi037.stdout:9/774: unlink d1/d48/d68/f5a 0 2024-04-25T17:19:15.991 INFO:tasks.workunit.client.1.smithi069.stdout:7/505: truncate d4/d6/d14/d5a/f7f 5052 0 2024-04-25T17:19:15.992 INFO:tasks.workunit.client.1.smithi069.stdout:5/501: dwrite d13/d17/d19/f50 [0,4194304] 0 2024-04-25T17:19:15.995 INFO:tasks.workunit.client.0.smithi037.stdout:4/796: write d7/d7e/d5b/dfe/d39/d7a/fd4 [144206,115392] 0 2024-04-25T17:19:15.996 INFO:tasks.workunit.client.1.smithi069.stdout:3/553: write d8/d16/d1a/f54 [2322637,125] 0 2024-04-25T17:19:15.997 INFO:tasks.workunit.client.1.smithi069.stdout:8/468: symlink d37/d47/d54/l9a 0 2024-04-25T17:19:15.997 INFO:tasks.workunit.client.0.smithi037.stdout:9/775: dwrite d1/d5/dc/fba [0,4194304] 0 2024-04-25T17:19:16.000 INFO:tasks.workunit.client.1.smithi069.stdout:1/487: creat d1/d19/d38/f90 x:0 0 0 2024-04-25T17:19:16.005 INFO:tasks.workunit.client.1.smithi069.stdout:0/410: mknod d0/da/d54/d7d/d8e/c96 0 2024-04-25T17:19:16.006 INFO:tasks.workunit.client.1.smithi069.stdout:7/506: mkdir d4/d6/d14/d44/d79/da4 0 2024-04-25T17:19:16.009 INFO:tasks.workunit.client.1.smithi069.stdout:6/442: rename d2/d7/c3a to d2/d1e/d3e/d74/c9a 0 2024-04-25T17:19:16.010 INFO:tasks.workunit.client.1.smithi069.stdout:0/411: read d0/d38/f7a [3354238,16970] 0 2024-04-25T17:19:16.011 INFO:tasks.workunit.client.1.smithi069.stdout:3/554: mkdir d8/d16/d9b/dc3/dc8 0 2024-04-25T17:19:16.011 INFO:tasks.workunit.client.1.smithi069.stdout:8/469: mkdir d37/d47/d54/d6e/d98/d9b 0 2024-04-25T17:19:16.012 INFO:tasks.workunit.client.0.smithi037.stdout:4/797: mknod d7/d7e/d5b/dfe/d39/d7a/dcc/c107 0 2024-04-25T17:19:16.013 INFO:tasks.workunit.client.1.smithi069.stdout:2/479: dwrite d0/d26/d10/f7e [8388608,4194304] 0 2024-04-25T17:19:16.014 INFO:tasks.workunit.client.0.smithi037.stdout:2/660: sync 2024-04-25T17:19:16.014 INFO:tasks.workunit.client.1.smithi069.stdout:1/488: link d1/df/f7b d1/d4/de/f91 0 2024-04-25T17:19:16.015 INFO:tasks.workunit.client.1.smithi069.stdout:5/502: dread d13/d17/d19/d20/f77 [0,4194304] 0 2024-04-25T17:19:16.028 INFO:tasks.workunit.client.1.smithi069.stdout:9/482: dread d2/da/dd/d1e/d40/f91 [0,4194304] 0 2024-04-25T17:19:16.166 INFO:tasks.workunit.client.1.smithi069.stdout:6/443: symlink d2/d51/d85/l9b 0 2024-04-25T17:19:16.167 INFO:tasks.workunit.client.0.smithi037.stdout:1/685: rename dc/f34 to dc/d52/d6b/dd9/d4d/d6a/d86/d9b/ff0 0 2024-04-25T17:19:16.169 INFO:tasks.workunit.client.1.smithi069.stdout:4/467: creat db/d15/d20/faa x:0 0 0 2024-04-25T17:19:16.173 INFO:tasks.workunit.client.1.smithi069.stdout:3/555: unlink d8/fe 0 2024-04-25T17:19:16.173 INFO:tasks.workunit.client.1.smithi069.stdout:3/556: chown d8/d71/d8d/d92/db6/lb9 41 1 2024-04-25T17:19:16.174 INFO:tasks.workunit.client.1.smithi069.stdout:3/557: chown d8/d16/f28 917 1 2024-04-25T17:19:16.174 INFO:tasks.workunit.client.1.smithi069.stdout:8/470: symlink d37/d47/d48/l9c 0 2024-04-25T17:19:16.176 INFO:tasks.workunit.client.1.smithi069.stdout:0/412: symlink d0/da/db/d2a/l97 0 2024-04-25T17:19:16.178 INFO:tasks.workunit.client.0.smithi037.stdout:9/776: unlink d1/d48/d68/d26/d81/d9c/c65 0 2024-04-25T17:19:16.180 INFO:tasks.workunit.client.1.smithi069.stdout:2/480: symlink d0/d56/l95 0 2024-04-25T17:19:16.181 INFO:tasks.workunit.client.1.smithi069.stdout:0/413: dwrite d0/da/d24/d43/f7f [0,4194304] 0 2024-04-25T17:19:16.182 INFO:tasks.workunit.client.0.smithi037.stdout:1/686: mkdir dc/d18/d64/df1 0 2024-04-25T17:19:16.182 INFO:tasks.workunit.client.1.smithi069.stdout:0/414: readlink d0/da/db/d2a/l47 0 2024-04-25T17:19:16.183 INFO:tasks.workunit.client.1.smithi069.stdout:2/481: truncate d0/d26/d10/d43/f80 853738 0 2024-04-25T17:19:16.183 INFO:tasks.workunit.client.1.smithi069.stdout:5/503: creat d13/d17/d29/d2e/d76/faf x:0 0 0 2024-04-25T17:19:16.185 INFO:tasks.workunit.client.0.smithi037.stdout:9/777: rename d1/d48/d68/d1c/de8 to d1/d5/d19/dde/d100 0 2024-04-25T17:19:16.186 INFO:tasks.workunit.client.1.smithi069.stdout:7/507: write d4/d6/f92 [735692,100560] 0 2024-04-25T17:19:16.188 INFO:tasks.workunit.client.1.smithi069.stdout:9/483: write d2/d51/f8b [989552,36309] 0 2024-04-25T17:19:16.188 INFO:tasks.workunit.client.1.smithi069.stdout:0/415: dread d0/da/db/d3a/f5a [0,4194304] 0 2024-04-25T17:19:16.189 INFO:tasks.workunit.client.1.smithi069.stdout:0/416: write d0/da/db/d2c/f4d [5535578,121610] 0 2024-04-25T17:19:16.192 INFO:tasks.workunit.client.0.smithi037.stdout:9/778: fsync d1/d48/d68/d26/d81/f97 0 2024-04-25T17:19:16.200 INFO:tasks.workunit.client.0.smithi037.stdout:4/798: dwrite d7/f2f [0,4194304] 0 2024-04-25T17:19:16.209 INFO:tasks.workunit.client.0.smithi037.stdout:4/799: mknod d7/d7e/d5b/dfe/d39/d9c/c108 0 2024-04-25T17:19:16.209 INFO:tasks.workunit.client.0.smithi037.stdout:1/687: write dc/d52/d6b/dd9/d4d/d6a/d86/d91/f93 [1019642,103463] 0 2024-04-25T17:19:16.210 INFO:tasks.workunit.client.0.smithi037.stdout:1/688: chown dc/d52/d6b/dd9/d4d 506 1 2024-04-25T17:19:16.211 INFO:tasks.workunit.client.0.smithi037.stdout:1/689: write f7 [2519975,3110] 0 2024-04-25T17:19:16.216 INFO:tasks.workunit.client.0.smithi037.stdout:4/800: dwrite d7/d7e/d5b/dfe/d39/fb8 [0,4194304] 0 2024-04-25T17:19:16.219 INFO:tasks.workunit.client.0.smithi037.stdout:9/779: link d1/d5/d19/d6e/lda d1/d5/dc/l101 0 2024-04-25T17:19:16.221 INFO:tasks.workunit.client.0.smithi037.stdout:9/780: dread - d1/d5/dc/da9/fce zero size 2024-04-25T17:19:16.223 INFO:tasks.workunit.client.1.smithi069.stdout:3/558: creat d8/d16/d1a/d2c/d49/d87/d8a/fc9 x:0 0 0 2024-04-25T17:19:16.223 INFO:tasks.workunit.client.1.smithi069.stdout:1/489: symlink d1/df/l92 0 2024-04-25T17:19:16.223 INFO:tasks.workunit.client.1.smithi069.stdout:8/471: chown c7 0 1 2024-04-25T17:19:16.224 INFO:tasks.workunit.client.1.smithi069.stdout:9/484: creat d2/da4/faf x:0 0 0 2024-04-25T17:19:16.225 INFO:tasks.workunit.client.0.smithi037.stdout:9/781: dread d1/d48/d68/d4e/f67 [0,4194304] 0 2024-04-25T17:19:16.226 INFO:tasks.workunit.client.1.smithi069.stdout:4/468: mknod db/d15/cab 0 2024-04-25T17:19:16.226 INFO:tasks.workunit.client.1.smithi069.stdout:1/490: chown d1/d4/de/d63/c8b 2189 1 2024-04-25T17:19:16.227 INFO:tasks.workunit.client.1.smithi069.stdout:7/508: write d4/d6/f59 [2830688,92567] 0 2024-04-25T17:19:16.227 INFO:tasks.workunit.client.0.smithi037.stdout:1/690: truncate dc/d52/d6b/dd9/d4d/d6a/d86/d9b/fd3 3588736 0 2024-04-25T17:19:16.227 INFO:tasks.workunit.client.1.smithi069.stdout:3/559: dread d8/d16/d1a/d2c/f45 [0,4194304] 0 2024-04-25T17:19:16.229 INFO:tasks.workunit.client.0.smithi037.stdout:4/801: link d7/d7e/d1e/dae/fd0 d7/d7e/d5b/dfe/d39/de6/f109 0 2024-04-25T17:19:16.229 INFO:tasks.workunit.client.0.smithi037.stdout:0/635: sync 2024-04-25T17:19:16.231 INFO:tasks.workunit.client.0.smithi037.stdout:0/636: chown d9/d14/l1d 103935 1 2024-04-25T17:19:16.231 INFO:tasks.workunit.client.1.smithi069.stdout:8/472: dwrite d37/d47/d54/f68 [0,4194304] 0 2024-04-25T17:19:16.233 INFO:tasks.workunit.client.1.smithi069.stdout:8/473: truncate d37/d47/d48/f83 883808 0 2024-04-25T17:19:16.234 INFO:tasks.workunit.client.1.smithi069.stdout:6/444: rename d2/d1e/d3e/d74 to d2/d9c 0 2024-04-25T17:19:16.242 INFO:tasks.workunit.client.0.smithi037.stdout:4/802: symlink d7/d7e/d5b/dfe/d39/d7a/l10a 0 2024-04-25T17:19:16.242 INFO:tasks.workunit.client.0.smithi037.stdout:1/691: dread dc/d52/d6b/dd9/d22/f2c [0,4194304] 0 2024-04-25T17:19:16.247 INFO:tasks.workunit.client.1.smithi069.stdout:7/509: truncate d4/d3e/f80 496860 0 2024-04-25T17:19:16.247 INFO:tasks.workunit.client.1.smithi069.stdout:7/510: write d4/d1a/d34/f66 [4971895,43452] 0 2024-04-25T17:19:16.248 INFO:tasks.workunit.client.1.smithi069.stdout:3/560: fdatasync f6 0 2024-04-25T17:19:16.249 INFO:tasks.workunit.client.1.smithi069.stdout:3/561: dread - d8/d16/d1a/d38/f58 zero size 2024-04-25T17:19:16.250 INFO:tasks.workunit.client.0.smithi037.stdout:4/803: mknod d7/d8a/c10b 0 2024-04-25T17:19:16.252 INFO:tasks.workunit.client.0.smithi037.stdout:1/692: creat dc/d52/ff2 x:0 0 0 2024-04-25T17:19:16.255 INFO:tasks.workunit.client.1.smithi069.stdout:3/562: dwrite d8/d71/f75 [0,4194304] 0 2024-04-25T17:19:16.256 INFO:tasks.workunit.client.1.smithi069.stdout:5/504: rename d13/d17/d19/d1c/da4/da9/daa/fae to d13/d17/d19/d20/d2d/d93/fb0 0 2024-04-25T17:19:16.258 INFO:tasks.workunit.client.0.smithi037.stdout:9/782: getdents d1/d48/d68/d26/d81 0 2024-04-25T17:19:16.261 INFO:tasks.workunit.client.0.smithi037.stdout:4/804: rmdir d7/d67 39 2024-04-25T17:19:16.263 INFO:tasks.workunit.client.0.smithi037.stdout:4/805: dread - d7/d7e/d5b/dfe/d39/d7a/dcc/fe4 zero size 2024-04-25T17:19:16.265 INFO:tasks.workunit.client.0.smithi037.stdout:0/637: write d9/d71/f99 [327205,66073] 0 2024-04-25T17:19:16.266 INFO:tasks.workunit.client.1.smithi069.stdout:4/469: dwrite db/d15/d26/f29 [0,4194304] 0 2024-04-25T17:19:16.270 INFO:tasks.workunit.client.0.smithi037.stdout:4/806: mknod d7/d7e/d1e/dae/c10c 0 2024-04-25T17:19:16.272 INFO:tasks.workunit.client.1.smithi069.stdout:6/445: write d2/d7/fd [2109576,42990] 0 2024-04-25T17:19:16.274 INFO:tasks.workunit.client.0.smithi037.stdout:1/693: dread dc/d18/d39/f6c [0,4194304] 0 2024-04-25T17:19:16.276 INFO:tasks.workunit.client.1.smithi069.stdout:8/474: mknod d37/d47/d48/d8e/c9d 0 2024-04-25T17:19:16.277 INFO:tasks.workunit.client.1.smithi069.stdout:8/475: fdatasync d37/d47/d48/f71 0 2024-04-25T17:19:16.278 INFO:tasks.workunit.client.1.smithi069.stdout:8/476: write d37/f45 [1244241,9040] 0 2024-04-25T17:19:16.279 INFO:tasks.workunit.client.0.smithi037.stdout:4/807: fsync d7/d7e/d5b/dfe/d39/d83/f9a 0 2024-04-25T17:19:16.280 INFO:tasks.workunit.client.0.smithi037.stdout:0/638: mknod d9/df/dbd/dc1/cd5 0 2024-04-25T17:19:16.282 INFO:tasks.workunit.client.0.smithi037.stdout:1/694: symlink dc/d52/d6b/dd9/d4d/lf3 0 2024-04-25T17:19:16.284 INFO:tasks.workunit.client.1.smithi069.stdout:3/563: mkdir d8/d16/d4b/d9e/dca 0 2024-04-25T17:19:16.285 INFO:tasks.workunit.client.1.smithi069.stdout:5/505: fdatasync d13/d17/d19/d20/f77 0 2024-04-25T17:19:16.288 INFO:tasks.workunit.client.1.smithi069.stdout:0/417: getdents d0/da/d24/d43 0 2024-04-25T17:19:16.290 INFO:tasks.workunit.client.0.smithi037.stdout:0/639: rename d9/fa to d9/df/dbd/fd6 0 2024-04-25T17:19:16.291 INFO:tasks.workunit.client.1.smithi069.stdout:7/511: symlink d4/d6/la5 0 2024-04-25T17:19:16.292 INFO:tasks.workunit.client.0.smithi037.stdout:9/783: write d1/d5/dc/d3c/f9d [4761683,101857] 0 2024-04-25T17:19:16.292 INFO:tasks.workunit.client.0.smithi037.stdout:1/695: rmdir dc/d52/d6b/dd9/d4d/d6a 39 2024-04-25T17:19:16.294 INFO:tasks.workunit.client.1.smithi069.stdout:4/470: truncate db/d15/f1d 1426439 0 2024-04-25T17:19:16.299 INFO:tasks.workunit.client.0.smithi037.stdout:9/784: dwrite d1/d5/dc/f11 [0,4194304] 0 2024-04-25T17:19:16.302 INFO:tasks.workunit.client.0.smithi037.stdout:1/696: mkdir dc/d18/d64/df1/df4 0 2024-04-25T17:19:16.302 INFO:tasks.workunit.client.0.smithi037.stdout:4/808: write d7/d7e/d1e/f56 [150009,35148] 0 2024-04-25T17:19:16.303 INFO:tasks.workunit.client.0.smithi037.stdout:1/697: readlink dc/d52/l94 0 2024-04-25T17:19:16.303 INFO:tasks.workunit.client.1.smithi069.stdout:8/477: mkdir d37/d47/d54/d6e/d9e 0 2024-04-25T17:19:16.305 INFO:tasks.workunit.client.0.smithi037.stdout:0/640: dread d9/d14/d28/d48/f7e [0,4194304] 0 2024-04-25T17:19:16.305 INFO:tasks.workunit.client.0.smithi037.stdout:9/785: unlink d1/d48/lac 0 2024-04-25T17:19:16.307 INFO:tasks.workunit.client.1.smithi069.stdout:3/564: fsync d8/d16/d1a/d2c/d6c/f76 0 2024-04-25T17:19:16.308 INFO:tasks.workunit.client.0.smithi037.stdout:4/809: stat d7/d7e/d1e/de1/fee 0 2024-04-25T17:19:16.308 INFO:tasks.workunit.client.0.smithi037.stdout:1/698: truncate dc/d52/d6b/dd9/d22/d36/d92/db8/dbc/fcd 518806 0 2024-04-25T17:19:16.308 INFO:tasks.workunit.client.0.smithi037.stdout:1/699: readlink dc/l33 0 2024-04-25T17:19:16.311 INFO:tasks.workunit.client.0.smithi037.stdout:1/700: truncate dc/d52/d6b/dd9/d22/d36/d8c/fa2 1362354 0 2024-04-25T17:19:16.312 INFO:tasks.workunit.client.1.smithi069.stdout:5/506: creat d13/d17/d19/d1c/d6c/fb1 x:0 0 0 2024-04-25T17:19:16.313 INFO:tasks.workunit.client.0.smithi037.stdout:9/786: unlink d1/d5/d2e/d34/d76/fad 0 2024-04-25T17:19:16.314 INFO:tasks.workunit.client.1.smithi069.stdout:6/446: dread d2/f9 [0,4194304] 0 2024-04-25T17:19:16.317 INFO:tasks.workunit.client.1.smithi069.stdout:0/418: truncate d0/f2f 2786816 0 2024-04-25T17:19:16.318 INFO:tasks.workunit.client.1.smithi069.stdout:0/419: stat d0/f79 0 2024-04-25T17:19:16.318 INFO:tasks.workunit.client.1.smithi069.stdout:5/507: dwrite d13/d17/d19/f70 [0,4194304] 0 2024-04-25T17:19:16.319 INFO:tasks.workunit.client.0.smithi037.stdout:1/701: dwrite dc/d52/d6b/dd9/d22/fa3 [0,4194304] 0 2024-04-25T17:19:16.320 INFO:tasks.workunit.client.1.smithi069.stdout:7/512: rename d4/d1a/f5c to d4/d6/d14/d44/d79/da4/fa6 0 2024-04-25T17:19:16.321 INFO:tasks.workunit.client.0.smithi037.stdout:0/641: fsync d9/df/d32/f55 0 2024-04-25T17:19:16.324 INFO:tasks.workunit.client.1.smithi069.stdout:0/420: dwrite d0/d17/d40/f68 [0,4194304] 0 2024-04-25T17:19:16.327 INFO:tasks.workunit.client.1.smithi069.stdout:1/491: getdents d1/d4/de/d63 0 2024-04-25T17:19:16.328 INFO:tasks.workunit.client.1.smithi069.stdout:1/492: chown d1/d4/de/d63/c8b 785563 1 2024-04-25T17:19:16.329 INFO:tasks.workunit.client.1.smithi069.stdout:1/493: chown d1/d19/d7c/f37 25040504 1 2024-04-25T17:19:16.329 INFO:tasks.workunit.client.0.smithi037.stdout:0/642: dwrite d9/d14/d28/d48/f7e [0,4194304] 0 2024-04-25T17:19:16.332 INFO:tasks.workunit.client.0.smithi037.stdout:4/810: getdents d7/d7e/d1e/dae/dc6 0 2024-04-25T17:19:16.339 INFO:tasks.workunit.client.1.smithi069.stdout:0/421: dread d0/f1 [0,4194304] 0 2024-04-25T17:19:16.340 INFO:tasks.workunit.client.0.smithi037.stdout:9/787: mknod d1/d48/d68/d26/d81/d9c/c102 0 2024-04-25T17:19:16.341 INFO:tasks.workunit.client.0.smithi037.stdout:9/788: readlink d1/d5/dc/d38/l94 0 2024-04-25T17:19:16.342 INFO:tasks.workunit.client.0.smithi037.stdout:9/789: write d1/d48/d68/d26/d81/d9c/da4/fc1 [1919885,2762] 0 2024-04-25T17:19:16.345 INFO:tasks.workunit.client.1.smithi069.stdout:6/447: symlink d2/d1e/d3f/l9d 0 2024-04-25T17:19:16.346 INFO:tasks.workunit.client.1.smithi069.stdout:6/448: write d2/d7/fd [2751203,16021] 0 2024-04-25T17:19:16.350 INFO:tasks.workunit.client.1.smithi069.stdout:4/471: dread - db/d15/d20/d35/d63/d43/f97 zero size 2024-04-25T17:19:16.350 INFO:tasks.workunit.client.1.smithi069.stdout:1/494: truncate d1/d19/f55 992220 0 2024-04-25T17:19:16.353 INFO:tasks.workunit.client.1.smithi069.stdout:6/449: creat d2/d1e/d43/f9e x:0 0 0 2024-04-25T17:19:16.354 INFO:tasks.workunit.client.1.smithi069.stdout:1/495: read d1/f5 [12527538,15094] 0 2024-04-25T17:19:16.354 INFO:tasks.workunit.client.1.smithi069.stdout:5/508: dwrite d13/d17/f63 [0,4194304] 0 2024-04-25T17:19:16.354 INFO:tasks.workunit.client.1.smithi069.stdout:8/478: rmdir d37/d47/d54/d6e/d98/d9b 0 2024-04-25T17:19:16.355 INFO:tasks.workunit.client.1.smithi069.stdout:1/496: stat d1/d19/d7c 0 2024-04-25T17:19:16.356 INFO:tasks.workunit.client.1.smithi069.stdout:1/497: fdatasync d1/f79 0 2024-04-25T17:19:16.356 INFO:tasks.workunit.client.1.smithi069.stdout:4/472: mknod db/d15/d20/d35/d63/d75/cac 0 2024-04-25T17:19:16.357 INFO:tasks.workunit.client.1.smithi069.stdout:1/498: fsync d1/df/f33 0 2024-04-25T17:19:16.357 INFO:tasks.workunit.client.1.smithi069.stdout:5/509: write d13/d17/d29/d30/d5c/f8f [1541660,77640] 0 2024-04-25T17:19:16.358 INFO:tasks.workunit.client.1.smithi069.stdout:7/513: mknod d4/d6/d14/d3d/d5d/ca7 0 2024-04-25T17:19:16.359 INFO:tasks.workunit.client.1.smithi069.stdout:6/450: creat d2/d1e/d43/d7d/f9f x:0 0 0 2024-04-25T17:19:16.360 INFO:tasks.workunit.client.1.smithi069.stdout:8/479: symlink d37/d62/l9f 0 2024-04-25T17:19:16.361 INFO:tasks.workunit.client.1.smithi069.stdout:1/499: read - d1/d4/de/d44/d68/f75 zero size 2024-04-25T17:19:16.364 INFO:tasks.workunit.client.1.smithi069.stdout:7/514: mkdir d4/d6/d14/d44/da8 0 2024-04-25T17:19:16.366 INFO:tasks.workunit.client.1.smithi069.stdout:5/510: dwrite d13/d17/d19/d20/d2d/f5d [0,4194304] 0 2024-04-25T17:19:16.367 INFO:tasks.workunit.client.1.smithi069.stdout:1/500: unlink d1/f88 0 2024-04-25T17:19:16.367 INFO:tasks.workunit.client.1.smithi069.stdout:2/482: sync 2024-04-25T17:19:16.368 INFO:tasks.workunit.client.1.smithi069.stdout:0/422: write d0/d17/f4a [300101,6693] 0 2024-04-25T17:19:16.372 INFO:tasks.workunit.client.1.smithi069.stdout:6/451: creat d2/d1e/d3e/d67/d8d/fa0 x:0 0 0 2024-04-25T17:19:16.372 INFO:tasks.workunit.client.1.smithi069.stdout:0/423: fdatasync d0/da/d24/d43/f57 0 2024-04-25T17:19:16.373 INFO:tasks.workunit.client.1.smithi069.stdout:8/480: truncate d37/d47/d48/f71 2107300 0 2024-04-25T17:19:16.375 INFO:tasks.workunit.client.1.smithi069.stdout:7/515: dwrite d4/d6/d14/d5a/d5e/f7a [0,4194304] 0 2024-04-25T17:19:16.377 INFO:tasks.workunit.client.1.smithi069.stdout:1/501: dwrite d1/df/d6c/f8c [0,4194304] 0 2024-04-25T17:19:16.378 INFO:tasks.workunit.client.1.smithi069.stdout:5/511: creat d13/d17/d19/d1c/da4/da9/daa/fb2 x:0 0 0 2024-04-25T17:19:16.380 INFO:tasks.workunit.client.1.smithi069.stdout:6/452: fsync d2/f63 0 2024-04-25T17:19:16.383 INFO:tasks.workunit.client.1.smithi069.stdout:4/473: write db/d15/f37 [2547921,18324] 0 2024-04-25T17:19:16.385 INFO:tasks.workunit.client.0.smithi037.stdout:0/643: rmdir d9/df/d32/d56 39 2024-04-25T17:19:16.385 INFO:tasks.workunit.client.1.smithi069.stdout:4/474: fdatasync db/d15/d20/d35/d63/d43/d48/f7c 0 2024-04-25T17:19:16.386 INFO:tasks.workunit.client.1.smithi069.stdout:7/516: mknod d4/d1a/d34/ca9 0 2024-04-25T17:19:16.386 INFO:tasks.workunit.client.0.smithi037.stdout:9/790: fdatasync d1/d5/dc/f23 0 2024-04-25T17:19:16.388 INFO:tasks.workunit.client.1.smithi069.stdout:5/512: creat d13/d17/d19/d1c/d6c/fb3 x:0 0 0 2024-04-25T17:19:16.389 INFO:tasks.workunit.client.0.smithi037.stdout:9/791: write d1/d5/dc/d3c/d3e/feb [539848,119110] 0 2024-04-25T17:19:16.391 INFO:tasks.workunit.client.0.smithi037.stdout:9/792: write d1/d5/dc/d38/d8b/f95 [1067310,15532] 0 2024-04-25T17:19:16.394 INFO:tasks.workunit.client.1.smithi069.stdout:6/453: fdatasync d2/f9 0 2024-04-25T17:19:16.396 INFO:tasks.workunit.client.1.smithi069.stdout:8/481: truncate ff 301493 0 2024-04-25T17:19:16.397 INFO:tasks.workunit.client.0.smithi037.stdout:0/644: fdatasync d9/df/d32/f3e 0 2024-04-25T17:19:16.398 INFO:tasks.workunit.client.0.smithi037.stdout:0/645: chown d9/d14/d28/d48/d58 1 1 2024-04-25T17:19:16.400 INFO:tasks.workunit.client.1.smithi069.stdout:1/502: symlink d1/d4/d6/d81/l93 0 2024-04-25T17:19:16.403 INFO:tasks.workunit.client.0.smithi037.stdout:9/793: mkdir d1/d5/dc/d3c/d3e/d103 0 2024-04-25T17:19:16.404 INFO:tasks.workunit.client.0.smithi037.stdout:9/794: readlink d1/l4b 0 2024-04-25T17:19:16.404 INFO:tasks.workunit.client.1.smithi069.stdout:6/454: dwrite d2/d1e/d43/d7d/f87 [0,4194304] 0 2024-04-25T17:19:16.404 INFO:tasks.workunit.client.1.smithi069.stdout:2/483: dread d0/d26/d10/f49 [0,4194304] 0 2024-04-25T17:19:16.406 INFO:tasks.workunit.client.1.smithi069.stdout:0/424: dread d0/da/d24/d67/f6a [0,4194304] 0 2024-04-25T17:19:16.407 INFO:tasks.workunit.client.1.smithi069.stdout:0/425: write d0/d38/f49 [1240318,60749] 0 2024-04-25T17:19:16.407 INFO:tasks.workunit.client.0.smithi037.stdout:9/795: dread - d1/d48/d68/d1c/fa7 zero size 2024-04-25T17:19:16.409 INFO:tasks.workunit.client.0.smithi037.stdout:4/811: write d7/d7e/d1e/d2b/f75 [4481061,53306] 0 2024-04-25T17:19:16.414 INFO:tasks.workunit.client.0.smithi037.stdout:9/796: fdatasync d1/d5/d2e/d34/daf/dcb/fec 0 2024-04-25T17:19:16.417 INFO:tasks.workunit.client.0.smithi037.stdout:0/646: rename d9/df/d32/d39/f52 to d9/df/d32/fd7 0 2024-04-25T17:19:16.418 INFO:tasks.workunit.client.1.smithi069.stdout:1/503: truncate d1/d43/f18 1685594 0 2024-04-25T17:19:16.419 INFO:tasks.workunit.client.0.smithi037.stdout:4/812: stat d7/d7e/d1e/d2b/f63 0 2024-04-25T17:19:16.421 INFO:tasks.workunit.client.1.smithi069.stdout:8/482: dread f26 [0,4194304] 0 2024-04-25T17:19:16.422 INFO:tasks.workunit.client.0.smithi037.stdout:9/797: mkdir d1/d48/d68/d26/d81/d9c/da4/d104 0 2024-04-25T17:19:16.425 INFO:tasks.workunit.client.1.smithi069.stdout:6/455: rmdir d2/d1e/d3f/d56 39 2024-04-25T17:19:16.427 INFO:tasks.workunit.client.0.smithi037.stdout:4/813: rename d7/d7e/d5b/f9d to d7/d7e/d1e/dae/dc6/f10d 0 2024-04-25T17:19:16.434 INFO:tasks.workunit.client.0.smithi037.stdout:9/798: rename d1/d5/dc/da9/cc2 to d1/d5/d19/c105 0 2024-04-25T17:19:16.435 INFO:tasks.workunit.client.0.smithi037.stdout:0/647: write d9/df/d32/f3e [690815,74998] 0 2024-04-25T17:19:16.435 INFO:tasks.workunit.client.1.smithi069.stdout:3/565: sync 2024-04-25T17:19:16.435 INFO:tasks.workunit.client.1.smithi069.stdout:9/485: sync 2024-04-25T17:19:16.435 INFO:tasks.workunit.client.1.smithi069.stdout:4/475: dwrite db/d22/d24/d41/f47 [0,4194304] 0 2024-04-25T17:19:16.436 INFO:tasks.workunit.client.1.smithi069.stdout:3/566: write f4 [1643393,26913] 0 2024-04-25T17:19:16.437 INFO:tasks.workunit.client.1.smithi069.stdout:4/476: fdatasync db/d15/f3f 0 2024-04-25T17:19:16.439 INFO:tasks.workunit.client.1.smithi069.stdout:8/483: symlink d37/d47/d48/d8e/la0 0 2024-04-25T17:19:16.440 INFO:tasks.workunit.client.0.smithi037.stdout:0/648: unlink d9/d14/f27 0 2024-04-25T17:19:16.440 INFO:tasks.workunit.client.1.smithi069.stdout:4/477: chown db/d15/d42/d64/la8 4714 1 2024-04-25T17:19:16.443 INFO:tasks.workunit.client.1.smithi069.stdout:7/517: rename d4/d6/d14/d3d/d47/f61 to d4/d6/d14/faa 0 2024-04-25T17:19:16.443 INFO:tasks.workunit.client.1.smithi069.stdout:2/484: dwrite d0/d26/d36/f59 [0,4194304] 0 2024-04-25T17:19:16.444 INFO:tasks.workunit.client.1.smithi069.stdout:7/518: dread - d4/d6/d14/d15/f8d zero size 2024-04-25T17:19:16.445 INFO:tasks.workunit.client.0.smithi037.stdout:9/799: rename d1/d48/d68/d26/da1/db0/le3 to d1/d48/d68/d26/da1/l106 0 2024-04-25T17:19:16.445 INFO:tasks.workunit.client.1.smithi069.stdout:2/485: write d0/d26/f60 [191799,113103] 0 2024-04-25T17:19:16.446 INFO:tasks.workunit.client.0.smithi037.stdout:4/814: dwrite d7/d7e/d5b/f85 [0,4194304] 0 2024-04-25T17:19:16.449 INFO:tasks.workunit.client.0.smithi037.stdout:0/649: mknod d9/df/d32/d39/d68/da7/db4/cd8 0 2024-04-25T17:19:16.451 INFO:tasks.workunit.client.0.smithi037.stdout:9/800: symlink d1/d5/d2e/d34/d76/db4/l107 0 2024-04-25T17:19:16.452 INFO:tasks.workunit.client.0.smithi037.stdout:4/815: fdatasync d7/d7e/d5b/dfe/f3e 0 2024-04-25T17:19:16.454 INFO:tasks.workunit.client.0.smithi037.stdout:0/650: mknod d9/df/dbd/dc1/cd9 0 2024-04-25T17:19:16.457 INFO:tasks.workunit.client.0.smithi037.stdout:9/801: unlink d1/d48/d68/d26/cb9 0 2024-04-25T17:19:16.458 INFO:tasks.workunit.client.1.smithi069.stdout:9/486: mkdir d2/da/dd/de/db0 0 2024-04-25T17:19:16.459 INFO:tasks.workunit.client.0.smithi037.stdout:4/816: symlink d7/d8a/l10e 0 2024-04-25T17:19:16.461 INFO:tasks.workunit.client.1.smithi069.stdout:3/567: creat d8/d71/d8d/d92/db6/fcb x:0 0 0 2024-04-25T17:19:16.462 INFO:tasks.workunit.client.0.smithi037.stdout:0/651: mknod d9/df/dbd/dc1/cda 0 2024-04-25T17:19:16.469 INFO:tasks.workunit.client.1.smithi069.stdout:0/426: rename d0/da/d59/d8b to d0/da/db/d56/d98 0 2024-04-25T17:19:16.470 INFO:tasks.workunit.client.1.smithi069.stdout:0/427: write d0/d17/f4a [433013,111984] 0 2024-04-25T17:19:16.470 INFO:tasks.workunit.client.0.smithi037.stdout:0/652: mkdir d9/df/d32/dd1/d7a/da4/ddb 0 2024-04-25T17:19:16.472 INFO:tasks.workunit.client.1.smithi069.stdout:7/519: creat d4/d3e/d94/da1/fab x:0 0 0 2024-04-25T17:19:16.475 INFO:tasks.workunit.client.1.smithi069.stdout:5/513: getdents d13/d17/d29/d2e/d76 0 2024-04-25T17:19:16.477 INFO:tasks.workunit.client.1.smithi069.stdout:0/428: dwrite d0/da/db/f64 [0,4194304] 0 2024-04-25T17:19:16.477 INFO:tasks.workunit.client.1.smithi069.stdout:1/504: creat d1/df/f94 x:0 0 0 2024-04-25T17:19:16.479 INFO:tasks.workunit.client.1.smithi069.stdout:3/568: mknod d8/d16/d9b/dc3/ccc 0 2024-04-25T17:19:16.480 INFO:tasks.workunit.client.1.smithi069.stdout:0/429: dread d0/da/db/d56/f78 [0,4194304] 0 2024-04-25T17:19:16.481 INFO:tasks.workunit.client.1.smithi069.stdout:3/569: write d8/f1f [102046,101859] 0 2024-04-25T17:19:16.483 INFO:tasks.workunit.client.1.smithi069.stdout:3/570: fsync d8/d16/d31/f44 0 2024-04-25T17:19:16.485 INFO:tasks.workunit.client.1.smithi069.stdout:6/456: rename d2/d51/f91 to d2/d1e/fa1 0 2024-04-25T17:19:16.486 INFO:tasks.workunit.client.1.smithi069.stdout:0/430: dread d0/d17/f4a [0,4194304] 0 2024-04-25T17:19:16.486 INFO:tasks.workunit.client.1.smithi069.stdout:8/484: rename d37/d66 to d37/d66/da1 22 2024-04-25T17:19:16.486 INFO:tasks.workunit.client.0.smithi037.stdout:3/467: sync 2024-04-25T17:19:16.486 INFO:tasks.workunit.client.0.smithi037.stdout:7/586: sync 2024-04-25T17:19:16.488 INFO:tasks.workunit.client.0.smithi037.stdout:3/468: stat d8/d31/l77 0 2024-04-25T17:19:16.489 INFO:tasks.workunit.client.1.smithi069.stdout:2/486: creat d0/d56/d94/f96 x:0 0 0 2024-04-25T17:19:16.489 INFO:tasks.workunit.client.1.smithi069.stdout:4/478: dread db/d22/d24/f2d [0,4194304] 0 2024-04-25T17:19:16.489 INFO:tasks.workunit.client.1.smithi069.stdout:6/457: truncate d2/d51/d85/f6f 1026378 0 2024-04-25T17:19:16.492 INFO:tasks.workunit.client.0.smithi037.stdout:9/802: dwrite d1/d48/d68/d26/d81/f86 [0,4194304] 0 2024-04-25T17:19:16.494 INFO:tasks.workunit.client.0.smithi037.stdout:7/587: creat d5/d15/d17/d1b/da2/d76/fd0 x:0 0 0 2024-04-25T17:19:16.494 INFO:tasks.workunit.client.0.smithi037.stdout:4/817: write d7/d7e/d1e/d70/fe0 [4721627,61171] 0 2024-04-25T17:19:16.495 INFO:tasks.workunit.client.1.smithi069.stdout:5/514: readlink d13/d17/d29/l91 0 2024-04-25T17:19:16.497 INFO:tasks.workunit.client.1.smithi069.stdout:5/515: chown c10 41644208 1 2024-04-25T17:19:16.497 INFO:tasks.workunit.client.1.smithi069.stdout:8/485: dwrite d37/d66/d6b/f7e [0,4194304] 0 2024-04-25T17:19:16.499 INFO:tasks.workunit.client.0.smithi037.stdout:0/653: write d9/d14/f3b [701862,22447] 0 2024-04-25T17:19:16.502 INFO:tasks.workunit.client.1.smithi069.stdout:5/516: write d13/d17/d19/d1c/f89 [8600484,61405] 0 2024-04-25T17:19:16.504 INFO:tasks.workunit.client.1.smithi069.stdout:4/479: dwrite db/d15/d20/d35/d63/fa2 [0,4194304] 0 2024-04-25T17:19:16.508 INFO:tasks.workunit.client.1.smithi069.stdout:8/486: dwrite d37/d66/f74 [0,4194304] 0 2024-04-25T17:19:16.510 INFO:tasks.workunit.client.0.smithi037.stdout:3/469: dwrite d8/d31/d32/d3e/f6e [4194304,4194304] 0 2024-04-25T17:19:16.514 INFO:tasks.workunit.client.0.smithi037.stdout:4/818: rename d7/d7e/d5b/cfa to d7/d7e/d1e/d70/d84/ddf/c10f 0 2024-04-25T17:19:16.524 INFO:tasks.workunit.client.1.smithi069.stdout:7/520: dread d4/f4a [0,4194304] 0 2024-04-25T17:19:16.527 INFO:tasks.workunit.client.1.smithi069.stdout:5/517: creat d13/d17/d29/fb4 x:0 0 0 2024-04-25T17:19:16.528 INFO:tasks.workunit.client.1.smithi069.stdout:5/518: dread - d13/d17/d19/d8a/f9e zero size 2024-04-25T17:19:16.528 INFO:tasks.workunit.client.1.smithi069.stdout:4/480: unlink db/d15/d26/l3a 0 2024-04-25T17:19:16.530 INFO:tasks.workunit.client.1.smithi069.stdout:5/519: write d13/d17/d19/d20/f7a [1211345,109232] 0 2024-04-25T17:19:16.531 INFO:tasks.workunit.client.1.smithi069.stdout:6/458: mknod d2/d1e/d3f/ca2 0 2024-04-25T17:19:16.532 INFO:tasks.workunit.client.1.smithi069.stdout:7/521: creat d4/d6/d14/d44/d79/d23/fac x:0 0 0 2024-04-25T17:19:16.533 INFO:tasks.workunit.client.1.smithi069.stdout:1/505: rename d1/d43/d1b/l1c to d1/d4/de/l95 0 2024-04-25T17:19:16.534 INFO:tasks.workunit.client.1.smithi069.stdout:4/481: mknod db/d15/d42/d64/d7f/cad 0 2024-04-25T17:19:16.535 INFO:tasks.workunit.client.1.smithi069.stdout:0/431: link d0/l16 d0/da/db/d1d/d5f/l99 0 2024-04-25T17:19:16.536 INFO:tasks.workunit.client.1.smithi069.stdout:6/459: read d2/d7/f94 [3052242,60133] 0 2024-04-25T17:19:16.538 INFO:tasks.workunit.client.1.smithi069.stdout:2/487: link d0/f92 d0/d26/d10/f97 0 2024-04-25T17:19:16.540 INFO:tasks.workunit.client.0.smithi037.stdout:9/803: creat d1/d5/d2e/d34/f108 x:0 0 0 2024-04-25T17:19:16.541 INFO:tasks.workunit.client.1.smithi069.stdout:1/506: rmdir d1/df/d17 39 2024-04-25T17:19:16.544 INFO:tasks.workunit.client.0.smithi037.stdout:4/819: dread d7/d7e/d5b/dfe/d39/fb8 [0,4194304] 0 2024-04-25T17:19:16.547 INFO:tasks.workunit.client.1.smithi069.stdout:4/482: creat db/d15/d20/d35/d63/d43/d48/d49/d4e/fae x:0 0 0 2024-04-25T17:19:16.549 INFO:tasks.workunit.client.0.smithi037.stdout:0/654: dwrite d9/d14/d28/d48/f49 [0,4194304] 0 2024-04-25T17:19:16.549 INFO:tasks.workunit.client.1.smithi069.stdout:6/460: chown d2/l29 8 1 2024-04-25T17:19:16.549 INFO:tasks.workunit.client.0.smithi037.stdout:9/804: truncate d1/d5/dc/d3c/fae 1745281 0 2024-04-25T17:19:16.551 INFO:tasks.workunit.client.0.smithi037.stdout:3/470: truncate d8/d23/d38/f6b 1049863 0 2024-04-25T17:19:16.552 INFO:tasks.workunit.client.0.smithi037.stdout:3/471: chown d8/d23/d3a/d5d/f7e 2147 1 2024-04-25T17:19:16.552 INFO:tasks.workunit.client.1.smithi069.stdout:9/487: sync 2024-04-25T17:19:16.553 INFO:tasks.workunit.client.1.smithi069.stdout:9/488: write d2/da/dd/d1e/d2e/d35/f98 [997709,64703] 0 2024-04-25T17:19:16.555 INFO:tasks.workunit.client.0.smithi037.stdout:4/820: symlink d7/d7e/d1e/dae/l110 0 2024-04-25T17:19:16.558 INFO:tasks.workunit.client.1.smithi069.stdout:2/488: mknod d0/d56/d5f/d62/d7d/d31/d61/c98 0 2024-04-25T17:19:16.558 INFO:tasks.workunit.client.1.smithi069.stdout:2/489: chown d0/d26/d10/d43/l6d 61968 1 2024-04-25T17:19:16.559 INFO:tasks.workunit.client.0.smithi037.stdout:0/655: fdatasync d9/df/d32/f60 0 2024-04-25T17:19:16.561 INFO:tasks.workunit.client.1.smithi069.stdout:3/571: rename d8/d16/d1a/cb3 to d8/d16/d9b/ccd 0 2024-04-25T17:19:16.563 INFO:tasks.workunit.client.0.smithi037.stdout:9/805: mknod d1/d5/dc/d3c/dca/df5/c109 0 2024-04-25T17:19:16.564 INFO:tasks.workunit.client.0.smithi037.stdout:9/806: truncate d1/d5/f58 2517642 0 2024-04-25T17:19:16.566 INFO:tasks.workunit.client.1.smithi069.stdout:8/487: getdents d37/d47/d48 0 2024-04-25T17:19:16.567 INFO:tasks.workunit.client.0.smithi037.stdout:4/821: mkdir d7/d7e/d4e/d111 0 2024-04-25T17:19:16.568 INFO:tasks.workunit.client.0.smithi037.stdout:4/822: write d7/d7e/d1e/de1/f102 [995161,97962] 0 2024-04-25T17:19:16.569 INFO:tasks.workunit.client.1.smithi069.stdout:5/520: dwrite d13/d17/d19/d20/d2d/f46 [0,4194304] 0 2024-04-25T17:19:16.569 INFO:tasks.workunit.client.1.smithi069.stdout:0/432: fsync d0/da/db/d1d/f86 0 2024-04-25T17:19:16.571 INFO:tasks.workunit.client.1.smithi069.stdout:5/521: write d13/d17/da5/fab [752636,120538] 0 2024-04-25T17:19:16.572 INFO:tasks.workunit.client.1.smithi069.stdout:5/522: chown d13/d17/d19/d1c/da4/da9/daa 17775676 1 2024-04-25T17:19:16.573 INFO:tasks.workunit.client.1.smithi069.stdout:5/523: chown d13/d17/d29/d2e/f59 0 1 2024-04-25T17:19:16.575 INFO:tasks.workunit.client.1.smithi069.stdout:7/522: link l0 d4/d3e/d94/da1/lad 0 2024-04-25T17:19:16.577 INFO:tasks.workunit.client.1.smithi069.stdout:9/489: mknod d2/da/dd/d1e/d2e/d68/cb1 0 2024-04-25T17:19:16.578 INFO:tasks.workunit.client.1.smithi069.stdout:9/490: write d2/da/dd/d1e/d2e/f34 [1644752,25236] 0 2024-04-25T17:19:16.579 INFO:tasks.workunit.client.1.smithi069.stdout:2/490: mkdir d0/d26/d10/d43/d99 0 2024-04-25T17:19:16.580 INFO:tasks.workunit.client.1.smithi069.stdout:9/491: write d2/da/dd/d1e/d2e/d35/f6c [4182621,12294] 0 2024-04-25T17:19:16.580 INFO:tasks.workunit.client.1.smithi069.stdout:2/491: fdatasync d0/d56/d5f/d62/d7d/d31/f6c 0 2024-04-25T17:19:16.581 INFO:tasks.workunit.client.1.smithi069.stdout:3/572: rename d8/d2a/c3d to d8/d16/d1a/d2c/d49/d87/cce 0 2024-04-25T17:19:16.581 INFO:tasks.workunit.client.0.smithi037.stdout:0/656: getdents d9/df/d32/dd1/d7a/daf/db1 0 2024-04-25T17:19:16.582 INFO:tasks.workunit.client.1.smithi069.stdout:2/492: chown d0/d56/d5f/d62/d7d/d31/d61 282 1 2024-04-25T17:19:16.582 INFO:tasks.workunit.client.1.smithi069.stdout:1/507: mknod d1/d19/d7c/d4d/d8f/c96 0 2024-04-25T17:19:16.583 INFO:tasks.workunit.client.1.smithi069.stdout:1/508: dread - d1/d43/d1b/d32/f7f zero size 2024-04-25T17:19:16.584 INFO:tasks.workunit.client.0.smithi037.stdout:3/472: rename d8/d23/d38/f73 to d8/d23/f93 0 2024-04-25T17:19:16.584 INFO:tasks.workunit.client.1.smithi069.stdout:8/488: readlink l19 0 2024-04-25T17:19:16.586 INFO:tasks.workunit.client.0.smithi037.stdout:0/657: dread d9/d14/d28/f2a [0,4194304] 0 2024-04-25T17:19:16.588 INFO:tasks.workunit.client.0.smithi037.stdout:4/823: fsync d7/f1a 0 2024-04-25T17:19:16.589 INFO:tasks.workunit.client.1.smithi069.stdout:4/483: stat db/d15/d20/d38/la6 0 2024-04-25T17:19:16.591 INFO:tasks.workunit.client.1.smithi069.stdout:8/489: dwrite d37/d66/f6f [0,4194304] 0 2024-04-25T17:19:16.595 INFO:tasks.workunit.client.1.smithi069.stdout:5/524: dread d13/d17/d29/f43 [0,4194304] 0 2024-04-25T17:19:16.596 INFO:tasks.workunit.client.0.smithi037.stdout:0/658: rmdir d9/d71 39 2024-04-25T17:19:16.601 INFO:tasks.workunit.client.1.smithi069.stdout:7/523: unlink d4/d6/d14/l6e 0 2024-04-25T17:19:16.601 INFO:tasks.workunit.client.0.smithi037.stdout:9/807: truncate d1/d5/dc/d38/f3a 105571 0 2024-04-25T17:19:16.607 INFO:tasks.workunit.client.0.smithi037.stdout:3/473: mknod d8/d31/d32/d3e/d7d/c94 0 2024-04-25T17:19:16.608 INFO:tasks.workunit.client.1.smithi069.stdout:3/573: creat d8/d16/d9b/dc3/fcf x:0 0 0 2024-04-25T17:19:16.613 INFO:tasks.workunit.client.1.smithi069.stdout:9/492: dwrite d2/f2c [0,4194304] 0 2024-04-25T17:19:16.614 INFO:tasks.workunit.client.0.smithi037.stdout:4/824: write d7/d7e/f7c [4402990,13693] 0 2024-04-25T17:19:16.614 INFO:tasks.workunit.client.1.smithi069.stdout:1/509: symlink d1/d4/d6/l97 0 2024-04-25T17:19:16.615 INFO:tasks.workunit.client.1.smithi069.stdout:1/510: readlink d1/d43/l7e 0 2024-04-25T17:19:16.616 INFO:tasks.workunit.client.0.smithi037.stdout:3/474: dread - d8/f5c zero size 2024-04-25T17:19:16.616 INFO:tasks.workunit.client.1.smithi069.stdout:1/511: chown d1/d19/d7c/c20 2 1 2024-04-25T17:19:16.619 INFO:tasks.workunit.client.0.smithi037.stdout:0/659: write d9/f73 [4618027,44439] 0 2024-04-25T17:19:16.620 INFO:tasks.workunit.client.0.smithi037.stdout:0/660: chown d9/df/f86 23 1 2024-04-25T17:19:16.621 INFO:tasks.workunit.client.0.smithi037.stdout:3/475: stat d8/d23/d3a/d63/c6c 0 2024-04-25T17:19:16.622 INFO:tasks.workunit.client.0.smithi037.stdout:0/661: readlink d9/df/d32/dd1/lae 0 2024-04-25T17:19:16.623 INFO:tasks.workunit.client.1.smithi069.stdout:4/484: read f0 [443541,94124] 0 2024-04-25T17:19:16.624 INFO:tasks.workunit.client.1.smithi069.stdout:4/485: write f5 [962536,32234] 0 2024-04-25T17:19:16.625 INFO:tasks.workunit.client.1.smithi069.stdout:6/461: creat d2/fa3 x:0 0 0 2024-04-25T17:19:16.626 INFO:tasks.workunit.client.1.smithi069.stdout:4/486: readlink db/d15/d42/d64/la8 0 2024-04-25T17:19:16.626 INFO:tasks.workunit.client.1.smithi069.stdout:6/462: write d2/d1e/f62 [961368,87969] 0 2024-04-25T17:19:16.628 INFO:tasks.workunit.client.1.smithi069.stdout:0/433: truncate d0/d36/f2b 1660315 0 2024-04-25T17:19:16.630 INFO:tasks.workunit.client.0.smithi037.stdout:4/825: truncate d7/d7e/d4e/da5/ff2 282468 0 2024-04-25T17:19:16.631 INFO:tasks.workunit.client.1.smithi069.stdout:3/574: truncate d8/d71/f81 1051729 0 2024-04-25T17:19:16.632 INFO:tasks.workunit.client.1.smithi069.stdout:2/493: symlink d0/l9a 0 2024-04-25T17:19:16.633 INFO:tasks.workunit.client.1.smithi069.stdout:3/575: fsync d8/d71/d8d/d92/db6/dc1/f7a 0 2024-04-25T17:19:16.634 INFO:tasks.workunit.client.0.smithi037.stdout:4/826: chown d7/d7e/d5b/dfe/c92 1613726 1 2024-04-25T17:19:16.634 INFO:tasks.workunit.client.1.smithi069.stdout:9/493: fdatasync d2/da/dd/d1e/d2e/d68/d8f/fad 0 2024-04-25T17:19:16.639 INFO:tasks.workunit.client.0.smithi037.stdout:3/476: dwrite d8/d31/f48 [0,4194304] 0 2024-04-25T17:19:16.641 INFO:tasks.workunit.client.0.smithi037.stdout:4/827: mkdir d7/d7e/d4e/da5/d112 0 2024-04-25T17:19:16.644 INFO:tasks.workunit.client.0.smithi037.stdout:3/477: dread d8/d23/f91 [4194304,4194304] 0 2024-04-25T17:19:16.645 INFO:tasks.workunit.client.0.smithi037.stdout:3/478: stat d8/l2f 0 2024-04-25T17:19:16.647 INFO:tasks.workunit.client.0.smithi037.stdout:0/662: dread d9/df/d32/d39/d68/f6e [0,4194304] 0 2024-04-25T17:19:16.649 INFO:tasks.workunit.client.0.smithi037.stdout:4/828: mkdir d7/d7e/d5b/dfe/d39/d7a/db2/d113 0 2024-04-25T17:19:16.650 INFO:tasks.workunit.client.1.smithi069.stdout:4/487: fsync db/d22/d24/f31 0 2024-04-25T17:19:16.650 INFO:tasks.workunit.client.0.smithi037.stdout:4/829: readlink d7/d7e/d1e/d70/d84/l9b 0 2024-04-25T17:19:16.653 INFO:tasks.workunit.client.1.smithi069.stdout:4/488: read db/d15/f37 [932699,4221] 0 2024-04-25T17:19:16.653 INFO:tasks.workunit.client.0.smithi037.stdout:3/479: rename d8/l6d to d8/d23/d3a/d81/l95 0 2024-04-25T17:19:16.654 INFO:tasks.workunit.client.1.smithi069.stdout:6/463: symlink d2/d51/d85/la4 0 2024-04-25T17:19:16.655 INFO:tasks.workunit.client.0.smithi037.stdout:1/702: sync 2024-04-25T17:19:16.655 INFO:tasks.workunit.client.0.smithi037.stdout:6/574: sync 2024-04-25T17:19:16.655 INFO:tasks.workunit.client.0.smithi037.stdout:8/569: sync 2024-04-25T17:19:16.655 INFO:tasks.workunit.client.0.smithi037.stdout:2/661: sync 2024-04-25T17:19:16.655 INFO:tasks.workunit.client.0.smithi037.stdout:5/663: sync 2024-04-25T17:19:16.658 INFO:tasks.workunit.client.0.smithi037.stdout:2/662: fdatasync d0/d23/dac/f87 0 2024-04-25T17:19:16.659 INFO:tasks.workunit.client.0.smithi037.stdout:4/830: dwrite d7/d7e/d1e/d70/fe0 [4194304,4194304] 0 2024-04-25T17:19:16.660 INFO:tasks.workunit.client.0.smithi037.stdout:6/575: readlink db/d26/d2e/d7d/d65/d8b/lc0 0 2024-04-25T17:19:16.661 INFO:tasks.workunit.client.0.smithi037.stdout:4/831: fdatasync d7/d7e/d5b/dfe/fd9 0 2024-04-25T17:19:16.663 INFO:tasks.workunit.client.0.smithi037.stdout:6/576: fsync db/d26/d2e/d3e/d25/fad 0 2024-04-25T17:19:16.663 INFO:tasks.workunit.client.0.smithi037.stdout:0/663: unlink d9/df/d32/d39/d68/f6e 0 2024-04-25T17:19:16.664 INFO:tasks.workunit.client.0.smithi037.stdout:2/663: read d0/f14 [1327088,102187] 0 2024-04-25T17:19:16.664 INFO:tasks.workunit.client.1.smithi069.stdout:8/490: truncate f33 560586 0 2024-04-25T17:19:16.665 INFO:tasks.workunit.client.1.smithi069.stdout:8/491: write d37/d66/f6f [4948764,121761] 0 2024-04-25T17:19:16.667 INFO:tasks.workunit.client.1.smithi069.stdout:8/492: dread - d37/d47/d78/d93/f94 zero size 2024-04-25T17:19:16.668 INFO:tasks.workunit.client.1.smithi069.stdout:8/493: chown d37/d47/d54/l9a 21118560 1 2024-04-25T17:19:16.670 INFO:tasks.workunit.client.0.smithi037.stdout:4/832: dwrite d7/d7e/d5b/fd6 [0,4194304] 0 2024-04-25T17:19:16.670 INFO:tasks.workunit.client.1.smithi069.stdout:2/494: stat d0/d26/d10/c3e 0 2024-04-25T17:19:16.675 INFO:tasks.workunit.client.1.smithi069.stdout:5/525: truncate d13/d17/d19/d8a/f8e 336719 0 2024-04-25T17:19:16.675 INFO:tasks.workunit.client.1.smithi069.stdout:9/494: rmdir d2/da/dd/de/d64 39 2024-04-25T17:19:16.676 INFO:tasks.workunit.client.0.smithi037.stdout:5/664: dread - d7/d25/f91 zero size 2024-04-25T17:19:16.676 INFO:tasks.workunit.client.1.smithi069.stdout:9/495: chown d2/da/dd/f5d 107348 1 2024-04-25T17:19:16.677 INFO:tasks.workunit.client.0.smithi037.stdout:1/703: dread - dc/d52/d6b/dd9/d4d/d6a/d8f/ddc/feb zero size 2024-04-25T17:19:16.679 INFO:tasks.workunit.client.1.smithi069.stdout:2/495: dread d0/d56/d5f/d62/d7d/d31/d61/f85 [0,4194304] 0 2024-04-25T17:19:16.680 INFO:tasks.workunit.client.0.smithi037.stdout:6/577: rmdir db 39 2024-04-25T17:19:16.681 INFO:tasks.workunit.client.0.smithi037.stdout:0/664: mkdir d9/d14/d28/d48/da9/ddc 0 2024-04-25T17:19:16.682 INFO:tasks.workunit.client.0.smithi037.stdout:0/665: chown d9/df/d32 441293242 1 2024-04-25T17:19:16.683 INFO:tasks.workunit.client.1.smithi069.stdout:6/464: write d2/d1e/d3f/d56/f5e [38712,36841] 0 2024-04-25T17:19:16.686 INFO:tasks.workunit.client.1.smithi069.stdout:7/524: rename l0 to d4/d6/lae 0 2024-04-25T17:19:16.686 INFO:tasks.workunit.client.1.smithi069.stdout:0/434: rename d0/da/db/d2a to d0/da/db/d2a/d9a 22 2024-04-25T17:19:16.687 INFO:tasks.workunit.client.1.smithi069.stdout:3/576: write d8/d16/d1a/d2c/d6c/f76 [507657,80986] 0 2024-04-25T17:19:16.690 INFO:tasks.workunit.client.1.smithi069.stdout:8/494: mknod d37/d47/d54/ca2 0 2024-04-25T17:19:16.691 INFO:tasks.workunit.client.1.smithi069.stdout:8/495: write d37/f3f [1133156,64731] 0 2024-04-25T17:19:16.696 INFO:tasks.workunit.client.0.smithi037.stdout:8/570: creat d5/db/d18/d3b/d75/fbf x:0 0 0 2024-04-25T17:19:16.697 INFO:tasks.workunit.client.1.smithi069.stdout:5/526: mkdir d13/d17/d19/d20/d51/db5 0 2024-04-25T17:19:16.698 INFO:tasks.workunit.client.0.smithi037.stdout:5/665: unlink d7/d12/d5d/faa 0 2024-04-25T17:19:16.699 INFO:tasks.workunit.client.1.smithi069.stdout:1/512: creat d1/d4/de/f98 x:0 0 0 2024-04-25T17:19:16.700 INFO:tasks.workunit.client.0.smithi037.stdout:1/704: write dc/d52/d6b/dd9/d22/d36/d92/fc8 [287064,50741] 0 2024-04-25T17:19:16.706 INFO:tasks.workunit.client.0.smithi037.stdout:3/480: truncate f5 3153013 0 2024-04-25T17:19:16.707 INFO:tasks.workunit.client.0.smithi037.stdout:0/666: dread d9/d71/f99 [0,4194304] 0 2024-04-25T17:19:16.708 INFO:tasks.workunit.client.0.smithi037.stdout:2/664: mknod d0/d23/d7d/dae/cd8 0 2024-04-25T17:19:16.708 INFO:tasks.workunit.client.0.smithi037.stdout:0/667: write d9/d14/d28/d48/d58/f77 [3153845,113927] 0 2024-04-25T17:19:16.710 INFO:tasks.workunit.client.1.smithi069.stdout:7/525: unlink d4/d6/f2c 0 2024-04-25T17:19:16.712 INFO:tasks.workunit.client.1.smithi069.stdout:7/526: read d4/d6/f59 [6632663,97706] 0 2024-04-25T17:19:16.713 INFO:tasks.workunit.client.1.smithi069.stdout:6/465: rename d2/d1e/d43/l47 to d2/d1e/d3e/d67/la5 0 2024-04-25T17:19:16.715 INFO:tasks.workunit.client.0.smithi037.stdout:2/665: dwrite d0/d23/dac/f65 [0,4194304] 0 2024-04-25T17:19:16.716 INFO:tasks.workunit.client.1.smithi069.stdout:3/577: write d8/d16/f27 [2981586,63067] 0 2024-04-25T17:19:16.717 INFO:tasks.workunit.client.0.smithi037.stdout:4/833: dwrite d7/d7e/d5b/dfe/d39/de6/f109 [4194304,4194304] 0 2024-04-25T17:19:16.718 INFO:tasks.workunit.client.0.smithi037.stdout:5/666: symlink d7/d12/d5d/d90/db1/lca 0 2024-04-25T17:19:16.722 INFO:tasks.workunit.client.1.smithi069.stdout:8/496: creat d37/d66/fa3 x:0 0 0 2024-04-25T17:19:16.724 INFO:tasks.workunit.client.1.smithi069.stdout:8/497: write d37/d47/d54/f91 [126067,4228] 0 2024-04-25T17:19:16.726 INFO:tasks.workunit.client.1.smithi069.stdout:9/496: mknod d2/da/dd/de/d64/cb2 0 2024-04-25T17:19:16.727 INFO:tasks.workunit.client.0.smithi037.stdout:0/668: readlink d9/df/d32/d35/l53 0 2024-04-25T17:19:16.728 INFO:tasks.workunit.client.0.smithi037.stdout:0/669: stat d9/d14/d28/d48/d58/dc4 0 2024-04-25T17:19:16.729 INFO:tasks.workunit.client.0.smithi037.stdout:8/571: creat d5/db/d18/d3b/d50/da0/da6/da8/fc0 x:0 0 0 2024-04-25T17:19:16.731 INFO:tasks.workunit.client.1.smithi069.stdout:2/496: creat d0/d26/d10/d43/d99/f9b x:0 0 0 2024-04-25T17:19:16.731 INFO:tasks.workunit.client.0.smithi037.stdout:8/572: chown d5/db/d18/d3b/d50/da0/da6/da8/fc0 2438 1 2024-04-25T17:19:16.733 INFO:tasks.workunit.client.0.smithi037.stdout:5/667: chown d7/d18/l4e 51592452 1 2024-04-25T17:19:16.733 INFO:tasks.workunit.client.0.smithi037.stdout:5/668: chown d7/d12/d6f/d94 18219 1 2024-04-25T17:19:16.735 INFO:tasks.workunit.client.0.smithi037.stdout:4/834: fdatasync d7/f1a 0 2024-04-25T17:19:16.736 INFO:tasks.workunit.client.1.smithi069.stdout:7/527: chown d4/d1a/f35 7 1 2024-04-25T17:19:16.737 INFO:tasks.workunit.client.0.smithi037.stdout:6/578: mkdir db/d1d/d20/dcf 0 2024-04-25T17:19:16.739 INFO:tasks.workunit.client.1.smithi069.stdout:3/578: dread d8/f37 [0,4194304] 0 2024-04-25T17:19:16.739 INFO:tasks.workunit.client.1.smithi069.stdout:6/466: mkdir d2/d1e/d43/da6 0 2024-04-25T17:19:16.739 INFO:tasks.workunit.client.1.smithi069.stdout:6/467: fdatasync d2/d51/f88 0 2024-04-25T17:19:16.740 INFO:tasks.workunit.client.1.smithi069.stdout:3/579: read - d8/d16/d1a/d2c/d49/fc4 zero size 2024-04-25T17:19:16.741 INFO:tasks.workunit.client.1.smithi069.stdout:3/580: stat d8/d16/d1a/d38/f58 0 2024-04-25T17:19:16.743 INFO:tasks.workunit.client.0.smithi037.stdout:0/670: fdatasync d9/df/d32/d39/d68/f93 0 2024-04-25T17:19:16.744 INFO:tasks.workunit.client.1.smithi069.stdout:1/513: truncate d1/d19/d7c/f64 230993 0 2024-04-25T17:19:16.746 INFO:tasks.workunit.client.0.smithi037.stdout:2/666: symlink d0/d16/ld9 0 2024-04-25T17:19:16.750 INFO:tasks.workunit.client.1.smithi069.stdout:9/497: creat d2/d51/fb3 x:0 0 0 2024-04-25T17:19:16.751 INFO:tasks.workunit.client.1.smithi069.stdout:9/498: write d2/da/dd/d1e/d2e/f47 [2147092,60271] 0 2024-04-25T17:19:16.753 INFO:tasks.workunit.client.0.smithi037.stdout:8/573: dwrite d5/db/d18/d3b/f48 [0,4194304] 0 2024-04-25T17:19:16.756 INFO:tasks.workunit.client.0.smithi037.stdout:1/705: creat dc/d52/d6b/dd9/d4d/d6a/dea/ff5 x:0 0 0 2024-04-25T17:19:16.759 INFO:tasks.workunit.client.1.smithi069.stdout:5/527: write d13/d17/d19/d20/f22 [4772917,26474] 0 2024-04-25T17:19:16.761 INFO:tasks.workunit.client.0.smithi037.stdout:3/481: link d8/f9 d8/d23/d72/f96 0 2024-04-25T17:19:16.768 INFO:tasks.workunit.client.0.smithi037.stdout:8/574: dwrite d5/db/d18/d3b/d50/fa4 [0,4194304] 0 2024-04-25T17:19:16.773 INFO:tasks.workunit.client.0.smithi037.stdout:5/669: rename d7/d43/c3e to d7/d25/d4f/da7/dab/ccb 0 2024-04-25T17:19:16.774 INFO:tasks.workunit.client.1.smithi069.stdout:7/528: symlink d4/d6/d14/laf 0 2024-04-25T17:19:16.776 INFO:tasks.workunit.client.1.smithi069.stdout:0/435: getdents d0/da/d54/d7d/d8e 0 2024-04-25T17:19:16.778 INFO:tasks.workunit.client.0.smithi037.stdout:4/835: mknod d7/d7e/d1e/d70/d84/ddf/df0/c114 0 2024-04-25T17:19:16.778 INFO:tasks.workunit.client.1.smithi069.stdout:6/468: getdents d2/d1e/d43/da6 0 2024-04-25T17:19:16.779 INFO:tasks.workunit.client.0.smithi037.stdout:4/836: write d7/d8a/f8b [3684585,16743] 0 2024-04-25T17:19:16.780 INFO:tasks.workunit.client.0.smithi037.stdout:4/837: chown d7/d7e/f7c 966 1 2024-04-25T17:19:16.787 INFO:tasks.workunit.client.0.smithi037.stdout:0/671: dread d9/d14/f16 [0,4194304] 0 2024-04-25T17:19:16.788 INFO:tasks.workunit.client.1.smithi069.stdout:8/498: write d37/d47/d48/f7b [2103493,22859] 0 2024-04-25T17:19:16.792 INFO:tasks.workunit.client.1.smithi069.stdout:0/436: mkdir d0/da/db/d2a/d9b 0 2024-04-25T17:19:16.792 INFO:tasks.workunit.client.1.smithi069.stdout:8/499: dread d37/d66/f74 [0,4194304] 0 2024-04-25T17:19:16.792 INFO:tasks.workunit.client.1.smithi069.stdout:8/500: chown f2b 63244475 1 2024-04-25T17:19:16.794 INFO:tasks.workunit.client.1.smithi069.stdout:3/581: write d8/d16/d1a/d38/fba [300248,29717] 0 2024-04-25T17:19:16.794 INFO:tasks.workunit.client.0.smithi037.stdout:1/706: dread dc/d24/da5/fda [0,4194304] 0 2024-04-25T17:19:16.796 INFO:tasks.workunit.client.1.smithi069.stdout:5/528: creat d13/d17/d29/d30/d9c/fb6 x:0 0 0 2024-04-25T17:19:16.797 INFO:tasks.workunit.client.0.smithi037.stdout:2/667: write d0/d15/f36 [1642050,98916] 0 2024-04-25T17:19:16.798 INFO:tasks.workunit.client.0.smithi037.stdout:5/670: dread d7/d43/f47 [4194304,4194304] 0 2024-04-25T17:19:16.799 INFO:tasks.workunit.client.1.smithi069.stdout:1/514: rename d1/df/f94 to d1/d4/de/f99 0 2024-04-25T17:19:16.803 INFO:tasks.workunit.client.0.smithi037.stdout:2/668: dwrite d0/d16/d20/d55/f60 [0,4194304] 0 2024-04-25T17:19:16.805 INFO:tasks.workunit.client.0.smithi037.stdout:2/669: chown d0/d23/d7d/dae/cd8 39156308 1 2024-04-25T17:19:16.806 INFO:tasks.workunit.client.0.smithi037.stdout:2/670: read - d0/d15/dcb/fd7 zero size 2024-04-25T17:19:16.809 INFO:tasks.workunit.client.1.smithi069.stdout:6/469: creat d2/d1e/d3f/d56/d7e/fa7 x:0 0 0 2024-04-25T17:19:16.810 INFO:tasks.workunit.client.1.smithi069.stdout:4/489: sync 2024-04-25T17:19:16.813 INFO:tasks.workunit.client.1.smithi069.stdout:5/529: symlink d13/d17/d29/d2e/lb7 0 2024-04-25T17:19:16.816 INFO:tasks.workunit.client.1.smithi069.stdout:9/499: rename d2/da4/da7 to d2/d51/db4 0 2024-04-25T17:19:16.817 INFO:tasks.workunit.client.1.smithi069.stdout:1/515: fdatasync d1/d43/d1b/d32/d4a/f58 0 2024-04-25T17:19:16.817 INFO:tasks.workunit.client.1.smithi069.stdout:7/529: truncate d4/d6/d14/d44/d79/da4/fa6 2148625 0 2024-04-25T17:19:16.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:16 smithi037 ceph-mon[26472]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-25T17:19:16.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:16 smithi037 ceph-mon[26472]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi037.front.sepia.ceph.com:9093"}]: dispatch 2024-04-25T17:19:16.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:16 smithi037 ceph-mon[26472]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-25T17:19:16.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:16 smithi037 ceph-mon[26472]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi037.front.sepia.ceph.com:3000"}]: dispatch 2024-04-25T17:19:16.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:16 smithi037 ceph-mon[26472]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-25T17:19:16.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:16 smithi037 ceph-mon[26472]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi037.front.sepia.ceph.com:9095"}]: dispatch 2024-04-25T17:19:16.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:16 smithi037 ceph-mon[26472]: Upgrade: Need to upgrade myself (mgr.smithi069.mmuhdo) 2024-04-25T17:19:16.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:16 smithi037 ceph-mon[26472]: Upgrade: Need to upgrade myself (mgr.smithi069.mmuhdo) 2024-04-25T17:19:16.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:16 smithi037 ceph-mon[26472]: pgmap v39: 65 pgs: 65 active+clean; 2.6 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 85 MiB/s rd, 301 MiB/s wr, 539 op/s 2024-04-25T17:19:16.823 INFO:tasks.workunit.client.1.smithi069.stdout:8/501: link d37/f41 d37/d47/d54/d6e/d9e/fa4 0 2024-04-25T17:19:16.823 INFO:tasks.workunit.client.1.smithi069.stdout:7/530: dwrite d4/d6/d14/d3d/f69 [0,4194304] 0 2024-04-25T17:19:16.825 INFO:tasks.workunit.client.1.smithi069.stdout:4/490: creat db/d15/d20/d35/d63/d70/faf x:0 0 0 2024-04-25T17:19:16.825 INFO:tasks.workunit.client.1.smithi069.stdout:3/582: mkdir d8/d16/d1a/d2c/d49/dd0 0 2024-04-25T17:19:16.827 INFO:tasks.workunit.client.1.smithi069.stdout:4/491: dread - db/d15/d20/d35/d63/d43/d48/d49/f88 zero size 2024-04-25T17:19:16.828 INFO:tasks.workunit.client.1.smithi069.stdout:5/530: fdatasync d13/d17/d29/d2e/f59 0 2024-04-25T17:19:16.833 INFO:tasks.workunit.client.1.smithi069.stdout:9/500: creat d2/da/dd/d1e/d2e/d68/fb5 x:0 0 0 2024-04-25T17:19:16.847 INFO:tasks.workunit.client.1.smithi069.stdout:8/502: symlink d37/d47/d54/d6e/la5 0 2024-04-25T17:19:16.848 INFO:tasks.workunit.client.1.smithi069.stdout:6/470: dwrite d2/f9 [0,4194304] 0 2024-04-25T17:19:16.851 INFO:tasks.workunit.client.1.smithi069.stdout:7/531: unlink d4/d6/d14/d44/c76 0 2024-04-25T17:19:16.854 INFO:tasks.workunit.client.1.smithi069.stdout:4/492: dread db/d15/f18 [0,4194304] 0 2024-04-25T17:19:16.854 INFO:tasks.workunit.client.1.smithi069.stdout:8/503: dwrite d37/f57 [0,4194304] 0 2024-04-25T17:19:16.854 INFO:tasks.workunit.client.1.smithi069.stdout:3/583: rename d8/lbb to d8/d2a/ld1 0 2024-04-25T17:19:16.856 INFO:tasks.workunit.client.1.smithi069.stdout:3/584: chown d8/d71/d8d/d92/db6/dc1/fa3 89010 1 2024-04-25T17:19:16.861 INFO:tasks.workunit.client.1.smithi069.stdout:2/497: sync 2024-04-25T17:19:16.865 INFO:tasks.workunit.client.0.smithi037.stdout:3/482: truncate d8/f58 223222 0 2024-04-25T17:19:16.866 INFO:tasks.workunit.client.0.smithi037.stdout:3/483: stat d8/d23/d3a/l3b 0 2024-04-25T17:19:16.868 INFO:tasks.workunit.client.1.smithi069.stdout:9/501: unlink d2/da/dd/de/f7c 0 2024-04-25T17:19:16.871 INFO:tasks.workunit.client.1.smithi069.stdout:1/516: write d1/df/f30 [523536,18982] 0 2024-04-25T17:19:16.871 INFO:tasks.workunit.client.1.smithi069.stdout:1/517: fsync d1/d4/f4c 0 2024-04-25T17:19:16.878 INFO:tasks.workunit.client.0.smithi037.stdout:4/838: fsync d7/d7e/d4e/f71 0 2024-04-25T17:19:16.878 INFO:tasks.workunit.client.1.smithi069.stdout:1/518: dwrite d1/d19/d7c/f14 [4194304,4194304] 0 2024-04-25T17:19:16.878 INFO:tasks.workunit.client.0.smithi037.stdout:4/839: chown d7/d7e/d1e/d2b/ceb 280 1 2024-04-25T17:19:16.886 INFO:tasks.workunit.client.0.smithi037.stdout:0/672: rename d9/df/fb3 to d9/df/d32/dd1/fdd 0 2024-04-25T17:19:16.888 INFO:tasks.workunit.client.0.smithi037.stdout:1/707: fdatasync dc/d52/f5b 0 2024-04-25T17:19:16.893 INFO:tasks.workunit.client.0.smithi037.stdout:5/671: unlink d7/d43/lac 0 2024-04-25T17:19:16.894 INFO:tasks.workunit.client.0.smithi037.stdout:2/671: symlink d0/d23/d7d/d56/lda 0 2024-04-25T17:19:16.897 INFO:tasks.workunit.client.0.smithi037.stdout:8/575: mkdir d5/db/da2/dc1 0 2024-04-25T17:19:16.899 INFO:tasks.workunit.client.0.smithi037.stdout:8/576: read d5/db/d18/d3b/f8d [758932,112885] 0 2024-04-25T17:19:16.903 INFO:tasks.workunit.client.1.smithi069.stdout:0/437: link d0/da/db/d1d/d5f/l8f d0/l9c 0 2024-04-25T17:19:16.906 INFO:tasks.workunit.client.0.smithi037.stdout:1/708: mknod dc/d52/d6b/dd9/d22/d36/d74/daf/cf6 0 2024-04-25T17:19:16.908 INFO:tasks.workunit.client.1.smithi069.stdout:6/471: mkdir d2/d1e/d3f/d86/da8 0 2024-04-25T17:19:16.908 INFO:tasks.workunit.client.0.smithi037.stdout:0/673: dwrite f7 [8388608,4194304] 0 2024-04-25T17:19:16.915 INFO:tasks.workunit.client.1.smithi069.stdout:6/472: dwrite d2/d1e/d3f/f49 [0,4194304] 0 2024-04-25T17:19:16.915 INFO:tasks.workunit.client.1.smithi069.stdout:4/493: rmdir db/d15/d20/d35/d63/d75 39 2024-04-25T17:19:16.915 INFO:tasks.workunit.client.0.smithi037.stdout:2/672: dread - d0/d16/d20/d55/fa1 zero size 2024-04-25T17:19:16.918 INFO:tasks.workunit.client.1.smithi069.stdout:8/504: creat d37/d47/d54/fa6 x:0 0 0 2024-04-25T17:19:16.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:16 smithi069 ceph-mon[34527]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-25T17:19:16.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:16 smithi069 ceph-mon[34527]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi037.front.sepia.ceph.com:9093"}]: dispatch 2024-04-25T17:19:16.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:16 smithi069 ceph-mon[34527]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-25T17:19:16.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:16 smithi069 ceph-mon[34527]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi037.front.sepia.ceph.com:3000"}]: dispatch 2024-04-25T17:19:16.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:16 smithi069 ceph-mon[34527]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-25T17:19:16.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:16 smithi069 ceph-mon[34527]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi037.front.sepia.ceph.com:9095"}]: dispatch 2024-04-25T17:19:16.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:16 smithi069 ceph-mon[34527]: Upgrade: Need to upgrade myself (mgr.smithi069.mmuhdo) 2024-04-25T17:19:16.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:16 smithi069 ceph-mon[34527]: Upgrade: Need to upgrade myself (mgr.smithi069.mmuhdo) 2024-04-25T17:19:16.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:16 smithi069 ceph-mon[34527]: pgmap v39: 65 pgs: 65 active+clean; 2.6 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 85 MiB/s rd, 301 MiB/s wr, 539 op/s 2024-04-25T17:19:16.920 INFO:tasks.workunit.client.1.smithi069.stdout:3/585: mkdir d8/d16/d1a/d2c/d49/d59/dd2 0 2024-04-25T17:19:16.924 INFO:tasks.workunit.client.1.smithi069.stdout:4/494: dwrite db/d15/d20/d35/d63/d43/d48/d49/d4e/fae [0,4194304] 0 2024-04-25T17:19:16.925 INFO:tasks.workunit.client.0.smithi037.stdout:6/579: sync 2024-04-25T17:19:16.925 INFO:tasks.workunit.client.0.smithi037.stdout:9/808: sync 2024-04-25T17:19:16.925 INFO:tasks.workunit.client.0.smithi037.stdout:7/588: sync 2024-04-25T17:19:16.926 INFO:tasks.workunit.client.1.smithi069.stdout:4/495: stat db/d15/d20/d38/c7e 0 2024-04-25T17:19:16.927 INFO:tasks.workunit.client.0.smithi037.stdout:7/589: readlink d5/d14/d31/lb2 0 2024-04-25T17:19:16.928 INFO:tasks.workunit.client.0.smithi037.stdout:4/840: dwrite d7/d7e/d5b/dfe/d39/d7a/dcc/f105 [0,4194304] 0 2024-04-25T17:19:16.929 INFO:tasks.workunit.client.1.smithi069.stdout:2/498: mkdir d0/d56/d5f/d62/d7d/d31/d61/d9c 0 2024-04-25T17:19:16.930 INFO:tasks.workunit.client.0.smithi037.stdout:9/809: write d1/d5/dc/d38/d8b/f60 [2402539,113962] 0 2024-04-25T17:19:16.931 INFO:tasks.workunit.client.1.smithi069.stdout:4/496: dread db/d22/d24/f2d [0,4194304] 0 2024-04-25T17:19:16.931 INFO:tasks.workunit.client.0.smithi037.stdout:5/672: write d7/f73 [804505,52816] 0 2024-04-25T17:19:16.931 INFO:tasks.workunit.client.1.smithi069.stdout:5/531: creat d13/d17/d19/d20/d51/db5/fb8 x:0 0 0 2024-04-25T17:19:16.933 INFO:tasks.workunit.client.1.smithi069.stdout:5/532: write d13/f8b [616468,74567] 0 2024-04-25T17:19:16.942 INFO:tasks.workunit.client.1.smithi069.stdout:0/438: rename d0/da/d54/d7d/d94 to d0/da/d24/d67/d9d 0 2024-04-25T17:19:16.943 INFO:tasks.workunit.client.0.smithi037.stdout:0/674: dread d9/f73 [0,4194304] 0 2024-04-25T17:19:16.944 INFO:tasks.workunit.client.1.smithi069.stdout:7/532: symlink d4/d6/d14/d5a/lb0 0 2024-04-25T17:19:16.948 INFO:tasks.workunit.client.1.smithi069.stdout:3/586: readlink d8/d71/d8d/d92/l9a 0 2024-04-25T17:19:16.951 INFO:tasks.workunit.client.0.smithi037.stdout:4/841: creat d7/d7e/d1e/d70/d84/f115 x:0 0 0 2024-04-25T17:19:16.951 INFO:tasks.workunit.client.1.smithi069.stdout:2/499: creat d0/d56/f9d x:0 0 0 2024-04-25T17:19:16.953 INFO:tasks.workunit.client.1.smithi069.stdout:4/497: mkdir db/db0 0 2024-04-25T17:19:16.954 INFO:tasks.workunit.client.0.smithi037.stdout:1/709: symlink dc/d52/d6b/dd9/d22/d36/d74/daf/ddd/lf7 0 2024-04-25T17:19:16.956 INFO:tasks.workunit.client.1.smithi069.stdout:1/519: symlink d1/d19/d7c/d1d/l9a 0 2024-04-25T17:19:16.957 INFO:tasks.workunit.client.0.smithi037.stdout:1/710: truncate dc/d52/d6b/dd9/d4d/d6a/d86/d9b/fe7 514613 0 2024-04-25T17:19:16.959 INFO:tasks.workunit.client.1.smithi069.stdout:5/533: rename fd to d13/d17/d19/d1c/da4/da9/fb9 0 2024-04-25T17:19:16.960 INFO:tasks.workunit.client.0.smithi037.stdout:3/484: getdents d8/d23/d3a/d63/d86 0 2024-04-25T17:19:16.962 INFO:tasks.workunit.client.0.smithi037.stdout:0/675: creat d9/df/dbd/dc1/fde x:0 0 0 2024-04-25T17:19:16.963 INFO:tasks.workunit.client.1.smithi069.stdout:6/473: creat d2/d1e/d3f/d86/da8/fa9 x:0 0 0 2024-04-25T17:19:16.963 INFO:tasks.workunit.client.1.smithi069.stdout:6/474: dread - d2/d1e/d3e/d67/d8d/fa0 zero size 2024-04-25T17:19:16.966 INFO:tasks.workunit.client.1.smithi069.stdout:4/498: truncate db/d15/d20/d35/d63/d75/f9b 667340 0 2024-04-25T17:19:16.967 INFO:tasks.workunit.client.0.smithi037.stdout:4/842: creat d7/d78/f116 x:0 0 0 2024-04-25T17:19:16.967 INFO:tasks.workunit.client.1.smithi069.stdout:4/499: write db/d4b/d78/f8b [28867,8558] 0 2024-04-25T17:19:16.969 INFO:tasks.workunit.client.1.smithi069.stdout:4/500: chown db/d15/d20/d35/d63/d70/f74 6 1 2024-04-25T17:19:16.969 INFO:tasks.workunit.client.0.smithi037.stdout:8/577: dwrite d5/db/d18/f86 [0,4194304] 0 2024-04-25T17:19:16.969 INFO:tasks.workunit.client.1.smithi069.stdout:4/501: dread - db/d15/d20/faa zero size 2024-04-25T17:19:16.971 INFO:tasks.workunit.client.0.smithi037.stdout:5/673: rename d7/f1c to d7/d12/d6f/d94/fcc 0 2024-04-25T17:19:16.972 INFO:tasks.workunit.client.1.smithi069.stdout:3/587: rename d8/d16/d9b/cc0 to d8/d71/d8d/d92/db6/dc1/d42/cd3 0 2024-04-25T17:19:16.973 INFO:tasks.workunit.client.1.smithi069.stdout:3/588: write d8/d16/d1a/d2c/d6c/f76 [1106652,79896] 0 2024-04-25T17:19:16.975 INFO:tasks.workunit.client.1.smithi069.stdout:9/502: write d2/da/d14/f37 [804935,100683] 0 2024-04-25T17:19:16.977 INFO:tasks.workunit.client.1.smithi069.stdout:7/533: fsync d4/f58 0 2024-04-25T17:19:16.978 INFO:tasks.workunit.client.0.smithi037.stdout:0/676: creat d9/df/d32/dd1/d7a/daf/fdf x:0 0 0 2024-04-25T17:19:16.978 INFO:tasks.workunit.client.1.smithi069.stdout:5/534: dread d13/d17/d19/f25 [0,4194304] 0 2024-04-25T17:19:16.979 INFO:tasks.workunit.client.1.smithi069.stdout:6/475: creat d2/d51/d85/faa x:0 0 0 2024-04-25T17:19:16.980 INFO:tasks.workunit.client.0.smithi037.stdout:2/673: write d0/d16/d20/f3d [170310,18994] 0 2024-04-25T17:19:16.981 INFO:tasks.workunit.client.0.smithi037.stdout:2/674: chown d0/l76 345479811 1 2024-04-25T17:19:16.984 INFO:tasks.workunit.client.1.smithi069.stdout:1/520: truncate d1/d43/f8a 768308 0 2024-04-25T17:19:16.986 INFO:tasks.workunit.client.1.smithi069.stdout:1/521: read d1/d19/d7c/f53 [304279,110497] 0 2024-04-25T17:19:16.986 INFO:tasks.workunit.client.0.smithi037.stdout:8/578: unlink d5/db/f1f 0 2024-04-25T17:19:16.986 INFO:tasks.workunit.client.1.smithi069.stdout:1/522: write d1/d4/f4c [740111,24165] 0 2024-04-25T17:19:16.987 INFO:tasks.workunit.client.0.smithi037.stdout:8/579: chown d5/db/da2 428 1 2024-04-25T17:19:16.988 INFO:tasks.workunit.client.0.smithi037.stdout:6/580: write db/d1d/d20/d2f/f6e [339978,78503] 0 2024-04-25T17:19:16.990 INFO:tasks.workunit.client.0.smithi037.stdout:9/810: rename d1/d5/dc/fa5 to d1/d5/d2e/d34/d76/db4/f10a 0 2024-04-25T17:19:16.991 INFO:tasks.workunit.client.0.smithi037.stdout:7/590: write d5/d15/d17/d1b/da2/d76/f8a [337609,79247] 0 2024-04-25T17:19:16.992 INFO:tasks.workunit.client.0.smithi037.stdout:5/674: mknod d7/d25/d4f/ccd 0 2024-04-25T17:19:16.994 INFO:tasks.workunit.client.0.smithi037.stdout:5/675: write d7/d18/f8e [2233707,70789] 0 2024-04-25T17:19:16.997 INFO:tasks.workunit.client.1.smithi069.stdout:5/535: dread d13/d17/f4a [0,4194304] 0 2024-04-25T17:19:16.998 INFO:tasks.workunit.client.0.smithi037.stdout:3/485: fdatasync d8/d23/d72/f96 0 2024-04-25T17:19:17.001 INFO:tasks.workunit.client.0.smithi037.stdout:0/677: mkdir d9/d72/de0 0 2024-04-25T17:19:17.002 INFO:tasks.workunit.client.1.smithi069.stdout:3/589: mknod d8/d16/d1a/d38/cd4 0 2024-04-25T17:19:17.003 INFO:tasks.workunit.client.1.smithi069.stdout:8/505: write ff [686961,121193] 0 2024-04-25T17:19:17.004 INFO:tasks.workunit.client.1.smithi069.stdout:3/590: write d8/d71/d8d/d92/db6/dc1/f7a [1278867,46585] 0 2024-04-25T17:19:17.005 INFO:tasks.workunit.client.1.smithi069.stdout:7/534: read d4/d18/f1f [556809,6839] 0 2024-04-25T17:19:17.006 INFO:tasks.workunit.client.0.smithi037.stdout:3/486: dwrite d8/d23/d3a/d5d/f84 [0,4194304] 0 2024-04-25T17:19:17.006 INFO:tasks.workunit.client.1.smithi069.stdout:7/535: fsync d4/d6/f72 0 2024-04-25T17:19:17.007 INFO:tasks.workunit.client.0.smithi037.stdout:4/843: dread d7/d7e/d5b/dfe/f36 [4194304,4194304] 0 2024-04-25T17:19:17.008 INFO:tasks.workunit.client.1.smithi069.stdout:7/536: chown d4/d6/d14/d15/f90 39 1 2024-04-25T17:19:17.008 INFO:tasks.workunit.client.0.smithi037.stdout:8/580: unlink d5/f9 0 2024-04-25T17:19:17.009 INFO:tasks.workunit.client.1.smithi069.stdout:7/537: chown d4/d1a/l39 13 1 2024-04-25T17:19:17.010 INFO:tasks.workunit.client.1.smithi069.stdout:6/476: symlink d2/d1e/d3e/lab 0 2024-04-25T17:19:17.012 INFO:tasks.workunit.client.1.smithi069.stdout:3/591: dwrite d8/d16/d1a/d2c/d6c/f76 [0,4194304] 0 2024-04-25T17:19:17.012 INFO:tasks.workunit.client.0.smithi037.stdout:6/581: creat db/d26/d2e/d3e/d25/d61/fd0 x:0 0 0 2024-04-25T17:19:17.015 INFO:tasks.workunit.client.0.smithi037.stdout:9/811: rmdir d1/d5/dc/d38 39 2024-04-25T17:19:17.017 INFO:tasks.workunit.client.1.smithi069.stdout:1/523: mkdir d1/d4/d6/d4f/d9b 0 2024-04-25T17:19:17.019 INFO:tasks.workunit.client.0.smithi037.stdout:7/591: mknod d5/d15/d17/d1b/da2/daf/dc8/cd1 0 2024-04-25T17:19:17.022 INFO:tasks.workunit.client.0.smithi037.stdout:6/582: dwrite db/d1d/d20/d2f/f6e [0,4194304] 0 2024-04-25T17:19:17.027 INFO:tasks.workunit.client.0.smithi037.stdout:5/676: dread d7/d25/f65 [0,4194304] 0 2024-04-25T17:19:17.032 INFO:tasks.workunit.client.0.smithi037.stdout:9/812: dread d1/d5/d19/d6e/ff1 [0,4194304] 0 2024-04-25T17:19:17.035 INFO:tasks.workunit.client.1.smithi069.stdout:9/503: dwrite d2/da/dd/f31 [0,4194304] 0 2024-04-25T17:19:17.035 INFO:tasks.workunit.client.1.smithi069.stdout:7/538: readlink d4/d4c/la0 0 2024-04-25T17:19:17.036 INFO:tasks.workunit.client.0.smithi037.stdout:1/711: dwrite dc/d18/d64/f68 [0,4194304] 0 2024-04-25T17:19:17.036 INFO:tasks.workunit.client.1.smithi069.stdout:6/477: dread d2/d7/fc [0,4194304] 0 2024-04-25T17:19:17.037 INFO:tasks.workunit.client.0.smithi037.stdout:1/712: chown dc/d52/fb2 17360391 1 2024-04-25T17:19:17.052 INFO:tasks.workunit.client.1.smithi069.stdout:8/506: symlink d37/la7 0 2024-04-25T17:19:17.055 INFO:tasks.workunit.client.0.smithi037.stdout:6/583: fdatasync db/d1d/f1f 0 2024-04-25T17:19:17.060 INFO:tasks.workunit.client.1.smithi069.stdout:6/478: symlink d2/d51/d85/lac 0 2024-04-25T17:19:17.061 INFO:tasks.workunit.client.1.smithi069.stdout:6/479: truncate d2/fa3 811825 0 2024-04-25T17:19:17.062 INFO:tasks.workunit.client.0.smithi037.stdout:2/675: creat d0/d23/fdb x:0 0 0 2024-04-25T17:19:17.064 INFO:tasks.workunit.client.0.smithi037.stdout:1/713: symlink dc/d52/d6b/dd9/d22/d36/d92/db8/dbc/lf8 0 2024-04-25T17:19:17.065 INFO:tasks.workunit.client.1.smithi069.stdout:8/507: rmdir d37/d47/d78 39 2024-04-25T17:19:17.069 INFO:tasks.workunit.client.1.smithi069.stdout:6/480: mkdir d2/d9c/d97/dad 0 2024-04-25T17:19:17.070 INFO:tasks.workunit.client.1.smithi069.stdout:4/502: link db/d15/d20/d35/d63/l85 db/d15/d20/d35/d63/lb1 0 2024-04-25T17:19:17.071 INFO:tasks.workunit.client.1.smithi069.stdout:8/508: mknod d37/d66/d6b/ca8 0 2024-04-25T17:19:17.072 INFO:tasks.workunit.client.1.smithi069.stdout:7/539: creat d4/fb1 x:0 0 0 2024-04-25T17:19:17.075 INFO:tasks.workunit.client.1.smithi069.stdout:1/524: getdents d1/d19 0 2024-04-25T17:19:17.076 INFO:tasks.workunit.client.1.smithi069.stdout:3/592: rmdir d8 39 2024-04-25T17:19:17.076 INFO:tasks.workunit.client.1.smithi069.stdout:1/525: dread - d1/d4/de/f91 zero size 2024-04-25T17:19:17.078 INFO:tasks.workunit.client.1.smithi069.stdout:6/481: rmdir d2/d7 39 2024-04-25T17:19:17.079 INFO:tasks.workunit.client.1.smithi069.stdout:6/482: dread - d2/d1e/d3f/d56/d7e/fa7 zero size 2024-04-25T17:19:17.081 INFO:tasks.workunit.client.1.smithi069.stdout:4/503: mknod db/d15/d20/d35/d63/d43/d48/d49/d72/d84/cb2 0 2024-04-25T17:19:17.082 INFO:tasks.workunit.client.1.smithi069.stdout:4/504: chown db/d15/f37 0 1 2024-04-25T17:19:17.082 INFO:tasks.workunit.client.1.smithi069.stdout:0/439: sync 2024-04-25T17:19:17.084 INFO:tasks.workunit.client.1.smithi069.stdout:0/440: read d0/da/db/d3a/f5a [862737,8642] 0 2024-04-25T17:19:17.085 INFO:tasks.workunit.client.1.smithi069.stdout:6/483: dwrite d2/d1e/d3f/d86/da8/fa9 [0,4194304] 0 2024-04-25T17:19:17.085 INFO:tasks.workunit.client.1.smithi069.stdout:7/540: mknod d4/d3e/d94/cb2 0 2024-04-25T17:19:17.090 INFO:tasks.workunit.client.0.smithi037.stdout:6/584: rename db/d26/l5e to db/d1d/ld1 0 2024-04-25T17:19:17.092 INFO:tasks.workunit.client.1.smithi069.stdout:8/509: dwrite d37/d47/d78/f84 [0,4194304] 0 2024-04-25T17:19:17.094 INFO:tasks.workunit.client.1.smithi069.stdout:7/541: dwrite d4/d6/d14/d44/f8b [0,4194304] 0 2024-04-25T17:19:17.095 INFO:tasks.workunit.client.1.smithi069.stdout:7/542: truncate d4/d83/f8f 609916 0 2024-04-25T17:19:17.099 INFO:tasks.workunit.client.0.smithi037.stdout:4/844: dwrite d7/d7e/d5b/dfe/d39/d83/f9a [0,4194304] 0 2024-04-25T17:19:17.100 INFO:tasks.workunit.client.0.smithi037.stdout:2/676: mknod d0/d16/d3b/dca/cdc 0 2024-04-25T17:19:17.102 INFO:tasks.workunit.client.0.smithi037.stdout:2/677: write d0/d16/d20/d59/fc9 [576942,35963] 0 2024-04-25T17:19:17.106 INFO:tasks.workunit.client.0.smithi037.stdout:6/585: fsync db/d26/f27 0 2024-04-25T17:19:17.106 INFO:tasks.workunit.client.0.smithi037.stdout:7/592: write d5/d15/f89 [662368,28103] 0 2024-04-25T17:19:17.106 INFO:tasks.workunit.client.0.smithi037.stdout:2/678: truncate d0/d16/d20/d59/d6a/f8c 1012974 0 2024-04-25T17:19:17.108 INFO:tasks.workunit.client.1.smithi069.stdout:6/484: symlink d2/d9c/d97/lae 0 2024-04-25T17:19:17.108 INFO:tasks.workunit.client.1.smithi069.stdout:9/504: write d2/da/d5f/f86 [914036,31881] 0 2024-04-25T17:19:17.109 INFO:tasks.workunit.client.0.smithi037.stdout:9/813: link d1/d48/d68/f74 d1/d5/dc/dfa/f10b 0 2024-04-25T17:19:17.110 INFO:tasks.workunit.client.1.smithi069.stdout:3/593: fdatasync d8/d71/f86 0 2024-04-25T17:19:17.111 INFO:tasks.workunit.client.1.smithi069.stdout:7/543: dread d4/f58 [0,4194304] 0 2024-04-25T17:19:17.113 INFO:tasks.workunit.client.1.smithi069.stdout:7/544: chown d4/d6/d14/d5a 194222 1 2024-04-25T17:19:17.115 INFO:tasks.workunit.client.0.smithi037.stdout:2/679: dwrite d0/d16/d20/d55/f60 [0,4194304] 0 2024-04-25T17:19:17.117 INFO:tasks.workunit.client.0.smithi037.stdout:4/845: mknod d7/d7e/d1e/d70/d84/ddf/c117 0 2024-04-25T17:19:17.118 INFO:tasks.workunit.client.0.smithi037.stdout:8/581: write d5/db/d23/d78/d93/fb9 [804609,42406] 0 2024-04-25T17:19:17.118 INFO:tasks.workunit.client.0.smithi037.stdout:3/487: write d8/d23/d3a/d5d/f2b [798585,79541] 0 2024-04-25T17:19:17.119 INFO:tasks.workunit.client.1.smithi069.stdout:1/526: symlink d1/d43/d1b/d32/d4a/d4b/l9c 0 2024-04-25T17:19:17.122 INFO:tasks.workunit.client.0.smithi037.stdout:6/586: mkdir db/d1d/d20/d2f/dd2 0 2024-04-25T17:19:17.125 INFO:tasks.workunit.client.0.smithi037.stdout:0/678: truncate f2 848806 0 2024-04-25T17:19:17.126 INFO:tasks.workunit.client.1.smithi069.stdout:4/505: symlink db/d15/d20/d35/d63/d43/lb3 0 2024-04-25T17:19:17.128 INFO:tasks.workunit.client.0.smithi037.stdout:9/814: mkdir d1/d5/d19/d10c 0 2024-04-25T17:19:17.129 INFO:tasks.workunit.client.1.smithi069.stdout:5/536: sync 2024-04-25T17:19:17.129 INFO:tasks.workunit.client.1.smithi069.stdout:2/500: sync 2024-04-25T17:19:17.129 INFO:tasks.workunit.client.0.smithi037.stdout:5/677: dwrite d7/d25/d4f/da7/dab/fc3 [0,4194304] 0 2024-04-25T17:19:17.132 INFO:tasks.workunit.client.1.smithi069.stdout:6/485: unlink d2/d1e/l38 0 2024-04-25T17:19:17.135 INFO:tasks.workunit.client.0.smithi037.stdout:3/488: mknod d8/d31/d32/d3e/d7d/c97 0 2024-04-25T17:19:17.136 INFO:tasks.workunit.client.1.smithi069.stdout:9/505: dread d2/da/dd/d1e/d40/f5c [0,4194304] 0 2024-04-25T17:19:17.139 INFO:tasks.workunit.client.1.smithi069.stdout:3/594: mknod d8/d16/d31/cd5 0 2024-04-25T17:19:17.141 INFO:tasks.workunit.client.1.smithi069.stdout:7/545: symlink d4/d83/lb3 0 2024-04-25T17:19:17.142 INFO:tasks.workunit.client.0.smithi037.stdout:1/714: dwrite dc/d52/d6b/dd9/d4d/d6a/dea/fb5 [0,4194304] 0 2024-04-25T17:19:17.144 INFO:tasks.workunit.client.0.smithi037.stdout:1/715: write dc/d18/f21 [530177,108774] 0 2024-04-25T17:19:17.147 INFO:tasks.workunit.client.0.smithi037.stdout:2/680: mknod d0/d16/d20/d59/d6a/dbe/cdd 0 2024-04-25T17:19:17.147 INFO:tasks.workunit.client.0.smithi037.stdout:1/716: stat dc/d52/d6b/dd9/d22/d36/lbf 0 2024-04-25T17:19:17.148 INFO:tasks.workunit.client.0.smithi037.stdout:9/815: write d1/d5/d19/d6e/f8f [2303789,11247] 0 2024-04-25T17:19:17.150 INFO:tasks.workunit.client.1.smithi069.stdout:4/506: rename db/d15/d20/d35/d63/d43/d48/d49/l5b to db/d15/d42/d53/lb4 0 2024-04-25T17:19:17.153 INFO:tasks.workunit.client.1.smithi069.stdout:0/441: creat d0/da/db/f9e x:0 0 0 2024-04-25T17:19:17.154 INFO:tasks.workunit.client.1.smithi069.stdout:0/442: truncate d0/da/db/f9e 684569 0 2024-04-25T17:19:17.154 INFO:tasks.workunit.client.1.smithi069.stdout:0/443: chown d0/f1 5971182 1 2024-04-25T17:19:17.155 INFO:tasks.workunit.client.0.smithi037.stdout:4/846: rename d7/d8a to d7/d67/d118 0 2024-04-25T17:19:17.156 INFO:tasks.workunit.client.0.smithi037.stdout:4/847: chown d7/d7e/d1e/dae 35606 1 2024-04-25T17:19:17.156 INFO:tasks.workunit.client.1.smithi069.stdout:6/486: rmdir d2/d1e/d3f/d56 39 2024-04-25T17:19:17.157 INFO:tasks.workunit.client.1.smithi069.stdout:6/487: dread - d2/d1e/d43/d7d/f8a zero size 2024-04-25T17:19:17.157 INFO:tasks.workunit.client.0.smithi037.stdout:3/489: creat d8/d31/d32/d87/f98 x:0 0 0 2024-04-25T17:19:17.158 INFO:tasks.workunit.client.0.smithi037.stdout:3/490: chown d8/d31/d32/d3e/d7d 295470048 1 2024-04-25T17:19:17.159 INFO:tasks.workunit.client.1.smithi069.stdout:9/506: mkdir d2/da/d14/d23/d65/d88/db6 0 2024-04-25T17:19:17.159 INFO:tasks.workunit.client.0.smithi037.stdout:7/593: dread d5/d15/f19 [0,4194304] 0 2024-04-25T17:19:17.163 INFO:tasks.workunit.client.1.smithi069.stdout:3/595: unlink d8/d16/d1a/d2c/d49/fa2 0 2024-04-25T17:19:17.165 INFO:tasks.workunit.client.0.smithi037.stdout:0/679: link d9/d14/d28/d48/f49 d9/df/dbd/fe1 0 2024-04-25T17:19:17.166 INFO:tasks.workunit.client.0.smithi037.stdout:0/680: fdatasync d9/df/d32/d39/f63 0 2024-04-25T17:19:17.167 INFO:tasks.workunit.client.1.smithi069.stdout:1/527: creat d1/df/d17/f9d x:0 0 0 2024-04-25T17:19:17.170 INFO:tasks.workunit.client.0.smithi037.stdout:2/681: creat d0/d16/d26/fde x:0 0 0 2024-04-25T17:19:17.172 INFO:tasks.workunit.client.0.smithi037.stdout:8/582: dwrite d5/db/d59/f88 [0,4194304] 0 2024-04-25T17:19:17.173 INFO:tasks.workunit.client.1.smithi069.stdout:5/537: rename d13/d17/d19/d8a/f6f to d13/d17/d19/d1c/da4/da9/daa/fba 0 2024-04-25T17:19:17.174 INFO:tasks.workunit.client.0.smithi037.stdout:1/717: write dc/d18/f1b [2098183,49251] 0 2024-04-25T17:19:17.175 INFO:tasks.workunit.client.1.smithi069.stdout:4/507: creat db/d15/d26/fb5 x:0 0 0 2024-04-25T17:19:17.176 INFO:tasks.workunit.client.0.smithi037.stdout:9/816: creat d1/d5/dc/d3c/dca/df5/f10d x:0 0 0 2024-04-25T17:19:17.176 INFO:tasks.workunit.client.0.smithi037.stdout:1/718: write dc/d52/d6b/dd9/d4d/d6a/d86/d91/fec [105926,62657] 0 2024-04-25T17:19:17.180 INFO:tasks.workunit.client.1.smithi069.stdout:6/488: truncate d2/d9c/d48/f5d 528713 0 2024-04-25T17:19:17.180 INFO:tasks.workunit.client.1.smithi069.stdout:6/489: chown d2 18 1 2024-04-25T17:19:17.181 INFO:tasks.workunit.client.1.smithi069.stdout:5/538: dwrite d13/d17/d19/d1c/f89 [0,4194304] 0 2024-04-25T17:19:17.182 INFO:tasks.workunit.client.1.smithi069.stdout:9/507: mknod d2/d51/cb7 0 2024-04-25T17:19:17.183 INFO:tasks.workunit.client.1.smithi069.stdout:8/510: dwrite d37/f45 [0,4194304] 0 2024-04-25T17:19:17.185 INFO:tasks.workunit.client.0.smithi037.stdout:5/678: dwrite d7/f5c [0,4194304] 0 2024-04-25T17:19:17.187 INFO:tasks.workunit.client.0.smithi037.stdout:5/679: write d7/d18/d62/f6a [572767,56469] 0 2024-04-25T17:19:17.201 INFO:tasks.workunit.client.0.smithi037.stdout:0/681: unlink d9/df/d32/f60 0 2024-04-25T17:19:17.204 INFO:tasks.workunit.client.0.smithi037.stdout:2/682: creat d0/d16/d20/d55/fdf x:0 0 0 2024-04-25T17:19:17.206 INFO:tasks.workunit.client.0.smithi037.stdout:9/817: dread d1/d5/dc/d3c/f9d [0,4194304] 0 2024-04-25T17:19:17.211 INFO:tasks.workunit.client.1.smithi069.stdout:3/596: write d8/d2a/f72 [2920742,93518] 0 2024-04-25T17:19:17.212 INFO:tasks.workunit.client.1.smithi069.stdout:3/597: chown d8/d16/d1a/d38/f83 1 1 2024-04-25T17:19:17.212 INFO:tasks.workunit.client.0.smithi037.stdout:4/848: symlink d7/d7e/d5b/dfe/d39/d9c/d103/l119 0 2024-04-25T17:19:17.214 INFO:tasks.workunit.client.0.smithi037.stdout:8/583: dread d5/da/fb4 [4194304,4194304] 0 2024-04-25T17:19:17.215 INFO:tasks.workunit.client.1.smithi069.stdout:7/546: truncate d4/d6/d14/d44/f8b 3363478 0 2024-04-25T17:19:17.216 INFO:tasks.workunit.client.1.smithi069.stdout:7/547: write d4/d1a/f24 [3691765,62881] 0 2024-04-25T17:19:17.219 INFO:tasks.workunit.client.1.smithi069.stdout:5/539: creat d13/d17/fbb x:0 0 0 2024-04-25T17:19:17.221 INFO:tasks.workunit.client.0.smithi037.stdout:3/491: rename d8/d23/c2a to d8/d23/d38/d66/c99 0 2024-04-25T17:19:17.221 INFO:tasks.workunit.client.1.smithi069.stdout:8/511: rmdir d37 39 2024-04-25T17:19:17.222 INFO:tasks.workunit.client.0.smithi037.stdout:3/492: dread - d8/d31/d32/d87/f89 zero size 2024-04-25T17:19:17.225 INFO:tasks.workunit.client.1.smithi069.stdout:4/508: dwrite f8 [0,4194304] 0 2024-04-25T17:19:17.226 INFO:tasks.workunit.client.1.smithi069.stdout:4/509: chown db/d15/d20/d35/d63/d43/d48/d49/d72 3569260 1 2024-04-25T17:19:17.254 INFO:tasks.workunit.client.1.smithi069.stdout:9/508: truncate d2/da/d14/d23/f55 3654055 0 2024-04-25T17:19:17.255 INFO:tasks.workunit.client.0.smithi037.stdout:6/587: link db/d1d/d20/f5b db/fd3 0 2024-04-25T17:19:17.256 INFO:tasks.workunit.client.0.smithi037.stdout:0/682: truncate d9/d72/f9f 1014484 0 2024-04-25T17:19:17.256 INFO:tasks.workunit.client.0.smithi037.stdout:6/588: truncate db/d1d/d20/d2f/fcd 425766 0 2024-04-25T17:19:17.257 INFO:tasks.workunit.client.0.smithi037.stdout:6/589: dread - db/d26/d2e/d3e/fb6 zero size 2024-04-25T17:19:17.264 INFO:tasks.workunit.client.1.smithi069.stdout:3/598: dread d8/d71/d8d/d92/db6/dc1/f6f [0,4194304] 0 2024-04-25T17:19:17.264 INFO:tasks.workunit.client.0.smithi037.stdout:6/590: dwrite db/d26/d2e/d3e/fb9 [0,4194304] 0 2024-04-25T17:19:17.266 INFO:tasks.workunit.client.0.smithi037.stdout:4/849: symlink d7/d7e/d1e/d70/d84/ddf/df0/l11a 0 2024-04-25T17:19:17.267 INFO:tasks.workunit.client.0.smithi037.stdout:4/850: fsync d7/d7e/d5b/dfe/d39/d7a/ffc 0 2024-04-25T17:19:17.268 INFO:tasks.workunit.client.1.smithi069.stdout:0/444: rmdir d0/da/d24/d67/d9d 0 2024-04-25T17:19:17.269 INFO:tasks.workunit.client.0.smithi037.stdout:8/584: symlink d5/db/d23/d58/lc2 0 2024-04-25T17:19:17.272 INFO:tasks.workunit.client.0.smithi037.stdout:1/719: rename dc/d52/d6b/dd9/d43 to dc/d24/da5/df9 0 2024-04-25T17:19:17.275 INFO:tasks.workunit.client.0.smithi037.stdout:3/493: symlink d8/d23/d38/l9a 0 2024-04-25T17:19:17.277 INFO:tasks.workunit.client.0.smithi037.stdout:9/818: dwrite d1/d48/d68/d26/d81/d9c/fd0 [0,4194304] 0 2024-04-25T17:19:17.278 INFO:tasks.workunit.client.0.smithi037.stdout:9/819: stat d1/d5/d2e/d34 0 2024-04-25T17:19:17.279 INFO:tasks.workunit.client.0.smithi037.stdout:7/594: rename d5/d15/d17/d25/d2b/f51 to d5/d15/d17/d25/d2b/fd2 0 2024-04-25T17:19:17.282 INFO:tasks.workunit.client.0.smithi037.stdout:0/683: mkdir d9/df/dbd/dc1/de2 0 2024-04-25T17:19:17.283 INFO:tasks.workunit.client.0.smithi037.stdout:0/684: chown d9/df/d32/d35/c7b 23810250 1 2024-04-25T17:19:17.286 INFO:tasks.workunit.client.0.smithi037.stdout:6/591: truncate db/d26/fa5 832045 0 2024-04-25T17:19:17.286 INFO:tasks.workunit.client.1.smithi069.stdout:7/548: write d4/f58 [654068,122025] 0 2024-04-25T17:19:17.288 INFO:tasks.workunit.client.0.smithi037.stdout:4/851: mkdir d7/d7e/d4e/da5/d11b 0 2024-04-25T17:19:17.288 INFO:tasks.workunit.client.1.smithi069.stdout:7/549: write d4/d1a/d34/f65 [3506058,6375] 0 2024-04-25T17:19:17.289 INFO:tasks.workunit.client.1.smithi069.stdout:8/512: dwrite d37/d47/d78/d93/f94 [0,4194304] 0 2024-04-25T17:19:17.289 INFO:tasks.workunit.client.1.smithi069.stdout:2/501: sync 2024-04-25T17:19:17.289 INFO:tasks.workunit.client.1.smithi069.stdout:6/490: sync 2024-04-25T17:19:17.289 INFO:tasks.workunit.client.1.smithi069.stdout:3/599: creat d8/d16/d1a/d99/fd6 x:0 0 0 2024-04-25T17:19:17.290 INFO:tasks.workunit.client.1.smithi069.stdout:6/491: chown d2/d1e/d43 15591781 1 2024-04-25T17:19:17.290 INFO:tasks.workunit.client.1.smithi069.stdout:6/492: chown d2/d9c 1844881405 1 2024-04-25T17:19:17.291 INFO:tasks.workunit.client.0.smithi037.stdout:8/585: truncate d5/db/d18/f19 3273620 0 2024-04-25T17:19:17.291 INFO:tasks.workunit.client.0.smithi037.stdout:8/586: dread - d5/db/f68 zero size 2024-04-25T17:19:17.294 INFO:tasks.workunit.client.1.smithi069.stdout:5/540: unlink d13/d17/d19/d20/f22 0 2024-04-25T17:19:17.294 INFO:tasks.workunit.client.1.smithi069.stdout:6/493: read d2/d1e/f33 [3695813,82096] 0 2024-04-25T17:19:17.299 INFO:tasks.workunit.client.0.smithi037.stdout:3/494: dread d8/f58 [0,4194304] 0 2024-04-25T17:19:17.300 INFO:tasks.workunit.client.1.smithi069.stdout:9/509: mknod d2/cb8 0 2024-04-25T17:19:17.302 INFO:tasks.workunit.client.1.smithi069.stdout:1/528: getdents d1/d19/d38 0 2024-04-25T17:19:17.303 INFO:tasks.workunit.client.1.smithi069.stdout:1/529: readlink d1/d4/d6/d81/l93 0 2024-04-25T17:19:17.303 INFO:tasks.workunit.client.0.smithi037.stdout:6/592: creat db/d26/d2e/d7d/d65/d68/d87/dbd/fd4 x:0 0 0 2024-04-25T17:19:17.306 INFO:tasks.workunit.client.1.smithi069.stdout:7/550: chown d4/d3e/l77 13571 1 2024-04-25T17:19:17.307 INFO:tasks.workunit.client.1.smithi069.stdout:7/551: read d4/d6/d14/d5a/d5e/f7a [687308,64266] 0 2024-04-25T17:19:17.307 INFO:tasks.workunit.client.1.smithi069.stdout:1/530: dread d1/d43/d1b/d32/d4a/f58 [0,4194304] 0 2024-04-25T17:19:17.309 INFO:tasks.workunit.client.0.smithi037.stdout:5/680: rename d7/fc to d7/d12/d5d/d90/db1/fce 0 2024-04-25T17:19:17.310 INFO:tasks.workunit.client.0.smithi037.stdout:4/852: dread d7/d7e/d4e/da5/fa8 [0,4194304] 0 2024-04-25T17:19:17.311 INFO:tasks.workunit.client.1.smithi069.stdout:8/513: creat d37/d66/fa9 x:0 0 0 2024-04-25T17:19:17.312 INFO:tasks.workunit.client.1.smithi069.stdout:8/514: chown d37/d47/d48 931 1 2024-04-25T17:19:17.313 INFO:tasks.workunit.client.0.smithi037.stdout:1/720: dread dc/d52/d6b/dd9/d22/d36/f54 [0,4194304] 0 2024-04-25T17:19:17.313 INFO:tasks.workunit.client.0.smithi037.stdout:6/593: dwrite db/d26/d2e/d7d/d65/d68/d87/dbd/fc4 [0,4194304] 0 2024-04-25T17:19:17.313 INFO:tasks.workunit.client.1.smithi069.stdout:7/552: dwrite d4/d6/f72 [0,4194304] 0 2024-04-25T17:19:17.319 INFO:tasks.workunit.client.1.smithi069.stdout:0/445: mknod d0/d38/d75/c9f 0 2024-04-25T17:19:17.319 INFO:tasks.workunit.client.1.smithi069.stdout:8/515: dwrite fb [0,4194304] 0 2024-04-25T17:19:17.323 INFO:tasks.workunit.client.1.smithi069.stdout:3/600: mkdir d8/d16/d1a/d2c/d49/d87/d8a/dd7 0 2024-04-25T17:19:17.327 INFO:tasks.workunit.client.1.smithi069.stdout:2/502: rename d0/d26/d10/l37 to d0/d56/d5f/d62/d7d/d72/l9e 0 2024-04-25T17:19:17.329 INFO:tasks.workunit.client.0.smithi037.stdout:7/595: mkdir d5/d14/dd3 0 2024-04-25T17:19:17.330 INFO:tasks.workunit.client.0.smithi037.stdout:7/596: chown d5/d15/l56 14987 1 2024-04-25T17:19:17.332 INFO:tasks.workunit.client.0.smithi037.stdout:0/685: symlink d9/le3 0 2024-04-25T17:19:17.332 INFO:tasks.workunit.client.0.smithi037.stdout:8/587: write d5/db/d59/f5f [668614,121023] 0 2024-04-25T17:19:17.333 INFO:tasks.workunit.client.1.smithi069.stdout:5/541: mkdir d13/d17/d19/d8a/dbc 0 2024-04-25T17:19:17.335 INFO:tasks.workunit.client.1.smithi069.stdout:6/494: mkdir d2/d9c/d48/d73/daf 0 2024-04-25T17:19:17.337 INFO:tasks.workunit.client.1.smithi069.stdout:9/510: chown d2/da/d14/d23/f55 418587 1 2024-04-25T17:19:17.338 INFO:tasks.workunit.client.0.smithi037.stdout:6/594: dread db/d1d/d20/f5b [0,4194304] 0 2024-04-25T17:19:17.338 INFO:tasks.workunit.client.1.smithi069.stdout:9/511: write d2/da/dd/de/f4a [2466846,111125] 0 2024-04-25T17:19:17.340 INFO:tasks.workunit.client.0.smithi037.stdout:1/721: unlink dc/d52/d6b/dd9/d22/d36/cdb 0 2024-04-25T17:19:17.341 INFO:tasks.workunit.client.1.smithi069.stdout:7/553: unlink d4/d3e/l77 0 2024-04-25T17:19:17.343 INFO:tasks.workunit.client.0.smithi037.stdout:9/820: rmdir d1/d5/d19/d10c 0 2024-04-25T17:19:17.345 INFO:tasks.workunit.client.1.smithi069.stdout:0/446: rmdir d0/da/db/d2a 39 2024-04-25T17:19:17.346 INFO:tasks.workunit.client.1.smithi069.stdout:0/447: fdatasync d0/da/db/f4e 0 2024-04-25T17:19:17.347 INFO:tasks.workunit.client.0.smithi037.stdout:8/588: symlink d5/db/d59/lc3 0 2024-04-25T17:19:17.348 INFO:tasks.workunit.client.1.smithi069.stdout:3/601: rmdir d8/d16/d1a/d2c/d49/d59 39 2024-04-25T17:19:17.349 INFO:tasks.workunit.client.0.smithi037.stdout:3/495: dread d8/d23/f91 [0,4194304] 0 2024-04-25T17:19:17.351 INFO:tasks.workunit.client.1.smithi069.stdout:1/531: rename d1/df/d6c to d1/d4/d6/d9e 0 2024-04-25T17:19:17.354 INFO:tasks.workunit.client.1.smithi069.stdout:4/510: link db/d15/d20/d38/c58 db/d15/d20/cb6 0 2024-04-25T17:19:17.355 INFO:tasks.workunit.client.0.smithi037.stdout:0/686: dread d9/d14/d28/d48/f50 [0,4194304] 0 2024-04-25T17:19:17.355 INFO:tasks.workunit.client.1.smithi069.stdout:4/511: stat db/d22/d24/l4d 0 2024-04-25T17:19:17.355 INFO:tasks.workunit.client.0.smithi037.stdout:9/821: symlink d1/d48/l10e 0 2024-04-25T17:19:17.361 INFO:tasks.workunit.client.1.smithi069.stdout:7/554: mknod d4/d6/d14/d44/d79/da4/cb4 0 2024-04-25T17:19:17.361 INFO:tasks.workunit.client.0.smithi037.stdout:5/681: creat d7/d12/d6f/fcf x:0 0 0 2024-04-25T17:19:17.364 INFO:tasks.workunit.client.0.smithi037.stdout:3/496: creat d8/d31/d32/d3e/f9b x:0 0 0 2024-04-25T17:19:17.366 INFO:tasks.workunit.client.0.smithi037.stdout:6/595: mkdir db/d1d/d20/dcf/dd5 0 2024-04-25T17:19:17.367 INFO:tasks.workunit.client.1.smithi069.stdout:8/516: mknod d37/d47/d54/d6e/d9e/caa 0 2024-04-25T17:19:17.367 INFO:tasks.workunit.client.0.smithi037.stdout:6/596: chown db/d26/d2e/d3e/d25/d61 907 1 2024-04-25T17:19:17.369 INFO:tasks.workunit.client.0.smithi037.stdout:1/722: write dc/f15 [252068,39178] 0 2024-04-25T17:19:17.373 INFO:tasks.workunit.client.0.smithi037.stdout:8/589: symlink d5/dbc/lc4 0 2024-04-25T17:19:17.378 INFO:tasks.workunit.client.0.smithi037.stdout:1/723: dwrite dc/d52/d6b/dd9/d4d/d6a/d86/d91/fec [0,4194304] 0 2024-04-25T17:19:17.379 INFO:tasks.workunit.client.0.smithi037.stdout:3/497: rmdir d8/d23 39 2024-04-25T17:19:17.379 INFO:tasks.workunit.client.0.smithi037.stdout:7/597: dwrite d5/f43 [0,4194304] 0 2024-04-25T17:19:17.382 INFO:tasks.workunit.client.0.smithi037.stdout:1/724: write dc/d24/f45 [2129978,87289] 0 2024-04-25T17:19:17.383 INFO:tasks.workunit.client.0.smithi037.stdout:9/822: mkdir d1/d5/dc/d38/d8b/d10f 0 2024-04-25T17:19:17.384 INFO:tasks.workunit.client.0.smithi037.stdout:1/725: chown dc/d52/d6b/dd9/d4d/lac 821 1 2024-04-25T17:19:17.386 INFO:tasks.workunit.client.1.smithi069.stdout:8/517: write f13 [1111082,116786] 0 2024-04-25T17:19:17.388 INFO:tasks.workunit.client.1.smithi069.stdout:8/518: rename d37 to d37/d47/d54/d6e/d9e/dab 22 2024-04-25T17:19:17.389 INFO:tasks.workunit.client.1.smithi069.stdout:0/448: write d0/f2f [2782479,72353] 0 2024-04-25T17:19:17.389 INFO:tasks.workunit.client.0.smithi037.stdout:8/590: mknod d5/db/d23/d42/cc5 0 2024-04-25T17:19:17.390 INFO:tasks.workunit.client.1.smithi069.stdout:0/449: readlink d0/l12 0 2024-04-25T17:19:17.390 INFO:tasks.workunit.client.0.smithi037.stdout:1/726: read fa [633351,82547] 0 2024-04-25T17:19:17.390 INFO:tasks.workunit.client.1.smithi069.stdout:8/519: dread - d37/d62/f8f zero size 2024-04-25T17:19:17.390 INFO:tasks.workunit.client.0.smithi037.stdout:1/727: read dc/f10 [63437,54741] 0 2024-04-25T17:19:17.394 INFO:tasks.workunit.client.1.smithi069.stdout:1/532: dwrite d1/f28 [0,4194304] 0 2024-04-25T17:19:17.396 INFO:tasks.workunit.client.0.smithi037.stdout:8/591: symlink d5/d26/d81/lc6 0 2024-04-25T17:19:17.397 INFO:tasks.workunit.client.1.smithi069.stdout:9/512: getdents d2/da/d5f/d76 0 2024-04-25T17:19:17.398 INFO:tasks.workunit.client.0.smithi037.stdout:1/728: symlink dc/d52/d6b/dd9/d4d/d6a/d8f/lfa 0 2024-04-25T17:19:17.401 INFO:tasks.workunit.client.0.smithi037.stdout:1/729: stat dc/d52/d6b/dd9/d22/d36/d92/db8 0 2024-04-25T17:19:17.401 INFO:tasks.workunit.client.1.smithi069.stdout:0/450: rename d0/f4 to d0/da/db/d1d/d5f/fa0 0 2024-04-25T17:19:17.402 INFO:tasks.workunit.client.1.smithi069.stdout:0/451: readlink d0/da/db/d56/l66 0 2024-04-25T17:19:17.403 INFO:tasks.workunit.client.1.smithi069.stdout:3/602: write d8/d16/d1a/f5d [733931,106311] 0 2024-04-25T17:19:17.406 INFO:tasks.workunit.client.0.smithi037.stdout:8/592: dwrite d5/db/d18/d3b/d50/f7d [0,4194304] 0 2024-04-25T17:19:17.409 INFO:tasks.workunit.client.1.smithi069.stdout:4/512: write db/d15/d20/d38/f68 [983247,76425] 0 2024-04-25T17:19:17.412 INFO:tasks.workunit.client.0.smithi037.stdout:8/593: chown d5/db/d18/d3b/d50/f94 74 1 2024-04-25T17:19:17.412 INFO:tasks.workunit.client.0.smithi037.stdout:1/730: dwrite dc/d52/d6b/dd9/d22/fa3 [0,4194304] 0 2024-04-25T17:19:17.415 INFO:tasks.workunit.client.0.smithi037.stdout:6/597: truncate db/d26/d2e/d7d/d65/d68/d87/dbd/fc4 1935740 0 2024-04-25T17:19:17.415 INFO:tasks.workunit.client.0.smithi037.stdout:8/594: dread - d5/db/d18/d3b/d75/f9e zero size 2024-04-25T17:19:17.417 INFO:tasks.workunit.client.0.smithi037.stdout:5/682: dwrite d7/d18/f1e [0,4194304] 0 2024-04-25T17:19:17.418 INFO:tasks.workunit.client.1.smithi069.stdout:3/603: chown d8/d16/d1a/c7d 1 1 2024-04-25T17:19:17.422 INFO:tasks.workunit.client.1.smithi069.stdout:6/495: getdents d2/d1e/d3f/d86 0 2024-04-25T17:19:17.425 INFO:tasks.workunit.client.1.smithi069.stdout:9/513: truncate d2/da/dd/de/d59/d7f/f89 2870079 0 2024-04-25T17:19:17.426 INFO:tasks.workunit.client.0.smithi037.stdout:5/683: dread - d7/d12/f60 zero size 2024-04-25T17:19:17.426 INFO:tasks.workunit.client.0.smithi037.stdout:8/595: dwrite d5/db/d18/d3b/fb2 [0,4194304] 0 2024-04-25T17:19:17.428 INFO:tasks.workunit.client.1.smithi069.stdout:3/604: rmdir d8/d16/d1a/d38 39 2024-04-25T17:19:17.428 INFO:tasks.workunit.client.0.smithi037.stdout:9/823: truncate d1/d5/dc/fba 488998 0 2024-04-25T17:19:17.430 INFO:tasks.workunit.client.1.smithi069.stdout:1/533: write d1/d4/de/d44/f69 [849828,20874] 0 2024-04-25T17:19:17.431 INFO:tasks.workunit.client.1.smithi069.stdout:8/520: dread d37/d47/d54/d6e/d9e/fa4 [0,4194304] 0 2024-04-25T17:19:17.432 INFO:tasks.workunit.client.1.smithi069.stdout:0/452: dread d0/da/d24/d43/f60 [0,4194304] 0 2024-04-25T17:19:17.432 INFO:tasks.workunit.client.1.smithi069.stdout:4/513: unlink db/d15/d20/d35/d63/d43/d48/d49/d72/d84/cb2 0 2024-04-25T17:19:17.436 INFO:tasks.workunit.client.1.smithi069.stdout:6/496: symlink d2/d1e/d3e/d67/d8d/lb0 0 2024-04-25T17:19:17.437 INFO:tasks.workunit.client.1.smithi069.stdout:9/514: creat d2/da/dd/de/d74/d8a/fb9 x:0 0 0 2024-04-25T17:19:17.438 INFO:tasks.workunit.client.0.smithi037.stdout:8/596: stat d5/db/d23/f4e 0 2024-04-25T17:19:17.441 INFO:tasks.workunit.client.1.smithi069.stdout:8/521: creat d37/d47/d48/d8e/fac x:0 0 0 2024-04-25T17:19:17.443 INFO:tasks.workunit.client.1.smithi069.stdout:1/534: rename d1/d4/f89 to d1/d4/d6/d81/f9f 0 2024-04-25T17:19:17.444 INFO:tasks.workunit.client.0.smithi037.stdout:1/731: truncate dc/d52/d6b/fb3 28293 0 2024-04-25T17:19:17.444 INFO:tasks.workunit.client.1.smithi069.stdout:1/535: fsync d1/d4/d6/d9e/f8d 0 2024-04-25T17:19:17.445 INFO:tasks.workunit.client.1.smithi069.stdout:0/453: mknod d0/da/d54/ca1 0 2024-04-25T17:19:17.446 INFO:tasks.workunit.client.1.smithi069.stdout:4/514: dread f0 [0,4194304] 0 2024-04-25T17:19:17.446 INFO:tasks.workunit.client.0.smithi037.stdout:8/597: dread - d5/db/d7e/f76 zero size 2024-04-25T17:19:17.447 INFO:tasks.workunit.client.1.smithi069.stdout:4/515: chown db/d15/d20/d35/d63/f60 3 1 2024-04-25T17:19:17.448 INFO:tasks.workunit.client.1.smithi069.stdout:9/515: mkdir d2/da/dd/d1e/d2e/d68/dba 0 2024-04-25T17:19:17.449 INFO:tasks.workunit.client.0.smithi037.stdout:5/684: creat d7/d12/da8/fd0 x:0 0 0 2024-04-25T17:19:17.451 INFO:tasks.workunit.client.1.smithi069.stdout:3/605: truncate d8/d2a/f43 20513 0 2024-04-25T17:19:17.453 INFO:tasks.workunit.client.1.smithi069.stdout:5/542: sync 2024-04-25T17:19:17.453 INFO:tasks.workunit.client.1.smithi069.stdout:2/503: sync 2024-04-25T17:19:17.454 INFO:tasks.workunit.client.1.smithi069.stdout:8/522: creat d37/d47/d54/d6e/d98/fad x:0 0 0 2024-04-25T17:19:17.455 INFO:tasks.workunit.client.1.smithi069.stdout:1/536: mknod d1/d43/d1b/d32/d4a/d4b/ca0 0 2024-04-25T17:19:17.456 INFO:tasks.workunit.client.1.smithi069.stdout:8/523: chown d37/d47/d48/f83 332549434 1 2024-04-25T17:19:17.457 INFO:tasks.workunit.client.1.smithi069.stdout:9/516: dwrite d2/da/d14/f37 [0,4194304] 0 2024-04-25T17:19:17.458 INFO:tasks.workunit.client.0.smithi037.stdout:6/598: getdents db/d1d/d20 0 2024-04-25T17:19:17.460 INFO:tasks.workunit.client.1.smithi069.stdout:0/454: symlink d0/da/db/d7e/d80/la2 0 2024-04-25T17:19:17.460 INFO:tasks.workunit.client.0.smithi037.stdout:8/598: creat d5/d26/d81/fc7 x:0 0 0 2024-04-25T17:19:17.462 INFO:tasks.workunit.client.1.smithi069.stdout:4/516: truncate db/d22/d24/d41/f4f 5197258 0 2024-04-25T17:19:17.463 INFO:tasks.workunit.client.1.smithi069.stdout:4/517: write db/d15/d20/d35/d63/d43/d48/d49/f56 [661310,124721] 0 2024-04-25T17:19:17.468 INFO:tasks.workunit.client.1.smithi069.stdout:3/606: chown d8/d16/d1a/d38/f66 16033935 1 2024-04-25T17:19:17.469 INFO:tasks.workunit.client.1.smithi069.stdout:5/543: dread - d13/d17/d29/fb4 zero size 2024-04-25T17:19:17.473 INFO:tasks.workunit.client.1.smithi069.stdout:7/555: sync 2024-04-25T17:19:17.474 INFO:tasks.workunit.client.1.smithi069.stdout:7/556: chown d4/d6/d14/d5a/d5e/d89/c8e 17008 1 2024-04-25T17:19:17.474 INFO:tasks.workunit.client.1.smithi069.stdout:1/537: creat d1/df/d17/fa1 x:0 0 0 2024-04-25T17:19:17.475 INFO:tasks.workunit.client.1.smithi069.stdout:6/497: getdents d2/d8b 0 2024-04-25T17:19:17.476 INFO:tasks.workunit.client.0.smithi037.stdout:1/732: write dc/d52/d6b/dd9/f4f [1679693,120087] 0 2024-04-25T17:19:17.476 INFO:tasks.workunit.client.1.smithi069.stdout:6/498: write d2/d9c/d48/f92 [984453,112441] 0 2024-04-25T17:19:17.478 INFO:tasks.workunit.client.1.smithi069.stdout:8/524: creat d37/d47/d54/fae x:0 0 0 2024-04-25T17:19:17.481 INFO:tasks.workunit.client.0.smithi037.stdout:9/824: getdents d1/d5/d19/d6e 0 2024-04-25T17:19:17.483 INFO:tasks.workunit.client.1.smithi069.stdout:4/518: unlink db/d15/d26/f34 0 2024-04-25T17:19:17.485 INFO:tasks.workunit.client.0.smithi037.stdout:6/599: write db/d1d/d20/f75 [274689,11370] 0 2024-04-25T17:19:17.485 INFO:tasks.workunit.client.1.smithi069.stdout:3/607: chown d8/d39/cae 191535969 1 2024-04-25T17:19:17.489 INFO:tasks.workunit.client.1.smithi069.stdout:5/544: rename d13/d17/d29/d2e/f74 to d13/d17/d29/d2e/d76/fbd 0 2024-04-25T17:19:17.489 INFO:tasks.workunit.client.0.smithi037.stdout:5/685: write d7/fb [71414,48699] 0 2024-04-25T17:19:17.490 INFO:tasks.workunit.client.1.smithi069.stdout:3/608: dwrite d8/d39/f3c [0,4194304] 0 2024-04-25T17:19:17.492 INFO:tasks.workunit.client.1.smithi069.stdout:2/504: unlink d0/d1/d5b/c66 0 2024-04-25T17:19:17.492 INFO:tasks.workunit.client.0.smithi037.stdout:1/733: write dc/d52/d6b/dd9/d4d/d6a/dea/fb4 [485906,124576] 0 2024-04-25T17:19:17.493 INFO:tasks.workunit.client.1.smithi069.stdout:2/505: chown d0/d26/d10/f5c 5634461 1 2024-04-25T17:19:17.494 INFO:tasks.workunit.client.0.smithi037.stdout:8/599: truncate f4 14343 0 2024-04-25T17:19:17.496 INFO:tasks.workunit.client.1.smithi069.stdout:1/538: rmdir d1/d4/d6/d81 39 2024-04-25T17:19:17.497 INFO:tasks.workunit.client.1.smithi069.stdout:6/499: creat d2/d1e/d3f/d86/fb1 x:0 0 0 2024-04-25T17:19:17.497 INFO:tasks.workunit.client.0.smithi037.stdout:6/600: symlink db/d1d/d20/ld6 0 2024-04-25T17:19:17.498 INFO:tasks.workunit.client.1.smithi069.stdout:1/539: chown d1/d4/de/d44/d68 1406021 1 2024-04-25T17:19:17.498 INFO:tasks.workunit.client.1.smithi069.stdout:8/525: mkdir d37/d66/d6b/daf 0 2024-04-25T17:19:17.498 INFO:tasks.workunit.client.1.smithi069.stdout:2/506: readlink d0/d56/d5f/d62/d7d/d72/l8f 0 2024-04-25T17:19:17.499 INFO:tasks.workunit.client.1.smithi069.stdout:9/517: dwrite d2/da/dd/f5d [0,4194304] 0 2024-04-25T17:19:17.499 INFO:tasks.workunit.client.0.smithi037.stdout:5/686: creat d7/d25/d4f/fd1 x:0 0 0 2024-04-25T17:19:17.500 INFO:tasks.workunit.client.1.smithi069.stdout:6/500: stat d2/d1e/d3e/lab 0 2024-04-25T17:19:17.501 INFO:tasks.workunit.client.1.smithi069.stdout:2/507: read d0/d26/d10/d43/f80 [252390,73908] 0 2024-04-25T17:19:17.502 INFO:tasks.workunit.client.0.smithi037.stdout:1/734: creat dc/d52/d6b/dd9/d22/d36/dbe/ffb x:0 0 0 2024-04-25T17:19:17.502 INFO:tasks.workunit.client.1.smithi069.stdout:7/557: dread d4/d6/d14/f48 [0,4194304] 0 2024-04-25T17:19:17.503 INFO:tasks.workunit.client.0.smithi037.stdout:1/735: chown dc/d52/d6b/dd9/d4d/d6a/de3 3229 1 2024-04-25T17:19:17.503 INFO:tasks.workunit.client.1.smithi069.stdout:0/455: symlink d0/da/db/d1d/la3 0 2024-04-25T17:19:17.504 INFO:tasks.workunit.client.0.smithi037.stdout:8/600: write d5/f47 [3514905,95772] 0 2024-04-25T17:19:17.505 INFO:tasks.workunit.client.1.smithi069.stdout:9/518: read d2/da/dd/d1e/d2e/d35/f6c [1949367,10031] 0 2024-04-25T17:19:17.506 INFO:tasks.workunit.client.0.smithi037.stdout:8/601: chown d5/db/d18/f86 4276 1 2024-04-25T17:19:17.506 INFO:tasks.workunit.client.0.smithi037.stdout:9/825: creat d1/d5/d2e/d34/daf/dcb/f110 x:0 0 0 2024-04-25T17:19:17.509 INFO:tasks.workunit.client.0.smithi037.stdout:9/826: read d1/d5/dc/d38/d8b/fd3 [20630,94572] 0 2024-04-25T17:19:17.509 INFO:tasks.workunit.client.1.smithi069.stdout:1/540: dwrite d1/d4/f4c [0,4194304] 0 2024-04-25T17:19:17.511 INFO:tasks.workunit.client.1.smithi069.stdout:9/519: read d2/da/d14/d23/d65/f73 [2936578,48083] 0 2024-04-25T17:19:17.511 INFO:tasks.workunit.client.0.smithi037.stdout:1/736: rename dc/d18/d64/de6 to dc/d52/d6b/dd9/d4d/d6a/d8f/ddc/dee/dfc 0 2024-04-25T17:19:17.512 INFO:tasks.workunit.client.0.smithi037.stdout:1/737: chown dc/d18/f21 763489123 1 2024-04-25T17:19:17.513 INFO:tasks.workunit.client.1.smithi069.stdout:4/519: dread db/f21 [0,4194304] 0 2024-04-25T17:19:17.513 INFO:tasks.workunit.client.1.smithi069.stdout:5/545: creat d13/d17/d29/d30/d9c/fbe x:0 0 0 2024-04-25T17:19:17.514 INFO:tasks.workunit.client.1.smithi069.stdout:0/456: dwrite d0/da/d6e/f84 [0,4194304] 0 2024-04-25T17:19:17.515 INFO:tasks.workunit.client.1.smithi069.stdout:0/457: write d0/da/d54/f5c [642632,24336] 0 2024-04-25T17:19:17.526 INFO:tasks.workunit.client.0.smithi037.stdout:9/827: creat d1/d5/d19/dde/f111 x:0 0 0 2024-04-25T17:19:17.530 INFO:tasks.workunit.client.1.smithi069.stdout:8/526: mknod d37/d66/cb0 0 2024-04-25T17:19:17.533 INFO:tasks.workunit.client.0.smithi037.stdout:1/738: readlink dc/d52/d6b/dd9/d4d/d6a/dea/dd8/lef 0 2024-04-25T17:19:17.538 INFO:tasks.workunit.client.0.smithi037.stdout:5/687: dwrite d7/d18/f2a [4194304,4194304] 0 2024-04-25T17:19:17.540 INFO:tasks.workunit.client.1.smithi069.stdout:7/558: rename d4/d6/d14/laf to d4/d6/d14/d44/lb5 0 2024-04-25T17:19:17.542 INFO:tasks.workunit.client.1.smithi069.stdout:2/508: rename d0/d56/d5f/d62/d7d/d31/f6c to d0/d56/d5f/d62/d7d/d31/f9f 0 2024-04-25T17:19:17.543 INFO:tasks.workunit.client.0.smithi037.stdout:9/828: fsync d1/d48/d68/d26/d81/f97 0 2024-04-25T17:19:17.546 INFO:tasks.workunit.client.1.smithi069.stdout:3/609: dwrite d8/f37 [4194304,4194304] 0 2024-04-25T17:19:17.549 INFO:tasks.workunit.client.1.smithi069.stdout:3/610: write d8/d16/d1a/d2c/d49/d87/d8a/fc9 [315552,98413] 0 2024-04-25T17:19:17.552 INFO:tasks.workunit.client.1.smithi069.stdout:5/546: creat d13/d17/d19/d8a/fbf x:0 0 0 2024-04-25T17:19:17.555 INFO:tasks.workunit.client.0.smithi037.stdout:6/601: rename db/d1d/d20/cbb to db/d1d/db1/cd7 0 2024-04-25T17:19:17.556 INFO:tasks.workunit.client.0.smithi037.stdout:5/688: read d7/d18/d62/f7e [2997692,105150] 0 2024-04-25T17:19:17.557 INFO:tasks.workunit.client.0.smithi037.stdout:8/602: dwrite d5/db/d18/f19 [0,4194304] 0 2024-04-25T17:19:17.559 INFO:tasks.workunit.client.0.smithi037.stdout:8/603: write d5/db/d18/f62 [4459678,105450] 0 2024-04-25T17:19:17.560 INFO:tasks.workunit.client.1.smithi069.stdout:0/458: symlink d0/da/d54/d7d/d8e/la4 0 2024-04-25T17:19:17.561 INFO:tasks.workunit.client.0.smithi037.stdout:8/604: write d5/d6a/f89 [63008,33827] 0 2024-04-25T17:19:17.562 INFO:tasks.workunit.client.0.smithi037.stdout:8/605: chown d5/db/d59/c91 247 1 2024-04-25T17:19:17.565 INFO:tasks.workunit.client.0.smithi037.stdout:9/829: rmdir d1/d5/dc 39 2024-04-25T17:19:17.566 INFO:tasks.workunit.client.1.smithi069.stdout:8/527: stat c1e 0 2024-04-25T17:19:17.567 INFO:tasks.workunit.client.1.smithi069.stdout:6/501: fdatasync d2/d9c/d48/f5d 0 2024-04-25T17:19:17.568 INFO:tasks.workunit.client.1.smithi069.stdout:8/528: chown d37/d47/d78/f88 4 1 2024-04-25T17:19:17.568 INFO:tasks.workunit.client.0.smithi037.stdout:1/739: dwrite dc/d52/fb2 [0,4194304] 0 2024-04-25T17:19:17.568 INFO:tasks.workunit.client.1.smithi069.stdout:4/520: write db/d15/d20/d38/f6a [4656989,108643] 0 2024-04-25T17:19:17.570 INFO:tasks.workunit.client.1.smithi069.stdout:6/502: read d2/d1e/d3e/d67/f69 [160467,6910] 0 2024-04-25T17:19:17.576 INFO:tasks.workunit.client.0.smithi037.stdout:9/830: mkdir d1/d48/d112 0 2024-04-25T17:19:17.578 INFO:tasks.workunit.client.0.smithi037.stdout:1/740: symlink dc/d52/d6b/dd9/d22/d36/d8c/lfd 0 2024-04-25T17:19:17.580 INFO:tasks.workunit.client.1.smithi069.stdout:2/509: creat d0/d26/fa0 x:0 0 0 2024-04-25T17:19:17.581 INFO:tasks.workunit.client.1.smithi069.stdout:2/510: fsync d0/d1/fe 0 2024-04-25T17:19:17.581 INFO:tasks.workunit.client.0.smithi037.stdout:6/602: write db/d26/d2e/d3e/f35 [1143523,119132] 0 2024-04-25T17:19:17.586 INFO:tasks.workunit.client.1.smithi069.stdout:3/611: dread - d8/d16/d1a/d2c/d6c/f8c zero size 2024-04-25T17:19:17.586 INFO:tasks.workunit.client.0.smithi037.stdout:5/689: dwrite d7/d18/d62/f7e [0,4194304] 0 2024-04-25T17:19:17.588 INFO:tasks.workunit.client.0.smithi037.stdout:6/603: unlink db/d26/d2e/d3e/l78 0 2024-04-25T17:19:17.594 INFO:tasks.workunit.client.1.smithi069.stdout:0/459: creat d0/d17/fa5 x:0 0 0 2024-04-25T17:19:17.594 INFO:tasks.workunit.client.0.smithi037.stdout:5/690: dwrite d7/d12/d6f/d94/fad [0,4194304] 0 2024-04-25T17:19:17.595 INFO:tasks.workunit.client.1.smithi069.stdout:4/521: dread db/d15/d20/d35/d63/d43/d48/f5e [0,4194304] 0 2024-04-25T17:19:17.599 INFO:tasks.workunit.client.0.smithi037.stdout:8/606: truncate d5/db/fb8 2455958 0 2024-04-25T17:19:17.601 INFO:tasks.workunit.client.0.smithi037.stdout:8/607: chown d5/d26/d33/f34 16669570 1 2024-04-25T17:19:17.604 INFO:tasks.workunit.client.0.smithi037.stdout:1/741: link dc/d52/d6b/dd9/d22/l72 dc/d52/d6b/dd9/d22/d36/d74/daf/lfe 0 2024-04-25T17:19:17.609 INFO:tasks.workunit.client.1.smithi069.stdout:1/541: rename d1/d19/d7c/f64 to d1/d4/d6/d9e/fa2 0 2024-04-25T17:19:17.612 INFO:tasks.workunit.client.1.smithi069.stdout:1/542: dread d1/d4/f4c [0,4194304] 0 2024-04-25T17:19:17.613 INFO:tasks.workunit.client.0.smithi037.stdout:8/608: mkdir d5/db/d18/dc8 0 2024-04-25T17:19:17.616 INFO:tasks.workunit.client.0.smithi037.stdout:1/742: fdatasync dc/d18/fc7 0 2024-04-25T17:19:17.618 INFO:tasks.workunit.client.1.smithi069.stdout:2/511: unlink d0/d26/f60 0 2024-04-25T17:19:17.618 INFO:tasks.workunit.client.0.smithi037.stdout:1/743: dread dc/d52/d6b/dd9/d4d/d6a/d8f/fd6 [0,4194304] 0 2024-04-25T17:19:17.621 INFO:tasks.workunit.client.0.smithi037.stdout:6/604: creat db/d1d/d20/d85/fd8 x:0 0 0 2024-04-25T17:19:17.623 INFO:tasks.workunit.client.1.smithi069.stdout:3/612: creat d8/d16/d1a/d2c/d6c/fd8 x:0 0 0 2024-04-25T17:19:17.623 INFO:tasks.workunit.client.0.smithi037.stdout:8/609: mknod d5/db/d18/d3b/d50/da0/da6/da8/cc9 0 2024-04-25T17:19:17.624 INFO:tasks.workunit.client.0.smithi037.stdout:8/610: readlink d5/db/d18/l31 0 2024-04-25T17:19:17.628 INFO:tasks.workunit.client.1.smithi069.stdout:4/522: creat db/d22/d24/d41/fb7 x:0 0 0 2024-04-25T17:19:17.630 INFO:tasks.workunit.client.0.smithi037.stdout:1/744: mknod dc/d52/d6b/cff 0 2024-04-25T17:19:17.631 INFO:tasks.workunit.client.0.smithi037.stdout:1/745: read dc/f10 [304673,70740] 0 2024-04-25T17:19:17.631 INFO:tasks.workunit.client.0.smithi037.stdout:9/831: link d1/d5/dc/d3c/dca/df5/lf7 d1/d48/d68/d26/d81/d9c/l113 0 2024-04-25T17:19:17.633 INFO:tasks.workunit.client.0.smithi037.stdout:6/605: creat db/d53/fd9 x:0 0 0 2024-04-25T17:19:17.634 INFO:tasks.workunit.client.1.smithi069.stdout:6/503: read d2/d7/f12 [4046809,58886] 0 2024-04-25T17:19:17.634 INFO:tasks.workunit.client.1.smithi069.stdout:4/523: dwrite db/d15/d26/f29 [4194304,4194304] 0 2024-04-25T17:19:17.637 INFO:tasks.workunit.client.1.smithi069.stdout:7/559: link d4/d1a/f35 d4/d4c/fb6 0 2024-04-25T17:19:17.637 INFO:tasks.workunit.client.1.smithi069.stdout:6/504: read - d2/d51/d85/faa zero size 2024-04-25T17:19:17.639 INFO:tasks.workunit.client.1.smithi069.stdout:5/547: dwrite d13/d17/d19/d1c/da4/da9/daa/fba [0,4194304] 0 2024-04-25T17:19:17.640 INFO:tasks.workunit.client.1.smithi069.stdout:5/548: write d13/f60 [4586795,80560] 0 2024-04-25T17:19:17.646 INFO:tasks.workunit.client.0.smithi037.stdout:9/832: unlink d1/d5/l9f 0 2024-04-25T17:19:17.647 INFO:tasks.workunit.client.1.smithi069.stdout:6/505: dwrite d2/d7/f25 [0,4194304] 0 2024-04-25T17:19:17.648 INFO:tasks.workunit.client.1.smithi069.stdout:2/512: creat d0/d26/d10/d43/fa1 x:0 0 0 2024-04-25T17:19:17.648 INFO:tasks.workunit.client.1.smithi069.stdout:6/506: stat d2/d51/d85/lac 0 2024-04-25T17:19:17.649 INFO:tasks.workunit.client.1.smithi069.stdout:9/520: getdents d2/da/dd/de/d64 0 2024-04-25T17:19:17.650 INFO:tasks.workunit.client.1.smithi069.stdout:2/513: write d0/d1/d5b/d33/f67 [1024252,22043] 0 2024-04-25T17:19:17.651 INFO:tasks.workunit.client.1.smithi069.stdout:3/613: rmdir d8/d16 39 2024-04-25T17:19:17.651 INFO:tasks.workunit.client.1.smithi069.stdout:9/521: chown d2/da/dd/d1e/d2e/d68/fb5 23850201 1 2024-04-25T17:19:17.653 INFO:tasks.workunit.client.0.smithi037.stdout:1/746: dwrite dc/f16 [0,4194304] 0 2024-04-25T17:19:17.653 INFO:tasks.workunit.client.1.smithi069.stdout:0/460: mknod d0/da/db/d1d/ca6 0 2024-04-25T17:19:17.654 INFO:tasks.workunit.client.1.smithi069.stdout:9/522: write d2/da/dd/de/d74/d8a/f9e [1960788,90929] 0 2024-04-25T17:19:17.656 INFO:tasks.workunit.client.0.smithi037.stdout:6/606: symlink db/d26/d2e/lda 0 2024-04-25T17:19:17.658 INFO:tasks.workunit.client.0.smithi037.stdout:6/607: read - db/d1d/d20/d85/fd8 zero size 2024-04-25T17:19:17.659 INFO:tasks.workunit.client.1.smithi069.stdout:8/529: creat d37/d47/fb1 x:0 0 0 2024-04-25T17:19:17.659 INFO:tasks.workunit.client.0.smithi037.stdout:6/608: chown db/d1d/d20/ld6 11233 1 2024-04-25T17:19:17.659 INFO:tasks.workunit.client.0.smithi037.stdout:1/747: mkdir dc/d52/d100 0 2024-04-25T17:19:17.660 INFO:tasks.workunit.client.0.smithi037.stdout:6/609: chown db/d26/f67 236 1 2024-04-25T17:19:17.661 INFO:tasks.workunit.client.1.smithi069.stdout:1/543: mkdir d1/d4/d6/d4f/d9b/da3 0 2024-04-25T17:19:17.664 INFO:tasks.workunit.client.1.smithi069.stdout:7/560: symlink d4/d6/d14/d44/lb7 0 2024-04-25T17:19:17.665 INFO:tasks.workunit.client.1.smithi069.stdout:7/561: readlink d4/d6/d14/l1b 0 2024-04-25T17:19:17.665 INFO:tasks.workunit.client.1.smithi069.stdout:6/507: creat d2/d1e/d3f/d86/fb2 x:0 0 0 2024-04-25T17:19:17.666 INFO:tasks.workunit.client.1.smithi069.stdout:6/508: fsync d2/d51/d85/f7b 0 2024-04-25T17:19:17.668 INFO:tasks.workunit.client.1.smithi069.stdout:8/530: rename d37/d66/f74 to d37/d66/d6b/fb2 0 2024-04-25T17:19:17.669 INFO:tasks.workunit.client.1.smithi069.stdout:1/544: creat d1/d43/d5f/fa4 x:0 0 0 2024-04-25T17:19:17.671 INFO:tasks.workunit.client.1.smithi069.stdout:3/614: creat d8/d16/d9b/dc3/fd9 x:0 0 0 2024-04-25T17:19:17.674 INFO:tasks.workunit.client.1.smithi069.stdout:5/549: dread d13/d17/d19/d20/f7a [0,4194304] 0 2024-04-25T17:19:17.676 INFO:tasks.workunit.client.1.smithi069.stdout:9/523: link d2/f2c d2/da/fbb 0 2024-04-25T17:19:17.676 INFO:tasks.workunit.client.1.smithi069.stdout:4/524: link db/cf db/d4b/d78/d79/cb8 0 2024-04-25T17:19:17.677 INFO:tasks.workunit.client.1.smithi069.stdout:7/562: link d4/d6/f59 d4/d6/d14/d44/fb8 0 2024-04-25T17:19:17.678 INFO:tasks.workunit.client.1.smithi069.stdout:9/524: write d2/da/d5f/fae [860677,105051] 0 2024-04-25T17:19:17.682 INFO:tasks.workunit.client.1.smithi069.stdout:5/550: dwrite d13/d17/d29/d2e/d76/f87 [0,4194304] 0 2024-04-25T17:19:17.683 INFO:tasks.workunit.client.0.smithi037.stdout:6/610: chown db/d5a/c66 1712450230 1 2024-04-25T17:19:17.683 INFO:tasks.workunit.client.0.smithi037.stdout:1/748: creat dc/d1c/f101 x:0 0 0 2024-04-25T17:19:17.684 INFO:tasks.workunit.client.0.smithi037.stdout:6/611: write db/d1d/f7f [2638622,60328] 0 2024-04-25T17:19:17.686 INFO:tasks.workunit.client.0.smithi037.stdout:1/749: write dc/d52/d6b/dd9/d4d/d6a/d8f/ddc/feb [736046,107243] 0 2024-04-25T17:19:17.686 INFO:tasks.workunit.client.1.smithi069.stdout:7/563: dwrite d4/d6/d14/d44/d79/f53 [4194304,4194304] 0 2024-04-25T17:19:17.686 INFO:tasks.workunit.client.0.smithi037.stdout:8/611: truncate d5/db/d18/d3b/fb2 621926 0 2024-04-25T17:19:17.689 INFO:tasks.workunit.client.0.smithi037.stdout:9/833: write d1/d5/d19/f1b [1163006,114876] 0 2024-04-25T17:19:17.690 INFO:tasks.workunit.client.0.smithi037.stdout:1/750: write dc/d52/d6b/dd9/d22/d36/d92/db8/dbc/fcd [250548,89162] 0 2024-04-25T17:19:17.691 INFO:tasks.workunit.client.0.smithi037.stdout:1/751: dread - dc/d24/fbd zero size 2024-04-25T17:19:17.701 INFO:tasks.workunit.client.0.smithi037.stdout:8/612: dread - d5/db/d23/d78/f83 zero size 2024-04-25T17:19:17.701 INFO:tasks.workunit.client.0.smithi037.stdout:8/613: dread - d5/db/d7e/f76 zero size 2024-04-25T17:19:17.702 INFO:tasks.workunit.client.1.smithi069.stdout:4/525: symlink db/d15/d20/d35/d63/d43/d48/d49/d4e/lb9 0 2024-04-25T17:19:17.703 INFO:tasks.workunit.client.1.smithi069.stdout:4/526: write db/d15/d20/d35/d63/d70/f86 [615837,88551] 0 2024-04-25T17:19:17.705 INFO:tasks.workunit.client.1.smithi069.stdout:9/525: mkdir d2/da/dd/de/d74/dbc 0 2024-04-25T17:19:17.707 INFO:tasks.workunit.client.1.smithi069.stdout:2/514: dread d0/d1/fe [0,4194304] 0 2024-04-25T17:19:17.708 INFO:tasks.workunit.client.1.smithi069.stdout:7/564: symlink d4/d6/d14/d44/d7c/lb9 0 2024-04-25T17:19:17.710 INFO:tasks.workunit.client.1.smithi069.stdout:6/509: link d2/d1e/d43/l5f d2/lb3 0 2024-04-25T17:19:17.711 INFO:tasks.workunit.client.1.smithi069.stdout:6/510: read - d2/d51/d89/f90 zero size 2024-04-25T17:19:17.711 INFO:tasks.workunit.client.1.smithi069.stdout:6/511: readlink d2/d51/d85/la4 0 2024-04-25T17:19:17.712 INFO:tasks.workunit.client.1.smithi069.stdout:6/512: truncate d2/d51/d85/f6f 2063804 0 2024-04-25T17:19:17.712 INFO:tasks.workunit.client.0.smithi037.stdout:8/614: symlink d5/db/d18/d3b/d50/d51/lca 0 2024-04-25T17:19:17.713 INFO:tasks.workunit.client.1.smithi069.stdout:6/513: dread - d2/d51/f93 zero size 2024-04-25T17:19:17.713 INFO:tasks.workunit.client.1.smithi069.stdout:8/531: getdents d37/d47/d78 0 2024-04-25T17:19:17.714 INFO:tasks.workunit.client.0.smithi037.stdout:1/752: mknod dc/d18/d64/df1/df4/c102 0 2024-04-25T17:19:17.715 INFO:tasks.workunit.client.0.smithi037.stdout:1/753: chown dc/d18/l1a 2 1 2024-04-25T17:19:17.717 INFO:tasks.workunit.client.1.smithi069.stdout:4/527: symlink db/d15/d20/d35/d63/d70/d8a/lba 0 2024-04-25T17:19:17.717 INFO:tasks.workunit.client.1.smithi069.stdout:0/461: dwrite d0/da/db/d3a/f4c [0,4194304] 0 2024-04-25T17:19:17.719 INFO:tasks.workunit.client.0.smithi037.stdout:8/615: chown d5/d26/d81/la1 1 1 2024-04-25T17:19:17.721 INFO:tasks.workunit.client.1.smithi069.stdout:9/526: creat d2/da4/fbd x:0 0 0 2024-04-25T17:19:17.722 INFO:tasks.workunit.client.0.smithi037.stdout:8/616: read d5/d6a/f3f [2530342,12263] 0 2024-04-25T17:19:17.722 INFO:tasks.workunit.client.1.smithi069.stdout:5/551: truncate d13/d17/f4a 4982577 0 2024-04-25T17:19:17.723 INFO:tasks.workunit.client.0.smithi037.stdout:1/754: dwrite dc/d24/da5/df9/fbb [0,4194304] 0 2024-04-25T17:19:17.723 INFO:tasks.workunit.client.1.smithi069.stdout:1/545: dwrite d1/df/f7b [0,4194304] 0 2024-04-25T17:19:17.724 INFO:tasks.workunit.client.0.smithi037.stdout:1/755: chown dc/d52/d6b/dd9/f4f 97501 1 2024-04-25T17:19:17.726 INFO:tasks.workunit.client.0.smithi037.stdout:1/756: truncate dc/d18/d64/fa0 480817 0 2024-04-25T17:19:17.732 INFO:tasks.workunit.client.1.smithi069.stdout:7/565: symlink d4/d6/d14/d44/lba 0 2024-04-25T17:19:17.736 INFO:tasks.workunit.client.0.smithi037.stdout:6/612: write db/d1d/d20/d85/fa3 [379789,84034] 0 2024-04-25T17:19:17.737 INFO:tasks.workunit.client.0.smithi037.stdout:1/757: truncate dc/d52/d6b/f6e 2254207 0 2024-04-25T17:19:17.738 INFO:tasks.workunit.client.0.smithi037.stdout:6/613: write db/d53/f58 [2921068,61318] 0 2024-04-25T17:19:17.741 INFO:tasks.workunit.client.1.smithi069.stdout:8/532: rmdir d37/d47/d78/d93 39 2024-04-25T17:19:17.744 INFO:tasks.workunit.client.0.smithi037.stdout:1/758: symlink dc/d24/l103 0 2024-04-25T17:19:17.747 INFO:tasks.workunit.client.1.smithi069.stdout:0/462: rename d0/da/db/f4e to d0/d17/d95/fa7 0 2024-04-25T17:19:17.748 INFO:tasks.workunit.client.1.smithi069.stdout:0/463: fsync d0/f2f 0 2024-04-25T17:19:17.750 INFO:tasks.workunit.client.1.smithi069.stdout:2/515: symlink d0/la2 0 2024-04-25T17:19:17.754 INFO:tasks.workunit.client.0.smithi037.stdout:1/759: symlink dc/d52/d6b/dd9/d4d/d6a/d8f/l104 0 2024-04-25T17:19:17.757 INFO:tasks.workunit.client.1.smithi069.stdout:5/552: symlink d13/d17/d19/d1c/da4/da9/lc0 0 2024-04-25T17:19:17.759 INFO:tasks.workunit.client.1.smithi069.stdout:1/546: mknod d1/df/d17/ca5 0 2024-04-25T17:19:17.759 INFO:tasks.workunit.client.1.smithi069.stdout:5/553: read d13/d17/d19/d1c/d6c/f7c [2600491,49927] 0 2024-04-25T17:19:17.759 INFO:tasks.workunit.client.1.smithi069.stdout:1/547: dread - d1/d4/de/d44/f5d zero size 2024-04-25T17:19:17.760 INFO:tasks.workunit.client.0.smithi037.stdout:1/760: write dc/d52/d6b/dd9/d4d/f7e [7401453,102178] 0 2024-04-25T17:19:17.760 INFO:tasks.workunit.client.1.smithi069.stdout:1/548: readlink d1/d43/d1b/d32/d4a/d4b/l9c 0 2024-04-25T17:19:17.766 INFO:tasks.workunit.client.0.smithi037.stdout:1/761: dwrite dc/d18/f2f [0,4194304] 0 2024-04-25T17:19:17.770 INFO:tasks.workunit.client.0.smithi037.stdout:9/834: rename d1/d5/d2e/d34/d76/l8a to d1/d48/l114 0 2024-04-25T17:19:17.775 INFO:tasks.workunit.client.1.smithi069.stdout:0/464: fdatasync d0/da/db/d1d/f20 0 2024-04-25T17:19:17.777 INFO:tasks.workunit.client.1.smithi069.stdout:2/516: creat d0/d1/d5b/d33/fa3 x:0 0 0 2024-04-25T17:19:17.779 INFO:tasks.workunit.client.1.smithi069.stdout:2/517: truncate d0/d26/d10/d43/f74 1203677 0 2024-04-25T17:19:17.779 INFO:tasks.workunit.client.1.smithi069.stdout:9/527: creat d2/da/d14/d23/d65/d88/db6/fbe x:0 0 0 2024-04-25T17:19:17.781 INFO:tasks.workunit.client.1.smithi069.stdout:9/528: read d2/da/d5f/f6d [163932,125227] 0 2024-04-25T17:19:17.782 INFO:tasks.workunit.client.1.smithi069.stdout:9/529: stat d2/da/dd/d1e/d2e/la2 0 2024-04-25T17:19:17.783 INFO:tasks.workunit.client.1.smithi069.stdout:5/554: mknod d13/d17/d29/cc1 0 2024-04-25T17:19:17.784 INFO:tasks.workunit.client.1.smithi069.stdout:5/555: write d13/d17/d29/d30/d9c/fbe [768629,27841] 0 2024-04-25T17:19:17.785 INFO:tasks.workunit.client.1.smithi069.stdout:5/556: write d13/f26 [2219203,125606] 0 2024-04-25T17:19:17.788 INFO:tasks.workunit.client.1.smithi069.stdout:7/566: mkdir d4/dbb 0 2024-04-25T17:19:17.790 INFO:tasks.workunit.client.1.smithi069.stdout:1/549: unlink d1/d19/f49 0 2024-04-25T17:19:17.792 INFO:tasks.workunit.client.1.smithi069.stdout:5/557: dwrite d13/d17/d29/d2e/d76/faf [0,4194304] 0 2024-04-25T17:19:17.792 INFO:tasks.workunit.client.1.smithi069.stdout:6/514: rmdir d2/d8b 0 2024-04-25T17:19:17.798 INFO:tasks.workunit.client.1.smithi069.stdout:3/615: sync 2024-04-25T17:19:17.809 INFO:tasks.workunit.client.1.smithi069.stdout:8/533: write f35 [787016,7852] 0 2024-04-25T17:19:17.809 INFO:tasks.workunit.client.1.smithi069.stdout:1/550: dread d1/d4/f2a [0,4194304] 0 2024-04-25T17:19:17.809 INFO:tasks.workunit.client.1.smithi069.stdout:9/530: read d2/da/dd/de/d64/f6e [651965,44249] 0 2024-04-25T17:19:17.812 INFO:tasks.workunit.client.1.smithi069.stdout:7/567: symlink d4/d18/lbc 0 2024-04-25T17:19:17.817 INFO:tasks.workunit.client.1.smithi069.stdout:5/558: symlink d13/d17/d19/d20/d51/db5/lc2 0 2024-04-25T17:19:17.817 INFO:tasks.workunit.client.1.smithi069.stdout:2/518: dwrite d0/f92 [0,4194304] 0 2024-04-25T17:19:17.818 INFO:tasks.workunit.client.1.smithi069.stdout:2/519: fsync d0/d26/d10/f7e 0 2024-04-25T17:19:17.819 INFO:tasks.workunit.client.1.smithi069.stdout:2/520: stat d0/d26/d10/d43/d99 0 2024-04-25T17:19:17.821 INFO:tasks.workunit.client.1.smithi069.stdout:4/528: getdents db/d15/d42 0 2024-04-25T17:19:17.823 INFO:tasks.workunit.client.1.smithi069.stdout:2/521: dread d0/f44 [0,4194304] 0 2024-04-25T17:19:17.828 INFO:tasks.workunit.client.1.smithi069.stdout:8/534: rmdir d37/d47/d54/d6e/d98 39 2024-04-25T17:19:17.828 INFO:tasks.workunit.client.1.smithi069.stdout:4/529: dwrite db/d15/d26/f62 [4194304,4194304] 0 2024-04-25T17:19:17.829 INFO:tasks.workunit.client.1.smithi069.stdout:8/535: chown d37/l56 331816 1 2024-04-25T17:19:17.841 INFO:tasks.workunit.client.1.smithi069.stdout:6/515: symlink d2/d1e/d3f/d56/d7e/lb4 0 2024-04-25T17:19:17.841 INFO:tasks.workunit.client.1.smithi069.stdout:5/559: unlink d13/d17/d29/l91 0 2024-04-25T17:19:17.844 INFO:tasks.workunit.client.1.smithi069.stdout:5/560: fsync d13/d17/d19/f50 0 2024-04-25T17:19:17.847 INFO:tasks.workunit.client.1.smithi069.stdout:2/522: creat d0/d56/d5f/d62/d7d/d72/fa4 x:0 0 0 2024-04-25T17:19:17.847 INFO:tasks.workunit.client.1.smithi069.stdout:3/616: dwrite d8/f18 [0,4194304] 0 2024-04-25T17:19:17.848 INFO:tasks.workunit.client.0.smithi037.stdout:6/614: rename db/f84 to db/d1d/d20/d2f/fdb 0 2024-04-25T17:19:17.848 INFO:tasks.workunit.client.1.smithi069.stdout:0/465: dwrite d0/da/d24/f6d [0,4194304] 0 2024-04-25T17:19:17.849 INFO:tasks.workunit.client.1.smithi069.stdout:3/617: chown d8/d16/d1a/d2c/d49/d87 203883 1 2024-04-25T17:19:17.849 INFO:tasks.workunit.client.1.smithi069.stdout:2/523: fsync d0/d26/d10/d43/d99/f9b 0 2024-04-25T17:19:17.853 INFO:tasks.workunit.client.0.smithi037.stdout:6/615: read db/d26/d2e/d7d/d65/fa7 [311728,90754] 0 2024-04-25T17:19:17.854 INFO:tasks.workunit.client.0.smithi037.stdout:9/835: rmdir d1/d48/d68/d26/d81/d9c 39 2024-04-25T17:19:17.860 INFO:tasks.workunit.client.1.smithi069.stdout:4/530: rename db/d15/d26/fb5 to db/d4b/d78/d79/da5/fbb 0 2024-04-25T17:19:17.861 INFO:tasks.workunit.client.1.smithi069.stdout:9/531: link d2/da/dd/de/d74/f78 d2/da/dd/de/d64/fbf 0 2024-04-25T17:19:17.862 INFO:tasks.workunit.client.0.smithi037.stdout:9/836: dwrite d1/d5/dc/d38/fbd [0,4194304] 0 2024-04-25T17:19:17.862 INFO:tasks.workunit.client.1.smithi069.stdout:9/532: read d2/da/d5f/f86 [384994,30522] 0 2024-04-25T17:19:17.868 INFO:tasks.workunit.client.1.smithi069.stdout:1/551: truncate d1/d19/d7c/f14 6752190 0 2024-04-25T17:19:17.869 INFO:tasks.workunit.client.1.smithi069.stdout:8/536: dread d37/f3a [0,4194304] 0 2024-04-25T17:19:17.869 INFO:tasks.workunit.client.1.smithi069.stdout:8/537: stat d37/d47/d48/d8e/la0 0 2024-04-25T17:19:17.870 INFO:tasks.workunit.client.1.smithi069.stdout:8/538: chown d37/f41 932607 1 2024-04-25T17:19:17.874 INFO:tasks.workunit.client.1.smithi069.stdout:1/552: dwrite d1/d19/d7c/d4d/f7a [0,4194304] 0 2024-04-25T17:19:17.877 INFO:tasks.workunit.client.1.smithi069.stdout:1/553: truncate d1/df/d17/f9d 550972 0 2024-04-25T17:19:17.878 INFO:tasks.workunit.client.1.smithi069.stdout:7/568: dwrite d4/d6/d14/faa [0,4194304] 0 2024-04-25T17:19:17.884 INFO:tasks.workunit.client.1.smithi069.stdout:2/524: rename d0/d56/d5f/d62/d7d/d72/c90 to d0/d26/d10/d43/d99/ca5 0 2024-04-25T17:19:17.886 INFO:tasks.workunit.client.1.smithi069.stdout:4/531: symlink db/d22/d24/d41/lbc 0 2024-04-25T17:19:17.887 INFO:tasks.workunit.client.1.smithi069.stdout:6/516: dwrite d2/d9c/f4b [0,4194304] 0 2024-04-25T17:19:17.890 INFO:tasks.workunit.client.1.smithi069.stdout:9/533: fsync d2/da/d14/d23/d65/d88/f54 0 2024-04-25T17:19:17.893 INFO:tasks.workunit.client.0.smithi037.stdout:1/762: rename dc/d52/d6b/dd9/d22/d36/d92/db8/dbc/ce0 to dc/c105 0 2024-04-25T17:19:17.893 INFO:tasks.workunit.client.0.smithi037.stdout:6/616: creat db/d1d/db1/dc7/fdc x:0 0 0 2024-04-25T17:19:17.897 INFO:tasks.workunit.client.1.smithi069.stdout:8/539: unlink d37/d66/l8a 0 2024-04-25T17:19:17.899 INFO:tasks.workunit.client.0.smithi037.stdout:9/837: creat d1/d5/d2e/d34/daf/f115 x:0 0 0 2024-04-25T17:19:17.902 INFO:tasks.workunit.client.0.smithi037.stdout:1/763: fsync dc/f10 0 2024-04-25T17:19:17.902 INFO:tasks.workunit.client.1.smithi069.stdout:3/618: getdents d8/d2a/dac 0 2024-04-25T17:19:17.907 INFO:tasks.workunit.client.1.smithi069.stdout:1/554: rename d1/d19 to d1/d4/d6/d9e/da6 0 2024-04-25T17:19:17.908 INFO:tasks.workunit.client.1.smithi069.stdout:1/555: stat d1/d4/d6/d9e/da6/d7c/d4d/f7a 0 2024-04-25T17:19:17.908 INFO:tasks.workunit.client.1.smithi069.stdout:1/556: chown d1/d43/d1b/d32/c67 68312557 1 2024-04-25T17:19:17.909 INFO:tasks.workunit.client.1.smithi069.stdout:2/525: creat d0/d56/d5f/fa6 x:0 0 0 2024-04-25T17:19:17.909 INFO:tasks.workunit.client.1.smithi069.stdout:1/557: dread - d1/d4/d6/d9e/f8d zero size 2024-04-25T17:19:17.911 INFO:tasks.workunit.client.1.smithi069.stdout:4/532: mkdir db/d15/d20/d35/d63/d75/dbd 0 2024-04-25T17:19:17.911 INFO:tasks.workunit.client.1.smithi069.stdout:1/558: dread d1/d43/d1b/d32/d4a/f58 [0,4194304] 0 2024-04-25T17:19:17.913 INFO:tasks.workunit.client.1.smithi069.stdout:4/533: truncate db/d15/d20/d35/d63/d43/f97 12287 0 2024-04-25T17:19:17.914 INFO:tasks.workunit.client.1.smithi069.stdout:6/517: mkdir d2/d1e/d43/d7d/db5 0 2024-04-25T17:19:17.919 INFO:tasks.workunit.client.0.smithi037.stdout:6/617: creat db/d26/d2e/d7d/d65/fdd x:0 0 0 2024-04-25T17:19:17.924 INFO:tasks.workunit.client.1.smithi069.stdout:7/569: rename d4/d1a/d34/c7e to d4/d83/cbd 0 2024-04-25T17:19:17.925 INFO:tasks.workunit.client.1.smithi069.stdout:2/526: readlink d0/l1e 0 2024-04-25T17:19:17.928 INFO:tasks.workunit.client.1.smithi069.stdout:9/534: symlink d2/lc0 0 2024-04-25T17:19:17.928 INFO:tasks.workunit.client.1.smithi069.stdout:8/540: mkdir d37/d47/d78/db3 0 2024-04-25T17:19:17.929 INFO:tasks.workunit.client.1.smithi069.stdout:5/561: getdents d13/d17/d19/d20/d51/db5 0 2024-04-25T17:19:17.931 INFO:tasks.workunit.client.1.smithi069.stdout:1/559: mknod d1/d4/d6/d4f/d9b/da3/ca7 0 2024-04-25T17:19:17.931 INFO:tasks.workunit.client.1.smithi069.stdout:8/541: truncate d37/f7c 192070 0 2024-04-25T17:19:17.934 INFO:tasks.workunit.client.1.smithi069.stdout:0/466: rename d0/da/db/c3c to d0/da/db/d2a/ca8 0 2024-04-25T17:19:17.936 INFO:tasks.workunit.client.1.smithi069.stdout:2/527: dwrite d0/d26/d10/d43/f7a [0,4194304] 0 2024-04-25T17:19:17.938 INFO:tasks.workunit.client.1.smithi069.stdout:8/542: truncate d37/d47/d78/d93/f94 4552283 0 2024-04-25T17:19:17.939 INFO:tasks.workunit.client.1.smithi069.stdout:2/528: fsync d0/d56/d5f/d62/d7d/d72/fa4 0 2024-04-25T17:19:17.942 INFO:tasks.workunit.client.1.smithi069.stdout:3/619: rename d8/d16/d1a/d99/fb8 to d8/d71/d8d/d92/db6/fda 0 2024-04-25T17:19:17.944 INFO:tasks.workunit.client.1.smithi069.stdout:3/620: readlink d8/d16/d1a/d2c/d49/l56 0 2024-04-25T17:19:17.946 INFO:tasks.workunit.client.1.smithi069.stdout:2/529: read - d0/d56/d5f/d62/d7d/d31/f81 zero size 2024-04-25T17:19:17.947 INFO:tasks.workunit.client.1.smithi069.stdout:7/570: dread d4/f4a [0,4194304] 0 2024-04-25T17:19:17.948 INFO:tasks.workunit.client.1.smithi069.stdout:8/543: dwrite d37/d62/f8f [0,4194304] 0 2024-04-25T17:19:17.950 INFO:tasks.workunit.client.0.smithi037.stdout:1/764: dwrite dc/d24/f5e [4194304,4194304] 0 2024-04-25T17:19:17.950 INFO:tasks.workunit.client.1.smithi069.stdout:6/518: rename d2/d9c/d48/d73 to d2/d1e/d43/db6 0 2024-04-25T17:19:17.957 INFO:tasks.workunit.client.0.smithi037.stdout:1/765: dread dc/d18/d64/fa0 [0,4194304] 0 2024-04-25T17:19:17.959 INFO:tasks.workunit.client.1.smithi069.stdout:7/571: readlink d4/d18/d36/l9d 0 2024-04-25T17:19:17.960 INFO:tasks.workunit.client.1.smithi069.stdout:8/544: creat d37/d66/d6b/fb4 x:0 0 0 2024-04-25T17:19:17.961 INFO:tasks.workunit.client.1.smithi069.stdout:1/560: getdents d1/d43/d5f 0 2024-04-25T17:19:17.963 INFO:tasks.workunit.client.0.smithi037.stdout:9/838: dwrite d1/d48/d68/d26/d81/f97 [0,4194304] 0 2024-04-25T17:19:17.965 INFO:tasks.workunit.client.1.smithi069.stdout:2/530: rename d0/d56/d5f/d62/l76 to d0/d56/d5f/d62/d7d/d31/d61/d8b/la7 0 2024-04-25T17:19:17.966 INFO:tasks.workunit.client.1.smithi069.stdout:8/545: dwrite d37/d47/d54/fae [0,4194304] 0 2024-04-25T17:19:17.967 INFO:tasks.workunit.client.1.smithi069.stdout:2/531: stat d0/d56/d5f/d62/d7d/d31/f38 0 2024-04-25T17:19:17.968 INFO:tasks.workunit.client.1.smithi069.stdout:3/621: symlink d8/d16/d1a/d2c/d49/dd0/ldb 0 2024-04-25T17:19:17.968 INFO:tasks.workunit.client.1.smithi069.stdout:2/532: write d0/d26/d10/f7e [9832560,102293] 0 2024-04-25T17:19:17.969 INFO:tasks.workunit.client.1.smithi069.stdout:2/533: fsync d0/d26/d10/d43/fa1 0 2024-04-25T17:19:17.970 INFO:tasks.workunit.client.0.smithi037.stdout:9/839: write d1/d48/d68/d26/d81/f86 [2702315,15369] 0 2024-04-25T17:19:17.970 INFO:tasks.workunit.client.1.smithi069.stdout:2/534: dread - d0/d56/f9d zero size 2024-04-25T17:19:17.971 INFO:tasks.workunit.client.1.smithi069.stdout:7/572: creat d4/d6/d14/d3d/d47/fbe x:0 0 0 2024-04-25T17:19:17.977 INFO:tasks.workunit.client.1.smithi069.stdout:2/535: dread d0/d1/fe [0,4194304] 0 2024-04-25T17:19:17.978 INFO:tasks.workunit.client.1.smithi069.stdout:4/534: dwrite db/d15/d20/d35/d63/d70/f74 [0,4194304] 0 2024-04-25T17:19:17.979 INFO:tasks.workunit.client.1.smithi069.stdout:1/561: dread d1/d43/f8a [0,4194304] 0 2024-04-25T17:19:17.980 INFO:tasks.workunit.client.1.smithi069.stdout:6/519: creat d2/d9c/d97/dad/fb7 x:0 0 0 2024-04-25T17:19:17.982 INFO:tasks.workunit.client.1.smithi069.stdout:5/562: write d13/d17/d19/d20/d2d/f56 [904081,76081] 0 2024-04-25T17:19:17.982 INFO:tasks.workunit.client.1.smithi069.stdout:3/622: symlink d8/d71/ldc 0 2024-04-25T17:19:17.983 INFO:tasks.workunit.client.1.smithi069.stdout:2/536: write d0/d26/f2b [1679256,53500] 0 2024-04-25T17:19:17.985 INFO:tasks.workunit.client.1.smithi069.stdout:4/535: read db/d22/f71 [1255378,89927] 0 2024-04-25T17:19:17.985 INFO:tasks.workunit.client.1.smithi069.stdout:0/467: write d0/da/db/d2a/f3f [4430678,116045] 0 2024-04-25T17:19:17.988 INFO:tasks.workunit.client.1.smithi069.stdout:7/573: write d4/f10 [3642479,29608] 0 2024-04-25T17:19:17.989 INFO:tasks.workunit.client.1.smithi069.stdout:9/535: dwrite d2/da/d14/d23/f55 [0,4194304] 0 2024-04-25T17:19:17.989 INFO:tasks.workunit.client.0.smithi037.stdout:9/840: getdents d1/d5/dc 0 2024-04-25T17:19:17.993 INFO:tasks.workunit.client.1.smithi069.stdout:8/546: rmdir d37/d66/d6b 39 2024-04-25T17:19:17.994 INFO:tasks.workunit.client.0.smithi037.stdout:1/766: write dc/d18/f51 [410051,60071] 0 2024-04-25T17:19:17.997 INFO:tasks.workunit.client.1.smithi069.stdout:5/563: mkdir d13/d17/d19/d20/d2d/dc3 0 2024-04-25T17:19:18.000 INFO:tasks.workunit.client.1.smithi069.stdout:5/564: write d13/d17/d19/d1c/d6c/fb3 [587152,85831] 0 2024-04-25T17:19:18.002 INFO:tasks.workunit.client.1.smithi069.stdout:1/562: dwrite d1/d4/d6/f7 [4194304,4194304] 0 2024-04-25T17:19:18.003 INFO:tasks.workunit.client.0.smithi037.stdout:1/767: creat dc/d52/d6b/dd9/d22/d70/f106 x:0 0 0 2024-04-25T17:19:18.006 INFO:tasks.workunit.client.1.smithi069.stdout:3/623: rename d8/d8b/db2/cc6 to d8/d8b/db2/cdd 0 2024-04-25T17:19:18.007 INFO:tasks.workunit.client.1.smithi069.stdout:2/537: creat d0/d56/d5f/d62/d7d/fa8 x:0 0 0 2024-04-25T17:19:18.007 INFO:tasks.workunit.client.0.smithi037.stdout:1/768: truncate dc/d52/d6b/dd9/d4d/f53 742439 0 2024-04-25T17:19:18.010 INFO:tasks.workunit.client.1.smithi069.stdout:9/536: fsync d2/da/f93 0 2024-04-25T17:19:18.014 INFO:tasks.workunit.client.1.smithi069.stdout:9/537: chown d2/da/dd/d1e/d2e/d68/cb1 0 1 2024-04-25T17:19:18.014 INFO:tasks.workunit.client.1.smithi069.stdout:0/468: dread d0/d17/f4a [0,4194304] 0 2024-04-25T17:19:18.015 INFO:tasks.workunit.client.0.smithi037.stdout:1/769: dwrite dc/d24/da5/df9/fbb [0,4194304] 0 2024-04-25T17:19:18.015 INFO:tasks.workunit.client.1.smithi069.stdout:6/520: rename d2/d1e/d3f/c6c to d2/d1e/d43/db6/cb8 0 2024-04-25T17:19:18.016 INFO:tasks.workunit.client.1.smithi069.stdout:3/624: dwrite d8/d71/d8d/d92/faa [0,4194304] 0 2024-04-25T17:19:18.018 INFO:tasks.workunit.client.1.smithi069.stdout:2/538: mknod d0/d56/d5f/d62/ca9 0 2024-04-25T17:19:18.024 INFO:tasks.workunit.client.0.smithi037.stdout:1/770: truncate dc/d52/d6b/dd9/d4d/d6a/d86/d9b/fd3 906077 0 2024-04-25T17:19:18.028 INFO:tasks.workunit.client.1.smithi069.stdout:0/469: write d0/da/d24/d43/f60 [1075776,35288] 0 2024-04-25T17:19:18.028 INFO:tasks.workunit.client.0.smithi037.stdout:9/841: dread d1/d48/d68/f46 [0,4194304] 0 2024-04-25T17:19:18.028 INFO:tasks.workunit.client.1.smithi069.stdout:8/547: dread d37/d47/f60 [0,4194304] 0 2024-04-25T17:19:18.029 INFO:tasks.workunit.client.1.smithi069.stdout:4/536: creat db/d15/d20/d35/d63/fbe x:0 0 0 2024-04-25T17:19:18.031 INFO:tasks.workunit.client.1.smithi069.stdout:3/625: dwrite d8/d71/d8d/d92/db6/fcb [0,4194304] 0 2024-04-25T17:19:18.033 INFO:tasks.workunit.client.1.smithi069.stdout:6/521: dwrite d2/d1e/d3f/d56/f5e [0,4194304] 0 2024-04-25T17:19:18.034 INFO:tasks.workunit.client.1.smithi069.stdout:3/626: write d8/d16/d1a/d2c/d6c/fd8 [833883,65923] 0 2024-04-25T17:19:18.035 INFO:tasks.workunit.client.0.smithi037.stdout:1/771: mknod dc/d52/d6b/dd9/d4d/c107 0 2024-04-25T17:19:18.039 INFO:tasks.workunit.client.0.smithi037.stdout:9/842: mkdir d1/d5/dc/d3c/d116 0 2024-04-25T17:19:18.042 INFO:tasks.workunit.client.0.smithi037.stdout:1/772: dwrite dc/d24/f48 [0,4194304] 0 2024-04-25T17:19:18.046 INFO:tasks.workunit.client.1.smithi069.stdout:7/574: getdents d4/d6/d14/d15 0 2024-04-25T17:19:18.049 INFO:tasks.workunit.client.1.smithi069.stdout:0/470: read d0/da/db/d1d/f86 [2465580,110490] 0 2024-04-25T17:19:18.049 INFO:tasks.workunit.client.0.smithi037.stdout:1/773: rename dc/d52/d6b/dd9/d22/d36/c8d to dc/d24/c108 0 2024-04-25T17:19:18.050 INFO:tasks.workunit.client.1.smithi069.stdout:0/471: chown d0/da/db/f13 45330 1 2024-04-25T17:19:18.052 INFO:tasks.workunit.client.1.smithi069.stdout:0/472: chown d0/da/d24/d67 806057313 1 2024-04-25T17:19:18.052 INFO:tasks.workunit.client.1.smithi069.stdout:5/565: dread d13/d17/f1d [0,4194304] 0 2024-04-25T17:19:18.053 INFO:tasks.workunit.client.1.smithi069.stdout:4/537: rmdir db/d15/d20/d35/d63/d43 39 2024-04-25T17:19:18.054 INFO:tasks.workunit.client.0.smithi037.stdout:1/774: rmdir dc/d52/d6b/dd9/d22/d36/d92/db8/dbc 39 2024-04-25T17:19:18.056 INFO:tasks.workunit.client.1.smithi069.stdout:7/575: symlink d4/d6/d14/d44/d79/d23/lbf 0 2024-04-25T17:19:18.061 INFO:tasks.workunit.client.1.smithi069.stdout:5/566: creat d13/d17/d29/d2e/fc4 x:0 0 0 2024-04-25T17:19:18.062 INFO:tasks.workunit.client.0.smithi037.stdout:1/775: dwrite dc/d52/d6b/dd9/d22/d36/d92/fc8 [0,4194304] 0 2024-04-25T17:19:18.063 INFO:tasks.workunit.client.1.smithi069.stdout:8/548: creat d37/d47/d54/d6e/d98/fb5 x:0 0 0 2024-04-25T17:19:18.064 INFO:tasks.workunit.client.1.smithi069.stdout:8/549: chown d37/d47/l69 26 1 2024-04-25T17:19:18.066 INFO:tasks.workunit.client.0.smithi037.stdout:1/776: mknod dc/d24/da5/df9/c109 0 2024-04-25T17:19:18.068 INFO:tasks.workunit.client.1.smithi069.stdout:9/538: truncate d2/da/d14/f18 1987628 0 2024-04-25T17:19:18.070 INFO:tasks.workunit.client.1.smithi069.stdout:1/563: truncate d1/d4/d6/d81/f9f 291727 0 2024-04-25T17:19:18.070 INFO:tasks.workunit.client.1.smithi069.stdout:9/539: truncate d2/da/d14/d23/d65/d88/db6/fbe 887705 0 2024-04-25T17:19:18.081 INFO:tasks.workunit.client.0.smithi037.stdout:1/777: rename dc/d52/d6b/dd9/d4d/d6a/d8f/ddc/feb to dc/d24/da5/df9/f10a 0 2024-04-25T17:19:18.082 INFO:tasks.workunit.client.1.smithi069.stdout:7/576: dread d4/d1a/d34/f65 [0,4194304] 0 2024-04-25T17:19:18.083 INFO:tasks.workunit.client.1.smithi069.stdout:7/577: fdatasync d4/fb1 0 2024-04-25T17:19:18.083 INFO:tasks.workunit.client.1.smithi069.stdout:2/539: truncate d0/d26/d10/d43/f74 386562 0 2024-04-25T17:19:18.085 INFO:tasks.workunit.client.1.smithi069.stdout:8/550: rename d37/d66/f6f to d37/d47/d78/d93/fb6 0 2024-04-25T17:19:18.085 INFO:tasks.workunit.client.0.smithi037.stdout:9/843: dwrite d1/d48/d68/d4e/fd7 [0,4194304] 0 2024-04-25T17:19:18.089 INFO:tasks.workunit.client.1.smithi069.stdout:7/578: dwrite d4/d18/f4f [0,4194304] 0 2024-04-25T17:19:18.090 INFO:tasks.workunit.client.1.smithi069.stdout:5/567: creat d13/d17/d62/fc5 x:0 0 0 2024-04-25T17:19:18.094 INFO:tasks.workunit.client.1.smithi069.stdout:1/564: symlink d1/d43/d1b/d32/d4a/d4b/la8 0 2024-04-25T17:19:18.095 INFO:tasks.workunit.client.1.smithi069.stdout:0/473: write d0/f6 [573041,85791] 0 2024-04-25T17:19:18.097 INFO:tasks.workunit.client.1.smithi069.stdout:0/474: chown d0/d17/d95/fa7 7541867 1 2024-04-25T17:19:18.099 INFO:tasks.workunit.client.1.smithi069.stdout:4/538: truncate db/d15/d20/d38/f6a 2421997 0 2024-04-25T17:19:18.100 INFO:tasks.workunit.client.0.smithi037.stdout:9/844: truncate d1/d5/dc/d38/f3a 605870 0 2024-04-25T17:19:18.102 INFO:tasks.workunit.client.0.smithi037.stdout:9/845: dread - d1/d5/d19/dde/fe4 zero size 2024-04-25T17:19:18.104 INFO:tasks.workunit.client.1.smithi069.stdout:5/568: unlink d13/c6a 0 2024-04-25T17:19:18.105 INFO:tasks.workunit.client.0.smithi037.stdout:9/846: mkdir d1/d5/d19/d6e/d117 0 2024-04-25T17:19:18.105 INFO:tasks.workunit.client.1.smithi069.stdout:5/569: truncate d13/d17/d29/d2e/f83 634905 0 2024-04-25T17:19:18.106 INFO:tasks.workunit.client.1.smithi069.stdout:5/570: chown d13/l90 292363441 1 2024-04-25T17:19:18.107 INFO:tasks.workunit.client.1.smithi069.stdout:0/475: mkdir d0/da/db/d7e/d80/da9 0 2024-04-25T17:19:18.107 INFO:tasks.workunit.client.1.smithi069.stdout:5/571: chown d13/d17/d29/d30/d5c/f69 8166200 1 2024-04-25T17:19:18.108 INFO:tasks.workunit.client.0.smithi037.stdout:9/847: write d1/d5/dc/f29 [1076891,19377] 0 2024-04-25T17:19:18.108 INFO:tasks.workunit.client.1.smithi069.stdout:0/476: chown d0/da/d6e/f84 39 1 2024-04-25T17:19:18.109 INFO:tasks.workunit.client.1.smithi069.stdout:8/551: symlink d37/d66/lb7 0 2024-04-25T17:19:18.109 INFO:tasks.workunit.client.1.smithi069.stdout:2/540: truncate d0/d1/d5b/f32 335810 0 2024-04-25T17:19:18.111 INFO:tasks.workunit.client.0.smithi037.stdout:9/848: mkdir d1/d5/dc/d3c/d116/d118 0 2024-04-25T17:19:18.111 INFO:tasks.workunit.client.1.smithi069.stdout:2/541: dread - d0/d1/d5b/d33/fa3 zero size 2024-04-25T17:19:18.111 INFO:tasks.workunit.client.1.smithi069.stdout:5/572: creat d13/d17/d62/fc6 x:0 0 0 2024-04-25T17:19:18.113 INFO:tasks.workunit.client.1.smithi069.stdout:9/540: getdents d2/d51 0 2024-04-25T17:19:18.113 INFO:tasks.workunit.client.1.smithi069.stdout:5/573: write d13/d17/d29/d2e/d76/faf [4931918,56504] 0 2024-04-25T17:19:18.115 INFO:tasks.workunit.client.0.smithi037.stdout:9/849: rename d1/d48/d68/d4e to d1/d5/d2e/d34/d76/db4/d119 0 2024-04-25T17:19:18.116 INFO:tasks.workunit.client.1.smithi069.stdout:9/541: read d2/fa1 [66624,35299] 0 2024-04-25T17:19:18.119 INFO:tasks.workunit.client.1.smithi069.stdout:9/542: write d2/da/d5f/d76/f85 [375985,111800] 0 2024-04-25T17:19:18.120 INFO:tasks.workunit.client.1.smithi069.stdout:7/579: dread d4/d6/d14/d3d/f69 [0,4194304] 0 2024-04-25T17:19:18.120 INFO:tasks.workunit.client.0.smithi037.stdout:9/850: creat d1/d5/d19/f11a x:0 0 0 2024-04-25T17:19:18.121 INFO:tasks.workunit.client.1.smithi069.stdout:8/552: symlink d37/d47/d54/d6e/lb8 0 2024-04-25T17:19:18.122 INFO:tasks.workunit.client.1.smithi069.stdout:9/543: write d2/da/dd/d1e/d2e/d68/fb5 [723374,128592] 0 2024-04-25T17:19:18.125 INFO:tasks.workunit.client.0.smithi037.stdout:9/851: mkdir d1/d48/d68/d26/da1/d11b 0 2024-04-25T17:19:18.126 INFO:tasks.workunit.client.0.smithi037.stdout:9/852: chown d1/d5/dc/d38/d8b/fc9 3023 1 2024-04-25T17:19:18.128 INFO:tasks.workunit.client.0.smithi037.stdout:1/778: write dc/d24/f47 [1158020,18937] 0 2024-04-25T17:19:18.129 INFO:tasks.workunit.client.1.smithi069.stdout:8/553: fsync d37/d47/d78/f88 0 2024-04-25T17:19:18.130 INFO:tasks.workunit.client.0.smithi037.stdout:1/779: chown dc/d52/d6b/dd9/d4d/d6a/d8f/ddc/dee 433 1 2024-04-25T17:19:18.136 INFO:tasks.workunit.client.1.smithi069.stdout:2/542: rename d0/d56/d5f/d62/d7d/l40 to d0/d26/d10/d43/d99/laa 0 2024-04-25T17:19:18.137 INFO:tasks.workunit.client.0.smithi037.stdout:1/780: rename dc/d52/d6b/dd9/d4d/c7c to dc/d24/da5/df9/c10b 0 2024-04-25T17:19:18.138 INFO:tasks.workunit.client.1.smithi069.stdout:7/580: symlink d4/d6/d14/d44/da8/lc0 0 2024-04-25T17:19:18.141 INFO:tasks.workunit.client.0.smithi037.stdout:9/853: getdents d1/d48 0 2024-04-25T17:19:18.141 INFO:tasks.workunit.client.1.smithi069.stdout:4/539: write db/d15/d42/d64/f80 [869508,95110] 0 2024-04-25T17:19:18.143 INFO:tasks.workunit.client.0.smithi037.stdout:1/781: mknod dc/d52/d6b/dd9/d4d/d6a/d8f/ddc/dee/dfc/c10c 0 2024-04-25T17:19:18.143 INFO:tasks.workunit.client.1.smithi069.stdout:1/565: dwrite d1/d4/d6/d9e/da6/d7c/f53 [0,4194304] 0 2024-04-25T17:19:18.148 INFO:tasks.workunit.client.0.smithi037.stdout:9/854: dwrite d1/f2 [4194304,4194304] 0 2024-04-25T17:19:18.150 INFO:tasks.workunit.client.0.smithi037.stdout:1/782: mknod dc/d52/d6b/dd9/d22/d36/d74/da6/c10d 0 2024-04-25T17:19:18.156 INFO:tasks.workunit.client.1.smithi069.stdout:0/477: dwrite d0/da/d24/f42 [0,4194304] 0 2024-04-25T17:19:18.158 INFO:tasks.workunit.client.1.smithi069.stdout:5/574: link d13/d17/l67 d13/d17/d19/d96/d9d/lc7 0 2024-04-25T17:19:18.161 INFO:tasks.workunit.client.0.smithi037.stdout:1/783: rename dc/d52/d6b/dd9/d4d/f53 to dc/d52/d6b/dd9/d22/d36/d8c/f10e 0 2024-04-25T17:19:18.166 INFO:tasks.workunit.client.0.smithi037.stdout:9/855: dread d1/d5/dc/dfa/f10b [0,4194304] 0 2024-04-25T17:19:18.168 INFO:tasks.workunit.client.0.smithi037.stdout:1/784: dwrite dc/d52/d6b/dd9/d22/d36/d74/daf/fed [0,4194304] 0 2024-04-25T17:19:18.170 INFO:tasks.workunit.client.1.smithi069.stdout:5/575: dread d13/d17/d29/d30/d5c/f8f [0,4194304] 0 2024-04-25T17:19:18.171 INFO:tasks.workunit.client.1.smithi069.stdout:9/544: dwrite d2/da/d14/d23/d65/d88/f54 [0,4194304] 0 2024-04-25T17:19:18.172 INFO:tasks.workunit.client.1.smithi069.stdout:5/576: stat d13/d17/d29/d30/l37 0 2024-04-25T17:19:18.173 INFO:tasks.workunit.client.1.smithi069.stdout:5/577: stat d13/d17/d19/d20/d2d/f46 0 2024-04-25T17:19:18.174 INFO:tasks.workunit.client.1.smithi069.stdout:5/578: chown d13/d17/d19/d20/d51/db5 1137 1 2024-04-25T17:19:18.178 INFO:tasks.workunit.client.1.smithi069.stdout:8/554: rename l2a to d37/d47/d54/d6e/lb9 0 2024-04-25T17:19:18.179 INFO:tasks.workunit.client.1.smithi069.stdout:8/555: chown l19 13353 1 2024-04-25T17:19:18.179 INFO:tasks.workunit.client.0.smithi037.stdout:1/785: mknod dc/d18/d64/c10f 0 2024-04-25T17:19:18.181 INFO:tasks.workunit.client.0.smithi037.stdout:1/786: truncate dc/f62 4357414 0 2024-04-25T17:19:18.181 INFO:tasks.workunit.client.1.smithi069.stdout:0/478: dwrite d0/da/db/fe [0,4194304] 0 2024-04-25T17:19:18.183 INFO:tasks.workunit.client.1.smithi069.stdout:7/581: getdents d4/d1a/d34 0 2024-04-25T17:19:18.185 INFO:tasks.workunit.client.0.smithi037.stdout:1/787: unlink dc/d52/d6b/dd9/c32 0 2024-04-25T17:19:18.185 INFO:tasks.workunit.client.0.smithi037.stdout:1/788: readlink dc/d24/l50 0 2024-04-25T17:19:18.187 INFO:tasks.workunit.client.1.smithi069.stdout:5/579: fsync f9 0 2024-04-25T17:19:18.190 INFO:tasks.workunit.client.1.smithi069.stdout:0/479: symlink d0/da/db/d56/laa 0 2024-04-25T17:19:18.191 INFO:tasks.workunit.client.1.smithi069.stdout:0/480: chown d0/da/db/d7e/d80/l8d 1 1 2024-04-25T17:19:18.191 INFO:tasks.workunit.client.1.smithi069.stdout:9/545: fsync d2/f39 0 2024-04-25T17:19:18.193 INFO:tasks.workunit.client.0.smithi037.stdout:1/789: creat dc/f110 x:0 0 0 2024-04-25T17:19:18.197 INFO:tasks.workunit.client.0.smithi037.stdout:1/790: creat dc/d52/d6b/dd9/d4d/d6a/d86/d91/f111 x:0 0 0 2024-04-25T17:19:18.198 INFO:tasks.workunit.client.1.smithi069.stdout:4/540: dwrite db/d15/d42/d64/f67 [4194304,4194304] 0 2024-04-25T17:19:18.199 INFO:tasks.workunit.client.1.smithi069.stdout:9/546: dwrite d2/da/dd/d1e/d2e/f45 [0,4194304] 0 2024-04-25T17:19:18.199 INFO:tasks.workunit.client.1.smithi069.stdout:0/481: mkdir d0/da/d59/dab 0 2024-04-25T17:19:18.201 INFO:tasks.workunit.client.0.smithi037.stdout:1/791: mknod dc/d52/c112 0 2024-04-25T17:19:18.202 INFO:tasks.workunit.client.1.smithi069.stdout:5/580: mknod d13/d17/d19/d1c/d79/cc8 0 2024-04-25T17:19:18.204 INFO:tasks.workunit.client.1.smithi069.stdout:1/566: rename d1/d4/d6/d9e/da6/d7c/f37 to d1/d4/d6/fa9 0 2024-04-25T17:19:18.205 INFO:tasks.workunit.client.1.smithi069.stdout:7/582: creat d4/d6/fc1 x:0 0 0 2024-04-25T17:19:18.217 INFO:tasks.workunit.client.1.smithi069.stdout:5/581: rmdir d13/d17/d19/d1c/d79 39 2024-04-25T17:19:18.218 INFO:tasks.workunit.client.1.smithi069.stdout:5/582: stat d13/d17/d19/d1c/d6c 0 2024-04-25T17:19:18.221 INFO:tasks.workunit.client.1.smithi069.stdout:6/522: sync 2024-04-25T17:19:18.224 INFO:tasks.workunit.client.0.smithi037.stdout:1/792: write dc/d18/f7d [927198,49639] 0 2024-04-25T17:19:18.224 INFO:tasks.workunit.client.1.smithi069.stdout:4/541: dread db/d22/d24/d41/f47 [0,4194304] 0 2024-04-25T17:19:18.225 INFO:tasks.workunit.client.0.smithi037.stdout:1/793: write f8 [3267270,9559] 0 2024-04-25T17:19:18.225 INFO:tasks.workunit.client.1.smithi069.stdout:4/542: dread - db/d22/d24/d41/fb7 zero size 2024-04-25T17:19:18.226 INFO:tasks.workunit.client.1.smithi069.stdout:5/583: rmdir d13/d17/d19/d20 39 2024-04-25T17:19:18.227 INFO:tasks.workunit.client.1.smithi069.stdout:5/584: fsync d13/f8b 0 2024-04-25T17:19:18.228 INFO:tasks.workunit.client.1.smithi069.stdout:1/567: mknod d1/caa 0 2024-04-25T17:19:18.228 INFO:tasks.workunit.client.1.smithi069.stdout:0/482: write d0/da/d24/f72 [454661,114747] 0 2024-04-25T17:19:18.230 INFO:tasks.workunit.client.1.smithi069.stdout:7/583: fdatasync d4/d6/d14/d5a/f7f 0 2024-04-25T17:19:18.231 INFO:tasks.workunit.client.0.smithi037.stdout:1/794: rmdir dc/d24/da5/df9 39 2024-04-25T17:19:18.232 INFO:tasks.workunit.client.1.smithi069.stdout:9/547: link d2/da/dd/cab d2/da/dd/d1e/d2e/d35/cc1 0 2024-04-25T17:19:18.232 INFO:tasks.workunit.client.0.smithi037.stdout:1/795: chown dc/d52/d6b 843789 1 2024-04-25T17:19:18.234 INFO:tasks.workunit.client.1.smithi069.stdout:8/556: rename d37/d47/f8d to d37/d47/d54/d6e/fba 0 2024-04-25T17:19:18.234 INFO:tasks.workunit.client.0.smithi037.stdout:1/796: readlink dc/d52/d6b/dd9/d22/d36/d92/db8/dbc/lf8 0 2024-04-25T17:19:18.236 INFO:tasks.workunit.client.0.smithi037.stdout:1/797: write dc/d52/d6b/dd9/d22/d36/d92/fc4 [1233841,7290] 0 2024-04-25T17:19:18.237 INFO:tasks.workunit.client.1.smithi069.stdout:1/568: creat d1/d4/d6/d9e/da6/d7c/d4d/d8f/fab x:0 0 0 2024-04-25T17:19:18.238 INFO:tasks.workunit.client.1.smithi069.stdout:1/569: dread - d1/df/d17/fa1 zero size 2024-04-25T17:19:18.239 INFO:tasks.workunit.client.1.smithi069.stdout:7/584: readlink d4/d6/d14/d5a/l5f 0 2024-04-25T17:19:18.241 INFO:tasks.workunit.client.0.smithi037.stdout:1/798: getdents dc/d24/da5 0 2024-04-25T17:19:18.242 INFO:tasks.workunit.client.0.smithi037.stdout:1/799: write dc/f110 [830987,95082] 0 2024-04-25T17:19:18.243 INFO:tasks.workunit.client.1.smithi069.stdout:8/557: creat d37/d47/d48/d8e/fbb x:0 0 0 2024-04-25T17:19:18.244 INFO:tasks.workunit.client.1.smithi069.stdout:4/543: mkdir db/d15/d20/d35/d63/d70/d8a/d96/dbf 0 2024-04-25T17:19:18.244 INFO:tasks.workunit.client.1.smithi069.stdout:7/585: dread d4/d1a/f2f [0,4194304] 0 2024-04-25T17:19:18.245 INFO:tasks.workunit.client.1.smithi069.stdout:5/585: mknod d13/d17/d19/d20/d51/db5/cc9 0 2024-04-25T17:19:18.246 INFO:tasks.workunit.client.1.smithi069.stdout:8/558: fsync d37/d66/fa3 0 2024-04-25T17:19:18.246 INFO:tasks.workunit.client.1.smithi069.stdout:1/570: dwrite d1/df/f34 [0,4194304] 0 2024-04-25T17:19:18.248 INFO:tasks.workunit.client.1.smithi069.stdout:3/627: sync 2024-04-25T17:19:18.249 INFO:tasks.workunit.client.1.smithi069.stdout:9/548: dread d2/da/dd/de/f12 [0,4194304] 0 2024-04-25T17:19:18.250 INFO:tasks.workunit.client.1.smithi069.stdout:9/549: chown d2/lc0 3576 1 2024-04-25T17:19:18.250 INFO:tasks.workunit.client.1.smithi069.stdout:3/628: write d8/d71/d8d/d92/db6/dc1/f7a [4429925,80479] 0 2024-04-25T17:19:18.251 INFO:tasks.workunit.client.1.smithi069.stdout:4/544: read db/d15/d20/d35/d63/f5c [1222712,128999] 0 2024-04-25T17:19:18.253 INFO:tasks.workunit.client.1.smithi069.stdout:3/629: dread - d8/d16/d9b/dc3/fd9 zero size 2024-04-25T17:19:18.253 INFO:tasks.workunit.client.1.smithi069.stdout:7/586: rmdir d4/d6/d14/d44/da8 39 2024-04-25T17:19:18.254 INFO:tasks.workunit.client.1.smithi069.stdout:9/550: fsync d2/da/dd/d1e/d2e/d68/f72 0 2024-04-25T17:19:18.254 INFO:tasks.workunit.client.1.smithi069.stdout:5/586: write d13/d17/f63 [2934866,16033] 0 2024-04-25T17:19:18.254 INFO:tasks.workunit.client.1.smithi069.stdout:0/483: link d0/da/db/d1d/c82 d0/da/db/d2c/cac 0 2024-04-25T17:19:18.256 INFO:tasks.workunit.client.1.smithi069.stdout:8/559: truncate f26 20402 0 2024-04-25T17:19:18.257 INFO:tasks.workunit.client.1.smithi069.stdout:1/571: creat d1/d4/d6/d4f/d9b/fac x:0 0 0 2024-04-25T17:19:18.257 INFO:tasks.workunit.client.1.smithi069.stdout:8/560: chown d37/d66/c73 137408323 1 2024-04-25T17:19:18.258 INFO:tasks.workunit.client.1.smithi069.stdout:8/561: dread - d37/d47/fb1 zero size 2024-04-25T17:19:18.258 INFO:tasks.workunit.client.1.smithi069.stdout:5/587: truncate d13/d17/d19/d1c/da4/da9/daa/fb2 661538 0 2024-04-25T17:19:18.259 INFO:tasks.workunit.client.1.smithi069.stdout:6/523: rename d2/d1e/d3e/c4c to d2/d1e/d3f/cb9 0 2024-04-25T17:19:18.263 INFO:tasks.workunit.client.1.smithi069.stdout:4/545: mkdir db/d15/d20/d35/d63/d75/dc0 0 2024-04-25T17:19:18.263 INFO:tasks.workunit.client.1.smithi069.stdout:0/484: mkdir d0/da/db/d56/d98/dad 0 2024-04-25T17:19:18.264 INFO:tasks.workunit.client.1.smithi069.stdout:1/572: rmdir d1/d43/d1b/d32/d4a/d4b 39 2024-04-25T17:19:18.265 INFO:tasks.workunit.client.1.smithi069.stdout:5/588: readlink d13/d17/l82 0 2024-04-25T17:19:18.266 INFO:tasks.workunit.client.1.smithi069.stdout:8/562: mknod d37/d47/d54/d6e/d98/cbc 0 2024-04-25T17:19:18.267 INFO:tasks.workunit.client.1.smithi069.stdout:7/587: rename d4/d6/d14/d44/d79/f53 to d4/d18/d36/fc2 0 2024-04-25T17:19:18.268 INFO:tasks.workunit.client.1.smithi069.stdout:7/588: write d4/d6/d14/d44/d79/d23/f27 [2751783,117754] 0 2024-04-25T17:19:18.269 INFO:tasks.workunit.client.1.smithi069.stdout:1/573: mkdir d1/d4/d6/d9e/da6/d7c/d1d/dad 0 2024-04-25T17:19:18.271 INFO:tasks.workunit.client.1.smithi069.stdout:5/589: creat d13/d17/d19/d1c/da4/da9/fca x:0 0 0 2024-04-25T17:19:18.273 INFO:tasks.workunit.client.1.smithi069.stdout:4/546: mknod db/d15/d20/d35/d63/d43/d48/d49/cc1 0 2024-04-25T17:19:18.274 INFO:tasks.workunit.client.0.smithi037.stdout:2/683: sync 2024-04-25T17:19:18.274 INFO:tasks.workunit.client.1.smithi069.stdout:7/589: mkdir d4/d6/d14/d44/d79/d23/dc3 0 2024-04-25T17:19:18.275 INFO:tasks.workunit.client.1.smithi069.stdout:8/563: readlink d37/d66/d6b/l80 0 2024-04-25T17:19:18.277 INFO:tasks.workunit.client.1.smithi069.stdout:8/564: read d37/d47/d48/f71 [509261,23580] 0 2024-04-25T17:19:18.277 INFO:tasks.workunit.client.1.smithi069.stdout:1/574: mknod d1/d4/d6/d9e/da6/d7c/d4d/cae 0 2024-04-25T17:19:18.278 INFO:tasks.workunit.client.0.smithi037.stdout:1/800: mkdir dc/d52/d6b/dd9/d22/d113 0 2024-04-25T17:19:18.278 INFO:tasks.workunit.client.1.smithi069.stdout:5/590: creat d13/d17/d62/fcb x:0 0 0 2024-04-25T17:19:18.279 INFO:tasks.workunit.client.1.smithi069.stdout:5/591: stat d13/f16 0 2024-04-25T17:19:18.279 INFO:tasks.workunit.client.1.smithi069.stdout:3/630: write f6 [671241,72815] 0 2024-04-25T17:19:18.281 INFO:tasks.workunit.client.1.smithi069.stdout:5/592: read f5 [7525864,120010] 0 2024-04-25T17:19:18.377 INFO:tasks.workunit.client.1.smithi069.stdout:2/543: sync 2024-04-25T17:19:18.400 INFO:tasks.workunit.client.1.smithi069.stdout:0/485: sync 2024-04-25T17:19:18.417 INFO:tasks.workunit.client.1.smithi069.stdout:4/547: read f7 [242993,79486] 0 2024-04-25T17:19:18.417 INFO:tasks.workunit.client.0.smithi037.stdout:2/684: creat d0/d16/d20/db9/fe0 x:0 0 0 2024-04-25T17:19:18.419 INFO:tasks.workunit.client.1.smithi069.stdout:7/590: rename d4/d18/d36/l9d to d4/d18/lc4 0 2024-04-25T17:19:18.421 INFO:tasks.workunit.client.1.smithi069.stdout:9/551: dwrite d2/da/dd/d1e/d2e/d68/d8f/fad [0,4194304] 0 2024-04-25T17:19:18.422 INFO:tasks.workunit.client.1.smithi069.stdout:9/552: dread - d2/da/dd/de/d74/d8a/fb9 zero size 2024-04-25T17:19:18.452 INFO:tasks.workunit.client.0.smithi037.stdout:1/801: symlink dc/d52/d6b/dd9/d22/d36/l114 0 2024-04-25T17:19:18.454 INFO:tasks.workunit.client.1.smithi069.stdout:8/565: creat d37/d47/d54/fbd x:0 0 0 2024-04-25T17:19:18.454 INFO:tasks.workunit.client.1.smithi069.stdout:8/566: dread - d37/d47/d54/f92 zero size 2024-04-25T17:19:18.454 INFO:tasks.workunit.client.1.smithi069.stdout:8/567: readlink d37/d62/l9f 0 2024-04-25T17:19:18.455 INFO:tasks.workunit.client.0.smithi037.stdout:2/685: unlink d0/d16/d20/d59/d6a/da5/fce 0 2024-04-25T17:19:18.456 INFO:tasks.workunit.client.0.smithi037.stdout:2/686: stat d0/d16/d20/d55/cb1 0 2024-04-25T17:19:18.457 INFO:tasks.workunit.client.0.smithi037.stdout:1/802: symlink dc/d52/l115 0 2024-04-25T17:19:18.460 INFO:tasks.workunit.client.1.smithi069.stdout:8/568: dwrite d37/d66/fa3 [0,4194304] 0 2024-04-25T17:19:18.460 INFO:tasks.workunit.client.1.smithi069.stdout:6/524: getdents d2/d1e/d3e/d67 0 2024-04-25T17:19:18.461 INFO:tasks.workunit.client.0.smithi037.stdout:1/803: fsync dc/d24/da5/fda 0 2024-04-25T17:19:18.463 INFO:tasks.workunit.client.1.smithi069.stdout:3/631: mknod d8/d16/d31/cde 0 2024-04-25T17:19:18.463 INFO:tasks.workunit.client.0.smithi037.stdout:1/804: read dc/d52/d6b/dd9/d22/d36/f40 [166300,1184] 0 2024-04-25T17:19:18.468 INFO:tasks.workunit.client.1.smithi069.stdout:4/548: mknod db/d22/d24/d41/cc2 0 2024-04-25T17:19:18.470 INFO:tasks.workunit.client.1.smithi069.stdout:7/591: fdatasync d4/d6/d14/f48 0 2024-04-25T17:19:18.470 INFO:tasks.workunit.client.1.smithi069.stdout:4/549: chown db/d15/d20/d35/d63/d43/d48/f7c 131001746 1 2024-04-25T17:19:18.471 INFO:tasks.workunit.client.1.smithi069.stdout:5/593: dwrite d13/d17/d29/f43 [0,4194304] 0 2024-04-25T17:19:18.471 INFO:tasks.workunit.client.0.smithi037.stdout:1/805: creat dc/d52/d6b/dd9/d4d/d6a/de3/f116 x:0 0 0 2024-04-25T17:19:18.471 INFO:tasks.workunit.client.1.smithi069.stdout:4/550: chown db/d22/d24/d41 20198049 1 2024-04-25T17:19:18.472 INFO:tasks.workunit.client.1.smithi069.stdout:4/551: readlink db/d15/d20/d38/la6 0 2024-04-25T17:19:18.477 INFO:tasks.workunit.client.0.smithi037.stdout:1/806: mkdir dc/d52/d6b/dd9/d4d/d6a/d117 0 2024-04-25T17:19:18.477 INFO:tasks.workunit.client.0.smithi037.stdout:1/807: readlink dc/d52/l94 0 2024-04-25T17:19:18.480 INFO:tasks.workunit.client.0.smithi037.stdout:2/687: truncate d0/d16/d20/d59/d6a/f8c 787674 0 2024-04-25T17:19:18.483 INFO:tasks.workunit.client.1.smithi069.stdout:8/569: creat d37/d62/fbe x:0 0 0 2024-04-25T17:19:18.487 INFO:tasks.workunit.client.1.smithi069.stdout:3/632: dread d8/d16/d1a/d2c/f63 [0,4194304] 0 2024-04-25T17:19:18.489 INFO:tasks.workunit.client.1.smithi069.stdout:2/544: dread - d0/d56/d5f/d62/d7d/d31/d61/f75 zero size 2024-04-25T17:19:18.490 INFO:tasks.workunit.client.1.smithi069.stdout:0/486: sync 2024-04-25T17:19:18.490 INFO:tasks.workunit.client.1.smithi069.stdout:0/487: stat d0/da/d24/c44 0 2024-04-25T17:19:18.491 INFO:tasks.workunit.client.1.smithi069.stdout:1/575: truncate d1/df/f34 3228943 0 2024-04-25T17:19:18.494 INFO:tasks.workunit.client.1.smithi069.stdout:5/594: write d13/d17/d19/d1c/f89 [7132663,83804] 0 2024-04-25T17:19:18.495 INFO:tasks.workunit.client.1.smithi069.stdout:5/595: stat d13/d17/d19/d1c/l5b 0 2024-04-25T17:19:18.496 INFO:tasks.workunit.client.1.smithi069.stdout:9/553: mknod d2/da/dd/de/d74/dbc/cc2 0 2024-04-25T17:19:18.496 INFO:tasks.workunit.client.1.smithi069.stdout:5/596: dread - d13/d17/d19/d20/f9a zero size 2024-04-25T17:19:18.497 INFO:tasks.workunit.client.1.smithi069.stdout:9/554: chown d2/da/d14/f79 7 1 2024-04-25T17:19:18.497 INFO:tasks.workunit.client.1.smithi069.stdout:9/555: chown d2/da/dd/de/d74/d8a 52167 1 2024-04-25T17:19:18.498 INFO:tasks.workunit.client.0.smithi037.stdout:1/808: rename dc/d18/c8b to dc/d52/d6b/dd9/d4d/d6a/c118 0 2024-04-25T17:19:18.499 INFO:tasks.workunit.client.0.smithi037.stdout:2/688: write d0/d15/d2a/d5a/fa3 [754387,9431] 0 2024-04-25T17:19:18.500 INFO:tasks.workunit.client.1.smithi069.stdout:8/570: creat d37/d62/fbf x:0 0 0 2024-04-25T17:19:18.501 INFO:tasks.workunit.client.1.smithi069.stdout:6/525: mknod d2/d9c/cba 0 2024-04-25T17:19:18.505 INFO:tasks.workunit.client.1.smithi069.stdout:3/633: symlink d8/d16/d1a/d2c/d6c/ldf 0 2024-04-25T17:19:18.506 INFO:tasks.workunit.client.1.smithi069.stdout:2/545: symlink d0/d26/lab 0 2024-04-25T17:19:18.514 INFO:tasks.workunit.client.1.smithi069.stdout:9/556: rename d2/f39 to d2/da/dd/d1e/d2e/d35/fc3 0 2024-04-25T17:19:18.518 INFO:tasks.workunit.client.0.smithi037.stdout:2/689: write d0/d16/d3c/fbc [237732,103477] 0 2024-04-25T17:19:18.520 INFO:tasks.workunit.client.1.smithi069.stdout:5/597: dread d13/d17/f7f [0,4194304] 0 2024-04-25T17:19:18.520 INFO:tasks.workunit.client.1.smithi069.stdout:3/634: dread d8/d71/d8d/f8f [0,4194304] 0 2024-04-25T17:19:18.521 INFO:tasks.workunit.client.1.smithi069.stdout:8/571: rename d37/d62/fbe to d37/d47/d48/fc0 0 2024-04-25T17:19:18.523 INFO:tasks.workunit.client.0.smithi037.stdout:2/690: rmdir d0/d23/dac/d4b 39 2024-04-25T17:19:18.523 INFO:tasks.workunit.client.1.smithi069.stdout:1/576: dwrite d1/d43/f8a [0,4194304] 0 2024-04-25T17:19:18.524 INFO:tasks.workunit.client.0.smithi037.stdout:2/691: write d0/d15/dcb/fd7 [415420,53703] 0 2024-04-25T17:19:18.524 INFO:tasks.workunit.client.1.smithi069.stdout:1/577: chown d1/d4/d6/d9e/da6/d7c/d1d/dad 628324 1 2024-04-25T17:19:18.525 INFO:tasks.workunit.client.1.smithi069.stdout:4/552: write db/d15/d20/d38/f6a [2352011,81609] 0 2024-04-25T17:19:18.527 INFO:tasks.workunit.client.1.smithi069.stdout:1/578: truncate d1/df/f30 927750 0 2024-04-25T17:19:18.528 INFO:tasks.workunit.client.1.smithi069.stdout:7/592: link d4/d3e/c50 d4/d6/d14/d3d/d47/cc5 0 2024-04-25T17:19:18.534 INFO:tasks.workunit.client.1.smithi069.stdout:9/557: unlink d2/da/d14/d23/f43 0 2024-04-25T17:19:18.535 INFO:tasks.workunit.client.1.smithi069.stdout:2/546: link d0/l1c d0/d26/d10/d43/d99/lac 0 2024-04-25T17:19:18.536 INFO:tasks.workunit.client.1.smithi069.stdout:6/526: dwrite d2/f14 [4194304,4194304] 0 2024-04-25T17:19:18.536 INFO:tasks.workunit.client.1.smithi069.stdout:7/593: dwrite d4/d6/d14/d44/d79/d23/f27 [0,4194304] 0 2024-04-25T17:19:18.537 INFO:tasks.workunit.client.1.smithi069.stdout:3/635: creat d8/d16/d1a/d2c/d49/dbc/fe0 x:0 0 0 2024-04-25T17:19:18.538 INFO:tasks.workunit.client.1.smithi069.stdout:8/572: symlink d37/lc1 0 2024-04-25T17:19:18.539 INFO:tasks.workunit.client.1.smithi069.stdout:4/553: write db/d22/d24/d41/f47 [4462627,96633] 0 2024-04-25T17:19:18.540 INFO:tasks.workunit.client.1.smithi069.stdout:5/598: link d13/d17/f7f d13/d17/d19/d20/d51/db5/fcc 0 2024-04-25T17:19:18.541 INFO:tasks.workunit.client.1.smithi069.stdout:4/554: chown db/d15/d20 8506 1 2024-04-25T17:19:18.541 INFO:tasks.workunit.client.1.smithi069.stdout:7/594: chown d4/d18/d36 62495681 1 2024-04-25T17:19:18.542 INFO:tasks.workunit.client.1.smithi069.stdout:9/558: mkdir d2/da/d14/d23/d65/dc4 0 2024-04-25T17:19:18.542 INFO:tasks.workunit.client.1.smithi069.stdout:4/555: fdatasync f8 0 2024-04-25T17:19:18.542 INFO:tasks.workunit.client.1.smithi069.stdout:2/547: creat d0/d56/d5f/d62/d7d/d31/d61/fad x:0 0 0 2024-04-25T17:19:18.545 INFO:tasks.workunit.client.1.smithi069.stdout:9/559: stat d2/da/d5f/d76/f85 0 2024-04-25T17:19:18.545 INFO:tasks.workunit.client.1.smithi069.stdout:4/556: write db/d4b/f89 [574254,32720] 0 2024-04-25T17:19:18.545 INFO:tasks.workunit.client.1.smithi069.stdout:3/636: creat d8/d8b/db2/fe1 x:0 0 0 2024-04-25T17:19:18.549 INFO:tasks.workunit.client.1.smithi069.stdout:8/573: rename d37/d62/fbf to d37/d66/d6b/fc2 0 2024-04-25T17:19:18.550 INFO:tasks.workunit.client.1.smithi069.stdout:1/579: getdents d1/d4/d6/d9e/da6/d7c/d1d 0 2024-04-25T17:19:18.551 INFO:tasks.workunit.client.1.smithi069.stdout:6/527: creat d2/d9c/d97/d98/fbb x:0 0 0 2024-04-25T17:19:18.553 INFO:tasks.workunit.client.1.smithi069.stdout:7/595: creat d4/d6/d14/d44/d79/da4/fc6 x:0 0 0 2024-04-25T17:19:18.553 INFO:tasks.workunit.client.1.smithi069.stdout:2/548: fdatasync d0/d26/d10/d43/f74 0 2024-04-25T17:19:18.555 INFO:tasks.workunit.client.1.smithi069.stdout:3/637: rename d8/d16/d9b/dc3/fd9 to d8/d16/d4b/d9e/dca/fe2 0 2024-04-25T17:19:18.555 INFO:tasks.workunit.client.1.smithi069.stdout:8/574: write d37/f87 [464549,36828] 0 2024-04-25T17:19:18.557 INFO:tasks.workunit.client.1.smithi069.stdout:5/599: dwrite d13/d17/d29/f43 [4194304,4194304] 0 2024-04-25T17:19:18.558 INFO:tasks.workunit.client.1.smithi069.stdout:6/528: mkdir d2/d7/dbc 0 2024-04-25T17:19:18.558 INFO:tasks.workunit.client.1.smithi069.stdout:1/580: read d1/f5 [11661630,26298] 0 2024-04-25T17:19:18.559 INFO:tasks.workunit.client.1.smithi069.stdout:7/596: fdatasync d4/d1a/d34/f65 0 2024-04-25T17:19:18.559 INFO:tasks.workunit.client.1.smithi069.stdout:3/638: chown d8/d16/d31/f44 532957599 1 2024-04-25T17:19:18.565 INFO:tasks.workunit.client.1.smithi069.stdout:4/557: dwrite db/d15/d20/d35/d63/fbe [0,4194304] 0 2024-04-25T17:19:18.565 INFO:tasks.workunit.client.1.smithi069.stdout:2/549: mkdir d0/d56/d5f/d62/d7d/d31/d61/dae 0 2024-04-25T17:19:18.565 INFO:tasks.workunit.client.1.smithi069.stdout:3/639: chown f5 1642 1 2024-04-25T17:19:18.565 INFO:tasks.workunit.client.1.smithi069.stdout:6/529: write d2/f14 [6006521,116697] 0 2024-04-25T17:19:18.565 INFO:tasks.workunit.client.1.smithi069.stdout:7/597: dread - d4/d3e/d94/da1/fab zero size 2024-04-25T17:19:18.569 INFO:tasks.workunit.client.1.smithi069.stdout:3/640: readlink d8/d16/d1a/d38/l3b 0 2024-04-25T17:19:18.569 INFO:tasks.workunit.client.1.smithi069.stdout:5/600: read d13/d17/d29/d30/d9c/fbe [663653,10694] 0 2024-04-25T17:19:18.578 INFO:tasks.workunit.client.1.smithi069.stdout:4/558: dread f0 [0,4194304] 0 2024-04-25T17:19:18.584 INFO:tasks.workunit.client.1.smithi069.stdout:3/641: dread d8/d16/d31/f44 [0,4194304] 0 2024-04-25T17:19:18.624 INFO:tasks.workunit.client.1.smithi069.stdout:1/581: mknod d1/d4/d6/d9e/da6/d38/caf 0 2024-04-25T17:19:18.625 INFO:tasks.workunit.client.1.smithi069.stdout:7/598: write d4/f4a [3720058,62696] 0 2024-04-25T17:19:18.626 INFO:tasks.workunit.client.1.smithi069.stdout:7/599: fsync d4/d6/d14/d15/f28 0 2024-04-25T17:19:18.627 INFO:tasks.workunit.client.1.smithi069.stdout:6/530: dread - d2/d1e/d3f/f96 zero size 2024-04-25T17:19:18.652 INFO:tasks.workunit.client.1.smithi069.stdout:0/488: sync 2024-04-25T17:19:18.661 INFO:tasks.workunit.client.0.smithi037.stdout:4/853: sync 2024-04-25T17:19:18.664 INFO:tasks.workunit.client.1.smithi069.stdout:5/601: symlink d13/d17/d19/d96/d9d/lcd 0 2024-04-25T17:19:18.665 INFO:tasks.workunit.client.1.smithi069.stdout:4/559: creat db/d15/d20/d35/d63/d43/d48/fc3 x:0 0 0 2024-04-25T17:19:18.666 INFO:tasks.workunit.client.1.smithi069.stdout:3/642: symlink d8/d71/d8d/le3 0 2024-04-25T17:19:18.667 INFO:tasks.workunit.client.0.smithi037.stdout:4/854: mknod d7/d7e/c11c 0 2024-04-25T17:19:18.668 INFO:tasks.workunit.client.1.smithi069.stdout:1/582: rmdir d1/df 39 2024-04-25T17:19:18.670 INFO:tasks.workunit.client.1.smithi069.stdout:2/550: mkdir d0/d56/d5f/d62/d7d/d72/daf 0 2024-04-25T17:19:18.670 INFO:tasks.workunit.client.0.smithi037.stdout:4/855: rmdir d7/d7e/d5b/dfe/d39/dba 39 2024-04-25T17:19:18.670 INFO:tasks.workunit.client.1.smithi069.stdout:2/551: chown d0/d26/f23 153 1 2024-04-25T17:19:18.672 INFO:tasks.workunit.client.0.smithi037.stdout:4/856: fdatasync d7/d7e/d5b/f8c 0 2024-04-25T17:19:18.674 INFO:tasks.workunit.client.1.smithi069.stdout:6/531: rename d2/d9c/d97/d98/fbb to d2/d1e/d3f/d56/fbd 0 2024-04-25T17:19:18.675 INFO:tasks.workunit.client.1.smithi069.stdout:6/532: readlink d2/d51/d85/l9b 0 2024-04-25T17:19:18.676 INFO:tasks.workunit.client.1.smithi069.stdout:5/602: mkdir d13/d17/d19/d8a/dce 0 2024-04-25T17:19:18.676 INFO:tasks.workunit.client.1.smithi069.stdout:5/603: stat d13/f8c 0 2024-04-25T17:19:18.679 INFO:tasks.workunit.client.1.smithi069.stdout:4/560: rename db/d22/d24 to db/d4b/d78/dc4 0 2024-04-25T17:19:18.681 INFO:tasks.workunit.client.1.smithi069.stdout:0/489: symlink d0/da/db/lae 0 2024-04-25T17:19:18.682 INFO:tasks.workunit.client.1.smithi069.stdout:2/552: dread d0/d56/d5f/d62/d7d/d31/d61/f85 [0,4194304] 0 2024-04-25T17:19:18.684 INFO:tasks.workunit.client.1.smithi069.stdout:1/583: truncate d1/d4/d6/d9e/da6/d7c/f14 4561559 0 2024-04-25T17:19:18.686 INFO:tasks.workunit.client.1.smithi069.stdout:7/600: truncate d4/d6/d14/d15/f90 126395 0 2024-04-25T17:19:18.687 INFO:tasks.workunit.client.1.smithi069.stdout:6/533: mkdir d2/d1e/d43/db6/daf/dbe 0 2024-04-25T17:19:18.689 INFO:tasks.workunit.client.1.smithi069.stdout:1/584: dread - d1/df/d17/fa1 zero size 2024-04-25T17:19:18.689 INFO:tasks.workunit.client.1.smithi069.stdout:7/601: dread d4/d1a/f35 [0,4194304] 0 2024-04-25T17:19:18.690 INFO:tasks.workunit.client.1.smithi069.stdout:1/585: readlink d1/d4/d6/d4f/l87 0 2024-04-25T17:19:18.695 INFO:tasks.workunit.client.1.smithi069.stdout:6/534: symlink d2/d9c/d97/dad/lbf 0 2024-04-25T17:19:18.696 INFO:tasks.workunit.client.1.smithi069.stdout:0/490: dread d0/da/d6e/f84 [0,4194304] 0 2024-04-25T17:19:18.696 INFO:tasks.workunit.client.1.smithi069.stdout:5/604: link d13/d17/d29/d30/d9c/fbe d13/d17/d29/d30/d5c/fcf 0 2024-04-25T17:19:18.700 INFO:tasks.workunit.client.1.smithi069.stdout:7/602: rename d4/d6 to d4/d3e/d94/da1/dc7 0 2024-04-25T17:19:18.700 INFO:tasks.workunit.client.1.smithi069.stdout:4/561: dwrite db/d22/f71 [0,4194304] 0 2024-04-25T17:19:18.702 INFO:tasks.workunit.client.1.smithi069.stdout:6/535: mknod d2/d1e/d3e/d67/cc0 0 2024-04-25T17:19:18.703 INFO:tasks.workunit.client.1.smithi069.stdout:6/536: chown d2/d1e/f33 3798 1 2024-04-25T17:19:18.705 INFO:tasks.workunit.client.1.smithi069.stdout:5/605: unlink d13/d17/d29/d2e/d76/fbd 0 2024-04-25T17:19:18.707 INFO:tasks.workunit.client.1.smithi069.stdout:5/606: read d13/d17/d29/f43 [4940012,77498] 0 2024-04-25T17:19:18.713 INFO:tasks.workunit.client.1.smithi069.stdout:0/491: link d0/f79 d0/da/db/d2a/faf 0 2024-04-25T17:19:18.713 INFO:tasks.workunit.client.1.smithi069.stdout:0/492: write d0/da/d24/f42 [1588195,30961] 0 2024-04-25T17:19:18.714 INFO:tasks.workunit.client.1.smithi069.stdout:5/607: creat d13/d17/d19/d1c/da4/fd0 x:0 0 0 2024-04-25T17:19:18.715 INFO:tasks.workunit.client.1.smithi069.stdout:0/493: write d0/da/d24/d43/f60 [8816941,28592] 0 2024-04-25T17:19:18.715 INFO:tasks.workunit.client.1.smithi069.stdout:4/562: symlink db/d15/d20/d35/d63/d70/d8a/d96/dbf/lc5 0 2024-04-25T17:19:18.717 INFO:tasks.workunit.client.1.smithi069.stdout:5/608: write d13/d17/d19/d1c/d6c/f98 [1209019,66441] 0 2024-04-25T17:19:18.717 INFO:tasks.workunit.client.1.smithi069.stdout:0/494: read d0/da/d24/f72 [182467,84107] 0 2024-04-25T17:19:18.721 INFO:tasks.workunit.client.1.smithi069.stdout:1/586: truncate d1/d43/f8a 20655 0 2024-04-25T17:19:18.722 INFO:tasks.workunit.client.1.smithi069.stdout:6/537: creat d2/fc1 x:0 0 0 2024-04-25T17:19:18.726 INFO:tasks.workunit.client.1.smithi069.stdout:4/563: mknod db/d15/d20/d35/d63/d43/d48/d49/d4e/cc6 0 2024-04-25T17:19:18.727 INFO:tasks.workunit.client.1.smithi069.stdout:0/495: symlink d0/d38/d75/lb0 0 2024-04-25T17:19:18.728 INFO:tasks.workunit.client.1.smithi069.stdout:5/609: rename l2 to d13/d17/d29/d30/ld1 0 2024-04-25T17:19:18.729 INFO:tasks.workunit.client.1.smithi069.stdout:5/610: readlink d13/d17/d19/d20/d51/db5/lc2 0 2024-04-25T17:19:18.730 INFO:tasks.workunit.client.1.smithi069.stdout:7/603: getdents d4/d3e/d94/da1/dc7/d14/d44/d7c 0 2024-04-25T17:19:18.731 INFO:tasks.workunit.client.1.smithi069.stdout:1/587: symlink d1/d4/d6/d4f/d9b/da3/lb0 0 2024-04-25T17:19:18.733 INFO:tasks.workunit.client.1.smithi069.stdout:0/496: mknod d0/da/d24/d67/cb1 0 2024-04-25T17:19:18.733 INFO:tasks.workunit.client.1.smithi069.stdout:0/497: read - d0/f79 zero size 2024-04-25T17:19:18.733 INFO:tasks.workunit.client.1.smithi069.stdout:5/611: creat d13/d17/d62/fd2 x:0 0 0 2024-04-25T17:19:18.734 INFO:tasks.workunit.client.1.smithi069.stdout:7/604: mkdir d4/d3e/dc8 0 2024-04-25T17:19:18.734 INFO:tasks.workunit.client.1.smithi069.stdout:7/605: stat d4/f10 0 2024-04-25T17:19:18.736 INFO:tasks.workunit.client.1.smithi069.stdout:1/588: creat d1/d4/d6/d9e/da6/d7c/d4d/fb1 x:0 0 0 2024-04-25T17:19:18.736 INFO:tasks.workunit.client.1.smithi069.stdout:7/606: chown d4/d3e/d94/da1/dc7/d14/d44/d7c/lb9 0 1 2024-04-25T17:19:18.738 INFO:tasks.workunit.client.1.smithi069.stdout:4/564: rmdir db/d4b/d78/dc4/d41/d92 0 2024-04-25T17:19:18.739 INFO:tasks.workunit.client.1.smithi069.stdout:4/565: readlink db/d15/d20/d35/d63/d70/d8a/d96/dbf/lc5 0 2024-04-25T17:19:18.740 INFO:tasks.workunit.client.1.smithi069.stdout:1/589: creat d1/d4/d6/d9e/da6/d7c/d1d/fb2 x:0 0 0 2024-04-25T17:19:18.740 INFO:tasks.workunit.client.1.smithi069.stdout:0/498: mknod d0/da/db/d1d/cb2 0 2024-04-25T17:19:18.743 INFO:tasks.workunit.client.1.smithi069.stdout:9/560: sync 2024-04-25T17:19:18.743 INFO:tasks.workunit.client.1.smithi069.stdout:6/538: getdents d2/d9c 0 2024-04-25T17:19:18.745 INFO:tasks.workunit.client.1.smithi069.stdout:1/590: mknod d1/d4/d6/d9e/da6/cb3 0 2024-04-25T17:19:18.746 INFO:tasks.workunit.client.1.smithi069.stdout:6/539: dread d2/d51/d85/f6f [0,4194304] 0 2024-04-25T17:19:18.750 INFO:tasks.workunit.client.1.smithi069.stdout:7/607: dread d4/d3e/d94/da1/dc7/d14/d44/d79/d23/f6b [0,4194304] 0 2024-04-25T17:19:18.750 INFO:tasks.workunit.client.1.smithi069.stdout:5/612: rmdir d13/d17/d19/d20/d2d/dc3 0 2024-04-25T17:19:18.751 INFO:tasks.workunit.client.0.smithi037.stdout:0/687: sync 2024-04-25T17:19:18.753 INFO:tasks.workunit.client.1.smithi069.stdout:4/566: link db/d15/d20/d35/d63/d43/d48/fc3 db/d4b/d78/dc4/d41/d9e/fc7 0 2024-04-25T17:19:18.754 INFO:tasks.workunit.client.0.smithi037.stdout:0/688: creat d9/df/d32/d35/fe4 x:0 0 0 2024-04-25T17:19:18.755 INFO:tasks.workunit.client.1.smithi069.stdout:4/567: chown db/d15/d20/d35/f8c 1730 1 2024-04-25T17:19:18.755 INFO:tasks.workunit.client.1.smithi069.stdout:0/499: truncate d0/d36/f2b 2105641 0 2024-04-25T17:19:18.757 INFO:tasks.workunit.client.1.smithi069.stdout:4/568: write db/d22/f71 [5336224,35509] 0 2024-04-25T17:19:18.759 INFO:tasks.workunit.client.0.smithi037.stdout:0/689: rename d9/df/d32/d35/c87 to d9/df/dbd/dc1/ce5 0 2024-04-25T17:19:18.761 INFO:tasks.workunit.client.1.smithi069.stdout:1/591: mkdir d1/d43/d1b/d32/d4a/db4 0 2024-04-25T17:19:18.765 INFO:tasks.workunit.client.1.smithi069.stdout:9/561: write d2/da/d14/f79 [1173344,99374] 0 2024-04-25T17:19:18.766 INFO:tasks.workunit.client.1.smithi069.stdout:6/540: dread d2/d7/f25 [0,4194304] 0 2024-04-25T17:19:18.768 INFO:tasks.workunit.client.1.smithi069.stdout:4/569: dwrite db/d15/d20/d35/d63/d43/f97 [0,4194304] 0 2024-04-25T17:19:18.768 INFO:tasks.workunit.client.1.smithi069.stdout:9/562: write d2/f6 [4958047,90844] 0 2024-04-25T17:19:18.768 INFO:tasks.workunit.client.1.smithi069.stdout:5/613: dread d13/d17/d19/d20/f77 [0,4194304] 0 2024-04-25T17:19:18.770 INFO:tasks.workunit.client.1.smithi069.stdout:7/608: dread d4/d1a/d34/f68 [0,4194304] 0 2024-04-25T17:19:18.774 INFO:tasks.workunit.client.1.smithi069.stdout:0/500: mknod d0/da/db/d7e/d80/da9/cb3 0 2024-04-25T17:19:18.775 INFO:tasks.workunit.client.0.smithi037.stdout:0/690: rmdir d9 39 2024-04-25T17:19:18.775 INFO:tasks.workunit.client.1.smithi069.stdout:0/501: chown d0/da/d54/ca1 164 1 2024-04-25T17:19:18.776 INFO:tasks.workunit.client.1.smithi069.stdout:0/502: chown d0/d17/d95/fa7 1 1 2024-04-25T17:19:18.777 INFO:tasks.workunit.client.1.smithi069.stdout:0/503: truncate d0/f2f 3708657 0 2024-04-25T17:19:18.777 INFO:tasks.workunit.client.1.smithi069.stdout:1/592: dread d1/d4/f2a [0,4194304] 0 2024-04-25T17:19:18.781 INFO:tasks.workunit.client.1.smithi069.stdout:9/563: mknod d2/da/dd/de/d74/cc5 0 2024-04-25T17:19:18.783 INFO:tasks.workunit.client.1.smithi069.stdout:5/614: rename d13/d17/d29/d30/l3b to d13/d17/d19/d20/ld3 0 2024-04-25T17:19:18.783 INFO:tasks.workunit.client.1.smithi069.stdout:8/575: sync 2024-04-25T17:19:18.783 INFO:tasks.workunit.client.1.smithi069.stdout:9/564: read d2/da/dd/d1e/d2e/d35/f5a [133143,119079] 0 2024-04-25T17:19:18.784 INFO:tasks.workunit.client.1.smithi069.stdout:5/615: dread - d13/d17/d62/fc5 zero size 2024-04-25T17:19:18.788 INFO:tasks.workunit.client.1.smithi069.stdout:6/541: unlink d2/d7/l2c 0 2024-04-25T17:19:18.790 INFO:tasks.workunit.client.1.smithi069.stdout:7/609: rename d4/d3e/d94/da1/dc7/d14/d44/d79/d23/f27 to d4/d83/fc9 0 2024-04-25T17:19:18.792 INFO:tasks.workunit.client.1.smithi069.stdout:4/570: dwrite db/f12 [0,4194304] 0 2024-04-25T17:19:18.792 INFO:tasks.workunit.client.1.smithi069.stdout:5/616: dwrite d13/d17/d19/d20/d2d/f72 [0,4194304] 0 2024-04-25T17:19:18.794 INFO:tasks.workunit.client.1.smithi069.stdout:7/610: truncate d4/d3e/d94/da1/dc7/f52 1856172 0 2024-04-25T17:19:18.794 INFO:tasks.workunit.client.1.smithi069.stdout:9/565: creat d2/da/d14/d23/fc6 x:0 0 0 2024-04-25T17:19:18.794 INFO:tasks.workunit.client.1.smithi069.stdout:1/593: symlink d1/d4/d6/lb5 0 2024-04-25T17:19:18.801 INFO:tasks.workunit.client.1.smithi069.stdout:1/594: readlink d1/d4/d6/d81/l93 0 2024-04-25T17:19:18.801 INFO:tasks.workunit.client.0.smithi037.stdout:3/498: sync 2024-04-25T17:19:18.803 INFO:tasks.workunit.client.0.smithi037.stdout:0/691: dread - d9/df/d32/dd1/d7a/fc9 zero size 2024-04-25T17:19:18.805 INFO:tasks.workunit.client.1.smithi069.stdout:5/617: dwrite d13/d17/d19/d1c/d6c/fb1 [0,4194304] 0 2024-04-25T17:19:18.805 INFO:tasks.workunit.client.1.smithi069.stdout:8/576: creat d37/d66/fc3 x:0 0 0 2024-04-25T17:19:18.807 INFO:tasks.workunit.client.0.smithi037.stdout:0/692: unlink d9/d14/d28/d48/d58/fac 0 2024-04-25T17:19:18.807 INFO:tasks.workunit.client.1.smithi069.stdout:6/542: dwrite d2/d7/f94 [4194304,4194304] 0 2024-04-25T17:19:18.811 INFO:tasks.workunit.client.1.smithi069.stdout:1/595: creat d1/d43/fb6 x:0 0 0 2024-04-25T17:19:18.811 INFO:tasks.workunit.client.1.smithi069.stdout:0/504: link d0/da/d59/l77 d0/da/db/d1d/d5f/lb4 0 2024-04-25T17:19:18.815 INFO:tasks.workunit.client.0.smithi037.stdout:0/693: dwrite d9/df/d32/d39/d68/da7/db4/fd0 [0,4194304] 0 2024-04-25T17:19:18.817 INFO:tasks.workunit.client.1.smithi069.stdout:1/596: read d1/d43/f3a [3626306,84280] 0 2024-04-25T17:19:18.817 INFO:tasks.workunit.client.0.smithi037.stdout:0/694: dread - d9/df/d32/d35/fe4 zero size 2024-04-25T17:19:18.818 INFO:tasks.workunit.client.0.smithi037.stdout:0/695: readlink d9/df/d32/d39/d68/l7f 0 2024-04-25T17:19:18.819 INFO:tasks.workunit.client.1.smithi069.stdout:6/543: symlink d2/d1e/d43/db6/daf/lc2 0 2024-04-25T17:19:18.819 INFO:tasks.workunit.client.0.smithi037.stdout:0/696: stat d9/df/d32/f4b 0 2024-04-25T17:19:18.823 INFO:tasks.workunit.client.1.smithi069.stdout:5/618: mkdir d13/d17/dd4 0 2024-04-25T17:19:18.825 INFO:tasks.workunit.client.1.smithi069.stdout:5/619: write d13/d17/d19/d20/d51/f97 [914164,5749] 0 2024-04-25T17:19:18.827 INFO:tasks.workunit.client.1.smithi069.stdout:5/620: fdatasync d13/d17/d19/d1c/f71 0 2024-04-25T17:19:18.828 INFO:tasks.workunit.client.1.smithi069.stdout:0/505: creat d0/da/db/d73/fb5 x:0 0 0 2024-04-25T17:19:18.831 INFO:tasks.workunit.client.0.smithi037.stdout:0/697: getdents d9/df/d32/dd1/d7a/daf 0 2024-04-25T17:19:18.831 INFO:tasks.workunit.client.0.smithi037.stdout:0/698: chown d9/df/d32/f3e 3 1 2024-04-25T17:19:18.832 INFO:tasks.workunit.client.1.smithi069.stdout:5/621: creat d13/d17/d19/d1c/da4/fd5 x:0 0 0 2024-04-25T17:19:18.832 INFO:tasks.workunit.client.0.smithi037.stdout:0/699: chown d9/d14/d28/d48/d58/f5e 799260072 1 2024-04-25T17:19:18.833 INFO:tasks.workunit.client.1.smithi069.stdout:0/506: mknod d0/da/db/d7e/d80/cb6 0 2024-04-25T17:19:18.834 INFO:tasks.workunit.client.1.smithi069.stdout:1/597: creat d1/d43/d1b/d32/d4a/fb7 x:0 0 0 2024-04-25T17:19:18.835 INFO:tasks.workunit.client.1.smithi069.stdout:8/577: dread d37/d47/d48/f71 [0,4194304] 0 2024-04-25T17:19:18.836 INFO:tasks.workunit.client.1.smithi069.stdout:5/622: truncate d13/d17/d19/d20/d2d/d93/fb0 744250 0 2024-04-25T17:19:18.837 INFO:tasks.workunit.client.1.smithi069.stdout:0/507: creat d0/da/d59/dab/fb7 x:0 0 0 2024-04-25T17:19:18.838 INFO:tasks.workunit.client.1.smithi069.stdout:8/578: fdatasync d37/d47/d48/f71 0 2024-04-25T17:19:18.839 INFO:tasks.workunit.client.1.smithi069.stdout:3/643: sync 2024-04-25T17:19:18.839 INFO:tasks.workunit.client.1.smithi069.stdout:2/553: sync 2024-04-25T17:19:18.839 INFO:tasks.workunit.client.1.smithi069.stdout:5/623: write d13/d17/f63 [4414521,75113] 0 2024-04-25T17:19:18.846 INFO:tasks.workunit.client.1.smithi069.stdout:8/579: symlink d37/d47/d54/d6e/d98/lc4 0 2024-04-25T17:19:18.847 INFO:tasks.workunit.client.1.smithi069.stdout:2/554: dread - d0/d56/d5f/d62/d7d/d31/d61/f75 zero size 2024-04-25T17:19:18.848 INFO:tasks.workunit.client.1.smithi069.stdout:4/571: write db/d15/d20/f2e [291990,50662] 0 2024-04-25T17:19:18.849 INFO:tasks.workunit.client.1.smithi069.stdout:2/555: readlink d0/l16 0 2024-04-25T17:19:18.850 INFO:tasks.workunit.client.1.smithi069.stdout:9/566: dread d2/da/d5f/f6d [0,4194304] 0 2024-04-25T17:19:18.853 INFO:tasks.workunit.client.1.smithi069.stdout:5/624: truncate d13/d17/d19/d20/d2d/d93/fb0 1456071 0 2024-04-25T17:19:18.853 INFO:tasks.workunit.client.1.smithi069.stdout:2/556: write d0/d26/d36/f59 [46130,93316] 0 2024-04-25T17:19:18.854 INFO:tasks.workunit.client.1.smithi069.stdout:4/572: dread - db/d15/d20/d35/d63/f77 zero size 2024-04-25T17:19:18.856 INFO:tasks.workunit.client.1.smithi069.stdout:7/611: dwrite d4/d3e/d94/da1/dc7/d14/f48 [0,4194304] 0 2024-04-25T17:19:18.858 INFO:tasks.workunit.client.1.smithi069.stdout:6/544: dread d2/d9c/d48/f4f [0,4194304] 0 2024-04-25T17:19:18.860 INFO:tasks.workunit.client.0.smithi037.stdout:0/700: write d9/d14/d28/d48/f49 [970152,64456] 0 2024-04-25T17:19:18.860 INFO:tasks.workunit.client.1.smithi069.stdout:7/612: dread d4/d3e/f80 [0,4194304] 0 2024-04-25T17:19:18.860 INFO:tasks.workunit.client.1.smithi069.stdout:6/545: chown d2/d1e/l26 3812496 1 2024-04-25T17:19:18.861 INFO:tasks.workunit.client.1.smithi069.stdout:6/546: read - d2/d1e/d3f/d56/fbd zero size 2024-04-25T17:19:18.863 INFO:tasks.workunit.client.0.smithi037.stdout:0/701: write d9/d14/d28/f2a [1741389,54477] 0 2024-04-25T17:19:18.864 INFO:tasks.workunit.client.1.smithi069.stdout:3/644: dread d8/d16/d1a/d2c/f4e [0,4194304] 0 2024-04-25T17:19:18.867 INFO:tasks.workunit.client.0.smithi037.stdout:0/702: creat d9/df/d32/d39/dd3/fe6 x:0 0 0 2024-04-25T17:19:18.868 INFO:tasks.workunit.client.1.smithi069.stdout:0/508: dwrite d0/d36/f2b [0,4194304] 0 2024-04-25T17:19:18.868 INFO:tasks.workunit.client.1.smithi069.stdout:0/509: chown d0/da/db/d2a/f3f 10623 1 2024-04-25T17:19:18.870 INFO:tasks.workunit.client.0.smithi037.stdout:0/703: symlink d9/df/d32/d56/le7 0 2024-04-25T17:19:18.871 INFO:tasks.workunit.client.1.smithi069.stdout:8/580: fdatasync d37/d47/f60 0 2024-04-25T17:19:18.874 INFO:tasks.workunit.client.1.smithi069.stdout:9/567: rmdir d2/da/dd/de/d74 39 2024-04-25T17:19:18.877 INFO:tasks.workunit.client.1.smithi069.stdout:4/573: rmdir db/d15/d20/d35 39 2024-04-25T17:19:18.880 INFO:tasks.workunit.client.1.smithi069.stdout:2/557: rename d0/d56/d5f/d62/d7d/d31/f38 to d0/d56/d5f/fb0 0 2024-04-25T17:19:18.881 INFO:tasks.workunit.client.1.smithi069.stdout:7/613: symlink d4/d3e/d94/lca 0 2024-04-25T17:19:18.882 INFO:tasks.workunit.client.1.smithi069.stdout:5/625: dwrite d13/d17/d19/d8a/f7b [0,4194304] 0 2024-04-25T17:19:18.882 INFO:tasks.workunit.client.1.smithi069.stdout:3/645: mknod d8/d16/d4b/d9e/ce4 0 2024-04-25T17:19:18.890 INFO:tasks.workunit.client.1.smithi069.stdout:8/581: mknod d37/d47/d78/db3/cc5 0 2024-04-25T17:19:18.891 INFO:tasks.workunit.client.1.smithi069.stdout:3/646: creat d8/d71/d8d/d92/db6/dc1/d42/fe5 x:0 0 0 2024-04-25T17:19:18.893 INFO:tasks.workunit.client.1.smithi069.stdout:4/574: creat db/d15/d20/d35/d63/d70/d8a/d96/dbf/fc8 x:0 0 0 2024-04-25T17:19:18.893 INFO:tasks.workunit.client.1.smithi069.stdout:3/647: write d8/d71/d8d/d92/db6/dc1/d42/fe5 [788413,86346] 0 2024-04-25T17:19:18.896 INFO:tasks.workunit.client.1.smithi069.stdout:5/626: dwrite d13/d17/d19/d1c/d6c/f7c [0,4194304] 0 2024-04-25T17:19:18.898 INFO:tasks.workunit.client.1.smithi069.stdout:3/648: dread - d8/d16/d4b/f62 zero size 2024-04-25T17:19:18.900 INFO:tasks.workunit.client.1.smithi069.stdout:8/582: rename f26 to d37/d47/d54/d6e/d98/fc6 0 2024-04-25T17:19:18.901 INFO:tasks.workunit.client.1.smithi069.stdout:5/627: mknod d13/d17/d29/d30/d9c/cd6 0 2024-04-25T17:19:18.901 INFO:tasks.workunit.client.1.smithi069.stdout:9/568: link d2/da/dd/f11 d2/da4/fc7 0 2024-04-25T17:19:18.902 INFO:tasks.workunit.client.1.smithi069.stdout:2/558: link d0/d56/d5f/d62/d7d/l4e d0/d56/d5f/d62/lb1 0 2024-04-25T17:19:18.902 INFO:tasks.workunit.client.1.smithi069.stdout:4/575: dwrite db/d15/d20/d38/f6a [0,4194304] 0 2024-04-25T17:19:18.905 INFO:tasks.workunit.client.0.smithi037.stdout:0/704: write d9/d14/fbe [473170,77181] 0 2024-04-25T17:19:18.905 INFO:tasks.workunit.client.1.smithi069.stdout:8/583: read d37/d47/d54/f68 [1204795,19486] 0 2024-04-25T17:19:18.913 INFO:tasks.workunit.client.1.smithi069.stdout:5/628: rename d13/d17/d29/d2e/lb7 to d13/d17/d62/ld7 0 2024-04-25T17:19:18.914 INFO:tasks.workunit.client.1.smithi069.stdout:8/584: unlink d37/d47/d48/f71 0 2024-04-25T17:19:18.922 INFO:tasks.workunit.client.1.smithi069.stdout:4/576: rename db/d15/d20/d38/la6 to db/d15/d20/d35/d63/d75/lc9 0 2024-04-25T17:19:18.922 INFO:tasks.workunit.client.1.smithi069.stdout:6/547: dwrite d2/d7/fa [0,4194304] 0 2024-04-25T17:19:18.923 INFO:tasks.workunit.client.1.smithi069.stdout:8/585: mknod d37/d66/d6b/cc7 0 2024-04-25T17:19:18.927 INFO:tasks.workunit.client.1.smithi069.stdout:4/577: dread - db/d4b/f6e zero size 2024-04-25T17:19:18.929 INFO:tasks.workunit.client.1.smithi069.stdout:4/578: fdatasync db/d15/d20/d35/d63/d75/f9b 0 2024-04-25T17:19:18.929 INFO:tasks.workunit.client.1.smithi069.stdout:6/548: stat d2/d7/c19 0 2024-04-25T17:19:18.930 INFO:tasks.workunit.client.1.smithi069.stdout:9/569: write d2/f24 [1450743,119440] 0 2024-04-25T17:19:18.930 INFO:tasks.workunit.client.1.smithi069.stdout:4/579: chown db/d15/c5d 7944 1 2024-04-25T17:19:18.931 INFO:tasks.workunit.client.1.smithi069.stdout:3/649: getdents d8/d16/d1a/d2c/d49/d87/d8a/d8e 0 2024-04-25T17:19:18.931 INFO:tasks.workunit.client.0.smithi037.stdout:0/705: dread d9/d71/f8e [0,4194304] 0 2024-04-25T17:19:18.932 INFO:tasks.workunit.client.0.smithi037.stdout:0/706: chown d9/d14/d23 62 1 2024-04-25T17:19:18.932 INFO:tasks.workunit.client.1.smithi069.stdout:8/586: fsync d37/d47/d54/d6e/fba 0 2024-04-25T17:19:18.933 INFO:tasks.workunit.client.0.smithi037.stdout:0/707: write d9/d14/f9a [2983506,10770] 0 2024-04-25T17:19:18.933 INFO:tasks.workunit.client.0.smithi037.stdout:9/856: sync 2024-04-25T17:19:18.934 INFO:tasks.workunit.client.0.smithi037.stdout:1/809: sync 2024-04-25T17:19:18.934 INFO:tasks.workunit.client.0.smithi037.stdout:6/618: sync 2024-04-25T17:19:18.934 INFO:tasks.workunit.client.0.smithi037.stdout:5/691: sync 2024-04-25T17:19:18.934 INFO:tasks.workunit.client.0.smithi037.stdout:7/598: sync 2024-04-25T17:19:18.934 INFO:tasks.workunit.client.0.smithi037.stdout:8/617: sync 2024-04-25T17:19:18.934 INFO:tasks.workunit.client.0.smithi037.stdout:4/857: sync 2024-04-25T17:19:18.934 INFO:tasks.workunit.client.0.smithi037.stdout:2/692: sync 2024-04-25T17:19:18.935 INFO:tasks.workunit.client.0.smithi037.stdout:0/708: fdatasync d9/fc5 0 2024-04-25T17:19:18.935 INFO:tasks.workunit.client.1.smithi069.stdout:8/587: fdatasync d37/d47/f5a 0 2024-04-25T17:19:18.935 INFO:tasks.workunit.client.1.smithi069.stdout:2/559: getdents d0/d26/d36 0 2024-04-25T17:19:18.936 INFO:tasks.workunit.client.1.smithi069.stdout:8/588: read d37/d47/d48/f49 [45491,103165] 0 2024-04-25T17:19:18.936 INFO:tasks.workunit.client.0.smithi037.stdout:8/618: stat d5/db/d18/d3b/l52 0 2024-04-25T17:19:18.937 INFO:tasks.workunit.client.0.smithi037.stdout:8/619: dread - d5/d6a/f9f zero size 2024-04-25T17:19:18.937 INFO:tasks.workunit.client.0.smithi037.stdout:6/619: fdatasync db/d26/d2e/d3e/d25/fad 0 2024-04-25T17:19:18.940 INFO:tasks.workunit.client.1.smithi069.stdout:9/570: unlink d2/d51/f8b 0 2024-04-25T17:19:18.940 INFO:tasks.workunit.client.1.smithi069.stdout:3/650: dwrite d8/d16/d1a/d2c/d6c/f76 [0,4194304] 0 2024-04-25T17:19:18.940 INFO:tasks.workunit.client.1.smithi069.stdout:2/560: truncate d0/d26/d10/d43/f4b 959068 0 2024-04-25T17:19:18.941 INFO:tasks.workunit.client.0.smithi037.stdout:2/693: unlink d0/d16/d3b/f47 0 2024-04-25T17:19:18.946 INFO:tasks.workunit.client.0.smithi037.stdout:4/858: rmdir d7/d7e/d45 39 2024-04-25T17:19:18.950 INFO:tasks.workunit.client.1.smithi069.stdout:5/629: dwrite d13/d17/d19/d20/d51/db5/fcc [0,4194304] 0 2024-04-25T17:19:18.952 INFO:tasks.workunit.client.1.smithi069.stdout:2/561: dwrite d0/f7 [0,4194304] 0 2024-04-25T17:19:18.953 INFO:tasks.workunit.client.0.smithi037.stdout:3/499: sync 2024-04-25T17:19:18.953 INFO:tasks.workunit.client.0.smithi037.stdout:0/709: fsync d9/d14/f3d 0 2024-04-25T17:19:18.954 INFO:tasks.workunit.client.1.smithi069.stdout:8/589: chown c9 1079509 1 2024-04-25T17:19:18.954 INFO:tasks.workunit.client.0.smithi037.stdout:2/694: dwrite d0/d16/d20/f3d [0,4194304] 0 2024-04-25T17:19:18.955 INFO:tasks.workunit.client.1.smithi069.stdout:6/549: dwrite d2/f9 [0,4194304] 0 2024-04-25T17:19:18.956 INFO:tasks.workunit.client.1.smithi069.stdout:2/562: chown d0/d56/d5f 352 1 2024-04-25T17:19:18.965 INFO:tasks.workunit.client.1.smithi069.stdout:8/590: read f33 [3774823,33867] 0 2024-04-25T17:19:18.967 INFO:tasks.workunit.client.1.smithi069.stdout:3/651: creat d8/d16/d4b/fe6 x:0 0 0 2024-04-25T17:19:18.969 INFO:tasks.workunit.client.1.smithi069.stdout:2/563: dread d0/d56/d5f/f71 [0,4194304] 0 2024-04-25T17:19:18.970 INFO:tasks.workunit.client.1.smithi069.stdout:2/564: readlink d0/d26/d36/l5d 0 2024-04-25T17:19:18.971 INFO:tasks.workunit.client.1.smithi069.stdout:2/565: write d0/d26/f93 [592580,54355] 0 2024-04-25T17:19:18.972 INFO:tasks.workunit.client.1.smithi069.stdout:9/571: creat d2/da/d14/d23/fc8 x:0 0 0 2024-04-25T17:19:18.973 INFO:tasks.workunit.client.1.smithi069.stdout:9/572: dread - d2/da/d14/d23/f83 zero size 2024-04-25T17:19:18.974 INFO:tasks.workunit.client.0.smithi037.stdout:4/859: symlink d7/d7e/d5b/dfe/d39/d7a/dcc/l11d 0 2024-04-25T17:19:18.975 INFO:tasks.workunit.client.1.smithi069.stdout:4/580: dwrite db/d15/d20/d35/f66 [0,4194304] 0 2024-04-25T17:19:18.976 INFO:tasks.workunit.client.1.smithi069.stdout:4/581: dread - db/d15/d42/d64/f83 zero size 2024-04-25T17:19:18.979 INFO:tasks.workunit.client.0.smithi037.stdout:3/500: rmdir d8/d31/d32 39 2024-04-25T17:19:18.981 INFO:tasks.workunit.client.1.smithi069.stdout:6/550: dread d2/d51/d85/f6f [0,4194304] 0 2024-04-25T17:19:18.983 INFO:tasks.workunit.client.0.smithi037.stdout:0/710: mknod d9/d71/ce8 0 2024-04-25T17:19:18.983 INFO:tasks.workunit.client.1.smithi069.stdout:3/652: mkdir d8/d16/d4b/d9e/dca/de7 0 2024-04-25T17:19:18.986 INFO:tasks.workunit.client.0.smithi037.stdout:5/692: dread d7/d12/d5d/f61 [0,4194304] 0 2024-04-25T17:19:18.986 INFO:tasks.workunit.client.0.smithi037.stdout:8/620: dwrite d5/da/f32 [0,4194304] 0 2024-04-25T17:19:18.990 INFO:tasks.workunit.client.0.smithi037.stdout:4/860: dread - d7/d7e/d4e/f7f zero size 2024-04-25T17:19:18.991 INFO:tasks.workunit.client.0.smithi037.stdout:1/810: dread dc/d52/d6b/dd9/d22/d36/d92/db8/fc2 [0,4194304] 0 2024-04-25T17:19:18.992 INFO:tasks.workunit.client.0.smithi037.stdout:7/599: creat d5/d15/d17/d1b/da2/fd4 x:0 0 0 2024-04-25T17:19:18.993 INFO:tasks.workunit.client.1.smithi069.stdout:9/573: dread d2/da/dd/de/d74/f78 [0,4194304] 0 2024-04-25T17:19:18.999 INFO:tasks.workunit.client.0.smithi037.stdout:9/857: getdents d1/d48 0 2024-04-25T17:19:19.000 INFO:tasks.workunit.client.1.smithi069.stdout:3/653: mkdir d8/d16/d4b/d9e/dca/de8 0 2024-04-25T17:19:19.001 INFO:tasks.workunit.client.1.smithi069.stdout:9/574: dwrite d2/d51/fb3 [0,4194304] 0 2024-04-25T17:19:19.003 INFO:tasks.workunit.client.0.smithi037.stdout:8/621: rmdir d5/db/da2 39 2024-04-25T17:19:19.004 INFO:tasks.workunit.client.1.smithi069.stdout:9/575: read d2/f24 [1208046,53193] 0 2024-04-25T17:19:19.005 INFO:tasks.workunit.client.1.smithi069.stdout:8/591: rename c2c to d37/d47/d54/d6e/cc8 0 2024-04-25T17:19:19.007 INFO:tasks.workunit.client.1.smithi069.stdout:9/576: write d2/da/dd/d1e/d2e/d35/fa5 [864278,71317] 0 2024-04-25T17:19:19.008 INFO:tasks.workunit.client.0.smithi037.stdout:1/811: creat dc/d52/d6b/dd9/d22/d36/d74/daf/ddd/f119 x:0 0 0 2024-04-25T17:19:19.008 INFO:tasks.workunit.client.1.smithi069.stdout:6/551: getdents d2/d1e/d43/db6/daf/dbe 0 2024-04-25T17:19:19.009 INFO:tasks.workunit.client.0.smithi037.stdout:7/600: dread - d5/d15/d17/d1b/da2/daf/d80/db5/fb6 zero size 2024-04-25T17:19:19.009 INFO:tasks.workunit.client.1.smithi069.stdout:6/552: dread - d2/d51/d85/f7b zero size 2024-04-25T17:19:19.010 INFO:tasks.workunit.client.1.smithi069.stdout:3/654: rmdir d8 39 2024-04-25T17:19:19.011 INFO:tasks.workunit.client.1.smithi069.stdout:6/553: fsync d2/d9c/f4b 0 2024-04-25T17:19:19.011 INFO:tasks.workunit.client.1.smithi069.stdout:4/582: dread db/f11 [0,4194304] 0 2024-04-25T17:19:19.013 INFO:tasks.workunit.client.0.smithi037.stdout:2/695: rename d0/d16/d26/f2c to d0/d23/dac/fe1 0 2024-04-25T17:19:19.014 INFO:tasks.workunit.client.0.smithi037.stdout:2/696: stat d0/d16/d26/c50 0 2024-04-25T17:19:19.019 INFO:tasks.workunit.client.1.smithi069.stdout:9/577: rename d2/da/dd/d1e/d2e/d35/c9f to d2/d51/cc9 0 2024-04-25T17:19:19.022 INFO:tasks.workunit.client.0.smithi037.stdout:3/501: truncate d8/d23/d38/f6b 1459966 0 2024-04-25T17:19:19.024 INFO:tasks.workunit.client.1.smithi069.stdout:6/554: rmdir d2/d1e/d3e 39 2024-04-25T17:19:19.026 INFO:tasks.workunit.client.1.smithi069.stdout:0/510: sync 2024-04-25T17:19:19.026 INFO:tasks.workunit.client.1.smithi069.stdout:1/598: sync 2024-04-25T17:19:19.026 INFO:tasks.workunit.client.1.smithi069.stdout:7/614: sync 2024-04-25T17:19:19.027 INFO:tasks.workunit.client.1.smithi069.stdout:4/583: fsync db/d15/d20/d35/d63/f60 0 2024-04-25T17:19:19.030 INFO:tasks.workunit.client.0.smithi037.stdout:6/620: dwrite db/d26/d2e/d3e/fab [0,4194304] 0 2024-04-25T17:19:19.030 INFO:tasks.workunit.client.1.smithi069.stdout:5/630: truncate d13/d17/d19/d20/d2d/f72 3272847 0 2024-04-25T17:19:19.031 INFO:tasks.workunit.client.1.smithi069.stdout:8/592: unlink d37/c43 0 2024-04-25T17:19:19.032 INFO:tasks.workunit.client.1.smithi069.stdout:0/511: dwrite d0/da/db/d1d/d5f/fa0 [0,4194304] 0 2024-04-25T17:19:19.032 INFO:tasks.workunit.client.1.smithi069.stdout:8/593: chown d37/d47/l4d 104890312 1 2024-04-25T17:19:19.038 INFO:tasks.workunit.client.0.smithi037.stdout:2/697: unlink d0/d16/d20/d55/cb1 0 2024-04-25T17:19:19.039 INFO:tasks.workunit.client.0.smithi037.stdout:2/698: chown d0/d16/d3b/dc4/lb4 829226 1 2024-04-25T17:19:19.043 INFO:tasks.workunit.client.1.smithi069.stdout:2/566: write d0/d56/d5f/fb0 [1002299,108954] 0 2024-04-25T17:19:19.044 INFO:tasks.workunit.client.0.smithi037.stdout:1/812: fsync dc/d52/d6b/dd9/d22/d36/d8c/f10e 0 2024-04-25T17:19:19.047 INFO:tasks.workunit.client.0.smithi037.stdout:0/711: dwrite d9/df/d32/d39/f8b [0,4194304] 0 2024-04-25T17:19:19.047 INFO:tasks.workunit.client.1.smithi069.stdout:9/578: dwrite d2/da/d14/d23/f83 [0,4194304] 0 2024-04-25T17:19:19.048 INFO:tasks.workunit.client.0.smithi037.stdout:3/502: creat d8/d23/d72/f9c x:0 0 0 2024-04-25T17:19:19.054 INFO:tasks.workunit.client.0.smithi037.stdout:3/503: dread d8/d23/f91 [0,4194304] 0 2024-04-25T17:19:19.059 INFO:tasks.workunit.client.1.smithi069.stdout:4/584: write db/d15/f18 [2468918,14897] 0 2024-04-25T17:19:19.059 INFO:tasks.workunit.client.0.smithi037.stdout:4/861: dwrite d7/d78/fa1 [0,4194304] 0 2024-04-25T17:19:19.059 INFO:tasks.workunit.client.0.smithi037.stdout:5/693: write d7/d43/f52 [787560,81269] 0 2024-04-25T17:19:19.060 INFO:tasks.workunit.client.1.smithi069.stdout:1/599: truncate d1/d4/d6/d9e/da6/f55 851131 0 2024-04-25T17:19:19.063 INFO:tasks.workunit.client.1.smithi069.stdout:5/631: symlink d13/d17/d19/d20/d51/ld8 0 2024-04-25T17:19:19.064 INFO:tasks.workunit.client.1.smithi069.stdout:5/632: read - d13/d17/d62/fc5 zero size 2024-04-25T17:19:19.065 INFO:tasks.workunit.client.0.smithi037.stdout:6/621: mkdir db/d26/d2e/d7d/dde 0 2024-04-25T17:19:19.066 INFO:tasks.workunit.client.1.smithi069.stdout:3/655: symlink d8/d16/d9b/dc3/dc8/le9 0 2024-04-25T17:19:19.067 INFO:tasks.workunit.client.1.smithi069.stdout:5/633: write d13/d17/d29/d2e/fc4 [715114,43046] 0 2024-04-25T17:19:19.068 INFO:tasks.workunit.client.1.smithi069.stdout:1/600: dwrite d1/df/f7b [0,4194304] 0 2024-04-25T17:19:19.068 INFO:tasks.workunit.client.0.smithi037.stdout:9/858: truncate d1/d48/d68/d26/d81/f97 2471905 0 2024-04-25T17:19:19.069 INFO:tasks.workunit.client.1.smithi069.stdout:3/656: chown d8/d16/d1a/d2c/d49/d87/d8a/d8e/fb1 40742 1 2024-04-25T17:19:19.070 INFO:tasks.workunit.client.1.smithi069.stdout:8/594: rename f35 to d37/d47/d78/db3/fc9 0 2024-04-25T17:19:19.072 INFO:tasks.workunit.client.1.smithi069.stdout:8/595: write d37/f3f [4083664,24674] 0 2024-04-25T17:19:19.072 INFO:tasks.workunit.client.1.smithi069.stdout:8/596: fdatasync f2b 0 2024-04-25T17:19:19.074 INFO:tasks.workunit.client.1.smithi069.stdout:5/634: rename d13/d17/d19/d1c/da4/da9 to d13/d17/d19/d1c/da4/da9/dd9 22 2024-04-25T17:19:19.075 INFO:tasks.workunit.client.1.smithi069.stdout:0/512: mkdir d0/da/d24/d67/db8 0 2024-04-25T17:19:19.077 INFO:tasks.workunit.client.0.smithi037.stdout:1/813: creat dc/d52/d6b/dd9/d22/d36/d8c/f11a x:0 0 0 2024-04-25T17:19:19.080 INFO:tasks.workunit.client.1.smithi069.stdout:6/555: dwrite d2/d9c/d48/f5d [0,4194304] 0 2024-04-25T17:19:19.081 INFO:tasks.workunit.client.1.smithi069.stdout:6/556: truncate d2/fa3 1182018 0 2024-04-25T17:19:19.081 INFO:tasks.workunit.client.1.smithi069.stdout:2/567: creat d0/d56/d94/fb2 x:0 0 0 2024-04-25T17:19:19.082 INFO:tasks.workunit.client.0.smithi037.stdout:0/712: rmdir d9/df/dbd/dc1 39 2024-04-25T17:19:19.083 INFO:tasks.workunit.client.0.smithi037.stdout:3/504: write d8/d31/d32/f39 [4724623,6737] 0 2024-04-25T17:19:19.084 INFO:tasks.workunit.client.1.smithi069.stdout:7/615: unlink d4/f6a 0 2024-04-25T17:19:19.084 INFO:tasks.workunit.client.0.smithi037.stdout:0/713: write d9/df/d32/d39/f63 [2475496,64787] 0 2024-04-25T17:19:19.086 INFO:tasks.workunit.client.0.smithi037.stdout:7/601: rmdir d5/d15/d17/d1b/da2/daf/dc8/dca 0 2024-04-25T17:19:19.090 INFO:tasks.workunit.client.1.smithi069.stdout:4/585: mkdir db/d4b/d78/d79/dca 0 2024-04-25T17:19:19.091 INFO:tasks.workunit.client.0.smithi037.stdout:4/862: write d7/d7e/d1e/d2b/f42 [3945115,129230] 0 2024-04-25T17:19:19.093 INFO:tasks.workunit.client.0.smithi037.stdout:4/863: write d7/d7e/d4e/f6d [6846809,75055] 0 2024-04-25T17:19:19.098 INFO:tasks.workunit.client.0.smithi037.stdout:6/622: mknod db/d5a/cdf 0 2024-04-25T17:19:19.099 INFO:tasks.workunit.client.0.smithi037.stdout:6/623: chown db/d26/d2e/d3e/cbf 19193 1 2024-04-25T17:19:19.106 INFO:tasks.workunit.client.0.smithi037.stdout:9/859: read d1/d48/d68/d26/d81/f87 [565934,1755] 0 2024-04-25T17:19:19.107 INFO:tasks.workunit.client.1.smithi069.stdout:8/597: rmdir d37/d47/d54/d6e/d98 39 2024-04-25T17:19:19.111 INFO:tasks.workunit.client.1.smithi069.stdout:5/635: creat d13/d17/d29/d30/fda x:0 0 0 2024-04-25T17:19:19.112 INFO:tasks.workunit.client.0.smithi037.stdout:3/505: rmdir d8/d31 39 2024-04-25T17:19:19.113 INFO:tasks.workunit.client.1.smithi069.stdout:0/513: creat d0/d17/fb9 x:0 0 0 2024-04-25T17:19:19.114 INFO:tasks.workunit.client.0.smithi037.stdout:0/714: fdatasync d9/d72/fa0 0 2024-04-25T17:19:19.115 INFO:tasks.workunit.client.0.smithi037.stdout:5/694: dread d7/d12/f21 [0,4194304] 0 2024-04-25T17:19:19.118 INFO:tasks.workunit.client.0.smithi037.stdout:8/622: rename d5/da/c2f to d5/db/ccb 0 2024-04-25T17:19:19.119 INFO:tasks.workunit.client.1.smithi069.stdout:6/557: fdatasync d2/d1e/f33 0 2024-04-25T17:19:19.121 INFO:tasks.workunit.client.1.smithi069.stdout:2/568: truncate d0/d26/f23 722759 0 2024-04-25T17:19:19.124 INFO:tasks.workunit.client.1.smithi069.stdout:0/514: dread d0/da/db/d1d/f86 [0,4194304] 0 2024-04-25T17:19:19.124 INFO:tasks.workunit.client.1.smithi069.stdout:0/515: stat d0/da/db/d2a/d8c 0 2024-04-25T17:19:19.125 INFO:tasks.workunit.client.1.smithi069.stdout:7/616: rename d4/d3e/d94/da1/dc7/d14/d44/d79/d23 to d4/d3e/d94/da1/dc7/d14/d44/d7c/d9f/dcb 0 2024-04-25T17:19:19.126 INFO:tasks.workunit.client.0.smithi037.stdout:6/624: stat db/d1d/d20/dcf/dd5 0 2024-04-25T17:19:19.129 INFO:tasks.workunit.client.1.smithi069.stdout:9/579: link d2/da/dd/d1e/d2e/d35/fa5 d2/da/dd/d1e/d40/fca 0 2024-04-25T17:19:19.130 INFO:tasks.workunit.client.1.smithi069.stdout:9/580: fdatasync d2/da/dd/d1e/d2e/d68/f72 0 2024-04-25T17:19:19.131 INFO:tasks.workunit.client.1.smithi069.stdout:1/601: creat d1/d43/d1b/d32/d4a/db4/fb8 x:0 0 0 2024-04-25T17:19:19.134 INFO:tasks.workunit.client.0.smithi037.stdout:9/860: mknod d1/d5/dc/d3c/d116/c11c 0 2024-04-25T17:19:19.137 INFO:tasks.workunit.client.0.smithi037.stdout:2/699: dwrite d0/d23/dac/fe1 [0,4194304] 0 2024-04-25T17:19:19.143 INFO:tasks.workunit.client.0.smithi037.stdout:3/506: dread d8/d23/f2d [4194304,4194304] 0 2024-04-25T17:19:19.144 INFO:tasks.workunit.client.0.smithi037.stdout:3/507: fdatasync d8/d23/d3a/f4f 0 2024-04-25T17:19:19.147 INFO:tasks.workunit.client.0.smithi037.stdout:7/602: rename d5/d15/d17/d1b/da2/d76/l8e to d5/d15/d17/d1b/da2/daf/d80/db5/ld5 0 2024-04-25T17:19:19.149 INFO:tasks.workunit.client.1.smithi069.stdout:2/569: dwrite d0/d56/d5f/d62/d7d/d31/f7c [0,4194304] 0 2024-04-25T17:19:19.150 INFO:tasks.workunit.client.1.smithi069.stdout:2/570: fsync d0/d26/d10/d43/f7a 0 2024-04-25T17:19:19.151 INFO:tasks.workunit.client.1.smithi069.stdout:2/571: readlink d0/d26/lab 0 2024-04-25T17:19:19.151 INFO:tasks.workunit.client.0.smithi037.stdout:8/623: mkdir d5/db/d23/d78/d93/dcc 0 2024-04-25T17:19:19.155 INFO:tasks.workunit.client.1.smithi069.stdout:4/586: write db/d4b/d78/dc4/d41/d9e/fc7 [823794,67594] 0 2024-04-25T17:19:19.156 INFO:tasks.workunit.client.1.smithi069.stdout:7/617: stat d4/d3e/d94/da1/lad 0 2024-04-25T17:19:19.157 INFO:tasks.workunit.client.0.smithi037.stdout:6/625: mkdir db/d26/d2e/d7d/d65/d8b/de0 0 2024-04-25T17:19:19.157 INFO:tasks.workunit.client.0.smithi037.stdout:2/700: dread d0/d23/dac/f65 [0,4194304] 0 2024-04-25T17:19:19.158 INFO:tasks.workunit.client.0.smithi037.stdout:6/626: readlink db/d1d/db1/lb3 0 2024-04-25T17:19:19.158 INFO:tasks.workunit.client.0.smithi037.stdout:2/701: chown d0/d16/d20/d59 44486 1 2024-04-25T17:19:19.159 INFO:tasks.workunit.client.1.smithi069.stdout:7/618: read d4/f10 [2979131,109417] 0 2024-04-25T17:19:19.160 INFO:tasks.workunit.client.1.smithi069.stdout:8/598: write f8 [1694702,89622] 0 2024-04-25T17:19:19.162 INFO:tasks.workunit.client.0.smithi037.stdout:9/861: fdatasync d1/d5/d19/d6e/fd6 0 2024-04-25T17:19:19.163 INFO:tasks.workunit.client.0.smithi037.stdout:9/862: readlink d1/d5/d2e/d34/d76/db4/lc4 0 2024-04-25T17:19:19.164 INFO:tasks.workunit.client.1.smithi069.stdout:9/581: dread d2/da/dd/d1e/d2e/d68/d8f/fad [0,4194304] 0 2024-04-25T17:19:19.168 INFO:tasks.workunit.client.0.smithi037.stdout:5/695: creat d7/d12/d6f/dbc/dc6/fd2 x:0 0 0 2024-04-25T17:19:19.170 INFO:tasks.workunit.client.1.smithi069.stdout:6/558: creat d2/d7/dbc/fc3 x:0 0 0 2024-04-25T17:19:19.170 INFO:tasks.workunit.client.1.smithi069.stdout:0/516: dwrite d0/da/d24/f72 [0,4194304] 0 2024-04-25T17:19:19.171 INFO:tasks.workunit.client.0.smithi037.stdout:7/603: fsync d5/d15/d17/d1b/da2/daf/f2a 0 2024-04-25T17:19:19.172 INFO:tasks.workunit.client.1.smithi069.stdout:1/602: dwrite d1/df/f42 [0,4194304] 0 2024-04-25T17:19:19.174 INFO:tasks.workunit.client.0.smithi037.stdout:8/624: rename d5/db/d18/f19 to d5/db/d59/fcd 0 2024-04-25T17:19:19.175 INFO:tasks.workunit.client.1.smithi069.stdout:1/603: fsync d1/f28 0 2024-04-25T17:19:19.176 INFO:tasks.workunit.client.1.smithi069.stdout:6/559: write d2/d1e/d3f/d86/fb1 [220600,41524] 0 2024-04-25T17:19:19.176 INFO:tasks.workunit.client.0.smithi037.stdout:6/627: creat db/d53/fe1 x:0 0 0 2024-04-25T17:19:19.186 INFO:tasks.workunit.client.1.smithi069.stdout:9/582: rmdir d2/da/dd 39 2024-04-25T17:19:19.189 INFO:tasks.workunit.client.0.smithi037.stdout:9/863: unlink d1/d5/dc/d3c/dca/ce9 0 2024-04-25T17:19:19.196 INFO:tasks.workunit.client.1.smithi069.stdout:2/572: symlink d0/d26/d10/lb3 0 2024-04-25T17:19:19.199 INFO:tasks.workunit.client.0.smithi037.stdout:3/508: write d8/d31/d32/d3e/f6e [8319224,14142] 0 2024-04-25T17:19:19.199 INFO:tasks.workunit.client.0.smithi037.stdout:4/864: getdents d7/d7e/d1e/de1 0 2024-04-25T17:19:19.201 INFO:tasks.workunit.client.1.smithi069.stdout:1/604: fsync d1/f9 0 2024-04-25T17:19:19.203 INFO:tasks.workunit.client.0.smithi037.stdout:7/604: write d5/d15/d17/d25/d2b/d59/fc4 [67878,108409] 0 2024-04-25T17:19:19.207 INFO:tasks.workunit.client.0.smithi037.stdout:3/509: dwrite d8/d23/d3a/d5d/f84 [0,4194304] 0 2024-04-25T17:19:19.208 INFO:tasks.workunit.client.1.smithi069.stdout:5/636: link d13/d17/d19/c58 d13/d17/d29/d2e/cdb 0 2024-04-25T17:19:19.210 INFO:tasks.workunit.client.1.smithi069.stdout:8/599: write fe [3403757,38190] 0 2024-04-25T17:19:19.212 INFO:tasks.workunit.client.0.smithi037.stdout:2/702: truncate d0/d16/d20/d55/f60 3901614 0 2024-04-25T17:19:19.214 INFO:tasks.workunit.client.0.smithi037.stdout:5/696: rename d7/d43/l72 to d7/da1/db0/ld3 0 2024-04-25T17:19:19.215 INFO:tasks.workunit.client.0.smithi037.stdout:4/865: readlink d7/d7e/lbf 0 2024-04-25T17:19:19.216 INFO:tasks.workunit.client.0.smithi037.stdout:4/866: stat d7/d7e/d4e/da5/fa8 0 2024-04-25T17:19:19.217 INFO:tasks.workunit.client.1.smithi069.stdout:5/637: write d13/d17/f86 [1852943,79180] 0 2024-04-25T17:19:19.218 INFO:tasks.workunit.client.1.smithi069.stdout:0/517: creat d0/da/db/d1d/fba x:0 0 0 2024-04-25T17:19:19.221 INFO:tasks.workunit.client.1.smithi069.stdout:8/600: creat d37/d47/d54/fca x:0 0 0 2024-04-25T17:19:19.222 INFO:tasks.workunit.client.1.smithi069.stdout:3/657: sync 2024-04-25T17:19:19.223 INFO:tasks.workunit.client.1.smithi069.stdout:1/605: write d1/d43/d1b/f2c [1074128,122825] 0 2024-04-25T17:19:19.224 INFO:tasks.workunit.client.1.smithi069.stdout:6/560: dread d2/f2f [0,4194304] 0 2024-04-25T17:19:19.225 INFO:tasks.workunit.client.0.smithi037.stdout:2/703: unlink d0/d16/d3b/cd5 0 2024-04-25T17:19:19.228 INFO:tasks.workunit.client.1.smithi069.stdout:5/638: rmdir d13/d17/d29/d30/d5c 39 2024-04-25T17:19:19.229 INFO:tasks.workunit.client.0.smithi037.stdout:4/867: truncate d7/d7e/d5b/dfe/d39/d7a/fa2 573941 0 2024-04-25T17:19:19.230 INFO:tasks.workunit.client.1.smithi069.stdout:3/658: dwrite d8/f37 [4194304,4194304] 0 2024-04-25T17:19:19.230 INFO:tasks.workunit.client.0.smithi037.stdout:5/697: read d7/d12/f4d [702851,108664] 0 2024-04-25T17:19:19.231 INFO:tasks.workunit.client.0.smithi037.stdout:6/628: dread db/f12 [0,4194304] 0 2024-04-25T17:19:19.232 INFO:tasks.workunit.client.0.smithi037.stdout:5/698: write d7/f1b [3771521,28772] 0 2024-04-25T17:19:19.234 INFO:tasks.workunit.client.0.smithi037.stdout:5/699: write d7/f49 [3353407,126288] 0 2024-04-25T17:19:19.235 INFO:tasks.workunit.client.0.smithi037.stdout:6/629: write db/d26/d2e/d3e/f6f [1662324,27920] 0 2024-04-25T17:19:19.235 INFO:tasks.workunit.client.1.smithi069.stdout:8/601: readlink l24 0 2024-04-25T17:19:19.236 INFO:tasks.workunit.client.0.smithi037.stdout:3/510: symlink d8/d31/d8d/l9d 0 2024-04-25T17:19:19.239 INFO:tasks.workunit.client.0.smithi037.stdout:7/605: dwrite d5/d15/d17/d1b/da2/daf/fb9 [0,4194304] 0 2024-04-25T17:19:19.239 INFO:tasks.workunit.client.0.smithi037.stdout:9/864: creat d1/d5/d2e/f11d x:0 0 0 2024-04-25T17:19:19.239 INFO:tasks.workunit.client.0.smithi037.stdout:6/630: chown db/d26/d2e/d7d/d65/f9c 18927161 1 2024-04-25T17:19:19.240 INFO:tasks.workunit.client.1.smithi069.stdout:1/606: rmdir d1/d4/d6/d81 39 2024-04-25T17:19:19.241 INFO:tasks.workunit.client.0.smithi037.stdout:3/511: write d8/d23/d38/d66/f75 [1919266,72430] 0 2024-04-25T17:19:19.241 INFO:tasks.workunit.client.0.smithi037.stdout:7/606: readlink d5/d14/l23 0 2024-04-25T17:19:19.243 INFO:tasks.workunit.client.0.smithi037.stdout:6/631: write db/d26/d2e/d3e/f6f [1181580,41110] 0 2024-04-25T17:19:19.245 INFO:tasks.workunit.client.0.smithi037.stdout:8/625: getdents d5/da 0 2024-04-25T17:19:19.245 INFO:tasks.workunit.client.0.smithi037.stdout:9/865: write d1/d5/d19/f11a [302033,40056] 0 2024-04-25T17:19:19.246 INFO:tasks.workunit.client.1.smithi069.stdout:6/561: rmdir d2/d1e/d3f/d56/d7e 39 2024-04-25T17:19:19.247 INFO:tasks.workunit.client.1.smithi069.stdout:1/607: dwrite d1/d4/d6/d9e/f8c [0,4194304] 0 2024-04-25T17:19:19.247 INFO:tasks.workunit.client.1.smithi069.stdout:9/583: creat d2/da/dd/de/fcb x:0 0 0 2024-04-25T17:19:19.248 INFO:tasks.workunit.client.1.smithi069.stdout:1/608: chown d1/d4/d6/d9e 4156714 1 2024-04-25T17:19:19.249 INFO:tasks.workunit.client.0.smithi037.stdout:6/632: write db/d26/d2e/d3e/d25/db0/fca [763286,88555] 0 2024-04-25T17:19:19.254 INFO:tasks.workunit.client.1.smithi069.stdout:3/659: dread d8/d16/d31/fa1 [0,4194304] 0 2024-04-25T17:19:19.256 INFO:tasks.workunit.client.1.smithi069.stdout:2/573: getdents d0/d1/d5b/d33 0 2024-04-25T17:19:19.260 INFO:tasks.workunit.client.1.smithi069.stdout:6/562: rmdir d2/d51 39 2024-04-25T17:19:19.263 INFO:tasks.workunit.client.0.smithi037.stdout:5/700: truncate d7/d12/d5d/d90/fb4 243011 0 2024-04-25T17:19:19.263 INFO:tasks.workunit.client.1.smithi069.stdout:0/518: dwrite d0/da/f10 [0,4194304] 0 2024-04-25T17:19:19.264 INFO:tasks.workunit.client.1.smithi069.stdout:0/519: chown d0/da/d54/ca1 705 1 2024-04-25T17:19:19.265 INFO:tasks.workunit.client.1.smithi069.stdout:8/602: write d37/f3a [639955,18451] 0 2024-04-25T17:19:19.266 INFO:tasks.workunit.client.1.smithi069.stdout:5/639: symlink d13/d17/dd4/ldc 0 2024-04-25T17:19:19.266 INFO:tasks.workunit.client.1.smithi069.stdout:0/520: write d0/da/db/d1d/fba [235773,114850] 0 2024-04-25T17:19:19.271 INFO:tasks.workunit.client.1.smithi069.stdout:2/574: symlink d0/d1/lb4 0 2024-04-25T17:19:19.273 INFO:tasks.workunit.client.0.smithi037.stdout:2/704: creat d0/d15/fe2 x:0 0 0 2024-04-25T17:19:19.275 INFO:tasks.workunit.client.1.smithi069.stdout:9/584: write d2/da/f8c [849915,88263] 0 2024-04-25T17:19:19.279 INFO:tasks.workunit.client.1.smithi069.stdout:8/603: write d37/f41 [1308773,130085] 0 2024-04-25T17:19:19.280 INFO:tasks.workunit.client.1.smithi069.stdout:0/521: creat d0/da/d24/d67/fbb x:0 0 0 2024-04-25T17:19:19.281 INFO:tasks.workunit.client.0.smithi037.stdout:9/866: symlink d1/d5/dc/da9/dc8/l11e 0 2024-04-25T17:19:19.283 INFO:tasks.workunit.client.1.smithi069.stdout:5/640: creat d13/d17/d19/d20/d51/db5/fdd x:0 0 0 2024-04-25T17:19:19.283 INFO:tasks.workunit.client.1.smithi069.stdout:1/609: dread d1/f5 [4194304,4194304] 0 2024-04-25T17:19:19.284 INFO:tasks.workunit.client.0.smithi037.stdout:4/868: dwrite d7/d7e/d45/d4f/f99 [0,4194304] 0 2024-04-25T17:19:19.284 INFO:tasks.workunit.client.0.smithi037.stdout:2/705: truncate d0/d15/f32 553817 0 2024-04-25T17:19:19.284 INFO:tasks.workunit.client.1.smithi069.stdout:5/641: fdatasync d13/d17/d19/d20/f2a 0 2024-04-25T17:19:19.284 INFO:tasks.workunit.client.1.smithi069.stdout:4/587: sync 2024-04-25T17:19:19.286 INFO:tasks.workunit.client.1.smithi069.stdout:2/575: fsync d0/d56/d5f/d62/d7d/d31/f81 0 2024-04-25T17:19:19.287 INFO:tasks.workunit.client.1.smithi069.stdout:9/585: symlink d2/da/dd/de/d59/lcc 0 2024-04-25T17:19:19.291 INFO:tasks.workunit.client.0.smithi037.stdout:6/633: dread db/d26/d2e/d3e/f45 [0,4194304] 0 2024-04-25T17:19:19.292 INFO:tasks.workunit.client.0.smithi037.stdout:6/634: readlink db/d26/d2e/d7d/l7a 0 2024-04-25T17:19:19.296 INFO:tasks.workunit.client.1.smithi069.stdout:9/586: dwrite d2/da/dd/d1e/d2e/f45 [0,4194304] 0 2024-04-25T17:19:19.301 INFO:tasks.workunit.client.1.smithi069.stdout:9/587: dwrite d2/da/d14/d23/f55 [0,4194304] 0 2024-04-25T17:19:19.329 INFO:tasks.workunit.client.1.smithi069.stdout:6/563: rename d2/d1e/d3e/d67/d8d/fa0 to d2/d7/dbc/fc4 0 2024-04-25T17:19:19.330 INFO:tasks.workunit.client.0.smithi037.stdout:8/626: link d5/db/d18/d3b/l4c d5/d26/lce 0 2024-04-25T17:19:19.331 INFO:tasks.workunit.client.0.smithi037.stdout:8/627: chown d5/db/d18/d3b/d50/f56 0 1 2024-04-25T17:19:19.332 INFO:tasks.workunit.client.1.smithi069.stdout:8/604: mknod d37/d62/ccb 0 2024-04-25T17:19:19.332 INFO:tasks.workunit.client.0.smithi037.stdout:8/628: write d5/d6a/f7a [6377617,63647] 0 2024-04-25T17:19:19.336 INFO:tasks.workunit.client.0.smithi037.stdout:9/867: dread d1/d5/d2e/d34/d76/ffb [0,4194304] 0 2024-04-25T17:19:19.362 INFO:tasks.workunit.client.1.smithi069.stdout:3/660: link d8/d16/d1a/d2c/d49/dd0/ldb d8/d16/d1a/d2c/d49/dd0/lea 0 2024-04-25T17:19:19.363 INFO:tasks.workunit.client.1.smithi069.stdout:3/661: chown d8/d71/d8d/d92/db6/dc1/d42/l60 23457200 1 2024-04-25T17:19:19.364 INFO:tasks.workunit.client.0.smithi037.stdout:2/706: creat d0/d16/d3b/dc4/fe3 x:0 0 0 2024-04-25T17:19:19.365 INFO:tasks.workunit.client.1.smithi069.stdout:5/642: chown d13/d17/f1b 25 1 2024-04-25T17:19:19.366 INFO:tasks.workunit.client.0.smithi037.stdout:2/707: dread d0/d16/d3c/fbc [0,4194304] 0 2024-04-25T17:19:19.367 INFO:tasks.workunit.client.0.smithi037.stdout:4/869: mkdir d7/d7e/d5b/dfe/d39/d9c/da3/d11e 0 2024-04-25T17:19:19.368 INFO:tasks.workunit.client.1.smithi069.stdout:1/610: symlink d1/d4/d6/d9e/lb9 0 2024-04-25T17:19:19.370 INFO:tasks.workunit.client.0.smithi037.stdout:5/701: rename d7/d25/d4f/f3d to d7/d18/d62/fd4 0 2024-04-25T17:19:19.372 INFO:tasks.workunit.client.0.smithi037.stdout:3/512: getdents d8/d23/d3a/d81 0 2024-04-25T17:19:19.374 INFO:tasks.workunit.client.0.smithi037.stdout:6/635: creat db/d26/d2e/d7d/d65/d68/dae/fe2 x:0 0 0 2024-04-25T17:19:19.376 INFO:tasks.workunit.client.0.smithi037.stdout:8/629: fdatasync d5/db/d59/f6c 0 2024-04-25T17:19:19.378 INFO:tasks.workunit.client.0.smithi037.stdout:8/630: write d5/db/d7e/fbb [808126,2332] 0 2024-04-25T17:19:19.381 INFO:tasks.workunit.client.0.smithi037.stdout:4/870: dread d7/f1a [4194304,4194304] 0 2024-04-25T17:19:19.383 INFO:tasks.workunit.client.1.smithi069.stdout:8/605: mkdir d37/d47/d54/dcc 0 2024-04-25T17:19:19.385 INFO:tasks.workunit.client.1.smithi069.stdout:0/522: creat d0/da/db/d1d/d89/fbc x:0 0 0 2024-04-25T17:19:19.388 INFO:tasks.workunit.client.1.smithi069.stdout:2/576: mkdir d0/d26/d10/db5 0 2024-04-25T17:19:19.390 INFO:tasks.workunit.client.1.smithi069.stdout:4/588: rename db/ce to db/d15/d20/d35/d63/d75/ccb 0 2024-04-25T17:19:19.395 INFO:tasks.workunit.client.1.smithi069.stdout:7/619: sync 2024-04-25T17:19:19.396 INFO:tasks.workunit.client.1.smithi069.stdout:6/564: link d2/d1e/d43/f57 d2/d1e/d43/fc5 0 2024-04-25T17:19:19.396 INFO:tasks.workunit.client.1.smithi069.stdout:4/589: write db/d15/d20/faa [618952,99065] 0 2024-04-25T17:19:19.396 INFO:tasks.workunit.client.1.smithi069.stdout:1/611: symlink d1/d43/d1b/d32/d4a/lba 0 2024-04-25T17:19:19.396 INFO:tasks.workunit.client.1.smithi069.stdout:3/662: rename d8/d16/d4b/d9e/dca/de8 to d8/d16/d4b/d9e/deb 0 2024-04-25T17:19:19.397 INFO:tasks.workunit.client.0.smithi037.stdout:4/871: creat d7/d7e/d4e/f11f x:0 0 0 2024-04-25T17:19:19.398 INFO:tasks.workunit.client.1.smithi069.stdout:8/606: getdents d37/d47/d54/dcc 0 2024-04-25T17:19:19.399 INFO:tasks.workunit.client.0.smithi037.stdout:2/708: fsync d0/d23/dac/d4b/f91 0 2024-04-25T17:19:19.402 INFO:tasks.workunit.client.0.smithi037.stdout:5/702: rmdir d7/d18/d7c 39 2024-04-25T17:19:19.411 INFO:tasks.workunit.client.0.smithi037.stdout:8/631: dwrite d5/db/d23/f29 [0,4194304] 0 2024-04-25T17:19:19.412 INFO:tasks.workunit.client.0.smithi037.stdout:8/632: chown d5/db 0 1 2024-04-25T17:19:19.416 INFO:tasks.workunit.client.0.smithi037.stdout:3/513: getdents d8/d31 0 2024-04-25T17:19:19.419 INFO:tasks.workunit.client.0.smithi037.stdout:8/633: unlink d5/db/d18/d3b/d75/faf 0 2024-04-25T17:19:19.421 INFO:tasks.workunit.client.0.smithi037.stdout:6/636: getdents db/d26/d2e/d7d/d65/d68 0 2024-04-25T17:19:19.422 INFO:tasks.workunit.client.0.smithi037.stdout:4/872: creat d7/d7e/d5b/dfe/d39/f120 x:0 0 0 2024-04-25T17:19:19.423 INFO:tasks.workunit.client.0.smithi037.stdout:3/514: symlink d8/d4c/l9e 0 2024-04-25T17:19:19.423 INFO:tasks.workunit.client.0.smithi037.stdout:9/868: dwrite d1/d48/d68/d26/d81/d9c/fa3 [0,4194304] 0 2024-04-25T17:19:19.426 INFO:tasks.workunit.client.0.smithi037.stdout:8/634: symlink d5/d26/d33/lcf 0 2024-04-25T17:19:19.428 INFO:tasks.workunit.client.0.smithi037.stdout:3/515: symlink d8/d23/d3a/l9f 0 2024-04-25T17:19:19.429 INFO:tasks.workunit.client.1.smithi069.stdout:3/663: chown d8/d16/d31/c32 43141 1 2024-04-25T17:19:19.429 INFO:tasks.workunit.client.1.smithi069.stdout:2/577: dwrite d0/d26/f93 [0,4194304] 0 2024-04-25T17:19:19.430 INFO:tasks.workunit.client.1.smithi069.stdout:1/612: unlink d1/d43/fb6 0 2024-04-25T17:19:19.431 INFO:tasks.workunit.client.0.smithi037.stdout:5/703: dwrite d7/d18/f29 [0,4194304] 0 2024-04-25T17:19:19.432 INFO:tasks.workunit.client.1.smithi069.stdout:6/565: symlink d2/d9c/d97/dad/lc6 0 2024-04-25T17:19:19.432 INFO:tasks.workunit.client.1.smithi069.stdout:4/590: mknod db/d15/d26/ccc 0 2024-04-25T17:19:19.432 INFO:tasks.workunit.client.0.smithi037.stdout:4/873: rename d7/d7e/d5b/cd2 to d7/d7e/d1e/dae/c121 0 2024-04-25T17:19:19.433 INFO:tasks.workunit.client.1.smithi069.stdout:1/613: truncate d1/df/f30 1439385 0 2024-04-25T17:19:19.435 INFO:tasks.workunit.client.1.smithi069.stdout:1/614: write d1/d43/f5b [1997558,89696] 0 2024-04-25T17:19:19.436 INFO:tasks.workunit.client.0.smithi037.stdout:6/637: dwrite db/d26/d2e/d3e/f35 [0,4194304] 0 2024-04-25T17:19:19.438 INFO:tasks.workunit.client.1.smithi069.stdout:7/620: mknod d4/d3e/d94/da1/dc7/d14/d44/d79/da4/ccc 0 2024-04-25T17:19:19.439 INFO:tasks.workunit.client.0.smithi037.stdout:3/516: read - d8/d23/d72/f76 zero size 2024-04-25T17:19:19.441 INFO:tasks.workunit.client.1.smithi069.stdout:4/591: dwrite db/d4b/f89 [0,4194304] 0 2024-04-25T17:19:19.444 INFO:tasks.workunit.client.0.smithi037.stdout:4/874: mknod d7/d7e/d5b/dfe/d39/d9c/c122 0 2024-04-25T17:19:19.446 INFO:tasks.workunit.client.0.smithi037.stdout:6/638: rmdir db/d26/d2e/d7d/d65/d68/d87 39 2024-04-25T17:19:19.447 INFO:tasks.workunit.client.1.smithi069.stdout:6/566: readlink d2/d1e/d3f/l5c 0 2024-04-25T17:19:19.449 INFO:tasks.workunit.client.0.smithi037.stdout:5/704: creat d7/d43/d9f/fd5 x:0 0 0 2024-04-25T17:19:19.451 INFO:tasks.workunit.client.1.smithi069.stdout:8/607: symlink d37/d47/d78/lcd 0 2024-04-25T17:19:19.451 INFO:tasks.workunit.client.0.smithi037.stdout:5/705: stat d7/d12/d6f/d68/fb6 0 2024-04-25T17:19:19.451 INFO:tasks.workunit.client.1.smithi069.stdout:4/592: dwrite db/d15/d20/d35/d63/f77 [0,4194304] 0 2024-04-25T17:19:19.452 INFO:tasks.workunit.client.0.smithi037.stdout:3/517: fdatasync d8/f5c 0 2024-04-25T17:19:19.452 INFO:tasks.workunit.client.0.smithi037.stdout:5/706: fsync d7/d25/f4b 0 2024-04-25T17:19:19.452 INFO:tasks.workunit.client.0.smithi037.stdout:9/869: link d1/c17 d1/d48/d68/d26/da1/db0/c11f 0 2024-04-25T17:19:19.454 INFO:tasks.workunit.client.0.smithi037.stdout:5/707: fsync d7/f1b 0 2024-04-25T17:19:19.454 INFO:tasks.workunit.client.0.smithi037.stdout:2/709: dread d0/d16/d68/f73 [0,4194304] 0 2024-04-25T17:19:19.455 INFO:tasks.workunit.client.1.smithi069.stdout:8/608: truncate d37/d47/d54/f91 591770 0 2024-04-25T17:19:19.455 INFO:tasks.workunit.client.1.smithi069.stdout:8/609: stat d37/d47/d48/f83 0 2024-04-25T17:19:19.458 INFO:tasks.workunit.client.0.smithi037.stdout:3/518: unlink d8/c1b 0 2024-04-25T17:19:19.459 INFO:tasks.workunit.client.0.smithi037.stdout:3/519: chown d8/d4c 64933575 1 2024-04-25T17:19:19.460 INFO:tasks.workunit.client.0.smithi037.stdout:4/875: creat d7/d7e/d5b/dfe/d39/d83/df1/f123 x:0 0 0 2024-04-25T17:19:19.462 INFO:tasks.workunit.client.0.smithi037.stdout:4/876: write d7/d7e/d1e/d70/d84/f115 [97993,89159] 0 2024-04-25T17:19:19.463 INFO:tasks.workunit.client.1.smithi069.stdout:6/567: rename d2/d1e/d3f/d56/f5e to d2/d1e/d3f/d86/fc7 0 2024-04-25T17:19:19.464 INFO:tasks.workunit.client.1.smithi069.stdout:4/593: dwrite db/d15/d20/d35/d63/d70/f86 [0,4194304] 0 2024-04-25T17:19:19.467 INFO:tasks.workunit.client.1.smithi069.stdout:9/588: sync 2024-04-25T17:19:19.467 INFO:tasks.workunit.client.0.smithi037.stdout:9/870: symlink d1/d48/d68/d26/da1/db0/l120 0 2024-04-25T17:19:19.467 INFO:tasks.workunit.client.0.smithi037.stdout:3/520: dwrite d8/d23/d3a/d5d/f7e [0,4194304] 0 2024-04-25T17:19:19.469 INFO:tasks.workunit.client.0.smithi037.stdout:9/871: dread - d1/d5/dc/d3c/dca/df5/f10d zero size 2024-04-25T17:19:19.469 INFO:tasks.workunit.client.0.smithi037.stdout:6/639: mknod db/d1d/d20/ce3 0 2024-04-25T17:19:19.471 INFO:tasks.workunit.client.1.smithi069.stdout:8/610: unlink d37/d66/cb0 0 2024-04-25T17:19:19.471 INFO:tasks.workunit.client.0.smithi037.stdout:2/710: truncate d0/d23/dac/f8e 1034500 0 2024-04-25T17:19:19.471 INFO:tasks.workunit.client.1.smithi069.stdout:8/611: write f13 [2488296,101745] 0 2024-04-25T17:19:19.472 INFO:tasks.workunit.client.1.smithi069.stdout:8/612: stat d37/d47/l69 0 2024-04-25T17:19:19.472 INFO:tasks.workunit.client.1.smithi069.stdout:8/613: readlink d37/l6c 0 2024-04-25T17:19:19.472 INFO:tasks.workunit.client.1.smithi069.stdout:2/578: rmdir d0/d56/d5f/d62/d7d/d31/d61/dae 0 2024-04-25T17:19:19.473 INFO:tasks.workunit.client.1.smithi069.stdout:7/621: truncate d4/d3e/d94/da1/dc7/f59 4836106 0 2024-04-25T17:19:19.477 INFO:tasks.workunit.client.1.smithi069.stdout:4/594: stat db/d15/d42/d53/lb4 0 2024-04-25T17:19:19.479 INFO:tasks.workunit.client.0.smithi037.stdout:6/640: rename db/d53/f58 to db/d1d/db1/dc7/fe4 0 2024-04-25T17:19:19.481 INFO:tasks.workunit.client.0.smithi037.stdout:3/521: mkdir d8/d23/da0 0 2024-04-25T17:19:19.482 INFO:tasks.workunit.client.1.smithi069.stdout:9/589: creat d2/da/dd/d1e/d2e/d68/fcd x:0 0 0 2024-04-25T17:19:19.484 INFO:tasks.workunit.client.1.smithi069.stdout:2/579: creat d0/d56/d5f/d62/d7d/d72/fb6 x:0 0 0 2024-04-25T17:19:19.485 INFO:tasks.workunit.client.1.smithi069.stdout:3/664: dread d8/d71/d8d/d92/faa [0,4194304] 0 2024-04-25T17:19:19.486 INFO:tasks.workunit.client.1.smithi069.stdout:7/622: dread d4/d1a/d34/f68 [0,4194304] 0 2024-04-25T17:19:19.486 INFO:tasks.workunit.client.0.smithi037.stdout:6/641: mknod db/d1d/d20/d2f/ce5 0 2024-04-25T17:19:19.487 INFO:tasks.workunit.client.0.smithi037.stdout:6/642: fsync db/d26/f27 0 2024-04-25T17:19:19.487 INFO:tasks.workunit.client.1.smithi069.stdout:6/568: dwrite d2/d7/f25 [0,4194304] 0 2024-04-25T17:19:19.488 INFO:tasks.workunit.client.0.smithi037.stdout:6/643: dread - db/d1d/db1/dc7/fdc zero size 2024-04-25T17:19:19.488 INFO:tasks.workunit.client.0.smithi037.stdout:3/522: creat d8/d57/fa1 x:0 0 0 2024-04-25T17:19:19.491 INFO:tasks.workunit.client.1.smithi069.stdout:4/595: dwrite db/d15/f1d [0,4194304] 0 2024-04-25T17:19:19.492 INFO:tasks.workunit.client.0.smithi037.stdout:3/523: mknod d8/d31/d32/d69/ca2 0 2024-04-25T17:19:19.492 INFO:tasks.workunit.client.0.smithi037.stdout:3/524: stat d8/f79 0 2024-04-25T17:19:19.493 INFO:tasks.workunit.client.1.smithi069.stdout:4/596: read db/f12 [4019076,33255] 0 2024-04-25T17:19:19.493 INFO:tasks.workunit.client.1.smithi069.stdout:6/569: symlink d2/d9c/d97/d98/lc8 0 2024-04-25T17:19:19.494 INFO:tasks.workunit.client.0.smithi037.stdout:9/872: getdents d1/d5/dc/d38/d8b 0 2024-04-25T17:19:19.496 INFO:tasks.workunit.client.0.smithi037.stdout:9/873: dread - d1/d5/d2e/d34/daf/dcb/f110 zero size 2024-04-25T17:19:19.496 INFO:tasks.workunit.client.1.smithi069.stdout:4/597: write db/d4b/d78/dc4/d41/fb7 [429028,81809] 0 2024-04-25T17:19:19.497 INFO:tasks.workunit.client.1.smithi069.stdout:7/623: truncate d4/f10 4859458 0 2024-04-25T17:19:19.498 INFO:tasks.workunit.client.1.smithi069.stdout:9/590: creat d2/da/dd/de/db0/fce x:0 0 0 2024-04-25T17:19:19.498 INFO:tasks.workunit.client.1.smithi069.stdout:4/598: chown db/d15/d42/d64/la8 28244033 1 2024-04-25T17:19:19.499 INFO:tasks.workunit.client.0.smithi037.stdout:3/525: rename l1 to d8/d31/d8d/la3 0 2024-04-25T17:19:19.501 INFO:tasks.workunit.client.0.smithi037.stdout:6/644: creat db/d26/fe6 x:0 0 0 2024-04-25T17:19:19.503 INFO:tasks.workunit.client.1.smithi069.stdout:2/580: dread d0/d56/d5f/d62/f73 [0,4194304] 0 2024-04-25T17:19:19.506 INFO:tasks.workunit.client.0.smithi037.stdout:3/526: dwrite d8/d31/d32/d3e/f9b [0,4194304] 0 2024-04-25T17:19:19.506 INFO:tasks.workunit.client.1.smithi069.stdout:3/665: getdents d8/d16/d1a/d2c/d49/d87/d8a/dd7 0 2024-04-25T17:19:19.508 INFO:tasks.workunit.client.0.smithi037.stdout:6/645: chown db/d26/d2e/d7d/d65/d68/d87 10 1 2024-04-25T17:19:19.509 INFO:tasks.workunit.client.0.smithi037.stdout:6/646: chown db/l33 3990 1 2024-04-25T17:19:19.510 INFO:tasks.workunit.client.0.smithi037.stdout:6/647: chown db/d26/d2e/d3e/d25/db0/fba 3 1 2024-04-25T17:19:19.511 INFO:tasks.workunit.client.0.smithi037.stdout:6/648: stat db/d5a/faa 0 2024-04-25T17:19:19.513 INFO:tasks.workunit.client.0.smithi037.stdout:2/711: dread d0/d16/d20/f39 [4194304,4194304] 0 2024-04-25T17:19:19.518 INFO:tasks.workunit.client.1.smithi069.stdout:9/591: rename d2/da/d14/d23 to d2/da4/dcf 0 2024-04-25T17:19:19.518 INFO:tasks.workunit.client.1.smithi069.stdout:0/523: sync 2024-04-25T17:19:19.518 INFO:tasks.workunit.client.1.smithi069.stdout:5/643: sync 2024-04-25T17:19:19.521 INFO:tasks.workunit.client.0.smithi037.stdout:2/712: dwrite d0/d16/d3b/dc4/fe3 [0,4194304] 0 2024-04-25T17:19:19.522 INFO:tasks.workunit.client.0.smithi037.stdout:6/649: creat db/d26/d2e/d7d/d65/d68/d87/dbd/fe7 x:0 0 0 2024-04-25T17:19:19.523 INFO:tasks.workunit.client.1.smithi069.stdout:2/581: symlink d0/d56/d5f/lb7 0 2024-04-25T17:19:19.523 INFO:tasks.workunit.client.0.smithi037.stdout:6/650: dread - db/d26/d2e/d3e/d25/d61/fd0 zero size 2024-04-25T17:19:19.524 INFO:tasks.workunit.client.0.smithi037.stdout:6/651: chown db/d26/d2e/d3e/f45 83 1 2024-04-25T17:19:19.525 INFO:tasks.workunit.client.1.smithi069.stdout:9/592: dwrite d2/da4/faf [0,4194304] 0 2024-04-25T17:19:19.526 INFO:tasks.workunit.client.0.smithi037.stdout:3/527: getdents d8/d23/d3a/d81 0 2024-04-25T17:19:19.526 INFO:tasks.workunit.client.0.smithi037.stdout:3/528: chown d8/d31/d32/d3e/c8a 109585 1 2024-04-25T17:19:19.527 INFO:tasks.workunit.client.1.smithi069.stdout:9/593: write d2/da/f20 [1781597,45181] 0 2024-04-25T17:19:19.528 INFO:tasks.workunit.client.1.smithi069.stdout:9/594: chown d2/da/l9d 16142269 1 2024-04-25T17:19:19.528 INFO:tasks.workunit.client.0.smithi037.stdout:3/529: write d8/d23/f91 [2871754,37717] 0 2024-04-25T17:19:19.530 INFO:tasks.workunit.client.1.smithi069.stdout:9/595: write d2/da/f10 [5540504,10908] 0 2024-04-25T17:19:19.530 INFO:tasks.workunit.client.0.smithi037.stdout:2/713: unlink d0/d7c/caf 0 2024-04-25T17:19:19.532 INFO:tasks.workunit.client.0.smithi037.stdout:2/714: chown d0/d23/dac/fd4 79778514 1 2024-04-25T17:19:19.533 INFO:tasks.workunit.client.0.smithi037.stdout:6/652: truncate db/d1d/f32 762690 0 2024-04-25T17:19:19.536 INFO:tasks.workunit.client.0.smithi037.stdout:3/530: dwrite d8/d31/f48 [0,4194304] 0 2024-04-25T17:19:19.539 INFO:tasks.workunit.client.1.smithi069.stdout:4/599: rename db/d15/d20/d35/d63/d43/d48/d49/f88 to db/d22/fcd 0 2024-04-25T17:19:19.539 INFO:tasks.workunit.client.1.smithi069.stdout:1/615: write d1/df/f34 [998002,107425] 0 2024-04-25T17:19:19.544 INFO:tasks.workunit.client.1.smithi069.stdout:5/644: chown d13/d17/d29/d30/d5c 46 1 2024-04-25T17:19:19.546 INFO:tasks.workunit.client.1.smithi069.stdout:5/645: dread - d13/d17/d19/d20/d51/db5/fb8 zero size 2024-04-25T17:19:19.546 INFO:tasks.workunit.client.1.smithi069.stdout:1/616: dwrite d1/d4/d6/d9e/da6/d7c/d4d/f7a [4194304,4194304] 0 2024-04-25T17:19:19.562 INFO:tasks.workunit.client.0.smithi037.stdout:3/531: dread d8/d31/f5f [0,4194304] 0 2024-04-25T17:19:19.563 INFO:tasks.workunit.client.0.smithi037.stdout:3/532: fdatasync d8/d23/d3a/d5d/f7e 0 2024-04-25T17:19:19.563 INFO:tasks.workunit.client.0.smithi037.stdout:3/533: stat d8/d23/d3a/f50 0 2024-04-25T17:19:19.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:19 smithi037 ceph-mon[26472]: pgmap v40: 65 pgs: 65 active+clean; 2.6 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 63 MiB/s rd, 218 MiB/s wr, 385 op/s 2024-04-25T17:19:19.642 INFO:tasks.workunit.client.1.smithi069.stdout:0/524: creat d0/da/db/d1d/d5f/fbd x:0 0 0 2024-04-25T17:19:19.643 INFO:tasks.workunit.client.0.smithi037.stdout:2/715: symlink d0/d23/d7d/dae/le4 0 2024-04-25T17:19:19.644 INFO:tasks.workunit.client.0.smithi037.stdout:2/716: chown d0/d15/d2a/cd0 18348802 1 2024-04-25T17:19:19.645 INFO:tasks.workunit.client.0.smithi037.stdout:2/717: stat d0/d16/d20/d55/fa6 0 2024-04-25T17:19:19.645 INFO:tasks.workunit.client.0.smithi037.stdout:4/877: write d7/d7e/d5b/dfe/d39/d9c/fca [100859,55769] 0 2024-04-25T17:19:19.648 INFO:tasks.workunit.client.0.smithi037.stdout:6/653: rename db/d26/d2e/d7d/d65/d68/d87/fa4 to db/d53/fe8 0 2024-04-25T17:19:19.649 INFO:tasks.workunit.client.1.smithi069.stdout:2/582: creat d0/d56/d94/fb8 x:0 0 0 2024-04-25T17:19:19.654 INFO:tasks.workunit.client.1.smithi069.stdout:3/666: symlink d8/d16/lec 0 2024-04-25T17:19:19.654 INFO:tasks.workunit.client.1.smithi069.stdout:3/667: chown d8/d16/d1a/d2c/l84 11 1 2024-04-25T17:19:19.658 INFO:tasks.workunit.client.1.smithi069.stdout:9/596: read d2/da4/dcf/d65/f73 [3664633,119737] 0 2024-04-25T17:19:19.658 INFO:tasks.workunit.client.0.smithi037.stdout:2/718: unlink d0/d16/d20/c74 0 2024-04-25T17:19:19.659 INFO:tasks.workunit.client.1.smithi069.stdout:8/614: truncate d37/d66/d6b/fb2 4014851 0 2024-04-25T17:19:19.661 INFO:tasks.workunit.client.1.smithi069.stdout:4/600: fsync db/d15/d20/d35/d63/f5c 0 2024-04-25T17:19:19.663 INFO:tasks.workunit.client.1.smithi069.stdout:4/601: write db/d15/d20/d35/d63/d70/faf [379797,106782] 0 2024-04-25T17:19:19.666 INFO:tasks.workunit.client.1.smithi069.stdout:5/646: mkdir d13/d17/d29/dde 0 2024-04-25T17:19:19.667 INFO:tasks.workunit.client.1.smithi069.stdout:1/617: truncate d1/df/d17/f3b 660060 0 2024-04-25T17:19:19.667 INFO:tasks.workunit.client.1.smithi069.stdout:6/570: write d2/d9c/d48/f77 [824337,43001] 0 2024-04-25T17:19:19.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:19 smithi069 ceph-mon[34527]: pgmap v40: 65 pgs: 65 active+clean; 2.6 GiB data, 9.2 GiB used, 527 GiB / 536 GiB avail; 63 MiB/s rd, 218 MiB/s wr, 385 op/s 2024-04-25T17:19:19.668 INFO:tasks.workunit.client.1.smithi069.stdout:7/624: write d4/d3e/d94/da1/dc7/d14/d5a/d5e/f7a [1260276,46276] 0 2024-04-25T17:19:19.671 INFO:tasks.workunit.client.1.smithi069.stdout:2/583: mkdir d0/d26/d36/db9 0 2024-04-25T17:19:19.671 INFO:tasks.workunit.client.1.smithi069.stdout:2/584: readlink d0/l1c 0 2024-04-25T17:19:19.674 INFO:tasks.workunit.client.0.smithi037.stdout:3/534: getdents d8/d23/d72 0 2024-04-25T17:19:19.674 INFO:tasks.workunit.client.0.smithi037.stdout:3/535: dread - d8/d4c/f8c zero size 2024-04-25T17:19:19.675 INFO:tasks.workunit.client.1.smithi069.stdout:9/597: symlink d2/da/dd/de/db0/ld0 0 2024-04-25T17:19:19.680 INFO:tasks.workunit.client.1.smithi069.stdout:4/602: mknod db/d15/d20/d35/d63/d70/d8a/cce 0 2024-04-25T17:19:19.682 INFO:tasks.workunit.client.1.smithi069.stdout:0/525: link d0/f7c d0/da/d24/d67/db8/fbe 0 2024-04-25T17:19:19.685 INFO:tasks.workunit.client.1.smithi069.stdout:6/571: dread - d2/d1e/d3f/d56/d7e/fa7 zero size 2024-04-25T17:19:19.689 INFO:tasks.workunit.client.1.smithi069.stdout:8/615: mkdir d37/d47/d54/d6e/dce 0 2024-04-25T17:19:19.689 INFO:tasks.workunit.client.1.smithi069.stdout:4/603: mknod db/d15/d20/d35/ccf 0 2024-04-25T17:19:19.690 INFO:tasks.workunit.client.1.smithi069.stdout:0/526: unlink d0/d17/f88 0 2024-04-25T17:19:19.694 INFO:tasks.workunit.client.1.smithi069.stdout:0/527: dread d0/da/d24/f72 [0,4194304] 0 2024-04-25T17:19:19.694 INFO:tasks.workunit.client.1.smithi069.stdout:1/618: mkdir d1/d43/d5f/d8e/dbb 0 2024-04-25T17:19:19.695 INFO:tasks.workunit.client.1.smithi069.stdout:6/572: creat d2/d1e/d43/fc9 x:0 0 0 2024-04-25T17:19:19.697 INFO:tasks.workunit.client.1.smithi069.stdout:7/625: mknod d4/d3e/d94/da1/dc7/d14/d44/da8/ccd 0 2024-04-25T17:19:19.697 INFO:tasks.workunit.client.1.smithi069.stdout:0/528: read d0/da/d24/f6d [2558959,86688] 0 2024-04-25T17:19:19.698 INFO:tasks.workunit.client.1.smithi069.stdout:2/585: getdents d0/d26/d36/db9 0 2024-04-25T17:19:19.698 INFO:tasks.workunit.client.1.smithi069.stdout:0/529: write d0/da/d24/f72 [601409,58793] 0 2024-04-25T17:19:19.699 INFO:tasks.workunit.client.1.smithi069.stdout:2/586: chown d0/d56/d5f/d62/d7d/d72/c8c 0 1 2024-04-25T17:19:19.699 INFO:tasks.workunit.client.1.smithi069.stdout:8/616: creat d37/d47/d54/d6e/d9e/fcf x:0 0 0 2024-04-25T17:19:19.701 INFO:tasks.workunit.client.0.smithi037.stdout:4/878: truncate d7/d7e/d5b/f85 5041 0 2024-04-25T17:19:19.702 INFO:tasks.workunit.client.0.smithi037.stdout:2/719: dwrite d0/d15/f81 [0,4194304] 0 2024-04-25T17:19:19.703 INFO:tasks.workunit.client.1.smithi069.stdout:5/647: link d13/d17/d19/d20/d51/db5/cc9 d13/d17/d29/d2e/d76/cdf 0 2024-04-25T17:19:19.706 INFO:tasks.workunit.client.1.smithi069.stdout:3/668: write d8/d16/f28 [1607383,75962] 0 2024-04-25T17:19:19.707 INFO:tasks.workunit.client.1.smithi069.stdout:1/619: symlink d1/d4/d6/d4f/d9b/lbc 0 2024-04-25T17:19:19.708 INFO:tasks.workunit.client.1.smithi069.stdout:4/604: dwrite db/d15/d42/d64/f83 [0,4194304] 0 2024-04-25T17:19:19.709 INFO:tasks.workunit.client.0.smithi037.stdout:2/720: rename d0/d15/dcb to d0/d16/d3c/de5 0 2024-04-25T17:19:19.711 INFO:tasks.workunit.client.1.smithi069.stdout:6/573: mkdir d2/d1e/d43/dca 0 2024-04-25T17:19:19.713 INFO:tasks.workunit.client.1.smithi069.stdout:7/626: creat d4/d3e/fce x:0 0 0 2024-04-25T17:19:19.714 INFO:tasks.workunit.client.1.smithi069.stdout:4/605: dread db/d15/d20/d35/d63/d43/d48/d49/f5a [0,4194304] 0 2024-04-25T17:19:19.715 INFO:tasks.workunit.client.1.smithi069.stdout:4/606: chown f8 505 1 2024-04-25T17:19:19.715 INFO:tasks.workunit.client.0.smithi037.stdout:3/536: dwrite d8/d57/f71 [0,4194304] 0 2024-04-25T17:19:19.716 INFO:tasks.workunit.client.1.smithi069.stdout:2/587: rmdir d0/d56/d5f 39 2024-04-25T17:19:19.720 INFO:tasks.workunit.client.0.smithi037.stdout:4/879: getdents d7/d7e/d1e/d70/d84 0 2024-04-25T17:19:19.723 INFO:tasks.workunit.client.1.smithi069.stdout:4/607: dwrite db/d4b/f89 [0,4194304] 0 2024-04-25T17:19:19.723 INFO:tasks.workunit.client.0.smithi037.stdout:3/537: fsync d8/d23/f93 0 2024-04-25T17:19:19.729 INFO:tasks.workunit.client.1.smithi069.stdout:1/620: dread d1/f28 [0,4194304] 0 2024-04-25T17:19:19.731 INFO:tasks.workunit.client.1.smithi069.stdout:4/608: dread db/d15/d20/faa [0,4194304] 0 2024-04-25T17:19:19.732 INFO:tasks.workunit.client.0.smithi037.stdout:4/880: creat d7/d7e/d5b/dfe/d39/d7a/db2/d113/f124 x:0 0 0 2024-04-25T17:19:19.735 INFO:tasks.workunit.client.1.smithi069.stdout:5/648: creat d13/d17/d19/d1c/da4/da9/daa/fe0 x:0 0 0 2024-04-25T17:19:19.736 INFO:tasks.workunit.client.1.smithi069.stdout:5/649: write d13/d17/d19/d1c/da4/da9/daa/fe0 [377607,122303] 0 2024-04-25T17:19:19.736 INFO:tasks.workunit.client.1.smithi069.stdout:3/669: truncate d8/d2a/f55 214232 0 2024-04-25T17:19:19.738 INFO:tasks.workunit.client.0.smithi037.stdout:4/881: creat d7/d7e/d5b/dfe/d39/dba/f125 x:0 0 0 2024-04-25T17:19:19.740 INFO:tasks.workunit.client.0.smithi037.stdout:4/882: write d7/d7e/d5b/dfe/d39/d7a/ffc [1017903,127987] 0 2024-04-25T17:19:19.741 INFO:tasks.workunit.client.1.smithi069.stdout:8/617: creat d37/d66/d6b/daf/fd0 x:0 0 0 2024-04-25T17:19:19.741 INFO:tasks.workunit.client.0.smithi037.stdout:4/883: chown d7/d7e/d5b/dfe/d39/d7a/db2/d113 86897020 1 2024-04-25T17:19:19.741 INFO:tasks.workunit.client.1.smithi069.stdout:8/618: dread - d37/d66/fc3 zero size 2024-04-25T17:19:19.743 INFO:tasks.workunit.client.1.smithi069.stdout:4/609: creat db/d15/d82/fd0 x:0 0 0 2024-04-25T17:19:19.743 INFO:tasks.workunit.client.1.smithi069.stdout:6/574: mknod d2/d1e/ccb 0 2024-04-25T17:19:19.745 INFO:tasks.workunit.client.1.smithi069.stdout:5/650: creat d13/d17/d19/d20/d51/db5/fe1 x:0 0 0 2024-04-25T17:19:19.745 INFO:tasks.workunit.client.1.smithi069.stdout:5/651: write d13/f1a [7629447,124585] 0 2024-04-25T17:19:19.748 INFO:tasks.workunit.client.1.smithi069.stdout:0/530: rmdir d0/da/db/d56/d98/dad 0 2024-04-25T17:19:19.748 INFO:tasks.workunit.client.0.smithi037.stdout:4/884: link d7/f1a d7/d7e/d5b/dfe/d39/d83/df1/f126 0 2024-04-25T17:19:19.749 INFO:tasks.workunit.client.0.smithi037.stdout:4/885: dread - d7/d7e/d1e/de1/fee zero size 2024-04-25T17:19:19.750 INFO:tasks.workunit.client.1.smithi069.stdout:8/619: stat l29 0 2024-04-25T17:19:19.750 INFO:tasks.workunit.client.0.smithi037.stdout:4/886: write d7/d67/d118/f8b [3097930,92942] 0 2024-04-25T17:19:19.751 INFO:tasks.workunit.client.1.smithi069.stdout:6/575: symlink d2/d9c/lcc 0 2024-04-25T17:19:19.751 INFO:tasks.workunit.client.1.smithi069.stdout:8/620: fdatasync d37/d47/d54/f92 0 2024-04-25T17:19:19.753 INFO:tasks.workunit.client.1.smithi069.stdout:0/531: truncate d0/da/db/d1d/fba 1397776 0 2024-04-25T17:19:19.754 INFO:tasks.workunit.client.0.smithi037.stdout:4/887: stat d7/d7e/d5b/dfe/d39/d83/df1/ff6 0 2024-04-25T17:19:19.754 INFO:tasks.workunit.client.1.smithi069.stdout:8/621: chown d37/d47/d48/d8e 1437 1 2024-04-25T17:19:19.755 INFO:tasks.workunit.client.1.smithi069.stdout:5/652: dwrite d13/d17/d29/d30/d9c/fb6 [0,4194304] 0 2024-04-25T17:19:19.757 INFO:tasks.workunit.client.1.smithi069.stdout:4/610: creat db/d4b/d78/dc4/d41/d9e/fd1 x:0 0 0 2024-04-25T17:19:19.758 INFO:tasks.workunit.client.1.smithi069.stdout:1/621: dread d1/f9 [0,4194304] 0 2024-04-25T17:19:19.758 INFO:tasks.workunit.client.1.smithi069.stdout:6/576: mknod d2/d1e/d43/db6/ccd 0 2024-04-25T17:19:19.758 INFO:tasks.workunit.client.0.smithi037.stdout:4/888: mknod d7/d7e/d4e/da5/c127 0 2024-04-25T17:19:19.759 INFO:tasks.workunit.client.1.smithi069.stdout:1/622: chown d1/df/d17/f9d 14 1 2024-04-25T17:19:19.760 INFO:tasks.workunit.client.1.smithi069.stdout:0/532: mknod d0/d38/d75/cbf 0 2024-04-25T17:19:19.763 INFO:tasks.workunit.client.1.smithi069.stdout:4/611: read db/f52 [2371943,10659] 0 2024-04-25T17:19:19.764 INFO:tasks.workunit.client.1.smithi069.stdout:8/622: symlink d37/d62/ld1 0 2024-04-25T17:19:19.766 INFO:tasks.workunit.client.0.smithi037.stdout:4/889: creat d7/d7e/d5b/dfe/d39/d9c/da3/f128 x:0 0 0 2024-04-25T17:19:19.766 INFO:tasks.workunit.client.1.smithi069.stdout:5/653: dread d13/d17/f1d [0,4194304] 0 2024-04-25T17:19:19.766 INFO:tasks.workunit.client.1.smithi069.stdout:3/670: dread d8/d16/d1a/f54 [0,4194304] 0 2024-04-25T17:19:19.769 INFO:tasks.workunit.client.1.smithi069.stdout:9/598: sync 2024-04-25T17:19:19.769 INFO:tasks.workunit.client.0.smithi037.stdout:4/890: mknod d7/d7e/d4e/da5/c129 0 2024-04-25T17:19:19.771 INFO:tasks.workunit.client.0.smithi037.stdout:4/891: stat d7/d7e/d5b/dfe/d39/d7a/f104 0 2024-04-25T17:19:19.771 INFO:tasks.workunit.client.1.smithi069.stdout:4/612: dwrite db/d15/d20/d35/d63/d43/d48/d49/d4e/fae [0,4194304] 0 2024-04-25T17:19:19.773 INFO:tasks.workunit.client.1.smithi069.stdout:1/623: rename d1/d4/l84 to d1/d4/de/d44/d68/lbd 0 2024-04-25T17:19:19.774 INFO:tasks.workunit.client.1.smithi069.stdout:8/623: read d37/f3f [2979138,129692] 0 2024-04-25T17:19:19.775 INFO:tasks.workunit.client.1.smithi069.stdout:4/613: dread - db/d4b/d78/dc4/d41/d9e/fd1 zero size 2024-04-25T17:19:19.778 INFO:tasks.workunit.client.1.smithi069.stdout:9/599: dwrite d2/da/dd/de/fcb [0,4194304] 0 2024-04-25T17:19:19.783 INFO:tasks.workunit.client.1.smithi069.stdout:5/654: fdatasync d13/d17/d19/d20/f9a 0 2024-04-25T17:19:19.783 INFO:tasks.workunit.client.1.smithi069.stdout:9/600: dread d2/da/dd/d1e/d2e/f45 [0,4194304] 0 2024-04-25T17:19:19.785 INFO:tasks.workunit.client.1.smithi069.stdout:6/577: mkdir d2/d1e/d43/dca/dce 0 2024-04-25T17:19:19.788 INFO:tasks.workunit.client.1.smithi069.stdout:5/655: dread d13/f8b [0,4194304] 0 2024-04-25T17:19:19.789 INFO:tasks.workunit.client.1.smithi069.stdout:3/671: unlink d8/d16/d1a/f54 0 2024-04-25T17:19:19.793 INFO:tasks.workunit.client.1.smithi069.stdout:2/588: write d0/d56/d5f/f65 [452022,3822] 0 2024-04-25T17:19:19.794 INFO:tasks.workunit.client.1.smithi069.stdout:2/589: dread - d0/d26/fa0 zero size 2024-04-25T17:19:19.799 INFO:tasks.workunit.client.1.smithi069.stdout:1/624: rmdir d1/d4/d6 39 2024-04-25T17:19:19.799 INFO:tasks.workunit.client.1.smithi069.stdout:2/590: dwrite d0/d26/d10/d43/f7a [0,4194304] 0 2024-04-25T17:19:19.800 INFO:tasks.workunit.client.1.smithi069.stdout:2/591: chown d0/f92 789199 1 2024-04-25T17:19:19.801 INFO:tasks.workunit.client.1.smithi069.stdout:8/624: rmdir d37 39 2024-04-25T17:19:19.803 INFO:tasks.workunit.client.1.smithi069.stdout:4/614: creat db/d15/d20/d35/d63/d43/d48/d49/d4e/fd2 x:0 0 0 2024-04-25T17:19:19.811 INFO:tasks.workunit.client.1.smithi069.stdout:6/578: chown d2/d51/d85/la4 100984595 1 2024-04-25T17:19:19.812 INFO:tasks.workunit.client.1.smithi069.stdout:5/656: fdatasync d13/d17/f1d 0 2024-04-25T17:19:19.813 INFO:tasks.workunit.client.1.smithi069.stdout:7/627: dwrite d4/f10 [4194304,4194304] 0 2024-04-25T17:19:19.814 INFO:tasks.workunit.client.1.smithi069.stdout:0/533: link d0/da/d24/f6d d0/da/d24/d43/fc0 0 2024-04-25T17:19:19.815 INFO:tasks.workunit.client.1.smithi069.stdout:3/672: read d8/d71/f81 [560857,19624] 0 2024-04-25T17:19:19.816 INFO:tasks.workunit.client.1.smithi069.stdout:0/534: write d0/da/db/d73/fb5 [563036,32361] 0 2024-04-25T17:19:19.824 INFO:tasks.workunit.client.1.smithi069.stdout:0/535: dwrite d0/da/d24/f42 [0,4194304] 0 2024-04-25T17:19:19.825 INFO:tasks.workunit.client.1.smithi069.stdout:4/615: dread db/d15/d20/d35/d63/f5c [0,4194304] 0 2024-04-25T17:19:19.825 INFO:tasks.workunit.client.1.smithi069.stdout:6/579: creat d2/d1e/d3f/d56/d7e/fcf x:0 0 0 2024-04-25T17:19:19.826 INFO:tasks.workunit.client.1.smithi069.stdout:4/616: stat db/d15/d20/d35/d63/d43/d48/d49 0 2024-04-25T17:19:19.829 INFO:tasks.workunit.client.1.smithi069.stdout:4/617: truncate db/d15/d20/d35/d63/d75/f9b 1033753 0 2024-04-25T17:19:19.831 INFO:tasks.workunit.client.0.smithi037.stdout:1/814: sync 2024-04-25T17:19:19.831 INFO:tasks.workunit.client.0.smithi037.stdout:0/715: sync 2024-04-25T17:19:19.831 INFO:tasks.workunit.client.1.smithi069.stdout:4/618: chown db/d15/d42/d64/d7f/cad 4596510 1 2024-04-25T17:19:19.832 INFO:tasks.workunit.client.1.smithi069.stdout:3/673: unlink d8/d16/d1a/d2c/f45 0 2024-04-25T17:19:19.833 INFO:tasks.workunit.client.1.smithi069.stdout:6/580: dwrite d2/d7/fa [0,4194304] 0 2024-04-25T17:19:19.833 INFO:tasks.workunit.client.1.smithi069.stdout:4/619: write db/d15/d26/f29 [5048111,1961] 0 2024-04-25T17:19:19.835 INFO:tasks.workunit.client.1.smithi069.stdout:3/674: write d8/d71/d8d/d92/db6/dc1/f7f [438948,70227] 0 2024-04-25T17:19:19.865 INFO:tasks.workunit.client.0.smithi037.stdout:3/538: dwrite d8/d57/f5e [0,4194304] 0 2024-04-25T17:19:19.886 INFO:tasks.workunit.client.0.smithi037.stdout:0/716: dread d9/fc5 [0,4194304] 0 2024-04-25T17:19:20.004 INFO:tasks.workunit.client.1.smithi069.stdout:1/625: chown d1/d4/d6/d81/l93 24505 1 2024-04-25T17:19:20.005 INFO:tasks.workunit.client.1.smithi069.stdout:9/601: write d2/da/d5f/f6d [764001,14749] 0 2024-04-25T17:19:20.013 INFO:tasks.workunit.client.1.smithi069.stdout:2/592: write d0/d56/f5e [4645454,107916] 0 2024-04-25T17:19:20.014 INFO:tasks.workunit.client.1.smithi069.stdout:2/593: readlink d0/d56/d5f/d62/l91 0 2024-04-25T17:19:20.014 INFO:tasks.workunit.client.1.smithi069.stdout:0/536: rmdir d0/da/db/d1d 39 2024-04-25T17:19:20.015 INFO:tasks.workunit.client.1.smithi069.stdout:2/594: fdatasync d0/d56/d5f/f65 0 2024-04-25T17:19:20.025 INFO:tasks.workunit.client.0.smithi037.stdout:8/635: sync 2024-04-25T17:19:20.025 INFO:tasks.workunit.client.0.smithi037.stdout:7/607: sync 2024-04-25T17:19:20.025 INFO:tasks.workunit.client.0.smithi037.stdout:5/708: sync 2024-04-25T17:19:20.026 INFO:tasks.workunit.client.0.smithi037.stdout:8/636: dread - d5/db/d7e/fb7 zero size 2024-04-25T17:19:20.029 INFO:tasks.workunit.client.1.smithi069.stdout:4/620: dwrite db/d15/d20/f2e [0,4194304] 0 2024-04-25T17:19:20.050 INFO:tasks.workunit.client.0.smithi037.stdout:4/892: rename d7/d7e/d5b/dfe/f40 to d7/d7e/d4e/da5/d112/f12a 0 2024-04-25T17:19:20.054 INFO:tasks.workunit.client.0.smithi037.stdout:4/893: dread d7/d7e/d5b/dfe/d39/d7a/fd4 [0,4194304] 0 2024-04-25T17:19:20.055 INFO:tasks.workunit.client.0.smithi037.stdout:4/894: chown d7/d78 321034577 1 2024-04-25T17:19:20.055 INFO:tasks.workunit.client.0.smithi037.stdout:0/717: readlink d9/d14/d23/lc7 0 2024-04-25T17:19:20.055 INFO:tasks.workunit.client.0.smithi037.stdout:4/895: chown d7/d67/d118/c10b 6152 1 2024-04-25T17:19:20.056 INFO:tasks.workunit.client.0.smithi037.stdout:4/896: chown d7/d7e/d45/d4f 186215762 1 2024-04-25T17:19:20.069 INFO:tasks.workunit.client.0.smithi037.stdout:0/718: fsync d9/d72/fa0 0 2024-04-25T17:19:20.072 INFO:tasks.workunit.client.0.smithi037.stdout:4/897: creat d7/d7e/d1e/dae/dc6/f12b x:0 0 0 2024-04-25T17:19:20.077 INFO:tasks.workunit.client.0.smithi037.stdout:7/608: mknod d5/d14/dcf/cd6 0 2024-04-25T17:19:20.080 INFO:tasks.workunit.client.0.smithi037.stdout:8/637: mkdir d5/dd0 0 2024-04-25T17:19:20.081 INFO:tasks.workunit.client.0.smithi037.stdout:8/638: dread - d5/db/d18/d3b/d75/fbf zero size 2024-04-25T17:19:20.082 INFO:tasks.workunit.client.0.smithi037.stdout:8/639: chown d5/d6a/f3f 705 1 2024-04-25T17:19:20.093 INFO:tasks.workunit.client.0.smithi037.stdout:8/640: symlink d5/db/d23/d78/ld1 0 2024-04-25T17:19:20.108 INFO:tasks.workunit.client.1.smithi069.stdout:2/595: creat d0/d26/d36/fba x:0 0 0 2024-04-25T17:19:20.115 INFO:tasks.workunit.client.1.smithi069.stdout:6/581: dread d2/d9c/d48/f5d [0,4194304] 0 2024-04-25T17:19:20.116 INFO:tasks.workunit.client.1.smithi069.stdout:8/625: creat d37/d47/d54/d6e/fd2 x:0 0 0 2024-04-25T17:19:20.117 INFO:tasks.workunit.client.1.smithi069.stdout:8/626: stat d37/d47/f5a 0 2024-04-25T17:19:20.117 INFO:tasks.workunit.client.1.smithi069.stdout:5/657: getdents d13/d17/d19/d1c/da4 0 2024-04-25T17:19:20.117 INFO:tasks.workunit.client.1.smithi069.stdout:8/627: chown d37/f5b 2071 1 2024-04-25T17:19:20.119 INFO:tasks.workunit.client.1.smithi069.stdout:2/596: write d0/d56/d5f/d62/f73 [1924750,60421] 0 2024-04-25T17:19:20.119 INFO:tasks.workunit.client.1.smithi069.stdout:8/628: write d37/d66/fc3 [938458,66405] 0 2024-04-25T17:19:20.120 INFO:tasks.workunit.client.1.smithi069.stdout:1/626: creat d1/d43/d1b/d32/d4a/fbe x:0 0 0 2024-04-25T17:19:20.121 INFO:tasks.workunit.client.1.smithi069.stdout:1/627: stat d1/d43/c2b 0 2024-04-25T17:19:20.124 INFO:tasks.workunit.client.1.smithi069.stdout:5/658: mknod d13/d17/d19/d96/ce2 0 2024-04-25T17:19:20.128 INFO:tasks.workunit.client.1.smithi069.stdout:2/597: dwrite d0/d56/d5f/d62/d7d/d31/f7c [0,4194304] 0 2024-04-25T17:19:20.132 INFO:tasks.workunit.client.1.smithi069.stdout:6/582: mknod d2/d1e/d43/cd0 0 2024-04-25T17:19:20.137 INFO:tasks.workunit.client.1.smithi069.stdout:6/583: symlink d2/d1e/d3e/d67/ld1 0 2024-04-25T17:19:20.139 INFO:tasks.workunit.client.1.smithi069.stdout:2/598: creat d0/d1/d5b/fbb x:0 0 0 2024-04-25T17:19:20.141 INFO:tasks.workunit.client.1.smithi069.stdout:2/599: fsync d0/d1/d5b/d33/fa3 0 2024-04-25T17:19:20.141 INFO:tasks.workunit.client.1.smithi069.stdout:8/629: dread f33 [0,4194304] 0 2024-04-25T17:19:20.142 INFO:tasks.workunit.client.1.smithi069.stdout:6/584: read d2/d1e/f71 [633198,103232] 0 2024-04-25T17:19:20.143 INFO:tasks.workunit.client.1.smithi069.stdout:8/630: symlink d37/d62/ld3 0 2024-04-25T17:19:20.145 INFO:tasks.workunit.client.1.smithi069.stdout:6/585: creat d2/d1e/d43/dca/fd2 x:0 0 0 2024-04-25T17:19:20.148 INFO:tasks.workunit.client.0.smithi037.stdout:9/874: sync 2024-04-25T17:19:20.148 INFO:tasks.workunit.client.1.smithi069.stdout:8/631: mknod d37/d47/cd4 0 2024-04-25T17:19:20.149 INFO:tasks.workunit.client.0.smithi037.stdout:9/875: dread d1/d48/d68/f74 [0,4194304] 0 2024-04-25T17:19:20.150 INFO:tasks.workunit.client.0.smithi037.stdout:9/876: chown d1/d5/dc/d3c/d116/d118 28159 1 2024-04-25T17:19:20.151 INFO:tasks.workunit.client.1.smithi069.stdout:8/632: mknod d37/d47/d54/d6e/d9e/cd5 0 2024-04-25T17:19:20.151 INFO:tasks.workunit.client.0.smithi037.stdout:9/877: write d1/d5/d2e/d34/d76/db4/fff [318863,94843] 0 2024-04-25T17:19:20.156 INFO:tasks.workunit.client.1.smithi069.stdout:8/633: creat d37/fd6 x:0 0 0 2024-04-25T17:19:20.159 INFO:tasks.workunit.client.1.smithi069.stdout:8/634: dread f33 [0,4194304] 0 2024-04-25T17:19:20.163 INFO:tasks.workunit.client.1.smithi069.stdout:6/586: dread d2/d1e/f6a [4194304,4194304] 0 2024-04-25T17:19:20.166 INFO:tasks.workunit.client.1.smithi069.stdout:6/587: symlink d2/d1e/d43/dca/ld3 0 2024-04-25T17:19:20.167 INFO:tasks.workunit.client.1.smithi069.stdout:6/588: readlink d2/d9c/d97/lae 0 2024-04-25T17:19:20.170 INFO:tasks.workunit.client.1.smithi069.stdout:6/589: creat d2/d9c/d97/fd4 x:0 0 0 2024-04-25T17:19:20.171 INFO:tasks.workunit.client.1.smithi069.stdout:6/590: dread - d2/d1e/d3f/d56/d7e/fcf zero size 2024-04-25T17:19:20.173 INFO:tasks.workunit.client.1.smithi069.stdout:6/591: creat d2/d7/dbc/fd5 x:0 0 0 2024-04-25T17:19:20.175 INFO:tasks.workunit.client.1.smithi069.stdout:6/592: dread - d2/d1e/d3e/d67/f79 zero size 2024-04-25T17:19:20.175 INFO:tasks.workunit.client.1.smithi069.stdout:8/635: dread d37/d47/d48/f7b [0,4194304] 0 2024-04-25T17:19:20.176 INFO:tasks.workunit.client.1.smithi069.stdout:6/593: write d2/d1e/d3f/d86/da8/fa9 [4162588,107889] 0 2024-04-25T17:19:20.183 INFO:tasks.workunit.client.1.smithi069.stdout:6/594: link d2/d1e/d43/dca/fd2 d2/d1e/d3f/d56/fd6 0 2024-04-25T17:19:20.188 INFO:tasks.workunit.client.1.smithi069.stdout:6/595: dread d2/d51/d85/f45 [0,4194304] 0 2024-04-25T17:19:20.192 INFO:tasks.workunit.client.1.smithi069.stdout:6/596: getdents d2/d51 0 2024-04-25T17:19:20.194 INFO:tasks.workunit.client.1.smithi069.stdout:6/597: write d2/d1e/d43/f70 [3770840,110680] 0 2024-04-25T17:19:20.194 INFO:tasks.workunit.client.0.smithi037.stdout:5/709: write f1 [8622107,53752] 0 2024-04-25T17:19:20.196 INFO:tasks.workunit.client.0.smithi037.stdout:5/710: write d7/d12/da8/fd0 [21492,109210] 0 2024-04-25T17:19:20.198 INFO:tasks.workunit.client.0.smithi037.stdout:6/654: sync 2024-04-25T17:19:20.198 INFO:tasks.workunit.client.0.smithi037.stdout:2/721: sync 2024-04-25T17:19:20.199 INFO:tasks.workunit.client.1.smithi069.stdout:7/628: rename d4/d3e/d94/da1/dc7/d14/d44/d7c/d9f/dcb/dc3 to d4/d3e/d94/da1/dc7/d14/dcf 0 2024-04-25T17:19:20.199 INFO:tasks.workunit.client.0.smithi037.stdout:6/655: dread - db/f98 zero size 2024-04-25T17:19:20.199 INFO:tasks.workunit.client.0.smithi037.stdout:2/722: stat d0/d15/d2a/cd0 0 2024-04-25T17:19:20.200 INFO:tasks.workunit.client.1.smithi069.stdout:6/598: dwrite d2/d7/fa [0,4194304] 0 2024-04-25T17:19:20.200 INFO:tasks.workunit.client.0.smithi037.stdout:2/723: readlink d0/d16/ld9 0 2024-04-25T17:19:20.205 INFO:tasks.workunit.client.1.smithi069.stdout:3/675: rename d8/d2a/l61 to d8/d71/d8d/d92/led 0 2024-04-25T17:19:20.206 INFO:tasks.workunit.client.0.smithi037.stdout:5/711: dwrite d7/d43/f30 [0,4194304] 0 2024-04-25T17:19:20.207 INFO:tasks.workunit.client.1.smithi069.stdout:6/599: rmdir d2/d9c/d48 39 2024-04-25T17:19:20.209 INFO:tasks.workunit.client.0.smithi037.stdout:5/712: write d7/d12/d6f/dbc/dc6/fd2 [186767,71257] 0 2024-04-25T17:19:20.209 INFO:tasks.workunit.client.1.smithi069.stdout:6/600: truncate d2/d7/dbc/fd5 903057 0 2024-04-25T17:19:20.216 INFO:tasks.workunit.client.0.smithi037.stdout:5/713: dread d7/d43/f30 [0,4194304] 0 2024-04-25T17:19:20.219 INFO:tasks.workunit.client.1.smithi069.stdout:7/629: link d4/d3e/d94/da1/dc7/d14/faa d4/d3e/d94/fd0 0 2024-04-25T17:19:20.220 INFO:tasks.workunit.client.0.smithi037.stdout:1/815: dwrite dc/d52/d6b/dd9/d4d/d6a/d86/d9b/fd3 [0,4194304] 0 2024-04-25T17:19:20.223 INFO:tasks.workunit.client.1.smithi069.stdout:6/601: symlink d2/d1e/d3f/d86/ld7 0 2024-04-25T17:19:20.224 INFO:tasks.workunit.client.1.smithi069.stdout:6/602: dread - d2/d51/d89/f90 zero size 2024-04-25T17:19:20.225 INFO:tasks.workunit.client.1.smithi069.stdout:6/603: chown d2/d1e/d3f/d56/c66 60608 1 2024-04-25T17:19:20.226 INFO:tasks.workunit.client.1.smithi069.stdout:6/604: write d2/d1e/d3f/d86/fb1 [98727,64587] 0 2024-04-25T17:19:20.227 INFO:tasks.workunit.client.1.smithi069.stdout:6/605: write d2/d7/fd [1237206,105673] 0 2024-04-25T17:19:20.230 INFO:tasks.workunit.client.1.smithi069.stdout:6/606: dread d2/d51/d85/f6f [0,4194304] 0 2024-04-25T17:19:20.232 INFO:tasks.workunit.client.0.smithi037.stdout:5/714: symlink d7/d12/d6f/ld6 0 2024-04-25T17:19:20.241 INFO:tasks.workunit.client.1.smithi069.stdout:8/636: rename l1f to d37/ld7 0 2024-04-25T17:19:20.243 INFO:tasks.workunit.client.0.smithi037.stdout:5/715: truncate d7/d12/d6f/d94/fcc 217218 0 2024-04-25T17:19:20.245 INFO:tasks.workunit.client.1.smithi069.stdout:8/637: creat d37/d47/d48/fd8 x:0 0 0 2024-04-25T17:19:20.247 INFO:tasks.workunit.client.1.smithi069.stdout:2/600: mkdir d0/d56/d5f/d62/dbc 0 2024-04-25T17:19:20.248 INFO:tasks.workunit.client.0.smithi037.stdout:0/719: write d9/d14/d28/f8c [600846,8582] 0 2024-04-25T17:19:20.252 INFO:tasks.workunit.client.0.smithi037.stdout:7/609: write d5/d14/f97 [102921,5102] 0 2024-04-25T17:19:20.254 INFO:tasks.workunit.client.0.smithi037.stdout:4/898: dwrite d7/d7e/d1e/dae/fbb [0,4194304] 0 2024-04-25T17:19:20.254 INFO:tasks.workunit.client.1.smithi069.stdout:2/601: link d0/d26/d10/c3e d0/d56/d5f/d62/d7d/d72/daf/cbd 0 2024-04-25T17:19:20.257 INFO:tasks.workunit.client.0.smithi037.stdout:7/610: creat d5/d14/dd3/fd7 x:0 0 0 2024-04-25T17:19:20.260 INFO:tasks.workunit.client.0.smithi037.stdout:4/899: mkdir d7/d7e/d5b/dfe/d39/dba/d12c 0 2024-04-25T17:19:20.264 INFO:tasks.workunit.client.1.smithi069.stdout:2/602: rename d0/d1/f1f to d0/d26/d10/d43/fbe 0 2024-04-25T17:19:20.265 INFO:tasks.workunit.client.0.smithi037.stdout:7/611: chown d5/d15/d17/c8f 0 1 2024-04-25T17:19:20.265 INFO:tasks.workunit.client.0.smithi037.stdout:7/612: chown d5/d14/c18 155 1 2024-04-25T17:19:20.268 INFO:tasks.workunit.client.0.smithi037.stdout:7/613: dread - d5/d15/d17/d1b/da2/daf/f8d zero size 2024-04-25T17:19:20.271 INFO:tasks.workunit.client.1.smithi069.stdout:2/603: rename d0/d1/l21 to d0/d56/d5f/d62/lbf 0 2024-04-25T17:19:20.273 INFO:tasks.workunit.client.0.smithi037.stdout:8/641: dwrite d5/db/fb8 [0,4194304] 0 2024-04-25T17:19:20.273 INFO:tasks.workunit.client.0.smithi037.stdout:4/900: link d7/d7e/d45/d4f/l5d d7/d7e/d5b/l12d 0 2024-04-25T17:19:20.273 INFO:tasks.workunit.client.1.smithi069.stdout:2/604: dread d0/d56/d5f/f71 [0,4194304] 0 2024-04-25T17:19:20.275 INFO:tasks.workunit.client.1.smithi069.stdout:0/537: creat d0/da/fc1 x:0 0 0 2024-04-25T17:19:20.277 INFO:tasks.workunit.client.0.smithi037.stdout:2/724: rename d0/d16/d26/l4d to d0/d16/le6 0 2024-04-25T17:19:20.278 INFO:tasks.workunit.client.1.smithi069.stdout:2/605: creat d0/d56/d94/fc0 x:0 0 0 2024-04-25T17:19:20.280 INFO:tasks.workunit.client.0.smithi037.stdout:4/901: rmdir d7/d7e/d1e/d70 39 2024-04-25T17:19:20.282 INFO:tasks.workunit.client.1.smithi069.stdout:0/538: creat d0/da/d59/dab/fc2 x:0 0 0 2024-04-25T17:19:20.282 INFO:tasks.workunit.client.0.smithi037.stdout:3/539: sync 2024-04-25T17:19:20.283 INFO:tasks.workunit.client.1.smithi069.stdout:0/539: dread - d0/d17/fb9 zero size 2024-04-25T17:19:20.283 INFO:tasks.workunit.client.1.smithi069.stdout:9/602: write d2/da/dd/f11 [2614469,28183] 0 2024-04-25T17:19:20.286 INFO:tasks.workunit.client.1.smithi069.stdout:4/621: dwrite db/f52 [0,4194304] 0 2024-04-25T17:19:20.286 INFO:tasks.workunit.client.0.smithi037.stdout:2/725: fdatasync d0/d15/fc7 0 2024-04-25T17:19:20.287 INFO:tasks.workunit.client.0.smithi037.stdout:2/726: write d0/d23/dac/fe1 [3111874,118315] 0 2024-04-25T17:19:20.288 INFO:tasks.workunit.client.1.smithi069.stdout:9/603: dread - d2/da/f4e zero size 2024-04-25T17:19:20.288 INFO:tasks.workunit.client.0.smithi037.stdout:8/642: rmdir d5/db/d18/d3b/d50/d51 39 2024-04-25T17:19:20.289 INFO:tasks.workunit.client.1.smithi069.stdout:4/622: dread - db/d15/d20/d35/d63/f60 zero size 2024-04-25T17:19:20.291 INFO:tasks.workunit.client.0.smithi037.stdout:3/540: symlink d8/d57/la4 0 2024-04-25T17:19:20.292 INFO:tasks.workunit.client.1.smithi069.stdout:9/604: stat d2/da/dd/de/d74/la0 0 2024-04-25T17:19:20.293 INFO:tasks.workunit.client.1.smithi069.stdout:0/540: dwrite d0/da/d24/f42 [0,4194304] 0 2024-04-25T17:19:20.293 INFO:tasks.workunit.client.1.smithi069.stdout:9/605: dread - d2/da/f4e zero size 2024-04-25T17:19:20.294 INFO:tasks.workunit.client.1.smithi069.stdout:1/628: sync 2024-04-25T17:19:20.295 INFO:tasks.workunit.client.0.smithi037.stdout:8/643: dwrite d5/db/d18/d3b/d75/f9e [0,4194304] 0 2024-04-25T17:19:20.295 INFO:tasks.workunit.client.1.smithi069.stdout:4/623: truncate db/d4b/d78/dc4/d41/fb7 613031 0 2024-04-25T17:19:20.296 INFO:tasks.workunit.client.1.smithi069.stdout:1/629: readlink d1/d4/d6/lb5 0 2024-04-25T17:19:20.298 INFO:tasks.workunit.client.0.smithi037.stdout:2/727: rmdir d0/d16/d3c 39 2024-04-25T17:19:20.298 INFO:tasks.workunit.client.0.smithi037.stdout:2/728: readlink d0/d23/l5c 0 2024-04-25T17:19:20.300 INFO:tasks.workunit.client.1.smithi069.stdout:4/624: chown db/d15/d20/d38 1593081 1 2024-04-25T17:19:20.301 INFO:tasks.workunit.client.0.smithi037.stdout:3/541: creat d8/d23/d72/fa5 x:0 0 0 2024-04-25T17:19:20.303 INFO:tasks.workunit.client.1.smithi069.stdout:9/606: readlink d2/da/dd/d1e/d2e/l63 0 2024-04-25T17:19:20.303 INFO:tasks.workunit.client.1.smithi069.stdout:9/607: readlink d2/da/l1d 0 2024-04-25T17:19:20.305 INFO:tasks.workunit.client.1.smithi069.stdout:5/659: dwrite d13/d17/d29/d2e/f59 [0,4194304] 0 2024-04-25T17:19:20.305 INFO:tasks.workunit.client.0.smithi037.stdout:6/656: rename db/d1d/d20/d2f/l52 to db/d26/d2e/d7d/d65/le9 0 2024-04-25T17:19:20.306 INFO:tasks.workunit.client.1.smithi069.stdout:1/630: rmdir d1/d4/d6/d9e/da6/d7c/d1d 39 2024-04-25T17:19:20.307 INFO:tasks.workunit.client.1.smithi069.stdout:1/631: chown d1/d4/l52 25212529 1 2024-04-25T17:19:20.310 INFO:tasks.workunit.client.1.smithi069.stdout:4/625: rmdir db/d15/d42/d64/d7f 39 2024-04-25T17:19:20.311 INFO:tasks.workunit.client.0.smithi037.stdout:8/644: symlink d5/db/d18/ld2 0 2024-04-25T17:19:20.313 INFO:tasks.workunit.client.0.smithi037.stdout:8/645: chown d5/d26/d81/fc7 28267 1 2024-04-25T17:19:20.313 INFO:tasks.workunit.client.1.smithi069.stdout:0/541: chown d0/da/db/d1d/c82 6523337 1 2024-04-25T17:19:20.315 INFO:tasks.workunit.client.0.smithi037.stdout:2/729: mknod d0/d16/d26/ce7 0 2024-04-25T17:19:20.317 INFO:tasks.workunit.client.0.smithi037.stdout:3/542: fdatasync d8/f58 0 2024-04-25T17:19:20.318 INFO:tasks.workunit.client.1.smithi069.stdout:5/660: truncate d13/d17/d19/d20/f9a 740274 0 2024-04-25T17:19:20.320 INFO:tasks.workunit.client.0.smithi037.stdout:9/878: mkdir d1/d48/d121 0 2024-04-25T17:19:20.322 INFO:tasks.workunit.client.1.smithi069.stdout:4/626: rmdir db/d4b/d78/d79 39 2024-04-25T17:19:20.323 INFO:tasks.workunit.client.0.smithi037.stdout:8/646: mkdir d5/db/d23/d58/dd3 0 2024-04-25T17:19:20.324 INFO:tasks.workunit.client.1.smithi069.stdout:0/542: creat d0/da/d59/fc3 x:0 0 0 2024-04-25T17:19:20.326 INFO:tasks.workunit.client.0.smithi037.stdout:2/730: creat d0/d23/d7d/dae/fe8 x:0 0 0 2024-04-25T17:19:20.327 INFO:tasks.workunit.client.0.smithi037.stdout:2/731: stat d0/d23/dac/f87 0 2024-04-25T17:19:20.327 INFO:tasks.workunit.client.1.smithi069.stdout:5/661: creat d13/d17/d19/d96/fe3 x:0 0 0 2024-04-25T17:19:20.329 INFO:tasks.workunit.client.0.smithi037.stdout:3/543: fdatasync d8/f79 0 2024-04-25T17:19:20.331 INFO:tasks.workunit.client.1.smithi069.stdout:0/543: dwrite d0/da/db/d2c/f4d [8388608,4194304] 0 2024-04-25T17:19:20.335 INFO:tasks.workunit.client.1.smithi069.stdout:5/662: dread - d13/f8c zero size 2024-04-25T17:19:20.339 INFO:tasks.workunit.client.0.smithi037.stdout:3/544: unlink d8/d23/d3a/d81/l95 0 2024-04-25T17:19:20.340 INFO:tasks.workunit.client.0.smithi037.stdout:6/657: dread db/f56 [0,4194304] 0 2024-04-25T17:19:20.341 INFO:tasks.workunit.client.1.smithi069.stdout:4/627: creat db/d15/d20/d35/d63/d43/d48/d6c/fd3 x:0 0 0 2024-04-25T17:19:20.343 INFO:tasks.workunit.client.1.smithi069.stdout:9/608: unlink d2/cb8 0 2024-04-25T17:19:20.344 INFO:tasks.workunit.client.0.smithi037.stdout:9/879: mknod d1/d5/d19/d6e/d117/c122 0 2024-04-25T17:19:20.345 INFO:tasks.workunit.client.0.smithi037.stdout:9/880: chown d1/l5b 60128830 1 2024-04-25T17:19:20.346 INFO:tasks.workunit.client.0.smithi037.stdout:9/881: read d1/d5/d2e/d34/d76/ffb [452242,1622] 0 2024-04-25T17:19:20.346 INFO:tasks.workunit.client.0.smithi037.stdout:8/647: unlink f4 0 2024-04-25T17:19:20.348 INFO:tasks.workunit.client.1.smithi069.stdout:9/609: dwrite d2/da4/fbd [0,4194304] 0 2024-04-25T17:19:20.348 INFO:tasks.workunit.client.1.smithi069.stdout:5/663: symlink d13/d17/d19/d20/d2d/d93/le4 0 2024-04-25T17:19:20.351 INFO:tasks.workunit.client.1.smithi069.stdout:5/664: read - d13/d17/d19/d1c/da4/da9/fca zero size 2024-04-25T17:19:20.351 INFO:tasks.workunit.client.1.smithi069.stdout:4/628: creat db/d15/d82/fd4 x:0 0 0 2024-04-25T17:19:20.353 INFO:tasks.workunit.client.0.smithi037.stdout:8/648: rmdir d5/db/d23/d78/d93 39 2024-04-25T17:19:20.356 INFO:tasks.workunit.client.0.smithi037.stdout:7/614: rename d5/d15/d17/d1b/da2/daf/d80 to d5/d15/dd8 0 2024-04-25T17:19:20.360 INFO:tasks.workunit.client.0.smithi037.stdout:6/658: mknod db/d26/d2e/d7d/dde/cea 0 2024-04-25T17:19:20.363 INFO:tasks.workunit.client.1.smithi069.stdout:5/665: mknod d13/d17/d19/d1c/da4/da9/ce5 0 2024-04-25T17:19:20.364 INFO:tasks.workunit.client.0.smithi037.stdout:9/882: creat d1/d48/d68/d26/d81/d9c/da4/d104/f123 x:0 0 0 2024-04-25T17:19:20.365 INFO:tasks.workunit.client.1.smithi069.stdout:9/610: mkdir d2/da/dd/d1e/d2e/d68/dba/dd1 0 2024-04-25T17:19:20.365 INFO:tasks.workunit.client.0.smithi037.stdout:9/883: dread - d1/d5/d2e/d34/daf/dcb/f110 zero size 2024-04-25T17:19:20.366 INFO:tasks.workunit.client.1.smithi069.stdout:3/676: dwrite d8/d2a/fad [0,4194304] 0 2024-04-25T17:19:20.367 INFO:tasks.workunit.client.0.smithi037.stdout:2/732: rename d0/d23/f43 to d0/d16/d3b/dc4/fe9 0 2024-04-25T17:19:20.368 INFO:tasks.workunit.client.1.smithi069.stdout:4/629: mknod db/d15/d82/da7/cd5 0 2024-04-25T17:19:20.373 INFO:tasks.workunit.client.0.smithi037.stdout:1/816: mkdir dc/d52/d6b/dd9/d22/d11b 0 2024-04-25T17:19:20.373 INFO:tasks.workunit.client.1.smithi069.stdout:3/677: dwrite d8/d16/f28 [0,4194304] 0 2024-04-25T17:19:20.374 INFO:tasks.workunit.client.1.smithi069.stdout:7/630: write d4/d3e/d94/da1/dc7/d14/d15/f90 [368189,15995] 0 2024-04-25T17:19:20.378 INFO:tasks.workunit.client.1.smithi069.stdout:7/631: fdatasync d4/f58 0 2024-04-25T17:19:20.380 INFO:tasks.workunit.client.0.smithi037.stdout:1/817: dwrite f8 [0,4194304] 0 2024-04-25T17:19:20.382 INFO:tasks.workunit.client.1.smithi069.stdout:4/630: rename db/d15/f37 to db/d15/d20/d35/d63/d43/d48/d49/d4e/fd6 0 2024-04-25T17:19:20.383 INFO:tasks.workunit.client.1.smithi069.stdout:5/666: dwrite d13/d17/d19/d96/d9d/fa7 [0,4194304] 0 2024-04-25T17:19:20.384 INFO:tasks.workunit.client.1.smithi069.stdout:8/638: write f10 [6412043,24490] 0 2024-04-25T17:19:20.385 INFO:tasks.workunit.client.0.smithi037.stdout:0/720: write d9/df/f10 [1473750,108095] 0 2024-04-25T17:19:20.385 INFO:tasks.workunit.client.1.smithi069.stdout:6/607: dwrite d2/d1e/d43/f53 [0,4194304] 0 2024-04-25T17:19:20.386 INFO:tasks.workunit.client.0.smithi037.stdout:3/545: getdents d8/d31/d8d 0 2024-04-25T17:19:20.388 INFO:tasks.workunit.client.0.smithi037.stdout:5/716: dwrite d7/d12/f23 [0,4194304] 0 2024-04-25T17:19:20.388 INFO:tasks.workunit.client.0.smithi037.stdout:3/546: readlink d8/d23/d3a/l4d 0 2024-04-25T17:19:20.388 INFO:tasks.workunit.client.1.smithi069.stdout:8/639: read d37/d47/d48/f83 [836366,122948] 0 2024-04-25T17:19:20.405 INFO:tasks.workunit.client.1.smithi069.stdout:7/632: creat d4/d3e/d94/da1/fd1 x:0 0 0 2024-04-25T17:19:20.407 INFO:tasks.workunit.client.1.smithi069.stdout:4/631: symlink db/d15/d26/ld7 0 2024-04-25T17:19:20.410 INFO:tasks.workunit.client.0.smithi037.stdout:5/717: mknod d7/d12/d6f/dbf/cd7 0 2024-04-25T17:19:20.413 INFO:tasks.workunit.client.1.smithi069.stdout:2/606: dwrite d0/f53 [0,4194304] 0 2024-04-25T17:19:20.414 INFO:tasks.workunit.client.1.smithi069.stdout:2/607: dread - d0/d56/d94/fc0 zero size 2024-04-25T17:19:20.414 INFO:tasks.workunit.client.0.smithi037.stdout:1/818: symlink dc/d52/d6b/dd9/l11c 0 2024-04-25T17:19:20.414 INFO:tasks.workunit.client.1.smithi069.stdout:6/608: creat d2/d51/d85/fd8 x:0 0 0 2024-04-25T17:19:20.416 INFO:tasks.workunit.client.0.smithi037.stdout:2/733: creat d0/d15/fea x:0 0 0 2024-04-25T17:19:20.421 INFO:tasks.workunit.client.0.smithi037.stdout:4/902: dwrite d7/d7e/d4e/da5/d112/f12a [0,4194304] 0 2024-04-25T17:19:20.424 INFO:tasks.workunit.client.1.smithi069.stdout:5/667: creat d13/d17/d19/d1c/d79/fe6 x:0 0 0 2024-04-25T17:19:20.432 INFO:tasks.workunit.client.0.smithi037.stdout:1/819: creat dc/d52/d6b/dd9/d22/d36/d74/da6/f11d x:0 0 0 2024-04-25T17:19:20.432 INFO:tasks.workunit.client.1.smithi069.stdout:2/608: dread d0/d26/d10/d43/f80 [0,4194304] 0 2024-04-25T17:19:20.434 INFO:tasks.workunit.client.1.smithi069.stdout:1/632: write d1/d4/d6/d9e/da6/f55 [1517628,79470] 0 2024-04-25T17:19:20.434 INFO:tasks.workunit.client.1.smithi069.stdout:1/633: chown d1/d43 217607923 1 2024-04-25T17:19:20.434 INFO:tasks.workunit.client.1.smithi069.stdout:7/633: truncate d4/d3e/d94/da1/dc7/f59 3193868 0 2024-04-25T17:19:20.436 INFO:tasks.workunit.client.1.smithi069.stdout:1/634: write d1/d4/d6/d9e/da6/d7c/d4d/fb1 [454796,79882] 0 2024-04-25T17:19:20.436 INFO:tasks.workunit.client.0.smithi037.stdout:2/734: truncate d0/d16/d3c/fbc 112475 0 2024-04-25T17:19:20.438 INFO:tasks.workunit.client.1.smithi069.stdout:1/635: write d1/d4/d6/d9e/da6/d7c/d4d/d8f/fab [770042,50622] 0 2024-04-25T17:19:20.442 INFO:tasks.workunit.client.1.smithi069.stdout:2/609: creat d0/d56/d5f/d62/fc1 x:0 0 0 2024-04-25T17:19:20.443 INFO:tasks.workunit.client.0.smithi037.stdout:4/903: mknod d7/d7e/d5b/dfe/d39/d7a/de8/c12e 0 2024-04-25T17:19:20.445 INFO:tasks.workunit.client.1.smithi069.stdout:0/544: truncate d0/d36/f2b 3945249 0 2024-04-25T17:19:20.448 INFO:tasks.workunit.client.1.smithi069.stdout:4/632: creat db/d15/d20/d35/d63/fd8 x:0 0 0 2024-04-25T17:19:20.451 INFO:tasks.workunit.client.1.smithi069.stdout:7/634: unlink d4/d3e/d94/da1/dc7/d14/d15/c29 0 2024-04-25T17:19:20.453 INFO:tasks.workunit.client.0.smithi037.stdout:5/718: getdents d7/d25/d4f 0 2024-04-25T17:19:20.454 INFO:tasks.workunit.client.0.smithi037.stdout:8/649: dwrite d5/d6a/f66 [0,4194304] 0 2024-04-25T17:19:20.456 INFO:tasks.workunit.client.0.smithi037.stdout:8/650: write d5/db/d18/d3b/f48 [406269,102726] 0 2024-04-25T17:19:20.456 INFO:tasks.workunit.client.1.smithi069.stdout:7/635: dwrite d4/fb1 [0,4194304] 0 2024-04-25T17:19:20.460 INFO:tasks.workunit.client.0.smithi037.stdout:4/904: dread d7/d7e/d1e/d2b/f5f [0,4194304] 0 2024-04-25T17:19:20.461 INFO:tasks.workunit.client.0.smithi037.stdout:4/905: dread - d7/d7e/d4e/f11f zero size 2024-04-25T17:19:20.463 INFO:tasks.workunit.client.0.smithi037.stdout:7/615: write d5/d15/d17/d1b/da2/daf/f8d [774699,24378] 0 2024-04-25T17:19:20.470 INFO:tasks.workunit.client.1.smithi069.stdout:5/668: creat d13/d17/d19/d1c/fe7 x:0 0 0 2024-04-25T17:19:20.470 INFO:tasks.workunit.client.1.smithi069.stdout:5/669: chown d13/d17/d62/fd2 115 1 2024-04-25T17:19:20.471 INFO:tasks.workunit.client.0.smithi037.stdout:9/884: dwrite d1/d5/fdb [0,4194304] 0 2024-04-25T17:19:20.472 INFO:tasks.workunit.client.1.smithi069.stdout:9/611: truncate d2/d51/fb3 737327 0 2024-04-25T17:19:20.474 INFO:tasks.workunit.client.0.smithi037.stdout:6/659: truncate db/d1d/f5c 424263 0 2024-04-25T17:19:20.475 INFO:tasks.workunit.client.1.smithi069.stdout:7/636: fsync d4/d3e/f41 0 2024-04-25T17:19:20.477 INFO:tasks.workunit.client.0.smithi037.stdout:8/651: creat d5/d26/d33/fd4 x:0 0 0 2024-04-25T17:19:20.479 INFO:tasks.workunit.client.1.smithi069.stdout:6/609: getdents d2/d9c 0 2024-04-25T17:19:20.480 INFO:tasks.workunit.client.1.smithi069.stdout:3/678: dwrite d8/d16/d1a/d99/fa7 [4194304,4194304] 0 2024-04-25T17:19:20.481 INFO:tasks.workunit.client.0.smithi037.stdout:7/616: truncate d5/d15/d17/d1b/da2/d76/fb0 866375 0 2024-04-25T17:19:20.481 INFO:tasks.workunit.client.1.smithi069.stdout:6/610: write d2/d1e/d3f/d56/d7e/fcf [444860,16623] 0 2024-04-25T17:19:20.483 INFO:tasks.workunit.client.1.smithi069.stdout:3/679: chown d8/d16/d1a/d2c/d49/d87/d8a/d8e/d95 10 1 2024-04-25T17:19:20.484 INFO:tasks.workunit.client.0.smithi037.stdout:1/820: creat dc/d18/d64/f11e x:0 0 0 2024-04-25T17:19:20.486 INFO:tasks.workunit.client.1.smithi069.stdout:3/680: dread d8/d2a/fad [0,4194304] 0 2024-04-25T17:19:20.487 INFO:tasks.workunit.client.0.smithi037.stdout:0/721: dwrite d9/df/d32/d39/d68/f93 [0,4194304] 0 2024-04-25T17:19:20.493 INFO:tasks.workunit.client.0.smithi037.stdout:3/547: truncate d8/d31/d32/d3e/f9b 138231 0 2024-04-25T17:19:20.494 INFO:tasks.workunit.client.1.smithi069.stdout:9/612: dread - d2/da/d5f/d76/f8e zero size 2024-04-25T17:19:20.496 INFO:tasks.workunit.client.1.smithi069.stdout:8/640: sync 2024-04-25T17:19:20.499 INFO:tasks.workunit.client.1.smithi069.stdout:1/636: rename d1/d43/d1b/d32/d4a/f58 to d1/fbf 0 2024-04-25T17:19:20.505 INFO:tasks.workunit.client.1.smithi069.stdout:7/637: mknod d4/d3e/d94/da1/cd2 0 2024-04-25T17:19:20.506 INFO:tasks.workunit.client.0.smithi037.stdout:6/660: dread db/d1d/d20/d2f/f6e [0,4194304] 0 2024-04-25T17:19:20.512 INFO:tasks.workunit.client.1.smithi069.stdout:4/633: rmdir db/d22/d8d 0 2024-04-25T17:19:20.513 INFO:tasks.workunit.client.0.smithi037.stdout:2/735: write d0/d15/fb3 [29665,124131] 0 2024-04-25T17:19:20.514 INFO:tasks.workunit.client.0.smithi037.stdout:7/617: fsync d5/d15/dd8/db5/fb6 0 2024-04-25T17:19:20.516 INFO:tasks.workunit.client.1.smithi069.stdout:3/681: creat d8/d16/d1a/d38/fee x:0 0 0 2024-04-25T17:19:20.517 INFO:tasks.workunit.client.0.smithi037.stdout:1/821: dread dc/d52/d6b/dd9/d22/d36/f54 [0,4194304] 0 2024-04-25T17:19:20.519 INFO:tasks.workunit.client.0.smithi037.stdout:1/822: fsync dc/d52/d6b/dd9/d22/d36/f4c 0 2024-04-25T17:19:20.520 INFO:tasks.workunit.client.1.smithi069.stdout:5/670: creat d13/d17/d29/dde/fe8 x:0 0 0 2024-04-25T17:19:20.523 INFO:tasks.workunit.client.0.smithi037.stdout:0/722: read d9/d14/d28/d48/d58/f5d [2095426,24403] 0 2024-04-25T17:19:20.524 INFO:tasks.workunit.client.1.smithi069.stdout:9/613: read d2/da/dd/d1e/d2e/d35/fc3 [2548292,105182] 0 2024-04-25T17:19:20.527 INFO:tasks.workunit.client.1.smithi069.stdout:0/545: dwrite d0/d17/f4a [0,4194304] 0 2024-04-25T17:19:20.527 INFO:tasks.workunit.client.0.smithi037.stdout:5/719: rename d7/d12/d6f/dbc to d7/d18/d62/dd8 0 2024-04-25T17:19:20.534 INFO:tasks.workunit.client.0.smithi037.stdout:4/906: write d7/d7e/d5b/dfe/f36 [6196293,13822] 0 2024-04-25T17:19:20.534 INFO:tasks.workunit.client.1.smithi069.stdout:8/641: creat d37/d47/d78/d93/fd9 x:0 0 0 2024-04-25T17:19:20.534 INFO:tasks.workunit.client.0.smithi037.stdout:5/720: dwrite d7/d12/d5d/f80 [0,4194304] 0 2024-04-25T17:19:20.536 INFO:tasks.workunit.client.1.smithi069.stdout:2/610: rename d0/d56/d5f/d62/d7d/d31/d61 to d0/d56/d5f/d62/d7d/d72/daf/dc2 0 2024-04-25T17:19:20.537 INFO:tasks.workunit.client.1.smithi069.stdout:2/611: chown d0/d26/d36/db9 207610 1 2024-04-25T17:19:20.538 INFO:tasks.workunit.client.0.smithi037.stdout:6/661: fsync db/d26/d2e/d3e/d25/db0/fbe 0 2024-04-25T17:19:20.541 INFO:tasks.workunit.client.1.smithi069.stdout:1/637: creat d1/d4/d6/d9e/da6/fc0 x:0 0 0 2024-04-25T17:19:20.545 INFO:tasks.workunit.client.0.smithi037.stdout:9/885: write d1/d5/dc/d38/d8b/fd3 [1266448,50891] 0 2024-04-25T17:19:20.548 INFO:tasks.workunit.client.0.smithi037.stdout:2/736: fdatasync d0/d23/dac/d4b/f91 0 2024-04-25T17:19:20.551 INFO:tasks.workunit.client.1.smithi069.stdout:3/682: mkdir d8/d16/d4b/def 0 2024-04-25T17:19:20.551 INFO:tasks.workunit.client.0.smithi037.stdout:1/823: fsync dc/d52/d6b/dd9/d22/d36/f5d 0 2024-04-25T17:19:20.553 INFO:tasks.workunit.client.0.smithi037.stdout:1/824: write dc/d18/d64/f11e [598706,76303] 0 2024-04-25T17:19:20.556 INFO:tasks.workunit.client.0.smithi037.stdout:0/723: fsync d9/df/d32/dd1/d7a/f9b 0 2024-04-25T17:19:20.562 INFO:tasks.workunit.client.0.smithi037.stdout:1/825: dwrite dc/d52/d6b/dd9/d22/d36/f4c [8388608,4194304] 0 2024-04-25T17:19:20.562 INFO:tasks.workunit.client.0.smithi037.stdout:4/907: rmdir d7/d7e/d4e 39 2024-04-25T17:19:20.563 INFO:tasks.workunit.client.1.smithi069.stdout:9/614: mkdir d2/da/dd/de/d64/dd2 0 2024-04-25T17:19:20.565 INFO:tasks.workunit.client.0.smithi037.stdout:0/724: dwrite d9/d14/fbe [0,4194304] 0 2024-04-25T17:19:20.568 INFO:tasks.workunit.client.0.smithi037.stdout:7/618: dread d5/f7c [0,4194304] 0 2024-04-25T17:19:20.570 INFO:tasks.workunit.client.1.smithi069.stdout:8/642: mknod d37/d66/d6b/cda 0 2024-04-25T17:19:20.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:20 smithi037 ceph-mon[26472]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:19:20.573 INFO:tasks.workunit.client.1.smithi069.stdout:6/611: rename d2/d1e/d43/f70 to d2/d1e/d43/dca/dce/fd9 0 2024-04-25T17:19:20.574 INFO:tasks.workunit.client.1.smithi069.stdout:8/643: read d37/d47/d54/f5e [2281525,61643] 0 2024-04-25T17:19:20.575 INFO:tasks.workunit.client.1.smithi069.stdout:8/644: chown d37/d47/c6a 2119943235 1 2024-04-25T17:19:20.575 INFO:tasks.workunit.client.0.smithi037.stdout:8/652: creat d5/db/d18/d3b/d50/fd5 x:0 0 0 2024-04-25T17:19:20.576 INFO:tasks.workunit.client.1.smithi069.stdout:8/645: write d37/d66/f97 [498378,131069] 0 2024-04-25T17:19:20.577 INFO:tasks.workunit.client.1.smithi069.stdout:8/646: write d37/d66/f97 [984055,39275] 0 2024-04-25T17:19:20.580 INFO:tasks.workunit.client.1.smithi069.stdout:7/638: getdents d4/d3e/dc8 0 2024-04-25T17:19:20.581 INFO:tasks.workunit.client.1.smithi069.stdout:7/639: chown d4/d3e/d94/fd0 480584989 1 2024-04-25T17:19:20.585 INFO:tasks.workunit.client.1.smithi069.stdout:3/683: fdatasync d8/d16/d1a/d2c/d6c/d9c/fc7 0 2024-04-25T17:19:20.592 INFO:tasks.workunit.client.0.smithi037.stdout:2/737: dread d0/d16/d26/f4a [0,4194304] 0 2024-04-25T17:19:20.593 INFO:tasks.workunit.client.1.smithi069.stdout:9/615: unlink d2/da/dd/d1e/d2e/d35/cc1 0 2024-04-25T17:19:20.594 INFO:tasks.workunit.client.0.smithi037.stdout:4/908: chown d7/d7e/d5b/f85 125799 1 2024-04-25T17:19:20.595 INFO:tasks.workunit.client.1.smithi069.stdout:0/546: symlink d0/da/lc4 0 2024-04-25T17:19:20.595 INFO:tasks.workunit.client.0.smithi037.stdout:5/721: mknod d7/d18/cd9 0 2024-04-25T17:19:20.598 INFO:tasks.workunit.client.1.smithi069.stdout:9/616: dwrite d2/da/d5f/d76/f85 [0,4194304] 0 2024-04-25T17:19:20.599 INFO:tasks.workunit.client.1.smithi069.stdout:9/617: write d2/da/dd/f5d [3374157,85682] 0 2024-04-25T17:19:20.604 INFO:tasks.workunit.client.1.smithi069.stdout:4/634: truncate db/d4b/d78/dc4/f31 1911906 0 2024-04-25T17:19:20.605 INFO:tasks.workunit.client.1.smithi069.stdout:4/635: write db/d15/d42/d64/f83 [4262922,59536] 0 2024-04-25T17:19:20.606 INFO:tasks.workunit.client.0.smithi037.stdout:1/826: dread dc/d24/f8a [0,4194304] 0 2024-04-25T17:19:20.606 INFO:tasks.workunit.client.0.smithi037.stdout:9/886: dwrite d1/ff [0,4194304] 0 2024-04-25T17:19:20.609 INFO:tasks.workunit.client.1.smithi069.stdout:5/671: truncate d13/d17/d19/d1c/da4/da9/daa/fba 2388771 0 2024-04-25T17:19:20.610 INFO:tasks.workunit.client.1.smithi069.stdout:2/612: mknod d0/d1/d5b/cc3 0 2024-04-25T17:19:20.614 INFO:tasks.workunit.client.1.smithi069.stdout:8/647: fsync d37/d47/d54/d6e/f7d 0 2024-04-25T17:19:20.615 INFO:tasks.workunit.client.1.smithi069.stdout:8/648: write d37/d66/d6b/f96 [316574,57787] 0 2024-04-25T17:19:20.616 INFO:tasks.workunit.client.0.smithi037.stdout:5/722: mkdir d7/da1/dda 0 2024-04-25T17:19:20.616 INFO:tasks.workunit.client.0.smithi037.stdout:7/619: write d5/fc9 [660690,21614] 0 2024-04-25T17:19:20.618 INFO:tasks.workunit.client.0.smithi037.stdout:0/725: mkdir d9/df/dbd/de9 0 2024-04-25T17:19:20.620 INFO:tasks.workunit.client.1.smithi069.stdout:5/672: dread d13/d17/d29/d2e/fc4 [0,4194304] 0 2024-04-25T17:19:20.621 INFO:tasks.workunit.client.0.smithi037.stdout:6/662: link db/f13 db/d1d/d20/d85/feb 0 2024-04-25T17:19:20.623 INFO:tasks.workunit.client.0.smithi037.stdout:8/653: write d5/db/d23/f1e [6266287,20270] 0 2024-04-25T17:19:20.627 INFO:tasks.workunit.client.0.smithi037.stdout:9/887: mknod d1/d48/d68/d26/da1/c124 0 2024-04-25T17:19:20.628 INFO:tasks.workunit.client.1.smithi069.stdout:9/618: mkdir d2/da/d5f/dd3 0 2024-04-25T17:19:20.629 INFO:tasks.workunit.client.0.smithi037.stdout:2/738: write d0/d15/d2a/f72 [466835,112546] 0 2024-04-25T17:19:20.630 INFO:tasks.workunit.client.0.smithi037.stdout:8/654: dwrite d5/db/d18/d3b/d50/fa4 [4194304,4194304] 0 2024-04-25T17:19:20.631 INFO:tasks.workunit.client.1.smithi069.stdout:4/636: mknod db/d15/d20/d38/cd9 0 2024-04-25T17:19:20.631 INFO:tasks.workunit.client.1.smithi069.stdout:4/637: stat f8 0 2024-04-25T17:19:20.632 INFO:tasks.workunit.client.0.smithi037.stdout:4/909: mkdir d7/d7e/d1e/d70/d12f 0 2024-04-25T17:19:20.638 INFO:tasks.workunit.client.0.smithi037.stdout:5/723: creat d7/d18/d62/dd8/fdb x:0 0 0 2024-04-25T17:19:20.639 INFO:tasks.workunit.client.1.smithi069.stdout:3/684: dwrite f5 [0,4194304] 0 2024-04-25T17:19:20.640 INFO:tasks.workunit.client.0.smithi037.stdout:0/726: truncate d9/df/f98 1894465 0 2024-04-25T17:19:20.640 INFO:tasks.workunit.client.1.smithi069.stdout:3/685: dread - d8/d71/f86 zero size 2024-04-25T17:19:20.641 INFO:tasks.workunit.client.1.smithi069.stdout:2/613: stat d0/d1/d5b/c7f 0 2024-04-25T17:19:20.641 INFO:tasks.workunit.client.1.smithi069.stdout:3/686: chown d8/d71/d8d/d92/db6/dc1/c4a 63874 1 2024-04-25T17:19:20.642 INFO:tasks.workunit.client.0.smithi037.stdout:6/663: creat db/d26/d2e/d3e/d25/db0/fec x:0 0 0 2024-04-25T17:19:20.642 INFO:tasks.workunit.client.1.smithi069.stdout:3/687: chown d8/d16/d1a/d99/fa7 7128156 1 2024-04-25T17:19:20.647 INFO:tasks.workunit.client.1.smithi069.stdout:7/640: mkdir d4/d83/da2/dd3 0 2024-04-25T17:19:20.649 INFO:tasks.workunit.client.0.smithi037.stdout:9/888: creat d1/d5/d2e/d34/d76/f125 x:0 0 0 2024-04-25T17:19:20.654 INFO:tasks.workunit.client.1.smithi069.stdout:5/673: creat d13/d17/d29/d30/d9c/fe9 x:0 0 0 2024-04-25T17:19:20.656 INFO:tasks.workunit.client.0.smithi037.stdout:4/910: unlink d7/fe 0 2024-04-25T17:19:20.658 INFO:tasks.workunit.client.0.smithi037.stdout:0/727: dread d9/df/d32/f55 [0,4194304] 0 2024-04-25T17:19:20.660 INFO:tasks.workunit.client.1.smithi069.stdout:5/674: dwrite d13/d17/d19/d1c/da4/fd5 [0,4194304] 0 2024-04-25T17:19:20.662 INFO:tasks.workunit.client.0.smithi037.stdout:1/827: dwrite dc/d24/f4b [0,4194304] 0 2024-04-25T17:19:20.662 INFO:tasks.workunit.client.1.smithi069.stdout:1/638: rename d1/d4/d6/d9e/da6/d7c/d4d/cae to d1/df/cc1 0 2024-04-25T17:19:20.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:20 smithi069 ceph-mon[34527]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:19:20.668 INFO:tasks.workunit.client.0.smithi037.stdout:2/739: creat d0/d16/d20/d55/dc8/feb x:0 0 0 2024-04-25T17:19:20.671 INFO:tasks.workunit.client.0.smithi037.stdout:8/655: rename d5/db/d23/l46 to d5/db/d23/daa/ld6 0 2024-04-25T17:19:20.675 INFO:tasks.workunit.client.0.smithi037.stdout:8/656: dread d5/d6a/f66 [0,4194304] 0 2024-04-25T17:19:20.676 INFO:tasks.workunit.client.1.smithi069.stdout:2/614: mknod d0/d56/d5f/d62/cc4 0 2024-04-25T17:19:20.680 INFO:tasks.workunit.client.0.smithi037.stdout:6/664: dread db/f46 [0,4194304] 0 2024-04-25T17:19:20.680 INFO:tasks.workunit.client.0.smithi037.stdout:4/911: mknod d7/d7e/d5b/dfe/d39/d9c/c130 0 2024-04-25T17:19:20.681 INFO:tasks.workunit.client.1.smithi069.stdout:0/547: sync 2024-04-25T17:19:20.682 INFO:tasks.workunit.client.0.smithi037.stdout:0/728: symlink d9/d71/lea 0 2024-04-25T17:19:20.682 INFO:tasks.workunit.client.0.smithi037.stdout:4/912: truncate d7/d7e/d1e/d70/d84/f115 447884 0 2024-04-25T17:19:20.683 INFO:tasks.workunit.client.0.smithi037.stdout:4/913: write d7/d7e/d5b/f8c [35682,7938] 0 2024-04-25T17:19:20.684 INFO:tasks.workunit.client.0.smithi037.stdout:4/914: chown d7/f12 94 1 2024-04-25T17:19:20.685 INFO:tasks.workunit.client.0.smithi037.stdout:5/724: truncate d7/f40 798818 0 2024-04-25T17:19:20.685 INFO:tasks.workunit.client.1.smithi069.stdout:2/615: dread d0/d56/d5f/fb0 [0,4194304] 0 2024-04-25T17:19:20.686 INFO:tasks.workunit.client.0.smithi037.stdout:9/889: symlink d1/d5/dc/d3c/d3e/d103/l126 0 2024-04-25T17:19:20.688 INFO:tasks.workunit.client.1.smithi069.stdout:4/638: unlink c3 0 2024-04-25T17:19:20.690 INFO:tasks.workunit.client.1.smithi069.stdout:5/675: creat d13/d17/d19/d1c/d6c/fea x:0 0 0 2024-04-25T17:19:20.691 INFO:tasks.workunit.client.1.smithi069.stdout:1/639: fsync d1/d4/f4c 0 2024-04-25T17:19:20.693 INFO:tasks.workunit.client.1.smithi069.stdout:6/612: getdents d2/d1e/d3f/d56/d7e 0 2024-04-25T17:19:20.695 INFO:tasks.workunit.client.0.smithi037.stdout:8/657: symlink d5/dbc/ld7 0 2024-04-25T17:19:20.696 INFO:tasks.workunit.client.1.smithi069.stdout:3/688: dread d8/d16/d1a/d38/f88 [0,4194304] 0 2024-04-25T17:19:20.696 INFO:tasks.workunit.client.0.smithi037.stdout:8/658: chown d5/db/d18/l87 2726 1 2024-04-25T17:19:20.697 INFO:tasks.workunit.client.1.smithi069.stdout:3/689: dread - d8/d16/d1a/d99/fd6 zero size 2024-04-25T17:19:20.698 INFO:tasks.workunit.client.1.smithi069.stdout:9/619: write d2/da/dd/de/f48 [1887357,68130] 0 2024-04-25T17:19:20.699 INFO:tasks.workunit.client.1.smithi069.stdout:8/649: creat d37/d47/d78/fdb x:0 0 0 2024-04-25T17:19:20.701 INFO:tasks.workunit.client.0.smithi037.stdout:7/620: getdents d5/d15 0 2024-04-25T17:19:20.702 INFO:tasks.workunit.client.0.smithi037.stdout:7/621: stat d5/d15/d17/d1b/da2/d76/l87 0 2024-04-25T17:19:20.710 INFO:tasks.workunit.client.1.smithi069.stdout:2/616: dread d0/d26/f23 [0,4194304] 0 2024-04-25T17:19:20.711 INFO:tasks.workunit.client.1.smithi069.stdout:2/617: fdatasync d0/d56/d94/fb8 0 2024-04-25T17:19:20.711 INFO:tasks.workunit.client.0.smithi037.stdout:9/890: creat d1/d5/d2e/d34/d76/f127 x:0 0 0 2024-04-25T17:19:20.712 INFO:tasks.workunit.client.0.smithi037.stdout:9/891: dread - d1/d48/d68/d26/f57 zero size 2024-04-25T17:19:20.713 INFO:tasks.workunit.client.1.smithi069.stdout:1/640: creat d1/d4/de/d44/d68/fc2 x:0 0 0 2024-04-25T17:19:20.713 INFO:tasks.workunit.client.0.smithi037.stdout:8/659: dread d5/db/d59/f88 [0,4194304] 0 2024-04-25T17:19:20.714 INFO:tasks.workunit.client.1.smithi069.stdout:0/548: dwrite d0/da/db/d2a/faf [0,4194304] 0 2024-04-25T17:19:20.714 INFO:tasks.workunit.client.1.smithi069.stdout:6/613: mknod d2/d1e/d3e/d67/cda 0 2024-04-25T17:19:20.715 INFO:tasks.workunit.client.1.smithi069.stdout:1/641: write d1/d4/d6/d9e/da6/d38/f90 [327795,91360] 0 2024-04-25T17:19:20.716 INFO:tasks.workunit.client.1.smithi069.stdout:7/641: fdatasync d4/d1a/d34/f68 0 2024-04-25T17:19:20.717 INFO:tasks.workunit.client.1.smithi069.stdout:1/642: readlink d1/d4/d6/l56 0 2024-04-25T17:19:20.718 INFO:tasks.workunit.client.0.smithi037.stdout:7/622: symlink d5/d15/d17/d1b/da2/d76/ld9 0 2024-04-25T17:19:20.721 INFO:tasks.workunit.client.0.smithi037.stdout:0/729: creat d9/df/d32/dd1/d7a/da4/ddb/feb x:0 0 0 2024-04-25T17:19:20.723 INFO:tasks.workunit.client.0.smithi037.stdout:4/915: unlink d7/l16 0 2024-04-25T17:19:20.723 INFO:tasks.workunit.client.1.smithi069.stdout:1/643: dwrite d1/d43/d1b/d32/d4a/db4/fb8 [0,4194304] 0 2024-04-25T17:19:20.724 INFO:tasks.workunit.client.0.smithi037.stdout:4/916: readlink d7/d7e/d1e/d70/lb5 0 2024-04-25T17:19:20.724 INFO:tasks.workunit.client.0.smithi037.stdout:5/725: mkdir d7/da1/dda/ddc 0 2024-04-25T17:19:20.725 INFO:tasks.workunit.client.0.smithi037.stdout:1/828: creat dc/d52/d6b/dd9/d22/d36/d92/db8/f11f x:0 0 0 2024-04-25T17:19:20.726 INFO:tasks.workunit.client.0.smithi037.stdout:9/892: rmdir d1/d5/dc/d38/d8b 39 2024-04-25T17:19:20.727 INFO:tasks.workunit.client.0.smithi037.stdout:1/829: read - dc/d52/d6b/dd9/d22/d36/d8c/f11a zero size 2024-04-25T17:19:20.729 INFO:tasks.workunit.client.1.smithi069.stdout:2/618: mkdir d0/d26/d36/dc5 0 2024-04-25T17:19:20.730 INFO:tasks.workunit.client.1.smithi069.stdout:0/549: symlink d0/da/db/d56/lc5 0 2024-04-25T17:19:20.731 INFO:tasks.workunit.client.1.smithi069.stdout:0/550: write d0/da/db/d2c/f4d [2215518,48499] 0 2024-04-25T17:19:20.732 INFO:tasks.workunit.client.1.smithi069.stdout:3/690: mkdir d8/d16/d4b/def/df0 0 2024-04-25T17:19:20.733 INFO:tasks.workunit.client.1.smithi069.stdout:0/551: read - d0/d17/fb9 zero size 2024-04-25T17:19:20.733 INFO:tasks.workunit.client.0.smithi037.stdout:2/740: truncate d0/d16/d20/d55/f80 3854320 0 2024-04-25T17:19:20.734 INFO:tasks.workunit.client.0.smithi037.stdout:2/741: chown d0/d23/dac/d4b 53 1 2024-04-25T17:19:20.735 INFO:tasks.workunit.client.0.smithi037.stdout:0/730: mkdir d9/d71/dec 0 2024-04-25T17:19:20.737 INFO:tasks.workunit.client.1.smithi069.stdout:6/614: dwrite d2/d1e/d3e/d67/f69 [0,4194304] 0 2024-04-25T17:19:20.737 INFO:tasks.workunit.client.1.smithi069.stdout:7/642: mknod d4/d3e/d94/da1/cd4 0 2024-04-25T17:19:20.738 INFO:tasks.workunit.client.0.smithi037.stdout:0/731: dread d9/d14/d28/d48/f4e [0,4194304] 0 2024-04-25T17:19:20.741 INFO:tasks.workunit.client.1.smithi069.stdout:4/639: creat db/d15/d42/d64/fda x:0 0 0 2024-04-25T17:19:20.742 INFO:tasks.workunit.client.1.smithi069.stdout:5/676: truncate d13/d17/f86 2716450 0 2024-04-25T17:19:20.745 INFO:tasks.workunit.client.0.smithi037.stdout:5/726: read d7/d12/d5d/d90/db1/fce [4597095,4460] 0 2024-04-25T17:19:20.747 INFO:tasks.workunit.client.0.smithi037.stdout:0/732: dwrite d9/df/dbd/fe1 [0,4194304] 0 2024-04-25T17:19:20.750 INFO:tasks.workunit.client.0.smithi037.stdout:9/893: dread d1/d5/dc/d38/f3a [0,4194304] 0 2024-04-25T17:19:20.751 INFO:tasks.workunit.client.0.smithi037.stdout:9/894: chown d1/d5/c93 839 1 2024-04-25T17:19:20.756 INFO:tasks.workunit.client.1.smithi069.stdout:3/691: unlink d8/d39/f3c 0 2024-04-25T17:19:20.757 INFO:tasks.workunit.client.0.smithi037.stdout:9/895: dread d1/d5/d2e/d34/d76/f8c [0,4194304] 0 2024-04-25T17:19:20.758 INFO:tasks.workunit.client.0.smithi037.stdout:6/665: truncate db/f3d 312092 0 2024-04-25T17:19:20.760 INFO:tasks.workunit.client.1.smithi069.stdout:0/552: mknod d0/da/db/d1d/d5f/cc6 0 2024-04-25T17:19:20.761 INFO:tasks.workunit.client.1.smithi069.stdout:0/553: truncate d0/da/db/d3a/f6c 636617 0 2024-04-25T17:19:20.761 INFO:tasks.workunit.client.0.smithi037.stdout:4/917: symlink d7/d7e/d1e/l131 0 2024-04-25T17:19:20.763 INFO:tasks.workunit.client.1.smithi069.stdout:8/650: truncate d37/d47/d78/db3/fc9 507331 0 2024-04-25T17:19:20.765 INFO:tasks.workunit.client.1.smithi069.stdout:8/651: write d37/f59 [513457,89819] 0 2024-04-25T17:19:20.766 INFO:tasks.workunit.client.1.smithi069.stdout:8/652: chown d37/d47/d54/l9a 0 1 2024-04-25T17:19:20.772 INFO:tasks.workunit.client.1.smithi069.stdout:5/677: mknod d13/d17/d29/dde/ceb 0 2024-04-25T17:19:20.776 INFO:tasks.workunit.client.0.smithi037.stdout:8/660: dwrite d5/db/d18/d3b/fb2 [0,4194304] 0 2024-04-25T17:19:20.777 INFO:tasks.workunit.client.1.smithi069.stdout:9/620: sync 2024-04-25T17:19:20.777 INFO:tasks.workunit.client.1.smithi069.stdout:2/619: dread d0/d26/f54 [0,4194304] 0 2024-04-25T17:19:20.777 INFO:tasks.workunit.client.0.smithi037.stdout:8/661: write d5/d26/d81/fc7 [797951,28689] 0 2024-04-25T17:19:20.782 INFO:tasks.workunit.client.1.smithi069.stdout:0/554: mkdir d0/da/db/d56/d98/dc7 0 2024-04-25T17:19:20.784 INFO:tasks.workunit.client.1.smithi069.stdout:2/620: dwrite d0/f92 [0,4194304] 0 2024-04-25T17:19:20.787 INFO:tasks.workunit.client.1.smithi069.stdout:7/643: unlink d4/d83/cbd 0 2024-04-25T17:19:20.790 INFO:tasks.workunit.client.0.smithi037.stdout:9/896: creat d1/d5/d19/dde/d100/f128 x:0 0 0 2024-04-25T17:19:20.791 INFO:tasks.workunit.client.1.smithi069.stdout:8/653: chown d37/d47/d54/d6e/d98/fb5 178439946 1 2024-04-25T17:19:20.792 INFO:tasks.workunit.client.0.smithi037.stdout:6/666: fsync db/d53/fe8 0 2024-04-25T17:19:20.793 INFO:tasks.workunit.client.0.smithi037.stdout:5/727: dwrite f0 [0,4194304] 0 2024-04-25T17:19:20.795 INFO:tasks.workunit.client.1.smithi069.stdout:6/615: unlink d2/d1e/d43/c46 0 2024-04-25T17:19:20.795 INFO:tasks.workunit.client.1.smithi069.stdout:4/640: dwrite db/d15/d20/faa [0,4194304] 0 2024-04-25T17:19:20.796 INFO:tasks.workunit.client.1.smithi069.stdout:4/641: readlink db/d15/d20/d35/d63/l6f 0 2024-04-25T17:19:20.797 INFO:tasks.workunit.client.1.smithi069.stdout:4/642: chown db/d15/d20/faa 294859 1 2024-04-25T17:19:20.800 INFO:tasks.workunit.client.0.smithi037.stdout:4/918: rename d7/d7e/d5b/dfe/d39/d9c/d103/l119 to d7/d7e/d1e/dae/dc6/l132 0 2024-04-25T17:19:20.801 INFO:tasks.workunit.client.0.smithi037.stdout:9/897: dwrite d1/d5/d2e/d34/f108 [0,4194304] 0 2024-04-25T17:19:20.804 INFO:tasks.workunit.client.1.smithi069.stdout:1/644: creat d1/d43/d1b/d32/fc3 x:0 0 0 2024-04-25T17:19:20.811 INFO:tasks.workunit.client.0.smithi037.stdout:4/919: dwrite d7/d7e/d5b/dfe/fd9 [4194304,4194304] 0 2024-04-25T17:19:20.812 INFO:tasks.workunit.client.0.smithi037.stdout:1/830: dwrite dc/d52/d6b/dd9/d4d/d6a/d8f/ddc/fe2 [0,4194304] 0 2024-04-25T17:19:20.813 INFO:tasks.workunit.client.0.smithi037.stdout:4/920: stat d7/d7e/d1e/f56 0 2024-04-25T17:19:20.813 INFO:tasks.workunit.client.1.smithi069.stdout:3/692: link f4 d8/d8b/ff1 0 2024-04-25T17:19:20.840 INFO:tasks.workunit.client.1.smithi069.stdout:2/621: mknod d0/d56/d5f/d62/cc6 0 2024-04-25T17:19:20.846 INFO:tasks.workunit.client.1.smithi069.stdout:5/678: sync 2024-04-25T17:19:20.848 INFO:tasks.workunit.client.1.smithi069.stdout:6/616: mkdir d2/d9c/d97/d98/ddb 0 2024-04-25T17:19:20.849 INFO:tasks.workunit.client.1.smithi069.stdout:4/643: symlink db/d4b/ldb 0 2024-04-25T17:19:20.854 INFO:tasks.workunit.client.1.smithi069.stdout:1/645: mknod d1/d4/d6/d9e/da6/d7c/d4d/d8f/cc4 0 2024-04-25T17:19:20.855 INFO:tasks.workunit.client.1.smithi069.stdout:9/621: getdents d2/da/d5f/dd3 0 2024-04-25T17:19:20.857 INFO:tasks.workunit.client.1.smithi069.stdout:3/693: truncate d8/d2a/f82 967432 0 2024-04-25T17:19:20.858 INFO:tasks.workunit.client.1.smithi069.stdout:1/646: write d1/d43/d1b/d32/d4a/fbe [1034622,122435] 0 2024-04-25T17:19:20.859 INFO:tasks.workunit.client.1.smithi069.stdout:8/654: write d37/d47/d54/f7a [53389,8916] 0 2024-04-25T17:19:20.859 INFO:tasks.workunit.client.1.smithi069.stdout:2/622: symlink d0/d1/d5b/d33/lc7 0 2024-04-25T17:19:20.861 INFO:tasks.workunit.client.1.smithi069.stdout:7/644: mkdir d4/d3e/d94/da1/dc7/d14/d44/dd5 0 2024-04-25T17:19:20.862 INFO:tasks.workunit.client.1.smithi069.stdout:2/623: chown d0/f92 153 1 2024-04-25T17:19:20.862 INFO:tasks.workunit.client.1.smithi069.stdout:4/644: dwrite db/d4b/d78/f8b [0,4194304] 0 2024-04-25T17:19:20.862 INFO:tasks.workunit.client.1.smithi069.stdout:0/555: dread d0/da/d24/f6d [0,4194304] 0 2024-04-25T17:19:20.864 INFO:tasks.workunit.client.1.smithi069.stdout:0/556: fdatasync d0/d38/d75/f7b 0 2024-04-25T17:19:20.865 INFO:tasks.workunit.client.1.smithi069.stdout:6/617: stat d2/d7/l5a 0 2024-04-25T17:19:20.872 INFO:tasks.workunit.client.1.smithi069.stdout:6/618: dwrite d2/d1e/d43/fc9 [0,4194304] 0 2024-04-25T17:19:20.872 INFO:tasks.workunit.client.1.smithi069.stdout:4/645: dwrite db/d15/d20/d35/d63/d43/f97 [4194304,4194304] 0 2024-04-25T17:19:20.873 INFO:tasks.workunit.client.1.smithi069.stdout:4/646: fsync db/d15/f18 0 2024-04-25T17:19:20.889 INFO:tasks.workunit.client.0.smithi037.stdout:7/623: getdents d5/d14/dcf 0 2024-04-25T17:19:20.892 INFO:tasks.workunit.client.0.smithi037.stdout:6/667: symlink db/d1d/db1/led 0 2024-04-25T17:19:20.893 INFO:tasks.workunit.client.0.smithi037.stdout:5/728: creat d7/d12/da8/fdd x:0 0 0 2024-04-25T17:19:20.897 INFO:tasks.workunit.client.0.smithi037.stdout:0/733: creat d9/df/d32/fed x:0 0 0 2024-04-25T17:19:20.901 INFO:tasks.workunit.client.0.smithi037.stdout:1/831: write dc/d18/f7d [795663,8429] 0 2024-04-25T17:19:20.901 INFO:tasks.workunit.client.0.smithi037.stdout:4/921: truncate d7/d7e/d5b/dfe/d39/dba/fb4 2329168 0 2024-04-25T17:19:20.902 INFO:tasks.workunit.client.1.smithi069.stdout:8/655: creat d37/d47/d48/d8e/fdc x:0 0 0 2024-04-25T17:19:20.904 INFO:tasks.workunit.client.1.smithi069.stdout:5/679: mkdir d13/d17/d19/d1c/dec 0 2024-04-25T17:19:20.905 INFO:tasks.workunit.client.0.smithi037.stdout:6/668: truncate db/fd3 2377010 0 2024-04-25T17:19:20.908 INFO:tasks.workunit.client.0.smithi037.stdout:0/734: fdatasync d9/d14/d28/d48/db7/fcd 0 2024-04-25T17:19:20.912 INFO:tasks.workunit.client.0.smithi037.stdout:1/832: creat dc/d52/d6b/dd9/d4d/d6a/de3/f120 x:0 0 0 2024-04-25T17:19:20.914 INFO:tasks.workunit.client.0.smithi037.stdout:1/833: chown dc/d52/d6b/dd9/d22/d36/d8c/f11a 1657 1 2024-04-25T17:19:20.914 INFO:tasks.workunit.client.0.smithi037.stdout:7/624: mkdir d5/d15/d17/d25/d2b/dcb/dda 0 2024-04-25T17:19:20.915 INFO:tasks.workunit.client.1.smithi069.stdout:6/619: mkdir d2/d1e/d43/ddc 0 2024-04-25T17:19:20.916 INFO:tasks.workunit.client.1.smithi069.stdout:6/620: dread - d2/d51/d85/f7b zero size 2024-04-25T17:19:20.917 INFO:tasks.workunit.client.0.smithi037.stdout:4/922: creat d7/d7e/d1e/de1/f133 x:0 0 0 2024-04-25T17:19:20.918 INFO:tasks.workunit.client.0.smithi037.stdout:6/669: mkdir db/d26/d2e/d7d/d65/d8b/dee 0 2024-04-25T17:19:20.923 INFO:tasks.workunit.client.1.smithi069.stdout:3/694: truncate d8/f12 729416 0 2024-04-25T17:19:20.924 INFO:tasks.workunit.client.1.smithi069.stdout:8/656: dread - d37/d47/d78/f90 zero size 2024-04-25T17:19:20.926 INFO:tasks.workunit.client.0.smithi037.stdout:1/834: mkdir dc/d24/da5/df9/d121 0 2024-04-25T17:19:20.926 INFO:tasks.workunit.client.1.smithi069.stdout:7/645: truncate d4/d1a/f2f 1265358 0 2024-04-25T17:19:20.929 INFO:tasks.workunit.client.1.smithi069.stdout:5/680: fsync d13/d17/d29/d30/d5c/f69 0 2024-04-25T17:19:20.930 INFO:tasks.workunit.client.1.smithi069.stdout:7/646: dread d4/f10 [4194304,4194304] 0 2024-04-25T17:19:20.930 INFO:tasks.workunit.client.0.smithi037.stdout:4/923: mknod d7/d67/c134 0 2024-04-25T17:19:20.931 INFO:tasks.workunit.client.1.smithi069.stdout:7/647: write d4/d3e/fce [790714,35284] 0 2024-04-25T17:19:20.934 INFO:tasks.workunit.client.0.smithi037.stdout:8/662: dwrite d5/db/d18/d3b/f9b [0,4194304] 0 2024-04-25T17:19:20.935 INFO:tasks.workunit.client.0.smithi037.stdout:1/835: dwrite dc/f110 [0,4194304] 0 2024-04-25T17:19:20.936 INFO:tasks.workunit.client.1.smithi069.stdout:5/681: dwrite d13/d17/d19/d1c/da4/da9/daa/fb2 [0,4194304] 0 2024-04-25T17:19:20.941 INFO:tasks.workunit.client.1.smithi069.stdout:6/621: mkdir d2/d1e/d43/db6/daf/ddd 0 2024-04-25T17:19:20.947 INFO:tasks.workunit.client.1.smithi069.stdout:9/622: link d2/da/dd/d1e/c2a d2/da/dd/de/d74/d8a/cd4 0 2024-04-25T17:19:20.949 INFO:tasks.workunit.client.1.smithi069.stdout:9/623: chown d2/da/dd/de/d64/f6e 1092210 1 2024-04-25T17:19:20.950 INFO:tasks.workunit.client.0.smithi037.stdout:9/898: dwrite d1/d5/dc/f72 [0,4194304] 0 2024-04-25T17:19:20.953 INFO:tasks.workunit.client.0.smithi037.stdout:8/663: write d5/db/d23/d78/d93/fb9 [204493,113371] 0 2024-04-25T17:19:20.955 INFO:tasks.workunit.client.0.smithi037.stdout:1/836: creat dc/d52/d6b/dd9/d22/d36/d74/daf/ddd/f122 x:0 0 0 2024-04-25T17:19:20.966 INFO:tasks.workunit.client.1.smithi069.stdout:7/648: rmdir d4/d83 39 2024-04-25T17:19:20.967 INFO:tasks.workunit.client.0.smithi037.stdout:5/729: truncate d7/d43/f47 8157135 0 2024-04-25T17:19:20.969 INFO:tasks.workunit.client.1.smithi069.stdout:2/624: rmdir d0/d56/d5f/d62/d7d/d72/daf/dc2/d9c 0 2024-04-25T17:19:20.969 INFO:tasks.workunit.client.1.smithi069.stdout:2/625: read d0/d26/f23 [688345,10278] 0 2024-04-25T17:19:20.973 INFO:tasks.workunit.client.1.smithi069.stdout:5/682: chown d13/d17/l94 3447 1 2024-04-25T17:19:20.975 INFO:tasks.workunit.client.1.smithi069.stdout:1/647: dwrite d1/d4/d6/d81/f9f [0,4194304] 0 2024-04-25T17:19:20.976 INFO:tasks.workunit.client.0.smithi037.stdout:8/664: mkdir d5/db/d23/dd8 0 2024-04-25T17:19:20.977 INFO:tasks.workunit.client.1.smithi069.stdout:4/647: creat db/d4b/d78/d79/dca/fdc x:0 0 0 2024-04-25T17:19:20.978 INFO:tasks.workunit.client.1.smithi069.stdout:4/648: write db/d15/d20/d35/d63/fa2 [1896679,72688] 0 2024-04-25T17:19:20.978 INFO:tasks.workunit.client.0.smithi037.stdout:0/735: dwrite d9/df/d32/dd1/fba [0,4194304] 0 2024-04-25T17:19:20.979 INFO:tasks.workunit.client.0.smithi037.stdout:5/730: creat d7/d12/d6f/d94/fde x:0 0 0 2024-04-25T17:19:20.980 INFO:tasks.workunit.client.1.smithi069.stdout:9/624: creat d2/da4/fd5 x:0 0 0 2024-04-25T17:19:20.982 INFO:tasks.workunit.client.1.smithi069.stdout:4/649: dread db/f52 [0,4194304] 0 2024-04-25T17:19:20.983 INFO:tasks.workunit.client.0.smithi037.stdout:6/670: write db/d26/d2e/d3e/f34 [2956167,123924] 0 2024-04-25T17:19:20.983 INFO:tasks.workunit.client.0.smithi037.stdout:1/837: fdatasync dc/d52/d6b/dd9/d4d/d6a/dea/f90 0 2024-04-25T17:19:20.986 INFO:tasks.workunit.client.0.smithi037.stdout:7/625: dwrite d5/d14/d31/f93 [0,4194304] 0 2024-04-25T17:19:20.986 INFO:tasks.workunit.client.0.smithi037.stdout:1/838: fsync dc/d24/da5/fda 0 2024-04-25T17:19:20.987 INFO:tasks.workunit.client.0.smithi037.stdout:8/665: mkdir d5/db/d18/d3b/d50/da0/da6/dd9 0 2024-04-25T17:19:20.988 INFO:tasks.workunit.client.0.smithi037.stdout:1/839: chown dc/d52/d6b/dd9/d4d/d6a/d86/d91/fd4 73 1 2024-04-25T17:19:20.988 INFO:tasks.workunit.client.0.smithi037.stdout:7/626: write d5/d15/d17/d1b/da2/d76/fd0 [476949,38856] 0 2024-04-25T17:19:20.990 INFO:tasks.workunit.client.1.smithi069.stdout:8/657: creat d37/d47/d54/d6e/dce/fdd x:0 0 0 2024-04-25T17:19:20.990 INFO:tasks.workunit.client.0.smithi037.stdout:8/666: truncate d5/d26/d81/fc7 870967 0 2024-04-25T17:19:20.991 INFO:tasks.workunit.client.0.smithi037.stdout:1/840: read - dc/d52/d6b/dd9/d22/d36/d74/daf/ddd/f122 zero size 2024-04-25T17:19:20.991 INFO:tasks.workunit.client.1.smithi069.stdout:8/658: write d37/fd6 [46468,90658] 0 2024-04-25T17:19:20.992 INFO:tasks.workunit.client.1.smithi069.stdout:0/557: truncate d0/da/d24/d43/f7f 3458074 0 2024-04-25T17:19:20.994 INFO:tasks.workunit.client.0.smithi037.stdout:1/841: write dc/d52/d6b/dd9/d22/d36/d74/da6/f11d [710167,99816] 0 2024-04-25T17:19:20.998 INFO:tasks.workunit.client.0.smithi037.stdout:5/731: mknod d7/d12/d5d/cdf 0 2024-04-25T17:19:21.000 INFO:tasks.workunit.client.0.smithi037.stdout:4/924: write d7/d7e/d45/d4f/f8e [1133372,68503] 0 2024-04-25T17:19:21.006 INFO:tasks.workunit.client.0.smithi037.stdout:8/667: symlink d5/d26/lda 0 2024-04-25T17:19:21.006 INFO:tasks.workunit.client.0.smithi037.stdout:9/899: write d1/d5/d2e/d34/d76/db4/d119/f51 [712500,34150] 0 2024-04-25T17:19:21.009 INFO:tasks.workunit.client.0.smithi037.stdout:9/900: write d1/d5/d2e/d34/d76/db4/d119/fd7 [1455997,118897] 0 2024-04-25T17:19:21.009 INFO:tasks.workunit.client.0.smithi037.stdout:0/736: mkdir d9/d14/dee 0 2024-04-25T17:19:21.010 INFO:tasks.workunit.client.0.smithi037.stdout:9/901: fdatasync d1/d5/d2e/d34/daf/f115 0 2024-04-25T17:19:21.011 INFO:tasks.workunit.client.0.smithi037.stdout:7/627: fdatasync d5/d15/f1f 0 2024-04-25T17:19:21.011 INFO:tasks.workunit.client.0.smithi037.stdout:1/842: creat dc/d52/d6b/dd9/d4d/d6a/d8f/ddc/f123 x:0 0 0 2024-04-25T17:19:21.011 INFO:tasks.workunit.client.0.smithi037.stdout:7/628: chown d5/f7c 77904 1 2024-04-25T17:19:21.012 INFO:tasks.workunit.client.1.smithi069.stdout:6/622: write d2/d1e/d43/fc5 [249669,84083] 0 2024-04-25T17:19:21.013 INFO:tasks.workunit.client.1.smithi069.stdout:6/623: write d2/d1e/d43/fc9 [2815884,118276] 0 2024-04-25T17:19:21.085 INFO:tasks.workunit.client.0.smithi037.stdout:5/732: chown d7/d43/ca0 172 1 2024-04-25T17:19:21.085 INFO:tasks.workunit.client.0.smithi037.stdout:5/733: write d7/d12/d6f/d94/fde [328390,118612] 0 2024-04-25T17:19:21.086 INFO:tasks.workunit.client.0.smithi037.stdout:6/671: mkdir db/d1d/dcc/def 0 2024-04-25T17:19:21.089 INFO:tasks.workunit.client.1.smithi069.stdout:4/650: mknod db/d15/d42/cdd 0 2024-04-25T17:19:21.093 INFO:tasks.workunit.client.1.smithi069.stdout:3/695: link d8/d71/d8d/d92/db6/dc1/f7a d8/d16/ff2 0 2024-04-25T17:19:21.098 INFO:tasks.workunit.client.0.smithi037.stdout:9/902: fdatasync d1/d48/d68/d1c/fcd 0 2024-04-25T17:19:21.099 INFO:tasks.workunit.client.1.smithi069.stdout:7/649: mkdir d4/d3e/d94/da1/dc7/d14/d44/dd5/dd6 0 2024-04-25T17:19:21.103 INFO:tasks.workunit.client.1.smithi069.stdout:2/626: mkdir d0/d26/d36/db9/dc8 0 2024-04-25T17:19:21.106 INFO:tasks.workunit.client.0.smithi037.stdout:9/903: dwrite d1/d5/d2e/d34/d76/db4/fff [0,4194304] 0 2024-04-25T17:19:21.108 INFO:tasks.workunit.client.0.smithi037.stdout:1/843: creat dc/d52/d6b/dd9/d4d/d6a/d8f/ddc/dee/dfc/f124 x:0 0 0 2024-04-25T17:19:21.108 INFO:tasks.workunit.client.0.smithi037.stdout:6/672: dread db/d26/d2e/d3e/fb9 [0,4194304] 0 2024-04-25T17:19:21.111 INFO:tasks.workunit.client.0.smithi037.stdout:6/673: chown db/d26/d2e/d7d/dde 960270 1 2024-04-25T17:19:21.116 INFO:tasks.workunit.client.0.smithi037.stdout:4/925: fsync d7/d7e/d1e/fcf 0 2024-04-25T17:19:21.119 INFO:tasks.workunit.client.0.smithi037.stdout:1/844: dwrite dc/d52/d6b/dd9/d4d/d6a/dea/ff5 [0,4194304] 0 2024-04-25T17:19:21.119 INFO:tasks.workunit.client.1.smithi069.stdout:1/648: creat d1/d43/d5f/d8e/dbb/fc5 x:0 0 0 2024-04-25T17:19:21.125 INFO:tasks.workunit.client.1.smithi069.stdout:4/651: mknod db/d15/d20/d35/d63/d43/d48/cde 0 2024-04-25T17:19:21.130 INFO:tasks.workunit.client.1.smithi069.stdout:8/659: unlink d37/d47/d54/d6e/lb9 0 2024-04-25T17:19:21.131 INFO:tasks.workunit.client.1.smithi069.stdout:2/627: dread d0/d1/d5b/d33/f39 [0,4194304] 0 2024-04-25T17:19:21.134 INFO:tasks.workunit.client.0.smithi037.stdout:7/629: dread d5/d14/db1/fa7 [0,4194304] 0 2024-04-25T17:19:21.139 INFO:tasks.workunit.client.0.smithi037.stdout:4/926: chown d7/d7e/d5b/dfe/d39/d7a/dcc/f105 169544060 1 2024-04-25T17:19:21.140 INFO:tasks.workunit.client.0.smithi037.stdout:4/927: dread - d7/d7e/d1e/d2b/f63 zero size 2024-04-25T17:19:21.140 INFO:tasks.workunit.client.1.smithi069.stdout:9/625: creat d2/fd6 x:0 0 0 2024-04-25T17:19:21.142 INFO:tasks.workunit.client.0.smithi037.stdout:0/737: write d9/df/d32/f4b [46379,92004] 0 2024-04-25T17:19:21.142 INFO:tasks.workunit.client.0.smithi037.stdout:4/928: dread - d7/d7e/d5b/dfe/d39/d7a/dcc/fe4 zero size 2024-04-25T17:19:21.142 INFO:tasks.workunit.client.0.smithi037.stdout:0/738: chown d9/df/d32/d39/d68/da7 1230815 1 2024-04-25T17:19:21.143 INFO:tasks.workunit.client.0.smithi037.stdout:4/929: chown d7/d7e/l33 53 1 2024-04-25T17:19:21.144 INFO:tasks.workunit.client.0.smithi037.stdout:8/668: creat d5/db/d23/fdb x:0 0 0 2024-04-25T17:19:21.144 INFO:tasks.workunit.client.1.smithi069.stdout:0/558: write d0/da/d24/d67/f6a [4610564,41229] 0 2024-04-25T17:19:21.145 INFO:tasks.workunit.client.1.smithi069.stdout:8/660: dread d37/d47/d54/d6e/d9e/fa4 [0,4194304] 0 2024-04-25T17:19:21.146 INFO:tasks.workunit.client.0.smithi037.stdout:9/904: fsync d1/d5/d2e/d34/fdd 0 2024-04-25T17:19:21.146 INFO:tasks.workunit.client.1.smithi069.stdout:8/661: fdatasync d37/d47/d54/fca 0 2024-04-25T17:19:21.148 INFO:tasks.workunit.client.0.smithi037.stdout:9/905: dread d1/d5/dc/d38/f3a [0,4194304] 0 2024-04-25T17:19:21.150 INFO:tasks.workunit.client.1.smithi069.stdout:7/650: dread d4/d3e/d94/da1/dc7/d14/d15/f17 [0,4194304] 0 2024-04-25T17:19:21.151 INFO:tasks.workunit.client.1.smithi069.stdout:0/559: dwrite d0/da/db/d73/fb5 [0,4194304] 0 2024-04-25T17:19:21.152 INFO:tasks.workunit.client.1.smithi069.stdout:5/683: getdents d13/d17/d19/d1c/d6c 0 2024-04-25T17:19:21.153 INFO:tasks.workunit.client.0.smithi037.stdout:1/845: write dc/d18/d39/f6c [4102842,115586] 0 2024-04-25T17:19:21.155 INFO:tasks.workunit.client.1.smithi069.stdout:1/649: rename d1/df/d17/c78 to d1/d4/d6/d4f/cc6 0 2024-04-25T17:19:21.161 INFO:tasks.workunit.client.0.smithi037.stdout:3/548: sync 2024-04-25T17:19:21.161 INFO:tasks.workunit.client.0.smithi037.stdout:2/742: sync 2024-04-25T17:19:21.163 INFO:tasks.workunit.client.0.smithi037.stdout:5/734: dwrite d7/da1/dbb/fc0 [0,4194304] 0 2024-04-25T17:19:21.163 INFO:tasks.workunit.client.0.smithi037.stdout:4/930: rename d7/d7e/d5b/dfe/d39/d9c/lc7 to d7/d7e/d5b/dfe/d39/dba/d12c/l135 0 2024-04-25T17:19:21.165 INFO:tasks.workunit.client.1.smithi069.stdout:4/652: symlink db/d15/d20/d35/d63/ldf 0 2024-04-25T17:19:21.172 INFO:tasks.workunit.client.0.smithi037.stdout:6/674: rmdir db/d1d/dcc/def 0 2024-04-25T17:19:21.173 INFO:tasks.workunit.client.1.smithi069.stdout:0/560: mknod d0/da/d54/d7d/cc8 0 2024-04-25T17:19:21.173 INFO:tasks.workunit.client.0.smithi037.stdout:7/630: truncate d5/d15/d17/d1b/f5b 134905 0 2024-04-25T17:19:21.174 INFO:tasks.workunit.client.1.smithi069.stdout:3/696: dwrite d8/d39/f89 [0,4194304] 0 2024-04-25T17:19:21.175 INFO:tasks.workunit.client.1.smithi069.stdout:0/561: write d0/da/db/d56/f78 [332424,118178] 0 2024-04-25T17:19:21.175 INFO:tasks.workunit.client.0.smithi037.stdout:7/631: chown d5/d15/d17/d1b/da2/daf/dc5 339479 1 2024-04-25T17:19:21.176 INFO:tasks.workunit.client.1.smithi069.stdout:0/562: chown d0/da 3026 1 2024-04-25T17:19:21.177 INFO:tasks.workunit.client.0.smithi037.stdout:1/846: creat dc/d52/d6b/dd9/d4d/d6a/d8f/f125 x:0 0 0 2024-04-25T17:19:21.179 INFO:tasks.workunit.client.1.smithi069.stdout:1/650: mknod d1/d4/d6/d9e/da6/d7c/d4d/cc7 0 2024-04-25T17:19:21.181 INFO:tasks.workunit.client.1.smithi069.stdout:5/684: dread f9 [0,4194304] 0 2024-04-25T17:19:21.182 INFO:tasks.workunit.client.1.smithi069.stdout:6/624: getdents d2/d51/d85 0 2024-04-25T17:19:21.183 INFO:tasks.workunit.client.1.smithi069.stdout:4/653: truncate db/d15/d42/f5f 318689 0 2024-04-25T17:19:21.184 INFO:tasks.workunit.client.1.smithi069.stdout:4/654: stat db/d15/d82 0 2024-04-25T17:19:21.184 INFO:tasks.workunit.client.1.smithi069.stdout:2/628: creat d0/d1/d5b/fc9 x:0 0 0 2024-04-25T17:19:21.187 INFO:tasks.workunit.client.1.smithi069.stdout:3/697: mknod d8/d16/d1a/d2c/d6c/cf3 0 2024-04-25T17:19:21.187 INFO:tasks.workunit.client.1.smithi069.stdout:9/626: dwrite d2/da/dd/d1e/f6a [0,4194304] 0 2024-04-25T17:19:21.188 INFO:tasks.workunit.client.0.smithi037.stdout:2/743: mknod d0/d16/d20/d59/d6a/da5/dbd/cec 0 2024-04-25T17:19:21.189 INFO:tasks.workunit.client.0.smithi037.stdout:4/931: readlink d7/d7e/d1e/d2b/l66 0 2024-04-25T17:19:21.190 INFO:tasks.workunit.client.0.smithi037.stdout:9/906: fdatasync d1/d48/d68/f31 0 2024-04-25T17:19:21.191 INFO:tasks.workunit.client.1.smithi069.stdout:1/651: symlink d1/d4/de/d44/lc8 0 2024-04-25T17:19:21.192 INFO:tasks.workunit.client.0.smithi037.stdout:9/907: dread - d1/d5/d19/dde/d100/f128 zero size 2024-04-25T17:19:21.193 INFO:tasks.workunit.client.1.smithi069.stdout:5/685: dwrite d13/d17/d19/d1c/d79/fe6 [0,4194304] 0 2024-04-25T17:19:21.195 INFO:tasks.workunit.client.0.smithi037.stdout:7/632: fsync d5/d14/d31/fb4 0 2024-04-25T17:19:21.196 INFO:tasks.workunit.client.0.smithi037.stdout:7/633: chown f0 12584 1 2024-04-25T17:19:21.199 INFO:tasks.workunit.client.0.smithi037.stdout:1/847: fsync dc/d52/d6b/dd9/fb9 0 2024-04-25T17:19:21.201 INFO:tasks.workunit.client.0.smithi037.stdout:1/848: readlink dc/d52/d6b/dd9/d4d/d6a/d8f/lfa 0 2024-04-25T17:19:21.201 INFO:tasks.workunit.client.1.smithi069.stdout:9/627: dwrite d2/da4/dcf/fc6 [0,4194304] 0 2024-04-25T17:19:21.204 INFO:tasks.workunit.client.0.smithi037.stdout:1/849: fdatasync dc/d52/d6b/dd9/d22/d36/d92/fc8 0 2024-04-25T17:19:21.205 INFO:tasks.workunit.client.1.smithi069.stdout:8/662: rename d37/f87 to d37/d66/fde 0 2024-04-25T17:19:21.207 INFO:tasks.workunit.client.0.smithi037.stdout:5/735: dread d7/d43/f16 [0,4194304] 0 2024-04-25T17:19:21.208 INFO:tasks.workunit.client.1.smithi069.stdout:7/651: dread d4/d3e/d94/da1/dc7/d14/d5a/f6c [0,4194304] 0 2024-04-25T17:19:21.210 INFO:tasks.workunit.client.0.smithi037.stdout:2/744: mkdir d0/d23/dac/d4b/ded 0 2024-04-25T17:19:21.212 INFO:tasks.workunit.client.0.smithi037.stdout:0/739: write d9/d14/d28/d48/da9/fb6 [990243,108936] 0 2024-04-25T17:19:21.212 INFO:tasks.workunit.client.1.smithi069.stdout:6/625: dwrite d2/d1e/d3f/f49 [0,4194304] 0 2024-04-25T17:19:21.213 INFO:tasks.workunit.client.0.smithi037.stdout:4/932: dread - d7/d7e/d45/fed zero size 2024-04-25T17:19:21.214 INFO:tasks.workunit.client.1.smithi069.stdout:1/652: creat d1/d4/d6/d4f/d9b/fc9 x:0 0 0 2024-04-25T17:19:21.216 INFO:tasks.workunit.client.1.smithi069.stdout:5/686: symlink d13/d17/d29/d2e/led 0 2024-04-25T17:19:21.216 INFO:tasks.workunit.client.1.smithi069.stdout:2/629: dread d0/d26/f93 [0,4194304] 0 2024-04-25T17:19:21.217 INFO:tasks.workunit.client.1.smithi069.stdout:2/630: stat d0/d26 0 2024-04-25T17:19:21.217 INFO:tasks.workunit.client.1.smithi069.stdout:5/687: fdatasync d13/d17/d19/d1c/f71 0 2024-04-25T17:19:21.218 INFO:tasks.workunit.client.0.smithi037.stdout:9/908: read d1/d5/dc/d38/d8b/f95 [1781378,21853] 0 2024-04-25T17:19:21.221 INFO:tasks.workunit.client.0.smithi037.stdout:3/549: dread d8/d31/d32/f36 [0,4194304] 0 2024-04-25T17:19:21.222 INFO:tasks.workunit.client.1.smithi069.stdout:9/628: creat d2/d51/db4/fd7 x:0 0 0 2024-04-25T17:19:21.225 INFO:tasks.workunit.client.0.smithi037.stdout:8/669: creat d5/db/d23/d58/dd3/fdc x:0 0 0 2024-04-25T17:19:21.228 INFO:tasks.workunit.client.0.smithi037.stdout:0/740: mknod d9/df/d32/d39/d68/cef 0 2024-04-25T17:19:21.232 INFO:tasks.workunit.client.1.smithi069.stdout:5/688: symlink d13/d17/d19/d20/d2d/lee 0 2024-04-25T17:19:21.232 INFO:tasks.workunit.client.0.smithi037.stdout:9/909: fsync d1/d5/d2e/f75 0 2024-04-25T17:19:21.233 INFO:tasks.workunit.client.0.smithi037.stdout:9/910: readlink d1/d5/lab 0 2024-04-25T17:19:21.234 INFO:tasks.workunit.client.1.smithi069.stdout:5/689: write d13/d17/d19/d1c/da4/fd0 [964978,58393] 0 2024-04-25T17:19:21.234 INFO:tasks.workunit.client.1.smithi069.stdout:3/698: getdents d8/d16/d1a/d2c/d49/d59/dd2 0 2024-04-25T17:19:21.234 INFO:tasks.workunit.client.1.smithi069.stdout:3/699: fsync d8/f1f 0 2024-04-25T17:19:21.235 INFO:tasks.workunit.client.0.smithi037.stdout:7/634: creat d5/d15/d17/d1b/d94/fdb x:0 0 0 2024-04-25T17:19:21.237 INFO:tasks.workunit.client.0.smithi037.stdout:3/550: rmdir d8/d23/d3a 39 2024-04-25T17:19:21.239 INFO:tasks.workunit.client.1.smithi069.stdout:8/663: rename l23 to d37/d47/d48/d8e/ldf 0 2024-04-25T17:19:21.240 INFO:tasks.workunit.client.0.smithi037.stdout:8/670: write d5/da/f4a [2065492,100740] 0 2024-04-25T17:19:21.241 INFO:tasks.workunit.client.0.smithi037.stdout:8/671: readlink d5/d26/d81/lc6 0 2024-04-25T17:19:21.242 INFO:tasks.workunit.client.1.smithi069.stdout:6/626: creat d2/d1e/d43/d7d/db5/fde x:0 0 0 2024-04-25T17:19:21.243 INFO:tasks.workunit.client.0.smithi037.stdout:5/736: rename d7/da1/db0/cc8 to d7/d12/d5d/d90/db1/ce0 0 2024-04-25T17:19:21.244 INFO:tasks.workunit.client.0.smithi037.stdout:5/737: stat d7/d18 0 2024-04-25T17:19:21.245 INFO:tasks.workunit.client.1.smithi069.stdout:8/664: dwrite fe [0,4194304] 0 2024-04-25T17:19:21.246 INFO:tasks.workunit.client.1.smithi069.stdout:8/665: dread - d37/d47/d54/d6e/d9e/fcf zero size 2024-04-25T17:19:21.247 INFO:tasks.workunit.client.0.smithi037.stdout:6/675: dread db/d1d/d20/f5b [0,4194304] 0 2024-04-25T17:19:21.248 INFO:tasks.workunit.client.0.smithi037.stdout:0/741: read d9/d14/d28/d48/f88 [3288032,57591] 0 2024-04-25T17:19:21.248 INFO:tasks.workunit.client.0.smithi037.stdout:0/742: stat d9/df/d32/d39/cc2 0 2024-04-25T17:19:21.251 INFO:tasks.workunit.client.1.smithi069.stdout:3/700: stat d8/d16/d1a/d2c/d49/d59/c64 0 2024-04-25T17:19:21.256 INFO:tasks.workunit.client.0.smithi037.stdout:7/635: rename f4 to d5/d15/fdc 0 2024-04-25T17:19:21.257 INFO:tasks.workunit.client.0.smithi037.stdout:7/636: readlink d5/d15/d17/d25/d2b/l2c 0 2024-04-25T17:19:21.257 INFO:tasks.workunit.client.1.smithi069.stdout:1/653: write d1/d4/d6/f31 [2012068,37348] 0 2024-04-25T17:19:21.259 INFO:tasks.workunit.client.1.smithi069.stdout:6/627: creat d2/d9c/fdf x:0 0 0 2024-04-25T17:19:21.260 INFO:tasks.workunit.client.1.smithi069.stdout:2/631: write d0/d26/d10/f5c [5992906,56730] 0 2024-04-25T17:19:21.261 INFO:tasks.workunit.client.1.smithi069.stdout:8/666: chown l1b 38896182 1 2024-04-25T17:19:21.262 INFO:tasks.workunit.client.1.smithi069.stdout:8/667: readlink d37/d66/l95 0 2024-04-25T17:19:21.263 INFO:tasks.workunit.client.1.smithi069.stdout:3/701: fdatasync d8/d16/d1a/d2c/f4e 0 2024-04-25T17:19:21.267 INFO:tasks.workunit.client.0.smithi037.stdout:9/911: creat d1/d48/d112/f129 x:0 0 0 2024-04-25T17:19:21.268 INFO:tasks.workunit.client.1.smithi069.stdout:1/654: rmdir d1/d4/d6/d9e/da6/d7c 39 2024-04-25T17:19:21.268 INFO:tasks.workunit.client.1.smithi069.stdout:9/629: dwrite d2/da/dd/f2d [0,4194304] 0 2024-04-25T17:19:21.274 INFO:tasks.workunit.client.0.smithi037.stdout:0/743: rename d9/d14/f16 to d9/d14/d28/d48/db7/ff0 0 2024-04-25T17:19:21.275 INFO:tasks.workunit.client.1.smithi069.stdout:2/632: fdatasync d0/d26/d10/f49 0 2024-04-25T17:19:21.276 INFO:tasks.workunit.client.1.smithi069.stdout:1/655: dwrite d1/d4/de/d44/d68/fc2 [0,4194304] 0 2024-04-25T17:19:21.276 INFO:tasks.workunit.client.0.smithi037.stdout:3/551: write d8/d23/f8e [48977,93051] 0 2024-04-25T17:19:21.278 INFO:tasks.workunit.client.1.smithi069.stdout:8/668: creat d37/d47/d78/db3/fe0 x:0 0 0 2024-04-25T17:19:21.279 INFO:tasks.workunit.client.0.smithi037.stdout:5/738: truncate d7/d12/d6f/f54 1237417 0 2024-04-25T17:19:21.282 INFO:tasks.workunit.client.1.smithi069.stdout:3/702: fsync d8/d71/d8d/d92/f97 0 2024-04-25T17:19:21.283 INFO:tasks.workunit.client.0.smithi037.stdout:2/745: getdents d0/d16/d3b 0 2024-04-25T17:19:21.283 INFO:tasks.workunit.client.1.smithi069.stdout:1/656: dwrite d1/df/f42 [0,4194304] 0 2024-04-25T17:19:21.284 INFO:tasks.workunit.client.1.smithi069.stdout:5/690: link d13/d17/d19/la0 d13/d17/d19/d96/d9d/lef 0 2024-04-25T17:19:21.285 INFO:tasks.workunit.client.1.smithi069.stdout:1/657: chown d1/d4/d6/f31 2 1 2024-04-25T17:19:21.291 INFO:tasks.workunit.client.0.smithi037.stdout:9/912: unlink d1/l24 0 2024-04-25T17:19:21.292 INFO:tasks.workunit.client.1.smithi069.stdout:9/630: mknod d2/da/d5f/cd8 0 2024-04-25T17:19:21.293 INFO:tasks.workunit.client.0.smithi037.stdout:9/913: readlink d1/d5/d2e/d34/d76/db4/d119/l8e 0 2024-04-25T17:19:21.293 INFO:tasks.workunit.client.0.smithi037.stdout:0/744: rmdir d9/d72 39 2024-04-25T17:19:21.300 INFO:tasks.workunit.client.0.smithi037.stdout:5/739: creat d7/da1/dbb/fe1 x:0 0 0 2024-04-25T17:19:21.303 INFO:tasks.workunit.client.1.smithi069.stdout:9/631: dread d2/da/dd/d1e/f26 [0,4194304] 0 2024-04-25T17:19:21.304 INFO:tasks.workunit.client.0.smithi037.stdout:2/746: mkdir d0/d7c/dee 0 2024-04-25T17:19:21.305 INFO:tasks.workunit.client.0.smithi037.stdout:2/747: chown d0/d16/d20/d55/f6f 3038556 1 2024-04-25T17:19:21.307 INFO:tasks.workunit.client.0.smithi037.stdout:9/914: mknod d1/d5/dc/d3c/d116/c12a 0 2024-04-25T17:19:21.311 INFO:tasks.workunit.client.1.smithi069.stdout:2/633: symlink d0/d1/lca 0 2024-04-25T17:19:21.313 INFO:tasks.workunit.client.1.smithi069.stdout:8/669: symlink d37/le1 0 2024-04-25T17:19:21.316 INFO:tasks.workunit.client.1.smithi069.stdout:9/632: creat d2/da/dd/de/d74/dbc/fd9 x:0 0 0 2024-04-25T17:19:21.317 INFO:tasks.workunit.client.1.smithi069.stdout:9/633: stat d2/da/dd/d1e/d2e/d35 0 2024-04-25T17:19:21.317 INFO:tasks.workunit.client.1.smithi069.stdout:9/634: chown d2/f24 15588 1 2024-04-25T17:19:21.319 INFO:tasks.workunit.client.0.smithi037.stdout:5/740: rename d7/d25/d4f/da7/dab/fc3 to d7/d63/fe2 0 2024-04-25T17:19:21.320 INFO:tasks.workunit.client.0.smithi037.stdout:0/745: dwrite d9/df/d32/d56/f8d [0,4194304] 0 2024-04-25T17:19:21.323 INFO:tasks.workunit.client.0.smithi037.stdout:6/676: getdents db/d26/d2e/d7d/d65 0 2024-04-25T17:19:21.324 INFO:tasks.workunit.client.0.smithi037.stdout:9/915: symlink d1/d5/d2e/d34/d76/db4/l12b 0 2024-04-25T17:19:21.325 INFO:tasks.workunit.client.0.smithi037.stdout:7/637: link d5/d15/d17/d25/d2b/f52 d5/d15/d17/d1b/da2/fdd 0 2024-04-25T17:19:21.330 INFO:tasks.workunit.client.1.smithi069.stdout:8/670: symlink d37/d47/d54/le2 0 2024-04-25T17:19:21.334 INFO:tasks.workunit.client.1.smithi069.stdout:9/635: creat d2/da/dd/de/d74/d8a/fda x:0 0 0 2024-04-25T17:19:21.338 INFO:tasks.workunit.client.1.smithi069.stdout:3/703: write d8/d8b/ff1 [82793,30817] 0 2024-04-25T17:19:21.339 INFO:tasks.workunit.client.1.smithi069.stdout:9/636: dwrite d2/da4/dcf/d65/d88/f54 [0,4194304] 0 2024-04-25T17:19:21.340 INFO:tasks.workunit.client.0.smithi037.stdout:2/748: rename d0/l18 to d0/d16/d3b/lef 0 2024-04-25T17:19:21.346 INFO:tasks.workunit.client.1.smithi069.stdout:5/691: rmdir d13/d17/d19/d1c/dec 0 2024-04-25T17:19:21.347 INFO:tasks.workunit.client.0.smithi037.stdout:2/749: dwrite d0/d15/f36 [0,4194304] 0 2024-04-25T17:19:21.349 INFO:tasks.workunit.client.0.smithi037.stdout:6/677: creat db/d26/d2e/d3e/ff0 x:0 0 0 2024-04-25T17:19:21.350 INFO:tasks.workunit.client.0.smithi037.stdout:9/916: unlink d1/d5/d2e/d34/d76/f8c 0 2024-04-25T17:19:21.352 INFO:tasks.workunit.client.0.smithi037.stdout:7/638: mknod d5/d15/d17/d1b/da2/d76/cde 0 2024-04-25T17:19:21.354 INFO:tasks.workunit.client.1.smithi069.stdout:6/628: link d2/d9c/d48/f92 d2/d1e/d3f/fe0 0 2024-04-25T17:19:21.355 INFO:tasks.workunit.client.1.smithi069.stdout:6/629: read - d2/d51/d85/faa zero size 2024-04-25T17:19:21.357 INFO:tasks.workunit.client.1.smithi069.stdout:9/637: truncate d2/da4/dcf/d65/f73 1119607 0 2024-04-25T17:19:21.358 INFO:tasks.workunit.client.0.smithi037.stdout:9/917: dwrite d1/d5/fdb [0,4194304] 0 2024-04-25T17:19:21.358 INFO:tasks.workunit.client.1.smithi069.stdout:6/630: dread d2/d7/dbc/fd5 [0,4194304] 0 2024-04-25T17:19:21.363 INFO:tasks.workunit.client.0.smithi037.stdout:0/746: write d9/df/d32/d39/fcb [538838,58213] 0 2024-04-25T17:19:21.364 INFO:tasks.workunit.client.1.smithi069.stdout:2/634: creat d0/d56/fcb x:0 0 0 2024-04-25T17:19:21.366 INFO:tasks.workunit.client.1.smithi069.stdout:8/671: mknod d37/d47/d54/d6e/ce3 0 2024-04-25T17:19:21.367 INFO:tasks.workunit.client.0.smithi037.stdout:2/750: truncate d0/f9 3034294 0 2024-04-25T17:19:21.368 INFO:tasks.workunit.client.0.smithi037.stdout:6/678: readlink db/d26/d2e/l4f 0 2024-04-25T17:19:21.369 INFO:tasks.workunit.client.0.smithi037.stdout:2/751: read d0/d23/dac/f87 [998470,99973] 0 2024-04-25T17:19:21.370 INFO:tasks.workunit.client.0.smithi037.stdout:6/679: chown db/d26/d2e/d7d/d65/d68/dae 10034 1 2024-04-25T17:19:21.371 INFO:tasks.workunit.client.1.smithi069.stdout:9/638: symlink d2/da/dd/d1e/d40/ldb 0 2024-04-25T17:19:21.372 INFO:tasks.workunit.client.0.smithi037.stdout:3/552: link d8/d23/d38/d66/c99 d8/d23/d3a/d63/d86/d88/ca6 0 2024-04-25T17:19:21.376 INFO:tasks.workunit.client.1.smithi069.stdout:5/692: dread d13/d17/d19/f50 [0,4194304] 0 2024-04-25T17:19:21.376 INFO:tasks.workunit.client.0.smithi037.stdout:7/639: rename d5/d15/d17/d1b/l2e to d5/d15/d17/d25/d2b/dcb/ldf 0 2024-04-25T17:19:21.378 INFO:tasks.workunit.client.0.smithi037.stdout:9/918: symlink d1/d5/dc/d3c/d3e/l12c 0 2024-04-25T17:19:21.380 INFO:tasks.workunit.client.1.smithi069.stdout:0/563: sync 2024-04-25T17:19:21.382 INFO:tasks.workunit.client.1.smithi069.stdout:0/564: write d0/da/db/d1d/d5f/fa0 [4738881,35313] 0 2024-04-25T17:19:21.383 INFO:tasks.workunit.client.1.smithi069.stdout:0/565: fsync d0/da/d59/f61 0 2024-04-25T17:19:21.383 INFO:tasks.workunit.client.1.smithi069.stdout:8/672: symlink d37/d47/d54/d6e/d98/le4 0 2024-04-25T17:19:21.387 INFO:tasks.workunit.client.0.smithi037.stdout:6/680: creat db/d26/d2e/d82/ff1 x:0 0 0 2024-04-25T17:19:21.388 INFO:tasks.workunit.client.1.smithi069.stdout:6/631: mknod d2/d1e/d43/db6/daf/ddd/ce1 0 2024-04-25T17:19:21.389 INFO:tasks.workunit.client.0.smithi037.stdout:2/752: creat d0/d16/d20/d59/d6a/da5/ff0 x:0 0 0 2024-04-25T17:19:21.390 INFO:tasks.workunit.client.0.smithi037.stdout:2/753: chown d0/d16/d3c/f42 1 1 2024-04-25T17:19:21.391 INFO:tasks.workunit.client.1.smithi069.stdout:3/704: truncate d8/d71/d8d/d92/db6/dc1/fbf 205921 0 2024-04-25T17:19:21.394 INFO:tasks.workunit.client.1.smithi069.stdout:3/705: truncate d8/d16/d1a/d2c/d49/d87/d8a/fc9 866500 0 2024-04-25T17:19:21.394 INFO:tasks.workunit.client.1.smithi069.stdout:9/639: dread d2/da/dd/d1e/d2e/d35/f6c [0,4194304] 0 2024-04-25T17:19:21.402 INFO:tasks.workunit.client.1.smithi069.stdout:5/693: dread d13/d17/f4a [0,4194304] 0 2024-04-25T17:19:21.414 INFO:tasks.workunit.client.0.smithi037.stdout:9/919: creat d1/d48/d68/d26/da1/f12d x:0 0 0 2024-04-25T17:19:21.415 INFO:tasks.workunit.client.0.smithi037.stdout:5/741: getdents d7/d12/d5d/d90/db1 0 2024-04-25T17:19:21.418 INFO:tasks.workunit.client.1.smithi069.stdout:8/673: unlink d37/d47/d48/f7b 0 2024-04-25T17:19:21.419 INFO:tasks.workunit.client.1.smithi069.stdout:2/635: dwrite d0/d56/d5f/f71 [0,4194304] 0 2024-04-25T17:19:21.419 INFO:tasks.workunit.client.1.smithi069.stdout:8/674: chown d37/c46 0 1 2024-04-25T17:19:21.419 INFO:tasks.workunit.client.0.smithi037.stdout:2/754: symlink d0/d16/d20/d59/d6a/da5/lf1 0 2024-04-25T17:19:21.420 INFO:tasks.workunit.client.1.smithi069.stdout:8/675: write d37/d47/d48/f49 [2919809,25564] 0 2024-04-25T17:19:21.421 INFO:tasks.workunit.client.1.smithi069.stdout:3/706: creat d8/d16/d1a/d2c/d49/d59/ff4 x:0 0 0 2024-04-25T17:19:21.422 INFO:tasks.workunit.client.0.smithi037.stdout:0/747: dwrite d9/d14/d28/f62 [0,4194304] 0 2024-04-25T17:19:21.422 INFO:tasks.workunit.client.0.smithi037.stdout:3/553: truncate f5 3685959 0 2024-04-25T17:19:21.422 INFO:tasks.workunit.client.0.smithi037.stdout:2/755: chown d0/d16/d20/d59/d6a/da5/dbd/da9 2150340 1 2024-04-25T17:19:21.427 INFO:tasks.workunit.client.1.smithi069.stdout:9/640: rename d2/da/dd/d1e/d2e/d35/fc3 to d2/da/dd/d1e/d2e/d68/dba/dd1/fdc 0 2024-04-25T17:19:21.431 INFO:tasks.workunit.client.0.smithi037.stdout:3/554: dwrite d8/d23/f91 [0,4194304] 0 2024-04-25T17:19:21.433 INFO:tasks.workunit.client.0.smithi037.stdout:9/920: unlink d1/d5/dc/d38/l94 0 2024-04-25T17:19:21.434 INFO:tasks.workunit.client.0.smithi037.stdout:7/640: write d5/d15/d17/d1b/da2/d76/fb3 [1553221,96388] 0 2024-04-25T17:19:21.440 INFO:tasks.workunit.client.1.smithi069.stdout:0/566: write d0/da/db/d2c/f74 [1301142,86538] 0 2024-04-25T17:19:21.441 INFO:tasks.workunit.client.0.smithi037.stdout:0/748: fsync d9/df/f69 0 2024-04-25T17:19:21.442 INFO:tasks.workunit.client.1.smithi069.stdout:2/636: symlink d0/d26/d10/d43/lcc 0 2024-04-25T17:19:21.443 INFO:tasks.workunit.client.1.smithi069.stdout:2/637: write d0/d56/d5f/d62/d7d/d72/fa4 [493569,8297] 0 2024-04-25T17:19:21.446 INFO:tasks.workunit.client.1.smithi069.stdout:8/676: creat d37/d66/d6b/fe5 x:0 0 0 2024-04-25T17:19:21.451 INFO:tasks.workunit.client.0.smithi037.stdout:9/921: creat d1/d48/f12e x:0 0 0 2024-04-25T17:19:21.452 INFO:tasks.workunit.client.0.smithi037.stdout:7/641: symlink d5/d14/dcf/le0 0 2024-04-25T17:19:21.456 INFO:tasks.workunit.client.1.smithi069.stdout:0/567: creat d0/da/d24/fc9 x:0 0 0 2024-04-25T17:19:21.457 INFO:tasks.workunit.client.1.smithi069.stdout:0/568: write d0/da/d24/fc9 [750523,81351] 0 2024-04-25T17:19:21.458 INFO:tasks.workunit.client.1.smithi069.stdout:0/569: write d0/d38/f7a [2803202,37202] 0 2024-04-25T17:19:21.458 INFO:tasks.workunit.client.1.smithi069.stdout:8/677: mkdir d37/d66/d6b/daf/de6 0 2024-04-25T17:19:21.461 INFO:tasks.workunit.client.0.smithi037.stdout:5/742: truncate d7/d12/f86 959639 0 2024-04-25T17:19:21.461 INFO:tasks.workunit.client.1.smithi069.stdout:3/707: dwrite d8/d16/d1a/f4f [0,4194304] 0 2024-04-25T17:19:21.462 INFO:tasks.workunit.client.1.smithi069.stdout:4/655: sync 2024-04-25T17:19:21.462 INFO:tasks.workunit.client.1.smithi069.stdout:7/652: sync 2024-04-25T17:19:21.463 INFO:tasks.workunit.client.1.smithi069.stdout:9/641: creat d2/da/d5f/dd3/fdd x:0 0 0 2024-04-25T17:19:21.465 INFO:tasks.workunit.client.0.smithi037.stdout:2/756: dread d0/d16/d3c/f42 [0,4194304] 0 2024-04-25T17:19:21.467 INFO:tasks.workunit.client.0.smithi037.stdout:0/749: mknod d9/df/dbd/de9/cf1 0 2024-04-25T17:19:21.470 INFO:tasks.workunit.client.0.smithi037.stdout:5/743: dwrite d7/d43/f52 [0,4194304] 0 2024-04-25T17:19:21.472 INFO:tasks.workunit.client.1.smithi069.stdout:8/678: dread f12 [4194304,4194304] 0 2024-04-25T17:19:21.475 INFO:tasks.workunit.client.1.smithi069.stdout:7/653: chown d4/d83/lb3 0 1 2024-04-25T17:19:21.476 INFO:tasks.workunit.client.0.smithi037.stdout:7/642: mkdir d5/dc1/de1 0 2024-04-25T17:19:21.478 INFO:tasks.workunit.client.1.smithi069.stdout:4/656: creat db/d22/fe0 x:0 0 0 2024-04-25T17:19:21.479 INFO:tasks.workunit.client.1.smithi069.stdout:2/638: truncate d0/d26/d10/d43/f4b 311068 0 2024-04-25T17:19:21.480 INFO:tasks.workunit.client.1.smithi069.stdout:9/642: mknod d2/da/dd/d1e/cde 0 2024-04-25T17:19:21.481 INFO:tasks.workunit.client.0.smithi037.stdout:3/555: getdents d8/d23/d38 0 2024-04-25T17:19:21.482 INFO:tasks.workunit.client.1.smithi069.stdout:5/694: getdents d13/d17/d19/d96/d9d 0 2024-04-25T17:19:21.483 INFO:tasks.workunit.client.0.smithi037.stdout:0/750: mkdir d9/df/dbd/de9/df2 0 2024-04-25T17:19:21.486 INFO:tasks.workunit.client.1.smithi069.stdout:0/570: dwrite d0/da/d59/f85 [0,4194304] 0 2024-04-25T17:19:21.486 INFO:tasks.workunit.client.1.smithi069.stdout:7/654: symlink d4/d3e/d94/da1/dc7/d14/d44/d79/da4/ld7 0 2024-04-25T17:19:21.486 INFO:tasks.workunit.client.0.smithi037.stdout:7/643: dread - d5/d15/d17/d1b/da2/daf/fad zero size 2024-04-25T17:19:21.489 INFO:tasks.workunit.client.1.smithi069.stdout:2/639: rmdir d0/d56/d5f/d62/d7d/d72/daf/dc2/d8b 39 2024-04-25T17:19:21.491 INFO:tasks.workunit.client.1.smithi069.stdout:2/640: dread d0/d26/f23 [0,4194304] 0 2024-04-25T17:19:21.491 INFO:tasks.workunit.client.1.smithi069.stdout:9/643: mknod d2/da/dd/d1e/d40/cdf 0 2024-04-25T17:19:21.496 INFO:tasks.workunit.client.0.smithi037.stdout:0/751: mkdir d9/df/d32/d39/dd3/df3 0 2024-04-25T17:19:21.497 INFO:tasks.workunit.client.0.smithi037.stdout:9/922: getdents d1/d5/dc/d3c/dca/df5 0 2024-04-25T17:19:21.499 INFO:tasks.workunit.client.1.smithi069.stdout:0/571: mknod d0/da/db/d7e/d80/cca 0 2024-04-25T17:19:21.501 INFO:tasks.workunit.client.0.smithi037.stdout:3/556: write d8/d4c/f68 [956199,22801] 0 2024-04-25T17:19:21.504 INFO:tasks.workunit.client.1.smithi069.stdout:7/655: dread d4/d3e/d94/da1/dc7/d14/d5a/d5e/f7a [0,4194304] 0 2024-04-25T17:19:21.505 INFO:tasks.workunit.client.1.smithi069.stdout:0/572: dwrite d0/da/d24/f42 [0,4194304] 0 2024-04-25T17:19:21.506 INFO:tasks.workunit.client.1.smithi069.stdout:7/656: chown d4/d3e/d94/da1/dc7/d14/d5a/f6c 10 1 2024-04-25T17:19:21.506 INFO:tasks.workunit.client.0.smithi037.stdout:0/752: creat d9/d14/d28/ff4 x:0 0 0 2024-04-25T17:19:21.506 INFO:tasks.workunit.client.1.smithi069.stdout:7/657: chown d4/d3e/c50 19528 1 2024-04-25T17:19:21.507 INFO:tasks.workunit.client.0.smithi037.stdout:9/923: mkdir d1/d5/dc/d3c/dca/d12f 0 2024-04-25T17:19:21.509 INFO:tasks.workunit.client.0.smithi037.stdout:2/757: dread d0/d15/f1d [0,4194304] 0 2024-04-25T17:19:21.511 INFO:tasks.workunit.client.0.smithi037.stdout:3/557: creat d8/d23/d38/d66/fa7 x:0 0 0 2024-04-25T17:19:21.512 INFO:tasks.workunit.client.1.smithi069.stdout:4/657: creat db/d15/d42/d64/fe1 x:0 0 0 2024-04-25T17:19:21.512 INFO:tasks.workunit.client.0.smithi037.stdout:5/744: getdents d7/d25/d4f/da7/dab 0 2024-04-25T17:19:21.513 INFO:tasks.workunit.client.0.smithi037.stdout:0/753: fsync d9/d14/d23/f3c 0 2024-04-25T17:19:21.514 INFO:tasks.workunit.client.0.smithi037.stdout:0/754: chown d9/df/d32/d39 90 1 2024-04-25T17:19:21.514 INFO:tasks.workunit.client.1.smithi069.stdout:2/641: dwrite d0/d26/f93 [0,4194304] 0 2024-04-25T17:19:21.516 INFO:tasks.workunit.client.1.smithi069.stdout:0/573: chown d0/da/db/d1d/d5f/l99 0 1 2024-04-25T17:19:21.518 INFO:tasks.workunit.client.1.smithi069.stdout:3/708: link d8/d16/d1a/d2c/d49/c67 d8/d16/d1a/d2c/d49/cf5 0 2024-04-25T17:19:21.520 INFO:tasks.workunit.client.1.smithi069.stdout:4/658: creat db/d15/d20/d35/d63/d43/d48/d6c/fe2 x:0 0 0 2024-04-25T17:19:21.522 INFO:tasks.workunit.client.1.smithi069.stdout:4/659: read db/d4b/d78/f8b [96466,128703] 0 2024-04-25T17:19:21.522 INFO:tasks.workunit.client.1.smithi069.stdout:2/642: dwrite d0/d56/d5f/f71 [0,4194304] 0 2024-04-25T17:19:21.528 INFO:tasks.workunit.client.1.smithi069.stdout:1/658: sync 2024-04-25T17:19:21.528 INFO:tasks.workunit.client.1.smithi069.stdout:6/632: sync 2024-04-25T17:19:21.529 INFO:tasks.workunit.client.1.smithi069.stdout:0/574: unlink d0/d38/d75/cbf 0 2024-04-25T17:19:21.531 INFO:tasks.workunit.client.1.smithi069.stdout:7/658: truncate d4/d1a/f2f 1141774 0 2024-04-25T17:19:21.533 INFO:tasks.workunit.client.0.smithi037.stdout:0/755: creat d9/df/d32/dd1/d7a/da4/ff5 x:0 0 0 2024-04-25T17:19:21.533 INFO:tasks.workunit.client.0.smithi037.stdout:7/644: write d5/d15/d17/d9d/fac [1017950,39112] 0 2024-04-25T17:19:21.535 INFO:tasks.workunit.client.1.smithi069.stdout:7/659: dread d4/d3e/d94/da1/dc7/d14/d5a/f6c [0,4194304] 0 2024-04-25T17:19:21.535 INFO:tasks.workunit.client.1.smithi069.stdout:3/709: unlink d8/d71/d8d/d92/db6/dc1/c48 0 2024-04-25T17:19:21.539 INFO:tasks.workunit.client.1.smithi069.stdout:4/660: mkdir db/de3 0 2024-04-25T17:19:21.540 INFO:tasks.workunit.client.0.smithi037.stdout:9/924: write d1/d48/d68/d1c/fa7 [14556,57755] 0 2024-04-25T17:19:21.545 INFO:tasks.workunit.client.1.smithi069.stdout:6/633: write d2/d1e/d3f/d86/da8/fa9 [2235533,53736] 0 2024-04-25T17:19:21.546 INFO:tasks.workunit.client.1.smithi069.stdout:6/634: write d2/d7/fa [4711200,44703] 0 2024-04-25T17:19:21.549 INFO:tasks.workunit.client.0.smithi037.stdout:0/756: mknod d9/d71/dec/cf6 0 2024-04-25T17:19:21.549 INFO:tasks.workunit.client.0.smithi037.stdout:3/558: dwrite d8/f79 [0,4194304] 0 2024-04-25T17:19:21.552 INFO:tasks.workunit.client.0.smithi037.stdout:5/745: dwrite d7/d12/d6f/d68/faf [0,4194304] 0 2024-04-25T17:19:21.554 INFO:tasks.workunit.client.0.smithi037.stdout:2/758: write d0/d15/f32 [790721,117534] 0 2024-04-25T17:19:21.555 INFO:tasks.workunit.client.1.smithi069.stdout:3/710: fdatasync d8/d16/d1a/d2c/d6c/f8c 0 2024-04-25T17:19:21.557 INFO:tasks.workunit.client.1.smithi069.stdout:3/711: fdatasync d8/d16/d1a/d2c/d49/fc4 0 2024-04-25T17:19:21.558 INFO:tasks.workunit.client.0.smithi037.stdout:3/559: chown d8/d31/d32/l40 12 1 2024-04-25T17:19:21.560 INFO:tasks.workunit.client.0.smithi037.stdout:0/757: mkdir d9/df/df7 0 2024-04-25T17:19:21.561 INFO:tasks.workunit.client.1.smithi069.stdout:4/661: chown db/d15/d20/d35/d63/lb1 52 1 2024-04-25T17:19:21.563 INFO:tasks.workunit.client.1.smithi069.stdout:2/643: getdents d0/d26/d36/db9/dc8 0 2024-04-25T17:19:21.565 INFO:tasks.workunit.client.1.smithi069.stdout:4/662: stat db/d15/d20/d35/d63/f60 0 2024-04-25T17:19:21.565 INFO:tasks.workunit.client.1.smithi069.stdout:1/659: symlink d1/df/lca 0 2024-04-25T17:19:21.565 INFO:tasks.workunit.client.1.smithi069.stdout:4/663: stat db 0 2024-04-25T17:19:21.566 INFO:tasks.workunit.client.1.smithi069.stdout:0/575: dwrite d0/da/db/f15 [0,4194304] 0 2024-04-25T17:19:21.567 INFO:tasks.workunit.client.0.smithi037.stdout:3/560: creat d8/d23/d3a/d81/fa8 x:0 0 0 2024-04-25T17:19:21.568 INFO:tasks.workunit.client.0.smithi037.stdout:7/645: dread d5/d14/d31/f3f [0,4194304] 0 2024-04-25T17:19:21.569 INFO:tasks.workunit.client.0.smithi037.stdout:0/758: mknod d9/df/dbd/de9/cf8 0 2024-04-25T17:19:21.570 INFO:tasks.workunit.client.1.smithi069.stdout:0/576: truncate d0/da/db/d1d/f6f 5703010 0 2024-04-25T17:19:21.570 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:21 smithi069 ceph-mon[34527]: pgmap v41: 65 pgs: 65 active+clean; 2.7 GiB data, 9.6 GiB used, 527 GiB / 536 GiB avail; 73 MiB/s rd, 246 MiB/s wr, 422 op/s 2024-04-25T17:19:21.571 INFO:tasks.workunit.client.1.smithi069.stdout:0/577: write d0/da/db/d2a/faf [2034858,67789] 0 2024-04-25T17:19:21.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:21 smithi037 ceph-mon[26472]: pgmap v41: 65 pgs: 65 active+clean; 2.7 GiB data, 9.6 GiB used, 527 GiB / 536 GiB avail; 73 MiB/s rd, 246 MiB/s wr, 422 op/s 2024-04-25T17:19:21.572 INFO:tasks.workunit.client.1.smithi069.stdout:6/635: unlink d2/d7/f44 0 2024-04-25T17:19:21.574 INFO:tasks.workunit.client.1.smithi069.stdout:0/578: write d0/da/db/d7e/d80/f45 [532867,102670] 0 2024-04-25T17:19:21.574 INFO:tasks.workunit.client.0.smithi037.stdout:9/925: dread d1/d5/f12 [0,4194304] 0 2024-04-25T17:19:21.575 INFO:tasks.workunit.client.0.smithi037.stdout:3/561: fsync d8/f22 0 2024-04-25T17:19:21.575 INFO:tasks.workunit.client.1.smithi069.stdout:0/579: write d0/da/d24/d43/f57 [3662047,19570] 0 2024-04-25T17:19:21.575 INFO:tasks.workunit.client.1.smithi069.stdout:0/580: fdatasync d0/da/d24/fc9 0 2024-04-25T17:19:21.577 INFO:tasks.workunit.client.0.smithi037.stdout:7/646: symlink d5/d15/d17/d25/d2b/d59/le2 0 2024-04-25T17:19:21.577 INFO:tasks.workunit.client.0.smithi037.stdout:3/562: chown d8/d23/d3a/d5d/f2b 814898 1 2024-04-25T17:19:21.578 INFO:tasks.workunit.client.1.smithi069.stdout:3/712: truncate d8/d16/f21 3823009 0 2024-04-25T17:19:21.582 INFO:tasks.workunit.client.1.smithi069.stdout:1/660: mkdir d1/d4/d6/d4f/dcb 0 2024-04-25T17:19:21.585 INFO:tasks.workunit.client.1.smithi069.stdout:8/679: sync 2024-04-25T17:19:21.586 INFO:tasks.workunit.client.0.smithi037.stdout:3/563: creat d8/d23/d3a/d5d/fa9 x:0 0 0 2024-04-25T17:19:21.586 INFO:tasks.workunit.client.1.smithi069.stdout:6/636: dread - d2/d1e/d3f/f96 zero size 2024-04-25T17:19:21.589 INFO:tasks.workunit.client.0.smithi037.stdout:0/759: unlink d9/df/dbd/dc1/ce5 0 2024-04-25T17:19:21.589 INFO:tasks.workunit.client.0.smithi037.stdout:0/760: chown d9/d71/dec 237 1 2024-04-25T17:19:21.590 INFO:tasks.workunit.client.0.smithi037.stdout:3/564: mkdir d8/d23/d3a/daa 0 2024-04-25T17:19:21.591 INFO:tasks.workunit.client.0.smithi037.stdout:5/746: link d7/d43/c44 d7/d12/ce3 0 2024-04-25T17:19:21.591 INFO:tasks.workunit.client.0.smithi037.stdout:3/565: chown d8/d57/la4 0 1 2024-04-25T17:19:21.591 INFO:tasks.workunit.client.1.smithi069.stdout:8/680: dwrite d37/d66/f97 [0,4194304] 0 2024-04-25T17:19:21.592 INFO:tasks.workunit.client.0.smithi037.stdout:5/747: chown d7/d25/f4b 0 1 2024-04-25T17:19:21.592 INFO:tasks.workunit.client.1.smithi069.stdout:8/681: write f13 [5152466,124642] 0 2024-04-25T17:19:21.594 INFO:tasks.workunit.client.1.smithi069.stdout:3/713: creat d8/d16/d1a/d2c/d49/dbc/ff6 x:0 0 0 2024-04-25T17:19:21.594 INFO:tasks.workunit.client.1.smithi069.stdout:8/682: write d37/d47/d48/f49 [4916716,5144] 0 2024-04-25T17:19:21.596 INFO:tasks.workunit.client.1.smithi069.stdout:4/664: truncate db/d15/f1d 1714998 0 2024-04-25T17:19:21.597 INFO:tasks.workunit.client.0.smithi037.stdout:7/647: dread d5/fd [0,4194304] 0 2024-04-25T17:19:21.597 INFO:tasks.workunit.client.0.smithi037.stdout:9/926: getdents d1/d5/d19 0 2024-04-25T17:19:21.600 INFO:tasks.workunit.client.0.smithi037.stdout:2/759: write d0/d23/f28 [189168,129413] 0 2024-04-25T17:19:21.604 INFO:tasks.workunit.client.0.smithi037.stdout:7/648: chown d5/d15/d17/d25/d2b/d59/c7a 18501 1 2024-04-25T17:19:21.613 INFO:tasks.workunit.client.1.smithi069.stdout:6/637: rmdir d2/d1e/d3f/d86 39 2024-04-25T17:19:21.615 INFO:tasks.workunit.client.0.smithi037.stdout:0/761: creat d9/df/d32/ff9 x:0 0 0 2024-04-25T17:19:21.615 INFO:tasks.workunit.client.0.smithi037.stdout:0/762: dread - d9/df/d32/fed zero size 2024-04-25T17:19:21.616 INFO:tasks.workunit.client.1.smithi069.stdout:7/660: write d4/d3e/d94/da1/dc7/f92 [233378,74803] 0 2024-04-25T17:19:21.617 INFO:tasks.workunit.client.1.smithi069.stdout:7/661: readlink d4/d3e/d94/da1/dc7/la5 0 2024-04-25T17:19:21.617 INFO:tasks.workunit.client.0.smithi037.stdout:5/748: creat d7/d63/db2/fe4 x:0 0 0 2024-04-25T17:19:21.622 INFO:tasks.workunit.client.0.smithi037.stdout:0/763: mknod d9/df/d32/dd1/d7a/cfa 0 2024-04-25T17:19:21.623 INFO:tasks.workunit.client.0.smithi037.stdout:0/764: dread - d9/df/d32/dd1/d7a/da4/ddb/feb zero size 2024-04-25T17:19:21.625 INFO:tasks.workunit.client.0.smithi037.stdout:5/749: dread d7/d12/d6f/f97 [0,4194304] 0 2024-04-25T17:19:21.626 INFO:tasks.workunit.client.0.smithi037.stdout:2/760: truncate d0/d16/f1b 2928445 0 2024-04-25T17:19:21.627 INFO:tasks.workunit.client.1.smithi069.stdout:1/661: symlink d1/d4/d6/d9e/da6/lcc 0 2024-04-25T17:19:21.628 INFO:tasks.workunit.client.1.smithi069.stdout:6/638: truncate d2/d1e/f32 4222601 0 2024-04-25T17:19:21.630 INFO:tasks.workunit.client.1.smithi069.stdout:2/644: truncate d0/d56/f5e 818056 0 2024-04-25T17:19:21.631 INFO:tasks.workunit.client.1.smithi069.stdout:7/662: creat d4/d83/da2/fd8 x:0 0 0 2024-04-25T17:19:21.632 INFO:tasks.workunit.client.0.smithi037.stdout:3/566: dwrite d8/f2c [0,4194304] 0 2024-04-25T17:19:21.632 INFO:tasks.workunit.client.1.smithi069.stdout:7/663: chown d4/d3e/d94/da1/dc7/d14/d5a/d5e/f7a 13011 1 2024-04-25T17:19:21.638 INFO:tasks.workunit.client.1.smithi069.stdout:3/714: creat d8/d16/d4b/d9e/dca/de7/ff7 x:0 0 0 2024-04-25T17:19:21.639 INFO:tasks.workunit.client.0.smithi037.stdout:7/649: write d5/d15/d17/d1b/fcd [585661,53857] 0 2024-04-25T17:19:21.641 INFO:tasks.workunit.client.1.smithi069.stdout:1/662: symlink d1/d43/d5f/lcd 0 2024-04-25T17:19:21.642 INFO:tasks.workunit.client.1.smithi069.stdout:1/663: fsync d1/d4/d6/d4f/d9b/fac 0 2024-04-25T17:19:21.646 INFO:tasks.workunit.client.1.smithi069.stdout:2/645: creat d0/d26/fcd x:0 0 0 2024-04-25T17:19:21.648 INFO:tasks.workunit.client.1.smithi069.stdout:0/581: getdents d0/da/db/d1d 0 2024-04-25T17:19:21.650 INFO:tasks.workunit.client.0.smithi037.stdout:7/650: creat d5/d15/d17/d1b/da2/daf/fe3 x:0 0 0 2024-04-25T17:19:21.650 INFO:tasks.workunit.client.1.smithi069.stdout:7/664: readlink d4/d3e/d94/da1/dc7/d14/d44/lb5 0 2024-04-25T17:19:21.652 INFO:tasks.workunit.client.0.smithi037.stdout:0/765: dread d9/f19 [4194304,4194304] 0 2024-04-25T17:19:21.653 INFO:tasks.workunit.client.1.smithi069.stdout:7/665: dread d4/d3e/fce [0,4194304] 0 2024-04-25T17:19:21.656 INFO:tasks.workunit.client.0.smithi037.stdout:2/761: write d0/d16/d20/d59/d6a/f82 [855190,56869] 0 2024-04-25T17:19:21.657 INFO:tasks.workunit.client.0.smithi037.stdout:3/567: link d8/d23/d3a/f43 d8/d23/d3a/d81/fab 0 2024-04-25T17:19:21.661 INFO:tasks.workunit.client.1.smithi069.stdout:6/639: link d2/d1e/d43/fc9 d2/d1e/d3e/fe2 0 2024-04-25T17:19:21.662 INFO:tasks.workunit.client.1.smithi069.stdout:6/640: chown d2/d1e/d43/da6 0 1 2024-04-25T17:19:21.662 INFO:tasks.workunit.client.0.smithi037.stdout:5/750: dwrite d7/da1/fa5 [4194304,4194304] 0 2024-04-25T17:19:21.663 INFO:tasks.workunit.client.1.smithi069.stdout:6/641: write d2/d1e/d3f/f49 [270783,17581] 0 2024-04-25T17:19:21.664 INFO:tasks.workunit.client.1.smithi069.stdout:1/664: creat d1/d4/d6/d4f/d9b/da3/fce x:0 0 0 2024-04-25T17:19:21.664 INFO:tasks.workunit.client.1.smithi069.stdout:6/642: read d2/f1c [11639,96293] 0 2024-04-25T17:19:21.665 INFO:tasks.workunit.client.1.smithi069.stdout:6/643: fsync d2/d1e/d43/f9e 0 2024-04-25T17:19:21.668 INFO:tasks.workunit.client.0.smithi037.stdout:0/766: mkdir d9/d14/d28/d48/da9/ddc/dfb 0 2024-04-25T17:19:21.668 INFO:tasks.workunit.client.0.smithi037.stdout:3/568: read d8/f1f [174341,109247] 0 2024-04-25T17:19:21.670 INFO:tasks.workunit.client.0.smithi037.stdout:2/762: dread d0/d16/d20/d59/d6a/f99 [0,4194304] 0 2024-04-25T17:19:21.671 INFO:tasks.workunit.client.0.smithi037.stdout:7/651: write d5/d15/d17/d1b/da2/daf/f8b [1270518,78706] 0 2024-04-25T17:19:21.671 INFO:tasks.workunit.client.0.smithi037.stdout:3/569: write d8/d31/d32/f39 [4051221,46123] 0 2024-04-25T17:19:21.672 INFO:tasks.workunit.client.0.smithi037.stdout:2/763: chown d0/d16/d20/d59/d6a/da5/dbd/dd6 22971 1 2024-04-25T17:19:21.673 INFO:tasks.workunit.client.0.smithi037.stdout:5/751: symlink d7/da1/dda/le5 0 2024-04-25T17:19:21.678 INFO:tasks.workunit.client.1.smithi069.stdout:8/683: link l30 d37/d47/d54/d6e/dce/le7 0 2024-04-25T17:19:21.680 INFO:tasks.workunit.client.0.smithi037.stdout:0/767: truncate d9/df/f86 2659281 0 2024-04-25T17:19:21.681 INFO:tasks.workunit.client.0.smithi037.stdout:3/570: creat d8/d23/d3a/d81/fac x:0 0 0 2024-04-25T17:19:21.683 INFO:tasks.workunit.client.1.smithi069.stdout:1/665: unlink d1/d4/l71 0 2024-04-25T17:19:21.683 INFO:tasks.workunit.client.1.smithi069.stdout:2/646: dwrite d0/d26/d10/d43/f80 [0,4194304] 0 2024-04-25T17:19:21.684 INFO:tasks.workunit.client.0.smithi037.stdout:0/768: mkdir d9/d14/d23/dfc 0 2024-04-25T17:19:21.685 INFO:tasks.workunit.client.1.smithi069.stdout:1/666: truncate d1/d4/de/d44/d68/f75 725500 0 2024-04-25T17:19:21.686 INFO:tasks.workunit.client.1.smithi069.stdout:6/644: rename d2/d1e/d43/fc5 to d2/d51/fe3 0 2024-04-25T17:19:21.687 INFO:tasks.workunit.client.1.smithi069.stdout:2/647: read d0/d56/d5f/d62/d7d/d72/daf/dc2/f85 [275291,33934] 0 2024-04-25T17:19:21.688 INFO:tasks.workunit.client.1.smithi069.stdout:2/648: fdatasync d0/d56/d94/fc0 0 2024-04-25T17:19:21.688 INFO:tasks.workunit.client.1.smithi069.stdout:3/715: truncate d8/d16/d1a/f5d 250768 0 2024-04-25T17:19:21.689 INFO:tasks.workunit.client.0.smithi037.stdout:3/571: creat d8/d23/d3a/d5d/fad x:0 0 0 2024-04-25T17:19:21.690 INFO:tasks.workunit.client.0.smithi037.stdout:3/572: dread - d8/d23/d3a/d5d/fa9 zero size 2024-04-25T17:19:21.691 INFO:tasks.workunit.client.0.smithi037.stdout:5/752: creat d7/d12/fe6 x:0 0 0 2024-04-25T17:19:21.692 INFO:tasks.workunit.client.0.smithi037.stdout:3/573: read - d8/d23/d38/d66/fa7 zero size 2024-04-25T17:19:21.693 INFO:tasks.workunit.client.0.smithi037.stdout:5/753: fsync d7/d12/d6f/d68/faf 0 2024-04-25T17:19:21.695 INFO:tasks.workunit.client.1.smithi069.stdout:7/666: unlink d4/c16 0 2024-04-25T17:19:21.696 INFO:tasks.workunit.client.1.smithi069.stdout:8/684: write d37/d47/d48/fc0 [789452,112310] 0 2024-04-25T17:19:21.697 INFO:tasks.workunit.client.1.smithi069.stdout:5/695: sync 2024-04-25T17:19:21.697 INFO:tasks.workunit.client.1.smithi069.stdout:9/644: sync 2024-04-25T17:19:21.697 INFO:tasks.workunit.client.0.smithi037.stdout:0/769: dread d9/df/f98 [0,4194304] 0 2024-04-25T17:19:21.698 INFO:tasks.workunit.client.1.smithi069.stdout:8/685: chown d37/d47/d78/db3/fe0 1076970 1 2024-04-25T17:19:21.699 INFO:tasks.workunit.client.0.smithi037.stdout:3/574: symlink d8/d31/d32/d3e/d7d/lae 0 2024-04-25T17:19:21.700 INFO:tasks.workunit.client.0.smithi037.stdout:2/764: dread d0/d7c/fba [0,4194304] 0 2024-04-25T17:19:21.703 INFO:tasks.workunit.client.0.smithi037.stdout:5/754: dread d7/d12/f86 [0,4194304] 0 2024-04-25T17:19:21.704 INFO:tasks.workunit.client.0.smithi037.stdout:5/755: read f0 [3288294,1382] 0 2024-04-25T17:19:21.704 INFO:tasks.workunit.client.1.smithi069.stdout:8/686: dwrite d37/d47/fb1 [0,4194304] 0 2024-04-25T17:19:21.704 INFO:tasks.workunit.client.0.smithi037.stdout:5/756: stat d7/d43/f16 0 2024-04-25T17:19:21.712 INFO:tasks.workunit.client.1.smithi069.stdout:2/649: symlink d0/d26/lce 0 2024-04-25T17:19:21.712 INFO:tasks.workunit.client.0.smithi037.stdout:5/757: dwrite d7/d12/da8/fd0 [0,4194304] 0 2024-04-25T17:19:21.712 INFO:tasks.workunit.client.1.smithi069.stdout:2/650: chown d0/d56/d5f/d62/d7d/d72/fb6 3929698 1 2024-04-25T17:19:21.714 INFO:tasks.workunit.client.0.smithi037.stdout:2/765: creat d0/d16/d20/d55/ff2 x:0 0 0 2024-04-25T17:19:21.717 INFO:tasks.workunit.client.1.smithi069.stdout:6/645: rename d2/d1e/d3e/d67 to d2/d1e/d43/db6/de4 0 2024-04-25T17:19:21.722 INFO:tasks.workunit.client.0.smithi037.stdout:0/770: mkdir d9/df/df7/dfd 0 2024-04-25T17:19:21.724 INFO:tasks.workunit.client.1.smithi069.stdout:5/696: fdatasync d13/d17/d19/f25 0 2024-04-25T17:19:21.725 INFO:tasks.workunit.client.0.smithi037.stdout:5/758: creat d7/da1/dbb/fe7 x:0 0 0 2024-04-25T17:19:21.725 INFO:tasks.workunit.client.1.smithi069.stdout:1/667: write d1/f2e [5069652,94238] 0 2024-04-25T17:19:21.726 INFO:tasks.workunit.client.0.smithi037.stdout:3/575: write d8/d31/f47 [384493,40761] 0 2024-04-25T17:19:21.728 INFO:tasks.workunit.client.0.smithi037.stdout:2/766: chown d0/d16/d3b/lef 3030 1 2024-04-25T17:19:21.728 INFO:tasks.workunit.client.0.smithi037.stdout:3/576: chown d8/d23/d3a/d63/l90 222451647 1 2024-04-25T17:19:21.729 INFO:tasks.workunit.client.0.smithi037.stdout:3/577: truncate d8/d31/d32/d87/f89 69690 0 2024-04-25T17:19:21.731 INFO:tasks.workunit.client.0.smithi037.stdout:0/771: fsync d9/d14/f44 0 2024-04-25T17:19:21.734 INFO:tasks.workunit.client.1.smithi069.stdout:2/651: unlink d0/d56/d5f/d62/d7d/d72/daf/dc2/f75 0 2024-04-25T17:19:21.735 INFO:tasks.workunit.client.0.smithi037.stdout:0/772: dread d9/df/d32/d56/f8d [0,4194304] 0 2024-04-25T17:19:21.736 INFO:tasks.workunit.client.1.smithi069.stdout:2/652: dread - d0/d26/d10/d43/fa1 zero size 2024-04-25T17:19:21.736 INFO:tasks.workunit.client.1.smithi069.stdout:2/653: chown d0/d26/d10/d43/f7a 270 1 2024-04-25T17:19:21.737 INFO:tasks.workunit.client.0.smithi037.stdout:3/578: dread d8/d23/d3a/f4f [0,4194304] 0 2024-04-25T17:19:21.737 INFO:tasks.workunit.client.0.smithi037.stdout:2/767: unlink d0/d16/d3b/f5b 0 2024-04-25T17:19:21.737 INFO:tasks.workunit.client.0.smithi037.stdout:2/768: stat d0/d16/d20/d59/c93 0 2024-04-25T17:19:21.740 INFO:tasks.workunit.client.1.smithi069.stdout:4/665: sync 2024-04-25T17:19:21.741 INFO:tasks.workunit.client.1.smithi069.stdout:0/582: getdents d0/da/db/d7e 0 2024-04-25T17:19:21.744 INFO:tasks.workunit.client.0.smithi037.stdout:2/769: symlink d0/d23/d7d/lf3 0 2024-04-25T17:19:21.745 INFO:tasks.workunit.client.1.smithi069.stdout:8/687: dread f34 [0,4194304] 0 2024-04-25T17:19:21.746 INFO:tasks.workunit.client.0.smithi037.stdout:5/759: dread d7/d18/f22 [0,4194304] 0 2024-04-25T17:19:21.747 INFO:tasks.workunit.client.0.smithi037.stdout:0/773: fsync d9/df/d32/fd7 0 2024-04-25T17:19:21.749 INFO:tasks.workunit.client.0.smithi037.stdout:0/774: dread - d9/df/d32/dd1/d7a/da4/ff5 zero size 2024-04-25T17:19:21.749 INFO:tasks.workunit.client.1.smithi069.stdout:8/688: dread d37/d47/d54/f91 [0,4194304] 0 2024-04-25T17:19:21.750 INFO:tasks.workunit.client.0.smithi037.stdout:3/579: write d8/d31/f52 [300437,112211] 0 2024-04-25T17:19:21.753 INFO:tasks.workunit.client.1.smithi069.stdout:6/646: dwrite d2/d1e/d3e/fe2 [0,4194304] 0 2024-04-25T17:19:21.754 INFO:tasks.workunit.client.1.smithi069.stdout:2/654: rmdir d0 39 2024-04-25T17:19:21.755 INFO:tasks.workunit.client.0.smithi037.stdout:0/775: creat d9/d14/d28/d48/da9/ffe x:0 0 0 2024-04-25T17:19:21.757 INFO:tasks.workunit.client.0.smithi037.stdout:2/770: mkdir d0/d23/dac/d4b/ded/df4 0 2024-04-25T17:19:21.758 INFO:tasks.workunit.client.1.smithi069.stdout:0/583: write d0/da/db/d3a/f6c [967746,49905] 0 2024-04-25T17:19:21.758 INFO:tasks.workunit.client.0.smithi037.stdout:3/580: symlink d8/d23/d38/d66/laf 0 2024-04-25T17:19:21.759 INFO:tasks.workunit.client.1.smithi069.stdout:7/667: link d4/d1a/d34/l45 d4/d3e/d94/da1/dc7/d14/d44/d79/ld9 0 2024-04-25T17:19:21.759 INFO:tasks.workunit.client.1.smithi069.stdout:7/668: chown d4/d83 438 1 2024-04-25T17:19:21.760 INFO:tasks.workunit.client.0.smithi037.stdout:5/760: fdatasync d7/f3c 0 2024-04-25T17:19:21.760 INFO:tasks.workunit.client.1.smithi069.stdout:7/669: readlink d4/d3e/d94/da1/dc7/lae 0 2024-04-25T17:19:21.761 INFO:tasks.workunit.client.1.smithi069.stdout:7/670: chown d4/d3e/d94/da1/dc7/d14/d44/d79 17516 1 2024-04-25T17:19:21.763 INFO:tasks.workunit.client.0.smithi037.stdout:0/776: rmdir d9/d14/d28/d48 39 2024-04-25T17:19:21.763 INFO:tasks.workunit.client.0.smithi037.stdout:5/761: dread d7/d43/f16 [0,4194304] 0 2024-04-25T17:19:21.764 INFO:tasks.workunit.client.0.smithi037.stdout:2/771: readlink d0/d16/le6 0 2024-04-25T17:19:21.765 INFO:tasks.workunit.client.0.smithi037.stdout:0/777: truncate d9/df/d32/ff9 204513 0 2024-04-25T17:19:21.765 INFO:tasks.workunit.client.0.smithi037.stdout:2/772: chown d0/d23/dac/d4b/fb5 12 1 2024-04-25T17:19:21.766 INFO:tasks.workunit.client.0.smithi037.stdout:3/581: creat d8/d23/d3a/d63/d86/fb0 x:0 0 0 2024-04-25T17:19:21.766 INFO:tasks.workunit.client.0.smithi037.stdout:2/773: chown d0/d23/dac/l46 0 1 2024-04-25T17:19:21.767 INFO:tasks.workunit.client.1.smithi069.stdout:8/689: mknod d37/d66/d6b/ce8 0 2024-04-25T17:19:21.767 INFO:tasks.workunit.client.0.smithi037.stdout:3/582: chown d8/d31/d32/d3e/l64 0 1 2024-04-25T17:19:21.772 INFO:tasks.workunit.client.1.smithi069.stdout:3/716: getdents d8/d16/d4b/d9e/dca/de7 0 2024-04-25T17:19:21.774 INFO:tasks.workunit.client.0.smithi037.stdout:0/778: mkdir d9/d14/dff 0 2024-04-25T17:19:21.774 INFO:tasks.workunit.client.0.smithi037.stdout:3/583: dwrite d8/d23/d3a/f4f [0,4194304] 0 2024-04-25T17:19:21.774 INFO:tasks.workunit.client.1.smithi069.stdout:3/717: write d8/d71/d8d/d92/db6/dc1/d42/f7e [16773,81032] 0 2024-04-25T17:19:21.775 INFO:tasks.workunit.client.0.smithi037.stdout:3/584: chown d8/d31/d32/f36 12 1 2024-04-25T17:19:21.776 INFO:tasks.workunit.client.1.smithi069.stdout:3/718: dread - d8/d16/d1a/d2c/d49/fc4 zero size 2024-04-25T17:19:21.776 INFO:tasks.workunit.client.0.smithi037.stdout:2/774: creat d0/d16/d20/d59/d6a/da5/dbd/da9/ff5 x:0 0 0 2024-04-25T17:19:21.777 INFO:tasks.workunit.client.1.smithi069.stdout:9/645: getdents d2/da/dd/de/db0 0 2024-04-25T17:19:21.777 INFO:tasks.workunit.client.0.smithi037.stdout:3/585: fsync d8/d23/d3a/d81/fa8 0 2024-04-25T17:19:21.778 INFO:tasks.workunit.client.0.smithi037.stdout:3/586: stat d8/d31/d32 0 2024-04-25T17:19:21.778 INFO:tasks.workunit.client.1.smithi069.stdout:5/697: dwrite d13/d17/d19/d20/f9a [0,4194304] 0 2024-04-25T17:19:21.779 INFO:tasks.workunit.client.1.smithi069.stdout:7/671: mkdir d4/d3e/d94/da1/dc7/d14/d15/dda 0 2024-04-25T17:19:21.781 INFO:tasks.workunit.client.1.smithi069.stdout:1/668: creat d1/d43/d1b/d32/fcf x:0 0 0 2024-04-25T17:19:21.782 INFO:tasks.workunit.client.0.smithi037.stdout:3/587: dread d8/d31/d32/f36 [0,4194304] 0 2024-04-25T17:19:21.783 INFO:tasks.workunit.client.1.smithi069.stdout:1/669: write d1/d4/de/d44/f69 [1688581,63189] 0 2024-04-25T17:19:21.788 INFO:tasks.workunit.client.0.smithi037.stdout:2/775: creat d0/d16/d20/d59/d6a/dbe/ff6 x:0 0 0 2024-04-25T17:19:21.789 INFO:tasks.workunit.client.0.smithi037.stdout:0/779: creat d9/df/d32/d39/f100 x:0 0 0 2024-04-25T17:19:21.794 INFO:tasks.workunit.client.1.smithi069.stdout:0/584: symlink d0/lcb 0 2024-04-25T17:19:21.794 INFO:tasks.workunit.client.1.smithi069.stdout:0/585: readlink d0/da/db/d56/l66 0 2024-04-25T17:19:21.796 INFO:tasks.workunit.client.1.smithi069.stdout:3/719: rmdir d8/d8b/db2 39 2024-04-25T17:19:21.798 INFO:tasks.workunit.client.1.smithi069.stdout:7/672: symlink d4/d3e/d94/da1/dc7/d14/d44/da8/ldb 0 2024-04-25T17:19:21.798 INFO:tasks.workunit.client.1.smithi069.stdout:8/690: dwrite d37/d47/d54/f5e [0,4194304] 0 2024-04-25T17:19:21.799 INFO:tasks.workunit.client.1.smithi069.stdout:5/698: rename d13/d17/d29/d2e/led to d13/d17/d19/d8a/dce/lf0 0 2024-04-25T17:19:21.800 INFO:tasks.workunit.client.1.smithi069.stdout:8/691: stat d37/d47/d48 0 2024-04-25T17:19:21.803 INFO:tasks.workunit.client.1.smithi069.stdout:9/646: truncate d2/da/dd/d1e/d2e/d68/d8f/fad 772219 0 2024-04-25T17:19:21.804 INFO:tasks.workunit.client.1.smithi069.stdout:9/647: fdatasync d2/da/dd/d1e/d2e/f34 0 2024-04-25T17:19:21.804 INFO:tasks.workunit.client.1.smithi069.stdout:5/699: dread d13/d17/d19/d1c/da4/fd0 [0,4194304] 0 2024-04-25T17:19:21.808 INFO:tasks.workunit.client.1.smithi069.stdout:6/647: mkdir d2/d1e/d3f/d56/de5 0 2024-04-25T17:19:21.808 INFO:tasks.workunit.client.1.smithi069.stdout:0/586: rmdir d0/da/db/d3a 39 2024-04-25T17:19:21.809 INFO:tasks.workunit.client.1.smithi069.stdout:2/655: dread d0/d1/f20 [0,4194304] 0 2024-04-25T17:19:21.810 INFO:tasks.workunit.client.1.smithi069.stdout:2/656: readlink d0/l9a 0 2024-04-25T17:19:21.811 INFO:tasks.workunit.client.1.smithi069.stdout:7/673: symlink d4/d4c/ldc 0 2024-04-25T17:19:21.812 INFO:tasks.workunit.client.1.smithi069.stdout:0/587: dread d0/da/db/d73/fb5 [0,4194304] 0 2024-04-25T17:19:21.812 INFO:tasks.workunit.client.1.smithi069.stdout:7/674: stat d4/d3e/d94/da1/dc7/d14/d5a/d5e/f7a 0 2024-04-25T17:19:21.814 INFO:tasks.workunit.client.1.smithi069.stdout:3/720: rename d8/l25 to d8/d16/d4b/d9e/lf8 0 2024-04-25T17:19:21.815 INFO:tasks.workunit.client.1.smithi069.stdout:3/721: write d8/f18 [2784442,20199] 0 2024-04-25T17:19:21.816 INFO:tasks.workunit.client.1.smithi069.stdout:3/722: chown d8/d71/d8d/d92/db6/dc1/c4a 4 1 2024-04-25T17:19:21.816 INFO:tasks.workunit.client.1.smithi069.stdout:3/723: chown d8/d39/cae 165602534 1 2024-04-25T17:19:21.817 INFO:tasks.workunit.client.1.smithi069.stdout:8/692: mkdir d37/d47/d54/de9 0 2024-04-25T17:19:21.818 INFO:tasks.workunit.client.1.smithi069.stdout:8/693: fsync d37/d47/d54/f7a 0 2024-04-25T17:19:21.823 INFO:tasks.workunit.client.0.smithi037.stdout:1/850: sync 2024-04-25T17:19:21.823 INFO:tasks.workunit.client.0.smithi037.stdout:4/933: sync 2024-04-25T17:19:21.826 INFO:tasks.workunit.client.1.smithi069.stdout:1/670: symlink d1/d4/d6/ld0 0 2024-04-25T17:19:21.830 INFO:tasks.workunit.client.1.smithi069.stdout:5/700: mkdir d13/d17/d19/d1c/d6c/df1 0 2024-04-25T17:19:21.834 INFO:tasks.workunit.client.1.smithi069.stdout:2/657: creat d0/d56/d5f/d62/d7d/d72/fcf x:0 0 0 2024-04-25T17:19:21.835 INFO:tasks.workunit.client.1.smithi069.stdout:5/701: dwrite d13/d17/d29/d2e/f83 [0,4194304] 0 2024-04-25T17:19:21.837 INFO:tasks.workunit.client.1.smithi069.stdout:9/648: rmdir d2/da/dd/de 39 2024-04-25T17:19:21.847 INFO:tasks.workunit.client.1.smithi069.stdout:8/694: fsync d37/d66/d6b/fc2 0 2024-04-25T17:19:21.860 INFO:tasks.workunit.client.1.smithi069.stdout:2/658: unlink d0/f57 0 2024-04-25T17:19:21.861 INFO:tasks.workunit.client.0.smithi037.stdout:1/851: rmdir dc/d52/d6b/dd9/d22/d36/d92 39 2024-04-25T17:19:21.863 INFO:tasks.workunit.client.1.smithi069.stdout:5/702: symlink d13/d17/d62/lf2 0 2024-04-25T17:19:21.865 INFO:tasks.workunit.client.1.smithi069.stdout:1/671: dread d1/df/d17/f2f [0,4194304] 0 2024-04-25T17:19:21.866 INFO:tasks.workunit.client.1.smithi069.stdout:1/672: stat d1/d4/d6/fa9 0 2024-04-25T17:19:21.866 INFO:tasks.workunit.client.1.smithi069.stdout:8/695: rename d37/c46 to d37/d47/d78/db3/cea 0 2024-04-25T17:19:21.867 INFO:tasks.workunit.client.1.smithi069.stdout:8/696: dread - d37/d47/d54/fbd zero size 2024-04-25T17:19:21.869 INFO:tasks.workunit.client.1.smithi069.stdout:6/648: creat d2/d7/fe6 x:0 0 0 2024-04-25T17:19:21.872 INFO:tasks.workunit.client.1.smithi069.stdout:3/724: dwrite d8/d16/d1a/d2c/d49/f68 [0,4194304] 0 2024-04-25T17:19:21.873 INFO:tasks.workunit.client.0.smithi037.stdout:3/588: write d8/d23/d3a/f50 [1332455,124571] 0 2024-04-25T17:19:21.874 INFO:tasks.workunit.client.1.smithi069.stdout:3/725: chown d8/d16/d1a/d2c/d49/d87/d8a/d8e 4905587 1 2024-04-25T17:19:21.874 INFO:tasks.workunit.client.1.smithi069.stdout:3/726: stat d8/d16/d4b/d9e/cc5 0 2024-04-25T17:19:21.875 INFO:tasks.workunit.client.1.smithi069.stdout:3/727: chown d8/d16/d1a/d38/f4c 17 1 2024-04-25T17:19:21.875 INFO:tasks.workunit.client.0.smithi037.stdout:2/776: write d0/d15/d2a/f94 [691649,125832] 0 2024-04-25T17:19:21.877 INFO:tasks.workunit.client.0.smithi037.stdout:2/777: write d0/d16/d26/fde [76777,15636] 0 2024-04-25T17:19:21.878 INFO:tasks.workunit.client.1.smithi069.stdout:0/588: truncate d0/d38/d75/f7b 1143584 0 2024-04-25T17:19:21.879 INFO:tasks.workunit.client.0.smithi037.stdout:0/780: write d9/d14/d23/f3c [3181460,37386] 0 2024-04-25T17:19:21.883 INFO:tasks.workunit.client.1.smithi069.stdout:9/649: write d2/f2c [1953411,109056] 0 2024-04-25T17:19:21.908 INFO:tasks.workunit.client.0.smithi037.stdout:0/781: stat d9/df/d32/f55 0 2024-04-25T17:19:21.909 INFO:tasks.workunit.client.0.smithi037.stdout:4/934: truncate d7/d7e/d5b/dfe/f36 5381551 0 2024-04-25T17:19:21.910 INFO:tasks.workunit.client.1.smithi069.stdout:5/703: creat d13/d17/d19/d20/d51/ff3 x:0 0 0 2024-04-25T17:19:21.910 INFO:tasks.workunit.client.1.smithi069.stdout:5/704: chown d13/d17/d19/d1c/fe7 22297 1 2024-04-25T17:19:21.911 INFO:tasks.workunit.client.1.smithi069.stdout:5/705: write d13/d17/d29/fb4 [415974,112828] 0 2024-04-25T17:19:21.912 INFO:tasks.workunit.client.1.smithi069.stdout:5/706: write d13/d17/d19/d96/fe3 [195246,130266] 0 2024-04-25T17:19:21.913 INFO:tasks.workunit.client.1.smithi069.stdout:1/673: chown d1/d4/d6/d9e/da6/d7c/d4d/d8f/c96 3014061 1 2024-04-25T17:19:21.914 INFO:tasks.workunit.client.1.smithi069.stdout:5/707: write d13/d17/d19/d20/d51/db5/fdd [225896,16085] 0 2024-04-25T17:19:21.915 INFO:tasks.workunit.client.1.smithi069.stdout:6/649: stat d2/d1e/d3f/ca2 0 2024-04-25T17:19:21.916 INFO:tasks.workunit.client.0.smithi037.stdout:1/852: dwrite dc/d52/d6b/dd9/d22/d36/d8c/f10e [0,4194304] 0 2024-04-25T17:19:21.916 INFO:tasks.workunit.client.1.smithi069.stdout:6/650: stat d2/d1e/d43/dca/dce/fd9 0 2024-04-25T17:19:21.916 INFO:tasks.workunit.client.0.smithi037.stdout:2/778: dwrite d0/d16/d20/d55/f6f [0,4194304] 0 2024-04-25T17:19:21.917 INFO:tasks.workunit.client.0.smithi037.stdout:3/589: link d8/d23/d3a/f43 d8/d23/d3a/fb1 0 2024-04-25T17:19:21.920 INFO:tasks.workunit.client.0.smithi037.stdout:4/935: creat d7/d7e/d45/d4f/f136 x:0 0 0 2024-04-25T17:19:21.921 INFO:tasks.workunit.client.0.smithi037.stdout:3/590: fsync d8/d23/d3a/d5d/f84 0 2024-04-25T17:19:21.924 INFO:tasks.workunit.client.0.smithi037.stdout:1/853: rmdir dc/d52/d6b/dd9/d4d/d6a/d86/d9b 39 2024-04-25T17:19:21.926 INFO:tasks.workunit.client.0.smithi037.stdout:2/779: mknod d0/d16/d3c/de5/cf7 0 2024-04-25T17:19:21.928 INFO:tasks.workunit.client.0.smithi037.stdout:1/854: read dc/f62 [4172160,1349] 0 2024-04-25T17:19:21.929 INFO:tasks.workunit.client.1.smithi069.stdout:1/674: unlink d1/df/d17/ca5 0 2024-04-25T17:19:21.930 INFO:tasks.workunit.client.0.smithi037.stdout:1/855: read dc/d1c/f58 [110565,40504] 0 2024-04-25T17:19:21.931 INFO:tasks.workunit.client.0.smithi037.stdout:3/591: symlink d8/d31/d32/d3e/d7d/lb2 0 2024-04-25T17:19:21.931 INFO:tasks.workunit.client.0.smithi037.stdout:1/856: write dc/d24/f5e [7432799,124950] 0 2024-04-25T17:19:21.932 INFO:tasks.workunit.client.1.smithi069.stdout:5/708: creat d13/d17/d29/ff4 x:0 0 0 2024-04-25T17:19:21.933 INFO:tasks.workunit.client.1.smithi069.stdout:5/709: fsync d13/d17/d19/d1c/f71 0 2024-04-25T17:19:21.934 INFO:tasks.workunit.client.0.smithi037.stdout:0/782: write d9/d14/f1a [886624,101600] 0 2024-04-25T17:19:21.935 INFO:tasks.workunit.client.0.smithi037.stdout:0/783: readlink d9/df/d32/d35/l74 0 2024-04-25T17:19:21.937 INFO:tasks.workunit.client.0.smithi037.stdout:2/780: mknod d0/d23/d7d/d56/cf8 0 2024-04-25T17:19:21.938 INFO:tasks.workunit.client.0.smithi037.stdout:2/781: dread - d0/d16/d20/d55/fa1 zero size 2024-04-25T17:19:21.940 INFO:tasks.workunit.client.1.smithi069.stdout:3/728: rename d8/d16/d1a/d2c/d49/dd0/ldb to d8/d16/d1a/d2c/d49/d87/d8a/d8e/lf9 0 2024-04-25T17:19:21.942 INFO:tasks.workunit.client.0.smithi037.stdout:3/592: creat d8/d23/d38/fb3 x:0 0 0 2024-04-25T17:19:21.943 INFO:tasks.workunit.client.1.smithi069.stdout:9/650: mkdir d2/da/dd/de0 0 2024-04-25T17:19:21.943 INFO:tasks.workunit.client.0.smithi037.stdout:3/593: write d8/d23/d38/d66/f75 [424350,30929] 0 2024-04-25T17:19:21.944 INFO:tasks.workunit.client.0.smithi037.stdout:3/594: chown d8/d57 855 1 2024-04-25T17:19:21.944 INFO:tasks.workunit.client.1.smithi069.stdout:2/659: creat d0/d56/fd0 x:0 0 0 2024-04-25T17:19:21.947 INFO:tasks.workunit.client.1.smithi069.stdout:3/729: dwrite f6 [0,4194304] 0 2024-04-25T17:19:21.948 INFO:tasks.workunit.client.0.smithi037.stdout:2/782: rename d0/d15/d2a/d5a/l79 to d0/d16/d20/d59/d6a/da5/dbd/lf9 0 2024-04-25T17:19:21.948 INFO:tasks.workunit.client.1.smithi069.stdout:4/666: sync 2024-04-25T17:19:21.952 INFO:tasks.workunit.client.1.smithi069.stdout:9/651: dwrite d2/da4/fd5 [0,4194304] 0 2024-04-25T17:19:21.952 INFO:tasks.workunit.client.1.smithi069.stdout:6/651: rename d2/d1e/d3f/d56/c66 to d2/d1e/d43/db6/daf/ddd/ce7 0 2024-04-25T17:19:21.953 INFO:tasks.workunit.client.0.smithi037.stdout:0/784: fdatasync d9/d14/d28/d48/d58/f5e 0 2024-04-25T17:19:21.954 INFO:tasks.workunit.client.1.smithi069.stdout:6/652: readlink d2/d1e/d43/db6/de4/ld1 0 2024-04-25T17:19:21.956 INFO:tasks.workunit.client.0.smithi037.stdout:1/857: dread dc/d18/f2b [0,4194304] 0 2024-04-25T17:19:21.958 INFO:tasks.workunit.client.1.smithi069.stdout:2/660: symlink d0/d56/d94/ld1 0 2024-04-25T17:19:21.962 INFO:tasks.workunit.client.1.smithi069.stdout:8/697: truncate d37/d47/d78/d93/fb6 4359782 0 2024-04-25T17:19:21.963 INFO:tasks.workunit.client.1.smithi069.stdout:8/698: write d37/d47/d54/d6e/d98/fb5 [574823,28490] 0 2024-04-25T17:19:21.964 INFO:tasks.workunit.client.1.smithi069.stdout:5/710: symlink d13/d17/d19/d1c/lf5 0 2024-04-25T17:19:21.966 INFO:tasks.workunit.client.0.smithi037.stdout:0/785: creat d9/df/d32/dd1/d7a/daf/f101 x:0 0 0 2024-04-25T17:19:21.969 INFO:tasks.workunit.client.1.smithi069.stdout:0/589: write d0/d36/f2b [2701530,51283] 0 2024-04-25T17:19:21.972 INFO:tasks.workunit.client.0.smithi037.stdout:2/783: truncate d0/d16/fad 762583 0 2024-04-25T17:19:21.975 INFO:tasks.workunit.client.1.smithi069.stdout:1/675: write d1/df/d17/f24 [4469348,28555] 0 2024-04-25T17:19:21.976 INFO:tasks.workunit.client.1.smithi069.stdout:2/661: creat d0/d1/d5b/d33/fd2 x:0 0 0 2024-04-25T17:19:21.977 INFO:tasks.workunit.client.1.smithi069.stdout:2/662: write d0/f92 [1319925,46501] 0 2024-04-25T17:19:21.978 INFO:tasks.workunit.client.0.smithi037.stdout:3/595: rename d8/d31/d32/d69 to d8/db4 0 2024-04-25T17:19:21.978 INFO:tasks.workunit.client.1.smithi069.stdout:2/663: truncate d0/d26/d10/d43/fa1 190951 0 2024-04-25T17:19:21.979 INFO:tasks.workunit.client.1.smithi069.stdout:8/699: creat d37/d66/d6b/daf/feb x:0 0 0 2024-04-25T17:19:21.980 INFO:tasks.workunit.client.0.smithi037.stdout:1/858: creat dc/d52/d6b/dd9/d22/d113/f126 x:0 0 0 2024-04-25T17:19:21.983 INFO:tasks.workunit.client.0.smithi037.stdout:3/596: unlink d8/ce 0 2024-04-25T17:19:21.986 INFO:tasks.workunit.client.0.smithi037.stdout:2/784: rename d0/d15/fb6 to d0/d23/dac/d4b/ded/df4/ffa 0 2024-04-25T17:19:21.989 INFO:tasks.workunit.client.0.smithi037.stdout:1/859: mkdir dc/d52/d6b/dd9/d22/d36/d74/daf/ddd/d127 0 2024-04-25T17:19:21.990 INFO:tasks.workunit.client.0.smithi037.stdout:1/860: stat dc/d18/d64/c10f 0 2024-04-25T17:19:21.991 INFO:tasks.workunit.client.0.smithi037.stdout:0/786: rmdir d9/df/d32/dd1/d7a/daf 39 2024-04-25T17:19:21.991 INFO:tasks.workunit.client.1.smithi069.stdout:5/711: dread d13/d17/f86 [0,4194304] 0 2024-04-25T17:19:21.993 INFO:tasks.workunit.client.0.smithi037.stdout:2/785: dwrite d0/d23/fdb [0,4194304] 0 2024-04-25T17:19:21.994 INFO:tasks.workunit.client.0.smithi037.stdout:2/786: write d0/d16/d20/d55/dc8/feb [555731,59008] 0 2024-04-25T17:19:21.995 INFO:tasks.workunit.client.1.smithi069.stdout:6/653: mkdir d2/d9c/d97/dad/de8 0 2024-04-25T17:19:21.995 INFO:tasks.workunit.client.1.smithi069.stdout:3/730: write d8/d16/d1a/d38/f83 [6869942,81795] 0 2024-04-25T17:19:21.995 INFO:tasks.workunit.client.0.smithi037.stdout:2/787: chown d0/d16/d20/c22 1881149 1 2024-04-25T17:19:21.997 INFO:tasks.workunit.client.1.smithi069.stdout:1/676: chown d1/df/d17/f3b 187293607 1 2024-04-25T17:19:21.997 INFO:tasks.workunit.client.1.smithi069.stdout:1/677: chown d1/d4/d6/ld0 1706609 1 2024-04-25T17:19:22.002 INFO:tasks.workunit.client.1.smithi069.stdout:2/664: chown d0/d26/d10/d43/d99/laa 7162353 1 2024-04-25T17:19:22.003 INFO:tasks.workunit.client.1.smithi069.stdout:2/665: chown d0/d26/fcd 34476 1 2024-04-25T17:19:22.004 INFO:tasks.workunit.client.1.smithi069.stdout:8/700: symlink d37/d47/d48/lec 0 2024-04-25T17:19:22.005 INFO:tasks.workunit.client.1.smithi069.stdout:8/701: dread - d37/d66/fa9 zero size 2024-04-25T17:19:22.006 INFO:tasks.workunit.client.0.smithi037.stdout:0/787: truncate d9/d14/d23/f29 1993778 0 2024-04-25T17:19:22.007 INFO:tasks.workunit.client.0.smithi037.stdout:0/788: readlink d9/df/d32/d35/l74 0 2024-04-25T17:19:22.010 INFO:tasks.workunit.client.1.smithi069.stdout:9/652: write d2/da/dd/d1e/d2e/d68/dba/dd1/fdc [1853803,22917] 0 2024-04-25T17:19:22.011 INFO:tasks.workunit.client.1.smithi069.stdout:9/653: write d2/da/dd/f11 [181374,130576] 0 2024-04-25T17:19:22.012 INFO:tasks.workunit.client.1.smithi069.stdout:5/712: rmdir d13/d17/d19/d1c/d6c 39 2024-04-25T17:19:22.014 INFO:tasks.workunit.client.0.smithi037.stdout:3/597: write d8/d23/d3a/d81/fab [1830624,108569] 0 2024-04-25T17:19:22.019 INFO:tasks.workunit.client.1.smithi069.stdout:3/731: mkdir d8/d39/dfa 0 2024-04-25T17:19:22.019 INFO:tasks.workunit.client.1.smithi069.stdout:2/666: mknod d0/d56/d5f/cd3 0 2024-04-25T17:19:22.019 INFO:tasks.workunit.client.1.smithi069.stdout:3/732: chown d8/d16/d1a/d2c 13 1 2024-04-25T17:19:22.020 INFO:tasks.workunit.client.0.smithi037.stdout:1/861: dwrite dc/d52/d6b/dd9/d4d/d6a/f9d [0,4194304] 0 2024-04-25T17:19:22.023 INFO:tasks.workunit.client.1.smithi069.stdout:3/733: dread f6 [0,4194304] 0 2024-04-25T17:19:22.024 INFO:tasks.workunit.client.1.smithi069.stdout:0/590: link d0/d17/d40/f68 d0/da/d54/fcc 0 2024-04-25T17:19:22.025 INFO:tasks.workunit.client.1.smithi069.stdout:0/591: write d0/f6 [849631,108346] 0 2024-04-25T17:19:22.025 INFO:tasks.workunit.client.1.smithi069.stdout:7/675: sync 2024-04-25T17:19:22.026 INFO:tasks.workunit.client.0.smithi037.stdout:2/788: rename d0/d16/d3b to d0/d23/dfb 0 2024-04-25T17:19:22.028 INFO:tasks.workunit.client.0.smithi037.stdout:1/862: chown dc/d18/f1b 0 1 2024-04-25T17:19:22.030 INFO:tasks.workunit.client.1.smithi069.stdout:5/713: creat d13/d17/d19/d1c/d79/ff6 x:0 0 0 2024-04-25T17:19:22.030 INFO:tasks.workunit.client.1.smithi069.stdout:6/654: write d2/d1e/f2b [3871938,98779] 0 2024-04-25T17:19:22.031 INFO:tasks.workunit.client.1.smithi069.stdout:6/655: dread - d2/d1e/d43/d7d/db5/fde zero size 2024-04-25T17:19:22.034 INFO:tasks.workunit.client.0.smithi037.stdout:1/863: unlink dc/d52/d6b/le1 0 2024-04-25T17:19:22.036 INFO:tasks.workunit.client.1.smithi069.stdout:5/714: dwrite d13/f1a [4194304,4194304] 0 2024-04-25T17:19:22.037 INFO:tasks.workunit.client.1.smithi069.stdout:5/715: fdatasync d13/d17/d19/d1c/da4/fd5 0 2024-04-25T17:19:22.039 INFO:tasks.workunit.client.1.smithi069.stdout:9/654: dread d2/da/dd/de/d74/d8a/f9e [0,4194304] 0 2024-04-25T17:19:22.040 INFO:tasks.workunit.client.1.smithi069.stdout:8/702: mknod d37/d47/d78/ced 0 2024-04-25T17:19:22.040 INFO:tasks.workunit.client.1.smithi069.stdout:8/703: write fb [1801431,62476] 0 2024-04-25T17:19:22.041 INFO:tasks.workunit.client.0.smithi037.stdout:1/864: dread dc/d18/f7d [0,4194304] 0 2024-04-25T17:19:22.042 INFO:tasks.workunit.client.1.smithi069.stdout:8/704: chown d37/d47/d54/d6e/d98/lc4 1 1 2024-04-25T17:19:22.044 INFO:tasks.workunit.client.0.smithi037.stdout:3/598: link d8/d31/d32/d3e/f42 d8/d23/d72/fb5 0 2024-04-25T17:19:22.045 INFO:tasks.workunit.client.0.smithi037.stdout:2/789: dread d0/d16/d20/f3d [0,4194304] 0 2024-04-25T17:19:22.045 INFO:tasks.workunit.client.0.smithi037.stdout:3/599: chown d8/d23/d3a/d81/l8b 2573643 1 2024-04-25T17:19:22.046 INFO:tasks.workunit.client.1.smithi069.stdout:7/676: rename d4/d18/f1f to d4/dbb/fdd 0 2024-04-25T17:19:22.047 INFO:tasks.workunit.client.0.smithi037.stdout:1/865: mknod dc/d52/d6b/dd9/d22/d36/d8c/c128 0 2024-04-25T17:19:22.048 INFO:tasks.workunit.client.0.smithi037.stdout:3/600: read d8/d31/f47 [2175176,7288] 0 2024-04-25T17:19:22.049 INFO:tasks.workunit.client.1.smithi069.stdout:1/678: link d1/d4/de/d44/d68/c6f d1/d4/d6/d9e/da6/d7c/d4d/cd1 0 2024-04-25T17:19:22.051 INFO:tasks.workunit.client.1.smithi069.stdout:6/656: mknod d2/d1e/d43/ce9 0 2024-04-25T17:19:22.057 INFO:tasks.workunit.client.0.smithi037.stdout:3/601: rename d8/d23/d3a/l7c to d8/d31/d32/d87/lb6 0 2024-04-25T17:19:22.058 INFO:tasks.workunit.client.1.smithi069.stdout:4/667: sync 2024-04-25T17:19:22.058 INFO:tasks.workunit.client.0.smithi037.stdout:3/602: fdatasync d8/d23/d3a/d5d/fa9 0 2024-04-25T17:19:22.059 INFO:tasks.workunit.client.1.smithi069.stdout:2/667: creat d0/d26/d36/dc5/fd4 x:0 0 0 2024-04-25T17:19:22.059 INFO:tasks.workunit.client.1.smithi069.stdout:4/668: write db/d15/d42/d64/fda [718682,129857] 0 2024-04-25T17:19:22.061 INFO:tasks.workunit.client.1.smithi069.stdout:5/716: creat d13/d17/d19/d20/d51/ff7 x:0 0 0 2024-04-25T17:19:22.062 INFO:tasks.workunit.client.1.smithi069.stdout:5/717: chown d13/c99 54 1 2024-04-25T17:19:22.063 INFO:tasks.workunit.client.1.smithi069.stdout:9/655: mknod d2/da/dd/de/d59/d7f/ce1 0 2024-04-25T17:19:22.064 INFO:tasks.workunit.client.1.smithi069.stdout:9/656: dread - d2/da/f4e zero size 2024-04-25T17:19:22.065 INFO:tasks.workunit.client.0.smithi037.stdout:3/603: mkdir d8/d31/d8d/db7 0 2024-04-25T17:19:22.066 INFO:tasks.workunit.client.0.smithi037.stdout:3/604: write d8/d23/d3a/d5d/f2b [1421310,24454] 0 2024-04-25T17:19:22.068 INFO:tasks.workunit.client.1.smithi069.stdout:7/677: dread d4/d3e/d94/da1/dc7/d14/d3d/f69 [0,4194304] 0 2024-04-25T17:19:22.069 INFO:tasks.workunit.client.1.smithi069.stdout:3/734: dwrite d8/d71/faf [0,4194304] 0 2024-04-25T17:19:22.069 INFO:tasks.workunit.client.0.smithi037.stdout:2/790: write d0/f9 [1825933,63869] 0 2024-04-25T17:19:22.071 INFO:tasks.workunit.client.0.smithi037.stdout:3/605: read d8/f9 [2221183,130613] 0 2024-04-25T17:19:22.076 INFO:tasks.workunit.client.1.smithi069.stdout:2/668: rename d0/d56/d5f/d62/d7d/d31/f3d to d0/d56/d5f/d62/d7d/d31/fd5 0 2024-04-25T17:19:22.078 INFO:tasks.workunit.client.0.smithi037.stdout:1/866: write dc/d52/d6b/dd9/d22/d36/d92/db8/fc2 [4099502,50214] 0 2024-04-25T17:19:22.079 INFO:tasks.workunit.client.0.smithi037.stdout:3/606: creat d8/d31/d32/d3e/d7d/fb8 x:0 0 0 2024-04-25T17:19:22.081 INFO:tasks.workunit.client.1.smithi069.stdout:5/718: mknod d13/d17/d62/cf8 0 2024-04-25T17:19:22.082 INFO:tasks.workunit.client.0.smithi037.stdout:2/791: fdatasync d0/d23/dac/d4b/ded/df4/ffa 0 2024-04-25T17:19:22.082 INFO:tasks.workunit.client.1.smithi069.stdout:5/719: write d13/d17/d29/d30/d9c/fe9 [750722,32509] 0 2024-04-25T17:19:22.084 INFO:tasks.workunit.client.1.smithi069.stdout:9/657: symlink d2/da4/le2 0 2024-04-25T17:19:22.084 INFO:tasks.workunit.client.1.smithi069.stdout:0/592: truncate d0/da/db/d1d/fba 726970 0 2024-04-25T17:19:22.086 INFO:tasks.workunit.client.0.smithi037.stdout:1/867: stat dc/d18/l23 0 2024-04-25T17:19:22.087 INFO:tasks.workunit.client.0.smithi037.stdout:3/607: dwrite d8/d23/d3a/f50 [0,4194304] 0 2024-04-25T17:19:22.087 INFO:tasks.workunit.client.0.smithi037.stdout:1/868: fsync dc/d24/fbd 0 2024-04-25T17:19:22.088 INFO:tasks.workunit.client.0.smithi037.stdout:3/608: stat d8/f1f 0 2024-04-25T17:19:22.089 INFO:tasks.workunit.client.0.smithi037.stdout:3/609: dread - d8/d23/d38/f74 zero size 2024-04-25T17:19:22.089 INFO:tasks.workunit.client.0.smithi037.stdout:3/610: dread - d8/f5c zero size 2024-04-25T17:19:22.096 INFO:tasks.workunit.client.1.smithi069.stdout:4/669: dread db/d4b/d78/dc4/d41/f87 [0,4194304] 0 2024-04-25T17:19:22.097 INFO:tasks.workunit.client.0.smithi037.stdout:3/611: rmdir d8/d23/d3a 39 2024-04-25T17:19:22.097 INFO:tasks.workunit.client.1.smithi069.stdout:4/670: fdatasync db/d15/d42/d64/fda 0 2024-04-25T17:19:22.098 INFO:tasks.workunit.client.1.smithi069.stdout:6/657: mknod d2/d1e/cea 0 2024-04-25T17:19:22.101 INFO:tasks.workunit.client.0.smithi037.stdout:8/672: sync 2024-04-25T17:19:22.101 INFO:tasks.workunit.client.0.smithi037.stdout:8/673: stat d5/db/d59/c91 0 2024-04-25T17:19:22.102 INFO:tasks.workunit.client.0.smithi037.stdout:3/612: mknod d8/db4/cb9 0 2024-04-25T17:19:22.103 INFO:tasks.workunit.client.0.smithi037.stdout:8/674: write d5/d26/d33/fd4 [930708,85863] 0 2024-04-25T17:19:22.103 INFO:tasks.workunit.client.0.smithi037.stdout:2/792: link d0/d16/d3c/c90 d0/d16/d20/d59/d6a/da5/dbd/dd6/cfc 0 2024-04-25T17:19:22.104 INFO:tasks.workunit.client.0.smithi037.stdout:2/793: chown d0/d15/d2a/d5a/d75/c9b 2 1 2024-04-25T17:19:22.105 INFO:tasks.workunit.client.1.smithi069.stdout:0/593: mknod d0/da/d59/ccd 0 2024-04-25T17:19:22.106 INFO:tasks.workunit.client.0.smithi037.stdout:1/869: link dc/d52/d6b/dd9/d22/f2c dc/d24/da5/f129 0 2024-04-25T17:19:22.106 INFO:tasks.workunit.client.1.smithi069.stdout:0/594: write d0/d38/f7a [30823,22220] 0 2024-04-25T17:19:22.106 INFO:tasks.workunit.client.1.smithi069.stdout:3/735: write d8/d16/ff2 [3276043,3760] 0 2024-04-25T17:19:22.108 INFO:tasks.workunit.client.1.smithi069.stdout:8/705: rename d37/d47/d54/l9a to d37/d47/lee 0 2024-04-25T17:19:22.112 INFO:tasks.workunit.client.0.smithi037.stdout:8/675: mkdir d5/d26/ddd 0 2024-04-25T17:19:22.112 INFO:tasks.workunit.client.0.smithi037.stdout:8/676: dread - d5/db/d7e/fb7 zero size 2024-04-25T17:19:22.114 INFO:tasks.workunit.client.0.smithi037.stdout:2/794: creat d0/d15/d2a/d5a/d75/ffd x:0 0 0 2024-04-25T17:19:22.116 INFO:tasks.workunit.client.1.smithi069.stdout:1/679: link d1/d4/d6/d9e/da6/d7c/f14 d1/d4/d6/d9e/da6/fd2 0 2024-04-25T17:19:22.118 INFO:tasks.workunit.client.0.smithi037.stdout:3/613: chown d8/d23/d3a/d63/d86/d88/ca6 304 1 2024-04-25T17:19:22.119 INFO:tasks.workunit.client.1.smithi069.stdout:9/658: dwrite d2/da/f13 [0,4194304] 0 2024-04-25T17:19:22.119 INFO:tasks.workunit.client.1.smithi069.stdout:4/671: creat db/d15/d82/da7/fe4 x:0 0 0 2024-04-25T17:19:22.120 INFO:tasks.workunit.client.1.smithi069.stdout:4/672: stat db/d15/d20/d35/l9a 0 2024-04-25T17:19:22.120 INFO:tasks.workunit.client.0.smithi037.stdout:2/795: dwrite d0/d23/fdb [4194304,4194304] 0 2024-04-25T17:19:22.121 INFO:tasks.workunit.client.1.smithi069.stdout:6/658: rmdir d2/d9c/d97/dad 39 2024-04-25T17:19:22.122 INFO:tasks.workunit.client.0.smithi037.stdout:2/796: truncate d0/d16/d20/db9/fe0 475340 0 2024-04-25T17:19:22.123 INFO:tasks.workunit.client.1.smithi069.stdout:2/669: truncate d0/d56/d5f/d62/d7d/d31/fd5 331235 0 2024-04-25T17:19:22.123 INFO:tasks.workunit.client.0.smithi037.stdout:2/797: write d0/d15/fe2 [987175,73426] 0 2024-04-25T17:19:22.124 INFO:tasks.workunit.client.1.smithi069.stdout:2/670: fsync d0/d26/fcd 0 2024-04-25T17:19:22.125 INFO:tasks.workunit.client.0.smithi037.stdout:1/870: rename dc/d18/ccb to dc/d52/d6b/dd9/d22/d11b/c12a 0 2024-04-25T17:19:22.127 INFO:tasks.workunit.client.1.smithi069.stdout:5/720: mknod d13/d17/d19/cf9 0 2024-04-25T17:19:22.129 INFO:tasks.workunit.client.0.smithi037.stdout:3/614: fsync d8/d23/d3a/d63/d86/f8f 0 2024-04-25T17:19:22.133 INFO:tasks.workunit.client.1.smithi069.stdout:5/721: dwrite d13/d17/d19/f50 [0,4194304] 0 2024-04-25T17:19:22.136 INFO:tasks.workunit.client.0.smithi037.stdout:2/798: fdatasync d0/d16/d20/d59/f66 0 2024-04-25T17:19:22.138 INFO:tasks.workunit.client.1.smithi069.stdout:3/736: creat d8/d16/d1a/d99/ffb x:0 0 0 2024-04-25T17:19:22.139 INFO:tasks.workunit.client.0.smithi037.stdout:1/871: creat dc/d52/d6b/dd9/d22/d36/d8c/f12b x:0 0 0 2024-04-25T17:19:22.142 INFO:tasks.workunit.client.1.smithi069.stdout:8/706: creat d37/d62/fef x:0 0 0 2024-04-25T17:19:22.143 INFO:tasks.workunit.client.0.smithi037.stdout:3/615: symlink d8/d57/lba 0 2024-04-25T17:19:22.143 INFO:tasks.workunit.client.1.smithi069.stdout:8/707: truncate d37/d47/d54/d6e/dce/fdd 475588 0 2024-04-25T17:19:22.147 INFO:tasks.workunit.client.1.smithi069.stdout:7/678: creat d4/d3e/d94/da1/dc7/d14/fde x:0 0 0 2024-04-25T17:19:22.148 INFO:tasks.workunit.client.0.smithi037.stdout:8/677: creat d5/db/d18/d3b/d50/fde x:0 0 0 2024-04-25T17:19:22.151 INFO:tasks.workunit.client.1.smithi069.stdout:9/659: dread - d2/da/dd/d1e/f2f zero size 2024-04-25T17:19:22.152 INFO:tasks.workunit.client.1.smithi069.stdout:4/673: rmdir db/d15/d20/d35/d63/d70/d8a 39 2024-04-25T17:19:22.159 INFO:tasks.workunit.client.1.smithi069.stdout:0/595: dread d0/da/db/d3a/f4c [0,4194304] 0 2024-04-25T17:19:22.160 INFO:tasks.workunit.client.1.smithi069.stdout:2/671: dread d0/d1/d5b/f32 [0,4194304] 0 2024-04-25T17:19:22.160 INFO:tasks.workunit.client.1.smithi069.stdout:5/722: mknod d13/d17/d19/d20/d2d/d93/cfa 0 2024-04-25T17:19:22.161 INFO:tasks.workunit.client.1.smithi069.stdout:5/723: dread - d13/d17/d62/fd2 zero size 2024-04-25T17:19:22.163 INFO:tasks.workunit.client.0.smithi037.stdout:1/872: mknod dc/d52/d6b/dd9/d4d/d6a/d117/c12c 0 2024-04-25T17:19:22.164 INFO:tasks.workunit.client.0.smithi037.stdout:2/799: write d0/d23/dac/d4b/f7a [229750,21515] 0 2024-04-25T17:19:22.164 INFO:tasks.workunit.client.1.smithi069.stdout:2/672: dread d0/d56/d5f/d62/d7d/d72/fa4 [0,4194304] 0 2024-04-25T17:19:22.164 INFO:tasks.workunit.client.1.smithi069.stdout:6/659: write d2/f2f [2605597,52332] 0 2024-04-25T17:19:22.165 INFO:tasks.workunit.client.0.smithi037.stdout:8/678: write d5/f27 [426607,40631] 0 2024-04-25T17:19:22.166 INFO:tasks.workunit.client.0.smithi037.stdout:8/679: chown d5/d26 214781 1 2024-04-25T17:19:22.168 INFO:tasks.workunit.client.0.smithi037.stdout:1/873: mknod dc/d18/d64/df1/df4/c12d 0 2024-04-25T17:19:22.170 INFO:tasks.workunit.client.1.smithi069.stdout:1/680: symlink d1/d43/d1b/d32/ld3 0 2024-04-25T17:19:22.171 INFO:tasks.workunit.client.1.smithi069.stdout:1/681: write d1/d4/d6/d9e/da6/d7c/d4d/f7a [7856283,20100] 0 2024-04-25T17:19:22.172 INFO:tasks.workunit.client.1.smithi069.stdout:1/682: read d1/d4/d6/d9e/da6/d7c/f14 [3064551,101357] 0 2024-04-25T17:19:22.177 INFO:tasks.workunit.client.1.smithi069.stdout:6/660: chown d2/f20 9730 1 2024-04-25T17:19:22.177 INFO:tasks.workunit.client.1.smithi069.stdout:8/708: unlink c0 0 2024-04-25T17:19:22.177 INFO:tasks.workunit.client.1.smithi069.stdout:7/679: creat d4/d3e/dc8/fdf x:0 0 0 2024-04-25T17:19:22.181 INFO:tasks.workunit.client.1.smithi069.stdout:0/596: write d0/f1 [1679423,59275] 0 2024-04-25T17:19:22.183 INFO:tasks.workunit.client.1.smithi069.stdout:3/737: truncate d8/d71/d8d/d92/db6/dc1/f7f 255110 0 2024-04-25T17:19:22.185 INFO:tasks.workunit.client.1.smithi069.stdout:2/673: dread d0/d26/f54 [0,4194304] 0 2024-04-25T17:19:22.187 INFO:tasks.workunit.client.1.smithi069.stdout:6/661: readlink d2/d9c/d97/dad/lc6 0 2024-04-25T17:19:22.188 INFO:tasks.workunit.client.1.smithi069.stdout:6/662: truncate d2/d7/fe6 567016 0 2024-04-25T17:19:22.189 INFO:tasks.workunit.client.1.smithi069.stdout:9/660: creat d2/da/fe3 x:0 0 0 2024-04-25T17:19:22.190 INFO:tasks.workunit.client.1.smithi069.stdout:6/663: write d2/d1e/f2b [3863306,20972] 0 2024-04-25T17:19:22.194 INFO:tasks.workunit.client.1.smithi069.stdout:5/724: creat d13/d17/d19/ffb x:0 0 0 2024-04-25T17:19:22.194 INFO:tasks.workunit.client.1.smithi069.stdout:8/709: write d37/d47/d54/d6e/f7d [1583915,104346] 0 2024-04-25T17:19:22.196 INFO:tasks.workunit.client.1.smithi069.stdout:7/680: dwrite d4/d3e/d94/da1/dc7/d14/d44/d7c/d9f/dcb/f6b [4194304,4194304] 0 2024-04-25T17:19:22.196 INFO:tasks.workunit.client.1.smithi069.stdout:1/683: write d1/d4/d6/d9e/da6/d7c/d1d/f5e [444397,129347] 0 2024-04-25T17:19:22.199 INFO:tasks.workunit.client.1.smithi069.stdout:7/681: write d4/d3e/d94/da1/dc7/f72 [3559333,71145] 0 2024-04-25T17:19:22.199 INFO:tasks.workunit.client.1.smithi069.stdout:4/674: rename f0 to db/d4b/d78/fe5 0 2024-04-25T17:19:22.201 INFO:tasks.workunit.client.1.smithi069.stdout:7/682: stat d4/d4c 0 2024-04-25T17:19:22.202 INFO:tasks.workunit.client.1.smithi069.stdout:0/597: link d0/da/db/d2a/f3f d0/da/db/d7e/fce 0 2024-04-25T17:19:22.203 INFO:tasks.workunit.client.0.smithi037.stdout:6/681: sync 2024-04-25T17:19:22.204 INFO:tasks.workunit.client.1.smithi069.stdout:9/661: creat d2/d51/fe4 x:0 0 0 2024-04-25T17:19:22.204 INFO:tasks.workunit.client.0.smithi037.stdout:3/616: dwrite d8/f9 [4194304,4194304] 0 2024-04-25T17:19:22.206 INFO:tasks.workunit.client.1.smithi069.stdout:2/674: symlink d0/d1/d5b/ld6 0 2024-04-25T17:19:22.207 INFO:tasks.workunit.client.0.smithi037.stdout:3/617: dread - d8/d23/d3a/d5d/fa9 zero size 2024-04-25T17:19:22.208 INFO:tasks.workunit.client.1.smithi069.stdout:8/710: write d37/d47/d54/f5e [1248899,28116] 0 2024-04-25T17:19:22.208 INFO:tasks.workunit.client.1.smithi069.stdout:5/725: dwrite d13/d17/f7f [4194304,4194304] 0 2024-04-25T17:19:22.211 INFO:tasks.workunit.client.1.smithi069.stdout:8/711: write d37/d62/f8f [3070089,63275] 0 2024-04-25T17:19:22.212 INFO:tasks.workunit.client.0.smithi037.stdout:8/680: chown d5/db/d18/d3b/d50/d51/l84 39007219 1 2024-04-25T17:19:22.216 INFO:tasks.workunit.client.1.smithi069.stdout:8/712: write d37/fd6 [728190,108859] 0 2024-04-25T17:19:22.218 INFO:tasks.workunit.client.0.smithi037.stdout:6/682: creat db/d53/ff2 x:0 0 0 2024-04-25T17:19:22.219 INFO:tasks.workunit.client.1.smithi069.stdout:2/675: dwrite d0/d56/d5f/d62/d7d/d72/fcf [0,4194304] 0 2024-04-25T17:19:22.220 INFO:tasks.workunit.client.1.smithi069.stdout:3/738: rename d8/d16/d1a/d2c/d49/dd0 to d8/d16/d1a/d2c/d49/d87/d8a/dd7/dfc 0 2024-04-25T17:19:22.222 INFO:tasks.workunit.client.1.smithi069.stdout:3/739: chown d8/d71/d8d/d92/db6/dc1/c4a 4962 1 2024-04-25T17:19:22.223 INFO:tasks.workunit.client.1.smithi069.stdout:4/675: mkdir db/d15/d20/d35/d63/d75/de6 0 2024-04-25T17:19:22.225 INFO:tasks.workunit.client.1.smithi069.stdout:6/664: creat d2/d1e/d3f/d86/feb x:0 0 0 2024-04-25T17:19:22.226 INFO:tasks.workunit.client.1.smithi069.stdout:6/665: fdatasync d2/d1e/d3f/d56/d7e/fa7 0 2024-04-25T17:19:22.229 INFO:tasks.workunit.client.1.smithi069.stdout:9/662: rmdir d2/da/dd/d1e/d2e/d68/dba/dd1 39 2024-04-25T17:19:22.229 INFO:tasks.workunit.client.1.smithi069.stdout:9/663: chown d2/lac 83718208 1 2024-04-25T17:19:22.231 INFO:tasks.workunit.client.0.smithi037.stdout:6/683: unlink db/d26/d2e/d3e/fa6 0 2024-04-25T17:19:22.231 INFO:tasks.workunit.client.1.smithi069.stdout:5/726: chown d13/d17/d19/d8a/dce/lf0 3969 1 2024-04-25T17:19:22.231 INFO:tasks.workunit.client.0.smithi037.stdout:2/800: getdents d0/d23/dac/d4b/ded 0 2024-04-25T17:19:22.236 INFO:tasks.workunit.client.0.smithi037.stdout:2/801: rmdir d0/d23/dac/d4b/ded/df4 39 2024-04-25T17:19:22.237 INFO:tasks.workunit.client.0.smithi037.stdout:2/802: dread d0/d16/d20/d59/d6a/f99 [0,4194304] 0 2024-04-25T17:19:22.239 INFO:tasks.workunit.client.0.smithi037.stdout:3/618: rename d8/d23/d3a to d8/d23/dbb 0 2024-04-25T17:19:22.243 INFO:tasks.workunit.client.1.smithi069.stdout:7/683: rename d4/d3e/d94/da1/dc7/d14/d3d/d47/c49 to d4/d3e/d94/da1/dc7/d14/d44/d88/ce0 0 2024-04-25T17:19:22.244 INFO:tasks.workunit.client.1.smithi069.stdout:3/740: read - d8/d16/d1a/d2c/d49/d87/d8a/d8e/fb1 zero size 2024-04-25T17:19:22.248 INFO:tasks.workunit.client.0.smithi037.stdout:2/803: dread - d0/d23/dac/d4b/ded/df4/ffa zero size 2024-04-25T17:19:22.249 INFO:tasks.workunit.client.0.smithi037.stdout:1/874: dwrite dc/d24/da5/f129 [0,4194304] 0 2024-04-25T17:19:22.249 INFO:tasks.workunit.client.0.smithi037.stdout:8/681: getdents d5/dbc 0 2024-04-25T17:19:22.250 INFO:tasks.workunit.client.1.smithi069.stdout:5/727: mknod d13/d17/d29/dde/cfc 0 2024-04-25T17:19:22.251 INFO:tasks.workunit.client.0.smithi037.stdout:1/875: write dc/d52/d6b/dd9/d22/d36/d92/fc4 [1391362,1880] 0 2024-04-25T17:19:22.251 INFO:tasks.workunit.client.1.smithi069.stdout:5/728: fsync d13/d17/d19/d1c/d79/ff6 0 2024-04-25T17:19:22.258 INFO:tasks.workunit.client.1.smithi069.stdout:2/676: mknod d0/d26/d10/cd7 0 2024-04-25T17:19:22.260 INFO:tasks.workunit.client.1.smithi069.stdout:7/684: creat d4/d3e/dc8/fe1 x:0 0 0 2024-04-25T17:19:22.264 INFO:tasks.workunit.client.1.smithi069.stdout:8/713: write f32 [2981362,93966] 0 2024-04-25T17:19:22.265 INFO:tasks.workunit.client.0.smithi037.stdout:6/684: link db/f3d db/d26/d2e/d3e/ff3 0 2024-04-25T17:19:22.265 INFO:tasks.workunit.client.0.smithi037.stdout:1/876: dread dc/d1c/f69 [0,4194304] 0 2024-04-25T17:19:22.266 INFO:tasks.workunit.client.1.smithi069.stdout:6/666: mknod d2/d1e/d43/db6/daf/dbe/cec 0 2024-04-25T17:19:22.266 INFO:tasks.workunit.client.0.smithi037.stdout:2/804: symlink d0/d7c/dee/lfe 0 2024-04-25T17:19:22.269 INFO:tasks.workunit.client.1.smithi069.stdout:3/741: dwrite d8/d16/d4b/d9e/dca/fe2 [0,4194304] 0 2024-04-25T17:19:22.269 INFO:tasks.workunit.client.0.smithi037.stdout:8/682: creat d5/db/d23/d78/d9c/fdf x:0 0 0 2024-04-25T17:19:22.271 INFO:tasks.workunit.client.1.smithi069.stdout:5/729: mknod d13/d17/d29/d2e/d76/cfd 0 2024-04-25T17:19:22.271 INFO:tasks.workunit.client.1.smithi069.stdout:3/742: fdatasync d8/d16/d1a/d2c/d49/d59/ff4 0 2024-04-25T17:19:22.271 INFO:tasks.workunit.client.1.smithi069.stdout:4/676: dwrite db/d15/d20/d38/f68 [0,4194304] 0 2024-04-25T17:19:22.272 INFO:tasks.workunit.client.0.smithi037.stdout:6/685: dwrite db/d26/d2e/d3e/fb6 [0,4194304] 0 2024-04-25T17:19:22.273 INFO:tasks.workunit.client.1.smithi069.stdout:5/730: stat d13/d17/d62/cf8 0 2024-04-25T17:19:22.273 INFO:tasks.workunit.client.1.smithi069.stdout:1/684: getdents d1/d4/d6 0 2024-04-25T17:19:22.276 INFO:tasks.workunit.client.1.smithi069.stdout:7/685: rename d4/d18/l98 to d4/d4c/le2 0 2024-04-25T17:19:22.281 INFO:tasks.workunit.client.0.smithi037.stdout:6/686: truncate db/f56 2984786 0 2024-04-25T17:19:22.281 INFO:tasks.workunit.client.1.smithi069.stdout:4/677: dwrite db/d15/d42/d64/fda [0,4194304] 0 2024-04-25T17:19:22.281 INFO:tasks.workunit.client.1.smithi069.stdout:5/731: dwrite d13/d17/d62/fc6 [0,4194304] 0 2024-04-25T17:19:22.283 INFO:tasks.workunit.client.1.smithi069.stdout:8/714: unlink d37/d47/fb1 0 2024-04-25T17:19:22.283 INFO:tasks.workunit.client.0.smithi037.stdout:2/805: truncate d0/d16/d3c/fbc 264142 0 2024-04-25T17:19:22.289 INFO:tasks.workunit.client.1.smithi069.stdout:9/664: link d2/da/dd/d1e/d2e/d68/dba/dd1/fdc d2/da4/dcf/d65/d88/db6/fe5 0 2024-04-25T17:19:22.292 INFO:tasks.workunit.client.1.smithi069.stdout:6/667: fsync d2/d1e/d43/dca/fd2 0 2024-04-25T17:19:22.294 INFO:tasks.workunit.client.1.smithi069.stdout:6/668: chown d2/fc1 191344170 1 2024-04-25T17:19:22.294 INFO:tasks.workunit.client.1.smithi069.stdout:6/669: chown d2/d1e/d43/ddc 378 1 2024-04-25T17:19:22.294 INFO:tasks.workunit.client.0.smithi037.stdout:6/687: creat db/d1d/ff4 x:0 0 0 2024-04-25T17:19:22.295 INFO:tasks.workunit.client.0.smithi037.stdout:1/877: write dc/d18/f2b [5124531,80842] 0 2024-04-25T17:19:22.295 INFO:tasks.workunit.client.1.smithi069.stdout:6/670: chown d2/d1e/d3f/d86/fb1 12 1 2024-04-25T17:19:22.297 INFO:tasks.workunit.client.1.smithi069.stdout:3/743: mknod d8/d16/d9b/cfd 0 2024-04-25T17:19:22.299 INFO:tasks.workunit.client.1.smithi069.stdout:3/744: write d8/d16/d1a/d2c/d49/fc4 [1021280,56425] 0 2024-04-25T17:19:22.300 INFO:tasks.workunit.client.0.smithi037.stdout:6/688: symlink db/d1d/lf5 0 2024-04-25T17:19:22.300 INFO:tasks.workunit.client.1.smithi069.stdout:0/598: sync 2024-04-25T17:19:22.301 INFO:tasks.workunit.client.1.smithi069.stdout:2/677: symlink d0/d56/d5f/d62/dbc/ld8 0 2024-04-25T17:19:22.304 INFO:tasks.workunit.client.1.smithi069.stdout:2/678: dread d0/d26/f23 [0,4194304] 0 2024-04-25T17:19:22.304 INFO:tasks.workunit.client.0.smithi037.stdout:8/683: truncate d5/db/d18/d3b/f9b 1004894 0 2024-04-25T17:19:22.306 INFO:tasks.workunit.client.1.smithi069.stdout:7/686: dread d4/d1a/f35 [0,4194304] 0 2024-04-25T17:19:22.309 INFO:tasks.workunit.client.1.smithi069.stdout:5/732: mknod d13/d17/d19/d20/d2d/d93/cfe 0 2024-04-25T17:19:22.310 INFO:tasks.workunit.client.0.smithi037.stdout:6/689: creat db/ff6 x:0 0 0 2024-04-25T17:19:22.312 INFO:tasks.workunit.client.1.smithi069.stdout:4/678: rename db/d15/d20/d35/d63/d43/d48/c95 to db/d4b/d78/dc4/d41/ce7 0 2024-04-25T17:19:22.314 INFO:tasks.workunit.client.1.smithi069.stdout:6/671: read d2/fe [2654367,123451] 0 2024-04-25T17:19:22.315 INFO:tasks.workunit.client.1.smithi069.stdout:1/685: truncate d1/d4/f4c 147217 0 2024-04-25T17:19:22.315 INFO:tasks.workunit.client.0.smithi037.stdout:6/690: dwrite db/d26/f27 [0,4194304] 0 2024-04-25T17:19:22.316 INFO:tasks.workunit.client.1.smithi069.stdout:0/599: mkdir d0/d17/d83/dcf 0 2024-04-25T17:19:22.318 INFO:tasks.workunit.client.1.smithi069.stdout:3/745: symlink d8/d16/d1a/d2c/d49/d87/d8a/dd7/dfc/lfe 0 2024-04-25T17:19:22.321 INFO:tasks.workunit.client.0.smithi037.stdout:2/806: dread d0/d15/f81 [0,4194304] 0 2024-04-25T17:19:22.322 INFO:tasks.workunit.client.0.smithi037.stdout:6/691: creat db/ff7 x:0 0 0 2024-04-25T17:19:22.323 INFO:tasks.workunit.client.1.smithi069.stdout:7/687: truncate d4/d3e/f9b 109021 0 2024-04-25T17:19:22.324 INFO:tasks.workunit.client.1.smithi069.stdout:7/688: chown d4/d3e/d94/da1/dc7/d14/d15 857 1 2024-04-25T17:19:22.324 INFO:tasks.workunit.client.1.smithi069.stdout:8/715: mknod d37/d47/cf0 0 2024-04-25T17:19:22.325 INFO:tasks.workunit.client.1.smithi069.stdout:3/746: dread d8/d71/f81 [0,4194304] 0 2024-04-25T17:19:22.325 INFO:tasks.workunit.client.1.smithi069.stdout:5/733: mkdir d13/dff 0 2024-04-25T17:19:22.325 INFO:tasks.workunit.client.0.smithi037.stdout:2/807: dread d0/d16/d20/d55/f80 [0,4194304] 0 2024-04-25T17:19:22.329 INFO:tasks.workunit.client.1.smithi069.stdout:5/734: dread - d13/d17/d29/d30/fda zero size 2024-04-25T17:19:22.329 INFO:tasks.workunit.client.1.smithi069.stdout:7/689: chown d4/d3e/d94/da1/dc7/d14/d44/d7c/d9f/dcb/la3 961214732 1 2024-04-25T17:19:22.329 INFO:tasks.workunit.client.1.smithi069.stdout:5/735: stat d13/d17/d19/d20/d2d/f46 0 2024-04-25T17:19:22.330 INFO:tasks.workunit.client.1.smithi069.stdout:5/736: chown fa 23 1 2024-04-25T17:19:22.331 INFO:tasks.workunit.client.1.smithi069.stdout:5/737: chown d13/d17/d19/d20/l73 0 1 2024-04-25T17:19:22.332 INFO:tasks.workunit.client.1.smithi069.stdout:5/738: readlink d13/d17/d19/l3e 0 2024-04-25T17:19:22.334 INFO:tasks.workunit.client.1.smithi069.stdout:0/600: mkdir d0/da/d6e/dd0 0 2024-04-25T17:19:22.337 INFO:tasks.workunit.client.1.smithi069.stdout:4/679: mknod db/d15/d42/d64/d7f/ce8 0 2024-04-25T17:19:22.338 INFO:tasks.workunit.client.0.smithi037.stdout:2/808: link d0/d23/dac/f8e d0/d16/d20/d59/d6a/dbe/fff 0 2024-04-25T17:19:22.339 INFO:tasks.workunit.client.1.smithi069.stdout:7/690: truncate d4/d1a/f35 423354 0 2024-04-25T17:19:22.343 INFO:tasks.workunit.client.1.smithi069.stdout:8/716: dread d37/d47/d54/fae [0,4194304] 0 2024-04-25T17:19:22.343 INFO:tasks.workunit.client.1.smithi069.stdout:0/601: unlink d0/l16 0 2024-04-25T17:19:22.344 INFO:tasks.workunit.client.0.smithi037.stdout:6/692: dread db/d1d/d20/d2f/f6e [0,4194304] 0 2024-04-25T17:19:22.347 INFO:tasks.workunit.client.1.smithi069.stdout:9/665: getdents d2/da4/dcf/d65/d88/db6 0 2024-04-25T17:19:22.349 INFO:tasks.workunit.client.0.smithi037.stdout:6/693: mkdir db/d1d/db1/dc7/df8 0 2024-04-25T17:19:22.352 INFO:tasks.workunit.client.1.smithi069.stdout:4/680: creat db/d22/fe9 x:0 0 0 2024-04-25T17:19:22.354 INFO:tasks.workunit.client.1.smithi069.stdout:3/747: truncate d8/d16/d1a/d2c/f4e 1797548 0 2024-04-25T17:19:22.355 INFO:tasks.workunit.client.1.smithi069.stdout:5/739: symlink d13/d17/d19/d1c/l100 0 2024-04-25T17:19:22.357 INFO:tasks.workunit.client.1.smithi069.stdout:7/691: rename d4/d3e/d94/da1/dc7/d14/d5a/f7f to d4/d3e/d94/da1/dc7/d14/d44/d79/fe3 0 2024-04-25T17:19:22.359 INFO:tasks.workunit.client.1.smithi069.stdout:0/602: rmdir d0/da/d24 39 2024-04-25T17:19:22.360 INFO:tasks.workunit.client.1.smithi069.stdout:2/679: getdents d0/d26/d10/d43/d99 0 2024-04-25T17:19:22.361 INFO:tasks.workunit.client.1.smithi069.stdout:6/672: write d2/d1e/d43/db6/f7c [258895,14022] 0 2024-04-25T17:19:22.361 INFO:tasks.workunit.client.1.smithi069.stdout:6/673: readlink d2/d1e/d3e/lab 0 2024-04-25T17:19:22.365 INFO:tasks.workunit.client.1.smithi069.stdout:4/681: chown db/d15/d20/d35/d63/d70/d8a/d96 13216778 1 2024-04-25T17:19:22.367 INFO:tasks.workunit.client.0.smithi037.stdout:2/809: write d0/d16/d20/f3d [1149547,3260] 0 2024-04-25T17:19:22.367 INFO:tasks.workunit.client.1.smithi069.stdout:3/748: rmdir d8/d71/d8d/d92 39 2024-04-25T17:19:22.370 INFO:tasks.workunit.client.1.smithi069.stdout:8/717: rename d37/d66/fde to d37/d66/d6b/daf/de6/ff1 0 2024-04-25T17:19:22.373 INFO:tasks.workunit.client.0.smithi037.stdout:2/810: mknod d0/d16/d20/d59/d6a/da5/dbd/c100 0 2024-04-25T17:19:22.374 INFO:tasks.workunit.client.1.smithi069.stdout:9/666: mkdir d2/da/dd/de0/de6 0 2024-04-25T17:19:22.375 INFO:tasks.workunit.client.0.smithi037.stdout:6/694: write db/d1d/d20/f5b [3028681,114764] 0 2024-04-25T17:19:22.376 INFO:tasks.workunit.client.1.smithi069.stdout:0/603: dread d0/da/db/d3a/f5a [0,4194304] 0 2024-04-25T17:19:22.376 INFO:tasks.workunit.client.1.smithi069.stdout:6/674: creat d2/d1e/d43/dca/fed x:0 0 0 2024-04-25T17:19:22.376 INFO:tasks.workunit.client.1.smithi069.stdout:9/667: write d2/da/d5f/dd3/fdd [202048,33304] 0 2024-04-25T17:19:22.378 INFO:tasks.workunit.client.0.smithi037.stdout:2/811: creat d0/d16/d20/d55/dc8/f101 x:0 0 0 2024-04-25T17:19:22.378 INFO:tasks.workunit.client.1.smithi069.stdout:6/675: write d2/d1e/d3f/d86/fb1 [954560,29051] 0 2024-04-25T17:19:22.380 INFO:tasks.workunit.client.0.smithi037.stdout:6/695: symlink db/d1d/lf9 0 2024-04-25T17:19:22.382 INFO:tasks.workunit.client.1.smithi069.stdout:0/604: dwrite d0/da/db/d2c/f4d [0,4194304] 0 2024-04-25T17:19:22.387 INFO:tasks.workunit.client.1.smithi069.stdout:4/682: rename db/d15/d20/d35/d63/d43/c61 to db/d15/d82/da7/cea 0 2024-04-25T17:19:22.387 INFO:tasks.workunit.client.1.smithi069.stdout:5/740: dread d13/d17/d19/f70 [0,4194304] 0 2024-04-25T17:19:22.390 INFO:tasks.workunit.client.1.smithi069.stdout:3/749: dwrite d8/d71/d8d/d92/db6/dc1/d42/fe5 [0,4194304] 0 2024-04-25T17:19:22.390 INFO:tasks.workunit.client.1.smithi069.stdout:4/683: fdatasync db/d15/d42/d64/fe1 0 2024-04-25T17:19:22.390 INFO:tasks.workunit.client.0.smithi037.stdout:6/696: dread db/d1d/fc6 [0,4194304] 0 2024-04-25T17:19:22.391 INFO:tasks.workunit.client.1.smithi069.stdout:5/741: truncate d13/d17/d29/fb4 1489413 0 2024-04-25T17:19:22.393 INFO:tasks.workunit.client.1.smithi069.stdout:5/742: write d13/d17/d29/d2e/f59 [2987113,105005] 0 2024-04-25T17:19:22.393 INFO:tasks.workunit.client.0.smithi037.stdout:6/697: read db/d26/d2e/d3e/fab [1127655,125060] 0 2024-04-25T17:19:22.398 INFO:tasks.workunit.client.0.smithi037.stdout:2/812: write d0/d23/d7d/f61 [2023972,48602] 0 2024-04-25T17:19:22.401 INFO:tasks.workunit.client.1.smithi069.stdout:6/676: rmdir d2/d1e/d43 39 2024-04-25T17:19:22.402 INFO:tasks.workunit.client.1.smithi069.stdout:6/677: truncate d2/d51/f93 213512 0 2024-04-25T17:19:22.404 INFO:tasks.workunit.client.0.smithi037.stdout:9/927: sync 2024-04-25T17:19:22.406 INFO:tasks.workunit.client.0.smithi037.stdout:2/813: dwrite d0/d16/d20/d59/d6a/dbe/ff6 [0,4194304] 0 2024-04-25T17:19:22.413 INFO:tasks.workunit.client.1.smithi069.stdout:9/668: write d2/da4/dcf/d65/d88/db6/fe5 [2092788,74875] 0 2024-04-25T17:19:22.414 INFO:tasks.workunit.client.0.smithi037.stdout:9/928: creat d1/d5/dc/d3c/dca/df5/f130 x:0 0 0 2024-04-25T17:19:22.415 INFO:tasks.workunit.client.0.smithi037.stdout:6/698: write db/d26/d2e/d3e/fb9 [2558799,92965] 0 2024-04-25T17:19:22.416 INFO:tasks.workunit.client.0.smithi037.stdout:9/929: write d1/d5/dc/f72 [4035918,1155] 0 2024-04-25T17:19:22.417 INFO:tasks.workunit.client.1.smithi069.stdout:7/692: creat d4/d3e/d94/da1/dc7/d14/d5a/fe4 x:0 0 0 2024-04-25T17:19:22.418 INFO:tasks.workunit.client.0.smithi037.stdout:2/814: fdatasync d0/d16/d20/d59/d6a/f99 0 2024-04-25T17:19:22.421 INFO:tasks.workunit.client.1.smithi069.stdout:8/718: rename f32 to d37/d47/d54/dcc/ff2 0 2024-04-25T17:19:22.424 INFO:tasks.workunit.client.1.smithi069.stdout:3/750: mkdir d8/d16/d1a/d2c/d49/d59/dff 0 2024-04-25T17:19:22.426 INFO:tasks.workunit.client.0.smithi037.stdout:6/699: rename db/d26/d2e/d7d to db/d1d/d20/dcf/dfa 0 2024-04-25T17:19:22.428 INFO:tasks.workunit.client.1.smithi069.stdout:4/684: mkdir db/d15/d20/d35/d63/d43/d48/d49/d72/deb 0 2024-04-25T17:19:22.432 INFO:tasks.workunit.client.0.smithi037.stdout:2/815: mknod d0/d16/d20/d59/d6a/da5/dbd/da9/c102 0 2024-04-25T17:19:22.433 INFO:tasks.workunit.client.0.smithi037.stdout:6/700: rmdir db/d1d/d20/dcf/dfa/dde 39 2024-04-25T17:19:22.434 INFO:tasks.workunit.client.1.smithi069.stdout:1/686: sync 2024-04-25T17:19:22.435 INFO:tasks.workunit.client.1.smithi069.stdout:1/687: stat d1/d4/d6/d9e/da6/cb3 0 2024-04-25T17:19:22.435 INFO:tasks.workunit.client.0.smithi037.stdout:9/930: symlink d1/d48/d68/d26/l131 0 2024-04-25T17:19:22.436 INFO:tasks.workunit.client.1.smithi069.stdout:1/688: dread - d1/d4/d6/d9e/da6/d7c/d1d/fb2 zero size 2024-04-25T17:19:22.437 INFO:tasks.workunit.client.1.smithi069.stdout:1/689: write d1/d4/d6/d9e/f8c [3837090,6298] 0 2024-04-25T17:19:22.439 INFO:tasks.workunit.client.1.smithi069.stdout:0/605: symlink d0/da/db/d2a/d9b/ld1 0 2024-04-25T17:19:22.440 INFO:tasks.workunit.client.1.smithi069.stdout:8/719: dread d37/d47/f60 [0,4194304] 0 2024-04-25T17:19:22.441 INFO:tasks.workunit.client.1.smithi069.stdout:7/693: creat d4/d4c/fe5 x:0 0 0 2024-04-25T17:19:22.442 INFO:tasks.workunit.client.0.smithi037.stdout:6/701: read db/d1d/d20/dcf/dfa/d65/f9c [3186995,70203] 0 2024-04-25T17:19:22.442 INFO:tasks.workunit.client.1.smithi069.stdout:7/694: fsync d4/d3e/d94/da1/dc7/d14/d44/d7c/d9f/dcb/f6b 0 2024-04-25T17:19:22.444 INFO:tasks.workunit.client.0.smithi037.stdout:9/931: symlink d1/d5/dc/dfa/l132 0 2024-04-25T17:19:22.445 INFO:tasks.workunit.client.1.smithi069.stdout:5/743: rename d13/d17/d19/d1c/da4/da9/ce5 to d13/d17/d29/d2e/d76/c101 0 2024-04-25T17:19:22.446 INFO:tasks.workunit.client.1.smithi069.stdout:5/744: chown d13/d17/d19/d8a/f95 24 1 2024-04-25T17:19:22.446 INFO:tasks.workunit.client.1.smithi069.stdout:3/751: symlink d8/d16/d1a/d38/l100 0 2024-04-25T17:19:22.448 INFO:tasks.workunit.client.0.smithi037.stdout:2/816: creat d0/d23/dac/f103 x:0 0 0 2024-04-25T17:19:22.450 INFO:tasks.workunit.client.1.smithi069.stdout:2/680: getdents d0/d56/d5f/d62 0 2024-04-25T17:19:22.451 INFO:tasks.workunit.client.1.smithi069.stdout:6/678: getdents d2/d9c/d97/d98/ddb 0 2024-04-25T17:19:22.457 INFO:tasks.workunit.client.0.smithi037.stdout:2/817: dwrite d0/d16/d20/d59/d6a/da5/ff0 [0,4194304] 0 2024-04-25T17:19:22.460 INFO:tasks.workunit.client.0.smithi037.stdout:6/702: getdents db/d26 0 2024-04-25T17:19:22.461 INFO:tasks.workunit.client.0.smithi037.stdout:9/932: dread d1/d5/d2e/d34/f108 [0,4194304] 0 2024-04-25T17:19:22.463 INFO:tasks.workunit.client.0.smithi037.stdout:9/933: write d1/d48/d112/f129 [154856,79780] 0 2024-04-25T17:19:22.466 INFO:tasks.workunit.client.1.smithi069.stdout:5/745: creat d13/d17/d29/d30/d5c/f102 x:0 0 0 2024-04-25T17:19:22.468 INFO:tasks.workunit.client.0.smithi037.stdout:2/818: truncate d0/d23/dac/fd4 760760 0 2024-04-25T17:19:22.469 INFO:tasks.workunit.client.0.smithi037.stdout:6/703: dwrite db/d1d/d20/dcf/dfa/d65/fdd [0,4194304] 0 2024-04-25T17:19:22.472 INFO:tasks.workunit.client.0.smithi037.stdout:9/934: symlink d1/d5/dc/d38/d8b/l133 0 2024-04-25T17:19:22.473 INFO:tasks.workunit.client.1.smithi069.stdout:4/685: symlink db/de3/lec 0 2024-04-25T17:19:22.475 INFO:tasks.workunit.client.1.smithi069.stdout:3/752: dwrite d8/d71/d8d/d92/db6/fda [0,4194304] 0 2024-04-25T17:19:22.475 INFO:tasks.workunit.client.1.smithi069.stdout:2/681: fsync d0/d26/d10/d43/fbe 0 2024-04-25T17:19:22.478 INFO:tasks.workunit.client.0.smithi037.stdout:6/704: mkdir db/d1d/d20/dcf/dfa/d65/d68/d87/dfb 0 2024-04-25T17:19:22.479 INFO:tasks.workunit.client.1.smithi069.stdout:6/679: read d2/d1e/d43/f53 [2252900,9678] 0 2024-04-25T17:19:22.479 INFO:tasks.workunit.client.0.smithi037.stdout:6/705: chown db/d1d/d20/d2f/dd2 200872 1 2024-04-25T17:19:22.480 INFO:tasks.workunit.client.0.smithi037.stdout:9/935: rmdir d1/d48/d68/d1c 39 2024-04-25T17:19:22.482 INFO:tasks.workunit.client.0.smithi037.stdout:2/819: symlink d0/d23/l104 0 2024-04-25T17:19:22.484 INFO:tasks.workunit.client.1.smithi069.stdout:8/720: link d37/d66/d6b/f96 d37/d47/d54/ff3 0 2024-04-25T17:19:22.486 INFO:tasks.workunit.client.1.smithi069.stdout:7/695: symlink d4/d3e/d94/da1/dc7/d14/d5a/le6 0 2024-04-25T17:19:22.491 INFO:tasks.workunit.client.1.smithi069.stdout:9/669: rename d2/da/dd/d1e/d2e/f47 to d2/da/dd/d1e/d40/fe7 0 2024-04-25T17:19:22.492 INFO:tasks.workunit.client.0.smithi037.stdout:2/820: mkdir d0/d16/d20/d59/d6a/d105 0 2024-04-25T17:19:22.492 INFO:tasks.workunit.client.0.smithi037.stdout:2/821: stat d0/d23/l5c 0 2024-04-25T17:19:22.494 INFO:tasks.workunit.client.1.smithi069.stdout:1/690: truncate d1/d4/d6/d9e/da6/f55 1189681 0 2024-04-25T17:19:22.495 INFO:tasks.workunit.client.1.smithi069.stdout:1/691: dread - d1/d4/d6/d4f/d9b/fac zero size 2024-04-25T17:19:22.495 INFO:tasks.workunit.client.0.smithi037.stdout:6/706: mknod db/d26/d2e/d3e/d25/cfc 0 2024-04-25T17:19:22.507 INFO:tasks.workunit.client.1.smithi069.stdout:6/680: unlink d2/d7/dbc/fc3 0 2024-04-25T17:19:22.507 INFO:tasks.workunit.client.1.smithi069.stdout:2/682: write d0/d26/f2f [584391,129786] 0 2024-04-25T17:19:22.508 INFO:tasks.workunit.client.0.smithi037.stdout:6/707: mkdir db/d1d/d20/dcf/dfa/dde/dfd 0 2024-04-25T17:19:22.510 INFO:tasks.workunit.client.0.smithi037.stdout:9/936: dread d1/d48/d68/d26/f80 [4194304,4194304] 0 2024-04-25T17:19:22.510 INFO:tasks.workunit.client.1.smithi069.stdout:8/721: symlink d37/d62/lf4 0 2024-04-25T17:19:22.511 INFO:tasks.workunit.client.1.smithi069.stdout:3/753: write d8/f20 [820150,20503] 0 2024-04-25T17:19:22.511 INFO:tasks.workunit.client.1.smithi069.stdout:8/722: stat d37/d47/d54/fca 0 2024-04-25T17:19:22.512 INFO:tasks.workunit.client.1.smithi069.stdout:1/692: dread d1/d4/d6/f31 [0,4194304] 0 2024-04-25T17:19:22.512 INFO:tasks.workunit.client.0.smithi037.stdout:9/937: stat d1/d5/dc/d38/l5c 0 2024-04-25T17:19:22.513 INFO:tasks.workunit.client.1.smithi069.stdout:7/696: creat d4/d83/fe7 x:0 0 0 2024-04-25T17:19:22.513 INFO:tasks.workunit.client.1.smithi069.stdout:8/723: dread - d37/d47/d54/fca zero size 2024-04-25T17:19:22.513 INFO:tasks.workunit.client.1.smithi069.stdout:1/693: readlink d1/d43/d5f/lcd 0 2024-04-25T17:19:22.513 INFO:tasks.workunit.client.0.smithi037.stdout:9/938: chown d1/c1f 21 1 2024-04-25T17:19:22.514 INFO:tasks.workunit.client.0.smithi037.stdout:2/822: dwrite d0/d15/f4f [0,4194304] 0 2024-04-25T17:19:22.514 INFO:tasks.workunit.client.1.smithi069.stdout:0/606: rename d0/da/d54/d7d/d8e/c96 to d0/d36/cd2 0 2024-04-25T17:19:22.516 INFO:tasks.workunit.client.0.smithi037.stdout:6/708: truncate db/d5a/f77 3235677 0 2024-04-25T17:19:22.517 INFO:tasks.workunit.client.1.smithi069.stdout:9/670: symlink d2/da4/dcf/le8 0 2024-04-25T17:19:22.519 INFO:tasks.workunit.client.0.smithi037.stdout:9/939: creat d1/d5/dc/f134 x:0 0 0 2024-04-25T17:19:22.522 INFO:tasks.workunit.client.0.smithi037.stdout:2/823: unlink d0/d23/dac/f65 0 2024-04-25T17:19:22.522 INFO:tasks.workunit.client.0.smithi037.stdout:2/824: readlink d0/ld3 0 2024-04-25T17:19:22.523 INFO:tasks.workunit.client.0.smithi037.stdout:6/709: dwrite db/ff6 [0,4194304] 0 2024-04-25T17:19:22.524 INFO:tasks.workunit.client.1.smithi069.stdout:7/697: dread d4/d1a/d34/f68 [0,4194304] 0 2024-04-25T17:19:22.528 INFO:tasks.workunit.client.1.smithi069.stdout:3/754: chown d8/d16/d1a/d2c/d49/d59/f6b 229926 1 2024-04-25T17:19:22.529 INFO:tasks.workunit.client.1.smithi069.stdout:8/724: creat d37/d47/d48/d8e/ff5 x:0 0 0 2024-04-25T17:19:22.533 INFO:tasks.workunit.client.1.smithi069.stdout:5/746: rename d13/d17/d19/d20/d51/ff3 to d13/d17/dd4/f103 0 2024-04-25T17:19:22.533 INFO:tasks.workunit.client.1.smithi069.stdout:5/747: chown c10 2161136 1 2024-04-25T17:19:22.534 INFO:tasks.workunit.client.1.smithi069.stdout:0/607: dread - d0/da/d24/d67/fbb zero size 2024-04-25T17:19:22.536 INFO:tasks.workunit.client.1.smithi069.stdout:9/671: truncate d2/da/dd/d1e/d2e/f45 4237029 0 2024-04-25T17:19:22.539 INFO:tasks.workunit.client.1.smithi069.stdout:4/686: creat db/d4b/d78/fed x:0 0 0 2024-04-25T17:19:22.541 INFO:tasks.workunit.client.1.smithi069.stdout:4/687: write db/d15/d20/d35/d63/d43/d48/d6c/fe2 [207270,11120] 0 2024-04-25T17:19:22.542 INFO:tasks.workunit.client.1.smithi069.stdout:6/681: creat d2/d9c/d97/d98/ddb/fee x:0 0 0 2024-04-25T17:19:22.546 INFO:tasks.workunit.client.1.smithi069.stdout:3/755: mkdir d8/d16/d1a/d2c/d49/d87/d8a/d8e/d101 0 2024-04-25T17:19:22.546 INFO:tasks.workunit.client.1.smithi069.stdout:3/756: stat d8/d71/d8d/d92/db6/dc1/d42/f7e 0 2024-04-25T17:19:22.550 INFO:tasks.workunit.client.1.smithi069.stdout:0/608: rmdir d0/da/d24/d67/db8 39 2024-04-25T17:19:22.552 INFO:tasks.workunit.client.1.smithi069.stdout:9/672: mknod d2/da/dd/d1e/d2e/ce9 0 2024-04-25T17:19:22.553 INFO:tasks.workunit.client.1.smithi069.stdout:9/673: fdatasync d2/da/dd/f31 0 2024-04-25T17:19:22.553 INFO:tasks.workunit.client.0.smithi037.stdout:2/825: dwrite d0/d23/dac/d4b/f91 [0,4194304] 0 2024-04-25T17:19:22.554 INFO:tasks.workunit.client.1.smithi069.stdout:7/698: creat d4/d83/da2/dd3/fe8 x:0 0 0 2024-04-25T17:19:22.554 INFO:tasks.workunit.client.1.smithi069.stdout:9/674: chown d2/da/dd/d1e/d40/cdf 88871904 1 2024-04-25T17:19:22.555 INFO:tasks.workunit.client.0.smithi037.stdout:2/826: stat d0/d16/d20/d59/d6a/da5/dbd/cec 0 2024-04-25T17:19:22.556 INFO:tasks.workunit.client.1.smithi069.stdout:4/688: creat db/d22/fee x:0 0 0 2024-04-25T17:19:22.559 INFO:tasks.workunit.client.1.smithi069.stdout:6/682: mkdir d2/d1e/d43/def 0 2024-04-25T17:19:22.560 INFO:tasks.workunit.client.1.smithi069.stdout:6/683: chown d2/d1e/d43/db6/daf 109 1 2024-04-25T17:19:22.564 INFO:tasks.workunit.client.1.smithi069.stdout:1/694: getdents d1/d4/de/d63 0 2024-04-25T17:19:22.569 INFO:tasks.workunit.client.0.smithi037.stdout:9/940: dwrite d1/d5/dc/f11 [0,4194304] 0 2024-04-25T17:19:22.570 INFO:tasks.workunit.client.1.smithi069.stdout:7/699: creat d4/d3e/d94/da1/dc7/d14/d44/d7c/d9f/fe9 x:0 0 0 2024-04-25T17:19:22.571 INFO:tasks.workunit.client.0.smithi037.stdout:9/941: write d1/d5/d2e/d34/d76/db4/d119/f67 [1752635,60379] 0 2024-04-25T17:19:22.574 INFO:tasks.workunit.client.1.smithi069.stdout:7/700: write d4/d1a/d34/f68 [2325063,30082] 0 2024-04-25T17:19:22.574 INFO:tasks.workunit.client.1.smithi069.stdout:9/675: symlink d2/da/dd/de/d64/dd2/lea 0 2024-04-25T17:19:22.574 INFO:tasks.workunit.client.1.smithi069.stdout:0/609: dread - d0/da/db/d1d/d5f/f93 zero size 2024-04-25T17:19:22.576 INFO:tasks.workunit.client.1.smithi069.stdout:4/689: symlink db/d15/d42/d64/lef 0 2024-04-25T17:19:22.576 INFO:tasks.workunit.client.1.smithi069.stdout:1/695: creat d1/d4/d6/d4f/dcb/fd4 x:0 0 0 2024-04-25T17:19:22.578 INFO:tasks.workunit.client.1.smithi069.stdout:4/690: write db/d15/d26/f62 [1966455,26635] 0 2024-04-25T17:19:22.581 INFO:tasks.workunit.client.1.smithi069.stdout:2/683: rename d0/d56/d5f/d62/d7d/d31/c55 to d0/d1/cd9 0 2024-04-25T17:19:22.582 INFO:tasks.workunit.client.1.smithi069.stdout:9/676: symlink d2/da4/dcf/d65/d88/leb 0 2024-04-25T17:19:22.583 INFO:tasks.workunit.client.1.smithi069.stdout:8/725: write f33 [5068716,118101] 0 2024-04-25T17:19:22.584 INFO:tasks.workunit.client.1.smithi069.stdout:0/610: symlink d0/da/db/d56/ld3 0 2024-04-25T17:19:22.588 INFO:tasks.workunit.client.1.smithi069.stdout:4/691: symlink db/d15/d20/d35/d63/d75/lf0 0 2024-04-25T17:19:22.590 INFO:tasks.workunit.client.0.smithi037.stdout:7/652: sync 2024-04-25T17:19:22.590 INFO:tasks.workunit.client.1.smithi069.stdout:2/684: creat d0/d26/d10/d43/fda x:0 0 0 2024-04-25T17:19:22.591 INFO:tasks.workunit.client.0.smithi037.stdout:2/827: dwrite d0/d23/dfb/dc4/fe9 [0,4194304] 0 2024-04-25T17:19:22.591 INFO:tasks.workunit.client.0.smithi037.stdout:7/653: chown d5/d15/d17/d1b/f88 13 1 2024-04-25T17:19:22.592 INFO:tasks.workunit.client.0.smithi037.stdout:7/654: chown d5/d15 3692 1 2024-04-25T17:19:22.592 INFO:tasks.workunit.client.1.smithi069.stdout:9/677: mknod d2/da/dd/de/d64/cec 0 2024-04-25T17:19:22.602 INFO:tasks.workunit.client.0.smithi037.stdout:9/942: dwrite d1/d5/dc/f4a [0,4194304] 0 2024-04-25T17:19:22.604 INFO:tasks.workunit.client.1.smithi069.stdout:1/696: write d1/d43/f3a [2463431,56312] 0 2024-04-25T17:19:22.610 INFO:tasks.workunit.client.1.smithi069.stdout:8/726: truncate d37/d47/d78/f88 301619 0 2024-04-25T17:19:22.610 INFO:tasks.workunit.client.1.smithi069.stdout:0/611: write d0/da/d24/d67/db8/fbe [1700598,43412] 0 2024-04-25T17:19:22.611 INFO:tasks.workunit.client.0.smithi037.stdout:2/828: link d0/l76 d0/d16/d20/d59/d6a/da5/l106 0 2024-04-25T17:19:22.611 INFO:tasks.workunit.client.1.smithi069.stdout:0/612: readlink d0/da/l3d 0 2024-04-25T17:19:22.612 INFO:tasks.workunit.client.0.smithi037.stdout:7/655: write d5/d15/d17/d1b/da2/daf/f3d [2008939,87532] 0 2024-04-25T17:19:22.614 INFO:tasks.workunit.client.1.smithi069.stdout:3/757: rename d8/d16/d1a/d38/f4c to d8/d71/d8d/f102 0 2024-04-25T17:19:22.615 INFO:tasks.workunit.client.0.smithi037.stdout:2/829: dread d0/d15/f81 [0,4194304] 0 2024-04-25T17:19:22.615 INFO:tasks.workunit.client.1.smithi069.stdout:3/758: chown d8/d71/f85 6775740 1 2024-04-25T17:19:22.616 INFO:tasks.workunit.client.1.smithi069.stdout:3/759: fsync d8/d16/d1a/d99/fa7 0 2024-04-25T17:19:22.618 INFO:tasks.workunit.client.1.smithi069.stdout:1/697: truncate d1/f79 8408689 0 2024-04-25T17:19:22.619 INFO:tasks.workunit.client.0.smithi037.stdout:2/830: mknod d0/d15/d2a/d5a/c107 0 2024-04-25T17:19:22.620 INFO:tasks.workunit.client.0.smithi037.stdout:2/831: chown d0/d16/d20/d55 39977 1 2024-04-25T17:19:22.622 INFO:tasks.workunit.client.1.smithi069.stdout:8/727: creat d37/d47/d54/ff6 x:0 0 0 2024-04-25T17:19:22.623 INFO:tasks.workunit.client.1.smithi069.stdout:0/613: rmdir d0/da/db/d2c 39 2024-04-25T17:19:22.623 INFO:tasks.workunit.client.0.smithi037.stdout:9/943: write d1/d5/dc/f27 [8061540,36648] 0 2024-04-25T17:19:22.624 INFO:tasks.workunit.client.0.smithi037.stdout:7/656: truncate d5/d15/d17/d25/d2b/fd2 2015937 0 2024-04-25T17:19:22.626 INFO:tasks.workunit.client.0.smithi037.stdout:7/657: truncate d5/d14/d31/f93 5230431 0 2024-04-25T17:19:22.627 INFO:tasks.workunit.client.1.smithi069.stdout:4/692: rename db/d15/d42/l8e to db/d15/d20/d35/d63/d70/d8a/lf1 0 2024-04-25T17:19:22.629 INFO:tasks.workunit.client.0.smithi037.stdout:7/658: rmdir d5/d14/dd3 39 2024-04-25T17:19:22.629 INFO:tasks.workunit.client.1.smithi069.stdout:2/685: link d0/d26/d10/lb3 d0/d26/d10/d43/d99/ldb 0 2024-04-25T17:19:22.631 INFO:tasks.workunit.client.1.smithi069.stdout:1/698: mknod d1/d4/de/d44/d68/cd5 0 2024-04-25T17:19:22.631 INFO:tasks.workunit.client.1.smithi069.stdout:2/686: write d0/d1/d5b/d33/f67 [1114432,130450] 0 2024-04-25T17:19:22.632 INFO:tasks.workunit.client.1.smithi069.stdout:1/699: chown d1/d4/d6/d9e/da6/d7c/d1d 0 1 2024-04-25T17:19:22.635 INFO:tasks.workunit.client.1.smithi069.stdout:4/693: mkdir db/d4b/d78/dc4/d41/d9e/df2 0 2024-04-25T17:19:22.638 INFO:tasks.workunit.client.0.smithi037.stdout:2/832: write d0/d15/f37 [1410027,39031] 0 2024-04-25T17:19:22.639 INFO:tasks.workunit.client.0.smithi037.stdout:2/833: chown d0/d23/dfb/db0/lc6 2451 1 2024-04-25T17:19:22.640 INFO:tasks.workunit.client.1.smithi069.stdout:8/728: creat d37/d47/d54/de9/ff7 x:0 0 0 2024-04-25T17:19:22.640 INFO:tasks.workunit.client.0.smithi037.stdout:2/834: stat d0/d16/d20/d59/f8b 0 2024-04-25T17:19:22.641 INFO:tasks.workunit.client.1.smithi069.stdout:2/687: rmdir d0/d1/d5b/d33 39 2024-04-25T17:19:22.643 INFO:tasks.workunit.client.0.smithi037.stdout:9/944: dread d1/d48/d68/d26/f80 [0,4194304] 0 2024-04-25T17:19:22.645 INFO:tasks.workunit.client.1.smithi069.stdout:8/729: dwrite d37/d62/f8f [0,4194304] 0 2024-04-25T17:19:22.645 INFO:tasks.workunit.client.1.smithi069.stdout:1/700: truncate d1/d4/d6/d9e/da6/d7c/d4d/f57 308579 0 2024-04-25T17:19:22.648 INFO:tasks.workunit.client.1.smithi069.stdout:3/760: link d8/d16/d1a/d2c/d49/d59/c64 d8/d16/d4b/d9e/da5/c103 0 2024-04-25T17:19:22.649 INFO:tasks.workunit.client.1.smithi069.stdout:3/761: fdatasync d8/d16/d31/f44 0 2024-04-25T17:19:22.649 INFO:tasks.workunit.client.0.smithi037.stdout:9/945: mkdir d1/d48/d112/d135 0 2024-04-25T17:19:22.650 INFO:tasks.workunit.client.0.smithi037.stdout:9/946: stat d1/d5/d19 0 2024-04-25T17:19:22.652 INFO:tasks.workunit.client.0.smithi037.stdout:9/947: dread - d1/d48/d68/d26/da1/f12d zero size 2024-04-25T17:19:22.652 INFO:tasks.workunit.client.1.smithi069.stdout:0/614: creat d0/da/db/d3a/fd4 x:0 0 0 2024-04-25T17:19:22.654 INFO:tasks.workunit.client.1.smithi069.stdout:1/701: truncate d1/d4/d6/d9e/da6/fd2 5221164 0 2024-04-25T17:19:22.656 INFO:tasks.workunit.client.1.smithi069.stdout:3/762: truncate d8/d16/d1a/d2c/d6c/f8c 716128 0 2024-04-25T17:19:22.657 INFO:tasks.workunit.client.0.smithi037.stdout:2/835: dread d0/d16/d20/d55/f6f [4194304,4194304] 0 2024-04-25T17:19:22.657 INFO:tasks.workunit.client.1.smithi069.stdout:3/763: dread - d8/d16/d1a/d99/ffb zero size 2024-04-25T17:19:22.659 INFO:tasks.workunit.client.0.smithi037.stdout:9/948: mknod d1/d48/d68/d26/d81/c136 0 2024-04-25T17:19:22.661 INFO:tasks.workunit.client.1.smithi069.stdout:2/688: rename d0/d56/c52 to d0/d56/d5f/d62/d7d/d72/daf/dc2/cdc 0 2024-04-25T17:19:22.663 INFO:tasks.workunit.client.1.smithi069.stdout:0/615: mkdir d0/d17/d83/dcf/dd5 0 2024-04-25T17:19:22.664 INFO:tasks.workunit.client.0.smithi037.stdout:2/836: mknod d0/d23/dac/d4b/ded/c108 0 2024-04-25T17:19:22.664 INFO:tasks.workunit.client.1.smithi069.stdout:0/616: stat d0/da/db/d7e/d80/da9 0 2024-04-25T17:19:22.665 INFO:tasks.workunit.client.0.smithi037.stdout:9/949: dwrite d1/d48/d112/f129 [0,4194304] 0 2024-04-25T17:19:22.667 INFO:tasks.workunit.client.1.smithi069.stdout:4/694: getdents db/d15/d20/d38 0 2024-04-25T17:19:22.668 INFO:tasks.workunit.client.1.smithi069.stdout:3/764: dread d8/d39/f89 [0,4194304] 0 2024-04-25T17:19:22.669 INFO:tasks.workunit.client.0.smithi037.stdout:2/837: read d0/d16/d20/d59/d6a/f8c [495691,9025] 0 2024-04-25T17:19:22.669 INFO:tasks.workunit.client.1.smithi069.stdout:2/689: unlink d0/d56/d5f/d62/d7d/d31/c35 0 2024-04-25T17:19:22.670 INFO:tasks.workunit.client.0.smithi037.stdout:2/838: fsync d0/d15/fe2 0 2024-04-25T17:19:22.671 INFO:tasks.workunit.client.0.smithi037.stdout:9/950: mknod d1/d48/d68/d26/da1/c137 0 2024-04-25T17:19:22.672 INFO:tasks.workunit.client.0.smithi037.stdout:2/839: stat d0/d16/d20/d59/d6a/da5/dbd/da9/c102 0 2024-04-25T17:19:22.672 INFO:tasks.workunit.client.1.smithi069.stdout:0/617: truncate d0/da/d24/d43/f92 169520 0 2024-04-25T17:19:22.673 INFO:tasks.workunit.client.1.smithi069.stdout:8/730: link d37/d47/d54/d6e/d98/lc4 d37/d66/lf8 0 2024-04-25T17:19:22.673 INFO:tasks.workunit.client.1.smithi069.stdout:0/618: write d0/da/d59/fc3 [975423,75070] 0 2024-04-25T17:19:22.677 INFO:tasks.workunit.client.0.smithi037.stdout:2/840: dread d0/d23/fdb [0,4194304] 0 2024-04-25T17:19:22.678 INFO:tasks.workunit.client.0.smithi037.stdout:9/951: stat d1/d5/dc/d38/d8b/ccf 0 2024-04-25T17:19:22.681 INFO:tasks.workunit.client.1.smithi069.stdout:3/765: creat d8/d16/d1a/d2c/d49/d87/f104 x:0 0 0 2024-04-25T17:19:22.682 INFO:tasks.workunit.client.0.smithi037.stdout:2/841: symlink d0/d16/d20/db9/l109 0 2024-04-25T17:19:22.685 INFO:tasks.workunit.client.0.smithi037.stdout:9/952: symlink d1/d48/d68/d26/da1/l138 0 2024-04-25T17:19:22.690 INFO:tasks.workunit.client.1.smithi069.stdout:8/731: rename d37/d47/d54/de9 to d37/d47/d78/d93/df9 0 2024-04-25T17:19:22.691 INFO:tasks.workunit.client.1.smithi069.stdout:1/702: getdents d1/d4/d6/d4f/dcb 0 2024-04-25T17:19:22.691 INFO:tasks.workunit.client.1.smithi069.stdout:8/732: read d37/d47/d78/d93/f94 [505141,88704] 0 2024-04-25T17:19:22.692 INFO:tasks.workunit.client.1.smithi069.stdout:1/703: fdatasync d1/d4/de/f91 0 2024-04-25T17:19:22.693 INFO:tasks.workunit.client.1.smithi069.stdout:4/695: creat db/db0/ff3 x:0 0 0 2024-04-25T17:19:22.693 INFO:tasks.workunit.client.0.smithi037.stdout:2/842: getdents d0/d16/d20/d59/d6a/d105 0 2024-04-25T17:19:22.695 INFO:tasks.workunit.client.0.smithi037.stdout:9/953: symlink d1/d48/d68/d26/d81/l139 0 2024-04-25T17:19:22.696 INFO:tasks.workunit.client.1.smithi069.stdout:2/690: mkdir d0/d56/d5f/d62/d7d/d72/daf/dc2/ddd 0 2024-04-25T17:19:22.697 INFO:tasks.workunit.client.0.smithi037.stdout:2/843: chown d0/d16/d3c/fbc 11935505 1 2024-04-25T17:19:22.697 INFO:tasks.workunit.client.1.smithi069.stdout:2/691: read - d0/d26/d10/d43/fda zero size 2024-04-25T17:19:22.698 INFO:tasks.workunit.client.1.smithi069.stdout:1/704: dwrite d1/d43/d1b/d32/d4a/fb7 [0,4194304] 0 2024-04-25T17:19:22.698 INFO:tasks.workunit.client.0.smithi037.stdout:9/954: chown d1/d5/dc/f72 0 1 2024-04-25T17:19:22.703 INFO:tasks.workunit.client.1.smithi069.stdout:9/678: sync 2024-04-25T17:19:22.703 INFO:tasks.workunit.client.1.smithi069.stdout:5/748: sync 2024-04-25T17:19:22.703 INFO:tasks.workunit.client.1.smithi069.stdout:6/684: sync 2024-04-25T17:19:22.703 INFO:tasks.workunit.client.1.smithi069.stdout:7/701: sync 2024-04-25T17:19:22.703 INFO:tasks.workunit.client.0.smithi037.stdout:2/844: dwrite d0/f9 [0,4194304] 0 2024-04-25T17:19:22.704 INFO:tasks.workunit.client.1.smithi069.stdout:3/766: rename f5 to d8/d16/d4b/d9e/dca/f105 0 2024-04-25T17:19:22.706 INFO:tasks.workunit.client.0.smithi037.stdout:9/955: creat d1/d5/d2e/d34/daf/f13a x:0 0 0 2024-04-25T17:19:22.711 INFO:tasks.workunit.client.1.smithi069.stdout:5/749: dwrite d13/d17/d29/d2e/d76/faf [4194304,4194304] 0 2024-04-25T17:19:22.714 INFO:tasks.workunit.client.0.smithi037.stdout:9/956: rename d1/d5/dc/d38 to d1/d5/d19/d13b 0 2024-04-25T17:19:22.716 INFO:tasks.workunit.client.1.smithi069.stdout:4/696: mkdir db/d15/d82/df4 0 2024-04-25T17:19:22.717 INFO:tasks.workunit.client.1.smithi069.stdout:4/697: chown db/d15/d20/d35/d63/d43/d48/d49/f5a 12330 1 2024-04-25T17:19:22.720 INFO:tasks.workunit.client.1.smithi069.stdout:0/619: write d0/da/db/d2c/f33 [1372475,57129] 0 2024-04-25T17:19:22.724 INFO:tasks.workunit.client.1.smithi069.stdout:2/692: creat d0/d26/d36/dc5/fde x:0 0 0 2024-04-25T17:19:22.725 INFO:tasks.workunit.client.1.smithi069.stdout:2/693: readlink d0/l9a 0 2024-04-25T17:19:22.726 INFO:tasks.workunit.client.0.smithi037.stdout:9/957: symlink d1/d48/d68/d26/d81/d9c/da4/l13c 0 2024-04-25T17:19:22.732 INFO:tasks.workunit.client.0.smithi037.stdout:9/958: rmdir d1/d5/dc/d3c/d3e/d103 39 2024-04-25T17:19:22.735 INFO:tasks.workunit.client.1.smithi069.stdout:5/750: symlink d13/d17/d19/d1c/da4/l104 0 2024-04-25T17:19:22.736 INFO:tasks.workunit.client.1.smithi069.stdout:5/751: fsync d13/d17/d19/d20/f9a 0 2024-04-25T17:19:22.737 INFO:tasks.workunit.client.0.smithi037.stdout:9/959: creat d1/d48/d121/f13d x:0 0 0 2024-04-25T17:19:22.737 INFO:tasks.workunit.client.1.smithi069.stdout:5/752: dread - d13/d17/d19/d1c/da4/da9/fca zero size 2024-04-25T17:19:22.738 INFO:tasks.workunit.client.1.smithi069.stdout:0/620: rename d0/da/f10 to d0/da/d54/d7d/fd6 0 2024-04-25T17:19:22.740 INFO:tasks.workunit.client.1.smithi069.stdout:8/733: dwrite d37/d47/d78/d93/fb6 [0,4194304] 0 2024-04-25T17:19:22.740 INFO:tasks.workunit.client.1.smithi069.stdout:8/734: dread - d37/d47/d54/d6e/fba zero size 2024-04-25T17:19:22.742 INFO:tasks.workunit.client.1.smithi069.stdout:1/705: creat d1/d43/d1b/d32/d4a/d4b/fd6 x:0 0 0 2024-04-25T17:19:22.742 INFO:tasks.workunit.client.1.smithi069.stdout:8/735: truncate d37/d47/d78/fdb 568221 0 2024-04-25T17:19:22.744 INFO:tasks.workunit.client.1.smithi069.stdout:7/702: unlink d4/d1a/c3a 0 2024-04-25T17:19:22.746 INFO:tasks.workunit.client.1.smithi069.stdout:7/703: chown d4/d3e/d94/da1/dc7/d14/c25 1 1 2024-04-25T17:19:22.746 INFO:tasks.workunit.client.1.smithi069.stdout:9/679: mkdir d2/da/dd/d1e/d2e/d68/dba/ded 0 2024-04-25T17:19:22.747 INFO:tasks.workunit.client.1.smithi069.stdout:3/767: getdents d8/d16/d1a/d2c/d49/d87/d8a/d8e/d95 0 2024-04-25T17:19:22.748 INFO:tasks.workunit.client.1.smithi069.stdout:6/685: dwrite d2/f21 [4194304,4194304] 0 2024-04-25T17:19:22.749 INFO:tasks.workunit.client.1.smithi069.stdout:9/680: write d2/da/d14/f37 [2174345,90282] 0 2024-04-25T17:19:22.750 INFO:tasks.workunit.client.1.smithi069.stdout:7/704: truncate d4/d3e/d94/da1/dc7/f92 1594942 0 2024-04-25T17:19:22.752 INFO:tasks.workunit.client.0.smithi037.stdout:9/960: dwrite d1/d48/d68/f74 [0,4194304] 0 2024-04-25T17:19:22.756 INFO:tasks.workunit.client.1.smithi069.stdout:8/736: mknod d37/d47/d78/d93/df9/cfa 0 2024-04-25T17:19:22.758 INFO:tasks.workunit.client.1.smithi069.stdout:4/698: creat db/d15/d20/d35/d63/ff5 x:0 0 0 2024-04-25T17:19:22.758 INFO:tasks.workunit.client.0.smithi037.stdout:9/961: creat d1/d5/d19/d13b/d8b/d10f/f13e x:0 0 0 2024-04-25T17:19:22.759 INFO:tasks.workunit.client.1.smithi069.stdout:4/699: chown db/d15/d42/d53/l73 807732 1 2024-04-25T17:19:22.759 INFO:tasks.workunit.client.1.smithi069.stdout:4/700: fdatasync db/d22/fe9 0 2024-04-25T17:19:22.759 INFO:tasks.workunit.client.1.smithi069.stdout:6/686: rmdir d2/d1e/d43/db6/daf/dbe 39 2024-04-25T17:19:22.760 INFO:tasks.workunit.client.1.smithi069.stdout:9/681: symlink d2/d51/lee 0 2024-04-25T17:19:22.761 INFO:tasks.workunit.client.1.smithi069.stdout:1/706: read d1/df/f33 [368356,106498] 0 2024-04-25T17:19:22.762 INFO:tasks.workunit.client.1.smithi069.stdout:7/705: read - d4/d3e/d94/da1/dc7/f8a zero size 2024-04-25T17:19:22.764 INFO:tasks.workunit.client.0.smithi037.stdout:9/962: symlink d1/d5/dc/d3c/l13f 0 2024-04-25T17:19:22.764 INFO:tasks.workunit.client.1.smithi069.stdout:1/707: chown d1/d4/d6/d9e/da6/lcc 597 1 2024-04-25T17:19:22.764 INFO:tasks.workunit.client.1.smithi069.stdout:0/621: write d0/da/d24/f6d [4070287,19414] 0 2024-04-25T17:19:22.766 INFO:tasks.workunit.client.1.smithi069.stdout:3/768: rename d8/d16/d4b/d9e/dca/f105 to d8/d16/d1a/d2c/d49/d87/d8a/d8e/d95/f106 0 2024-04-25T17:19:22.766 INFO:tasks.workunit.client.1.smithi069.stdout:5/753: rmdir d13/d17/da5 39 2024-04-25T17:19:22.769 INFO:tasks.workunit.client.0.smithi037.stdout:9/963: rmdir d1/d48/d68/d1c 39 2024-04-25T17:19:22.769 INFO:tasks.workunit.client.1.smithi069.stdout:9/682: dwrite d2/da/dd/f50 [4194304,4194304] 0 2024-04-25T17:19:22.769 INFO:tasks.workunit.client.1.smithi069.stdout:5/754: dread - d13/d17/d29/ff4 zero size 2024-04-25T17:19:22.770 INFO:tasks.workunit.client.0.smithi037.stdout:9/964: dread - d1/d5/d19/d13b/d8b/fc9 zero size 2024-04-25T17:19:22.772 INFO:tasks.workunit.client.0.smithi037.stdout:5/762: sync 2024-04-25T17:19:22.772 INFO:tasks.workunit.client.1.smithi069.stdout:0/622: read d0/d17/f4a [672293,20020] 0 2024-04-25T17:19:22.772 INFO:tasks.workunit.client.0.smithi037.stdout:5/763: stat d7 0 2024-04-25T17:19:22.773 INFO:tasks.workunit.client.0.smithi037.stdout:9/965: rmdir d1/d5 39 2024-04-25T17:19:22.774 INFO:tasks.workunit.client.1.smithi069.stdout:5/755: read d13/d17/d29/fb4 [74446,64679] 0 2024-04-25T17:19:22.775 INFO:tasks.workunit.client.1.smithi069.stdout:0/623: dread - d0/da/db/d1d/d89/fbc zero size 2024-04-25T17:19:22.775 INFO:tasks.workunit.client.1.smithi069.stdout:2/694: dwrite d0/d1/d5b/d33/f39 [0,4194304] 0 2024-04-25T17:19:22.778 INFO:tasks.workunit.client.0.smithi037.stdout:9/966: creat d1/d48/d121/f140 x:0 0 0 2024-04-25T17:19:22.780 INFO:tasks.workunit.client.1.smithi069.stdout:6/687: dwrite d2/d1e/d43/dca/dce/fd9 [0,4194304] 0 2024-04-25T17:19:22.785 INFO:tasks.workunit.client.0.smithi037.stdout:9/967: write d1/d5/d19/d13b/d8b/f60 [2644881,16371] 0 2024-04-25T17:19:22.794 INFO:tasks.workunit.client.1.smithi069.stdout:5/756: write d13/d17/d19/d1c/d6c/fb1 [42056,111057] 0 2024-04-25T17:19:22.795 INFO:tasks.workunit.client.0.smithi037.stdout:9/968: chown d1/d5/dc/f47 2774 1 2024-04-25T17:19:22.797 INFO:tasks.workunit.client.1.smithi069.stdout:2/695: symlink d0/d56/d5f/d62/d7d/d72/ldf 0 2024-04-25T17:19:22.799 INFO:tasks.workunit.client.1.smithi069.stdout:8/737: dread d37/f41 [0,4194304] 0 2024-04-25T17:19:22.799 INFO:tasks.workunit.client.1.smithi069.stdout:3/769: mkdir d8/d16/d1a/d2c/d49/d59/dff/d107 0 2024-04-25T17:19:22.800 INFO:tasks.workunit.client.1.smithi069.stdout:8/738: dread - d37/d47/d78/d93/df9/ff7 zero size 2024-04-25T17:19:22.800 INFO:tasks.workunit.client.0.smithi037.stdout:5/764: dwrite d7/d12/d6f/d68/f76 [0,4194304] 0 2024-04-25T17:19:22.806 INFO:tasks.workunit.client.1.smithi069.stdout:9/683: dread d2/da/d14/f18 [0,4194304] 0 2024-04-25T17:19:22.807 INFO:tasks.workunit.client.1.smithi069.stdout:9/684: chown d2/da/dd/d1e/c1f 12 1 2024-04-25T17:19:22.810 INFO:tasks.workunit.client.1.smithi069.stdout:7/706: creat d4/d3e/d94/da1/dc7/d14/fea x:0 0 0 2024-04-25T17:19:22.814 INFO:tasks.workunit.client.1.smithi069.stdout:6/688: write d2/d1e/d3f/fe0 [1550506,63038] 0 2024-04-25T17:19:22.819 INFO:tasks.workunit.client.1.smithi069.stdout:2/696: write d0/d1/fe [60433,69062] 0 2024-04-25T17:19:22.823 INFO:tasks.workunit.client.1.smithi069.stdout:3/770: unlink d8/d16/d1a/d99/ffb 0 2024-04-25T17:19:22.825 INFO:tasks.workunit.client.0.smithi037.stdout:5/765: dread d7/da1/dbb/fc0 [0,4194304] 0 2024-04-25T17:19:22.825 INFO:tasks.workunit.client.1.smithi069.stdout:2/697: dwrite d0/d1/d5b/d33/fa3 [0,4194304] 0 2024-04-25T17:19:22.826 INFO:tasks.workunit.client.1.smithi069.stdout:3/771: truncate d8/d16/d1a/d38/fee 646356 0 2024-04-25T17:19:22.826 INFO:tasks.workunit.client.1.smithi069.stdout:2/698: dread - d0/d56/f9d zero size 2024-04-25T17:19:22.827 INFO:tasks.workunit.client.1.smithi069.stdout:2/699: dread - d0/d56/d94/fb2 zero size 2024-04-25T17:19:22.827 INFO:tasks.workunit.client.1.smithi069.stdout:1/708: link d1/d4/d6/d9e/da6/d7c/d4d/c59 d1/d4/d6/d9e/da6/d7c/d1d/cd7 0 2024-04-25T17:19:22.829 INFO:tasks.workunit.client.1.smithi069.stdout:1/709: chown d1/d4/d6/d4f/d9b/da3/lb0 5324 1 2024-04-25T17:19:22.831 INFO:tasks.workunit.client.1.smithi069.stdout:4/701: link db/d15/d42/d53/c6b db/d15/d20/cf6 0 2024-04-25T17:19:22.833 INFO:tasks.workunit.client.1.smithi069.stdout:9/685: symlink d2/da/dd/d1e/d2e/d35/lef 0 2024-04-25T17:19:22.834 INFO:tasks.workunit.client.1.smithi069.stdout:9/686: chown d2/da4/dcf/l4f 93502176 1 2024-04-25T17:19:22.835 INFO:tasks.workunit.client.1.smithi069.stdout:7/707: mknod d4/d18/ceb 0 2024-04-25T17:19:22.837 INFO:tasks.workunit.client.1.smithi069.stdout:4/702: dwrite db/d15/d20/d38/f68 [0,4194304] 0 2024-04-25T17:19:22.847 INFO:tasks.workunit.client.1.smithi069.stdout:3/772: symlink d8/d2a/l108 0 2024-04-25T17:19:22.848 INFO:tasks.workunit.client.1.smithi069.stdout:3/773: stat d8/d16/d1a/d2c/d49/d59 0 2024-04-25T17:19:22.849 INFO:tasks.workunit.client.1.smithi069.stdout:2/700: mkdir d0/d56/d5f/d62/de0 0 2024-04-25T17:19:22.852 INFO:tasks.workunit.client.1.smithi069.stdout:1/710: rename d1/d4/l52 to d1/d4/d6/d9e/da6/d7c/d4d/ld8 0 2024-04-25T17:19:22.855 INFO:tasks.workunit.client.1.smithi069.stdout:3/774: dwrite d8/d16/d1a/d2c/d49/d87/d8a/fc9 [0,4194304] 0 2024-04-25T17:19:22.855 INFO:tasks.workunit.client.1.smithi069.stdout:9/687: chown d2/da/d14/c56 14 1 2024-04-25T17:19:22.863 INFO:tasks.workunit.client.1.smithi069.stdout:7/708: symlink d4/d3e/d94/da1/dc7/d14/d5a/d5e/lec 0 2024-04-25T17:19:22.864 INFO:tasks.workunit.client.1.smithi069.stdout:4/703: chown db/c1b 45 1 2024-04-25T17:19:22.865 INFO:tasks.workunit.client.1.smithi069.stdout:6/689: mknod d2/d1e/cf0 0 2024-04-25T17:19:22.865 INFO:tasks.workunit.client.1.smithi069.stdout:4/704: readlink db/d15/l2b 0 2024-04-25T17:19:22.866 INFO:tasks.workunit.client.1.smithi069.stdout:6/690: write d2/d7/f94 [7556958,57124] 0 2024-04-25T17:19:22.866 INFO:tasks.workunit.client.1.smithi069.stdout:4/705: chown db/d15/d42/d53/c6b 351388665 1 2024-04-25T17:19:22.867 INFO:tasks.workunit.client.1.smithi069.stdout:0/624: link d0/da/db/c2d d0/d17/d83/cd7 0 2024-04-25T17:19:22.868 INFO:tasks.workunit.client.1.smithi069.stdout:8/739: creat d37/d66/ffb x:0 0 0 2024-04-25T17:19:22.870 INFO:tasks.workunit.client.1.smithi069.stdout:8/740: write f33 [2388754,94524] 0 2024-04-25T17:19:22.874 INFO:tasks.workunit.client.1.smithi069.stdout:9/688: mknod d2/da/dd/de/d64/cf0 0 2024-04-25T17:19:22.876 INFO:tasks.workunit.client.1.smithi069.stdout:5/757: getdents d13/d17/d29/d2e/d76 0 2024-04-25T17:19:22.897 INFO:tasks.workunit.client.0.smithi037.stdout:5/766: creat d7/fe8 x:0 0 0 2024-04-25T17:19:22.899 INFO:tasks.workunit.client.0.smithi037.stdout:9/969: getdents d1/d5/d19/d6e 0 2024-04-25T17:19:22.902 INFO:tasks.workunit.client.0.smithi037.stdout:9/970: mkdir d1/d48/d68/d26/da1/db0/d141 0 2024-04-25T17:19:22.907 INFO:tasks.workunit.client.0.smithi037.stdout:9/971: creat d1/d5/dc/dfa/f142 x:0 0 0 2024-04-25T17:19:22.909 INFO:tasks.workunit.client.1.smithi069.stdout:7/709: mkdir d4/d83/da2/ded 0 2024-04-25T17:19:22.910 INFO:tasks.workunit.client.1.smithi069.stdout:7/710: chown d4/d3e/dc8/fe1 3 1 2024-04-25T17:19:22.911 INFO:tasks.workunit.client.0.smithi037.stdout:5/767: dread d7/d12/d6f/d94/fad [0,4194304] 0 2024-04-25T17:19:22.916 INFO:tasks.workunit.client.1.smithi069.stdout:0/625: rename d0/da/db/f9e to d0/d17/d95/fd8 0 2024-04-25T17:19:22.920 INFO:tasks.workunit.client.0.smithi037.stdout:5/768: mkdir d7/d12/d6f/de9 0 2024-04-25T17:19:22.921 INFO:tasks.workunit.client.1.smithi069.stdout:8/741: creat d37/d62/ffc x:0 0 0 2024-04-25T17:19:22.921 INFO:tasks.workunit.client.0.smithi037.stdout:9/972: link d1/d5/d19/d6e/cb3 d1/d5/dc/d3c/d3e/c143 0 2024-04-25T17:19:22.924 INFO:tasks.workunit.client.1.smithi069.stdout:5/758: unlink d13/d17/d19/d20/f57 0 2024-04-25T17:19:22.927 INFO:tasks.workunit.client.0.smithi037.stdout:9/973: mknod d1/d5/c144 0 2024-04-25T17:19:22.927 INFO:tasks.workunit.client.0.smithi037.stdout:5/769: dread d7/d18/d62/fd4 [0,4194304] 0 2024-04-25T17:19:22.927 INFO:tasks.workunit.client.1.smithi069.stdout:7/711: dread d4/d1a/f35 [0,4194304] 0 2024-04-25T17:19:22.928 INFO:tasks.workunit.client.1.smithi069.stdout:7/712: fdatasync d4/d3e/d94/da1/dc7/d14/fea 0 2024-04-25T17:19:22.932 INFO:tasks.workunit.client.0.smithi037.stdout:5/770: creat d7/d25/d4f/da7/fea x:0 0 0 2024-04-25T17:19:22.933 INFO:tasks.workunit.client.1.smithi069.stdout:5/759: symlink d13/d17/d19/d1c/d79/l105 0 2024-04-25T17:19:22.935 INFO:tasks.workunit.client.0.smithi037.stdout:5/771: creat d7/d25/d4f/feb x:0 0 0 2024-04-25T17:19:22.936 INFO:tasks.workunit.client.1.smithi069.stdout:6/691: rmdir d2/d1e/d43/def 0 2024-04-25T17:19:22.937 INFO:tasks.workunit.client.1.smithi069.stdout:0/626: mknod d0/d17/d83/dcf/dd5/cd9 0 2024-04-25T17:19:22.937 INFO:tasks.workunit.client.1.smithi069.stdout:6/692: chown d2/d1e/d43/db6/daf/lc2 808538 1 2024-04-25T17:19:22.938 INFO:tasks.workunit.client.1.smithi069.stdout:6/693: read - d2/d9c/fdf zero size 2024-04-25T17:19:22.938 INFO:tasks.workunit.client.1.smithi069.stdout:7/713: creat d4/d3e/dc8/fee x:0 0 0 2024-04-25T17:19:22.939 INFO:tasks.workunit.client.1.smithi069.stdout:2/701: getdents d0/d56/d5f/d62/d7d/d72/daf 0 2024-04-25T17:19:22.940 INFO:tasks.workunit.client.1.smithi069.stdout:7/714: read d4/d3e/d94/da1/dc7/f92 [185839,31405] 0 2024-04-25T17:19:22.941 INFO:tasks.workunit.client.1.smithi069.stdout:7/715: chown d4/d3e/d94/da1/dc7/d14/d15/f90 3056 1 2024-04-25T17:19:22.942 INFO:tasks.workunit.client.1.smithi069.stdout:1/711: getdents d1/d4/de/d63/d7d 0 2024-04-25T17:19:22.942 INFO:tasks.workunit.client.1.smithi069.stdout:1/712: fdatasync d1/d43/d1b/f2c 0 2024-04-25T17:19:22.943 INFO:tasks.workunit.client.0.smithi037.stdout:5/772: creat d7/d12/fec x:0 0 0 2024-04-25T17:19:22.943 INFO:tasks.workunit.client.1.smithi069.stdout:3/775: getdents d8/d16/d1a/d2c/d49/d87/d8a/d8e/d95 0 2024-04-25T17:19:22.944 INFO:tasks.workunit.client.1.smithi069.stdout:3/776: chown d8/d71/lb4 13774155 1 2024-04-25T17:19:22.946 INFO:tasks.workunit.client.1.smithi069.stdout:0/627: write d0/da/d6e/f84 [4876038,36705] 0 2024-04-25T17:19:22.947 INFO:tasks.workunit.client.1.smithi069.stdout:0/628: truncate d0/da/db/fe 5772374 0 2024-04-25T17:19:22.948 INFO:tasks.workunit.client.1.smithi069.stdout:3/777: dread d8/d16/d4b/d9e/dca/fe2 [0,4194304] 0 2024-04-25T17:19:22.953 INFO:tasks.workunit.client.1.smithi069.stdout:8/742: rename d37/d47/f89 to d37/d47/ffd 0 2024-04-25T17:19:22.955 INFO:tasks.workunit.client.1.smithi069.stdout:4/706: truncate db/d4b/d78/f8b 2822585 0 2024-04-25T17:19:22.956 INFO:tasks.workunit.client.0.smithi037.stdout:9/974: write d1/d5/d2e/f52 [3029809,97646] 0 2024-04-25T17:19:22.957 INFO:tasks.workunit.client.0.smithi037.stdout:5/773: getdents d7/d12/d6f/dbf 0 2024-04-25T17:19:22.962 INFO:tasks.workunit.client.0.smithi037.stdout:9/975: read d1/d5/dc/f2d [1123983,119455] 0 2024-04-25T17:19:22.964 INFO:tasks.workunit.client.0.smithi037.stdout:5/774: mknod d7/d12/d6f/d68/ced 0 2024-04-25T17:19:22.965 INFO:tasks.workunit.client.1.smithi069.stdout:0/629: chown d0/l5e 27415 1 2024-04-25T17:19:22.966 INFO:tasks.workunit.client.0.smithi037.stdout:9/976: fsync d1/d48/d68/f46 0 2024-04-25T17:19:22.967 INFO:tasks.workunit.client.0.smithi037.stdout:5/775: mkdir d7/d25/d4f/dee 0 2024-04-25T17:19:22.970 INFO:tasks.workunit.client.1.smithi069.stdout:6/694: dwrite d2/d1e/d43/d7d/f9f [0,4194304] 0 2024-04-25T17:19:22.972 INFO:tasks.workunit.client.0.smithi037.stdout:5/776: mkdir d7/d12/d5d/d90/def 0 2024-04-25T17:19:22.973 INFO:tasks.workunit.client.1.smithi069.stdout:2/702: dwrite d0/d1/d5b/f6e [0,4194304] 0 2024-04-25T17:19:22.973 INFO:tasks.workunit.client.1.smithi069.stdout:5/760: write d13/d17/d19/d1c/da4/da9/daa/fba [972174,3431] 0 2024-04-25T17:19:22.974 INFO:tasks.workunit.client.0.smithi037.stdout:5/777: chown d7/d12/d6f/de9 116 1 2024-04-25T17:19:22.974 INFO:tasks.workunit.client.0.smithi037.stdout:9/977: mknod d1/d5/dc/c145 0 2024-04-25T17:19:22.975 INFO:tasks.workunit.client.0.smithi037.stdout:5/778: dread d7/d12/d6f/f97 [0,4194304] 0 2024-04-25T17:19:22.976 INFO:tasks.workunit.client.0.smithi037.stdout:9/978: fsync d1/d5/d2e/d34/d76/db4/d119/f51 0 2024-04-25T17:19:22.978 INFO:tasks.workunit.client.1.smithi069.stdout:7/716: link d4/d3e/d94/da1/dc7/f92 d4/d3e/d94/da1/dc7/d14/d3d/d47/fef 0 2024-04-25T17:19:22.979 INFO:tasks.workunit.client.1.smithi069.stdout:4/707: mkdir db/d15/d42/d64/d7f/df7 0 2024-04-25T17:19:22.983 INFO:tasks.workunit.client.1.smithi069.stdout:9/689: sync 2024-04-25T17:19:22.984 INFO:tasks.workunit.client.1.smithi069.stdout:0/630: symlink d0/da/d59/dab/lda 0 2024-04-25T17:19:22.985 INFO:tasks.workunit.client.0.smithi037.stdout:9/979: mknod d1/d48/d68/d26/da1/d11b/c146 0 2024-04-25T17:19:22.989 INFO:tasks.workunit.client.1.smithi069.stdout:6/695: mkdir d2/d9c/d97/dad/df1 0 2024-04-25T17:19:22.989 INFO:tasks.workunit.client.0.smithi037.stdout:5/779: link d7/d12/l58 d7/d12/d6f/lf0 0 2024-04-25T17:19:22.990 INFO:tasks.workunit.client.0.smithi037.stdout:4/936: sync 2024-04-25T17:19:22.990 INFO:tasks.workunit.client.1.smithi069.stdout:5/761: symlink d13/d17/d19/d96/d9d/l106 0 2024-04-25T17:19:22.990 INFO:tasks.workunit.client.1.smithi069.stdout:0/631: dwrite d0/da/db/d56/f78 [0,4194304] 0 2024-04-25T17:19:22.991 INFO:tasks.workunit.client.0.smithi037.stdout:9/980: symlink d1/d5/dc/d3c/d3e/l147 0 2024-04-25T17:19:22.992 INFO:tasks.workunit.client.1.smithi069.stdout:8/743: fsync d37/d47/d78/f88 0 2024-04-25T17:19:22.993 INFO:tasks.workunit.client.0.smithi037.stdout:9/981: read - d1/d5/dc/d3c/dca/df5/f130 zero size 2024-04-25T17:19:22.993 INFO:tasks.workunit.client.1.smithi069.stdout:0/632: read d0/f1 [805229,116254] 0 2024-04-25T17:19:22.996 INFO:tasks.workunit.client.1.smithi069.stdout:7/717: mknod d4/d3e/d94/da1/dc7/d14/d44/da8/cf0 0 2024-04-25T17:19:22.997 INFO:tasks.workunit.client.1.smithi069.stdout:7/718: fdatasync d4/d83/fc9 0 2024-04-25T17:19:22.997 INFO:tasks.workunit.client.1.smithi069.stdout:8/744: dwrite d37/d47/d78/fdb [0,4194304] 0 2024-04-25T17:19:22.999 INFO:tasks.workunit.client.1.smithi069.stdout:7/719: chown d4/d3e/d94/da1/dc7/d14/d44/d7c/d9f 106 1 2024-04-25T17:19:23.001 INFO:tasks.workunit.client.1.smithi069.stdout:4/708: symlink db/d4b/d78/dc4/d41/d9e/lf8 0 2024-04-25T17:19:23.004 INFO:tasks.workunit.client.1.smithi069.stdout:1/713: truncate d1/d43/f3a 3762554 0 2024-04-25T17:19:23.007 INFO:tasks.workunit.client.0.smithi037.stdout:5/780: rmdir d7/d25/d4f/da7/dab/dc7 0 2024-04-25T17:19:23.007 INFO:tasks.workunit.client.0.smithi037.stdout:5/781: chown f0 233528679 1 2024-04-25T17:19:23.011 INFO:tasks.workunit.client.1.smithi069.stdout:3/778: rename d8/d16/d1a/d38/fee to d8/d16/d1a/d2c/d49/f109 0 2024-04-25T17:19:23.017 INFO:tasks.workunit.client.0.smithi037.stdout:4/937: rename d7/d7e/d5b/dfe/d39/cb6 to d7/c137 0 2024-04-25T17:19:23.018 INFO:tasks.workunit.client.0.smithi037.stdout:4/938: fsync d7/d7e/d45/f8d 0 2024-04-25T17:19:23.020 INFO:tasks.workunit.client.0.smithi037.stdout:5/782: fdatasync d7/d12/f46 0 2024-04-25T17:19:23.021 INFO:tasks.workunit.client.1.smithi069.stdout:5/762: write d13/d17/d29/d30/d5c/f8f [2089559,85367] 0 2024-04-25T17:19:23.023 INFO:tasks.workunit.client.1.smithi069.stdout:5/763: fdatasync d13/d17/d19/d1c/d79/fe6 0 2024-04-25T17:19:23.023 INFO:tasks.workunit.client.1.smithi069.stdout:4/709: dread db/d22/f71 [0,4194304] 0 2024-04-25T17:19:23.025 INFO:tasks.workunit.client.0.smithi037.stdout:4/939: mkdir d7/d7e/d1e/dae/dc6/d138 0 2024-04-25T17:19:23.025 INFO:tasks.workunit.client.1.smithi069.stdout:5/764: write d13/d17/d19/d1c/da4/da9/daa/fb2 [4649695,46054] 0 2024-04-25T17:19:23.031 INFO:tasks.workunit.client.0.smithi037.stdout:9/982: dwrite d1/d48/d68/d26/f57 [0,4194304] 0 2024-04-25T17:19:23.032 INFO:tasks.workunit.client.1.smithi069.stdout:2/703: creat d0/d56/d5f/d62/d7d/d72/daf/dc2/ddd/fe1 x:0 0 0 2024-04-25T17:19:23.034 INFO:tasks.workunit.client.0.smithi037.stdout:4/940: chown d7/d7e/d1e/l60 216709152 1 2024-04-25T17:19:23.039 INFO:tasks.workunit.client.1.smithi069.stdout:8/745: mknod d37/d47/d54/cfe 0 2024-04-25T17:19:23.044 INFO:tasks.workunit.client.1.smithi069.stdout:9/690: symlink d2/da/dd/de/lf1 0 2024-04-25T17:19:23.048 INFO:tasks.workunit.client.1.smithi069.stdout:1/714: mknod d1/d4/de/d44/cd9 0 2024-04-25T17:19:23.049 INFO:tasks.workunit.client.0.smithi037.stdout:9/983: mknod d1/d5/d19/d13b/c148 0 2024-04-25T17:19:23.054 INFO:tasks.workunit.client.1.smithi069.stdout:6/696: symlink d2/d1e/d43/db6/daf/dbe/lf2 0 2024-04-25T17:19:23.056 INFO:tasks.workunit.client.0.smithi037.stdout:9/984: truncate d1/d5/d2e/d34/f8d 2782510 0 2024-04-25T17:19:23.057 INFO:tasks.workunit.client.1.smithi069.stdout:7/720: dread d4/d3e/d94/da1/dc7/f59 [0,4194304] 0 2024-04-25T17:19:23.059 INFO:tasks.workunit.client.1.smithi069.stdout:4/710: symlink db/d4b/d78/d79/da5/lf9 0 2024-04-25T17:19:23.062 INFO:tasks.workunit.client.0.smithi037.stdout:9/985: rename d1/d5/d2e/d34/daf/dcb to d1/d5/d2e/d34/d76/db4/d119/d149 0 2024-04-25T17:19:23.063 INFO:tasks.workunit.client.0.smithi037.stdout:0/789: sync 2024-04-25T17:19:23.063 INFO:tasks.workunit.client.0.smithi037.stdout:1/878: sync 2024-04-25T17:19:23.063 INFO:tasks.workunit.client.0.smithi037.stdout:8/684: sync 2024-04-25T17:19:23.063 INFO:tasks.workunit.client.0.smithi037.stdout:2/845: sync 2024-04-25T17:19:23.064 INFO:tasks.workunit.client.0.smithi037.stdout:7/659: sync 2024-04-25T17:19:23.064 INFO:tasks.workunit.client.0.smithi037.stdout:6/710: sync 2024-04-25T17:19:23.064 INFO:tasks.workunit.client.0.smithi037.stdout:3/619: sync 2024-04-25T17:19:23.064 INFO:tasks.workunit.client.1.smithi069.stdout:0/633: mknod d0/da/d6e/d90/cdb 0 2024-04-25T17:19:23.066 INFO:tasks.workunit.client.0.smithi037.stdout:8/685: chown d5/db/d18/d3b/l52 6268 1 2024-04-25T17:19:23.067 INFO:tasks.workunit.client.0.smithi037.stdout:2/846: dread d0/d16/d20/d59/d6a/f99 [0,4194304] 0 2024-04-25T17:19:23.068 INFO:tasks.workunit.client.0.smithi037.stdout:9/986: symlink d1/d5/d19/l14a 0 2024-04-25T17:19:23.068 INFO:tasks.workunit.client.0.smithi037.stdout:2/847: chown d0/d15/fea 1 1 2024-04-25T17:19:23.069 INFO:tasks.workunit.client.1.smithi069.stdout:8/746: mknod d37/d47/d54/d6e/dce/cff 0 2024-04-25T17:19:23.070 INFO:tasks.workunit.client.1.smithi069.stdout:0/634: dwrite d0/da/fc1 [0,4194304] 0 2024-04-25T17:19:23.070 INFO:tasks.workunit.client.0.smithi037.stdout:5/783: truncate d7/d18/f29 4137269 0 2024-04-25T17:19:23.071 INFO:tasks.workunit.client.0.smithi037.stdout:0/790: symlink d9/df/d32/d35/l102 0 2024-04-25T17:19:23.074 INFO:tasks.workunit.client.0.smithi037.stdout:4/941: write d7/d7e/f7c [3189502,65447] 0 2024-04-25T17:19:23.075 INFO:tasks.workunit.client.0.smithi037.stdout:6/711: readlink db/d26/d2e/d3e/d25/d61/l62 0 2024-04-25T17:19:23.078 INFO:tasks.workunit.client.1.smithi069.stdout:1/715: rename d1/d4/f2a to d1/d4/de/d44/d68/fda 0 2024-04-25T17:19:23.078 INFO:tasks.workunit.client.1.smithi069.stdout:0/635: dwrite d0/d36/f2b [4194304,4194304] 0 2024-04-25T17:19:23.078 INFO:tasks.workunit.client.0.smithi037.stdout:1/879: creat dc/d52/d6b/dd9/d4d/d6a/d8f/f12e x:0 0 0 2024-04-25T17:19:23.079 INFO:tasks.workunit.client.1.smithi069.stdout:1/716: fsync d1/d4/d6/d9e/da6/d7c/d4d/f7a 0 2024-04-25T17:19:23.081 INFO:tasks.workunit.client.0.smithi037.stdout:1/880: read - dc/d52/d6b/dd9/d4d/d6a/de3/f116 zero size 2024-04-25T17:19:23.085 INFO:tasks.workunit.client.0.smithi037.stdout:8/686: dwrite d5/db/fb8 [0,4194304] 0 2024-04-25T17:19:23.100 INFO:tasks.workunit.client.0.smithi037.stdout:4/942: mknod d7/d7e/d5b/dfe/d39/d83/c139 0 2024-04-25T17:19:23.101 INFO:tasks.workunit.client.1.smithi069.stdout:5/765: unlink d13/d17/d19/d96/d9d/lef 0 2024-04-25T17:19:23.103 INFO:tasks.workunit.client.0.smithi037.stdout:6/712: rename db/d26/l70 to db/d1d/d20/dcf/dfa/dde/lfe 0 2024-04-25T17:19:23.105 INFO:tasks.workunit.client.1.smithi069.stdout:2/704: symlink d0/d26/d10/le2 0 2024-04-25T17:19:23.107 INFO:tasks.workunit.client.0.smithi037.stdout:8/687: mkdir d5/db/d18/de0 0 2024-04-25T17:19:23.108 INFO:tasks.workunit.client.0.smithi037.stdout:8/688: write d5/db/d7e/fb7 [639460,21157] 0 2024-04-25T17:19:23.110 INFO:tasks.workunit.client.1.smithi069.stdout:8/747: creat d37/d47/d54/d6e/d9e/f100 x:0 0 0 2024-04-25T17:19:23.113 INFO:tasks.workunit.client.0.smithi037.stdout:0/791: link d9/df/d32/f55 d9/df/d32/d39/d68/da7/db4/f103 0 2024-04-25T17:19:23.114 INFO:tasks.workunit.client.0.smithi037.stdout:3/620: dwrite d8/d23/d72/f76 [0,4194304] 0 2024-04-25T17:19:23.115 INFO:tasks.workunit.client.0.smithi037.stdout:3/621: read - d8/d23/d38/fb3 zero size 2024-04-25T17:19:23.116 INFO:tasks.workunit.client.0.smithi037.stdout:4/943: creat d7/d7e/d1e/d70/d84/ddf/df0/f13a x:0 0 0 2024-04-25T17:19:23.117 INFO:tasks.workunit.client.1.smithi069.stdout:3/779: truncate d8/d16/d1a/d38/f83 4274859 0 2024-04-25T17:19:23.117 INFO:tasks.workunit.client.0.smithi037.stdout:4/944: chown d7/d67/d118 36 1 2024-04-25T17:19:23.121 INFO:tasks.workunit.client.1.smithi069.stdout:3/780: dread d8/d16/d4b/d9e/dca/fe2 [0,4194304] 0 2024-04-25T17:19:23.122 INFO:tasks.workunit.client.0.smithi037.stdout:1/881: rename dc/d52/d6b/dd9/d22/d36/d92/db8/dbc/cd1 to dc/d24/c12f 0 2024-04-25T17:19:23.123 INFO:tasks.workunit.client.1.smithi069.stdout:6/697: write d2/d1e/d3f/d86/fb2 [512271,92477] 0 2024-04-25T17:19:23.123 INFO:tasks.workunit.client.0.smithi037.stdout:9/987: dwrite d1/d5/dc/d3c/d3e/f42 [0,4194304] 0 2024-04-25T17:19:23.125 INFO:tasks.workunit.client.0.smithi037.stdout:6/713: symlink db/d1d/d20/dcf/dfa/d65/d68/d87/lff 0 2024-04-25T17:19:23.128 INFO:tasks.workunit.client.0.smithi037.stdout:1/882: write dc/d52/d6b/dd9/d22/d36/d74/daf/ddd/f119 [339748,29356] 0 2024-04-25T17:19:23.135 INFO:tasks.workunit.client.1.smithi069.stdout:7/721: mknod d4/d3e/d94/da1/dc7/d14/d44/dd5/dd6/cf1 0 2024-04-25T17:19:23.136 INFO:tasks.workunit.client.0.smithi037.stdout:4/945: write d7/d7e/d45/d4f/f96 [3890494,39643] 0 2024-04-25T17:19:23.136 INFO:tasks.workunit.client.1.smithi069.stdout:4/711: symlink db/d15/d20/d35/d63/lfa 0 2024-04-25T17:19:23.139 INFO:tasks.workunit.client.1.smithi069.stdout:5/766: unlink d13/d17/d19/cf9 0 2024-04-25T17:19:23.139 INFO:tasks.workunit.client.1.smithi069.stdout:5/767: chown d13/d17/dd4/f103 207624 1 2024-04-25T17:19:23.145 INFO:tasks.workunit.client.1.smithi069.stdout:3/781: mkdir d8/d16/d1a/d2c/d49/d87/d8a/d8e/d95/d10a 0 2024-04-25T17:19:23.150 INFO:tasks.workunit.client.1.smithi069.stdout:9/691: truncate d2/da4/fc7 1291609 0 2024-04-25T17:19:23.151 INFO:tasks.workunit.client.1.smithi069.stdout:3/782: dwrite d8/d16/ff2 [0,4194304] 0 2024-04-25T17:19:23.152 INFO:tasks.workunit.client.1.smithi069.stdout:3/783: stat d8/d16/d31/cd5 0 2024-04-25T17:19:23.153 INFO:tasks.workunit.client.0.smithi037.stdout:3/622: mknod d8/d23/cbc 0 2024-04-25T17:19:23.156 INFO:tasks.workunit.client.0.smithi037.stdout:4/946: creat d7/d7e/d1e/d70/d84/dc9/f13b x:0 0 0 2024-04-25T17:19:23.161 INFO:tasks.workunit.client.0.smithi037.stdout:8/689: mknod d5/db/da2/dc1/ce1 0 2024-04-25T17:19:23.162 INFO:tasks.workunit.client.1.smithi069.stdout:2/705: mkdir d0/d26/d10/db5/de3 0 2024-04-25T17:19:23.165 INFO:tasks.workunit.client.0.smithi037.stdout:1/883: write dc/d52/d6b/dd9/d4d/d6a/d8f/fd6 [1479424,72279] 0 2024-04-25T17:19:23.169 INFO:tasks.workunit.client.0.smithi037.stdout:0/792: creat d9/f104 x:0 0 0 2024-04-25T17:19:23.172 INFO:tasks.workunit.client.0.smithi037.stdout:9/988: dwrite d1/d48/fee [0,4194304] 0 2024-04-25T17:19:23.172 INFO:tasks.workunit.client.0.smithi037.stdout:3/623: mknod d8/d31/d8d/cbd 0 2024-04-25T17:19:23.173 INFO:tasks.workunit.client.0.smithi037.stdout:6/714: dwrite db/d1d/d20/d85/feb [0,4194304] 0 2024-04-25T17:19:23.177 INFO:tasks.workunit.client.0.smithi037.stdout:3/624: fdatasync d8/d23/dbb/d5d/f7e 0 2024-04-25T17:19:23.178 INFO:tasks.workunit.client.1.smithi069.stdout:9/692: mknod d2/da/dd/de0/cf2 0 2024-04-25T17:19:23.179 INFO:tasks.workunit.client.1.smithi069.stdout:5/768: dwrite d13/d17/d29/f2b [0,4194304] 0 2024-04-25T17:19:23.182 INFO:tasks.workunit.client.1.smithi069.stdout:1/717: creat d1/d4/de/fdb x:0 0 0 2024-04-25T17:19:23.184 INFO:tasks.workunit.client.1.smithi069.stdout:1/718: chown d1/d4/d6/d9e/da6/d7c/d4d/d8f 8 1 2024-04-25T17:19:23.189 INFO:tasks.workunit.client.0.smithi037.stdout:3/625: dwrite d8/d31/d32/f39 [8388608,4194304] 0 2024-04-25T17:19:23.189 INFO:tasks.workunit.client.0.smithi037.stdout:0/793: rmdir d9/df/d32/d39/dd3 39 2024-04-25T17:19:23.190 INFO:tasks.workunit.client.0.smithi037.stdout:8/690: dread d5/db/d59/fcd [0,4194304] 0 2024-04-25T17:19:23.192 INFO:tasks.workunit.client.1.smithi069.stdout:6/698: truncate d2/d7/fd 3545277 0 2024-04-25T17:19:23.193 INFO:tasks.workunit.client.1.smithi069.stdout:7/722: link d4/d3e/d94/da1/dc7/d14/fde d4/d3e/d94/da1/dc7/d14/d44/d88/ff2 0 2024-04-25T17:19:23.193 INFO:tasks.workunit.client.1.smithi069.stdout:6/699: truncate d2/d9c/d97/dad/fb7 1017858 0 2024-04-25T17:19:23.194 INFO:tasks.workunit.client.0.smithi037.stdout:9/989: creat d1/d48/d68/d26/da1/d11b/f14b x:0 0 0 2024-04-25T17:19:23.195 INFO:tasks.workunit.client.1.smithi069.stdout:4/712: symlink db/d4b/d78/dc4/lfb 0 2024-04-25T17:19:23.199 INFO:tasks.workunit.client.1.smithi069.stdout:4/713: truncate db/d15/d20/d35/d63/d43/d48/f5e 4293164 0 2024-04-25T17:19:23.199 INFO:tasks.workunit.client.1.smithi069.stdout:4/714: read - db/d22/fcd zero size 2024-04-25T17:19:23.203 INFO:tasks.workunit.client.1.smithi069.stdout:6/700: dread d2/d9c/d48/f92 [0,4194304] 0 2024-04-25T17:19:23.204 INFO:tasks.workunit.client.0.smithi037.stdout:1/884: write dc/d52/d6b/dd9/d4d/f7e [5509632,15049] 0 2024-04-25T17:19:23.204 INFO:tasks.workunit.client.1.smithi069.stdout:0/636: getdents d0/da/db/d1d/d5f 0 2024-04-25T17:19:23.205 INFO:tasks.workunit.client.0.smithi037.stdout:1/885: write dc/d18/f2b [5994408,89795] 0 2024-04-25T17:19:23.211 INFO:tasks.workunit.client.1.smithi069.stdout:5/769: mknod d13/d17/d19/d20/c107 0 2024-04-25T17:19:23.217 INFO:tasks.workunit.client.1.smithi069.stdout:3/784: link d8/d16/f28 d8/d71/d8d/d92/f10b 0 2024-04-25T17:19:23.218 INFO:tasks.workunit.client.0.smithi037.stdout:0/794: mkdir d9/d14/dff/d105 0 2024-04-25T17:19:23.220 INFO:tasks.workunit.client.1.smithi069.stdout:7/723: unlink d4/d3e/fce 0 2024-04-25T17:19:23.224 INFO:tasks.workunit.client.1.smithi069.stdout:8/748: getdents d37/d47/d78/db3 0 2024-04-25T17:19:23.226 INFO:tasks.workunit.client.0.smithi037.stdout:9/990: dwrite d1/d5/d19/d13b/d8b/f95 [4194304,4194304] 0 2024-04-25T17:19:23.227 INFO:tasks.workunit.client.0.smithi037.stdout:3/626: dread d8/d23/d38/d66/f75 [0,4194304] 0 2024-04-25T17:19:23.229 INFO:tasks.workunit.client.0.smithi037.stdout:6/715: link db/d1d/f96 db/d1d/d20/d2f/f100 0 2024-04-25T17:19:23.230 INFO:tasks.workunit.client.0.smithi037.stdout:9/991: read - d1/d48/d121/f140 zero size 2024-04-25T17:19:23.232 INFO:tasks.workunit.client.0.smithi037.stdout:6/716: stat db/d1d/db1 0 2024-04-25T17:19:23.232 INFO:tasks.workunit.client.0.smithi037.stdout:8/691: dread d5/f65 [0,4194304] 0 2024-04-25T17:19:23.232 INFO:tasks.workunit.client.0.smithi037.stdout:0/795: mkdir d9/df/d32/d56/d106 0 2024-04-25T17:19:23.233 INFO:tasks.workunit.client.0.smithi037.stdout:4/947: dwrite d7/d7e/d4e/fdd [0,4194304] 0 2024-04-25T17:19:23.235 INFO:tasks.workunit.client.1.smithi069.stdout:6/701: mkdir d2/d9c/d97/d98/df3 0 2024-04-25T17:19:23.240 INFO:tasks.workunit.client.1.smithi069.stdout:9/693: chown d2/da/dd/de/d59/d7f/f89 2 1 2024-04-25T17:19:23.240 INFO:tasks.workunit.client.1.smithi069.stdout:9/694: chown d2/da/dd/d1e/d2e/d68/dba 167 1 2024-04-25T17:19:23.241 INFO:tasks.workunit.client.1.smithi069.stdout:9/695: chown d2/da/dd/de/d74/dbc 29519 1 2024-04-25T17:19:23.246 INFO:tasks.workunit.client.0.smithi037.stdout:3/627: dwrite d8/d31/f48 [0,4194304] 0 2024-04-25T17:19:23.246 INFO:tasks.workunit.client.1.smithi069.stdout:5/770: unlink d13/d17/d29/d30/l37 0 2024-04-25T17:19:23.247 INFO:tasks.workunit.client.0.smithi037.stdout:3/628: write d8/d31/f52 [551234,17155] 0 2024-04-25T17:19:23.250 INFO:tasks.workunit.client.0.smithi037.stdout:3/629: chown d8/d23/dbb/d81/l8b 4 1 2024-04-25T17:19:23.252 INFO:tasks.workunit.client.1.smithi069.stdout:2/706: truncate d0/d56/d5f/d62/d7d/d31/f7c 808952 0 2024-04-25T17:19:23.253 INFO:tasks.workunit.client.1.smithi069.stdout:3/785: symlink d8/d16/d9b/dc3/dc8/l10c 0 2024-04-25T17:19:23.258 INFO:tasks.workunit.client.1.smithi069.stdout:8/749: fsync f2b 0 2024-04-25T17:19:23.258 INFO:tasks.workunit.client.1.smithi069.stdout:2/707: dwrite d0/d1/d5b/fc9 [0,4194304] 0 2024-04-25T17:19:23.259 INFO:tasks.workunit.client.1.smithi069.stdout:4/715: mkdir db/d15/d82/df4/dfc 0 2024-04-25T17:19:23.259 INFO:tasks.workunit.client.0.smithi037.stdout:8/692: dread d5/db/d18/d3b/d75/f9e [0,4194304] 0 2024-04-25T17:19:23.260 INFO:tasks.workunit.client.1.smithi069.stdout:4/716: fdatasync db/d15/d20/d35/d63/d70/faf 0 2024-04-25T17:19:23.261 INFO:tasks.workunit.client.0.smithi037.stdout:8/693: chown d5/d6a/f89 124694353 1 2024-04-25T17:19:23.261 INFO:tasks.workunit.client.1.smithi069.stdout:0/637: truncate d0/da/db/d1d/f20 4326202 0 2024-04-25T17:19:23.263 INFO:tasks.workunit.client.1.smithi069.stdout:6/702: chown d2/d9c/c6b 26376199 1 2024-04-25T17:19:23.267 INFO:tasks.workunit.client.0.smithi037.stdout:1/886: rename dc/d52/d6b/dd9/d4d/d6a/de3/f116 to dc/d52/d6b/dd9/d22/d36/d92/db8/f130 0 2024-04-25T17:19:23.268 INFO:tasks.workunit.client.0.smithi037.stdout:1/887: chown dc/d52/d6b/dd9/d4d/d6a/dea 46917 1 2024-04-25T17:19:23.272 INFO:tasks.workunit.client.1.smithi069.stdout:7/724: truncate d4/d3e/d94/da1/dc7/d14/faa 3363758 0 2024-04-25T17:19:23.276 INFO:tasks.workunit.client.0.smithi037.stdout:6/717: mkdir db/d1d/d20/dcf/dfa/d65/d68/d101 0 2024-04-25T17:19:23.276 INFO:tasks.workunit.client.1.smithi069.stdout:2/708: symlink d0/d56/d5f/le4 0 2024-04-25T17:19:23.279 INFO:tasks.workunit.client.1.smithi069.stdout:4/717: fsync db/d22/fcd 0 2024-04-25T17:19:23.281 INFO:tasks.workunit.client.0.smithi037.stdout:9/992: creat d1/d48/d68/d26/f14c x:0 0 0 2024-04-25T17:19:23.287 INFO:tasks.workunit.client.0.smithi037.stdout:1/888: rename dc/d52/d6b/dd9/d22/d36/d8c/f12b to dc/d52/d6b/dd9/d22/d36/d92/db8/dbc/f131 0 2024-04-25T17:19:23.293 INFO:tasks.workunit.client.1.smithi069.stdout:5/771: rename d13/c7e to d13/d17/d19/d8a/c108 0 2024-04-25T17:19:23.295 INFO:tasks.workunit.client.1.smithi069.stdout:1/719: sync 2024-04-25T17:19:23.296 INFO:tasks.workunit.client.0.smithi037.stdout:0/796: rename d9/df/dbd/fe1 to d9/df/dbd/f107 0 2024-04-25T17:19:23.296 INFO:tasks.workunit.client.1.smithi069.stdout:1/720: readlink d1/d4/d6/d4f/d9b/da3/lb0 0 2024-04-25T17:19:23.299 INFO:tasks.workunit.client.0.smithi037.stdout:3/630: write d8/d31/d32/f36 [2519009,42936] 0 2024-04-25T17:19:23.302 INFO:tasks.workunit.client.0.smithi037.stdout:3/631: read d8/d31/d32/f39 [7082055,16420] 0 2024-04-25T17:19:23.304 INFO:tasks.workunit.client.1.smithi069.stdout:8/750: mknod d37/d47/d54/d6e/c101 0 2024-04-25T17:19:23.307 INFO:tasks.workunit.client.1.smithi069.stdout:2/709: truncate d0/d1/d5b/d33/f84 223610 0 2024-04-25T17:19:23.310 INFO:tasks.workunit.client.1.smithi069.stdout:6/703: getdents d2/d1e/d43/da6 0 2024-04-25T17:19:23.310 INFO:tasks.workunit.client.0.smithi037.stdout:4/948: getdents d7/d7e/d1e/d70/d84/ddf/df0 0 2024-04-25T17:19:23.312 INFO:tasks.workunit.client.1.smithi069.stdout:9/696: write d2/d51/fb3 [519411,117788] 0 2024-04-25T17:19:23.313 INFO:tasks.workunit.client.1.smithi069.stdout:0/638: dwrite d0/d38/f49 [0,4194304] 0 2024-04-25T17:19:23.316 INFO:tasks.workunit.client.1.smithi069.stdout:4/718: rename db/d15/d20/d35/d63/d70/d8a/cce to db/d15/d20/d35/d63/d75/dc0/cfd 0 2024-04-25T17:19:23.316 INFO:tasks.workunit.client.0.smithi037.stdout:4/949: dwrite d7/d7e/d1e/de1/fee [0,4194304] 0 2024-04-25T17:19:23.320 INFO:tasks.workunit.client.1.smithi069.stdout:4/719: write db/d15/d26/f91 [3561846,76683] 0 2024-04-25T17:19:23.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:23 smithi037 ceph-mon[26472]: pgmap v42: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 89 MiB/s rd, 270 MiB/s wr, 508 op/s 2024-04-25T17:19:23.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:23 smithi037 ceph-mon[26472]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:19:23.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:23 smithi037 ceph-mon[26472]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi037.txrgxl", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T17:19:23.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:23 smithi037 ceph-mon[26472]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi037.txrgxl", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T17:19:23.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:23 smithi037 ceph-mon[26472]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T17:19:23.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:23 smithi037 ceph-mon[26472]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:19:23.323 INFO:tasks.workunit.client.1.smithi069.stdout:4/720: chown db/d15/d82/da7 15540310 1 2024-04-25T17:19:23.325 INFO:tasks.workunit.client.1.smithi069.stdout:9/697: dwrite d2/d51/fb3 [0,4194304] 0 2024-04-25T17:19:23.326 INFO:tasks.workunit.client.0.smithi037.stdout:8/694: creat d5/db/d18/d3b/fe2 x:0 0 0 2024-04-25T17:19:23.327 INFO:tasks.workunit.client.1.smithi069.stdout:0/639: dwrite d0/f2f [0,4194304] 0 2024-04-25T17:19:23.327 INFO:tasks.workunit.client.1.smithi069.stdout:7/725: truncate d4/d3e/d94/da1/dc7/d14/d15/f28 1118106 0 2024-04-25T17:19:23.329 INFO:tasks.workunit.client.0.smithi037.stdout:3/632: creat d8/d23/dbb/d81/fbe x:0 0 0 2024-04-25T17:19:23.331 INFO:tasks.workunit.client.1.smithi069.stdout:8/751: truncate d37/d47/d78/db3/fc9 1546771 0 2024-04-25T17:19:23.332 INFO:tasks.workunit.client.1.smithi069.stdout:9/698: write d2/da4/fd5 [1499430,80495] 0 2024-04-25T17:19:23.333 INFO:tasks.workunit.client.1.smithi069.stdout:3/786: dwrite d8/d71/d8d/d92/db6/dc1/f7f [0,4194304] 0 2024-04-25T17:19:23.335 INFO:tasks.workunit.client.1.smithi069.stdout:2/710: unlink d0/d56/d5f/d62/d7d/d31/f6a 0 2024-04-25T17:19:23.338 INFO:tasks.workunit.client.1.smithi069.stdout:3/787: dread d8/d16/d1a/d2c/d49/f109 [0,4194304] 0 2024-04-25T17:19:23.341 INFO:tasks.workunit.client.1.smithi069.stdout:6/704: truncate d2/f20 3710263 0 2024-04-25T17:19:23.342 INFO:tasks.workunit.client.1.smithi069.stdout:6/705: readlink d2/d1e/l95 0 2024-04-25T17:19:23.343 INFO:tasks.workunit.client.1.smithi069.stdout:6/706: fsync d2/d1e/d3f/d86/fb1 0 2024-04-25T17:19:23.345 INFO:tasks.workunit.client.0.smithi037.stdout:4/950: mkdir d7/d7e/d5b/dfe/d39/d7a/db2/d13c 0 2024-04-25T17:19:23.346 INFO:tasks.workunit.client.0.smithi037.stdout:4/951: chown d7/d7e/d1e/dae 177757198 1 2024-04-25T17:19:23.346 INFO:tasks.workunit.client.0.smithi037.stdout:6/718: mkdir db/d26/d2e/d3e/d102 0 2024-04-25T17:19:23.349 INFO:tasks.workunit.client.1.smithi069.stdout:1/721: mknod d1/d4/d6/d9e/da6/cdc 0 2024-04-25T17:19:23.349 INFO:tasks.workunit.client.1.smithi069.stdout:6/707: dwrite d2/d1e/f33 [4194304,4194304] 0 2024-04-25T17:19:23.350 INFO:tasks.workunit.client.1.smithi069.stdout:6/708: fsync d2/d7/fc 0 2024-04-25T17:19:23.351 INFO:tasks.workunit.client.0.smithi037.stdout:7/660: sync 2024-04-25T17:19:23.351 INFO:tasks.workunit.client.0.smithi037.stdout:5/784: sync 2024-04-25T17:19:23.351 INFO:tasks.workunit.client.0.smithi037.stdout:2/848: sync 2024-04-25T17:19:23.351 INFO:tasks.workunit.client.0.smithi037.stdout:9/993: link d1/d48/d68/d26/d81/d9c/da4/fc1 d1/d48/d68/d26/da1/d11b/f14d 0 2024-04-25T17:19:23.353 INFO:tasks.workunit.client.0.smithi037.stdout:2/849: fsync d0/d16/d20/d59/d6a/da5/dbd/da9/ff5 0 2024-04-25T17:19:23.358 INFO:tasks.workunit.client.0.smithi037.stdout:0/797: symlink d9/d72/de0/l108 0 2024-04-25T17:19:23.360 INFO:tasks.workunit.client.0.smithi037.stdout:5/785: dread d7/d12/d5d/d90/db1/fce [4194304,4194304] 0 2024-04-25T17:19:23.363 INFO:tasks.workunit.client.1.smithi069.stdout:4/721: fsync db/d4b/d78/dc4/d41/f87 0 2024-04-25T17:19:23.365 INFO:tasks.workunit.client.0.smithi037.stdout:6/719: creat db/d1d/d20/dcf/f103 x:0 0 0 2024-04-25T17:19:23.366 INFO:tasks.workunit.client.1.smithi069.stdout:7/726: chown d4/d18/l1d 24675192 1 2024-04-25T17:19:23.366 INFO:tasks.workunit.client.0.smithi037.stdout:1/889: dwrite dc/d18/f3e [0,4194304] 0 2024-04-25T17:19:23.367 INFO:tasks.workunit.client.0.smithi037.stdout:8/695: mknod d5/db/d23/dd8/ce3 0 2024-04-25T17:19:23.369 INFO:tasks.workunit.client.0.smithi037.stdout:8/696: truncate d5/db/d23/d78/d9c/fb6 1248677 0 2024-04-25T17:19:23.371 INFO:tasks.workunit.client.0.smithi037.stdout:8/697: dread - d5/db/d23/d78/d9c/fdf zero size 2024-04-25T17:19:23.373 INFO:tasks.workunit.client.0.smithi037.stdout:3/633: link d8/d31/d32/d3e/d7d/fb8 d8/d23/dbb/d81/fbf 0 2024-04-25T17:19:23.374 INFO:tasks.workunit.client.1.smithi069.stdout:0/640: fdatasync d0/da/d54/d7d/fd6 0 2024-04-25T17:19:23.378 INFO:tasks.workunit.client.1.smithi069.stdout:8/752: creat d37/d47/d48/f102 x:0 0 0 2024-04-25T17:19:23.378 INFO:tasks.workunit.client.0.smithi037.stdout:8/698: dread d5/db/d23/d78/d93/fb9 [0,4194304] 0 2024-04-25T17:19:23.382 INFO:tasks.workunit.client.0.smithi037.stdout:2/850: mknod d0/d16/d20/d59/d6a/c10a 0 2024-04-25T17:19:23.392 INFO:tasks.workunit.client.1.smithi069.stdout:1/722: mknod d1/d4/d6/d4f/d9b/cdd 0 2024-04-25T17:19:23.394 INFO:tasks.workunit.client.1.smithi069.stdout:6/709: creat d2/d9c/d48/ff4 x:0 0 0 2024-04-25T17:19:23.397 INFO:tasks.workunit.client.1.smithi069.stdout:9/699: write d2/da4/dcf/f3b [4492187,5090] 0 2024-04-25T17:19:23.397 INFO:tasks.workunit.client.1.smithi069.stdout:9/700: dread - d2/da/fe3 zero size 2024-04-25T17:19:23.399 INFO:tasks.workunit.client.0.smithi037.stdout:2/851: dread d0/f44 [0,4194304] 0 2024-04-25T17:19:23.400 INFO:tasks.workunit.client.0.smithi037.stdout:9/994: fsync d1/d5/d2e/d34/d76/db4/f10a 0 2024-04-25T17:19:23.400 INFO:tasks.workunit.client.1.smithi069.stdout:2/711: write d0/d56/d5f/f89 [308711,29334] 0 2024-04-25T17:19:23.402 INFO:tasks.workunit.client.0.smithi037.stdout:2/852: chown d0/d16/d20/d59/d6a/da5 1931 1 2024-04-25T17:19:23.404 INFO:tasks.workunit.client.0.smithi037.stdout:7/661: dwrite d5/f46 [0,4194304] 0 2024-04-25T17:19:23.405 INFO:tasks.workunit.client.1.smithi069.stdout:4/722: write db/d4b/d78/dc4/d41/f87 [1266833,118135] 0 2024-04-25T17:19:23.405 INFO:tasks.workunit.client.1.smithi069.stdout:2/712: dread d0/d26/f2f [0,4194304] 0 2024-04-25T17:19:23.407 INFO:tasks.workunit.client.1.smithi069.stdout:7/727: symlink d4/d3e/d94/da1/dc7/d14/d5a/d5e/lf3 0 2024-04-25T17:19:23.408 INFO:tasks.workunit.client.0.smithi037.stdout:7/662: dread - d5/d14/d31/fb4 zero size 2024-04-25T17:19:23.409 INFO:tasks.workunit.client.1.smithi069.stdout:5/772: sync 2024-04-25T17:19:23.410 INFO:tasks.workunit.client.0.smithi037.stdout:0/798: dwrite d9/df/d32/f5c [4194304,4194304] 0 2024-04-25T17:19:23.412 INFO:tasks.workunit.client.1.smithi069.stdout:0/641: rename d0/da/db/d3a/fd4 to d0/da/db/d7e/fdc 0 2024-04-25T17:19:23.413 INFO:tasks.workunit.client.1.smithi069.stdout:0/642: chown d0/da/db/d1d/f6f 2418 1 2024-04-25T17:19:23.415 INFO:tasks.workunit.client.1.smithi069.stdout:8/753: creat d37/d47/d54/d6e/d9e/f103 x:0 0 0 2024-04-25T17:19:23.416 INFO:tasks.workunit.client.1.smithi069.stdout:8/754: chown d37/l56 58116803 1 2024-04-25T17:19:23.417 INFO:tasks.workunit.client.0.smithi037.stdout:1/890: mknod dc/d24/da5/c132 0 2024-04-25T17:19:23.418 INFO:tasks.workunit.client.0.smithi037.stdout:1/891: fdatasync dc/d52/d6b/dd9/d22/d36/d92/fc8 0 2024-04-25T17:19:23.420 INFO:tasks.workunit.client.0.smithi037.stdout:3/634: mkdir d8/d23/dc0 0 2024-04-25T17:19:23.424 INFO:tasks.workunit.client.1.smithi069.stdout:9/701: chown d2/da/dd/de/d59/c7e 508 1 2024-04-25T17:19:23.425 INFO:tasks.workunit.client.0.smithi037.stdout:2/853: truncate d0/d16/d20/d55/fdf 412232 0 2024-04-25T17:19:23.426 INFO:tasks.workunit.client.0.smithi037.stdout:2/854: dread - d0/d23/d7d/dae/fe8 zero size 2024-04-25T17:19:23.427 INFO:tasks.workunit.client.0.smithi037.stdout:8/699: write d5/d26/d33/f34 [1213168,18404] 0 2024-04-25T17:19:23.428 INFO:tasks.workunit.client.0.smithi037.stdout:8/700: fdatasync d5/db/d23/d58/dd3/fdc 0 2024-04-25T17:19:23.429 INFO:tasks.workunit.client.0.smithi037.stdout:0/799: mkdir d9/df/d109 0 2024-04-25T17:19:23.430 INFO:tasks.workunit.client.0.smithi037.stdout:0/800: chown d9/df/f45 13064 1 2024-04-25T17:19:23.431 INFO:tasks.workunit.client.0.smithi037.stdout:0/801: readlink d9/df/d32/dd1/lae 0 2024-04-25T17:19:23.432 INFO:tasks.workunit.client.0.smithi037.stdout:7/663: read d5/d15/d17/f20 [3601766,117856] 0 2024-04-25T17:19:23.434 INFO:tasks.workunit.client.1.smithi069.stdout:7/728: symlink d4/d3e/d94/da1/dc7/d14/d44/da8/lf4 0 2024-04-25T17:19:23.435 INFO:tasks.workunit.client.0.smithi037.stdout:4/952: getdents d7/d7e/d1e/d70/d84/dc9 0 2024-04-25T17:19:23.437 INFO:tasks.workunit.client.0.smithi037.stdout:6/720: creat db/d26/d2e/d3e/d25/f104 x:0 0 0 2024-04-25T17:19:23.437 INFO:tasks.workunit.client.0.smithi037.stdout:6/721: fdatasync db/fd3 0 2024-04-25T17:19:23.438 INFO:tasks.workunit.client.1.smithi069.stdout:3/788: dwrite d8/d16/d1a/d38/f83 [0,4194304] 0 2024-04-25T17:19:23.440 INFO:tasks.workunit.client.0.smithi037.stdout:3/635: chown d8/d31/d32/c49 2381541 1 2024-04-25T17:19:23.443 INFO:tasks.workunit.client.1.smithi069.stdout:6/710: creat d2/d1e/d43/da6/ff5 x:0 0 0 2024-04-25T17:19:23.445 INFO:tasks.workunit.client.1.smithi069.stdout:3/789: dwrite d8/d16/d1a/d2c/d6c/f76 [0,4194304] 0 2024-04-25T17:19:23.446 INFO:tasks.workunit.client.0.smithi037.stdout:5/786: getdents d7/d18 0 2024-04-25T17:19:23.446 INFO:tasks.workunit.client.1.smithi069.stdout:1/723: truncate d1/d4/d6/d9e/da6/fd2 5963538 0 2024-04-25T17:19:23.449 INFO:tasks.workunit.client.1.smithi069.stdout:9/702: mknod d2/da/dd/de/db0/cf3 0 2024-04-25T17:19:23.451 INFO:tasks.workunit.client.1.smithi069.stdout:6/711: dwrite d2/d7/fa [4194304,4194304] 0 2024-04-25T17:19:23.452 INFO:tasks.workunit.client.1.smithi069.stdout:6/712: fsync d2/f21 0 2024-04-25T17:19:23.453 INFO:tasks.workunit.client.0.smithi037.stdout:8/701: rename d5/db/d23/f29 to d5/dbc/fe4 0 2024-04-25T17:19:23.456 INFO:tasks.workunit.client.0.smithi037.stdout:0/802: fsync d9/df/d32/f47 0 2024-04-25T17:19:23.457 INFO:tasks.workunit.client.0.smithi037.stdout:0/803: stat d9/df/fb5 0 2024-04-25T17:19:23.461 INFO:tasks.workunit.client.0.smithi037.stdout:7/664: creat d5/d14/db1/fe4 x:0 0 0 2024-04-25T17:19:23.461 INFO:tasks.workunit.client.1.smithi069.stdout:4/723: link db/d15/d20/d35/d63/d70/f86 db/d15/d20/d35/d63/d75/dbd/ffe 0 2024-04-25T17:19:23.462 INFO:tasks.workunit.client.0.smithi037.stdout:1/892: dread dc/d24/da5/fda [0,4194304] 0 2024-04-25T17:19:23.463 INFO:tasks.workunit.client.1.smithi069.stdout:7/729: creat d4/d83/da2/dd3/ff5 x:0 0 0 2024-04-25T17:19:23.463 INFO:tasks.workunit.client.0.smithi037.stdout:4/953: rmdir d7/d7e/d1e/d70 39 2024-04-25T17:19:23.465 INFO:tasks.workunit.client.1.smithi069.stdout:5/773: mknod d13/d17/da5/c109 0 2024-04-25T17:19:23.466 INFO:tasks.workunit.client.1.smithi069.stdout:0/643: symlink d0/da/d6e/dd0/ldd 0 2024-04-25T17:19:23.470 INFO:tasks.workunit.client.1.smithi069.stdout:3/790: fdatasync d8/d71/f75 0 2024-04-25T17:19:23.471 INFO:tasks.workunit.client.0.smithi037.stdout:5/787: rename d7/d18/c5f to d7/d25/d4f/da7/dab/cf1 0 2024-04-25T17:19:23.471 INFO:tasks.workunit.client.1.smithi069.stdout:0/644: dwrite d0/da/d59/fc3 [0,4194304] 0 2024-04-25T17:19:23.472 INFO:tasks.workunit.client.1.smithi069.stdout:1/724: creat d1/d4/d6/fde x:0 0 0 2024-04-25T17:19:23.475 INFO:tasks.workunit.client.1.smithi069.stdout:9/703: creat d2/da/dd/de/d74/d8a/ff4 x:0 0 0 2024-04-25T17:19:23.475 INFO:tasks.workunit.client.1.smithi069.stdout:8/755: dread f10 [0,4194304] 0 2024-04-25T17:19:23.476 INFO:tasks.workunit.client.1.smithi069.stdout:9/704: write d2/da/dd/de/d74/d8a/fb9 [922236,12086] 0 2024-04-25T17:19:23.477 INFO:tasks.workunit.client.1.smithi069.stdout:6/713: mknod d2/d1e/d43/dca/cf6 0 2024-04-25T17:19:23.488 INFO:tasks.workunit.client.1.smithi069.stdout:5/774: mknod d13/d17/d29/d2e/d76/c10a 0 2024-04-25T17:19:23.488 INFO:tasks.workunit.client.0.smithi037.stdout:5/788: dwrite d7/d12/d6f/d68/faf [4194304,4194304] 0 2024-04-25T17:19:23.490 INFO:tasks.workunit.client.0.smithi037.stdout:6/722: getdents db/d26/d2e/d3e/d102 0 2024-04-25T17:19:23.490 INFO:tasks.workunit.client.0.smithi037.stdout:6/723: stat db/d1d/ff4 0 2024-04-25T17:19:23.494 INFO:tasks.workunit.client.0.smithi037.stdout:3/636: link d8/d23/dbb/d5d/f2b d8/d4c/fc1 0 2024-04-25T17:19:23.502 INFO:tasks.workunit.client.0.smithi037.stdout:6/724: dwrite db/d26/d2e/d3e/f35 [0,4194304] 0 2024-04-25T17:19:23.504 INFO:tasks.workunit.client.0.smithi037.stdout:9/995: getdents d1/d48/d68/d26/d81/d9c 0 2024-04-25T17:19:23.504 INFO:tasks.workunit.client.1.smithi069.stdout:2/713: dwrite d0/d56/d5f/d62/d7d/d31/fd5 [0,4194304] 0 2024-04-25T17:19:23.505 INFO:tasks.workunit.client.0.smithi037.stdout:2/855: dwrite d0/d15/d2a/d5a/faa [0,4194304] 0 2024-04-25T17:19:23.509 INFO:tasks.workunit.client.1.smithi069.stdout:3/791: rmdir d8/d2a 39 2024-04-25T17:19:23.512 INFO:tasks.workunit.client.1.smithi069.stdout:0/645: rmdir d0/da/d24 39 2024-04-25T17:19:23.513 INFO:tasks.workunit.client.1.smithi069.stdout:0/646: write d0/f6 [286660,125199] 0 2024-04-25T17:19:23.514 INFO:tasks.workunit.client.1.smithi069.stdout:0/647: readlink d0/l5e 0 2024-04-25T17:19:23.515 INFO:tasks.workunit.client.0.smithi037.stdout:4/954: fsync d7/f26 0 2024-04-25T17:19:23.519 INFO:tasks.workunit.client.1.smithi069.stdout:1/725: mknod d1/d4/de/d63/d7d/cdf 0 2024-04-25T17:19:23.522 INFO:tasks.workunit.client.1.smithi069.stdout:9/705: creat d2/d51/db4/ff5 x:0 0 0 2024-04-25T17:19:23.523 INFO:tasks.workunit.client.1.smithi069.stdout:9/706: readlink d2/da/dd/de/d74/la0 0 2024-04-25T17:19:23.526 INFO:tasks.workunit.client.1.smithi069.stdout:6/714: creat d2/d9c/d48/ff7 x:0 0 0 2024-04-25T17:19:23.527 INFO:tasks.workunit.client.1.smithi069.stdout:6/715: write d2/d51/d85/f7b [647136,61678] 0 2024-04-25T17:19:23.528 INFO:tasks.workunit.client.0.smithi037.stdout:8/702: write d5/da/fb4 [1426501,114001] 0 2024-04-25T17:19:23.528 INFO:tasks.workunit.client.1.smithi069.stdout:6/716: chown d2/d1e/d3f/d86/ld7 100193316 1 2024-04-25T17:19:23.529 INFO:tasks.workunit.client.1.smithi069.stdout:4/724: mknod db/d15/d20/d35/d63/cff 0 2024-04-25T17:19:23.529 INFO:tasks.workunit.client.1.smithi069.stdout:6/717: dread - d2/d1e/d43/d7d/db5/fde zero size 2024-04-25T17:19:23.534 INFO:tasks.workunit.client.0.smithi037.stdout:3/637: mknod d8/d23/dbb/d63/d86/cc2 0 2024-04-25T17:19:23.535 INFO:tasks.workunit.client.0.smithi037.stdout:1/893: dread dc/d18/f42 [0,4194304] 0 2024-04-25T17:19:23.536 INFO:tasks.workunit.client.1.smithi069.stdout:5/775: mknod d13/d17/d19/d1c/da4/c10b 0 2024-04-25T17:19:23.541 INFO:tasks.workunit.client.0.smithi037.stdout:9/996: truncate d1/d5/dc/f47 1366565 0 2024-04-25T17:19:23.541 INFO:tasks.workunit.client.0.smithi037.stdout:7/665: dwrite d5/d15/d17/d25/d2b/d59/f8c [4194304,4194304] 0 2024-04-25T17:19:23.544 INFO:tasks.workunit.client.0.smithi037.stdout:9/997: fdatasync d1/d5/d2e/d34/daf/f13a 0 2024-04-25T17:19:23.545 INFO:tasks.workunit.client.1.smithi069.stdout:3/792: write d8/d71/d8d/f8f [129884,28332] 0 2024-04-25T17:19:23.545 INFO:tasks.workunit.client.0.smithi037.stdout:0/804: write d9/df/d32/dd1/fdd [250315,62794] 0 2024-04-25T17:19:23.550 INFO:tasks.workunit.client.0.smithi037.stdout:4/955: chown d7/d7e/d4e/da5/fa8 848 1 2024-04-25T17:19:23.554 INFO:tasks.workunit.client.0.smithi037.stdout:5/789: rename d7/d43/c8b to d7/d12/d5d/d90/db1/db3/cf2 0 2024-04-25T17:19:23.558 INFO:tasks.workunit.client.0.smithi037.stdout:3/638: fdatasync d8/f5c 0 2024-04-25T17:19:23.565 INFO:tasks.workunit.client.0.smithi037.stdout:6/725: dwrite db/d53/f54 [0,4194304] 0 2024-04-25T17:19:23.568 INFO:tasks.workunit.client.1.smithi069.stdout:8/756: truncate d37/d47/d48/f49 2431653 0 2024-04-25T17:19:23.574 INFO:tasks.workunit.client.1.smithi069.stdout:7/730: rename d4/d1a/d34 to d4/d3e/d94/da1/dc7/d14/d3d/df6 0 2024-04-25T17:19:23.574 INFO:tasks.workunit.client.1.smithi069.stdout:4/725: read db/d15/d20/f76 [2009014,71021] 0 2024-04-25T17:19:23.575 INFO:tasks.workunit.client.1.smithi069.stdout:8/757: dwrite d37/d47/d54/d6e/d9e/f100 [0,4194304] 0 2024-04-25T17:19:23.577 INFO:tasks.workunit.client.1.smithi069.stdout:7/731: stat d4/d3e/d94/da1/dc7/d14/d44/fb8 0 2024-04-25T17:19:23.577 INFO:tasks.workunit.client.1.smithi069.stdout:2/714: mknod d0/d56/d5f/d62/de0/ce5 0 2024-04-25T17:19:23.578 INFO:tasks.workunit.client.1.smithi069.stdout:2/715: fdatasync d0/f53 0 2024-04-25T17:19:23.581 INFO:tasks.workunit.client.0.smithi037.stdout:4/956: symlink d7/d7e/d5b/dfe/d39/dba/d12c/l13d 0 2024-04-25T17:19:23.583 INFO:tasks.workunit.client.0.smithi037.stdout:4/957: chown d7/d7e/d45/d4f/ca9 30293142 1 2024-04-25T17:19:23.586 INFO:tasks.workunit.client.1.smithi069.stdout:5/776: dread d13/d17/f33 [0,4194304] 0 2024-04-25T17:19:23.589 INFO:tasks.workunit.client.1.smithi069.stdout:9/707: creat d2/da4/dcf/d65/dc4/ff6 x:0 0 0 2024-04-25T17:19:23.593 INFO:tasks.workunit.client.1.smithi069.stdout:3/793: write d8/d71/d8d/d92/db6/dc1/fbf [649270,1884] 0 2024-04-25T17:19:23.593 INFO:tasks.workunit.client.1.smithi069.stdout:5/777: dwrite d13/d17/d19/d1c/d79/ff6 [0,4194304] 0 2024-04-25T17:19:23.596 INFO:tasks.workunit.client.0.smithi037.stdout:5/790: write d7/d12/f21 [2227914,84581] 0 2024-04-25T17:19:23.596 INFO:tasks.workunit.client.1.smithi069.stdout:8/758: chown d37/d47/d48/d8e/ldf 0 1 2024-04-25T17:19:23.598 INFO:tasks.workunit.client.1.smithi069.stdout:9/708: dwrite d2/da/d14/f79 [0,4194304] 0 2024-04-25T17:19:23.600 INFO:tasks.workunit.client.1.smithi069.stdout:9/709: write d2/da/dd/f2d [4858982,101670] 0 2024-04-25T17:19:23.600 INFO:tasks.workunit.client.1.smithi069.stdout:4/726: rename db/d15/d26/f91 to db/d15/d20/d35/d63/d75/de6/f100 0 2024-04-25T17:19:23.605 INFO:tasks.workunit.client.1.smithi069.stdout:2/716: fdatasync d0/d56/d5f/d62/d7d/d31/f9f 0 2024-04-25T17:19:23.606 INFO:tasks.workunit.client.0.smithi037.stdout:2/856: link d0/f44 d0/f10b 0 2024-04-25T17:19:23.607 INFO:tasks.workunit.client.0.smithi037.stdout:2/857: fsync d0/d16/d20/d59/d6a/f82 0 2024-04-25T17:19:23.609 INFO:tasks.workunit.client.1.smithi069.stdout:0/648: link d0/da/d24/d67/fbb d0/d38/fde 0 2024-04-25T17:19:23.610 INFO:tasks.workunit.client.0.smithi037.stdout:9/998: fsync d1/d5/dc/f23 0 2024-04-25T17:19:23.611 INFO:tasks.workunit.client.1.smithi069.stdout:2/717: dwrite d0/d26/fa0 [0,4194304] 0 2024-04-25T17:19:23.613 INFO:tasks.workunit.client.1.smithi069.stdout:2/718: chown d0/d1/f20 13460087 1 2024-04-25T17:19:23.615 INFO:tasks.workunit.client.0.smithi037.stdout:3/639: getdents d8/d31/d8d/db7 0 2024-04-25T17:19:23.616 INFO:tasks.workunit.client.0.smithi037.stdout:3/640: write d8/f79 [1192404,15731] 0 2024-04-25T17:19:23.619 INFO:tasks.workunit.client.1.smithi069.stdout:5/778: mknod d13/d17/d19/d20/c10c 0 2024-04-25T17:19:23.622 INFO:tasks.workunit.client.0.smithi037.stdout:6/726: mkdir db/d1d/d20/dcf/dfa/d65/d8b/dee/d105 0 2024-04-25T17:19:23.626 INFO:tasks.workunit.client.1.smithi069.stdout:5/779: dread d13/d17/d19/d1c/d6c/fb3 [0,4194304] 0 2024-04-25T17:19:23.628 INFO:tasks.workunit.client.0.smithi037.stdout:2/858: creat d0/d16/d68/f10c x:0 0 0 2024-04-25T17:19:23.630 INFO:tasks.workunit.client.0.smithi037.stdout:2/859: write d0/d16/d68/f10c [628570,72693] 0 2024-04-25T17:19:23.632 INFO:tasks.workunit.client.1.smithi069.stdout:7/732: rename d4/d3e/d94/da1/dc7/d14/d44/d79/ld9 to d4/d3e/d94/da1/dc7/d14/d44/dd5/dd6/lf7 0 2024-04-25T17:19:23.633 INFO:tasks.workunit.client.1.smithi069.stdout:3/794: write d8/d16/d4b/f62 [363850,81635] 0 2024-04-25T17:19:23.633 INFO:tasks.workunit.client.1.smithi069.stdout:7/733: fsync d4/f4a 0 2024-04-25T17:19:23.633 INFO:tasks.workunit.client.0.smithi037.stdout:4/958: fdatasync d7/d7e/d5b/dfe/f36 0 2024-04-25T17:19:23.635 INFO:tasks.workunit.client.1.smithi069.stdout:4/727: fdatasync db/d15/f3f 0 2024-04-25T17:19:23.637 INFO:tasks.workunit.client.1.smithi069.stdout:6/718: sync 2024-04-25T17:19:23.639 INFO:tasks.workunit.client.1.smithi069.stdout:9/710: truncate d2/da/dd/d1e/d2e/d35/f6c 2648402 0 2024-04-25T17:19:23.640 INFO:tasks.workunit.client.0.smithi037.stdout:8/703: rename d5/db/d23/d42/l67 to d5/le5 0 2024-04-25T17:19:23.642 INFO:tasks.workunit.client.1.smithi069.stdout:9/711: read d2/da/dd/f2d [1864168,48551] 0 2024-04-25T17:19:23.643 INFO:tasks.workunit.client.1.smithi069.stdout:9/712: write d2/f2c [3995505,15405] 0 2024-04-25T17:19:23.644 INFO:tasks.workunit.client.1.smithi069.stdout:5/780: dread d13/d17/d19/f50 [0,4194304] 0 2024-04-25T17:19:23.645 INFO:tasks.workunit.client.0.smithi037.stdout:3/641: mkdir d8/d23/dbb/d81/dc3 0 2024-04-25T17:19:23.650 INFO:tasks.workunit.client.1.smithi069.stdout:9/713: dwrite d2/d51/db4/ff5 [0,4194304] 0 2024-04-25T17:19:23.651 INFO:tasks.workunit.client.1.smithi069.stdout:5/781: dwrite d13/d17/f63 [0,4194304] 0 2024-04-25T17:19:23.653 INFO:tasks.workunit.client.1.smithi069.stdout:2/719: chown d0/d26/d10/c46 3935548 1 2024-04-25T17:19:23.655 INFO:tasks.workunit.client.0.smithi037.stdout:7/666: getdents d5/d15/d17/d1b/d94 0 2024-04-25T17:19:23.662 INFO:tasks.workunit.client.0.smithi037.stdout:2/860: truncate d0/d16/d20/d55/fa6 35375 0 2024-04-25T17:19:23.663 INFO:tasks.workunit.client.1.smithi069.stdout:8/759: symlink d37/d47/d78/l104 0 2024-04-25T17:19:23.666 INFO:tasks.workunit.client.0.smithi037.stdout:4/959: rmdir d7/d78 39 2024-04-25T17:19:23.666 INFO:tasks.workunit.client.1.smithi069.stdout:7/734: truncate d4/f10 8849568 0 2024-04-25T17:19:23.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:23 smithi069 ceph-mon[34527]: pgmap v42: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 89 MiB/s rd, 270 MiB/s wr, 508 op/s 2024-04-25T17:19:23.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:23 smithi069 ceph-mon[34527]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:19:23.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:23 smithi069 ceph-mon[34527]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi037.txrgxl", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T17:19:23.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:23 smithi069 ceph-mon[34527]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi037.txrgxl", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T17:19:23.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:23 smithi069 ceph-mon[34527]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T17:19:23.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:23 smithi069 ceph-mon[34527]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:19:23.668 INFO:tasks.workunit.client.0.smithi037.stdout:6/727: dwrite db/d26/d2e/d3e/ff3 [0,4194304] 0 2024-04-25T17:19:23.669 INFO:tasks.workunit.client.1.smithi069.stdout:3/795: rename d8/d16/d9b/dc3/dc8 to d8/d16/d1a/d2c/d49/d59/dff/d107/d10d 0 2024-04-25T17:19:23.672 INFO:tasks.workunit.client.0.smithi037.stdout:0/805: rename d9/d14/d28/d48/f4e to d9/df/dbd/dc1/de2/f10a 0 2024-04-25T17:19:23.673 INFO:tasks.workunit.client.1.smithi069.stdout:4/728: fsync db/d4b/f6e 0 2024-04-25T17:19:23.677 INFO:tasks.workunit.client.0.smithi037.stdout:5/791: readlink d7/d18/d62/l71 0 2024-04-25T17:19:23.682 INFO:tasks.workunit.client.1.smithi069.stdout:1/726: creat d1/d4/d6/d9e/da6/d7c/fe0 x:0 0 0 2024-04-25T17:19:23.684 INFO:tasks.workunit.client.0.smithi037.stdout:9/999: creat d1/d5/dc/d3c/f14e x:0 0 0 2024-04-25T17:19:23.686 INFO:tasks.workunit.client.0.smithi037.stdout:4/960: creat d7/d7e/d5b/dfe/d39/d7a/dcc/f13e x:0 0 0 2024-04-25T17:19:23.688 INFO:tasks.workunit.client.1.smithi069.stdout:1/727: dread d1/d4/d6/d9e/da6/d7c/d4d/d8f/fab [0,4194304] 0 2024-04-25T17:19:23.695 INFO:tasks.workunit.client.1.smithi069.stdout:8/760: mknod d37/d47/d78/d93/c105 0 2024-04-25T17:19:23.698 INFO:tasks.workunit.client.0.smithi037.stdout:5/792: write d7/d43/f30 [8009500,50358] 0 2024-04-25T17:19:23.698 INFO:tasks.workunit.client.1.smithi069.stdout:7/735: symlink d4/d3e/d94/da1/dc7/d14/d44/d88/lf8 0 2024-04-25T17:19:23.699 INFO:tasks.workunit.client.0.smithi037.stdout:8/704: write d5/db/d18/d3b/d50/f56 [542148,121902] 0 2024-04-25T17:19:23.699 INFO:tasks.workunit.client.1.smithi069.stdout:7/736: chown d4/d3e/c56 490043 1 2024-04-25T17:19:23.700 INFO:tasks.workunit.client.1.smithi069.stdout:7/737: readlink d4/d3e/d94/da1/dc7/d14/d44/da8/lc0 0 2024-04-25T17:19:23.701 INFO:tasks.workunit.client.1.smithi069.stdout:3/796: symlink d8/d16/d1a/d2c/d49/d87/d8a/l10e 0 2024-04-25T17:19:23.702 INFO:tasks.workunit.client.1.smithi069.stdout:3/797: write d8/d16/d4b/d9e/dca/de7/ff7 [778142,50987] 0 2024-04-25T17:19:23.703 INFO:tasks.workunit.client.0.smithi037.stdout:6/728: mkdir db/d26/d2e/d106 0 2024-04-25T17:19:23.705 INFO:tasks.workunit.client.0.smithi037.stdout:8/705: dread d5/d26/d33/f34 [0,4194304] 0 2024-04-25T17:19:23.706 INFO:tasks.workunit.client.0.smithi037.stdout:2/861: write d0/d15/f48 [95964,17193] 0 2024-04-25T17:19:23.706 INFO:tasks.workunit.client.0.smithi037.stdout:8/706: write d5/db/d7e/fb7 [1455216,106948] 0 2024-04-25T17:19:23.710 INFO:tasks.workunit.client.1.smithi069.stdout:4/729: dread db/d22/f71 [0,4194304] 0 2024-04-25T17:19:23.711 INFO:tasks.workunit.client.0.smithi037.stdout:3/642: creat d8/d23/fc4 x:0 0 0 2024-04-25T17:19:23.712 INFO:tasks.workunit.client.1.smithi069.stdout:0/649: creat d0/fdf x:0 0 0 2024-04-25T17:19:23.712 INFO:tasks.workunit.client.0.smithi037.stdout:5/793: dread - d7/d43/f9b zero size 2024-04-25T17:19:23.713 INFO:tasks.workunit.client.0.smithi037.stdout:5/794: chown d7/d12/f4d 994 1 2024-04-25T17:19:23.715 INFO:tasks.workunit.client.1.smithi069.stdout:4/730: dwrite db/d15/d20/d35/d63/d43/d48/d6c/fe2 [0,4194304] 0 2024-04-25T17:19:23.718 INFO:tasks.workunit.client.0.smithi037.stdout:6/729: rmdir db/d26/d2e 39 2024-04-25T17:19:23.720 INFO:tasks.workunit.client.1.smithi069.stdout:5/782: mkdir d13/dff/d10d 0 2024-04-25T17:19:23.723 INFO:tasks.workunit.client.0.smithi037.stdout:0/806: dwrite d9/df/d32/d35/f90 [0,4194304] 0 2024-04-25T17:19:23.723 INFO:tasks.workunit.client.0.smithi037.stdout:5/795: dwrite d7/d12/d6f/d94/fde [0,4194304] 0 2024-04-25T17:19:23.723 INFO:tasks.workunit.client.1.smithi069.stdout:2/720: mknod d0/d26/d10/db5/de3/ce6 0 2024-04-25T17:19:23.724 INFO:tasks.workunit.client.1.smithi069.stdout:2/721: write d0/d26/d10/d43/fa1 [593330,13031] 0 2024-04-25T17:19:23.725 INFO:tasks.workunit.client.0.smithi037.stdout:0/807: fdatasync d9/d14/f9a 0 2024-04-25T17:19:23.725 INFO:tasks.workunit.client.0.smithi037.stdout:5/796: chown d7/d25/f2b 0 1 2024-04-25T17:19:23.730 INFO:tasks.workunit.client.1.smithi069.stdout:1/728: rename d1/d43/d5f to d1/d4/d6/d9e/da6/d7c/d1d/de1 0 2024-04-25T17:19:23.732 INFO:tasks.workunit.client.1.smithi069.stdout:1/729: write d1/d4/d6/d9e/da6/d7c/f82 [540606,32306] 0 2024-04-25T17:19:23.732 INFO:tasks.workunit.client.0.smithi037.stdout:1/894: rename dc/d24/da5/df9/d121 to dc/d18/d64/d133 0 2024-04-25T17:19:23.733 INFO:tasks.workunit.client.0.smithi037.stdout:1/895: chown dc/d18/f7d 108 1 2024-04-25T17:19:23.734 INFO:tasks.workunit.client.1.smithi069.stdout:8/761: stat c7 0 2024-04-25T17:19:23.734 INFO:tasks.workunit.client.0.smithi037.stdout:8/707: fsync d5/db/d18/d3b/d75/f9e 0 2024-04-25T17:19:23.735 INFO:tasks.workunit.client.1.smithi069.stdout:6/719: sync 2024-04-25T17:19:23.736 INFO:tasks.workunit.client.0.smithi037.stdout:3/643: mknod d8/d23/d38/cc5 0 2024-04-25T17:19:23.737 INFO:tasks.workunit.client.1.smithi069.stdout:6/720: fdatasync d2/d1e/d43/dca/dce/fd9 0 2024-04-25T17:19:23.738 INFO:tasks.workunit.client.1.smithi069.stdout:8/762: truncate d37/d47/d54/d6e/d98/fb5 860643 0 2024-04-25T17:19:23.738 INFO:tasks.workunit.client.1.smithi069.stdout:7/738: mkdir d4/d3e/d94/da1/dc7/d14/d5a/d5e/df9 0 2024-04-25T17:19:23.739 INFO:tasks.workunit.client.1.smithi069.stdout:8/763: write d37/d47/d48/f102 [681982,48290] 0 2024-04-25T17:19:23.740 INFO:tasks.workunit.client.1.smithi069.stdout:9/714: write d2/da/dd/de/d64/fbf [270797,86398] 0 2024-04-25T17:19:23.741 INFO:tasks.workunit.client.1.smithi069.stdout:9/715: dread - d2/fd6 zero size 2024-04-25T17:19:23.744 INFO:tasks.workunit.client.0.smithi037.stdout:1/896: read dc/d52/d6b/dd9/d4d/d6a/dea/dd8/fe9 [2896687,83990] 0 2024-04-25T17:19:23.744 INFO:tasks.workunit.client.0.smithi037.stdout:3/644: dwrite d8/d57/fa1 [0,4194304] 0 2024-04-25T17:19:23.749 INFO:tasks.workunit.client.0.smithi037.stdout:6/730: dread - db/d26/fe6 zero size 2024-04-25T17:19:23.751 INFO:tasks.workunit.client.0.smithi037.stdout:4/961: link d7/d7e/d45/d4f/l7b d7/d7e/d5b/dfe/d39/dba/d12c/l13f 0 2024-04-25T17:19:23.752 INFO:tasks.workunit.client.0.smithi037.stdout:4/962: dread - d7/d7e/d5b/dfe/d39/d9c/fda zero size 2024-04-25T17:19:23.753 INFO:tasks.workunit.client.1.smithi069.stdout:5/783: mkdir d13/d17/d19/d20/d2d/d10e 0 2024-04-25T17:19:23.754 INFO:tasks.workunit.client.0.smithi037.stdout:5/797: symlink d7/da1/dda/lf3 0 2024-04-25T17:19:23.756 INFO:tasks.workunit.client.1.smithi069.stdout:2/722: mkdir d0/d1/d5b/d33/de7 0 2024-04-25T17:19:23.758 INFO:tasks.workunit.client.1.smithi069.stdout:0/650: rename d0/da/d59/f61 to d0/da/db/d2a/d8c/fe0 0 2024-04-25T17:19:23.759 INFO:tasks.workunit.client.0.smithi037.stdout:8/708: chown d5/db/d23/d58/la3 438954 1 2024-04-25T17:19:23.762 INFO:tasks.workunit.client.1.smithi069.stdout:4/731: write db/d15/d20/f76 [2073236,87839] 0 2024-04-25T17:19:23.764 INFO:tasks.workunit.client.0.smithi037.stdout:3/645: creat d8/d57/fc6 x:0 0 0 2024-04-25T17:19:23.764 INFO:tasks.workunit.client.1.smithi069.stdout:4/732: readlink db/d15/d42/d64/lef 0 2024-04-25T17:19:23.766 INFO:tasks.workunit.client.0.smithi037.stdout:1/897: mkdir dc/d52/d6b/dd9/d4d/d6a/d8f/ddc/dee/dfc/d134 0 2024-04-25T17:19:23.767 INFO:tasks.workunit.client.1.smithi069.stdout:1/730: dwrite d1/d4/d6/d4f/d9b/fc9 [0,4194304] 0 2024-04-25T17:19:23.768 INFO:tasks.workunit.client.1.smithi069.stdout:6/721: mkdir d2/d51/df8 0 2024-04-25T17:19:23.768 INFO:tasks.workunit.client.0.smithi037.stdout:1/898: write dc/d52/d6b/dd9/d22/d36/f4c [4599404,58991] 0 2024-04-25T17:19:23.768 INFO:tasks.workunit.client.1.smithi069.stdout:1/731: chown d1/f9 4449417 1 2024-04-25T17:19:23.769 INFO:tasks.workunit.client.0.smithi037.stdout:1/899: fsync dc/d24/fbd 0 2024-04-25T17:19:23.770 INFO:tasks.workunit.client.1.smithi069.stdout:6/722: write d2/d1e/d3f/d86/fb1 [1097960,7149] 0 2024-04-25T17:19:23.772 INFO:tasks.workunit.client.1.smithi069.stdout:7/739: write d4/d1a/f2f [1126402,69335] 0 2024-04-25T17:19:23.772 INFO:tasks.workunit.client.1.smithi069.stdout:7/740: chown d4/d3e/c50 148 1 2024-04-25T17:19:23.775 INFO:tasks.workunit.client.1.smithi069.stdout:7/741: rename d4/d3e/d94/da1/dc7/d14/d44/dd5 to d4/d3e/d94/da1/dc7/d14/d44/dd5/dd6/dfa 22 2024-04-25T17:19:23.779 INFO:tasks.workunit.client.0.smithi037.stdout:3/646: symlink d8/d23/dbb/d81/lc7 0 2024-04-25T17:19:23.781 INFO:tasks.workunit.client.0.smithi037.stdout:1/900: dwrite dc/d52/d6b/dd9/d22/d36/d8c/f11a [0,4194304] 0 2024-04-25T17:19:23.784 INFO:tasks.workunit.client.0.smithi037.stdout:4/963: mkdir d7/d7e/d5b/d140 0 2024-04-25T17:19:23.785 INFO:tasks.workunit.client.0.smithi037.stdout:4/964: chown d7/d7e/d5b/dfe/f3e 2485 1 2024-04-25T17:19:23.786 INFO:tasks.workunit.client.1.smithi069.stdout:0/651: chown d0/d36/cd2 13 1 2024-04-25T17:19:23.787 INFO:tasks.workunit.client.0.smithi037.stdout:4/965: chown d7/d7e/d5b/dfe/d39/dba/d12c 250935610 1 2024-04-25T17:19:23.788 INFO:tasks.workunit.client.1.smithi069.stdout:4/733: mknod db/d15/d20/d35/d63/d70/d8a/c101 0 2024-04-25T17:19:23.790 INFO:tasks.workunit.client.0.smithi037.stdout:0/808: link d9/df/d32/d39/f76 d9/df/d32/f10b 0 2024-04-25T17:19:23.795 INFO:tasks.workunit.client.1.smithi069.stdout:3/798: rmdir d8/d16/d4b/def/df0 0 2024-04-25T17:19:23.796 INFO:tasks.workunit.client.1.smithi069.stdout:3/799: chown d8/d16/d1a/d99/fa7 5 1 2024-04-25T17:19:23.798 INFO:tasks.workunit.client.1.smithi069.stdout:7/742: mknod d4/d3e/d94/da1/dc7/d14/d3d/df6/cfb 0 2024-04-25T17:19:23.799 INFO:tasks.workunit.client.1.smithi069.stdout:6/723: dread d2/d7/f25 [0,4194304] 0 2024-04-25T17:19:23.800 INFO:tasks.workunit.client.1.smithi069.stdout:3/800: dread d8/d16/d1a/d38/f83 [0,4194304] 0 2024-04-25T17:19:23.801 INFO:tasks.workunit.client.1.smithi069.stdout:3/801: dread - d8/d16/d1a/d2c/d49/d87/f104 zero size 2024-04-25T17:19:23.802 INFO:tasks.workunit.client.0.smithi037.stdout:8/709: dwrite d5/db/d59/f5f [0,4194304] 0 2024-04-25T17:19:23.804 INFO:tasks.workunit.client.0.smithi037.stdout:6/731: dread db/d26/d2e/d3e/f6f [0,4194304] 0 2024-04-25T17:19:23.807 INFO:tasks.workunit.client.1.smithi069.stdout:3/802: dread d8/f12 [0,4194304] 0 2024-04-25T17:19:23.808 INFO:tasks.workunit.client.0.smithi037.stdout:4/966: truncate d7/d7e/d1e/d70/d84/dc9/f13b 429171 0 2024-04-25T17:19:23.810 INFO:tasks.workunit.client.0.smithi037.stdout:0/809: unlink d9/df/f98 0 2024-04-25T17:19:23.812 INFO:tasks.workunit.client.1.smithi069.stdout:4/734: truncate db/d4b/f6e 454364 0 2024-04-25T17:19:23.814 INFO:tasks.workunit.client.1.smithi069.stdout:0/652: dwrite d0/da/db/d7e/fdc [0,4194304] 0 2024-04-25T17:19:23.814 INFO:tasks.workunit.client.0.smithi037.stdout:6/732: dread db/d1d/fc6 [0,4194304] 0 2024-04-25T17:19:23.814 INFO:tasks.workunit.client.1.smithi069.stdout:4/735: write db/d4b/d78/d79/dca/fdc [950544,116553] 0 2024-04-25T17:19:23.817 INFO:tasks.workunit.client.1.smithi069.stdout:8/764: truncate d37/d47/d54/fae 64412 0 2024-04-25T17:19:23.820 INFO:tasks.workunit.client.1.smithi069.stdout:6/724: dread d2/d7/f12 [0,4194304] 0 2024-04-25T17:19:23.824 INFO:tasks.workunit.client.1.smithi069.stdout:0/653: dwrite d0/da/d24/f6d [4194304,4194304] 0 2024-04-25T17:19:23.829 INFO:tasks.workunit.client.1.smithi069.stdout:1/732: creat d1/d4/d6/d9e/da6/fe2 x:0 0 0 2024-04-25T17:19:23.832 INFO:tasks.workunit.client.1.smithi069.stdout:4/736: mkdir db/d15/d42/d64/d7f/d102 0 2024-04-25T17:19:23.833 INFO:tasks.workunit.client.1.smithi069.stdout:7/743: mkdir d4/d1a/dfc 0 2024-04-25T17:19:23.834 INFO:tasks.workunit.client.1.smithi069.stdout:4/737: chown db/d15/d42/d64/d7f/df7 258 1 2024-04-25T17:19:23.835 INFO:tasks.workunit.client.1.smithi069.stdout:6/725: chown d2/l3 24433911 1 2024-04-25T17:19:23.835 INFO:tasks.workunit.client.1.smithi069.stdout:9/716: link d2/da/dd/d1e/d40/l53 d2/da/dd/d1e/d2e/d68/dba/lf7 0 2024-04-25T17:19:23.836 INFO:tasks.workunit.client.0.smithi037.stdout:5/798: getdents d7/d12/d6f/d94 0 2024-04-25T17:19:23.837 INFO:tasks.workunit.client.1.smithi069.stdout:1/733: dwrite d1/d4/d6/d4f/d9b/fac [0,4194304] 0 2024-04-25T17:19:23.839 INFO:tasks.workunit.client.1.smithi069.stdout:0/654: unlink d0/da/db/d1d/cb2 0 2024-04-25T17:19:23.841 INFO:tasks.workunit.client.1.smithi069.stdout:7/744: creat d4/d18/ffd x:0 0 0 2024-04-25T17:19:23.843 INFO:tasks.workunit.client.1.smithi069.stdout:9/717: fdatasync d2/da/dd/f11 0 2024-04-25T17:19:23.845 INFO:tasks.workunit.client.1.smithi069.stdout:4/738: mkdir db/d15/d20/d35/d63/d70/d8a/d96/dbf/d103 0 2024-04-25T17:19:23.847 INFO:tasks.workunit.client.1.smithi069.stdout:3/803: dread d8/d71/d8d/d92/db6/fcb [0,4194304] 0 2024-04-25T17:19:23.847 INFO:tasks.workunit.client.1.smithi069.stdout:6/726: rename d2/d1e/d3f/d56/fd6 to d2/d1e/d3f/d56/de5/ff9 0 2024-04-25T17:19:23.848 INFO:tasks.workunit.client.1.smithi069.stdout:0/655: symlink d0/d17/d40/le1 0 2024-04-25T17:19:23.849 INFO:tasks.workunit.client.1.smithi069.stdout:1/734: truncate d1/d4/d6/d9e/da6/d7c/d4d/d8f/fab 1228245 0 2024-04-25T17:19:23.850 INFO:tasks.workunit.client.0.smithi037.stdout:8/710: mkdir d5/db/d18/d3b/de6 0 2024-04-25T17:19:23.851 INFO:tasks.workunit.client.0.smithi037.stdout:3/647: getdents d8/d23/dbb/d63 0 2024-04-25T17:19:23.851 INFO:tasks.workunit.client.1.smithi069.stdout:6/727: dread d2/d1e/d43/d7d/f9f [0,4194304] 0 2024-04-25T17:19:23.852 INFO:tasks.workunit.client.1.smithi069.stdout:9/718: mkdir d2/da/dd/de/d74/dbc/df8 0 2024-04-25T17:19:23.852 INFO:tasks.workunit.client.1.smithi069.stdout:6/728: chown d2/d1e/l26 14105012 1 2024-04-25T17:19:23.852 INFO:tasks.workunit.client.1.smithi069.stdout:6/729: dread - d2/d51/f54 zero size 2024-04-25T17:19:23.853 INFO:tasks.workunit.client.1.smithi069.stdout:6/730: dread - d2/d51/d89/f90 zero size 2024-04-25T17:19:23.854 INFO:tasks.workunit.client.1.smithi069.stdout:4/739: creat db/f104 x:0 0 0 2024-04-25T17:19:23.854 INFO:tasks.workunit.client.0.smithi037.stdout:6/733: mknod db/d1d/d20/dcf/dfa/d65/d68/c107 0 2024-04-25T17:19:23.855 INFO:tasks.workunit.client.0.smithi037.stdout:5/799: creat d7/d18/d7c/ff4 x:0 0 0 2024-04-25T17:19:23.859 INFO:tasks.workunit.client.0.smithi037.stdout:3/648: rename d8/d23/dbb/d63/c6c to d8/d57/cc8 0 2024-04-25T17:19:23.862 INFO:tasks.workunit.client.0.smithi037.stdout:0/810: link d9/df/d32/d56/f8d d9/d14/d28/d48/da9/ddc/f10c 0 2024-04-25T17:19:23.863 INFO:tasks.workunit.client.0.smithi037.stdout:0/811: chown d9/d14/d28/ff4 1851 1 2024-04-25T17:19:23.864 INFO:tasks.workunit.client.0.smithi037.stdout:6/734: mkdir db/d1d/d20/dcf/d108 0 2024-04-25T17:19:23.866 INFO:tasks.workunit.client.0.smithi037.stdout:5/800: creat d7/d43/d9f/ff5 x:0 0 0 2024-04-25T17:19:23.867 INFO:tasks.workunit.client.0.smithi037.stdout:8/711: dwrite d5/d6a/f71 [4194304,4194304] 0 2024-04-25T17:19:23.868 INFO:tasks.workunit.client.0.smithi037.stdout:3/649: truncate d8/f37 3332002 0 2024-04-25T17:19:23.868 INFO:tasks.workunit.client.1.smithi069.stdout:9/719: mknod d2/da/dd/d1e/d2e/d35/cf9 0 2024-04-25T17:19:23.868 INFO:tasks.workunit.client.1.smithi069.stdout:6/731: creat d2/d7/dbc/ffa x:0 0 0 2024-04-25T17:19:23.868 INFO:tasks.workunit.client.0.smithi037.stdout:5/801: chown d7/d12/f31 0 1 2024-04-25T17:19:23.869 INFO:tasks.workunit.client.1.smithi069.stdout:6/732: fsync d2/d1e/d43/db6/f7c 0 2024-04-25T17:19:23.869 INFO:tasks.workunit.client.1.smithi069.stdout:9/720: truncate d2/fd6 812629 0 2024-04-25T17:19:23.870 INFO:tasks.workunit.client.1.smithi069.stdout:6/733: write d2/d9c/d48/f4f [2166832,17749] 0 2024-04-25T17:19:23.873 INFO:tasks.workunit.client.1.smithi069.stdout:3/804: mkdir d8/d10f 0 2024-04-25T17:19:23.874 INFO:tasks.workunit.client.1.smithi069.stdout:4/740: dread db/d15/d20/d35/d63/d43/d48/f5e [0,4194304] 0 2024-04-25T17:19:23.875 INFO:tasks.workunit.client.0.smithi037.stdout:4/967: dread d7/d7e/d5b/dfe/d39/de6/f109 [4194304,4194304] 0 2024-04-25T17:19:23.875 INFO:tasks.workunit.client.0.smithi037.stdout:0/812: dwrite d9/df/d32/d35/fe4 [0,4194304] 0 2024-04-25T17:19:23.880 INFO:tasks.workunit.client.0.smithi037.stdout:4/968: readlink d7/d7e/d1e/dae/l110 0 2024-04-25T17:19:23.886 INFO:tasks.workunit.client.1.smithi069.stdout:2/723: sync 2024-04-25T17:19:23.890 INFO:tasks.workunit.client.1.smithi069.stdout:5/784: write d13/d17/f42 [1151284,110155] 0 2024-04-25T17:19:23.913 INFO:tasks.workunit.client.0.smithi037.stdout:4/969: rmdir d7/d7e/d5b/dfe/d39/d9c/da3/d11e 0 2024-04-25T17:19:23.918 INFO:tasks.workunit.client.0.smithi037.stdout:4/970: write d7/d78/fe2 [4120515,15732] 0 2024-04-25T17:19:23.921 INFO:tasks.workunit.client.0.smithi037.stdout:1/901: dwrite dc/d52/d6b/f6e [0,4194304] 0 2024-04-25T17:19:23.935 INFO:tasks.workunit.client.1.smithi069.stdout:8/765: sync 2024-04-25T17:19:23.936 INFO:tasks.workunit.client.1.smithi069.stdout:8/766: chown d37/d47/d78/d93/c105 64989 1 2024-04-25T17:19:23.943 INFO:tasks.workunit.client.1.smithi069.stdout:8/767: dwrite d37/d66/d6b/fe5 [0,4194304] 0 2024-04-25T17:19:23.944 INFO:tasks.workunit.client.1.smithi069.stdout:8/768: chown d37/d47/c77 5 1 2024-04-25T17:19:23.972 INFO:tasks.workunit.client.0.smithi037.stdout:1/902: creat dc/d52/d6b/dd9/d4d/f135 x:0 0 0 2024-04-25T17:19:23.979 INFO:tasks.workunit.client.1.smithi069.stdout:0/656: write d0/da/d54/f5c [947972,104153] 0 2024-04-25T17:19:23.981 INFO:tasks.workunit.client.1.smithi069.stdout:0/657: read d0/da/db/d2a/d8c/fe0 [4216982,16502] 0 2024-04-25T17:19:23.981 INFO:tasks.workunit.client.1.smithi069.stdout:0/658: chown d0/da/db/d7e/d80/la2 0 1 2024-04-25T17:19:23.984 INFO:tasks.workunit.client.0.smithi037.stdout:3/650: rmdir d8 39 2024-04-25T17:19:23.988 INFO:tasks.workunit.client.0.smithi037.stdout:8/712: write d5/d6a/f54 [871372,12465] 0 2024-04-25T17:19:23.992 INFO:tasks.workunit.client.0.smithi037.stdout:5/802: write d7/f75 [794859,124969] 0 2024-04-25T17:19:23.993 INFO:tasks.workunit.client.0.smithi037.stdout:3/651: chown d8/d31/d32/d87/lb6 0 1 2024-04-25T17:19:23.995 INFO:tasks.workunit.client.0.smithi037.stdout:6/735: dwrite db/d1d/d20/dcf/dfa/d65/d68/dae/fc5 [0,4194304] 0 2024-04-25T17:19:23.996 INFO:tasks.workunit.client.0.smithi037.stdout:6/736: stat db/d26/d2e/d82 0 2024-04-25T17:19:23.999 INFO:tasks.workunit.client.0.smithi037.stdout:8/713: dwrite d5/db/fb3 [4194304,4194304] 0 2024-04-25T17:19:24.000 INFO:tasks.workunit.client.0.smithi037.stdout:8/714: chown d5/db/d23/dd8/ce3 120 1 2024-04-25T17:19:24.001 INFO:tasks.workunit.client.0.smithi037.stdout:5/803: rmdir d7/d25/d4f/da7 39 2024-04-25T17:19:24.003 INFO:tasks.workunit.client.1.smithi069.stdout:0/659: dread d0/da/db/d2c/f74 [0,4194304] 0 2024-04-25T17:19:24.003 INFO:tasks.workunit.client.0.smithi037.stdout:5/804: stat d7 0 2024-04-25T17:19:24.005 INFO:tasks.workunit.client.0.smithi037.stdout:0/813: write d9/d14/d28/d48/d58/f5d [237480,26061] 0 2024-04-25T17:19:24.007 INFO:tasks.workunit.client.0.smithi037.stdout:8/715: dread d5/db/d18/d3b/d50/f56 [0,4194304] 0 2024-04-25T17:19:24.008 INFO:tasks.workunit.client.0.smithi037.stdout:8/716: chown d5/da/f11 233133 1 2024-04-25T17:19:24.010 INFO:tasks.workunit.client.1.smithi069.stdout:0/660: dwrite d0/fdf [0,4194304] 0 2024-04-25T17:19:24.024 INFO:tasks.workunit.client.0.smithi037.stdout:6/737: fdatasync db/d1d/d20/f3a 0 2024-04-25T17:19:24.030 INFO:tasks.workunit.client.1.smithi069.stdout:9/721: chown d2/da4/dcf/c7b 316837893 1 2024-04-25T17:19:24.032 INFO:tasks.workunit.client.1.smithi069.stdout:6/734: mknod d2/d9c/d97/d98/cfb 0 2024-04-25T17:19:24.036 INFO:tasks.workunit.client.1.smithi069.stdout:4/741: unlink db/d15/d42/d64/lef 0 2024-04-25T17:19:24.036 INFO:tasks.workunit.client.0.smithi037.stdout:1/903: rmdir dc/d52/d6b/dd9/d4d 39 2024-04-25T17:19:24.037 INFO:tasks.workunit.client.0.smithi037.stdout:4/971: dwrite d7/d7e/d45/fb9 [0,4194304] 0 2024-04-25T17:19:24.037 INFO:tasks.workunit.client.1.smithi069.stdout:9/722: dread d2/da/d14/f25 [0,4194304] 0 2024-04-25T17:19:24.045 INFO:tasks.workunit.client.0.smithi037.stdout:8/717: symlink d5/db/d18/dc8/le7 0 2024-04-25T17:19:24.047 INFO:tasks.workunit.client.0.smithi037.stdout:6/738: dread db/d26/f67 [0,4194304] 0 2024-04-25T17:19:24.048 INFO:tasks.workunit.client.0.smithi037.stdout:8/718: truncate d5/db/d18/d3b/d50/fde 281020 0 2024-04-25T17:19:24.048 INFO:tasks.workunit.client.0.smithi037.stdout:3/652: getdents d8/d23/d38 0 2024-04-25T17:19:24.049 INFO:tasks.workunit.client.1.smithi069.stdout:8/769: creat d37/d47/d78/d93/df9/f106 x:0 0 0 2024-04-25T17:19:24.057 INFO:tasks.workunit.client.0.smithi037.stdout:3/653: unlink d8/d23/d72/f9c 0 2024-04-25T17:19:24.060 INFO:tasks.workunit.client.0.smithi037.stdout:4/972: dread d7/d7e/d5b/f6a [0,4194304] 0 2024-04-25T17:19:24.065 INFO:tasks.workunit.client.0.smithi037.stdout:6/739: creat db/d1d/d20/dcf/dfa/d65/d68/dae/f109 x:0 0 0 2024-04-25T17:19:24.070 INFO:tasks.workunit.client.1.smithi069.stdout:7/745: rename d4/d18/lc4 to d4/d3e/d94/da1/dc7/d14/lfe 0 2024-04-25T17:19:24.073 INFO:tasks.workunit.client.0.smithi037.stdout:3/654: rmdir d8/d23/dbb 39 2024-04-25T17:19:24.074 INFO:tasks.workunit.client.0.smithi037.stdout:3/655: chown d8/d31/d8d/db7 0 1 2024-04-25T17:19:24.075 INFO:tasks.workunit.client.0.smithi037.stdout:0/814: write d9/df/d32/dd1/d7a/da4/fd4 [7438,3994] 0 2024-04-25T17:19:24.075 INFO:tasks.workunit.client.0.smithi037.stdout:0/815: chown d9/d14/d28/d48 51 1 2024-04-25T17:19:24.076 INFO:tasks.workunit.client.0.smithi037.stdout:8/719: symlink d5/le8 0 2024-04-25T17:19:24.077 INFO:tasks.workunit.client.0.smithi037.stdout:0/816: chown d9/d72/fa0 3685511 1 2024-04-25T17:19:24.078 INFO:tasks.workunit.client.1.smithi069.stdout:4/742: dread - db/d15/d20/f46 zero size 2024-04-25T17:19:24.079 INFO:tasks.workunit.client.1.smithi069.stdout:4/743: chown db/d15/d82/df4 9 1 2024-04-25T17:19:24.079 INFO:tasks.workunit.client.0.smithi037.stdout:0/817: write d9/df/d32/dd1/d7a/da4/fd4 [466313,41560] 0 2024-04-25T17:19:24.081 INFO:tasks.workunit.client.0.smithi037.stdout:1/904: mkdir dc/d52/d6b/dd9/d4d/d6a/d136 0 2024-04-25T17:19:24.083 INFO:tasks.workunit.client.0.smithi037.stdout:5/805: truncate d7/d12/d6f/d68/faf 1448389 0 2024-04-25T17:19:24.085 INFO:tasks.workunit.client.0.smithi037.stdout:5/806: write d7/d12/f21 [4113345,21859] 0 2024-04-25T17:19:24.086 INFO:tasks.workunit.client.1.smithi069.stdout:5/785: symlink d13/d17/d19/d1c/l10f 0 2024-04-25T17:19:24.088 INFO:tasks.workunit.client.1.smithi069.stdout:8/770: creat d37/d62/f107 x:0 0 0 2024-04-25T17:19:24.091 INFO:tasks.workunit.client.1.smithi069.stdout:0/661: mkdir d0/da/de2 0 2024-04-25T17:19:24.093 INFO:tasks.workunit.client.0.smithi037.stdout:6/740: creat db/d1d/db1/dc7/df8/f10a x:0 0 0 2024-04-25T17:19:24.094 INFO:tasks.workunit.client.1.smithi069.stdout:1/735: rename d1/d43/c25 to d1/d4/d6/d9e/da6/d7c/d1d/de1/ce3 0 2024-04-25T17:19:24.098 INFO:tasks.workunit.client.0.smithi037.stdout:1/905: rename dc/d18/f7d to dc/d52/d6b/dd9/d4d/d6a/d8f/ddc/dee/f137 0 2024-04-25T17:19:24.100 INFO:tasks.workunit.client.1.smithi069.stdout:6/735: mknod d2/d1e/d43/db6/daf/cfc 0 2024-04-25T17:19:24.101 INFO:tasks.workunit.client.1.smithi069.stdout:6/736: chown d2/d1e/d43/d7d/db5/fde 484669596 1 2024-04-25T17:19:24.102 INFO:tasks.workunit.client.1.smithi069.stdout:3/805: fsync d8/d2a/f82 0 2024-04-25T17:19:24.104 INFO:tasks.workunit.client.1.smithi069.stdout:1/736: dwrite d1/d4/d6/d4f/d9b/da3/fce [0,4194304] 0 2024-04-25T17:19:24.105 INFO:tasks.workunit.client.0.smithi037.stdout:5/807: mkdir d7/d43/d9f/df6 0 2024-04-25T17:19:24.108 INFO:tasks.workunit.client.0.smithi037.stdout:0/818: dread d9/df/d32/d39/f64 [0,4194304] 0 2024-04-25T17:19:24.108 INFO:tasks.workunit.client.0.smithi037.stdout:2/862: sync 2024-04-25T17:19:24.109 INFO:tasks.workunit.client.0.smithi037.stdout:7/667: sync 2024-04-25T17:19:24.110 INFO:tasks.workunit.client.0.smithi037.stdout:4/973: creat d7/d7e/d1e/f141 x:0 0 0 2024-04-25T17:19:24.111 INFO:tasks.workunit.client.1.smithi069.stdout:2/724: creat d0/d56/d5f/d62/d7d/fe8 x:0 0 0 2024-04-25T17:19:24.113 INFO:tasks.workunit.client.1.smithi069.stdout:2/725: chown d0/d1/d5b/c7f 430 1 2024-04-25T17:19:24.113 INFO:tasks.workunit.client.1.smithi069.stdout:9/723: write d2/da/f4e [328145,106475] 0 2024-04-25T17:19:24.117 INFO:tasks.workunit.client.1.smithi069.stdout:2/726: dread d0/d56/d5f/f65 [0,4194304] 0 2024-04-25T17:19:24.119 INFO:tasks.workunit.client.0.smithi037.stdout:3/656: rename d8/d23/dbb/d81/fbf to d8/d23/d38/fc9 0 2024-04-25T17:19:24.121 INFO:tasks.workunit.client.0.smithi037.stdout:1/906: mknod dc/d52/d6b/dd9/d4d/d6a/d117/c138 0 2024-04-25T17:19:24.124 INFO:tasks.workunit.client.1.smithi069.stdout:1/737: dread d1/d4/de/f91 [0,4194304] 0 2024-04-25T17:19:24.125 INFO:tasks.workunit.client.0.smithi037.stdout:0/819: creat d9/df/d32/dd1/f10d x:0 0 0 2024-04-25T17:19:24.128 INFO:tasks.workunit.client.1.smithi069.stdout:6/737: unlink d2/d1e/d43/db6/de4/f69 0 2024-04-25T17:19:24.132 INFO:tasks.workunit.client.0.smithi037.stdout:4/974: symlink d7/d7e/d5b/dfe/d39/dba/d12c/l142 0 2024-04-25T17:19:24.133 INFO:tasks.workunit.client.1.smithi069.stdout:4/744: mknod db/d4b/d78/c105 0 2024-04-25T17:19:24.133 INFO:tasks.workunit.client.0.smithi037.stdout:8/720: link d5/db/d18/f86 d5/db/d18/dc8/fe9 0 2024-04-25T17:19:24.135 INFO:tasks.workunit.client.1.smithi069.stdout:9/724: symlink d2/da4/lfa 0 2024-04-25T17:19:24.136 INFO:tasks.workunit.client.0.smithi037.stdout:6/741: mkdir db/d26/d2e/d3e/d25/d10b 0 2024-04-25T17:19:24.138 INFO:tasks.workunit.client.0.smithi037.stdout:3/657: fsync d8/d31/f47 0 2024-04-25T17:19:24.140 INFO:tasks.workunit.client.1.smithi069.stdout:2/727: fsync d0/d56/d5f/d62/d7d/d31/f48 0 2024-04-25T17:19:24.140 INFO:tasks.workunit.client.1.smithi069.stdout:2/728: chown d0 0 1 2024-04-25T17:19:24.141 INFO:tasks.workunit.client.1.smithi069.stdout:2/729: chown d0/d1/d5b/d33/c5a 1776751031 1 2024-04-25T17:19:24.148 INFO:tasks.workunit.client.1.smithi069.stdout:3/806: write d8/d16/d1a/d2c/d49/dbc/fe0 [707328,109964] 0 2024-04-25T17:19:24.153 INFO:tasks.workunit.client.1.smithi069.stdout:6/738: mkdir d2/d51/d89/dfd 0 2024-04-25T17:19:24.154 INFO:tasks.workunit.client.1.smithi069.stdout:6/739: read d2/fe [1917841,70267] 0 2024-04-25T17:19:24.155 INFO:tasks.workunit.client.0.smithi037.stdout:4/975: creat d7/d7e/d5b/dfe/d39/d7a/de8/f143 x:0 0 0 2024-04-25T17:19:24.160 INFO:tasks.workunit.client.0.smithi037.stdout:0/820: write d9/df/d32/f47 [198777,43219] 0 2024-04-25T17:19:24.161 INFO:tasks.workunit.client.1.smithi069.stdout:6/740: dwrite d2/d1e/d3f/d86/fb2 [0,4194304] 0 2024-04-25T17:19:24.161 INFO:tasks.workunit.client.1.smithi069.stdout:8/771: dwrite d37/d47/d78/db3/fc9 [0,4194304] 0 2024-04-25T17:19:24.162 INFO:tasks.workunit.client.0.smithi037.stdout:7/668: write d5/d15/d17/d1b/da2/daf/f60 [1826822,45898] 0 2024-04-25T17:19:24.163 INFO:tasks.workunit.client.0.smithi037.stdout:5/808: dwrite d7/d18/f22 [4194304,4194304] 0 2024-04-25T17:19:24.167 INFO:tasks.workunit.client.0.smithi037.stdout:1/907: mkdir dc/d18/d64/d139 0 2024-04-25T17:19:24.174 INFO:tasks.workunit.client.1.smithi069.stdout:0/662: link d0/d38/f7a d0/da/db/d2a/fe3 0 2024-04-25T17:19:24.174 INFO:tasks.workunit.client.0.smithi037.stdout:2/863: creat d0/d15/f10d x:0 0 0 2024-04-25T17:19:24.176 INFO:tasks.workunit.client.0.smithi037.stdout:2/864: write d0/d15/f32 [1588305,89644] 0 2024-04-25T17:19:24.177 INFO:tasks.workunit.client.0.smithi037.stdout:2/865: dread - d0/d23/dac/d4b/ded/df4/ffa zero size 2024-04-25T17:19:24.179 INFO:tasks.workunit.client.1.smithi069.stdout:5/786: getdents d13/d17/d19/d8a 0 2024-04-25T17:19:24.180 INFO:tasks.workunit.client.0.smithi037.stdout:6/742: creat db/d1d/d20/dcf/dfa/d65/d8b/de0/f10c x:0 0 0 2024-04-25T17:19:24.181 INFO:tasks.workunit.client.0.smithi037.stdout:6/743: chown db/d26/d2e/d3e/f2c 37440 1 2024-04-25T17:19:24.183 INFO:tasks.workunit.client.1.smithi069.stdout:6/741: mknod d2/d51/d85/cfe 0 2024-04-25T17:19:24.185 INFO:tasks.workunit.client.1.smithi069.stdout:8/772: creat d37/d47/d54/d6e/d98/f108 x:0 0 0 2024-04-25T17:19:24.186 INFO:tasks.workunit.client.1.smithi069.stdout:8/773: write d37/d66/d6b/daf/feb [591378,114360] 0 2024-04-25T17:19:24.187 INFO:tasks.workunit.client.1.smithi069.stdout:2/730: rename d0/d26/d10/c46 to d0/d56/d5f/d62/d7d/d72/daf/dc2/d8b/ce9 0 2024-04-25T17:19:24.187 INFO:tasks.workunit.client.1.smithi069.stdout:2/731: chown d0/d1/d5b/f6e 533788401 1 2024-04-25T17:19:24.188 INFO:tasks.workunit.client.1.smithi069.stdout:7/746: sync 2024-04-25T17:19:24.188 INFO:tasks.workunit.client.1.smithi069.stdout:2/732: chown d0/d26/d10/d43 2476 1 2024-04-25T17:19:24.189 INFO:tasks.workunit.client.1.smithi069.stdout:7/747: chown d4/d3e/d94/da1/dc7/f92 0 1 2024-04-25T17:19:24.189 INFO:tasks.workunit.client.1.smithi069.stdout:2/733: write d0/d56/d5f/f71 [3877546,71889] 0 2024-04-25T17:19:24.192 INFO:tasks.workunit.client.1.smithi069.stdout:0/663: mkdir d0/d17/d83/dcf/de4 0 2024-04-25T17:19:24.192 INFO:tasks.workunit.client.0.smithi037.stdout:5/809: dwrite d7/fb [0,4194304] 0 2024-04-25T17:19:24.193 INFO:tasks.workunit.client.0.smithi037.stdout:1/908: mkdir dc/d18/d64/d133/d13a 0 2024-04-25T17:19:24.196 INFO:tasks.workunit.client.1.smithi069.stdout:4/745: link db/d15/d20/d35/d63/d75/l7b db/d15/d42/d53/l106 0 2024-04-25T17:19:24.196 INFO:tasks.workunit.client.1.smithi069.stdout:4/746: stat db/d15/d20/cb6 0 2024-04-25T17:19:24.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.197+0000 7fe689a7a700 1 -- 172.21.15.37:0/142379098 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe68406e440 msgr2=0x7fe68406e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:19:24.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.197+0000 7fe689a7a700 1 --2- 172.21.15.37:0/142379098 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe68406e440 0x7fe68406e850 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe674004940 tx=0x7fe674009e30 comp rx=0 tx=0).stop 2024-04-25T17:19:24.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.197+0000 7fe689a7a700 1 -- 172.21.15.37:0/142379098 shutdown_connections 2024-04-25T17:19:24.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.197+0000 7fe689a7a700 1 --2- 172.21.15.37:0/142379098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe68406ed90 0x7fe684108f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:24.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.197+0000 7fe689a7a700 1 --2- 172.21.15.37:0/142379098 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe68406e440 0x7fe68406e850 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:24.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.197+0000 7fe689a7a700 1 -- 172.21.15.37:0/142379098 >> 172.21.15.37:0/142379098 conn(0x7fe684069dc0 msgr2=0x7fe68406c1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:19:24.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.197+0000 7fe689a7a700 1 -- 172.21.15.37:0/142379098 shutdown_connections 2024-04-25T17:19:24.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.197+0000 7fe689a7a700 1 -- 172.21.15.37:0/142379098 wait complete. 2024-04-25T17:19:24.200 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.198+0000 7fe689a7a700 1 Processor -- start 2024-04-25T17:19:24.200 INFO:tasks.workunit.client.0.smithi037.stdout:2/866: dread d0/d23/dac/fd4 [0,4194304] 0 2024-04-25T17:19:24.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.198+0000 7fe689a7a700 1 -- start start 2024-04-25T17:19:24.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.199+0000 7fe689a7a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe68406e440 0x7fe68411c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:19:24.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.199+0000 7fe689a7a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe68406ed90 0x7fe68411cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:19:24.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.199+0000 7fe689a7a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe68411d1d0 con 0x7fe68406e440 2024-04-25T17:19:24.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.199+0000 7fe689a7a700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe68411d340 con 0x7fe68406ed90 2024-04-25T17:19:24.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.199+0000 7fe6837fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe68406e440 0x7fe68411c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:19:24.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.199+0000 7fe6837fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe68406e440 0x7fe68411c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49560/0 (socket says 172.21.15.37:49560) 2024-04-25T17:19:24.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.199+0000 7fe6837fe700 1 -- 172.21.15.37:0/1946628797 learned_addr learned my addr 172.21.15.37:0/1946628797 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:19:24.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.200+0000 7fe682ffd700 1 --2- 172.21.15.37:0/1946628797 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe68406ed90 0x7fe68411cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:19:24.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.200+0000 7fe6837fe700 1 -- 172.21.15.37:0/1946628797 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe68406ed90 msgr2=0x7fe68411cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:19:24.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.200+0000 7fe6837fe700 1 --2- 172.21.15.37:0/1946628797 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe68406ed90 0x7fe68411cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:24.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.200+0000 7fe6837fe700 1 -- 172.21.15.37:0/1946628797 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe674005040 con 0x7fe68406e440 2024-04-25T17:19:24.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.200+0000 7fe6837fe700 1 --2- 172.21.15.37:0/1946628797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe68406e440 0x7fe68411c690 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe67400b0d0 tx=0x7fe674009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:19:24.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.200+0000 7fe67bfff700 1 -- 172.21.15.37:0/1946628797 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe67400e070 con 0x7fe68406e440 2024-04-25T17:19:24.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.200+0000 7fe67bfff700 1 -- 172.21.15.37:0/1946628797 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe67400b410 con 0x7fe68406e440 2024-04-25T17:19:24.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.200+0000 7fe689a7a700 1 -- 172.21.15.37:0/1946628797 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe684121d40 con 0x7fe68406e440 2024-04-25T17:19:24.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.200+0000 7fe689a7a700 1 -- 172.21.15.37:0/1946628797 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6841222a0 con 0x7fe68406e440 2024-04-25T17:19:24.204 INFO:tasks.workunit.client.1.smithi069.stdout:5/787: unlink d13/d17/d19/d1c/da4/da9/fb9 0 2024-04-25T17:19:24.204 INFO:tasks.workunit.client.1.smithi069.stdout:5/788: write d13/d17/d29/ff4 [275970,56925] 0 2024-04-25T17:19:24.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.201+0000 7fe67bfff700 1 -- 172.21.15.37:0/1946628797 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe674012600 con 0x7fe68406e440 2024-04-25T17:19:24.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.202+0000 7fe689a7a700 1 -- 172.21.15.37:0/1946628797 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6640052e0 con 0x7fe68406e440 2024-04-25T17:19:24.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.203+0000 7fe67bfff700 1 -- 172.21.15.37:0/1946628797 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) v1 ==== 92608+0+0 (secure 0 0 0) 0x7fe674013af0 con 0x7fe68406e440 2024-04-25T17:19:24.204 INFO:tasks.workunit.client.1.smithi069.stdout:1/738: dwrite d1/f79 [8388608,4194304] 0 2024-04-25T17:19:24.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.203+0000 7fe67bfff700 1 --2- 172.21.15.37:0/1946628797 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7fe67006fd10 0x7fe6700721c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:19:24.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.203+0000 7fe67bfff700 1 -- 172.21.15.37:0/1946628797 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fe674090460 con 0x7fe68406e440 2024-04-25T17:19:24.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.204+0000 7fe682ffd700 1 --2- 172.21.15.37:0/1946628797 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7fe67006fd10 0x7fe6700721c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:19:24.206 INFO:tasks.workunit.client.0.smithi037.stdout:6/744: chown db/d26/d2e/l3f 4 1 2024-04-25T17:19:24.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.205+0000 7fe682ffd700 1 --2- 172.21.15.37:0/1946628797 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7fe67006fd10 0x7fe6700721c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe66c004600 tx=0x7fe66c00b040 comp rx=0 tx=0).ready entity=mgr.24417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:19:24.207 INFO:tasks.workunit.client.1.smithi069.stdout:8/774: unlink d37/d47/d48/l9c 0 2024-04-25T17:19:24.210 INFO:tasks.workunit.client.0.smithi037.stdout:0/821: rename d9/df/d32/d39/d68/da7/db4 to d9/df/d32/dd1/d7a/daf/db1/d10e 0 2024-04-25T17:19:24.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.211+0000 7fe67bfff700 1 -- 172.21.15.37:0/1946628797 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7fe6740597b0 con 0x7fe68406e440 2024-04-25T17:19:24.213 INFO:tasks.workunit.client.1.smithi069.stdout:0/664: dread d0/da/d54/fcc [0,4194304] 0 2024-04-25T17:19:24.213 INFO:tasks.workunit.client.0.smithi037.stdout:7/669: mkdir d5/d15/d17/d25/d2b/de5 0 2024-04-25T17:19:24.222 INFO:tasks.workunit.client.1.smithi069.stdout:9/725: sync 2024-04-25T17:19:24.222 INFO:tasks.workunit.client.1.smithi069.stdout:4/747: readlink db/d15/d20/d35/d63/d70/d8a/lf1 0 2024-04-25T17:19:24.223 INFO:tasks.workunit.client.1.smithi069.stdout:3/807: dwrite d8/d16/d1a/d2c/f4e [0,4194304] 0 2024-04-25T17:19:24.223 INFO:tasks.workunit.client.1.smithi069.stdout:9/726: readlink d2/l9 0 2024-04-25T17:19:24.226 INFO:tasks.workunit.client.0.smithi037.stdout:3/658: dwrite d8/d31/d32/d3e/f42 [0,4194304] 0 2024-04-25T17:19:24.228 INFO:tasks.workunit.client.0.smithi037.stdout:3/659: chown d8/d23/d38/d66/laf 1 1 2024-04-25T17:19:24.229 INFO:tasks.workunit.client.0.smithi037.stdout:1/909: fsync dc/d52/d6b/dd9/d22/d36/f40 0 2024-04-25T17:19:24.242 INFO:tasks.workunit.client.1.smithi069.stdout:8/775: rename c7 to d37/d47/d54/c109 0 2024-04-25T17:19:24.244 INFO:tasks.workunit.client.0.smithi037.stdout:5/810: write d7/d12/d6f/d68/fb6 [1834939,97831] 0 2024-04-25T17:19:24.247 INFO:tasks.workunit.client.0.smithi037.stdout:0/822: rename d9/fc5 to d9/df/d32/d56/d106/f10f 0 2024-04-25T17:19:24.249 INFO:tasks.workunit.client.0.smithi037.stdout:0/823: stat d9/df/d32/dd1/d7a/daf/fdf 0 2024-04-25T17:19:24.250 INFO:tasks.workunit.client.1.smithi069.stdout:2/734: link d0/f7 d0/d56/d5f/d62/d7d/d72/daf/fea 0 2024-04-25T17:19:24.252 INFO:tasks.workunit.client.0.smithi037.stdout:7/670: read d5/d15/d17/d1b/da2/fdd [23064,16670] 0 2024-04-25T17:19:24.255 INFO:tasks.workunit.client.0.smithi037.stdout:4/976: getdents d7/d7e/d1e 0 2024-04-25T17:19:24.256 INFO:tasks.workunit.client.1.smithi069.stdout:3/808: rename d8/d71/f86 to d8/d71/f110 0 2024-04-25T17:19:24.257 INFO:tasks.workunit.client.0.smithi037.stdout:4/977: stat d7/d7e/d5b/dfe/d39/fb8 0 2024-04-25T17:19:24.259 INFO:tasks.workunit.client.1.smithi069.stdout:9/727: mknod d2/da/dd/de/d64/dd2/cfb 0 2024-04-25T17:19:24.261 INFO:tasks.workunit.client.1.smithi069.stdout:3/809: dwrite d8/d16/d1a/d2c/d6c/d9c/fc7 [0,4194304] 0 2024-04-25T17:19:24.261 INFO:tasks.workunit.client.1.smithi069.stdout:3/810: chown f4 3767626 1 2024-04-25T17:19:24.263 INFO:tasks.workunit.client.0.smithi037.stdout:2/867: dread d0/fa2 [0,4194304] 0 2024-04-25T17:19:24.263 INFO:tasks.workunit.client.0.smithi037.stdout:3/660: dread d8/d23/f62 [0,4194304] 0 2024-04-25T17:19:24.264 INFO:tasks.workunit.client.1.smithi069.stdout:6/742: creat d2/d9c/fff x:0 0 0 2024-04-25T17:19:24.265 INFO:tasks.workunit.client.0.smithi037.stdout:2/868: chown d0/d16/d20/d59/c93 19 1 2024-04-25T17:19:24.268 INFO:tasks.workunit.client.1.smithi069.stdout:1/739: mkdir d1/de4 0 2024-04-25T17:19:24.272 INFO:tasks.workunit.client.1.smithi069.stdout:3/811: dread d8/d16/d1a/d2c/d49/dbc/fe0 [0,4194304] 0 2024-04-25T17:19:24.274 INFO:tasks.workunit.client.1.smithi069.stdout:5/789: link d13/d17/d19/d1c/d79/fe6 d13/d17/d19/d1c/da4/da9/f110 0 2024-04-25T17:19:24.274 INFO:tasks.workunit.client.0.smithi037.stdout:0/824: dread d9/d71/f8e [0,4194304] 0 2024-04-25T17:19:24.274 INFO:tasks.workunit.client.1.smithi069.stdout:1/740: dwrite d1/d4/d6/d4f/d9b/fc9 [0,4194304] 0 2024-04-25T17:19:24.275 INFO:tasks.workunit.client.0.smithi037.stdout:8/721: link d5/db/d18/d3b/d50/d51/f57 d5/db/d18/d3b/d50/d51/fea 0 2024-04-25T17:19:24.277 INFO:tasks.workunit.client.0.smithi037.stdout:0/825: readlink d9/df/d32/d35/l102 0 2024-04-25T17:19:24.277 INFO:tasks.workunit.client.0.smithi037.stdout:2/869: dwrite d0/d15/d2a/d5a/d75/ffd [0,4194304] 0 2024-04-25T17:19:24.281 INFO:tasks.workunit.client.0.smithi037.stdout:6/745: mkdir db/d26/d2e/d3e/d25/d10d 0 2024-04-25T17:19:24.281 INFO:tasks.workunit.client.1.smithi069.stdout:7/748: creat d4/d3e/d94/da1/dc7/d14/d44/fff x:0 0 0 2024-04-25T17:19:24.282 INFO:tasks.workunit.client.0.smithi037.stdout:5/811: creat d7/d12/d6f/d94/ff7 x:0 0 0 2024-04-25T17:19:24.283 INFO:tasks.workunit.client.0.smithi037.stdout:6/746: write db/d53/fe1 [722111,27976] 0 2024-04-25T17:19:24.290 INFO:tasks.workunit.client.0.smithi037.stdout:7/671: dread d5/d15/d17/d1b/da2/daf/f8b [0,4194304] 0 2024-04-25T17:19:24.294 INFO:tasks.workunit.client.0.smithi037.stdout:3/661: mkdir d8/db4/dca 0 2024-04-25T17:19:24.294 INFO:tasks.workunit.client.0.smithi037.stdout:5/812: dwrite d7/d12/d6f/d68/f76 [0,4194304] 0 2024-04-25T17:19:24.294 INFO:tasks.workunit.client.0.smithi037.stdout:6/747: fsync db/d1d/d20/dcf/dfa/d65/d8b/de0/f10c 0 2024-04-25T17:19:24.300 INFO:tasks.workunit.client.1.smithi069.stdout:5/790: symlink d13/d17/da5/l111 0 2024-04-25T17:19:24.303 INFO:tasks.workunit.client.0.smithi037.stdout:8/722: creat d5/db/d23/d42/feb x:0 0 0 2024-04-25T17:19:24.304 INFO:tasks.workunit.client.0.smithi037.stdout:2/870: mknod d0/d23/d7d/c10e 0 2024-04-25T17:19:24.306 INFO:tasks.workunit.client.0.smithi037.stdout:0/826: creat d9/df/d32/d56/d106/f110 x:0 0 0 2024-04-25T17:19:24.309 INFO:tasks.workunit.client.1.smithi069.stdout:4/748: creat db/d4b/d78/dc4/f107 x:0 0 0 2024-04-25T17:19:24.310 INFO:tasks.workunit.client.1.smithi069.stdout:4/749: stat db/d15/d20/d35/d63/d43/d48/d49/d72 0 2024-04-25T17:19:24.313 INFO:tasks.workunit.client.1.smithi069.stdout:8/776: write d37/f7c [683085,69323] 0 2024-04-25T17:19:24.317 INFO:tasks.workunit.client.1.smithi069.stdout:0/665: truncate d0/f2f 3235292 0 2024-04-25T17:19:24.317 INFO:tasks.workunit.client.0.smithi037.stdout:5/813: rmdir d7/d18/d62/dd8/dc6 39 2024-04-25T17:19:24.318 INFO:tasks.workunit.client.1.smithi069.stdout:1/741: mknod d1/ce5 0 2024-04-25T17:19:24.319 INFO:tasks.workunit.client.1.smithi069.stdout:1/742: write d1/d4/de/d44/f69 [535167,68270] 0 2024-04-25T17:19:24.320 INFO:tasks.workunit.client.1.smithi069.stdout:1/743: dread - d1/d4/d6/d9e/da6/fe2 zero size 2024-04-25T17:19:24.321 INFO:tasks.workunit.client.1.smithi069.stdout:5/791: creat d13/d17/da5/f112 x:0 0 0 2024-04-25T17:19:24.322 INFO:tasks.workunit.client.1.smithi069.stdout:6/743: write d2/d1e/d43/d7d/f9f [826979,4694] 0 2024-04-25T17:19:24.323 INFO:tasks.workunit.client.0.smithi037.stdout:7/672: dread d5/d15/d17/d1b/da2/d76/f8a [0,4194304] 0 2024-04-25T17:19:24.323 INFO:tasks.workunit.client.1.smithi069.stdout:6/744: write d2/d1e/d43/d7d/f9f [2643386,129089] 0 2024-04-25T17:19:24.324 INFO:tasks.workunit.client.0.smithi037.stdout:3/662: rename d8/d57/f5e to d8/d23/dc0/fcb 0 2024-04-25T17:19:24.326 INFO:tasks.workunit.client.1.smithi069.stdout:7/749: mknod d4/d3e/d94/da1/dc7/d14/c100 0 2024-04-25T17:19:24.327 INFO:tasks.workunit.client.1.smithi069.stdout:7/750: write d4/d3e/d94/da1/dc7/d14/d44/d7c/d9f/fe9 [636947,74100] 0 2024-04-25T17:19:24.328 INFO:tasks.workunit.client.0.smithi037.stdout:6/748: fsync db/d1d/d20/dcf/dfa/d65/d68/d87/fc3 0 2024-04-25T17:19:24.332 INFO:tasks.workunit.client.0.smithi037.stdout:3/663: dwrite d8/d57/fc6 [0,4194304] 0 2024-04-25T17:19:24.334 INFO:tasks.workunit.client.1.smithi069.stdout:9/728: rename d2/da/d5f/f6d to d2/da/dd/d1e/d2e/d68/dba/ffc 0 2024-04-25T17:19:24.335 INFO:tasks.workunit.client.1.smithi069.stdout:9/729: stat d2/da/d5f/d76/l8d 0 2024-04-25T17:19:24.336 INFO:tasks.workunit.client.1.smithi069.stdout:2/735: dwrite d0/d1/f4f [0,4194304] 0 2024-04-25T17:19:24.337 INFO:tasks.workunit.client.0.smithi037.stdout:0/827: fdatasync d9/df/dbd/dc1/fde 0 2024-04-25T17:19:24.339 INFO:tasks.workunit.client.0.smithi037.stdout:0/828: read d9/df/d32/f4b [630956,39968] 0 2024-04-25T17:19:24.339 INFO:tasks.workunit.client.0.smithi037.stdout:4/978: link d7/d7e/d5b/dfe/d39/dba/d12c/l13f d7/d7e/d5b/dfe/d39/de6/l144 0 2024-04-25T17:19:24.341 INFO:tasks.workunit.client.1.smithi069.stdout:7/751: dread d4/d18/d36/fc2 [4194304,4194304] 0 2024-04-25T17:19:24.341 INFO:tasks.workunit.client.0.smithi037.stdout:5/814: truncate d7/d43/f9b 127831 0 2024-04-25T17:19:24.344 INFO:tasks.workunit.client.1.smithi069.stdout:1/744: symlink d1/d4/d6/d9e/da6/d7c/d4d/le6 0 2024-04-25T17:19:24.348 INFO:tasks.workunit.client.0.smithi037.stdout:7/673: truncate d5/f96 158530 0 2024-04-25T17:19:24.349 INFO:tasks.workunit.client.1.smithi069.stdout:6/745: mkdir d2/d1e/d3f/d56/d7e/d100 0 2024-04-25T17:19:24.349 INFO:tasks.workunit.client.0.smithi037.stdout:5/815: dwrite d7/f75 [0,4194304] 0 2024-04-25T17:19:24.349 INFO:tasks.workunit.client.0.smithi037.stdout:7/674: stat d5/d15/d17/f65 0 2024-04-25T17:19:24.350 INFO:tasks.workunit.client.0.smithi037.stdout:5/816: chown d7/d18/d7c/ff4 21574 1 2024-04-25T17:19:24.350 INFO:tasks.workunit.client.0.smithi037.stdout:7/675: chown d5/d15/d17/d25/f4d 996 1 2024-04-25T17:19:24.353 INFO:tasks.workunit.client.0.smithi037.stdout:2/871: rename d0/d23/d7d/d56 to d0/d16/d20/db9/d10f 0 2024-04-25T17:19:24.354 INFO:tasks.workunit.client.1.smithi069.stdout:4/750: creat db/d15/d20/d35/d63/d70/d8a/d96/dbf/d103/f108 x:0 0 0 2024-04-25T17:19:24.359 INFO:tasks.workunit.client.0.smithi037.stdout:1/910: getdents dc/d52/d6b/dd9/d22/d36/d74 0 2024-04-25T17:19:24.362 INFO:tasks.workunit.client.1.smithi069.stdout:3/812: rename d8/d16/d1a/d2c/d49/d87/d8a/d8e/d95/d10a to d8/d16/d1a/d99/d111 0 2024-04-25T17:19:24.364 INFO:tasks.workunit.client.1.smithi069.stdout:9/730: creat d2/da4/dcf/ffd x:0 0 0 2024-04-25T17:19:24.367 INFO:tasks.workunit.client.0.smithi037.stdout:8/723: mknod d5/db/d18/d3b/d50/d51/cec 0 2024-04-25T17:19:24.367 INFO:tasks.workunit.client.1.smithi069.stdout:8/777: write d37/f57 [4190995,96683] 0 2024-04-25T17:19:24.368 INFO:tasks.workunit.client.1.smithi069.stdout:0/666: write d0/da/db/d7e/fce [5308728,105972] 0 2024-04-25T17:19:24.373 INFO:tasks.workunit.client.1.smithi069.stdout:6/746: chown d2/d9c/d48/ff7 66554657 1 2024-04-25T17:19:24.374 INFO:tasks.workunit.client.0.smithi037.stdout:0/829: write d9/df/d32/d39/dd3/fe6 [536152,15101] 0 2024-04-25T17:19:24.375 INFO:tasks.workunit.client.1.smithi069.stdout:4/751: rmdir db/d15/d20/d35/d63/d43/d48/d49 39 2024-04-25T17:19:24.376 INFO:tasks.workunit.client.1.smithi069.stdout:5/792: dwrite d13/d17/d19/d20/d2d/f46 [0,4194304] 0 2024-04-25T17:19:24.376 INFO:tasks.workunit.client.0.smithi037.stdout:0/830: truncate d9/df/d32/dd1/d7a/daf/f101 596897 0 2024-04-25T17:19:24.377 INFO:tasks.workunit.client.0.smithi037.stdout:4/979: unlink d7/d7e/d4e/da5/fab 0 2024-04-25T17:19:24.381 INFO:tasks.workunit.client.1.smithi069.stdout:6/747: dwrite d2/d1e/d43/d7d/f9f [0,4194304] 0 2024-04-25T17:19:24.383 INFO:tasks.workunit.client.1.smithi069.stdout:6/748: dread - d2/d1e/d43/dca/fed zero size 2024-04-25T17:19:24.383 INFO:tasks.workunit.client.1.smithi069.stdout:4/752: dwrite db/d15/d20/d35/f66 [0,4194304] 0 2024-04-25T17:19:24.383 INFO:tasks.workunit.client.1.smithi069.stdout:2/736: rename d0/d26/d10/le2 to d0/d56/d5f/d62/d7d/d72/daf/dc2/ddd/leb 0 2024-04-25T17:19:24.384 INFO:tasks.workunit.client.0.smithi037.stdout:5/817: unlink d7/d12/d6f/d94/ff7 0 2024-04-25T17:19:24.385 INFO:tasks.workunit.client.0.smithi037.stdout:5/818: chown d7/d63/f8d 2745592 1 2024-04-25T17:19:24.386 INFO:tasks.workunit.client.1.smithi069.stdout:3/813: truncate d8/d16/d1a/d2c/d49/d87/d8a/d8e/fb1 811900 0 2024-04-25T17:19:24.396 INFO:tasks.workunit.client.0.smithi037.stdout:2/872: rename d0/d16/d20/c22 to d0/d23/dac/d4b/c110 0 2024-04-25T17:19:24.398 INFO:tasks.workunit.client.0.smithi037.stdout:1/911: readlink dc/d52/d6b/dd9/d22/lcf 0 2024-04-25T17:19:24.400 INFO:tasks.workunit.client.1.smithi069.stdout:0/667: symlink d0/da/d59/le5 0 2024-04-25T17:19:24.400 INFO:tasks.workunit.client.0.smithi037.stdout:6/749: mkdir db/d26/d2e/d3e/d25/d10b/d10e 0 2024-04-25T17:19:24.402 INFO:tasks.workunit.client.1.smithi069.stdout:1/745: symlink d1/d4/d6/d81/le7 0 2024-04-25T17:19:24.403 INFO:tasks.workunit.client.1.smithi069.stdout:1/746: readlink d1/d43/d1b/d32/d4a/d4b/l9c 0 2024-04-25T17:19:24.403 INFO:tasks.workunit.client.0.smithi037.stdout:3/664: link d8/f2c d8/d23/dbb/d63/d86/d88/fcc 0 2024-04-25T17:19:24.413 INFO:tasks.workunit.client.0.smithi037.stdout:7/676: dwrite d5/d15/d17/d25/d2b/f52 [0,4194304] 0 2024-04-25T17:19:24.416 INFO:tasks.workunit.client.0.smithi037.stdout:0/831: creat d9/d14/dff/f111 x:0 0 0 2024-04-25T17:19:24.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:24 smithi069 ceph-mon[34527]: Upgrade: Updating mgr.smithi037.txrgxl 2024-04-25T17:19:24.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:24 smithi069 ceph-mon[34527]: Deploying daemon mgr.smithi037.txrgxl on smithi037 2024-04-25T17:19:24.420 INFO:tasks.workunit.client.1.smithi069.stdout:2/737: fdatasync d0/d56/d5f/d62/d7d/d31/f48 0 2024-04-25T17:19:24.421 INFO:tasks.workunit.client.1.smithi069.stdout:2/738: chown d0/d56/d94/f96 9970937 1 2024-04-25T17:19:24.422 INFO:tasks.workunit.client.1.smithi069.stdout:5/793: dread fa [0,4194304] 0 2024-04-25T17:19:24.422 INFO:tasks.workunit.client.1.smithi069.stdout:9/731: getdents d2/da/dd/de/d74/dbc/df8 0 2024-04-25T17:19:24.423 INFO:tasks.workunit.client.1.smithi069.stdout:2/739: write d0/d56/d5f/f89 [896252,105784] 0 2024-04-25T17:19:24.425 INFO:tasks.workunit.client.1.smithi069.stdout:9/732: write d2/da4/dcf/f55 [3441283,13739] 0 2024-04-25T17:19:24.428 INFO:tasks.workunit.client.0.smithi037.stdout:4/980: rename d7/d7e to d7/d67/d118/d145 0 2024-04-25T17:19:24.428 INFO:tasks.workunit.client.1.smithi069.stdout:3/814: dwrite d8/d16/d1a/d2c/d49/f109 [0,4194304] 0 2024-04-25T17:19:24.430 INFO:tasks.workunit.client.1.smithi069.stdout:8/778: mkdir d37/d66/d10a 0 2024-04-25T17:19:24.431 INFO:tasks.workunit.client.0.smithi037.stdout:2/873: chown d0/d16/d68/c9a 12 1 2024-04-25T17:19:24.432 INFO:tasks.workunit.client.1.smithi069.stdout:7/752: sync 2024-04-25T17:19:24.434 INFO:tasks.workunit.client.1.smithi069.stdout:6/749: dwrite d2/d7/f12 [0,4194304] 0 2024-04-25T17:19:24.436 INFO:tasks.workunit.client.1.smithi069.stdout:6/750: fsync d2/d1e/d43/dca/dce/fd9 0 2024-04-25T17:19:24.441 INFO:tasks.workunit.client.0.smithi037.stdout:7/677: fsync d5/d15/d17/d1b/da2/d76/f8a 0 2024-04-25T17:19:24.441 INFO:tasks.workunit.client.0.smithi037.stdout:0/832: rename d9/df/f84 to d9/df/d32/d39/d68/da7/f112 0 2024-04-25T17:19:24.443 INFO:tasks.workunit.client.0.smithi037.stdout:1/912: mknod dc/d18/d64/d133/d13a/c13b 0 2024-04-25T17:19:24.444 INFO:tasks.workunit.client.0.smithi037.stdout:0/833: read d9/df/d32/ff9 [82978,113136] 0 2024-04-25T17:19:24.445 INFO:tasks.workunit.client.1.smithi069.stdout:0/668: dread d0/f1 [0,4194304] 0 2024-04-25T17:19:24.446 INFO:tasks.workunit.client.0.smithi037.stdout:2/874: creat d0/d16/d20/d59/d6a/da5/dbd/f111 x:0 0 0 2024-04-25T17:19:24.451 INFO:tasks.workunit.client.0.smithi037.stdout:3/665: truncate d8/d23/dbb/d63/d86/d88/fcc 2863390 0 2024-04-25T17:19:24.453 INFO:tasks.workunit.client.0.smithi037.stdout:3/666: read - d8/d23/dbb/d63/d86/fb0 zero size 2024-04-25T17:19:24.454 INFO:tasks.workunit.client.1.smithi069.stdout:9/733: creat d2/da/dd/de/d64/dd2/ffe x:0 0 0 2024-04-25T17:19:24.455 INFO:tasks.workunit.client.0.smithi037.stdout:7/678: symlink d5/d15/d17/d1b/da2/daf/dc8/le6 0 2024-04-25T17:19:24.455 INFO:tasks.workunit.client.0.smithi037.stdout:7/679: chown d5/d15/d17/d1b/fcd 232630 1 2024-04-25T17:19:24.457 INFO:tasks.workunit.client.1.smithi069.stdout:8/779: symlink d37/d47/d78/db3/l10b 0 2024-04-25T17:19:24.458 INFO:tasks.workunit.client.0.smithi037.stdout:5/819: rename d7/d12/d6f/de9 to d7/d25/d4f/da7/df8 0 2024-04-25T17:19:24.460 INFO:tasks.workunit.client.1.smithi069.stdout:9/734: dread d2/da/dd/d1e/d2e/d68/d8f/fad [0,4194304] 0 2024-04-25T17:19:24.461 INFO:tasks.workunit.client.1.smithi069.stdout:7/753: read - d4/d3e/d94/da1/dc7/d14/d5a/d5e/f95 zero size 2024-04-25T17:19:24.462 INFO:tasks.workunit.client.1.smithi069.stdout:7/754: chown d4/d3e/d94/da1/dc7/d14/d44/da8/ccd 113706002 1 2024-04-25T17:19:24.466 INFO:tasks.workunit.client.0.smithi037.stdout:6/750: dwrite db/d26/d2e/f42 [0,4194304] 0 2024-04-25T17:19:24.477 INFO:tasks.workunit.client.0.smithi037.stdout:5/820: truncate d7/d12/d6f/fb8 463927 0 2024-04-25T17:19:24.479 INFO:tasks.workunit.client.1.smithi069.stdout:0/669: write d0/da/db/f64 [2543804,17835] 0 2024-04-25T17:19:24.480 INFO:tasks.workunit.client.0.smithi037.stdout:0/834: mknod d9/d14/d28/c113 0 2024-04-25T17:19:24.482 INFO:tasks.workunit.client.1.smithi069.stdout:1/747: rename d1/d4/d6/d9e/f8c to d1/d4/d6/d9e/da6/d7c/fe8 0 2024-04-25T17:19:24.483 INFO:tasks.workunit.client.0.smithi037.stdout:6/751: mknod db/d1d/d20/dcf/dfa/d65/d68/dae/c10f 0 2024-04-25T17:19:24.485 INFO:tasks.workunit.client.1.smithi069.stdout:9/735: dread d2/da/dd/de/f48 [0,4194304] 0 2024-04-25T17:19:24.488 INFO:tasks.workunit.client.0.smithi037.stdout:0/835: dwrite d9/d14/d28/d48/da9/ffe [0,4194304] 0 2024-04-25T17:19:24.489 INFO:tasks.workunit.client.1.smithi069.stdout:5/794: link d13/d17/d19/d1c/l10f d13/dff/d10d/l113 0 2024-04-25T17:19:24.496 INFO:tasks.workunit.client.1.smithi069.stdout:0/670: mkdir d0/da/d59/dab/de6 0 2024-04-25T17:19:24.496 INFO:tasks.workunit.client.0.smithi037.stdout:6/752: rmdir db/d26/d2e/d3e/d25/d10b 39 2024-04-25T17:19:24.497 INFO:tasks.workunit.client.0.smithi037.stdout:6/753: fdatasync db/d26/fe6 0 2024-04-25T17:19:24.498 INFO:tasks.workunit.client.0.smithi037.stdout:6/754: chown db/d26/fe6 307 1 2024-04-25T17:19:24.501 INFO:tasks.workunit.client.1.smithi069.stdout:1/748: rmdir d1 39 2024-04-25T17:19:24.506 INFO:tasks.workunit.client.0.smithi037.stdout:3/667: getdents d8/d23/dbb/d63 0 2024-04-25T17:19:24.507 INFO:tasks.workunit.client.1.smithi069.stdout:8/780: dread d37/d47/d78/f84 [0,4194304] 0 2024-04-25T17:19:24.507 INFO:tasks.workunit.client.0.smithi037.stdout:7/680: getdents d5/d15/d17/d25/d2b/dcb 0 2024-04-25T17:19:24.508 INFO:tasks.workunit.client.1.smithi069.stdout:4/753: link db/d15/d42/d53/l106 db/d15/d42/d64/l109 0 2024-04-25T17:19:24.512 INFO:tasks.workunit.client.1.smithi069.stdout:5/795: symlink d13/d17/d62/l114 0 2024-04-25T17:19:24.514 INFO:tasks.workunit.client.0.smithi037.stdout:5/821: rmdir d7/d43/d9f/df6 0 2024-04-25T17:19:24.514 INFO:tasks.workunit.client.0.smithi037.stdout:5/822: chown d7/d12/d6f/dbf 1834614 1 2024-04-25T17:19:24.514 INFO:tasks.workunit.client.1.smithi069.stdout:2/740: getdents d0/d56/d94 0 2024-04-25T17:19:24.514 INFO:tasks.workunit.client.1.smithi069.stdout:7/755: dwrite d4/d3e/d94/da1/dc7/d14/d15/f28 [0,4194304] 0 2024-04-25T17:19:24.515 INFO:tasks.workunit.client.0.smithi037.stdout:5/823: chown d7/d12/d5d/f61 149868 1 2024-04-25T17:19:24.515 INFO:tasks.workunit.client.1.smithi069.stdout:2/741: fsync d0/d56/d94/fb2 0 2024-04-25T17:19:24.520 INFO:tasks.workunit.client.0.smithi037.stdout:6/755: rename l2 to db/d26/d2e/d3e/d25/d10b/d10e/l110 0 2024-04-25T17:19:24.522 INFO:tasks.workunit.client.0.smithi037.stdout:6/756: write db/d26/d2e/d3e/f35 [1564099,32679] 0 2024-04-25T17:19:24.523 INFO:tasks.workunit.client.0.smithi037.stdout:5/824: readlink d7/d12/d6f/l85 0 2024-04-25T17:19:24.523 INFO:tasks.workunit.client.1.smithi069.stdout:0/671: dread d0/d38/d75/f7b [0,4194304] 0 2024-04-25T17:19:24.524 INFO:tasks.workunit.client.1.smithi069.stdout:0/672: dread - d0/da/db/d1d/d5f/fbd zero size 2024-04-25T17:19:24.525 INFO:tasks.workunit.client.0.smithi037.stdout:3/668: mkdir d8/d31/d8d/db7/dcd 0 2024-04-25T17:19:24.526 INFO:tasks.workunit.client.1.smithi069.stdout:6/751: getdents d2/d51/d85 0 2024-04-25T17:19:24.531 INFO:tasks.workunit.client.0.smithi037.stdout:0/836: getdents d9/df/d32/d56/d106 0 2024-04-25T17:19:24.532 INFO:tasks.workunit.client.1.smithi069.stdout:2/742: mknod d0/d56/d5f/d62/d7d/d31/cec 0 2024-04-25T17:19:24.536 INFO:tasks.workunit.client.1.smithi069.stdout:3/815: rename d8/d16/d31/cd5 to d8/c112 0 2024-04-25T17:19:24.537 INFO:tasks.workunit.client.1.smithi069.stdout:1/749: mkdir d1/d43/d1b/de9 0 2024-04-25T17:19:24.540 INFO:tasks.workunit.client.1.smithi069.stdout:9/736: creat d2/da/dd/de/fff x:0 0 0 2024-04-25T17:19:24.541 INFO:tasks.workunit.client.0.smithi037.stdout:3/669: symlink d8/d4c/lce 0 2024-04-25T17:19:24.541 INFO:tasks.workunit.client.1.smithi069.stdout:9/737: truncate d2/da/dd/de/db0/fce 521638 0 2024-04-25T17:19:24.543 INFO:tasks.workunit.client.0.smithi037.stdout:7/681: creat d5/d14/d31/fe7 x:0 0 0 2024-04-25T17:19:24.545 INFO:tasks.workunit.client.0.smithi037.stdout:0/837: chown d9/d14/f36 1621 1 2024-04-25T17:19:24.546 INFO:tasks.workunit.client.1.smithi069.stdout:6/752: symlink d2/d1e/d43/da6/l101 0 2024-04-25T17:19:24.547 INFO:tasks.workunit.client.0.smithi037.stdout:0/838: truncate d9/df/d32/d39/fcb 967712 0 2024-04-25T17:19:24.547 INFO:tasks.workunit.client.0.smithi037.stdout:0/839: chown d9/d14/d28/d48/d58/dc4 76 1 2024-04-25T17:19:24.547 INFO:tasks.workunit.client.0.smithi037.stdout:6/757: symlink db/d1d/d20/l111 0 2024-04-25T17:19:24.547 INFO:tasks.workunit.client.1.smithi069.stdout:6/753: write d2/d1e/d43/fc9 [2376233,5763] 0 2024-04-25T17:19:24.548 INFO:tasks.workunit.client.1.smithi069.stdout:6/754: chown d2/d1e/d3f/d86/ld7 0 1 2024-04-25T17:19:24.548 INFO:tasks.workunit.client.0.smithi037.stdout:0/840: chown d9/df/dbd/dc1/de2 0 1 2024-04-25T17:19:24.548 INFO:tasks.workunit.client.0.smithi037.stdout:0/841: stat d9/df/df7 0 2024-04-25T17:19:24.548 INFO:tasks.workunit.client.1.smithi069.stdout:6/755: chown d2/d51/d85/cfe 1313 1 2024-04-25T17:19:24.549 INFO:tasks.workunit.client.1.smithi069.stdout:7/756: mknod d4/c101 0 2024-04-25T17:19:24.550 INFO:tasks.workunit.client.0.smithi037.stdout:5/825: symlink d7/lf9 0 2024-04-25T17:19:24.552 INFO:tasks.workunit.client.0.smithi037.stdout:5/826: read d7/d12/f35 [4834809,84184] 0 2024-04-25T17:19:24.553 INFO:tasks.workunit.client.0.smithi037.stdout:3/670: rename d8/d31/d32/d87/lb6 to d8/d23/dbb/daa/lcf 0 2024-04-25T17:19:24.557 INFO:tasks.workunit.client.1.smithi069.stdout:3/816: creat d8/d16/d1a/d2c/d49/d59/dff/d107/f113 x:0 0 0 2024-04-25T17:19:24.558 INFO:tasks.workunit.client.0.smithi037.stdout:6/758: fdatasync db/d1d/d20/d2f/fb7 0 2024-04-25T17:19:24.562 INFO:tasks.workunit.client.0.smithi037.stdout:0/842: creat d9/df/dbd/de9/f114 x:0 0 0 2024-04-25T17:19:24.564 INFO:tasks.workunit.client.1.smithi069.stdout:6/756: dread d2/d7/fc [0,4194304] 0 2024-04-25T17:19:24.564 INFO:tasks.workunit.client.1.smithi069.stdout:8/781: creat d37/d47/d54/d6e/f10c x:0 0 0 2024-04-25T17:19:24.565 INFO:tasks.workunit.client.0.smithi037.stdout:6/759: dwrite db/d1d/d20/d85/feb [0,4194304] 0 2024-04-25T17:19:24.566 INFO:tasks.workunit.client.1.smithi069.stdout:7/757: dread d4/d83/fc9 [0,4194304] 0 2024-04-25T17:19:24.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:24 smithi037 ceph-mon[26472]: Upgrade: Updating mgr.smithi037.txrgxl 2024-04-25T17:19:24.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:24 smithi037 ceph-mon[26472]: Deploying daemon mgr.smithi037.txrgxl on smithi037 2024-04-25T17:19:24.572 INFO:tasks.workunit.client.0.smithi037.stdout:5/827: creat d7/d63/ffa x:0 0 0 2024-04-25T17:19:24.573 INFO:tasks.workunit.client.1.smithi069.stdout:2/743: mknod d0/d26/d10/ced 0 2024-04-25T17:19:24.575 INFO:tasks.workunit.client.0.smithi037.stdout:3/671: rename d8/d57/la4 to d8/d23/dc0/ld0 0 2024-04-25T17:19:24.577 INFO:tasks.workunit.client.0.smithi037.stdout:7/682: write d5/f43 [2041516,84045] 0 2024-04-25T17:19:24.578 INFO:tasks.workunit.client.1.smithi069.stdout:3/817: fsync d8/d16/d1a/d2c/d6c/fd8 0 2024-04-25T17:19:24.587 INFO:tasks.workunit.client.1.smithi069.stdout:0/673: link d0/d38/d75/f7b d0/d17/fe7 0 2024-04-25T17:19:24.588 INFO:tasks.workunit.client.1.smithi069.stdout:2/744: mknod d0/d56/d5f/d62/d7d/d72/daf/dc2/d8b/cee 0 2024-04-25T17:19:24.589 INFO:tasks.workunit.client.0.smithi037.stdout:3/672: rmdir d8/d23/d38 39 2024-04-25T17:19:24.589 INFO:tasks.workunit.client.1.smithi069.stdout:2/745: chown d0/d26/d10 610 1 2024-04-25T17:19:24.589 INFO:tasks.workunit.client.1.smithi069.stdout:2/746: chown d0/d1/d5b/d33/lc7 435 1 2024-04-25T17:19:24.590 INFO:tasks.workunit.client.0.smithi037.stdout:7/683: rmdir d5/d14/dcf 39 2024-04-25T17:19:24.590 INFO:tasks.workunit.client.1.smithi069.stdout:4/754: rename db/d15/d42/d64/d7f/cad to db/d15/c10a 0 2024-04-25T17:19:24.593 INFO:tasks.workunit.client.1.smithi069.stdout:4/755: dread db/d15/d20/d35/f66 [0,4194304] 0 2024-04-25T17:19:24.594 INFO:tasks.workunit.client.1.smithi069.stdout:4/756: dread - db/d15/d20/d35/d63/d70/d8a/d96/dbf/fc8 zero size 2024-04-25T17:19:24.598 INFO:tasks.workunit.client.0.smithi037.stdout:7/684: creat d5/d15/d17/d9d/fe8 x:0 0 0 2024-04-25T17:19:24.603 INFO:tasks.workunit.client.0.smithi037.stdout:3/673: dread d8/d23/dbb/f43 [0,4194304] 0 2024-04-25T17:19:24.603 INFO:tasks.workunit.client.0.smithi037.stdout:6/760: rename db/d1d/d20/dcf/dfa/d65/d8b/de0 to db/d1d/d20/dcf/dfa/d112 0 2024-04-25T17:19:24.606 INFO:tasks.workunit.client.0.smithi037.stdout:6/761: write db/d1d/d20/dcf/dfa/d65/d68/dae/fe2 [617161,74614] 0 2024-04-25T17:19:24.607 INFO:tasks.workunit.client.0.smithi037.stdout:0/843: rmdir d9 39 2024-04-25T17:19:24.611 INFO:tasks.workunit.client.1.smithi069.stdout:2/747: unlink d0/d1/f20 0 2024-04-25T17:19:24.614 INFO:tasks.workunit.client.1.smithi069.stdout:5/796: rename d13/d17/d29/f43 to d13/d17/d19/d20/d2d/f115 0 2024-04-25T17:19:24.615 INFO:tasks.workunit.client.0.smithi037.stdout:3/674: symlink d8/d23/dbb/daa/ld1 0 2024-04-25T17:19:24.619 INFO:tasks.workunit.client.1.smithi069.stdout:4/757: mkdir db/d15/d20/d35/d63/d75/d10b 0 2024-04-25T17:19:24.622 INFO:tasks.workunit.client.1.smithi069.stdout:7/758: creat d4/d1a/f102 x:0 0 0 2024-04-25T17:19:24.622 INFO:tasks.workunit.client.1.smithi069.stdout:8/782: write d37/d66/d6b/fb4 [831768,21976] 0 2024-04-25T17:19:24.623 INFO:tasks.workunit.client.1.smithi069.stdout:1/750: dwrite d1/df/d17/f2f [0,4194304] 0 2024-04-25T17:19:24.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.623+0000 7fe689a7a700 1 -- 172.21.15.37:0/1946628797 --> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe664000bf0 con 0x7fe67006fd10 2024-04-25T17:19:24.625 INFO:tasks.workunit.client.1.smithi069.stdout:2/748: mknod d0/d26/d36/dc5/cef 0 2024-04-25T17:19:24.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.626+0000 7fe67bfff700 1 -- 172.21.15.37:0/1946628797 <== mgr.24417 v2:172.21.15.69:6828/2602478 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7fe664000bf0 con 0x7fe67006fd10 2024-04-25T17:19:24.627 INFO:tasks.workunit.client.1.smithi069.stdout:9/738: rename d2/f2c to d2/da/d5f/dd3/f100 0 2024-04-25T17:19:24.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.630+0000 7fe689a7a700 1 -- 172.21.15.37:0/1946628797 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7fe67006fd10 msgr2=0x7fe6700721c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:19:24.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.630+0000 7fe689a7a700 1 --2- 172.21.15.37:0/1946628797 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7fe67006fd10 0x7fe6700721c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe66c004600 tx=0x7fe66c00b040 comp rx=0 tx=0).stop 2024-04-25T17:19:24.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.630+0000 7fe689a7a700 1 -- 172.21.15.37:0/1946628797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe68406e440 msgr2=0x7fe68411c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:19:24.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.630+0000 7fe689a7a700 1 --2- 172.21.15.37:0/1946628797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe68406e440 0x7fe68411c690 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe67400b0d0 tx=0x7fe674009e30 comp rx=0 tx=0).stop 2024-04-25T17:19:24.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.630+0000 7fe689a7a700 1 -- 172.21.15.37:0/1946628797 shutdown_connections 2024-04-25T17:19:24.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.630+0000 7fe689a7a700 1 --2- 172.21.15.37:0/1946628797 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7fe67006fd10 0x7fe6700721c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:24.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.630+0000 7fe689a7a700 1 --2- 172.21.15.37:0/1946628797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe68406e440 0x7fe68411c690 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:24.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.630+0000 7fe689a7a700 1 --2- 172.21.15.37:0/1946628797 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe68406ed90 0x7fe68411cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:24.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.630+0000 7fe689a7a700 1 -- 172.21.15.37:0/1946628797 >> 172.21.15.37:0/1946628797 conn(0x7fe684069dc0 msgr2=0x7fe684107040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:19:24.634 INFO:tasks.workunit.client.1.smithi069.stdout:8/783: creat d37/d47/d54/dcc/f10d x:0 0 0 2024-04-25T17:19:24.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.631+0000 7fe689a7a700 1 -- 172.21.15.37:0/1946628797 shutdown_connections 2024-04-25T17:19:24.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.632+0000 7fe689a7a700 1 -- 172.21.15.37:0/1946628797 wait complete. 2024-04-25T17:19:24.634 INFO:tasks.workunit.client.1.smithi069.stdout:3/818: dwrite d8/d16/d1a/d38/f58 [0,4194304] 0 2024-04-25T17:19:24.642 INFO:tasks.workunit.client.1.smithi069.stdout:0/674: dwrite d0/f1 [0,4194304] 0 2024-04-25T17:19:24.642 INFO:tasks.workunit.client.1.smithi069.stdout:6/757: rename d2/d1e/d43/d7d/f9f to d2/d51/d89/dfd/f102 0 2024-04-25T17:19:24.645 INFO:tasks.workunit.client.1.smithi069.stdout:6/758: stat d2/d7/f80 0 2024-04-25T17:19:24.645 INFO:tasks.workunit.client.1.smithi069.stdout:6/759: write d2/d1e/d3f/d86/feb [290009,102801] 0 2024-04-25T17:19:24.645 INFO:tasks.workunit.client.1.smithi069.stdout:9/739: rmdir d2/da/dd/d1e/d2e/d68/d8f 39 2024-04-25T17:19:24.649 INFO:tasks.workunit.client.1.smithi069.stdout:9/740: dread d2/da/dd/d1e/d2e/d68/f72 [0,4194304] 0 2024-04-25T17:19:24.650 INFO:tasks.workunit.client.1.smithi069.stdout:7/759: dread d4/d3e/d94/da1/dc7/d14/d5a/f6c [0,4194304] 0 2024-04-25T17:19:24.651 INFO:tasks.workunit.client.1.smithi069.stdout:8/784: rmdir d37/d47/d78/d93 39 2024-04-25T17:19:24.652 INFO:tasks.workunit.client.1.smithi069.stdout:9/741: write d2/da/dd/de/d74/dbc/fd9 [1015449,11343] 0 2024-04-25T17:19:24.653 INFO:tasks.workunit.client.1.smithi069.stdout:7/760: stat d4/d3e/d94/da1/dc7/d14/d5a/l64 0 2024-04-25T17:19:24.653 INFO:tasks.workunit.client.1.smithi069.stdout:6/760: dwrite d2/d7/fa [4194304,4194304] 0 2024-04-25T17:19:24.654 INFO:tasks.workunit.client.1.smithi069.stdout:3/819: mknod d8/d2a/c114 0 2024-04-25T17:19:24.655 INFO:teuthology.orchestra.run.smithi037.stdout:true 2024-04-25T17:19:24.661 INFO:tasks.workunit.client.1.smithi069.stdout:3/820: dwrite d8/d16/d1a/d2c/d49/d87/f104 [0,4194304] 0 2024-04-25T17:19:24.663 INFO:tasks.workunit.client.1.smithi069.stdout:4/758: rename db/d15/d20/d35/d63/d70/f86 to db/d15/d82/f10c 0 2024-04-25T17:19:24.665 INFO:tasks.workunit.client.1.smithi069.stdout:0/675: mknod d0/da/d24/d67/db8/ce8 0 2024-04-25T17:19:24.666 INFO:tasks.workunit.client.1.smithi069.stdout:5/797: dwrite d13/d17/d29/d30/d5c/f69 [0,4194304] 0 2024-04-25T17:19:24.667 INFO:tasks.workunit.client.1.smithi069.stdout:1/751: write d1/d4/de/d44/f5d [66103,98219] 0 2024-04-25T17:19:24.669 INFO:tasks.workunit.client.1.smithi069.stdout:1/752: fdatasync d1/df/f34 0 2024-04-25T17:19:24.670 INFO:tasks.workunit.client.1.smithi069.stdout:2/749: write d0/d56/d5f/d62/d7d/d72/daf/fea [3059061,82046] 0 2024-04-25T17:19:24.676 INFO:tasks.workunit.client.1.smithi069.stdout:4/759: mknod db/d15/d20/d35/d63/d75/dc0/c10d 0 2024-04-25T17:19:24.677 INFO:tasks.workunit.client.1.smithi069.stdout:0/676: creat d0/da/d6e/fe9 x:0 0 0 2024-04-25T17:19:24.677 INFO:tasks.workunit.client.1.smithi069.stdout:4/760: write db/d4b/d78/dc4/d41/fb7 [1059573,96418] 0 2024-04-25T17:19:24.678 INFO:tasks.workunit.client.1.smithi069.stdout:8/785: mknod d37/d47/d78/d93/c10e 0 2024-04-25T17:19:24.682 INFO:tasks.workunit.client.1.smithi069.stdout:9/742: symlink d2/l101 0 2024-04-25T17:19:24.683 INFO:tasks.workunit.client.1.smithi069.stdout:4/761: dwrite db/d15/d20/d35/d63/fd8 [0,4194304] 0 2024-04-25T17:19:24.683 INFO:tasks.workunit.client.1.smithi069.stdout:5/798: mknod d13/d17/d19/d20/d2d/c116 0 2024-04-25T17:19:24.688 INFO:tasks.workunit.client.1.smithi069.stdout:3/821: write d8/d16/d1a/d2c/d49/d59/f6b [355282,13746] 0 2024-04-25T17:19:24.688 INFO:tasks.workunit.client.1.smithi069.stdout:6/761: creat d2/d1e/d3f/d56/d7e/d100/f103 x:0 0 0 2024-04-25T17:19:24.690 INFO:tasks.workunit.client.1.smithi069.stdout:8/786: symlink d37/d47/d54/l10f 0 2024-04-25T17:19:24.692 INFO:tasks.workunit.client.1.smithi069.stdout:9/743: truncate d2/da/dd/de/d74/d8a/f9e 2394354 0 2024-04-25T17:19:24.694 INFO:tasks.workunit.client.1.smithi069.stdout:7/761: dwrite d4/d3e/f62 [0,4194304] 0 2024-04-25T17:19:24.695 INFO:tasks.workunit.client.1.smithi069.stdout:6/762: fsync d2/f14 0 2024-04-25T17:19:24.701 INFO:tasks.workunit.client.1.smithi069.stdout:1/753: dread d1/d43/f18 [0,4194304] 0 2024-04-25T17:19:24.701 INFO:tasks.workunit.client.1.smithi069.stdout:2/750: rename d0/d26/d36/dc5/fd4 to d0/d26/d10/ff0 0 2024-04-25T17:19:24.703 INFO:tasks.workunit.client.1.smithi069.stdout:7/762: mkdir d4/d3e/d94/da1/dc7/d14/d5a/d5e/d89/d103 0 2024-04-25T17:19:24.704 INFO:tasks.workunit.client.1.smithi069.stdout:7/763: chown d4/d3e/d94/da1/f91 241458 1 2024-04-25T17:19:24.711 INFO:tasks.workunit.client.1.smithi069.stdout:8/787: rename d37/f7c to d37/d66/d6b/daf/de6/f110 0 2024-04-25T17:19:24.712 INFO:tasks.workunit.client.1.smithi069.stdout:2/751: creat d0/d56/d5f/d62/ff1 x:0 0 0 2024-04-25T17:19:24.714 INFO:tasks.workunit.client.1.smithi069.stdout:1/754: symlink d1/d4/d6/d9e/da6/d7c/d1d/de1/lea 0 2024-04-25T17:19:24.714 INFO:tasks.workunit.client.1.smithi069.stdout:5/799: dread d13/d17/d19/d1c/da4/da9/f110 [0,4194304] 0 2024-04-25T17:19:24.715 INFO:tasks.workunit.client.1.smithi069.stdout:7/764: creat d4/d3e/d94/da1/dc7/d14/d44/d88/f104 x:0 0 0 2024-04-25T17:19:24.719 INFO:tasks.workunit.client.1.smithi069.stdout:8/788: mkdir d37/d66/d6b/d111 0 2024-04-25T17:19:24.721 INFO:tasks.workunit.client.1.smithi069.stdout:6/763: write d2/d51/d85/f45 [1690687,22794] 0 2024-04-25T17:19:24.721 INFO:tasks.workunit.client.1.smithi069.stdout:0/677: dwrite d0/d17/fe7 [0,4194304] 0 2024-04-25T17:19:24.722 INFO:tasks.workunit.client.1.smithi069.stdout:4/762: getdents db/d15/d20/d35/d63/d43/d48/d49/d72/d84 0 2024-04-25T17:19:24.725 INFO:tasks.workunit.client.1.smithi069.stdout:1/755: truncate d1/d4/d6/d9e/da6/d7c/f53 937053 0 2024-04-25T17:19:24.727 INFO:tasks.workunit.client.1.smithi069.stdout:8/789: chown d37/l53 0 1 2024-04-25T17:19:24.730 INFO:tasks.workunit.client.1.smithi069.stdout:2/752: dread d0/d26/d10/d43/fbe [0,4194304] 0 2024-04-25T17:19:24.731 INFO:tasks.workunit.client.1.smithi069.stdout:0/678: creat d0/da/d59/dab/fea x:0 0 0 2024-04-25T17:19:24.734 INFO:tasks.workunit.client.1.smithi069.stdout:1/756: dwrite d1/d43/d1b/f2c [0,4194304] 0 2024-04-25T17:19:24.735 INFO:tasks.workunit.client.1.smithi069.stdout:7/765: dread d4/fb1 [0,4194304] 0 2024-04-25T17:19:24.739 INFO:tasks.workunit.client.1.smithi069.stdout:2/753: mknod d0/d56/d5f/d62/d7d/d72/daf/dc2/d8b/cf2 0 2024-04-25T17:19:24.740 INFO:tasks.workunit.client.1.smithi069.stdout:4/763: truncate db/d4b/d78/dc4/d41/f4f 5905814 0 2024-04-25T17:19:24.740 INFO:tasks.workunit.client.1.smithi069.stdout:5/800: dwrite d13/f26 [0,4194304] 0 2024-04-25T17:19:24.741 INFO:tasks.workunit.client.1.smithi069.stdout:2/754: stat d0/d56/d5f/d62/lbf 0 2024-04-25T17:19:24.741 INFO:tasks.workunit.client.1.smithi069.stdout:8/790: truncate f10 3487502 0 2024-04-25T17:19:24.742 INFO:tasks.workunit.client.1.smithi069.stdout:8/791: write d37/d47/d54/d6e/fba [828606,116331] 0 2024-04-25T17:19:24.743 INFO:tasks.workunit.client.1.smithi069.stdout:1/757: fdatasync d1/f5 0 2024-04-25T17:19:24.744 INFO:tasks.workunit.client.1.smithi069.stdout:0/679: fdatasync d0/da/db/d1d/f20 0 2024-04-25T17:19:24.746 INFO:tasks.workunit.client.1.smithi069.stdout:6/764: getdents d2/d1e/d3f 0 2024-04-25T17:19:24.748 INFO:tasks.workunit.client.1.smithi069.stdout:2/755: mkdir d0/d26/df3 0 2024-04-25T17:19:24.751 INFO:tasks.workunit.client.1.smithi069.stdout:5/801: dwrite d13/d17/d19/d20/d51/db5/fe1 [0,4194304] 0 2024-04-25T17:19:24.755 INFO:tasks.workunit.client.1.smithi069.stdout:0/680: unlink d0/da/l3d 0 2024-04-25T17:19:24.757 INFO:tasks.workunit.client.1.smithi069.stdout:6/765: dread d2/d1e/f71 [0,4194304] 0 2024-04-25T17:19:24.761 INFO:tasks.workunit.client.1.smithi069.stdout:1/758: symlink d1/leb 0 2024-04-25T17:19:24.762 INFO:tasks.workunit.client.0.smithi037.stdout:5/828: rename d7/d18/ca3 to d7/d63/cfb 0 2024-04-25T17:19:24.763 INFO:tasks.workunit.client.1.smithi069.stdout:4/764: rename db/d15/d82/da7/cea to db/d15/d20/d35/d63/d70/d8a/d96/dbf/d103/c10e 0 2024-04-25T17:19:24.764 INFO:tasks.workunit.client.0.smithi037.stdout:7/685: write d5/d15/d17/f41 [838048,117777] 0 2024-04-25T17:19:24.765 INFO:tasks.workunit.client.0.smithi037.stdout:0/844: dread - d9/fb9 zero size 2024-04-25T17:19:24.767 INFO:tasks.workunit.client.0.smithi037.stdout:6/762: rename db/d1d/db1/dc7/df8 to db/d26/d2e/d3e/d25/d10d/d113 0 2024-04-25T17:19:24.768 INFO:tasks.workunit.client.1.smithi069.stdout:7/766: dwrite d4/d3e/d94/da1/dc7/d14/d44/d79/da4/fc6 [0,4194304] 0 2024-04-25T17:19:24.768 INFO:tasks.workunit.client.0.smithi037.stdout:6/763: readlink db/d26/d2e/d3e/l50 0 2024-04-25T17:19:24.773 INFO:tasks.workunit.client.0.smithi037.stdout:7/686: unlink d5/lc6 0 2024-04-25T17:19:24.781 INFO:tasks.workunit.client.0.smithi037.stdout:5/829: creat d7/d12/d5d/d90/def/ffc x:0 0 0 2024-04-25T17:19:24.782 INFO:tasks.workunit.client.0.smithi037.stdout:5/830: chown d7/da1/dbb 18743 1 2024-04-25T17:19:24.784 INFO:tasks.workunit.client.0.smithi037.stdout:0/845: mkdir d9/df/d32/d115 0 2024-04-25T17:19:24.786 INFO:tasks.workunit.client.0.smithi037.stdout:3/675: write d8/d23/d38/f74 [907656,27388] 0 2024-04-25T17:19:24.791 INFO:tasks.workunit.client.0.smithi037.stdout:5/831: rename d7/d43/l78 to d7/da1/dbb/lfd 0 2024-04-25T17:19:24.792 INFO:tasks.workunit.client.0.smithi037.stdout:6/764: getdents db/d26/d2e/d3e/d25/d10b 0 2024-04-25T17:19:24.793 INFO:tasks.workunit.client.0.smithi037.stdout:7/687: dread d5/d15/d17/f47 [0,4194304] 0 2024-04-25T17:19:24.794 INFO:tasks.workunit.client.0.smithi037.stdout:0/846: link d9/f104 d9/df/d32/d39/dd3/f116 0 2024-04-25T17:19:24.795 INFO:tasks.workunit.client.0.smithi037.stdout:0/847: readlink d9/df/d32/d39/d68/lbf 0 2024-04-25T17:19:24.795 INFO:tasks.workunit.client.0.smithi037.stdout:3/676: mknod d8/d31/d32/cd2 0 2024-04-25T17:19:24.796 INFO:tasks.workunit.client.0.smithi037.stdout:0/848: stat d9/d14/dff/d105 0 2024-04-25T17:19:24.798 INFO:tasks.workunit.client.0.smithi037.stdout:7/688: unlink d5/f43 0 2024-04-25T17:19:24.804 INFO:tasks.workunit.client.0.smithi037.stdout:6/765: creat db/d1d/d20/dcf/dfa/d65/d68/d87/f114 x:0 0 0 2024-04-25T17:19:24.804 INFO:tasks.workunit.client.0.smithi037.stdout:3/677: rename d8/d23/d72 to d8/d4c/dd3 0 2024-04-25T17:19:24.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.805+0000 7fcf9b429700 1 -- 172.21.15.37:0/4006940420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf94104670 msgr2=0x7fcf94104ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:19:24.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.805+0000 7fcf9b429700 1 --2- 172.21.15.37:0/4006940420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf94104670 0x7fcf94104ae0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fcf84004940 tx=0x7fcf84009e30 comp rx=0 tx=0).stop 2024-04-25T17:19:24.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.805+0000 7fcf9b429700 1 -- 172.21.15.37:0/4006940420 shutdown_connections 2024-04-25T17:19:24.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.805+0000 7fcf9b429700 1 --2- 172.21.15.37:0/4006940420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf94104670 0x7fcf94104ae0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:24.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.805+0000 7fcf9b429700 1 --2- 172.21.15.37:0/4006940420 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcf941033c0 0x7fcf941037d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:24.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.805+0000 7fcf9b429700 1 -- 172.21.15.37:0/4006940420 >> 172.21.15.37:0/4006940420 conn(0x7fcf940725e0 msgr2=0x7fcf94074a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:19:24.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.805+0000 7fcf9b429700 1 -- 172.21.15.37:0/4006940420 shutdown_connections 2024-04-25T17:19:24.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.805+0000 7fcf9b429700 1 -- 172.21.15.37:0/4006940420 wait complete. 2024-04-25T17:19:24.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.806+0000 7fcf9b429700 1 Processor -- start 2024-04-25T17:19:24.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.806+0000 7fcf9b429700 1 -- start start 2024-04-25T17:19:24.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.806+0000 7fcf9b429700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf941033c0 0x7fcf9407d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:19:24.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.806+0000 7fcf9b429700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcf94104670 0x7fcf9407d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:19:24.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.806+0000 7fcf9b429700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9407edc0 con 0x7fcf941033c0 2024-04-25T17:19:24.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.806+0000 7fcf9b429700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9407dc00 con 0x7fcf94104670 2024-04-25T17:19:24.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.807+0000 7fcf991c5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf941033c0 0x7fcf9407d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:19:24.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.807+0000 7fcf991c5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf941033c0 0x7fcf9407d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49582/0 (socket says 172.21.15.37:49582) 2024-04-25T17:19:24.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.807+0000 7fcf991c5700 1 -- 172.21.15.37:0/103037290 learned_addr learned my addr 172.21.15.37:0/103037290 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:19:24.808 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.807+0000 7fcf989c4700 1 --2- 172.21.15.37:0/103037290 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcf94104670 0x7fcf9407d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:19:24.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.808+0000 7fcf991c5700 1 -- 172.21.15.37:0/103037290 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcf94104670 msgr2=0x7fcf9407d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:19:24.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.808+0000 7fcf991c5700 1 --2- 172.21.15.37:0/103037290 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcf94104670 0x7fcf9407d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:24.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.808+0000 7fcf991c5700 1 -- 172.21.15.37:0/103037290 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf84005040 con 0x7fcf941033c0 2024-04-25T17:19:24.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.808+0000 7fcf991c5700 1 --2- 172.21.15.37:0/103037290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf941033c0 0x7fcf9407d180 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fcf90002a50 tx=0x7fcf900046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:19:24.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.808+0000 7fcf989c4700 1 --2- 172.21.15.37:0/103037290 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcf94104670 0x7fcf9407d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T17:19:24.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.808+0000 7fcf89ffb700 1 -- 172.21.15.37:0/103037290 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf90007cc0 con 0x7fcf941033c0 2024-04-25T17:19:24.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.808+0000 7fcf9b429700 1 -- 172.21.15.37:0/103037290 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf9407de60 con 0x7fcf941033c0 2024-04-25T17:19:24.810 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.808+0000 7fcf89ffb700 1 -- 172.21.15.37:0/103037290 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcf9000f040 con 0x7fcf941033c0 2024-04-25T17:19:24.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.810+0000 7fcf89ffb700 1 -- 172.21.15.37:0/103037290 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf9000da60 con 0x7fcf941033c0 2024-04-25T17:19:24.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.810+0000 7fcf9b429700 1 -- 172.21.15.37:0/103037290 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf94067bc0 con 0x7fcf941033c0 2024-04-25T17:19:24.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.810+0000 7fcf9b429700 1 -- 172.21.15.37:0/103037290 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf9405f5c0 con 0x7fcf941033c0 2024-04-25T17:19:24.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.810+0000 7fcf89ffb700 1 -- 172.21.15.37:0/103037290 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) v1 ==== 92608+0+0 (secure 0 0 0) 0x7fcf9000dbc0 con 0x7fcf941033c0 2024-04-25T17:19:24.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.811+0000 7fcf89ffb700 1 --2- 172.21.15.37:0/103037290 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7fcf8006fcb0 0x7fcf80072160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:19:24.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.811+0000 7fcf89ffb700 1 -- 172.21.15.37:0/103037290 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fcf9008f480 con 0x7fcf941033c0 2024-04-25T17:19:24.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.811+0000 7fcf989c4700 1 --2- 172.21.15.37:0/103037290 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7fcf8006fcb0 0x7fcf80072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:19:24.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.812+0000 7fcf989c4700 1 --2- 172.21.15.37:0/103037290 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7fcf8006fcb0 0x7fcf80072160 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fcf8400b3b0 tx=0x7fcf84009e30 comp rx=0 tx=0).ready entity=mgr.24417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:19:24.813 INFO:tasks.workunit.client.1.smithi069.stdout:5/802: dwrite d13/d17/d19/d20/d2d/f5d [0,4194304] 0 2024-04-25T17:19:24.814 INFO:tasks.workunit.client.1.smithi069.stdout:7/767: mknod d4/d3e/d94/da1/dc7/d14/d15/c105 0 2024-04-25T17:19:24.814 INFO:tasks.workunit.client.1.smithi069.stdout:5/803: read d13/d17/d19/d20/d51/db5/fe1 [868402,125387] 0 2024-04-25T17:19:24.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:24.816+0000 7fcf89ffb700 1 -- 172.21.15.37:0/103037290 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7fcf900587c0 con 0x7fcf941033c0 2024-04-25T17:19:24.819 INFO:tasks.workunit.client.1.smithi069.stdout:8/792: getdents d37/d47/d48 0 2024-04-25T17:19:24.825 INFO:tasks.workunit.client.1.smithi069.stdout:2/756: rename d0/d56/f5e to d0/d26/d10/d43/ff4 0 2024-04-25T17:19:24.826 INFO:tasks.workunit.client.0.smithi037.stdout:7/689: dwrite d5/d15/d17/d25/d2b/fd2 [0,4194304] 0 2024-04-25T17:19:24.828 INFO:tasks.workunit.client.1.smithi069.stdout:5/804: fdatasync d13/d17/d19/d1c/da4/da9/f110 0 2024-04-25T17:19:24.830 INFO:tasks.workunit.client.1.smithi069.stdout:1/759: creat d1/d4/d6/d9e/da6/d7c/fec x:0 0 0 2024-04-25T17:19:24.831 INFO:tasks.workunit.client.1.smithi069.stdout:5/805: truncate d13/d17/d19/d20/f9a 4270837 0 2024-04-25T17:19:24.973 INFO:tasks.workunit.client.1.smithi069.stdout:6/766: sync 2024-04-25T17:19:24.973 INFO:tasks.workunit.client.1.smithi069.stdout:3/822: sync 2024-04-25T17:19:24.973 INFO:tasks.workunit.client.1.smithi069.stdout:9/744: sync 2024-04-25T17:19:24.975 INFO:tasks.workunit.client.1.smithi069.stdout:3/823: read d8/d16/d1a/d38/fba [80268,73441] 0 2024-04-25T17:19:25.011 INFO:tasks.workunit.client.1.smithi069.stdout:2/757: creat d0/d56/d5f/d62/d7d/d72/ff5 x:0 0 0 2024-04-25T17:19:25.016 INFO:tasks.workunit.client.1.smithi069.stdout:7/768: sync 2024-04-25T17:19:25.016 INFO:tasks.workunit.client.1.smithi069.stdout:1/760: sync 2024-04-25T17:19:25.023 INFO:tasks.workunit.client.1.smithi069.stdout:5/806: creat d13/d17/d19/d96/d9d/f117 x:0 0 0 2024-04-25T17:19:25.091 INFO:tasks.workunit.client.0.smithi037.stdout:3/678: creat d8/d31/d8d/db7/fd4 x:0 0 0 2024-04-25T17:19:25.108 INFO:tasks.workunit.client.0.smithi037.stdout:3/679: dread d8/d31/d32/d3e/f9b [0,4194304] 0 2024-04-25T17:19:25.108 INFO:tasks.workunit.client.0.smithi037.stdout:3/680: chown d8/d23/l34 47 1 2024-04-25T17:19:25.110 INFO:tasks.workunit.client.0.smithi037.stdout:3/681: write d8/d31/f52 [2403380,32281] 0 2024-04-25T17:19:25.111 INFO:tasks.workunit.client.0.smithi037.stdout:3/682: fsync d8/d4c/dd3/f96 0 2024-04-25T17:19:25.111 INFO:tasks.workunit.client.0.smithi037.stdout:7/690: symlink d5/d14/dcf/le9 0 2024-04-25T17:19:25.122 INFO:tasks.workunit.client.0.smithi037.stdout:7/691: fsync d5/d15/dd8/fbb 0 2024-04-25T17:19:25.128 INFO:tasks.workunit.client.0.smithi037.stdout:7/692: mknod d5/dc1/cea 0 2024-04-25T17:19:25.144 INFO:tasks.workunit.client.1.smithi069.stdout:6/767: chown d2/d9c/d97/lae 37672532 1 2024-04-25T17:19:25.144 INFO:tasks.workunit.client.1.smithi069.stdout:6/768: fdatasync d2/d9c/d48/f4f 0 2024-04-25T17:19:25.153 INFO:tasks.workunit.client.1.smithi069.stdout:4/765: getdents db/d15/d42/d64 0 2024-04-25T17:19:25.155 INFO:tasks.workunit.client.1.smithi069.stdout:0/681: rename d0/da/d24/c6b to d0/da/db/d56/d98/ceb 0 2024-04-25T17:19:25.156 INFO:tasks.workunit.client.1.smithi069.stdout:0/682: chown d0/da/db/d7e 1344026294 1 2024-04-25T17:19:25.157 INFO:tasks.workunit.client.1.smithi069.stdout:2/758: truncate d0/d26/d10/f7e 960411 0 2024-04-25T17:19:25.161 INFO:tasks.workunit.client.1.smithi069.stdout:7/769: fsync d4/d3e/d94/da1/dc7/d14/d3d/df6/f65 0 2024-04-25T17:19:25.162 INFO:tasks.workunit.client.1.smithi069.stdout:1/761: dread d1/d4/de/d44/f5c [0,4194304] 0 2024-04-25T17:19:25.162 INFO:tasks.workunit.client.1.smithi069.stdout:7/770: chown d4/d18 122 1 2024-04-25T17:19:25.163 INFO:tasks.workunit.client.1.smithi069.stdout:7/771: dread - d4/d3e/d94/da1/dc7/d14/fde zero size 2024-04-25T17:19:25.168 INFO:tasks.workunit.client.1.smithi069.stdout:1/762: dwrite d1/d4/d6/d9e/da6/d38/f90 [0,4194304] 0 2024-04-25T17:19:25.168 INFO:tasks.workunit.client.1.smithi069.stdout:6/769: symlink d2/d51/d85/l104 0 2024-04-25T17:19:25.172 INFO:tasks.workunit.client.1.smithi069.stdout:4/766: creat db/d15/d20/d35/d63/d70/d8a/d96/f10f x:0 0 0 2024-04-25T17:19:25.176 INFO:tasks.workunit.client.1.smithi069.stdout:2/759: mknod d0/d56/d5f/d62/cf6 0 2024-04-25T17:19:25.177 INFO:tasks.workunit.client.1.smithi069.stdout:2/760: chown d0/d26/d10/ced 66 1 2024-04-25T17:19:25.177 INFO:tasks.workunit.client.1.smithi069.stdout:0/683: dread d0/da/db/d2c/f74 [0,4194304] 0 2024-04-25T17:19:25.182 INFO:tasks.workunit.client.1.smithi069.stdout:5/807: dread d13/d17/d29/d30/d9c/fb6 [0,4194304] 0 2024-04-25T17:19:25.186 INFO:tasks.workunit.client.1.smithi069.stdout:8/793: link l24 d37/d47/d78/d93/df9/l112 0 2024-04-25T17:19:25.189 INFO:tasks.workunit.client.1.smithi069.stdout:6/770: creat d2/d1e/d3f/d56/de5/f105 x:0 0 0 2024-04-25T17:19:25.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.189+0000 7fcf9b429700 1 -- 172.21.15.37:0/103037290 --> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcf94108950 con 0x7fcf8006fcb0 2024-04-25T17:19:25.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.190+0000 7fcf89ffb700 1 -- 172.21.15.37:0/103037290 <== mgr.24417 v2:172.21.15.69:6828/2602478 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7fcf94108950 con 0x7fcf8006fcb0 2024-04-25T17:19:25.192 INFO:tasks.workunit.client.1.smithi069.stdout:4/767: unlink db/d15/d42/d64/d7f/l99 0 2024-04-25T17:19:25.193 INFO:tasks.workunit.client.1.smithi069.stdout:6/771: read d2/d1e/d3f/d86/fc7 [2474523,86414] 0 2024-04-25T17:19:25.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.193+0000 7fcf9b429700 1 -- 172.21.15.37:0/103037290 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7fcf8006fcb0 msgr2=0x7fcf80072160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:19:25.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.193+0000 7fcf9b429700 1 --2- 172.21.15.37:0/103037290 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7fcf8006fcb0 0x7fcf80072160 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fcf8400b3b0 tx=0x7fcf84009e30 comp rx=0 tx=0).stop 2024-04-25T17:19:25.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.193+0000 7fcf9b429700 1 -- 172.21.15.37:0/103037290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf941033c0 msgr2=0x7fcf9407d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:19:25.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.193+0000 7fcf9b429700 1 --2- 172.21.15.37:0/103037290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf941033c0 0x7fcf9407d180 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fcf90002a50 tx=0x7fcf900046b0 comp rx=0 tx=0).stop 2024-04-25T17:19:25.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.193+0000 7fcf9b429700 1 -- 172.21.15.37:0/103037290 shutdown_connections 2024-04-25T17:19:25.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.193+0000 7fcf9b429700 1 --2- 172.21.15.37:0/103037290 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7fcf8006fcb0 0x7fcf80072160 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:25.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.193+0000 7fcf9b429700 1 --2- 172.21.15.37:0/103037290 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf941033c0 0x7fcf9407d180 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:25.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.193+0000 7fcf9b429700 1 --2- 172.21.15.37:0/103037290 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcf94104670 0x7fcf9407d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:25.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.193+0000 7fcf9b429700 1 -- 172.21.15.37:0/103037290 >> 172.21.15.37:0/103037290 conn(0x7fcf940725e0 msgr2=0x7fcf94073be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:19:25.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.193+0000 7fcf9b429700 1 -- 172.21.15.37:0/103037290 shutdown_connections 2024-04-25T17:19:25.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.193+0000 7fcf9b429700 1 -- 172.21.15.37:0/103037290 wait complete. 2024-04-25T17:19:25.196 INFO:tasks.workunit.client.1.smithi069.stdout:0/684: unlink d0/da/d24/f55 0 2024-04-25T17:19:25.197 INFO:tasks.workunit.client.1.smithi069.stdout:0/685: truncate d0/d17/d95/fa7 4244527 0 2024-04-25T17:19:25.199 INFO:tasks.workunit.client.1.smithi069.stdout:5/808: write d13/d17/d19/d1c/da4/da9/daa/fe0 [1414765,45407] 0 2024-04-25T17:19:25.200 INFO:tasks.workunit.client.1.smithi069.stdout:7/772: unlink d4/d1a/f1c 0 2024-04-25T17:19:25.201 INFO:tasks.workunit.client.1.smithi069.stdout:4/768: dwrite db/db0/ff3 [0,4194304] 0 2024-04-25T17:19:25.202 INFO:tasks.workunit.client.1.smithi069.stdout:2/761: dread d0/f53 [0,4194304] 0 2024-04-25T17:19:25.203 INFO:tasks.workunit.client.1.smithi069.stdout:8/794: creat d37/d47/d48/f113 x:0 0 0 2024-04-25T17:19:25.206 INFO:tasks.workunit.client.1.smithi069.stdout:0/686: creat d0/d17/d83/dcf/dd5/fec x:0 0 0 2024-04-25T17:19:25.209 INFO:tasks.workunit.client.1.smithi069.stdout:1/763: dread d1/d43/f3a [0,4194304] 0 2024-04-25T17:19:25.209 INFO:tasks.workunit.client.1.smithi069.stdout:4/769: creat db/de3/f110 x:0 0 0 2024-04-25T17:19:25.209 INFO:tasks.workunit.client.1.smithi069.stdout:7/773: rmdir d4/d3e/d94/da1/dc7/d14/d3d/df6 39 2024-04-25T17:19:25.211 INFO:tasks.workunit.client.1.smithi069.stdout:6/772: dread d2/d1e/f6a [0,4194304] 0 2024-04-25T17:19:25.214 INFO:tasks.workunit.client.1.smithi069.stdout:0/687: dwrite d0/da/db/d1d/d5f/fbd [0,4194304] 0 2024-04-25T17:19:25.218 INFO:tasks.workunit.client.1.smithi069.stdout:1/764: write d1/df/f30 [1438341,111216] 0 2024-04-25T17:19:25.220 INFO:tasks.workunit.client.1.smithi069.stdout:2/762: creat d0/d26/d36/db9/dc8/ff7 x:0 0 0 2024-04-25T17:19:25.222 INFO:tasks.workunit.client.1.smithi069.stdout:6/773: mknod d2/d1e/d43/db6/de4/d8d/c106 0 2024-04-25T17:19:25.224 INFO:tasks.workunit.client.1.smithi069.stdout:0/688: creat d0/d38/fed x:0 0 0 2024-04-25T17:19:25.229 INFO:tasks.workunit.client.1.smithi069.stdout:0/689: dwrite d0/da/db/fe [0,4194304] 0 2024-04-25T17:19:25.229 INFO:tasks.workunit.client.1.smithi069.stdout:2/763: mkdir d0/d56/d5f/d62/d7d/d31/df8 0 2024-04-25T17:19:25.230 INFO:tasks.workunit.client.1.smithi069.stdout:2/764: stat d0/d1/d5b/d33/c5a 0 2024-04-25T17:19:25.231 INFO:tasks.workunit.client.1.smithi069.stdout:6/774: creat d2/d1e/d43/db6/de4/f107 x:0 0 0 2024-04-25T17:19:25.239 INFO:tasks.workunit.client.1.smithi069.stdout:2/765: creat d0/d26/d10/db5/de3/ff9 x:0 0 0 2024-04-25T17:19:25.241 INFO:tasks.workunit.client.1.smithi069.stdout:6/775: read d2/d1e/f62 [2579710,125197] 0 2024-04-25T17:19:25.242 INFO:tasks.workunit.client.1.smithi069.stdout:6/776: write d2/d1e/d43/f9e [399319,80493] 0 2024-04-25T17:19:25.242 INFO:tasks.workunit.client.1.smithi069.stdout:6/777: fsync d2/d9c/d97/fd4 0 2024-04-25T17:19:25.246 INFO:tasks.workunit.client.1.smithi069.stdout:6/778: read d2/d1e/f62 [3002493,99018] 0 2024-04-25T17:19:25.247 INFO:tasks.workunit.client.1.smithi069.stdout:6/779: write d2/d51/d85/fd8 [534554,27556] 0 2024-04-25T17:19:25.252 INFO:tasks.workunit.client.1.smithi069.stdout:6/780: dwrite d2/d51/d89/f90 [0,4194304] 0 2024-04-25T17:19:25.278 INFO:tasks.workunit.client.0.smithi037.stdout:6/766: rename db/d26/c40 to db/d1d/d20/dcf/dfa/d65/d68/d87/dbd/c115 0 2024-04-25T17:19:25.279 INFO:tasks.workunit.client.0.smithi037.stdout:6/767: dread - db/ff7 zero size 2024-04-25T17:19:25.288 INFO:tasks.workunit.client.0.smithi037.stdout:6/768: creat db/d1d/d20/dcf/dfa/d65/d68/f116 x:0 0 0 2024-04-25T17:19:25.292 INFO:tasks.workunit.client.0.smithi037.stdout:6/769: unlink db/d26/f93 0 2024-04-25T17:19:25.293 INFO:tasks.workunit.client.1.smithi069.stdout:5/809: truncate d13/d17/d19/d20/f2a 268431 0 2024-04-25T17:19:25.295 INFO:tasks.workunit.client.1.smithi069.stdout:5/810: truncate d13/d17/d19/d1c/d6c/fea 595424 0 2024-04-25T17:19:25.295 INFO:tasks.workunit.client.1.smithi069.stdout:5/811: chown d13/d17/d29/d30/d5c/f48 418732 1 2024-04-25T17:19:25.296 INFO:tasks.workunit.client.1.smithi069.stdout:5/812: fsync d13/d17/d19/d96/d9d/fa7 0 2024-04-25T17:19:25.296 INFO:tasks.workunit.client.1.smithi069.stdout:5/813: chown d13/d17/d19/f25 368 1 2024-04-25T17:19:25.297 INFO:tasks.workunit.client.1.smithi069.stdout:5/814: fsync d13/d17/d29/f2b 0 2024-04-25T17:19:25.299 INFO:tasks.workunit.client.1.smithi069.stdout:5/815: rmdir d13/d17/d19/d1c/d6c 39 2024-04-25T17:19:25.300 INFO:tasks.workunit.client.0.smithi037.stdout:0/849: write d9/df/d32/d56/f8d [1555537,3243] 0 2024-04-25T17:19:25.301 INFO:tasks.workunit.client.0.smithi037.stdout:0/850: readlink d9/df/d32/l8f 0 2024-04-25T17:19:25.305 INFO:tasks.workunit.client.1.smithi069.stdout:3/824: creat d8/d16/d9b/f115 x:0 0 0 2024-04-25T17:19:25.307 INFO:tasks.workunit.client.1.smithi069.stdout:3/825: rmdir d8/d16/d1a/d2c/d49/d87 39 2024-04-25T17:19:25.308 INFO:tasks.workunit.client.1.smithi069.stdout:3/826: chown d8/d71/d8d/d92/faa 60596 1 2024-04-25T17:19:25.308 INFO:tasks.workunit.client.1.smithi069.stdout:3/827: chown d8/d2a/f72 45069 1 2024-04-25T17:19:25.309 INFO:tasks.workunit.client.1.smithi069.stdout:7/774: sync 2024-04-25T17:19:25.309 INFO:tasks.workunit.client.1.smithi069.stdout:7/775: chown d4/d3e/d94/cb2 210261 1 2024-04-25T17:19:25.339 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.337+0000 7f095f74e700 1 -- 172.21.15.37:0/2930462084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09581022e0 msgr2=0x7f09581046c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:19:25.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.337+0000 7f095f74e700 1 --2- 172.21.15.37:0/2930462084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09581022e0 0x7f09581046c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0948004940 tx=0x7f0948009e30 comp rx=0 tx=0).stop 2024-04-25T17:19:25.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.337+0000 7f095f74e700 1 -- 172.21.15.37:0/2930462084 shutdown_connections 2024-04-25T17:19:25.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.337+0000 7f095f74e700 1 --2- 172.21.15.37:0/2930462084 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09581022e0 0x7f09581046c0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:25.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.337+0000 7f095f74e700 1 --2- 172.21.15.37:0/2930462084 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f09580662c0 0x7f0958101da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:25.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.337+0000 7f095f74e700 1 -- 172.21.15.37:0/2930462084 >> 172.21.15.37:0/2930462084 conn(0x7f09580f7430 msgr2=0x7f09580f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:19:25.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.337+0000 7f095f74e700 1 -- 172.21.15.37:0/2930462084 shutdown_connections 2024-04-25T17:19:25.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.337+0000 7f095f74e700 1 -- 172.21.15.37:0/2930462084 wait complete. 2024-04-25T17:19:25.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.337+0000 7f095f74e700 1 Processor -- start 2024-04-25T17:19:25.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.337+0000 7f095f74e700 1 -- start start 2024-04-25T17:19:25.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.337+0000 7f095f74e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f09580662c0 0x7f095810fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:19:25.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.337+0000 7f095f74e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09581022e0 0x7f0958110170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:19:25.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.337+0000 7f095f74e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0958110770 con 0x7f09581022e0 2024-04-25T17:19:25.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.337+0000 7f095f74e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0958110fc0 con 0x7f09580662c0 2024-04-25T17:19:25.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.338+0000 7f095cce9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09581022e0 0x7f0958110170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:19:25.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.338+0000 7f095cce9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09581022e0 0x7f0958110170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49602/0 (socket says 172.21.15.37:49602) 2024-04-25T17:19:25.340 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.338+0000 7f095cce9700 1 -- 172.21.15.37:0/2653186990 learned_addr learned my addr 172.21.15.37:0/2653186990 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:19:25.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.338+0000 7f095d4ea700 1 --2- 172.21.15.37:0/2653186990 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f09580662c0 0x7f095810fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:19:25.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.338+0000 7f095cce9700 1 -- 172.21.15.37:0/2653186990 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f09580662c0 msgr2=0x7f095810fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:19:25.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.338+0000 7f095cce9700 1 --2- 172.21.15.37:0/2653186990 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f09580662c0 0x7f095810fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:25.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.338+0000 7f095cce9700 1 -- 172.21.15.37:0/2653186990 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0948005040 con 0x7f09581022e0 2024-04-25T17:19:25.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.338+0000 7f095cce9700 1 --2- 172.21.15.37:0/2653186990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09581022e0 0x7f0958110170 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f0948009150 tx=0x7f0948009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:19:25.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.338+0000 7f094dffb700 1 -- 172.21.15.37:0/2653186990 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f094800e040 con 0x7f09581022e0 2024-04-25T17:19:25.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.338+0000 7f094dffb700 1 -- 172.21.15.37:0/2653186990 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0948004290 con 0x7f09581022e0 2024-04-25T17:19:25.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.338+0000 7f094dffb700 1 -- 172.21.15.37:0/2653186990 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f094801c630 con 0x7f09581022e0 2024-04-25T17:19:25.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.338+0000 7f095f74e700 1 -- 172.21.15.37:0/2653186990 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0958111240 con 0x7f09581022e0 2024-04-25T17:19:25.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.340+0000 7f095f74e700 1 -- 172.21.15.37:0/2653186990 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0958111730 con 0x7f09581022e0 2024-04-25T17:19:25.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.340+0000 7f095f74e700 1 -- 172.21.15.37:0/2653186990 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f095805f5c0 con 0x7f09581022e0 2024-04-25T17:19:25.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.340+0000 7f094dffb700 1 -- 172.21.15.37:0/2653186990 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) v1 ==== 92608+0+0 (secure 0 0 0) 0x7f094800bbf0 con 0x7f09581022e0 2024-04-25T17:19:25.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.340+0000 7f094dffb700 1 --2- 172.21.15.37:0/2653186990 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f094406fcb0 0x7f0944072160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:19:25.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.341+0000 7f094dffb700 1 -- 172.21.15.37:0/2653186990 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f0948090370 con 0x7f09581022e0 2024-04-25T17:19:25.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.341+0000 7f095d4ea700 1 --2- 172.21.15.37:0/2653186990 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f094406fcb0 0x7f0944072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:19:25.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.341+0000 7f095d4ea700 1 --2- 172.21.15.37:0/2653186990 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f094406fcb0 0x7f0944072160 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0954007fd0 tx=0x7f0954009040 comp rx=0 tx=0).ready entity=mgr.24417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:19:25.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.345+0000 7f094dffb700 1 -- 172.21.15.37:0/2653186990 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f09480597d0 con 0x7f09581022e0 2024-04-25T17:19:25.425 INFO:tasks.workunit.client.1.smithi069.stdout:3/828: creat d8/d16/d9b/dc3/f116 x:0 0 0 2024-04-25T17:19:25.425 INFO:tasks.workunit.client.1.smithi069.stdout:7/776: creat d4/dbb/f106 x:0 0 0 2024-04-25T17:19:25.427 INFO:tasks.workunit.client.1.smithi069.stdout:7/777: creat d4/d3e/d94/f107 x:0 0 0 2024-04-25T17:19:25.427 INFO:tasks.workunit.client.1.smithi069.stdout:7/778: chown d4/d83/da2/ded 4546 1 2024-04-25T17:19:25.503 INFO:tasks.workunit.client.1.smithi069.stdout:3/829: mknod d8/d39/dfa/c117 0 2024-04-25T17:19:25.503 INFO:tasks.workunit.client.1.smithi069.stdout:3/830: chown d8/d71/ldc 1887408 1 2024-04-25T17:19:25.503 INFO:tasks.workunit.client.1.smithi069.stdout:7/779: mkdir d4/d83/d108 0 2024-04-25T17:19:25.517 INFO:tasks.workunit.client.0.smithi037.stdout:7/693: dwrite d5/d15/f89 [0,4194304] 0 2024-04-25T17:19:25.520 INFO:tasks.workunit.client.0.smithi037.stdout:7/694: mknod d5/dc1/de1/ceb 0 2024-04-25T17:19:25.523 INFO:tasks.workunit.client.1.smithi069.stdout:9/745: dwrite d2/da/dd/f11 [0,4194304] 0 2024-04-25T17:19:25.549 INFO:tasks.workunit.client.1.smithi069.stdout:8/795: dwrite d37/d47/d54/d6e/d9e/fa4 [0,4194304] 0 2024-04-25T17:19:25.550 INFO:tasks.workunit.client.1.smithi069.stdout:6/781: rename d2/d1e/d43/db6/de4/d8d to d2/d51/d85/d108 0 2024-04-25T17:19:25.557 INFO:tasks.workunit.client.1.smithi069.stdout:1/765: truncate d1/d4/d6/fa9 1802173 0 2024-04-25T17:19:25.558 INFO:tasks.workunit.client.1.smithi069.stdout:8/796: dwrite d37/d47/d78/db3/fe0 [0,4194304] 0 2024-04-25T17:19:25.558 INFO:tasks.workunit.client.1.smithi069.stdout:0/690: truncate d0/f79 3113754 0 2024-04-25T17:19:25.560 INFO:tasks.workunit.client.1.smithi069.stdout:1/766: readlink d1/d4/d6/d9e/da6/d7c/d1d/de1/lcd 0 2024-04-25T17:19:25.560 INFO:tasks.workunit.client.1.smithi069.stdout:0/691: chown d0/d38/fde 63 1 2024-04-25T17:19:25.560 INFO:tasks.workunit.client.1.smithi069.stdout:8/797: dread - d37/d47/d78/d93/df9/f106 zero size 2024-04-25T17:19:25.562 INFO:tasks.workunit.client.1.smithi069.stdout:2/766: creat d0/d26/d10/ffa x:0 0 0 2024-04-25T17:19:25.565 INFO:tasks.workunit.client.1.smithi069.stdout:8/798: rename d37/d66 to d37/d47/d78/db3/d114 0 2024-04-25T17:19:25.567 INFO:tasks.workunit.client.1.smithi069.stdout:1/767: symlink d1/d4/d6/d9e/da6/led 0 2024-04-25T17:19:25.569 INFO:tasks.workunit.client.1.smithi069.stdout:2/767: creat d0/d56/d5f/d62/d7d/d72/daf/ffb x:0 0 0 2024-04-25T17:19:25.570 INFO:tasks.workunit.client.1.smithi069.stdout:0/692: creat d0/da/d24/d67/fee x:0 0 0 2024-04-25T17:19:25.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:25 smithi037 ceph-mon[26472]: pgmap v43: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 73 MiB/s rd, 195 MiB/s wr, 405 op/s 2024-04-25T17:19:25.572 INFO:tasks.workunit.client.1.smithi069.stdout:1/768: mknod d1/d4/d6/d9e/da6/d7c/d1d/de1/d8e/cee 0 2024-04-25T17:19:25.572 INFO:tasks.workunit.client.1.smithi069.stdout:6/782: dread d2/d1e/d43/fc9 [0,4194304] 0 2024-04-25T17:19:25.576 INFO:tasks.workunit.client.0.smithi037.stdout:6/770: creat db/f117 x:0 0 0 2024-04-25T17:19:25.577 INFO:tasks.workunit.client.0.smithi037.stdout:6/771: readlink db/d1d/d20/dcf/dfa/l7a 0 2024-04-25T17:19:25.578 INFO:tasks.workunit.client.0.smithi037.stdout:7/695: unlink d5/f96 0 2024-04-25T17:19:25.580 INFO:tasks.workunit.client.1.smithi069.stdout:1/769: symlink d1/d4/d6/d9e/da6/d7c/d4d/lef 0 2024-04-25T17:19:25.582 INFO:tasks.workunit.client.0.smithi037.stdout:6/772: creat db/d1d/db1/f118 x:0 0 0 2024-04-25T17:19:25.584 INFO:tasks.workunit.client.1.smithi069.stdout:1/770: dwrite d1/f79 [4194304,4194304] 0 2024-04-25T17:19:25.590 INFO:tasks.workunit.client.0.smithi037.stdout:6/773: rename db/d1d/d20/dcf/dfa/d65/fb8 to db/d1d/d20/d2f/f119 0 2024-04-25T17:19:25.591 INFO:tasks.workunit.client.1.smithi069.stdout:6/783: creat d2/d1e/d43/ddc/f109 x:0 0 0 2024-04-25T17:19:25.591 INFO:tasks.workunit.client.1.smithi069.stdout:5/816: write d13/d17/d29/d2e/d76/f87 [5003799,87786] 0 2024-04-25T17:19:25.592 INFO:tasks.workunit.client.0.smithi037.stdout:0/851: write d9/d14/d28/d48/f50 [2423431,11017] 0 2024-04-25T17:19:25.593 INFO:tasks.workunit.client.1.smithi069.stdout:8/799: dread d37/d47/d54/f5e [0,4194304] 0 2024-04-25T17:19:25.593 INFO:tasks.workunit.client.1.smithi069.stdout:6/784: write d2/d1e/d43/dca/fed [657557,128488] 0 2024-04-25T17:19:25.594 INFO:tasks.workunit.client.1.smithi069.stdout:9/746: sync 2024-04-25T17:19:25.594 INFO:tasks.workunit.client.1.smithi069.stdout:8/800: readlink d37/d62/l9f 0 2024-04-25T17:19:25.595 INFO:tasks.workunit.client.1.smithi069.stdout:4/770: mknod db/d15/d20/d35/d63/d43/d48/c111 0 2024-04-25T17:19:25.595 INFO:tasks.workunit.client.1.smithi069.stdout:6/785: dread - d2/d1e/d43/da6/ff5 zero size 2024-04-25T17:19:25.597 INFO:tasks.workunit.client.1.smithi069.stdout:6/786: truncate d2/d1e/d43/f9e 1437265 0 2024-04-25T17:19:25.601 INFO:tasks.workunit.client.1.smithi069.stdout:8/801: symlink d37/d47/d48/d8e/l115 0 2024-04-25T17:19:25.603 INFO:tasks.workunit.client.1.smithi069.stdout:3/831: write f6 [2628711,93733] 0 2024-04-25T17:19:25.606 INFO:tasks.workunit.client.1.smithi069.stdout:6/787: dread - d2/d9c/f50 zero size 2024-04-25T17:19:25.606 INFO:tasks.workunit.client.1.smithi069.stdout:7/780: write d4/d3e/d94/fd0 [667618,91859] 0 2024-04-25T17:19:25.608 INFO:tasks.workunit.client.1.smithi069.stdout:3/832: dread d8/d16/d1a/d38/f58 [0,4194304] 0 2024-04-25T17:19:25.609 INFO:tasks.workunit.client.1.smithi069.stdout:5/817: link d13/d17/dd4/f103 d13/d17/d19/d96/d9d/f118 0 2024-04-25T17:19:25.611 INFO:tasks.workunit.client.0.smithi037.stdout:6/774: dread db/f12 [0,4194304] 0 2024-04-25T17:19:25.612 INFO:tasks.workunit.client.1.smithi069.stdout:9/747: link d2/da/d14/f79 d2/da/dd/de/db0/f102 0 2024-04-25T17:19:25.612 INFO:tasks.workunit.client.0.smithi037.stdout:6/775: chown db/d26/d2e/d3e/d25/d10d/d113 138922 1 2024-04-25T17:19:25.614 INFO:tasks.workunit.client.0.smithi037.stdout:6/776: chown db/d26/d2e/d3e/d25/d10d/d113/f10a 9036152 1 2024-04-25T17:19:25.614 INFO:tasks.workunit.client.0.smithi037.stdout:6/777: readlink db/d1d/l55 0 2024-04-25T17:19:25.615 INFO:tasks.workunit.client.1.smithi069.stdout:6/788: dread - d2/d1e/d43/dca/fd2 zero size 2024-04-25T17:19:25.618 INFO:tasks.workunit.client.1.smithi069.stdout:3/833: rmdir d8/d71/d8d 39 2024-04-25T17:19:25.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.618+0000 7f095f74e700 1 -- 172.21.15.37:0/2653186990 --> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0958111a60 con 0x7f094406fcb0 2024-04-25T17:19:25.620 INFO:tasks.workunit.client.0.smithi037.stdout:6/778: rename db/d26/d2e/d3e/fb6 to db/d26/d2e/d3e/d102/f11a 0 2024-04-25T17:19:25.623 INFO:tasks.workunit.client.1.smithi069.stdout:8/802: mkdir d37/d116 0 2024-04-25T17:19:25.627 INFO:tasks.workunit.client.1.smithi069.stdout:9/748: creat d2/d51/f103 x:0 0 0 2024-04-25T17:19:25.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.629+0000 7f094dffb700 1 -- 172.21.15.37:0/2653186990 <== mgr.24417 v2:172.21.15.69:6828/2602478 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f0958111a60 con 0x7f094406fcb0 2024-04-25T17:19:25.629 INFO:teuthology.orchestra.run.smithi037.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-25T17:19:25.629 INFO:teuthology.orchestra.run.smithi037.stdout:alertmanager.smithi037 smithi037 *:9093,9094 starting - - - - 2024-04-25T17:19:25.629 INFO:teuthology.orchestra.run.smithi037.stdout:crash.smithi037 smithi037 running (9m) 67s ago 9m 6656k - 17.2.7-902-gc61472c8 0de407c1b3af b3d152574e80 2024-04-25T17:19:25.629 INFO:teuthology.orchestra.run.smithi037.stdout:crash.smithi069 smithi069 running (8m) 71s ago 8m 6660k - 17.2.7-902-gc61472c8 0de407c1b3af aa6086c64cc3 2024-04-25T17:19:25.629 INFO:teuthology.orchestra.run.smithi037.stdout:grafana.smithi037 smithi037 *:3000 starting - - - - 2024-04-25T17:19:25.629 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi037.ksmixc smithi037 running (3m) 67s ago 3m 86.1M - 17.2.7-902-gc61472c8 0de407c1b3af 394aa56079b4 2024-04-25T17:19:25.630 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi037.ovkrpq smithi037 running (3m) 67s ago 3m 52.7M - 17.2.7-902-gc61472c8 0de407c1b3af 73ca662174a7 2024-04-25T17:19:25.630 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi069.cpprst smithi069 running (3m) 71s ago 3m 13.4M - 17.2.7-902-gc61472c8 0de407c1b3af dbda101df20e 2024-04-25T17:19:25.630 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi069.ytlqcf smithi069 running (3m) 71s ago 3m 11.7M - 17.2.7-902-gc61472c8 0de407c1b3af 911df6b18215 2024-04-25T17:19:25.630 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.smithi037.txrgxl smithi037 *:9283 running (10m) 67s ago 10m 322M - 17.2.7-902-gc61472c8 0de407c1b3af 796b326569c2 2024-04-25T17:19:25.630 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.smithi069.mmuhdo smithi069 *:8443,9283 running (99s) 71s ago 8m 558M - 19.0.0-3291-g994e2f20 d53c96779a29 defb664cef69 2024-04-25T17:19:25.630 INFO:teuthology.orchestra.run.smithi037.stdout:mon.smithi037 smithi037 running (10m) 67s ago 10m 46.5M 2048M 17.2.7-902-gc61472c8 0de407c1b3af 5cfadcf8f2e4 2024-04-25T17:19:25.631 INFO:teuthology.orchestra.run.smithi037.stdout:mon.smithi069 smithi069 running (8m) 71s ago 8m 38.6M 2048M 17.2.7-902-gc61472c8 0de407c1b3af ffcd456d1dce 2024-04-25T17:19:25.631 INFO:teuthology.orchestra.run.smithi037.stdout:node-exporter.smithi037 smithi037 *:9100 starting - - - - 2024-04-25T17:19:25.631 INFO:teuthology.orchestra.run.smithi037.stdout:node-exporter.smithi069 smithi069 *:9100 starting - - - - 2024-04-25T17:19:25.631 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0 smithi037 running (7m) 67s ago 7m 80.2M 1559M 17.2.7-902-gc61472c8 0de407c1b3af 8ff4b0f1aae9 2024-04-25T17:19:25.631 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1 smithi037 running (6m) 67s ago 6m 81.3M 1559M 17.2.7-902-gc61472c8 0de407c1b3af 5715a5da241d 2024-04-25T17:19:25.631 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2 smithi037 running (6m) 67s ago 6m 72.4M 1559M 17.2.7-902-gc61472c8 0de407c1b3af 2eedaf9886dd 2024-04-25T17:19:25.631 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3 smithi069 running (6m) 71s ago 6m 79.0M 2581M 17.2.7-902-gc61472c8 0de407c1b3af ebba78fb1923 2024-04-25T17:19:25.631 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4 smithi069 running (5m) 71s ago 5m 80.0M 2581M 17.2.7-902-gc61472c8 0de407c1b3af ba7b785c50f9 2024-04-25T17:19:25.631 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5 smithi069 running (5m) 71s ago 5m 77.2M 2581M 17.2.7-902-gc61472c8 0de407c1b3af f6be99c364ff 2024-04-25T17:19:25.631 INFO:teuthology.orchestra.run.smithi037.stdout:prometheus.smithi037 smithi037 *:9095 starting - - - - 2024-04-25T17:19:25.632 INFO:tasks.workunit.client.0.smithi037.stdout:6/779: mkdir db/d1d/db1/dc7/d11b 0 2024-04-25T17:19:25.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.632+0000 7f095f74e700 1 -- 172.21.15.37:0/2653186990 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f094406fcb0 msgr2=0x7f0944072160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:19:25.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.632+0000 7f095f74e700 1 --2- 172.21.15.37:0/2653186990 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f094406fcb0 0x7f0944072160 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0954007fd0 tx=0x7f0954009040 comp rx=0 tx=0).stop 2024-04-25T17:19:25.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.632+0000 7f095f74e700 1 -- 172.21.15.37:0/2653186990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09581022e0 msgr2=0x7f0958110170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:19:25.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.632+0000 7f095f74e700 1 --2- 172.21.15.37:0/2653186990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09581022e0 0x7f0958110170 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f0948009150 tx=0x7f0948009e30 comp rx=0 tx=0).stop 2024-04-25T17:19:25.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.632+0000 7f095f74e700 1 -- 172.21.15.37:0/2653186990 shutdown_connections 2024-04-25T17:19:25.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.632+0000 7f095f74e700 1 --2- 172.21.15.37:0/2653186990 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f094406fcb0 0x7f0944072160 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:25.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.632+0000 7f095f74e700 1 --2- 172.21.15.37:0/2653186990 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f09580662c0 0x7f095810fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:25.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.632+0000 7f095f74e700 1 --2- 172.21.15.37:0/2653186990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f09581022e0 0x7f0958110170 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:25.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.632+0000 7f095f74e700 1 -- 172.21.15.37:0/2653186990 >> 172.21.15.37:0/2653186990 conn(0x7f09580f7430 msgr2=0x7f09580f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:19:25.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.632+0000 7f095f74e700 1 -- 172.21.15.37:0/2653186990 shutdown_connections 2024-04-25T17:19:25.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.632+0000 7f095f74e700 1 -- 172.21.15.37:0/2653186990 wait complete. 2024-04-25T17:19:25.638 INFO:tasks.workunit.client.1.smithi069.stdout:9/749: chown d2/da/dd/d1e/d40/l53 501368 1 2024-04-25T17:19:25.639 INFO:tasks.workunit.client.1.smithi069.stdout:2/768: dwrite d0/d56/d5f/d62/d7d/d31/f81 [0,4194304] 0 2024-04-25T17:19:25.640 INFO:tasks.workunit.client.0.smithi037.stdout:6/780: dread db/d1d/d20/f5b [0,4194304] 0 2024-04-25T17:19:25.640 INFO:tasks.workunit.client.1.smithi069.stdout:0/693: truncate d0/da/db/d1d/d5f/fbd 3409932 0 2024-04-25T17:19:25.645 INFO:tasks.workunit.client.1.smithi069.stdout:5/818: getdents d13/d17/d19/d8a 0 2024-04-25T17:19:25.646 INFO:tasks.workunit.client.0.smithi037.stdout:7/696: dwrite d5/d15/f1e [0,4194304] 0 2024-04-25T17:19:25.650 INFO:tasks.workunit.client.1.smithi069.stdout:1/771: truncate d1/d43/d1b/d32/d4a/fb7 2413657 0 2024-04-25T17:19:25.653 INFO:tasks.workunit.client.0.smithi037.stdout:7/697: dread d5/d15/d17/d25/f67 [0,4194304] 0 2024-04-25T17:19:25.655 INFO:tasks.workunit.client.1.smithi069.stdout:4/771: write db/d15/d20/d35/d63/d43/d48/f7c [494247,126501] 0 2024-04-25T17:19:25.655 INFO:tasks.workunit.client.0.smithi037.stdout:6/781: chown db/d1d/d20/dcf/dfa/d65/le9 7664 1 2024-04-25T17:19:25.656 INFO:tasks.workunit.client.1.smithi069.stdout:9/750: mkdir d2/da/dd/de/d104 0 2024-04-25T17:19:25.657 INFO:tasks.workunit.client.0.smithi037.stdout:0/852: dwrite d9/d14/d28/d48/db7/fcd [0,4194304] 0 2024-04-25T17:19:25.663 INFO:tasks.workunit.client.1.smithi069.stdout:2/769: mkdir d0/d56/d5f/d62/d7d/d31/df8/dfc 0 2024-04-25T17:19:25.665 INFO:tasks.workunit.client.1.smithi069.stdout:7/781: write d4/d18/f4f [4194119,3200] 0 2024-04-25T17:19:25.666 INFO:tasks.workunit.client.0.smithi037.stdout:0/853: fsync d9/d71/f99 0 2024-04-25T17:19:25.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:25 smithi069 ceph-mon[34527]: pgmap v43: 65 pgs: 65 active+clean; 3.0 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 73 MiB/s rd, 195 MiB/s wr, 405 op/s 2024-04-25T17:19:25.670 INFO:tasks.workunit.client.1.smithi069.stdout:4/772: chown db/d4b/d78/f8b 19443801 1 2024-04-25T17:19:25.671 INFO:tasks.workunit.client.1.smithi069.stdout:4/773: chown db/d4b/d78/dc4/c9c 524045985 1 2024-04-25T17:19:25.672 INFO:tasks.workunit.client.0.smithi037.stdout:6/782: creat db/d1d/db1/dc7/d11b/f11c x:0 0 0 2024-04-25T17:19:25.673 INFO:tasks.workunit.client.0.smithi037.stdout:6/783: write db/d26/d2e/f42 [2211656,67378] 0 2024-04-25T17:19:25.673 INFO:tasks.workunit.client.1.smithi069.stdout:9/751: unlink d2/da/dd/de/d64/dd2/lea 0 2024-04-25T17:19:25.678 INFO:tasks.workunit.client.0.smithi037.stdout:7/698: creat d5/d15/d17/d1b/fec x:0 0 0 2024-04-25T17:19:25.678 INFO:tasks.workunit.client.1.smithi069.stdout:6/789: write d2/d1e/d43/db6/de4/f79 [552561,57725] 0 2024-04-25T17:19:25.679 INFO:tasks.workunit.client.1.smithi069.stdout:6/790: chown d2/d51/fe3 5287 1 2024-04-25T17:19:25.680 INFO:tasks.workunit.client.1.smithi069.stdout:6/791: chown d2/d1e/d43/d7d/f87 11859806 1 2024-04-25T17:19:25.680 INFO:tasks.workunit.client.1.smithi069.stdout:6/792: stat d2/d51/d89/f90 0 2024-04-25T17:19:25.682 INFO:tasks.workunit.client.1.smithi069.stdout:8/803: write d37/d47/d54/fae [457860,106032] 0 2024-04-25T17:19:25.685 INFO:tasks.workunit.client.1.smithi069.stdout:0/694: rmdir d0/da/de2 0 2024-04-25T17:19:25.686 INFO:tasks.workunit.client.0.smithi037.stdout:7/699: dwrite d5/d14/d31/fe7 [0,4194304] 0 2024-04-25T17:19:25.686 INFO:tasks.workunit.client.0.smithi037.stdout:7/700: chown d5/d15/d17 6 1 2024-04-25T17:19:25.691 INFO:tasks.workunit.client.1.smithi069.stdout:0/695: dwrite d0/da/db/fe [0,4194304] 0 2024-04-25T17:19:25.692 INFO:tasks.workunit.client.1.smithi069.stdout:0/696: chown d0/da/db/d2a/d8c 119 1 2024-04-25T17:19:25.693 INFO:tasks.workunit.client.1.smithi069.stdout:1/772: mkdir d1/d4/d6/d9e/da6/df0 0 2024-04-25T17:19:25.693 INFO:tasks.workunit.client.1.smithi069.stdout:1/773: dread - d1/d4/de/f99 zero size 2024-04-25T17:19:25.694 INFO:tasks.workunit.client.0.smithi037.stdout:7/701: creat d5/d15/d17/d9d/fed x:0 0 0 2024-04-25T17:19:25.695 INFO:tasks.workunit.client.0.smithi037.stdout:7/702: chown d5/d15/d17/d1b/c6d 13231377 1 2024-04-25T17:19:25.696 INFO:tasks.workunit.client.0.smithi037.stdout:4/981: sync 2024-04-25T17:19:25.696 INFO:tasks.workunit.client.0.smithi037.stdout:8/724: sync 2024-04-25T17:19:25.704 INFO:tasks.workunit.client.1.smithi069.stdout:4/774: rename db/d15/d82/da7/fe4 to db/d15/d82/df4/f112 0 2024-04-25T17:19:25.705 INFO:tasks.workunit.client.0.smithi037.stdout:8/725: dwrite d5/db/d59/f5f [0,4194304] 0 2024-04-25T17:19:25.708 INFO:tasks.workunit.client.1.smithi069.stdout:3/834: sync 2024-04-25T17:19:25.716 INFO:tasks.workunit.client.1.smithi069.stdout:2/770: mkdir d0/dfd 0 2024-04-25T17:19:25.717 INFO:tasks.workunit.client.1.smithi069.stdout:5/819: truncate d13/d17/d19/d20/f77 2169562 0 2024-04-25T17:19:25.717 INFO:tasks.workunit.client.0.smithi037.stdout:7/703: dread d5/d15/d17/d1b/da2/d76/fb3 [0,4194304] 0 2024-04-25T17:19:25.718 INFO:tasks.workunit.client.1.smithi069.stdout:2/771: write d0/d1/d5b/d33/f39 [4154236,120741] 0 2024-04-25T17:19:25.723 INFO:tasks.workunit.client.0.smithi037.stdout:8/726: mkdir d5/db/d23/d78/d9c/ded 0 2024-04-25T17:19:25.726 INFO:tasks.workunit.client.0.smithi037.stdout:4/982: truncate d7/d67/d118/d145/d4e/da5/ff2 1320093 0 2024-04-25T17:19:25.727 INFO:tasks.workunit.client.1.smithi069.stdout:1/774: mknod d1/d4/d6/d81/cf1 0 2024-04-25T17:19:25.732 INFO:tasks.workunit.client.1.smithi069.stdout:7/782: dwrite d4/d3e/d94/da1/dc7/d14/d15/f63 [4194304,4194304] 0 2024-04-25T17:19:25.735 INFO:tasks.workunit.client.1.smithi069.stdout:6/793: write d2/d1e/d3f/d56/fbd [384987,108530] 0 2024-04-25T17:19:25.737 INFO:tasks.workunit.client.0.smithi037.stdout:6/784: dwrite db/d1d/d20/dcf/dfa/d65/d68/d87/dbd/fc4 [0,4194304] 0 2024-04-25T17:19:25.747 INFO:tasks.workunit.client.0.smithi037.stdout:6/785: dwrite db/d26/d2e/d3e/d25/d10d/d113/f10a [0,4194304] 0 2024-04-25T17:19:25.748 INFO:tasks.workunit.client.1.smithi069.stdout:0/697: mkdir d0/da/db/def 0 2024-04-25T17:19:25.765 INFO:tasks.workunit.client.0.smithi037.stdout:4/983: dwrite d7/d78/f116 [0,4194304] 0 2024-04-25T17:19:25.768 INFO:tasks.workunit.client.1.smithi069.stdout:7/783: symlink d4/d83/l109 0 2024-04-25T17:19:25.775 INFO:tasks.workunit.client.0.smithi037.stdout:6/786: write db/d1d/d20/dcf/dfa/d65/d68/d87/fc3 [413568,122245] 0 2024-04-25T17:19:25.776 INFO:tasks.workunit.client.0.smithi037.stdout:6/787: dread - db/d26/fe6 zero size 2024-04-25T17:19:25.780 INFO:tasks.workunit.client.0.smithi037.stdout:4/984: rename d7/f1a to d7/d67/d118/d145/d5b/f146 0 2024-04-25T17:19:25.783 INFO:tasks.workunit.client.1.smithi069.stdout:9/752: rename d2/da4/fbd to d2/da/dd/d1e/d2e/d68/dba/f105 0 2024-04-25T17:19:25.787 INFO:tasks.workunit.client.1.smithi069.stdout:6/794: dwrite d2/d9c/d48/f5d [0,4194304] 0 2024-04-25T17:19:25.788 INFO:tasks.workunit.client.1.smithi069.stdout:6/795: read - d2/d51/d85/faa zero size 2024-04-25T17:19:25.789 INFO:tasks.workunit.client.0.smithi037.stdout:4/985: fsync d7/f49 0 2024-04-25T17:19:25.793 INFO:tasks.workunit.client.1.smithi069.stdout:5/820: sync 2024-04-25T17:19:25.793 INFO:tasks.workunit.client.0.smithi037.stdout:6/788: rename db/d1d/d20/dcf/dfa/fa8 to db/d1d/d20/dcf/dfa/d65/d8b/dee/f11d 0 2024-04-25T17:19:25.795 INFO:tasks.workunit.client.1.smithi069.stdout:4/775: creat db/d15/f113 x:0 0 0 2024-04-25T17:19:25.799 INFO:tasks.workunit.client.1.smithi069.stdout:3/835: dread d8/d71/d8d/d92/db6/dc1/fa3 [4194304,4194304] 0 2024-04-25T17:19:25.800 INFO:tasks.workunit.client.1.smithi069.stdout:1/775: truncate d1/d4/d6/d9e/da6/fd2 4715877 0 2024-04-25T17:19:25.802 INFO:tasks.workunit.client.1.smithi069.stdout:7/784: fdatasync d4/d1a/f24 0 2024-04-25T17:19:25.803 INFO:tasks.workunit.client.0.smithi037.stdout:6/789: rename db/d26/d2e/f42 to db/d1d/d20/dcf/dd5/f11e 0 2024-04-25T17:19:25.804 INFO:tasks.workunit.client.1.smithi069.stdout:8/804: getdents d37/d47/d54/dcc 0 2024-04-25T17:19:25.808 INFO:tasks.workunit.client.1.smithi069.stdout:0/698: symlink d0/da/db/lf0 0 2024-04-25T17:19:25.809 INFO:tasks.workunit.client.1.smithi069.stdout:0/699: stat d0/da/d24/d43/f60 0 2024-04-25T17:19:25.810 INFO:tasks.workunit.client.0.smithi037.stdout:4/986: dread d7/d78/fe2 [0,4194304] 0 2024-04-25T17:19:25.811 INFO:tasks.workunit.client.1.smithi069.stdout:9/753: mkdir d2/da/dd/de/d74/d106 0 2024-04-25T17:19:25.817 INFO:tasks.workunit.client.1.smithi069.stdout:5/821: mknod d13/d17/d19/d1c/da4/da9/c119 0 2024-04-25T17:19:25.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.817+0000 7fe8a7973700 1 -- 172.21.15.37:0/3442947511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8a00fcf70 msgr2=0x7fe8a00fd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:19:25.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.817+0000 7fe8a7973700 1 --2- 172.21.15.37:0/3442947511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8a00fcf70 0x7fe8a00fd3e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe890004940 tx=0x7fe890009e30 comp rx=0 tx=0).stop 2024-04-25T17:19:25.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.817+0000 7fe8a7973700 1 -- 172.21.15.37:0/3442947511 shutdown_connections 2024-04-25T17:19:25.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.817+0000 7fe8a7973700 1 --2- 172.21.15.37:0/3442947511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8a00fcf70 0x7fe8a00fd3e0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:25.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.817+0000 7fe8a7973700 1 --2- 172.21.15.37:0/3442947511 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe8a00fbcc0 0x7fe8a00fc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:25.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.817+0000 7fe8a7973700 1 -- 172.21.15.37:0/3442947511 >> 172.21.15.37:0/3442947511 conn(0x7fe8a00f7420 msgr2=0x7fe8a00f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:19:25.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.817+0000 7fe8a7973700 1 -- 172.21.15.37:0/3442947511 shutdown_connections 2024-04-25T17:19:25.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.817+0000 7fe8a7973700 1 -- 172.21.15.37:0/3442947511 wait complete. 2024-04-25T17:19:25.819 INFO:tasks.workunit.client.1.smithi069.stdout:5/822: chown d13/d17/d62/fcb 5713 1 2024-04-25T17:19:25.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.818+0000 7fe8a7973700 1 Processor -- start 2024-04-25T17:19:25.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.818+0000 7fe8a7973700 1 -- start start 2024-04-25T17:19:25.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.818+0000 7fe8a7973700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8a00fbcc0 0x7fe8a010c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:19:25.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.818+0000 7fe8a7973700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe8a00fcf70 0x7fe8a010cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:19:25.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.818+0000 7fe8a7973700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a010d3c0 con 0x7fe8a00fbcc0 2024-04-25T17:19:25.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.818+0000 7fe8a7973700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8a010dc10 con 0x7fe8a00fcf70 2024-04-25T17:19:25.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.818+0000 7fe8a570f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8a00fbcc0 0x7fe8a010c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:19:25.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.818+0000 7fe8a570f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8a00fbcc0 0x7fe8a010c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49610/0 (socket says 172.21.15.37:49610) 2024-04-25T17:19:25.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.818+0000 7fe8a570f700 1 -- 172.21.15.37:0/3900068193 learned_addr learned my addr 172.21.15.37:0/3900068193 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:19:25.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.819+0000 7fe8a4f0e700 1 --2- 172.21.15.37:0/3900068193 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe8a00fcf70 0x7fe8a010cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:19:25.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.819+0000 7fe8a570f700 1 -- 172.21.15.37:0/3900068193 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe8a00fcf70 msgr2=0x7fe8a010cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:19:25.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.819+0000 7fe8a570f700 1 --2- 172.21.15.37:0/3900068193 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe8a00fcf70 0x7fe8a010cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:25.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.819+0000 7fe8a570f700 1 -- 172.21.15.37:0/3900068193 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe890005040 con 0x7fe8a00fbcc0 2024-04-25T17:19:25.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.819+0000 7fe8a570f700 1 --2- 172.21.15.37:0/3900068193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8a00fbcc0 0x7fe8a010c880 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe89c00eb40 tx=0x7fe89c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:19:25.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.819+0000 7fe895ffb700 1 -- 172.21.15.37:0/3900068193 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe89c007cc0 con 0x7fe8a00fbcc0 2024-04-25T17:19:25.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.819+0000 7fe8a7973700 1 -- 172.21.15.37:0/3900068193 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8a010de90 con 0x7fe8a00fbcc0 2024-04-25T17:19:25.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.820+0000 7fe895ffb700 1 -- 172.21.15.37:0/3900068193 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe89c00f040 con 0x7fe8a00fbcc0 2024-04-25T17:19:25.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.820+0000 7fe895ffb700 1 -- 172.21.15.37:0/3900068193 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe89c00ca10 con 0x7fe8a00fbcc0 2024-04-25T17:19:25.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.820+0000 7fe8a7973700 1 -- 172.21.15.37:0/3900068193 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8a010e3d0 con 0x7fe8a00fbcc0 2024-04-25T17:19:25.823 INFO:tasks.workunit.client.1.smithi069.stdout:7/785: dread d4/d3e/d94/da1/dc7/d14/faa [0,4194304] 0 2024-04-25T17:19:25.823 INFO:tasks.workunit.client.1.smithi069.stdout:7/786: read d4/d3e/d94/da1/dc7/d14/d3d/f69 [2658848,60015] 0 2024-04-25T17:19:25.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.821+0000 7fe8a7973700 1 -- 172.21.15.37:0/3900068193 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8a005f5c0 con 0x7fe8a00fbcc0 2024-04-25T17:19:25.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.822+0000 7fe895ffb700 1 -- 172.21.15.37:0/3900068193 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) v1 ==== 92608+0+0 (secure 0 0 0) 0x7fe89c00cb70 con 0x7fe8a00fbcc0 2024-04-25T17:19:25.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.822+0000 7fe895ffb700 1 --2- 172.21.15.37:0/3900068193 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7fe88c0740c0 0x7fe88c076570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:19:25.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.822+0000 7fe895ffb700 1 -- 172.21.15.37:0/3900068193 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fe89c08f2d0 con 0x7fe8a00fbcc0 2024-04-25T17:19:25.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.822+0000 7fe8a4f0e700 1 --2- 172.21.15.37:0/3900068193 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7fe88c0740c0 0x7fe88c076570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:19:25.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.823+0000 7fe8a4f0e700 1 --2- 172.21.15.37:0/3900068193 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7fe88c0740c0 0x7fe88c076570 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe89000b0d0 tx=0x7fe890009e30 comp rx=0 tx=0).ready entity=mgr.24417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:19:25.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:25.830+0000 7fe895ffb700 1 -- 172.21.15.37:0/3900068193 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7fe89c050930 con 0x7fe8a00fbcc0 2024-04-25T17:19:25.833 INFO:tasks.workunit.client.1.smithi069.stdout:2/772: getdents d0/d56/d5f/d62 0 2024-04-25T17:19:25.836 INFO:tasks.workunit.client.1.smithi069.stdout:0/700: mkdir d0/d17/d83/dcf/df1 0 2024-04-25T17:19:25.837 INFO:tasks.workunit.client.1.smithi069.stdout:6/796: dwrite d2/f63 [0,4194304] 0 2024-04-25T17:19:25.842 INFO:tasks.workunit.client.1.smithi069.stdout:7/787: creat d4/d3e/d94/da1/dc7/d14/d15/f10a x:0 0 0 2024-04-25T17:19:25.845 INFO:tasks.workunit.client.1.smithi069.stdout:8/805: dread d37/d47/d78/d93/f94 [0,4194304] 0 2024-04-25T17:19:25.845 INFO:tasks.workunit.client.1.smithi069.stdout:0/701: dwrite d0/da/d24/d43/f57 [4194304,4194304] 0 2024-04-25T17:19:25.850 INFO:tasks.workunit.client.1.smithi069.stdout:7/788: dwrite d4/d3e/d94/da1/dc7/f92 [0,4194304] 0 2024-04-25T17:19:25.856 INFO:tasks.workunit.client.1.smithi069.stdout:6/797: mknod d2/d51/d85/c10a 0 2024-04-25T17:19:25.857 INFO:tasks.workunit.client.1.smithi069.stdout:5/823: write d13/d17/f4a [3898926,43320] 0 2024-04-25T17:19:25.860 INFO:tasks.workunit.client.1.smithi069.stdout:9/754: dwrite d2/da4/dcf/d65/f87 [0,4194304] 0 2024-04-25T17:19:25.863 INFO:tasks.workunit.client.1.smithi069.stdout:4/776: rename db/d15/d20/d35/d63/ff5 to db/d15/f114 0 2024-04-25T17:19:25.865 INFO:tasks.workunit.client.1.smithi069.stdout:9/755: read d2/da/dd/f5d [2718654,98632] 0 2024-04-25T17:19:25.877 INFO:tasks.workunit.client.1.smithi069.stdout:5/824: read d13/d17/da5/fab [193751,89467] 0 2024-04-25T17:19:25.877 INFO:tasks.workunit.client.1.smithi069.stdout:5/825: chown d13/d17/d19/d1c/da4/da9/lc0 27429 1 2024-04-25T17:19:25.880 INFO:tasks.workunit.client.1.smithi069.stdout:3/836: rename d8/d16/f27 to d8/d71/d8d/d92/db6/dc1/d42/f118 0 2024-04-25T17:19:25.884 INFO:tasks.workunit.client.1.smithi069.stdout:1/776: getdents d1/d4/d6/d81 0 2024-04-25T17:19:25.886 INFO:tasks.workunit.client.0.smithi037.stdout:6/790: chown db/d1d/d20/fac 158563726 1 2024-04-25T17:19:25.890 INFO:tasks.workunit.client.1.smithi069.stdout:1/777: dwrite d1/d4/de/f91 [4194304,4194304] 0 2024-04-25T17:19:25.892 INFO:tasks.workunit.client.1.smithi069.stdout:0/702: getdents d0/da/db/d1d/d5f 0 2024-04-25T17:19:25.893 INFO:tasks.workunit.client.1.smithi069.stdout:0/703: chown d0/d17/d83 0 1 2024-04-25T17:19:25.898 INFO:tasks.workunit.client.1.smithi069.stdout:2/773: truncate d0/d1/d5b/d33/f39 825319 0 2024-04-25T17:19:25.898 INFO:tasks.workunit.client.1.smithi069.stdout:2/774: stat d0/d1/d5b/f32 0 2024-04-25T17:19:25.900 INFO:tasks.workunit.client.1.smithi069.stdout:6/798: write d2/fe [2923431,14337] 0 2024-04-25T17:19:25.905 INFO:tasks.workunit.client.1.smithi069.stdout:6/799: dwrite d2/d1e/d3f/d56/fbd [0,4194304] 0 2024-04-25T17:19:25.912 INFO:tasks.workunit.client.1.smithi069.stdout:4/777: write db/d15/d20/d35/f8c [1270708,125462] 0 2024-04-25T17:19:25.913 INFO:tasks.workunit.client.1.smithi069.stdout:4/778: fsync db/d15/d20/d35/d63/d70/d8a/d96/dbf/fc8 0 2024-04-25T17:19:25.916 INFO:tasks.workunit.client.0.smithi037.stdout:4/987: write d7/d67/d118/d145/d1e/d2b/f75 [138445,98907] 0 2024-04-25T17:19:25.918 INFO:tasks.workunit.client.0.smithi037.stdout:6/791: write db/d26/d2e/d3e/f9d [573917,44176] 0 2024-04-25T17:19:25.919 INFO:tasks.workunit.client.0.smithi037.stdout:6/792: fdatasync db/d26/d2e/d3e/f34 0 2024-04-25T17:19:25.919 INFO:tasks.workunit.client.1.smithi069.stdout:9/756: dwrite d2/da/d5f/fae [0,4194304] 0 2024-04-25T17:19:25.920 INFO:tasks.workunit.client.0.smithi037.stdout:4/988: chown d7/d67/d118/d145/d5b/dfe/c6e 0 1 2024-04-25T17:19:25.922 INFO:tasks.workunit.client.1.smithi069.stdout:8/806: dwrite f34 [4194304,4194304] 0 2024-04-25T17:19:25.923 INFO:tasks.workunit.client.1.smithi069.stdout:8/807: stat d37/d47/d54/d6e/d9e/cd5 0 2024-04-25T17:19:25.925 INFO:tasks.workunit.client.1.smithi069.stdout:8/808: fdatasync d37/d47/d78/db3/d114/d6b/fc2 0 2024-04-25T17:19:25.928 INFO:tasks.workunit.client.0.smithi037.stdout:4/989: dwrite d7/d67/d118/d145/d1e/d70/d84/dc9/f13b [0,4194304] 0 2024-04-25T17:19:25.938 INFO:tasks.workunit.client.0.smithi037.stdout:1/913: sync 2024-04-25T17:19:25.938 INFO:tasks.workunit.client.0.smithi037.stdout:2/875: sync 2024-04-25T17:19:25.938 INFO:tasks.workunit.client.0.smithi037.stdout:3/683: sync 2024-04-25T17:19:25.939 INFO:tasks.workunit.client.0.smithi037.stdout:5/832: sync 2024-04-25T17:19:25.941 INFO:tasks.workunit.client.0.smithi037.stdout:4/990: creat d7/d67/d118/d145/d1e/d70/d84/f147 x:0 0 0 2024-04-25T17:19:25.941 INFO:tasks.workunit.client.0.smithi037.stdout:5/833: read d7/d12/d5d/f80 [955773,83565] 0 2024-04-25T17:19:25.943 INFO:tasks.workunit.client.0.smithi037.stdout:4/991: stat d7/d67/d118/d145/d5b/dfe/d39/d83/c139 0 2024-04-25T17:19:25.944 INFO:tasks.workunit.client.0.smithi037.stdout:4/992: chown d7/d67/d118/d145/d4e/da5 720591 1 2024-04-25T17:19:25.946 INFO:tasks.workunit.client.0.smithi037.stdout:2/876: creat d0/d16/d3c/f112 x:0 0 0 2024-04-25T17:19:25.946 INFO:tasks.workunit.client.0.smithi037.stdout:4/993: chown d7/d67/d118/d145/d1e/d70/d84/ddf/df0/c114 106351 1 2024-04-25T17:19:25.947 INFO:tasks.workunit.client.0.smithi037.stdout:3/684: symlink d8/d23/dbb/ld5 0 2024-04-25T17:19:25.948 INFO:tasks.workunit.client.1.smithi069.stdout:5/826: rmdir d13/dff/d10d 39 2024-04-25T17:19:25.949 INFO:tasks.workunit.client.0.smithi037.stdout:3/685: stat d8/d23/dbb/d5d/l55 0 2024-04-25T17:19:25.953 INFO:tasks.workunit.client.0.smithi037.stdout:2/877: unlink d0/ld3 0 2024-04-25T17:19:25.955 INFO:tasks.workunit.client.0.smithi037.stdout:3/686: mknod d8/d31/d32/d3e/cd6 0 2024-04-25T17:19:25.959 INFO:tasks.workunit.client.0.smithi037.stdout:4/994: fdatasync d7/d67/d118/d145/d5b/dfe/d39/d9c/da3/f128 0 2024-04-25T17:19:25.961 INFO:tasks.workunit.client.0.smithi037.stdout:5/834: mknod d7/d18/d62/dd8/cfe 0 2024-04-25T17:19:25.963 INFO:tasks.workunit.client.1.smithi069.stdout:0/704: readlink d0/da/d24/l51 0 2024-04-25T17:19:25.964 INFO:tasks.workunit.client.0.smithi037.stdout:4/995: dread d7/d67/d118/d145/d1e/f93 [0,4194304] 0 2024-04-25T17:19:25.964 INFO:tasks.workunit.client.0.smithi037.stdout:1/914: dread dc/d52/d6b/dd9/d22/d36/d92/fc8 [0,4194304] 0 2024-04-25T17:19:25.972 INFO:tasks.workunit.client.0.smithi037.stdout:6/793: dwrite db/d1d/d20/fac [0,4194304] 0 2024-04-25T17:19:25.973 INFO:tasks.workunit.client.0.smithi037.stdout:2/878: symlink d0/d16/d20/d55/dd1/l113 0 2024-04-25T17:19:25.979 INFO:tasks.workunit.client.0.smithi037.stdout:4/996: mkdir d7/d67/d118/d145/d5b/dfe/d39/d7a/d148 0 2024-04-25T17:19:25.981 INFO:tasks.workunit.client.1.smithi069.stdout:5/827: rename f5 to d13/d17/d62/f11a 0 2024-04-25T17:19:25.985 INFO:tasks.workunit.client.0.smithi037.stdout:2/879: creat d0/d7c/dee/f114 x:0 0 0 2024-04-25T17:19:25.987 INFO:tasks.workunit.client.1.smithi069.stdout:0/705: symlink d0/da/d6e/lf2 0 2024-04-25T17:19:25.988 INFO:tasks.workunit.client.0.smithi037.stdout:5/835: rename d7/d18/d62/f7e to d7/d18/fff 0 2024-04-25T17:19:25.989 INFO:tasks.workunit.client.1.smithi069.stdout:7/789: getdents d4/d3e/d94/da1/dc7/d14/d44/d79 0 2024-04-25T17:19:25.993 INFO:tasks.workunit.client.1.smithi069.stdout:1/778: sync 2024-04-25T17:19:25.996 INFO:tasks.workunit.client.0.smithi037.stdout:4/997: rename d7/d67/d118/d145/d1e/d2b/f42 to d7/d67/d118/d145/d1e/d70/d84/f149 0 2024-04-25T17:19:26.000 INFO:tasks.workunit.client.1.smithi069.stdout:0/706: creat d0/da/d54/d7d/d8e/ff3 x:0 0 0 2024-04-25T17:19:26.001 INFO:tasks.workunit.client.0.smithi037.stdout:6/794: link db/d1d/db1/led db/d1d/d20/dcf/dfa/d65/d68/d87/dfb/l11f 0 2024-04-25T17:19:26.001 INFO:tasks.workunit.client.1.smithi069.stdout:4/779: dread db/d15/d26/f29 [4194304,4194304] 0 2024-04-25T17:19:26.003 INFO:tasks.workunit.client.0.smithi037.stdout:1/915: dread dc/d52/d6b/f9a [0,4194304] 0 2024-04-25T17:19:26.004 INFO:tasks.workunit.client.1.smithi069.stdout:6/800: link d2/d9c/d97/lae d2/d7/dbc/l10b 0 2024-04-25T17:19:26.005 INFO:tasks.workunit.client.1.smithi069.stdout:5/828: dread d13/d17/d19/f25 [0,4194304] 0 2024-04-25T17:19:26.007 INFO:tasks.workunit.client.1.smithi069.stdout:1/779: symlink d1/df/d17/lf2 0 2024-04-25T17:19:26.008 INFO:tasks.workunit.client.0.smithi037.stdout:4/998: mkdir d7/d67/d118/d145/d1e/dae/d14a 0 2024-04-25T17:19:26.012 INFO:tasks.workunit.client.1.smithi069.stdout:4/780: fdatasync db/d4b/d78/dc4/f2d 0 2024-04-25T17:19:26.013 INFO:tasks.workunit.client.1.smithi069.stdout:4/781: readlink db/d15/d20/d35/d63/d70/d8a/lf1 0 2024-04-25T17:19:26.014 INFO:tasks.workunit.client.1.smithi069.stdout:2/775: dwrite d0/d56/d5f/d62/d7d/d72/daf/dc2/f85 [0,4194304] 0 2024-04-25T17:19:26.015 INFO:tasks.workunit.client.1.smithi069.stdout:2/776: chown d0/d56/d5f/lb7 30183340 1 2024-04-25T17:19:26.018 INFO:tasks.workunit.client.1.smithi069.stdout:7/790: creat d4/d3e/d94/da1/dc7/d14/d5a/d5e/d89/d103/f10b x:0 0 0 2024-04-25T17:19:26.022 INFO:tasks.workunit.client.0.smithi037.stdout:1/916: creat dc/d52/d6b/dd9/d4d/d6a/d8f/ddc/dee/dfc/f13c x:0 0 0 2024-04-25T17:19:26.023 INFO:tasks.workunit.client.1.smithi069.stdout:5/829: rename d13/d17/fbb to d13/d17/d29/d30/d5c/f11b 0 2024-04-25T17:19:26.025 INFO:tasks.workunit.client.0.smithi037.stdout:4/999: unlink d7/d67/d118/d145/d5b/dfe/d39/d7a/ffc 0 2024-04-25T17:19:26.028 INFO:tasks.workunit.client.1.smithi069.stdout:3/837: truncate d8/d71/d8d/d92/db6/dc1/f7f 518637 0 2024-04-25T17:19:26.033 INFO:tasks.workunit.client.1.smithi069.stdout:4/782: truncate db/d15/d42/d64/f67 6517521 0 2024-04-25T17:19:26.035 INFO:tasks.workunit.client.0.smithi037.stdout:1/917: symlink dc/d18/l13d 0 2024-04-25T17:19:26.039 INFO:tasks.workunit.client.1.smithi069.stdout:7/791: creat d4/d3e/d94/da1/dc7/d14/d3d/d5d/f10c x:0 0 0 2024-04-25T17:19:26.040 INFO:tasks.workunit.client.1.smithi069.stdout:7/792: dread - d4/d3e/dc8/fe1 zero size 2024-04-25T17:19:26.040 INFO:tasks.workunit.client.0.smithi037.stdout:2/880: dwrite d0/fa2 [0,4194304] 0 2024-04-25T17:19:26.042 INFO:tasks.workunit.client.0.smithi037.stdout:1/918: dwrite dc/d24/f5e [0,4194304] 0 2024-04-25T17:19:26.044 INFO:tasks.workunit.client.0.smithi037.stdout:1/919: stat dc/d52/d6b/dd9/d4d/d6a/d86/d91 0 2024-04-25T17:19:26.044 INFO:tasks.workunit.client.0.smithi037.stdout:2/881: read d0/d16/d20/d59/d6a/da5/ff0 [3083055,294] 0 2024-04-25T17:19:26.046 INFO:tasks.workunit.client.1.smithi069.stdout:1/780: truncate d1/d4/d6/f31 4174097 0 2024-04-25T17:19:26.046 INFO:tasks.workunit.client.1.smithi069.stdout:3/838: dread d8/d16/d1a/d2c/d49/f68 [0,4194304] 0 2024-04-25T17:19:26.046 INFO:tasks.workunit.client.0.smithi037.stdout:5/836: write d7/f5c [2112448,114311] 0 2024-04-25T17:19:26.047 INFO:tasks.workunit.client.1.smithi069.stdout:3/839: stat d8/d16/d4b/d9e/cc5 0 2024-04-25T17:19:26.055 INFO:tasks.workunit.client.1.smithi069.stdout:4/783: rename db/d15/d20/d35/l9a to db/d15/d20/d35/d63/d43/d48/d49/d72/deb/l115 0 2024-04-25T17:19:26.061 INFO:tasks.workunit.client.1.smithi069.stdout:2/777: mknod d0/d56/d5f/d62/d7d/d72/daf/dc2/cfe 0 2024-04-25T17:19:26.062 INFO:tasks.workunit.client.1.smithi069.stdout:4/784: dwrite db/de3/f110 [0,4194304] 0 2024-04-25T17:19:26.062 INFO:tasks.workunit.client.1.smithi069.stdout:2/778: chown d0/d56/d5f/d62/f73 776447533 1 2024-04-25T17:19:26.063 INFO:tasks.workunit.client.0.smithi037.stdout:5/837: write d7/d63/fe2 [4131753,15607] 0 2024-04-25T17:19:26.065 INFO:tasks.workunit.client.0.smithi037.stdout:6/795: write db/d26/d2e/d3e/f2c [2167034,24684] 0 2024-04-25T17:19:26.070 INFO:tasks.workunit.client.0.smithi037.stdout:6/796: dread db/d26/d2e/d3e/ff3 [0,4194304] 0 2024-04-25T17:19:26.070 INFO:tasks.workunit.client.1.smithi069.stdout:1/781: symlink d1/df/d17/lf3 0 2024-04-25T17:19:26.074 INFO:tasks.workunit.client.1.smithi069.stdout:1/782: dread d1/d4/d6/d9e/da6/d38/f90 [0,4194304] 0 2024-04-25T17:19:26.076 INFO:tasks.workunit.client.0.smithi037.stdout:2/882: creat d0/d16/d20/d59/d6a/da5/dbd/dd6/f115 x:0 0 0 2024-04-25T17:19:26.082 INFO:tasks.workunit.client.0.smithi037.stdout:1/920: creat dc/d52/d6b/dd9/d22/d36/f13e x:0 0 0 2024-04-25T17:19:26.083 INFO:tasks.workunit.client.0.smithi037.stdout:5/838: dread d7/da1/dbb/fc0 [0,4194304] 0 2024-04-25T17:19:26.083 INFO:tasks.workunit.client.0.smithi037.stdout:6/797: creat db/d53/f120 x:0 0 0 2024-04-25T17:19:26.085 INFO:tasks.workunit.client.1.smithi069.stdout:4/785: mkdir db/d15/d20/d35/d63/d43/d48/d49/d4e/d116 0 2024-04-25T17:19:26.085 INFO:tasks.workunit.client.0.smithi037.stdout:5/839: truncate d7/d63/db2/fe4 3025 0 2024-04-25T17:19:26.087 INFO:tasks.workunit.client.1.smithi069.stdout:5/830: link d13/d17/d19/d1c/c35 d13/d17/d29/d2e/c11c 0 2024-04-25T17:19:26.089 INFO:tasks.workunit.client.1.smithi069.stdout:5/831: write d13/d17/d19/d1c/d79/fe6 [2580344,9423] 0 2024-04-25T17:19:26.090 INFO:tasks.workunit.client.1.smithi069.stdout:7/793: creat d4/d83/da2/ded/f10d x:0 0 0 2024-04-25T17:19:26.092 INFO:tasks.workunit.client.0.smithi037.stdout:1/921: symlink dc/d52/d6b/dd9/d22/d36/d74/daf/l13f 0 2024-04-25T17:19:26.092 INFO:tasks.workunit.client.1.smithi069.stdout:9/757: sync 2024-04-25T17:19:26.095 INFO:tasks.workunit.client.0.smithi037.stdout:6/798: creat db/d26/d2e/d3e/d25/d10b/d10e/f121 x:0 0 0 2024-04-25T17:19:26.098 INFO:tasks.workunit.client.1.smithi069.stdout:2/779: symlink d0/lff 0 2024-04-25T17:19:26.098 INFO:tasks.workunit.client.1.smithi069.stdout:2/780: fsync d0/d26/d10/f49 0 2024-04-25T17:19:26.102 INFO:tasks.workunit.client.1.smithi069.stdout:5/832: creat d13/d17/d19/d96/f11d x:0 0 0 2024-04-25T17:19:26.103 INFO:tasks.workunit.client.1.smithi069.stdout:5/833: readlink d13/l90 0 2024-04-25T17:19:26.103 INFO:tasks.workunit.client.0.smithi037.stdout:6/799: mkdir db/d1d/db1/d122 0 2024-04-25T17:19:26.105 INFO:tasks.workunit.client.1.smithi069.stdout:7/794: symlink d4/d83/da2/ded/l10e 0 2024-04-25T17:19:26.105 INFO:tasks.workunit.client.1.smithi069.stdout:7/795: read - d4/d83/da2/ded/f10d zero size 2024-04-25T17:19:26.109 INFO:tasks.workunit.client.0.smithi037.stdout:6/800: rename db/d26/d2e/d3e/d25/d10d/d113 to db/d1d/db1/dc7/d11b/d123 0 2024-04-25T17:19:26.110 INFO:tasks.workunit.client.1.smithi069.stdout:7/796: dwrite d4/d1a/f102 [0,4194304] 0 2024-04-25T17:19:26.114 INFO:tasks.workunit.client.0.smithi037.stdout:6/801: mkdir db/d26/d2e/d3e/d25/d10d/d124 0 2024-04-25T17:19:26.116 INFO:tasks.workunit.client.0.smithi037.stdout:5/840: getdents d7/d12/d5d 0 2024-04-25T17:19:26.121 INFO:tasks.workunit.client.0.smithi037.stdout:6/802: creat db/d1d/d20/dcf/dfa/d65/d8b/f125 x:0 0 0 2024-04-25T17:19:26.125 INFO:tasks.workunit.client.0.smithi037.stdout:5/841: truncate d7/f49 28963 0 2024-04-25T17:19:26.125 INFO:tasks.workunit.client.1.smithi069.stdout:2/781: dread d0/d26/f2f [0,4194304] 0 2024-04-25T17:19:26.126 INFO:tasks.workunit.client.1.smithi069.stdout:2/782: chown d0/d56/d5f/d62/d7d/fe8 4 1 2024-04-25T17:19:26.130 INFO:tasks.workunit.client.1.smithi069.stdout:7/797: unlink d4/d3e/d94/da1/dc7/d14/d5a/d5e/d89/c8e 0 2024-04-25T17:19:26.131 INFO:tasks.workunit.client.0.smithi037.stdout:2/883: write d0/d23/dac/d4b/ded/df4/ffa [955293,103132] 0 2024-04-25T17:19:26.132 INFO:tasks.workunit.client.0.smithi037.stdout:2/884: write d0/d16/d20/db9/fe0 [567490,70476] 0 2024-04-25T17:19:26.133 INFO:tasks.workunit.client.1.smithi069.stdout:4/786: rmdir db/d15/d20/d35/d63/d75/d10b 0 2024-04-25T17:19:26.134 INFO:tasks.workunit.client.1.smithi069.stdout:4/787: dread - db/d22/fe0 zero size 2024-04-25T17:19:26.137 INFO:tasks.workunit.client.1.smithi069.stdout:5/834: truncate d13/d17/d19/d1c/d6c/f98 64075 0 2024-04-25T17:19:26.137 INFO:tasks.workunit.client.1.smithi069.stdout:5/835: fdatasync d13/d17/f7f 0 2024-04-25T17:19:26.142 INFO:tasks.workunit.client.1.smithi069.stdout:2/783: mknod d0/d26/d36/db9/dc8/c100 0 2024-04-25T17:19:26.143 INFO:tasks.workunit.client.1.smithi069.stdout:2/784: chown d0/d56/d5f/fb0 10981 1 2024-04-25T17:19:26.147 INFO:tasks.workunit.client.1.smithi069.stdout:2/785: dwrite d0/d1/fe [0,4194304] 0 2024-04-25T17:19:26.149 INFO:tasks.workunit.client.1.smithi069.stdout:3/840: truncate d8/d16/d1a/d2c/d49/d87/d8a/fc9 3464908 0 2024-04-25T17:19:26.150 INFO:tasks.workunit.client.1.smithi069.stdout:4/788: symlink db/d4b/d78/d79/da5/l117 0 2024-04-25T17:19:26.157 INFO:tasks.workunit.client.1.smithi069.stdout:5/836: symlink d13/d17/d19/d8a/dce/l11e 0 2024-04-25T17:19:26.158 INFO:tasks.workunit.client.1.smithi069.stdout:9/758: getdents d2/da/dd/d1e/d2e/d68/dba 0 2024-04-25T17:19:26.158 INFO:tasks.workunit.client.1.smithi069.stdout:5/837: read d13/d17/d19/d1c/d6c/fea [407224,92916] 0 2024-04-25T17:19:26.163 INFO:tasks.workunit.client.1.smithi069.stdout:9/759: rmdir d2/da/dd/d1e/d2e/d68/dba/dd1 39 2024-04-25T17:19:26.163 INFO:tasks.workunit.client.1.smithi069.stdout:9/760: fdatasync d2/da/dd/f50 0 2024-04-25T17:19:26.165 INFO:tasks.workunit.client.1.smithi069.stdout:5/838: mkdir d13/d17/d19/d8a/dce/d11f 0 2024-04-25T17:19:26.167 INFO:tasks.workunit.client.1.smithi069.stdout:4/789: mkdir db/d15/d118 0 2024-04-25T17:19:26.168 INFO:tasks.workunit.client.0.smithi037.stdout:0/854: sync 2024-04-25T17:19:26.168 INFO:tasks.workunit.client.1.smithi069.stdout:7/798: getdents d4/d1a 0 2024-04-25T17:19:26.169 INFO:tasks.workunit.client.0.smithi037.stdout:5/842: creat d7/d18/d62/dd8/f100 x:0 0 0 2024-04-25T17:19:26.171 INFO:tasks.workunit.client.0.smithi037.stdout:6/803: getdents db/d1d/d20/dcf/dfa/d65/d8b/dee 0 2024-04-25T17:19:26.171 INFO:tasks.workunit.client.1.smithi069.stdout:2/786: rename d0/d56/c70 to d0/d1/c101 0 2024-04-25T17:19:26.173 INFO:tasks.workunit.client.0.smithi037.stdout:1/922: dwrite dc/d52/f5b [0,4194304] 0 2024-04-25T17:19:26.174 INFO:tasks.workunit.client.1.smithi069.stdout:9/761: creat d2/da/dd/de/d74/d8a/f107 x:0 0 0 2024-04-25T17:19:26.174 INFO:tasks.workunit.client.0.smithi037.stdout:6/804: dread - db/d1d/ff4 zero size 2024-04-25T17:19:26.175 INFO:tasks.workunit.client.0.smithi037.stdout:0/855: symlink d9/d71/l117 0 2024-04-25T17:19:26.176 INFO:tasks.workunit.client.0.smithi037.stdout:6/805: fdatasync db/d1d/d20/dcf/dfa/d65/d68/d87/f114 0 2024-04-25T17:19:26.177 INFO:tasks.workunit.client.1.smithi069.stdout:3/841: creat d8/d71/d8d/f119 x:0 0 0 2024-04-25T17:19:26.181 INFO:tasks.workunit.client.1.smithi069.stdout:5/839: fdatasync d13/d17/d19/f70 0 2024-04-25T17:19:26.183 INFO:tasks.workunit.client.0.smithi037.stdout:2/885: creat d0/d23/dac/d4b/ded/f116 x:0 0 0 2024-04-25T17:19:26.186 INFO:tasks.workunit.client.1.smithi069.stdout:4/790: fdatasync f7 0 2024-04-25T17:19:26.188 INFO:tasks.workunit.client.0.smithi037.stdout:5/843: rename d7/d18/d62/dd8/fdb to d7/d18/d7c/f101 0 2024-04-25T17:19:26.188 INFO:tasks.workunit.client.0.smithi037.stdout:5/844: fdatasync d7/fb 0 2024-04-25T17:19:26.190 INFO:tasks.workunit.client.1.smithi069.stdout:7/799: creat d4/d3e/d94/da1/dc7/d14/d5a/d5e/f10f x:0 0 0 2024-04-25T17:19:26.191 INFO:tasks.workunit.client.1.smithi069.stdout:7/800: dread - d4/d3e/d94/da1/dc7/d14/d3d/d5d/f10c zero size 2024-04-25T17:19:26.193 INFO:tasks.workunit.client.1.smithi069.stdout:2/787: rmdir d0/d56/d5f/d62/d7d/d72/daf 39 2024-04-25T17:19:26.195 INFO:tasks.workunit.client.1.smithi069.stdout:8/809: sync 2024-04-25T17:19:26.196 INFO:tasks.workunit.client.0.smithi037.stdout:0/856: dread d9/d14/f9a [0,4194304] 0 2024-04-25T17:19:26.200 INFO:tasks.workunit.client.0.smithi037.stdout:2/886: mkdir d0/d16/d20/d59/d6a/da5/dbd/d117 0 2024-04-25T17:19:26.201 INFO:tasks.workunit.client.1.smithi069.stdout:3/842: dread d8/d39/f89 [0,4194304] 0 2024-04-25T17:19:26.203 INFO:tasks.workunit.client.1.smithi069.stdout:5/840: mknod d13/d17/d29/d30/d5c/c120 0 2024-04-25T17:19:26.206 INFO:tasks.workunit.client.0.smithi037.stdout:5/845: symlink d7/d25/d4f/da7/df8/l102 0 2024-04-25T17:19:26.207 INFO:tasks.workunit.client.1.smithi069.stdout:7/801: dread d4/d3e/d94/da1/dc7/f72 [0,4194304] 0 2024-04-25T17:19:26.208 INFO:tasks.workunit.client.1.smithi069.stdout:4/791: creat db/d15/d20/d35/d63/d75/dc0/f119 x:0 0 0 2024-04-25T17:19:26.211 INFO:tasks.workunit.client.1.smithi069.stdout:2/788: mknod d0/d26/d36/dc5/c102 0 2024-04-25T17:19:26.213 INFO:tasks.workunit.client.1.smithi069.stdout:8/810: symlink d37/d47/d78/d93/df9/l117 0 2024-04-25T17:19:26.215 INFO:tasks.workunit.client.0.smithi037.stdout:5/846: chown d7/d43/f9b 57 1 2024-04-25T17:19:26.217 INFO:tasks.workunit.client.0.smithi037.stdout:0/857: unlink d9/lb0 0 2024-04-25T17:19:26.218 INFO:tasks.workunit.client.0.smithi037.stdout:0/858: fsync d9/df/d32/d39/dd3/fe6 0 2024-04-25T17:19:26.219 INFO:tasks.workunit.client.1.smithi069.stdout:5/841: symlink d13/d17/d19/d1c/da4/da9/daa/l121 0 2024-04-25T17:19:26.223 INFO:tasks.workunit.client.1.smithi069.stdout:7/802: dread d4/d3e/d94/da1/dc7/d14/d15/f90 [0,4194304] 0 2024-04-25T17:19:26.224 INFO:tasks.workunit.client.0.smithi037.stdout:1/923: write dc/f62 [5079076,79955] 0 2024-04-25T17:19:26.225 INFO:tasks.workunit.client.1.smithi069.stdout:7/803: readlink d4/d3e/d94/da1/dc7/d14/d44/da8/ldb 0 2024-04-25T17:19:26.225 INFO:tasks.workunit.client.0.smithi037.stdout:5/847: creat d7/d12/da8/f103 x:0 0 0 2024-04-25T17:19:26.226 INFO:tasks.workunit.client.1.smithi069.stdout:9/762: write d2/da/dd/de/db0/f102 [4900840,96653] 0 2024-04-25T17:19:26.229 INFO:tasks.workunit.client.0.smithi037.stdout:0/859: readlink d9/d14/l2e 0 2024-04-25T17:19:26.229 INFO:tasks.workunit.client.1.smithi069.stdout:3/843: mkdir d8/d16/d1a/d99/dab/d11a 0 2024-04-25T17:19:26.230 INFO:tasks.workunit.client.0.smithi037.stdout:6/806: link db/d1d/d20/dcf/dfa/d65/lc2 db/d1d/d20/dcf/dfa/d65/d68/d87/l126 0 2024-04-25T17:19:26.231 INFO:tasks.workunit.client.0.smithi037.stdout:6/807: stat db/d26 0 2024-04-25T17:19:26.232 INFO:tasks.workunit.client.0.smithi037.stdout:6/808: fdatasync db/d1d/d20/dcf/dfa/d65/d68/d87/f114 0 2024-04-25T17:19:26.233 INFO:tasks.workunit.client.0.smithi037.stdout:2/887: rename d0/d16/d20/d59/d6a/f8c to d0/d23/dac/d4b/ded/f118 0 2024-04-25T17:19:26.235 INFO:tasks.workunit.client.1.smithi069.stdout:5/842: unlink d13/d17/d29/ff4 0 2024-04-25T17:19:26.237 INFO:tasks.workunit.client.1.smithi069.stdout:7/804: creat d4/d1a/f110 x:0 0 0 2024-04-25T17:19:26.240 INFO:tasks.workunit.client.0.smithi037.stdout:2/888: stat d0/c10 0 2024-04-25T17:19:26.240 INFO:tasks.workunit.client.0.smithi037.stdout:5/848: dread d7/d12/d6f/dbf/fc5 [0,4194304] 0 2024-04-25T17:19:26.241 INFO:tasks.workunit.client.1.smithi069.stdout:2/789: rename d0/d1/l2 to d0/dfd/l103 0 2024-04-25T17:19:26.243 INFO:tasks.workunit.client.0.smithi037.stdout:2/889: chown d0/d15/d2a/c40 1 1 2024-04-25T17:19:26.243 INFO:tasks.workunit.client.1.smithi069.stdout:7/805: dwrite d4/d3e/d94/da1/dc7/f92 [0,4194304] 0 2024-04-25T17:19:26.244 INFO:tasks.workunit.client.1.smithi069.stdout:8/811: mknod d37/d47/d78/db3/d114/c118 0 2024-04-25T17:19:26.245 INFO:tasks.workunit.client.0.smithi037.stdout:0/860: dwrite d9/f73 [4194304,4194304] 0 2024-04-25T17:19:26.245 INFO:tasks.workunit.client.1.smithi069.stdout:7/806: read d4/d4c/fb6 [103617,119255] 0 2024-04-25T17:19:26.249 INFO:tasks.workunit.client.0.smithi037.stdout:0/861: dread d9/d71/f99 [0,4194304] 0 2024-04-25T17:19:26.252 INFO:tasks.workunit.client.0.smithi037.stdout:0/862: truncate d9/df/d32/d39/dd3/f116 112099 0 2024-04-25T17:19:26.253 INFO:tasks.workunit.client.0.smithi037.stdout:1/924: dread dc/d52/fb2 [0,4194304] 0 2024-04-25T17:19:26.254 INFO:tasks.workunit.client.0.smithi037.stdout:0/863: dread - d9/df/d32/dd1/d7a/daf/fc6 zero size 2024-04-25T17:19:26.257 INFO:tasks.workunit.client.0.smithi037.stdout:5/849: creat d7/d18/d62/dd8/dc6/f104 x:0 0 0 2024-04-25T17:19:26.261 INFO:tasks.workunit.client.0.smithi037.stdout:1/925: dwrite dc/d52/d6b/dd9/d4d/d6a/dea/ff5 [0,4194304] 0 2024-04-25T17:19:26.267 INFO:tasks.workunit.client.0.smithi037.stdout:0/864: fdatasync d9/f19 0 2024-04-25T17:19:26.274 INFO:tasks.workunit.client.0.smithi037.stdout:1/926: unlink dc/d52/d6b/dd9/d22/c59 0 2024-04-25T17:19:26.276 INFO:tasks.workunit.client.1.smithi069.stdout:8/812: mknod d37/d47/d54/d6e/dce/c119 0 2024-04-25T17:19:26.279 INFO:tasks.workunit.client.1.smithi069.stdout:6/801: sync 2024-04-25T17:19:26.279 INFO:tasks.workunit.client.1.smithi069.stdout:0/707: sync 2024-04-25T17:19:26.279 INFO:tasks.workunit.client.1.smithi069.stdout:1/783: sync 2024-04-25T17:19:26.280 INFO:tasks.workunit.client.1.smithi069.stdout:7/807: fsync d4/d3e/d94/da1/dc7/fa 0 2024-04-25T17:19:26.282 INFO:tasks.workunit.client.0.smithi037.stdout:6/809: dwrite db/f1c [0,4194304] 0 2024-04-25T17:19:26.284 INFO:tasks.workunit.client.1.smithi069.stdout:2/790: mknod d0/d56/d5f/d62/d7d/d72/daf/dc2/ddd/c104 0 2024-04-25T17:19:26.285 INFO:tasks.workunit.client.1.smithi069.stdout:5/843: dwrite d13/d17/d19/d20/f7a [4194304,4194304] 0 2024-04-25T17:19:26.286 INFO:tasks.workunit.client.1.smithi069.stdout:2/791: write d0/d26/d10/d43/f80 [2941181,55484] 0 2024-04-25T17:19:26.289 INFO:tasks.workunit.client.1.smithi069.stdout:9/763: creat d2/da/dd/de/f108 x:0 0 0 2024-04-25T17:19:26.289 INFO:tasks.workunit.client.1.smithi069.stdout:3/844: truncate d8/d16/ff2 3233083 0 2024-04-25T17:19:26.289 INFO:tasks.workunit.client.0.smithi037.stdout:1/927: mkdir dc/d52/d6b/dd9/d22/d36/d74/da6/d140 0 2024-04-25T17:19:26.291 INFO:tasks.workunit.client.0.smithi037.stdout:1/928: dread - dc/d52/d6b/dd9/d4d/d6a/d8f/ddc/dee/dfc/f124 zero size 2024-04-25T17:19:26.292 INFO:tasks.workunit.client.1.smithi069.stdout:9/764: read d2/da/fc [6801182,105863] 0 2024-04-25T17:19:26.292 INFO:tasks.workunit.client.0.smithi037.stdout:1/929: stat dc/f16 0 2024-04-25T17:19:26.292 INFO:tasks.workunit.client.0.smithi037.stdout:2/890: link d0/d16/d20/d59/d6a/da5/ff0 d0/d16/d20/f119 0 2024-04-25T17:19:26.293 INFO:tasks.workunit.client.1.smithi069.stdout:9/765: dread - d2/da/dd/de/d74/d8a/fda zero size 2024-04-25T17:19:26.294 INFO:tasks.workunit.client.1.smithi069.stdout:9/766: chown d2/da/f10 28 1 2024-04-25T17:19:26.298 INFO:tasks.workunit.client.1.smithi069.stdout:0/708: mknod d0/da/db/d7e/cf4 0 2024-04-25T17:19:26.299 INFO:tasks.workunit.client.0.smithi037.stdout:6/810: readlink db/d1d/d20/l44 0 2024-04-25T17:19:26.300 INFO:tasks.workunit.client.0.smithi037.stdout:2/891: dwrite d0/d23/dac/d4b/ded/df4/ffa [0,4194304] 0 2024-04-25T17:19:26.300 INFO:tasks.workunit.client.0.smithi037.stdout:6/811: stat db/f3d 0 2024-04-25T17:19:26.302 INFO:tasks.workunit.client.1.smithi069.stdout:6/802: symlink d2/d1e/d3f/d86/da8/l10c 0 2024-04-25T17:19:26.302 INFO:tasks.workunit.client.0.smithi037.stdout:6/812: fdatasync db/d1d/d20/dcf/f103 0 2024-04-25T17:19:26.303 INFO:tasks.workunit.client.0.smithi037.stdout:5/850: write f1 [4596042,32424] 0 2024-04-25T17:19:26.303 INFO:tasks.workunit.client.1.smithi069.stdout:1/784: symlink d1/d4/d6/d9e/da6/d38/lf4 0 2024-04-25T17:19:26.305 INFO:tasks.workunit.client.1.smithi069.stdout:7/808: write d4/d3e/d94/da1/dc7/d14/d3d/f69 [5075093,71023] 0 2024-04-25T17:19:26.307 INFO:tasks.workunit.client.0.smithi037.stdout:2/892: read d0/d7c/fba [416955,99350] 0 2024-04-25T17:19:26.307 INFO:tasks.workunit.client.0.smithi037.stdout:0/865: link d9/df/d32/d39/d68/ca2 d9/d14/d28/d48/da9/c118 0 2024-04-25T17:19:26.309 INFO:tasks.workunit.client.0.smithi037.stdout:6/813: stat db/d1d/d20/dcf/dfa/d65/f9c 0 2024-04-25T17:19:26.313 INFO:tasks.workunit.client.1.smithi069.stdout:8/813: rename c1e to d37/d47/d54/d6e/dce/c11a 0 2024-04-25T17:19:26.313 INFO:tasks.workunit.client.1.smithi069.stdout:8/814: dread - d37/d47/d78/db3/d114/ffb zero size 2024-04-25T17:19:26.314 INFO:tasks.workunit.client.0.smithi037.stdout:1/930: symlink dc/d52/d6b/dd9/d22/d36/l141 0 2024-04-25T17:19:26.317 INFO:tasks.workunit.client.1.smithi069.stdout:3/845: mkdir d8/d16/d1a/d2c/d49/d59/dff/d107/d10d/d11b 0 2024-04-25T17:19:26.318 INFO:tasks.workunit.client.1.smithi069.stdout:3/846: chown d8/d16/d4b/def 1789 1 2024-04-25T17:19:26.320 INFO:tasks.workunit.client.1.smithi069.stdout:8/815: dwrite d37/d47/d48/d8e/ff5 [0,4194304] 0 2024-04-25T17:19:26.321 INFO:tasks.workunit.client.1.smithi069.stdout:0/709: rmdir d0/da/db/d56/d98 39 2024-04-25T17:19:26.323 INFO:tasks.workunit.client.0.smithi037.stdout:5/851: mkdir d7/d18/d62/dd8/d105 0 2024-04-25T17:19:26.325 INFO:tasks.workunit.client.1.smithi069.stdout:6/803: mkdir d2/d1e/d43/dca/d10d 0 2024-04-25T17:19:26.325 INFO:tasks.workunit.client.1.smithi069.stdout:9/767: dread d2/da/dd/d1e/d2e/d35/f98 [0,4194304] 0 2024-04-25T17:19:26.326 INFO:tasks.workunit.client.0.smithi037.stdout:6/814: creat db/d1d/d20/dcf/dfa/d65/d8b/f127 x:0 0 0 2024-04-25T17:19:26.330 INFO:tasks.workunit.client.1.smithi069.stdout:2/792: symlink d0/d1/l105 0 2024-04-25T17:19:26.331 INFO:tasks.workunit.client.0.smithi037.stdout:5/852: truncate d7/d18/d62/f6a 448457 0 2024-04-25T17:19:26.331 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:26.331+0000 7fe8a7973700 1 -- 172.21.15.37:0/3900068193 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe8a01047b0 con 0x7fe8a00fbcc0 2024-04-25T17:19:26.332 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:26.332+0000 7fe895ffb700 1 -- 172.21.15.37:0/3900068193 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+846 (secure 0 0 0) 0x7fe89c0586c0 con 0x7fe8a00fbcc0 2024-04-25T17:19:26.333 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-25T17:19:26.333 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": { 2024-04-25T17:19:26.333 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 2 2024-04-25T17:19:26.333 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:19:26.333 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": { 2024-04-25T17:19:26.333 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 1, 2024-04-25T17:19:26.333 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 1 2024-04-25T17:19:26.333 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:19:26.333 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": { 2024-04-25T17:19:26.333 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 6 2024-04-25T17:19:26.333 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:19:26.333 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": { 2024-04-25T17:19:26.333 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 4 2024-04-25T17:19:26.333 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:19:26.334 INFO:teuthology.orchestra.run.smithi037.stdout: "overall": { 2024-04-25T17:19:26.334 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 13, 2024-04-25T17:19:26.334 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 1 2024-04-25T17:19:26.334 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-04-25T17:19:26.334 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-25T17:19:26.334 INFO:tasks.workunit.client.1.smithi069.stdout:8/816: mkdir d37/d47/d78/db3/d114/d6b/d11b 0 2024-04-25T17:19:26.335 INFO:tasks.workunit.client.1.smithi069.stdout:8/817: chown d37/d47/d78/db3/d114/d6b/ca8 747 1 2024-04-25T17:19:26.335 INFO:tasks.workunit.client.0.smithi037.stdout:2/893: creat d0/d23/dac/d4b/ded/f11a x:0 0 0 2024-04-25T17:19:26.336 INFO:tasks.workunit.client.1.smithi069.stdout:8/818: truncate d37/d62/f8f 4217123 0 2024-04-25T17:19:26.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:26.335+0000 7fe8a7973700 1 -- 172.21.15.37:0/3900068193 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7fe88c0740c0 msgr2=0x7fe88c076570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:19:26.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:26.335+0000 7fe8a7973700 1 --2- 172.21.15.37:0/3900068193 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7fe88c0740c0 0x7fe88c076570 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe89000b0d0 tx=0x7fe890009e30 comp rx=0 tx=0).stop 2024-04-25T17:19:26.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:26.335+0000 7fe8a7973700 1 -- 172.21.15.37:0/3900068193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8a00fbcc0 msgr2=0x7fe8a010c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:19:26.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:26.335+0000 7fe8a7973700 1 --2- 172.21.15.37:0/3900068193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8a00fbcc0 0x7fe8a010c880 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe89c00eb40 tx=0x7fe89c00b040 comp rx=0 tx=0).stop 2024-04-25T17:19:26.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:26.336+0000 7fe8a7973700 1 -- 172.21.15.37:0/3900068193 shutdown_connections 2024-04-25T17:19:26.336 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:26.336+0000 7fe8a7973700 1 --2- 172.21.15.37:0/3900068193 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7fe88c0740c0 0x7fe88c076570 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:26.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:26.336+0000 7fe8a7973700 1 --2- 172.21.15.37:0/3900068193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe8a00fbcc0 0x7fe8a010c880 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:26.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:26.336+0000 7fe8a7973700 1 --2- 172.21.15.37:0/3900068193 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe8a00fcf70 0x7fe8a010cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:26.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:26.336+0000 7fe8a7973700 1 -- 172.21.15.37:0/3900068193 >> 172.21.15.37:0/3900068193 conn(0x7fe8a00f7420 msgr2=0x7fe8a00f8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:19:26.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:26.336+0000 7fe8a7973700 1 -- 172.21.15.37:0/3900068193 shutdown_connections 2024-04-25T17:19:26.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:26.336+0000 7fe8a7973700 1 -- 172.21.15.37:0/3900068193 wait complete. 2024-04-25T17:19:26.344 INFO:tasks.workunit.client.0.smithi037.stdout:2/894: mkdir d0/d15/d2a/d5a/d75/d11b 0 2024-04-25T17:19:26.346 INFO:tasks.workunit.client.1.smithi069.stdout:0/710: dread d0/da/db/d7e/fdc [0,4194304] 0 2024-04-25T17:19:26.347 INFO:tasks.workunit.client.0.smithi037.stdout:0/866: getdents d9/df/d32/d39/d68 0 2024-04-25T17:19:26.349 INFO:tasks.workunit.client.1.smithi069.stdout:1/785: dwrite d1/d4/d6/d9e/f8d [0,4194304] 0 2024-04-25T17:19:26.354 INFO:tasks.workunit.client.1.smithi069.stdout:4/792: sync 2024-04-25T17:19:26.354 INFO:tasks.workunit.client.0.smithi037.stdout:0/867: mknod d9/d14/dff/c119 0 2024-04-25T17:19:26.355 INFO:tasks.workunit.client.0.smithi037.stdout:6/815: dwrite db/d26/d2e/d3e/f4c [0,4194304] 0 2024-04-25T17:19:26.358 INFO:tasks.workunit.client.0.smithi037.stdout:5/853: write d7/d12/f60 [433432,91343] 0 2024-04-25T17:19:26.361 INFO:tasks.workunit.client.1.smithi069.stdout:3/847: link d8/d71/d8d/d92/db6/dc1/d42/fe5 d8/d16/d4b/d9e/f11c 0 2024-04-25T17:19:26.364 INFO:tasks.workunit.client.0.smithi037.stdout:0/868: mkdir d9/df/d32/dd1/d7a/da4/d11a 0 2024-04-25T17:19:26.365 INFO:tasks.workunit.client.0.smithi037.stdout:0/869: chown d9/df/d32/dd1/fdd 2303 1 2024-04-25T17:19:26.365 INFO:tasks.workunit.client.1.smithi069.stdout:7/809: truncate d4/d18/d36/fc2 4872192 0 2024-04-25T17:19:26.367 INFO:tasks.workunit.client.1.smithi069.stdout:7/810: fdatasync d4/d3e/f41 0 2024-04-25T17:19:26.367 INFO:tasks.workunit.client.1.smithi069.stdout:9/768: dwrite d2/da4/dcf/d65/f75 [0,4194304] 0 2024-04-25T17:19:26.369 INFO:tasks.workunit.client.0.smithi037.stdout:2/895: getdents d0/d16/d20/d59 0 2024-04-25T17:19:26.370 INFO:tasks.workunit.client.1.smithi069.stdout:9/769: stat d2/da/dd/d1e/d2e/d35/f38 0 2024-04-25T17:19:26.371 INFO:tasks.workunit.client.1.smithi069.stdout:0/711: mknod d0/d17/d40/cf5 0 2024-04-25T17:19:26.373 INFO:tasks.workunit.client.1.smithi069.stdout:1/786: creat d1/d4/de/d44/ff5 x:0 0 0 2024-04-25T17:19:26.373 INFO:tasks.workunit.client.0.smithi037.stdout:2/896: creat d0/d16/d20/d59/d6a/dbe/f11c x:0 0 0 2024-04-25T17:19:26.373 INFO:tasks.workunit.client.1.smithi069.stdout:3/848: dread d8/f19 [0,4194304] 0 2024-04-25T17:19:26.376 INFO:tasks.workunit.client.1.smithi069.stdout:2/793: dwrite d0/d26/d10/d43/f7a [0,4194304] 0 2024-04-25T17:19:26.376 INFO:tasks.workunit.client.1.smithi069.stdout:8/819: rename l36 to d37/d47/d54/l11c 0 2024-04-25T17:19:26.379 INFO:tasks.workunit.client.0.smithi037.stdout:2/897: mkdir d0/d15/d2a/d5a/d75/d11d 0 2024-04-25T17:19:26.379 INFO:tasks.workunit.client.1.smithi069.stdout:5/844: sync 2024-04-25T17:19:26.384 INFO:tasks.workunit.client.0.smithi037.stdout:2/898: symlink d0/d7c/l11e 0 2024-04-25T17:19:26.384 INFO:tasks.workunit.client.0.smithi037.stdout:2/899: readlink d0/d7c/dee/lfe 0 2024-04-25T17:19:26.386 INFO:tasks.workunit.client.1.smithi069.stdout:6/804: write d2/f20 [3040664,48412] 0 2024-04-25T17:19:26.393 INFO:tasks.workunit.client.1.smithi069.stdout:9/770: rename d2/da/dd/de/d64/dd2/ffe to d2/da4/dcf/d65/d88/db6/f109 0 2024-04-25T17:19:26.394 INFO:tasks.workunit.client.0.smithi037.stdout:2/900: symlink d0/d15/l11f 0 2024-04-25T17:19:26.400 INFO:tasks.workunit.client.1.smithi069.stdout:1/787: dread d1/df/f42 [0,4194304] 0 2024-04-25T17:19:26.401 INFO:tasks.workunit.client.1.smithi069.stdout:5/845: creat d13/d17/d19/d20/f122 x:0 0 0 2024-04-25T17:19:26.403 INFO:tasks.workunit.client.1.smithi069.stdout:5/846: fsync d13/d17/d19/d96/fe3 0 2024-04-25T17:19:26.406 INFO:tasks.workunit.client.1.smithi069.stdout:0/712: mknod d0/da/db/d3a/cf6 0 2024-04-25T17:19:26.407 INFO:tasks.workunit.client.1.smithi069.stdout:2/794: write d0/d56/d5f/d62/fc1 [634064,121579] 0 2024-04-25T17:19:26.409 INFO:tasks.workunit.client.0.smithi037.stdout:2/901: write d0/d16/d3c/f92 [2307642,53329] 0 2024-04-25T17:19:26.409 INFO:tasks.workunit.client.1.smithi069.stdout:7/811: dwrite d4/d3e/d94/da1/dc7/d14/d44/d88/ff2 [0,4194304] 0 2024-04-25T17:19:26.410 INFO:tasks.workunit.client.0.smithi037.stdout:2/902: dread - d0/d23/dac/f103 zero size 2024-04-25T17:19:26.411 INFO:tasks.workunit.client.1.smithi069.stdout:6/805: write d2/d7/f80 [231275,75326] 0 2024-04-25T17:19:26.411 INFO:tasks.workunit.client.0.smithi037.stdout:2/903: chown d0/d23/d7d/dae 6 1 2024-04-25T17:19:26.412 INFO:tasks.workunit.client.1.smithi069.stdout:0/713: write d0/da/db/f64 [1733799,70363] 0 2024-04-25T17:19:26.412 INFO:tasks.workunit.client.1.smithi069.stdout:1/788: dwrite d1/d4/d6/d9e/da6/d7c/d1d/fb2 [0,4194304] 0 2024-04-25T17:19:26.412 INFO:tasks.workunit.client.1.smithi069.stdout:3/849: write d8/d16/d1a/d2c/d49/d87/d8a/fc9 [3496246,3719] 0 2024-04-25T17:19:26.414 INFO:tasks.workunit.client.1.smithi069.stdout:4/793: getdents db/d15/d20/d35/d63/d75/dc0 0 2024-04-25T17:19:26.417 INFO:tasks.workunit.client.1.smithi069.stdout:0/714: chown d0/da/db/d1d/la3 213 1 2024-04-25T17:19:26.418 INFO:tasks.workunit.client.1.smithi069.stdout:8/820: dwrite d37/d47/d78/f88 [0,4194304] 0 2024-04-25T17:19:26.418 INFO:tasks.workunit.client.1.smithi069.stdout:0/715: readlink d0/da/db/d1d/la3 0 2024-04-25T17:19:26.422 INFO:tasks.workunit.client.1.smithi069.stdout:2/795: rename d0/d56/f9d to d0/d56/d94/f106 0 2024-04-25T17:19:26.426 INFO:tasks.workunit.client.1.smithi069.stdout:6/806: unlink d2/d7/fe6 0 2024-04-25T17:19:26.427 INFO:tasks.workunit.client.1.smithi069.stdout:6/807: stat d2/d7/f25 0 2024-04-25T17:19:26.428 INFO:tasks.workunit.client.1.smithi069.stdout:6/808: readlink d2/d1e/d3f/d86/ld7 0 2024-04-25T17:19:26.428 INFO:tasks.workunit.client.1.smithi069.stdout:1/789: mkdir d1/d4/de/d63/d7d/df6 0 2024-04-25T17:19:26.432 INFO:tasks.workunit.client.1.smithi069.stdout:7/812: truncate d4/d3e/d94/da1/dc7/d14/d15/f8d 215445 0 2024-04-25T17:19:26.433 INFO:tasks.workunit.client.1.smithi069.stdout:8/821: unlink d37/d47/d48/d8e/c9d 0 2024-04-25T17:19:26.435 INFO:tasks.workunit.client.1.smithi069.stdout:0/716: unlink d0/d38/f7a 0 2024-04-25T17:19:26.437 INFO:tasks.workunit.client.0.smithi037.stdout:2/904: write d0/d15/fb3 [725412,74584] 0 2024-04-25T17:19:26.438 INFO:tasks.workunit.client.0.smithi037.stdout:2/905: chown d0/d23/dac/d4b/f91 42417081 1 2024-04-25T17:19:26.440 INFO:tasks.workunit.client.1.smithi069.stdout:2/796: rename d0/d56/d5f/d62/d7d/d31/df8/dfc to d0/d26/d107 0 2024-04-25T17:19:26.441 INFO:tasks.workunit.client.1.smithi069.stdout:2/797: write d0/d56/d5f/d62/d7d/d72/ff5 [239546,51549] 0 2024-04-25T17:19:26.444 INFO:tasks.workunit.client.1.smithi069.stdout:6/809: creat d2/d1e/d43/d7d/f10e x:0 0 0 2024-04-25T17:19:26.447 INFO:tasks.workunit.client.1.smithi069.stdout:4/794: rename db/d4b/d78/dc4/d41/ce7 to db/d4b/d78/dc4/d41/c11a 0 2024-04-25T17:19:26.450 INFO:tasks.workunit.client.1.smithi069.stdout:5/847: dread d13/d17/d19/d1c/d6c/fb1 [0,4194304] 0 2024-04-25T17:19:26.452 INFO:tasks.workunit.client.1.smithi069.stdout:9/771: mknod d2/da/dd/d1e/d2e/d68/dba/ded/c10a 0 2024-04-25T17:19:26.454 INFO:tasks.workunit.client.1.smithi069.stdout:7/813: rename d4/d83/da2/dd3/fe8 to d4/d3e/d94/da1/f111 0 2024-04-25T17:19:26.454 INFO:tasks.workunit.client.1.smithi069.stdout:3/850: write d8/f19 [513081,18561] 0 2024-04-25T17:19:26.455 INFO:tasks.workunit.client.1.smithi069.stdout:2/798: mknod d0/d26/d36/dc5/c108 0 2024-04-25T17:19:26.457 INFO:tasks.workunit.client.1.smithi069.stdout:6/810: mkdir d2/d51/d89/dfd/d10f 0 2024-04-25T17:19:26.459 INFO:tasks.workunit.client.1.smithi069.stdout:5/848: symlink d13/d17/d19/d1c/da4/da9/l123 0 2024-04-25T17:19:26.462 INFO:tasks.workunit.client.0.smithi037.stdout:2/906: write d0/f33 [4166860,46486] 0 2024-04-25T17:19:26.465 INFO:tasks.workunit.client.1.smithi069.stdout:8/822: rename d37/l4c to d37/d47/d54/d6e/d9e/l11d 0 2024-04-25T17:19:26.466 INFO:tasks.workunit.client.1.smithi069.stdout:1/790: creat d1/df/ff7 x:0 0 0 2024-04-25T17:19:26.467 INFO:tasks.workunit.client.0.smithi037.stdout:2/907: dread - d0/d23/dac/f9d zero size 2024-04-25T17:19:26.471 INFO:tasks.workunit.client.1.smithi069.stdout:7/814: creat d4/d83/da2/dd3/f112 x:0 0 0 2024-04-25T17:19:26.473 INFO:tasks.workunit.client.1.smithi069.stdout:0/717: dwrite d0/da/d24/f72 [0,4194304] 0 2024-04-25T17:19:26.473 INFO:tasks.workunit.client.1.smithi069.stdout:7/815: readlink d4/d3e/d94/da1/dc7/d14/d44/lba 0 2024-04-25T17:19:26.474 INFO:tasks.workunit.client.1.smithi069.stdout:1/791: dwrite d1/d4/d6/d4f/d9b/fc9 [0,4194304] 0 2024-04-25T17:19:26.475 INFO:tasks.workunit.client.1.smithi069.stdout:6/811: creat d2/d1e/d3f/d86/f110 x:0 0 0 2024-04-25T17:19:26.479 INFO:tasks.workunit.client.1.smithi069.stdout:9/772: write d2/da/dd/d1e/d2e/d35/f98 [179096,128923] 0 2024-04-25T17:19:26.481 INFO:tasks.workunit.client.1.smithi069.stdout:2/799: creat d0/d26/df3/f109 x:0 0 0 2024-04-25T17:19:26.486 INFO:tasks.workunit.client.1.smithi069.stdout:2/800: read d0/d26/d10/f49 [2090428,31683] 0 2024-04-25T17:19:26.487 INFO:tasks.workunit.client.0.smithi037.stdout:7/704: sync 2024-04-25T17:19:26.489 INFO:tasks.workunit.client.0.smithi037.stdout:2/908: dread d0/d23/dac/fe1 [0,4194304] 0 2024-04-25T17:19:26.490 INFO:tasks.workunit.client.1.smithi069.stdout:0/718: truncate d0/da/db/d1d/f86 2077753 0 2024-04-25T17:19:26.490 INFO:tasks.workunit.client.1.smithi069.stdout:5/849: symlink d13/d17/d19/l124 0 2024-04-25T17:19:26.495 INFO:tasks.workunit.client.1.smithi069.stdout:8/823: mknod d37/d47/d54/d6e/c11e 0 2024-04-25T17:19:26.496 INFO:tasks.workunit.client.1.smithi069.stdout:3/851: dwrite d8/d16/d1a/d38/f88 [0,4194304] 0 2024-04-25T17:19:26.496 INFO:tasks.workunit.client.0.smithi037.stdout:7/705: fsync d5/d15/d17/d1b/da2/d76/fb0 0 2024-04-25T17:19:26.497 INFO:tasks.workunit.client.0.smithi037.stdout:2/909: dwrite d0/d23/dac/d4b/ded/f11a [0,4194304] 0 2024-04-25T17:19:26.499 INFO:tasks.workunit.client.1.smithi069.stdout:7/816: write d4/d3e/d94/da1/dc7/f59 [2192300,81009] 0 2024-04-25T17:19:26.499 INFO:tasks.workunit.client.1.smithi069.stdout:6/812: dwrite d2/d1e/d43/f57 [0,4194304] 0 2024-04-25T17:19:26.500 INFO:tasks.workunit.client.1.smithi069.stdout:8/824: chown d37/d47/d78/db3/d114/lb7 0 1 2024-04-25T17:19:26.502 INFO:tasks.workunit.client.1.smithi069.stdout:9/773: mkdir d2/da/dd/d1e/d40/d10b 0 2024-04-25T17:19:26.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:26.502+0000 7fd3e00fe700 1 -- 172.21.15.37:0/973759631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3d8070890 msgr2=0x7fd3d8070d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:19:26.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:26.502+0000 7fd3e00fe700 1 --2- 172.21.15.37:0/973759631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3d8070890 0x7fd3d8070d00 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8004940 tx=0x7fd3c8009e30 comp rx=0 tx=0).stop 2024-04-25T17:19:26.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:26.503+0000 7fd3e00fe700 1 -- 172.21.15.37:0/973759631 shutdown_connections 2024-04-25T17:19:26.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:26.503+0000 7fd3e00fe700 1 --2- 172.21.15.37:0/973759631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3d8070890 0x7fd3d8070d00 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:26.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:26.503+0000 7fd3e00fe700 1 --2- 172.21.15.37:0/973759631 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3d8071e40 0x7fd3d8070350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:26.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:26.503+0000 7fd3e00fe700 1 -- 172.21.15.37:0/973759631 >> 172.21.15.37:0/973759631 conn(0x7fd3d80f8520 msgr2=0x7fd3d80fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:19:26.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:26.504+0000 7fd3e00fe700 1 -- 172.21.15.37:0/973759631 shutdown_connections 2024-04-25T17:19:26.505 INFO:tasks.workunit.client.0.smithi037.stdout:2/910: creat d0/d16/d20/db9/f120 x:0 0 0 2024-04-25T17:19:26.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:26.504+0000 7fd3e00fe700 1 -- 172.21.15.37:0/973759631 wait complete. 2024-04-25T17:19:26.505 INFO:tasks.workunit.client.1.smithi069.stdout:4/795: dwrite db/d4b/d78/fe5 [0,4194304] 0 2024-04-25T17:19:26.506 INFO:tasks.workunit.client.1.smithi069.stdout:9/774: stat d2/da4/dcf/d65/d88/leb 0 2024-04-25T17:19:26.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:26.505+0000 7fd3e00fe700 1 Processor -- start 2024-04-25T17:19:26.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:26.506+0000 7fd3e00fe700 1 -- start start 2024-04-25T17:19:26.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:26.506+0000 7fd3e00fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3d8070890 0x7fd3d8113f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:19:26.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:26.506+0000 7fd3e00fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3d8071e40 0x7fd3d81144a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:19:26.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:26.506+0000 7fd3e00fe700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d8114b30 con 0x7fd3d8071e40 2024-04-25T17:19:26.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:26.506+0000 7fd3e00fe700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d81194d0 con 0x7fd3d8070890 2024-04-25T17:19:26.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:26.506+0000 7fd3dd699700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3d8071e40 0x7fd3d81144a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:19:26.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:26.506+0000 7fd3dd699700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3d8071e40 0x7fd3d81144a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49632/0 (socket says 172.21.15.37:49632) 2024-04-25T17:19:26.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:26.506+0000 7fd3dd699700 1 -- 172.21.15.37:0/1931452126 learned_addr learned my addr 172.21.15.37:0/1931452126 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:19:26.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:26.507+0000 7fd3dd699700 1 -- 172.21.15.37:0/1931452126 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3d8070890 msgr2=0x7fd3d8113f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:19:26.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:26.507+0000 7fd3dd699700 1 --2- 172.21.15.37:0/1931452126 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3d8070890 0x7fd3d8113f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:26.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:26.507+0000 7fd3dd699700 1 -- 172.21.15.37:0/1931452126 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c8005040 con 0x7fd3d8071e40 2024-04-25T17:19:26.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:26.507+0000 7fd3dd699700 1 --2- 172.21.15.37:0/1931452126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3d8071e40 0x7fd3d81144a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8009150 tx=0x7fd3c8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:19:26.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:26.507+0000 7fd3ce7fc700 1 -- 172.21.15.37:0/1931452126 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3c800e040 con 0x7fd3d8071e40 2024-04-25T17:19:26.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:26.508+0000 7fd3e00fe700 1 -- 172.21.15.37:0/1931452126 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3d81196d0 con 0x7fd3d8071e40 2024-04-25T17:19:26.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:26.508+0000 7fd3e00fe700 1 -- 172.21.15.37:0/1931452126 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3d8119b80 con 0x7fd3d8071e40 2024-04-25T17:19:26.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:26.510+0000 7fd3c3fff700 1 -- 172.21.15.37:0/1931452126 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3bc0052e0 con 0x7fd3d8071e40 2024-04-25T17:19:26.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:26.510+0000 7fd3ce7fc700 1 -- 172.21.15.37:0/1931452126 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd3c800bbf0 con 0x7fd3d8071e40 2024-04-25T17:19:26.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:26.510+0000 7fd3ce7fc700 1 -- 172.21.15.37:0/1931452126 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3c8025400 con 0x7fd3d8071e40 2024-04-25T17:19:26.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:26.511+0000 7fd3ce7fc700 1 -- 172.21.15.37:0/1931452126 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) v1 ==== 92608+0+0 (secure 0 0 0) 0x7fd3c8025620 con 0x7fd3d8071e40 2024-04-25T17:19:26.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:26.513+0000 7fd3ce7fc700 1 --2- 172.21.15.37:0/1931452126 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7fd3c406fcc0 0x7fd3c4072170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:19:26.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:26.514+0000 7fd3ce7fc700 1 -- 172.21.15.37:0/1931452126 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7fd3c8091b90 con 0x7fd3d8071e40 2024-04-25T17:19:26.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:26.515+0000 7fd3dde9a700 1 --2- 172.21.15.37:0/1931452126 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7fd3c406fcc0 0x7fd3c4072170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:19:26.517 INFO:tasks.workunit.client.0.smithi037.stdout:2/911: mknod d0/d7c/c121 0 2024-04-25T17:19:26.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:26.519+0000 7fd3dde9a700 1 --2- 172.21.15.37:0/1931452126 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7fd3c406fcc0 0x7fd3c4072170 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd3d4006fd0 tx=0x7fd3d4006db0 comp rx=0 tx=0).ready entity=mgr.24417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:19:26.520 INFO:tasks.workunit.client.1.smithi069.stdout:0/719: mkdir d0/d38/d75/df7 0 2024-04-25T17:19:26.521 INFO:tasks.workunit.client.1.smithi069.stdout:5/850: creat d13/d17/d29/d30/d5c/f125 x:0 0 0 2024-04-25T17:19:26.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:26.523+0000 7fd3ce7fc700 1 -- 172.21.15.37:0/1931452126 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7fd3c805af70 con 0x7fd3d8071e40 2024-04-25T17:19:26.524 INFO:tasks.workunit.client.0.smithi037.stdout:2/912: dwrite d0/d15/fb3 [0,4194304] 0 2024-04-25T17:19:26.526 INFO:tasks.workunit.client.1.smithi069.stdout:7/817: unlink d4/d18/ceb 0 2024-04-25T17:19:26.528 INFO:tasks.workunit.client.1.smithi069.stdout:5/851: dwrite d13/f92 [0,4194304] 0 2024-04-25T17:19:26.529 INFO:tasks.workunit.client.1.smithi069.stdout:6/813: symlink d2/d9c/d97/d98/l111 0 2024-04-25T17:19:26.530 INFO:tasks.workunit.client.0.smithi037.stdout:2/913: chown d0/d16/d20/d55/f60 49 1 2024-04-25T17:19:26.532 INFO:tasks.workunit.client.1.smithi069.stdout:8/825: unlink d37/d47/d54/d6e/d98/f108 0 2024-04-25T17:19:26.533 INFO:tasks.workunit.client.0.smithi037.stdout:7/706: dread d5/d15/d17/d1b/da2/daf/f3d [0,4194304] 0 2024-04-25T17:19:26.534 INFO:tasks.workunit.client.0.smithi037.stdout:7/707: chown d5/d15/d17/d25/d2b/f35 0 1 2024-04-25T17:19:26.535 INFO:tasks.workunit.client.1.smithi069.stdout:3/852: dread d8/d71/f85 [0,4194304] 0 2024-04-25T17:19:26.536 INFO:tasks.workunit.client.0.smithi037.stdout:2/914: rename d0/d7c/dee/lfe to d0/l122 0 2024-04-25T17:19:26.537 INFO:tasks.workunit.client.1.smithi069.stdout:8/826: dread d37/d47/d78/db3/d114/d6b/f96 [0,4194304] 0 2024-04-25T17:19:26.537 INFO:tasks.workunit.client.1.smithi069.stdout:8/827: chown d37 1767 1 2024-04-25T17:19:26.538 INFO:tasks.workunit.client.0.smithi037.stdout:2/915: write d0/d16/d20/f3d [3910488,34350] 0 2024-04-25T17:19:26.540 INFO:tasks.workunit.client.0.smithi037.stdout:2/916: write d0/d16/d20/d55/f80 [2794723,19860] 0 2024-04-25T17:19:26.543 INFO:tasks.workunit.client.1.smithi069.stdout:7/818: chown d4/d3e/d94/da1/dc7/d14/d3d/df6/f65 5064244 1 2024-04-25T17:19:26.543 INFO:tasks.workunit.client.1.smithi069.stdout:2/801: write d0/d1/d5b/fbb [561575,106091] 0 2024-04-25T17:19:26.545 INFO:tasks.workunit.client.1.smithi069.stdout:8/828: dwrite d37/d47/d78/d93/df9/ff7 [0,4194304] 0 2024-04-25T17:19:26.547 INFO:tasks.workunit.client.1.smithi069.stdout:8/829: read d37/f3a [3042888,102874] 0 2024-04-25T17:19:26.547 INFO:tasks.workunit.client.1.smithi069.stdout:7/819: chown d4/d3e/d94/da1/dc7/d14/d44/d88/lf8 64418 1 2024-04-25T17:19:26.548 INFO:tasks.workunit.client.1.smithi069.stdout:2/802: read d0/d56/d5f/d62/fc1 [115822,375] 0 2024-04-25T17:19:26.549 INFO:tasks.workunit.client.1.smithi069.stdout:5/852: rename d13/f92 to d13/d17/d19/d1c/da4/da9/daa/f126 0 2024-04-25T17:19:26.550 INFO:tasks.workunit.client.1.smithi069.stdout:7/820: fsync d4/d3e/d94/da1/dc7/d14/d44/fb8 0 2024-04-25T17:19:26.553 INFO:tasks.workunit.client.1.smithi069.stdout:7/821: truncate d4/d83/da2/dd3/f112 219135 0 2024-04-25T17:19:26.553 INFO:tasks.workunit.client.1.smithi069.stdout:5/853: truncate d13/d17/d19/d20/d2d/f5d 4499446 0 2024-04-25T17:19:26.555 INFO:tasks.workunit.client.1.smithi069.stdout:8/830: dwrite d37/d47/d48/f102 [0,4194304] 0 2024-04-25T17:19:26.556 INFO:tasks.workunit.client.0.smithi037.stdout:2/917: rename d0/d16/d20/d55/f80 to d0/d16/d20/f123 0 2024-04-25T17:19:26.556 INFO:tasks.workunit.client.0.smithi037.stdout:2/918: stat d0/d16/d20/d59/c93 0 2024-04-25T17:19:26.559 INFO:tasks.workunit.client.1.smithi069.stdout:3/853: mkdir d8/d16/d1a/d2c/d49/d59/dff/d11d 0 2024-04-25T17:19:26.559 INFO:tasks.workunit.client.1.smithi069.stdout:1/792: link d1/df/d17/lf3 d1/d4/lf8 0 2024-04-25T17:19:26.560 INFO:tasks.workunit.client.1.smithi069.stdout:0/720: getdents d0/da/d59/dab/de6 0 2024-04-25T17:19:26.560 INFO:tasks.workunit.client.1.smithi069.stdout:3/854: write d8/d16/d1a/d2c/f4e [1660924,113705] 0 2024-04-25T17:19:26.561 INFO:tasks.workunit.client.1.smithi069.stdout:1/793: truncate d1/d4/d6/d9e/da6/fe2 900274 0 2024-04-25T17:19:26.567 INFO:tasks.workunit.client.0.smithi037.stdout:7/708: dread d5/d14/db1/fa7 [0,4194304] 0 2024-04-25T17:19:26.568 INFO:tasks.workunit.client.1.smithi069.stdout:9/775: dwrite d2/da/dd/f2d [0,4194304] 0 2024-04-25T17:19:26.575 INFO:tasks.workunit.client.0.smithi037.stdout:7/709: creat d5/d15/d17/d25/d2b/dcb/dda/fee x:0 0 0 2024-04-25T17:19:26.578 INFO:tasks.workunit.client.1.smithi069.stdout:2/803: dread d0/d26/f2b [4194304,4194304] 0 2024-04-25T17:19:26.579 INFO:tasks.workunit.client.1.smithi069.stdout:4/796: creat db/d15/d20/d35/d63/d43/f11b x:0 0 0 2024-04-25T17:19:26.583 INFO:tasks.workunit.client.1.smithi069.stdout:7/822: fsync d4/d3e/d94/da1/dc7/fa 0 2024-04-25T17:19:26.584 INFO:tasks.workunit.client.1.smithi069.stdout:3/855: dread d8/d71/d8d/d92/db6/dc1/d42/fe5 [0,4194304] 0 2024-04-25T17:19:26.585 INFO:tasks.workunit.client.1.smithi069.stdout:5/854: mknod d13/d17/d19/d1c/d79/c127 0 2024-04-25T17:19:26.589 INFO:tasks.workunit.client.0.smithi037.stdout:7/710: creat d5/d15/d17/d1b/da2/fef x:0 0 0 2024-04-25T17:19:26.589 INFO:tasks.workunit.client.1.smithi069.stdout:0/721: readlink d0/da/db/ld 0 2024-04-25T17:19:26.590 INFO:tasks.workunit.client.0.smithi037.stdout:7/711: chown d5/d15/d17/d25/d2b/d59/c79 47445 1 2024-04-25T17:19:26.592 INFO:tasks.workunit.client.1.smithi069.stdout:1/794: readlink d1/d4/lf8 0 2024-04-25T17:19:26.592 INFO:tasks.workunit.client.1.smithi069.stdout:1/795: readlink d1/d43/d1b/l3d 0 2024-04-25T17:19:26.594 INFO:tasks.workunit.client.0.smithi037.stdout:7/712: mknod d5/d15/dd8/cf0 0 2024-04-25T17:19:26.596 INFO:tasks.workunit.client.1.smithi069.stdout:6/814: link d2/d9c/d48/c59 d2/d1e/d3f/d86/c112 0 2024-04-25T17:19:26.600 INFO:tasks.workunit.client.0.smithi037.stdout:7/713: mknod d5/d14/dd3/cf1 0 2024-04-25T17:19:26.601 INFO:tasks.workunit.client.0.smithi037.stdout:7/714: readlink d5/d15/d17/d1b/da2/d76/ld9 0 2024-04-25T17:19:26.602 INFO:tasks.workunit.client.1.smithi069.stdout:8/831: dread d37/d47/ffd [0,4194304] 0 2024-04-25T17:19:26.602 INFO:tasks.workunit.client.1.smithi069.stdout:5/855: mkdir d13/d17/d29/d128 0 2024-04-25T17:19:26.602 INFO:tasks.workunit.client.1.smithi069.stdout:3/856: fsync d8/d16/d1a/d2c/d49/dbc/fe0 0 2024-04-25T17:19:26.603 INFO:tasks.workunit.client.1.smithi069.stdout:0/722: mkdir d0/da/db/d73/df8 0 2024-04-25T17:19:26.604 INFO:tasks.workunit.client.1.smithi069.stdout:5/856: write d13/d17/d19/d1c/da4/da9/fca [668770,40037] 0 2024-04-25T17:19:26.605 INFO:tasks.workunit.client.1.smithi069.stdout:3/857: write d8/d16/d1a/d2c/d6c/f76 [2250192,35898] 0 2024-04-25T17:19:26.605 INFO:tasks.workunit.client.1.smithi069.stdout:1/796: rmdir d1/d4/d6/d9e/da6/d7c/d1d 39 2024-04-25T17:19:26.606 INFO:tasks.workunit.client.1.smithi069.stdout:9/776: mknod d2/da/dd/de/d104/c10c 0 2024-04-25T17:19:26.610 INFO:tasks.workunit.client.1.smithi069.stdout:4/797: dread db/d4b/f89 [0,4194304] 0 2024-04-25T17:19:26.611 INFO:tasks.workunit.client.1.smithi069.stdout:8/832: creat d37/d47/d54/d6e/d9e/f11f x:0 0 0 2024-04-25T17:19:26.613 INFO:tasks.workunit.client.1.smithi069.stdout:6/815: mkdir d2/d9c/d97/dad/de8/d113 0 2024-04-25T17:19:26.614 INFO:tasks.workunit.client.1.smithi069.stdout:6/816: write d2/f63 [1905831,61418] 0 2024-04-25T17:19:26.614 INFO:tasks.workunit.client.1.smithi069.stdout:1/797: mkdir d1/d4/d6/d4f/d9b/da3/df9 0 2024-04-25T17:19:26.615 INFO:tasks.workunit.client.1.smithi069.stdout:3/858: mknod d8/d16/d1a/d2c/d6c/c11e 0 2024-04-25T17:19:26.618 INFO:tasks.workunit.client.1.smithi069.stdout:0/723: mknod d0/da/db/d3a/cf9 0 2024-04-25T17:19:26.621 INFO:tasks.workunit.client.1.smithi069.stdout:5/857: link d13/d17/d29/d30/d5c/f102 d13/d17/d19/d20/d2d/d93/f129 0 2024-04-25T17:19:26.622 INFO:tasks.workunit.client.1.smithi069.stdout:6/817: symlink d2/d9c/d97/dad/de8/l114 0 2024-04-25T17:19:26.623 INFO:tasks.workunit.client.1.smithi069.stdout:6/818: dread - d2/d51/f8e zero size 2024-04-25T17:19:26.623 INFO:tasks.workunit.client.1.smithi069.stdout:5/858: write d13/d17/d29/d30/d5c/f8f [1572228,18758] 0 2024-04-25T17:19:26.623 INFO:tasks.workunit.client.1.smithi069.stdout:9/777: truncate d2/da/dd/d1e/d2e/d35/f6c 2023623 0 2024-04-25T17:19:26.625 INFO:tasks.workunit.client.1.smithi069.stdout:3/859: link d8/d16/d9b/f115 d8/d16/d1a/d99/d111/f11f 0 2024-04-25T17:19:26.625 INFO:tasks.workunit.client.1.smithi069.stdout:5/859: write f6 [4280737,3114] 0 2024-04-25T17:19:26.625 INFO:tasks.workunit.client.1.smithi069.stdout:6/819: fsync d2/d1e/f6a 0 2024-04-25T17:19:26.628 INFO:tasks.workunit.client.1.smithi069.stdout:4/798: dread db/d15/d42/d64/f67 [4194304,4194304] 0 2024-04-25T17:19:26.630 INFO:tasks.workunit.client.1.smithi069.stdout:4/799: write db/d15/d42/d64/fe1 [386592,28059] 0 2024-04-25T17:19:26.631 INFO:tasks.workunit.client.0.smithi037.stdout:7/715: dwrite d5/d15/d17/d1b/da2/daf/f2a [0,4194304] 0 2024-04-25T17:19:26.632 INFO:tasks.workunit.client.1.smithi069.stdout:9/778: mknod d2/da/dd/de0/c10d 0 2024-04-25T17:19:26.633 INFO:tasks.workunit.client.0.smithi037.stdout:7/716: chown d5/d15/l56 7750664 1 2024-04-25T17:19:26.634 INFO:tasks.workunit.client.1.smithi069.stdout:8/833: dread f10 [0,4194304] 0 2024-04-25T17:19:26.636 INFO:tasks.workunit.client.1.smithi069.stdout:5/860: truncate d13/d17/d19/d20/d2d/d93/fb0 870276 0 2024-04-25T17:19:26.638 INFO:tasks.workunit.client.0.smithi037.stdout:7/717: creat d5/d14/db1/ff2 x:0 0 0 2024-04-25T17:19:26.639 INFO:tasks.workunit.client.1.smithi069.stdout:0/724: dread d0/d17/f4a [0,4194304] 0 2024-04-25T17:19:26.640 INFO:tasks.workunit.client.1.smithi069.stdout:7/823: dwrite d4/d3e/d94/da1/dc7/d14/d15/f17 [4194304,4194304] 0 2024-04-25T17:19:26.640 INFO:tasks.workunit.client.1.smithi069.stdout:4/800: creat db/de3/f11c x:0 0 0 2024-04-25T17:19:26.641 INFO:tasks.workunit.client.1.smithi069.stdout:4/801: dread - db/d15/f113 zero size 2024-04-25T17:19:26.641 INFO:tasks.workunit.client.1.smithi069.stdout:7/824: readlink d4/d3e/d94/da1/dc7/d14/d44/d7c/lb9 0 2024-04-25T17:19:26.642 INFO:tasks.workunit.client.1.smithi069.stdout:4/802: write db/d4b/d78/dc4/f107 [338220,94034] 0 2024-04-25T17:19:26.645 INFO:tasks.workunit.client.1.smithi069.stdout:4/803: readlink db/d15/d20/d35/d63/d43/d48/d49/l69 0 2024-04-25T17:19:26.646 INFO:tasks.workunit.client.1.smithi069.stdout:4/804: truncate db/f104 576770 0 2024-04-25T17:19:26.646 INFO:tasks.workunit.client.1.smithi069.stdout:1/798: write d1/f5 [7569703,50646] 0 2024-04-25T17:19:26.650 INFO:tasks.workunit.client.1.smithi069.stdout:0/725: mknod d0/d17/d83/cfa 0 2024-04-25T17:19:26.652 INFO:tasks.workunit.client.1.smithi069.stdout:1/799: dwrite d1/df/f34 [0,4194304] 0 2024-04-25T17:19:26.653 INFO:tasks.workunit.client.1.smithi069.stdout:9/779: mknod d2/da/dd/de/d74/dbc/df8/c10e 0 2024-04-25T17:19:26.656 INFO:tasks.workunit.client.1.smithi069.stdout:5/861: mkdir d13/d17/d19/d20/d2d/d10e/d12a 0 2024-04-25T17:19:26.659 INFO:tasks.workunit.client.1.smithi069.stdout:7/825: symlink d4/d3e/d94/da1/dc7/l113 0 2024-04-25T17:19:26.661 INFO:tasks.workunit.client.1.smithi069.stdout:8/834: creat d37/d47/f120 x:0 0 0 2024-04-25T17:19:26.665 INFO:tasks.workunit.client.1.smithi069.stdout:5/862: symlink d13/dff/d10d/l12b 0 2024-04-25T17:19:26.667 INFO:tasks.workunit.client.1.smithi069.stdout:1/800: mkdir d1/d4/d6/d9e/da6/d7c/dfa 0 2024-04-25T17:19:26.668 INFO:tasks.workunit.client.1.smithi069.stdout:6/820: truncate d2/d7/f25 2165329 0 2024-04-25T17:19:26.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:26 smithi069 ceph-mon[34527]: from='client.14738 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:19:26.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:26 smithi069 ceph-mon[34527]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:19:26.669 INFO:tasks.workunit.client.1.smithi069.stdout:5/863: chown d13/d17/d29/d30/d9c/fb6 119 1 2024-04-25T17:19:26.669 INFO:tasks.workunit.client.1.smithi069.stdout:3/860: dwrite d8/d71/d8d/d92/db6/dc1/d42/f7e [0,4194304] 0 2024-04-25T17:19:26.669 INFO:tasks.workunit.client.1.smithi069.stdout:7/826: creat d4/d3e/d94/da1/dc7/d14/dcf/f114 x:0 0 0 2024-04-25T17:19:26.669 INFO:tasks.workunit.client.0.smithi037.stdout:7/718: write d5/d15/d17/d1b/da2/daf/fb9 [3524416,98037] 0 2024-04-25T17:19:26.670 INFO:tasks.workunit.client.1.smithi069.stdout:9/780: dread d2/fa1 [0,4194304] 0 2024-04-25T17:19:26.677 INFO:tasks.workunit.client.1.smithi069.stdout:0/726: creat d0/da/ffb x:0 0 0 2024-04-25T17:19:26.678 INFO:tasks.workunit.client.1.smithi069.stdout:6/821: rmdir d2/d1e 39 2024-04-25T17:19:26.678 INFO:tasks.workunit.client.0.smithi037.stdout:7/719: mknod d5/d15/d17/d1b/cf3 0 2024-04-25T17:19:26.679 INFO:tasks.workunit.client.0.smithi037.stdout:7/720: chown d5/d15/d17/d1b/da2/d76/l87 55472 1 2024-04-25T17:19:26.681 INFO:tasks.workunit.client.0.smithi037.stdout:7/721: write d5/d15/d17/d1b/da2/daf/f2a [550269,21646] 0 2024-04-25T17:19:26.686 INFO:tasks.workunit.client.0.smithi037.stdout:7/722: unlink d5/d15/d17/d25/c6e 0 2024-04-25T17:19:26.690 INFO:tasks.workunit.client.0.smithi037.stdout:7/723: fdatasync d5/f37 0 2024-04-25T17:19:26.692 INFO:tasks.workunit.client.0.smithi037.stdout:7/724: chown d5/d15/d17/d1b/da2/fdd 199711 1 2024-04-25T17:19:26.698 INFO:tasks.workunit.client.0.smithi037.stdout:7/725: dwrite d5/d15/d17/d25/d2b/fd2 [0,4194304] 0 2024-04-25T17:19:26.701 INFO:tasks.workunit.client.0.smithi037.stdout:7/726: dread - d5/d14/d31/f9f zero size 2024-04-25T17:19:26.707 INFO:tasks.workunit.client.1.smithi069.stdout:7/827: fdatasync d4/dbb/fdd 0 2024-04-25T17:19:26.707 INFO:tasks.workunit.client.1.smithi069.stdout:4/805: link db/d15/d20/d35/d63/d75/cac db/d15/d20/d35/d63/c11d 0 2024-04-25T17:19:26.707 INFO:tasks.workunit.client.1.smithi069.stdout:0/727: rename d0/da/db/d1d to d0/da/d24/d43/dfc 0 2024-04-25T17:19:26.708 INFO:tasks.workunit.client.1.smithi069.stdout:8/835: write d37/d47/d48/f83 [1855612,52777] 0 2024-04-25T17:19:26.710 INFO:tasks.workunit.client.1.smithi069.stdout:1/801: truncate d1/d4/d6/d9e/da6/d7c/d1d/de1/fa4 744237 0 2024-04-25T17:19:26.712 INFO:tasks.workunit.client.1.smithi069.stdout:0/728: symlink d0/d17/lfd 0 2024-04-25T17:19:26.713 INFO:tasks.workunit.client.1.smithi069.stdout:6/822: mkdir d2/d1e/d3e/d115 0 2024-04-25T17:19:26.715 INFO:tasks.workunit.client.1.smithi069.stdout:7/828: chown d4/d1a/f24 132605131 1 2024-04-25T17:19:26.715 INFO:tasks.workunit.client.1.smithi069.stdout:3/861: dwrite d8/d16/d4b/d9e/f11c [0,4194304] 0 2024-04-25T17:19:26.717 INFO:tasks.workunit.client.1.smithi069.stdout:4/806: truncate db/d15/d42/d64/f67 6635722 0 2024-04-25T17:19:26.717 INFO:tasks.workunit.client.1.smithi069.stdout:4/807: chown db/d15/d20/d35/d63/d43/lb3 1178244 1 2024-04-25T17:19:26.719 INFO:tasks.workunit.client.1.smithi069.stdout:4/808: write db/d15/f18 [1682907,33804] 0 2024-04-25T17:19:26.719 INFO:tasks.workunit.client.1.smithi069.stdout:7/829: creat d4/d83/f115 x:0 0 0 2024-04-25T17:19:26.721 INFO:tasks.workunit.client.1.smithi069.stdout:7/830: readlink d4/d3e/d94/da1/dc7/d14/d5a/d5e/lec 0 2024-04-25T17:19:26.721 INFO:tasks.workunit.client.1.smithi069.stdout:7/831: readlink d4/d3e/d94/da1/dc7/d14/d44/da8/lf4 0 2024-04-25T17:19:26.726 INFO:tasks.workunit.client.0.smithi037.stdout:7/727: dwrite d5/d15/d17/d1b/da2/d76/f77 [4194304,4194304] 0 2024-04-25T17:19:26.730 INFO:tasks.workunit.client.0.smithi037.stdout:7/728: rmdir d5/d15/d17 39 2024-04-25T17:19:26.737 INFO:tasks.workunit.client.1.smithi069.stdout:8/836: dwrite d37/d47/d78/db3/d114/f97 [4194304,4194304] 0 2024-04-25T17:19:26.737 INFO:tasks.workunit.client.1.smithi069.stdout:0/729: rename d0/da/db/d2a/f3f to d0/da/db/d56/ffe 0 2024-04-25T17:19:26.737 INFO:tasks.workunit.client.0.smithi037.stdout:7/729: symlink d5/d15/d17/d1b/da2/d76/lf4 0 2024-04-25T17:19:26.738 INFO:tasks.workunit.client.1.smithi069.stdout:4/809: creat db/d15/d20/d35/d63/f11e x:0 0 0 2024-04-25T17:19:26.741 INFO:tasks.workunit.client.1.smithi069.stdout:3/862: dwrite d8/d71/d8d/f102 [0,4194304] 0 2024-04-25T17:19:26.741 INFO:tasks.workunit.client.0.smithi037.stdout:7/730: mknod d5/d15/d17/d9d/cf5 0 2024-04-25T17:19:26.744 INFO:tasks.workunit.client.1.smithi069.stdout:8/837: fdatasync d37/d47/ffd 0 2024-04-25T17:19:26.744 INFO:tasks.workunit.client.1.smithi069.stdout:4/810: fdatasync db/d15/fa9 0 2024-04-25T17:19:26.744 INFO:tasks.workunit.client.0.smithi037.stdout:7/731: fdatasync d5/d14/dd3/fd7 0 2024-04-25T17:19:26.747 INFO:tasks.workunit.client.1.smithi069.stdout:1/802: rename d1/d4/d6/d9e/da6/d7c/d1d/de1/fa4 to d1/d4/de/d44/d68/ffb 0 2024-04-25T17:19:26.752 INFO:tasks.workunit.client.0.smithi037.stdout:7/732: rename d5/d15/f1e to d5/d15/d17/d1b/da2/daf/ff6 0 2024-04-25T17:19:26.754 INFO:tasks.workunit.client.1.smithi069.stdout:8/838: chown fe 6004845 1 2024-04-25T17:19:26.754 INFO:tasks.workunit.client.1.smithi069.stdout:7/832: dread d4/d3e/d94/fd0 [0,4194304] 0 2024-04-25T17:19:26.755 INFO:tasks.workunit.client.1.smithi069.stdout:7/833: truncate d4/d3e/d94/da1/dc7/d14/d5a/fe4 313088 0 2024-04-25T17:19:26.760 INFO:tasks.workunit.client.1.smithi069.stdout:0/730: rename d0/d17/d95/fa7 to d0/d17/d40/fff 0 2024-04-25T17:19:26.761 INFO:tasks.workunit.client.1.smithi069.stdout:0/731: write d0/da/ffb [658628,97774] 0 2024-04-25T17:19:26.762 INFO:tasks.workunit.client.0.smithi037.stdout:7/733: dwrite d5/d15/d17/d1b/da2/d76/fc3 [0,4194304] 0 2024-04-25T17:19:26.762 INFO:tasks.workunit.client.1.smithi069.stdout:2/804: sync 2024-04-25T17:19:26.765 INFO:tasks.workunit.client.1.smithi069.stdout:1/803: mkdir d1/d4/d6/d9e/da6/d7c/d1d/de1/d8e/dbb/dfc 0 2024-04-25T17:19:26.765 INFO:tasks.workunit.client.1.smithi069.stdout:3/863: write d8/d16/d1a/d99/fd6 [838637,50642] 0 2024-04-25T17:19:26.766 INFO:tasks.workunit.client.1.smithi069.stdout:8/839: unlink d37/f45 0 2024-04-25T17:19:26.767 INFO:tasks.workunit.client.1.smithi069.stdout:8/840: stat d37/d47/d54/fae 0 2024-04-25T17:19:26.768 INFO:tasks.workunit.client.1.smithi069.stdout:1/804: dread d1/df/d17/f3b [0,4194304] 0 2024-04-25T17:19:26.769 INFO:tasks.workunit.client.1.smithi069.stdout:7/834: creat d4/d3e/d94/da1/dc7/d14/d15/f116 x:0 0 0 2024-04-25T17:19:26.782 INFO:tasks.workunit.client.0.smithi037.stdout:7/734: write d5/d14/d31/f62 [2591486,54957] 0 2024-04-25T17:19:26.792 INFO:tasks.workunit.client.0.smithi037.stdout:7/735: dwrite d5/f6b [0,4194304] 0 2024-04-25T17:19:26.793 INFO:tasks.workunit.client.0.smithi037.stdout:7/736: readlink d5/d14/l4e 0 2024-04-25T17:19:26.795 INFO:tasks.workunit.client.0.smithi037.stdout:7/737: mkdir d5/d15/d17/d25/d2b/d59/df7 0 2024-04-25T17:19:26.797 INFO:tasks.workunit.client.0.smithi037.stdout:8/727: sync 2024-04-25T17:19:26.798 INFO:tasks.workunit.client.0.smithi037.stdout:7/738: truncate d5/d15/d17/d25/d2b/d59/f6c 1354458 0 2024-04-25T17:19:26.800 INFO:tasks.workunit.client.0.smithi037.stdout:7/739: dread - d5/d15/d17/d1b/da2/fc0 zero size 2024-04-25T17:19:26.802 INFO:tasks.workunit.client.0.smithi037.stdout:8/728: creat d5/db/d23/d78/d9c/ded/fee x:0 0 0 2024-04-25T17:19:26.803 INFO:tasks.workunit.client.0.smithi037.stdout:8/729: chown d5/db/d59/fcd 6 1 2024-04-25T17:19:26.803 INFO:tasks.workunit.client.0.smithi037.stdout:7/740: truncate d5/d15/f19 3146711 0 2024-04-25T17:19:26.805 INFO:tasks.workunit.client.0.smithi037.stdout:8/730: symlink d5/da/lef 0 2024-04-25T17:19:26.806 INFO:tasks.workunit.client.0.smithi037.stdout:8/731: chown d5/db/d18/d3b/d50/fd5 0 1 2024-04-25T17:19:26.816 INFO:tasks.workunit.client.1.smithi069.stdout:2/805: read - d0/d56/d5f/d62/d7d/fa8 zero size 2024-04-25T17:19:26.817 INFO:tasks.workunit.client.1.smithi069.stdout:3/864: rename d8/d2a/c114 to d8/d16/d1a/d99/dab/c120 0 2024-04-25T17:19:26.817 INFO:tasks.workunit.client.1.smithi069.stdout:4/811: dread db/f52 [0,4194304] 0 2024-04-25T17:19:26.817 INFO:tasks.workunit.client.1.smithi069.stdout:0/732: link d0/da/db/d2c/f33 d0/d17/d83/dcf/de4/f100 0 2024-04-25T17:19:26.818 INFO:tasks.workunit.client.1.smithi069.stdout:8/841: write d37/d47/d78/d93/f94 [3346737,104101] 0 2024-04-25T17:19:26.819 INFO:tasks.workunit.client.1.smithi069.stdout:0/733: chown d0/da/d54/d7d/fd6 991308253 1 2024-04-25T17:19:26.820 INFO:tasks.workunit.client.1.smithi069.stdout:7/835: mkdir d4/d3e/d94/da1/dc7/d14/d44/d7c/d117 0 2024-04-25T17:19:26.821 INFO:tasks.workunit.client.1.smithi069.stdout:8/842: write d37/d47/d78/db3/d114/d6b/daf/feb [1322137,44458] 0 2024-04-25T17:19:26.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:26 smithi037 ceph-mon[26472]: from='client.14738 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:19:26.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:26 smithi037 ceph-mon[26472]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:19:26.823 INFO:tasks.workunit.client.1.smithi069.stdout:2/806: creat d0/d26/d107/f10a x:0 0 0 2024-04-25T17:19:26.826 INFO:tasks.workunit.client.1.smithi069.stdout:3/865: unlink d8/d16/d1a/d38/f66 0 2024-04-25T17:19:26.828 INFO:tasks.workunit.client.1.smithi069.stdout:1/805: truncate d1/d4/de/d44/d68/ffb 791767 0 2024-04-25T17:19:26.836 INFO:tasks.workunit.client.1.smithi069.stdout:0/734: dread d0/da/d24/d43/dfc/fba [0,4194304] 0 2024-04-25T17:19:26.839 INFO:tasks.workunit.client.1.smithi069.stdout:3/866: mkdir d8/d71/d8d/d92/d121 0 2024-04-25T17:19:26.839 INFO:tasks.workunit.client.1.smithi069.stdout:7/836: dread d4/d3e/d94/da1/dc7/f52 [0,4194304] 0 2024-04-25T17:19:26.840 INFO:tasks.workunit.client.1.smithi069.stdout:1/806: mknod d1/d4/de/d63/cfd 0 2024-04-25T17:19:26.842 INFO:tasks.workunit.client.1.smithi069.stdout:5/864: sync 2024-04-25T17:19:26.843 INFO:tasks.workunit.client.1.smithi069.stdout:4/812: mkdir db/d4b/d78/dc4/d41/d9e/df2/d11f 0 2024-04-25T17:19:26.846 INFO:tasks.workunit.client.1.smithi069.stdout:2/807: mknod d0/d56/d5f/d62/d7d/d72/c10b 0 2024-04-25T17:19:26.852 INFO:tasks.workunit.client.1.smithi069.stdout:7/837: creat d4/d3e/d94/da1/dc7/d14/d5a/d5e/d89/f118 x:0 0 0 2024-04-25T17:19:26.855 INFO:tasks.workunit.client.1.smithi069.stdout:3/867: rename d8/d16/d1a/d2c/d49/d87/d8a/d8e/d95/f106 to d8/d16/d4b/d9e/deb/f122 0 2024-04-25T17:19:26.857 INFO:tasks.workunit.client.1.smithi069.stdout:1/807: truncate d1/df/d17/fa1 518673 0 2024-04-25T17:19:26.859 INFO:tasks.workunit.client.1.smithi069.stdout:4/813: mknod db/d15/d20/d35/d63/d75/de6/c120 0 2024-04-25T17:19:26.862 INFO:tasks.workunit.client.1.smithi069.stdout:1/808: dwrite d1/d4/d6/d4f/dcb/fd4 [0,4194304] 0 2024-04-25T17:19:26.867 INFO:tasks.workunit.client.1.smithi069.stdout:3/868: mkdir d8/d16/d4b/d9e/deb/d123 0 2024-04-25T17:19:26.868 INFO:tasks.workunit.client.1.smithi069.stdout:4/814: fdatasync db/d15/fa9 0 2024-04-25T17:19:26.870 INFO:tasks.workunit.client.1.smithi069.stdout:5/865: truncate d13/d17/d29/d30/d9c/fb6 763640 0 2024-04-25T17:19:26.881 INFO:tasks.workunit.client.1.smithi069.stdout:7/838: symlink d4/d3e/d94/da1/dc7/d14/d5a/l119 0 2024-04-25T17:19:26.889 INFO:tasks.workunit.client.1.smithi069.stdout:1/809: getdents d1/d4/d6/d4f/d9b/da3/df9 0 2024-04-25T17:19:26.889 INFO:tasks.workunit.client.1.smithi069.stdout:1/810: fdatasync d1/d4/d6/fde 0 2024-04-25T17:19:26.890 INFO:tasks.workunit.client.1.smithi069.stdout:0/735: getdents d0/da/db/d7e 0 2024-04-25T17:19:26.896 INFO:tasks.workunit.client.0.smithi037.stdout:7/741: link d5/d15/d17/d1b/c6d d5/d15/cf8 0 2024-04-25T17:19:26.898 INFO:tasks.workunit.client.0.smithi037.stdout:8/732: mkdir d5/db/d23/d78/d93/dcc/df0 0 2024-04-25T17:19:26.899 INFO:tasks.workunit.client.0.smithi037.stdout:8/733: chown d5/d26/d33/f34 136606 1 2024-04-25T17:19:26.900 INFO:tasks.workunit.client.0.smithi037.stdout:8/734: stat d5/db/d23/d78/d93/fb9 0 2024-04-25T17:19:26.901 INFO:tasks.workunit.client.1.smithi069.stdout:9/781: sync 2024-04-25T17:19:26.908 INFO:tasks.workunit.client.0.smithi037.stdout:7/742: getdents d5/d15/d17/d1b/d94/da8 0 2024-04-25T17:19:26.911 INFO:tasks.workunit.client.0.smithi037.stdout:7/743: read - d5/d15/d17/d1b/da2/fd4 zero size 2024-04-25T17:19:26.914 INFO:tasks.workunit.client.0.smithi037.stdout:7/744: symlink d5/d14/dcf/lf9 0 2024-04-25T17:19:26.919 INFO:tasks.workunit.client.0.smithi037.stdout:7/745: dwrite d5/d15/d17/d25/d2b/f52 [0,4194304] 0 2024-04-25T17:19:26.920 INFO:tasks.workunit.client.0.smithi037.stdout:7/746: fdatasync d5/d14/d31/fe7 0 2024-04-25T17:19:26.921 INFO:tasks.workunit.client.0.smithi037.stdout:7/747: chown d5/f7c 240266494 1 2024-04-25T17:19:26.926 INFO:tasks.workunit.client.0.smithi037.stdout:7/748: fdatasync d5/d15/d17/f1c 0 2024-04-25T17:19:26.933 INFO:tasks.workunit.client.0.smithi037.stdout:3/687: sync 2024-04-25T17:19:26.933 INFO:tasks.workunit.client.0.smithi037.stdout:5/854: sync 2024-04-25T17:19:26.946 INFO:tasks.workunit.client.0.smithi037.stdout:3/688: rename d8/d31/d32/d3e to d8/d31/d32/dd7 0 2024-04-25T17:19:26.948 INFO:tasks.workunit.client.0.smithi037.stdout:5/855: link d7/d12/d6f/dbf/fc5 d7/d63/db2/f106 0 2024-04-25T17:19:26.952 INFO:tasks.workunit.client.1.smithi069.stdout:8/843: sync 2024-04-25T17:19:26.953 INFO:tasks.workunit.client.1.smithi069.stdout:3/869: sync 2024-04-25T17:19:26.953 INFO:tasks.workunit.client.1.smithi069.stdout:6/823: sync 2024-04-25T17:19:26.954 INFO:tasks.workunit.client.0.smithi037.stdout:5/856: rename d7/d12/d5d/d90/db1/lca to d7/d43/d9f/l107 0 2024-04-25T17:19:26.955 INFO:tasks.workunit.client.1.smithi069.stdout:3/870: chown d8/d16/d1a/d2c/d6c 491274 1 2024-04-25T17:19:26.955 INFO:tasks.workunit.client.1.smithi069.stdout:6/824: dread - d2/d1e/d3f/d56/de5/f105 zero size 2024-04-25T17:19:26.955 INFO:tasks.workunit.client.1.smithi069.stdout:4/815: dwrite db/d4b/d78/dc4/d41/d9e/fc7 [0,4194304] 0 2024-04-25T17:19:26.956 INFO:tasks.workunit.client.0.smithi037.stdout:3/689: mkdir d8/dd8 0 2024-04-25T17:19:26.957 INFO:tasks.workunit.client.0.smithi037.stdout:3/690: chown d8/d23/f93 1338482939 1 2024-04-25T17:19:26.959 INFO:tasks.workunit.client.1.smithi069.stdout:2/808: getdents d0/d1/d5b/d33 0 2024-04-25T17:19:26.960 INFO:tasks.workunit.client.1.smithi069.stdout:0/736: symlink d0/d17/l101 0 2024-04-25T17:19:26.967 INFO:tasks.workunit.client.1.smithi069.stdout:7/839: creat d4/d3e/d94/da1/dc7/d14/d5a/d5e/df9/f11a x:0 0 0 2024-04-25T17:19:26.968 INFO:tasks.workunit.client.1.smithi069.stdout:9/782: dwrite d2/fa1 [0,4194304] 0 2024-04-25T17:19:26.969 INFO:tasks.workunit.client.1.smithi069.stdout:7/840: readlink d4/d3e/d94/da1/dc7/d14/d5a/le6 0 2024-04-25T17:19:26.970 INFO:tasks.workunit.client.0.smithi037.stdout:8/735: dwrite d5/db/d18/d3b/d75/fbf [0,4194304] 0 2024-04-25T17:19:26.971 INFO:tasks.workunit.client.1.smithi069.stdout:8/844: unlink d37/d47/d78/db3/d114/d6b/f7e 0 2024-04-25T17:19:26.972 INFO:tasks.workunit.client.0.smithi037.stdout:8/736: chown d5/db/d18/d3b/d50/da0/da6/lae 3040 1 2024-04-25T17:19:26.975 INFO:tasks.workunit.client.1.smithi069.stdout:4/816: fdatasync db/f11 0 2024-04-25T17:19:26.976 INFO:tasks.workunit.client.1.smithi069.stdout:9/783: dread d2/da/dd/de/f48 [0,4194304] 0 2024-04-25T17:19:26.979 INFO:tasks.workunit.client.0.smithi037.stdout:8/737: rename d5/d6a/db0 to d5/db/d18/d3b/d50/da0/df1 0 2024-04-25T17:19:26.981 INFO:tasks.workunit.client.1.smithi069.stdout:3/871: rename d8/d16/d31/l80 to d8/d16/d9b/dc3/l124 0 2024-04-25T17:19:26.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:26.981+0000 7fd3c3fff700 1 -- 172.21.15.37:0/1931452126 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd3bc005860 con 0x7fd3d8071e40 2024-04-25T17:19:26.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:26.981+0000 7fd3ce7fc700 1 -- 172.21.15.37:0/1931452126 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1830 (secure 0 0 0) 0x7fd3c805a910 con 0x7fd3d8071e40 2024-04-25T17:19:26.982 INFO:teuthology.orchestra.run.smithi037.stdout:e16 2024-04-25T17:19:26.982 INFO:teuthology.orchestra.run.smithi037.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-25T17:19:26.982 INFO:teuthology.orchestra.run.smithi037.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T17:19:26.982 INFO:teuthology.orchestra.run.smithi037.stdout:legacy client fscid: 1 2024-04-25T17:19:26.982 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:19:26.982 INFO:teuthology.orchestra.run.smithi037.stdout:Filesystem 'cephfs' (1) 2024-04-25T17:19:26.983 INFO:teuthology.orchestra.run.smithi037.stdout:fs_name cephfs 2024-04-25T17:19:26.983 INFO:teuthology.orchestra.run.smithi037.stdout:epoch 16 2024-04-25T17:19:26.983 INFO:teuthology.orchestra.run.smithi037.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-25T17:19:26.983 INFO:teuthology.orchestra.run.smithi037.stdout:created 2024-04-25T17:15:40.586130+0000 2024-04-25T17:19:26.983 INFO:teuthology.orchestra.run.smithi037.stdout:modified 2024-04-25T17:15:57.508740+0000 2024-04-25T17:19:26.983 INFO:teuthology.orchestra.run.smithi037.stdout:tableserver 0 2024-04-25T17:19:26.983 INFO:teuthology.orchestra.run.smithi037.stdout:root 0 2024-04-25T17:19:26.983 INFO:teuthology.orchestra.run.smithi037.stdout:session_timeout 60 2024-04-25T17:19:26.983 INFO:teuthology.orchestra.run.smithi037.stdout:session_autoclose 300 2024-04-25T17:19:26.983 INFO:teuthology.orchestra.run.smithi037.stdout:max_file_size 1099511627776 2024-04-25T17:19:26.983 INFO:teuthology.orchestra.run.smithi037.stdout:required_client_features {} 2024-04-25T17:19:26.983 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure 0 2024-04-25T17:19:26.983 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure_osd_epoch 0 2024-04-25T17:19:26.983 INFO:teuthology.orchestra.run.smithi037.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T17:19:26.984 INFO:teuthology.orchestra.run.smithi037.stdout:max_mds 1 2024-04-25T17:19:26.984 INFO:teuthology.orchestra.run.smithi037.stdout:in 0 2024-04-25T17:19:26.984 INFO:teuthology.orchestra.run.smithi037.stdout:up {0=14470} 2024-04-25T17:19:26.984 INFO:teuthology.orchestra.run.smithi037.stdout:failed 2024-04-25T17:19:26.984 INFO:teuthology.orchestra.run.smithi037.stdout:damaged 2024-04-25T17:19:26.984 INFO:teuthology.orchestra.run.smithi037.stdout:stopped 2024-04-25T17:19:26.984 INFO:teuthology.orchestra.run.smithi037.stdout:data_pools [3] 2024-04-25T17:19:26.984 INFO:teuthology.orchestra.run.smithi037.stdout:metadata_pool 2 2024-04-25T17:19:26.984 INFO:teuthology.orchestra.run.smithi037.stdout:inline_data disabled 2024-04-25T17:19:26.984 INFO:teuthology.orchestra.run.smithi037.stdout:balancer 2024-04-25T17:19:26.984 INFO:teuthology.orchestra.run.smithi037.stdout:standby_count_wanted 1 2024-04-25T17:19:26.984 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi037.ksmixc{0:14470} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.37:6826/1903989494,v1:172.21.15.37:6827/1903989494] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:19:26.985 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi037.ovkrpq{0:14482} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.37:6828/4206394422,v1:172.21.15.37:6829/4206394422] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:19:26.985 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:19:26.985 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:19:26.985 INFO:teuthology.orchestra.run.smithi037.stdout:Standby daemons: 2024-04-25T17:19:26.985 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:19:26.985 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi069.cpprst{-1:24289} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.69:6826/518856100,v1:172.21.15.69:6827/518856100] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:19:26.985 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi069.ytlqcf{-1:24293} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.69:6824/134210439,v1:172.21.15.69:6825/134210439] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:19:26.986 INFO:tasks.workunit.client.1.smithi069.stdout:2/809: rmdir d0/d26/d10/db5/de3 39 2024-04-25T17:19:26.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:26.984+0000 7fd3c3fff700 1 -- 172.21.15.37:0/1931452126 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7fd3c406fcc0 msgr2=0x7fd3c4072170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:19:26.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:26.984+0000 7fd3c3fff700 1 --2- 172.21.15.37:0/1931452126 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7fd3c406fcc0 0x7fd3c4072170 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd3d4006fd0 tx=0x7fd3d4006db0 comp rx=0 tx=0).stop 2024-04-25T17:19:26.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:26.984+0000 7fd3c3fff700 1 -- 172.21.15.37:0/1931452126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3d8071e40 msgr2=0x7fd3d81144a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:19:26.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:26.984+0000 7fd3c3fff700 1 --2- 172.21.15.37:0/1931452126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3d8071e40 0x7fd3d81144a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8009150 tx=0x7fd3c8009e30 comp rx=0 tx=0).stop 2024-04-25T17:19:26.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:26.984+0000 7fd3c3fff700 1 -- 172.21.15.37:0/1931452126 shutdown_connections 2024-04-25T17:19:26.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:26.984+0000 7fd3c3fff700 1 --2- 172.21.15.37:0/1931452126 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7fd3c406fcc0 0x7fd3c4072170 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:26.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:26.984+0000 7fd3c3fff700 1 --2- 172.21.15.37:0/1931452126 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3d8070890 0x7fd3d8113f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:26.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:26.984+0000 7fd3c3fff700 1 --2- 172.21.15.37:0/1931452126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3d8071e40 0x7fd3d81144a0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:26.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:26.984+0000 7fd3c3fff700 1 -- 172.21.15.37:0/1931452126 >> 172.21.15.37:0/1931452126 conn(0x7fd3d80f8520 msgr2=0x7fd3d80f9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:19:26.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:26.985+0000 7fd3c3fff700 1 -- 172.21.15.37:0/1931452126 shutdown_connections 2024-04-25T17:19:26.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:26.985+0000 7fd3c3fff700 1 -- 172.21.15.37:0/1931452126 wait complete. 2024-04-25T17:19:26.987 INFO:tasks.workunit.client.0.smithi037.stdout:8/738: symlink d5/dbc/lf2 0 2024-04-25T17:19:26.988 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 16 2024-04-25T17:19:26.988 INFO:tasks.workunit.client.1.smithi069.stdout:1/811: sync 2024-04-25T17:19:26.988 INFO:tasks.workunit.client.1.smithi069.stdout:0/737: mkdir d0/da/d24/d43/d102 0 2024-04-25T17:19:26.988 INFO:tasks.workunit.client.1.smithi069.stdout:7/841: mkdir d4/d3e/d94/da1/dc7/d14/d15/d11b 0 2024-04-25T17:19:26.990 INFO:tasks.workunit.client.1.smithi069.stdout:2/810: dwrite d0/d26/d10/ffa [0,4194304] 0 2024-04-25T17:19:26.991 INFO:tasks.workunit.client.1.smithi069.stdout:8/845: symlink d37/d47/d78/d93/df9/l121 0 2024-04-25T17:19:26.992 INFO:tasks.workunit.client.1.smithi069.stdout:7/842: read d4/d3e/d94/da1/dc7/d14/d3d/df6/f68 [905101,20060] 0 2024-04-25T17:19:26.992 INFO:tasks.workunit.client.0.smithi037.stdout:6/816: sync 2024-04-25T17:19:26.993 INFO:tasks.workunit.client.0.smithi037.stdout:1/931: sync 2024-04-25T17:19:26.993 INFO:tasks.workunit.client.0.smithi037.stdout:2/919: sync 2024-04-25T17:19:26.993 INFO:tasks.workunit.client.0.smithi037.stdout:0/870: sync 2024-04-25T17:19:26.993 INFO:tasks.workunit.client.1.smithi069.stdout:7/843: chown d4/d3e/f80 264 1 2024-04-25T17:19:26.996 INFO:tasks.workunit.client.1.smithi069.stdout:6/825: mknod d2/d1e/d43/db6/daf/c116 0 2024-04-25T17:19:27.002 INFO:tasks.workunit.client.0.smithi037.stdout:0/871: chown d9/df/dbd/dc1/de2/f10a 232167 1 2024-04-25T17:19:27.004 INFO:tasks.workunit.client.1.smithi069.stdout:3/872: symlink d8/d16/d1a/d2c/d49/d87/d8a/d8e/d95/l125 0 2024-04-25T17:19:27.004 INFO:tasks.workunit.client.1.smithi069.stdout:3/873: chown d8/d71/lb4 23968188 1 2024-04-25T17:19:27.008 INFO:tasks.workunit.client.0.smithi037.stdout:6/817: truncate db/d26/f2b 1391580 0 2024-04-25T17:19:27.009 INFO:tasks.workunit.client.0.smithi037.stdout:7/749: dwrite d5/d15/dd8/fbb [0,4194304] 0 2024-04-25T17:19:27.010 INFO:tasks.workunit.client.1.smithi069.stdout:1/812: write d1/d4/d6/d9e/da6/d7c/fe8 [2493788,14466] 0 2024-04-25T17:19:27.011 INFO:tasks.workunit.client.0.smithi037.stdout:0/872: symlink d9/df/d32/d39/dd3/l11b 0 2024-04-25T17:19:27.012 INFO:tasks.workunit.client.0.smithi037.stdout:0/873: chown d9/d14/d28/d48/c6d 1773 1 2024-04-25T17:19:27.013 INFO:tasks.workunit.client.0.smithi037.stdout:1/932: getdents dc/d52/d6b/dd9/d4d/d6a/d8f/ddc/dee/dfc/d134 0 2024-04-25T17:19:27.015 INFO:tasks.workunit.client.1.smithi069.stdout:2/811: symlink d0/d26/l10c 0 2024-04-25T17:19:27.017 INFO:tasks.workunit.client.1.smithi069.stdout:8/846: rmdir d37/d47/d54/dcc 39 2024-04-25T17:19:27.018 INFO:tasks.workunit.client.1.smithi069.stdout:8/847: readlink d37/d47/d78/db3/d114/d6b/l80 0 2024-04-25T17:19:27.020 INFO:tasks.workunit.client.1.smithi069.stdout:3/874: dread d8/d71/d8d/d92/db6/fda [0,4194304] 0 2024-04-25T17:19:27.022 INFO:tasks.workunit.client.1.smithi069.stdout:7/844: symlink d4/d3e/d94/da1/dc7/d14/d5a/d5e/d89/l11c 0 2024-04-25T17:19:27.023 INFO:tasks.workunit.client.1.smithi069.stdout:7/845: write d4/d3e/d94/da1/dc7/d14/d44/d88/ff2 [2727921,45062] 0 2024-04-25T17:19:27.023 INFO:tasks.workunit.client.0.smithi037.stdout:6/818: mknod db/d26/d2e/d3e/d25/d10b/d10e/c128 0 2024-04-25T17:19:27.024 INFO:tasks.workunit.client.1.smithi069.stdout:6/826: chown d2/c28 885348 1 2024-04-25T17:19:27.026 INFO:tasks.workunit.client.1.smithi069.stdout:4/817: creat db/d15/d42/d64/d7f/df7/f121 x:0 0 0 2024-04-25T17:19:27.029 INFO:tasks.workunit.client.1.smithi069.stdout:5/866: truncate d13/d17/d29/d2e/f83 1626290 0 2024-04-25T17:19:27.029 INFO:tasks.workunit.client.1.smithi069.stdout:5/867: chown d13/d17/d19/d1c/d79/l105 259070455 1 2024-04-25T17:19:27.030 INFO:tasks.workunit.client.0.smithi037.stdout:7/750: mknod d5/d15/cfa 0 2024-04-25T17:19:27.032 INFO:tasks.workunit.client.1.smithi069.stdout:5/868: chown d13/d17/d19/d1c/da4/da9/l123 13597 1 2024-04-25T17:19:27.033 INFO:tasks.workunit.client.0.smithi037.stdout:3/691: write d8/f26 [1065697,3913] 0 2024-04-25T17:19:27.035 INFO:tasks.workunit.client.0.smithi037.stdout:5/857: truncate d7/d18/f98 2089265 0 2024-04-25T17:19:27.040 INFO:tasks.workunit.client.0.smithi037.stdout:6/819: dwrite db/d1d/d20/dcf/dfa/d65/fdd [0,4194304] 0 2024-04-25T17:19:27.043 INFO:tasks.workunit.client.1.smithi069.stdout:1/813: mkdir d1/d4/d6/d81/dfe 0 2024-04-25T17:19:27.045 INFO:tasks.workunit.client.0.smithi037.stdout:7/751: chown d5/d15/d17/d25/d2b/d59/f6c 1166055 1 2024-04-25T17:19:27.050 INFO:tasks.workunit.client.0.smithi037.stdout:7/752: dread d5/d15/d17/d1b/da2/daf/ff6 [0,4194304] 0 2024-04-25T17:19:27.050 INFO:tasks.workunit.client.1.smithi069.stdout:2/812: symlink d0/d26/df3/l10d 0 2024-04-25T17:19:27.055 INFO:tasks.workunit.client.1.smithi069.stdout:3/875: write d8/d16/d4b/d9e/deb/f122 [87830,28144] 0 2024-04-25T17:19:27.056 INFO:tasks.workunit.client.1.smithi069.stdout:2/813: dwrite d0/d26/d10/f97 [4194304,4194304] 0 2024-04-25T17:19:27.059 INFO:tasks.workunit.client.0.smithi037.stdout:1/933: mknod dc/d52/d6b/dd9/d4d/d6a/d86/d9b/c142 0 2024-04-25T17:19:27.059 INFO:tasks.workunit.client.0.smithi037.stdout:8/739: dwrite d5/da/f11 [4194304,4194304] 0 2024-04-25T17:19:27.064 INFO:tasks.workunit.client.0.smithi037.stdout:6/820: creat db/d1d/d20/dcf/dfa/d65/d68/d87/f129 x:0 0 0 2024-04-25T17:19:27.067 INFO:tasks.workunit.client.0.smithi037.stdout:7/753: mknod d5/dc1/de1/cfb 0 2024-04-25T17:19:27.068 INFO:tasks.workunit.client.0.smithi037.stdout:2/920: dwrite d0/d16/d20/d55/fa1 [0,4194304] 0 2024-04-25T17:19:27.070 INFO:tasks.workunit.client.0.smithi037.stdout:2/921: chown d0/d23/dac/d4b/ded 2 1 2024-04-25T17:19:27.070 INFO:tasks.workunit.client.0.smithi037.stdout:7/754: stat d5/d15/d17/d9d/cf5 0 2024-04-25T17:19:27.070 INFO:tasks.workunit.client.1.smithi069.stdout:4/818: mkdir db/d15/d82/da7/d122 0 2024-04-25T17:19:27.076 INFO:tasks.workunit.client.0.smithi037.stdout:3/692: mknod d8/dd8/cd9 0 2024-04-25T17:19:27.077 INFO:tasks.workunit.client.1.smithi069.stdout:9/784: creat d2/da/dd/f10f x:0 0 0 2024-04-25T17:19:27.077 INFO:tasks.workunit.client.1.smithi069.stdout:5/869: truncate d13/d17/d19/d1c/d6c/fb3 1512253 0 2024-04-25T17:19:27.077 INFO:tasks.workunit.client.1.smithi069.stdout:9/785: truncate d2/da/fc 9088146 0 2024-04-25T17:19:27.080 INFO:tasks.workunit.client.1.smithi069.stdout:0/738: creat d0/da/db/f103 x:0 0 0 2024-04-25T17:19:27.081 INFO:tasks.workunit.client.0.smithi037.stdout:8/740: chown d5/db/d18/d3b/d75/c96 215 1 2024-04-25T17:19:27.081 INFO:tasks.workunit.client.0.smithi037.stdout:8/741: chown d5/db/d59 954 1 2024-04-25T17:19:27.083 INFO:tasks.workunit.client.1.smithi069.stdout:1/814: creat d1/d43/d1b/d32/d4a/db4/fff x:0 0 0 2024-04-25T17:19:27.087 INFO:tasks.workunit.client.0.smithi037.stdout:6/821: symlink db/d26/d2e/d3e/l12a 0 2024-04-25T17:19:27.088 INFO:tasks.workunit.client.1.smithi069.stdout:1/815: dwrite d1/d4/de/f91 [4194304,4194304] 0 2024-04-25T17:19:27.089 INFO:tasks.workunit.client.0.smithi037.stdout:2/922: creat d0/d16/d26/f124 x:0 0 0 2024-04-25T17:19:27.091 INFO:tasks.workunit.client.1.smithi069.stdout:3/876: mknod d8/d16/d4b/d9e/c126 0 2024-04-25T17:19:27.092 INFO:tasks.workunit.client.0.smithi037.stdout:2/923: dread d0/d23/dac/fd4 [0,4194304] 0 2024-04-25T17:19:27.095 INFO:tasks.workunit.client.1.smithi069.stdout:2/814: fdatasync d0/d56/d94/f106 0 2024-04-25T17:19:27.096 INFO:tasks.workunit.client.0.smithi037.stdout:3/693: rmdir d8/d31/d8d 39 2024-04-25T17:19:27.098 INFO:tasks.workunit.client.1.smithi069.stdout:7/846: mkdir d4/d3e/d94/da1/dc7/d14/d15/dda/d11d 0 2024-04-25T17:19:27.102 INFO:tasks.workunit.client.0.smithi037.stdout:0/874: dwrite d9/d72/f9f [0,4194304] 0 2024-04-25T17:19:27.103 INFO:tasks.workunit.client.0.smithi037.stdout:8/742: truncate d5/db/d23/d42/f43 3944311 0 2024-04-25T17:19:27.104 INFO:tasks.workunit.client.0.smithi037.stdout:1/934: dread dc/d24/f4b [0,4194304] 0 2024-04-25T17:19:27.111 INFO:tasks.workunit.client.0.smithi037.stdout:2/924: rmdir d0/d7c 39 2024-04-25T17:19:27.111 INFO:tasks.workunit.client.0.smithi037.stdout:0/875: dwrite d9/df/d32/d39/dd3/fe6 [0,4194304] 0 2024-04-25T17:19:27.113 INFO:tasks.workunit.client.1.smithi069.stdout:8/848: dwrite fe [0,4194304] 0 2024-04-25T17:19:27.113 INFO:tasks.workunit.client.1.smithi069.stdout:4/819: dwrite db/d15/f114 [0,4194304] 0 2024-04-25T17:19:27.115 INFO:tasks.workunit.client.1.smithi069.stdout:4/820: stat db/d15/d82/df4/f112 0 2024-04-25T17:19:27.115 INFO:tasks.workunit.client.1.smithi069.stdout:4/821: read db/f12 [481578,21937] 0 2024-04-25T17:19:27.120 INFO:tasks.workunit.client.1.smithi069.stdout:3/877: fsync d8/d16/d9b/dc3/fcf 0 2024-04-25T17:19:27.120 INFO:tasks.workunit.client.0.smithi037.stdout:5/858: getdents d7/d12/d5d/d90 0 2024-04-25T17:19:27.123 INFO:tasks.workunit.client.1.smithi069.stdout:8/849: dwrite d37/d47/d48/f83 [0,4194304] 0 2024-04-25T17:19:27.123 INFO:tasks.workunit.client.1.smithi069.stdout:8/850: fdatasync d37/fd6 0 2024-04-25T17:19:27.124 INFO:tasks.workunit.client.1.smithi069.stdout:8/851: write f34 [2875472,121523] 0 2024-04-25T17:19:27.125 INFO:tasks.workunit.client.0.smithi037.stdout:0/876: read d9/d14/d28/d48/f50 [38428,108138] 0 2024-04-25T17:19:27.126 INFO:tasks.workunit.client.1.smithi069.stdout:2/815: mkdir d0/d56/d5f/d62/d7d/d31/df8/d10e 0 2024-04-25T17:19:27.127 INFO:tasks.workunit.client.1.smithi069.stdout:2/816: read - d0/d26/d107/f10a zero size 2024-04-25T17:19:27.128 INFO:tasks.workunit.client.0.smithi037.stdout:8/743: creat d5/d26/d81/ff3 x:0 0 0 2024-04-25T17:19:27.128 INFO:tasks.workunit.client.1.smithi069.stdout:2/817: chown d0/d26/df3/f109 97 1 2024-04-25T17:19:27.133 INFO:tasks.workunit.client.1.smithi069.stdout:6/827: rename d2/f20 to d2/d1e/d3f/d56/f117 0 2024-04-25T17:19:27.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.154+0000 7f70abdbb700 1 -- 172.21.15.37:0/980468289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70a40fd350 msgr2=0x7f70a40fd760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:19:27.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.154+0000 7f70abdbb700 1 --2- 172.21.15.37:0/980468289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70a40fd350 0x7f70a40fd760 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f70a0004940 tx=0x7f70a0009e30 comp rx=0 tx=0).stop 2024-04-25T17:19:27.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.155+0000 7f70abdbb700 1 -- 172.21.15.37:0/980468289 shutdown_connections 2024-04-25T17:19:27.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.155+0000 7f70abdbb700 1 --2- 172.21.15.37:0/980468289 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70a40fdca0 0x7f70a41045f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:27.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.155+0000 7f70abdbb700 1 --2- 172.21.15.37:0/980468289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70a40fd350 0x7f70a40fd760 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:27.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.155+0000 7f70abdbb700 1 -- 172.21.15.37:0/980468289 >> 172.21.15.37:0/980468289 conn(0x7f70a40f6be0 msgr2=0x7f70a40f8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:19:27.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.155+0000 7f70abdbb700 1 -- 172.21.15.37:0/980468289 shutdown_connections 2024-04-25T17:19:27.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.155+0000 7f70abdbb700 1 -- 172.21.15.37:0/980468289 wait complete. 2024-04-25T17:19:27.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.155+0000 7f70abdbb700 1 Processor -- start 2024-04-25T17:19:27.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.155+0000 7f70abdbb700 1 -- start start 2024-04-25T17:19:27.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.155+0000 7f70abdbb700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70a40fd350 0x7f70a410fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:19:27.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.155+0000 7f70abdbb700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70a40fdca0 0x7f70a41100c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:19:27.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.155+0000 7f70abdbb700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a41106c0 con 0x7f70a40fd350 2024-04-25T17:19:27.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.155+0000 7f70abdbb700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70a4110830 con 0x7f70a40fdca0 2024-04-25T17:19:27.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.155+0000 7f70a9b57700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70a40fd350 0x7f70a410fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:19:27.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.156+0000 7f70a9b57700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70a40fd350 0x7f70a410fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40164/0 (socket says 172.21.15.37:40164) 2024-04-25T17:19:27.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.156+0000 7f70a9b57700 1 -- 172.21.15.37:0/215176593 learned_addr learned my addr 172.21.15.37:0/215176593 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:19:27.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.156+0000 7f70a9356700 1 --2- 172.21.15.37:0/215176593 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70a40fdca0 0x7f70a41100c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:19:27.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.156+0000 7f70a9b57700 1 -- 172.21.15.37:0/215176593 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70a40fdca0 msgr2=0x7f70a41100c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:19:27.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.156+0000 7f70a9b57700 1 --2- 172.21.15.37:0/215176593 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70a40fdca0 0x7f70a41100c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:27.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.156+0000 7f70a9b57700 1 -- 172.21.15.37:0/215176593 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a0005040 con 0x7f70a40fd350 2024-04-25T17:19:27.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.156+0000 7f70a9b57700 1 --2- 172.21.15.37:0/215176593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70a40fd350 0x7f70a410fb80 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f70a000b3b0 tx=0x7f70a0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:19:27.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.156+0000 7f709a7fc700 1 -- 172.21.15.37:0/215176593 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70a000e040 con 0x7f70a40fd350 2024-04-25T17:19:27.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.156+0000 7f709a7fc700 1 -- 172.21.15.37:0/215176593 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f70a000bbf0 con 0x7f70a40fd350 2024-04-25T17:19:27.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.156+0000 7f70abdbb700 1 -- 172.21.15.37:0/215176593 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70a41151e0 con 0x7f70a40fd350 2024-04-25T17:19:27.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.156+0000 7f709a7fc700 1 -- 172.21.15.37:0/215176593 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70a001c630 con 0x7f70a40fd350 2024-04-25T17:19:27.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.156+0000 7f70abdbb700 1 -- 172.21.15.37:0/215176593 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70a41157a0 con 0x7f70a40fd350 2024-04-25T17:19:27.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.157+0000 7f70abdbb700 1 -- 172.21.15.37:0/215176593 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70a404c710 con 0x7f70a40fd350 2024-04-25T17:19:27.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.158+0000 7f709a7fc700 1 -- 172.21.15.37:0/215176593 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) v1 ==== 92608+0+0 (secure 0 0 0) 0x7f70a000bd60 con 0x7f70a40fd350 2024-04-25T17:19:27.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.158+0000 7f709a7fc700 1 --2- 172.21.15.37:0/215176593 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f709006fcc0 0x7f7090072170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:19:27.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.158+0000 7f709a7fc700 1 -- 172.21.15.37:0/215176593 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f70a00903c0 con 0x7f70a40fd350 2024-04-25T17:19:27.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.159+0000 7f70a9356700 1 --2- 172.21.15.37:0/215176593 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f709006fcc0 0x7f7090072170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:19:27.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.159+0000 7f70a9356700 1 --2- 172.21.15.37:0/215176593 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f709006fcc0 0x7f7090072170 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7094004f30 tx=0x7f709400b040 comp rx=0 tx=0).ready entity=mgr.24417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:19:27.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.163+0000 7f709a7fc700 1 -- 172.21.15.37:0/215176593 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f70a0059820 con 0x7f70a40fd350 2024-04-25T17:19:27.245 INFO:tasks.workunit.client.1.smithi069.stdout:0/739: mkdir d0/da/db/d3a/d104 0 2024-04-25T17:19:27.247 INFO:tasks.workunit.client.0.smithi037.stdout:7/755: write d5/d15/d17/d25/d2b/d48/f72 [701568,44274] 0 2024-04-25T17:19:27.248 INFO:tasks.workunit.client.0.smithi037.stdout:7/756: chown d5/d15/d17/d1b/da2/daf 23386607 1 2024-04-25T17:19:27.257 INFO:tasks.workunit.client.1.smithi069.stdout:5/870: dwrite f9 [0,4194304] 0 2024-04-25T17:19:27.259 INFO:tasks.workunit.client.1.smithi069.stdout:5/871: truncate d13/d17/d29/d30/d5c/f125 747777 0 2024-04-25T17:19:27.261 INFO:tasks.workunit.client.0.smithi037.stdout:6/822: link db/d1d/d20/l44 db/d1d/d20/dcf/l12b 0 2024-04-25T17:19:27.262 INFO:tasks.workunit.client.0.smithi037.stdout:1/935: write dc/d52/d6b/dd9/d4d/d6a/d86/d91/f93 [1989232,110106] 0 2024-04-25T17:19:27.264 INFO:tasks.workunit.client.0.smithi037.stdout:1/936: chown dc/d52/d6b/dd9/d4d/d6a/d136 6536682 1 2024-04-25T17:19:27.265 INFO:tasks.workunit.client.0.smithi037.stdout:1/937: chown dc/d18/f42 24808308 1 2024-04-25T17:19:27.273 INFO:tasks.workunit.client.1.smithi069.stdout:7/847: creat d4/d3e/d94/da1/dc7/d14/d15/dda/d11d/f11e x:0 0 0 2024-04-25T17:19:27.276 INFO:tasks.workunit.client.1.smithi069.stdout:2/818: truncate d0/d26/f2b 3991721 0 2024-04-25T17:19:27.277 INFO:tasks.workunit.client.0.smithi037.stdout:1/938: dread dc/d52/d6b/dd9/d22/d36/d92/fc4 [0,4194304] 0 2024-04-25T17:19:27.281 INFO:tasks.workunit.client.1.smithi069.stdout:9/786: rename d2/da/dd/de/d74/dbc/df8/c10e to d2/da/dd/de/d74/d8a/c110 0 2024-04-25T17:19:27.281 INFO:tasks.workunit.client.0.smithi037.stdout:0/877: write d9/df/d32/d39/dd3/f116 [122491,128405] 0 2024-04-25T17:19:27.283 INFO:tasks.workunit.client.1.smithi069.stdout:1/816: dwrite d1/d4/d6/f31 [0,4194304] 0 2024-04-25T17:19:27.285 INFO:tasks.workunit.client.0.smithi037.stdout:6/823: symlink db/d26/d2e/d82/l12c 0 2024-04-25T17:19:27.288 INFO:tasks.workunit.client.1.smithi069.stdout:4/822: dwrite db/d15/d20/d35/d63/d43/d48/d49/f56 [0,4194304] 0 2024-04-25T17:19:27.288 INFO:tasks.workunit.client.1.smithi069.stdout:0/740: mknod d0/da/d59/dab/c105 0 2024-04-25T17:19:27.290 INFO:tasks.workunit.client.0.smithi037.stdout:2/925: write d0/d16/d20/d59/d6a/da5/ff0 [4452748,126795] 0 2024-04-25T17:19:27.291 INFO:tasks.workunit.client.0.smithi037.stdout:7/757: write d5/d15/d17/d1b/f68 [5064775,21857] 0 2024-04-25T17:19:27.291 INFO:tasks.workunit.client.0.smithi037.stdout:3/694: getdents d8/d57 0 2024-04-25T17:19:27.295 INFO:tasks.workunit.client.1.smithi069.stdout:5/872: creat d13/d17/d19/d1c/da4/da9/daa/f12c x:0 0 0 2024-04-25T17:19:27.295 INFO:tasks.workunit.client.1.smithi069.stdout:8/852: mkdir d37/d47/d78/d122 0 2024-04-25T17:19:27.298 INFO:tasks.workunit.client.0.smithi037.stdout:8/744: link d5/d26/d33/lad d5/db/d23/d78/d93/lf4 0 2024-04-25T17:19:27.300 INFO:tasks.workunit.client.1.smithi069.stdout:2/819: mknod d0/d56/d5f/d62/d7d/d72/daf/dc2/d8b/c10f 0 2024-04-25T17:19:27.300 INFO:tasks.workunit.client.1.smithi069.stdout:2/820: stat d0/d56/f6f 0 2024-04-25T17:19:27.303 INFO:tasks.workunit.client.0.smithi037.stdout:0/878: dwrite d9/df/dbd/f107 [0,4194304] 0 2024-04-25T17:19:27.303 INFO:tasks.workunit.client.1.smithi069.stdout:9/787: mknod d2/da4/dcf/d65/dc4/c111 0 2024-04-25T17:19:27.305 INFO:tasks.workunit.client.0.smithi037.stdout:8/745: dread d5/da/f11 [4194304,4194304] 0 2024-04-25T17:19:27.306 INFO:tasks.workunit.client.0.smithi037.stdout:2/926: unlink d0/d16/d20/d59/c6b 0 2024-04-25T17:19:27.308 INFO:tasks.workunit.client.0.smithi037.stdout:2/927: read d0/d16/d20/d59/d6a/f99 [60314,100464] 0 2024-04-25T17:19:27.313 INFO:tasks.workunit.client.0.smithi037.stdout:6/824: mknod db/d1d/d20/dcf/d108/c12d 0 2024-04-25T17:19:27.314 INFO:tasks.workunit.client.0.smithi037.stdout:6/825: chown db/d1d/lf5 2 1 2024-04-25T17:19:27.315 INFO:tasks.workunit.client.1.smithi069.stdout:5/873: write d13/d17/d62/f11a [2310140,31814] 0 2024-04-25T17:19:27.325 INFO:tasks.workunit.client.0.smithi037.stdout:3/695: creat d8/d31/d8d/fda x:0 0 0 2024-04-25T17:19:27.325 INFO:tasks.workunit.client.1.smithi069.stdout:8/853: dread d37/f57 [0,4194304] 0 2024-04-25T17:19:27.325 INFO:tasks.workunit.client.1.smithi069.stdout:9/788: creat d2/da/dd/de0/f112 x:0 0 0 2024-04-25T17:19:27.327 INFO:tasks.workunit.client.1.smithi069.stdout:9/789: chown d2/da4/dcf/ffd 48 1 2024-04-25T17:19:27.327 INFO:tasks.workunit.client.1.smithi069.stdout:8/854: write d37/d62/ffc [713863,124900] 0 2024-04-25T17:19:27.327 INFO:tasks.workunit.client.0.smithi037.stdout:1/939: write dc/d52/d6b/dd9/d4d/d6a/d8f/ddc/f123 [1014316,66956] 0 2024-04-25T17:19:27.332 INFO:tasks.workunit.client.0.smithi037.stdout:2/928: dread d0/d16/d20/d59/d6a/dbe/fff [0,4194304] 0 2024-04-25T17:19:27.333 INFO:tasks.workunit.client.1.smithi069.stdout:2/821: dread d0/d26/d10/f49 [0,4194304] 0 2024-04-25T17:19:27.334 INFO:tasks.workunit.client.1.smithi069.stdout:9/790: dwrite d2/da/dd/de0/f112 [0,4194304] 0 2024-04-25T17:19:27.335 INFO:tasks.workunit.client.0.smithi037.stdout:0/879: symlink d9/df/d32/d39/l11c 0 2024-04-25T17:19:27.336 INFO:tasks.workunit.client.0.smithi037.stdout:8/746: dread d5/db/d59/f88 [0,4194304] 0 2024-04-25T17:19:27.338 INFO:tasks.workunit.client.0.smithi037.stdout:6/826: stat db/d26/d2e/f64 0 2024-04-25T17:19:27.340 INFO:tasks.workunit.client.1.smithi069.stdout:7/848: dwrite d4/d3e/d94/da1/dc7/f52 [0,4194304] 0 2024-04-25T17:19:27.342 INFO:tasks.workunit.client.1.smithi069.stdout:6/828: truncate d2/d1e/d43/db6/de4/f79 333106 0 2024-04-25T17:19:27.349 INFO:tasks.workunit.client.0.smithi037.stdout:7/758: dwrite d5/fc9 [0,4194304] 0 2024-04-25T17:19:27.351 INFO:tasks.workunit.client.0.smithi037.stdout:0/880: creat d9/df/d32/d35/f11d x:0 0 0 2024-04-25T17:19:27.354 INFO:tasks.workunit.client.0.smithi037.stdout:8/747: truncate d5/d6a/f14 4468469 0 2024-04-25T17:19:27.356 INFO:tasks.workunit.client.1.smithi069.stdout:4/823: link db/cf db/d15/d82/da7/c123 0 2024-04-25T17:19:27.359 INFO:tasks.workunit.client.1.smithi069.stdout:9/791: chown d2/f17 23 1 2024-04-25T17:19:27.361 INFO:tasks.workunit.client.1.smithi069.stdout:0/741: dwrite d0/da/db/d2a/faf [0,4194304] 0 2024-04-25T17:19:27.361 INFO:tasks.workunit.client.1.smithi069.stdout:5/874: write d13/f8b [664576,70889] 0 2024-04-25T17:19:27.362 INFO:tasks.workunit.client.1.smithi069.stdout:0/742: dread - d0/da/d24/d67/fee zero size 2024-04-25T17:19:27.366 INFO:tasks.workunit.client.0.smithi037.stdout:2/929: unlink d0/l76 0 2024-04-25T17:19:27.367 INFO:tasks.workunit.client.0.smithi037.stdout:2/930: chown d0/d15/fb3 39044 1 2024-04-25T17:19:27.369 INFO:tasks.workunit.client.0.smithi037.stdout:1/940: dwrite dc/d52/d6b/dd9/d22/d36/d92/fc4 [0,4194304] 0 2024-04-25T17:19:27.376 INFO:tasks.workunit.client.1.smithi069.stdout:3/878: rename d8/d16/d4b/d9e/lf8 to d8/d16/l127 0 2024-04-25T17:19:27.377 INFO:tasks.workunit.client.1.smithi069.stdout:7/849: dread d4/d1a/f35 [0,4194304] 0 2024-04-25T17:19:27.378 INFO:tasks.workunit.client.0.smithi037.stdout:8/748: read - d5/d6a/f8c zero size 2024-04-25T17:19:27.379 INFO:tasks.workunit.client.0.smithi037.stdout:1/941: dwrite dc/d52/d6b/dd9/d4d/d6a/d86/d9b/fe7 [0,4194304] 0 2024-04-25T17:19:27.383 INFO:tasks.workunit.client.1.smithi069.stdout:1/817: getdents d1/d4/de/d44 0 2024-04-25T17:19:27.384 INFO:tasks.workunit.client.0.smithi037.stdout:3/696: link d8/d4c/f8c d8/d31/d8d/fdb 0 2024-04-25T17:19:27.385 INFO:tasks.workunit.client.0.smithi037.stdout:7/759: write d5/d15/d17/d25/f67 [932608,795] 0 2024-04-25T17:19:27.387 INFO:tasks.workunit.client.0.smithi037.stdout:7/760: write d5/d15/d17/d9d/fe8 [661133,81121] 0 2024-04-25T17:19:27.388 INFO:tasks.workunit.client.0.smithi037.stdout:7/761: stat d5/d15/f1f 0 2024-04-25T17:19:27.390 INFO:tasks.workunit.client.1.smithi069.stdout:9/792: mkdir d2/da/dd/d1e/d2e/d113 0 2024-04-25T17:19:27.391 INFO:tasks.workunit.client.1.smithi069.stdout:1/818: dwrite d1/d4/d6/d4f/d9b/fc9 [0,4194304] 0 2024-04-25T17:19:27.392 INFO:tasks.workunit.client.0.smithi037.stdout:2/931: mkdir d0/d16/d20/d59/d125 0 2024-04-25T17:19:27.393 INFO:tasks.workunit.client.1.smithi069.stdout:6/829: dread d2/d1e/d3f/fe0 [0,4194304] 0 2024-04-25T17:19:27.394 INFO:tasks.workunit.client.1.smithi069.stdout:2/822: fdatasync d0/d56/d5f/d62/d7d/d31/f7c 0 2024-04-25T17:19:27.396 INFO:tasks.workunit.client.0.smithi037.stdout:0/881: symlink d9/d14/d23/dfc/l11e 0 2024-04-25T17:19:27.397 INFO:tasks.workunit.client.0.smithi037.stdout:0/882: read - d9/df/d32/dd1/d7a/f9b zero size 2024-04-25T17:19:27.398 INFO:tasks.workunit.client.1.smithi069.stdout:5/875: stat d13/d17/d19/d1c/c35 0 2024-04-25T17:19:27.402 INFO:tasks.workunit.client.1.smithi069.stdout:0/743: mkdir d0/da/d6e/d106 0 2024-04-25T17:19:27.406 INFO:tasks.workunit.client.0.smithi037.stdout:6/827: creat db/d26/f12e x:0 0 0 2024-04-25T17:19:27.407 INFO:tasks.workunit.client.1.smithi069.stdout:0/744: dwrite d0/fdf [0,4194304] 0 2024-04-25T17:19:27.408 INFO:tasks.workunit.client.1.smithi069.stdout:3/879: fsync d8/d16/d9b/dc3/fcf 0 2024-04-25T17:19:27.409 INFO:tasks.workunit.client.1.smithi069.stdout:3/880: chown d8/d71/f85 8682960 1 2024-04-25T17:19:27.410 INFO:tasks.workunit.client.0.smithi037.stdout:1/942: dread dc/d24/da5/fda [0,4194304] 0 2024-04-25T17:19:27.416 INFO:tasks.workunit.client.1.smithi069.stdout:3/881: dwrite d8/d8b/ff1 [0,4194304] 0 2024-04-25T17:19:27.417 INFO:tasks.workunit.client.0.smithi037.stdout:7/762: creat d5/d15/d17/d25/d2b/dcb/ffc x:0 0 0 2024-04-25T17:19:27.419 INFO:tasks.workunit.client.0.smithi037.stdout:5/859: sync 2024-04-25T17:19:27.419 INFO:tasks.workunit.client.0.smithi037.stdout:7/763: read d5/d15/d17/d1b/da2/daf/ff6 [5608295,76252] 0 2024-04-25T17:19:27.421 INFO:tasks.workunit.client.1.smithi069.stdout:8/855: creat d37/d47/f123 x:0 0 0 2024-04-25T17:19:27.422 INFO:tasks.workunit.client.1.smithi069.stdout:8/856: dread - d37/d62/f107 zero size 2024-04-25T17:19:27.424 INFO:tasks.workunit.client.1.smithi069.stdout:9/793: mknod d2/da4/c114 0 2024-04-25T17:19:27.427 INFO:tasks.workunit.client.0.smithi037.stdout:7/764: dread d5/d15/d17/d1b/f1d [0,4194304] 0 2024-04-25T17:19:27.428 INFO:tasks.workunit.client.0.smithi037.stdout:0/883: dread d9/df/d32/f5c [0,4194304] 0 2024-04-25T17:19:27.428 INFO:tasks.workunit.client.0.smithi037.stdout:6/828: mknod db/d1d/db1/dc7/d11b/d123/c12f 0 2024-04-25T17:19:27.431 INFO:tasks.workunit.client.0.smithi037.stdout:7/765: write d5/d15/d17/d25/d2b/d48/f72 [79515,88299] 0 2024-04-25T17:19:27.433 INFO:tasks.workunit.client.1.smithi069.stdout:1/819: fdatasync d1/f2e 0 2024-04-25T17:19:27.434 INFO:tasks.workunit.client.1.smithi069.stdout:1/820: readlink d1/d43/d1b/l3d 0 2024-04-25T17:19:27.436 INFO:tasks.workunit.client.0.smithi037.stdout:8/749: dread d5/db/d23/f1e [4194304,4194304] 0 2024-04-25T17:19:27.436 INFO:tasks.workunit.client.1.smithi069.stdout:6/830: creat d2/d1e/d3f/d56/d7e/d100/f118 x:0 0 0 2024-04-25T17:19:27.437 INFO:tasks.workunit.client.0.smithi037.stdout:3/697: dread d8/d23/f93 [4194304,4194304] 0 2024-04-25T17:19:27.438 INFO:tasks.workunit.client.0.smithi037.stdout:2/932: mknod d0/d15/c126 0 2024-04-25T17:19:27.444 INFO:tasks.workunit.client.0.smithi037.stdout:0/884: rename d9/df/d32/d39/f100 to d9/df/df7/f11f 0 2024-04-25T17:19:27.447 INFO:tasks.workunit.client.0.smithi037.stdout:7/766: chown d5/d15/fdc 27594538 1 2024-04-25T17:19:27.449 INFO:tasks.workunit.client.0.smithi037.stdout:1/943: mknod dc/d52/d6b/dd9/d4d/d6a/d86/c143 0 2024-04-25T17:19:27.450 INFO:tasks.workunit.client.1.smithi069.stdout:7/850: readlink d4/d3e/d94/da1/dc7/d14/d44/d7c/d9f/dcb/la3 0 2024-04-25T17:19:27.451 INFO:tasks.workunit.client.1.smithi069.stdout:7/851: dread d4/d4c/fb6 [0,4194304] 0 2024-04-25T17:19:27.452 INFO:tasks.workunit.client.1.smithi069.stdout:3/882: unlink d8/d16/d4b/d9e/c126 0 2024-04-25T17:19:27.457 INFO:tasks.workunit.client.0.smithi037.stdout:8/750: write d5/db/d7e/f76 [460121,116297] 0 2024-04-25T17:19:27.463 INFO:tasks.workunit.client.0.smithi037.stdout:0/885: creat d9/df/d32/dd1/d7a/daf/db1/d10e/f120 x:0 0 0 2024-04-25T17:19:27.464 INFO:tasks.workunit.client.0.smithi037.stdout:6/829: mknod db/d1d/d20/dcf/dfa/d65/d8b/dee/d105/c130 0 2024-04-25T17:19:27.466 INFO:tasks.workunit.client.1.smithi069.stdout:6/831: rename d2/d1e/d43/d7d/db5/fde to d2/d1e/d43/db6/f119 0 2024-04-25T17:19:27.468 INFO:tasks.workunit.client.0.smithi037.stdout:1/944: rmdir dc/d18/d39 39 2024-04-25T17:19:27.468 INFO:tasks.workunit.client.0.smithi037.stdout:5/860: dwrite d7/f87 [0,4194304] 0 2024-04-25T17:19:27.471 INFO:tasks.workunit.client.0.smithi037.stdout:3/698: dwrite d8/d31/d8d/fdb [0,4194304] 0 2024-04-25T17:19:27.472 INFO:tasks.workunit.client.0.smithi037.stdout:3/699: chown d8/d23/dbb/d81/lc7 3375768 1 2024-04-25T17:19:27.472 INFO:tasks.workunit.client.1.smithi069.stdout:2/823: link d0/d26/d10/d43/f7a d0/d56/d94/f110 0 2024-04-25T17:19:27.473 INFO:tasks.workunit.client.1.smithi069.stdout:5/876: mkdir d13/d17/d19/d8a/dce/d11f/d12d 0 2024-04-25T17:19:27.477 INFO:tasks.workunit.client.0.smithi037.stdout:2/933: fsync d0/d7c/fba 0 2024-04-25T17:19:27.479 INFO:tasks.workunit.client.0.smithi037.stdout:2/934: read d0/d16/d3c/fbc [55266,1133] 0 2024-04-25T17:19:27.480 INFO:tasks.workunit.client.1.smithi069.stdout:4/824: sync 2024-04-25T17:19:27.484 INFO:tasks.workunit.client.0.smithi037.stdout:6/830: symlink db/d1d/d20/d85/l131 0 2024-04-25T17:19:27.486 INFO:tasks.workunit.client.1.smithi069.stdout:8/857: mkdir d37/d47/d54/dcc/d124 0 2024-04-25T17:19:27.489 INFO:tasks.workunit.client.0.smithi037.stdout:1/945: read dc/d18/d64/f11e [357894,60298] 0 2024-04-25T17:19:27.492 INFO:tasks.workunit.client.0.smithi037.stdout:5/861: fsync d7/d25/d4f/f34 0 2024-04-25T17:19:27.493 INFO:tasks.workunit.client.0.smithi037.stdout:5/862: write d7/d12/da8/f103 [531874,19539] 0 2024-04-25T17:19:27.497 INFO:tasks.workunit.client.1.smithi069.stdout:1/821: mkdir d1/d4/d6/d9e/da6/d7c/d1d/dad/d100 0 2024-04-25T17:19:27.499 INFO:tasks.workunit.client.0.smithi037.stdout:8/751: write d5/da/f32 [2731225,50790] 0 2024-04-25T17:19:27.502 INFO:tasks.workunit.client.1.smithi069.stdout:6/832: creat d2/d9c/d97/dad/de8/f11a x:0 0 0 2024-04-25T17:19:27.502 INFO:tasks.workunit.client.1.smithi069.stdout:6/833: dread - d2/d7/dbc/fc4 zero size 2024-04-25T17:19:27.503 INFO:tasks.workunit.client.1.smithi069.stdout:7/852: write d4/d3e/d94/da1/dc7/f8a [302180,83097] 0 2024-04-25T17:19:27.503 INFO:tasks.workunit.client.1.smithi069.stdout:6/834: fsync d2/d7/dbc/ffa 0 2024-04-25T17:19:27.504 INFO:tasks.workunit.client.1.smithi069.stdout:2/824: mkdir d0/d56/d5f/d62/d111 0 2024-04-25T17:19:27.504 INFO:tasks.workunit.client.0.smithi037.stdout:2/935: dread d0/d15/d2a/d5a/faa [0,4194304] 0 2024-04-25T17:19:27.505 INFO:tasks.workunit.client.1.smithi069.stdout:2/825: readlink d0/d26/d10/d43/d99/laa 0 2024-04-25T17:19:27.506 INFO:tasks.workunit.client.1.smithi069.stdout:5/877: rmdir d13/d17/d19/d1c/da4/da9/daa 39 2024-04-25T17:19:27.509 INFO:tasks.workunit.client.0.smithi037.stdout:7/767: link d5/d15/d17/d25/la9 d5/d15/d17/d1b/da2/daf/dc8/lfd 0 2024-04-25T17:19:27.510 INFO:tasks.workunit.client.1.smithi069.stdout:3/883: dwrite d8/f12 [4194304,4194304] 0 2024-04-25T17:19:27.510 INFO:tasks.workunit.client.1.smithi069.stdout:9/794: truncate d2/da/d14/f19 4161400 0 2024-04-25T17:19:27.512 INFO:tasks.workunit.client.1.smithi069.stdout:5/878: dread d13/d17/d19/d1c/da4/da9/fca [0,4194304] 0 2024-04-25T17:19:27.513 INFO:tasks.workunit.client.0.smithi037.stdout:0/886: creat d9/df/dbd/de9/df2/f121 x:0 0 0 2024-04-25T17:19:27.515 INFO:tasks.workunit.client.0.smithi037.stdout:6/831: creat db/d1d/d20/dcf/f132 x:0 0 0 2024-04-25T17:19:27.517 INFO:tasks.workunit.client.1.smithi069.stdout:1/822: mknod d1/d4/d6/d4f/d9b/c101 0 2024-04-25T17:19:27.521 INFO:tasks.workunit.client.1.smithi069.stdout:6/835: mkdir d2/d51/d89/d11b 0 2024-04-25T17:19:27.523 INFO:tasks.workunit.client.1.smithi069.stdout:6/836: chown d2/d1e/d3f/d56/d7e/d100/f118 55398944 1 2024-04-25T17:19:27.524 INFO:tasks.workunit.client.1.smithi069.stdout:2/826: rmdir d0/d56/d5f/d62/dbc 39 2024-04-25T17:19:27.525 INFO:tasks.workunit.client.0.smithi037.stdout:5/863: dread - d7/d43/d9f/fd5 zero size 2024-04-25T17:19:27.526 INFO:tasks.workunit.client.1.smithi069.stdout:4/825: dwrite f8 [0,4194304] 0 2024-04-25T17:19:27.527 INFO:tasks.workunit.client.0.smithi037.stdout:8/752: mknod d5/db/d18/d3b/d50/da0/da6/da8/cf5 0 2024-04-25T17:19:27.528 INFO:tasks.workunit.client.0.smithi037.stdout:8/753: read - d5/db/d23/d78/f83 zero size 2024-04-25T17:19:27.528 INFO:tasks.workunit.client.1.smithi069.stdout:0/745: getdents d0/d17/d83/dcf 0 2024-04-25T17:19:27.530 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.530+0000 7f70abdbb700 1 -- 172.21.15.37:0/215176593 --> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f70a40f86d0 con 0x7f709006fcc0 2024-04-25T17:19:27.531 INFO:tasks.workunit.client.1.smithi069.stdout:0/746: chown d0/da/d59/dab 19932 1 2024-04-25T17:19:27.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.531+0000 7f709a7fc700 1 -- 172.21.15.37:0/215176593 <== mgr.24417 v2:172.21.15.69:6828/2602478 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+349 (secure 0 0 0) 0x7f70a40f86d0 con 0x7f709006fcc0 2024-04-25T17:19:27.532 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-25T17:19:27.532 INFO:teuthology.orchestra.run.smithi037.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385", 2024-04-25T17:19:27.532 INFO:teuthology.orchestra.run.smithi037.stdout: "in_progress": true, 2024-04-25T17:19:27.532 INFO:teuthology.orchestra.run.smithi037.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-25T17:19:27.532 INFO:teuthology.orchestra.run.smithi037.stdout: "services_complete": [], 2024-04-25T17:19:27.532 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": "1/21 daemons upgraded", 2024-04-25T17:19:27.532 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "Currently upgrading mgr daemons", 2024-04-25T17:19:27.532 INFO:teuthology.orchestra.run.smithi037.stdout: "is_paused": false 2024-04-25T17:19:27.533 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-25T17:19:27.533 INFO:tasks.workunit.client.0.smithi037.stdout:1/946: write dc/d52/d6b/dd9/d4d/d6a/d86/d9b/fd3 [4130092,60302] 0 2024-04-25T17:19:27.533 INFO:tasks.workunit.client.1.smithi069.stdout:6/837: dwrite d2/d1e/d43/dca/dce/fd9 [8388608,4194304] 0 2024-04-25T17:19:27.533 INFO:tasks.workunit.client.0.smithi037.stdout:1/947: chown dc/d18/f1b 5303 1 2024-04-25T17:19:27.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.535+0000 7f70abdbb700 1 -- 172.21.15.37:0/215176593 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f709006fcc0 msgr2=0x7f7090072170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:19:27.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.535+0000 7f70abdbb700 1 --2- 172.21.15.37:0/215176593 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f709006fcc0 0x7f7090072170 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7094004f30 tx=0x7f709400b040 comp rx=0 tx=0).stop 2024-04-25T17:19:27.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.535+0000 7f70abdbb700 1 -- 172.21.15.37:0/215176593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70a40fd350 msgr2=0x7f70a410fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:19:27.536 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.535+0000 7f70abdbb700 1 --2- 172.21.15.37:0/215176593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70a40fd350 0x7f70a410fb80 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f70a000b3b0 tx=0x7f70a0009e30 comp rx=0 tx=0).stop 2024-04-25T17:19:27.536 INFO:tasks.workunit.client.1.smithi069.stdout:4/826: dwrite db/d15/f18 [0,4194304] 0 2024-04-25T17:19:27.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.536+0000 7f70abdbb700 1 -- 172.21.15.37:0/215176593 shutdown_connections 2024-04-25T17:19:27.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.536+0000 7f70abdbb700 1 --2- 172.21.15.37:0/215176593 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f709006fcc0 0x7f7090072170 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:27.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.536+0000 7f70abdbb700 1 --2- 172.21.15.37:0/215176593 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70a40fd350 0x7f70a410fb80 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:27.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.536+0000 7f70abdbb700 1 --2- 172.21.15.37:0/215176593 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70a40fdca0 0x7f70a41100c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:27.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.536+0000 7f70abdbb700 1 -- 172.21.15.37:0/215176593 >> 172.21.15.37:0/215176593 conn(0x7f70a40f6be0 msgr2=0x7f70a40f6fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:19:27.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.536+0000 7f70abdbb700 1 -- 172.21.15.37:0/215176593 shutdown_connections 2024-04-25T17:19:27.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.536+0000 7f70abdbb700 1 -- 172.21.15.37:0/215176593 wait complete. 2024-04-25T17:19:27.538 INFO:tasks.workunit.client.0.smithi037.stdout:3/700: write f5 [625057,66532] 0 2024-04-25T17:19:27.538 INFO:tasks.workunit.client.1.smithi069.stdout:9/795: mkdir d2/da/d5f/d115 0 2024-04-25T17:19:27.539 INFO:tasks.workunit.client.0.smithi037.stdout:0/887: write d9/df/d32/f5c [284151,35799] 0 2024-04-25T17:19:27.540 INFO:tasks.workunit.client.0.smithi037.stdout:6/832: creat db/d1d/dcc/f133 x:0 0 0 2024-04-25T17:19:27.541 INFO:tasks.workunit.client.0.smithi037.stdout:6/833: write db/d53/fe1 [836520,80095] 0 2024-04-25T17:19:27.542 INFO:tasks.workunit.client.1.smithi069.stdout:3/884: write d8/d16/d4b/d9e/dca/fe2 [2880999,98414] 0 2024-04-25T17:19:27.544 INFO:tasks.workunit.client.1.smithi069.stdout:5/879: creat d13/d17/d29/d30/d9c/f12e x:0 0 0 2024-04-25T17:19:27.545 INFO:tasks.workunit.client.1.smithi069.stdout:8/858: mkdir d37/d47/d125 0 2024-04-25T17:19:27.548 INFO:tasks.workunit.client.1.smithi069.stdout:1/823: symlink d1/d4/d6/d9e/da6/d7c/d4d/d8f/l102 0 2024-04-25T17:19:27.549 INFO:tasks.workunit.client.1.smithi069.stdout:0/747: dwrite d0/da/db/d56/f78 [0,4194304] 0 2024-04-25T17:19:27.552 INFO:tasks.workunit.client.1.smithi069.stdout:2/827: dread d0/d56/d5f/d62/d7d/d31/fd5 [0,4194304] 0 2024-04-25T17:19:27.553 INFO:tasks.workunit.client.0.smithi037.stdout:8/754: read - d5/db/d18/d3b/d50/da0/da6/fb1 zero size 2024-04-25T17:19:27.553 INFO:tasks.workunit.client.1.smithi069.stdout:6/838: dread d2/d1e/d43/db6/f7c [0,4194304] 0 2024-04-25T17:19:27.554 INFO:tasks.workunit.client.1.smithi069.stdout:6/839: stat d2/d1e/d3e/d115 0 2024-04-25T17:19:27.556 INFO:tasks.workunit.client.1.smithi069.stdout:1/824: dwrite d1/d43/d1b/f2c [4194304,4194304] 0 2024-04-25T17:19:27.557 INFO:tasks.workunit.client.0.smithi037.stdout:1/948: symlink dc/d52/d6b/dd9/d4d/d6a/d8f/ddc/l144 0 2024-04-25T17:19:27.564 INFO:tasks.workunit.client.1.smithi069.stdout:3/885: creat d8/d39/f128 x:0 0 0 2024-04-25T17:19:27.565 INFO:tasks.workunit.client.0.smithi037.stdout:6/834: creat db/d26/d2e/d82/f134 x:0 0 0 2024-04-25T17:19:27.566 INFO:tasks.workunit.client.0.smithi037.stdout:6/835: read - db/d1d/d20/dcf/dfa/d65/d8b/f127 zero size 2024-04-25T17:19:27.567 INFO:tasks.workunit.client.0.smithi037.stdout:6/836: dread - db/d53/ff2 zero size 2024-04-25T17:19:27.569 INFO:tasks.workunit.client.0.smithi037.stdout:6/837: chown db/d1d/d20/dcf/dfa/d65/d8b/dee/f11d 33 1 2024-04-25T17:19:27.571 INFO:tasks.workunit.client.0.smithi037.stdout:6/838: chown db/d1d/d20/dcf/dfa/d65/d68/d87/dbd/fd4 358936416 1 2024-04-25T17:19:27.571 INFO:tasks.workunit.client.0.smithi037.stdout:2/936: link d0/d15/d2a/f72 d0/d23/d7d/f127 0 2024-04-25T17:19:27.577 INFO:tasks.workunit.client.1.smithi069.stdout:7/853: dwrite d4/d3e/d94/da1/dc7/d14/d44/d79/da4/fa6 [0,4194304] 0 2024-04-25T17:19:27.578 INFO:tasks.workunit.client.0.smithi037.stdout:3/701: creat d8/d31/d8d/db7/dcd/fdc x:0 0 0 2024-04-25T17:19:27.580 INFO:tasks.workunit.client.0.smithi037.stdout:3/702: dread d8/d23/f62 [0,4194304] 0 2024-04-25T17:19:27.581 INFO:tasks.workunit.client.0.smithi037.stdout:0/888: write d9/fb9 [315807,107310] 0 2024-04-25T17:19:27.582 INFO:tasks.workunit.client.1.smithi069.stdout:8/859: write d37/f59 [499600,65890] 0 2024-04-25T17:19:27.582 INFO:tasks.workunit.client.1.smithi069.stdout:4/827: mkdir db/d15/d42/d64/d7f/d102/d124 0 2024-04-25T17:19:27.583 INFO:tasks.workunit.client.0.smithi037.stdout:0/889: write d9/df/d32/d35/f11d [363067,49445] 0 2024-04-25T17:19:27.584 INFO:tasks.workunit.client.0.smithi037.stdout:0/890: chown d9/df/d32 123063 1 2024-04-25T17:19:27.584 INFO:tasks.workunit.client.0.smithi037.stdout:8/755: mkdir d5/db/d18/d3b/d50/df6 0 2024-04-25T17:19:27.587 INFO:tasks.workunit.client.0.smithi037.stdout:6/839: unlink db/d1d/d20/dcf/f103 0 2024-04-25T17:19:27.591 INFO:tasks.workunit.client.0.smithi037.stdout:5/864: dwrite d7/d12/d6f/f54 [0,4194304] 0 2024-04-25T17:19:27.591 INFO:tasks.workunit.client.1.smithi069.stdout:2/828: write d0/d56/d5f/fa6 [61113,55175] 0 2024-04-25T17:19:27.593 INFO:tasks.workunit.client.1.smithi069.stdout:9/796: creat d2/da/dd/d1e/d2e/d68/dba/dd1/f116 x:0 0 0 2024-04-25T17:19:27.594 INFO:tasks.workunit.client.1.smithi069.stdout:5/880: fsync d13/d17/d29/d2e/f83 0 2024-04-25T17:19:27.596 INFO:tasks.workunit.client.0.smithi037.stdout:7/768: getdents d5/d14/d31 0 2024-04-25T17:19:27.599 INFO:tasks.workunit.client.0.smithi037.stdout:2/937: write d0/d16/d20/d59/fc9 [1470822,90238] 0 2024-04-25T17:19:27.600 INFO:tasks.workunit.client.1.smithi069.stdout:7/854: creat d4/d3e/d94/da1/dc7/d14/d44/dd5/dd6/f11f x:0 0 0 2024-04-25T17:19:27.602 INFO:tasks.workunit.client.1.smithi069.stdout:0/748: write d0/da/d24/d43/f92 [350918,13607] 0 2024-04-25T17:19:27.604 INFO:tasks.workunit.client.0.smithi037.stdout:3/703: mknod d8/d23/d38/cdd 0 2024-04-25T17:19:27.608 INFO:tasks.workunit.client.1.smithi069.stdout:3/886: link d8/d16/d1a/f4f d8/d16/d4b/d9e/f129 0 2024-04-25T17:19:27.608 INFO:tasks.workunit.client.1.smithi069.stdout:0/749: dwrite d0/da/db/fe [0,4194304] 0 2024-04-25T17:19:27.609 INFO:tasks.workunit.client.1.smithi069.stdout:0/750: fdatasync d0/da/d24/f42 0 2024-04-25T17:19:27.610 INFO:tasks.workunit.client.1.smithi069.stdout:2/829: mknod d0/d56/d5f/d62/d7d/d72/daf/c112 0 2024-04-25T17:19:27.615 INFO:tasks.workunit.client.0.smithi037.stdout:1/949: creat dc/d52/d6b/dd9/d22/d36/d92/db8/f145 x:0 0 0 2024-04-25T17:19:27.616 INFO:tasks.workunit.client.1.smithi069.stdout:5/881: dread d13/d17/d19/d1c/da4/da9/fca [0,4194304] 0 2024-04-25T17:19:27.618 INFO:tasks.workunit.client.1.smithi069.stdout:2/830: dwrite d0/d26/d107/f10a [0,4194304] 0 2024-04-25T17:19:27.619 INFO:tasks.workunit.client.1.smithi069.stdout:9/797: dread d2/da/dd/d1e/d2e/d68/fb5 [0,4194304] 0 2024-04-25T17:19:27.620 INFO:tasks.workunit.client.1.smithi069.stdout:5/882: write d13/d17/d19/d8a/f95 [619029,39048] 0 2024-04-25T17:19:27.621 INFO:tasks.workunit.client.1.smithi069.stdout:2/831: chown d0/d56/fcb 2725416 1 2024-04-25T17:19:27.621 INFO:tasks.workunit.client.0.smithi037.stdout:2/938: mkdir d0/d15/d2a/d5a/d128 0 2024-04-25T17:19:27.622 INFO:tasks.workunit.client.1.smithi069.stdout:4/828: dwrite db/d4b/d78/dc4/f2d [0,4194304] 0 2024-04-25T17:19:27.623 INFO:tasks.workunit.client.1.smithi069.stdout:2/832: chown d0/d26/df3/f109 2389 1 2024-04-25T17:19:27.626 INFO:tasks.workunit.client.1.smithi069.stdout:1/825: creat d1/df/f103 x:0 0 0 2024-04-25T17:19:27.628 INFO:tasks.workunit.client.1.smithi069.stdout:8/860: creat d37/d47/d78/db3/d114/d6b/d11b/f126 x:0 0 0 2024-04-25T17:19:27.631 INFO:tasks.workunit.client.0.smithi037.stdout:6/840: creat db/d26/d2e/d106/f135 x:0 0 0 2024-04-25T17:19:27.633 INFO:tasks.workunit.client.0.smithi037.stdout:7/769: dwrite d5/d15/d17/d25/d2b/f35 [0,4194304] 0 2024-04-25T17:19:27.633 INFO:tasks.workunit.client.1.smithi069.stdout:3/887: truncate d8/d71/f85 804822 0 2024-04-25T17:19:27.635 INFO:tasks.workunit.client.1.smithi069.stdout:0/751: mkdir d0/da/db/d2a/d9b/d107 0 2024-04-25T17:19:27.636 INFO:tasks.workunit.client.0.smithi037.stdout:1/950: mkdir dc/d52/d6b/dd9/d22/d36/d92/d146 0 2024-04-25T17:19:27.638 INFO:tasks.workunit.client.0.smithi037.stdout:3/704: symlink d8/d23/dbb/d81/dc3/lde 0 2024-04-25T17:19:27.638 INFO:tasks.workunit.client.0.smithi037.stdout:5/865: dread d7/d25/f4b [0,4194304] 0 2024-04-25T17:19:27.641 INFO:tasks.workunit.client.1.smithi069.stdout:6/840: sync 2024-04-25T17:19:27.642 INFO:tasks.workunit.client.1.smithi069.stdout:6/841: chown d2/d1e/cea 30670 1 2024-04-25T17:19:27.643 INFO:tasks.workunit.client.0.smithi037.stdout:0/891: creat d9/f122 x:0 0 0 2024-04-25T17:19:27.643 INFO:tasks.workunit.client.1.smithi069.stdout:2/833: read d0/d1/d5b/d33/f51 [2374123,121732] 0 2024-04-25T17:19:27.645 INFO:tasks.workunit.client.0.smithi037.stdout:8/756: rename d5/db/d18/d3b/d50/f98 to d5/db/d18/d3b/d50/ff7 0 2024-04-25T17:19:27.645 INFO:tasks.workunit.client.1.smithi069.stdout:2/834: chown d0/d56/d5f/d62/d7d/d72/daf/dc2/l8a 291169078 1 2024-04-25T17:19:27.648 INFO:tasks.workunit.client.0.smithi037.stdout:8/757: dread - d5/db/d18/d3b/d50/da0/da6/fb1 zero size 2024-04-25T17:19:27.648 INFO:tasks.workunit.client.0.smithi037.stdout:7/770: rmdir d5/d15 39 2024-04-25T17:19:27.651 INFO:tasks.workunit.client.0.smithi037.stdout:0/892: dwrite d9/df/d32/d35/f11d [0,4194304] 0 2024-04-25T17:19:27.657 INFO:tasks.workunit.client.0.smithi037.stdout:5/866: chown d7/d18/f8e 3 1 2024-04-25T17:19:27.658 INFO:tasks.workunit.client.1.smithi069.stdout:4/829: rename db/d4b/d78/dc4/d41/l54 to db/d15/d20/d35/d63/d43/d48/d49/l125 0 2024-04-25T17:19:27.661 INFO:tasks.workunit.client.0.smithi037.stdout:3/705: rename d8/d4c/dd3/f7a to d8/d23/d38/fdf 0 2024-04-25T17:19:27.662 INFO:tasks.workunit.client.0.smithi037.stdout:2/939: dread d0/f44 [0,4194304] 0 2024-04-25T17:19:27.663 INFO:tasks.workunit.client.1.smithi069.stdout:8/861: creat d37/d47/d54/dcc/f127 x:0 0 0 2024-04-25T17:19:27.664 INFO:tasks.workunit.client.0.smithi037.stdout:2/940: truncate d0/d16/d20/d59/d6a/f82 1757340 0 2024-04-25T17:19:27.666 INFO:tasks.workunit.client.1.smithi069.stdout:3/888: unlink d8/d39/cae 0 2024-04-25T17:19:27.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:27 smithi069 ceph-mon[34527]: from='client.14746 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:19:27.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:27 smithi069 ceph-mon[34527]: pgmap v44: 65 pgs: 65 active+clean; 3.6 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 112 MiB/s rd, 281 MiB/s wr, 609 op/s 2024-04-25T17:19:27.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:27 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/3900068193' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:19:27.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:27 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/1931452126' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T17:19:27.672 INFO:tasks.workunit.client.1.smithi069.stdout:6/842: symlink d2/d1e/d3e/l11c 0 2024-04-25T17:19:27.672 INFO:tasks.workunit.client.1.smithi069.stdout:6/843: stat d2/d9c/d48/c83 0 2024-04-25T17:19:27.673 INFO:tasks.workunit.client.0.smithi037.stdout:7/771: read d5/d15/d17/d1b/da2/d76/fb3 [1442419,2712] 0 2024-04-25T17:19:27.675 INFO:tasks.workunit.client.1.smithi069.stdout:2/835: fdatasync d0/d56/d94/f96 0 2024-04-25T17:19:27.676 INFO:tasks.workunit.client.0.smithi037.stdout:1/951: dwrite dc/d24/f4b [0,4194304] 0 2024-04-25T17:19:27.676 INFO:tasks.workunit.client.1.smithi069.stdout:2/836: write d0/d56/d5f/d62/d7d/d72/daf/dc2/ddd/fe1 [279422,122456] 0 2024-04-25T17:19:27.679 INFO:tasks.workunit.client.1.smithi069.stdout:7/855: link d4/d3e/d94/da1/dc7/d14/d44/lb5 d4/d3e/d94/da1/dc7/d14/d3d/df6/l120 0 2024-04-25T17:19:27.679 INFO:tasks.workunit.client.0.smithi037.stdout:0/893: unlink d9/df/d32/d56/d106/f10f 0 2024-04-25T17:19:27.684 INFO:tasks.workunit.client.0.smithi037.stdout:2/941: chown d0/d16/d20/d55/fa6 246 1 2024-04-25T17:19:27.686 INFO:tasks.workunit.client.0.smithi037.stdout:5/867: dread d7/d18/d62/f6a [0,4194304] 0 2024-04-25T17:19:27.687 INFO:tasks.workunit.client.1.smithi069.stdout:5/883: mknod d13/d17/d19/d1c/c12f 0 2024-04-25T17:19:27.687 INFO:tasks.workunit.client.1.smithi069.stdout:0/752: dwrite d0/da/d59/dab/fb7 [0,4194304] 0 2024-04-25T17:19:27.688 INFO:tasks.workunit.client.0.smithi037.stdout:6/841: link db/d1d/d20/dcf/dfa/d65/le9 db/d26/d2e/d3e/l136 0 2024-04-25T17:19:27.688 INFO:tasks.workunit.client.0.smithi037.stdout:6/842: dread - db/d53/ff2 zero size 2024-04-25T17:19:27.689 INFO:tasks.workunit.client.0.smithi037.stdout:6/843: stat db/d26/d2e/l8a 0 2024-04-25T17:19:27.693 INFO:tasks.workunit.client.1.smithi069.stdout:1/826: rename d1/d4/de/d63/cfd to d1/d4/d6/d9e/da6/d38/c104 0 2024-04-25T17:19:27.694 INFO:tasks.workunit.client.0.smithi037.stdout:8/758: mknod d5/db/d18/d3b/de6/cf8 0 2024-04-25T17:19:27.694 INFO:tasks.workunit.client.1.smithi069.stdout:9/798: write d2/da4/dcf/d65/f73 [571084,15460] 0 2024-04-25T17:19:27.696 INFO:tasks.workunit.client.0.smithi037.stdout:7/772: mkdir d5/d15/d17/d25/d2b/d59/dfe 0 2024-04-25T17:19:27.699 INFO:tasks.workunit.client.1.smithi069.stdout:3/889: dread d8/d2a/f43 [0,4194304] 0 2024-04-25T17:19:27.700 INFO:tasks.workunit.client.0.smithi037.stdout:1/952: dread dc/d52/d6b/fb3 [0,4194304] 0 2024-04-25T17:19:27.700 INFO:tasks.workunit.client.0.smithi037.stdout:0/894: read d9/d14/d28/f8c [139308,46563] 0 2024-04-25T17:19:27.701 INFO:tasks.workunit.client.1.smithi069.stdout:2/837: mkdir d0/d56/d94/d113 0 2024-04-25T17:19:27.702 INFO:tasks.workunit.client.0.smithi037.stdout:1/953: write dc/d52/d6b/dd9/d4d/d6a/d86/f97 [10489989,61208] 0 2024-04-25T17:19:27.702 INFO:tasks.workunit.client.1.smithi069.stdout:7/856: creat d4/d3e/d94/f121 x:0 0 0 2024-04-25T17:19:27.704 INFO:tasks.workunit.client.0.smithi037.stdout:1/954: read - dc/d52/d6b/dd9/d22/d36/d92/db8/dbc/f131 zero size 2024-04-25T17:19:27.706 INFO:tasks.workunit.client.1.smithi069.stdout:5/884: creat d13/d17/dd4/f130 x:0 0 0 2024-04-25T17:19:27.706 INFO:tasks.workunit.client.1.smithi069.stdout:5/885: stat d13/d17/d19/d8a/c5f 0 2024-04-25T17:19:27.707 INFO:tasks.workunit.client.0.smithi037.stdout:7/773: creat d5/d15/d17/d25/d2b/d48/fff x:0 0 0 2024-04-25T17:19:27.708 INFO:tasks.workunit.client.1.smithi069.stdout:0/753: creat d0/da/d24/d43/f108 x:0 0 0 2024-04-25T17:19:27.714 INFO:tasks.workunit.client.1.smithi069.stdout:1/827: chown d1/d4/d6/d9e/da6/d7c/f53 3 1 2024-04-25T17:19:27.716 INFO:tasks.workunit.client.1.smithi069.stdout:8/862: truncate d37/d47/f60 2182058 0 2024-04-25T17:19:27.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.716+0000 7f5b06649700 1 -- 172.21.15.37:0/150660388 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b000fff60 msgr2=0x7f5b00102340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:19:27.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.716+0000 7f5b06649700 1 --2- 172.21.15.37:0/150660388 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b000fff60 0x7f5b00102340 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5af4004880 tx=0x7f5af4009e30 comp rx=0 tx=0).stop 2024-04-25T17:19:27.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.716+0000 7f5b06649700 1 -- 172.21.15.37:0/150660388 shutdown_connections 2024-04-25T17:19:27.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.716+0000 7f5b06649700 1 --2- 172.21.15.37:0/150660388 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b000fff60 0x7f5b00102340 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:27.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.716+0000 7f5b06649700 1 --2- 172.21.15.37:0/150660388 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b00066e50 0x7f5b000ffa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:27.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.716+0000 7f5b06649700 1 -- 172.21.15.37:0/150660388 >> 172.21.15.37:0/150660388 conn(0x7f5b000f7430 msgr2=0x7f5b000f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:19:27.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.716+0000 7f5b06649700 1 -- 172.21.15.37:0/150660388 shutdown_connections 2024-04-25T17:19:27.718 INFO:tasks.workunit.client.0.smithi037.stdout:5/868: write d7/d25/f91 [1009071,70345] 0 2024-04-25T17:19:27.718 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:27 smithi037 ceph-mon[26472]: from='client.14746 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:19:27.718 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:27 smithi037 ceph-mon[26472]: pgmap v44: 65 pgs: 65 active+clean; 3.6 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 112 MiB/s rd, 281 MiB/s wr, 609 op/s 2024-04-25T17:19:27.718 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:27 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/3900068193' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:19:27.718 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:27 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/1931452126' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T17:19:27.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.717+0000 7f5b06649700 1 -- 172.21.15.37:0/150660388 wait complete. 2024-04-25T17:19:27.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.717+0000 7f5b06649700 1 Processor -- start 2024-04-25T17:19:27.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.718+0000 7f5b06649700 1 -- start start 2024-04-25T17:19:27.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.718+0000 7f5b06649700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b00066e50 0x7f5b0010d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:19:27.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.718+0000 7f5b06649700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b000fff60 0x7f5b0010deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:19:27.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.718+0000 7f5afffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b00066e50 0x7f5b0010d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:19:27.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.718+0000 7f5afffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b00066e50 0x7f5b0010d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40194/0 (socket says 172.21.15.37:40194) 2024-04-25T17:19:27.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.718+0000 7f5afffff700 1 -- 172.21.15.37:0/182838818 learned_addr learned my addr 172.21.15.37:0/182838818 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:19:27.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.718+0000 7f5b06649700 1 -- 172.21.15.37:0/182838818 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0010e4b0 con 0x7f5b00066e50 2024-04-25T17:19:27.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.718+0000 7f5b06649700 1 -- 172.21.15.37:0/182838818 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0010e620 con 0x7f5b000fff60 2024-04-25T17:19:27.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.719+0000 7f5afffff700 1 -- 172.21.15.37:0/182838818 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b000fff60 msgr2=0x7f5b0010deb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T17:19:27.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.719+0000 7f5afffff700 1 --2- 172.21.15.37:0/182838818 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b000fff60 0x7f5b0010deb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:27.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.719+0000 7f5afffff700 1 -- 172.21.15.37:0/182838818 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af0005040 con 0x7f5b00066e50 2024-04-25T17:19:27.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.719+0000 7f5afffff700 1 --2- 172.21.15.37:0/182838818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b00066e50 0x7f5b0010d970 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f5af00096b0 tx=0x7f5af0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:19:27.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.719+0000 7f5afcff9700 1 -- 172.21.15.37:0/182838818 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5af000e840 con 0x7f5b00066e50 2024-04-25T17:19:27.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.719+0000 7f5b06649700 1 -- 172.21.15.37:0/182838818 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5af4005040 con 0x7f5b00066e50 2024-04-25T17:19:27.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.719+0000 7f5b06649700 1 -- 172.21.15.37:0/182838818 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b00113450 con 0x7f5b00066e50 2024-04-25T17:19:27.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.719+0000 7f5afcff9700 1 -- 172.21.15.37:0/182838818 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5af000f040 con 0x7f5b00066e50 2024-04-25T17:19:27.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.719+0000 7f5afcff9700 1 -- 172.21.15.37:0/182838818 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5af0013df0 con 0x7f5b00066e50 2024-04-25T17:19:27.722 INFO:tasks.workunit.client.1.smithi069.stdout:8/863: dread d37/d47/d78/db3/d114/d6b/daf/de6/f110 [0,4194304] 0 2024-04-25T17:19:27.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.720+0000 7f5b06649700 1 -- 172.21.15.37:0/182838818 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5aec0052e0 con 0x7f5b00066e50 2024-04-25T17:19:27.722 INFO:tasks.workunit.client.0.smithi037.stdout:6/844: mkdir db/d26/d2e/d3e/d25/d10d/d124/d137 0 2024-04-25T17:19:27.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.722+0000 7f5afcff9700 1 -- 172.21.15.37:0/182838818 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 25) v1 ==== 92608+0+0 (secure 0 0 0) 0x7f5af0013620 con 0x7f5b00066e50 2024-04-25T17:19:27.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.722+0000 7f5afcff9700 1 --2- 172.21.15.37:0/182838818 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f5ae806fcc0 0x7f5ae8072170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:19:27.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.722+0000 7f5afcff9700 1 -- 172.21.15.37:0/182838818 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5722+0+0 (secure 0 0 0) 0x7f5af008f5e0 con 0x7f5b00066e50 2024-04-25T17:19:27.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.723+0000 7f5aff7fe700 1 --2- 172.21.15.37:0/182838818 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f5ae806fcc0 0x7f5ae8072170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:19:27.724 INFO:tasks.workunit.client.1.smithi069.stdout:3/890: rmdir d8/d16/d1a/d2c/d49/d87/d8a/d8e/d95 39 2024-04-25T17:19:27.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.723+0000 7f5aff7fe700 1 --2- 172.21.15.37:0/182838818 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f5ae806fcc0 0x7f5ae8072170 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5af40138f0 tx=0x7f5af4009e30 comp rx=0 tx=0).ready entity=mgr.24417 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:19:27.726 INFO:tasks.workunit.client.0.smithi037.stdout:7/774: creat d5/d15/dd8/f100 x:0 0 0 2024-04-25T17:19:27.728 INFO:tasks.workunit.client.0.smithi037.stdout:2/942: creat d0/d23/dac/f129 x:0 0 0 2024-04-25T17:19:27.729 INFO:tasks.workunit.client.0.smithi037.stdout:0/895: symlink d9/df/d32/d39/l123 0 2024-04-25T17:19:27.732 INFO:tasks.workunit.client.1.smithi069.stdout:9/799: unlink d2/da/d14/f19 0 2024-04-25T17:19:27.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:27.732+0000 7f5afcff9700 1 -- 172.21.15.37:0/182838818 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f5af0058880 con 0x7f5b00066e50 2024-04-25T17:19:27.735 INFO:tasks.workunit.client.0.smithi037.stdout:6/845: rename db/l33 to db/d1d/d20/dcf/dfa/dde/dfd/l138 0 2024-04-25T17:19:27.737 INFO:tasks.workunit.client.0.smithi037.stdout:1/955: mknod dc/c147 0 2024-04-25T17:19:27.740 INFO:tasks.workunit.client.0.smithi037.stdout:8/759: creat d5/db/d23/d58/ff9 x:0 0 0 2024-04-25T17:19:27.742 INFO:tasks.workunit.client.1.smithi069.stdout:6/844: creat d2/d1e/f11d x:0 0 0 2024-04-25T17:19:27.743 INFO:tasks.workunit.client.1.smithi069.stdout:5/886: dwrite d13/d17/d19/f27 [0,4194304] 0 2024-04-25T17:19:27.747 INFO:tasks.workunit.client.1.smithi069.stdout:3/891: mknod d8/d16/d4b/def/c12a 0 2024-04-25T17:19:27.750 INFO:tasks.workunit.client.1.smithi069.stdout:1/828: dwrite d1/df/f33 [0,4194304] 0 2024-04-25T17:19:27.750 INFO:tasks.workunit.client.1.smithi069.stdout:2/838: rename d0/d56/c68 to d0/d26/d36/db9/c114 0 2024-04-25T17:19:27.752 INFO:tasks.workunit.client.1.smithi069.stdout:2/839: write d0/d26/d36/db9/dc8/ff7 [245730,106803] 0 2024-04-25T17:19:27.754 INFO:tasks.workunit.client.0.smithi037.stdout:1/956: creat dc/d52/d6b/dd9/d22/d36/d92/db8/dbc/f148 x:0 0 0 2024-04-25T17:19:27.759 INFO:tasks.workunit.client.0.smithi037.stdout:2/943: symlink d0/d15/l12a 0 2024-04-25T17:19:27.760 INFO:tasks.workunit.client.0.smithi037.stdout:2/944: write d0/d16/d20/d59/d6a/f82 [2360900,117374] 0 2024-04-25T17:19:27.761 INFO:tasks.workunit.client.0.smithi037.stdout:0/896: link d9/df/d32/d56/d106/f110 d9/d71/f124 0 2024-04-25T17:19:27.763 INFO:tasks.workunit.client.0.smithi037.stdout:6/846: mkdir db/d26/d139 0 2024-04-25T17:19:27.764 INFO:tasks.workunit.client.1.smithi069.stdout:6/845: mknod d2/d1e/d43/d7d/c11e 0 2024-04-25T17:19:27.764 INFO:tasks.workunit.client.1.smithi069.stdout:8/864: symlink d37/d47/d54/dcc/d124/l128 0 2024-04-25T17:19:27.765 INFO:tasks.workunit.client.0.smithi037.stdout:8/760: fdatasync d5/db/d23/d58/f8b 0 2024-04-25T17:19:27.766 INFO:tasks.workunit.client.1.smithi069.stdout:5/887: creat d13/d17/da5/f131 x:0 0 0 2024-04-25T17:19:27.766 INFO:tasks.workunit.client.0.smithi037.stdout:7/775: link d5/d15/fdc d5/d15/d17/d1b/d94/f101 0 2024-04-25T17:19:27.767 INFO:tasks.workunit.client.0.smithi037.stdout:7/776: dread - d5/d15/d17/d1b/da2/fd4 zero size 2024-04-25T17:19:27.772 INFO:tasks.workunit.client.1.smithi069.stdout:3/892: mknod d8/d16/d1a/d2c/d49/d87/d8a/dd7/dfc/c12b 0 2024-04-25T17:19:27.774 INFO:tasks.workunit.client.0.smithi037.stdout:2/945: fsync d0/d15/fea 0 2024-04-25T17:19:27.775 INFO:tasks.workunit.client.0.smithi037.stdout:2/946: chown d0/d16/d20/d55/f60 11 1 2024-04-25T17:19:27.777 INFO:tasks.workunit.client.1.smithi069.stdout:0/754: dwrite d0/da/db/d2a/d8c/fe0 [0,4194304] 0 2024-04-25T17:19:27.778 INFO:tasks.workunit.client.0.smithi037.stdout:0/897: unlink d9/df/f12 0 2024-04-25T17:19:27.779 INFO:tasks.workunit.client.1.smithi069.stdout:7/857: mkdir d4/d1a/dfc/d122 0 2024-04-25T17:19:27.899 INFO:tasks.workunit.client.0.smithi037.stdout:1/957: mkdir dc/d52/d6b/dd9/d149 0 2024-04-25T17:19:27.900 INFO:tasks.workunit.client.0.smithi037.stdout:2/947: dread d0/d16/d20/f39 [4194304,4194304] 0 2024-04-25T17:19:27.900 INFO:tasks.workunit.client.0.smithi037.stdout:7/777: write d5/d15/d17/f20 [465707,122439] 0 2024-04-25T17:19:27.900 INFO:tasks.workunit.client.0.smithi037.stdout:7/778: write d5/fc9 [2792514,5999] 0 2024-04-25T17:19:27.900 INFO:tasks.workunit.client.0.smithi037.stdout:6/847: dwrite db/d1d/d20/f3a [0,4194304] 0 2024-04-25T17:19:27.900 INFO:tasks.workunit.client.0.smithi037.stdout:1/958: truncate dc/d18/f42 3245812 0 2024-04-25T17:19:27.900 INFO:tasks.workunit.client.0.smithi037.stdout:8/761: creat d5/db/d18/de0/ffa x:0 0 0 2024-04-25T17:19:27.900 INFO:tasks.workunit.client.0.smithi037.stdout:2/948: fsync d0/d15/f36 0 2024-04-25T17:19:27.900 INFO:tasks.workunit.client.0.smithi037.stdout:0/898: dwrite d9/d14/d23/f1e [0,4194304] 0 2024-04-25T17:19:27.901 INFO:tasks.workunit.client.0.smithi037.stdout:0/899: fsync d9/df/dbd/de9/f114 0 2024-04-25T17:19:27.901 INFO:tasks.workunit.client.0.smithi037.stdout:7/779: dwrite d5/f46 [0,4194304] 0 2024-04-25T17:19:27.903 INFO:tasks.workunit.client.1.smithi069.stdout:4/830: sync 2024-04-25T17:19:27.903 INFO:tasks.workunit.client.1.smithi069.stdout:9/800: dwrite d2/da/faa [0,4194304] 0 2024-04-25T17:19:27.903 INFO:tasks.workunit.client.1.smithi069.stdout:6/846: dread d2/f63 [0,4194304] 0 2024-04-25T17:19:27.903 INFO:tasks.workunit.client.1.smithi069.stdout:1/829: dwrite d1/d4/d6/d9e/da6/d38/f90 [0,4194304] 0 2024-04-25T17:19:27.903 INFO:tasks.workunit.client.1.smithi069.stdout:8/865: creat d37/d47/d78/db3/d114/d6b/daf/de6/f129 x:0 0 0 2024-04-25T17:19:27.903 INFO:tasks.workunit.client.1.smithi069.stdout:8/866: dread - d37/d47/d78/db3/d114/d6b/d11b/f126 zero size 2024-04-25T17:19:27.903 INFO:tasks.workunit.client.1.smithi069.stdout:2/840: symlink d0/d56/d94/d113/l115 0 2024-04-25T17:19:27.903 INFO:tasks.workunit.client.1.smithi069.stdout:7/858: mkdir d4/d3e/d94/da1/dc7/d14/d44/dd5/d123 0 2024-04-25T17:19:27.903 INFO:tasks.workunit.client.1.smithi069.stdout:6/847: unlink d2/d1e/d3f/d86/fb1 0 2024-04-25T17:19:27.904 INFO:tasks.workunit.client.1.smithi069.stdout:1/830: symlink d1/d4/de/d44/l105 0 2024-04-25T17:19:27.904 INFO:tasks.workunit.client.1.smithi069.stdout:4/831: write db/d15/d20/d35/d63/fbe [475565,110760] 0 2024-04-25T17:19:27.904 INFO:tasks.workunit.client.1.smithi069.stdout:8/867: rename d37/d47/d48/f83 to d37/d47/d54/d6e/dce/f12a 0 2024-04-25T17:19:27.904 INFO:tasks.workunit.client.1.smithi069.stdout:8/868: readlink d37/l6c 0 2024-04-25T17:19:27.904 INFO:tasks.workunit.client.1.smithi069.stdout:8/869: dwrite d37/d62/f8f [4194304,4194304] 0 2024-04-25T17:19:27.904 INFO:tasks.workunit.client.1.smithi069.stdout:9/801: creat d2/da/dd/d1e/d2e/d113/f117 x:0 0 0 2024-04-25T17:19:27.904 INFO:tasks.workunit.client.1.smithi069.stdout:1/831: read d1/df/d17/f2f [3744713,79052] 0 2024-04-25T17:19:27.904 INFO:tasks.workunit.client.1.smithi069.stdout:1/832: dread d1/d4/d6/d9e/da6/fe2 [0,4194304] 0 2024-04-25T17:19:27.904 INFO:tasks.workunit.client.1.smithi069.stdout:0/755: link d0/da/db/d3a/cf6 d0/da/db/d2a/d8c/c109 0 2024-04-25T17:19:27.904 INFO:tasks.workunit.client.1.smithi069.stdout:0/756: chown d0/da/db/d2a/d8c/c109 22 1 2024-04-25T17:19:27.904 INFO:tasks.workunit.client.1.smithi069.stdout:2/841: mknod d0/d56/d5f/d62/c116 0 2024-04-25T17:19:27.905 INFO:tasks.workunit.client.1.smithi069.stdout:0/757: write d0/da/d24/d67/fee [991276,98114] 0 2024-04-25T17:19:27.905 INFO:tasks.workunit.client.1.smithi069.stdout:2/842: chown d0/d26/d10/d43/f7a 2737 1 2024-04-25T17:19:27.905 INFO:tasks.workunit.client.1.smithi069.stdout:7/859: dwrite d4/d3e/f80 [0,4194304] 0 2024-04-25T17:19:27.905 INFO:tasks.workunit.client.1.smithi069.stdout:4/832: dread db/d15/d42/d64/f83 [0,4194304] 0 2024-04-25T17:19:27.905 INFO:tasks.workunit.client.1.smithi069.stdout:0/758: dwrite d0/da/d24/f72 [0,4194304] 0 2024-04-25T17:19:27.905 INFO:tasks.workunit.client.1.smithi069.stdout:9/802: fsync d2/da/dd/d1e/d2e/d68/fb5 0 2024-04-25T17:19:27.910 INFO:tasks.workunit.client.1.smithi069.stdout:6/848: creat d2/d9c/d97/dad/df1/f11f x:0 0 0 2024-04-25T17:19:27.911 INFO:tasks.workunit.client.1.smithi069.stdout:6/849: dread - d2/d9c/f50 zero size 2024-04-25T17:19:27.914 INFO:tasks.workunit.client.1.smithi069.stdout:5/888: truncate d13/d17/d19/d1c/da4/da9/daa/fba 2160054 0 2024-04-25T17:19:27.959 INFO:tasks.workunit.client.0.smithi037.stdout:2/949: rename d0/d16/d20/d59/d6a/dbe/fff to d0/d16/d68/f12b 0 2024-04-25T17:19:27.960 INFO:tasks.workunit.client.0.smithi037.stdout:0/900: rename d9/df/d32/d39/d68 to d9/df/d32/d39/d68/da7/d125 22 2024-04-25T17:19:27.964 INFO:tasks.workunit.client.1.smithi069.stdout:1/833: sync 2024-04-25T17:19:27.974 INFO:tasks.workunit.client.0.smithi037.stdout:0/901: creat d9/df/d32/d56/f126 x:0 0 0 2024-04-25T17:19:27.976 INFO:tasks.workunit.client.0.smithi037.stdout:0/902: read d9/d14/d28/d48/d58/f5d [3547319,61335] 0 2024-04-25T17:19:27.983 INFO:tasks.workunit.client.0.smithi037.stdout:0/903: dwrite d9/df/d32/d39/dd3/fe6 [0,4194304] 0 2024-04-25T17:19:27.983 INFO:tasks.workunit.client.0.smithi037.stdout:8/762: getdents d5/db/d18/d3b/d50/d51 0 2024-04-25T17:19:27.993 INFO:tasks.workunit.client.0.smithi037.stdout:8/763: symlink d5/da/lfb 0 2024-04-25T17:19:27.997 INFO:tasks.workunit.client.0.smithi037.stdout:0/904: symlink d9/d14/d28/l127 0 2024-04-25T17:19:28.001 INFO:tasks.workunit.client.0.smithi037.stdout:2/950: rmdir d0/d16/d20/d59/d6a/da5/dbd/d117 0 2024-04-25T17:19:28.001 INFO:tasks.workunit.client.0.smithi037.stdout:2/951: chown d0/d16/d20/d55/dc8 216024 1 2024-04-25T17:19:28.014 INFO:tasks.workunit.client.0.smithi037.stdout:8/764: getdents d5/db/d23 0 2024-04-25T17:19:28.016 INFO:tasks.workunit.client.0.smithi037.stdout:0/905: getdents d9/df/dbd/de9/df2 0 2024-04-25T17:19:28.019 INFO:tasks.workunit.client.0.smithi037.stdout:0/906: write d9/df/dbd/de9/f114 [292435,56797] 0 2024-04-25T17:19:28.021 INFO:tasks.workunit.client.0.smithi037.stdout:6/848: dwrite db/d1d/f96 [0,4194304] 0 2024-04-25T17:19:28.026 INFO:tasks.workunit.client.0.smithi037.stdout:8/765: dwrite d5/db/d23/d78/d9c/fdf [0,4194304] 0 2024-04-25T17:19:28.029 INFO:tasks.workunit.client.1.smithi069.stdout:3/893: getdents d8/d16/d1a/d2c 0 2024-04-25T17:19:28.035 INFO:tasks.workunit.client.0.smithi037.stdout:6/849: creat db/d1d/d20/dcf/dfa/d65/d8b/dee/d105/f13a x:0 0 0 2024-04-25T17:19:28.037 INFO:tasks.workunit.client.1.smithi069.stdout:8/870: creat d37/d47/d78/db3/d114/d10a/f12b x:0 0 0 2024-04-25T17:19:28.041 INFO:tasks.workunit.client.0.smithi037.stdout:0/907: mknod d9/df/d32/dd1/d7a/c128 0 2024-04-25T17:19:28.043 INFO:tasks.workunit.client.0.smithi037.stdout:6/850: creat db/d26/d2e/d3e/d25/db0/f13b x:0 0 0 2024-04-25T17:19:28.046 INFO:tasks.workunit.client.1.smithi069.stdout:7/860: dread d4/d3e/d94/da1/dc7/d14/d15/f8d [0,4194304] 0 2024-04-25T17:19:28.047 INFO:tasks.workunit.client.1.smithi069.stdout:7/861: chown d4/d3e/d94/da1/dc7/d14/fde 41164496 1 2024-04-25T17:19:28.049 INFO:tasks.workunit.client.1.smithi069.stdout:0/759: creat d0/da/d24/d43/f10a x:0 0 0 2024-04-25T17:19:28.050 INFO:tasks.workunit.client.1.smithi069.stdout:0/760: stat d0/d17/fe7 0 2024-04-25T17:19:28.055 INFO:tasks.workunit.client.1.smithi069.stdout:6/850: mknod d2/d9c/d97/dad/df1/c120 0 2024-04-25T17:19:28.057 INFO:tasks.workunit.client.1.smithi069.stdout:5/889: rename d13/d17/d29/d30/d5c/c120 to d13/d17/d19/d1c/da4/c132 0 2024-04-25T17:19:28.058 INFO:tasks.workunit.client.1.smithi069.stdout:5/890: chown d13/d17/d29/dde/fe8 8 1 2024-04-25T17:19:28.060 INFO:tasks.workunit.client.1.smithi069.stdout:5/891: read d13/d17/d19/d1c/da4/da9/f110 [1652564,78845] 0 2024-04-25T17:19:28.061 INFO:tasks.workunit.client.1.smithi069.stdout:3/894: symlink d8/d16/d1a/d2c/d49/d59/l12c 0 2024-04-25T17:19:28.063 INFO:tasks.workunit.client.1.smithi069.stdout:2/843: symlink d0/d56/d5f/d62/dbc/l117 0 2024-04-25T17:19:28.064 INFO:tasks.workunit.client.0.smithi037.stdout:2/952: dwrite d0/d23/dac/d4b/fb5 [0,4194304] 0 2024-04-25T17:19:28.066 INFO:tasks.workunit.client.1.smithi069.stdout:4/833: mkdir db/d4b/d78/dc4/d41/d9e/df2/d11f/d126 0 2024-04-25T17:19:28.068 INFO:tasks.workunit.client.1.smithi069.stdout:0/761: chown d0/da/d24/d43/dfc/d5f/l99 150 1 2024-04-25T17:19:28.069 INFO:tasks.workunit.client.1.smithi069.stdout:2/844: dread d0/d1/d5b/fbb [0,4194304] 0 2024-04-25T17:19:28.070 INFO:tasks.workunit.client.0.smithi037.stdout:2/953: mkdir d0/d16/d20/d59/d6a/dbe/d12c 0 2024-04-25T17:19:28.072 INFO:tasks.workunit.client.0.smithi037.stdout:2/954: dread - d0/d15/fea zero size 2024-04-25T17:19:28.074 INFO:tasks.workunit.client.1.smithi069.stdout:1/834: symlink d1/de4/l106 0 2024-04-25T17:19:28.075 INFO:tasks.workunit.client.1.smithi069.stdout:1/835: stat d1/d4/d6/d9e/da6/d7c/d4d/d8f/c96 0 2024-04-25T17:19:28.075 INFO:tasks.workunit.client.1.smithi069.stdout:7/862: rename d4/d3e/d94/da1/dc7/d14/d44/d7c/d9f/fe9 to d4/d3e/d94/da1/dc7/d14/d15/dda/f124 0 2024-04-25T17:19:28.076 INFO:tasks.workunit.client.0.smithi037.stdout:2/955: mknod d0/d16/d20/d55/dd1/c12d 0 2024-04-25T17:19:28.077 INFO:tasks.workunit.client.1.smithi069.stdout:7/863: dread - d4/d3e/d94/da1/dc7/d14/d5a/d5e/f10f zero size 2024-04-25T17:19:28.078 INFO:tasks.workunit.client.1.smithi069.stdout:5/892: creat d13/d17/d19/d20/d51/db5/f133 x:0 0 0 2024-04-25T17:19:28.079 INFO:tasks.workunit.client.0.smithi037.stdout:2/956: rmdir d0/d15/d2a/d5a 39 2024-04-25T17:19:28.079 INFO:tasks.workunit.client.0.smithi037.stdout:2/957: chown d0/d23/d7d/lcf 13 1 2024-04-25T17:19:28.081 INFO:tasks.workunit.client.1.smithi069.stdout:4/834: mknod db/d15/d20/d35/c127 0 2024-04-25T17:19:28.085 INFO:tasks.workunit.client.1.smithi069.stdout:2/845: unlink d0/d56/d5f/d62/d7d/d72/daf/ffb 0 2024-04-25T17:19:28.086 INFO:tasks.workunit.client.1.smithi069.stdout:2/846: fdatasync d0/d56/d5f/d62/ff1 0 2024-04-25T17:19:28.086 INFO:tasks.workunit.client.1.smithi069.stdout:6/851: creat d2/d1e/d3e/d115/f121 x:0 0 0 2024-04-25T17:19:28.089 INFO:tasks.workunit.client.0.smithi037.stdout:8/766: dwrite d5/db/d23/fdb [0,4194304] 0 2024-04-25T17:19:28.090 INFO:tasks.workunit.client.1.smithi069.stdout:3/895: rename d8/d16/d4b/d9e/dca/fe2 to d8/d16/d1a/d2c/d49/d87/d8a/dd7/dfc/f12d 0 2024-04-25T17:19:28.099 INFO:tasks.workunit.client.1.smithi069.stdout:5/893: mkdir d13/d17/d19/d20/d2d/d93/d134 0 2024-04-25T17:19:28.102 INFO:tasks.workunit.client.1.smithi069.stdout:9/803: write d2/da/dd/d1e/d40/fca [79149,82812] 0 2024-04-25T17:19:28.104 INFO:tasks.workunit.client.0.smithi037.stdout:6/851: truncate db/d1d/d20/fac 311492 0 2024-04-25T17:19:28.105 INFO:tasks.workunit.client.0.smithi037.stdout:0/908: dwrite d9/df/d32/fed [0,4194304] 0 2024-04-25T17:19:28.106 INFO:tasks.workunit.client.1.smithi069.stdout:4/835: mknod db/d15/d20/d35/d63/d43/d48/d49/d72/deb/c128 0 2024-04-25T17:19:28.107 INFO:tasks.workunit.client.1.smithi069.stdout:4/836: chown db/d15/d42/d64/d7f/ce8 3369 1 2024-04-25T17:19:28.108 INFO:tasks.workunit.client.1.smithi069.stdout:9/804: dwrite d2/da/dd/de/d74/dbc/fd9 [0,4194304] 0 2024-04-25T17:19:28.112 INFO:tasks.workunit.client.0.smithi037.stdout:6/852: read db/d1d/d20/d2f/fcd [109877,4764] 0 2024-04-25T17:19:28.115 INFO:tasks.workunit.client.0.smithi037.stdout:0/909: truncate d9/df/f94 660675 0 2024-04-25T17:19:28.122 INFO:tasks.workunit.client.0.smithi037.stdout:0/910: fsync d9/d14/d28/ff4 0 2024-04-25T17:19:28.122 INFO:tasks.workunit.client.0.smithi037.stdout:0/911: readlink d9/d14/d28/l4f 0 2024-04-25T17:19:28.125 INFO:tasks.workunit.client.1.smithi069.stdout:3/896: dread - d8/d16/d1a/d2c/d49/dbc/ff6 zero size 2024-04-25T17:19:28.129 INFO:tasks.workunit.client.1.smithi069.stdout:8/871: getdents d37/d47/d78/db3/d114/d6b/d11b 0 2024-04-25T17:19:28.130 INFO:tasks.workunit.client.1.smithi069.stdout:5/894: dread - d13/d17/d19/d1c/fe7 zero size 2024-04-25T17:19:28.131 INFO:tasks.workunit.client.0.smithi037.stdout:2/958: write d0/d16/d3c/de5/fd7 [733674,63882] 0 2024-04-25T17:19:28.134 INFO:tasks.workunit.client.1.smithi069.stdout:0/762: dwrite d0/da/d24/d43/dfc/fba [0,4194304] 0 2024-04-25T17:19:28.136 INFO:tasks.workunit.client.1.smithi069.stdout:9/805: write d2/da/fbb [3300656,1993] 0 2024-04-25T17:19:28.138 INFO:tasks.workunit.client.1.smithi069.stdout:4/837: creat db/d15/d20/d35/d63/d43/d48/d49/d72/f129 x:0 0 0 2024-04-25T17:19:28.139 INFO:tasks.workunit.client.0.smithi037.stdout:8/767: write d5/d6a/f14 [2844907,56278] 0 2024-04-25T17:19:28.140 INFO:tasks.workunit.client.0.smithi037.stdout:2/959: creat d0/d23/dac/d4b/ded/f12e x:0 0 0 2024-04-25T17:19:28.141 INFO:tasks.workunit.client.0.smithi037.stdout:2/960: dread - d0/d16/d20/db9/f120 zero size 2024-04-25T17:19:28.144 INFO:tasks.workunit.client.1.smithi069.stdout:3/897: creat d8/d16/d1a/d2c/d49/dbc/f12e x:0 0 0 2024-04-25T17:19:28.146 INFO:tasks.workunit.client.1.smithi069.stdout:1/836: link d1/df/d17/f2f d1/d4/d6/d4f/d9b/da3/df9/f107 0 2024-04-25T17:19:28.150 INFO:tasks.workunit.client.1.smithi069.stdout:2/847: write d0/d26/f93 [2450085,27613] 0 2024-04-25T17:19:28.151 INFO:tasks.workunit.client.0.smithi037.stdout:8/768: mknod d5/cfc 0 2024-04-25T17:19:28.152 INFO:tasks.workunit.client.1.smithi069.stdout:5/895: mkdir d13/d17/d19/d20/d2d/d135 0 2024-04-25T17:19:28.156 INFO:tasks.workunit.client.1.smithi069.stdout:7/864: link d4/d3e/d94/da1/dc7/l113 d4/d3e/d94/da1/dc7/d14/d44/da8/l125 0 2024-04-25T17:19:28.156 INFO:tasks.workunit.client.0.smithi037.stdout:6/853: dwrite db/d26/d2e/f64 [0,4194304] 0 2024-04-25T17:19:28.157 INFO:tasks.workunit.client.1.smithi069.stdout:6/852: dwrite d2/d1e/d3f/f96 [0,4194304] 0 2024-04-25T17:19:28.158 INFO:tasks.workunit.client.0.smithi037.stdout:8/769: unlink d5/d6a/f14 0 2024-04-25T17:19:28.161 INFO:tasks.workunit.client.0.smithi037.stdout:8/770: truncate d5/d26/d81/ff3 361183 0 2024-04-25T17:19:28.166 INFO:tasks.workunit.client.1.smithi069.stdout:2/848: dread d0/d56/d5f/d62/f69 [0,4194304] 0 2024-04-25T17:19:28.168 INFO:tasks.workunit.client.0.smithi037.stdout:0/912: dwrite d9/df/d32/f3e [0,4194304] 0 2024-04-25T17:19:28.169 INFO:tasks.workunit.client.0.smithi037.stdout:0/913: chown d9/df/d32/d39/ccc 742021999 1 2024-04-25T17:19:28.175 INFO:tasks.workunit.client.0.smithi037.stdout:2/961: write d0/f9 [4083996,103928] 0 2024-04-25T17:19:28.176 INFO:tasks.workunit.client.0.smithi037.stdout:2/962: readlink d0/d23/dac/l46 0 2024-04-25T17:19:28.177 INFO:tasks.workunit.client.1.smithi069.stdout:1/837: mknod d1/d4/d6/d9e/da6/d7c/d1d/de1/c108 0 2024-04-25T17:19:28.177 INFO:tasks.workunit.client.1.smithi069.stdout:8/872: write d37/d62/f6d [1016768,95769] 0 2024-04-25T17:19:28.182 INFO:tasks.workunit.client.1.smithi069.stdout:5/896: creat d13/d17/d19/d1c/d6c/f136 x:0 0 0 2024-04-25T17:19:28.187 INFO:tasks.workunit.client.0.smithi037.stdout:6/854: rename db/d5a to db/d1d/d20/d13c 0 2024-04-25T17:19:28.188 INFO:tasks.workunit.client.1.smithi069.stdout:0/763: dwrite d0/d17/d83/dcf/de4/f100 [0,4194304] 0 2024-04-25T17:19:28.189 INFO:tasks.workunit.client.1.smithi069.stdout:6/853: mkdir d2/d9c/d97/dad/de8/d122 0 2024-04-25T17:19:28.191 INFO:tasks.workunit.client.0.smithi037.stdout:2/963: rmdir d0/d16/d20/d59/d6a/da5/dbd/dd6 39 2024-04-25T17:19:28.195 INFO:tasks.workunit.client.1.smithi069.stdout:0/764: dwrite d0/da/d6e/fe9 [0,4194304] 0 2024-04-25T17:19:28.197 INFO:tasks.workunit.client.0.smithi037.stdout:6/855: rename db/d1d/d20/dcf/dfa/d65/d68/dae/f109 to db/d26/d2e/d106/f13d 0 2024-04-25T17:19:28.198 INFO:tasks.workunit.client.0.smithi037.stdout:8/771: write d5/db/d18/d3b/d50/f94 [606899,17670] 0 2024-04-25T17:19:28.198 INFO:tasks.workunit.client.1.smithi069.stdout:9/806: dread d2/da/dd/d1e/d2e/d68/d8f/fad [0,4194304] 0 2024-04-25T17:19:28.198 INFO:tasks.workunit.client.0.smithi037.stdout:8/772: chown d5/dd0 1095469698 1 2024-04-25T17:19:28.199 INFO:tasks.workunit.client.0.smithi037.stdout:8/773: chown d5/db/d18/d3b/d50/fa4 4 1 2024-04-25T17:19:28.200 INFO:tasks.workunit.client.1.smithi069.stdout:2/849: creat d0/d26/d36/dc5/f118 x:0 0 0 2024-04-25T17:19:28.202 INFO:tasks.workunit.client.1.smithi069.stdout:4/838: symlink db/d15/d42/d64/d7f/d102/d124/l12a 0 2024-04-25T17:19:28.203 INFO:tasks.workunit.client.1.smithi069.stdout:3/898: unlink d8/d16/d1a/d2c/d6c/f8c 0 2024-04-25T17:19:28.204 INFO:tasks.workunit.client.1.smithi069.stdout:0/765: dwrite d0/da/d59/dab/fb7 [0,4194304] 0 2024-04-25T17:19:28.205 INFO:tasks.workunit.client.0.smithi037.stdout:0/914: write d9/df/f94 [649567,41352] 0 2024-04-25T17:19:28.208 INFO:tasks.workunit.client.0.smithi037.stdout:2/964: rename d0/d16/d20/d55/dc8 to d0/d23/d7d/dae/d12f 0 2024-04-25T17:19:28.209 INFO:tasks.workunit.client.1.smithi069.stdout:0/766: dread d0/da/d24/d43/dfc/f6f [0,4194304] 0 2024-04-25T17:19:28.214 INFO:tasks.workunit.client.0.smithi037.stdout:0/915: unlink d9/df/dbd/dc1/fde 0 2024-04-25T17:19:28.216 INFO:tasks.workunit.client.0.smithi037.stdout:2/965: truncate d0/d23/d7d/dae/d12f/f101 908119 0 2024-04-25T17:19:28.216 INFO:tasks.workunit.client.0.smithi037.stdout:0/916: truncate d9/d14/f9a 3224616 0 2024-04-25T17:19:28.216 INFO:tasks.workunit.client.1.smithi069.stdout:6/854: symlink d2/d9c/d97/dad/de8/l123 0 2024-04-25T17:19:28.220 INFO:tasks.workunit.client.0.smithi037.stdout:2/966: dread d0/d16/d68/f12b [0,4194304] 0 2024-04-25T17:19:28.224 INFO:tasks.workunit.client.1.smithi069.stdout:3/899: mknod d8/d16/d1a/d99/dab/c12f 0 2024-04-25T17:19:28.225 INFO:tasks.workunit.client.0.smithi037.stdout:2/967: write d0/f44 [4106012,28215] 0 2024-04-25T17:19:28.229 INFO:tasks.workunit.client.1.smithi069.stdout:4/839: mkdir db/d15/d20/d35/d63/d43/d48/d49/d72/d84/d12b 0 2024-04-25T17:19:28.229 INFO:tasks.workunit.client.0.smithi037.stdout:6/856: dread db/f56 [0,4194304] 0 2024-04-25T17:19:28.231 INFO:tasks.workunit.client.0.smithi037.stdout:0/917: creat d9/d14/f129 x:0 0 0 2024-04-25T17:19:28.231 INFO:tasks.workunit.client.1.smithi069.stdout:8/873: write d37/d47/d54/fbd [8508,112630] 0 2024-04-25T17:19:28.232 INFO:tasks.workunit.client.0.smithi037.stdout:0/918: fdatasync d9/d72/f9f 0 2024-04-25T17:19:28.236 INFO:tasks.workunit.client.1.smithi069.stdout:1/838: fsync d1/d43/f8a 0 2024-04-25T17:19:28.238 INFO:tasks.workunit.client.0.smithi037.stdout:6/857: dwrite db/d26/f12e [0,4194304] 0 2024-04-25T17:19:28.240 INFO:tasks.workunit.client.0.smithi037.stdout:8/774: dwrite d5/db/d18/d3b/d50/d51/f57 [0,4194304] 0 2024-04-25T17:19:28.241 INFO:tasks.workunit.client.1.smithi069.stdout:0/767: mknod d0/da/d59/c10b 0 2024-04-25T17:19:28.244 INFO:tasks.workunit.client.1.smithi069.stdout:5/897: symlink d13/d17/d29/d128/l137 0 2024-04-25T17:19:28.246 INFO:tasks.workunit.client.0.smithi037.stdout:0/919: fdatasync d9/d14/f36 0 2024-04-25T17:19:28.247 INFO:tasks.workunit.client.1.smithi069.stdout:2/850: dwrite d0/d56/d5f/d62/d7d/d72/fcf [4194304,4194304] 0 2024-04-25T17:19:28.247 INFO:tasks.workunit.client.0.smithi037.stdout:3/706: sync 2024-04-25T17:19:28.251 INFO:tasks.workunit.client.1.smithi069.stdout:7/865: rename d4/d18/d36 to d4/d1a/d126 0 2024-04-25T17:19:28.253 INFO:tasks.workunit.client.1.smithi069.stdout:6/855: mkdir d2/d1e/d43/db6/d124 0 2024-04-25T17:19:28.254 INFO:tasks.workunit.client.1.smithi069.stdout:6/856: chown d2/d1e/d3f/fe0 1 1 2024-04-25T17:19:28.254 INFO:tasks.workunit.client.0.smithi037.stdout:2/968: link d0/d16/d20/d59/c93 d0/d23/dfb/c130 0 2024-04-25T17:19:28.255 INFO:tasks.workunit.client.1.smithi069.stdout:9/807: mknod d2/da/dd/d1e/d2e/d68/dba/c118 0 2024-04-25T17:19:28.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:28.257+0000 7f5b06649700 1 -- 172.21.15.37:0/182838818 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f5aec005860 con 0x7f5b00066e50 2024-04-25T17:19:28.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:28.258+0000 7f5afcff9700 1 -- 172.21.15.37:0/182838818 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f5af0058220 con 0x7f5b00066e50 2024-04-25T17:19:28.258 INFO:teuthology.orchestra.run.smithi037.stdout:HEALTH_OK 2024-04-25T17:19:28.261 INFO:tasks.workunit.client.0.smithi037.stdout:0/920: mknod d9/df/d32/dd1/d7a/da4/c12a 0 2024-04-25T17:19:28.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:28.261+0000 7f5b06649700 1 -- 172.21.15.37:0/182838818 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f5ae806fcc0 msgr2=0x7f5ae8072170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:19:28.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:28.261+0000 7f5b06649700 1 --2- 172.21.15.37:0/182838818 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f5ae806fcc0 0x7f5ae8072170 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5af40138f0 tx=0x7f5af4009e30 comp rx=0 tx=0).stop 2024-04-25T17:19:28.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:28.261+0000 7f5b06649700 1 -- 172.21.15.37:0/182838818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b00066e50 msgr2=0x7f5b0010d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:19:28.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:28.261+0000 7f5b06649700 1 --2- 172.21.15.37:0/182838818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b00066e50 0x7f5b0010d970 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f5af00096b0 tx=0x7f5af0009e30 comp rx=0 tx=0).stop 2024-04-25T17:19:28.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:28.261+0000 7f5b06649700 1 -- 172.21.15.37:0/182838818 shutdown_connections 2024-04-25T17:19:28.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:28.262+0000 7f5b06649700 1 --2- 172.21.15.37:0/182838818 >> [v2:172.21.15.69:6828/2602478,v1:172.21.15.69:6829/2602478] conn(0x7f5ae806fcc0 0x7f5ae8072170 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:28.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:28.262+0000 7f5b06649700 1 --2- 172.21.15.37:0/182838818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b00066e50 0x7f5b0010d970 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:28.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:28.262+0000 7f5b06649700 1 --2- 172.21.15.37:0/182838818 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b000fff60 0x7f5b0010deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:28.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:28.262+0000 7f5b06649700 1 -- 172.21.15.37:0/182838818 >> 172.21.15.37:0/182838818 conn(0x7f5b000f7430 msgr2=0x7f5b000f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:19:28.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:28.262+0000 7f5b06649700 1 -- 172.21.15.37:0/182838818 shutdown_connections 2024-04-25T17:19:28.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:28.262+0000 7f5b06649700 1 -- 172.21.15.37:0/182838818 wait complete. 2024-04-25T17:19:28.263 INFO:tasks.workunit.client.0.smithi037.stdout:0/921: write d9/d72/f9f [3893780,88102] 0 2024-04-25T17:19:28.263 INFO:tasks.workunit.client.1.smithi069.stdout:8/874: mknod d37/d47/d54/dcc/d124/c12c 0 2024-04-25T17:19:28.264 INFO:tasks.workunit.client.1.smithi069.stdout:8/875: write d37/d47/d78/d93/df9/f106 [456951,35987] 0 2024-04-25T17:19:28.273 INFO:tasks.workunit.client.0.smithi037.stdout:0/922: symlink d9/df/d32/d39/dd3/l12b 0 2024-04-25T17:19:28.274 INFO:tasks.workunit.client.1.smithi069.stdout:4/840: dwrite db/d15/fa9 [0,4194304] 0 2024-04-25T17:19:28.276 INFO:tasks.workunit.client.0.smithi037.stdout:2/969: link d0/d23/dac/d4b/ded/f116 d0/d23/d7d/f131 0 2024-04-25T17:19:28.277 INFO:tasks.workunit.client.1.smithi069.stdout:0/768: write d0/da/db/d3a/f5a [3592936,111645] 0 2024-04-25T17:19:28.277 INFO:tasks.workunit.client.0.smithi037.stdout:2/970: dread - d0/d7c/dee/f114 zero size 2024-04-25T17:19:28.278 INFO:tasks.workunit.client.0.smithi037.stdout:8/775: truncate d5/db/d23/fdb 4148885 0 2024-04-25T17:19:28.282 INFO:tasks.workunit.client.1.smithi069.stdout:3/900: rmdir d8/d8b/db2 39 2024-04-25T17:19:28.283 INFO:tasks.workunit.client.1.smithi069.stdout:4/841: dwrite db/d15/d20/d35/d63/d70/d8a/d96/dbf/d103/f108 [0,4194304] 0 2024-04-25T17:19:28.284 INFO:tasks.workunit.client.0.smithi037.stdout:3/707: dread d8/d31/f47 [0,4194304] 0 2024-04-25T17:19:28.285 INFO:tasks.workunit.client.0.smithi037.stdout:6/858: getdents db/d1d/d20/dcf/dfa/d65/d68/dae 0 2024-04-25T17:19:28.286 INFO:tasks.workunit.client.1.smithi069.stdout:0/769: dread d0/da/d24/d67/fee [0,4194304] 0 2024-04-25T17:19:28.286 INFO:tasks.workunit.client.0.smithi037.stdout:6/859: stat db/d26/d2e/d3e/d25/d10d 0 2024-04-25T17:19:28.289 INFO:tasks.workunit.client.0.smithi037.stdout:8/776: creat d5/db/d18/ffd x:0 0 0 2024-04-25T17:19:28.290 INFO:tasks.workunit.client.1.smithi069.stdout:4/842: dread db/d15/d20/d35/d63/d43/d48/d49/f56 [0,4194304] 0 2024-04-25T17:19:28.291 INFO:tasks.workunit.client.1.smithi069.stdout:8/876: creat d37/d47/d54/d6e/d9e/f12d x:0 0 0 2024-04-25T17:19:28.292 INFO:tasks.workunit.client.1.smithi069.stdout:8/877: chown d37/d62/f107 208 1 2024-04-25T17:19:28.293 INFO:tasks.workunit.client.0.smithi037.stdout:2/971: symlink d0/d23/l132 0 2024-04-25T17:19:28.296 INFO:tasks.workunit.client.0.smithi037.stdout:8/777: creat d5/db/d18/d3b/d50/da0/da6/da8/ffe x:0 0 0 2024-04-25T17:19:28.297 INFO:tasks.workunit.client.0.smithi037.stdout:0/923: link d9/d14/d28/d48/l78 d9/df/d32/d39/d68/da7/l12c 0 2024-04-25T17:19:28.305 INFO:tasks.workunit.client.0.smithi037.stdout:6/860: unlink db/d26/d2e/c6b 0 2024-04-25T17:19:28.306 INFO:tasks.workunit.client.1.smithi069.stdout:5/898: write d13/d17/d19/d1c/d6c/fb3 [1983396,77773] 0 2024-04-25T17:19:28.306 INFO:tasks.workunit.client.0.smithi037.stdout:6/861: chown db/d1d/db1 750538 1 2024-04-25T17:19:28.308 INFO:tasks.workunit.client.1.smithi069.stdout:9/808: dread d2/da4/dcf/fc6 [0,4194304] 0 2024-04-25T17:19:28.311 INFO:tasks.workunit.client.0.smithi037.stdout:3/708: dread d8/d23/dbb/d81/fab [0,4194304] 0 2024-04-25T17:19:28.312 INFO:tasks.workunit.client.0.smithi037.stdout:3/709: chown d8/d23/d38/fb3 7 1 2024-04-25T17:19:28.313 INFO:tasks.workunit.client.1.smithi069.stdout:0/770: symlink d0/da/d6e/dd0/l10c 0 2024-04-25T17:19:28.314 INFO:tasks.workunit.client.1.smithi069.stdout:0/771: fsync d0/d17/d83/dcf/dd5/fec 0 2024-04-25T17:19:28.319 INFO:tasks.workunit.client.1.smithi069.stdout:8/878: write d37/d47/d78/f90 [234048,109954] 0 2024-04-25T17:19:28.322 INFO:tasks.workunit.client.1.smithi069.stdout:7/866: link d4/d3e/d94/fd0 d4/d3e/d94/da1/dc7/d14/d44/da8/f127 0 2024-04-25T17:19:28.322 INFO:tasks.workunit.client.1.smithi069.stdout:7/867: chown d4/d3e/d94/da1/dc7/d14/d44/d79/fe3 100366 1 2024-04-25T17:19:28.327 INFO:tasks.workunit.client.0.smithi037.stdout:8/778: dwrite d5/d6a/f9a [0,4194304] 0 2024-04-25T17:19:28.330 INFO:tasks.workunit.client.0.smithi037.stdout:0/924: dwrite d9/df/d32/dd1/d7a/fc9 [0,4194304] 0 2024-04-25T17:19:28.332 INFO:tasks.workunit.client.1.smithi069.stdout:9/809: unlink d2/da/dd/de/d74/f78 0 2024-04-25T17:19:28.332 INFO:tasks.workunit.client.1.smithi069.stdout:9/810: stat d2/d51/db4/ff5 0 2024-04-25T17:19:28.332 INFO:tasks.workunit.client.1.smithi069.stdout:9/811: chown d2/da4/fc7 652206 1 2024-04-25T17:19:28.335 INFO:tasks.workunit.client.1.smithi069.stdout:3/901: write d8/d71/d8d/d92/db6/dc1/f7a [3491589,403] 0 2024-04-25T17:19:28.336 INFO:tasks.workunit.client.0.smithi037.stdout:6/862: creat db/d26/d2e/f13e x:0 0 0 2024-04-25T17:19:28.336 INFO:tasks.workunit.client.0.smithi037.stdout:2/972: dwrite d0/d16/d20/d55/fdf [0,4194304] 0 2024-04-25T17:19:28.337 INFO:tasks.workunit.client.1.smithi069.stdout:0/772: truncate d0/da/d24/d67/f6a 655376 0 2024-04-25T17:19:28.341 INFO:tasks.workunit.client.0.smithi037.stdout:3/710: dwrite d8/d31/d32/dd7/f6e [4194304,4194304] 0 2024-04-25T17:19:28.343 INFO:tasks.workunit.client.0.smithi037.stdout:0/925: creat d9/d14/d28/d48/da9/ddc/f12d x:0 0 0 2024-04-25T17:19:28.344 INFO:tasks.workunit.client.1.smithi069.stdout:1/839: rename d1/d4/de/d44/d68/fda to d1/f109 0 2024-04-25T17:19:28.345 INFO:tasks.workunit.client.0.smithi037.stdout:8/779: dwrite d5/db/d18/d3b/d50/fde [0,4194304] 0 2024-04-25T17:19:28.358 INFO:tasks.workunit.client.0.smithi037.stdout:6/863: mkdir db/d26/d139/d13f 0 2024-04-25T17:19:28.360 INFO:tasks.workunit.client.1.smithi069.stdout:9/812: creat d2/da/dd/d1e/f119 x:0 0 0 2024-04-25T17:19:28.361 INFO:tasks.workunit.client.0.smithi037.stdout:0/926: symlink d9/df/d32/d39/dd3/l12e 0 2024-04-25T17:19:28.363 INFO:tasks.workunit.client.0.smithi037.stdout:5/869: sync 2024-04-25T17:19:28.363 INFO:tasks.workunit.client.0.smithi037.stdout:1/959: sync 2024-04-25T17:19:28.363 INFO:tasks.workunit.client.0.smithi037.stdout:3/711: rename d8/d31/d32/dd7/d7d/lb2 to d8/d23/dbb/d5d/le0 0 2024-04-25T17:19:28.363 INFO:tasks.workunit.client.1.smithi069.stdout:2/851: getdents d0/d26/d10/db5/de3 0 2024-04-25T17:19:28.365 INFO:tasks.workunit.client.0.smithi037.stdout:8/780: dread d5/db/d18/d3b/d50/ff7 [0,4194304] 0 2024-04-25T17:19:28.366 INFO:tasks.workunit.client.1.smithi069.stdout:6/857: rename d2/d9c/d97/dad/de8/l123 to d2/d1e/d43/db6/d124/l125 0 2024-04-25T17:19:28.366 INFO:tasks.workunit.client.0.smithi037.stdout:7/780: sync 2024-04-25T17:19:28.368 INFO:tasks.workunit.client.0.smithi037.stdout:6/864: rmdir db/d26/d2e/d3e/d25/d61 39 2024-04-25T17:19:28.374 INFO:tasks.workunit.client.0.smithi037.stdout:1/960: symlink dc/d52/d6b/l14a 0 2024-04-25T17:19:28.374 INFO:tasks.workunit.client.0.smithi037.stdout:7/781: read d5/d15/d17/f20 [4648927,128605] 0 2024-04-25T17:19:28.376 INFO:tasks.workunit.client.1.smithi069.stdout:8/879: write d37/d47/ffd [1960535,42650] 0 2024-04-25T17:19:28.376 INFO:tasks.workunit.client.1.smithi069.stdout:8/880: stat d37/d47/d78/d93/df9/l117 0 2024-04-25T17:19:28.378 INFO:tasks.workunit.client.0.smithi037.stdout:3/712: creat d8/d23/d38/fe1 x:0 0 0 2024-04-25T17:19:28.379 INFO:tasks.workunit.client.1.smithi069.stdout:9/813: mknod d2/da/d5f/c11a 0 2024-04-25T17:19:28.379 INFO:tasks.workunit.client.1.smithi069.stdout:9/814: stat d2/da/dd/d1e/d2e/d35/lef 0 2024-04-25T17:19:28.380 INFO:tasks.workunit.client.1.smithi069.stdout:9/815: fsync d2/da/d5f/fae 0 2024-04-25T17:19:28.380 INFO:tasks.workunit.client.1.smithi069.stdout:0/773: mknod d0/da/db/c10d 0 2024-04-25T17:19:28.381 INFO:tasks.workunit.client.0.smithi037.stdout:2/973: dwrite d0/d16/d20/d55/f6f [0,4194304] 0 2024-04-25T17:19:28.388 INFO:tasks.workunit.client.1.smithi069.stdout:0/774: dwrite d0/da/db/d56/f78 [0,4194304] 0 2024-04-25T17:19:28.388 INFO:tasks.workunit.client.0.smithi037.stdout:5/870: write d7/d18/d62/f8c [4816736,112633] 0 2024-04-25T17:19:28.394 INFO:tasks.workunit.client.1.smithi069.stdout:4/843: rename db/d15/d42/d64/f83 to db/d4b/d78/dc4/d41/d9e/df2/f12c 0 2024-04-25T17:19:28.397 INFO:tasks.workunit.client.0.smithi037.stdout:3/713: dread - d8/f5c zero size 2024-04-25T17:19:28.398 INFO:tasks.workunit.client.1.smithi069.stdout:5/899: getdents d13/d17/d29/d128 0 2024-04-25T17:19:28.399 INFO:tasks.workunit.client.1.smithi069.stdout:6/858: dwrite d2/d1e/fa1 [0,4194304] 0 2024-04-25T17:19:28.399 INFO:tasks.workunit.client.1.smithi069.stdout:8/881: mknod d37/d47/d54/d6e/d9e/c12e 0 2024-04-25T17:19:28.406 INFO:tasks.workunit.client.0.smithi037.stdout:0/927: rename d9/df/dbd/de9/df2 to d9/d12f 0 2024-04-25T17:19:28.406 INFO:tasks.workunit.client.0.smithi037.stdout:1/961: dread dc/d52/d6b/dd9/d4d/d6a/dea/fb4 [0,4194304] 0 2024-04-25T17:19:28.407 INFO:tasks.workunit.client.1.smithi069.stdout:8/882: dwrite d37/d47/d54/d6e/d9e/f11f [0,4194304] 0 2024-04-25T17:19:28.407 INFO:tasks.workunit.client.1.smithi069.stdout:8/883: readlink d37/l56 0 2024-04-25T17:19:28.408 INFO:tasks.workunit.client.0.smithi037.stdout:1/962: chown dc/d52/d6b/dd9/d4d/c107 11 1 2024-04-25T17:19:28.409 INFO:tasks.workunit.client.1.smithi069.stdout:9/816: dread d2/da/dd/d1e/d2e/d68/fb5 [0,4194304] 0 2024-04-25T17:19:28.410 INFO:tasks.workunit.client.0.smithi037.stdout:6/865: write db/d1d/d20/dcf/dfa/f76 [896376,59151] 0 2024-04-25T17:19:28.413 INFO:tasks.workunit.client.1.smithi069.stdout:7/868: truncate d4/d1a/f102 985517 0 2024-04-25T17:19:28.413 INFO:tasks.workunit.client.0.smithi037.stdout:0/928: dread d9/df/d32/d39/dd3/fe6 [0,4194304] 0 2024-04-25T17:19:28.415 INFO:tasks.workunit.client.0.smithi037.stdout:3/714: mknod d8/d57/ce2 0 2024-04-25T17:19:28.416 INFO:tasks.workunit.client.1.smithi069.stdout:1/840: creat d1/df/f10a x:0 0 0 2024-04-25T17:19:28.417 INFO:tasks.workunit.client.0.smithi037.stdout:8/781: creat d5/db/d23/d58/fff x:0 0 0 2024-04-25T17:19:28.421 INFO:tasks.workunit.client.1.smithi069.stdout:3/902: rename d8/d71/d8d/d92/db6/dc1/d42 to d8/d71/d8d/d92/d130 0 2024-04-25T17:19:28.422 INFO:tasks.workunit.client.0.smithi037.stdout:7/782: dread d5/d15/fdc [0,4194304] 0 2024-04-25T17:19:28.423 INFO:tasks.workunit.client.0.smithi037.stdout:8/782: dread d5/db/d18/d3b/d50/d51/f57 [0,4194304] 0 2024-04-25T17:19:28.424 INFO:tasks.workunit.client.0.smithi037.stdout:2/974: rename d0/d15/d2a/d5a/fa3 to d0/d7c/f133 0 2024-04-25T17:19:28.427 INFO:tasks.workunit.client.0.smithi037.stdout:5/871: mkdir d7/da1/dda/ddc/d108 0 2024-04-25T17:19:28.428 INFO:tasks.workunit.client.1.smithi069.stdout:6/859: mknod d2/d51/d85/d108/c126 0 2024-04-25T17:19:28.431 INFO:tasks.workunit.client.0.smithi037.stdout:1/963: read dc/d52/d6b/dd9/d4d/d6a/d86/d91/fd4 [1263860,72049] 0 2024-04-25T17:19:28.434 INFO:tasks.workunit.client.0.smithi037.stdout:1/964: dread - dc/d52/d6b/dd9/d22/d36/d92/db8/dbc/f131 zero size 2024-04-25T17:19:28.434 INFO:tasks.workunit.client.1.smithi069.stdout:4/844: dread db/d15/d20/d35/d63/d43/d48/d49/d4e/fd6 [0,4194304] 0 2024-04-25T17:19:28.435 INFO:tasks.workunit.client.0.smithi037.stdout:1/965: chown dc/d52/d6b/dd9/d22/d36/d74/da6/f11d 0 1 2024-04-25T17:19:28.437 INFO:tasks.workunit.client.0.smithi037.stdout:3/715: dread - d8/d23/dbb/d81/fa8 zero size 2024-04-25T17:19:28.442 INFO:tasks.workunit.client.1.smithi069.stdout:1/841: truncate d1/df/d17/f3b 227200 0 2024-04-25T17:19:28.442 INFO:tasks.workunit.client.1.smithi069.stdout:5/900: dread d13/d17/d19/d1c/f45 [0,4194304] 0 2024-04-25T17:19:28.443 INFO:tasks.workunit.client.0.smithi037.stdout:2/975: creat d0/d16/d20/d59/f134 x:0 0 0 2024-04-25T17:19:28.443 INFO:tasks.workunit.client.1.smithi069.stdout:5/901: chown d13/d17/d19/d1c/da4/da9/daa/fe0 2088589 1 2024-04-25T17:19:28.445 INFO:tasks.workunit.client.1.smithi069.stdout:3/903: creat d8/d39/dfa/f131 x:0 0 0 2024-04-25T17:19:28.448 INFO:tasks.workunit.client.1.smithi069.stdout:4/845: dread db/d15/d20/d35/d63/d43/d48/d6c/fe2 [0,4194304] 0 2024-04-25T17:19:28.448 INFO:tasks.workunit.client.1.smithi069.stdout:6/860: rmdir d2/d1e/d3f/d56/de5 39 2024-04-25T17:19:28.448 INFO:tasks.workunit.client.1.smithi069.stdout:6/861: stat d2/d1e/d43/db6/de4 0 2024-04-25T17:19:28.450 INFO:tasks.workunit.client.1.smithi069.stdout:8/884: dread f33 [0,4194304] 0 2024-04-25T17:19:28.452 INFO:tasks.workunit.client.0.smithi037.stdout:0/929: mkdir d9/d14/d28/d130 0 2024-04-25T17:19:28.453 INFO:tasks.workunit.client.0.smithi037.stdout:0/930: readlink d9/df/d32/d39/l123 0 2024-04-25T17:19:28.453 INFO:tasks.workunit.client.1.smithi069.stdout:7/869: dwrite d4/d3e/d94/da1/dc7/d14/d5a/d5e/f95 [0,4194304] 0 2024-04-25T17:19:28.454 INFO:tasks.workunit.client.0.smithi037.stdout:0/931: dread - d9/d12f/f121 zero size 2024-04-25T17:19:28.454 INFO:tasks.workunit.client.0.smithi037.stdout:1/966: creat dc/d52/d6b/f14b x:0 0 0 2024-04-25T17:19:28.457 INFO:tasks.workunit.client.1.smithi069.stdout:9/817: truncate d2/da/fbb 2682762 0 2024-04-25T17:19:28.457 INFO:tasks.workunit.client.1.smithi069.stdout:9/818: dread - d2/da/fe3 zero size 2024-04-25T17:19:28.460 INFO:tasks.workunit.client.0.smithi037.stdout:0/932: dread d9/df/d32/d39/fcb [0,4194304] 0 2024-04-25T17:19:28.463 INFO:tasks.workunit.client.0.smithi037.stdout:2/976: symlink d0/d16/d20/d55/l135 0 2024-04-25T17:19:28.466 INFO:tasks.workunit.client.1.smithi069.stdout:5/902: creat d13/d17/d29/f138 x:0 0 0 2024-04-25T17:19:28.466 INFO:tasks.workunit.client.1.smithi069.stdout:5/903: dread - d13/d17/d19/d96/d9d/f118 zero size 2024-04-25T17:19:28.472 INFO:tasks.workunit.client.1.smithi069.stdout:1/842: write d1/d4/d6/fa9 [2036740,3318] 0 2024-04-25T17:19:28.473 INFO:tasks.workunit.client.0.smithi037.stdout:1/967: creat dc/d52/d6b/dd9/d22/f14c x:0 0 0 2024-04-25T17:19:28.475 INFO:tasks.workunit.client.1.smithi069.stdout:4/846: rmdir db/d15/d20/d35/d63/d43/d48/d6c 39 2024-04-25T17:19:28.481 INFO:tasks.workunit.client.1.smithi069.stdout:8/885: creat d37/d47/d54/d6e/d9e/f12f x:0 0 0 2024-04-25T17:19:28.482 INFO:tasks.workunit.client.0.smithi037.stdout:5/872: creat d7/f109 x:0 0 0 2024-04-25T17:19:28.483 INFO:tasks.workunit.client.0.smithi037.stdout:0/933: write d9/d14/d28/d48/f7e [4649946,122582] 0 2024-04-25T17:19:28.483 INFO:tasks.workunit.client.1.smithi069.stdout:2/852: link d0/d26/f2b d0/d1/d5b/f119 0 2024-04-25T17:19:28.484 INFO:tasks.workunit.client.0.smithi037.stdout:0/934: dread - d9/d71/f124 zero size 2024-04-25T17:19:28.484 INFO:tasks.workunit.client.1.smithi069.stdout:2/853: fdatasync d0/d1/d5b/fc9 0 2024-04-25T17:19:28.485 INFO:tasks.workunit.client.0.smithi037.stdout:6/866: getdents db/d26/d2e/d82 0 2024-04-25T17:19:28.487 INFO:tasks.workunit.client.0.smithi037.stdout:3/716: creat d8/d31/fe3 x:0 0 0 2024-04-25T17:19:28.488 INFO:tasks.workunit.client.1.smithi069.stdout:2/854: read d0/d56/d5f/f71 [3653678,122561] 0 2024-04-25T17:19:28.489 INFO:tasks.workunit.client.1.smithi069.stdout:0/775: rename d0/da/d54/d7d/d8e/la4 to d0/da/db/l10e 0 2024-04-25T17:19:28.490 INFO:tasks.workunit.client.0.smithi037.stdout:7/783: getdents d5/d15/d17 0 2024-04-25T17:19:28.492 INFO:tasks.workunit.client.1.smithi069.stdout:5/904: readlink d13/d17/d19/d20/ld3 0 2024-04-25T17:19:28.493 INFO:tasks.workunit.client.0.smithi037.stdout:5/873: fdatasync d7/d18/f8e 0 2024-04-25T17:19:28.494 INFO:tasks.workunit.client.1.smithi069.stdout:3/904: creat d8/d16/d4b/d9e/deb/d123/f132 x:0 0 0 2024-04-25T17:19:28.497 INFO:tasks.workunit.client.1.smithi069.stdout:1/843: dread d1/d43/f8a [0,4194304] 0 2024-04-25T17:19:28.498 INFO:tasks.workunit.client.1.smithi069.stdout:1/844: write d1/df/f30 [2338456,10784] 0 2024-04-25T17:19:28.499 INFO:tasks.workunit.client.1.smithi069.stdout:1/845: chown d1/d4/de/d44 20 1 2024-04-25T17:19:28.499 INFO:tasks.workunit.client.1.smithi069.stdout:4/847: mkdir db/d15/d20/d35/d63/d43/d48/d49/d4e/d12d 0 2024-04-25T17:19:28.500 INFO:tasks.workunit.client.1.smithi069.stdout:4/848: chown db/d15/f1d 300608 1 2024-04-25T17:19:28.502 INFO:tasks.workunit.client.1.smithi069.stdout:2/855: dread d0/d26/d10/d43/fbe [0,4194304] 0 2024-04-25T17:19:28.503 INFO:tasks.workunit.client.0.smithi037.stdout:2/977: truncate d0/d16/f1b 598454 0 2024-04-25T17:19:28.504 INFO:tasks.workunit.client.0.smithi037.stdout:2/978: chown d0/d16/d20/d55/dd1/c12d 15330 1 2024-04-25T17:19:28.504 INFO:tasks.workunit.client.0.smithi037.stdout:6/867: creat db/d26/d2e/d3e/d25/d10d/d124/f140 x:0 0 0 2024-04-25T17:19:28.506 INFO:tasks.workunit.client.1.smithi069.stdout:8/886: creat d37/d47/d78/db3/f130 x:0 0 0 2024-04-25T17:19:28.510 INFO:tasks.workunit.client.1.smithi069.stdout:7/870: rename d4/d3e/d94/da1/dc7/d14/d15/f10a to d4/d3e/d94/da1/dc7/d14/d44/d88/f128 0 2024-04-25T17:19:28.519 INFO:tasks.workunit.client.0.smithi037.stdout:6/868: read db/d1d/f79 [290213,30890] 0 2024-04-25T17:19:28.520 INFO:tasks.workunit.client.0.smithi037.stdout:6/869: dread - db/d26/d2e/f13e zero size 2024-04-25T17:19:28.521 INFO:tasks.workunit.client.1.smithi069.stdout:1/846: write d1/fbf [1022979,57670] 0 2024-04-25T17:19:28.523 INFO:tasks.workunit.client.1.smithi069.stdout:6/862: creat d2/d1e/f127 x:0 0 0 2024-04-25T17:19:28.523 INFO:tasks.workunit.client.0.smithi037.stdout:7/784: symlink d5/d15/d17/d25/d2b/d59/dfe/l102 0 2024-04-25T17:19:28.524 INFO:tasks.workunit.client.1.smithi069.stdout:4/849: creat db/d15/d20/d35/d63/d70/d8a/d96/dbf/d103/f12e x:0 0 0 2024-04-25T17:19:28.525 INFO:tasks.workunit.client.1.smithi069.stdout:4/850: readlink db/d15/d20/d35/d63/ldf 0 2024-04-25T17:19:28.527 INFO:tasks.workunit.client.1.smithi069.stdout:0/776: write d0/da/d24/d43/dfc/d5f/f93 [958074,50294] 0 2024-04-25T17:19:28.529 INFO:tasks.workunit.client.1.smithi069.stdout:0/777: chown d0/d17/d83/cfa 1174797739 1 2024-04-25T17:19:28.529 INFO:tasks.workunit.client.1.smithi069.stdout:5/905: dread d13/d17/d19/d20/d51/db5/fe1 [0,4194304] 0 2024-04-25T17:19:28.530 INFO:tasks.workunit.client.0.smithi037.stdout:0/935: truncate d9/d14/d23/f1e 1195502 0 2024-04-25T17:19:28.531 INFO:tasks.workunit.client.1.smithi069.stdout:8/887: creat d37/d47/d48/f131 x:0 0 0 2024-04-25T17:19:28.531 INFO:tasks.workunit.client.1.smithi069.stdout:3/905: write d8/d16/d1a/d2c/d6c/d9c/fc7 [3742484,21896] 0 2024-04-25T17:19:28.531 INFO:tasks.workunit.client.1.smithi069.stdout:8/888: chown d37/d62/ccb 4 1 2024-04-25T17:19:28.534 INFO:tasks.workunit.client.0.smithi037.stdout:5/874: dread d7/d12/f20 [0,4194304] 0 2024-04-25T17:19:28.535 INFO:tasks.workunit.client.0.smithi037.stdout:3/717: creat d8/fe4 x:0 0 0 2024-04-25T17:19:28.537 INFO:tasks.workunit.client.0.smithi037.stdout:3/718: read d8/d31/f5f [3599844,25674] 0 2024-04-25T17:19:28.538 INFO:tasks.workunit.client.0.smithi037.stdout:3/719: chown d8/d23/dbb/d63/l7f 1932713 1 2024-04-25T17:19:28.539 INFO:tasks.workunit.client.0.smithi037.stdout:2/979: truncate d0/fa2 2845390 0 2024-04-25T17:19:28.542 INFO:tasks.workunit.client.1.smithi069.stdout:6/863: mkdir d2/d1e/d43/db6/daf/dbe/d128 0 2024-04-25T17:19:28.545 INFO:tasks.workunit.client.0.smithi037.stdout:5/875: creat d7/da1/dda/ddc/f10a x:0 0 0 2024-04-25T17:19:28.545 INFO:tasks.workunit.client.0.smithi037.stdout:5/876: stat d7/d12/d6f/ld6 0 2024-04-25T17:19:28.546 INFO:tasks.workunit.client.1.smithi069.stdout:4/851: read db/d4b/f6e [441788,107986] 0 2024-04-25T17:19:28.546 INFO:tasks.workunit.client.1.smithi069.stdout:4/852: write db/d15/d20/d35/d63/d70/faf [474855,4605] 0 2024-04-25T17:19:28.547 INFO:tasks.workunit.client.1.smithi069.stdout:2/856: mknod d0/c11a 0 2024-04-25T17:19:28.547 INFO:tasks.workunit.client.1.smithi069.stdout:4/853: read db/d15/f18 [3421449,71814] 0 2024-04-25T17:19:28.549 INFO:tasks.workunit.client.0.smithi037.stdout:0/936: write d9/df/d32/d39/fcb [253135,47580] 0 2024-04-25T17:19:28.551 INFO:tasks.workunit.client.0.smithi037.stdout:0/937: read d9/f73 [1802112,48910] 0 2024-04-25T17:19:28.552 INFO:tasks.workunit.client.0.smithi037.stdout:0/938: readlink d9/d72/lbb 0 2024-04-25T17:19:28.552 INFO:tasks.workunit.client.0.smithi037.stdout:0/939: read - d9/df/d32/d56/d106/f110 zero size 2024-04-25T17:19:28.553 INFO:tasks.workunit.client.0.smithi037.stdout:2/980: creat d0/d16/d20/db9/d10f/f136 x:0 0 0 2024-04-25T17:19:28.554 INFO:tasks.workunit.client.0.smithi037.stdout:0/940: stat d9/d14/d28/d48/da9/ddc 0 2024-04-25T17:19:28.554 INFO:tasks.workunit.client.0.smithi037.stdout:2/981: chown d0/d15/d2a/d5a/d75/ffd 1728946 1 2024-04-25T17:19:28.555 INFO:tasks.workunit.client.0.smithi037.stdout:0/941: write d9/df/d32/dd1/d7a/fc9 [2227589,654] 0 2024-04-25T17:19:28.559 INFO:tasks.workunit.client.0.smithi037.stdout:5/877: chown d7/da1/db0/ld3 62 1 2024-04-25T17:19:28.561 INFO:tasks.workunit.client.0.smithi037.stdout:7/785: rename d5/d15/l22 to d5/d15/l103 0 2024-04-25T17:19:28.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:28 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/182838818' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T17:19:28.573 INFO:tasks.workunit.client.0.smithi037.stdout:6/870: getdents db/d1d/d20/dcf/dfa/d65/d8b 0 2024-04-25T17:19:28.573 INFO:tasks.workunit.client.0.smithi037.stdout:6/871: chown db/d53/f54 38037 1 2024-04-25T17:19:28.576 INFO:tasks.workunit.client.1.smithi069.stdout:7/871: unlink d4/d3e/d94/da1/dc7/d14/d44/d7c/d9f/dcb/lbf 0 2024-04-25T17:19:28.577 INFO:tasks.workunit.client.1.smithi069.stdout:2/857: fdatasync d0/d26/d10/d43/f7a 0 2024-04-25T17:19:28.577 INFO:tasks.workunit.client.1.smithi069.stdout:6/864: write d2/d7/dbc/fc4 [602074,3111] 0 2024-04-25T17:19:28.577 INFO:tasks.workunit.client.0.smithi037.stdout:7/786: rename d5/d14/d31/c3e to d5/d15/d17/d1b/d94/da8/c104 0 2024-04-25T17:19:28.578 INFO:tasks.workunit.client.1.smithi069.stdout:4/854: write db/d22/f71 [5533919,19774] 0 2024-04-25T17:19:28.578 INFO:tasks.workunit.client.1.smithi069.stdout:0/778: dread d0/da/db/fe [0,4194304] 0 2024-04-25T17:19:28.579 INFO:tasks.workunit.client.1.smithi069.stdout:5/906: truncate d13/d17/d19/d96/d9d/fa7 3438898 0 2024-04-25T17:19:28.581 INFO:tasks.workunit.client.0.smithi037.stdout:0/942: dwrite d9/d72/fa0 [0,4194304] 0 2024-04-25T17:19:28.585 INFO:tasks.workunit.client.0.smithi037.stdout:5/878: dwrite d7/d43/d9f/fd5 [0,4194304] 0 2024-04-25T17:19:28.597 INFO:tasks.workunit.client.1.smithi069.stdout:2/858: rmdir d0 39 2024-04-25T17:19:28.598 INFO:tasks.workunit.client.0.smithi037.stdout:3/720: getdents d8/d4c 0 2024-04-25T17:19:28.599 INFO:tasks.workunit.client.0.smithi037.stdout:3/721: chown d8/d23/dbb/l3b 85 1 2024-04-25T17:19:28.600 INFO:tasks.workunit.client.1.smithi069.stdout:4/855: rmdir db/d15/d20/d35/d63/d70/d8a 39 2024-04-25T17:19:28.600 INFO:tasks.workunit.client.0.smithi037.stdout:2/982: link d0/d16/d20/d59/d6a/da5/dbd/ca8 d0/d16/d20/d59/d125/c137 0 2024-04-25T17:19:28.601 INFO:tasks.workunit.client.1.smithi069.stdout:1/847: getdents d1/d43/d1b/d32/d4a/d4b 0 2024-04-25T17:19:28.602 INFO:tasks.workunit.client.0.smithi037.stdout:0/943: rmdir d9/df/d32/dd1/d7a/daf/db1 39 2024-04-25T17:19:28.602 INFO:tasks.workunit.client.1.smithi069.stdout:1/848: dread - d1/d4/d6/d9e/da6/d7c/fe0 zero size 2024-04-25T17:19:28.602 INFO:tasks.workunit.client.1.smithi069.stdout:1/849: chown d1/d4/c40 647950 1 2024-04-25T17:19:28.603 INFO:tasks.workunit.client.1.smithi069.stdout:1/850: readlink d1/d4/d6/d9e/da6/d7c/d1d/l9a 0 2024-04-25T17:19:28.604 INFO:tasks.workunit.client.0.smithi037.stdout:6/872: creat db/d26/d139/d13f/f141 x:0 0 0 2024-04-25T17:19:28.604 INFO:tasks.workunit.client.0.smithi037.stdout:5/879: rmdir d7/d12/d5d/d90/db1 39 2024-04-25T17:19:28.606 INFO:tasks.workunit.client.1.smithi069.stdout:8/889: creat d37/d47/d78/f132 x:0 0 0 2024-04-25T17:19:28.607 INFO:tasks.workunit.client.1.smithi069.stdout:7/872: write d4/f58 [1440108,46306] 0 2024-04-25T17:19:28.607 INFO:tasks.workunit.client.1.smithi069.stdout:8/890: chown d37/d47/d78/l104 25910473 1 2024-04-25T17:19:28.610 INFO:tasks.workunit.client.0.smithi037.stdout:3/722: unlink d8/d31/d32/cd2 0 2024-04-25T17:19:28.616 INFO:tasks.workunit.client.1.smithi069.stdout:6/865: creat d2/d9c/d97/d98/df3/f129 x:0 0 0 2024-04-25T17:19:28.616 INFO:tasks.workunit.client.1.smithi069.stdout:0/779: dwrite d0/da/d24/d43/dfc/d89/fbc [0,4194304] 0 2024-04-25T17:19:28.617 INFO:tasks.workunit.client.1.smithi069.stdout:6/866: write d2/d1e/d43/db6/f7c [1000887,83897] 0 2024-04-25T17:19:28.617 INFO:tasks.workunit.client.1.smithi069.stdout:0/780: write d0/da/d6e/f84 [747185,32000] 0 2024-04-25T17:19:28.618 INFO:tasks.workunit.client.1.smithi069.stdout:4/856: rmdir db/d15/d20/d35/d63/d43/d48/d49/d4e 39 2024-04-25T17:19:28.621 INFO:tasks.workunit.client.1.smithi069.stdout:5/907: mkdir d13/d17/d19/d1c/d6c/df1/d139 0 2024-04-25T17:19:28.622 INFO:tasks.workunit.client.0.smithi037.stdout:2/983: mkdir d0/d23/dac/d138 0 2024-04-25T17:19:28.624 INFO:tasks.workunit.client.0.smithi037.stdout:3/723: truncate d8/d23/dbb/d81/fa8 825300 0 2024-04-25T17:19:28.626 INFO:tasks.workunit.client.1.smithi069.stdout:1/851: rename d1/d43/d1b/d32/d4a/lba to d1/d4/d6/d9e/da6/d7c/d1d/de1/d8e/dbb/dfc/l10b 0 2024-04-25T17:19:28.627 INFO:tasks.workunit.client.1.smithi069.stdout:8/891: readlink l1b 0 2024-04-25T17:19:28.627 INFO:tasks.workunit.client.0.smithi037.stdout:0/944: dwrite d9/df/d32/f10b [0,4194304] 0 2024-04-25T17:19:28.629 INFO:tasks.workunit.client.1.smithi069.stdout:7/873: unlink d4/d3e/d94/da1/dc7/c42 0 2024-04-25T17:19:28.631 INFO:tasks.workunit.client.0.smithi037.stdout:5/880: rename d7/d18/l4e to d7/d63/l10b 0 2024-04-25T17:19:28.632 INFO:tasks.workunit.client.0.smithi037.stdout:5/881: readlink d7/l93 0 2024-04-25T17:19:28.633 INFO:tasks.workunit.client.1.smithi069.stdout:1/852: dwrite d1/d4/de/fdb [0,4194304] 0 2024-04-25T17:19:28.635 INFO:tasks.workunit.client.1.smithi069.stdout:1/853: chown d1/d4/de/f99 5 1 2024-04-25T17:19:28.635 INFO:tasks.workunit.client.0.smithi037.stdout:3/724: chown d8/db4/l85 14368 1 2024-04-25T17:19:28.639 INFO:tasks.workunit.client.1.smithi069.stdout:0/781: unlink d0/d38/fde 0 2024-04-25T17:19:28.641 INFO:tasks.workunit.client.0.smithi037.stdout:6/873: link db/d26/d2e/d3e/f4c db/d26/f142 0 2024-04-25T17:19:28.645 INFO:tasks.workunit.client.0.smithi037.stdout:0/945: truncate d9/df/d32/dd1/d7a/daf/fc6 800739 0 2024-04-25T17:19:28.647 INFO:tasks.workunit.client.0.smithi037.stdout:5/882: fsync d7/d25/f8a 0 2024-04-25T17:19:28.648 INFO:tasks.workunit.client.0.smithi037.stdout:7/787: truncate d5/d14/d31/f3f 5424619 0 2024-04-25T17:19:28.649 INFO:tasks.workunit.client.1.smithi069.stdout:8/892: creat d37/d47/d78/d93/f133 x:0 0 0 2024-04-25T17:19:28.650 INFO:tasks.workunit.client.1.smithi069.stdout:2/859: write d0/d56/d94/f110 [398545,79178] 0 2024-04-25T17:19:28.651 INFO:tasks.workunit.client.0.smithi037.stdout:2/984: creat d0/d23/dac/d138/f139 x:0 0 0 2024-04-25T17:19:28.651 INFO:tasks.workunit.client.1.smithi069.stdout:2/860: write d0/d1/f4f [4435010,39071] 0 2024-04-25T17:19:28.652 INFO:tasks.workunit.client.1.smithi069.stdout:7/874: mknod d4/dbb/c129 0 2024-04-25T17:19:28.652 INFO:tasks.workunit.client.0.smithi037.stdout:0/946: write d9/d14/d28/d48/da9/fb6 [4480772,72713] 0 2024-04-25T17:19:28.654 INFO:tasks.workunit.client.0.smithi037.stdout:6/874: rmdir db/d1d/d20/dcf/d108 39 2024-04-25T17:19:28.656 INFO:tasks.workunit.client.0.smithi037.stdout:6/875: readlink db/d1d/d20/dcf/dfa/l7a 0 2024-04-25T17:19:28.657 INFO:tasks.workunit.client.1.smithi069.stdout:9/819: sync 2024-04-25T17:19:28.658 INFO:tasks.workunit.client.0.smithi037.stdout:6/876: write db/d1d/d20/dcf/dfa/d65/d8b/f125 [742732,61612] 0 2024-04-25T17:19:28.658 INFO:tasks.workunit.client.1.smithi069.stdout:9/820: truncate d2/da/dd/de/db0/f102 5308735 0 2024-04-25T17:19:28.659 INFO:tasks.workunit.client.0.smithi037.stdout:6/877: chown db/d1d/d20/d2f/fcd 514522 1 2024-04-25T17:19:28.661 INFO:tasks.workunit.client.1.smithi069.stdout:0/782: rename d0/d17/fe7 to d0/d17/f10f 0 2024-04-25T17:19:28.667 INFO:tasks.workunit.client.0.smithi037.stdout:7/788: read d5/d15/d17/d1b/f5b [36943,41884] 0 2024-04-25T17:19:28.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:28 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/182838818' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T17:19:28.668 INFO:tasks.workunit.client.1.smithi069.stdout:8/893: creat d37/d47/d78/d93/df9/f134 x:0 0 0 2024-04-25T17:19:28.668 INFO:tasks.workunit.client.0.smithi037.stdout:2/985: dread d0/d7c/fba [0,4194304] 0 2024-04-25T17:19:28.669 INFO:tasks.workunit.client.0.smithi037.stdout:3/725: symlink d8/d31/d32/le5 0 2024-04-25T17:19:28.672 INFO:tasks.workunit.client.0.smithi037.stdout:6/878: creat db/d1d/d20/dcf/dfa/dde/f143 x:0 0 0 2024-04-25T17:19:28.673 INFO:tasks.workunit.client.0.smithi037.stdout:6/879: chown db/d26/d2e/d3e/f34 94661 1 2024-04-25T17:19:28.674 INFO:tasks.workunit.client.0.smithi037.stdout:5/883: fdatasync d7/d18/f1e 0 2024-04-25T17:19:28.675 INFO:tasks.workunit.client.1.smithi069.stdout:0/783: symlink d0/da/d59/dab/l110 0 2024-04-25T17:19:28.676 INFO:tasks.workunit.client.1.smithi069.stdout:0/784: write d0/da/db/d56/f78 [298397,26080] 0 2024-04-25T17:19:28.677 INFO:tasks.workunit.client.1.smithi069.stdout:4/857: rename db/d4b/d78/dc4/l4d to db/d15/d20/l12f 0 2024-04-25T17:19:28.678 INFO:tasks.workunit.client.0.smithi037.stdout:2/986: rmdir d0/d15/d2a 39 2024-04-25T17:19:28.678 INFO:tasks.workunit.client.0.smithi037.stdout:2/987: readlink d0/d15/l1a 0 2024-04-25T17:19:28.682 INFO:tasks.workunit.client.1.smithi069.stdout:1/854: link d1/df/c62 d1/d4/d6/d81/dfe/c10c 0 2024-04-25T17:19:28.684 INFO:tasks.workunit.client.1.smithi069.stdout:6/867: link d2/d7/dbc/l10b d2/d1e/d43/da6/l12a 0 2024-04-25T17:19:28.685 INFO:tasks.workunit.client.1.smithi069.stdout:6/868: write d2/d1e/d43/db6/de4/f107 [155946,117125] 0 2024-04-25T17:19:28.689 INFO:tasks.workunit.client.1.smithi069.stdout:5/908: rename d13/d17/d19/d1c/f71 to d13/d17/dd4/f13a 0 2024-04-25T17:19:28.689 INFO:tasks.workunit.client.1.smithi069.stdout:4/858: symlink db/d15/d42/l130 0 2024-04-25T17:19:28.690 INFO:tasks.workunit.client.1.smithi069.stdout:8/894: symlink d37/d47/l135 0 2024-04-25T17:19:28.691 INFO:tasks.workunit.client.1.smithi069.stdout:2/861: creat d0/d56/d5f/d62/d7d/f11b x:0 0 0 2024-04-25T17:19:28.691 INFO:tasks.workunit.client.1.smithi069.stdout:1/855: symlink d1/d4/d6/d9e/da6/d7c/d1d/de1/d8e/l10d 0 2024-04-25T17:19:28.692 INFO:tasks.workunit.client.1.smithi069.stdout:6/869: mknod d2/d1e/d3e/c12b 0 2024-04-25T17:19:28.692 INFO:tasks.workunit.client.1.smithi069.stdout:1/856: readlink d1/d43/d1b/d32/d4a/d4b/la8 0 2024-04-25T17:19:28.693 INFO:tasks.workunit.client.1.smithi069.stdout:0/785: creat d0/da/db/d3a/d104/f111 x:0 0 0 2024-04-25T17:19:28.693 INFO:tasks.workunit.client.1.smithi069.stdout:5/909: creat d13/d17/d62/f13b x:0 0 0 2024-04-25T17:19:28.694 INFO:tasks.workunit.client.1.smithi069.stdout:4/859: mknod db/d15/d82/c131 0 2024-04-25T17:19:28.696 INFO:tasks.workunit.client.1.smithi069.stdout:2/862: fdatasync d0/d26/d36/fba 0 2024-04-25T17:19:28.696 INFO:tasks.workunit.client.1.smithi069.stdout:6/870: rmdir d2/d9c 39 2024-04-25T17:19:28.697 INFO:tasks.workunit.client.1.smithi069.stdout:0/786: unlink d0/da/db/d7e/d80/la2 0 2024-04-25T17:19:28.699 INFO:tasks.workunit.client.1.smithi069.stdout:4/860: readlink db/d15/d20/d35/d63/d43/d48/d49/d4e/lb9 0 2024-04-25T17:19:28.702 INFO:tasks.workunit.client.1.smithi069.stdout:6/871: rename d2/d1e/d43/da6/l101 to d2/d9c/d97/d98/l12c 0 2024-04-25T17:19:28.703 INFO:tasks.workunit.client.1.smithi069.stdout:1/857: link d1/d4/d6/d9e/da6/fe2 d1/d43/d1b/d32/d4a/d4b/f10e 0 2024-04-25T17:19:28.703 INFO:tasks.workunit.client.1.smithi069.stdout:4/861: symlink db/d4b/d78/dc4/l132 0 2024-04-25T17:19:28.705 INFO:tasks.workunit.client.1.smithi069.stdout:6/872: mkdir d2/d1e/d43/db6/daf/d12d 0 2024-04-25T17:19:28.705 INFO:tasks.workunit.client.1.smithi069.stdout:6/873: chown d2/d51/d85/f45 1905 1 2024-04-25T17:19:28.707 INFO:tasks.workunit.client.1.smithi069.stdout:4/862: creat db/d15/d20/d35/d63/d43/d48/d49/d4e/d12d/f133 x:0 0 0 2024-04-25T17:19:28.707 INFO:tasks.workunit.client.1.smithi069.stdout:1/858: link d1/d4/d6/d9e/da6/fc0 d1/df/d17/f10f 0 2024-04-25T17:19:28.717 INFO:tasks.workunit.client.1.smithi069.stdout:4/863: dread db/d4b/f89 [0,4194304] 0 2024-04-25T17:19:28.724 INFO:tasks.workunit.client.1.smithi069.stdout:3/906: sync 2024-04-25T17:19:28.724 INFO:tasks.workunit.client.1.smithi069.stdout:3/907: chown d8/d16/d1a/d2c 607 1 2024-04-25T17:19:28.729 INFO:tasks.workunit.client.1.smithi069.stdout:3/908: dwrite d8/d71/d8d/d92/db6/dc1/f7a [0,4194304] 0 2024-04-25T17:19:28.730 INFO:tasks.workunit.client.1.smithi069.stdout:3/909: chown d8/d16/d9b/dc3/f116 7 1 2024-04-25T17:19:28.731 INFO:tasks.workunit.client.1.smithi069.stdout:3/910: write d8/d71/d8d/d92/db6/dc1/fbf [3377285,57633] 0 2024-04-25T17:19:28.753 INFO:tasks.workunit.client.0.smithi037.stdout:0/947: mknod d9/df/d109/c131 0 2024-04-25T17:19:28.754 INFO:tasks.workunit.client.0.smithi037.stdout:3/726: write d8/d23/dbb/d81/fac [441705,54764] 0 2024-04-25T17:19:28.755 INFO:tasks.workunit.client.0.smithi037.stdout:5/884: symlink d7/da1/dbb/l10c 0 2024-04-25T17:19:28.760 INFO:tasks.workunit.client.0.smithi037.stdout:2/988: dread d0/d16/d3c/fbc [0,4194304] 0 2024-04-25T17:19:28.761 INFO:tasks.workunit.client.0.smithi037.stdout:2/989: chown d0/d15/f37 14366 1 2024-04-25T17:19:28.761 INFO:tasks.workunit.client.0.smithi037.stdout:3/727: fsync d8/d23/dbb/d5d/f20 0 2024-04-25T17:19:28.768 INFO:tasks.workunit.client.0.smithi037.stdout:7/789: dread d5/d15/f1f [0,4194304] 0 2024-04-25T17:19:28.769 INFO:tasks.workunit.client.0.smithi037.stdout:3/728: mknod d8/d4c/ce6 0 2024-04-25T17:19:28.770 INFO:tasks.workunit.client.0.smithi037.stdout:2/990: dwrite d0/d16/d20/d55/fdf [0,4194304] 0 2024-04-25T17:19:28.771 INFO:tasks.workunit.client.0.smithi037.stdout:7/790: write d5/d15/d17/d1b/fec [523626,127885] 0 2024-04-25T17:19:28.772 INFO:tasks.workunit.client.1.smithi069.stdout:7/875: sync 2024-04-25T17:19:28.772 INFO:tasks.workunit.client.1.smithi069.stdout:9/821: sync 2024-04-25T17:19:28.773 INFO:tasks.workunit.client.0.smithi037.stdout:5/885: mknod d7/d12/d5d/d90/db1/c10d 0 2024-04-25T17:19:28.774 INFO:tasks.workunit.client.1.smithi069.stdout:0/787: dread d0/d17/f4a [0,4194304] 0 2024-04-25T17:19:28.774 INFO:tasks.workunit.client.1.smithi069.stdout:9/822: write d2/da/dd/de/d74/d8a/ff4 [27326,28080] 0 2024-04-25T17:19:28.776 INFO:tasks.workunit.client.1.smithi069.stdout:9/823: chown d2/da/dd/de/d74/d8a/fda 40351460 1 2024-04-25T17:19:28.777 INFO:tasks.workunit.client.0.smithi037.stdout:2/991: dread - d0/d16/f96 zero size 2024-04-25T17:19:28.778 INFO:tasks.workunit.client.1.smithi069.stdout:7/876: mkdir d4/d3e/d94/da1/dc7/d14/d44/d79/da4/d12a 0 2024-04-25T17:19:28.780 INFO:tasks.workunit.client.0.smithi037.stdout:5/886: creat d7/d18/d62/dd8/dc6/f10e x:0 0 0 2024-04-25T17:19:28.781 INFO:tasks.workunit.client.0.smithi037.stdout:5/887: fdatasync d7/d12/d6f/d68/fb6 0 2024-04-25T17:19:28.782 INFO:tasks.workunit.client.0.smithi037.stdout:0/948: link d9/d14/l2e d9/d14/d28/l132 0 2024-04-25T17:19:28.783 INFO:tasks.workunit.client.1.smithi069.stdout:8/895: dwrite d37/d47/d48/d8e/fdc [0,4194304] 0 2024-04-25T17:19:28.785 INFO:tasks.workunit.client.1.smithi069.stdout:9/824: creat d2/da4/f11b x:0 0 0 2024-04-25T17:19:28.787 INFO:tasks.workunit.client.1.smithi069.stdout:9/825: chown d2/da/dd/d1e/d40 335900 1 2024-04-25T17:19:28.787 INFO:tasks.workunit.client.1.smithi069.stdout:7/877: mkdir d4/d3e/d94/da1/dc7/d14/d44/dd5/dd6/d12b 0 2024-04-25T17:19:28.788 INFO:tasks.workunit.client.1.smithi069.stdout:2/863: write d0/d26/d10/f5c [4236510,95098] 0 2024-04-25T17:19:28.791 INFO:tasks.workunit.client.0.smithi037.stdout:7/791: dread d5/f7c [0,4194304] 0 2024-04-25T17:19:28.791 INFO:tasks.workunit.client.1.smithi069.stdout:6/874: getdents d2/d9c/d97/d98 0 2024-04-25T17:19:28.792 INFO:tasks.workunit.client.1.smithi069.stdout:5/910: dwrite d13/d17/d19/d8a/f9e [0,4194304] 0 2024-04-25T17:19:28.796 INFO:tasks.workunit.client.0.smithi037.stdout:0/949: creat d9/d12f/f133 x:0 0 0 2024-04-25T17:19:28.798 INFO:tasks.workunit.client.1.smithi069.stdout:1/859: write d1/d43/d1b/d32/d4a/fb7 [808923,24780] 0 2024-04-25T17:19:28.798 INFO:tasks.workunit.client.1.smithi069.stdout:4/864: write db/d15/d26/f3b [759239,26335] 0 2024-04-25T17:19:28.799 INFO:tasks.workunit.client.0.smithi037.stdout:7/792: rmdir d5/d15 39 2024-04-25T17:19:28.801 INFO:tasks.workunit.client.1.smithi069.stdout:9/826: unlink d2/da/dd/d1e/d40/cdf 0 2024-04-25T17:19:28.802 INFO:tasks.workunit.client.1.smithi069.stdout:3/911: write d8/f18 [1616839,56265] 0 2024-04-25T17:19:28.803 INFO:tasks.workunit.client.1.smithi069.stdout:0/788: link d0/da/db/d3a/cf6 d0/d17/c112 0 2024-04-25T17:19:28.805 INFO:tasks.workunit.client.1.smithi069.stdout:2/864: mkdir d0/d26/df3/d11c 0 2024-04-25T17:19:28.810 INFO:tasks.workunit.client.0.smithi037.stdout:6/880: dwrite db/d1d/d20/f75 [0,4194304] 0 2024-04-25T17:19:28.816 INFO:tasks.workunit.client.1.smithi069.stdout:1/860: symlink d1/d4/d6/d4f/d9b/da3/l110 0 2024-04-25T17:19:28.818 INFO:tasks.workunit.client.1.smithi069.stdout:4/865: mkdir db/db0/d134 0 2024-04-25T17:19:28.819 INFO:tasks.workunit.client.1.smithi069.stdout:8/896: dread d37/d47/d78/db3/d114/fa3 [0,4194304] 0 2024-04-25T17:19:28.821 INFO:tasks.workunit.client.1.smithi069.stdout:9/827: symlink d2/da4/dcf/d65/d88/l11c 0 2024-04-25T17:19:28.822 INFO:tasks.workunit.client.1.smithi069.stdout:4/866: dread db/d15/d20/f2e [0,4194304] 0 2024-04-25T17:19:28.823 INFO:tasks.workunit.client.1.smithi069.stdout:9/828: read d2/da/dd/de/d74/d8a/fb9 [131530,36721] 0 2024-04-25T17:19:28.827 INFO:tasks.workunit.client.0.smithi037.stdout:6/881: creat db/d53/f144 x:0 0 0 2024-04-25T17:19:28.827 INFO:tasks.workunit.client.1.smithi069.stdout:2/865: write d0/d26/d10/d43/fbe [2998067,101583] 0 2024-04-25T17:19:28.831 INFO:tasks.workunit.client.0.smithi037.stdout:5/888: truncate d7/f75 1362437 0 2024-04-25T17:19:28.831 INFO:tasks.workunit.client.0.smithi037.stdout:2/992: dwrite d0/d16/d20/d59/d6a/dbe/ff6 [0,4194304] 0 2024-04-25T17:19:28.832 INFO:tasks.workunit.client.0.smithi037.stdout:5/889: write d7/d25/f91 [1429294,77447] 0 2024-04-25T17:19:28.838 INFO:tasks.workunit.client.0.smithi037.stdout:0/950: dwrite d9/d14/f3b [0,4194304] 0 2024-04-25T17:19:28.840 INFO:tasks.workunit.client.1.smithi069.stdout:7/878: dwrite d4/d3e/d94/da1/dc7/d14/d5a/f6c [0,4194304] 0 2024-04-25T17:19:28.842 INFO:tasks.workunit.client.1.smithi069.stdout:8/897: fdatasync d37/d47/d54/d6e/dce/f12a 0 2024-04-25T17:19:28.844 INFO:tasks.workunit.client.1.smithi069.stdout:3/912: write d8/d2a/f82 [813293,54234] 0 2024-04-25T17:19:28.845 INFO:tasks.workunit.client.0.smithi037.stdout:7/793: dwrite d5/d15/f1f [0,4194304] 0 2024-04-25T17:19:28.847 INFO:tasks.workunit.client.0.smithi037.stdout:7/794: readlink d5/d15/d17/d1b/d94/da8/lbd 0 2024-04-25T17:19:28.850 INFO:tasks.workunit.client.1.smithi069.stdout:4/867: creat db/d4b/d78/dc4/d41/d9e/df2/f135 x:0 0 0 2024-04-25T17:19:28.851 INFO:tasks.workunit.client.1.smithi069.stdout:4/868: readlink db/d15/l2b 0 2024-04-25T17:19:28.852 INFO:tasks.workunit.client.1.smithi069.stdout:5/911: write d13/d17/d19/d20/d2d/d93/fb0 [877800,51279] 0 2024-04-25T17:19:28.854 INFO:tasks.workunit.client.1.smithi069.stdout:9/829: creat d2/da/dd/de/d74/f11d x:0 0 0 2024-04-25T17:19:28.860 INFO:tasks.workunit.client.1.smithi069.stdout:2/866: mknod d0/dfd/c11d 0 2024-04-25T17:19:28.872 INFO:tasks.workunit.client.1.smithi069.stdout:0/789: creat d0/da/db/f113 x:0 0 0 2024-04-25T17:19:28.873 INFO:tasks.workunit.client.1.smithi069.stdout:2/867: dread - d0/d26/d10/d43/fda zero size 2024-04-25T17:19:28.875 INFO:tasks.workunit.client.1.smithi069.stdout:1/861: creat d1/f111 x:0 0 0 2024-04-25T17:19:28.876 INFO:tasks.workunit.client.1.smithi069.stdout:0/790: read d0/da/db/d7e/fdc [2973356,77314] 0 2024-04-25T17:19:28.876 INFO:tasks.workunit.client.1.smithi069.stdout:0/791: stat d0/da/d24 0 2024-04-25T17:19:28.877 INFO:tasks.workunit.client.1.smithi069.stdout:0/792: chown d0/l12 180315633 1 2024-04-25T17:19:28.877 INFO:tasks.workunit.client.1.smithi069.stdout:2/868: dread d0/d1/d5b/d33/f51 [0,4194304] 0 2024-04-25T17:19:28.878 INFO:tasks.workunit.client.1.smithi069.stdout:0/793: stat d0/da/d24/d43/dfc/f20 0 2024-04-25T17:19:28.878 INFO:tasks.workunit.client.1.smithi069.stdout:4/869: mkdir db/d15/d20/d136 0 2024-04-25T17:19:28.882 INFO:tasks.workunit.client.1.smithi069.stdout:6/875: sync 2024-04-25T17:19:28.883 INFO:tasks.workunit.client.1.smithi069.stdout:8/898: dread d37/f50 [0,4194304] 0 2024-04-25T17:19:28.884 INFO:tasks.workunit.client.1.smithi069.stdout:6/876: chown d2/d1e/f33 38 1 2024-04-25T17:19:28.884 INFO:tasks.workunit.client.1.smithi069.stdout:5/912: write d13/d17/d19/d8a/f8e [1292098,105276] 0 2024-04-25T17:19:28.884 INFO:tasks.workunit.client.1.smithi069.stdout:1/862: creat d1/d4/de/d63/f112 x:0 0 0 2024-04-25T17:19:28.890 INFO:tasks.workunit.client.1.smithi069.stdout:7/879: rename d4/d4c/la0 to d4/d1a/l12c 0 2024-04-25T17:19:28.891 INFO:tasks.workunit.client.1.smithi069.stdout:3/913: dwrite d8/d16/d31/f44 [0,4194304] 0 2024-04-25T17:19:28.891 INFO:tasks.workunit.client.1.smithi069.stdout:0/794: truncate d0/da/d24/d43/dfc/f6f 903379 0 2024-04-25T17:19:28.892 INFO:tasks.workunit.client.1.smithi069.stdout:5/913: chown d13/d17/d19/d20/d51/f97 258778 1 2024-04-25T17:19:28.893 INFO:tasks.workunit.client.1.smithi069.stdout:9/830: rmdir d2/da/dd/de0/de6 0 2024-04-25T17:19:28.893 INFO:tasks.workunit.client.1.smithi069.stdout:7/880: write d4/d3e/d94/da1/dc7/d14/d44/fb8 [838392,49059] 0 2024-04-25T17:19:28.912 INFO:tasks.workunit.client.1.smithi069.stdout:4/870: dwrite db/d15/d82/fd0 [0,4194304] 0 2024-04-25T17:19:28.913 INFO:tasks.workunit.client.1.smithi069.stdout:4/871: chown db/d15/d42/d64/la8 792033963 1 2024-04-25T17:19:28.914 INFO:tasks.workunit.client.1.smithi069.stdout:4/872: chown db/db0 469760917 1 2024-04-25T17:19:28.930 INFO:tasks.workunit.client.0.smithi037.stdout:5/890: creat d7/da1/f10f x:0 0 0 2024-04-25T17:19:28.932 INFO:tasks.workunit.client.0.smithi037.stdout:6/882: dwrite db/d1d/d20/dcf/dd5/f11e [0,4194304] 0 2024-04-25T17:19:28.933 INFO:tasks.workunit.client.0.smithi037.stdout:0/951: fdatasync d9/df/d32/dd1/fba 0 2024-04-25T17:19:28.937 INFO:tasks.workunit.client.0.smithi037.stdout:7/795: rmdir d5/dc1/de1 39 2024-04-25T17:19:28.941 INFO:tasks.workunit.client.0.smithi037.stdout:6/883: mkdir db/d1d/db1/dc7/d145 0 2024-04-25T17:19:28.944 INFO:tasks.workunit.client.0.smithi037.stdout:7/796: unlink d5/f7c 0 2024-04-25T17:19:28.947 INFO:tasks.workunit.client.0.smithi037.stdout:5/891: fdatasync d7/d18/f29 0 2024-04-25T17:19:28.950 INFO:tasks.workunit.client.0.smithi037.stdout:2/993: dread d0/d23/dfb/dc4/fe9 [0,4194304] 0 2024-04-25T17:19:28.960 INFO:tasks.workunit.client.0.smithi037.stdout:7/797: mkdir d5/d15/d17/d1b/da2/d105 0 2024-04-25T17:19:28.965 INFO:tasks.workunit.client.0.smithi037.stdout:6/884: rename db/d1d/d20/dcf/dfa/d65/d68/f116 to db/d1d/d20/dcf/f146 0 2024-04-25T17:19:28.967 INFO:tasks.workunit.client.0.smithi037.stdout:6/885: chown db/d1d/d20/dcf/dfa/d65/d8b/c94 7095222 1 2024-04-25T17:19:28.969 INFO:tasks.workunit.client.0.smithi037.stdout:2/994: dread d0/d23/dac/fe1 [0,4194304] 0 2024-04-25T17:19:28.970 INFO:tasks.workunit.client.0.smithi037.stdout:2/995: chown d0/d16/d20/f39 3706184 1 2024-04-25T17:19:28.981 INFO:tasks.workunit.client.1.smithi069.stdout:1/863: creat d1/d4/d6/d9e/da6/d7c/d1d/dad/f113 x:0 0 0 2024-04-25T17:19:28.982 INFO:tasks.workunit.client.1.smithi069.stdout:5/914: rmdir d13/d17/d29/d2e 39 2024-04-25T17:19:28.985 INFO:tasks.workunit.client.0.smithi037.stdout:6/886: dwrite db/d26/d2e/d3e/d25/d61/f74 [4194304,4194304] 0 2024-04-25T17:19:28.990 INFO:tasks.workunit.client.1.smithi069.stdout:3/914: rename d8/d16/d1a/d2c/d49/l56 to d8/d16/d4b/d9e/deb/l133 0 2024-04-25T17:19:28.990 INFO:tasks.workunit.client.0.smithi037.stdout:2/996: dread d0/d16/d20/f119 [0,4194304] 0 2024-04-25T17:19:28.998 INFO:tasks.workunit.client.1.smithi069.stdout:4/873: symlink db/d15/d42/d64/l137 0 2024-04-25T17:19:29.000 INFO:tasks.workunit.client.1.smithi069.stdout:8/899: mkdir d37/d47/d78/db3/d114/d136 0 2024-04-25T17:19:29.001 INFO:tasks.workunit.client.1.smithi069.stdout:8/900: write d37/d47/d78/f132 [1008958,48013] 0 2024-04-25T17:19:29.001 INFO:tasks.workunit.client.1.smithi069.stdout:8/901: truncate d37/d47/f120 199579 0 2024-04-25T17:19:29.002 INFO:tasks.workunit.client.1.smithi069.stdout:2/869: link d0/d26/d36/dc5/f118 d0/f11e 0 2024-04-25T17:19:29.002 INFO:tasks.workunit.client.1.smithi069.stdout:8/902: chown d37/d47/d48/fc0 43165738 1 2024-04-25T17:19:29.003 INFO:tasks.workunit.client.1.smithi069.stdout:8/903: readlink d37/d47/d78/lcd 0 2024-04-25T17:19:29.004 INFO:tasks.workunit.client.1.smithi069.stdout:8/904: write d37/d47/d54/d6e/f10c [23336,46381] 0 2024-04-25T17:19:29.007 INFO:tasks.workunit.client.0.smithi037.stdout:6/887: rename db/d26/d2e/d3e to db/d147 0 2024-04-25T17:19:29.009 INFO:tasks.workunit.client.1.smithi069.stdout:6/877: creat d2/d1e/d43/db6/daf/dbe/d128/f12e x:0 0 0 2024-04-25T17:19:29.009 INFO:tasks.workunit.client.1.smithi069.stdout:8/905: dwrite d37/d47/d54/d6e/d9e/f12d [0,4194304] 0 2024-04-25T17:19:29.010 INFO:tasks.workunit.client.1.smithi069.stdout:6/878: chown d2/d51/f88 23981494 1 2024-04-25T17:19:29.012 INFO:tasks.workunit.client.1.smithi069.stdout:0/795: mkdir d0/da/db/d73/df8/d114 0 2024-04-25T17:19:29.014 INFO:tasks.workunit.client.0.smithi037.stdout:6/888: dwrite db/d53/fe1 [0,4194304] 0 2024-04-25T17:19:29.014 INFO:tasks.workunit.client.1.smithi069.stdout:1/864: dread d1/d4/d6/d9e/da6/d7c/d4d/fb1 [0,4194304] 0 2024-04-25T17:19:29.015 INFO:tasks.workunit.client.1.smithi069.stdout:0/796: write d0/da/db/d2a/d8c/fe0 [5756568,49120] 0 2024-04-25T17:19:29.016 INFO:tasks.workunit.client.1.smithi069.stdout:1/865: fdatasync d1/d4/d6/f31 0 2024-04-25T17:19:29.024 INFO:tasks.workunit.client.1.smithi069.stdout:2/870: creat d0/d56/d5f/d62/d7d/d31/f11f x:0 0 0 2024-04-25T17:19:29.025 INFO:tasks.workunit.client.0.smithi037.stdout:6/889: symlink db/d147/d25/d10d/l148 0 2024-04-25T17:19:29.029 INFO:tasks.workunit.client.1.smithi069.stdout:6/879: dread d2/d1e/d43/fc9 [0,4194304] 0 2024-04-25T17:19:29.033 INFO:tasks.workunit.client.0.smithi037.stdout:6/890: dwrite db/d1d/d20/dcf/dfa/d65/d68/d87/f114 [0,4194304] 0 2024-04-25T17:19:29.037 INFO:tasks.workunit.client.1.smithi069.stdout:0/797: creat d0/da/d24/d43/f115 x:0 0 0 2024-04-25T17:19:29.048 INFO:tasks.workunit.client.1.smithi069.stdout:8/906: mknod d37/d47/d54/c137 0 2024-04-25T17:19:29.050 INFO:tasks.workunit.client.1.smithi069.stdout:2/871: dread d0/d1/d5b/d33/f51 [0,4194304] 0 2024-04-25T17:19:29.051 INFO:tasks.workunit.client.1.smithi069.stdout:0/798: creat d0/da/db/d2a/d9b/f116 x:0 0 0 2024-04-25T17:19:29.054 INFO:tasks.workunit.client.1.smithi069.stdout:7/881: getdents d4/d3e/d94/da1/dc7/d14/d44/d7c/d9f/dcb 0 2024-04-25T17:19:29.056 INFO:tasks.workunit.client.1.smithi069.stdout:7/882: read d4/d3e/d94/da1/dc7/f8a [355991,69530] 0 2024-04-25T17:19:29.059 INFO:tasks.workunit.client.0.smithi037.stdout:5/892: write d7/d12/d6f/d94/fcc [412818,24143] 0 2024-04-25T17:19:29.059 INFO:tasks.workunit.client.1.smithi069.stdout:2/872: symlink d0/d56/d5f/d62/d7d/d31/l120 0 2024-04-25T17:19:29.060 INFO:tasks.workunit.client.1.smithi069.stdout:2/873: dread - d0/d26/d36/dc5/f118 zero size 2024-04-25T17:19:29.064 INFO:tasks.workunit.client.0.smithi037.stdout:5/893: mknod d7/da1/dda/ddc/d108/c110 0 2024-04-25T17:19:29.066 INFO:tasks.workunit.client.1.smithi069.stdout:7/883: mknod d4/d3e/d94/da1/dc7/d14/d5a/d5e/c12d 0 2024-04-25T17:19:29.067 INFO:tasks.workunit.client.1.smithi069.stdout:8/907: symlink d37/d47/l138 0 2024-04-25T17:19:29.067 INFO:tasks.workunit.client.0.smithi037.stdout:7/798: write d5/d15/d17/d1b/d94/da8/fbe [167762,42881] 0 2024-04-25T17:19:29.068 INFO:tasks.workunit.client.0.smithi037.stdout:5/894: mknod d7/d12/d6f/d68/c111 0 2024-04-25T17:19:29.073 INFO:tasks.workunit.client.0.smithi037.stdout:5/895: fdatasync d7/d12/f20 0 2024-04-25T17:19:29.075 INFO:tasks.workunit.client.1.smithi069.stdout:2/874: truncate d0/f7 1982389 0 2024-04-25T17:19:29.077 INFO:tasks.workunit.client.1.smithi069.stdout:9/831: dwrite d2/da/f10 [0,4194304] 0 2024-04-25T17:19:29.077 INFO:tasks.workunit.client.1.smithi069.stdout:9/832: readlink d2/lc0 0 2024-04-25T17:19:29.078 INFO:tasks.workunit.client.0.smithi037.stdout:2/997: write d0/d15/f48 [2371596,90291] 0 2024-04-25T17:19:29.080 INFO:tasks.workunit.client.0.smithi037.stdout:2/998: fdatasync d0/d16/d20/d59/fc9 0 2024-04-25T17:19:29.080 INFO:tasks.workunit.client.0.smithi037.stdout:5/896: fsync d7/da1/dbb/fc0 0 2024-04-25T17:19:29.083 INFO:tasks.workunit.client.1.smithi069.stdout:6/880: getdents d2/d1e/d43/db6/daf/dbe 0 2024-04-25T17:19:29.085 INFO:tasks.workunit.client.1.smithi069.stdout:9/833: dwrite d2/da/dd/d1e/d2e/d68/dba/dd1/fdc [0,4194304] 0 2024-04-25T17:19:29.085 INFO:tasks.workunit.client.1.smithi069.stdout:6/881: dread - d2/d1e/d3f/d86/f110 zero size 2024-04-25T17:19:29.088 INFO:tasks.workunit.client.1.smithi069.stdout:8/908: dwrite d37/d47/d54/f5e [0,4194304] 0 2024-04-25T17:19:29.091 INFO:tasks.workunit.client.0.smithi037.stdout:2/999: rmdir d0/d23/d7d 39 2024-04-25T17:19:29.094 INFO:tasks.workunit.client.1.smithi069.stdout:4/874: write db/d15/d26/f29 [2476113,20865] 0 2024-04-25T17:19:29.094 INFO:tasks.workunit.client.1.smithi069.stdout:2/875: mkdir d0/d26/d10/d121 0 2024-04-25T17:19:29.094 INFO:tasks.workunit.client.1.smithi069.stdout:5/915: truncate d13/d17/f42 3214405 0 2024-04-25T17:19:29.096 INFO:tasks.workunit.client.1.smithi069.stdout:8/909: write d37/d47/d78/db3/d114/d6b/daf/de6/f129 [998224,80777] 0 2024-04-25T17:19:29.096 INFO:tasks.workunit.client.1.smithi069.stdout:9/834: symlink d2/da4/dcf/l11e 0 2024-04-25T17:19:29.097 INFO:tasks.workunit.client.1.smithi069.stdout:3/915: dwrite d8/d16/d1a/d2c/d49/fc4 [0,4194304] 0 2024-04-25T17:19:29.099 INFO:tasks.workunit.client.1.smithi069.stdout:6/882: unlink d2/d51/d89/dfd/f102 0 2024-04-25T17:19:29.100 INFO:tasks.workunit.client.1.smithi069.stdout:7/884: creat d4/f12e x:0 0 0 2024-04-25T17:19:29.101 INFO:tasks.workunit.client.1.smithi069.stdout:7/885: write d4/dbb/f106 [776139,115472] 0 2024-04-25T17:19:29.101 INFO:tasks.workunit.client.1.smithi069.stdout:6/883: chown d2/d1e/d43/da6/ff5 642300 1 2024-04-25T17:19:29.104 INFO:tasks.workunit.client.1.smithi069.stdout:7/886: chown d4/d3e/d94/da1/cd4 519 1 2024-04-25T17:19:29.105 INFO:tasks.workunit.client.1.smithi069.stdout:7/887: write d4/d83/da2/dd3/f112 [465354,76104] 0 2024-04-25T17:19:29.105 INFO:tasks.workunit.client.1.smithi069.stdout:5/916: read - d13/d17/d19/ffb zero size 2024-04-25T17:19:29.106 INFO:tasks.workunit.client.1.smithi069.stdout:2/876: mknod d0/d56/d5f/d62/d7d/d31/c122 0 2024-04-25T17:19:29.106 INFO:tasks.workunit.client.1.smithi069.stdout:4/875: read db/d15/d26/f2c [47243,105583] 0 2024-04-25T17:19:29.107 INFO:tasks.workunit.client.1.smithi069.stdout:7/888: write d4/f58 [2489049,73322] 0 2024-04-25T17:19:29.108 INFO:tasks.workunit.client.1.smithi069.stdout:4/876: fsync db/d15/d82/fd0 0 2024-04-25T17:19:29.109 INFO:tasks.workunit.client.1.smithi069.stdout:3/916: mkdir d8/d16/d4b/def/d134 0 2024-04-25T17:19:29.114 INFO:tasks.workunit.client.1.smithi069.stdout:7/889: dwrite d4/d3e/d94/da1/dc7/d14/d5a/f6c [4194304,4194304] 0 2024-04-25T17:19:29.115 INFO:tasks.workunit.client.0.smithi037.stdout:6/891: dwrite db/d147/f4c [0,4194304] 0 2024-04-25T17:19:29.116 INFO:tasks.workunit.client.1.smithi069.stdout:7/890: write d4/dbb/f106 [770384,109545] 0 2024-04-25T17:19:29.120 INFO:tasks.workunit.client.1.smithi069.stdout:6/884: mknod d2/d1e/d43/dca/d10d/c12f 0 2024-04-25T17:19:29.120 INFO:tasks.workunit.client.1.smithi069.stdout:0/799: dread d0/da/db/fe [0,4194304] 0 2024-04-25T17:19:29.122 INFO:tasks.workunit.client.0.smithi037.stdout:6/892: dread db/d1d/f79 [0,4194304] 0 2024-04-25T17:19:29.123 INFO:tasks.workunit.client.1.smithi069.stdout:1/866: dwrite d1/d4/d6/d9e/da6/fe2 [0,4194304] 0 2024-04-25T17:19:29.123 INFO:tasks.workunit.client.1.smithi069.stdout:5/917: symlink d13/d17/d19/d8a/dbc/l13c 0 2024-04-25T17:19:29.124 INFO:tasks.workunit.client.1.smithi069.stdout:0/800: chown d0/d17/fa5 270615903 1 2024-04-25T17:19:29.126 INFO:tasks.workunit.client.1.smithi069.stdout:0/801: chown d0/da/d59/dab/lda 14976 1 2024-04-25T17:19:29.126 INFO:tasks.workunit.client.1.smithi069.stdout:1/867: truncate d1/d4/de/f99 440073 0 2024-04-25T17:19:29.127 INFO:tasks.workunit.client.0.smithi037.stdout:6/893: truncate db/d26/d2e/f39 2435258 0 2024-04-25T17:19:29.128 INFO:tasks.workunit.client.1.smithi069.stdout:4/877: mkdir db/d15/d20/d35/d63/d70/d8a/d138 0 2024-04-25T17:19:29.131 INFO:tasks.workunit.client.0.smithi037.stdout:6/894: write db/d147/d25/d10b/d10e/f121 [466923,36723] 0 2024-04-25T17:19:29.131 INFO:tasks.workunit.client.1.smithi069.stdout:4/878: write db/d15/d20/d35/d63/d70/d8a/d96/f10f [252805,75247] 0 2024-04-25T17:19:29.133 INFO:tasks.workunit.client.0.smithi037.stdout:7/799: dwrite d5/d15/d17/d1b/da2/d76/f8a [0,4194304] 0 2024-04-25T17:19:29.134 INFO:tasks.workunit.client.1.smithi069.stdout:0/802: dwrite d0/da/d59/dab/fb7 [0,4194304] 0 2024-04-25T17:19:29.134 INFO:tasks.workunit.client.1.smithi069.stdout:8/910: dread d37/d47/d78/f84 [0,4194304] 0 2024-04-25T17:19:29.135 INFO:tasks.workunit.client.0.smithi037.stdout:7/800: readlink d5/d15/d17/d25/d2b/d59/le2 0 2024-04-25T17:19:29.135 INFO:tasks.workunit.client.1.smithi069.stdout:0/803: chown d0/da/d59/dab/fc2 0 1 2024-04-25T17:19:29.135 INFO:tasks.workunit.client.1.smithi069.stdout:7/891: rmdir d4/d3e/d94/da1/dc7/d14/d3d/d5d 39 2024-04-25T17:19:29.137 INFO:tasks.workunit.client.1.smithi069.stdout:0/804: chown d0/d38/d75/f7b 3398 1 2024-04-25T17:19:29.139 INFO:tasks.workunit.client.1.smithi069.stdout:6/885: symlink d2/d1e/d43/dca/dce/l130 0 2024-04-25T17:19:29.141 INFO:tasks.workunit.client.1.smithi069.stdout:0/805: write d0/d17/d83/dcf/dd5/fec [466658,7977] 0 2024-04-25T17:19:29.143 INFO:tasks.workunit.client.0.smithi037.stdout:7/801: dread d5/d15/d17/f1c [0,4194304] 0 2024-04-25T17:19:29.144 INFO:tasks.workunit.client.1.smithi069.stdout:0/806: fsync d0/da/db/d2a/d9b/f116 0 2024-04-25T17:19:29.144 INFO:tasks.workunit.client.1.smithi069.stdout:5/918: creat d13/d17/d19/d20/f13d x:0 0 0 2024-04-25T17:19:29.145 INFO:tasks.workunit.client.0.smithi037.stdout:5/897: write d7/d12/f35 [3260847,101372] 0 2024-04-25T17:19:29.145 INFO:tasks.workunit.client.1.smithi069.stdout:0/807: chown d0/d38/d75 3835 1 2024-04-25T17:19:29.145 INFO:tasks.workunit.client.1.smithi069.stdout:2/877: creat d0/d56/d5f/d62/d7d/f123 x:0 0 0 2024-04-25T17:19:29.147 INFO:tasks.workunit.client.1.smithi069.stdout:0/808: chown d0/d17/fa5 290987 1 2024-04-25T17:19:29.149 INFO:tasks.workunit.client.1.smithi069.stdout:6/886: dwrite d2/d1e/d43/d7d/f10e [0,4194304] 0 2024-04-25T17:19:29.153 INFO:tasks.workunit.client.1.smithi069.stdout:1/868: creat d1/d4/d6/d9e/da6/d7c/d1d/f114 x:0 0 0 2024-04-25T17:19:29.156 INFO:tasks.workunit.client.0.smithi037.stdout:6/895: creat db/d1d/d20/dcf/dfa/d65/d68/f149 x:0 0 0 2024-04-25T17:19:29.156 INFO:tasks.workunit.client.0.smithi037.stdout:6/896: stat db/d147/d25/f104 0 2024-04-25T17:19:29.158 INFO:tasks.workunit.client.0.smithi037.stdout:5/898: fdatasync d7/d43/f16 0 2024-04-25T17:19:29.160 INFO:tasks.workunit.client.1.smithi069.stdout:8/911: creat d37/d47/d54/d6e/dce/f139 x:0 0 0 2024-04-25T17:19:29.163 INFO:tasks.workunit.client.1.smithi069.stdout:9/835: dwrite d2/da4/dcf/d65/d88/f54 [0,4194304] 0 2024-04-25T17:19:29.164 INFO:tasks.workunit.client.1.smithi069.stdout:5/919: rmdir d13/d17/dd4 39 2024-04-25T17:19:29.165 INFO:tasks.workunit.client.0.smithi037.stdout:5/899: truncate d7/d25/d4f/da7/fea 559316 0 2024-04-25T17:19:29.167 INFO:tasks.workunit.client.1.smithi069.stdout:2/878: rmdir d0/d56/d5f/d62/d7d/d31/df8 39 2024-04-25T17:19:29.169 INFO:tasks.workunit.client.0.smithi037.stdout:5/900: creat d7/d12/d6f/d68/f112 x:0 0 0 2024-04-25T17:19:29.172 INFO:tasks.workunit.client.0.smithi037.stdout:5/901: read d7/d12/da8/f103 [467765,39198] 0 2024-04-25T17:19:29.172 INFO:tasks.workunit.client.0.smithi037.stdout:6/897: creat db/f14a x:0 0 0 2024-04-25T17:19:29.174 INFO:tasks.workunit.client.1.smithi069.stdout:0/809: dwrite d0/da/d24/f42 [0,4194304] 0 2024-04-25T17:19:29.174 INFO:tasks.workunit.client.0.smithi037.stdout:6/898: write db/d1d/d20/dcf/dfa/d65/fdd [2827690,128343] 0 2024-04-25T17:19:29.175 INFO:tasks.workunit.client.1.smithi069.stdout:6/887: write d2/d1e/d43/db6/f119 [920215,50541] 0 2024-04-25T17:19:29.178 INFO:tasks.workunit.client.1.smithi069.stdout:4/879: mkdir db/d15/d20/d136/d139 0 2024-04-25T17:19:29.181 INFO:tasks.workunit.client.1.smithi069.stdout:3/917: getdents d8/d71 0 2024-04-25T17:19:29.186 INFO:tasks.workunit.client.1.smithi069.stdout:7/892: link d4/d3e/d94/da1/f111 d4/d4c/f12f 0 2024-04-25T17:19:29.187 INFO:tasks.workunit.client.1.smithi069.stdout:7/893: write d4/d18/f4f [3118755,14354] 0 2024-04-25T17:19:29.188 INFO:tasks.workunit.client.0.smithi037.stdout:7/802: dwrite d5/f13 [0,4194304] 0 2024-04-25T17:19:29.189 INFO:tasks.workunit.client.0.smithi037.stdout:6/899: truncate db/d26/fa5 714251 0 2024-04-25T17:19:29.190 INFO:tasks.workunit.client.0.smithi037.stdout:6/900: chown db/d147/d25/d61/l62 37 1 2024-04-25T17:19:29.191 INFO:tasks.workunit.client.1.smithi069.stdout:5/920: mkdir d13/d17/d19/d1c/da4/d13e 0 2024-04-25T17:19:29.193 INFO:tasks.workunit.client.1.smithi069.stdout:7/894: dwrite d4/d3e/d94/da1/dc7/d14/d44/fb8 [0,4194304] 0 2024-04-25T17:19:29.195 INFO:tasks.workunit.client.1.smithi069.stdout:2/879: fsync d0/d56/d5f/d62/d7d/fa8 0 2024-04-25T17:19:29.197 INFO:tasks.workunit.client.0.smithi037.stdout:7/803: mkdir d5/d15/dd8/d106 0 2024-04-25T17:19:29.198 INFO:tasks.workunit.client.0.smithi037.stdout:7/804: write d5/d15/f89 [429816,48665] 0 2024-04-25T17:19:29.198 INFO:tasks.workunit.client.0.smithi037.stdout:8/783: sync 2024-04-25T17:19:29.199 INFO:tasks.workunit.client.0.smithi037.stdout:8/784: stat d5/f27 0 2024-04-25T17:19:29.199 INFO:tasks.workunit.client.1.smithi069.stdout:0/810: mknod d0/d36/c117 0 2024-04-25T17:19:29.200 INFO:tasks.workunit.client.1.smithi069.stdout:0/811: write d0/f1 [1724572,84751] 0 2024-04-25T17:19:29.206 INFO:tasks.workunit.client.0.smithi037.stdout:6/901: dwrite db/d1d/d20/dcf/f146 [0,4194304] 0 2024-04-25T17:19:29.207 INFO:tasks.workunit.client.0.smithi037.stdout:7/805: symlink d5/d15/d17/d25/d2b/d48/l107 0 2024-04-25T17:19:29.213 INFO:tasks.workunit.client.0.smithi037.stdout:5/902: dwrite d7/d18/d62/dd8/dc6/fd2 [0,4194304] 0 2024-04-25T17:19:29.221 INFO:tasks.workunit.client.1.smithi069.stdout:9/836: dwrite d2/d51/db4/fd7 [0,4194304] 0 2024-04-25T17:19:29.222 INFO:tasks.workunit.client.0.smithi037.stdout:7/806: unlink d5/d15/d17/d1b/cf3 0 2024-04-25T17:19:29.235 INFO:tasks.workunit.client.1.smithi069.stdout:3/918: write d8/d16/d1a/d2c/d49/d59/ff4 [186716,62466] 0 2024-04-25T17:19:29.235 INFO:tasks.workunit.client.0.smithi037.stdout:8/785: link d5/db/d18/d3b/d50/d51/lca d5/db/d7e/l100 0 2024-04-25T17:19:29.236 INFO:tasks.workunit.client.0.smithi037.stdout:8/786: read d5/d6a/f9a [2495108,47851] 0 2024-04-25T17:19:29.240 INFO:tasks.workunit.client.0.smithi037.stdout:5/903: dread d7/d43/f30 [0,4194304] 0 2024-04-25T17:19:29.243 INFO:tasks.workunit.client.0.smithi037.stdout:8/787: creat d5/d26/f101 x:0 0 0 2024-04-25T17:19:29.245 INFO:tasks.workunit.client.0.smithi037.stdout:8/788: chown d5/db/d23/d58/f8b 2 1 2024-04-25T17:19:29.250 INFO:tasks.workunit.client.0.smithi037.stdout:7/807: dread d5/d15/d17/d25/d2b/f52 [0,4194304] 0 2024-04-25T17:19:29.255 INFO:tasks.workunit.client.1.smithi069.stdout:7/895: mknod d4/d3e/d94/da1/dc7/d14/d15/d11b/c130 0 2024-04-25T17:19:29.256 INFO:tasks.workunit.client.1.smithi069.stdout:2/880: write d0/d56/d5f/fb0 [1747488,94987] 0 2024-04-25T17:19:29.257 INFO:tasks.workunit.client.0.smithi037.stdout:7/808: truncate d5/d15/d17/d25/d2b/d59/fc4 796450 0 2024-04-25T17:19:29.260 INFO:tasks.workunit.client.1.smithi069.stdout:0/812: symlink d0/da/d24/d67/l118 0 2024-04-25T17:19:29.260 INFO:tasks.workunit.client.1.smithi069.stdout:3/919: dread d8/d71/f75 [0,4194304] 0 2024-04-25T17:19:29.260 INFO:tasks.workunit.client.0.smithi037.stdout:7/809: dread d5/f46 [0,4194304] 0 2024-04-25T17:19:29.261 INFO:tasks.workunit.client.1.smithi069.stdout:6/888: link d2/d9c/d97/dad/df1/c120 d2/d1e/d43/db6/d124/c131 0 2024-04-25T17:19:29.261 INFO:tasks.workunit.client.1.smithi069.stdout:0/813: write d0/fdf [5216107,72418] 0 2024-04-25T17:19:29.266 INFO:tasks.workunit.client.1.smithi069.stdout:1/869: link d1/d4/d6/lb5 d1/d4/d6/d9e/da6/d7c/d1d/de1/d8e/dbb/l115 0 2024-04-25T17:19:29.267 INFO:tasks.workunit.client.0.smithi037.stdout:8/789: write d5/db/d23/d42/f4f [9420109,93524] 0 2024-04-25T17:19:29.268 INFO:tasks.workunit.client.1.smithi069.stdout:8/912: getdents d37/d47/d78/db3/d114/d6b 0 2024-04-25T17:19:29.269 INFO:tasks.workunit.client.1.smithi069.stdout:5/921: write d13/d17/d29/d2e/fc4 [1254526,28675] 0 2024-04-25T17:19:29.269 INFO:tasks.workunit.client.0.smithi037.stdout:7/810: symlink d5/d15/d17/d1b/da2/l108 0 2024-04-25T17:19:29.270 INFO:tasks.workunit.client.1.smithi069.stdout:5/922: stat d13/d17/d19/d1c/lf5 0 2024-04-25T17:19:29.271 INFO:tasks.workunit.client.1.smithi069.stdout:9/837: truncate d2/da/fbb 3414812 0 2024-04-25T17:19:29.271 INFO:tasks.workunit.client.1.smithi069.stdout:9/838: fsync d2/da/fe3 0 2024-04-25T17:19:29.272 INFO:tasks.workunit.client.1.smithi069.stdout:9/839: chown d2/da4/dcf/l11e 6 1 2024-04-25T17:19:29.272 INFO:tasks.workunit.client.1.smithi069.stdout:7/896: truncate d4/d3e/dc8/fee 773030 0 2024-04-25T17:19:29.274 INFO:tasks.workunit.client.1.smithi069.stdout:2/881: dread d0/d26/d10/ffa [0,4194304] 0 2024-04-25T17:19:29.275 INFO:tasks.workunit.client.0.smithi037.stdout:8/790: dwrite d5/d26/f101 [0,4194304] 0 2024-04-25T17:19:29.277 INFO:tasks.workunit.client.0.smithi037.stdout:7/811: creat d5/d15/d17/d1b/d94/da8/f109 x:0 0 0 2024-04-25T17:19:29.278 INFO:tasks.workunit.client.1.smithi069.stdout:6/889: fdatasync d2/d51/d85/f6f 0 2024-04-25T17:19:29.278 INFO:tasks.workunit.client.1.smithi069.stdout:6/890: fsync d2/d51/d85/faa 0 2024-04-25T17:19:29.279 INFO:tasks.workunit.client.1.smithi069.stdout:6/891: write d2/d7/f80 [670534,114950] 0 2024-04-25T17:19:29.282 INFO:tasks.workunit.client.1.smithi069.stdout:3/920: write d8/d16/d1a/d2c/d49/d87/d8a/dd7/dfc/f12d [2370662,16611] 0 2024-04-25T17:19:29.284 INFO:tasks.workunit.client.0.smithi037.stdout:8/791: symlink d5/d26/d33/l102 0 2024-04-25T17:19:29.287 INFO:tasks.workunit.client.1.smithi069.stdout:0/814: rename d0/da/d54/d7d to d0/da/d59/dab/d119 0 2024-04-25T17:19:29.288 INFO:tasks.workunit.client.1.smithi069.stdout:4/880: getdents db/de3 0 2024-04-25T17:19:29.293 INFO:tasks.workunit.client.0.smithi037.stdout:7/812: link d5/d14/l1a d5/d15/d17/d25/d2b/d59/dfe/l10a 0 2024-04-25T17:19:29.295 INFO:tasks.workunit.client.0.smithi037.stdout:8/792: dread d5/db/d18/d3b/d50/d51/f85 [0,4194304] 0 2024-04-25T17:19:29.296 INFO:tasks.workunit.client.0.smithi037.stdout:8/793: fsync d5/da/f4a 0 2024-04-25T17:19:29.297 INFO:tasks.workunit.client.0.smithi037.stdout:7/813: creat d5/d15/dd8/db5/f10b x:0 0 0 2024-04-25T17:19:29.299 INFO:tasks.workunit.client.1.smithi069.stdout:8/913: write d37/d47/d54/d6e/d9e/f100 [702282,101201] 0 2024-04-25T17:19:29.300 INFO:tasks.workunit.client.1.smithi069.stdout:8/914: stat d37/d47/d54/d6e/ce3 0 2024-04-25T17:19:29.303 INFO:tasks.workunit.client.1.smithi069.stdout:9/840: dwrite d2/da/dd/f5d [0,4194304] 0 2024-04-25T17:19:29.304 INFO:tasks.workunit.client.1.smithi069.stdout:3/921: fsync d8/d71/faf 0 2024-04-25T17:19:29.304 INFO:tasks.workunit.client.1.smithi069.stdout:7/897: dread d4/d1a/f102 [0,4194304] 0 2024-04-25T17:19:29.305 INFO:tasks.workunit.client.1.smithi069.stdout:9/841: chown d2/da/dd/f31 1 1 2024-04-25T17:19:29.306 INFO:tasks.workunit.client.1.smithi069.stdout:0/815: rename d0/d17/d40/c48 to d0/da/db/d2a/d9b/d107/c11a 0 2024-04-25T17:19:29.309 INFO:tasks.workunit.client.0.smithi037.stdout:8/794: dwrite d5/d6a/f66 [4194304,4194304] 0 2024-04-25T17:19:29.310 INFO:tasks.workunit.client.1.smithi069.stdout:3/922: dwrite d8/d16/d4b/d9e/deb/d123/f132 [0,4194304] 0 2024-04-25T17:19:29.312 INFO:tasks.workunit.client.1.smithi069.stdout:5/923: symlink d13/d17/d19/d1c/da4/da9/l13f 0 2024-04-25T17:19:29.313 INFO:tasks.workunit.client.0.smithi037.stdout:7/814: dwrite d5/d15/d17/d1b/da2/daf/f8b [4194304,4194304] 0 2024-04-25T17:19:29.321 INFO:tasks.workunit.client.1.smithi069.stdout:8/915: creat d37/d62/f13a x:0 0 0 2024-04-25T17:19:29.322 INFO:tasks.workunit.client.1.smithi069.stdout:8/916: fsync d37/d47/d78/d93/df9/ff7 0 2024-04-25T17:19:29.325 INFO:tasks.workunit.client.1.smithi069.stdout:7/898: creat d4/d3e/d94/da1/dc7/d14/d3d/df6/f131 x:0 0 0 2024-04-25T17:19:29.326 INFO:tasks.workunit.client.1.smithi069.stdout:4/881: symlink db/d15/d20/d35/d63/l13a 0 2024-04-25T17:19:29.332 INFO:tasks.workunit.client.1.smithi069.stdout:7/899: dwrite d4/d3e/d94/da1/dc7/d14/d15/f17 [0,4194304] 0 2024-04-25T17:19:29.333 INFO:tasks.workunit.client.1.smithi069.stdout:5/924: mknod d13/d17/d19/d8a/dce/d11f/d12d/c140 0 2024-04-25T17:19:29.334 INFO:tasks.workunit.client.1.smithi069.stdout:9/842: truncate d2/da/d14/f25 2461148 0 2024-04-25T17:19:29.339 INFO:tasks.workunit.client.1.smithi069.stdout:5/925: dwrite d13/d17/d29/d30/d5c/f8f [0,4194304] 0 2024-04-25T17:19:29.339 INFO:tasks.workunit.client.1.smithi069.stdout:0/816: getdents d0/d36 0 2024-04-25T17:19:29.342 INFO:tasks.workunit.client.1.smithi069.stdout:3/923: getdents d8/d16/d1a/d2c/d49/d87 0 2024-04-25T17:19:29.342 INFO:tasks.workunit.client.1.smithi069.stdout:4/882: link db/d15/d20/d35/d63/d75/l7b db/d15/d20/d35/d63/d70/d8a/d96/l13b 0 2024-04-25T17:19:29.343 INFO:tasks.workunit.client.1.smithi069.stdout:7/900: creat d4/d83/d108/f132 x:0 0 0 2024-04-25T17:19:29.344 INFO:tasks.workunit.client.1.smithi069.stdout:5/926: rmdir d13/d17/d29/d30 39 2024-04-25T17:19:29.344 INFO:tasks.workunit.client.0.smithi037.stdout:7/815: dread d5/f37 [0,4194304] 0 2024-04-25T17:19:29.345 INFO:tasks.workunit.client.1.smithi069.stdout:0/817: symlink d0/da/d59/dab/l11b 0 2024-04-25T17:19:29.345 INFO:tasks.workunit.client.0.smithi037.stdout:7/816: fsync d5/d15/d17/d1b/da2/d76/f8a 0 2024-04-25T17:19:29.347 INFO:tasks.workunit.client.1.smithi069.stdout:4/883: creat db/f13c x:0 0 0 2024-04-25T17:19:29.351 INFO:tasks.workunit.client.1.smithi069.stdout:7/901: creat d4/d3e/d94/da1/dc7/d14/d15/dda/f133 x:0 0 0 2024-04-25T17:19:29.354 INFO:tasks.workunit.client.0.smithi037.stdout:7/817: creat d5/d15/f10c x:0 0 0 2024-04-25T17:19:29.356 INFO:tasks.workunit.client.1.smithi069.stdout:0/818: creat d0/da/d59/dab/f11c x:0 0 0 2024-04-25T17:19:29.357 INFO:tasks.workunit.client.1.smithi069.stdout:0/819: fsync d0/da/db/f64 0 2024-04-25T17:19:29.357 INFO:tasks.workunit.client.1.smithi069.stdout:4/884: symlink db/d15/d20/d35/d63/d43/d48/d49/d4e/l13d 0 2024-04-25T17:19:29.358 INFO:tasks.workunit.client.1.smithi069.stdout:2/882: truncate d0/d56/d5f/d62/d7d/d31/fd5 2846910 0 2024-04-25T17:19:29.359 INFO:tasks.workunit.client.1.smithi069.stdout:9/843: link d2/da/dd/d1e/d2e/d68/dba/c118 d2/da/dd/c11f 0 2024-04-25T17:19:29.360 INFO:tasks.workunit.client.0.smithi037.stdout:7/818: creat d5/d15/d17/d1b/da2/d105/f10d x:0 0 0 2024-04-25T17:19:29.360 INFO:tasks.workunit.client.1.smithi069.stdout:4/885: readlink db/d15/d20/d35/d63/d70/d8a/la0 0 2024-04-25T17:19:29.360 INFO:tasks.workunit.client.1.smithi069.stdout:1/870: dwrite d1/f109 [0,4194304] 0 2024-04-25T17:19:29.363 INFO:tasks.workunit.client.1.smithi069.stdout:3/924: creat d8/d16/f135 x:0 0 0 2024-04-25T17:19:29.366 INFO:tasks.workunit.client.1.smithi069.stdout:8/917: write d37/d47/d54/ff6 [472095,64787] 0 2024-04-25T17:19:29.369 INFO:tasks.workunit.client.1.smithi069.stdout:9/844: mkdir d2/da/dd/d1e/d2e/d35/d120 0 2024-04-25T17:19:29.370 INFO:tasks.workunit.client.1.smithi069.stdout:9/845: readlink d2/da4/dcf/d65/d88/l11c 0 2024-04-25T17:19:29.373 INFO:tasks.workunit.client.1.smithi069.stdout:1/871: rmdir d1/d4/de/d63 39 2024-04-25T17:19:29.375 INFO:tasks.workunit.client.0.smithi037.stdout:7/819: getdents d5/d15/d17/d1b/da2 0 2024-04-25T17:19:29.376 INFO:tasks.workunit.client.1.smithi069.stdout:4/886: truncate db/d4b/d78/f8b 2974021 0 2024-04-25T17:19:29.378 INFO:tasks.workunit.client.1.smithi069.stdout:1/872: dwrite d1/df/f34 [0,4194304] 0 2024-04-25T17:19:29.378 INFO:tasks.workunit.client.1.smithi069.stdout:4/887: chown db/d15/d20/d35/d63/c94 1 1 2024-04-25T17:19:29.380 INFO:tasks.workunit.client.1.smithi069.stdout:3/925: creat d8/d16/d1a/d2c/d49/d59/f136 x:0 0 0 2024-04-25T17:19:29.381 INFO:tasks.workunit.client.1.smithi069.stdout:0/820: truncate d0/d17/d95/fd8 1427201 0 2024-04-25T17:19:29.383 INFO:tasks.workunit.client.1.smithi069.stdout:8/918: mknod d37/d47/d48/c13b 0 2024-04-25T17:19:29.386 INFO:tasks.workunit.client.1.smithi069.stdout:9/846: mknod d2/da/dd/de/d59/c121 0 2024-04-25T17:19:29.387 INFO:tasks.workunit.client.1.smithi069.stdout:5/927: dwrite d13/d17/d19/d1c/d6c/fea [0,4194304] 0 2024-04-25T17:19:29.391 INFO:tasks.workunit.client.1.smithi069.stdout:4/888: rmdir db/d15/d82/df4 39 2024-04-25T17:19:29.395 INFO:tasks.workunit.client.1.smithi069.stdout:4/889: chown db/d15/d42/d64/la8 91 1 2024-04-25T17:19:29.395 INFO:tasks.workunit.client.1.smithi069.stdout:8/919: rmdir d37/d47/d54/d6e/dce 39 2024-04-25T17:19:29.398 INFO:tasks.workunit.client.1.smithi069.stdout:4/890: fdatasync db/d15/d42/d64/fe1 0 2024-04-25T17:19:29.398 INFO:tasks.workunit.client.1.smithi069.stdout:9/847: creat d2/d51/db4/f122 x:0 0 0 2024-04-25T17:19:29.399 INFO:tasks.workunit.client.1.smithi069.stdout:7/902: dwrite d4/d18/ffd [0,4194304] 0 2024-04-25T17:19:29.400 INFO:tasks.workunit.client.1.smithi069.stdout:8/920: chown d37/d47/d78/db3/d114/d6b/daf/feb 7668878 1 2024-04-25T17:19:29.400 INFO:tasks.workunit.client.1.smithi069.stdout:3/926: getdents d8/d16/d1a/d2c/d49/d59/dff/d11d 0 2024-04-25T17:19:29.402 INFO:tasks.workunit.client.1.smithi069.stdout:2/883: dwrite d0/d26/f23 [0,4194304] 0 2024-04-25T17:19:29.403 INFO:tasks.workunit.client.1.smithi069.stdout:8/921: read - d37/d47/d54/d6e/d9e/f12f zero size 2024-04-25T17:19:29.406 INFO:tasks.workunit.client.0.smithi037.stdout:7/820: dwrite d5/d15/d17/d25/f4d [0,4194304] 0 2024-04-25T17:19:29.408 INFO:tasks.workunit.client.1.smithi069.stdout:6/892: sync 2024-04-25T17:19:29.412 INFO:tasks.workunit.client.1.smithi069.stdout:3/927: symlink d8/d39/l137 0 2024-04-25T17:19:29.413 INFO:tasks.workunit.client.0.smithi037.stdout:7/821: dread - d5/d15/dd8/f86 zero size 2024-04-25T17:19:29.415 INFO:tasks.workunit.client.1.smithi069.stdout:2/884: dwrite d0/d56/d5f/d62/d7d/d72/daf/dc2/ddd/fe1 [0,4194304] 0 2024-04-25T17:19:29.416 INFO:tasks.workunit.client.1.smithi069.stdout:4/891: symlink db/d15/d20/d35/d63/d75/dc0/l13e 0 2024-04-25T17:19:29.416 INFO:tasks.workunit.client.0.smithi037.stdout:7/822: dread - d5/d14/db1/fe4 zero size 2024-04-25T17:19:29.418 INFO:tasks.workunit.client.1.smithi069.stdout:0/821: dwrite d0/da/db/f15 [0,4194304] 0 2024-04-25T17:19:29.419 INFO:tasks.workunit.client.1.smithi069.stdout:8/922: creat d37/d47/d78/db3/d114/d6b/d11b/f13c x:0 0 0 2024-04-25T17:19:29.420 INFO:tasks.workunit.client.0.smithi037.stdout:7/823: mkdir d5/d15/d17/d25/d2b/d59/dfe/d10e 0 2024-04-25T17:19:29.424 INFO:tasks.workunit.client.0.smithi037.stdout:7/824: symlink d5/d15/d17/d1b/da2/d76/l10f 0 2024-04-25T17:19:29.425 INFO:tasks.workunit.client.1.smithi069.stdout:9/848: mkdir d2/da/dd/d1e/d2e/d35/d120/d123 0 2024-04-25T17:19:29.426 INFO:tasks.workunit.client.1.smithi069.stdout:3/928: rmdir d8/d16/d4b/def 39 2024-04-25T17:19:29.429 INFO:tasks.workunit.client.1.smithi069.stdout:8/923: truncate d37/d47/d78/d93/f133 777707 0 2024-04-25T17:19:29.431 INFO:tasks.workunit.client.1.smithi069.stdout:5/928: getdents d13 0 2024-04-25T17:19:29.431 INFO:tasks.workunit.client.1.smithi069.stdout:3/929: chown d8/d71/f110 1409235 1 2024-04-25T17:19:29.432 INFO:tasks.workunit.client.0.smithi037.stdout:1/968: sync 2024-04-25T17:19:29.432 INFO:tasks.workunit.client.1.smithi069.stdout:9/849: chown d2/da4/dcf/l28 1452540 1 2024-04-25T17:19:29.433 INFO:tasks.workunit.client.1.smithi069.stdout:2/885: truncate d0/d56/d5f/d62/f73 313869 0 2024-04-25T17:19:29.433 INFO:tasks.workunit.client.1.smithi069.stdout:6/893: truncate d2/d9c/f4b 3521096 0 2024-04-25T17:19:29.435 INFO:tasks.workunit.client.0.smithi037.stdout:1/969: read - dc/d52/d6b/dd9/d22/d36/dbe/ffb zero size 2024-04-25T17:19:29.435 INFO:tasks.workunit.client.1.smithi069.stdout:1/873: dread d1/d43/f5b [0,4194304] 0 2024-04-25T17:19:29.435 INFO:tasks.workunit.client.1.smithi069.stdout:7/903: dwrite d4/d3e/d94/da1/f91 [0,4194304] 0 2024-04-25T17:19:29.436 INFO:tasks.workunit.client.0.smithi037.stdout:7/825: getdents d5/d15/d17 0 2024-04-25T17:19:29.439 INFO:tasks.workunit.client.1.smithi069.stdout:3/930: mkdir d8/d39/dfa/d138 0 2024-04-25T17:19:29.441 INFO:tasks.workunit.client.0.smithi037.stdout:1/970: creat dc/d52/d6b/dd9/d4d/d6a/d8f/f14d x:0 0 0 2024-04-25T17:19:29.441 INFO:tasks.workunit.client.1.smithi069.stdout:5/929: readlink d13/d17/d29/d30/d5c/l84 0 2024-04-25T17:19:29.442 INFO:tasks.workunit.client.0.smithi037.stdout:7/826: fdatasync d5/d15/d17/d1b/da2/fdd 0 2024-04-25T17:19:29.445 INFO:tasks.workunit.client.1.smithi069.stdout:6/894: creat d2/d51/d89/dfd/f132 x:0 0 0 2024-04-25T17:19:29.446 INFO:tasks.workunit.client.0.smithi037.stdout:1/971: creat dc/d52/d6b/dd9/d22/d36/d8c/f14e x:0 0 0 2024-04-25T17:19:29.451 INFO:tasks.workunit.client.1.smithi069.stdout:7/904: symlink d4/d3e/d94/da1/dc7/d14/d3d/df6/l134 0 2024-04-25T17:19:29.451 INFO:tasks.workunit.client.0.smithi037.stdout:1/972: dread - dc/d1c/f101 zero size 2024-04-25T17:19:29.453 INFO:tasks.workunit.client.1.smithi069.stdout:9/850: dread d2/da/dd/de/d74/d8a/f9e [0,4194304] 0 2024-04-25T17:19:29.454 INFO:tasks.workunit.client.1.smithi069.stdout:4/892: write db/d22/fcd [156122,109564] 0 2024-04-25T17:19:29.456 INFO:tasks.workunit.client.0.smithi037.stdout:1/973: unlink dc/d52/d6b/dd9/d22/d36/d8c/c128 0 2024-04-25T17:19:29.461 INFO:tasks.workunit.client.1.smithi069.stdout:6/895: symlink d2/d1e/d43/db6/daf/ddd/l133 0 2024-04-25T17:19:29.463 INFO:tasks.workunit.client.1.smithi069.stdout:0/822: dread d0/da/d24/d43/f7f [0,4194304] 0 2024-04-25T17:19:29.464 INFO:tasks.workunit.client.1.smithi069.stdout:5/930: dread d13/d17/d29/d30/d9c/fe9 [0,4194304] 0 2024-04-25T17:19:29.464 INFO:tasks.workunit.client.1.smithi069.stdout:0/823: chown d0/da/db/d3a/d104 3521439 1 2024-04-25T17:19:29.465 INFO:tasks.workunit.client.1.smithi069.stdout:4/893: symlink db/d15/d26/l13f 0 2024-04-25T17:19:29.466 INFO:tasks.workunit.client.0.smithi037.stdout:7/827: write d5/d15/fdc [3867012,6711] 0 2024-04-25T17:19:29.469 INFO:tasks.workunit.client.1.smithi069.stdout:8/924: dread d37/d47/d54/d6e/d9e/f100 [0,4194304] 0 2024-04-25T17:19:29.469 INFO:tasks.workunit.client.1.smithi069.stdout:2/886: dread d0/f92 [0,4194304] 0 2024-04-25T17:19:29.469 INFO:tasks.workunit.client.1.smithi069.stdout:9/851: unlink d2/da/dd/de/d59/lcc 0 2024-04-25T17:19:29.471 INFO:tasks.workunit.client.1.smithi069.stdout:6/896: mknod d2/d1e/d3f/d56/d7e/d100/c134 0 2024-04-25T17:19:29.471 INFO:tasks.workunit.client.1.smithi069.stdout:8/925: chown d37/d47/d54/c81 1035602660 1 2024-04-25T17:19:29.471 INFO:tasks.workunit.client.1.smithi069.stdout:3/931: dread d8/d71/d8d/d92/db6/dc1/fbf [4194304,4194304] 0 2024-04-25T17:19:29.476 INFO:tasks.workunit.client.1.smithi069.stdout:3/932: dwrite d8/f18 [0,4194304] 0 2024-04-25T17:19:29.479 INFO:tasks.workunit.client.1.smithi069.stdout:4/894: creat db/d4b/d78/dc4/d41/d9e/f140 x:0 0 0 2024-04-25T17:19:29.479 INFO:tasks.workunit.client.1.smithi069.stdout:1/874: write d1/d4/d6/d9e/da6/fd2 [4519267,54587] 0 2024-04-25T17:19:29.480 INFO:tasks.workunit.client.0.smithi037.stdout:1/974: dwrite fa [0,4194304] 0 2024-04-25T17:19:29.481 INFO:tasks.workunit.client.1.smithi069.stdout:7/905: rename d4/d3e/d94/da1/dc7/d14/d3d/df6/l45 to d4/d3e/d94/da1/dc7/d14/d5a/d5e/d89/d103/l135 0 2024-04-25T17:19:29.483 INFO:tasks.workunit.client.1.smithi069.stdout:2/887: mknod d0/d56/d5f/d62/d7d/d72/daf/c124 0 2024-04-25T17:19:29.483 INFO:tasks.workunit.client.0.smithi037.stdout:7/828: link d5/d15/cfa d5/dc1/de1/c110 0 2024-04-25T17:19:29.485 INFO:tasks.workunit.client.1.smithi069.stdout:5/931: dread d13/f1a [0,4194304] 0 2024-04-25T17:19:29.486 INFO:tasks.workunit.client.1.smithi069.stdout:5/932: read d13/d17/d19/d1c/d6c/fea [64339,98732] 0 2024-04-25T17:19:29.487 INFO:tasks.workunit.client.1.smithi069.stdout:5/933: readlink d13/dff/d10d/l12b 0 2024-04-25T17:19:29.489 INFO:tasks.workunit.client.1.smithi069.stdout:0/824: write d0/f6 [2267762,50964] 0 2024-04-25T17:19:29.492 INFO:tasks.workunit.client.0.smithi037.stdout:7/829: rename d5/d15/d17/d1b/d94/f101 to d5/d15/dd8/db5/f111 0 2024-04-25T17:19:29.493 INFO:tasks.workunit.client.1.smithi069.stdout:6/897: mkdir d2/d1e/d3f/d86/da8/d135 0 2024-04-25T17:19:29.495 INFO:tasks.workunit.client.0.smithi037.stdout:1/975: creat dc/d18/d64/f14f x:0 0 0 2024-04-25T17:19:29.496 INFO:tasks.workunit.client.0.smithi037.stdout:7/830: creat d5/d15/d17/d25/d2b/dcb/dda/f112 x:0 0 0 2024-04-25T17:19:29.496 INFO:tasks.workunit.client.1.smithi069.stdout:3/933: truncate d8/d2a/f72 4282694 0 2024-04-25T17:19:29.499 INFO:tasks.workunit.client.0.smithi037.stdout:7/831: creat d5/dc1/de1/f113 x:0 0 0 2024-04-25T17:19:29.501 INFO:tasks.workunit.client.1.smithi069.stdout:8/926: rename d37/d47/d48/c13b to d37/d47/d54/d6e/d98/c13d 0 2024-04-25T17:19:29.510 INFO:tasks.workunit.client.0.smithi037.stdout:7/832: creat d5/d14/d31/f114 x:0 0 0 2024-04-25T17:19:29.511 INFO:tasks.workunit.client.1.smithi069.stdout:0/825: creat d0/da/db/d2a/d8c/f11d x:0 0 0 2024-04-25T17:19:29.512 INFO:tasks.workunit.client.1.smithi069.stdout:0/826: readlink d0/da/db/lae 0 2024-04-25T17:19:29.513 INFO:tasks.workunit.client.1.smithi069.stdout:9/852: dwrite d2/da/dd/d1e/d2e/d35/f7a [4194304,4194304] 0 2024-04-25T17:19:29.516 INFO:tasks.workunit.client.1.smithi069.stdout:6/898: dread d2/d1e/d3f/d56/d7e/fcf [0,4194304] 0 2024-04-25T17:19:29.521 INFO:tasks.workunit.client.1.smithi069.stdout:7/906: write d4/d4c/fe5 [297240,8944] 0 2024-04-25T17:19:29.524 INFO:tasks.workunit.client.1.smithi069.stdout:5/934: write d13/d17/d29/dde/fe8 [982962,109637] 0 2024-04-25T17:19:29.525 INFO:tasks.workunit.client.1.smithi069.stdout:4/895: dwrite db/d15/d42/d64/fda [0,4194304] 0 2024-04-25T17:19:29.526 INFO:tasks.workunit.client.0.smithi037.stdout:1/976: dwrite dc/d52/d6b/dd9/d22/d36/d74/daf/ddd/f122 [0,4194304] 0 2024-04-25T17:19:29.526 INFO:tasks.workunit.client.1.smithi069.stdout:6/899: dwrite d2/d9c/d97/dad/de8/f11a [0,4194304] 0 2024-04-25T17:19:29.528 INFO:tasks.workunit.client.1.smithi069.stdout:4/896: write db/d15/d20/d35/d63/f11e [186679,64636] 0 2024-04-25T17:19:29.529 INFO:tasks.workunit.client.0.smithi037.stdout:1/977: write dc/d52/d6b/dd9/d22/d36/d92/fc4 [1886798,16022] 0 2024-04-25T17:19:29.530 INFO:tasks.workunit.client.0.smithi037.stdout:7/833: write d5/d15/d17/d1b/da2/d76/fb0 [911523,109535] 0 2024-04-25T17:19:29.530 INFO:tasks.workunit.client.1.smithi069.stdout:4/897: chown db/d15/d26/f62 1848 1 2024-04-25T17:19:29.531 INFO:tasks.workunit.client.0.smithi037.stdout:1/978: fsync dc/d52/d6b/dd9/d4d/d6a/d86/d91/f93 0 2024-04-25T17:19:29.532 INFO:tasks.workunit.client.1.smithi069.stdout:4/898: chown db/f104 1770324 1 2024-04-25T17:19:29.534 INFO:tasks.workunit.client.1.smithi069.stdout:1/875: rmdir d1/d4/d6/d9e/da6/d7c/d1d/dad/d100 0 2024-04-25T17:19:29.536 INFO:tasks.workunit.client.1.smithi069.stdout:0/827: write d0/da/d24/d67/db8/fbe [1839237,79068] 0 2024-04-25T17:19:29.537 INFO:tasks.workunit.client.1.smithi069.stdout:1/876: fdatasync d1/d4/d6/d9e/da6/d7c/fe8 0 2024-04-25T17:19:29.537 INFO:tasks.workunit.client.0.smithi037.stdout:1/979: dread dc/d52/d6b/dd9/d22/d36/d74/daf/ddd/f122 [0,4194304] 0 2024-04-25T17:19:29.538 INFO:tasks.workunit.client.1.smithi069.stdout:2/888: creat d0/d56/d5f/d62/d7d/d31/df8/d10e/f125 x:0 0 0 2024-04-25T17:19:29.538 INFO:tasks.workunit.client.1.smithi069.stdout:3/934: dwrite d8/d71/d8d/d92/f97 [0,4194304] 0 2024-04-25T17:19:29.539 INFO:tasks.workunit.client.0.smithi037.stdout:7/834: write d5/d15/d17/d1b/da2/fce [1649690,49816] 0 2024-04-25T17:19:29.543 INFO:tasks.workunit.client.0.smithi037.stdout:7/835: dwrite d5/d15/d17/d9d/fe8 [0,4194304] 0 2024-04-25T17:19:29.545 INFO:tasks.workunit.client.1.smithi069.stdout:1/877: dwrite d1/f5 [4194304,4194304] 0 2024-04-25T17:19:29.594 INFO:tasks.workunit.client.0.smithi037.stdout:0/952: sync 2024-04-25T17:19:29.594 INFO:tasks.workunit.client.0.smithi037.stdout:3/729: sync 2024-04-25T17:19:29.605 INFO:tasks.workunit.client.0.smithi037.stdout:1/980: creat dc/d18/d64/d133/d13a/f150 x:0 0 0 2024-04-25T17:19:29.605 INFO:tasks.workunit.client.1.smithi069.stdout:9/853: dwrite d2/da/f8c [0,4194304] 0 2024-04-25T17:19:29.605 INFO:tasks.workunit.client.1.smithi069.stdout:7/907: fdatasync d4/d3e/d94/da1/dc7/d14/d3d/df6/f68 0 2024-04-25T17:19:29.606 INFO:tasks.workunit.client.0.smithi037.stdout:1/981: write dc/f62 [3783329,51190] 0 2024-04-25T17:19:29.607 INFO:tasks.workunit.client.0.smithi037.stdout:7/836: dread - d5/d14/d31/fb4 zero size 2024-04-25T17:19:29.611 INFO:tasks.workunit.client.0.smithi037.stdout:0/953: symlink d9/d72/de0/l134 0 2024-04-25T17:19:29.612 INFO:tasks.workunit.client.0.smithi037.stdout:0/954: stat d9/df/d32/fd7 0 2024-04-25T17:19:29.612 INFO:tasks.workunit.client.0.smithi037.stdout:3/730: creat d8/d31/d32/dd7/fe7 x:0 0 0 2024-04-25T17:19:29.615 INFO:tasks.workunit.client.1.smithi069.stdout:4/899: rmdir db/d15/d42/d64/d7f/df7 39 2024-04-25T17:19:29.618 INFO:tasks.workunit.client.0.smithi037.stdout:1/982: truncate dc/d52/d6b/dd9/d22/d36/d8c/fa7 442349 0 2024-04-25T17:19:29.618 INFO:tasks.workunit.client.0.smithi037.stdout:0/955: rmdir d9/df/d32 39 2024-04-25T17:19:29.620 INFO:tasks.workunit.client.1.smithi069.stdout:2/889: creat d0/d26/d36/db9/f126 x:0 0 0 2024-04-25T17:19:29.620 INFO:tasks.workunit.client.0.smithi037.stdout:3/731: mkdir d8/d23/dbb/d81/dc3/de8 0 2024-04-25T17:19:29.621 INFO:tasks.workunit.client.1.smithi069.stdout:2/890: fsync d0/d1/d5b/fc9 0 2024-04-25T17:19:29.621 INFO:tasks.workunit.client.1.smithi069.stdout:3/935: mknod d8/d16/d1a/d2c/d49/d59/dff/c139 0 2024-04-25T17:19:29.622 INFO:tasks.workunit.client.1.smithi069.stdout:3/936: chown d8/f1f 1 1 2024-04-25T17:19:29.622 INFO:tasks.workunit.client.1.smithi069.stdout:1/878: truncate d1/d4/d6/d9e/da6/d7c/f53 1177025 0 2024-04-25T17:19:29.624 INFO:tasks.workunit.client.1.smithi069.stdout:1/879: write d1/d4/d6/d4f/d9b/fc9 [4329380,82863] 0 2024-04-25T17:19:29.627 INFO:tasks.workunit.client.0.smithi037.stdout:3/732: dread d8/d4c/fc1 [0,4194304] 0 2024-04-25T17:19:29.629 INFO:tasks.workunit.client.1.smithi069.stdout:9/854: creat d2/d51/f124 x:0 0 0 2024-04-25T17:19:29.630 INFO:tasks.workunit.client.1.smithi069.stdout:7/908: chown d4/d18/l9e 738 1 2024-04-25T17:19:29.634 INFO:tasks.workunit.client.1.smithi069.stdout:6/900: creat d2/d51/d89/dfd/d10f/f136 x:0 0 0 2024-04-25T17:19:29.634 INFO:tasks.workunit.client.1.smithi069.stdout:8/927: write ff [966536,25294] 0 2024-04-25T17:19:29.636 INFO:tasks.workunit.client.1.smithi069.stdout:1/880: dread d1/d4/d6/d4f/d9b/da3/df9/f107 [0,4194304] 0 2024-04-25T17:19:29.638 INFO:tasks.workunit.client.1.smithi069.stdout:1/881: chown d1/d4/d6/d9e/da6/d7c/d1d/de1/d8e/dbb 1760638226 1 2024-04-25T17:19:29.639 INFO:tasks.workunit.client.0.smithi037.stdout:3/733: mknod d8/d23/d38/ce9 0 2024-04-25T17:19:29.640 INFO:tasks.workunit.client.1.smithi069.stdout:2/891: write d0/f92 [4831777,113244] 0 2024-04-25T17:19:29.641 INFO:tasks.workunit.client.0.smithi037.stdout:3/734: write d8/d23/dbb/d81/fac [1304820,104920] 0 2024-04-25T17:19:29.641 INFO:tasks.workunit.client.0.smithi037.stdout:7/837: getdents d5/d14/dcf 0 2024-04-25T17:19:29.642 INFO:tasks.workunit.client.1.smithi069.stdout:0/828: dread d0/da/d59/fc3 [0,4194304] 0 2024-04-25T17:19:29.646 INFO:tasks.workunit.client.1.smithi069.stdout:3/937: rename d8/d71/f85 to d8/d16/d1a/d2c/d49/d59/dd2/f13a 0 2024-04-25T17:19:29.647 INFO:tasks.workunit.client.1.smithi069.stdout:5/935: write d13/d17/d29/fb4 [1018503,103999] 0 2024-04-25T17:19:29.648 INFO:tasks.workunit.client.0.smithi037.stdout:7/838: write d5/d14/d31/f93 [254126,688] 0 2024-04-25T17:19:29.648 INFO:tasks.workunit.client.1.smithi069.stdout:3/938: write d8/d16/d1a/d2c/d49/d87/d8a/fc9 [3465232,24344] 0 2024-04-25T17:19:29.650 INFO:tasks.workunit.client.0.smithi037.stdout:3/735: read - d8/d23/d38/d66/fa7 zero size 2024-04-25T17:19:29.652 INFO:tasks.workunit.client.0.smithi037.stdout:3/736: write d8/f26 [1677292,58732] 0 2024-04-25T17:19:29.652 INFO:tasks.workunit.client.1.smithi069.stdout:9/855: read d2/f29 [4059084,9190] 0 2024-04-25T17:19:29.653 INFO:tasks.workunit.client.0.smithi037.stdout:3/737: write d8/d23/d38/f74 [1519208,38709] 0 2024-04-25T17:19:29.655 INFO:tasks.workunit.client.1.smithi069.stdout:7/909: dread d4/d3e/dc8/fee [0,4194304] 0 2024-04-25T17:19:29.656 INFO:tasks.workunit.client.0.smithi037.stdout:7/839: rmdir d5/d15/d17/d25/d2b/d48 39 2024-04-25T17:19:29.657 INFO:tasks.workunit.client.0.smithi037.stdout:7/840: write d5/d15/d17/d9d/fe8 [1080512,76770] 0 2024-04-25T17:19:29.660 INFO:tasks.workunit.client.1.smithi069.stdout:8/928: creat d37/d47/d54/d6e/d9e/f13e x:0 0 0 2024-04-25T17:19:29.662 INFO:tasks.workunit.client.0.smithi037.stdout:1/983: write dc/d52/d6b/fb3 [216603,21850] 0 2024-04-25T17:19:29.663 INFO:tasks.workunit.client.0.smithi037.stdout:0/956: write d9/d14/f44 [6344209,3856] 0 2024-04-25T17:19:29.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:29 smithi069 ceph-mon[34527]: from='client.14758 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:19:29.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:29 smithi069 ceph-mon[34527]: pgmap v45: 65 pgs: 65 active+clean; 3.6 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 76 MiB/s rd, 172 MiB/s wr, 403 op/s 2024-04-25T17:19:29.668 INFO:tasks.workunit.client.1.smithi069.stdout:6/901: dread d2/d7/f94 [4194304,4194304] 0 2024-04-25T17:19:29.669 INFO:tasks.workunit.client.1.smithi069.stdout:4/900: write db/d15/d42/d64/f80 [660684,40672] 0 2024-04-25T17:19:29.670 INFO:tasks.workunit.client.0.smithi037.stdout:3/738: creat d8/db4/dca/fea x:0 0 0 2024-04-25T17:19:29.672 INFO:tasks.workunit.client.1.smithi069.stdout:5/936: symlink d13/d17/d19/d20/l141 0 2024-04-25T17:19:29.680 INFO:tasks.workunit.client.0.smithi037.stdout:3/739: unlink d8/d23/dbb/f50 0 2024-04-25T17:19:29.681 INFO:tasks.workunit.client.1.smithi069.stdout:1/882: write d1/f2e [6082176,20307] 0 2024-04-25T17:19:29.681 INFO:tasks.workunit.client.1.smithi069.stdout:9/856: write d2/da/d14/f79 [4102475,74914] 0 2024-04-25T17:19:29.682 INFO:tasks.workunit.client.1.smithi069.stdout:9/857: chown d2/da4/dcf/le8 4 1 2024-04-25T17:19:29.683 INFO:tasks.workunit.client.1.smithi069.stdout:7/910: mkdir d4/d3e/d94/da1/dc7/d14/d44/d7c/d9f/dcb/d136 0 2024-04-25T17:19:29.683 INFO:tasks.workunit.client.1.smithi069.stdout:1/883: truncate d1/d43/d1b/d32/d4a/db4/fff 847110 0 2024-04-25T17:19:29.684 INFO:tasks.workunit.client.1.smithi069.stdout:7/911: chown d4/d83/da2/ded/l10e 52511877 1 2024-04-25T17:19:29.684 INFO:tasks.workunit.client.0.smithi037.stdout:0/957: chown d9/df/d32/d39/l51 7 1 2024-04-25T17:19:29.685 INFO:tasks.workunit.client.0.smithi037.stdout:7/841: link d5/d14/l7b d5/d15/d17/d9d/l115 0 2024-04-25T17:19:29.685 INFO:tasks.workunit.client.0.smithi037.stdout:1/984: write dc/d52/ff2 [943863,11071] 0 2024-04-25T17:19:29.687 INFO:tasks.workunit.client.0.smithi037.stdout:3/740: chown d8/f37 14 1 2024-04-25T17:19:29.688 INFO:tasks.workunit.client.0.smithi037.stdout:0/958: symlink d9/df/d32/d39/d68/da7/l135 0 2024-04-25T17:19:29.692 INFO:tasks.workunit.client.1.smithi069.stdout:5/937: readlink d13/dff/d10d/l113 0 2024-04-25T17:19:29.694 INFO:tasks.workunit.client.0.smithi037.stdout:0/959: mkdir d9/d14/d23/d136 0 2024-04-25T17:19:29.695 INFO:tasks.workunit.client.0.smithi037.stdout:0/960: chown d9/df/d32/d39/fcb 1 1 2024-04-25T17:19:29.698 INFO:tasks.workunit.client.1.smithi069.stdout:7/912: truncate d4/d83/fe7 998842 0 2024-04-25T17:19:29.701 INFO:tasks.workunit.client.1.smithi069.stdout:1/884: symlink d1/d4/d6/d9e/da6/d7c/d1d/de1/d8e/dbb/l116 0 2024-04-25T17:19:29.702 INFO:tasks.workunit.client.0.smithi037.stdout:0/961: symlink d9/d71/l137 0 2024-04-25T17:19:29.704 INFO:tasks.workunit.client.1.smithi069.stdout:2/892: rename d0/d56/d5f/d62/d7d/d72/daf to d0/d26/d10/d127 0 2024-04-25T17:19:29.705 INFO:tasks.workunit.client.0.smithi037.stdout:7/842: dwrite d5/d15/d17/d1b/da2/fc0 [0,4194304] 0 2024-04-25T17:19:29.706 INFO:tasks.workunit.client.1.smithi069.stdout:4/901: dwrite db/f21 [0,4194304] 0 2024-04-25T17:19:29.707 INFO:tasks.workunit.client.0.smithi037.stdout:3/741: rename d8/d23/dbb/d63/d86 to d8/deb 0 2024-04-25T17:19:29.707 INFO:tasks.workunit.client.0.smithi037.stdout:3/742: stat d8/d23/dbb/d5d/fa9 0 2024-04-25T17:19:29.708 INFO:tasks.workunit.client.1.smithi069.stdout:3/939: creat d8/d16/d4b/def/d134/f13b x:0 0 0 2024-04-25T17:19:29.709 INFO:tasks.workunit.client.0.smithi037.stdout:1/985: getdents dc/d52/d6b/dd9 0 2024-04-25T17:19:29.711 INFO:tasks.workunit.client.1.smithi069.stdout:5/938: creat d13/d17/d19/d1c/da4/da9/daa/f142 x:0 0 0 2024-04-25T17:19:29.712 INFO:tasks.workunit.client.1.smithi069.stdout:9/858: creat d2/da/dd/d1e/d2e/d35/d120/d123/f125 x:0 0 0 2024-04-25T17:19:29.714 INFO:tasks.workunit.client.1.smithi069.stdout:5/939: read d13/d17/d19/d1c/d6c/fb3 [848230,21986] 0 2024-04-25T17:19:29.715 INFO:tasks.workunit.client.1.smithi069.stdout:7/913: dread d4/d3e/d94/da1/dc7/d14/d44/d79/da4/fc6 [0,4194304] 0 2024-04-25T17:19:29.718 INFO:tasks.workunit.client.1.smithi069.stdout:7/914: write d4/d3e/d94/da1/dc7/d14/d3d/d47/fef [4287609,17069] 0 2024-04-25T17:19:29.720 INFO:tasks.workunit.client.0.smithi037.stdout:7/843: creat d5/d15/dd8/d106/f116 x:0 0 0 2024-04-25T17:19:29.721 INFO:tasks.workunit.client.1.smithi069.stdout:9/859: dwrite d2/da/dd/d1e/d40/fca [0,4194304] 0 2024-04-25T17:19:29.728 INFO:tasks.workunit.client.1.smithi069.stdout:0/829: rename d0/da/db/d3a/d104/f111 to d0/da/d24/f11e 0 2024-04-25T17:19:29.731 INFO:tasks.workunit.client.0.smithi037.stdout:3/743: link d8/d23/fc4 d8/d23/dbb/fec 0 2024-04-25T17:19:29.733 INFO:tasks.workunit.client.0.smithi037.stdout:1/986: creat dc/d24/da5/f151 x:0 0 0 2024-04-25T17:19:29.733 INFO:tasks.workunit.client.1.smithi069.stdout:3/940: rmdir d8/d16/d4b/d9e/deb/d123 39 2024-04-25T17:19:29.736 INFO:tasks.workunit.client.0.smithi037.stdout:7/844: rename d5/d14/d31/fe7 to d5/d15/d17/d1b/da2/daf/dc8/f117 0 2024-04-25T17:19:29.737 INFO:tasks.workunit.client.1.smithi069.stdout:2/893: dread d0/d56/d5f/d62/d7d/d72/fcf [4194304,4194304] 0 2024-04-25T17:19:29.741 INFO:tasks.workunit.client.0.smithi037.stdout:1/987: rename dc/d52/d6b/dd9/d4d/d6a/d86/d91/f93 to dc/d52/d6b/dd9/d22/d36/d74/daf/f152 0 2024-04-25T17:19:29.742 INFO:tasks.workunit.client.0.smithi037.stdout:7/845: dwrite d5/d15/d17/f65 [4194304,4194304] 0 2024-04-25T17:19:29.744 INFO:tasks.workunit.client.1.smithi069.stdout:1/885: fdatasync d1/d4/d6/d9e/da6/d7c/d4d/f57 0 2024-04-25T17:19:29.747 INFO:tasks.workunit.client.1.smithi069.stdout:7/915: unlink d4/d1a/f102 0 2024-04-25T17:19:29.748 INFO:tasks.workunit.client.0.smithi037.stdout:7/846: fdatasync d5/d15/dd8/f85 0 2024-04-25T17:19:29.750 INFO:tasks.workunit.client.1.smithi069.stdout:6/902: getdents d2/d1e/d43/da6 0 2024-04-25T17:19:29.753 INFO:tasks.workunit.client.1.smithi069.stdout:8/929: rename d37/d47/l69 to d37/d47/d54/dcc/l13f 0 2024-04-25T17:19:29.757 INFO:tasks.workunit.client.0.smithi037.stdout:7/847: creat d5/d15/d17/d1b/d94/f118 x:0 0 0 2024-04-25T17:19:29.758 INFO:tasks.workunit.client.1.smithi069.stdout:3/941: fdatasync d8/d16/d1a/fb7 0 2024-04-25T17:19:29.760 INFO:tasks.workunit.client.0.smithi037.stdout:7/848: mknod d5/d15/dd8/db5/c119 0 2024-04-25T17:19:29.766 INFO:tasks.workunit.client.1.smithi069.stdout:8/930: readlink d37/l44 0 2024-04-25T17:19:29.769 INFO:tasks.workunit.client.0.smithi037.stdout:7/849: getdents d5/dc1 0 2024-04-25T17:19:29.770 INFO:tasks.workunit.client.1.smithi069.stdout:2/894: symlink d0/d56/d5f/d62/d111/l128 0 2024-04-25T17:19:29.771 INFO:tasks.workunit.client.0.smithi037.stdout:7/850: fdatasync d5/d14/d31/fb4 0 2024-04-25T17:19:29.772 INFO:tasks.workunit.client.1.smithi069.stdout:1/886: dwrite d1/d43/f18 [0,4194304] 0 2024-04-25T17:19:29.775 INFO:tasks.workunit.client.1.smithi069.stdout:8/931: truncate d37/d47/d54/f68 1285471 0 2024-04-25T17:19:29.775 INFO:tasks.workunit.client.1.smithi069.stdout:4/902: getdents db/d4b/d78/d79/dca 0 2024-04-25T17:19:29.776 INFO:tasks.workunit.client.0.smithi037.stdout:7/851: dread d5/d15/d17/d25/d2b/f52 [0,4194304] 0 2024-04-25T17:19:29.777 INFO:tasks.workunit.client.1.smithi069.stdout:8/932: chown d37/d47/d78/db3/d114/d6b/f96 75 1 2024-04-25T17:19:29.779 INFO:tasks.workunit.client.1.smithi069.stdout:3/942: dread d8/d16/d1a/d2c/f4e [0,4194304] 0 2024-04-25T17:19:29.782 INFO:tasks.workunit.client.0.smithi037.stdout:7/852: mknod d5/d15/d17/d25/d2b/d59/c11a 0 2024-04-25T17:19:29.783 INFO:tasks.workunit.client.0.smithi037.stdout:7/853: chown d5/d15/d17/d1b/da2/daf/l36 705050041 1 2024-04-25T17:19:29.783 INFO:tasks.workunit.client.1.smithi069.stdout:9/860: getdents d2/da/dd/de 0 2024-04-25T17:19:29.784 INFO:tasks.workunit.client.1.smithi069.stdout:3/943: dwrite d8/d16/d1a/d2c/d49/f68 [0,4194304] 0 2024-04-25T17:19:29.785 INFO:tasks.workunit.client.1.smithi069.stdout:3/944: fdatasync d8/d16/d1a/d2c/d49/dbc/f12e 0 2024-04-25T17:19:29.786 INFO:tasks.workunit.client.1.smithi069.stdout:5/940: rename d13/d17/d29/d30/d5c/l4d to d13/dff/l143 0 2024-04-25T17:19:29.787 INFO:tasks.workunit.client.1.smithi069.stdout:3/945: write d8/d2a/f82 [1029053,22101] 0 2024-04-25T17:19:29.792 INFO:tasks.workunit.client.1.smithi069.stdout:1/887: write d1/d4/d6/d9e/fa2 [502513,98767] 0 2024-04-25T17:19:29.794 INFO:tasks.workunit.client.1.smithi069.stdout:4/903: creat db/d15/d20/d35/d63/d70/d8a/d96/f141 x:0 0 0 2024-04-25T17:19:29.794 INFO:tasks.workunit.client.1.smithi069.stdout:5/941: dwrite d13/d17/d29/f2b [0,4194304] 0 2024-04-25T17:19:29.796 INFO:tasks.workunit.client.0.smithi037.stdout:7/854: dread d5/d15/d17/d25/d2b/d48/f72 [0,4194304] 0 2024-04-25T17:19:29.797 INFO:tasks.workunit.client.1.smithi069.stdout:2/895: truncate d0/f53 452133 0 2024-04-25T17:19:29.798 INFO:tasks.workunit.client.1.smithi069.stdout:2/896: chown d0/d1/d5b/cc3 71 1 2024-04-25T17:19:29.800 INFO:tasks.workunit.client.1.smithi069.stdout:8/933: write d37/d47/d78/db3/d114/fa3 [4464634,81199] 0 2024-04-25T17:19:29.802 INFO:tasks.workunit.client.1.smithi069.stdout:9/861: creat d2/d51/f126 x:0 0 0 2024-04-25T17:19:29.803 INFO:tasks.workunit.client.0.smithi037.stdout:7/855: creat d5/d15/d17/d25/d2b/d59/df7/f11b x:0 0 0 2024-04-25T17:19:29.806 INFO:tasks.workunit.client.1.smithi069.stdout:0/830: rename d0/da/db/d2a/d9b to d0/da/db/def/d11f 0 2024-04-25T17:19:29.812 INFO:tasks.workunit.client.1.smithi069.stdout:5/942: mknod d13/d17/d19/d20/d51/c144 0 2024-04-25T17:19:29.813 INFO:tasks.workunit.client.1.smithi069.stdout:4/904: mkdir db/d15/d20/d35/d63/d75/d142 0 2024-04-25T17:19:29.817 INFO:tasks.workunit.client.1.smithi069.stdout:9/862: read - d2/da4/dcf/d65/dc4/ff6 zero size 2024-04-25T17:19:29.817 INFO:tasks.workunit.client.1.smithi069.stdout:5/943: dread d13/d17/d29/d2e/fc4 [0,4194304] 0 2024-04-25T17:19:29.818 INFO:tasks.workunit.client.0.smithi037.stdout:7/856: truncate d5/d15/d17/d25/d2b/f35 3360004 0 2024-04-25T17:19:29.819 INFO:tasks.workunit.client.1.smithi069.stdout:4/905: dwrite db/d15/f114 [0,4194304] 0 2024-04-25T17:19:29.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:29 smithi037 ceph-mon[26472]: from='client.14758 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:19:29.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:29 smithi037 ceph-mon[26472]: pgmap v45: 65 pgs: 65 active+clean; 3.6 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 76 MiB/s rd, 172 MiB/s wr, 403 op/s 2024-04-25T17:19:29.822 INFO:tasks.workunit.client.1.smithi069.stdout:7/916: rename d4/d3e/d94/da1/dc7/d14/d44/d88/lf8 to d4/d3e/d94/da1/dc7/d14/d3d/d47/l137 0 2024-04-25T17:19:29.823 INFO:tasks.workunit.client.0.smithi037.stdout:7/857: write d5/d15/dd8/db5/f111 [2298229,215] 0 2024-04-25T17:19:29.824 INFO:tasks.workunit.client.1.smithi069.stdout:7/917: truncate d4/f12e 603640 0 2024-04-25T17:19:29.824 INFO:tasks.workunit.client.1.smithi069.stdout:0/831: mkdir d0/da/d59/dab/d120 0 2024-04-25T17:19:29.825 INFO:tasks.workunit.client.1.smithi069.stdout:8/934: write d37/d47/d54/fca [141322,71742] 0 2024-04-25T17:19:29.826 INFO:tasks.workunit.client.1.smithi069.stdout:1/888: creat d1/d4/d6/d9e/da6/df0/f117 x:0 0 0 2024-04-25T17:19:29.827 INFO:tasks.workunit.client.1.smithi069.stdout:5/944: dwrite d13/d17/d29/d30/d9c/f12e [0,4194304] 0 2024-04-25T17:19:29.828 INFO:tasks.workunit.client.1.smithi069.stdout:8/935: readlink d37/d47/d78/db3/d114/lb7 0 2024-04-25T17:19:29.828 INFO:tasks.workunit.client.1.smithi069.stdout:7/918: readlink d4/d3e/d94/da1/dc7/d14/d3d/df6/l120 0 2024-04-25T17:19:29.832 INFO:tasks.workunit.client.1.smithi069.stdout:9/863: chown d2/da/dd/cab 166907 1 2024-04-25T17:19:29.835 INFO:tasks.workunit.client.1.smithi069.stdout:4/906: dread db/d4b/d78/dc4/f31 [0,4194304] 0 2024-04-25T17:19:29.906 INFO:tasks.workunit.client.1.smithi069.stdout:3/946: truncate d8/d71/f110 558967 0 2024-04-25T17:19:29.910 INFO:tasks.workunit.client.1.smithi069.stdout:6/903: sync 2024-04-25T17:19:29.926 INFO:tasks.workunit.client.0.smithi037.stdout:6/902: sync 2024-04-25T17:19:29.927 INFO:tasks.workunit.client.0.smithi037.stdout:5/904: sync 2024-04-25T17:19:29.981 INFO:tasks.workunit.client.1.smithi069.stdout:2/897: write d0/d1/d5b/d33/f51 [2896506,10911] 0 2024-04-25T17:19:29.982 INFO:tasks.workunit.client.1.smithi069.stdout:2/898: write d0/d26/d10/d43/f7a [3302109,11490] 0 2024-04-25T17:19:29.983 INFO:tasks.workunit.client.1.smithi069.stdout:2/899: read - d0/d26/d36/dc5/f118 zero size 2024-04-25T17:19:29.985 INFO:tasks.workunit.client.1.smithi069.stdout:5/945: creat d13/d17/d19/d20/d2d/d93/f145 x:0 0 0 2024-04-25T17:19:29.991 INFO:tasks.workunit.client.0.smithi037.stdout:8/795: sync 2024-04-25T17:19:29.991 INFO:tasks.workunit.client.0.smithi037.stdout:0/962: sync 2024-04-25T17:19:29.993 INFO:tasks.workunit.client.0.smithi037.stdout:0/963: write d9/df/dbd/de9/f114 [879391,93926] 0 2024-04-25T17:19:29.996 INFO:tasks.workunit.client.1.smithi069.stdout:9/864: creat d2/da/d5f/dd3/f127 x:0 0 0 2024-04-25T17:19:30.042 INFO:tasks.workunit.client.0.smithi037.stdout:3/744: sync 2024-04-25T17:19:30.042 INFO:tasks.workunit.client.0.smithi037.stdout:1/988: sync 2024-04-25T17:19:30.094 INFO:tasks.workunit.client.0.smithi037.stdout:7/858: creat d5/d15/d17/d25/d2b/d59/dfe/d10e/f11c x:0 0 0 2024-04-25T17:19:30.094 INFO:tasks.workunit.client.0.smithi037.stdout:7/859: chown d5/d15/d17/d25/d2b/d59 222 1 2024-04-25T17:19:30.096 INFO:tasks.workunit.client.0.smithi037.stdout:5/905: chown d7/d18/d62/f6b 427522 1 2024-04-25T17:19:30.097 INFO:tasks.workunit.client.0.smithi037.stdout:7/860: dread d5/d15/d17/d1b/da2/daf/f3d [4194304,4194304] 0 2024-04-25T17:19:30.103 INFO:tasks.workunit.client.0.smithi037.stdout:6/903: rename db/d26 to db/d147/d25/db0/d14b 0 2024-04-25T17:19:30.111 INFO:tasks.workunit.client.0.smithi037.stdout:8/796: creat d5/db/d23/d78/d9c/ded/f103 x:0 0 0 2024-04-25T17:19:30.113 INFO:tasks.workunit.client.0.smithi037.stdout:5/906: dread d7/d18/f29 [0,4194304] 0 2024-04-25T17:19:30.116 INFO:tasks.workunit.client.0.smithi037.stdout:0/964: symlink d9/df/df7/l138 0 2024-04-25T17:19:30.120 INFO:tasks.workunit.client.0.smithi037.stdout:3/745: mknod d8/d31/d32/dd7/ced 0 2024-04-25T17:19:30.124 INFO:tasks.workunit.client.0.smithi037.stdout:7/861: mknod d5/d15/d17/d25/d2b/d59/df7/c11d 0 2024-04-25T17:19:30.132 INFO:tasks.workunit.client.0.smithi037.stdout:8/797: dread d5/db/d59/f6c [0,4194304] 0 2024-04-25T17:19:30.141 INFO:tasks.workunit.client.0.smithi037.stdout:3/746: creat d8/d23/dc0/fee x:0 0 0 2024-04-25T17:19:30.144 INFO:tasks.workunit.client.0.smithi037.stdout:1/989: symlink dc/d52/d6b/dd9/d4d/d6a/d86/d9b/l153 0 2024-04-25T17:19:30.162 INFO:tasks.workunit.client.0.smithi037.stdout:0/965: rename d9/df/d32/dd1/d7a/daf/db1 to d9/d14/d28/d48/da9/ddc/d139 0 2024-04-25T17:19:30.165 INFO:tasks.workunit.client.0.smithi037.stdout:3/747: creat d8/d31/d8d/db7/fef x:0 0 0 2024-04-25T17:19:30.168 INFO:tasks.workunit.client.1.smithi069.stdout:2/900: dread - d0/d56/d94/fb8 zero size 2024-04-25T17:19:30.171 INFO:tasks.workunit.client.0.smithi037.stdout:1/990: rmdir dc/d18/d64/d133/d13a 39 2024-04-25T17:19:30.174 INFO:tasks.workunit.client.1.smithi069.stdout:5/946: creat d13/d17/d29/dde/f146 x:0 0 0 2024-04-25T17:19:30.175 INFO:tasks.workunit.client.1.smithi069.stdout:9/865: truncate d2/f24 1759773 0 2024-04-25T17:19:30.178 INFO:tasks.workunit.client.0.smithi037.stdout:6/904: rmdir db/d1d/d20/d2f/dd2 0 2024-04-25T17:19:30.181 INFO:tasks.workunit.client.1.smithi069.stdout:4/907: mknod db/db0/d134/c143 0 2024-04-25T17:19:30.183 INFO:tasks.workunit.client.0.smithi037.stdout:8/798: creat d5/db/d18/d3b/d50/df6/f104 x:0 0 0 2024-04-25T17:19:30.191 INFO:tasks.workunit.client.1.smithi069.stdout:6/904: mknod d2/d1e/c137 0 2024-04-25T17:19:30.194 INFO:tasks.workunit.client.0.smithi037.stdout:3/748: creat d8/d23/dbb/d81/dc3/ff0 x:0 0 0 2024-04-25T17:19:30.196 INFO:tasks.workunit.client.0.smithi037.stdout:0/966: dread d9/d14/d23/f1e [0,4194304] 0 2024-04-25T17:19:30.197 INFO:tasks.workunit.client.0.smithi037.stdout:0/967: chown d9/df/d32/dd1/d7a/da4/ddb 293312496 1 2024-04-25T17:19:30.200 INFO:tasks.workunit.client.0.smithi037.stdout:6/905: rmdir db/d1d/db1/dc7 39 2024-04-25T17:19:30.201 INFO:tasks.workunit.client.0.smithi037.stdout:6/906: chown db/d1d/d20/d2f 1542075 1 2024-04-25T17:19:30.202 INFO:tasks.workunit.client.0.smithi037.stdout:6/907: chown db/d1d/d20/dcf/dfa/d65/d68/f149 5791 1 2024-04-25T17:19:30.203 INFO:tasks.workunit.client.0.smithi037.stdout:6/908: chown db/d1d/d20/d2f/f100 769961 1 2024-04-25T17:19:30.204 INFO:tasks.workunit.client.0.smithi037.stdout:8/799: rmdir d5/da 39 2024-04-25T17:19:30.207 INFO:tasks.workunit.client.1.smithi069.stdout:5/947: mknod d13/d17/d19/d8a/dbc/c147 0 2024-04-25T17:19:30.220 INFO:tasks.workunit.client.0.smithi037.stdout:6/909: fdatasync db/d1d/f79 0 2024-04-25T17:19:30.222 INFO:tasks.workunit.client.1.smithi069.stdout:6/905: mkdir d2/d1e/d43/dca/d138 0 2024-04-25T17:19:30.225 INFO:tasks.workunit.client.1.smithi069.stdout:2/901: mkdir d0/d26/d10/d127/dc2/d129 0 2024-04-25T17:19:30.226 INFO:tasks.workunit.client.0.smithi037.stdout:3/749: symlink d8/lf1 0 2024-04-25T17:19:30.228 INFO:tasks.workunit.client.0.smithi037.stdout:3/750: chown d8/d23/dbb/d63/l7f 47787 1 2024-04-25T17:19:30.228 INFO:tasks.workunit.client.1.smithi069.stdout:5/948: creat d13/d17/d19/d1c/da4/da9/daa/f148 x:0 0 0 2024-04-25T17:19:30.229 INFO:tasks.workunit.client.0.smithi037.stdout:1/991: link dc/d52/fb2 dc/d52/d6b/dd9/d149/f154 0 2024-04-25T17:19:30.230 INFO:tasks.workunit.client.1.smithi069.stdout:9/866: dread d2/da/dd/d1e/d40/f91 [0,4194304] 0 2024-04-25T17:19:30.233 INFO:tasks.workunit.client.1.smithi069.stdout:2/902: truncate d0/d26/d10/d43/fa1 923281 0 2024-04-25T17:19:30.234 INFO:tasks.workunit.client.1.smithi069.stdout:2/903: truncate d0/d56/d5f/d62/d7d/d31/f81 4919127 0 2024-04-25T17:19:30.235 INFO:tasks.workunit.client.1.smithi069.stdout:5/949: fdatasync d13/d17/d19/d1c/da4/fd5 0 2024-04-25T17:19:30.237 INFO:tasks.workunit.client.1.smithi069.stdout:4/908: getdents db/d15/d82/df4/dfc 0 2024-04-25T17:19:30.240 INFO:tasks.workunit.client.1.smithi069.stdout:9/867: mkdir d2/da/dd/d1e/d2e/d68/dba/ded/d128 0 2024-04-25T17:19:30.240 INFO:tasks.workunit.client.1.smithi069.stdout:9/868: chown d2/da/dd/de/d59 0 1 2024-04-25T17:19:30.242 INFO:tasks.workunit.client.0.smithi037.stdout:3/751: creat d8/dd8/ff2 x:0 0 0 2024-04-25T17:19:30.245 INFO:tasks.workunit.client.0.smithi037.stdout:1/992: chown dc/d52/d6b/dd9/d4d/d6a/dea/cce 44164242 1 2024-04-25T17:19:30.249 INFO:tasks.workunit.client.1.smithi069.stdout:5/950: rmdir d13/d17/d19/d1c/da4 39 2024-04-25T17:19:30.250 INFO:tasks.workunit.client.0.smithi037.stdout:3/752: creat d8/d31/d32/d87/ff3 x:0 0 0 2024-04-25T17:19:30.254 INFO:tasks.workunit.client.0.smithi037.stdout:1/993: write dc/d24/da5/df9/f10a [673370,125883] 0 2024-04-25T17:19:30.257 INFO:tasks.workunit.client.0.smithi037.stdout:3/753: truncate d8/d31/d32/d87/f89 884592 0 2024-04-25T17:19:30.258 INFO:tasks.workunit.client.0.smithi037.stdout:3/754: stat d8/d31/d32 0 2024-04-25T17:19:30.261 INFO:tasks.workunit.client.0.smithi037.stdout:1/994: dwrite dc/d24/da5/fda [4194304,4194304] 0 2024-04-25T17:19:30.262 INFO:tasks.workunit.client.1.smithi069.stdout:9/869: creat d2/da/dd/de/d64/dd2/f129 x:0 0 0 2024-04-25T17:19:30.283 INFO:tasks.workunit.client.1.smithi069.stdout:1/889: dwrite d1/df/d17/f2f [0,4194304] 0 2024-04-25T17:19:30.283 INFO:tasks.workunit.client.1.smithi069.stdout:1/890: stat d1/df/f33 0 2024-04-25T17:19:30.287 INFO:tasks.workunit.client.1.smithi069.stdout:7/919: dwrite d4/d4c/fb6 [0,4194304] 0 2024-04-25T17:19:30.302 INFO:tasks.workunit.client.1.smithi069.stdout:7/920: dread d4/d3e/d94/fd0 [0,4194304] 0 2024-04-25T17:19:30.309 INFO:tasks.workunit.client.1.smithi069.stdout:7/921: unlink d4/d3e/f9b 0 2024-04-25T17:19:30.314 INFO:tasks.workunit.client.1.smithi069.stdout:7/922: read d4/d3e/d94/da1/dc7/d14/d44/d7c/d9f/dcb/f6b [415259,67632] 0 2024-04-25T17:19:30.318 INFO:tasks.workunit.client.1.smithi069.stdout:7/923: dread d4/d3e/d94/da1/dc7/d14/d3d/df6/f66 [0,4194304] 0 2024-04-25T17:19:30.318 INFO:tasks.workunit.client.1.smithi069.stdout:6/906: sync 2024-04-25T17:19:30.348 INFO:tasks.workunit.client.1.smithi069.stdout:8/936: rmdir d37/d47/d78/db3/d114/d10a 39 2024-04-25T17:19:30.349 INFO:tasks.workunit.client.1.smithi069.stdout:8/937: mkdir d37/d47/d78/db3/d114/d6b/d140 0 2024-04-25T17:19:30.351 INFO:tasks.workunit.client.1.smithi069.stdout:8/938: creat d37/d47/d54/d6e/d98/f141 x:0 0 0 2024-04-25T17:19:30.361 INFO:tasks.workunit.client.1.smithi069.stdout:0/832: write d0/d17/d95/fd8 [1928947,38679] 0 2024-04-25T17:19:30.364 INFO:tasks.workunit.client.0.smithi037.stdout:5/907: dwrite d7/f57 [0,4194304] 0 2024-04-25T17:19:30.367 INFO:tasks.workunit.client.0.smithi037.stdout:7/862: dwrite d5/d15/dd8/f86 [0,4194304] 0 2024-04-25T17:19:30.373 INFO:tasks.workunit.client.0.smithi037.stdout:5/908: mkdir d7/da1/dda/ddc/d113 0 2024-04-25T17:19:30.374 INFO:tasks.workunit.client.0.smithi037.stdout:7/863: mknod d5/d14/d31/c11e 0 2024-04-25T17:19:30.387 INFO:tasks.workunit.client.1.smithi069.stdout:3/947: dwrite d8/d71/d8d/d92/db6/dc1/f6f [0,4194304] 0 2024-04-25T17:19:30.388 INFO:tasks.workunit.client.1.smithi069.stdout:3/948: chown d8/d39/la4 1 1 2024-04-25T17:19:30.397 INFO:tasks.workunit.client.0.smithi037.stdout:0/968: dwrite d9/d14/d28/ff4 [0,4194304] 0 2024-04-25T17:19:30.400 INFO:tasks.workunit.client.0.smithi037.stdout:8/800: dwrite d5/db/d59/f88 [0,4194304] 0 2024-04-25T17:19:30.405 INFO:tasks.workunit.client.0.smithi037.stdout:8/801: mknod d5/db/d18/d3b/d50/da0/da6/da8/c105 0 2024-04-25T17:19:30.413 INFO:tasks.workunit.client.1.smithi069.stdout:2/904: dwrite d0/f44 [0,4194304] 0 2024-04-25T17:19:30.414 INFO:tasks.workunit.client.0.smithi037.stdout:6/910: dwrite db/d1d/d20/f21 [0,4194304] 0 2024-04-25T17:19:30.415 INFO:tasks.workunit.client.1.smithi069.stdout:5/951: truncate d13/d17/d19/f27 2869312 0 2024-04-25T17:19:30.418 INFO:tasks.workunit.client.1.smithi069.stdout:4/909: dwrite db/d15/d42/f5f [0,4194304] 0 2024-04-25T17:19:30.421 INFO:tasks.workunit.client.1.smithi069.stdout:9/870: write d2/da/d14/f18 [1034340,15219] 0 2024-04-25T17:19:30.423 INFO:tasks.workunit.client.0.smithi037.stdout:1/995: dwrite dc/d1c/f101 [0,4194304] 0 2024-04-25T17:19:30.423 INFO:tasks.workunit.client.1.smithi069.stdout:2/905: creat d0/d26/df3/f12a x:0 0 0 2024-04-25T17:19:30.425 INFO:tasks.workunit.client.0.smithi037.stdout:1/996: dread - dc/d52/d6b/dd9/d22/d36/d92/db8/dbc/f131 zero size 2024-04-25T17:19:30.432 INFO:tasks.workunit.client.0.smithi037.stdout:1/997: dread dc/d52/d6b/dd9/d4d/d6a/dea/f90 [0,4194304] 0 2024-04-25T17:19:30.433 INFO:tasks.workunit.client.1.smithi069.stdout:3/949: creat d8/f13c x:0 0 0 2024-04-25T17:19:30.435 INFO:tasks.workunit.client.1.smithi069.stdout:2/906: mknod d0/d26/d10/db5/de3/c12b 0 2024-04-25T17:19:30.439 INFO:tasks.workunit.client.1.smithi069.stdout:1/891: truncate d1/d4/d6/d9e/da6/fe2 1780076 0 2024-04-25T17:19:30.440 INFO:tasks.workunit.client.1.smithi069.stdout:3/950: fsync d8/d71/d8d/f8f 0 2024-04-25T17:19:30.442 INFO:tasks.workunit.client.1.smithi069.stdout:2/907: unlink d0/f92 0 2024-04-25T17:19:30.445 INFO:tasks.workunit.client.0.smithi037.stdout:8/802: dread d5/d6a/f3f [0,4194304] 0 2024-04-25T17:19:30.446 INFO:tasks.workunit.client.0.smithi037.stdout:8/803: chown d5/db/d7e/f76 3297 1 2024-04-25T17:19:30.446 INFO:tasks.workunit.client.1.smithi069.stdout:1/892: creat d1/d4/d6/d9e/f118 x:0 0 0 2024-04-25T17:19:30.452 INFO:tasks.workunit.client.0.smithi037.stdout:6/911: dread db/d147/f6f [0,4194304] 0 2024-04-25T17:19:30.452 INFO:tasks.workunit.client.1.smithi069.stdout:3/951: creat d8/d16/d1a/d2c/d49/d59/dff/d107/d10d/f13d x:0 0 0 2024-04-25T17:19:30.452 INFO:tasks.workunit.client.1.smithi069.stdout:1/893: dwrite d1/d43/d1b/d32/d4a/fb7 [0,4194304] 0 2024-04-25T17:19:30.452 INFO:tasks.workunit.client.1.smithi069.stdout:1/894: chown d1/d4 3 1 2024-04-25T17:19:30.453 INFO:tasks.workunit.client.0.smithi037.stdout:8/804: rmdir d5/db/d23/d78/d93 39 2024-04-25T17:19:30.456 INFO:tasks.workunit.client.1.smithi069.stdout:9/871: dread d2/da/dd/d1e/d2e/d35/f7a [0,4194304] 0 2024-04-25T17:19:30.456 INFO:tasks.workunit.client.1.smithi069.stdout:2/908: rmdir d0/d56/d5f/d62/d7d/d31/df8/d10e 39 2024-04-25T17:19:30.459 INFO:tasks.workunit.client.0.smithi037.stdout:6/912: creat db/d1d/dcc/f14c x:0 0 0 2024-04-25T17:19:30.459 INFO:tasks.workunit.client.1.smithi069.stdout:5/952: getdents d13/dff 0 2024-04-25T17:19:30.462 INFO:tasks.workunit.client.1.smithi069.stdout:3/952: readlink d8/d16/d1a/l29 0 2024-04-25T17:19:30.462 INFO:tasks.workunit.client.1.smithi069.stdout:7/924: truncate d4/d3e/d94/da1/dc7/d14/d3d/f69 3365273 0 2024-04-25T17:19:30.463 INFO:tasks.workunit.client.0.smithi037.stdout:8/805: mkdir d5/db/d18/d3b/d106 0 2024-04-25T17:19:30.466 INFO:tasks.workunit.client.1.smithi069.stdout:1/895: rename d1/d43/d1b/d32/f7f to d1/d4/d6/d9e/da6/d7c/d1d/de1/d8e/dbb/f119 0 2024-04-25T17:19:30.467 INFO:tasks.workunit.client.1.smithi069.stdout:5/953: dwrite d13/d17/d19/d8a/f9e [4194304,4194304] 0 2024-04-25T17:19:30.468 INFO:tasks.workunit.client.1.smithi069.stdout:6/907: dwrite d2/d1e/d43/d7d/f8a [0,4194304] 0 2024-04-25T17:19:30.468 INFO:tasks.workunit.client.1.smithi069.stdout:5/954: stat d13/f60 0 2024-04-25T17:19:30.469 INFO:tasks.workunit.client.0.smithi037.stdout:8/806: rename d5/db/d18/d3b/l4c to d5/db/d18/d3b/d50/da0/da6/dd9/l107 0 2024-04-25T17:19:30.470 INFO:tasks.workunit.client.0.smithi037.stdout:6/913: getdents db/d1d/d20/dcf/dfa/d65/d68/d101 0 2024-04-25T17:19:30.471 INFO:tasks.workunit.client.1.smithi069.stdout:8/939: write d37/d47/d48/d8e/fac [949496,24597] 0 2024-04-25T17:19:30.473 INFO:tasks.workunit.client.1.smithi069.stdout:8/940: dread - d37/d47/d78/db3/d114/ffb zero size 2024-04-25T17:19:30.476 INFO:tasks.workunit.client.0.smithi037.stdout:8/807: chown d5/da/lef 427 1 2024-04-25T17:19:30.477 INFO:tasks.workunit.client.0.smithi037.stdout:8/808: stat d5/db/d18/d3b/d106 0 2024-04-25T17:19:30.477 INFO:tasks.workunit.client.1.smithi069.stdout:7/925: creat d4/d3e/d94/f138 x:0 0 0 2024-04-25T17:19:30.479 INFO:tasks.workunit.client.1.smithi069.stdout:0/833: dwrite d0/da/d24/d67/fbb [0,4194304] 0 2024-04-25T17:19:30.481 INFO:tasks.workunit.client.0.smithi037.stdout:5/909: write d7/d12/d5d/d90/db1/fce [6466843,125599] 0 2024-04-25T17:19:30.485 INFO:tasks.workunit.client.0.smithi037.stdout:8/809: creat d5/d26/f108 x:0 0 0 2024-04-25T17:19:30.487 INFO:tasks.workunit.client.1.smithi069.stdout:1/896: readlink d1/d4/de/d44/d68/lbd 0 2024-04-25T17:19:30.487 INFO:tasks.workunit.client.0.smithi037.stdout:0/969: write d9/df/d32/d56/d106/f110 [49736,65431] 0 2024-04-25T17:19:30.491 INFO:tasks.workunit.client.0.smithi037.stdout:7/864: dwrite d5/d14/d31/fa1 [0,4194304] 0 2024-04-25T17:19:30.492 INFO:tasks.workunit.client.0.smithi037.stdout:7/865: readlink d5/d15/d17/la4 0 2024-04-25T17:19:30.494 INFO:tasks.workunit.client.0.smithi037.stdout:7/866: write d5/d14/d31/f114 [600487,91954] 0 2024-04-25T17:19:30.495 INFO:tasks.workunit.client.1.smithi069.stdout:2/909: mkdir d0/d26/d10/d127/dc2/d12c 0 2024-04-25T17:19:30.495 INFO:tasks.workunit.client.1.smithi069.stdout:2/910: chown d0/d26/lab 392968440 1 2024-04-25T17:19:30.496 INFO:tasks.workunit.client.1.smithi069.stdout:3/953: dread d8/d16/d1a/d38/f88 [0,4194304] 0 2024-04-25T17:19:30.498 INFO:tasks.workunit.client.0.smithi037.stdout:8/810: mkdir d5/db/d18/d3b/d50/da0/d109 0 2024-04-25T17:19:30.500 INFO:tasks.workunit.client.1.smithi069.stdout:6/908: mkdir d2/d1e/d3f/d86/da8/d139 0 2024-04-25T17:19:30.504 INFO:tasks.workunit.client.0.smithi037.stdout:0/970: read - d9/df/df7/f11f zero size 2024-04-25T17:19:30.507 INFO:tasks.workunit.client.1.smithi069.stdout:1/897: dread d1/d4/d6/f31 [0,4194304] 0 2024-04-25T17:19:30.509 INFO:tasks.workunit.client.1.smithi069.stdout:4/910: dwrite db/d15/d20/d35/f66 [4194304,4194304] 0 2024-04-25T17:19:30.510 INFO:tasks.workunit.client.1.smithi069.stdout:1/898: dread d1/d4/de/f99 [0,4194304] 0 2024-04-25T17:19:30.512 INFO:tasks.workunit.client.1.smithi069.stdout:7/926: dread - d4/d3e/d94/da1/dc7/d14/d44/d88/f104 zero size 2024-04-25T17:19:30.513 INFO:tasks.workunit.client.0.smithi037.stdout:1/998: dwrite dc/d18/d64/f11e [0,4194304] 0 2024-04-25T17:19:30.517 INFO:tasks.workunit.client.1.smithi069.stdout:4/911: dwrite db/d15/d20/d35/d63/d70/d8a/d96/dbf/d103/f108 [0,4194304] 0 2024-04-25T17:19:30.526 INFO:tasks.workunit.client.1.smithi069.stdout:2/911: mkdir d0/d56/d94/d12d 0 2024-04-25T17:19:30.532 INFO:tasks.workunit.client.0.smithi037.stdout:1/999: fsync dc/d18/d64/f68 0 2024-04-25T17:19:30.536 INFO:tasks.workunit.client.1.smithi069.stdout:1/899: dread d1/d4/de/fdb [0,4194304] 0 2024-04-25T17:19:30.537 INFO:tasks.workunit.client.1.smithi069.stdout:8/941: link d37/d62/f13a d37/d47/d78/db3/d114/d6b/daf/de6/f142 0 2024-04-25T17:19:30.538 INFO:tasks.workunit.client.0.smithi037.stdout:6/914: write db/d147/d25/db0/d14b/d2e/f39 [2197935,53212] 0 2024-04-25T17:19:30.541 INFO:tasks.workunit.client.0.smithi037.stdout:5/910: write d7/d12/d5d/d90/def/ffc [279401,17809] 0 2024-04-25T17:19:30.544 INFO:tasks.workunit.client.1.smithi069.stdout:2/912: dread d0/d26/f2b [0,4194304] 0 2024-04-25T17:19:30.545 INFO:tasks.workunit.client.0.smithi037.stdout:0/971: link d9/ld d9/df/d32/d56/l13a 0 2024-04-25T17:19:30.547 INFO:tasks.workunit.client.0.smithi037.stdout:6/915: dwrite db/d147/d25/db0/d14b/f142 [4194304,4194304] 0 2024-04-25T17:19:30.551 INFO:tasks.workunit.client.1.smithi069.stdout:7/927: creat d4/d3e/d94/da1/dc7/d14/d15/f139 x:0 0 0 2024-04-25T17:19:30.553 INFO:tasks.workunit.client.1.smithi069.stdout:7/928: write d4/d3e/d94/da1/dc7/d14/d5a/d5e/d89/f118 [613487,36328] 0 2024-04-25T17:19:30.557 INFO:tasks.workunit.client.0.smithi037.stdout:7/867: write d5/d15/d17/d1b/fcd [1163069,49985] 0 2024-04-25T17:19:30.559 INFO:tasks.workunit.client.0.smithi037.stdout:6/916: symlink db/d147/d25/db0/d14b/d139/d13f/l14d 0 2024-04-25T17:19:30.566 INFO:tasks.workunit.client.0.smithi037.stdout:7/868: unlink d5/d15/d17/d1b/da2/daf/f5f 0 2024-04-25T17:19:30.567 INFO:tasks.workunit.client.1.smithi069.stdout:3/954: truncate d8/d2a/f55 705321 0 2024-04-25T17:19:30.567 INFO:tasks.workunit.client.0.smithi037.stdout:8/811: dwrite d5/db/d18/d3b/fe2 [0,4194304] 0 2024-04-25T17:19:30.571 INFO:tasks.workunit.client.0.smithi037.stdout:0/972: link d9/df/d32/d39/d68/lbf d9/d71/l13b 0 2024-04-25T17:19:30.573 INFO:tasks.workunit.client.1.smithi069.stdout:5/955: link d13/d17/d19/d20/c34 d13/d17/d19/d20/d2d/d135/c149 0 2024-04-25T17:19:30.574 INFO:tasks.workunit.client.1.smithi069.stdout:5/956: read d13/f1a [7284288,114557] 0 2024-04-25T17:19:30.578 INFO:tasks.workunit.client.0.smithi037.stdout:7/869: mkdir d5/d15/d17/d25/d2b/d59/dfe/d10e/d11f 0 2024-04-25T17:19:30.580 INFO:tasks.workunit.client.1.smithi069.stdout:2/913: creat d0/d56/d94/f12e x:0 0 0 2024-04-25T17:19:30.581 INFO:tasks.workunit.client.0.smithi037.stdout:6/917: symlink db/d147/d25/l14e 0 2024-04-25T17:19:30.582 INFO:tasks.workunit.client.1.smithi069.stdout:4/912: write db/d15/d20/d35/d63/d43/d48/d49/f5a [989032,99248] 0 2024-04-25T17:19:30.583 INFO:tasks.workunit.client.1.smithi069.stdout:0/834: truncate d0/da/db/d3a/f4c 1048604 0 2024-04-25T17:19:30.584 INFO:tasks.workunit.client.1.smithi069.stdout:0/835: chown d0/da/db/d2c 795 1 2024-04-25T17:19:30.584 INFO:tasks.workunit.client.1.smithi069.stdout:0/836: readlink d0/da/db/ld 0 2024-04-25T17:19:30.587 INFO:tasks.workunit.client.1.smithi069.stdout:7/929: creat d4/d83/da2/ded/f13a x:0 0 0 2024-04-25T17:19:30.595 INFO:tasks.workunit.client.1.smithi069.stdout:9/872: link d2/c7 d2/da/dd/de/d64/c12a 0 2024-04-25T17:19:30.596 INFO:tasks.workunit.client.1.smithi069.stdout:9/873: write d2/da/d5f/fae [1161270,126154] 0 2024-04-25T17:19:30.596 INFO:tasks.workunit.client.1.smithi069.stdout:9/874: chown d2/da4/f11b 1854624 1 2024-04-25T17:19:30.601 INFO:tasks.workunit.client.1.smithi069.stdout:3/955: symlink d8/d16/d31/l13e 0 2024-04-25T17:19:30.601 INFO:tasks.workunit.client.0.smithi037.stdout:8/812: write d5/db/d18/f86 [3770348,70018] 0 2024-04-25T17:19:30.602 INFO:tasks.workunit.client.0.smithi037.stdout:6/918: mkdir db/d1d/db1/d14f 0 2024-04-25T17:19:30.606 INFO:tasks.workunit.client.1.smithi069.stdout:6/909: rename d2/d1e/d3f/d86/da8 to d2/d1e/d13a 0 2024-04-25T17:19:30.610 INFO:tasks.workunit.client.0.smithi037.stdout:7/870: dwrite d5/d15/d17/f20 [0,4194304] 0 2024-04-25T17:19:30.615 INFO:tasks.workunit.client.0.smithi037.stdout:0/973: getdents d9/df/d32/d35 0 2024-04-25T17:19:30.615 INFO:tasks.workunit.client.1.smithi069.stdout:5/957: read d13/d17/d19/d1c/da4/fd5 [178984,45682] 0 2024-04-25T17:19:30.618 INFO:tasks.workunit.client.1.smithi069.stdout:4/913: symlink db/l144 0 2024-04-25T17:19:30.618 INFO:tasks.workunit.client.1.smithi069.stdout:0/837: truncate d0/da/d54/fcc 4751131 0 2024-04-25T17:19:30.619 INFO:tasks.workunit.client.1.smithi069.stdout:7/930: dread - d4/d3e/d94/da1/fab zero size 2024-04-25T17:19:30.619 INFO:tasks.workunit.client.1.smithi069.stdout:4/914: fsync db/d15/d20/d35/f8c 0 2024-04-25T17:19:30.620 INFO:tasks.workunit.client.1.smithi069.stdout:9/875: symlink d2/da/dd/de/d74/dbc/l12b 0 2024-04-25T17:19:30.622 INFO:tasks.workunit.client.1.smithi069.stdout:8/942: link d37/d47/d54/cfe d37/d47/d78/db3/d114/d6b/daf/de6/c143 0 2024-04-25T17:19:30.623 INFO:tasks.workunit.client.1.smithi069.stdout:5/958: chown d13/d17/d19/d20/d51/db5/cc9 185636746 1 2024-04-25T17:19:30.625 INFO:tasks.workunit.client.1.smithi069.stdout:0/838: creat d0/d17/f121 x:0 0 0 2024-04-25T17:19:30.629 INFO:tasks.workunit.client.1.smithi069.stdout:3/956: mkdir d8/d71/d13f 0 2024-04-25T17:19:30.631 INFO:tasks.workunit.client.0.smithi037.stdout:7/871: creat d5/d15/d17/d25/f120 x:0 0 0 2024-04-25T17:19:30.632 INFO:tasks.workunit.client.1.smithi069.stdout:1/900: truncate d1/fbf 623065 0 2024-04-25T17:19:30.637 INFO:tasks.workunit.client.0.smithi037.stdout:8/813: dread d5/da/fb4 [0,4194304] 0 2024-04-25T17:19:30.637 INFO:tasks.workunit.client.1.smithi069.stdout:4/915: write db/d15/d20/d35/d63/d75/de6/f100 [148509,110256] 0 2024-04-25T17:19:30.638 INFO:tasks.workunit.client.0.smithi037.stdout:6/919: dwrite db/d1d/d20/dcf/dfa/d65/d68/dae/fc5 [0,4194304] 0 2024-04-25T17:19:30.639 INFO:tasks.workunit.client.0.smithi037.stdout:8/814: write d5/db/d18/ffd [887725,50679] 0 2024-04-25T17:19:30.640 INFO:tasks.workunit.client.1.smithi069.stdout:7/931: rename d4/d3e/d94/da1/dc7/d14/d44/d79/da4/ccc to d4/d83/da2/ded/c13b 0 2024-04-25T17:19:30.642 INFO:tasks.workunit.client.1.smithi069.stdout:6/910: write d2/d1e/d3f/fe0 [1446939,95241] 0 2024-04-25T17:19:30.643 INFO:tasks.workunit.client.1.smithi069.stdout:2/914: creat d0/d26/d10/db5/de3/f12f x:0 0 0 2024-04-25T17:19:30.644 INFO:tasks.workunit.client.0.smithi037.stdout:6/920: creat db/d147/f150 x:0 0 0 2024-04-25T17:19:30.646 INFO:tasks.workunit.client.1.smithi069.stdout:8/943: creat d37/d47/d48/f144 x:0 0 0 2024-04-25T17:19:30.648 INFO:tasks.workunit.client.0.smithi037.stdout:8/815: creat d5/db/d18/d3b/d50/d51/f10a x:0 0 0 2024-04-25T17:19:30.649 INFO:tasks.workunit.client.1.smithi069.stdout:5/959: creat d13/d17/d29/d30/d5c/f14a x:0 0 0 2024-04-25T17:19:30.649 INFO:tasks.workunit.client.1.smithi069.stdout:6/911: dwrite d2/d9c/d97/d98/df3/f129 [0,4194304] 0 2024-04-25T17:19:30.654 INFO:tasks.workunit.client.1.smithi069.stdout:0/839: unlink d0/da/d24/d43/dfc/d5f/f93 0 2024-04-25T17:19:30.654 INFO:tasks.workunit.client.0.smithi037.stdout:0/974: dwrite d9/df/d32/ff9 [0,4194304] 0 2024-04-25T17:19:30.657 INFO:tasks.workunit.client.1.smithi069.stdout:0/840: read d0/da/d24/f42 [4106636,105263] 0 2024-04-25T17:19:30.660 INFO:tasks.workunit.client.1.smithi069.stdout:3/957: symlink d8/d16/d1a/d99/d111/l140 0 2024-04-25T17:19:30.662 INFO:tasks.workunit.client.0.smithi037.stdout:8/816: readlink d5/d26/d81/lbd 0 2024-04-25T17:19:30.666 INFO:tasks.workunit.client.1.smithi069.stdout:1/901: creat d1/d4/d6/d4f/f11a x:0 0 0 2024-04-25T17:19:30.667 INFO:tasks.workunit.client.0.smithi037.stdout:7/872: dwrite d5/d14/d31/f9f [0,4194304] 0 2024-04-25T17:19:30.669 INFO:tasks.workunit.client.1.smithi069.stdout:9/876: mkdir d2/da/dd/d1e/d40/d10b/d12c 0 2024-04-25T17:19:30.672 INFO:tasks.workunit.client.0.smithi037.stdout:0/975: read d9/df/fb5 [260534,17660] 0 2024-04-25T17:19:30.678 INFO:tasks.workunit.client.1.smithi069.stdout:7/932: creat d4/d83/da2/dd3/f13c x:0 0 0 2024-04-25T17:19:30.682 INFO:tasks.workunit.client.1.smithi069.stdout:2/915: read d0/d26/d10/f97 [5239548,89275] 0 2024-04-25T17:19:30.683 INFO:tasks.workunit.client.0.smithi037.stdout:0/976: dread - d9/df/d32/dd1/d7a/daf/fdf zero size 2024-04-25T17:19:30.684 INFO:tasks.workunit.client.0.smithi037.stdout:6/921: dwrite db/d147/d25/d61/fd0 [0,4194304] 0 2024-04-25T17:19:30.689 INFO:tasks.workunit.client.1.smithi069.stdout:4/916: write db/d15/d20/d35/d63/d43/d48/d49/d4e/fd2 [479425,32471] 0 2024-04-25T17:19:30.689 INFO:tasks.workunit.client.0.smithi037.stdout:7/873: dread d5/d15/d17/d25/d2b/d59/f6c [0,4194304] 0 2024-04-25T17:19:30.690 INFO:tasks.workunit.client.1.smithi069.stdout:4/917: read db/d15/f1d [1299083,43969] 0 2024-04-25T17:19:30.694 INFO:tasks.workunit.client.0.smithi037.stdout:0/977: mknod d9/d71/dec/c13c 0 2024-04-25T17:19:30.697 INFO:tasks.workunit.client.1.smithi069.stdout:6/912: unlink d2/d9c/d97/d98/cfb 0 2024-04-25T17:19:30.698 INFO:tasks.workunit.client.1.smithi069.stdout:6/913: stat d2/d9c/d97/d98/ddb/fee 0 2024-04-25T17:19:30.698 INFO:tasks.workunit.client.1.smithi069.stdout:6/914: readlink d2/d1e/d3f/l5b 0 2024-04-25T17:19:30.700 INFO:tasks.workunit.client.0.smithi037.stdout:0/978: dwrite d9/df/d32/f5c [0,4194304] 0 2024-04-25T17:19:30.703 INFO:tasks.workunit.client.0.smithi037.stdout:7/874: creat d5/d15/d17/d1b/da2/daf/f121 x:0 0 0 2024-04-25T17:19:30.703 INFO:tasks.workunit.client.1.smithi069.stdout:8/944: dwrite d37/d47/d54/d6e/fba [0,4194304] 0 2024-04-25T17:19:30.706 INFO:tasks.workunit.client.1.smithi069.stdout:3/958: rename d8/d16/d4b/d9e/dca to d8/d71/d8d/d92/d141 0 2024-04-25T17:19:30.709 INFO:tasks.workunit.client.0.smithi037.stdout:8/817: getdents d5/db/d18/d3b/d50/d51 0 2024-04-25T17:19:30.710 INFO:tasks.workunit.client.1.smithi069.stdout:9/877: symlink d2/da/dd/d1e/d2e/l12d 0 2024-04-25T17:19:30.710 INFO:tasks.workunit.client.0.smithi037.stdout:7/875: symlink d5/d14/dd3/l122 0 2024-04-25T17:19:30.711 INFO:tasks.workunit.client.1.smithi069.stdout:9/878: chown d2/da4/dcf/d65/d88/f54 28536 1 2024-04-25T17:19:30.711 INFO:tasks.workunit.client.0.smithi037.stdout:7/876: stat d5/d14/dcf/le0 0 2024-04-25T17:19:30.712 INFO:tasks.workunit.client.0.smithi037.stdout:7/877: chown d5/d15/d17/d1b/da2/daf/f60 100562648 1 2024-04-25T17:19:30.713 INFO:tasks.workunit.client.0.smithi037.stdout:6/922: rename db/d1d/d20/d2f/c89 to db/c151 0 2024-04-25T17:19:30.714 INFO:tasks.workunit.client.0.smithi037.stdout:7/878: write d5/d15/d17/d25/d2b/d59/df7/f11b [325225,7547] 0 2024-04-25T17:19:30.715 INFO:tasks.workunit.client.1.smithi069.stdout:7/933: chown d4/d3e/d94/da1/dc7/d14/d44/d7c/d9f/dcb/fac 3319884 1 2024-04-25T17:19:30.715 INFO:tasks.workunit.client.0.smithi037.stdout:6/923: chown db/d1d/d20/d13c/c66 58210 1 2024-04-25T17:19:30.715 INFO:tasks.workunit.client.1.smithi069.stdout:7/934: readlink d4/d18/l9e 0 2024-04-25T17:19:30.716 INFO:tasks.workunit.client.0.smithi037.stdout:8/818: mknod d5/dd0/c10b 0 2024-04-25T17:19:30.722 INFO:tasks.workunit.client.0.smithi037.stdout:6/924: creat db/d147/d25/d10b/d10e/f152 x:0 0 0 2024-04-25T17:19:30.722 INFO:tasks.workunit.client.0.smithi037.stdout:6/925: stat db/d147/cbf 0 2024-04-25T17:19:30.728 INFO:tasks.workunit.client.0.smithi037.stdout:6/926: chown db/d1d/db1/dc7/d11b 0 1 2024-04-25T17:19:30.733 INFO:tasks.workunit.client.1.smithi069.stdout:9/879: read d2/da/dd/d1e/d2e/f34 [1333764,67903] 0 2024-04-25T17:19:30.734 INFO:tasks.workunit.client.1.smithi069.stdout:7/935: rmdir d4/d3e/d94/da1/dc7/d14/d5a/d5e 39 2024-04-25T17:19:30.735 INFO:tasks.workunit.client.0.smithi037.stdout:8/819: dread d5/db/d18/d3b/d75/fbf [0,4194304] 0 2024-04-25T17:19:30.736 INFO:tasks.workunit.client.0.smithi037.stdout:7/879: dread d5/d15/d17/d1b/da2/daf/fb9 [0,4194304] 0 2024-04-25T17:19:30.743 INFO:tasks.workunit.client.0.smithi037.stdout:8/820: creat d5/db/d18/dc8/f10c x:0 0 0 2024-04-25T17:19:30.745 INFO:tasks.workunit.client.1.smithi069.stdout:6/915: dwrite d2/d9c/d48/f77 [0,4194304] 0 2024-04-25T17:19:30.746 INFO:tasks.workunit.client.0.smithi037.stdout:6/927: rename db/d1d/d20/d2f/f6e to db/d1d/d20/dcf/dfa/d65/d68/f153 0 2024-04-25T17:19:30.748 INFO:tasks.workunit.client.1.smithi069.stdout:1/902: link d1/d43/d1b/d32/d4a/l54 d1/d4/d6/d9e/da6/d7c/d1d/l11b 0 2024-04-25T17:19:30.749 INFO:tasks.workunit.client.0.smithi037.stdout:7/880: symlink d5/d14/l123 0 2024-04-25T17:19:30.750 INFO:tasks.workunit.client.0.smithi037.stdout:8/821: dwrite d5/db/d18/d3b/d50/da0/da6/da8/ffe [0,4194304] 0 2024-04-25T17:19:30.751 INFO:tasks.workunit.client.1.smithi069.stdout:9/880: write d2/da/dd/d1e/d2e/d35/f38 [2081527,126771] 0 2024-04-25T17:19:30.752 INFO:tasks.workunit.client.0.smithi037.stdout:8/822: chown d5/db/d23/d78/d9c/fdf 54312011 1 2024-04-25T17:19:30.753 INFO:tasks.workunit.client.0.smithi037.stdout:8/823: dread - d5/db/d18/de0/ffa zero size 2024-04-25T17:19:30.754 INFO:tasks.workunit.client.1.smithi069.stdout:3/959: dwrite d8/d16/d1a/d2c/d49/f109 [0,4194304] 0 2024-04-25T17:19:30.754 INFO:tasks.workunit.client.1.smithi069.stdout:5/960: write d13/d17/dd4/f13a [165359,47005] 0 2024-04-25T17:19:30.761 INFO:tasks.workunit.client.1.smithi069.stdout:0/841: link d0/da/db/def/d11f/d107/c11a d0/da/d54/c122 0 2024-04-25T17:19:30.765 INFO:tasks.workunit.client.0.smithi037.stdout:7/881: dread d5/d15/d17/d1b/fec [0,4194304] 0 2024-04-25T17:19:30.770 INFO:tasks.workunit.client.1.smithi069.stdout:6/916: symlink d2/d1e/d3f/d56/d7e/l13b 0 2024-04-25T17:19:30.771 INFO:tasks.workunit.client.0.smithi037.stdout:8/824: symlink d5/db/d23/d78/l10d 0 2024-04-25T17:19:30.772 INFO:tasks.workunit.client.1.smithi069.stdout:1/903: mkdir d1/d4/d6/d9e/da6/d7c/d1d/de1/d8e/dbb/dfc/d11c 0 2024-04-25T17:19:30.774 INFO:tasks.workunit.client.1.smithi069.stdout:9/881: mknod d2/da/dd/de/d74/d8a/c12e 0 2024-04-25T17:19:30.774 INFO:tasks.workunit.client.1.smithi069.stdout:7/936: dwrite d4/d83/f8f [0,4194304] 0 2024-04-25T17:19:30.776 INFO:tasks.workunit.client.1.smithi069.stdout:0/842: mknod d0/da/d59/dab/c123 0 2024-04-25T17:19:30.776 INFO:tasks.workunit.client.1.smithi069.stdout:8/945: getdents d37/d47/d78/db3/d114/d6b/daf 0 2024-04-25T17:19:30.778 INFO:tasks.workunit.client.1.smithi069.stdout:0/843: write d0/da/d24/d43/dfc/d89/fbc [4077681,37252] 0 2024-04-25T17:19:30.782 INFO:tasks.workunit.client.1.smithi069.stdout:9/882: rmdir d2/da/dd/de 39 2024-04-25T17:19:30.784 INFO:tasks.workunit.client.0.smithi037.stdout:6/928: write db/d53/fe8 [38727,6226] 0 2024-04-25T17:19:30.787 INFO:tasks.workunit.client.1.smithi069.stdout:7/937: truncate d4/d3e/d94/da1/dc7/d14/fea 421399 0 2024-04-25T17:19:30.789 INFO:tasks.workunit.client.1.smithi069.stdout:7/938: read d4/d3e/d94/da1/dc7/d14/d44/d7c/d9f/dcb/f6b [1610496,19463] 0 2024-04-25T17:19:30.789 INFO:tasks.workunit.client.1.smithi069.stdout:1/904: creat d1/d43/d1b/de9/f11d x:0 0 0 2024-04-25T17:19:30.792 INFO:tasks.workunit.client.1.smithi069.stdout:0/844: symlink d0/da/db/d7e/d80/l124 0 2024-04-25T17:19:30.792 INFO:tasks.workunit.client.0.smithi037.stdout:7/882: write d5/f55 [2412358,54525] 0 2024-04-25T17:19:30.798 INFO:tasks.workunit.client.1.smithi069.stdout:8/946: write d37/f50 [2798632,130447] 0 2024-04-25T17:19:30.799 INFO:tasks.workunit.client.0.smithi037.stdout:7/883: symlink d5/d14/d31/l124 0 2024-04-25T17:19:30.802 INFO:tasks.workunit.client.1.smithi069.stdout:8/947: read d37/d47/d54/fca [165834,117925] 0 2024-04-25T17:19:30.802 INFO:tasks.workunit.client.1.smithi069.stdout:6/917: dwrite d2/f21 [4194304,4194304] 0 2024-04-25T17:19:30.803 INFO:tasks.workunit.client.1.smithi069.stdout:9/883: rename d2/da/d5f/d76/f85 to d2/da/dd/de/d59/f12f 0 2024-04-25T17:19:30.803 INFO:tasks.workunit.client.1.smithi069.stdout:3/960: link d8/d16/d1a/l29 d8/d16/d4b/d9e/deb/d123/l142 0 2024-04-25T17:19:30.804 INFO:tasks.workunit.client.1.smithi069.stdout:8/948: write f34 [3061277,119516] 0 2024-04-25T17:19:30.804 INFO:tasks.workunit.client.0.smithi037.stdout:7/884: dread d5/d15/d17/d9d/fe8 [0,4194304] 0 2024-04-25T17:19:30.805 INFO:tasks.workunit.client.1.smithi069.stdout:5/961: dwrite d13/d17/d19/d20/f2a [0,4194304] 0 2024-04-25T17:19:30.805 INFO:tasks.workunit.client.0.smithi037.stdout:7/885: readlink d5/d15/l57 0 2024-04-25T17:19:30.806 INFO:tasks.workunit.client.0.smithi037.stdout:6/929: dread db/d147/f47 [0,4194304] 0 2024-04-25T17:19:30.809 INFO:tasks.workunit.client.1.smithi069.stdout:3/961: write d8/d16/d1a/d2c/d49/f68 [4557252,59809] 0 2024-04-25T17:19:30.809 INFO:tasks.workunit.client.1.smithi069.stdout:8/949: dread - d37/d47/d78/db3/d114/d6b/d11b/f13c zero size 2024-04-25T17:19:30.812 INFO:tasks.workunit.client.0.smithi037.stdout:7/886: mknod d5/d15/d17/d25/d2b/d59/dfe/c125 0 2024-04-25T17:19:30.816 INFO:tasks.workunit.client.0.smithi037.stdout:6/930: creat db/d1d/d20/dcf/dfa/d65/d8b/dee/d105/f154 x:0 0 0 2024-04-25T17:19:30.819 INFO:tasks.workunit.client.1.smithi069.stdout:6/918: dread - d2/d9c/d97/d98/ddb/fee zero size 2024-04-25T17:19:30.821 INFO:tasks.workunit.client.0.smithi037.stdout:7/887: dwrite d5/d15/d17/d25/d2b/dcb/dda/fee [0,4194304] 0 2024-04-25T17:19:30.823 INFO:tasks.workunit.client.0.smithi037.stdout:6/931: dread db/d1d/d20/dcf/f146 [0,4194304] 0 2024-04-25T17:19:30.824 INFO:tasks.workunit.client.1.smithi069.stdout:0/845: dread d0/da/d24/f42 [0,4194304] 0 2024-04-25T17:19:30.831 INFO:tasks.workunit.client.0.smithi037.stdout:6/932: creat db/d1d/d20/dcf/dfa/d65/d8b/dc8/f155 x:0 0 0 2024-04-25T17:19:30.831 INFO:tasks.workunit.client.0.smithi037.stdout:6/933: dread - db/d1d/ff4 zero size 2024-04-25T17:19:30.835 INFO:tasks.workunit.client.0.smithi037.stdout:6/934: stat db/d147/d25/d10d/l148 0 2024-04-25T17:19:30.836 INFO:tasks.workunit.client.0.smithi037.stdout:6/935: write db/f1c [1088614,58225] 0 2024-04-25T17:19:30.837 INFO:tasks.workunit.client.1.smithi069.stdout:5/962: write d13/d17/da5/f112 [316501,104118] 0 2024-04-25T17:19:30.839 INFO:tasks.workunit.client.1.smithi069.stdout:7/939: getdents d4/d83/da2/ded 0 2024-04-25T17:19:30.841 INFO:tasks.workunit.client.1.smithi069.stdout:7/940: truncate d4/d3e/d94/da1/dc7/d14/d15/dda/f133 243643 0 2024-04-25T17:19:30.841 INFO:tasks.workunit.client.1.smithi069.stdout:0/846: mknod d0/da/db/d7e/d80/c125 0 2024-04-25T17:19:30.842 INFO:tasks.workunit.client.1.smithi069.stdout:7/941: fdatasync d4/d3e/d94/da1/f91 0 2024-04-25T17:19:30.845 INFO:tasks.workunit.client.1.smithi069.stdout:3/962: creat d8/d71/d13f/f143 x:0 0 0 2024-04-25T17:19:30.846 INFO:tasks.workunit.client.1.smithi069.stdout:8/950: dwrite d37/d47/d54/d6e/d9e/f103 [0,4194304] 0 2024-04-25T17:19:30.847 INFO:tasks.workunit.client.1.smithi069.stdout:8/951: chown d37/d47/d54/d6e/d98/fad 250385549 1 2024-04-25T17:19:30.850 INFO:tasks.workunit.client.1.smithi069.stdout:9/884: truncate d2/da/d5f/fae 3260149 0 2024-04-25T17:19:30.851 INFO:tasks.workunit.client.1.smithi069.stdout:0/847: mkdir d0/d17/d40/d126 0 2024-04-25T17:19:30.852 INFO:tasks.workunit.client.1.smithi069.stdout:8/952: dread d37/d47/d78/db3/d114/d6b/f96 [0,4194304] 0 2024-04-25T17:19:30.852 INFO:tasks.workunit.client.1.smithi069.stdout:2/916: sync 2024-04-25T17:19:30.854 INFO:tasks.workunit.client.1.smithi069.stdout:7/942: creat d4/d4c/f13d x:0 0 0 2024-04-25T17:19:30.858 INFO:tasks.workunit.client.1.smithi069.stdout:3/963: symlink d8/d16/d9b/dc3/l144 0 2024-04-25T17:19:30.859 INFO:tasks.workunit.client.1.smithi069.stdout:3/964: write d8/d39/dfa/f131 [602979,63770] 0 2024-04-25T17:19:30.866 INFO:tasks.workunit.client.0.smithi037.stdout:6/936: creat db/d1d/f156 x:0 0 0 2024-04-25T17:19:30.869 INFO:tasks.workunit.client.1.smithi069.stdout:0/848: unlink d0/da/d59/f85 0 2024-04-25T17:19:30.871 INFO:tasks.workunit.client.0.smithi037.stdout:6/937: readlink db/d1d/d20/dcf/dfa/dde/lfe 0 2024-04-25T17:19:30.873 INFO:tasks.workunit.client.1.smithi069.stdout:2/917: mkdir d0/d56/d94/d130 0 2024-04-25T17:19:30.875 INFO:tasks.workunit.client.1.smithi069.stdout:0/849: dwrite d0/da/d24/d43/f10a [0,4194304] 0 2024-04-25T17:19:30.881 INFO:tasks.workunit.client.1.smithi069.stdout:9/885: dread d2/da4/faf [0,4194304] 0 2024-04-25T17:19:30.882 INFO:tasks.workunit.client.0.smithi037.stdout:6/938: mknod db/d147/d25/c157 0 2024-04-25T17:19:30.883 INFO:tasks.workunit.client.1.smithi069.stdout:6/919: getdents d2/d1e/d43 0 2024-04-25T17:19:30.886 INFO:tasks.workunit.client.0.smithi037.stdout:6/939: creat db/d1d/d20/dcf/dfa/dde/f158 x:0 0 0 2024-04-25T17:19:30.888 INFO:tasks.workunit.client.0.smithi037.stdout:6/940: fsync db/d1d/d20/dcf/f132 0 2024-04-25T17:19:30.888 INFO:tasks.workunit.client.1.smithi069.stdout:2/918: rmdir d0/d56/d5f/d62/de0 39 2024-04-25T17:19:30.889 INFO:tasks.workunit.client.1.smithi069.stdout:7/943: write d4/d3e/d94/da1/dc7/d14/faa [1376889,24640] 0 2024-04-25T17:19:30.890 INFO:tasks.workunit.client.1.smithi069.stdout:0/850: mkdir d0/da/d6e/d127 0 2024-04-25T17:19:30.891 INFO:tasks.workunit.client.1.smithi069.stdout:0/851: write d0/f1 [933873,118818] 0 2024-04-25T17:19:30.893 INFO:tasks.workunit.client.0.smithi037.stdout:6/941: creat db/d147/d25/d10d/d124/f159 x:0 0 0 2024-04-25T17:19:30.894 INFO:tasks.workunit.client.1.smithi069.stdout:3/965: chown d8/d8b/db2/cdd 86311368 1 2024-04-25T17:19:30.895 INFO:tasks.workunit.client.1.smithi069.stdout:5/963: link d13/d17/f1d d13/d17/d29/d30/f14b 0 2024-04-25T17:19:30.896 INFO:tasks.workunit.client.0.smithi037.stdout:6/942: rmdir db/d1d/db1 39 2024-04-25T17:19:30.899 INFO:tasks.workunit.client.0.smithi037.stdout:6/943: write db/d147/d25/d61/f74 [2686251,2774] 0 2024-04-25T17:19:30.900 INFO:tasks.workunit.client.1.smithi069.stdout:8/953: creat d37/d47/d54/f145 x:0 0 0 2024-04-25T17:19:30.900 INFO:tasks.workunit.client.1.smithi069.stdout:4/918: sync 2024-04-25T17:19:30.907 INFO:tasks.workunit.client.0.smithi037.stdout:6/944: mkdir db/d1d/db1/dc7/d11b/d123/d15a 0 2024-04-25T17:19:30.909 INFO:tasks.workunit.client.1.smithi069.stdout:3/966: creat d8/d16/d1a/d2c/d49/d59/dd2/f145 x:0 0 0 2024-04-25T17:19:30.910 INFO:tasks.workunit.client.1.smithi069.stdout:2/919: dwrite d0/d56/d5f/d62/d7d/d31/f9f [0,4194304] 0 2024-04-25T17:19:30.914 INFO:tasks.workunit.client.0.smithi037.stdout:6/945: dwrite db/d147/d25/db0/d14b/d2e/d82/f134 [0,4194304] 0 2024-04-25T17:19:30.915 INFO:tasks.workunit.client.1.smithi069.stdout:0/852: dwrite d0/da/db/d3a/f6c [0,4194304] 0 2024-04-25T17:19:30.917 INFO:tasks.workunit.client.1.smithi069.stdout:3/967: dwrite d8/d71/d8d/f119 [0,4194304] 0 2024-04-25T17:19:30.920 INFO:tasks.workunit.client.0.smithi037.stdout:6/946: truncate db/d1d/d20/dcf/dfa/d65/d8b/dee/d105/f154 703879 0 2024-04-25T17:19:30.926 INFO:tasks.workunit.client.0.smithi037.stdout:6/947: fsync db/d147/d25/db0/fba 0 2024-04-25T17:19:30.932 INFO:tasks.workunit.client.0.smithi037.stdout:6/948: mknod db/d1d/d20/dcf/dfa/d65/d8b/dee/c15b 0 2024-04-25T17:19:30.943 INFO:tasks.workunit.client.1.smithi069.stdout:6/920: symlink d2/d1e/l13c 0 2024-04-25T17:19:30.946 INFO:tasks.workunit.client.1.smithi069.stdout:4/919: mkdir db/d15/d42/d64/d7f/d102/d124/d145 0 2024-04-25T17:19:30.948 INFO:tasks.workunit.client.1.smithi069.stdout:7/944: read d4/d3e/d94/da1/dc7/d14/d5a/d5e/f7a [1574226,124809] 0 2024-04-25T17:19:30.951 INFO:tasks.workunit.client.1.smithi069.stdout:2/920: rename d0/d26/df3/l10d to d0/d26/d36/db9/l131 0 2024-04-25T17:19:30.952 INFO:tasks.workunit.client.1.smithi069.stdout:2/921: fsync d0/d1/d5b/d33/f51 0 2024-04-25T17:19:30.953 INFO:tasks.workunit.client.1.smithi069.stdout:2/922: read - d0/d56/d5f/d62/d7d/f123 zero size 2024-04-25T17:19:30.953 INFO:tasks.workunit.client.1.smithi069.stdout:0/853: creat d0/d17/f128 x:0 0 0 2024-04-25T17:19:30.954 INFO:tasks.workunit.client.1.smithi069.stdout:0/854: truncate d0/da/db/f103 902064 0 2024-04-25T17:19:30.954 INFO:tasks.workunit.client.1.smithi069.stdout:9/886: creat d2/da/d14/f130 x:0 0 0 2024-04-25T17:19:30.954 INFO:tasks.workunit.client.1.smithi069.stdout:6/921: truncate d2/d51/f54 776684 0 2024-04-25T17:19:30.957 INFO:tasks.workunit.client.1.smithi069.stdout:1/905: sync 2024-04-25T17:19:30.959 INFO:tasks.workunit.client.1.smithi069.stdout:3/968: creat d8/d39/dfa/d138/f146 x:0 0 0 2024-04-25T17:19:30.960 INFO:tasks.workunit.client.1.smithi069.stdout:0/855: dwrite d0/da/db/d2a/d8c/fe0 [4194304,4194304] 0 2024-04-25T17:19:30.962 INFO:tasks.workunit.client.1.smithi069.stdout:9/887: symlink d2/da4/dcf/l131 0 2024-04-25T17:19:30.962 INFO:tasks.workunit.client.1.smithi069.stdout:9/888: chown d2/da/d14/f130 144394 1 2024-04-25T17:19:30.965 INFO:tasks.workunit.client.1.smithi069.stdout:7/945: creat d4/d3e/d94/da1/dc7/d14/d44/dd5/dd6/d12b/f13e x:0 0 0 2024-04-25T17:19:30.966 INFO:tasks.workunit.client.1.smithi069.stdout:7/946: read d4/d4c/fb6 [1863603,124128] 0 2024-04-25T17:19:30.968 INFO:tasks.workunit.client.1.smithi069.stdout:2/923: mkdir d0/d1/d132 0 2024-04-25T17:19:30.970 INFO:tasks.workunit.client.1.smithi069.stdout:0/856: unlink d0/da/d24/d43/dfc/f6f 0 2024-04-25T17:19:30.972 INFO:tasks.workunit.client.1.smithi069.stdout:0/857: truncate d0/da/db/d3a/f5a 4552993 0 2024-04-25T17:19:30.972 INFO:tasks.workunit.client.1.smithi069.stdout:9/889: unlink d2/da/faa 0 2024-04-25T17:19:30.975 INFO:tasks.workunit.client.1.smithi069.stdout:2/924: chown d0/d56/d5f/d62/d7d/d31/df8/d10e/f125 631132376 1 2024-04-25T17:19:30.976 INFO:tasks.workunit.client.1.smithi069.stdout:2/925: write d0/d56/d5f/d62/d7d/d31/f81 [2512470,42043] 0 2024-04-25T17:19:30.977 INFO:tasks.workunit.client.1.smithi069.stdout:9/890: mknod d2/da/dd/de/c132 0 2024-04-25T17:19:30.977 INFO:tasks.workunit.client.1.smithi069.stdout:4/920: link db/d15/d26/f62 db/d15/d42/d64/d7f/df7/f146 0 2024-04-25T17:19:30.981 INFO:tasks.workunit.client.0.smithi037.stdout:6/949: dwrite db/f15 [4194304,4194304] 0 2024-04-25T17:19:30.985 INFO:tasks.workunit.client.1.smithi069.stdout:9/891: fdatasync d2/da4/dcf/f3b 0 2024-04-25T17:19:30.987 INFO:tasks.workunit.client.1.smithi069.stdout:5/964: write d13/d17/d29/d30/fda [225000,16359] 0 2024-04-25T17:19:30.991 INFO:tasks.workunit.client.1.smithi069.stdout:4/921: mkdir db/d4b/d78/d79/d147 0 2024-04-25T17:19:30.994 INFO:tasks.workunit.client.0.smithi037.stdout:6/950: rename db/d1d/d20/dcf/dfa/d65/d8b/dc8 to db/d147/d25/db0/d14b/d139/d15c 0 2024-04-25T17:19:30.995 INFO:tasks.workunit.client.1.smithi069.stdout:1/906: getdents d1/d4/d6/d4f/d9b/da3/df9 0 2024-04-25T17:19:30.998 INFO:tasks.workunit.client.1.smithi069.stdout:2/926: dread d0/d56/d5f/fb0 [0,4194304] 0 2024-04-25T17:19:30.998 INFO:tasks.workunit.client.0.smithi037.stdout:6/951: creat db/d147/d25/d10d/d124/f15d x:0 0 0 2024-04-25T17:19:30.998 INFO:tasks.workunit.client.1.smithi069.stdout:8/954: truncate d37/d47/d78/db3/d114/d6b/daf/de6/ff1 183628 0 2024-04-25T17:19:31.003 INFO:tasks.workunit.client.1.smithi069.stdout:6/922: dread d2/d1e/d43/d7d/f87 [0,4194304] 0 2024-04-25T17:19:31.003 INFO:tasks.workunit.client.1.smithi069.stdout:6/923: chown d2/fe 26901 1 2024-04-25T17:19:31.004 INFO:tasks.workunit.client.1.smithi069.stdout:4/922: write db/d15/d20/d35/d63/d43/d48/d49/f56 [392971,43905] 0 2024-04-25T17:19:31.007 INFO:tasks.workunit.client.1.smithi069.stdout:1/907: mknod d1/d4/d6/d9e/da6/d7c/d4d/d8f/c11e 0 2024-04-25T17:19:31.007 INFO:tasks.workunit.client.1.smithi069.stdout:4/923: truncate db/d15/d20/d35/d63/d43/d48/d49/d4e/d12d/f133 1005176 0 2024-04-25T17:19:31.011 INFO:tasks.workunit.client.1.smithi069.stdout:3/969: dwrite d8/d16/d1a/d2c/d49/d87/f104 [0,4194304] 0 2024-04-25T17:19:31.012 INFO:tasks.workunit.client.0.smithi037.stdout:6/952: rmdir db/d1d/db1/dc7/d11b/d123/d15a 0 2024-04-25T17:19:31.013 INFO:tasks.workunit.client.0.smithi037.stdout:6/953: stat db/d1d/d20/f21 0 2024-04-25T17:19:31.014 INFO:tasks.workunit.client.1.smithi069.stdout:0/858: getdents d0/da/db/def/d11f 0 2024-04-25T17:19:31.016 INFO:tasks.workunit.client.0.smithi037.stdout:6/954: mknod db/d147/d25/d10b/c15e 0 2024-04-25T17:19:31.017 INFO:tasks.workunit.client.1.smithi069.stdout:6/924: truncate d2/d1e/d3f/d56/d7e/fcf 1218006 0 2024-04-25T17:19:31.018 INFO:tasks.workunit.client.1.smithi069.stdout:6/925: stat d2/d7/l5a 0 2024-04-25T17:19:31.020 INFO:tasks.workunit.client.0.smithi037.stdout:6/955: readlink db/d1d/d20/dcf/l12b 0 2024-04-25T17:19:31.024 INFO:tasks.workunit.client.1.smithi069.stdout:8/955: mkdir d37/d47/d54/d6e/d146 0 2024-04-25T17:19:31.029 INFO:tasks.workunit.client.1.smithi069.stdout:5/965: creat d13/d17/f14c x:0 0 0 2024-04-25T17:19:31.036 INFO:tasks.workunit.client.1.smithi069.stdout:4/924: symlink db/d4b/d78/d79/d147/l148 0 2024-04-25T17:19:31.037 INFO:tasks.workunit.client.1.smithi069.stdout:2/927: dwrite d0/d1/d5b/f32 [0,4194304] 0 2024-04-25T17:19:31.037 INFO:tasks.workunit.client.1.smithi069.stdout:2/928: readlink d0/d26/lce 0 2024-04-25T17:19:31.038 INFO:tasks.workunit.client.1.smithi069.stdout:3/970: symlink d8/l147 0 2024-04-25T17:19:31.038 INFO:tasks.workunit.client.1.smithi069.stdout:8/956: truncate d37/d47/d54/fca 1216519 0 2024-04-25T17:19:31.040 INFO:tasks.workunit.client.1.smithi069.stdout:9/892: mknod d2/da/dd/de/db0/c133 0 2024-04-25T17:19:31.042 INFO:tasks.workunit.client.1.smithi069.stdout:7/947: sync 2024-04-25T17:19:31.049 INFO:tasks.workunit.client.1.smithi069.stdout:6/926: write d2/f9 [2449485,24130] 0 2024-04-25T17:19:31.051 INFO:tasks.workunit.client.1.smithi069.stdout:1/908: write d1/d4/de/d44/d68/ffb [540963,68895] 0 2024-04-25T17:19:31.052 INFO:tasks.workunit.client.1.smithi069.stdout:0/859: dwrite d0/da/db/d2c/f4d [8388608,4194304] 0 2024-04-25T17:19:31.054 INFO:tasks.workunit.client.1.smithi069.stdout:3/971: rename d8/d71/d8d/d92/d130/l6d to d8/d16/d1a/d2c/d49/d87/l148 0 2024-04-25T17:19:31.054 INFO:tasks.workunit.client.1.smithi069.stdout:2/929: read d0/d26/d10/d43/f7a [4174689,105641] 0 2024-04-25T17:19:31.061 INFO:tasks.workunit.client.1.smithi069.stdout:1/909: write d1/d4/de/d63/f112 [507404,119542] 0 2024-04-25T17:19:31.063 INFO:tasks.workunit.client.1.smithi069.stdout:8/957: rename d37/d47/d54/d6e/d9e/f103 to d37/d47/d125/f147 0 2024-04-25T17:19:31.066 INFO:tasks.workunit.client.1.smithi069.stdout:2/930: mknod d0/d26/d36/dc5/c133 0 2024-04-25T17:19:31.068 INFO:tasks.workunit.client.1.smithi069.stdout:9/893: truncate d2/da/dd/de/d74/d8a/fb9 1375442 0 2024-04-25T17:19:31.069 INFO:tasks.workunit.client.1.smithi069.stdout:9/894: truncate d2/da/dd/d1e/d2e/d113/f117 171204 0 2024-04-25T17:19:31.072 INFO:tasks.workunit.client.1.smithi069.stdout:6/927: mknod d2/d1e/d43/db6/daf/d12d/c13d 0 2024-04-25T17:19:31.077 INFO:tasks.workunit.client.1.smithi069.stdout:7/948: rename d4/d1a/f110 to d4/d3e/d94/da1/dc7/d14/d44/d79/da4/f13f 0 2024-04-25T17:19:31.077 INFO:tasks.workunit.client.1.smithi069.stdout:1/910: dread d1/d4/f4c [0,4194304] 0 2024-04-25T17:19:31.083 INFO:tasks.workunit.client.1.smithi069.stdout:5/966: getdents d13/d17 0 2024-04-25T17:19:31.084 INFO:tasks.workunit.client.1.smithi069.stdout:4/925: getdents db/d15/d42/d64/d7f/d102/d124 0 2024-04-25T17:19:31.084 INFO:tasks.workunit.client.1.smithi069.stdout:6/928: mknod d2/d9c/d97/dad/df1/c13e 0 2024-04-25T17:19:31.086 INFO:tasks.workunit.client.1.smithi069.stdout:0/860: rename d0/da/db/d56/f78 to d0/da/db/d2a/f129 0 2024-04-25T17:19:31.086 INFO:tasks.workunit.client.1.smithi069.stdout:8/958: mknod d37/d47/d54/d6e/d146/c148 0 2024-04-25T17:19:31.087 INFO:tasks.workunit.client.1.smithi069.stdout:7/949: fsync d4/d3e/d94/da1/dc7/d14/d44/d7c/d9f/dcb/f6b 0 2024-04-25T17:19:31.089 INFO:tasks.workunit.client.1.smithi069.stdout:3/972: dwrite d8/d2a/f55 [0,4194304] 0 2024-04-25T17:19:31.095 INFO:tasks.workunit.client.1.smithi069.stdout:0/861: dwrite d0/da/d6e/f84 [0,4194304] 0 2024-04-25T17:19:31.097 INFO:tasks.workunit.client.1.smithi069.stdout:2/931: dwrite d0/d26/d10/ff0 [0,4194304] 0 2024-04-25T17:19:31.099 INFO:tasks.workunit.client.1.smithi069.stdout:6/929: symlink d2/d9c/l13f 0 2024-04-25T17:19:31.103 INFO:tasks.workunit.client.1.smithi069.stdout:3/973: creat d8/d16/d1a/d2c/d6c/d9c/f149 x:0 0 0 2024-04-25T17:19:31.108 INFO:tasks.workunit.client.1.smithi069.stdout:9/895: rename d2/da/dd/de/d74/d8a/fb9 to d2/da/dd/d1e/d2e/d113/f134 0 2024-04-25T17:19:31.109 INFO:tasks.workunit.client.1.smithi069.stdout:8/959: symlink d37/d47/l149 0 2024-04-25T17:19:31.110 INFO:tasks.workunit.client.1.smithi069.stdout:9/896: write d2/da/dd/d1e/d2e/d113/f117 [615193,50281] 0 2024-04-25T17:19:31.112 INFO:tasks.workunit.client.1.smithi069.stdout:1/911: link d1/d43/f5b d1/d4/d6/d9e/da6/df0/f11f 0 2024-04-25T17:19:31.113 INFO:tasks.workunit.client.1.smithi069.stdout:9/897: read d2/da/dd/de0/f112 [4165739,101689] 0 2024-04-25T17:19:31.118 INFO:tasks.workunit.client.1.smithi069.stdout:4/926: rename db/d4b/d78/c105 to db/d15/d20/d35/d63/d43/d48/d6c/c149 0 2024-04-25T17:19:31.119 INFO:tasks.workunit.client.1.smithi069.stdout:8/960: mknod d37/d47/d54/dcc/c14a 0 2024-04-25T17:19:31.120 INFO:tasks.workunit.client.1.smithi069.stdout:8/961: chown d37/d47/d54/d6e/d9e/f12d 191388 1 2024-04-25T17:19:31.123 INFO:tasks.workunit.client.0.smithi037.stdout:6/956: rename db/d147/d25/db0/d14b/d139/d15c/cc9 to db/d1d/db1/dc7/c15f 0 2024-04-25T17:19:31.124 INFO:tasks.workunit.client.1.smithi069.stdout:2/932: creat d0/d1/d132/f134 x:0 0 0 2024-04-25T17:19:31.127 INFO:tasks.workunit.client.0.smithi037.stdout:6/957: rmdir db/d147/d25/db0/d14b 39 2024-04-25T17:19:31.131 INFO:tasks.workunit.client.1.smithi069.stdout:1/912: rename d1/d4/de/d44/d68/fc2 to d1/d4/d6/d9e/da6/d7c/d1d/de1/d8e/dbb/f120 0 2024-04-25T17:19:31.131 INFO:tasks.workunit.client.1.smithi069.stdout:5/967: write d13/d17/d19/d1c/da4/da9/daa/f126 [4127778,102565] 0 2024-04-25T17:19:31.131 INFO:tasks.workunit.client.0.smithi037.stdout:6/958: fsync db/f117 0 2024-04-25T17:19:31.132 INFO:tasks.workunit.client.1.smithi069.stdout:5/968: stat d13/d17/da5/l111 0 2024-04-25T17:19:31.139 INFO:tasks.workunit.client.1.smithi069.stdout:8/962: creat d37/d47/d78/d93/df9/f14b x:0 0 0 2024-04-25T17:19:31.140 INFO:tasks.workunit.client.1.smithi069.stdout:3/974: write d8/d16/d1a/d2c/d49/d59/dff/d107/f113 [278920,107388] 0 2024-04-25T17:19:31.141 INFO:tasks.workunit.client.1.smithi069.stdout:2/933: unlink d0/d1/lca 0 2024-04-25T17:19:31.144 INFO:tasks.workunit.client.1.smithi069.stdout:7/950: dwrite d4/f10 [4194304,4194304] 0 2024-04-25T17:19:31.144 INFO:tasks.workunit.client.1.smithi069.stdout:8/963: write d37/d47/d48/d8e/fac [1494452,107522] 0 2024-04-25T17:19:31.145 INFO:tasks.workunit.client.1.smithi069.stdout:2/934: write d0/d26/d10/d43/fbe [3618288,109102] 0 2024-04-25T17:19:31.145 INFO:tasks.workunit.client.1.smithi069.stdout:1/913: unlink d1/d43/d1b/d32/d4a/d4b/l9c 0 2024-04-25T17:19:31.147 INFO:tasks.workunit.client.1.smithi069.stdout:6/930: dwrite d2/d51/f93 [0,4194304] 0 2024-04-25T17:19:31.147 INFO:tasks.workunit.client.1.smithi069.stdout:5/969: rename d13/d17/d19/d20/d2d/c53 to d13/d17/d19/d20/d2d/d93/d134/c14d 0 2024-04-25T17:19:31.148 INFO:tasks.workunit.client.1.smithi069.stdout:1/914: fsync d1/d43/f18 0 2024-04-25T17:19:31.154 INFO:tasks.workunit.client.1.smithi069.stdout:1/915: chown d1/d4/d6/d9e/da6/d38/f90 16129 1 2024-04-25T17:19:31.156 INFO:tasks.workunit.client.1.smithi069.stdout:0/862: getdents d0/da/d24 0 2024-04-25T17:19:31.158 INFO:tasks.workunit.client.1.smithi069.stdout:3/975: creat d8/d71/d8d/d92/db6/dc1/f14a x:0 0 0 2024-04-25T17:19:31.158 INFO:tasks.workunit.client.0.smithi037.stdout:6/959: dread db/d1d/d20/dcf/dfa/d65/d68/f153 [0,4194304] 0 2024-04-25T17:19:31.160 INFO:tasks.workunit.client.1.smithi069.stdout:9/898: write d2/da/d14/f25 [2157937,66587] 0 2024-04-25T17:19:31.163 INFO:tasks.workunit.client.1.smithi069.stdout:2/935: dwrite d0/d26/d36/db9/f126 [0,4194304] 0 2024-04-25T17:19:31.163 INFO:tasks.workunit.client.0.smithi037.stdout:6/960: creat db/d1d/d20/dcf/dfa/d65/d68/dae/f160 x:0 0 0 2024-04-25T17:19:31.164 INFO:tasks.workunit.client.1.smithi069.stdout:9/899: fsync d2/da4/f11b 0 2024-04-25T17:19:31.166 INFO:tasks.workunit.client.0.smithi037.stdout:6/961: read db/d1d/f96 [3143558,41804] 0 2024-04-25T17:19:31.167 INFO:tasks.workunit.client.1.smithi069.stdout:0/863: creat d0/da/db/def/f12a x:0 0 0 2024-04-25T17:19:31.167 INFO:tasks.workunit.client.1.smithi069.stdout:1/916: creat d1/d4/d6/d4f/d9b/da3/f121 x:0 0 0 2024-04-25T17:19:31.169 INFO:tasks.workunit.client.1.smithi069.stdout:4/927: dwrite db/d15/d20/d35/d63/d70/f74 [0,4194304] 0 2024-04-25T17:19:31.170 INFO:tasks.workunit.client.1.smithi069.stdout:6/931: dwrite d2/d1e/d43/db6/f119 [0,4194304] 0 2024-04-25T17:19:31.170 INFO:tasks.workunit.client.1.smithi069.stdout:5/970: link d13/d17/da5/f131 d13/d17/d19/d20/d2d/d93/d134/f14e 0 2024-04-25T17:19:31.176 INFO:tasks.workunit.client.1.smithi069.stdout:3/976: creat d8/d16/d1a/d2c/d49/d59/dd2/f14b x:0 0 0 2024-04-25T17:19:31.178 INFO:tasks.workunit.client.1.smithi069.stdout:9/900: truncate d2/da/dd/de/f108 274941 0 2024-04-25T17:19:31.178 INFO:tasks.workunit.client.1.smithi069.stdout:9/901: chown d2/d51/db4 43 1 2024-04-25T17:19:31.182 INFO:tasks.workunit.client.1.smithi069.stdout:0/864: rmdir d0/da/db/d73 39 2024-04-25T17:19:31.184 INFO:tasks.workunit.client.1.smithi069.stdout:1/917: rmdir d1/d4/d6/d4f/d9b/da3/df9 39 2024-04-25T17:19:31.185 INFO:tasks.workunit.client.0.smithi037.stdout:6/962: link db/d147/f35 db/d1d/db1/dc7/d11b/f161 0 2024-04-25T17:19:31.188 INFO:tasks.workunit.client.0.smithi037.stdout:6/963: mkdir db/d147/d25/d10b/d162 0 2024-04-25T17:19:31.189 INFO:tasks.workunit.client.1.smithi069.stdout:3/977: creat d8/d16/d4b/d9e/deb/d123/f14c x:0 0 0 2024-04-25T17:19:31.189 INFO:tasks.workunit.client.1.smithi069.stdout:2/936: dwrite d0/d56/fcb [0,4194304] 0 2024-04-25T17:19:31.190 INFO:tasks.workunit.client.1.smithi069.stdout:9/902: unlink d2/da4/dcf/c7b 0 2024-04-25T17:19:31.193 INFO:tasks.workunit.client.1.smithi069.stdout:0/865: mkdir d0/d17/d83/dcf/dd5/d12b 0 2024-04-25T17:19:31.194 INFO:tasks.workunit.client.1.smithi069.stdout:7/951: link d4/d3e/d94/da1/dc7/d14/d3d/d5d/f10c d4/d1a/dfc/d122/f140 0 2024-04-25T17:19:31.202 INFO:tasks.workunit.client.1.smithi069.stdout:5/971: creat d13/d17/d19/f14f x:0 0 0 2024-04-25T17:19:31.202 INFO:tasks.workunit.client.1.smithi069.stdout:6/932: link d2/d1e/d3f/d56/d7e/l13b d2/d9c/d97/dad/df1/l140 0 2024-04-25T17:19:31.205 INFO:tasks.workunit.client.1.smithi069.stdout:9/903: rename d2/da/d5f/f86 to d2/da/dd/de/d64/dd2/f135 0 2024-04-25T17:19:31.205 INFO:tasks.workunit.client.1.smithi069.stdout:1/918: link d1/d4/d6/d4f/l87 d1/d4/d6/d9e/l122 0 2024-04-25T17:19:31.206 INFO:tasks.workunit.client.1.smithi069.stdout:7/952: mknod d4/d3e/d94/da1/dc7/d14/d44/d7c/d9f/dcb/d136/c141 0 2024-04-25T17:19:31.207 INFO:tasks.workunit.client.1.smithi069.stdout:5/972: creat d13/d17/d19/d20/f150 x:0 0 0 2024-04-25T17:19:31.210 INFO:tasks.workunit.client.1.smithi069.stdout:6/933: dwrite d2/d1e/d43/db6/f7c [0,4194304] 0 2024-04-25T17:19:31.211 INFO:tasks.workunit.client.1.smithi069.stdout:0/866: getdents d0/da/d24/d67 0 2024-04-25T17:19:31.211 INFO:tasks.workunit.client.1.smithi069.stdout:7/953: rmdir d4/d83/da2 39 2024-04-25T17:19:31.212 INFO:tasks.workunit.client.1.smithi069.stdout:0/867: fsync d0/da/db/f64 0 2024-04-25T17:19:31.213 INFO:tasks.workunit.client.1.smithi069.stdout:7/954: write d4/f10 [5969806,59028] 0 2024-04-25T17:19:31.215 INFO:tasks.workunit.client.1.smithi069.stdout:5/973: rename d13/d17/d62/fd2 to d13/d17/d19/d8a/dce/d11f/f151 0 2024-04-25T17:19:31.216 INFO:tasks.workunit.client.1.smithi069.stdout:5/974: chown d13/d17/d29/cc1 112 1 2024-04-25T17:19:31.218 INFO:tasks.workunit.client.1.smithi069.stdout:7/955: chown d4/d3e/d94/da1/dc7/d14/d44/d79/da4/cb4 205711407 1 2024-04-25T17:19:31.220 INFO:tasks.workunit.client.1.smithi069.stdout:1/919: creat d1/d4/d6/d4f/d9b/da3/f123 x:0 0 0 2024-04-25T17:19:31.222 INFO:tasks.workunit.client.1.smithi069.stdout:0/868: dwrite d0/da/d24/f72 [4194304,4194304] 0 2024-04-25T17:19:31.223 INFO:tasks.workunit.client.1.smithi069.stdout:5/975: mknod d13/d17/d19/d1c/da4/c152 0 2024-04-25T17:19:31.223 INFO:tasks.workunit.client.1.smithi069.stdout:0/869: dread - d0/da/db/def/f12a zero size 2024-04-25T17:19:31.225 INFO:tasks.workunit.client.1.smithi069.stdout:1/920: symlink d1/d4/d6/d9e/da6/df0/l124 0 2024-04-25T17:19:31.228 INFO:tasks.workunit.client.0.smithi037.stdout:6/964: dwrite db/d147/d25/db0/fba [0,4194304] 0 2024-04-25T17:19:31.232 INFO:tasks.workunit.client.1.smithi069.stdout:5/976: dwrite d13/d17/d19/d20/f122 [0,4194304] 0 2024-04-25T17:19:31.234 INFO:tasks.workunit.client.1.smithi069.stdout:9/904: dread d2/da/dd/d1e/d2e/d35/f38 [0,4194304] 0 2024-04-25T17:19:31.238 INFO:tasks.workunit.client.1.smithi069.stdout:2/937: dwrite d0/d1/d5b/f6e [0,4194304] 0 2024-04-25T17:19:31.240 INFO:tasks.workunit.client.1.smithi069.stdout:5/977: dwrite d13/d17/f7f [0,4194304] 0 2024-04-25T17:19:31.241 INFO:tasks.workunit.client.1.smithi069.stdout:3/978: truncate d8/d16/d1a/d99/fd6 200761 0 2024-04-25T17:19:31.249 INFO:tasks.workunit.client.1.smithi069.stdout:5/978: truncate d13/d17/f86 3009037 0 2024-04-25T17:19:31.250 INFO:tasks.workunit.client.1.smithi069.stdout:1/921: rename d1/df/d17/f3b to d1/d4/de/d44/f125 0 2024-04-25T17:19:31.250 INFO:tasks.workunit.client.1.smithi069.stdout:0/870: dread d0/da/db/d56/ffe [0,4194304] 0 2024-04-25T17:19:31.251 INFO:tasks.workunit.client.1.smithi069.stdout:2/938: truncate d0/d56/d94/f96 623650 0 2024-04-25T17:19:31.254 INFO:tasks.workunit.client.1.smithi069.stdout:9/905: unlink d2/da/d14/c56 0 2024-04-25T17:19:31.254 INFO:tasks.workunit.client.1.smithi069.stdout:9/906: write d2/da4/f11b [105517,123298] 0 2024-04-25T17:19:31.260 INFO:tasks.workunit.client.1.smithi069.stdout:1/922: creat d1/de4/f126 x:0 0 0 2024-04-25T17:19:31.262 INFO:tasks.workunit.client.0.smithi037.stdout:5/911: sync 2024-04-25T17:19:31.262 INFO:tasks.workunit.client.0.smithi037.stdout:3/755: sync 2024-04-25T17:19:31.263 INFO:tasks.workunit.client.1.smithi069.stdout:9/907: creat d2/da/d5f/d76/f136 x:0 0 0 2024-04-25T17:19:31.263 INFO:tasks.workunit.client.1.smithi069.stdout:2/939: read d0/d26/d10/d43/f4b [286146,104187] 0 2024-04-25T17:19:31.265 INFO:tasks.workunit.client.1.smithi069.stdout:6/934: dwrite d2/d1e/d43/d7d/f87 [4194304,4194304] 0 2024-04-25T17:19:31.270 INFO:tasks.workunit.client.1.smithi069.stdout:1/923: mkdir d1/d43/d1b/d32/d4a/db4/d127 0 2024-04-25T17:19:31.271 INFO:tasks.workunit.client.0.smithi037.stdout:5/912: unlink d7/d12/d5d/f80 0 2024-04-25T17:19:31.272 INFO:tasks.workunit.client.1.smithi069.stdout:9/908: dread d2/da/dd/d1e/d2e/d68/fb5 [0,4194304] 0 2024-04-25T17:19:31.276 INFO:tasks.workunit.client.1.smithi069.stdout:3/979: rename d8/d16/d9b to d8/d71/d14d 0 2024-04-25T17:19:31.278 INFO:tasks.workunit.client.0.smithi037.stdout:5/913: dwrite d7/d18/d62/dd8/dc6/f104 [0,4194304] 0 2024-04-25T17:19:31.280 INFO:tasks.workunit.client.0.smithi037.stdout:5/914: chown d7/d63 8 1 2024-04-25T17:19:31.282 INFO:tasks.workunit.client.1.smithi069.stdout:6/935: truncate d2/d1e/d3f/d86/feb 681531 0 2024-04-25T17:19:31.283 INFO:tasks.workunit.client.1.smithi069.stdout:9/909: symlink d2/da/dd/de/d74/dbc/df8/l137 0 2024-04-25T17:19:31.285 INFO:tasks.workunit.client.0.smithi037.stdout:5/915: fdatasync d7/d12/d5d/d90/fb4 0 2024-04-25T17:19:31.289 INFO:tasks.workunit.client.1.smithi069.stdout:3/980: creat d8/d16/d1a/d2c/d49/d59/dd2/f14e x:0 0 0 2024-04-25T17:19:31.289 INFO:tasks.workunit.client.0.smithi037.stdout:5/916: chown d7/da1/dda 857000 1 2024-04-25T17:19:31.291 INFO:tasks.workunit.client.0.smithi037.stdout:6/965: dwrite db/d147/d25/db0/fca [0,4194304] 0 2024-04-25T17:19:31.295 INFO:tasks.workunit.client.1.smithi069.stdout:6/936: symlink d2/d1e/d43/dca/dce/l141 0 2024-04-25T17:19:31.299 INFO:tasks.workunit.client.1.smithi069.stdout:5/979: dwrite d13/d17/d19/d20/d2d/f46 [0,4194304] 0 2024-04-25T17:19:31.300 INFO:tasks.workunit.client.1.smithi069.stdout:5/980: readlink d13/d17/d29/d30/d5c/l84 0 2024-04-25T17:19:31.300 INFO:tasks.workunit.client.0.smithi037.stdout:5/917: truncate d7/d12/f46 152865 0 2024-04-25T17:19:31.301 INFO:tasks.workunit.client.1.smithi069.stdout:9/910: mkdir d2/da4/dcf/d138 0 2024-04-25T17:19:31.304 INFO:tasks.workunit.client.0.smithi037.stdout:6/966: readlink db/d147/d25/db0/d14b/d139/d13f/l14d 0 2024-04-25T17:19:31.306 INFO:tasks.workunit.client.1.smithi069.stdout:3/981: mknod d8/d16/d1a/d2c/d49/d59/c14f 0 2024-04-25T17:19:31.307 INFO:tasks.workunit.client.0.smithi037.stdout:3/756: dwrite d8/d31/d32/d87/f98 [0,4194304] 0 2024-04-25T17:19:31.308 INFO:tasks.workunit.client.1.smithi069.stdout:9/911: dwrite d2/da4/dcf/d65/f75 [0,4194304] 0 2024-04-25T17:19:31.308 INFO:tasks.workunit.client.1.smithi069.stdout:9/912: stat d2/da4/dcf/d65/f73 0 2024-04-25T17:19:31.311 INFO:tasks.workunit.client.1.smithi069.stdout:8/964: sync 2024-04-25T17:19:31.311 INFO:tasks.workunit.client.1.smithi069.stdout:4/928: sync 2024-04-25T17:19:31.312 INFO:tasks.workunit.client.1.smithi069.stdout:2/940: write d0/d26/f54 [4952275,16864] 0 2024-04-25T17:19:31.313 INFO:tasks.workunit.client.1.smithi069.stdout:1/924: link d1/d43/d1b/d32/d4a/fbe d1/d4/d6/d4f/d9b/f128 0 2024-04-25T17:19:31.314 INFO:tasks.workunit.client.1.smithi069.stdout:2/941: chown d0/d26/d36/fba 0 1 2024-04-25T17:19:31.315 INFO:tasks.workunit.client.0.smithi037.stdout:6/967: creat db/d147/d25/db0/d14b/d2e/d82/f163 x:0 0 0 2024-04-25T17:19:31.320 INFO:tasks.workunit.client.1.smithi069.stdout:5/981: dread - d13/d17/d19/d8a/dce/d11f/f151 zero size 2024-04-25T17:19:31.322 INFO:tasks.workunit.client.1.smithi069.stdout:6/937: dread d2/d51/d85/fd8 [0,4194304] 0 2024-04-25T17:19:31.330 INFO:tasks.workunit.client.1.smithi069.stdout:0/871: rename d0/da/db/f103 to d0/da/db/d3a/f12c 0 2024-04-25T17:19:31.330 INFO:tasks.workunit.client.0.smithi037.stdout:5/918: rename d7/f9 to d7/d18/d62/dd8/f114 0 2024-04-25T17:19:31.330 INFO:tasks.workunit.client.0.smithi037.stdout:5/919: readlink d7/da1/db0/ld3 0 2024-04-25T17:19:31.333 INFO:tasks.workunit.client.0.smithi037.stdout:3/757: mkdir d8/df4 0 2024-04-25T17:19:31.341 INFO:tasks.workunit.client.1.smithi069.stdout:9/913: read d2/da/dd/d1e/f5e [74260,92638] 0 2024-04-25T17:19:31.342 INFO:tasks.workunit.client.1.smithi069.stdout:8/965: dread d37/d47/d78/db3/d114/f97 [0,4194304] 0 2024-04-25T17:19:31.343 INFO:tasks.workunit.client.1.smithi069.stdout:8/966: write d37/d47/d48/f49 [4646549,81968] 0 2024-04-25T17:19:31.344 INFO:tasks.workunit.client.0.smithi037.stdout:3/758: creat d8/dd8/ff5 x:0 0 0 2024-04-25T17:19:31.344 INFO:tasks.workunit.client.0.smithi037.stdout:0/979: sync 2024-04-25T17:19:31.344 INFO:tasks.workunit.client.0.smithi037.stdout:7/888: sync 2024-04-25T17:19:31.344 INFO:tasks.workunit.client.0.smithi037.stdout:8/825: sync 2024-04-25T17:19:31.350 INFO:tasks.workunit.client.1.smithi069.stdout:1/925: symlink d1/d4/d6/d4f/d9b/l129 0 2024-04-25T17:19:31.351 INFO:tasks.workunit.client.0.smithi037.stdout:5/920: write d7/d43/f52 [2146301,19635] 0 2024-04-25T17:19:31.354 INFO:tasks.workunit.client.0.smithi037.stdout:6/968: dwrite db/d1d/d20/d2f/fdb [0,4194304] 0 2024-04-25T17:19:31.355 INFO:tasks.workunit.client.0.smithi037.stdout:7/889: unlink d5/d15/cf8 0 2024-04-25T17:19:31.355 INFO:tasks.workunit.client.0.smithi037.stdout:6/969: chown db/d1d/f156 0 1 2024-04-25T17:19:31.356 INFO:tasks.workunit.client.1.smithi069.stdout:4/929: write db/db0/ff3 [1170934,21645] 0 2024-04-25T17:19:31.362 INFO:tasks.workunit.client.0.smithi037.stdout:0/980: mkdir d9/df/d32/dd1/d13d 0 2024-04-25T17:19:31.363 INFO:tasks.workunit.client.1.smithi069.stdout:3/982: dread d8/d71/d8d/d92/d130/f118 [0,4194304] 0 2024-04-25T17:19:31.364 INFO:tasks.workunit.client.0.smithi037.stdout:8/826: write d5/d6a/f9f [2892664,28622] 0 2024-04-25T17:19:31.364 INFO:tasks.workunit.client.0.smithi037.stdout:6/970: dwrite db/d1d/d20/d2f/fdb [0,4194304] 0 2024-04-25T17:19:31.365 INFO:tasks.workunit.client.0.smithi037.stdout:0/981: chown d9/df/d32/d39/f64 26386 1 2024-04-25T17:19:31.368 INFO:tasks.workunit.client.1.smithi069.stdout:6/938: creat d2/d51/d89/f142 x:0 0 0 2024-04-25T17:19:31.368 INFO:tasks.workunit.client.0.smithi037.stdout:8/827: dread d5/db/d59/f6c [0,4194304] 0 2024-04-25T17:19:31.369 INFO:tasks.workunit.client.1.smithi069.stdout:6/939: readlink d2/d1e/l75 0 2024-04-25T17:19:31.369 INFO:tasks.workunit.client.0.smithi037.stdout:6/971: dread - db/d53/f144 zero size 2024-04-25T17:19:31.370 INFO:tasks.workunit.client.0.smithi037.stdout:3/759: dwrite d8/d31/f48 [0,4194304] 0 2024-04-25T17:19:31.371 INFO:tasks.workunit.client.0.smithi037.stdout:7/890: creat d5/dc1/f126 x:0 0 0 2024-04-25T17:19:31.379 INFO:tasks.workunit.client.0.smithi037.stdout:0/982: creat d9/d14/d28/d48/d58/f13e x:0 0 0 2024-04-25T17:19:31.379 INFO:tasks.workunit.client.0.smithi037.stdout:8/828: dread d5/db/d18/d3b/f8d [0,4194304] 0 2024-04-25T17:19:31.386 INFO:tasks.workunit.client.1.smithi069.stdout:7/956: sync 2024-04-25T17:19:31.387 INFO:tasks.workunit.client.1.smithi069.stdout:4/930: mknod db/d15/d42/c14a 0 2024-04-25T17:19:31.388 INFO:tasks.workunit.client.1.smithi069.stdout:4/931: truncate db/d22/fe0 73654 0 2024-04-25T17:19:31.388 INFO:tasks.workunit.client.1.smithi069.stdout:3/983: chown d8/d16/d1a/d2c/d49/cf5 1 1 2024-04-25T17:19:31.389 INFO:tasks.workunit.client.1.smithi069.stdout:4/932: truncate db/de3/f11c 833830 0 2024-04-25T17:19:31.389 INFO:tasks.workunit.client.1.smithi069.stdout:3/984: chown d8/d71/d14d/dc3/f116 68458 1 2024-04-25T17:19:31.390 INFO:tasks.workunit.client.1.smithi069.stdout:0/872: truncate d0/da/db/d73/fb5 2464820 0 2024-04-25T17:19:31.394 INFO:tasks.workunit.client.1.smithi069.stdout:7/957: creat d4/d3e/d94/da1/dc7/d14/d15/dda/d11d/f142 x:0 0 0 2024-04-25T17:19:31.394 INFO:tasks.workunit.client.1.smithi069.stdout:5/982: creat d13/d17/d29/f153 x:0 0 0 2024-04-25T17:19:31.395 INFO:tasks.workunit.client.1.smithi069.stdout:6/940: mknod d2/d1e/d3f/d56/c143 0 2024-04-25T17:19:31.395 INFO:tasks.workunit.client.1.smithi069.stdout:5/983: stat d13/d17/d19/d1c/d6c/fb1 0 2024-04-25T17:19:31.395 INFO:tasks.workunit.client.1.smithi069.stdout:4/933: readlink db/d15/d20/d35/d63/d70/d8a/d96/l13b 0 2024-04-25T17:19:31.396 INFO:tasks.workunit.client.1.smithi069.stdout:9/914: link d2/da/dd/de/db0/c133 d2/da4/dcf/d65/c139 0 2024-04-25T17:19:31.399 INFO:tasks.workunit.client.1.smithi069.stdout:3/985: mkdir d8/d16/d4b/d9e/da5/d150 0 2024-04-25T17:19:31.400 INFO:tasks.workunit.client.1.smithi069.stdout:4/934: symlink db/d4b/d78/dc4/d41/d9e/df2/l14b 0 2024-04-25T17:19:31.400 INFO:tasks.workunit.client.1.smithi069.stdout:5/984: read d13/d17/d19/d96/fa2 [2063675,22628] 0 2024-04-25T17:19:31.401 INFO:tasks.workunit.client.1.smithi069.stdout:6/941: fsync d2/d1e/d3f/d86/feb 0 2024-04-25T17:19:31.401 INFO:tasks.workunit.client.1.smithi069.stdout:4/935: fsync db/d15/d20/d35/d63/d70/faf 0 2024-04-25T17:19:31.402 INFO:tasks.workunit.client.1.smithi069.stdout:9/915: symlink d2/da/dd/d1e/d2e/d35/d120/l13a 0 2024-04-25T17:19:31.404 INFO:tasks.workunit.client.1.smithi069.stdout:0/873: creat d0/da/db/d3a/f12d x:0 0 0 2024-04-25T17:19:31.405 INFO:tasks.workunit.client.1.smithi069.stdout:0/874: stat d0/da/db/d56/l62 0 2024-04-25T17:19:31.406 INFO:tasks.workunit.client.1.smithi069.stdout:5/985: stat d13/d17/f86 0 2024-04-25T17:19:31.409 INFO:tasks.workunit.client.1.smithi069.stdout:3/986: dread d8/d71/d8d/f102 [0,4194304] 0 2024-04-25T17:19:31.411 INFO:tasks.workunit.client.1.smithi069.stdout:7/958: link d4/d3e/d94/da1/dc7/d14/d44/d7c/lb9 d4/d3e/l143 0 2024-04-25T17:19:31.411 INFO:tasks.workunit.client.1.smithi069.stdout:3/987: truncate d8/d16/d1a/d2c/d49/d87/d8a/fc9 4380362 0 2024-04-25T17:19:31.412 INFO:tasks.workunit.client.1.smithi069.stdout:3/988: chown d8/d8b/db2/fe1 709792374 1 2024-04-25T17:19:31.413 INFO:tasks.workunit.client.1.smithi069.stdout:1/926: write d1/d4/d6/d4f/d9b/fac [2155276,58356] 0 2024-04-25T17:19:31.414 INFO:tasks.workunit.client.1.smithi069.stdout:1/927: chown d1/d4/d6/d9e/da6/d7c/d1d/de1/d8e/dbb/dfc 93588622 1 2024-04-25T17:19:31.415 INFO:tasks.workunit.client.1.smithi069.stdout:4/936: fsync db/d4b/d78/dc4/d41/f4f 0 2024-04-25T17:19:31.418 INFO:tasks.workunit.client.1.smithi069.stdout:7/959: creat d4/d18/f144 x:0 0 0 2024-04-25T17:19:31.419 INFO:tasks.workunit.client.1.smithi069.stdout:2/942: dwrite d0/d56/d5f/d62/d7d/d31/fd5 [0,4194304] 0 2024-04-25T17:19:31.422 INFO:tasks.workunit.client.1.smithi069.stdout:8/967: truncate d37/d47/d54/d6e/d9e/f11f 1334792 0 2024-04-25T17:19:31.423 INFO:tasks.workunit.client.1.smithi069.stdout:8/968: write d37/d47/d48/f131 [900636,108556] 0 2024-04-25T17:19:31.424 INFO:tasks.workunit.client.1.smithi069.stdout:1/928: mknod d1/d43/c12a 0 2024-04-25T17:19:31.431 INFO:tasks.workunit.client.1.smithi069.stdout:0/875: rmdir d0/da/d6e/d106 0 2024-04-25T17:19:31.433 INFO:tasks.workunit.client.1.smithi069.stdout:3/989: creat d8/d16/d4b/d9e/da5/d150/f151 x:0 0 0 2024-04-25T17:19:31.435 INFO:tasks.workunit.client.1.smithi069.stdout:8/969: symlink d37/d47/d78/db3/d114/d6b/daf/de6/l14c 0 2024-04-25T17:19:31.438 INFO:tasks.workunit.client.1.smithi069.stdout:7/960: truncate d4/d83/fc9 2449162 0 2024-04-25T17:19:31.438 INFO:tasks.workunit.client.1.smithi069.stdout:6/942: write d2/d9c/d97/fd4 [450805,65156] 0 2024-04-25T17:19:31.440 INFO:tasks.workunit.client.1.smithi069.stdout:0/876: mkdir d0/da/d54/d12e 0 2024-04-25T17:19:31.440 INFO:tasks.workunit.client.1.smithi069.stdout:5/986: write d13/f8c [361642,65653] 0 2024-04-25T17:19:31.441 INFO:tasks.workunit.client.1.smithi069.stdout:2/943: mkdir d0/d56/d135 0 2024-04-25T17:19:31.441 INFO:tasks.workunit.client.1.smithi069.stdout:7/961: truncate d4/d3e/d94/da1/dc7/d14/d3d/d47/fef 4426466 0 2024-04-25T17:19:31.443 INFO:tasks.workunit.client.1.smithi069.stdout:2/944: chown d0/d56/d5f/d62/d111/l128 310728 1 2024-04-25T17:19:31.446 INFO:tasks.workunit.client.1.smithi069.stdout:6/943: mkdir d2/d1e/d3f/d86/d144 0 2024-04-25T17:19:31.447 INFO:tasks.workunit.client.1.smithi069.stdout:0/877: dwrite d0/da/db/d2a/faf [0,4194304] 0 2024-04-25T17:19:31.448 INFO:tasks.workunit.client.1.smithi069.stdout:4/937: write db/d15/d20/d35/d63/fa2 [726116,110307] 0 2024-04-25T17:19:31.450 INFO:tasks.workunit.client.1.smithi069.stdout:5/987: symlink d13/d17/d19/d1c/d6c/df1/l154 0 2024-04-25T17:19:31.453 INFO:tasks.workunit.client.1.smithi069.stdout:8/970: mknod d37/d47/d78/db3/d114/d6b/d140/c14d 0 2024-04-25T17:19:31.453 INFO:tasks.workunit.client.1.smithi069.stdout:2/945: dwrite d0/d1/d5b/f6e [0,4194304] 0 2024-04-25T17:19:31.453 INFO:tasks.workunit.client.1.smithi069.stdout:5/988: readlink d13/d17/dd4/ldc 0 2024-04-25T17:19:31.454 INFO:tasks.workunit.client.1.smithi069.stdout:1/929: creat d1/d4/d6/d4f/d9b/da3/f12b x:0 0 0 2024-04-25T17:19:31.455 INFO:tasks.workunit.client.1.smithi069.stdout:5/989: readlink d13/d17/l94 0 2024-04-25T17:19:31.460 INFO:tasks.workunit.client.1.smithi069.stdout:8/971: dread d37/d47/d54/ff3 [0,4194304] 0 2024-04-25T17:19:31.460 INFO:tasks.workunit.client.1.smithi069.stdout:4/938: creat db/d15/d20/d35/d63/d70/d8a/d96/dbf/d103/f14c x:0 0 0 2024-04-25T17:19:31.462 INFO:tasks.workunit.client.1.smithi069.stdout:5/990: stat d13/d17/d19/d96/d9d 0 2024-04-25T17:19:31.463 INFO:tasks.workunit.client.1.smithi069.stdout:9/916: dwrite d2/da/d5f/dd3/fdd [0,4194304] 0 2024-04-25T17:19:31.464 INFO:tasks.workunit.client.1.smithi069.stdout:0/878: dwrite d0/da/db/def/f12a [0,4194304] 0 2024-04-25T17:19:31.466 INFO:tasks.workunit.client.1.smithi069.stdout:9/917: chown d2/da/dd/d1e/d2e 5145773 1 2024-04-25T17:19:31.466 INFO:tasks.workunit.client.1.smithi069.stdout:7/962: link d4/d3e/d94/da1/dc7/d14/d5a/d5e/df9/f11a d4/d3e/d94/da1/dc7/d14/d44/d79/f145 0 2024-04-25T17:19:31.467 INFO:tasks.workunit.client.1.smithi069.stdout:6/944: mkdir d2/d1e/d43/dca/d138/d145 0 2024-04-25T17:19:31.467 INFO:tasks.workunit.client.1.smithi069.stdout:5/991: write d13/d17/d19/d20/d2d/d93/fb0 [926426,24922] 0 2024-04-25T17:19:31.470 INFO:tasks.workunit.client.1.smithi069.stdout:0/879: chown d0/da/d24/d43/dfc/la3 10 1 2024-04-25T17:19:31.472 INFO:tasks.workunit.client.1.smithi069.stdout:3/990: getdents d8/d16/d4b/def 0 2024-04-25T17:19:31.473 INFO:tasks.workunit.client.1.smithi069.stdout:2/946: dread - d0/d56/d94/fb2 zero size 2024-04-25T17:19:31.473 INFO:tasks.workunit.client.1.smithi069.stdout:2/947: dread - d0/d56/d94/fb8 zero size 2024-04-25T17:19:31.476 INFO:tasks.workunit.client.1.smithi069.stdout:1/930: read d1/d4/d6/d9e/da6/d7c/d4d/d8f/fab [235344,124444] 0 2024-04-25T17:19:31.477 INFO:tasks.workunit.client.1.smithi069.stdout:8/972: truncate d37/d47/f5a 3337471 0 2024-04-25T17:19:31.480 INFO:tasks.workunit.client.1.smithi069.stdout:5/992: fdatasync d13/d17/d62/fcb 0 2024-04-25T17:19:31.481 INFO:tasks.workunit.client.1.smithi069.stdout:7/963: dread - d4/d3e/d94/da1/dc7/d14/d3d/d47/fbe zero size 2024-04-25T17:19:31.484 INFO:tasks.workunit.client.1.smithi069.stdout:0/880: symlink d0/d17/d40/l12f 0 2024-04-25T17:19:31.485 INFO:tasks.workunit.client.1.smithi069.stdout:6/945: mknod d2/d9c/d97/dad/df1/c146 0 2024-04-25T17:19:31.489 INFO:tasks.workunit.client.1.smithi069.stdout:1/931: mkdir d1/d4/de/d44/d68/d12c 0 2024-04-25T17:19:31.490 INFO:tasks.workunit.client.1.smithi069.stdout:1/932: chown d1/d4/d6/d9e/da6/d7c/d1d/fb2 195820 1 2024-04-25T17:19:31.490 INFO:tasks.workunit.client.1.smithi069.stdout:8/973: mkdir d37/d47/d78/db3/d114/d6b/d14e 0 2024-04-25T17:19:31.496 INFO:tasks.workunit.client.1.smithi069.stdout:9/918: rename d2/da/dd/de/d104 to d2/da/dd/d1e/d2e/d68/dba/ded/d128/d13b 0 2024-04-25T17:19:31.498 INFO:tasks.workunit.client.1.smithi069.stdout:2/948: dread d0/d1/d5b/d33/fa3 [0,4194304] 0 2024-04-25T17:19:31.500 INFO:tasks.workunit.client.1.smithi069.stdout:1/933: creat d1/d4/d6/d4f/f12d x:0 0 0 2024-04-25T17:19:31.501 INFO:tasks.workunit.client.1.smithi069.stdout:5/993: mkdir d13/d17/d19/d1c/d155 0 2024-04-25T17:19:31.502 INFO:tasks.workunit.client.1.smithi069.stdout:5/994: truncate d13/d17/f14c 65575 0 2024-04-25T17:19:31.506 INFO:tasks.workunit.client.1.smithi069.stdout:6/946: creat d2/d1e/d3f/d56/de5/f147 x:0 0 0 2024-04-25T17:19:31.507 INFO:tasks.workunit.client.0.smithi037.stdout:7/891: symlink d5/d15/d17/d1b/da2/daf/l127 0 2024-04-25T17:19:31.507 INFO:tasks.workunit.client.1.smithi069.stdout:6/947: fdatasync d2/fe 0 2024-04-25T17:19:31.507 INFO:tasks.workunit.client.1.smithi069.stdout:8/974: mknod d37/d47/d54/d6e/c14f 0 2024-04-25T17:19:31.508 INFO:tasks.workunit.client.0.smithi037.stdout:5/921: creat d7/d12/f115 x:0 0 0 2024-04-25T17:19:31.509 INFO:tasks.workunit.client.1.smithi069.stdout:1/934: creat d1/d4/d6/d9e/f12e x:0 0 0 2024-04-25T17:19:31.509 INFO:tasks.workunit.client.0.smithi037.stdout:7/892: stat d5/d15/d17/d1b 0 2024-04-25T17:19:31.510 INFO:tasks.workunit.client.0.smithi037.stdout:3/760: dwrite d8/d31/d8d/db7/dcd/fdc [0,4194304] 0 2024-04-25T17:19:31.510 INFO:tasks.workunit.client.1.smithi069.stdout:1/935: dread - d1/d4/d6/d9e/da6/d7c/d1d/dad/f113 zero size 2024-04-25T17:19:31.511 INFO:tasks.workunit.client.1.smithi069.stdout:5/995: rmdir d13 39 2024-04-25T17:19:31.516 INFO:tasks.workunit.client.0.smithi037.stdout:0/983: rename d9/df/d32/d39 to d9/df/dbd/dc1/de2/d13f 0 2024-04-25T17:19:31.517 INFO:tasks.workunit.client.1.smithi069.stdout:0/881: link d0/da/db/d2c/f74 d0/da/d59/dab/f130 0 2024-04-25T17:19:31.517 INFO:tasks.workunit.client.0.smithi037.stdout:0/984: stat d9/df/d32/dd1/f10d 0 2024-04-25T17:19:31.518 INFO:tasks.workunit.client.1.smithi069.stdout:4/939: write db/d22/fee [357404,129599] 0 2024-04-25T17:19:31.518 INFO:tasks.workunit.client.1.smithi069.stdout:4/940: chown db/d15/d82/fd4 9 1 2024-04-25T17:19:31.519 INFO:tasks.workunit.client.1.smithi069.stdout:4/941: chown db/d15/d20/d35/d63/d75/dbd 6646 1 2024-04-25T17:19:31.519 INFO:tasks.workunit.client.0.smithi037.stdout:5/922: unlink d7/d43/d9f/ff5 0 2024-04-25T17:19:31.520 INFO:tasks.workunit.client.0.smithi037.stdout:5/923: readlink d7/d12/d6f/lf0 0 2024-04-25T17:19:31.522 INFO:tasks.workunit.client.1.smithi069.stdout:2/949: symlink d0/d56/d5f/d62/d7d/d31/l136 0 2024-04-25T17:19:31.527 INFO:tasks.workunit.client.0.smithi037.stdout:7/893: write d5/d15/d17/d1b/f88 [1630105,103559] 0 2024-04-25T17:19:31.530 INFO:tasks.workunit.client.1.smithi069.stdout:1/936: rmdir d1/d4/d6/d9e/da6/d7c/d4d/d8f 39 2024-04-25T17:19:31.531 INFO:tasks.workunit.client.0.smithi037.stdout:3/761: getdents d8/df4 0 2024-04-25T17:19:31.534 INFO:tasks.workunit.client.1.smithi069.stdout:3/991: write d8/d16/d1a/d99/fd6 [294493,19213] 0 2024-04-25T17:19:31.535 INFO:tasks.workunit.client.1.smithi069.stdout:7/964: dwrite d4/d3e/d94/da1/dc7/d14/d15/f8d [0,4194304] 0 2024-04-25T17:19:31.535 INFO:tasks.workunit.client.0.smithi037.stdout:8/829: mkdir d5/db/d18/d3b/d50/da0/d109/d10e 0 2024-04-25T17:19:31.535 INFO:tasks.workunit.client.0.smithi037.stdout:8/830: chown d5/db/f68 36768 1 2024-04-25T17:19:31.537 INFO:tasks.workunit.client.0.smithi037.stdout:8/831: write d5/db/fb3 [7477671,11617] 0 2024-04-25T17:19:31.538 INFO:tasks.workunit.client.1.smithi069.stdout:9/919: write d2/d51/fe4 [132037,68176] 0 2024-04-25T17:19:31.539 INFO:tasks.workunit.client.1.smithi069.stdout:4/942: mkdir db/db0/d134/d14d 0 2024-04-25T17:19:31.541 INFO:tasks.workunit.client.1.smithi069.stdout:5/996: dwrite d13/d17/d62/f11a [0,4194304] 0 2024-04-25T17:19:31.543 INFO:tasks.workunit.client.1.smithi069.stdout:2/950: rmdir d0/d56/d5f/d62/dbc 39 2024-04-25T17:19:31.546 INFO:tasks.workunit.client.0.smithi037.stdout:3/762: creat d8/d23/dbb/d63/ff6 x:0 0 0 2024-04-25T17:19:31.546 INFO:tasks.workunit.client.1.smithi069.stdout:4/943: dwrite db/d22/f71 [0,4194304] 0 2024-04-25T17:19:31.556 INFO:tasks.workunit.client.0.smithi037.stdout:8/832: creat d5/db/d23/d58/dd3/f10f x:0 0 0 2024-04-25T17:19:31.561 INFO:tasks.workunit.client.0.smithi037.stdout:0/985: getdents d9/df/dbd/dc1/de2/d13f/d68/da7 0 2024-04-25T17:19:31.562 INFO:tasks.workunit.client.1.smithi069.stdout:3/992: mkdir d8/d71/d8d/d92/d141/de7/d152 0 2024-04-25T17:19:31.565 INFO:tasks.workunit.client.1.smithi069.stdout:7/965: rename d4/d3e/d94/da1/dc7/lae to d4/d3e/d94/da1/dc7/d14/d15/l146 0 2024-04-25T17:19:31.566 INFO:tasks.workunit.client.0.smithi037.stdout:0/986: mkdir d9/df/dbd/de9/d140 0 2024-04-25T17:19:31.567 INFO:tasks.workunit.client.0.smithi037.stdout:0/987: chown c8 8697 1 2024-04-25T17:19:31.567 INFO:tasks.workunit.client.1.smithi069.stdout:7/966: dread d4/d3e/dc8/fee [0,4194304] 0 2024-04-25T17:19:31.569 INFO:tasks.workunit.client.1.smithi069.stdout:4/944: creat db/d15/d20/d35/f14e x:0 0 0 2024-04-25T17:19:31.569 INFO:tasks.workunit.client.1.smithi069.stdout:6/948: link d2/d1e/l27 d2/d1e/d13a/d135/l148 0 2024-04-25T17:19:31.570 INFO:tasks.workunit.client.1.smithi069.stdout:4/945: fsync db/d22/fcd 0 2024-04-25T17:19:31.570 INFO:tasks.workunit.client.1.smithi069.stdout:6/949: fsync d2/d7/fc 0 2024-04-25T17:19:31.571 INFO:tasks.workunit.client.1.smithi069.stdout:6/950: read - d2/d1e/d43/dca/fd2 zero size 2024-04-25T17:19:31.576 INFO:tasks.workunit.client.1.smithi069.stdout:5/997: link d13/d17/dd4/f13a d13/d17/d19/d1c/d6c/df1/d139/f156 0 2024-04-25T17:19:31.576 INFO:tasks.workunit.client.1.smithi069.stdout:0/882: dread d0/d17/d40/fff [0,4194304] 0 2024-04-25T17:19:31.581 INFO:tasks.workunit.client.1.smithi069.stdout:3/993: unlink d8/c112 0 2024-04-25T17:19:31.583 INFO:tasks.workunit.client.1.smithi069.stdout:8/975: truncate fe 4132334 0 2024-04-25T17:19:31.584 INFO:tasks.workunit.client.1.smithi069.stdout:2/951: creat d0/d1/d5b/f137 x:0 0 0 2024-04-25T17:19:31.584 INFO:tasks.workunit.client.1.smithi069.stdout:3/994: dread d8/d71/d8d/f8f [4194304,4194304] 0 2024-04-25T17:19:31.585 INFO:tasks.workunit.client.1.smithi069.stdout:7/967: mkdir d4/d83/d147 0 2024-04-25T17:19:31.586 INFO:tasks.workunit.client.0.smithi037.stdout:7/894: truncate d5/d14/d31/fa1 1091181 0 2024-04-25T17:19:31.586 INFO:tasks.workunit.client.1.smithi069.stdout:7/968: chown d4/d3e/d94/da1/dc7/d14/d3d/df6/ca9 1 1 2024-04-25T17:19:31.588 INFO:tasks.workunit.client.1.smithi069.stdout:5/998: unlink d13/d17/da5/f112 0 2024-04-25T17:19:31.589 INFO:tasks.workunit.client.1.smithi069.stdout:0/883: fsync d0/da/db/d7e/fdc 0 2024-04-25T17:19:31.590 INFO:tasks.workunit.client.1.smithi069.stdout:2/952: dread d0/d26/f2b [0,4194304] 0 2024-04-25T17:19:31.590 INFO:tasks.workunit.client.0.smithi037.stdout:7/895: creat d5/d15/d17/d25/d2b/dcb/dda/f128 x:0 0 0 2024-04-25T17:19:31.592 INFO:tasks.workunit.client.1.smithi069.stdout:6/951: mkdir d2/d149 0 2024-04-25T17:19:31.593 INFO:tasks.workunit.client.1.smithi069.stdout:6/952: chown d2/d1e/d43 377 1 2024-04-25T17:19:31.594 INFO:tasks.workunit.client.0.smithi037.stdout:3/763: dwrite d8/d23/f62 [0,4194304] 0 2024-04-25T17:19:31.596 INFO:tasks.workunit.client.0.smithi037.stdout:3/764: chown d8/deb/f8f 5366 1 2024-04-25T17:19:31.599 INFO:tasks.workunit.client.0.smithi037.stdout:8/833: dwrite d5/d6a/f7a [8388608,4194304] 0 2024-04-25T17:19:31.600 INFO:tasks.workunit.client.0.smithi037.stdout:8/834: readlink d5/db/d18/dc8/le7 0 2024-04-25T17:19:31.606 INFO:tasks.workunit.client.1.smithi069.stdout:7/969: mknod d4/d3e/d94/da1/dc7/d14/d15/d11b/c148 0 2024-04-25T17:19:31.607 INFO:tasks.workunit.client.0.smithi037.stdout:0/988: dwrite d9/df/df7/f11f [0,4194304] 0 2024-04-25T17:19:31.607 INFO:tasks.workunit.client.1.smithi069.stdout:1/937: dwrite d1/fbf [0,4194304] 0 2024-04-25T17:19:31.609 INFO:tasks.workunit.client.0.smithi037.stdout:7/896: creat d5/dc1/de1/f129 x:0 0 0 2024-04-25T17:19:31.613 INFO:tasks.workunit.client.1.smithi069.stdout:4/946: write db/d15/f3f [4901789,95522] 0 2024-04-25T17:19:31.613 INFO:tasks.workunit.client.1.smithi069.stdout:0/884: unlink d0/da/db/d7e/d80/c81 0 2024-04-25T17:19:31.615 INFO:tasks.workunit.client.0.smithi037.stdout:0/989: mkdir d9/df/dbd/dc1/de2/d13f/dd3/d141 0 2024-04-25T17:19:31.616 INFO:tasks.workunit.client.1.smithi069.stdout:2/953: symlink d0/dfd/l138 0 2024-04-25T17:19:31.618 INFO:tasks.workunit.client.1.smithi069.stdout:2/954: readlink d0/d26/d36/l5d 0 2024-04-25T17:19:31.619 INFO:tasks.workunit.client.0.smithi037.stdout:7/897: truncate d5/d15/dd8/db5/fb6 739621 0 2024-04-25T17:19:31.619 INFO:tasks.workunit.client.1.smithi069.stdout:9/920: creat d2/da/dd/de/d64/f13c x:0 0 0 2024-04-25T17:19:31.619 INFO:tasks.workunit.client.0.smithi037.stdout:7/898: readlink d5/d15/d17/d25/d2b/dcb/ldf 0 2024-04-25T17:19:31.624 INFO:tasks.workunit.client.0.smithi037.stdout:0/990: rename d9/d14/d23/dfc/l11e to d9/df/dbd/dc1/l142 0 2024-04-25T17:19:31.626 INFO:tasks.workunit.client.1.smithi069.stdout:9/921: dwrite d2/da4/dcf/d65/d88/f54 [0,4194304] 0 2024-04-25T17:19:31.626 INFO:tasks.workunit.client.1.smithi069.stdout:8/976: mknod d37/d47/d54/c150 0 2024-04-25T17:19:31.628 INFO:tasks.workunit.client.1.smithi069.stdout:3/995: symlink d8/d16/d1a/d99/dab/d11a/l153 0 2024-04-25T17:19:31.630 INFO:tasks.workunit.client.0.smithi037.stdout:0/991: creat d9/df/dbd/dc1/de2/d13f/d68/f143 x:0 0 0 2024-04-25T17:19:31.633 INFO:tasks.workunit.client.0.smithi037.stdout:7/899: mkdir d5/d14/d31/d12a 0 2024-04-25T17:19:31.635 INFO:tasks.workunit.client.0.smithi037.stdout:3/765: write d8/d23/d38/d66/f75 [3072200,119840] 0 2024-04-25T17:19:31.637 INFO:tasks.workunit.client.1.smithi069.stdout:1/938: symlink d1/d4/d6/d9e/da6/d7c/d1d/de1/d8e/dbb/l12f 0 2024-04-25T17:19:31.637 INFO:tasks.workunit.client.1.smithi069.stdout:1/939: chown d1/d43/d1b/d32/fcf 1622 1 2024-04-25T17:19:31.638 INFO:tasks.workunit.client.1.smithi069.stdout:5/999: write d13/d17/d19/d8a/dce/d11f/f151 [888105,9824] 0 2024-04-25T17:19:31.639 INFO:tasks.workunit.client.1.smithi069.stdout:1/940: dread - d1/d4/d6/d9e/f118 zero size 2024-04-25T17:19:31.639 INFO:tasks.workunit.client.0.smithi037.stdout:0/992: symlink d9/df/d32/d115/l144 0 2024-04-25T17:19:31.640 INFO:tasks.workunit.client.1.smithi069.stdout:4/947: creat db/d4b/d78/dc4/d41/d9e/f14f x:0 0 0 2024-04-25T17:19:31.641 INFO:tasks.workunit.client.1.smithi069.stdout:4/948: fdatasync db/d15/f114 0 2024-04-25T17:19:31.643 INFO:tasks.workunit.client.0.smithi037.stdout:3/766: unlink d8/d23/dbb/d81/dc3/lde 0 2024-04-25T17:19:31.644 INFO:tasks.workunit.client.0.smithi037.stdout:7/900: stat d5/d15/dd8/db5/fb6 0 2024-04-25T17:19:31.644 INFO:tasks.workunit.client.1.smithi069.stdout:1/941: dread d1/d43/f8a [0,4194304] 0 2024-04-25T17:19:31.652 INFO:tasks.workunit.client.1.smithi069.stdout:6/953: dread d2/d1e/f2b [0,4194304] 0 2024-04-25T17:19:31.652 INFO:tasks.workunit.client.1.smithi069.stdout:9/922: read d2/da/dd/de0/f112 [817136,117626] 0 2024-04-25T17:19:31.655 INFO:tasks.workunit.client.1.smithi069.stdout:0/885: mkdir d0/da/d6e/d127/d131 0 2024-04-25T17:19:31.658 INFO:tasks.workunit.client.1.smithi069.stdout:8/977: symlink d37/d47/l151 0 2024-04-25T17:19:31.659 INFO:tasks.workunit.client.1.smithi069.stdout:3/996: truncate d8/d71/faf 3559810 0 2024-04-25T17:19:31.659 INFO:tasks.workunit.client.1.smithi069.stdout:4/949: dwrite db/d15/d82/df4/f112 [0,4194304] 0 2024-04-25T17:19:31.659 INFO:tasks.workunit.client.1.smithi069.stdout:3/997: chown d8/d2a 238280 1 2024-04-25T17:19:31.660 INFO:tasks.workunit.client.1.smithi069.stdout:3/998: chown d8/d10f 314 1 2024-04-25T17:19:31.660 INFO:tasks.workunit.client.1.smithi069.stdout:4/950: stat db/d15/d42/d64/fda 0 2024-04-25T17:19:31.661 INFO:tasks.workunit.client.1.smithi069.stdout:3/999: chown d8/d2a/f55 9 1 2024-04-25T17:19:31.661 INFO:tasks.workunit.client.1.smithi069.stdout:7/970: creat d4/d3e/d94/da1/dc7/f149 x:0 0 0 2024-04-25T17:19:31.664 INFO:tasks.workunit.client.1.smithi069.stdout:6/954: dread - d2/d1e/d43/da6/ff5 zero size 2024-04-25T17:19:31.665 INFO:tasks.workunit.client.1.smithi069.stdout:9/923: mknod d2/da4/dcf/d65/d88/c13d 0 2024-04-25T17:19:31.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:31 smithi069 ceph-mon[34527]: pgmap v46: 65 pgs: 65 active+clean; 3.7 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 86 MiB/s rd, 195 MiB/s wr, 483 op/s 2024-04-25T17:19:31.672 INFO:tasks.workunit.client.0.smithi037.stdout:0/993: write d9/d14/d28/d48/db7/fcd [3867990,41030] 0 2024-04-25T17:19:31.675 INFO:tasks.workunit.client.1.smithi069.stdout:4/951: mkdir db/d4b/d78/d79/da5/d150 0 2024-04-25T17:19:31.676 INFO:tasks.workunit.client.1.smithi069.stdout:7/971: creat d4/d1a/d126/f14a x:0 0 0 2024-04-25T17:19:31.678 INFO:tasks.workunit.client.0.smithi037.stdout:0/994: creat d9/d14/d28/d48/da9/ddc/d139/f145 x:0 0 0 2024-04-25T17:19:31.679 INFO:tasks.workunit.client.0.smithi037.stdout:3/767: dwrite d8/d57/fa1 [0,4194304] 0 2024-04-25T17:19:31.680 INFO:tasks.workunit.client.0.smithi037.stdout:0/995: stat d9/df/d32/d56/d106/f110 0 2024-04-25T17:19:31.680 INFO:tasks.workunit.client.1.smithi069.stdout:9/924: truncate d2/da/dd/de/d74/d8a/f107 912225 0 2024-04-25T17:19:31.681 INFO:tasks.workunit.client.1.smithi069.stdout:0/886: mknod d0/d17/d83/dcf/df1/c132 0 2024-04-25T17:19:31.681 INFO:tasks.workunit.client.1.smithi069.stdout:9/925: read - d2/da/fe3 zero size 2024-04-25T17:19:31.682 INFO:tasks.workunit.client.0.smithi037.stdout:0/996: write d9/df/df7/f11f [1605988,15833] 0 2024-04-25T17:19:31.682 INFO:tasks.workunit.client.1.smithi069.stdout:0/887: chown d0/da/lc4 6983947 1 2024-04-25T17:19:31.682 INFO:tasks.workunit.client.1.smithi069.stdout:4/952: rmdir db/d4b/d78/dc4 39 2024-04-25T17:19:31.684 INFO:tasks.workunit.client.0.smithi037.stdout:3/768: creat d8/d57/ff7 x:0 0 0 2024-04-25T17:19:31.685 INFO:tasks.workunit.client.1.smithi069.stdout:4/953: truncate db/d15/d20/d35/f14e 655905 0 2024-04-25T17:19:31.687 INFO:tasks.workunit.client.1.smithi069.stdout:7/972: dread - d4/d3e/d94/da1/fd1 zero size 2024-04-25T17:19:31.687 INFO:tasks.workunit.client.1.smithi069.stdout:6/955: dread d2/d9c/d97/dad/de8/f11a [0,4194304] 0 2024-04-25T17:19:31.688 INFO:tasks.workunit.client.0.smithi037.stdout:0/997: rename d9/df/dbd/de9/cf8 to d9/d72/c146 0 2024-04-25T17:19:31.689 INFO:tasks.workunit.client.1.smithi069.stdout:7/973: dread - d4/d3e/d94/da1/dc7/d14/d15/dda/d11d/f142 zero size 2024-04-25T17:19:31.691 INFO:tasks.workunit.client.1.smithi069.stdout:1/942: truncate d1/df/f42 137516 0 2024-04-25T17:19:31.691 INFO:tasks.workunit.client.1.smithi069.stdout:9/926: truncate d2/da4/dcf/f83 4334869 0 2024-04-25T17:19:31.692 INFO:tasks.workunit.client.1.smithi069.stdout:1/943: dread - d1/d4/d6/d4f/d9b/da3/f12b zero size 2024-04-25T17:19:31.693 INFO:tasks.workunit.client.0.smithi037.stdout:0/998: unlink d9/d14/d28/c42 0 2024-04-25T17:19:31.694 INFO:tasks.workunit.client.1.smithi069.stdout:2/955: truncate d0/d26/d10/f5c 5347833 0 2024-04-25T17:19:31.695 INFO:tasks.workunit.client.1.smithi069.stdout:4/954: mkdir db/d15/d20/d35/d63/d75/dc0/d151 0 2024-04-25T17:19:31.695 INFO:tasks.workunit.client.1.smithi069.stdout:6/956: fdatasync d2/d1e/d3f/d56/de5/ff9 0 2024-04-25T17:19:31.702 INFO:tasks.workunit.client.1.smithi069.stdout:9/927: truncate d2/da4/fd5 109603 0 2024-04-25T17:19:31.705 INFO:tasks.workunit.client.1.smithi069.stdout:2/956: unlink d0/d56/l4c 0 2024-04-25T17:19:31.706 INFO:tasks.workunit.client.1.smithi069.stdout:4/955: truncate db/d4b/d78/fed 111154 0 2024-04-25T17:19:31.709 INFO:tasks.workunit.client.0.smithi037.stdout:3/769: dread d8/d23/dbb/fb1 [0,4194304] 0 2024-04-25T17:19:31.710 INFO:tasks.workunit.client.1.smithi069.stdout:9/928: stat d2/da/dd/de/f4a 0 2024-04-25T17:19:31.712 INFO:tasks.workunit.client.1.smithi069.stdout:7/974: dread d4/d3e/d94/da1/dc7/d14/d5a/f7b [4194304,4194304] 0 2024-04-25T17:19:31.712 INFO:tasks.workunit.client.1.smithi069.stdout:9/929: chown d2/da/dd/d1e/d40/f5c 6809415 1 2024-04-25T17:19:31.713 INFO:tasks.workunit.client.1.smithi069.stdout:0/888: dwrite d0/d17/fa5 [0,4194304] 0 2024-04-25T17:19:31.714 INFO:tasks.workunit.client.1.smithi069.stdout:2/957: read - d0/d56/d5f/d62/d7d/d72/fb6 zero size 2024-04-25T17:19:31.716 INFO:tasks.workunit.client.1.smithi069.stdout:4/956: chown db/d4b/d78/dc4/d41/d9e 8222833 1 2024-04-25T17:19:31.717 INFO:tasks.workunit.client.0.smithi037.stdout:3/770: mkdir d8/d31/d32/df8 0 2024-04-25T17:19:31.717 INFO:tasks.workunit.client.1.smithi069.stdout:6/957: mkdir d2/d1e/d14a 0 2024-04-25T17:19:31.723 INFO:tasks.workunit.client.0.smithi037.stdout:0/999: dwrite d9/df/f45 [0,4194304] 0 2024-04-25T17:19:31.723 INFO:tasks.workunit.client.1.smithi069.stdout:6/958: dwrite d2/d1e/d3f/d56/fbd [0,4194304] 0 2024-04-25T17:19:31.725 INFO:tasks.workunit.client.1.smithi069.stdout:1/944: write d1/d4/d6/d4f/f83 [139268,106181] 0 2024-04-25T17:19:31.726 INFO:tasks.workunit.client.1.smithi069.stdout:1/945: write d1/df/f30 [2205903,23442] 0 2024-04-25T17:19:31.727 INFO:tasks.workunit.client.1.smithi069.stdout:7/975: chown d4/d3e/d94/da1/dc7/d14/d44/dd5/dd6/lf7 60968984 1 2024-04-25T17:19:31.730 INFO:tasks.workunit.client.1.smithi069.stdout:2/958: mknod d0/d56/d94/c139 0 2024-04-25T17:19:31.736 INFO:tasks.workunit.client.1.smithi069.stdout:0/889: dwrite d0/da/db/d2a/fe3 [4194304,4194304] 0 2024-04-25T17:19:31.740 INFO:tasks.workunit.client.1.smithi069.stdout:7/976: dwrite d4/d3e/d94/da1/dc7/d14/d44/dd5/dd6/f11f [0,4194304] 0 2024-04-25T17:19:31.740 INFO:tasks.workunit.client.1.smithi069.stdout:6/959: rename d2/d51/d89/dfd/d10f to d2/d1e/d43/dca/d138/d14b 0 2024-04-25T17:19:31.740 INFO:tasks.workunit.client.1.smithi069.stdout:0/890: write d0/da/db/d2a/d8c/f11d [457996,45950] 0 2024-04-25T17:19:31.742 INFO:tasks.workunit.client.1.smithi069.stdout:1/946: mknod d1/d4/d6/d4f/d9b/c130 0 2024-04-25T17:19:31.742 INFO:tasks.workunit.client.1.smithi069.stdout:0/891: write d0/da/d59/dab/d119/d8e/ff3 [138660,84646] 0 2024-04-25T17:19:31.746 INFO:tasks.workunit.client.1.smithi069.stdout:0/892: dread d0/da/db/def/f12a [0,4194304] 0 2024-04-25T17:19:31.746 INFO:tasks.workunit.client.1.smithi069.stdout:2/959: write d0/d56/d5f/d62/d7d/d72/fcf [5846925,119076] 0 2024-04-25T17:19:31.746 INFO:tasks.workunit.client.1.smithi069.stdout:0/893: fsync d0/d17/d95/fd8 0 2024-04-25T17:19:31.756 INFO:tasks.workunit.client.0.smithi037.stdout:3/771: dread d8/d31/d32/f36 [0,4194304] 0 2024-04-25T17:19:31.773 INFO:tasks.workunit.client.0.smithi037.stdout:3/772: dwrite d8/d23/dbb/f4f [0,4194304] 0 2024-04-25T17:19:31.777 INFO:tasks.workunit.client.0.smithi037.stdout:3/773: write d8/f5c [998169,85040] 0 2024-04-25T17:19:31.783 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:31 smithi037 ceph-mon[26472]: pgmap v46: 65 pgs: 65 active+clean; 3.7 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 86 MiB/s rd, 195 MiB/s wr, 483 op/s 2024-04-25T17:19:31.783 INFO:tasks.workunit.client.0.smithi037.stdout:6/972: sync 2024-04-25T17:19:31.786 INFO:tasks.workunit.client.0.smithi037.stdout:6/973: dread - db/d147/ff0 zero size 2024-04-25T17:19:31.786 INFO:tasks.workunit.client.0.smithi037.stdout:3/774: dwrite d8/d31/f52 [0,4194304] 0 2024-04-25T17:19:31.792 INFO:tasks.workunit.client.0.smithi037.stdout:6/974: link db/d147/d25/d61/c72 db/d1d/db1/d122/c164 0 2024-04-25T17:19:31.794 INFO:tasks.workunit.client.1.smithi069.stdout:9/930: dwrite d2/da/dd/de0/f112 [0,4194304] 0 2024-04-25T17:19:31.794 INFO:tasks.workunit.client.1.smithi069.stdout:0/894: mknod d0/d17/d83/dcf/c133 0 2024-04-25T17:19:31.794 INFO:tasks.workunit.client.1.smithi069.stdout:2/960: truncate d0/d26/d10/f97 6272469 0 2024-04-25T17:19:31.796 INFO:tasks.workunit.client.1.smithi069.stdout:7/977: write d4/d3e/dc8/fee [1294713,82257] 0 2024-04-25T17:19:31.799 INFO:tasks.workunit.client.1.smithi069.stdout:4/957: dwrite db/d15/d20/d35/d63/d43/d48/d49/d4e/fae [0,4194304] 0 2024-04-25T17:19:31.800 INFO:tasks.workunit.client.0.smithi037.stdout:6/975: dwrite db/d1d/d20/dcf/dfa/d65/d68/dae/fc5 [0,4194304] 0 2024-04-25T17:19:31.801 INFO:tasks.workunit.client.1.smithi069.stdout:6/960: getdents d2/d1e/d13a 0 2024-04-25T17:19:31.801 INFO:tasks.workunit.client.1.smithi069.stdout:7/978: fdatasync d4/d3e/d94/da1/dc7/d14/d5a/d5e/d89/f118 0 2024-04-25T17:19:31.802 INFO:tasks.workunit.client.1.smithi069.stdout:0/895: creat d0/da/d59/dab/de6/f134 x:0 0 0 2024-04-25T17:19:31.802 INFO:tasks.workunit.client.1.smithi069.stdout:4/958: write db/d15/d20/d35/d63/d70/d8a/d96/f10f [102555,125383] 0 2024-04-25T17:19:31.803 INFO:tasks.workunit.client.1.smithi069.stdout:6/961: readlink d2/d1e/l75 0 2024-04-25T17:19:31.805 INFO:tasks.workunit.client.1.smithi069.stdout:0/896: fdatasync d0/da/d24/d43/f10a 0 2024-04-25T17:19:31.806 INFO:tasks.workunit.client.1.smithi069.stdout:2/961: rmdir d0/d56/d94/d130 0 2024-04-25T17:19:31.810 INFO:tasks.workunit.client.1.smithi069.stdout:6/962: creat d2/d1e/d43/db6/daf/ddd/f14c x:0 0 0 2024-04-25T17:19:31.810 INFO:tasks.workunit.client.0.smithi037.stdout:6/976: link db/d147/d25/f104 db/d147/d25/db0/d14b/d139/d15c/f165 0 2024-04-25T17:19:31.812 INFO:tasks.workunit.client.1.smithi069.stdout:7/979: mknod d4/d3e/d94/da1/dc7/d14/d44/da8/c14b 0 2024-04-25T17:19:31.815 INFO:tasks.workunit.client.1.smithi069.stdout:6/963: mknod d2/d1e/d43/db6/c14d 0 2024-04-25T17:19:31.816 INFO:tasks.workunit.client.1.smithi069.stdout:6/964: read d2/f18 [39692,31835] 0 2024-04-25T17:19:31.816 INFO:tasks.workunit.client.1.smithi069.stdout:0/897: creat d0/d38/d75/df7/f135 x:0 0 0 2024-04-25T17:19:31.817 INFO:tasks.workunit.client.1.smithi069.stdout:2/962: dread - d0/d26/d10/d127/dc2/fad zero size 2024-04-25T17:19:31.818 INFO:tasks.workunit.client.1.smithi069.stdout:2/963: chown d0/d1/d5b/c88 3060 1 2024-04-25T17:19:31.818 INFO:tasks.workunit.client.1.smithi069.stdout:2/964: chown d0/d56/d5f/d62/cf6 4954412 1 2024-04-25T17:19:31.819 INFO:tasks.workunit.client.1.smithi069.stdout:7/980: link d4/d18/f144 d4/d83/d147/f14c 0 2024-04-25T17:19:31.819 INFO:tasks.workunit.client.0.smithi037.stdout:3/775: dread d8/d57/fc6 [0,4194304] 0 2024-04-25T17:19:31.820 INFO:tasks.workunit.client.1.smithi069.stdout:6/965: creat d2/d1e/d43/db6/f14e x:0 0 0 2024-04-25T17:19:31.820 INFO:tasks.workunit.client.1.smithi069.stdout:0/898: mkdir d0/da/db/d7e/d80/da9/d136 0 2024-04-25T17:19:31.822 INFO:tasks.workunit.client.0.smithi037.stdout:3/776: fdatasync d8/d4c/dd3/fb5 0 2024-04-25T17:19:31.824 INFO:tasks.workunit.client.1.smithi069.stdout:2/965: rename d0/d26/d36/db9/c114 to d0/d26/c13a 0 2024-04-25T17:19:31.826 INFO:tasks.workunit.client.1.smithi069.stdout:7/981: dwrite d4/d83/f115 [0,4194304] 0 2024-04-25T17:19:31.826 INFO:tasks.workunit.client.0.smithi037.stdout:3/777: rename d8/d23/dbb/l3b to d8/d31/d8d/db7/lf9 0 2024-04-25T17:19:31.828 INFO:tasks.workunit.client.1.smithi069.stdout:7/982: rename d4/d3e/d94/da1/dc7 to d4/d3e/d94/da1/dc7/d14/d3d/df6/d14d 22 2024-04-25T17:19:31.829 INFO:tasks.workunit.client.0.smithi037.stdout:3/778: rename d8/d31/d32/f39 to d8/d23/da0/ffa 0 2024-04-25T17:19:31.831 INFO:tasks.workunit.client.1.smithi069.stdout:6/966: getdents d2/d51/d85 0 2024-04-25T17:19:31.831 INFO:tasks.workunit.client.1.smithi069.stdout:6/967: readlink d2/d7/l76 0 2024-04-25T17:19:31.833 INFO:tasks.workunit.client.1.smithi069.stdout:6/968: chown d2/d1e/d43/ce9 40 1 2024-04-25T17:19:31.834 INFO:tasks.workunit.client.1.smithi069.stdout:6/969: readlink d2/d51/d85/lac 0 2024-04-25T17:19:31.834 INFO:tasks.workunit.client.1.smithi069.stdout:6/970: chown d2/d1e/cea 5179 1 2024-04-25T17:19:31.834 INFO:tasks.workunit.client.1.smithi069.stdout:4/959: dread db/d15/d20/d35/d63/d75/de6/f100 [0,4194304] 0 2024-04-25T17:19:31.835 INFO:tasks.workunit.client.1.smithi069.stdout:7/983: rename d4/d1a/l12c to d4/d3e/d94/da1/dc7/d14/d5a/d5e/d89/l14e 0 2024-04-25T17:19:31.837 INFO:tasks.workunit.client.1.smithi069.stdout:2/966: getdents d0/d1/d132 0 2024-04-25T17:19:31.837 INFO:tasks.workunit.client.1.smithi069.stdout:4/960: truncate db/d15/d20/d35/d63/d43/f11b 167123 0 2024-04-25T17:19:31.838 INFO:tasks.workunit.client.1.smithi069.stdout:4/961: write db/d15/d20/d35/d63/d43/d48/d49/d4e/fd2 [48338,120418] 0 2024-04-25T17:19:31.840 INFO:tasks.workunit.client.1.smithi069.stdout:4/962: write db/d15/d20/d35/d63/fa2 [400499,88996] 0 2024-04-25T17:19:31.840 INFO:tasks.workunit.client.0.smithi037.stdout:3/779: dwrite d8/d31/d8d/db7/fef [0,4194304] 0 2024-04-25T17:19:31.843 INFO:tasks.workunit.client.1.smithi069.stdout:7/984: mknod d4/d3e/d94/da1/dc7/d14/d15/d11b/c14f 0 2024-04-25T17:19:31.848 INFO:tasks.workunit.client.1.smithi069.stdout:0/899: dread d0/da/d24/d43/dfc/f20 [0,4194304] 0 2024-04-25T17:19:31.854 INFO:tasks.workunit.client.0.smithi037.stdout:6/977: truncate db/d1d/d20/f75 3110424 0 2024-04-25T17:19:31.855 INFO:tasks.workunit.client.1.smithi069.stdout:4/963: dwrite db/f12 [4194304,4194304] 0 2024-04-25T17:19:31.856 INFO:tasks.workunit.client.1.smithi069.stdout:4/964: read - db/d15/f113 zero size 2024-04-25T17:19:31.863 INFO:tasks.workunit.client.1.smithi069.stdout:8/978: sync 2024-04-25T17:19:31.864 INFO:tasks.workunit.client.1.smithi069.stdout:8/979: write d37/d47/d78/f90 [432672,50943] 0 2024-04-25T17:19:31.865 INFO:tasks.workunit.client.1.smithi069.stdout:7/985: rename d4/d3e/d94/da1/dc7/d14/d44/dd5/dd6/lf7 to d4/d3e/d94/da1/dc7/d14/d44/d7c/d9f/dcb/l150 0 2024-04-25T17:19:31.873 INFO:tasks.workunit.client.1.smithi069.stdout:4/965: rename db/d15/d42/d64/d7f/d102 to db/d15/d20/d35/d63/d70/d8a/d96/dbf/d103/d152 0 2024-04-25T17:19:31.875 INFO:tasks.workunit.client.1.smithi069.stdout:8/980: creat d37/d47/d78/d122/f152 x:0 0 0 2024-04-25T17:19:31.877 INFO:tasks.workunit.client.1.smithi069.stdout:7/986: rename d4/d3e/dc8/fee to d4/d3e/f151 0 2024-04-25T17:19:31.885 INFO:tasks.workunit.client.1.smithi069.stdout:0/900: write d0/da/db/d7e/d80/f45 [223040,42739] 0 2024-04-25T17:19:31.889 INFO:tasks.workunit.client.1.smithi069.stdout:8/981: creat d37/d47/d78/db3/d114/d6b/d14e/f153 x:0 0 0 2024-04-25T17:19:31.890 INFO:tasks.workunit.client.1.smithi069.stdout:8/982: readlink d37/l6c 0 2024-04-25T17:19:31.904 INFO:tasks.workunit.client.0.smithi037.stdout:3/780: symlink d8/d23/dc0/lfb 0 2024-04-25T17:19:31.906 INFO:tasks.workunit.client.0.smithi037.stdout:3/781: fdatasync d8/d31/d32/d87/ff3 0 2024-04-25T17:19:31.906 INFO:tasks.workunit.client.0.smithi037.stdout:6/978: creat db/d1d/db1/dc7/d11b/d123/f166 x:0 0 0 2024-04-25T17:19:31.908 INFO:tasks.workunit.client.0.smithi037.stdout:6/979: truncate db/d1d/d20/dcf/dfa/d65/d8b/dee/f11d 5202026 0 2024-04-25T17:19:31.908 INFO:tasks.workunit.client.0.smithi037.stdout:3/782: link d8/f1f d8/d23/dbb/d81/ffc 0 2024-04-25T17:19:31.910 INFO:tasks.workunit.client.0.smithi037.stdout:6/980: chown db/d1d/d20/dcf/dfa/d65/lc2 1 1 2024-04-25T17:19:31.911 INFO:tasks.workunit.client.0.smithi037.stdout:6/981: creat db/d1d/d20/d2f/f167 x:0 0 0 2024-04-25T17:19:31.912 INFO:tasks.workunit.client.0.smithi037.stdout:3/783: link d8/db4/cb9 d8/d23/d38/cfd 0 2024-04-25T17:19:31.913 INFO:tasks.workunit.client.0.smithi037.stdout:6/982: chown db/d1d/d20/dcf/dfa/d65/d68/d87/dbd/fd4 6 1 2024-04-25T17:19:31.914 INFO:tasks.workunit.client.0.smithi037.stdout:3/784: fdatasync d8/d23/dbb/fb1 0 2024-04-25T17:19:31.916 INFO:tasks.workunit.client.0.smithi037.stdout:6/983: unlink db/d1d/d20/d2f/f119 0 2024-04-25T17:19:31.917 INFO:tasks.workunit.client.0.smithi037.stdout:3/785: symlink d8/d31/lfe 0 2024-04-25T17:19:31.918 INFO:tasks.workunit.client.0.smithi037.stdout:3/786: chown d8/d31/d32/d87/ff3 2008637 1 2024-04-25T17:19:31.918 INFO:tasks.workunit.client.0.smithi037.stdout:3/787: dread - d8/d23/d38/fc9 zero size 2024-04-25T17:19:31.919 INFO:tasks.workunit.client.0.smithi037.stdout:6/984: mkdir db/d1d/d20/dcf/dfa/d168 0 2024-04-25T17:19:31.919 INFO:tasks.workunit.client.0.smithi037.stdout:3/788: chown d8/d57/fc6 4 1 2024-04-25T17:19:31.921 INFO:tasks.workunit.client.0.smithi037.stdout:6/985: symlink db/d147/d25/d10d/d124/d137/l169 0 2024-04-25T17:19:31.923 INFO:tasks.workunit.client.0.smithi037.stdout:6/986: truncate db/d147/d25/db0/d14b/d2e/f13e 215856 0 2024-04-25T17:19:31.930 INFO:tasks.workunit.client.0.smithi037.stdout:6/987: dwrite db/d1d/f156 [0,4194304] 0 2024-04-25T17:19:31.931 INFO:tasks.workunit.client.0.smithi037.stdout:6/988: stat db/d1d/d20/dcf/dfa/d65/d68/d87/dbd 0 2024-04-25T17:19:31.939 INFO:tasks.workunit.client.0.smithi037.stdout:3/789: truncate d8/d31/d8d/fdb 107562 0 2024-04-25T17:19:31.940 INFO:tasks.workunit.client.0.smithi037.stdout:3/790: fsync d8/d23/d38/fe1 0 2024-04-25T17:19:31.942 INFO:tasks.workunit.client.0.smithi037.stdout:3/791: mkdir d8/d23/d38/d66/dff 0 2024-04-25T17:19:31.950 INFO:tasks.workunit.client.0.smithi037.stdout:5/924: sync 2024-04-25T17:19:31.950 INFO:tasks.workunit.client.1.smithi069.stdout:0/901: truncate d0/da/d24/f6d 3226259 0 2024-04-25T17:19:31.951 INFO:tasks.workunit.client.1.smithi069.stdout:8/983: fsync d37/d47/d78/db3/d114/d6b/d11b/f13c 0 2024-04-25T17:19:31.953 INFO:tasks.workunit.client.1.smithi069.stdout:8/984: dread - d37/d47/d78/d93/df9/f134 zero size 2024-04-25T17:19:31.956 INFO:tasks.workunit.client.0.smithi037.stdout:5/925: dwrite d7/d18/d62/dd8/dc6/fd2 [0,4194304] 0 2024-04-25T17:19:31.956 INFO:tasks.workunit.client.1.smithi069.stdout:7/987: dwrite d4/d3e/d94/da1/dc7/f72 [0,4194304] 0 2024-04-25T17:19:31.958 INFO:tasks.workunit.client.1.smithi069.stdout:0/902: dwrite d0/f7c [0,4194304] 0 2024-04-25T17:19:31.959 INFO:tasks.workunit.client.1.smithi069.stdout:7/988: dread - d4/d3e/d94/da1/dc7/f149 zero size 2024-04-25T17:19:31.960 INFO:tasks.workunit.client.1.smithi069.stdout:0/903: write d0/da/d59/dab/fb7 [2900772,81087] 0 2024-04-25T17:19:31.961 INFO:tasks.workunit.client.0.smithi037.stdout:3/792: dwrite d8/d23/dbb/d5d/f3d [0,4194304] 0 2024-04-25T17:19:31.962 INFO:tasks.workunit.client.1.smithi069.stdout:8/985: dread d37/d62/f6d [0,4194304] 0 2024-04-25T17:19:31.963 INFO:tasks.workunit.client.0.smithi037.stdout:3/793: fdatasync d8/d23/dbb/d81/fac 0 2024-04-25T17:19:31.968 INFO:tasks.workunit.client.1.smithi069.stdout:1/947: sync 2024-04-25T17:19:31.970 INFO:tasks.workunit.client.0.smithi037.stdout:3/794: dread d8/d31/d8d/db7/fef [0,4194304] 0 2024-04-25T17:19:31.978 INFO:tasks.workunit.client.0.smithi037.stdout:3/795: rmdir d8/deb/d88 39 2024-04-25T17:19:31.985 INFO:tasks.workunit.client.0.smithi037.stdout:3/796: rmdir d8/d23/dbb 39 2024-04-25T17:19:31.987 INFO:tasks.workunit.client.0.smithi037.stdout:5/926: getdents d7/d12/d6f/d68 0 2024-04-25T17:19:31.991 INFO:tasks.workunit.client.0.smithi037.stdout:5/927: unlink d7/d12/f31 0 2024-04-25T17:19:31.995 INFO:tasks.workunit.client.1.smithi069.stdout:2/967: sync 2024-04-25T17:19:31.995 INFO:tasks.workunit.client.1.smithi069.stdout:9/931: sync 2024-04-25T17:19:31.995 INFO:tasks.workunit.client.1.smithi069.stdout:6/971: sync 2024-04-25T17:19:31.996 INFO:tasks.workunit.client.1.smithi069.stdout:9/932: write d2/da/f8c [2785413,14075] 0 2024-04-25T17:19:31.998 INFO:tasks.workunit.client.0.smithi037.stdout:5/928: truncate d7/d18/d62/dd8/f114 4753206 0 2024-04-25T17:19:32.001 INFO:tasks.workunit.client.0.smithi037.stdout:5/929: readlink d7/d43/d9f/l107 0 2024-04-25T17:19:32.005 INFO:tasks.workunit.client.0.smithi037.stdout:5/930: mknod d7/d25/d4f/da7/c116 0 2024-04-25T17:19:32.006 INFO:tasks.workunit.client.0.smithi037.stdout:5/931: write d7/d12/d5d/f7f [4071507,15459] 0 2024-04-25T17:19:32.013 INFO:tasks.workunit.client.0.smithi037.stdout:5/932: dread d7/d12/da8/f103 [0,4194304] 0 2024-04-25T17:19:32.014 INFO:tasks.workunit.client.0.smithi037.stdout:3/797: write d8/d4c/dd3/f76 [4126827,55153] 0 2024-04-25T17:19:32.016 INFO:tasks.workunit.client.1.smithi069.stdout:4/966: getdents db/d15/d20 0 2024-04-25T17:19:32.019 INFO:tasks.workunit.client.0.smithi037.stdout:3/798: creat d8/d31/d32/dd7/d7d/f100 x:0 0 0 2024-04-25T17:19:32.021 INFO:tasks.workunit.client.0.smithi037.stdout:5/933: mknod d7/d18/d62/dd8/c117 0 2024-04-25T17:19:32.024 INFO:tasks.workunit.client.0.smithi037.stdout:3/799: write d8/d23/dbb/d81/fac [2330088,116981] 0 2024-04-25T17:19:32.027 INFO:tasks.workunit.client.0.smithi037.stdout:5/934: dread d7/f49 [0,4194304] 0 2024-04-25T17:19:32.029 INFO:tasks.workunit.client.0.smithi037.stdout:3/800: rename d8/f58 to d8/d31/d32/d87/f101 0 2024-04-25T17:19:32.031 INFO:tasks.workunit.client.1.smithi069.stdout:0/904: dwrite d0/d17/f4a [0,4194304] 0 2024-04-25T17:19:32.033 INFO:tasks.workunit.client.1.smithi069.stdout:0/905: truncate d0/d38/d75/df7/f135 812025 0 2024-04-25T17:19:32.034 INFO:tasks.workunit.client.1.smithi069.stdout:0/906: chown d0/d17/d83/dcf/dd5/d12b 4842705 1 2024-04-25T17:19:32.034 INFO:tasks.workunit.client.1.smithi069.stdout:1/948: mknod d1/d4/d6/d9e/da6/d7c/d1d/de1/d8e/dbb/c131 0 2024-04-25T17:19:32.035 INFO:tasks.workunit.client.0.smithi037.stdout:3/801: rmdir d8/d23/dbb/d63 39 2024-04-25T17:19:32.036 INFO:tasks.workunit.client.1.smithi069.stdout:8/986: dread d37/d47/d54/d6e/d98/fb5 [0,4194304] 0 2024-04-25T17:19:32.036 INFO:tasks.workunit.client.0.smithi037.stdout:3/802: chown d8/d23/dbb/d81/fbe 664 1 2024-04-25T17:19:32.037 INFO:tasks.workunit.client.1.smithi069.stdout:6/972: unlink d2/f9 0 2024-04-25T17:19:32.042 INFO:tasks.workunit.client.0.smithi037.stdout:3/803: symlink d8/d23/d38/d66/l102 0 2024-04-25T17:19:32.046 INFO:tasks.workunit.client.1.smithi069.stdout:4/967: symlink db/d15/d20/d35/d63/d70/d8a/d96/dbf/d103/d152/d124/l153 0 2024-04-25T17:19:32.047 INFO:tasks.workunit.client.0.smithi037.stdout:3/804: creat d8/d31/d8d/f103 x:0 0 0 2024-04-25T17:19:32.050 INFO:tasks.workunit.client.1.smithi069.stdout:7/989: truncate d4/d1a/f35 4857322 0 2024-04-25T17:19:32.052 INFO:tasks.workunit.client.0.smithi037.stdout:3/805: truncate d8/d31/d32/dd7/f42 2245254 0 2024-04-25T17:19:32.052 INFO:tasks.workunit.client.0.smithi037.stdout:5/935: write d7/d12/da8/fd0 [3109958,64333] 0 2024-04-25T17:19:32.053 INFO:tasks.workunit.client.1.smithi069.stdout:1/949: truncate d1/df/d17/f70 2826364 0 2024-04-25T17:19:32.056 INFO:tasks.workunit.client.0.smithi037.stdout:5/936: unlink d7/d12/d6f/fcf 0 2024-04-25T17:19:32.056 INFO:tasks.workunit.client.1.smithi069.stdout:8/987: mkdir d37/d47/d48/d154 0 2024-04-25T17:19:32.059 INFO:tasks.workunit.client.1.smithi069.stdout:6/973: mknod d2/d1e/d43/dca/d138/d14b/c14f 0 2024-04-25T17:19:32.065 INFO:tasks.workunit.client.1.smithi069.stdout:4/968: creat db/d15/d42/f154 x:0 0 0 2024-04-25T17:19:32.066 INFO:tasks.workunit.client.1.smithi069.stdout:0/907: write d0/da/d24/fc9 [1466838,21158] 0 2024-04-25T17:19:32.072 INFO:tasks.workunit.client.1.smithi069.stdout:6/974: unlink d2/d9c/d97/d98/l111 0 2024-04-25T17:19:32.077 INFO:tasks.workunit.client.0.smithi037.stdout:3/806: write d8/d23/dbb/d81/fbe [491486,115705] 0 2024-04-25T17:19:32.079 INFO:tasks.workunit.client.1.smithi069.stdout:9/933: rename d2/da/dd/d1e/f5e to d2/da/dd/f13e 0 2024-04-25T17:19:32.080 INFO:tasks.workunit.client.1.smithi069.stdout:4/969: chown db/d15/d42/d53/c90 218624627 1 2024-04-25T17:19:32.080 INFO:tasks.workunit.client.0.smithi037.stdout:5/937: write d7/d12/d6f/d94/f9c [110725,5542] 0 2024-04-25T17:19:32.082 INFO:tasks.workunit.client.0.smithi037.stdout:3/807: dread d8/d31/d32/d87/f98 [0,4194304] 0 2024-04-25T17:19:32.083 INFO:tasks.workunit.client.1.smithi069.stdout:7/990: truncate d4/d1a/f24 6936598 0 2024-04-25T17:19:32.084 INFO:tasks.workunit.client.1.smithi069.stdout:8/988: write d37/d47/d54/d6e/d98/fad [105942,8116] 0 2024-04-25T17:19:32.085 INFO:tasks.workunit.client.1.smithi069.stdout:9/934: dwrite d2/da4/dcf/d65/f73 [0,4194304] 0 2024-04-25T17:19:32.087 INFO:tasks.workunit.client.0.smithi037.stdout:5/938: creat d7/d12/d6f/dbf/f118 x:0 0 0 2024-04-25T17:19:32.090 INFO:tasks.workunit.client.0.smithi037.stdout:3/808: creat d8/d23/dbb/d5d/f104 x:0 0 0 2024-04-25T17:19:32.094 INFO:tasks.workunit.client.1.smithi069.stdout:2/968: link d0/d56/d5f/d62/d7d/d72/c86 d0/d56/d5f/d62/dbc/c13b 0 2024-04-25T17:19:32.098 INFO:tasks.workunit.client.1.smithi069.stdout:6/975: rename d2/d1e/d3e to d2/d1e/d3f/d150 0 2024-04-25T17:19:32.100 INFO:tasks.workunit.client.1.smithi069.stdout:0/908: write d0/d38/fed [730527,6013] 0 2024-04-25T17:19:32.100 INFO:tasks.workunit.client.1.smithi069.stdout:0/909: readlink d0/d38/d75/lb0 0 2024-04-25T17:19:32.104 INFO:tasks.workunit.client.0.smithi037.stdout:5/939: rename d7/d12/d6f/d68/f76 to d7/d43/f119 0 2024-04-25T17:19:32.105 INFO:tasks.workunit.client.1.smithi069.stdout:9/935: dread d2/f29 [0,4194304] 0 2024-04-25T17:19:32.106 INFO:tasks.workunit.client.1.smithi069.stdout:7/991: unlink d4/d3e/d94/da1/dc7/fc1 0 2024-04-25T17:19:32.106 INFO:tasks.workunit.client.0.smithi037.stdout:5/940: read d7/d25/d4f/f82 [493948,111707] 0 2024-04-25T17:19:32.106 INFO:tasks.workunit.client.0.smithi037.stdout:8/835: sync 2024-04-25T17:19:32.106 INFO:tasks.workunit.client.0.smithi037.stdout:7/901: sync 2024-04-25T17:19:32.110 INFO:tasks.workunit.client.0.smithi037.stdout:3/809: write d8/f2c [176582,112815] 0 2024-04-25T17:19:32.111 INFO:tasks.workunit.client.0.smithi037.stdout:3/810: chown d8/d23/dbb/d5d/l80 11 1 2024-04-25T17:19:32.112 INFO:tasks.workunit.client.1.smithi069.stdout:0/910: dread d0/da/db/d3a/f5a [0,4194304] 0 2024-04-25T17:19:32.112 INFO:tasks.workunit.client.0.smithi037.stdout:8/836: truncate d5/db/d18/d3b/d50/fa4 2602551 0 2024-04-25T17:19:32.113 INFO:tasks.workunit.client.0.smithi037.stdout:3/811: stat d8/d31/d8d 0 2024-04-25T17:19:32.113 INFO:tasks.workunit.client.0.smithi037.stdout:5/941: truncate d7/d18/fff 862251 0 2024-04-25T17:19:32.114 INFO:tasks.workunit.client.1.smithi069.stdout:4/970: creat db/db0/d134/d14d/f155 x:0 0 0 2024-04-25T17:19:32.115 INFO:tasks.workunit.client.0.smithi037.stdout:7/902: mkdir d5/d15/d17/d25/d12b 0 2024-04-25T17:19:32.116 INFO:tasks.workunit.client.0.smithi037.stdout:7/903: chown d5/d15/d17/d1b/da2/l108 1046246058 1 2024-04-25T17:19:32.116 INFO:tasks.workunit.client.0.smithi037.stdout:3/812: mknod d8/d23/dbb/d81/c105 0 2024-04-25T17:19:32.119 INFO:tasks.workunit.client.1.smithi069.stdout:9/936: creat d2/da/dd/d1e/d2e/d68/dba/ded/d128/f13f x:0 0 0 2024-04-25T17:19:32.120 INFO:tasks.workunit.client.1.smithi069.stdout:8/989: creat d37/d47/d78/db3/d114/d6b/d111/f155 x:0 0 0 2024-04-25T17:19:32.121 INFO:tasks.workunit.client.0.smithi037.stdout:5/942: read d7/d18/d62/fd4 [328270,91417] 0 2024-04-25T17:19:32.125 INFO:tasks.workunit.client.1.smithi069.stdout:2/969: creat d0/d56/d135/f13c x:0 0 0 2024-04-25T17:19:32.129 INFO:tasks.workunit.client.0.smithi037.stdout:7/904: symlink d5/d15/d17/d1b/l12c 0 2024-04-25T17:19:32.132 INFO:tasks.workunit.client.1.smithi069.stdout:0/911: unlink d0/d38/d75/lb0 0 2024-04-25T17:19:32.135 INFO:tasks.workunit.client.0.smithi037.stdout:3/813: symlink d8/d23/l106 0 2024-04-25T17:19:32.136 INFO:tasks.workunit.client.1.smithi069.stdout:0/912: dread d0/da/d24/d67/db8/fbe [0,4194304] 0 2024-04-25T17:19:32.136 INFO:tasks.workunit.client.0.smithi037.stdout:3/814: dread - d8/d23/dbb/d81/dc3/ff0 zero size 2024-04-25T17:19:32.137 INFO:tasks.workunit.client.0.smithi037.stdout:3/815: dread - d8/d31/d32/dd7/fe7 zero size 2024-04-25T17:19:32.139 INFO:tasks.workunit.client.1.smithi069.stdout:1/950: dread d1/df/d17/f70 [0,4194304] 0 2024-04-25T17:19:32.141 INFO:tasks.workunit.client.1.smithi069.stdout:7/992: write d4/d3e/d94/da1/dc7/d14/d15/f90 [341088,82454] 0 2024-04-25T17:19:32.142 INFO:tasks.workunit.client.0.smithi037.stdout:8/837: dwrite d5/d26/d33/f34 [0,4194304] 0 2024-04-25T17:19:32.151 INFO:tasks.workunit.client.0.smithi037.stdout:5/943: rmdir d7/d25/d4f/dee 0 2024-04-25T17:19:32.156 INFO:tasks.workunit.client.0.smithi037.stdout:7/905: link d5/d15/c39 d5/d15/d17/d25/d2b/dcb/c12d 0 2024-04-25T17:19:32.157 INFO:tasks.workunit.client.0.smithi037.stdout:3/816: dread d8/d31/d32/dd7/f6e [4194304,4194304] 0 2024-04-25T17:19:32.158 INFO:tasks.workunit.client.1.smithi069.stdout:0/913: symlink d0/da/db/d7e/d80/l137 0 2024-04-25T17:19:32.160 INFO:tasks.workunit.client.1.smithi069.stdout:4/971: truncate db/d15/d42/d64/d7f/df7/f146 4882852 0 2024-04-25T17:19:32.160 INFO:tasks.workunit.client.1.smithi069.stdout:2/970: write d0/d56/d94/f110 [3786230,6051] 0 2024-04-25T17:19:32.161 INFO:tasks.workunit.client.0.smithi037.stdout:3/817: dread d8/d31/d32/f36 [0,4194304] 0 2024-04-25T17:19:32.162 INFO:tasks.workunit.client.1.smithi069.stdout:9/937: dwrite d2/da4/fc7 [0,4194304] 0 2024-04-25T17:19:32.164 INFO:tasks.workunit.client.1.smithi069.stdout:8/990: symlink d37/d47/d78/db3/d114/l156 0 2024-04-25T17:19:32.165 INFO:tasks.workunit.client.0.smithi037.stdout:8/838: rename d5/d26/d33/c5b to d5/dd0/c110 0 2024-04-25T17:19:32.166 INFO:tasks.workunit.client.1.smithi069.stdout:7/993: dread - d4/d3e/d94/f107 zero size 2024-04-25T17:19:32.167 INFO:tasks.workunit.client.0.smithi037.stdout:7/906: creat d5/d15/d17/d1b/da2/d76/f12e x:0 0 0 2024-04-25T17:19:32.167 INFO:tasks.workunit.client.0.smithi037.stdout:8/839: read - d5/db/d18/d3b/d50/d51/f69 zero size 2024-04-25T17:19:32.171 INFO:tasks.workunit.client.1.smithi069.stdout:0/914: mknod d0/d38/c138 0 2024-04-25T17:19:32.172 INFO:tasks.workunit.client.1.smithi069.stdout:4/972: write db/d4b/d78/d79/da5/fbb [769978,99576] 0 2024-04-25T17:19:32.173 INFO:tasks.workunit.client.1.smithi069.stdout:8/991: dwrite d37/d47/d78/db3/d114/d6b/daf/de6/f129 [0,4194304] 0 2024-04-25T17:19:32.174 INFO:tasks.workunit.client.0.smithi037.stdout:7/907: dwrite d5/d15/f1f [0,4194304] 0 2024-04-25T17:19:32.175 INFO:tasks.workunit.client.1.smithi069.stdout:7/994: dwrite d4/d3e/d94/da1/dc7/d14/d5a/d5e/f95 [0,4194304] 0 2024-04-25T17:19:32.177 INFO:tasks.workunit.client.1.smithi069.stdout:2/971: fsync d0/d1/d5b/d33/f67 0 2024-04-25T17:19:32.177 INFO:tasks.workunit.client.1.smithi069.stdout:4/973: dread db/d4b/f6e [0,4194304] 0 2024-04-25T17:19:32.177 INFO:tasks.workunit.client.1.smithi069.stdout:7/995: readlink d4/d3e/d94/da1/dc7/d14/d5a/l64 0 2024-04-25T17:19:32.179 INFO:tasks.workunit.client.1.smithi069.stdout:4/974: read db/d4b/f6e [395083,81400] 0 2024-04-25T17:19:32.180 INFO:tasks.workunit.client.0.smithi037.stdout:5/944: link d7/d12/d6f/d68/ca2 d7/d43/d9f/c11a 0 2024-04-25T17:19:32.181 INFO:tasks.workunit.client.0.smithi037.stdout:5/945: chown d7/da1/dda/lf3 4036045 1 2024-04-25T17:19:32.182 INFO:tasks.workunit.client.1.smithi069.stdout:4/975: chown db/d15/d20/d35/d63/d43/d48/d49/d72/c81 22010729 1 2024-04-25T17:19:32.186 INFO:tasks.workunit.client.1.smithi069.stdout:7/996: dwrite d4/d83/f8f [0,4194304] 0 2024-04-25T17:19:32.189 INFO:tasks.workunit.client.0.smithi037.stdout:7/908: rename d5/d15/d17/d9d/fac to d5/d14/db1/f12f 0 2024-04-25T17:19:32.191 INFO:tasks.workunit.client.0.smithi037.stdout:6/989: sync 2024-04-25T17:19:32.194 INFO:tasks.workunit.client.0.smithi037.stdout:5/946: creat d7/d25/d4f/da7/dab/f11b x:0 0 0 2024-04-25T17:19:32.194 INFO:tasks.workunit.client.0.smithi037.stdout:3/818: write d8/deb/fb0 [376862,98628] 0 2024-04-25T17:19:32.200 INFO:tasks.workunit.client.1.smithi069.stdout:6/976: link d2/d9c/d48/c8c d2/d1e/d43/dca/d10d/c151 0 2024-04-25T17:19:32.201 INFO:tasks.workunit.client.0.smithi037.stdout:7/909: symlink d5/dc1/l130 0 2024-04-25T17:19:32.204 INFO:tasks.workunit.client.1.smithi069.stdout:1/951: truncate d1/d4/d6/d9e/da6/d7c/f14 3033525 0 2024-04-25T17:19:32.206 INFO:tasks.workunit.client.0.smithi037.stdout:6/990: creat db/d1d/d20/dcf/dfa/d65/d68/d101/f16a x:0 0 0 2024-04-25T17:19:32.207 INFO:tasks.workunit.client.0.smithi037.stdout:5/947: symlink d7/d12/d6f/dbf/dc2/l11c 0 2024-04-25T17:19:32.208 INFO:tasks.workunit.client.0.smithi037.stdout:8/840: dwrite d5/db/d23/d78/f83 [0,4194304] 0 2024-04-25T17:19:32.208 INFO:tasks.workunit.client.0.smithi037.stdout:7/910: dread d5/d15/d17/d1b/fcd [0,4194304] 0 2024-04-25T17:19:32.209 INFO:tasks.workunit.client.1.smithi069.stdout:2/972: truncate d0/d56/d5f/d62/d7d/d31/f48 950879 0 2024-04-25T17:19:32.210 INFO:tasks.workunit.client.1.smithi069.stdout:2/973: readlink d0/d56/d5f/d62/lbf 0 2024-04-25T17:19:32.211 INFO:tasks.workunit.client.1.smithi069.stdout:2/974: read - d0/d26/d10/d127/dc2/fad zero size 2024-04-25T17:19:32.213 INFO:tasks.workunit.client.1.smithi069.stdout:6/977: dread d2/d1e/d43/fc9 [0,4194304] 0 2024-04-25T17:19:32.215 INFO:tasks.workunit.client.0.smithi037.stdout:5/948: fsync f1 0 2024-04-25T17:19:32.220 INFO:tasks.workunit.client.0.smithi037.stdout:6/991: mkdir db/d147/d25/db0/d14b/d2e/d16b 0 2024-04-25T17:19:32.222 INFO:tasks.workunit.client.1.smithi069.stdout:4/976: mkdir db/d4b/d78/dc4/d41/d9e/df2/d11f/d126/d156 0 2024-04-25T17:19:32.223 INFO:tasks.workunit.client.0.smithi037.stdout:8/841: unlink d5/d26/d33/lad 0 2024-04-25T17:19:32.226 INFO:tasks.workunit.client.1.smithi069.stdout:7/997: truncate d4/d83/da2/fd8 101618 0 2024-04-25T17:19:32.228 INFO:tasks.workunit.client.0.smithi037.stdout:7/911: fsync d5/d14/d31/fa1 0 2024-04-25T17:19:32.228 INFO:tasks.workunit.client.0.smithi037.stdout:8/842: dread d5/db/d23/d78/f83 [0,4194304] 0 2024-04-25T17:19:32.232 INFO:tasks.workunit.client.1.smithi069.stdout:4/977: symlink db/d15/d20/d35/d63/d43/d48/d49/d72/d84/l157 0 2024-04-25T17:19:32.233 INFO:tasks.workunit.client.0.smithi037.stdout:7/912: symlink d5/d15/dd8/l131 0 2024-04-25T17:19:32.233 INFO:tasks.workunit.client.1.smithi069.stdout:4/978: write db/d15/d20/d35/d63/d70/d8a/d96/dbf/d103/f14c [5174,65073] 0 2024-04-25T17:19:32.236 INFO:tasks.workunit.client.0.smithi037.stdout:7/913: mkdir d5/d15/dd8/d106/d132 0 2024-04-25T17:19:32.239 INFO:tasks.workunit.client.1.smithi069.stdout:0/915: getdents d0/d17/d83 0 2024-04-25T17:19:32.240 INFO:tasks.workunit.client.1.smithi069.stdout:8/992: dread d37/d47/d78/db3/d114/d6b/fe5 [0,4194304] 0 2024-04-25T17:19:32.245 INFO:tasks.workunit.client.1.smithi069.stdout:9/938: link d2/da/dd/de/d64/cf0 d2/da/d5f/d76/c140 0 2024-04-25T17:19:32.245 INFO:tasks.workunit.client.1.smithi069.stdout:9/939: stat d2/f29 0 2024-04-25T17:19:32.246 INFO:tasks.workunit.client.0.smithi037.stdout:7/914: dread d5/d15/d17/d1b/da2/fce [0,4194304] 0 2024-04-25T17:19:32.247 INFO:tasks.workunit.client.1.smithi069.stdout:0/916: write d0/da/d24/f11e [319420,54118] 0 2024-04-25T17:19:32.248 INFO:tasks.workunit.client.1.smithi069.stdout:0/917: stat d0/da/d24/d43/f7f 0 2024-04-25T17:19:32.253 INFO:tasks.workunit.client.0.smithi037.stdout:7/915: dwrite d5/d15/dd8/db5/f111 [0,4194304] 0 2024-04-25T17:19:32.254 INFO:tasks.workunit.client.1.smithi069.stdout:7/998: dread d4/d3e/d94/fd0 [0,4194304] 0 2024-04-25T17:19:32.254 INFO:tasks.workunit.client.1.smithi069.stdout:9/940: rmdir d2/da/dd/de/d74/dbc 39 2024-04-25T17:19:32.255 INFO:tasks.workunit.client.1.smithi069.stdout:9/941: chown d2/da/dd/d1e/d2e/d35/d120 1 1 2024-04-25T17:19:32.256 INFO:tasks.workunit.client.1.smithi069.stdout:0/918: fdatasync d0/f7c 0 2024-04-25T17:19:32.261 INFO:tasks.workunit.client.1.smithi069.stdout:7/999: fdatasync d4/d4c/f12f 0 2024-04-25T17:19:32.265 INFO:tasks.workunit.client.1.smithi069.stdout:6/978: dread d2/d1e/d3f/f96 [0,4194304] 0 2024-04-25T17:19:32.265 INFO:tasks.workunit.client.1.smithi069.stdout:1/952: dwrite d1/d4/d6/d9e/da6/d7c/d1d/fb2 [0,4194304] 0 2024-04-25T17:19:32.267 INFO:tasks.workunit.client.1.smithi069.stdout:0/919: rename d0/da/d6e/d90 to d0/da/db/d56/d98/d139 0 2024-04-25T17:19:32.269 INFO:tasks.workunit.client.1.smithi069.stdout:0/920: write d0/d17/d83/dcf/de4/f100 [1929678,98938] 0 2024-04-25T17:19:32.270 INFO:tasks.workunit.client.1.smithi069.stdout:9/942: link d2/da4/faf d2/da/d5f/d115/f141 0 2024-04-25T17:19:32.270 INFO:tasks.workunit.client.1.smithi069.stdout:1/953: dread d1/d4/d6/d9e/fa2 [0,4194304] 0 2024-04-25T17:19:32.272 INFO:tasks.workunit.client.0.smithi037.stdout:5/949: truncate d7/d43/f52 341417 0 2024-04-25T17:19:32.278 INFO:tasks.workunit.client.0.smithi037.stdout:8/843: write d5/db/d18/d3b/d75/f9e [3089472,112543] 0 2024-04-25T17:19:32.279 INFO:tasks.workunit.client.0.smithi037.stdout:8/844: readlink d5/dbc/ld7 0 2024-04-25T17:19:32.283 INFO:tasks.workunit.client.0.smithi037.stdout:5/950: rename d7/d12/ce3 to d7/d25/d4f/da7/c11d 0 2024-04-25T17:19:32.284 INFO:tasks.workunit.client.0.smithi037.stdout:5/951: stat d7/d12/f115 0 2024-04-25T17:19:32.287 INFO:tasks.workunit.client.0.smithi037.stdout:8/845: getdents d5/db/d18/d3b/d50/da0/da6 0 2024-04-25T17:19:32.288 INFO:tasks.workunit.client.0.smithi037.stdout:7/916: write d5/d15/d17/d1b/da2/f61 [578251,38900] 0 2024-04-25T17:19:32.289 INFO:tasks.workunit.client.1.smithi069.stdout:0/921: mkdir d0/d38/d75/df7/d13a 0 2024-04-25T17:19:32.290 INFO:tasks.workunit.client.0.smithi037.stdout:7/917: readlink d5/d15/l56 0 2024-04-25T17:19:32.290 INFO:tasks.workunit.client.1.smithi069.stdout:2/975: dwrite d0/d1/d5b/fbb [0,4194304] 0 2024-04-25T17:19:32.291 INFO:tasks.workunit.client.1.smithi069.stdout:8/993: write d37/d47/d54/fae [1078520,27210] 0 2024-04-25T17:19:32.291 INFO:tasks.workunit.client.0.smithi037.stdout:8/846: fsync d5/db/d23/d58/f79 0 2024-04-25T17:19:32.292 INFO:tasks.workunit.client.1.smithi069.stdout:0/922: stat d0/l1e 0 2024-04-25T17:19:32.292 INFO:tasks.workunit.client.1.smithi069.stdout:4/979: write db/d4b/d78/fed [797491,78835] 0 2024-04-25T17:19:32.293 INFO:tasks.workunit.client.1.smithi069.stdout:2/976: read - d0/d56/d5f/d62/d7d/f11b zero size 2024-04-25T17:19:32.296 INFO:tasks.workunit.client.0.smithi037.stdout:7/918: chown d5/dc1/cea 6929905 1 2024-04-25T17:19:32.299 INFO:tasks.workunit.client.0.smithi037.stdout:7/919: read d5/d15/d17/d1b/da2/d76/f77 [7509895,12487] 0 2024-04-25T17:19:32.301 INFO:tasks.workunit.client.0.smithi037.stdout:7/920: dread d5/d14/d31/fa1 [0,4194304] 0 2024-04-25T17:19:32.302 INFO:tasks.workunit.client.0.smithi037.stdout:7/921: dread - d5/d15/d17/d25/d2b/d48/fff zero size 2024-04-25T17:19:32.304 INFO:tasks.workunit.client.0.smithi037.stdout:5/952: dread d7/d18/d62/fd4 [0,4194304] 0 2024-04-25T17:19:32.305 INFO:tasks.workunit.client.1.smithi069.stdout:9/943: symlink d2/da/dd/d1e/d2e/d68/d8f/l142 0 2024-04-25T17:19:32.306 INFO:tasks.workunit.client.1.smithi069.stdout:9/944: chown d2/da/dd/d1e/d2e/d68/dba/dd1/fdc 13 1 2024-04-25T17:19:32.307 INFO:tasks.workunit.client.1.smithi069.stdout:8/994: fsync d37/d47/d78/f88 0 2024-04-25T17:19:32.308 INFO:tasks.workunit.client.1.smithi069.stdout:8/995: stat d37/d47/d78/db3/d114/d6b/f96 0 2024-04-25T17:19:32.310 INFO:tasks.workunit.client.0.smithi037.stdout:7/922: mknod d5/d15/d17/d1b/da2/daf/dc8/c133 0 2024-04-25T17:19:32.315 INFO:tasks.workunit.client.1.smithi069.stdout:9/945: stat d2/da/dd/de/f48 0 2024-04-25T17:19:32.315 INFO:tasks.workunit.client.1.smithi069.stdout:0/923: dread d0/d17/f10f [0,4194304] 0 2024-04-25T17:19:32.317 INFO:tasks.workunit.client.0.smithi037.stdout:5/953: symlink d7/d18/d62/l11e 0 2024-04-25T17:19:32.318 INFO:tasks.workunit.client.1.smithi069.stdout:8/996: symlink d37/d47/d78/db3/d114/d6b/d111/l157 0 2024-04-25T17:19:32.319 INFO:tasks.workunit.client.1.smithi069.stdout:8/997: chown d37/d62/ffc 296 1 2024-04-25T17:19:32.319 INFO:tasks.workunit.client.0.smithi037.stdout:7/923: symlink d5/d15/d17/d25/d2b/dcb/dda/l134 0 2024-04-25T17:19:32.320 INFO:tasks.workunit.client.1.smithi069.stdout:2/977: write d0/d26/f2f [467861,61084] 0 2024-04-25T17:19:32.320 INFO:tasks.workunit.client.1.smithi069.stdout:8/998: write d37/d47/d48/f131 [22627,77558] 0 2024-04-25T17:19:32.322 INFO:tasks.workunit.client.1.smithi069.stdout:2/978: write d0/d56/d5f/d62/d7d/d31/f11f [752632,65441] 0 2024-04-25T17:19:32.323 INFO:tasks.workunit.client.0.smithi037.stdout:8/847: rename d5/db/fb8 to d5/f111 0 2024-04-25T17:19:32.324 INFO:tasks.workunit.client.1.smithi069.stdout:1/954: dread d1/d4/d6/d9e/f8d [0,4194304] 0 2024-04-25T17:19:32.324 INFO:tasks.workunit.client.1.smithi069.stdout:9/946: mkdir d2/da4/dcf/d65/d143 0 2024-04-25T17:19:32.325 INFO:tasks.workunit.client.0.smithi037.stdout:8/848: chown d5/db/d18/d3b/d75 5 1 2024-04-25T17:19:32.326 INFO:tasks.workunit.client.1.smithi069.stdout:0/924: mkdir d0/da/db/d7e/d13b 0 2024-04-25T17:19:32.326 INFO:tasks.workunit.client.1.smithi069.stdout:0/925: dread - d0/da/db/def/d11f/f116 zero size 2024-04-25T17:19:32.329 INFO:tasks.workunit.client.0.smithi037.stdout:7/924: rename d5/d15/d17/f1c to d5/d15/d17/d25/d2b/d59/dfe/d10e/d11f/f135 0 2024-04-25T17:19:32.330 INFO:tasks.workunit.client.0.smithi037.stdout:7/925: readlink d5/d15/d17/d1b/da2/daf/l36 0 2024-04-25T17:19:32.331 INFO:tasks.workunit.client.1.smithi069.stdout:0/926: dwrite d0/da/d24/d43/dfc/d89/fbc [0,4194304] 0 2024-04-25T17:19:32.334 INFO:tasks.workunit.client.1.smithi069.stdout:4/980: link f8 db/d15/d20/d35/d63/d70/f158 0 2024-04-25T17:19:32.335 INFO:tasks.workunit.client.0.smithi037.stdout:8/849: creat d5/db/d18/d3b/de6/f112 x:0 0 0 2024-04-25T17:19:32.340 INFO:tasks.workunit.client.0.smithi037.stdout:7/926: rename d5/d15/d17/d25/d2b/de5 to d5/d15/d17/d1b/da2/daf/dc5/d136 0 2024-04-25T17:19:32.342 INFO:tasks.workunit.client.0.smithi037.stdout:7/927: write d5/d15/f10c [957550,6391] 0 2024-04-25T17:19:32.342 INFO:tasks.workunit.client.1.smithi069.stdout:9/947: creat d2/da/dd/de/d64/dd2/f144 x:0 0 0 2024-04-25T17:19:32.343 INFO:tasks.workunit.client.0.smithi037.stdout:7/928: chown d5/d15/d17/d25/d2b/l2c 704 1 2024-04-25T17:19:32.343 INFO:tasks.workunit.client.1.smithi069.stdout:9/948: chown d2/da/dd/d1e/d2e/d68/dba/ded/c10a 20110 1 2024-04-25T17:19:32.348 INFO:tasks.workunit.client.1.smithi069.stdout:0/927: rename d0/d17/d83/dcf to d0/d17/d40/d126/d13c 0 2024-04-25T17:19:32.349 INFO:tasks.workunit.client.0.smithi037.stdout:5/954: write d7/d12/d6f/dbf/fc5 [5075499,121578] 0 2024-04-25T17:19:32.351 INFO:tasks.workunit.client.0.smithi037.stdout:8/850: rename d5/db/d23/d58/f79 to d5/db/d23/d78/d9c/f113 0 2024-04-25T17:19:32.355 INFO:tasks.workunit.client.0.smithi037.stdout:5/955: truncate d7/d25/d4f/fd1 188528 0 2024-04-25T17:19:32.360 INFO:tasks.workunit.client.1.smithi069.stdout:1/955: mkdir d1/d43/d1b/d32/d132 0 2024-04-25T17:19:32.361 INFO:tasks.workunit.client.0.smithi037.stdout:5/956: dread - d7/d12/da8/fdd zero size 2024-04-25T17:19:32.362 INFO:tasks.workunit.client.0.smithi037.stdout:5/957: readlink d7/d12/d6f/l85 0 2024-04-25T17:19:32.363 INFO:tasks.workunit.client.1.smithi069.stdout:9/949: mknod d2/da/dd/d1e/d2e/d35/d120/c145 0 2024-04-25T17:19:32.367 INFO:tasks.workunit.client.1.smithi069.stdout:4/981: write db/d15/d20/d35/d63/f60 [613238,100282] 0 2024-04-25T17:19:32.368 INFO:tasks.workunit.client.1.smithi069.stdout:8/999: truncate d37/d47/d78/db3/d114/fa3 3119143 0 2024-04-25T17:19:32.370 INFO:tasks.workunit.client.1.smithi069.stdout:0/928: symlink d0/d38/d75/df7/l13d 0 2024-04-25T17:19:32.370 INFO:tasks.workunit.client.0.smithi037.stdout:8/851: truncate d5/db/d23/d78/d9c/f113 303875 0 2024-04-25T17:19:32.371 INFO:tasks.workunit.client.1.smithi069.stdout:6/979: sync 2024-04-25T17:19:32.371 INFO:tasks.workunit.client.0.smithi037.stdout:7/929: link d5/d15/d17/d1b/cc2 d5/dc1/c137 0 2024-04-25T17:19:32.373 INFO:tasks.workunit.client.1.smithi069.stdout:1/956: chown d1/d4/d6/d9e/da6/f55 3 1 2024-04-25T17:19:32.378 INFO:tasks.workunit.client.1.smithi069.stdout:1/957: dwrite d1/d4/d6/d9e/da6/d38/f90 [0,4194304] 0 2024-04-25T17:19:32.379 INFO:tasks.workunit.client.1.smithi069.stdout:1/958: chown d1/df/d17 12046560 1 2024-04-25T17:19:32.385 INFO:tasks.workunit.client.0.smithi037.stdout:5/958: creat d7/d12/f11f x:0 0 0 2024-04-25T17:19:32.387 INFO:tasks.workunit.client.0.smithi037.stdout:8/852: write d5/db/d18/d3b/fb2 [4313994,48893] 0 2024-04-25T17:19:32.392 INFO:tasks.workunit.client.0.smithi037.stdout:5/959: creat d7/d12/d5d/d90/db1/db3/f120 x:0 0 0 2024-04-25T17:19:32.392 INFO:tasks.workunit.client.1.smithi069.stdout:4/982: write db/d15/d20/d35/d63/fd8 [619257,89089] 0 2024-04-25T17:19:32.392 INFO:tasks.workunit.client.1.smithi069.stdout:6/980: readlink d2/d9c/d97/dad/df1/l140 0 2024-04-25T17:19:32.392 INFO:tasks.workunit.client.1.smithi069.stdout:2/979: getdents d0/d26/d10/db5/de3 0 2024-04-25T17:19:32.394 INFO:tasks.workunit.client.0.smithi037.stdout:8/853: chown d5/db/d18/d3b/d50/d51/l84 407757629 1 2024-04-25T17:19:32.394 INFO:tasks.workunit.client.1.smithi069.stdout:9/950: symlink d2/da4/dcf/d65/d143/l146 0 2024-04-25T17:19:32.395 INFO:tasks.workunit.client.1.smithi069.stdout:0/929: mkdir d0/da/d24/d43/d102/d13e 0 2024-04-25T17:19:32.397 INFO:tasks.workunit.client.1.smithi069.stdout:0/930: write d0/d38/fed [485554,41303] 0 2024-04-25T17:19:32.397 INFO:tasks.workunit.client.0.smithi037.stdout:8/854: truncate d5/d26/d33/f34 4308066 0 2024-04-25T17:19:32.397 INFO:tasks.workunit.client.1.smithi069.stdout:0/931: dread - d0/d17/f128 zero size 2024-04-25T17:19:32.398 INFO:tasks.workunit.client.1.smithi069.stdout:2/980: mkdir d0/d1/d5b/d33/d13d 0 2024-04-25T17:19:32.398 INFO:tasks.workunit.client.1.smithi069.stdout:2/981: readlink d0/l1e 0 2024-04-25T17:19:32.399 INFO:tasks.workunit.client.0.smithi037.stdout:7/930: dwrite d5/d15/d17/d1b/da2/daf/fe3 [0,4194304] 0 2024-04-25T17:19:32.399 INFO:tasks.workunit.client.1.smithi069.stdout:2/982: fsync d0/d26/d10/d43/fbe 0 2024-04-25T17:19:32.400 INFO:tasks.workunit.client.0.smithi037.stdout:5/960: rename d7/d12/d5d/f81 to d7/d12/d6f/d94/f121 0 2024-04-25T17:19:32.401 INFO:tasks.workunit.client.1.smithi069.stdout:4/983: fdatasync db/d15/d20/d35/d63/fd8 0 2024-04-25T17:19:32.404 INFO:tasks.workunit.client.1.smithi069.stdout:9/951: dread - d2/da/dd/d1e/d2e/d68/fcd zero size 2024-04-25T17:19:32.405 INFO:tasks.workunit.client.1.smithi069.stdout:2/983: dwrite d0/d56/fcb [0,4194304] 0 2024-04-25T17:19:32.405 INFO:tasks.workunit.client.0.smithi037.stdout:8/855: chown d5/db/d23/d78/d93 20 1 2024-04-25T17:19:32.411 INFO:tasks.workunit.client.0.smithi037.stdout:7/931: read d5/d14/d31/f3f [3847863,53209] 0 2024-04-25T17:19:32.413 INFO:tasks.workunit.client.1.smithi069.stdout:6/981: unlink d2/d1e/d43/db6/d124/l125 0 2024-04-25T17:19:32.415 INFO:tasks.workunit.client.1.smithi069.stdout:1/959: dwrite d1/d4/d6/d9e/da6/d7c/fec [0,4194304] 0 2024-04-25T17:19:32.473 INFO:tasks.workunit.client.1.smithi069.stdout:4/984: creat db/d4b/d78/d79/d147/f159 x:0 0 0 2024-04-25T17:19:32.474 INFO:tasks.workunit.client.1.smithi069.stdout:4/985: chown db/d4b/d78/dc4/f31 139501009 1 2024-04-25T17:19:32.476 INFO:tasks.workunit.client.0.smithi037.stdout:5/961: dwrite d7/d18/f2a [4194304,4194304] 0 2024-04-25T17:19:32.478 INFO:tasks.workunit.client.1.smithi069.stdout:9/952: write d2/da/dd/d1e/d2e/f82 [830374,70679] 0 2024-04-25T17:19:32.481 INFO:tasks.workunit.client.0.smithi037.stdout:8/856: getdents d5/db/da2 0 2024-04-25T17:19:32.482 INFO:tasks.workunit.client.1.smithi069.stdout:0/932: mknod d0/c13f 0 2024-04-25T17:19:32.482 INFO:tasks.workunit.client.0.smithi037.stdout:5/962: mkdir d7/d63/db2/d122 0 2024-04-25T17:19:32.483 INFO:tasks.workunit.client.0.smithi037.stdout:7/932: getdents d5/d15/dd8/db5 0 2024-04-25T17:19:32.484 INFO:tasks.workunit.client.1.smithi069.stdout:1/960: chown d1/d4/d6/f16 1 1 2024-04-25T17:19:32.484 INFO:tasks.workunit.client.0.smithi037.stdout:8/857: fsync d5/da/f11 0 2024-04-25T17:19:32.484 INFO:tasks.workunit.client.1.smithi069.stdout:1/961: chown d1/f9 252004 1 2024-04-25T17:19:32.485 INFO:tasks.workunit.client.1.smithi069.stdout:1/962: read d1/d43/f8a [482541,81905] 0 2024-04-25T17:19:32.486 INFO:tasks.workunit.client.0.smithi037.stdout:5/963: fdatasync d7/d12/f4d 0 2024-04-25T17:19:32.491 INFO:tasks.workunit.client.0.smithi037.stdout:7/933: write d5/d15/d17/d1b/da2/daf/dc8/f117 [4339764,52092] 0 2024-04-25T17:19:32.493 INFO:tasks.workunit.client.1.smithi069.stdout:0/933: rename d0/da/d24/d67/l118 to d0/da/db/d73/df8/l140 0 2024-04-25T17:19:32.494 INFO:tasks.workunit.client.1.smithi069.stdout:0/934: fsync d0/da/d24/fc9 0 2024-04-25T17:19:32.495 INFO:tasks.workunit.client.1.smithi069.stdout:6/982: write d2/d1e/f32 [925213,76359] 0 2024-04-25T17:19:32.496 INFO:tasks.workunit.client.1.smithi069.stdout:2/984: creat d0/d56/d5f/d62/f13e x:0 0 0 2024-04-25T17:19:32.497 INFO:tasks.workunit.client.0.smithi037.stdout:5/964: creat d7/d12/d6f/d68/f123 x:0 0 0 2024-04-25T17:19:32.498 INFO:tasks.workunit.client.1.smithi069.stdout:1/963: creat d1/d43/d1b/f133 x:0 0 0 2024-04-25T17:19:32.499 INFO:tasks.workunit.client.1.smithi069.stdout:6/983: dread d2/d1e/f71 [0,4194304] 0 2024-04-25T17:19:32.500 INFO:tasks.workunit.client.1.smithi069.stdout:6/984: fdatasync d2/d1e/f33 0 2024-04-25T17:19:32.501 INFO:tasks.workunit.client.0.smithi037.stdout:7/934: symlink d5/l138 0 2024-04-25T17:19:32.502 INFO:tasks.workunit.client.0.smithi037.stdout:7/935: write d5/d14/d31/f93 [1768959,44728] 0 2024-04-25T17:19:32.504 INFO:tasks.workunit.client.1.smithi069.stdout:1/964: dwrite d1/d4/d6/d4f/f12d [0,4194304] 0 2024-04-25T17:19:32.504 INFO:tasks.workunit.client.0.smithi037.stdout:7/936: write d5/d15/d17/d1b/f68 [6000795,1531] 0 2024-04-25T17:19:32.506 INFO:tasks.workunit.client.0.smithi037.stdout:7/937: dread - d5/d15/d17/d1b/da2/d105/f10d zero size 2024-04-25T17:19:32.507 INFO:tasks.workunit.client.0.smithi037.stdout:8/858: write d5/db/d23/d78/d9c/f113 [179016,41372] 0 2024-04-25T17:19:32.510 INFO:tasks.workunit.client.1.smithi069.stdout:2/985: fsync d0/d26/d10/d43/d99/f9b 0 2024-04-25T17:19:32.512 INFO:tasks.workunit.client.0.smithi037.stdout:5/965: write d7/d25/f2b [1888789,4243] 0 2024-04-25T17:19:32.514 INFO:tasks.workunit.client.0.smithi037.stdout:7/938: creat d5/d15/d17/d25/d2b/d59/df7/f139 x:0 0 0 2024-04-25T17:19:32.515 INFO:tasks.workunit.client.1.smithi069.stdout:6/985: symlink d2/d1e/d43/db6/d124/l152 0 2024-04-25T17:19:32.515 INFO:tasks.workunit.client.0.smithi037.stdout:8/859: mkdir d5/db/d23/d42/d114 0 2024-04-25T17:19:32.517 INFO:tasks.workunit.client.0.smithi037.stdout:5/966: mkdir d7/da1/dda/ddc/d108/d124 0 2024-04-25T17:19:32.522 INFO:tasks.workunit.client.0.smithi037.stdout:8/860: rename d5/db/d59/f6c to d5/da/f115 0 2024-04-25T17:19:32.524 INFO:tasks.workunit.client.1.smithi069.stdout:0/935: truncate d0/da/db/f15 719173 0 2024-04-25T17:19:32.526 INFO:tasks.workunit.client.1.smithi069.stdout:2/986: truncate d0/d26/d36/fba 727630 0 2024-04-25T17:19:32.526 INFO:tasks.workunit.client.1.smithi069.stdout:2/987: write d0/f44 [4190105,45865] 0 2024-04-25T17:19:32.527 INFO:tasks.workunit.client.1.smithi069.stdout:1/965: dread d1/d4/d6/d9e/da6/d7c/d1d/f5e [0,4194304] 0 2024-04-25T17:19:32.527 INFO:tasks.workunit.client.1.smithi069.stdout:9/953: getdents d2/da/dd/d1e/d2e 0 2024-04-25T17:19:32.530 INFO:tasks.workunit.client.0.smithi037.stdout:8/861: mknod d5/db/d18/d3b/d50/da0/d109/d10e/c116 0 2024-04-25T17:19:32.533 INFO:tasks.workunit.client.0.smithi037.stdout:5/967: creat d7/d12/f125 x:0 0 0 2024-04-25T17:19:32.534 INFO:tasks.workunit.client.1.smithi069.stdout:6/986: write d2/d1e/d43/ddc/f109 [733654,42126] 0 2024-04-25T17:19:32.535 INFO:tasks.workunit.client.0.smithi037.stdout:5/968: dread d7/d12/d5d/d90/fb4 [0,4194304] 0 2024-04-25T17:19:32.535 INFO:tasks.workunit.client.0.smithi037.stdout:7/939: getdents d5/d14/db1 0 2024-04-25T17:19:32.537 INFO:tasks.workunit.client.0.smithi037.stdout:8/862: mkdir d5/db/d23/d42/d117 0 2024-04-25T17:19:32.538 INFO:tasks.workunit.client.0.smithi037.stdout:7/940: dread d5/d15/d17/d1b/fec [0,4194304] 0 2024-04-25T17:19:32.538 INFO:tasks.workunit.client.0.smithi037.stdout:8/863: chown d5/d6a/c60 0 1 2024-04-25T17:19:32.539 INFO:tasks.workunit.client.0.smithi037.stdout:5/969: mkdir d7/d12/d6f/d94/d126 0 2024-04-25T17:19:32.539 INFO:tasks.workunit.client.0.smithi037.stdout:7/941: dread - d5/d15/d17/d1b/da2/d105/f10d zero size 2024-04-25T17:19:32.541 INFO:tasks.workunit.client.1.smithi069.stdout:1/966: stat d1/df/d17/f24 0 2024-04-25T17:19:32.543 INFO:tasks.workunit.client.0.smithi037.stdout:8/864: creat d5/db/d18/d3b/d50/da0/d109/d10e/f118 x:0 0 0 2024-04-25T17:19:32.543 INFO:tasks.workunit.client.0.smithi037.stdout:7/942: mknod d5/d15/d17/d25/d2b/d59/c13a 0 2024-04-25T17:19:32.546 INFO:tasks.workunit.client.0.smithi037.stdout:7/943: dread d5/d15/dd8/db5/fb6 [0,4194304] 0 2024-04-25T17:19:32.547 INFO:tasks.workunit.client.0.smithi037.stdout:7/944: write d5/d15/d17/d1b/da2/d76/f8a [3959315,100541] 0 2024-04-25T17:19:32.548 INFO:tasks.workunit.client.0.smithi037.stdout:7/945: readlink d5/d15/d17/d1b/da2/l83 0 2024-04-25T17:19:32.555 INFO:tasks.workunit.client.1.smithi069.stdout:9/954: dread d2/da/dd/d1e/d2e/d68/dba/f105 [0,4194304] 0 2024-04-25T17:19:32.570 INFO:tasks.workunit.client.1.smithi069.stdout:4/986: sync 2024-04-25T17:19:32.574 INFO:tasks.workunit.client.1.smithi069.stdout:4/987: dwrite db/db0/ff3 [0,4194304] 0 2024-04-25T17:19:32.580 INFO:tasks.workunit.client.0.smithi037.stdout:8/865: mkdir d5/db/d23/d58/d119 0 2024-04-25T17:19:32.582 INFO:tasks.workunit.client.1.smithi069.stdout:0/936: symlink d0/da/d24/d67/l141 0 2024-04-25T17:19:32.584 INFO:tasks.workunit.client.1.smithi069.stdout:2/988: creat d0/d56/d5f/d62/f13f x:0 0 0 2024-04-25T17:19:32.588 INFO:tasks.workunit.client.0.smithi037.stdout:8/866: dread d5/d26/d81/fc7 [0,4194304] 0 2024-04-25T17:19:32.589 INFO:tasks.workunit.client.1.smithi069.stdout:2/989: dread - d0/d56/d5f/d62/d7d/fa8 zero size 2024-04-25T17:19:32.592 INFO:tasks.workunit.client.1.smithi069.stdout:9/955: rename d2/da/dd/de/d74/dbc/fd9 to d2/da/dd/de/d64/dd2/f147 0 2024-04-25T17:19:32.593 INFO:tasks.workunit.client.1.smithi069.stdout:9/956: rename d2/da/dd/d1e/d2e/d68/dba/ded to d2/da/dd/d1e/d2e/d68/dba/ded/d128/d148 22 2024-04-25T17:19:32.596 INFO:tasks.workunit.client.1.smithi069.stdout:6/987: getdents d2/d9c/d97 0 2024-04-25T17:19:32.603 INFO:tasks.workunit.client.0.smithi037.stdout:8/867: dwrite d5/db/d18/d3b/d75/fbf [4194304,4194304] 0 2024-04-25T17:19:32.606 INFO:tasks.workunit.client.1.smithi069.stdout:4/988: write db/d15/d20/d35/d63/d75/dbd/ffe [2719221,52806] 0 2024-04-25T17:19:32.609 INFO:tasks.workunit.client.0.smithi037.stdout:7/946: dread d5/d15/d17/f65 [0,4194304] 0 2024-04-25T17:19:32.616 INFO:tasks.workunit.client.1.smithi069.stdout:9/957: mkdir d2/da/dd/de/d74/dbc/d149 0 2024-04-25T17:19:32.618 INFO:tasks.workunit.client.1.smithi069.stdout:1/967: getdents d1/d4/d6/d9e/da6/d7c/d1d/de1 0 2024-04-25T17:19:32.621 INFO:tasks.workunit.client.1.smithi069.stdout:0/937: write d0/da/d24/d43/dfc/d5f/fbd [1806233,69128] 0 2024-04-25T17:19:32.622 INFO:tasks.workunit.client.1.smithi069.stdout:6/988: symlink d2/d1e/d43/dca/dce/l153 0 2024-04-25T17:19:32.624 INFO:tasks.workunit.client.1.smithi069.stdout:1/968: dwrite d1/f109 [4194304,4194304] 0 2024-04-25T17:19:32.625 INFO:tasks.workunit.client.1.smithi069.stdout:2/990: mknod d0/d56/d5f/d62/d7d/d72/c140 0 2024-04-25T17:19:32.626 INFO:tasks.workunit.client.0.smithi037.stdout:8/868: write d5/f35 [2555450,20003] 0 2024-04-25T17:19:32.626 INFO:tasks.workunit.client.1.smithi069.stdout:9/958: chown d2/da/d5f/d76/c140 0 1 2024-04-25T17:19:32.626 INFO:tasks.workunit.client.0.smithi037.stdout:7/947: write d5/d14/db1/ff2 [960330,19402] 0 2024-04-25T17:19:32.627 INFO:tasks.workunit.client.1.smithi069.stdout:9/959: dread - d2/da/d5f/d76/f136 zero size 2024-04-25T17:19:32.628 INFO:tasks.workunit.client.0.smithi037.stdout:7/948: write d5/d15/d17/d1b/da2/d105/f10d [623058,22147] 0 2024-04-25T17:19:32.628 INFO:tasks.workunit.client.1.smithi069.stdout:9/960: fsync d2/da/d14/f79 0 2024-04-25T17:19:32.630 INFO:tasks.workunit.client.1.smithi069.stdout:9/961: chown d2/da/dd/d1e/f6a 321 1 2024-04-25T17:19:32.630 INFO:tasks.workunit.client.1.smithi069.stdout:1/969: creat d1/d43/d1b/de9/f134 x:0 0 0 2024-04-25T17:19:32.631 INFO:tasks.workunit.client.1.smithi069.stdout:9/962: readlink d2/da4/dcf/d65/d88/l11c 0 2024-04-25T17:19:32.634 INFO:tasks.workunit.client.1.smithi069.stdout:1/970: dread d1/d4/d6/d4f/f83 [0,4194304] 0 2024-04-25T17:19:32.636 INFO:tasks.workunit.client.1.smithi069.stdout:4/989: write db/d15/d26/f62 [1225140,31354] 0 2024-04-25T17:19:32.637 INFO:tasks.workunit.client.0.smithi037.stdout:7/949: link d5/d14/l5a d5/d15/d17/d25/d2b/d59/dfe/d10e/l13b 0 2024-04-25T17:19:32.639 INFO:tasks.workunit.client.1.smithi069.stdout:0/938: dwrite d0/da/d24/d67/fbb [4194304,4194304] 0 2024-04-25T17:19:32.639 INFO:tasks.workunit.client.1.smithi069.stdout:9/963: read d2/da4/dcf/d65/d88/db6/fbe [207199,17563] 0 2024-04-25T17:19:32.641 INFO:tasks.workunit.client.1.smithi069.stdout:1/971: mknod d1/d43/d1b/d32/d4a/d4b/c135 0 2024-04-25T17:19:32.642 INFO:tasks.workunit.client.1.smithi069.stdout:9/964: chown d2/da4/dcf/fc8 335707269 1 2024-04-25T17:19:32.642 INFO:tasks.workunit.client.1.smithi069.stdout:6/989: dwrite d2/f63 [0,4194304] 0 2024-04-25T17:19:32.642 INFO:tasks.workunit.client.0.smithi037.stdout:7/950: mkdir d5/d15/d17/d25/d12b/d13c 0 2024-04-25T17:19:32.643 INFO:tasks.workunit.client.1.smithi069.stdout:1/972: fdatasync d1/df/f103 0 2024-04-25T17:19:32.644 INFO:tasks.workunit.client.1.smithi069.stdout:2/991: link d0/d26/l10c d0/d56/l141 0 2024-04-25T17:19:32.645 INFO:tasks.workunit.client.1.smithi069.stdout:0/939: creat d0/d17/d40/d126/d13c/f142 x:0 0 0 2024-04-25T17:19:32.649 INFO:tasks.workunit.client.1.smithi069.stdout:4/990: creat db/d15/d20/d35/d63/d43/d48/d49/d72/d84/d12b/f15a x:0 0 0 2024-04-25T17:19:32.650 INFO:tasks.workunit.client.1.smithi069.stdout:0/940: fsync d0/d38/d75/f7b 0 2024-04-25T17:19:32.651 INFO:tasks.workunit.client.1.smithi069.stdout:4/991: write db/d15/f3f [6022680,100276] 0 2024-04-25T17:19:32.651 INFO:tasks.workunit.client.1.smithi069.stdout:0/941: fdatasync d0/d17/f121 0 2024-04-25T17:19:32.653 INFO:tasks.workunit.client.1.smithi069.stdout:6/990: rename d2/f2d to d2/d9c/d97/dad/de8/d113/f154 0 2024-04-25T17:19:32.655 INFO:tasks.workunit.client.1.smithi069.stdout:1/973: mkdir d1/d4/d6/d4f/d9b/da3/df9/d136 0 2024-04-25T17:19:32.656 INFO:tasks.workunit.client.1.smithi069.stdout:9/965: creat d2/da/dd/de/f14a x:0 0 0 2024-04-25T17:19:32.658 INFO:tasks.workunit.client.1.smithi069.stdout:9/966: fsync d2/da/dd/f10f 0 2024-04-25T17:19:32.658 INFO:tasks.workunit.client.1.smithi069.stdout:6/991: dwrite d2/d9c/d97/d98/df3/f129 [0,4194304] 0 2024-04-25T17:19:32.661 INFO:tasks.workunit.client.1.smithi069.stdout:0/942: symlink d0/da/d59/dab/d119/d8e/l143 0 2024-04-25T17:19:32.663 INFO:tasks.workunit.client.1.smithi069.stdout:1/974: mkdir d1/d4/d6/d9e/da6/d7c/d1d/dad/d137 0 2024-04-25T17:19:32.665 INFO:tasks.workunit.client.1.smithi069.stdout:9/967: stat d2/da/dd/de/d64/cb2 0 2024-04-25T17:19:32.665 INFO:tasks.workunit.client.1.smithi069.stdout:9/968: stat d2/da/dd/de/d64/dd2 0 2024-04-25T17:19:32.666 INFO:tasks.workunit.client.0.smithi037.stdout:7/951: write d5/d15/d17/d25/d2b/d59/f6c [2195525,81121] 0 2024-04-25T17:19:32.668 INFO:tasks.workunit.client.1.smithi069.stdout:0/943: creat d0/da/d59/dab/de6/f144 x:0 0 0 2024-04-25T17:19:32.669 INFO:tasks.workunit.client.0.smithi037.stdout:7/952: unlink d5/f6f 0 2024-04-25T17:19:32.674 INFO:tasks.workunit.client.0.smithi037.stdout:7/953: symlink d5/d14/db1/l13d 0 2024-04-25T17:19:32.674 INFO:tasks.workunit.client.1.smithi069.stdout:0/944: mknod d0/da/db/d73/c145 0 2024-04-25T17:19:32.676 INFO:tasks.workunit.client.1.smithi069.stdout:6/992: rename d2/d51/d85 to d2/d9c/d48/d155 0 2024-04-25T17:19:32.678 INFO:tasks.workunit.client.0.smithi037.stdout:7/954: creat d5/d15/d17/d25/d2b/dcb/f13e x:0 0 0 2024-04-25T17:19:32.680 INFO:tasks.workunit.client.1.smithi069.stdout:1/975: rename d1/d4/d6/d81/dfe to d1/d43/d1b/d32/d4a/db4/d138 0 2024-04-25T17:19:32.681 INFO:tasks.workunit.client.1.smithi069.stdout:4/992: dwrite db/d15/d20/f76 [0,4194304] 0 2024-04-25T17:19:32.683 INFO:tasks.workunit.client.1.smithi069.stdout:9/969: write d2/da/dd/d1e/d2e/f34 [1591141,5934] 0 2024-04-25T17:19:32.684 INFO:tasks.workunit.client.1.smithi069.stdout:1/976: read d1/d4/d6/d4f/d9b/f128 [741624,624] 0 2024-04-25T17:19:32.684 INFO:tasks.workunit.client.1.smithi069.stdout:6/993: symlink d2/d1e/d3f/d56/de5/l156 0 2024-04-25T17:19:32.686 INFO:tasks.workunit.client.1.smithi069.stdout:4/993: creat db/d15/d42/d53/f15b x:0 0 0 2024-04-25T17:19:32.689 INFO:tasks.workunit.client.0.smithi037.stdout:7/955: rename d5/d15/d17/d25/d2b/d59/dfe/d10e/d11f/f135 to d5/dc1/de1/f13f 0 2024-04-25T17:19:32.693 INFO:tasks.workunit.client.1.smithi069.stdout:0/945: getdents d0/da/db/d3a/d104 0 2024-04-25T17:19:32.696 INFO:tasks.workunit.client.1.smithi069.stdout:1/977: rename d1/d4/d6/d9e/da6/d7c/d1d/de1/d8e/dbb/l116 to d1/d4/d6/d4f/d9b/da3/df9/l139 0 2024-04-25T17:19:32.697 INFO:tasks.workunit.client.1.smithi069.stdout:1/978: write d1/f5 [2926845,17370] 0 2024-04-25T17:19:32.698 INFO:tasks.workunit.client.1.smithi069.stdout:4/994: mknod db/d15/d42/d64/d7f/c15c 0 2024-04-25T17:19:32.698 INFO:tasks.workunit.client.1.smithi069.stdout:4/995: readlink db/d15/d20/d38/la3 0 2024-04-25T17:19:32.700 INFO:tasks.workunit.client.1.smithi069.stdout:6/994: creat d2/d7/f157 x:0 0 0 2024-04-25T17:19:32.700 INFO:tasks.workunit.client.1.smithi069.stdout:1/979: write d1/d4/de/f99 [1426817,89215] 0 2024-04-25T17:19:32.701 INFO:tasks.workunit.client.1.smithi069.stdout:4/996: unlink db/d15/d20/d35/d63/c94 0 2024-04-25T17:19:32.702 INFO:tasks.workunit.client.1.smithi069.stdout:6/995: truncate d2/d1e/d3f/d56/de5/f147 156069 0 2024-04-25T17:19:32.703 INFO:tasks.workunit.client.1.smithi069.stdout:0/946: getdents d0/da/d24/d43/dfc/d89 0 2024-04-25T17:19:32.704 INFO:tasks.workunit.client.1.smithi069.stdout:4/997: write db/d15/d20/d35/d63/d43/d48/fc3 [2047980,127626] 0 2024-04-25T17:19:32.704 INFO:tasks.workunit.client.1.smithi069.stdout:0/947: readlink d0/da/db/def/d11f/ld1 0 2024-04-25T17:19:32.705 INFO:tasks.workunit.client.1.smithi069.stdout:0/948: chown d0/d17 0 1 2024-04-25T17:19:32.705 INFO:tasks.workunit.client.1.smithi069.stdout:4/998: fdatasync db/d15/d42/f154 0 2024-04-25T17:19:32.707 INFO:tasks.workunit.client.1.smithi069.stdout:0/949: symlink d0/da/d59/dab/d119/l146 0 2024-04-25T17:19:32.710 INFO:tasks.workunit.client.1.smithi069.stdout:4/999: link db/de3/f11c db/d15/d20/d35/d63/d43/d48/d49/d4e/f15d 0 2024-04-25T17:19:32.712 INFO:tasks.workunit.client.1.smithi069.stdout:1/980: write d1/df/d17/f10f [242123,85776] 0 2024-04-25T17:19:32.716 INFO:tasks.workunit.client.1.smithi069.stdout:6/996: dwrite d2/f1c [0,4194304] 0 2024-04-25T17:19:32.721 INFO:tasks.workunit.client.1.smithi069.stdout:6/997: mkdir d2/d1e/d3f/d150/d115/d158 0 2024-04-25T17:19:32.724 INFO:tasks.workunit.client.1.smithi069.stdout:6/998: symlink d2/d1e/d43/d7d/l159 0 2024-04-25T17:19:32.724 INFO:tasks.workunit.client.1.smithi069.stdout:1/981: dwrite d1/d43/d1b/d32/d4a/db4/fb8 [0,4194304] 0 2024-04-25T17:19:32.724 INFO:tasks.workunit.client.1.smithi069.stdout:1/982: stat d1/d4/d6/d81/cf1 0 2024-04-25T17:19:32.726 INFO:tasks.workunit.client.1.smithi069.stdout:6/999: creat d2/d1e/f15a x:0 0 0 2024-04-25T17:19:32.729 INFO:tasks.workunit.client.1.smithi069.stdout:2/992: sync 2024-04-25T17:19:32.732 INFO:tasks.workunit.client.1.smithi069.stdout:1/983: dwrite d1/d4/d6/d9e/f12e [0,4194304] 0 2024-04-25T17:19:32.738 INFO:tasks.workunit.client.1.smithi069.stdout:2/993: dwrite d0/d26/d10/db5/de3/f12f [0,4194304] 0 2024-04-25T17:19:32.748 INFO:tasks.workunit.client.1.smithi069.stdout:1/984: write d1/d43/d1b/d32/fc3 [123705,54146] 0 2024-04-25T17:19:32.750 INFO:tasks.workunit.client.1.smithi069.stdout:1/985: mknod d1/d4/d6/d9e/da6/c13a 0 2024-04-25T17:19:32.768 INFO:tasks.workunit.client.0.smithi037.stdout:6/992: sync 2024-04-25T17:19:32.769 INFO:tasks.workunit.client.0.smithi037.stdout:3/819: sync 2024-04-25T17:19:32.770 INFO:tasks.workunit.client.1.smithi069.stdout:9/970: sync 2024-04-25T17:19:32.774 INFO:tasks.workunit.client.0.smithi037.stdout:3/820: rename d8/d31/d32/c83 to d8/d31/d32/dd7/d7d/c107 0 2024-04-25T17:19:32.778 INFO:tasks.workunit.client.1.smithi069.stdout:2/994: dwrite d0/d26/d10/d43/fa1 [0,4194304] 0 2024-04-25T17:19:32.811 INFO:tasks.workunit.client.1.smithi069.stdout:0/950: sync 2024-04-25T17:19:32.811 INFO:tasks.workunit.client.1.smithi069.stdout:0/951: chown d0/l12 221763 1 2024-04-25T17:19:32.812 INFO:tasks.workunit.client.0.smithi037.stdout:3/821: fsync d8/d31/d8d/db7/fef 0 2024-04-25T17:19:32.813 INFO:tasks.workunit.client.1.smithi069.stdout:1/986: write d1/d4/d6/d9e/da6/df0/f11f [3845169,47583] 0 2024-04-25T17:19:32.819 INFO:tasks.workunit.client.0.smithi037.stdout:6/993: dwrite db/d1d/d20/dcf/dfa/d65/d68/f153 [0,4194304] 0 2024-04-25T17:19:32.823 INFO:tasks.workunit.client.1.smithi069.stdout:9/971: link d2/da/dd/d1e/d2e/d68/d8f/fad d2/da4/dcf/d65/d143/f14b 0 2024-04-25T17:19:32.823 INFO:tasks.workunit.client.1.smithi069.stdout:9/972: readlink d2/da/dd/d1e/la8 0 2024-04-25T17:19:32.830 INFO:tasks.workunit.client.1.smithi069.stdout:2/995: write d0/d26/d10/f97 [5938926,41884] 0 2024-04-25T17:19:32.831 INFO:tasks.workunit.client.0.smithi037.stdout:3/822: getdents d8/d31/d8d 0 2024-04-25T17:19:32.833 INFO:tasks.workunit.client.1.smithi069.stdout:9/973: unlink d2/da/dd/d1e/d2e/d68/cb1 0 2024-04-25T17:19:32.834 INFO:tasks.workunit.client.1.smithi069.stdout:1/987: creat d1/d4/d6/d9e/da6/d7c/f13b x:0 0 0 2024-04-25T17:19:32.835 INFO:tasks.workunit.client.0.smithi037.stdout:6/994: dwrite db/d147/d25/db0/d14b/f67 [0,4194304] 0 2024-04-25T17:19:32.835 INFO:tasks.workunit.client.1.smithi069.stdout:2/996: mkdir d0/d26/df3/d142 0 2024-04-25T17:19:32.836 INFO:tasks.workunit.client.1.smithi069.stdout:2/997: write d0/f7 [2991289,102645] 0 2024-04-25T17:19:32.838 INFO:tasks.workunit.client.1.smithi069.stdout:9/974: truncate d2/da4/dcf/fc8 417955 0 2024-04-25T17:19:32.840 INFO:tasks.workunit.client.1.smithi069.stdout:0/952: dwrite d0/d17/d40/f68 [0,4194304] 0 2024-04-25T17:19:32.841 INFO:tasks.workunit.client.1.smithi069.stdout:0/953: chown d0/da/d24/d43/f108 2 1 2024-04-25T17:19:32.843 INFO:tasks.workunit.client.0.smithi037.stdout:5/970: sync 2024-04-25T17:19:32.845 INFO:tasks.workunit.client.1.smithi069.stdout:2/998: mkdir d0/d26/d143 0 2024-04-25T17:19:32.845 INFO:tasks.workunit.client.0.smithi037.stdout:6/995: rename db/d53/f144 to db/d147/d25/d10b/d10e/f16c 0 2024-04-25T17:19:32.845 INFO:tasks.workunit.client.0.smithi037.stdout:5/971: stat d7/d25 0 2024-04-25T17:19:32.846 INFO:tasks.workunit.client.1.smithi069.stdout:9/975: dwrite d2/da4/dcf/d65/d88/db6/fe5 [0,4194304] 0 2024-04-25T17:19:32.846 INFO:tasks.workunit.client.1.smithi069.stdout:9/976: dread - d2/d51/db4/f122 zero size 2024-04-25T17:19:32.847 INFO:tasks.workunit.client.1.smithi069.stdout:0/954: dread - d0/da/d59/dab/fc2 zero size 2024-04-25T17:19:32.849 INFO:tasks.workunit.client.0.smithi037.stdout:5/972: dread d7/f3c [0,4194304] 0 2024-04-25T17:19:32.850 INFO:tasks.workunit.client.0.smithi037.stdout:5/973: chown d7/d12/d5d/f61 17053179 1 2024-04-25T17:19:32.852 INFO:tasks.workunit.client.1.smithi069.stdout:2/999: creat d0/d26/d36/f144 x:0 0 0 2024-04-25T17:19:32.854 INFO:tasks.workunit.client.1.smithi069.stdout:9/977: rmdir d2/da4/dcf/d65/d88 39 2024-04-25T17:19:32.856 INFO:tasks.workunit.client.1.smithi069.stdout:1/988: link d1/d4/d6/d9e/da6/df0/l124 d1/d43/d1b/d32/d4a/db4/d127/l13c 0 2024-04-25T17:19:32.860 INFO:tasks.workunit.client.1.smithi069.stdout:9/978: creat d2/da/dd/de/d74/d8a/f14c x:0 0 0 2024-04-25T17:19:32.863 INFO:tasks.workunit.client.1.smithi069.stdout:9/979: creat d2/da/dd/d1e/d2e/d35/f14d x:0 0 0 2024-04-25T17:19:32.870 INFO:tasks.workunit.client.1.smithi069.stdout:1/989: getdents d1/d43/d1b/d32/d4a/d4b 0 2024-04-25T17:19:32.875 INFO:tasks.workunit.client.1.smithi069.stdout:0/955: truncate d0/da/db/d56/ffe 5303238 0 2024-04-25T17:19:32.876 INFO:tasks.workunit.client.1.smithi069.stdout:9/980: link d2/da/dd/d1e/d2e/d35/d120/d123/f125 d2/da/d5f/f14e 0 2024-04-25T17:19:32.880 INFO:tasks.workunit.client.1.smithi069.stdout:0/956: creat d0/da/d59/dab/f147 x:0 0 0 2024-04-25T17:19:32.885 INFO:tasks.workunit.client.1.smithi069.stdout:0/957: mkdir d0/da/d6e/d148 0 2024-04-25T17:19:32.890 INFO:tasks.workunit.client.1.smithi069.stdout:1/990: write d1/df/ff7 [309670,61313] 0 2024-04-25T17:19:32.891 INFO:tasks.workunit.client.1.smithi069.stdout:1/991: read d1/d4/d6/d9e/da6/d7c/fec [2874548,21741] 0 2024-04-25T17:19:32.899 INFO:tasks.workunit.client.1.smithi069.stdout:0/958: link d0/da/ffb d0/da/d6e/dd0/f149 0 2024-04-25T17:19:32.900 INFO:tasks.workunit.client.1.smithi069.stdout:0/959: write d0/da/d24/d43/dfc/fba [747983,85649] 0 2024-04-25T17:19:32.903 INFO:tasks.workunit.client.1.smithi069.stdout:9/981: write d2/da/dd/d1e/d2e/d113/f134 [1773313,19044] 0 2024-04-25T17:19:32.905 INFO:tasks.workunit.client.1.smithi069.stdout:9/982: truncate d2/da/d5f/dd3/f127 1014707 0 2024-04-25T17:19:32.907 INFO:tasks.workunit.client.1.smithi069.stdout:0/960: write d0/da/db/def/f12a [1754584,111071] 0 2024-04-25T17:19:32.910 INFO:tasks.workunit.client.0.smithi037.stdout:6/996: fdatasync db/d147/f2c 0 2024-04-25T17:19:32.911 INFO:tasks.workunit.client.0.smithi037.stdout:6/997: readlink db/d1d/d20/dcf/dfa/d65/lc2 0 2024-04-25T17:19:32.911 INFO:tasks.workunit.client.1.smithi069.stdout:0/961: write d0/da/db/d2a/f129 [3811,42118] 0 2024-04-25T17:19:32.913 INFO:tasks.workunit.client.1.smithi069.stdout:0/962: write d0/da/d24/d43/dfc/d89/fbc [708763,129844] 0 2024-04-25T17:19:32.913 INFO:tasks.workunit.client.0.smithi037.stdout:5/974: truncate d7/d63/f92 165846 0 2024-04-25T17:19:32.914 INFO:tasks.workunit.client.0.smithi037.stdout:5/975: stat d7/d25/d4f/f82 0 2024-04-25T17:19:32.918 INFO:tasks.workunit.client.1.smithi069.stdout:0/963: mkdir d0/da/db/d2a/d8c/d14a 0 2024-04-25T17:19:32.919 INFO:tasks.workunit.client.0.smithi037.stdout:6/998: symlink db/d1d/d20/d2f/l16d 0 2024-04-25T17:19:32.920 INFO:tasks.workunit.client.1.smithi069.stdout:1/992: dwrite d1/df/d17/fa1 [0,4194304] 0 2024-04-25T17:19:32.921 INFO:tasks.workunit.client.0.smithi037.stdout:5/976: read d7/f56 [52494,46420] 0 2024-04-25T17:19:32.922 INFO:tasks.workunit.client.0.smithi037.stdout:5/977: fsync d7/d25/d4f/da7/dab/f11b 0 2024-04-25T17:19:32.926 INFO:tasks.workunit.client.0.smithi037.stdout:6/999: creat db/d147/d25/d10d/d124/d137/f16e x:0 0 0 2024-04-25T17:19:32.927 INFO:tasks.workunit.client.1.smithi069.stdout:1/993: readlink d1/d4/d6/d9e/da6/d7c/d1d/l11b 0 2024-04-25T17:19:32.928 INFO:tasks.workunit.client.1.smithi069.stdout:1/994: write d1/d4/d6/d9e/da6/d7c/fe8 [4644577,49654] 0 2024-04-25T17:19:32.933 INFO:tasks.workunit.client.1.smithi069.stdout:0/964: write d0/da/fc1 [74645,86051] 0 2024-04-25T17:19:32.934 INFO:tasks.workunit.client.1.smithi069.stdout:1/995: creat d1/d4/f13d x:0 0 0 2024-04-25T17:19:32.936 INFO:tasks.workunit.client.1.smithi069.stdout:0/965: unlink d0/da/d6e/lf2 0 2024-04-25T17:19:32.938 INFO:tasks.workunit.client.1.smithi069.stdout:1/996: mkdir d1/d13e 0 2024-04-25T17:19:32.939 INFO:tasks.workunit.client.1.smithi069.stdout:0/966: creat d0/d17/d40/d126/d13c/dd5/f14b x:0 0 0 2024-04-25T17:19:32.941 INFO:tasks.workunit.client.1.smithi069.stdout:1/997: rename d1/d43/d1b/d32/d4a/l54 to d1/d4/d6/d9e/da6/d38/l13f 0 2024-04-25T17:19:32.941 INFO:tasks.workunit.client.0.smithi037.stdout:5/978: dwrite d7/d12/d6f/fb8 [0,4194304] 0 2024-04-25T17:19:32.943 INFO:tasks.workunit.client.1.smithi069.stdout:0/967: symlink d0/d36/l14c 0 2024-04-25T17:19:32.944 INFO:tasks.workunit.client.1.smithi069.stdout:1/998: truncate d1/d4/de/d44/f5d 928937 0 2024-04-25T17:19:32.944 INFO:tasks.workunit.client.1.smithi069.stdout:1/999: readlink d1/d4/d6/d4f/d9b/da3/lb0 0 2024-04-25T17:19:32.945 INFO:tasks.workunit.client.0.smithi037.stdout:5/979: fsync d7/d12/f4d 0 2024-04-25T17:19:32.947 INFO:tasks.workunit.client.0.smithi037.stdout:5/980: fdatasync d7/f56 0 2024-04-25T17:19:32.948 INFO:tasks.workunit.client.0.smithi037.stdout:5/981: stat d7/d63/l79 0 2024-04-25T17:19:32.954 INFO:tasks.workunit.client.0.smithi037.stdout:5/982: symlink d7/d12/d6f/l127 0 2024-04-25T17:19:32.956 INFO:tasks.workunit.client.0.smithi037.stdout:8/869: sync 2024-04-25T17:19:32.960 INFO:tasks.workunit.client.0.smithi037.stdout:5/983: mkdir d7/d12/d5d/d90/d128 0 2024-04-25T17:19:32.961 INFO:tasks.workunit.client.0.smithi037.stdout:8/870: creat d5/db/d23/f11a x:0 0 0 2024-04-25T17:19:32.963 INFO:tasks.workunit.client.0.smithi037.stdout:8/871: dread - d5/db/d18/d3b/d50/df6/f104 zero size 2024-04-25T17:19:32.963 INFO:tasks.workunit.client.0.smithi037.stdout:5/984: creat d7/d12/d6f/d68/f129 x:0 0 0 2024-04-25T17:19:32.963 INFO:tasks.workunit.client.1.smithi069.stdout:0/968: dread d0/da/d24/d67/f6a [0,4194304] 0 2024-04-25T17:19:32.968 INFO:tasks.workunit.client.0.smithi037.stdout:5/985: mkdir d7/d12/d6f/d12a 0 2024-04-25T17:19:32.970 INFO:tasks.workunit.client.0.smithi037.stdout:5/986: chown d7/d18/cd9 20843 1 2024-04-25T17:19:32.974 INFO:tasks.workunit.client.0.smithi037.stdout:8/872: getdents d5/db/d18/d3b/d50/da0/d109/d10e 0 2024-04-25T17:19:32.984 INFO:tasks.workunit.client.0.smithi037.stdout:8/873: truncate d5/db/d23/f11a 1047329 0 2024-04-25T17:19:32.988 INFO:tasks.workunit.client.1.smithi069.stdout:9/983: sync 2024-04-25T17:19:32.988 INFO:tasks.workunit.client.1.smithi069.stdout:9/984: dread - d2/da/dd/de/d64/dd2/f129 zero size 2024-04-25T17:19:32.992 INFO:tasks.workunit.client.0.smithi037.stdout:8/874: link d5/db/d18/d3b/fb2 d5/d26/d81/f11b 0 2024-04-25T17:19:32.999 INFO:tasks.workunit.client.0.smithi037.stdout:7/956: sync 2024-04-25T17:19:32.999 INFO:tasks.workunit.client.0.smithi037.stdout:3/823: sync 2024-04-25T17:19:33.001 INFO:tasks.workunit.client.0.smithi037.stdout:5/987: dwrite d7/da1/dbb/fe1 [0,4194304] 0 2024-04-25T17:19:33.003 INFO:tasks.workunit.client.0.smithi037.stdout:7/957: chown d5/d14/d31/f93 18 1 2024-04-25T17:19:33.012 INFO:tasks.workunit.client.1.smithi069.stdout:0/969: truncate d0/da/db/fe 1708891 0 2024-04-25T17:19:33.012 INFO:tasks.workunit.client.0.smithi037.stdout:3/824: link d8/d31/d8d/la3 d8/d4c/l108 0 2024-04-25T17:19:33.013 INFO:tasks.workunit.client.0.smithi037.stdout:7/958: link d5/d14/db1/l7d d5/d15/d17/d25/d2b/d59/dfe/d10e/d11f/l140 0 2024-04-25T17:19:33.016 INFO:tasks.workunit.client.0.smithi037.stdout:3/825: fdatasync d8/d57/f71 0 2024-04-25T17:19:33.018 INFO:tasks.workunit.client.0.smithi037.stdout:8/875: dread d5/db/d18/d3b/d50/d51/f57 [0,4194304] 0 2024-04-25T17:19:33.018 INFO:tasks.workunit.client.1.smithi069.stdout:0/970: rename d0/da/db/d73/df8/l140 to d0/da/d59/dab/l14d 0 2024-04-25T17:19:33.019 INFO:tasks.workunit.client.0.smithi037.stdout:8/876: write d5/d26/f101 [3661114,30094] 0 2024-04-25T17:19:33.020 INFO:tasks.workunit.client.0.smithi037.stdout:7/959: creat d5/d15/d17/d25/d2b/d59/dfe/d10e/f141 x:0 0 0 2024-04-25T17:19:33.024 INFO:tasks.workunit.client.1.smithi069.stdout:0/971: dwrite d0/da/d59/dab/f130 [0,4194304] 0 2024-04-25T17:19:33.027 INFO:tasks.workunit.client.0.smithi037.stdout:3/826: mkdir d8/d23/d38/d66/dff/d109 0 2024-04-25T17:19:33.030 INFO:tasks.workunit.client.0.smithi037.stdout:7/960: mkdir d5/d15/d17/d25/d142 0 2024-04-25T17:19:33.030 INFO:tasks.workunit.client.0.smithi037.stdout:8/877: getdents d5/db/d18/d3b/d50/da0/df1 0 2024-04-25T17:19:33.034 INFO:tasks.workunit.client.1.smithi069.stdout:0/972: fdatasync d0/da/db/d3a/f4c 0 2024-04-25T17:19:33.035 INFO:tasks.workunit.client.0.smithi037.stdout:3/827: unlink d8/db4/ca2 0 2024-04-25T17:19:33.039 INFO:tasks.workunit.client.0.smithi037.stdout:8/878: truncate d5/db/d18/d3b/d50/da0/da6/fb1 944168 0 2024-04-25T17:19:33.042 INFO:tasks.workunit.client.1.smithi069.stdout:0/973: creat d0/da/db/d7e/d80/da9/d136/f14e x:0 0 0 2024-04-25T17:19:33.048 INFO:tasks.workunit.client.1.smithi069.stdout:0/974: mkdir d0/da/d59/dab/d119/d14f 0 2024-04-25T17:19:33.049 INFO:tasks.workunit.client.0.smithi037.stdout:7/961: creat d5/d14/f143 x:0 0 0 2024-04-25T17:19:33.057 INFO:tasks.workunit.client.0.smithi037.stdout:7/962: unlink d5/d15/d17/d1b/da2/daf/f8d 0 2024-04-25T17:19:33.058 INFO:tasks.workunit.client.0.smithi037.stdout:3/828: link d8/deb/d88/ca6 d8/d23/dbb/d81/dc3/c10a 0 2024-04-25T17:19:33.063 INFO:tasks.workunit.client.0.smithi037.stdout:7/963: symlink d5/d15/d17/d25/d2b/d59/dfe/d10e/d11f/l144 0 2024-04-25T17:19:33.065 INFO:tasks.workunit.client.0.smithi037.stdout:3/829: fsync d8/f79 0 2024-04-25T17:19:33.070 INFO:tasks.workunit.client.0.smithi037.stdout:7/964: rename d5/d15/d17/d25/d2b/f52 to d5/d15/d17/d25/d12b/d13c/f145 0 2024-04-25T17:19:33.073 INFO:tasks.workunit.client.0.smithi037.stdout:7/965: creat d5/d15/d17/d1b/d94/da8/f146 x:0 0 0 2024-04-25T17:19:33.074 INFO:tasks.workunit.client.0.smithi037.stdout:7/966: fdatasync d5/d15/d17/d1b/da2/d76/f8a 0 2024-04-25T17:19:33.075 INFO:tasks.workunit.client.1.smithi069.stdout:0/975: write d0/d38/f49 [1728386,112213] 0 2024-04-25T17:19:33.078 INFO:tasks.workunit.client.0.smithi037.stdout:7/967: truncate d5/d15/d17/d1b/da2/fd4 752332 0 2024-04-25T17:19:33.079 INFO:tasks.workunit.client.1.smithi069.stdout:9/985: sync 2024-04-25T17:19:33.079 INFO:tasks.workunit.client.1.smithi069.stdout:0/976: mknod d0/da/db/d7e/d13b/c150 0 2024-04-25T17:19:33.080 INFO:tasks.workunit.client.0.smithi037.stdout:8/879: dwrite d5/db/d23/d58/f8b [0,4194304] 0 2024-04-25T17:19:33.082 INFO:tasks.workunit.client.1.smithi069.stdout:0/977: read d0/da/d24/d43/f60 [7567936,13225] 0 2024-04-25T17:19:33.083 INFO:tasks.workunit.client.1.smithi069.stdout:9/986: symlink d2/da4/dcf/d138/l14f 0 2024-04-25T17:19:33.083 INFO:tasks.workunit.client.0.smithi037.stdout:3/830: write d8/d31/d8d/db7/fd4 [419956,82699] 0 2024-04-25T17:19:33.083 INFO:tasks.workunit.client.0.smithi037.stdout:7/968: mknod d5/d15/d17/d25/d2b/d59/df7/c147 0 2024-04-25T17:19:33.086 INFO:tasks.workunit.client.1.smithi069.stdout:9/987: truncate d2/da/dd/de/d74/d8a/f14c 879167 0 2024-04-25T17:19:33.087 INFO:tasks.workunit.client.0.smithi037.stdout:7/969: symlink d5/d15/dd8/d106/l148 0 2024-04-25T17:19:33.088 INFO:tasks.workunit.client.1.smithi069.stdout:9/988: chown d2/da/dd/d1e/d2e/d35/f5a 29 1 2024-04-25T17:19:33.090 INFO:tasks.workunit.client.1.smithi069.stdout:0/978: dwrite d0/da/d24/d67/fbb [0,4194304] 0 2024-04-25T17:19:33.092 INFO:tasks.workunit.client.0.smithi037.stdout:3/831: dread d8/d31/d32/d87/f98 [0,4194304] 0 2024-04-25T17:19:33.094 INFO:tasks.workunit.client.1.smithi069.stdout:0/979: dread d0/d17/d40/f68 [0,4194304] 0 2024-04-25T17:19:33.095 INFO:tasks.workunit.client.0.smithi037.stdout:8/880: dwrite d5/db/d23/d78/d9c/fdf [0,4194304] 0 2024-04-25T17:19:33.095 INFO:tasks.workunit.client.1.smithi069.stdout:9/989: fsync d2/da4/dcf/fc8 0 2024-04-25T17:19:33.098 INFO:tasks.workunit.client.0.smithi037.stdout:7/970: dwrite d5/d15/f89 [0,4194304] 0 2024-04-25T17:19:33.108 INFO:tasks.workunit.client.0.smithi037.stdout:8/881: symlink d5/l11c 0 2024-04-25T17:19:33.110 INFO:tasks.workunit.client.0.smithi037.stdout:8/882: write d5/db/d18/ffd [888331,56723] 0 2024-04-25T17:19:33.113 INFO:tasks.workunit.client.1.smithi069.stdout:0/980: getdents d0/d17/d40 0 2024-04-25T17:19:33.114 INFO:tasks.workunit.client.0.smithi037.stdout:3/832: link d8/d23/d38/c82 d8/d31/d32/dd7/c10b 0 2024-04-25T17:19:33.115 INFO:tasks.workunit.client.0.smithi037.stdout:8/883: getdents d5/db/d18/d3b/d106 0 2024-04-25T17:19:33.115 INFO:tasks.workunit.client.0.smithi037.stdout:3/833: readlink d8/d23/dbb/ld5 0 2024-04-25T17:19:33.118 INFO:tasks.workunit.client.0.smithi037.stdout:8/884: mknod d5/db/d23/d42/c11d 0 2024-04-25T17:19:33.120 INFO:tasks.workunit.client.0.smithi037.stdout:8/885: symlink d5/db/d18/d3b/d50/d51/l11e 0 2024-04-25T17:19:33.131 INFO:tasks.workunit.client.0.smithi037.stdout:3/834: dwrite d8/d23/dbb/d5d/f20 [0,4194304] 0 2024-04-25T17:19:33.134 INFO:tasks.workunit.client.0.smithi037.stdout:3/835: creat d8/d31/d32/d87/f10c x:0 0 0 2024-04-25T17:19:33.135 INFO:tasks.workunit.client.0.smithi037.stdout:3/836: dread - d8/d23/dbb/d5d/f104 zero size 2024-04-25T17:19:33.136 INFO:tasks.workunit.client.0.smithi037.stdout:3/837: stat d8/d4c/fc1 0 2024-04-25T17:19:33.140 INFO:tasks.workunit.client.0.smithi037.stdout:3/838: symlink d8/d23/dbb/d63/l10d 0 2024-04-25T17:19:33.142 INFO:tasks.workunit.client.0.smithi037.stdout:3/839: unlink d8/d4c/dd3/fa5 0 2024-04-25T17:19:33.144 INFO:tasks.workunit.client.0.smithi037.stdout:8/886: dread d5/f6f [0,4194304] 0 2024-04-25T17:19:33.151 INFO:tasks.workunit.client.0.smithi037.stdout:8/887: dwrite d5/dbc/fe4 [0,4194304] 0 2024-04-25T17:19:33.154 INFO:tasks.workunit.client.0.smithi037.stdout:8/888: creat d5/db/d18/d3b/d75/f11f x:0 0 0 2024-04-25T17:19:33.160 INFO:tasks.workunit.client.0.smithi037.stdout:8/889: dwrite d5/d26/f101 [0,4194304] 0 2024-04-25T17:19:33.163 INFO:tasks.workunit.client.0.smithi037.stdout:8/890: creat d5/dd0/f120 x:0 0 0 2024-04-25T17:19:33.166 INFO:tasks.workunit.client.0.smithi037.stdout:8/891: creat d5/d26/f121 x:0 0 0 2024-04-25T17:19:33.168 INFO:tasks.workunit.client.0.smithi037.stdout:8/892: read d5/db/d18/d3b/fe2 [1178473,16220] 0 2024-04-25T17:19:33.170 INFO:tasks.workunit.client.0.smithi037.stdout:8/893: symlink d5/db/da2/l122 0 2024-04-25T17:19:33.175 INFO:tasks.workunit.client.0.smithi037.stdout:8/894: rename d5/db/d23/f11a to d5/d26/d81/f123 0 2024-04-25T17:19:33.187 INFO:tasks.workunit.client.1.smithi069.stdout:9/990: sync 2024-04-25T17:19:33.188 INFO:tasks.workunit.client.1.smithi069.stdout:9/991: read d2/da/d14/f79 [390147,33546] 0 2024-04-25T17:19:33.189 INFO:tasks.workunit.client.0.smithi037.stdout:8/895: dread d5/db/d18/d3b/d75/fbf [0,4194304] 0 2024-04-25T17:19:33.191 INFO:tasks.workunit.client.1.smithi069.stdout:9/992: rename d2/da/dd/cab to d2/da/c150 0 2024-04-25T17:19:33.195 INFO:tasks.workunit.client.1.smithi069.stdout:9/993: creat d2/da/f151 x:0 0 0 2024-04-25T17:19:33.198 INFO:tasks.workunit.client.0.smithi037.stdout:8/896: write d5/db/d18/d3b/d50/da0/da6/da8/fc0 [814238,83024] 0 2024-04-25T17:19:33.202 INFO:tasks.workunit.client.1.smithi069.stdout:9/994: truncate d2/da4/dcf/d65/d88/f54 3966945 0 2024-04-25T17:19:33.205 INFO:tasks.workunit.client.1.smithi069.stdout:9/995: unlink d2/da/d5f/d76/l9b 0 2024-04-25T17:19:33.207 INFO:tasks.workunit.client.0.smithi037.stdout:8/897: creat d5/db/d23/d78/d93/f124 x:0 0 0 2024-04-25T17:19:33.208 INFO:tasks.workunit.client.1.smithi069.stdout:9/996: truncate d2/da/f93 501296 0 2024-04-25T17:19:33.213 INFO:tasks.workunit.client.0.smithi037.stdout:8/898: getdents d5/db/d23/d78 0 2024-04-25T17:19:33.214 INFO:tasks.workunit.client.1.smithi069.stdout:0/981: sync 2024-04-25T17:19:33.216 INFO:tasks.workunit.client.1.smithi069.stdout:0/982: read d0/da/d59/dab/fb7 [2609445,107058] 0 2024-04-25T17:19:33.217 INFO:tasks.workunit.client.0.smithi037.stdout:8/899: rename d5/db/fb3 to d5/db/d18/d3b/d50/da0/df1/f125 0 2024-04-25T17:19:33.221 INFO:tasks.workunit.client.1.smithi069.stdout:0/983: mkdir d0/da/d59/d151 0 2024-04-25T17:19:33.223 INFO:tasks.workunit.client.1.smithi069.stdout:9/997: dwrite d2/da/dd/de/d64/f6e [0,4194304] 0 2024-04-25T17:19:33.228 INFO:tasks.workunit.client.1.smithi069.stdout:9/998: creat d2/da/dd/de/d64/dd2/f152 x:0 0 0 2024-04-25T17:19:33.229 INFO:tasks.workunit.client.1.smithi069.stdout:9/999: chown d2/da4/dcf/l28 20 1 2024-04-25T17:19:33.234 INFO:tasks.workunit.client.0.smithi037.stdout:8/900: dread d5/d6a/f9a [0,4194304] 0 2024-04-25T17:19:33.241 INFO:tasks.workunit.client.1.smithi069.stdout:0/984: dread d0/d17/fa5 [0,4194304] 0 2024-04-25T17:19:33.242 INFO:tasks.workunit.client.0.smithi037.stdout:8/901: dread d5/db/d18/d3b/d50/d51/f85 [0,4194304] 0 2024-04-25T17:19:33.245 INFO:tasks.workunit.client.1.smithi069.stdout:0/985: getdents d0/da/d24/d67 0 2024-04-25T17:19:33.246 INFO:tasks.workunit.client.0.smithi037.stdout:8/902: link d5/db/d23/d42/ca9 d5/db/d18/c126 0 2024-04-25T17:19:33.248 INFO:tasks.workunit.client.0.smithi037.stdout:8/903: symlink d5/l127 0 2024-04-25T17:19:33.251 INFO:tasks.workunit.client.0.smithi037.stdout:8/904: truncate d5/db/d23/f1e 1504293 0 2024-04-25T17:19:33.253 INFO:tasks.workunit.client.0.smithi037.stdout:8/905: write d5/db/d23/d78/d93/f124 [13740,42374] 0 2024-04-25T17:19:33.255 INFO:tasks.workunit.client.1.smithi069.stdout:0/986: dwrite d0/da/d24/d43/f108 [0,4194304] 0 2024-04-25T17:19:33.257 INFO:tasks.workunit.client.1.smithi069.stdout:0/987: dread - d0/da/db/d7e/d80/da9/d136/f14e zero size 2024-04-25T17:19:33.257 INFO:tasks.workunit.client.0.smithi037.stdout:8/906: fdatasync d5/db/d18/d3b/d50/d51/f69 0 2024-04-25T17:19:33.260 INFO:tasks.workunit.client.0.smithi037.stdout:8/907: mknod d5/db/d23/dd8/c128 0 2024-04-25T17:19:33.263 INFO:tasks.workunit.client.1.smithi069.stdout:0/988: link d0/da/d24/d43/dfc/d5f/lb4 d0/d17/d40/d126/l152 0 2024-04-25T17:19:33.263 INFO:tasks.workunit.client.0.smithi037.stdout:5/988: sync 2024-04-25T17:19:33.264 INFO:tasks.workunit.client.1.smithi069.stdout:0/989: symlink d0/da/d24/d43/d102/l153 0 2024-04-25T17:19:33.267 INFO:tasks.workunit.client.0.smithi037.stdout:8/908: getdents d5/d26 0 2024-04-25T17:19:33.267 INFO:tasks.workunit.client.0.smithi037.stdout:8/909: stat d5/c22 0 2024-04-25T17:19:33.268 INFO:tasks.workunit.client.0.smithi037.stdout:5/989: getdents d7/da1/dbb 0 2024-04-25T17:19:33.271 INFO:tasks.workunit.client.0.smithi037.stdout:8/910: symlink d5/db/d23/d78/d93/dcc/df0/l129 0 2024-04-25T17:19:33.275 INFO:tasks.workunit.client.0.smithi037.stdout:5/990: dwrite d7/d12/d6f/d68/f123 [0,4194304] 0 2024-04-25T17:19:33.277 INFO:tasks.workunit.client.0.smithi037.stdout:8/911: rename d5/db/d18/de0 to d5/db/d18/d3b/d106/d12a 0 2024-04-25T17:19:33.278 INFO:tasks.workunit.client.0.smithi037.stdout:8/912: read d5/db/d23/d78/d9c/fdf [2108156,79354] 0 2024-04-25T17:19:33.282 INFO:tasks.workunit.client.0.smithi037.stdout:8/913: creat d5/db/d18/d3b/d50/da0/da6/da8/f12b x:0 0 0 2024-04-25T17:19:33.284 INFO:tasks.workunit.client.0.smithi037.stdout:5/991: creat d7/f12b x:0 0 0 2024-04-25T17:19:33.286 INFO:tasks.workunit.client.0.smithi037.stdout:5/992: symlink d7/d63/db2/l12c 0 2024-04-25T17:19:33.286 INFO:tasks.workunit.client.1.smithi069.stdout:0/990: dread d0/da/db/f64 [0,4194304] 0 2024-04-25T17:19:33.287 INFO:tasks.workunit.client.0.smithi037.stdout:8/914: link d5/le8 d5/db/d18/d3b/d50/da0/d109/l12c 0 2024-04-25T17:19:33.287 INFO:tasks.workunit.client.0.smithi037.stdout:5/993: readlink d7/d18/d7c/l95 0 2024-04-25T17:19:33.287 INFO:tasks.workunit.client.1.smithi069.stdout:0/991: chown d0/da/d24/f11e 1040520 1 2024-04-25T17:19:33.288 INFO:tasks.workunit.client.0.smithi037.stdout:8/915: creat d5/da/f12d x:0 0 0 2024-04-25T17:19:33.290 INFO:tasks.workunit.client.0.smithi037.stdout:8/916: mknod d5/d26/c12e 0 2024-04-25T17:19:33.292 INFO:tasks.workunit.client.0.smithi037.stdout:5/994: link d7/d43/f16 d7/d12/d6f/d94/d126/f12d 0 2024-04-25T17:19:33.293 INFO:tasks.workunit.client.0.smithi037.stdout:8/917: mkdir d5/db/d18/d3b/de6/d12f 0 2024-04-25T17:19:33.294 INFO:tasks.workunit.client.1.smithi069.stdout:0/992: link d0/da/d59/dab/fb7 d0/da/d6e/f154 0 2024-04-25T17:19:33.295 INFO:tasks.workunit.client.0.smithi037.stdout:5/995: stat d7/d25/d4f/da7/fea 0 2024-04-25T17:19:33.296 INFO:tasks.workunit.client.1.smithi069.stdout:0/993: symlink d0/da/d59/l155 0 2024-04-25T17:19:33.296 INFO:tasks.workunit.client.0.smithi037.stdout:8/918: mkdir d5/d130 0 2024-04-25T17:19:33.297 INFO:tasks.workunit.client.0.smithi037.stdout:5/996: creat d7/d12/d5d/d90/db1/f12e x:0 0 0 2024-04-25T17:19:33.298 INFO:tasks.workunit.client.1.smithi069.stdout:0/994: creat d0/da/d24/d67/f156 x:0 0 0 2024-04-25T17:19:33.299 INFO:tasks.workunit.client.0.smithi037.stdout:8/919: mknod d5/db/d23/d42/d117/c131 0 2024-04-25T17:19:33.300 INFO:tasks.workunit.client.0.smithi037.stdout:5/997: mknod d7/d18/d62/dd8/c12f 0 2024-04-25T17:19:33.301 INFO:tasks.workunit.client.0.smithi037.stdout:8/920: fsync d5/d6a/f3f 0 2024-04-25T17:19:33.303 INFO:tasks.workunit.client.1.smithi069.stdout:0/995: unlink d0/da/db/d2a/d8c/fe0 0 2024-04-25T17:19:33.306 INFO:tasks.workunit.client.0.smithi037.stdout:8/921: creat d5/db/d18/d3b/d50/da0/da6/da8/f132 x:0 0 0 2024-04-25T17:19:33.309 INFO:tasks.workunit.client.0.smithi037.stdout:8/922: creat d5/db/d18/d3b/d106/d12a/f133 x:0 0 0 2024-04-25T17:19:33.312 INFO:tasks.workunit.client.0.smithi037.stdout:5/998: rename d7/d12/d5d/d90/def/ffc to d7/d43/f130 0 2024-04-25T17:19:33.315 INFO:tasks.workunit.client.0.smithi037.stdout:5/999: creat d7/d25/d4f/da7/f131 x:0 0 0 2024-04-25T17:19:33.316 INFO:tasks.workunit.client.0.smithi037.stdout:8/923: getdents d5/dbc 0 2024-04-25T17:19:33.323 INFO:tasks.workunit.client.0.smithi037.stdout:8/924: dwrite d5/db/d18/d3b/de6/f112 [0,4194304] 0 2024-04-25T17:19:33.324 INFO:tasks.workunit.client.0.smithi037.stdout:7/971: sync 2024-04-25T17:19:33.326 INFO:tasks.workunit.client.0.smithi037.stdout:8/925: truncate d5/db/d18/d3b/d50/d51/f10a 486331 0 2024-04-25T17:19:33.327 INFO:tasks.workunit.client.0.smithi037.stdout:7/972: stat d5/d14/l1a 0 2024-04-25T17:19:33.329 INFO:tasks.workunit.client.0.smithi037.stdout:8/926: creat d5/da/f134 x:0 0 0 2024-04-25T17:19:33.330 INFO:tasks.workunit.client.0.smithi037.stdout:7/973: creat d5/d15/dd8/f149 x:0 0 0 2024-04-25T17:19:33.331 INFO:tasks.workunit.client.0.smithi037.stdout:8/927: fdatasync d5/db/d23/d58/fff 0 2024-04-25T17:19:33.333 INFO:tasks.workunit.client.0.smithi037.stdout:7/974: symlink d5/d15/d17/d25/d2b/d59/dfe/d10e/l14a 0 2024-04-25T17:19:33.334 INFO:tasks.workunit.client.0.smithi037.stdout:7/975: write d5/d15/dd8/db5/f10b [619786,52917] 0 2024-04-25T17:19:33.335 INFO:tasks.workunit.client.1.smithi069.stdout:0/996: dwrite d0/da/d24/d67/fee [0,4194304] 0 2024-04-25T17:19:33.336 INFO:tasks.workunit.client.0.smithi037.stdout:8/928: getdents d5/d26 0 2024-04-25T17:19:33.337 INFO:tasks.workunit.client.0.smithi037.stdout:7/976: creat d5/d15/dd8/d106/d132/f14b x:0 0 0 2024-04-25T17:19:33.341 INFO:tasks.workunit.client.1.smithi069.stdout:0/997: link d0/da/d59/dab/f147 d0/da/d59/dab/de6/f157 0 2024-04-25T17:19:33.341 INFO:tasks.workunit.client.1.smithi069.stdout:0/998: stat d0/da/d54 0 2024-04-25T17:19:33.346 INFO:tasks.workunit.client.1.smithi069.stdout:0/999: mkdir d0/da/db/d2a/d8c/d158 0 2024-04-25T17:19:33.346 INFO:tasks.workunit.client.0.smithi037.stdout:7/977: rename d5/d15/d17/d25/d2b/f35 to d5/d14/db1/f14c 0 2024-04-25T17:19:33.347 INFO:tasks.workunit.client.0.smithi037.stdout:7/978: creat d5/d15/d17/d1b/da2/d76/f14d x:0 0 0 2024-04-25T17:19:33.347 INFO:tasks.workunit.client.0.smithi037.stdout:7/979: stat d5/d14/l123 0 2024-04-25T17:19:33.348 INFO:tasks.workunit.client.1.smithi069.stderr:+ rm -rf -- ./tmp.o33FBP4vLD 2024-04-25T17:19:33.351 INFO:tasks.workunit.client.0.smithi037.stdout:8/929: dread d5/f111 [0,4194304] 0 2024-04-25T17:19:33.351 INFO:tasks.workunit.client.0.smithi037.stdout:7/980: creat d5/d15/d17/d1b/da2/daf/dc5/f14e x:0 0 0 2024-04-25T17:19:33.353 INFO:tasks.workunit.client.0.smithi037.stdout:8/930: symlink d5/db/d7e/l135 0 2024-04-25T17:19:33.354 INFO:tasks.workunit.client.0.smithi037.stdout:7/981: write d5/d15/d17/d25/d2b/d48/f72 [1420819,60519] 0 2024-04-25T17:19:33.356 INFO:tasks.workunit.client.0.smithi037.stdout:8/931: dread d5/f111 [0,4194304] 0 2024-04-25T17:19:33.359 INFO:tasks.workunit.client.0.smithi037.stdout:7/982: rename d5/d15/d17/d1b/da2/daf/c82 to d5/d15/d17/d1b/d94/c14f 0 2024-04-25T17:19:33.360 INFO:tasks.workunit.client.0.smithi037.stdout:8/932: creat d5/dbc/f136 x:0 0 0 2024-04-25T17:19:33.363 INFO:tasks.workunit.client.0.smithi037.stdout:8/933: mkdir d5/db/d18/d3b/d106/d137 0 2024-04-25T17:19:33.364 INFO:tasks.workunit.client.0.smithi037.stdout:8/934: dread - d5/db/d18/d3b/d50/d51/fac zero size 2024-04-25T17:19:33.365 INFO:tasks.workunit.client.0.smithi037.stdout:8/935: chown d5/db/d23/d42/c11d 33450620 1 2024-04-25T17:19:33.366 INFO:tasks.workunit.client.0.smithi037.stdout:3/840: sync 2024-04-25T17:19:33.366 INFO:tasks.workunit.client.0.smithi037.stdout:8/936: chown d5/db/d18/d3b/d50/f7d 79 1 2024-04-25T17:19:33.368 INFO:tasks.workunit.client.0.smithi037.stdout:3/841: truncate d8/ff 122070 0 2024-04-25T17:19:33.371 INFO:tasks.workunit.client.0.smithi037.stdout:8/937: rename d5/db/d18/d3b/d50/fd5 to d5/db/d23/d42/d117/f138 0 2024-04-25T17:19:33.371 INFO:tasks.workunit.client.0.smithi037.stdout:8/938: chown d5/d26/d33 3 1 2024-04-25T17:19:33.373 INFO:tasks.workunit.client.0.smithi037.stdout:3/842: creat d8/d23/da0/f10e x:0 0 0 2024-04-25T17:19:33.380 INFO:tasks.workunit.client.0.smithi037.stdout:3/843: link d8/d23/dbb/d81/dc3/ff0 d8/d31/d8d/db7/f10f 0 2024-04-25T17:19:33.380 INFO:tasks.workunit.client.0.smithi037.stdout:8/939: dwrite d5/db/d18/d3b/d50/da0/da6/da8/f132 [0,4194304] 0 2024-04-25T17:19:33.380 INFO:tasks.workunit.client.0.smithi037.stdout:7/983: dwrite d5/d15/d17/d1b/da2/d76/f77 [8388608,4194304] 0 2024-04-25T17:19:33.387 INFO:tasks.workunit.client.0.smithi037.stdout:3/844: dread d8/d31/d32/f36 [0,4194304] 0 2024-04-25T17:19:33.389 INFO:tasks.workunit.client.0.smithi037.stdout:3/845: chown d8/d31/d32/dd7/fe7 524107342 1 2024-04-25T17:19:33.393 INFO:tasks.workunit.client.0.smithi037.stdout:3/846: creat d8/db4/f110 x:0 0 0 2024-04-25T17:19:33.394 INFO:tasks.workunit.client.0.smithi037.stdout:8/940: mknod d5/d26/ddd/c139 0 2024-04-25T17:19:33.396 INFO:tasks.workunit.client.0.smithi037.stdout:3/847: symlink d8/d23/dbb/daa/l111 0 2024-04-25T17:19:33.397 INFO:tasks.workunit.client.0.smithi037.stdout:8/941: mknod d5/db/d23/d42/c13a 0 2024-04-25T17:19:33.397 INFO:tasks.workunit.client.0.smithi037.stdout:3/848: fdatasync d8/d23/d38/f74 0 2024-04-25T17:19:33.399 INFO:tasks.workunit.client.0.smithi037.stdout:8/942: dread - d5/db/d23/d78/d9c/ded/f103 zero size 2024-04-25T17:19:33.400 INFO:tasks.workunit.client.0.smithi037.stdout:3/849: symlink d8/db4/dca/l112 0 2024-04-25T17:19:33.400 INFO:tasks.workunit.client.0.smithi037.stdout:8/943: mknod d5/db/da2/dc1/c13b 0 2024-04-25T17:19:33.404 INFO:tasks.workunit.client.0.smithi037.stdout:3/850: dread d8/d23/dbb/d81/fab [0,4194304] 0 2024-04-25T17:19:33.405 INFO:tasks.workunit.client.0.smithi037.stdout:8/944: chown d5/db/d18/d3b/f9b 703 1 2024-04-25T17:19:33.407 INFO:tasks.workunit.client.0.smithi037.stdout:8/945: fdatasync d5/db/d18/d3b/d106/d12a/f133 0 2024-04-25T17:19:33.410 INFO:tasks.workunit.client.0.smithi037.stdout:7/984: dread d5/d14/d31/f9f [0,4194304] 0 2024-04-25T17:19:33.412 INFO:tasks.workunit.client.0.smithi037.stdout:8/946: creat d5/db/d59/f13c x:0 0 0 2024-04-25T17:19:33.412 INFO:tasks.workunit.client.0.smithi037.stdout:7/985: chown d5/d14/d31/c50 23 1 2024-04-25T17:19:33.413 INFO:tasks.workunit.client.0.smithi037.stdout:8/947: readlink d5/db/d23/d58/la3 0 2024-04-25T17:19:33.414 INFO:tasks.workunit.client.0.smithi037.stdout:7/986: dread - d5/d15/d17/d1b/d94/da8/f109 zero size 2024-04-25T17:19:33.418 INFO:tasks.workunit.client.0.smithi037.stdout:7/987: creat d5/d15/d17/f150 x:0 0 0 2024-04-25T17:19:33.422 INFO:tasks.workunit.client.0.smithi037.stdout:3/851: dread d8/d23/d38/fdf [0,4194304] 0 2024-04-25T17:19:33.426 INFO:tasks.workunit.client.0.smithi037.stdout:3/852: rename d8/d23/dbb/d81 to d8/d31/d32/df8/d113 0 2024-04-25T17:19:33.431 INFO:tasks.workunit.client.0.smithi037.stdout:3/853: mknod d8/d31/d32/d87/c114 0 2024-04-25T17:19:33.435 INFO:tasks.workunit.client.0.smithi037.stdout:3/854: truncate d8/d57/fc6 1741279 0 2024-04-25T17:19:33.436 INFO:tasks.workunit.client.0.smithi037.stdout:3/855: fdatasync d8/d31/d32/df8/d113/fac 0 2024-04-25T17:19:33.437 INFO:tasks.workunit.client.0.smithi037.stdout:3/856: write d8/d23/f62 [3796994,32434] 0 2024-04-25T17:19:33.451 INFO:tasks.workunit.client.0.smithi037.stdout:7/988: write d5/d15/d17/d1b/da2/daf/ff6 [5259724,112940] 0 2024-04-25T17:19:33.453 INFO:tasks.workunit.client.0.smithi037.stdout:8/948: dwrite d5/d26/d33/f4d [0,4194304] 0 2024-04-25T17:19:33.457 INFO:tasks.workunit.client.0.smithi037.stdout:8/949: dread d5/f111 [0,4194304] 0 2024-04-25T17:19:33.460 INFO:tasks.workunit.client.0.smithi037.stdout:7/989: mknod d5/dc1/de1/c151 0 2024-04-25T17:19:33.474 INFO:tasks.workunit.client.0.smithi037.stdout:3/857: write d8/d31/d32/df8/d113/dc3/ff0 [402701,53774] 0 2024-04-25T17:19:33.475 INFO:tasks.workunit.client.0.smithi037.stdout:8/950: mknod d5/c13d 0 2024-04-25T17:19:33.480 INFO:tasks.workunit.client.0.smithi037.stdout:7/990: rename d5/d15/d17/d25/d2b/d48/lbf to d5/dc1/de1/l152 0 2024-04-25T17:19:33.481 INFO:tasks.workunit.client.0.smithi037.stdout:7/991: chown d5/d15/d17/d1b/da2/d105 429453 1 2024-04-25T17:19:33.482 INFO:tasks.workunit.client.0.smithi037.stdout:7/992: readlink d5/d15/d17/d25/d2b/d59/dfe/l102 0 2024-04-25T17:19:33.484 INFO:tasks.workunit.client.0.smithi037.stdout:3/858: mkdir d8/d23/dbb/daa/d115 0 2024-04-25T17:19:33.495 INFO:tasks.workunit.client.0.smithi037.stdout:7/993: creat d5/d15/d17/d1b/da2/f153 x:0 0 0 2024-04-25T17:19:33.497 INFO:tasks.workunit.client.0.smithi037.stdout:3/859: mkdir d8/d31/d32/dd7/d116 0 2024-04-25T17:19:33.500 INFO:tasks.workunit.client.0.smithi037.stdout:3/860: mknod d8/d23/dbb/d5d/c117 0 2024-04-25T17:19:33.502 INFO:tasks.workunit.client.0.smithi037.stdout:8/951: creat d5/db/d23/f13e x:0 0 0 2024-04-25T17:19:33.503 INFO:tasks.workunit.client.0.smithi037.stdout:7/994: creat d5/d15/d17/d25/d142/f154 x:0 0 0 2024-04-25T17:19:33.508 INFO:tasks.workunit.client.0.smithi037.stdout:8/952: read d5/db/d23/f1e [746453,75183] 0 2024-04-25T17:19:33.510 INFO:tasks.workunit.client.0.smithi037.stdout:7/995: mknod d5/dc1/de1/c155 0 2024-04-25T17:19:33.517 INFO:tasks.workunit.client.0.smithi037.stdout:7/996: creat d5/d14/dd3/f156 x:0 0 0 2024-04-25T17:19:33.518 INFO:tasks.workunit.client.0.smithi037.stdout:7/997: dread - d5/d15/d17/d1b/d94/da8/f109 zero size 2024-04-25T17:19:33.520 INFO:tasks.workunit.client.0.smithi037.stdout:7/998: write d5/d15/d17/d25/d2b/d59/dfe/d10e/f141 [945013,49338] 0 2024-04-25T17:19:33.522 INFO:tasks.workunit.client.0.smithi037.stdout:7/999: dread - d5/d15/dd8/f100 zero size 2024-04-25T17:19:33.524 INFO:tasks.workunit.client.0.smithi037.stdout:3/861: write d8/d23/dbb/d5d/f84 [3040036,88621] 0 2024-04-25T17:19:33.525 INFO:tasks.workunit.client.0.smithi037.stdout:3/862: chown d8/d31/d8d/db7/fd4 4877914 1 2024-04-25T17:19:33.529 INFO:tasks.workunit.client.0.smithi037.stdout:8/953: write d5/da/f32 [311359,92119] 0 2024-04-25T17:19:33.543 INFO:tasks.workunit.client.0.smithi037.stdout:8/954: write d5/db/d18/d3b/fb2 [2962431,56834] 0 2024-04-25T17:19:33.545 INFO:tasks.workunit.client.0.smithi037.stdout:3/863: dwrite d8/deb/f8f [0,4194304] 0 2024-04-25T17:19:33.553 INFO:tasks.workunit.client.0.smithi037.stdout:8/955: dwrite d5/db/d18/d3b/d50/da0/da6/da8/ffe [0,4194304] 0 2024-04-25T17:19:33.554 INFO:tasks.workunit.client.0.smithi037.stdout:3/864: rename d8/d31/d32/dd7/d7d/c94 to d8/d23/c118 0 2024-04-25T17:19:33.555 INFO:tasks.workunit.client.0.smithi037.stdout:8/956: chown d5/db/d18/d3b/fb2 1 1 2024-04-25T17:19:33.557 INFO:tasks.workunit.client.0.smithi037.stdout:8/957: stat d5/db/d18/d3b/d50/da0/da6/da8/cf5 0 2024-04-25T17:19:33.561 INFO:tasks.workunit.client.0.smithi037.stdout:8/958: read d5/da/f11 [1326113,55270] 0 2024-04-25T17:19:33.561 INFO:tasks.workunit.client.0.smithi037.stdout:3/865: dread d8/d23/d38/f74 [0,4194304] 0 2024-04-25T17:19:33.575 INFO:tasks.workunit.client.0.smithi037.stdout:8/959: truncate d5/d6a/f66 3895379 0 2024-04-25T17:19:33.579 INFO:tasks.workunit.client.0.smithi037.stdout:3/866: dwrite d8/d31/d8d/fda [0,4194304] 0 2024-04-25T17:19:33.584 INFO:tasks.workunit.client.0.smithi037.stdout:8/960: dwrite d5/d6a/f7a [0,4194304] 0 2024-04-25T17:19:33.604 INFO:tasks.workunit.client.0.smithi037.stdout:8/961: dread d5/d6a/f71 [0,4194304] 0 2024-04-25T17:19:33.606 INFO:tasks.workunit.client.0.smithi037.stdout:8/962: read d5/db/d7e/f9d [154905,97334] 0 2024-04-25T17:19:33.609 INFO:tasks.workunit.client.0.smithi037.stdout:8/963: unlink d5/db/d18/d3b/d50/d51/f85 0 2024-04-25T17:19:33.610 INFO:tasks.workunit.client.0.smithi037.stdout:8/964: write d5/dbc/f136 [574135,38369] 0 2024-04-25T17:19:33.617 INFO:tasks.workunit.client.0.smithi037.stdout:8/965: dwrite d5/f35 [4194304,4194304] 0 2024-04-25T17:19:33.620 INFO:tasks.workunit.client.0.smithi037.stdout:3/867: dread d8/d31/d32/f51 [0,4194304] 0 2024-04-25T17:19:33.623 INFO:tasks.workunit.client.0.smithi037.stdout:3/868: rmdir d8/d23/dbb/d5d 39 2024-04-25T17:19:33.625 INFO:tasks.workunit.client.0.smithi037.stdout:8/966: rename d5/d6a/l2a to d5/db/d18/d3b/d106/d12a/l13f 0 2024-04-25T17:19:33.635 INFO:tasks.workunit.client.0.smithi037.stdout:8/967: write d5/d26/d33/fd4 [834107,109799] 0 2024-04-25T17:19:33.643 INFO:tasks.workunit.client.0.smithi037.stdout:8/968: creat d5/db/d23/d58/f140 x:0 0 0 2024-04-25T17:19:33.645 INFO:tasks.workunit.client.0.smithi037.stdout:8/969: mkdir d5/d26/ddd/d141 0 2024-04-25T17:19:33.647 INFO:tasks.workunit.client.0.smithi037.stdout:3/869: dread d8/f9 [4194304,4194304] 0 2024-04-25T17:19:33.648 INFO:tasks.workunit.client.0.smithi037.stdout:8/970: unlink d5/db/d18/d3b/d50/da0/da6/da8/ffe 0 2024-04-25T17:19:33.652 INFO:tasks.workunit.client.0.smithi037.stdout:3/870: getdents d8/d31/d32/dd7/d116 0 2024-04-25T17:19:33.655 INFO:tasks.workunit.client.0.smithi037.stdout:3/871: fdatasync d8/d31/d8d/db7/dcd/fdc 0 2024-04-25T17:19:33.655 INFO:tasks.workunit.client.0.smithi037.stdout:8/971: dwrite d5/dd0/f120 [0,4194304] 0 2024-04-25T17:19:33.656 INFO:tasks.workunit.client.0.smithi037.stdout:3/872: chown d8/db4/f110 879 1 2024-04-25T17:19:33.660 INFO:tasks.workunit.client.0.smithi037.stdout:8/972: creat d5/db/d18/d3b/d50/df6/f142 x:0 0 0 2024-04-25T17:19:33.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:33 smithi069 ceph-mon[34527]: pgmap v47: 65 pgs: 65 active+clean; 4.0 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 102 MiB/s rd, 224 MiB/s wr, 561 op/s 2024-04-25T17:19:33.672 INFO:tasks.workunit.client.0.smithi037.stdout:8/973: dwrite d5/da/f4a [0,4194304] 0 2024-04-25T17:19:33.681 INFO:tasks.workunit.client.0.smithi037.stdout:8/974: symlink d5/d26/l143 0 2024-04-25T17:19:33.683 INFO:tasks.workunit.client.0.smithi037.stdout:8/975: mkdir d5/db/d23/d78/d9c/d144 0 2024-04-25T17:19:33.684 INFO:tasks.workunit.client.0.smithi037.stdout:8/976: chown d5/db/d7e/f9d 2768 1 2024-04-25T17:19:33.687 INFO:tasks.workunit.client.0.smithi037.stdout:8/977: mknod d5/db/d18/d3b/d50/da0/da6/dd9/c145 0 2024-04-25T17:19:33.690 INFO:tasks.workunit.client.0.smithi037.stdout:3/873: dwrite d8/d23/dbb/d5d/f7e [0,4194304] 0 2024-04-25T17:19:33.695 INFO:tasks.workunit.client.0.smithi037.stdout:3/874: dread d8/deb/fb0 [0,4194304] 0 2024-04-25T17:19:33.702 INFO:tasks.workunit.client.0.smithi037.stdout:3/875: mkdir d8/d23/dc0/d119 0 2024-04-25T17:19:33.702 INFO:tasks.workunit.client.0.smithi037.stdout:8/978: write d5/d6a/f89 [680620,44181] 0 2024-04-25T17:19:33.706 INFO:tasks.workunit.client.0.smithi037.stdout:3/876: fdatasync d8/d31/f47 0 2024-04-25T17:19:33.707 INFO:tasks.workunit.client.0.smithi037.stdout:8/979: symlink d5/db/d18/d3b/d50/da0/d109/d10e/l146 0 2024-04-25T17:19:33.711 INFO:tasks.workunit.client.0.smithi037.stdout:3/877: creat d8/db4/f11a x:0 0 0 2024-04-25T17:19:33.714 INFO:tasks.workunit.client.0.smithi037.stdout:3/878: fdatasync d8/d23/fc4 0 2024-04-25T17:19:33.715 INFO:tasks.workunit.client.0.smithi037.stdout:3/879: chown d8/d23/dc0/lfb 2369 1 2024-04-25T17:19:33.715 INFO:tasks.workunit.client.0.smithi037.stdout:3/880: readlink d8/d31/d32/le5 0 2024-04-25T17:19:33.717 INFO:tasks.workunit.client.0.smithi037.stdout:3/881: read d8/d31/d32/df8/d113/fac [40721,21379] 0 2024-04-25T17:19:33.722 INFO:tasks.workunit.client.0.smithi037.stdout:3/882: mkdir d8/d31/d11b 0 2024-04-25T17:19:33.724 INFO:tasks.workunit.client.0.smithi037.stdout:3/883: mkdir d8/d23/dbb/d5d/d11c 0 2024-04-25T17:19:33.726 INFO:tasks.workunit.client.0.smithi037.stdout:3/884: creat d8/d23/dbb/daa/f11d x:0 0 0 2024-04-25T17:19:33.727 INFO:tasks.workunit.client.0.smithi037.stdout:3/885: read d8/d23/d38/f6b [32783,53555] 0 2024-04-25T17:19:33.730 INFO:tasks.workunit.client.0.smithi037.stdout:3/886: readlink d8/d23/dbb/l67 0 2024-04-25T17:19:33.734 INFO:tasks.workunit.client.0.smithi037.stdout:3/887: rename d8/d23/f2d to d8/d23/f11e 0 2024-04-25T17:19:33.736 INFO:tasks.workunit.client.0.smithi037.stdout:3/888: mkdir d8/d31/d32/df8/d113/d11f 0 2024-04-25T17:19:33.739 INFO:tasks.workunit.client.0.smithi037.stdout:3/889: dread d8/d31/d8d/db7/fd4 [0,4194304] 0 2024-04-25T17:19:33.748 INFO:tasks.workunit.client.0.smithi037.stdout:3/890: write d8/f79 [3270192,95334] 0 2024-04-25T17:19:33.763 INFO:tasks.workunit.client.0.smithi037.stdout:3/891: dread d8/d23/d38/d66/f75 [0,4194304] 0 2024-04-25T17:19:33.773 INFO:tasks.workunit.client.0.smithi037.stdout:3/892: write d8/f22 [3643367,131029] 0 2024-04-25T17:19:33.774 INFO:tasks.workunit.client.0.smithi037.stdout:3/893: stat d8/db4/f110 0 2024-04-25T17:19:33.776 INFO:tasks.workunit.client.0.smithi037.stdout:3/894: symlink d8/d31/d32/df8/d113/dc3/l120 0 2024-04-25T17:19:33.777 INFO:tasks.workunit.client.0.smithi037.stdout:3/895: write d8/fe4 [1024487,68316] 0 2024-04-25T17:19:33.781 INFO:tasks.workunit.client.0.smithi037.stdout:3/896: dread d8/d31/d32/f51 [0,4194304] 0 2024-04-25T17:19:33.783 INFO:tasks.workunit.client.0.smithi037.stdout:3/897: mknod d8/d23/dbb/d5d/d11c/c121 0 2024-04-25T17:19:33.793 INFO:tasks.workunit.client.0.smithi037.stdout:3/898: write d8/f37 [1132005,86918] 0 2024-04-25T17:19:33.800 INFO:tasks.workunit.client.0.smithi037.stdout:3/899: truncate d8/deb/d88/fcc 2601256 0 2024-04-25T17:19:33.805 INFO:tasks.workunit.client.0.smithi037.stdout:3/900: dwrite d8/d23/dbb/f4f [0,4194304] 0 2024-04-25T17:19:33.806 INFO:tasks.workunit.client.0.smithi037.stdout:3/901: chown d8/d4c 3046 1 2024-04-25T17:19:33.812 INFO:tasks.workunit.client.0.smithi037.stdout:3/902: getdents d8/d31/d32/df8/d113/dc3 0 2024-04-25T17:19:33.816 INFO:tasks.workunit.client.0.smithi037.stdout:3/903: fsync d8/d4c/f8c 0 2024-04-25T17:19:33.819 INFO:tasks.workunit.client.0.smithi037.stdout:3/904: creat d8/d31/d32/dd7/f122 x:0 0 0 2024-04-25T17:19:33.820 INFO:tasks.workunit.client.0.smithi037.stdout:3/905: stat d8/d31/f48 0 2024-04-25T17:19:33.821 INFO:tasks.workunit.client.0.smithi037.stdout:3/906: chown d8/f37 129119659 1 2024-04-25T17:19:33.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:33 smithi037 ceph-mon[26472]: pgmap v47: 65 pgs: 65 active+clean; 4.0 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 102 MiB/s rd, 224 MiB/s wr, 561 op/s 2024-04-25T17:19:33.822 INFO:tasks.workunit.client.0.smithi037.stdout:3/907: write d8/f79 [1260359,127874] 0 2024-04-25T17:19:33.825 INFO:tasks.workunit.client.0.smithi037.stdout:3/908: creat d8/d31/d8d/f123 x:0 0 0 2024-04-25T17:19:33.826 INFO:tasks.workunit.client.0.smithi037.stdout:3/909: dread - d8/d31/fe3 zero size 2024-04-25T17:19:33.830 INFO:tasks.workunit.client.0.smithi037.stdout:3/910: rename d8/d31/d32/le5 to d8/d23/dbb/d5d/d11c/l124 0 2024-04-25T17:19:33.830 INFO:tasks.workunit.client.0.smithi037.stdout:3/911: chown d8/d31/d32/f51 52442139 1 2024-04-25T17:19:33.832 INFO:tasks.workunit.client.0.smithi037.stdout:3/912: chown d8/d57 615 1 2024-04-25T17:19:33.834 INFO:tasks.workunit.client.0.smithi037.stdout:3/913: dread d8/d31/d32/df8/d113/dc3/ff0 [0,4194304] 0 2024-04-25T17:19:33.850 INFO:tasks.workunit.client.0.smithi037.stdout:3/914: write d8/d23/f11e [1038121,45] 0 2024-04-25T17:19:33.913 INFO:tasks.workunit.client.0.smithi037.stdout:3/915: mknod d8/d31/d8d/db7/dcd/c125 0 2024-04-25T17:19:33.915 INFO:tasks.workunit.client.0.smithi037.stdout:3/916: symlink d8/deb/d88/l126 0 2024-04-25T17:19:33.916 INFO:tasks.workunit.client.0.smithi037.stdout:3/917: read d8/d23/d38/d66/f75 [1942166,121441] 0 2024-04-25T17:19:33.918 INFO:tasks.workunit.client.0.smithi037.stdout:3/918: creat d8/d23/dbb/daa/f127 x:0 0 0 2024-04-25T17:19:33.920 INFO:tasks.workunit.client.0.smithi037.stdout:3/919: read d8/d31/d8d/db7/dcd/fdc [239423,88332] 0 2024-04-25T17:19:34.565 INFO:tasks.workunit.client.0.smithi037.stdout:3/920: sync 2024-04-25T17:19:34.565 INFO:tasks.workunit.client.0.smithi037.stdout:8/980: sync 2024-04-25T17:19:34.570 INFO:tasks.workunit.client.0.smithi037.stdout:3/921: rename d8/d31/d8d/cbd to d8/d23/d38/d66/c128 0 2024-04-25T17:19:34.574 INFO:tasks.workunit.client.0.smithi037.stdout:8/981: creat d5/db/d18/d3b/f147 x:0 0 0 2024-04-25T17:19:34.576 INFO:tasks.workunit.client.0.smithi037.stdout:8/982: creat d5/db/d18/d3b/d75/f148 x:0 0 0 2024-04-25T17:19:34.579 INFO:tasks.workunit.client.0.smithi037.stdout:8/983: creat d5/d26/ddd/f149 x:0 0 0 2024-04-25T17:19:34.583 INFO:tasks.workunit.client.0.smithi037.stdout:3/922: dread d8/d31/d8d/db7/dcd/fdc [0,4194304] 0 2024-04-25T17:19:34.584 INFO:tasks.workunit.client.0.smithi037.stdout:8/984: link d5/da/l2d d5/db/da2/l14a 0 2024-04-25T17:19:34.586 INFO:tasks.workunit.client.0.smithi037.stdout:3/923: rename d8/d23/dbb/d5d/d11c to d8/d23/dbb/d5d/d129 0 2024-04-25T17:19:34.588 INFO:tasks.workunit.client.0.smithi037.stdout:3/924: symlink d8/d57/l12a 0 2024-04-25T17:19:34.590 INFO:tasks.workunit.client.0.smithi037.stdout:3/925: mknod d8/d23/dbb/d5d/c12b 0 2024-04-25T17:19:34.612 INFO:tasks.workunit.client.0.smithi037.stdout:3/926: truncate d8/f79 184914 0 2024-04-25T17:19:34.617 INFO:tasks.workunit.client.0.smithi037.stdout:3/927: rmdir d8/d31/d11b 0 2024-04-25T17:19:34.622 INFO:tasks.workunit.client.0.smithi037.stdout:3/928: link d8/d4c/lce d8/deb/l12c 0 2024-04-25T17:19:34.627 INFO:tasks.workunit.client.0.smithi037.stdout:3/929: dwrite d8/d31/d32/f36 [0,4194304] 0 2024-04-25T17:19:34.630 INFO:tasks.workunit.client.0.smithi037.stdout:3/930: creat d8/d31/d32/df8/d113/f12d x:0 0 0 2024-04-25T17:19:34.654 INFO:tasks.workunit.client.0.smithi037.stdout:3/931: write d8/f1f [1350882,110492] 0 2024-04-25T17:19:34.657 INFO:tasks.workunit.client.0.smithi037.stdout:3/932: rename d8/db4/f110 to d8/d23/dbb/d5d/f12e 0 2024-04-25T17:19:34.664 INFO:tasks.workunit.client.0.smithi037.stdout:3/933: getdents d8/db4/dca 0 2024-04-25T17:19:34.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:34 smithi069 ceph-mon[34527]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:19:34.670 INFO:tasks.workunit.client.0.smithi037.stdout:3/934: rename d8/d31/d32/c78 to d8/db4/c12f 0 2024-04-25T17:19:34.670 INFO:tasks.workunit.client.0.smithi037.stdout:3/935: write d8/d31/d32/df8/d113/ffc [1222433,29045] 0 2024-04-25T17:19:34.672 INFO:tasks.workunit.client.0.smithi037.stdout:3/936: truncate d8/d23/dbb/fec 303925 0 2024-04-25T17:19:34.676 INFO:tasks.workunit.client.0.smithi037.stdout:3/937: dread d8/d31/d32/f51 [0,4194304] 0 2024-04-25T17:19:34.677 INFO:tasks.workunit.client.0.smithi037.stdout:3/938: write d8/f26 [2249259,74018] 0 2024-04-25T17:19:34.680 INFO:tasks.workunit.client.0.smithi037.stdout:3/939: rename d8/d23/dbb/d5d/f3d to d8/deb/d88/f130 0 2024-04-25T17:19:34.682 INFO:tasks.workunit.client.0.smithi037.stdout:3/940: truncate d8/d23/d38/f6b 566310 0 2024-04-25T17:19:34.684 INFO:tasks.workunit.client.0.smithi037.stdout:3/941: mkdir d8/d131 0 2024-04-25T17:19:34.685 INFO:tasks.workunit.client.0.smithi037.stdout:3/942: truncate d8/f22 4900538 0 2024-04-25T17:19:34.687 INFO:tasks.workunit.client.0.smithi037.stdout:3/943: creat d8/d23/dbb/d63/f132 x:0 0 0 2024-04-25T17:19:34.690 INFO:tasks.workunit.client.0.smithi037.stdout:3/944: mknod d8/d23/dc0/d119/c133 0 2024-04-25T17:19:34.694 INFO:tasks.workunit.client.0.smithi037.stdout:3/945: truncate d8/d31/d32/df8/d113/fa8 554715 0 2024-04-25T17:19:34.695 INFO:tasks.workunit.client.0.smithi037.stdout:3/946: symlink d8/d31/d8d/l134 0 2024-04-25T17:19:34.710 INFO:tasks.workunit.client.0.smithi037.stdout:3/947: dread d8/d31/f47 [0,4194304] 0 2024-04-25T17:19:34.712 INFO:tasks.workunit.client.0.smithi037.stdout:3/948: rmdir d8/deb 39 2024-04-25T17:19:34.717 INFO:tasks.workunit.client.0.smithi037.stdout:3/949: dwrite d8/d23/dbb/f43 [0,4194304] 0 2024-04-25T17:19:34.734 INFO:tasks.workunit.client.0.smithi037.stdout:3/950: truncate d8/d23/f62 1027450 0 2024-04-25T17:19:34.735 INFO:tasks.workunit.client.0.smithi037.stdout:3/951: write d8/d31/d32/f36 [1485228,83023] 0 2024-04-25T17:19:34.736 INFO:tasks.workunit.client.0.smithi037.stdout:3/952: chown d8/d31/d32/dd7/d7d/f100 12 1 2024-04-25T17:19:34.740 INFO:tasks.workunit.client.0.smithi037.stdout:3/953: mkdir d8/d23/d38/d66/dff/d135 0 2024-04-25T17:19:34.740 INFO:tasks.workunit.client.0.smithi037.stdout:3/954: stat d8/d4c/l7b 0 2024-04-25T17:19:34.753 INFO:tasks.workunit.client.0.smithi037.stdout:3/955: dwrite d8/d23/dbb/d5d/fa9 [0,4194304] 0 2024-04-25T17:19:34.759 INFO:tasks.workunit.client.0.smithi037.stdout:3/956: symlink d8/d23/l136 0 2024-04-25T17:19:34.779 INFO:tasks.workunit.client.0.smithi037.stdout:3/957: dread d8/d23/dc0/fcb [0,4194304] 0 2024-04-25T17:19:34.785 INFO:tasks.workunit.client.0.smithi037.stdout:3/958: dwrite d8/d31/d32/df8/d113/fac [0,4194304] 0 2024-04-25T17:19:34.799 INFO:tasks.workunit.client.0.smithi037.stdout:3/959: dwrite d8/d31/d32/df8/d113/fa8 [0,4194304] 0 2024-04-25T17:19:34.804 INFO:tasks.workunit.client.0.smithi037.stdout:3/960: rename d8/d31/d8d/db7/fef to d8/d31/d32/df8/d113/f137 0 2024-04-25T17:19:34.808 INFO:tasks.workunit.client.0.smithi037.stdout:3/961: dread d8/d31/d32/f36 [4194304,4194304] 0 2024-04-25T17:19:34.810 INFO:tasks.workunit.client.0.smithi037.stdout:3/962: rmdir d8/d31/d32 39 2024-04-25T17:19:34.812 INFO:tasks.workunit.client.0.smithi037.stdout:3/963: unlink d8/f26 0 2024-04-25T17:19:34.817 INFO:tasks.workunit.client.0.smithi037.stdout:3/964: rename d8/lb to d8/d23/dbb/l138 0 2024-04-25T17:19:34.820 INFO:tasks.workunit.client.0.smithi037.stdout:3/965: rename d8/d23/l136 to d8/d23/dbb/d5d/l139 0 2024-04-25T17:19:34.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:34 smithi037 ceph-mon[26472]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:19:34.821 INFO:tasks.workunit.client.0.smithi037.stdout:3/966: mkdir d8/db4/d13a 0 2024-04-25T17:19:34.825 INFO:tasks.workunit.client.0.smithi037.stdout:3/967: fdatasync d8/ff 0 2024-04-25T17:19:34.825 INFO:tasks.workunit.client.0.smithi037.stdout:3/968: readlink d8/d4c/l9e 0 2024-04-25T17:19:34.827 INFO:tasks.workunit.client.0.smithi037.stdout:3/969: creat d8/db4/dca/f13b x:0 0 0 2024-04-25T17:19:34.830 INFO:tasks.workunit.client.0.smithi037.stdout:8/985: sync 2024-04-25T17:19:34.834 INFO:tasks.workunit.client.0.smithi037.stdout:8/986: rename d5/db/d23/d58/dd3/fdc to d5/db/d18/d3b/d50/da0/f14b 0 2024-04-25T17:19:34.844 INFO:tasks.workunit.client.0.smithi037.stdout:8/987: dread d5/da/fb4 [0,4194304] 0 2024-04-25T17:19:34.848 INFO:tasks.workunit.client.0.smithi037.stdout:8/988: dread d5/db/d18/d3b/d50/da0/da6/da8/fc0 [0,4194304] 0 2024-04-25T17:19:34.936 INFO:tasks.workunit.client.0.smithi037.stdout:8/989: dwrite d5/db/d23/d78/d93/f124 [0,4194304] 0 2024-04-25T17:19:34.938 INFO:tasks.workunit.client.0.smithi037.stdout:3/970: truncate d8/d31/f48 3135073 0 2024-04-25T17:19:34.939 INFO:tasks.workunit.client.0.smithi037.stdout:3/971: chown d8/d23/dbb/d5d/d129 176790832 1 2024-04-25T17:19:35.013 INFO:tasks.workunit.client.0.smithi037.stdout:8/990: unlink d5/d6a/f8c 0 2024-04-25T17:19:35.016 INFO:tasks.workunit.client.0.smithi037.stdout:3/972: creat d8/d23/dbb/d5d/d129/f13c x:0 0 0 2024-04-25T17:19:35.016 INFO:tasks.workunit.client.0.smithi037.stdout:3/973: chown d8/d31/f5f 82247 1 2024-04-25T17:19:35.018 INFO:tasks.workunit.client.0.smithi037.stdout:8/991: creat d5/d26/d33/f14c x:0 0 0 2024-04-25T17:19:35.025 INFO:tasks.workunit.client.0.smithi037.stdout:8/992: dwrite d5/db/d23/d78/d9c/ded/f103 [0,4194304] 0 2024-04-25T17:19:35.030 INFO:tasks.workunit.client.0.smithi037.stdout:8/993: truncate d5/db/d18/d3b/d50/d51/f69 622885 0 2024-04-25T17:19:35.054 INFO:tasks.workunit.client.0.smithi037.stdout:8/994: dread d5/db/d23/d42/f4f [4194304,4194304] 0 2024-04-25T17:19:35.177 INFO:tasks.workunit.client.0.smithi037.stdout:3/974: write d8/f2c [3334897,90603] 0 2024-04-25T17:19:35.182 INFO:tasks.workunit.client.0.smithi037.stdout:3/975: dread d8/d31/d32/df8/d113/fa8 [0,4194304] 0 2024-04-25T17:19:35.184 INFO:tasks.workunit.client.0.smithi037.stdout:3/976: unlink d8/d4c/l7b 0 2024-04-25T17:19:35.185 INFO:tasks.workunit.client.0.smithi037.stdout:3/977: chown d8/d4c/f68 3494 1 2024-04-25T17:19:35.189 INFO:tasks.workunit.client.0.smithi037.stdout:3/978: link d8/d31/lfe d8/d31/d32/dd7/d116/l13d 0 2024-04-25T17:19:35.190 INFO:tasks.workunit.client.0.smithi037.stdout:3/979: symlink d8/db4/l13e 0 2024-04-25T17:19:35.191 INFO:tasks.workunit.client.0.smithi037.stdout:3/980: chown d8/d23/dbb/fec 9436609 1 2024-04-25T17:19:35.195 INFO:tasks.workunit.client.0.smithi037.stdout:8/995: write d5/db/d23/f1e [1015484,26002] 0 2024-04-25T17:19:35.197 INFO:tasks.workunit.client.0.smithi037.stdout:8/996: mknod d5/db/d7e/c14d 0 2024-04-25T17:19:35.233 INFO:tasks.workunit.client.0.smithi037.stdout:3/981: dwrite d8/d23/d38/d66/fa7 [0,4194304] 0 2024-04-25T17:19:35.234 INFO:tasks.workunit.client.0.smithi037.stdout:8/997: dwrite d5/f111 [4194304,4194304] 0 2024-04-25T17:19:35.235 INFO:tasks.workunit.client.0.smithi037.stdout:8/998: dread - d5/db/d23/d58/dd3/f10f zero size 2024-04-25T17:19:35.242 INFO:tasks.workunit.client.0.smithi037.stdout:8/999: mknod d5/db/d23/dd8/c14e 0 2024-04-25T17:19:35.243 INFO:tasks.workunit.client.0.smithi037.stdout:3/982: dwrite d8/f37 [0,4194304] 0 2024-04-25T17:19:35.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:35 smithi069 ceph-mon[34527]: pgmap v48: 65 pgs: 65 active+clean; 4.0 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 75 MiB/s rd, 164 MiB/s wr, 398 op/s 2024-04-25T17:19:35.680 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:35 smithi037 ceph-mon[26472]: pgmap v48: 65 pgs: 65 active+clean; 4.0 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 75 MiB/s rd, 164 MiB/s wr, 398 op/s 2024-04-25T17:19:35.761 INFO:tasks.workunit.client.0.smithi037.stdout:3/983: sync 2024-04-25T17:19:35.762 INFO:tasks.workunit.client.0.smithi037.stdout:3/984: chown d8/d23/dbb/d5d/c117 96482 1 2024-04-25T17:19:35.768 INFO:tasks.workunit.client.0.smithi037.stdout:3/985: write d8/d23/d38/fc9 [562675,44856] 0 2024-04-25T17:19:35.769 INFO:tasks.workunit.client.0.smithi037.stdout:3/986: chown d8/d23/dbb 29 1 2024-04-25T17:19:35.772 INFO:tasks.workunit.client.0.smithi037.stdout:3/987: write d8/deb/d88/fcc [583687,35971] 0 2024-04-25T17:19:35.775 INFO:tasks.workunit.client.0.smithi037.stdout:3/988: mkdir d8/db4/d13a/d13f 0 2024-04-25T17:19:35.775 INFO:tasks.workunit.client.0.smithi037.stdout:3/989: chown d8/d23/f93 1774 1 2024-04-25T17:19:35.782 INFO:tasks.workunit.client.0.smithi037.stdout:3/990: dwrite d8/dd8/ff2 [0,4194304] 0 2024-04-25T17:19:35.783 INFO:tasks.workunit.client.0.smithi037.stdout:3/991: write d8/d23/da0/f10e [488144,90134] 0 2024-04-25T17:19:35.788 INFO:tasks.workunit.client.0.smithi037.stdout:3/992: rename d8/d31/d32/dd7/d7d/c97 to d8/d31/d32/dd7/c140 0 2024-04-25T17:19:35.795 INFO:tasks.workunit.client.0.smithi037.stdout:3/993: dread d8/d31/d32/df8/d113/ffc [0,4194304] 0 2024-04-25T17:19:35.795 INFO:tasks.workunit.client.0.smithi037.stdout:3/994: dread - d8/d23/d38/fe1 zero size 2024-04-25T17:19:35.797 INFO:tasks.workunit.client.0.smithi037.stdout:3/995: mkdir d8/d23/dbb/daa/d141 0 2024-04-25T17:19:35.800 INFO:tasks.workunit.client.0.smithi037.stdout:3/996: symlink d8/d31/d32/df8/d113/l142 0 2024-04-25T17:19:35.800 INFO:tasks.workunit.client.0.smithi037.stdout:3/997: write d8/d57/ff7 [816673,8763] 0 2024-04-25T17:19:35.804 INFO:tasks.workunit.client.0.smithi037.stdout:3/998: getdents d8/d23/dbb/daa/d115 0 2024-04-25T17:19:35.806 INFO:tasks.workunit.client.0.smithi037.stdout:3/999: symlink d8/d23/dc0/d119/l143 0 2024-04-25T17:19:35.810 INFO:tasks.workunit.client.0.smithi037.stderr:+ rm -rf -- ./tmp.iWwsdQYkoI 2024-04-25T17:19:37.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:37 smithi037 ceph-mon[26472]: pgmap v49: 65 pgs: 65 active+clean; 4.3 GiB data, 14 GiB used, 522 GiB / 536 GiB avail; 99 MiB/s rd, 225 MiB/s wr, 558 op/s 2024-04-25T17:19:37.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:37 smithi037 ceph-mon[26472]: mgrmap e26: smithi069.mmuhdo(active, since 92s), standbys: smithi037.txrgxl 2024-04-25T17:19:37.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:37 smithi037 ceph-mon[26472]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:19:37.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:37 smithi037 ceph-mon[26472]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:19:37.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:37 smithi037 ceph-mon[26472]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:19:37.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:37 smithi069 ceph-mon[34527]: pgmap v49: 65 pgs: 65 active+clean; 4.3 GiB data, 14 GiB used, 522 GiB / 536 GiB avail; 99 MiB/s rd, 225 MiB/s wr, 558 op/s 2024-04-25T17:19:37.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:37 smithi069 ceph-mon[34527]: mgrmap e26: smithi069.mmuhdo(active, since 92s), standbys: smithi037.txrgxl 2024-04-25T17:19:37.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:37 smithi069 ceph-mon[34527]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:19:37.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:37 smithi069 ceph-mon[34527]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:19:37.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:37 smithi069 ceph-mon[34527]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:19:38.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:38 smithi037 ceph-mon[26472]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:19:38.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:38 smithi037 ceph-mon[26472]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:19:38.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:38 smithi037 ceph-mon[26472]: pgmap v50: 65 pgs: 65 active+clean; 4.3 GiB data, 14 GiB used, 522 GiB / 536 GiB avail; 60 MiB/s rd, 139 MiB/s wr, 355 op/s 2024-04-25T17:19:38.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:38 smithi069 ceph-mon[34527]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:19:38.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:38 smithi069 ceph-mon[34527]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:19:38.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:38 smithi069 ceph-mon[34527]: pgmap v50: 65 pgs: 65 active+clean; 4.3 GiB data, 14 GiB used, 522 GiB / 536 GiB avail; 60 MiB/s rd, 139 MiB/s wr, 355 op/s 2024-04-25T17:19:41.208 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:40 smithi037 ceph-mon[26472]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:19:41.208 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:40 smithi037 ceph-mon[26472]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:19:41.208 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:40 smithi037 ceph-mon[26472]: pgmap v51: 65 pgs: 65 active+clean; 4.1 GiB data, 14 GiB used, 523 GiB / 536 GiB avail; 60 MiB/s rd, 140 MiB/s wr, 364 op/s 2024-04-25T17:19:41.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:40 smithi069 ceph-mon[34527]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:19:41.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:40 smithi069 ceph-mon[34527]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:19:41.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:40 smithi069 ceph-mon[34527]: pgmap v51: 65 pgs: 65 active+clean; 4.1 GiB data, 14 GiB used, 523 GiB / 536 GiB avail; 60 MiB/s rd, 140 MiB/s wr, 364 op/s 2024-04-25T17:19:43.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:43 smithi037 ceph-mon[26472]: pgmap v52: 65 pgs: 65 active+clean; 3.5 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 51 MiB/s rd, 118 MiB/s wr, 349 op/s 2024-04-25T17:19:43.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:43 smithi069 ceph-mon[34527]: pgmap v52: 65 pgs: 65 active+clean; 3.5 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 51 MiB/s rd, 118 MiB/s wr, 349 op/s 2024-04-25T17:19:45.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:44 smithi037 ceph-mon[26472]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:19:45.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:44 smithi037 ceph-mon[26472]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:19:45.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:44 smithi037 ceph-mon[26472]: pgmap v53: 65 pgs: 65 active+clean; 3.5 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 25 MiB/s rd, 62 MiB/s wr, 234 op/s 2024-04-25T17:19:45.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:44 smithi069 ceph-mon[34527]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:19:45.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:44 smithi069 ceph-mon[34527]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:19:45.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:44 smithi069 ceph-mon[34527]: pgmap v53: 65 pgs: 65 active+clean; 3.5 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 25 MiB/s rd, 62 MiB/s wr, 234 op/s 2024-04-25T17:19:46.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:46 smithi037 ceph-mon[26472]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:19:46.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:46 smithi037 ceph-mon[26472]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:19:46.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:46 smithi069 ceph-mon[34527]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:19:46.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:46 smithi069 ceph-mon[34527]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:19:47.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:47 smithi069 ceph-mon[34527]: pgmap v54: 65 pgs: 65 active+clean; 2.8 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 26 MiB/s rd, 63 MiB/s wr, 291 op/s 2024-04-25T17:19:47.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:47 smithi069 ceph-mon[34527]: Standby manager daemon smithi037.txrgxl restarted 2024-04-25T17:19:47.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:47 smithi069 ceph-mon[34527]: Standby manager daemon smithi037.txrgxl started 2024-04-25T17:19:47.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:47 smithi069 ceph-mon[34527]: from='mgr.? 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi037.txrgxl/crt"}]: dispatch 2024-04-25T17:19:47.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:47 smithi069 ceph-mon[34527]: from='mgr.? 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T17:19:47.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:47 smithi069 ceph-mon[34527]: from='mgr.? 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi037.txrgxl/key"}]: dispatch 2024-04-25T17:19:47.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:47 smithi069 ceph-mon[34527]: from='mgr.? 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T17:19:47.677 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:47 smithi037 ceph-mon[26472]: pgmap v54: 65 pgs: 65 active+clean; 2.8 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 26 MiB/s rd, 63 MiB/s wr, 291 op/s 2024-04-25T17:19:47.677 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:47 smithi037 ceph-mon[26472]: Standby manager daemon smithi037.txrgxl restarted 2024-04-25T17:19:47.677 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:47 smithi037 ceph-mon[26472]: Standby manager daemon smithi037.txrgxl started 2024-04-25T17:19:47.677 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:47 smithi037 ceph-mon[26472]: from='mgr.? 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi037.txrgxl/crt"}]: dispatch 2024-04-25T17:19:47.678 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:47 smithi037 ceph-mon[26472]: from='mgr.? 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T17:19:47.678 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:47 smithi037 ceph-mon[26472]: from='mgr.? 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi037.txrgxl/key"}]: dispatch 2024-04-25T17:19:47.678 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:47 smithi037 ceph-mon[26472]: from='mgr.? 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T17:19:48.676 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:48 smithi037 ceph-mon[26472]: mgrmap e27: smithi069.mmuhdo(active, since 103s), standbys: smithi037.txrgxl 2024-04-25T17:19:48.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:48 smithi069 ceph-mon[34527]: mgrmap e27: smithi069.mmuhdo(active, since 103s), standbys: smithi037.txrgxl 2024-04-25T17:19:49.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:49 smithi037 ceph-mon[26472]: pgmap v55: 65 pgs: 65 active+clean; 2.8 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 1.1 MiB/s rd, 2.4 MiB/s wr, 131 op/s 2024-04-25T17:19:49.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:49 smithi037 ceph-mon[26472]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:19:49.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:49 smithi069 ceph-mon[34527]: pgmap v55: 65 pgs: 65 active+clean; 2.8 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 1.1 MiB/s rd, 2.4 MiB/s wr, 131 op/s 2024-04-25T17:19:49.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:49 smithi069 ceph-mon[34527]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:19:51.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:50 smithi037 ceph-mon[26472]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:19:51.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:50 smithi037 ceph-mon[26472]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:19:51.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:50 smithi037 ceph-mon[26472]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:19:51.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:50 smithi037 ceph-mon[26472]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:19:51.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:50 smithi037 ceph-mon[26472]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:19:51.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:50 smithi037 ceph-mon[26472]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:19:51.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:50 smithi037 ceph-mon[26472]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "mgr fail", "who": "smithi069.mmuhdo"}]: dispatch 2024-04-25T17:19:51.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:50 smithi037 ceph-mon[26472]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "mgr fail", "who": "smithi069.mmuhdo"}]: dispatch 2024-04-25T17:19:51.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:50 smithi037 ceph-mon[26472]: Activating manager daemon smithi037.txrgxl 2024-04-25T17:19:51.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:50 smithi037 ceph-mon[26472]: osdmap e48: 6 total, 6 up, 6 in 2024-04-25T17:19:51.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:50 smithi037 ceph-mon[26472]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' cmd='[{"prefix": "mgr fail", "who": "smithi069.mmuhdo"}]': finished 2024-04-25T17:19:51.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:50 smithi037 ceph-mon[26472]: mgrmap e28: smithi037.txrgxl(active, starting, since 0.0075906s) 2024-04-25T17:19:51.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:50 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mon metadata", "id": "smithi037"}]: dispatch 2024-04-25T17:19:51.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:50 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mon metadata", "id": "smithi069"}]: dispatch 2024-04-25T17:19:51.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:50 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi037.ksmixc"}]: dispatch 2024-04-25T17:19:51.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:50 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi037.ovkrpq"}]: dispatch 2024-04-25T17:19:51.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:50 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi069.cpprst"}]: dispatch 2024-04-25T17:19:51.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:50 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi069.ytlqcf"}]: dispatch 2024-04-25T17:19:51.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:50 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mgr metadata", "who": "smithi037.txrgxl", "id": "smithi037.txrgxl"}]: dispatch 2024-04-25T17:19:51.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:50 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T17:19:51.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:50 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T17:19:51.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:50 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T17:19:51.074 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:50 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T17:19:51.074 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:50 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T17:19:51.074 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:50 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T17:19:51.074 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:50 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-25T17:19:51.074 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:50 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-25T17:19:51.074 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:50 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-25T17:19:51.074 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:50 smithi037 ceph-mon[26472]: Manager daemon smithi037.txrgxl is now available 2024-04-25T17:19:51.074 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:50 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:19:51.074 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:50 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:19:51.074 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:50 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi037.txrgxl/mirror_snapshot_schedule"}]: dispatch 2024-04-25T17:19:51.074 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:50 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi037.txrgxl/trash_purge_schedule"}]: dispatch 2024-04-25T17:19:51.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:50 smithi069 ceph-mon[34527]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:19:51.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:50 smithi069 ceph-mon[34527]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:19:51.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:50 smithi069 ceph-mon[34527]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:19:51.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:50 smithi069 ceph-mon[34527]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:19:51.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:50 smithi069 ceph-mon[34527]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' 2024-04-25T17:19:51.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:50 smithi069 ceph-mon[34527]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:19:51.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:50 smithi069 ceph-mon[34527]: from='mgr.24417 172.21.15.69:0/1455945564' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "mgr fail", "who": "smithi069.mmuhdo"}]: dispatch 2024-04-25T17:19:51.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:50 smithi069 ceph-mon[34527]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "mgr fail", "who": "smithi069.mmuhdo"}]: dispatch 2024-04-25T17:19:51.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:50 smithi069 ceph-mon[34527]: Activating manager daemon smithi037.txrgxl 2024-04-25T17:19:51.170 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:50 smithi069 ceph-mon[34527]: osdmap e48: 6 total, 6 up, 6 in 2024-04-25T17:19:51.170 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:50 smithi069 ceph-mon[34527]: from='mgr.24417 ' entity='mgr.smithi069.mmuhdo' cmd='[{"prefix": "mgr fail", "who": "smithi069.mmuhdo"}]': finished 2024-04-25T17:19:51.170 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:50 smithi069 ceph-mon[34527]: mgrmap e28: smithi037.txrgxl(active, starting, since 0.0075906s) 2024-04-25T17:19:51.170 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:50 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mon metadata", "id": "smithi037"}]: dispatch 2024-04-25T17:19:51.170 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:50 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mon metadata", "id": "smithi069"}]: dispatch 2024-04-25T17:19:51.170 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:50 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi037.ksmixc"}]: dispatch 2024-04-25T17:19:51.170 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:50 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi037.ovkrpq"}]: dispatch 2024-04-25T17:19:51.170 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:50 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi069.cpprst"}]: dispatch 2024-04-25T17:19:51.170 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:50 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi069.ytlqcf"}]: dispatch 2024-04-25T17:19:51.170 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:50 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mgr metadata", "who": "smithi037.txrgxl", "id": "smithi037.txrgxl"}]: dispatch 2024-04-25T17:19:51.171 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:50 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T17:19:51.171 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:50 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T17:19:51.171 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:50 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T17:19:51.171 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:50 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T17:19:51.171 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:50 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T17:19:51.171 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:50 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T17:19:51.171 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:50 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-25T17:19:51.171 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:50 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-25T17:19:51.171 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:50 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-25T17:19:51.171 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:50 smithi069 ceph-mon[34527]: Manager daemon smithi037.txrgxl is now available 2024-04-25T17:19:51.171 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:50 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:19:51.172 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:50 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:19:51.172 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:50 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi037.txrgxl/mirror_snapshot_schedule"}]: dispatch 2024-04-25T17:19:51.172 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:50 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi037.txrgxl/trash_purge_schedule"}]: dispatch 2024-04-25T17:19:52.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:51 smithi037 ceph-mon[26472]: mgrmap e29: smithi037.txrgxl(active, since 1.00996s) 2024-04-25T17:19:52.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:51 smithi037 ceph-mon[26472]: pgmap v3: 65 pgs: 65 active+clean; 1.6 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail 2024-04-25T17:19:52.181 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:51 smithi069 ceph-mon[34527]: mgrmap e29: smithi037.txrgxl(active, since 1.00996s) 2024-04-25T17:19:52.181 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:51 smithi069 ceph-mon[34527]: pgmap v3: 65 pgs: 65 active+clean; 1.6 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail 2024-04-25T17:19:53.000 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:52 smithi069 ceph-mon[34527]: [25/Apr/2024:17:19:52] ENGINE Bus STARTING 2024-04-25T17:19:53.000 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:52 smithi069 ceph-mon[34527]: [25/Apr/2024:17:19:52] ENGINE Serving on http://172.21.15.37:8765 2024-04-25T17:19:53.000 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:52 smithi069 ceph-mon[34527]: [25/Apr/2024:17:19:52] ENGINE Serving on https://172.21.15.37:7150 2024-04-25T17:19:53.000 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:52 smithi069 ceph-mon[34527]: [25/Apr/2024:17:19:52] ENGINE Bus STARTED 2024-04-25T17:19:53.258 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:52 smithi037 ceph-mon[26472]: [25/Apr/2024:17:19:52] ENGINE Bus STARTING 2024-04-25T17:19:53.258 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:52 smithi037 ceph-mon[26472]: [25/Apr/2024:17:19:52] ENGINE Serving on http://172.21.15.37:8765 2024-04-25T17:19:53.258 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:52 smithi037 ceph-mon[26472]: [25/Apr/2024:17:19:52] ENGINE Serving on https://172.21.15.37:7150 2024-04-25T17:19:53.258 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:52 smithi037 ceph-mon[26472]: [25/Apr/2024:17:19:52] ENGINE Bus STARTED 2024-04-25T17:19:53.947 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-25T17:19:53.947 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-04-25T17:19:53.971 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:53 smithi069 ceph-mon[34527]: mgrmap e30: smithi037.txrgxl(active, since 3s) 2024-04-25T17:19:53.971 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:53 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:19:53.971 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:53 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:19:54.218 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:53 smithi037 ceph-mon[26472]: mgrmap e30: smithi037.txrgxl(active, since 3s) 2024-04-25T17:19:54.218 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:53 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:19:54.218 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:53 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:19:55.129 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-25T17:19:55.129 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-25T17:19:55.194 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:54 smithi037 ceph-mon[26472]: pgmap v5: 65 pgs: 65 active+clean; 1.6 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail 2024-04-25T17:19:55.284 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:54 smithi069 ceph-mon[34527]: pgmap v5: 65 pgs: 65 active+clean; 1.6 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail 2024-04-25T17:19:56.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:55 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:19:56.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:55 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:19:56.321 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:55 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:19:56.321 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:55 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:19:57.321 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:56 smithi037 ceph-mon[26472]: pgmap v6: 65 pgs: 65 active+clean; 1.6 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail 2024-04-25T17:19:57.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:56 smithi069 ceph-mon[34527]: pgmap v6: 65 pgs: 65 active+clean; 1.6 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail 2024-04-25T17:19:58.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.411+0000 7f32ac170700 1 -- 172.21.15.37:0/3899030821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32a40fcf60 msgr2=0x7f32a40fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:19:58.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.411+0000 7f32ac170700 1 --2- 172.21.15.37:0/3899030821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32a40fcf60 0x7f32a40fd3d0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3294004940 tx=0x7f3294009e30 comp rx=0 tx=0).stop 2024-04-25T17:19:58.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.411+0000 7f32ac170700 1 -- 172.21.15.37:0/3899030821 shutdown_connections 2024-04-25T17:19:58.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.411+0000 7f32ac170700 1 --2- 172.21.15.37:0/3899030821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32a40fcf60 0x7f32a40fd3d0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:58.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.411+0000 7f32ac170700 1 --2- 172.21.15.37:0/3899030821 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f32a40fbcb0 0x7f32a40fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:58.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.411+0000 7f32ac170700 1 -- 172.21.15.37:0/3899030821 >> 172.21.15.37:0/3899030821 conn(0x7f32a40f7430 msgr2=0x7f32a40f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:19:58.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.411+0000 7f32ac170700 1 -- 172.21.15.37:0/3899030821 shutdown_connections 2024-04-25T17:19:58.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.411+0000 7f32ac170700 1 -- 172.21.15.37:0/3899030821 wait complete. 2024-04-25T17:19:58.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.412+0000 7f32ac170700 1 Processor -- start 2024-04-25T17:19:58.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.412+0000 7f32ac170700 1 -- start start 2024-04-25T17:19:58.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.412+0000 7f32ac170700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32a40fbcb0 0x7f32a40ffd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:19:58.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.412+0000 7f32ac170700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f32a40fcf60 0x7f32a40fe2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:19:58.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.412+0000 7f32ac170700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a40fe830 con 0x7f32a40fbcb0 2024-04-25T17:19:58.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.412+0000 7f32ac170700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a40fe970 con 0x7f32a40fcf60 2024-04-25T17:19:58.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.412+0000 7f32a9f0c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32a40fbcb0 0x7f32a40ffd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:19:58.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.412+0000 7f32a9f0c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32a40fbcb0 0x7f32a40ffd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46926/0 (socket says 172.21.15.37:46926) 2024-04-25T17:19:58.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.412+0000 7f32a9f0c700 1 -- 172.21.15.37:0/1037779985 learned_addr learned my addr 172.21.15.37:0/1037779985 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:19:58.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.412+0000 7f32a970b700 1 --2- 172.21.15.37:0/1037779985 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f32a40fcf60 0x7f32a40fe2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:19:58.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.413+0000 7f32a9f0c700 1 -- 172.21.15.37:0/1037779985 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f32a40fcf60 msgr2=0x7f32a40fe2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:19:58.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.413+0000 7f32a9f0c700 1 --2- 172.21.15.37:0/1037779985 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f32a40fcf60 0x7f32a40fe2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:58.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.413+0000 7f32a9f0c700 1 -- 172.21.15.37:0/1037779985 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3294005040 con 0x7f32a40fbcb0 2024-04-25T17:19:58.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.413+0000 7f32a9f0c700 1 --2- 172.21.15.37:0/1037779985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32a40fbcb0 0x7f32a40ffd80 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f32a000eb40 tx=0x7f32a000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:19:58.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.413+0000 7f329a7fc700 1 -- 172.21.15.37:0/1037779985 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32a0007cc0 con 0x7f32a40fbcb0 2024-04-25T17:19:58.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.413+0000 7f329a7fc700 1 -- 172.21.15.37:0/1037779985 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f32a000f040 con 0x7f32a40fbcb0 2024-04-25T17:19:58.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.413+0000 7f32ac170700 1 -- 172.21.15.37:0/1037779985 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32a40febf0 con 0x7f32a40fbcb0 2024-04-25T17:19:58.416 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.413+0000 7f329a7fc700 1 -- 172.21.15.37:0/1037779985 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f32a000ca10 con 0x7f32a40fbcb0 2024-04-25T17:19:58.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.413+0000 7f32ac170700 1 -- 172.21.15.37:0/1037779985 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32a40ff100 con 0x7f32a40fbcb0 2024-04-25T17:19:58.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.414+0000 7f329a7fc700 1 -- 172.21.15.37:0/1037779985 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 30) v1 ==== 49524+0+0 (secure 0 0 0) 0x7f32a000cb70 con 0x7f32a40fbcb0 2024-04-25T17:19:58.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.414+0000 7f32ac170700 1 -- 172.21.15.37:0/1037779985 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32a4101af0 con 0x7f32a40fbcb0 2024-04-25T17:19:58.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.414+0000 7f329a7fc700 1 --2- 172.21.15.37:0/1037779985 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7f329003d430 0x7f329003f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:19:58.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.415+0000 7f329a7fc700 1 -- 172.21.15.37:0/1037779985 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f32a0051c50 con 0x7f32a40fbcb0 2024-04-25T17:19:58.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.415+0000 7f32a970b700 1 --2- 172.21.15.37:0/1037779985 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7f329003d430 0x7f329003f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:19:58.417 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.415+0000 7f32a970b700 1 --2- 172.21.15.37:0/1037779985 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7f329003d430 0x7f329003f8e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3294009b30 tx=0x7f3294009e30 comp rx=0 tx=0).ready entity=mgr.14766 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:19:58.420 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.420+0000 7f329a7fc700 1 -- 172.21.15.37:0/1037779985 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f32a001b8c0 con 0x7f32a40fbcb0 2024-04-25T17:19:58.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.762+0000 7f32ac170700 1 -- 172.21.15.37:0/1037779985 --> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f32a4104960 con 0x7f329003d430 2024-04-25T17:19:58.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.764+0000 7f329a7fc700 1 -- 172.21.15.37:0/1037779985 <== mgr.14766 v2:172.21.15.37:6800/709373822 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f32a4104960 con 0x7f329003d430 2024-04-25T17:19:58.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.766+0000 7f32ac170700 1 -- 172.21.15.37:0/1037779985 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7f329003d430 msgr2=0x7f329003f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:19:58.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.766+0000 7f32ac170700 1 --2- 172.21.15.37:0/1037779985 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7f329003d430 0x7f329003f8e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3294009b30 tx=0x7f3294009e30 comp rx=0 tx=0).stop 2024-04-25T17:19:58.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.767+0000 7f32ac170700 1 -- 172.21.15.37:0/1037779985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32a40fbcb0 msgr2=0x7f32a40ffd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:19:58.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.767+0000 7f32ac170700 1 --2- 172.21.15.37:0/1037779985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32a40fbcb0 0x7f32a40ffd80 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f32a000eb40 tx=0x7f32a000b040 comp rx=0 tx=0).stop 2024-04-25T17:19:58.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.767+0000 7f32ac170700 1 -- 172.21.15.37:0/1037779985 shutdown_connections 2024-04-25T17:19:58.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.767+0000 7f32ac170700 1 --2- 172.21.15.37:0/1037779985 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7f329003d430 0x7f329003f8e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:58.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.767+0000 7f32ac170700 1 --2- 172.21.15.37:0/1037779985 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32a40fbcb0 0x7f32a40ffd80 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:58.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.767+0000 7f32ac170700 1 --2- 172.21.15.37:0/1037779985 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f32a40fcf60 0x7f32a40fe2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:58.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.767+0000 7f32ac170700 1 -- 172.21.15.37:0/1037779985 >> 172.21.15.37:0/1037779985 conn(0x7f32a40f7430 msgr2=0x7f32a4065b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:19:58.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.767+0000 7f32ac170700 1 -- 172.21.15.37:0/1037779985 shutdown_connections 2024-04-25T17:19:58.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.767+0000 7f32ac170700 1 -- 172.21.15.37:0/1037779985 wait complete. 2024-04-25T17:19:58.781 INFO:teuthology.orchestra.run.smithi037.stdout:true 2024-04-25T17:19:58.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.896+0000 7f5b64468700 1 -- 172.21.15.37:0/1314554359 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b5c0fcf70 msgr2=0x7f5b5c0fd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:19:58.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.896+0000 7f5b64468700 1 --2- 172.21.15.37:0/1314554359 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b5c0fcf70 0x7f5b5c0fd3e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c004940 tx=0x7f5b4c009e30 comp rx=0 tx=0).stop 2024-04-25T17:19:58.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.897+0000 7f5b64468700 1 -- 172.21.15.37:0/1314554359 shutdown_connections 2024-04-25T17:19:58.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.897+0000 7f5b64468700 1 --2- 172.21.15.37:0/1314554359 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b5c0fcf70 0x7f5b5c0fd3e0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:58.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.897+0000 7f5b64468700 1 --2- 172.21.15.37:0/1314554359 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b5c0fbcc0 0x7f5b5c0fc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:58.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.897+0000 7f5b64468700 1 -- 172.21.15.37:0/1314554359 >> 172.21.15.37:0/1314554359 conn(0x7f5b5c0f7420 msgr2=0x7f5b5c0f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:19:58.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.897+0000 7f5b64468700 1 -- 172.21.15.37:0/1314554359 shutdown_connections 2024-04-25T17:19:58.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.897+0000 7f5b64468700 1 -- 172.21.15.37:0/1314554359 wait complete. 2024-04-25T17:19:58.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.898+0000 7f5b64468700 1 Processor -- start 2024-04-25T17:19:58.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.898+0000 7f5b64468700 1 -- start start 2024-04-25T17:19:58.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.898+0000 7f5b64468700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b5c0fbcc0 0x7f5b5c10fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:19:58.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.898+0000 7f5b64468700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b5c0fcf70 0x7f5b5c1100c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:19:58.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.898+0000 7f5b64468700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5c1106c0 con 0x7f5b5c0fbcc0 2024-04-25T17:19:58.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.898+0000 7f5b64468700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5c110f10 con 0x7f5b5c0fcf70 2024-04-25T17:19:58.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.898+0000 7f5b62204700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b5c0fbcc0 0x7f5b5c10fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:19:58.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.898+0000 7f5b62204700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b5c0fbcc0 0x7f5b5c10fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46950/0 (socket says 172.21.15.37:46950) 2024-04-25T17:19:58.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.898+0000 7f5b62204700 1 -- 172.21.15.37:0/3047337621 learned_addr learned my addr 172.21.15.37:0/3047337621 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:19:58.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.898+0000 7f5b61a03700 1 --2- 172.21.15.37:0/3047337621 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b5c0fcf70 0x7f5b5c1100c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:19:58.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.899+0000 7f5b62204700 1 -- 172.21.15.37:0/3047337621 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b5c0fcf70 msgr2=0x7f5b5c1100c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:19:58.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.899+0000 7f5b62204700 1 --2- 172.21.15.37:0/3047337621 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b5c0fcf70 0x7f5b5c1100c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:58.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.899+0000 7f5b62204700 1 -- 172.21.15.37:0/3047337621 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b58005040 con 0x7f5b5c0fbcc0 2024-04-25T17:19:58.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.899+0000 7f5b61a03700 1 --2- 172.21.15.37:0/3047337621 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b5c0fcf70 0x7f5b5c1100c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T17:19:58.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.899+0000 7f5b62204700 1 --2- 172.21.15.37:0/3047337621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b5c0fbcc0 0x7f5b5c10fb80 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5b580096d0 tx=0x7f5b58009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:19:58.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.900+0000 7f5b52ffd700 1 -- 172.21.15.37:0/3047337621 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b5800e840 con 0x7f5b5c0fbcc0 2024-04-25T17:19:58.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.900+0000 7f5b52ffd700 1 -- 172.21.15.37:0/3047337621 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5b5800f040 con 0x7f5b5c0fbcc0 2024-04-25T17:19:58.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.900+0000 7f5b64468700 1 -- 172.21.15.37:0/3047337621 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b4c005040 con 0x7f5b5c0fbcc0 2024-04-25T17:19:58.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.900+0000 7f5b52ffd700 1 -- 172.21.15.37:0/3047337621 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b58013dc0 con 0x7f5b5c0fbcc0 2024-04-25T17:19:58.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.901+0000 7f5b64468700 1 -- 172.21.15.37:0/3047337621 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b5c111540 con 0x7f5b5c0fbcc0 2024-04-25T17:19:58.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.902+0000 7f5b64468700 1 -- 172.21.15.37:0/3047337621 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b5c101900 con 0x7f5b5c0fbcc0 2024-04-25T17:19:58.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.902+0000 7f5b52ffd700 1 -- 172.21.15.37:0/3047337621 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 30) v1 ==== 49524+0+0 (secure 0 0 0) 0x7f5b5800e9a0 con 0x7f5b5c0fbcc0 2024-04-25T17:19:58.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.902+0000 7f5b52ffd700 1 --2- 172.21.15.37:0/3047337621 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7f5b4803d480 0x7f5b4803f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:19:58.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.903+0000 7f5b52ffd700 1 -- 172.21.15.37:0/3047337621 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f5b58051dc0 con 0x7f5b5c0fbcc0 2024-04-25T17:19:58.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.903+0000 7f5b61a03700 1 --2- 172.21.15.37:0/3047337621 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7f5b4803d480 0x7f5b4803f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:19:58.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.903+0000 7f5b61a03700 1 --2- 172.21.15.37:0/3047337621 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7f5b4803d480 0x7f5b4803f930 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c009fd0 tx=0x7f5b4c009e30 comp rx=0 tx=0).ready entity=mgr.14766 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:19:58.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:58.910+0000 7f5b52ffd700 1 -- 172.21.15.37:0/3047337621 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f5b5801ccb0 con 0x7f5b5c0fbcc0 2024-04-25T17:19:59.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.021+0000 7f5b52ffd700 1 -- 172.21.15.37:0/3047337621 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 31) v1 ==== 98485+0+0 (secure 0 0 0) 0x7f5b58018220 con 0x7f5b5c0fbcc0 2024-04-25T17:19:59.022 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:58 smithi037 ceph-mon[26472]: pgmap v7: 65 pgs: 65 active+clean; 508 MiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 938 KiB/s rd, 856 KiB/s wr, 129 op/s 2024-04-25T17:19:59.022 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:59 smithi037 ceph-mon[26472]: Standby manager daemon smithi069.mmuhdo started 2024-04-25T17:19:59.022 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:59 smithi037 ceph-mon[26472]: from='mgr.? 172.21.15.69:0/2465275623' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi069.mmuhdo/crt"}]: dispatch 2024-04-25T17:19:59.022 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:59 smithi037 ceph-mon[26472]: from='mgr.? 172.21.15.69:0/2465275623' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T17:19:59.022 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:59 smithi037 ceph-mon[26472]: from='mgr.? 172.21.15.69:0/2465275623' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi069.mmuhdo/key"}]: dispatch 2024-04-25T17:19:59.022 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:19:59 smithi037 ceph-mon[26472]: from='mgr.? 172.21.15.69:0/2465275623' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T17:19:59.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.205+0000 7f5b64468700 1 -- 172.21.15.37:0/3047337621 --> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5b5c1117b0 con 0x7f5b4803d480 2024-04-25T17:19:59.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.207+0000 7f5b52ffd700 1 -- 172.21.15.37:0/3047337621 <== mgr.14766 v2:172.21.15.37:6800/709373822 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f5b5c1117b0 con 0x7f5b4803d480 2024-04-25T17:19:59.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.209+0000 7f5b64468700 1 -- 172.21.15.37:0/3047337621 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7f5b4803d480 msgr2=0x7f5b4803f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:19:59.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.209+0000 7f5b64468700 1 --2- 172.21.15.37:0/3047337621 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7f5b4803d480 0x7f5b4803f930 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c009fd0 tx=0x7f5b4c009e30 comp rx=0 tx=0).stop 2024-04-25T17:19:59.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.209+0000 7f5b64468700 1 -- 172.21.15.37:0/3047337621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b5c0fbcc0 msgr2=0x7f5b5c10fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:19:59.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.209+0000 7f5b64468700 1 --2- 172.21.15.37:0/3047337621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b5c0fbcc0 0x7f5b5c10fb80 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5b580096d0 tx=0x7f5b58009e30 comp rx=0 tx=0).stop 2024-04-25T17:19:59.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.210+0000 7f5b64468700 1 -- 172.21.15.37:0/3047337621 shutdown_connections 2024-04-25T17:19:59.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.210+0000 7f5b64468700 1 --2- 172.21.15.37:0/3047337621 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7f5b4803d480 0x7f5b4803f930 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:59.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.210+0000 7f5b64468700 1 --2- 172.21.15.37:0/3047337621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b5c0fbcc0 0x7f5b5c10fb80 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:59.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.210+0000 7f5b64468700 1 --2- 172.21.15.37:0/3047337621 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b5c0fcf70 0x7f5b5c1100c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:59.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.210+0000 7f5b64468700 1 -- 172.21.15.37:0/3047337621 >> 172.21.15.37:0/3047337621 conn(0x7f5b5c0f7420 msgr2=0x7f5b5c0f89d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:19:59.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.210+0000 7f5b64468700 1 -- 172.21.15.37:0/3047337621 shutdown_connections 2024-04-25T17:19:59.211 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.210+0000 7f5b64468700 1 -- 172.21.15.37:0/3047337621 wait complete. 2024-04-25T17:19:59.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.345+0000 7f4c84225700 1 -- 172.21.15.37:0/589352456 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c7c0662c0 msgr2=0x7f4c7c0ff9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:19:59.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.345+0000 7f4c84225700 1 --2- 172.21.15.37:0/589352456 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c7c0662c0 0x7f4c7c0ff9a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4c78004940 tx=0x7f4c78009e30 comp rx=0 tx=0).stop 2024-04-25T17:19:59.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.345+0000 7f4c84225700 1 -- 172.21.15.37:0/589352456 shutdown_connections 2024-04-25T17:19:59.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.345+0000 7f4c84225700 1 --2- 172.21.15.37:0/589352456 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c7c0ffee0 0x7f4c7c102300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:59.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.345+0000 7f4c84225700 1 --2- 172.21.15.37:0/589352456 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c7c0662c0 0x7f4c7c0ff9a0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:59.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.345+0000 7f4c84225700 1 -- 172.21.15.37:0/589352456 >> 172.21.15.37:0/589352456 conn(0x7f4c7c0f7430 msgr2=0x7f4c7c0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:19:59.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.345+0000 7f4c84225700 1 -- 172.21.15.37:0/589352456 shutdown_connections 2024-04-25T17:19:59.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.345+0000 7f4c84225700 1 -- 172.21.15.37:0/589352456 wait complete. 2024-04-25T17:19:59.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.346+0000 7f4c84225700 1 Processor -- start 2024-04-25T17:19:59.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.346+0000 7f4c84225700 1 -- start start 2024-04-25T17:19:59.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.346+0000 7f4c84225700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c7c0662c0 0x7f4c7c0fd380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:19:59.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.346+0000 7f4c84225700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c7c0ffee0 0x7f4c7c0fb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:19:59.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.346+0000 7f4c817c0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c7c0ffee0 0x7f4c7c0fb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:19:59.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.346+0000 7f4c817c0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c7c0ffee0 0x7f4c7c0fb8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46966/0 (socket says 172.21.15.37:46966) 2024-04-25T17:19:59.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.346+0000 7f4c817c0700 1 -- 172.21.15.37:0/3916665793 learned_addr learned my addr 172.21.15.37:0/3916665793 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:19:59.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.346+0000 7f4c81fc1700 1 --2- 172.21.15.37:0/3916665793 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c7c0662c0 0x7f4c7c0fd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:19:59.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.346+0000 7f4c84225700 1 -- 172.21.15.37:0/3916665793 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7c0fbe30 con 0x7f4c7c0ffee0 2024-04-25T17:19:59.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.347+0000 7f4c84225700 1 -- 172.21.15.37:0/3916665793 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7c0fbf70 con 0x7f4c7c0662c0 2024-04-25T17:19:59.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.347+0000 7f4c817c0700 1 -- 172.21.15.37:0/3916665793 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c7c0662c0 msgr2=0x7f4c7c0fd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:19:59.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.347+0000 7f4c817c0700 1 --2- 172.21.15.37:0/3916665793 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c7c0662c0 0x7f4c7c0fd380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:59.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.347+0000 7f4c817c0700 1 -- 172.21.15.37:0/3916665793 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c6c005040 con 0x7f4c7c0ffee0 2024-04-25T17:19:59.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.347+0000 7f4c81fc1700 1 --2- 172.21.15.37:0/3916665793 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c7c0662c0 0x7f4c7c0fd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T17:19:59.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.347+0000 7f4c817c0700 1 --2- 172.21.15.37:0/3916665793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c7c0ffee0 0x7f4c7c0fb8a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c0096d0 tx=0x7f4c6c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:19:59.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.347+0000 7f4c727fc700 1 -- 172.21.15.37:0/3916665793 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c6c00e840 con 0x7f4c7c0ffee0 2024-04-25T17:19:59.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.347+0000 7f4c84225700 1 -- 172.21.15.37:0/3916665793 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c78005040 con 0x7f4c7c0ffee0 2024-04-25T17:19:59.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.347+0000 7f4c727fc700 1 -- 172.21.15.37:0/3916665793 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4c6c00f040 con 0x7f4c7c0ffee0 2024-04-25T17:19:59.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.347+0000 7f4c727fc700 1 -- 172.21.15.37:0/3916665793 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c6c013e50 con 0x7f4c7c0ffee0 2024-04-25T17:19:59.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.348+0000 7f4c84225700 1 -- 172.21.15.37:0/3916665793 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c7c0fc680 con 0x7f4c7c0ffee0 2024-04-25T17:19:59.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.349+0000 7f4c84225700 1 -- 172.21.15.37:0/3916665793 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c7c05f5c0 con 0x7f4c7c0ffee0 2024-04-25T17:19:59.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.349+0000 7f4c727fc700 1 -- 172.21.15.37:0/3916665793 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 31) v1 ==== 98485+0+0 (secure 0 0 0) 0x7f4c6c00e9a0 con 0x7f4c7c0ffee0 2024-04-25T17:19:59.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.350+0000 7f4c727fc700 1 --2- 172.21.15.37:0/3916665793 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7f4c68076530 0x7f4c680789e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:19:59.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.350+0000 7f4c727fc700 1 -- 172.21.15.37:0/3916665793 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f4c6c097a70 con 0x7f4c7c0ffee0 2024-04-25T17:19:59.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.351+0000 7f4c81fc1700 1 --2- 172.21.15.37:0/3916665793 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7f4c68076530 0x7f4c680789e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:19:59.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.352+0000 7f4c81fc1700 1 --2- 172.21.15.37:0/3916665793 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7f4c68076530 0x7f4c680789e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4c78009fd0 tx=0x7f4c78009e30 comp rx=0 tx=0).ready entity=mgr.14766 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:19:59.357 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.357+0000 7f4c727fc700 1 -- 172.21.15.37:0/3916665793 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f4c6c060c30 con 0x7f4c7c0ffee0 2024-04-25T17:19:59.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:58 smithi069 ceph-mon[34527]: pgmap v7: 65 pgs: 65 active+clean; 508 MiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 938 KiB/s rd, 856 KiB/s wr, 129 op/s 2024-04-25T17:19:59.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:58 smithi069 ceph-mon[34527]: Standby manager daemon smithi069.mmuhdo started 2024-04-25T17:19:59.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:58 smithi069 ceph-mon[34527]: from='mgr.? 172.21.15.69:0/2465275623' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi069.mmuhdo/crt"}]: dispatch 2024-04-25T17:19:59.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:58 smithi069 ceph-mon[34527]: from='mgr.? 172.21.15.69:0/2465275623' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T17:19:59.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:58 smithi069 ceph-mon[34527]: from='mgr.? 172.21.15.69:0/2465275623' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi069.mmuhdo/key"}]: dispatch 2024-04-25T17:19:59.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:19:58 smithi069 ceph-mon[34527]: from='mgr.? 172.21.15.69:0/2465275623' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T17:19:59.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.686+0000 7f4c84225700 1 -- 172.21.15.37:0/3916665793 --> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4c7c0f8f20 con 0x7f4c68076530 2024-04-25T17:19:59.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.698+0000 7f4c727fc700 1 -- 172.21.15.37:0/3916665793 <== mgr.14766 v2:172.21.15.37:6800/709373822 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f4c7c0f8f20 con 0x7f4c68076530 2024-04-25T17:19:59.698 INFO:teuthology.orchestra.run.smithi037.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-25T17:19:59.698 INFO:teuthology.orchestra.run.smithi037.stdout:alertmanager.smithi037 smithi037 *:9093,9094 running (86s) 15s ago 9m 27.6M - 0.25.0 c8568f914cd2 18aed8f409ee 2024-04-25T17:19:59.698 INFO:teuthology.orchestra.run.smithi037.stdout:crash.smithi037 smithi037 running (10m) 15s ago 10m 6656k - 17.2.7-902-gc61472c8 0de407c1b3af b3d152574e80 2024-04-25T17:19:59.698 INFO:teuthology.orchestra.run.smithi037.stdout:crash.smithi069 smithi069 running (8m) 5s ago 8m 6660k - 17.2.7-902-gc61472c8 0de407c1b3af aa6086c64cc3 2024-04-25T17:19:59.698 INFO:teuthology.orchestra.run.smithi037.stdout:grafana.smithi037 smithi037 *:3000 running (81s) 15s ago 9m 78.8M - 9.4.7 954c08fa6188 1eff3ea3f9b0 2024-04-25T17:19:59.699 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi037.ksmixc smithi037 running (4m) 15s ago 4m 221M - 17.2.7-902-gc61472c8 0de407c1b3af 394aa56079b4 2024-04-25T17:19:59.699 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi037.ovkrpq smithi037 running (4m) 15s ago 4m 139M - 17.2.7-902-gc61472c8 0de407c1b3af 73ca662174a7 2024-04-25T17:19:59.699 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi069.cpprst smithi069 running (4m) 5s ago 4m 14.2M - 17.2.7-902-gc61472c8 0de407c1b3af dbda101df20e 2024-04-25T17:19:59.699 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi069.ytlqcf smithi069 running (4m) 5s ago 4m 12.4M - 17.2.7-902-gc61472c8 0de407c1b3af 911df6b18215 2024-04-25T17:19:59.699 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.smithi037.txrgxl smithi037 *:8443,9283,8765 running (23s) 15s ago 11m 165M - 19.0.0-3291-g994e2f20 d53c96779a29 e9653fc62df9 2024-04-25T17:19:59.699 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.smithi069.mmuhdo smithi069 *:8443,9283 running (2m) 5s ago 8m 147M - 19.0.0-3291-g994e2f20 d53c96779a29 defb664cef69 2024-04-25T17:19:59.699 INFO:teuthology.orchestra.run.smithi037.stdout:mon.smithi037 smithi037 running (11m) 15s ago 11m 46.4M 2048M 17.2.7-902-gc61472c8 0de407c1b3af 5cfadcf8f2e4 2024-04-25T17:19:59.699 INFO:teuthology.orchestra.run.smithi037.stdout:mon.smithi069 smithi069 running (8m) 5s ago 8m 43.9M 2048M 17.2.7-902-gc61472c8 0de407c1b3af ffcd456d1dce 2024-04-25T17:19:59.699 INFO:teuthology.orchestra.run.smithi037.stdout:node-exporter.smithi037 smithi037 *:9100 running (92s) 15s ago 9m 14.0M - 1.5.0 0da6a335fe13 1e59bbb2aa82 2024-04-25T17:19:59.699 INFO:teuthology.orchestra.run.smithi037.stdout:node-exporter.smithi069 smithi069 *:9100 running (47s) 5s ago 8m 8392k - 1.5.0 0da6a335fe13 0c51a9833fe4 2024-04-25T17:19:59.699 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0 smithi037 running (7m) 15s ago 7m 204M 1559M 17.2.7-902-gc61472c8 0de407c1b3af 8ff4b0f1aae9 2024-04-25T17:19:59.699 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1 smithi037 running (7m) 15s ago 7m 213M 1559M 17.2.7-902-gc61472c8 0de407c1b3af 5715a5da241d 2024-04-25T17:19:59.699 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2 smithi037 running (6m) 15s ago 6m 179M 1559M 17.2.7-902-gc61472c8 0de407c1b3af 2eedaf9886dd 2024-04-25T17:19:59.699 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3 smithi069 running (6m) 5s ago 6m 233M 2581M 17.2.7-902-gc61472c8 0de407c1b3af ebba78fb1923 2024-04-25T17:19:59.699 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4 smithi069 running (6m) 5s ago 6m 214M 2581M 17.2.7-902-gc61472c8 0de407c1b3af ba7b785c50f9 2024-04-25T17:19:59.700 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5 smithi069 running (5m) 5s ago 5m 204M 2581M 17.2.7-902-gc61472c8 0de407c1b3af f6be99c364ff 2024-04-25T17:19:59.700 INFO:teuthology.orchestra.run.smithi037.stdout:prometheus.smithi037 smithi037 *:9095 running (55s) 15s ago 9m 45.0M - 2.43.0 a07b618ecd1d b2f50bb9c6bb 2024-04-25T17:19:59.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.700+0000 7f4c84225700 1 -- 172.21.15.37:0/3916665793 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7f4c68076530 msgr2=0x7f4c680789e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:19:59.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.700+0000 7f4c84225700 1 --2- 172.21.15.37:0/3916665793 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7f4c68076530 0x7f4c680789e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4c78009fd0 tx=0x7f4c78009e30 comp rx=0 tx=0).stop 2024-04-25T17:19:59.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.701+0000 7f4c84225700 1 -- 172.21.15.37:0/3916665793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c7c0ffee0 msgr2=0x7f4c7c0fb8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:19:59.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.701+0000 7f4c84225700 1 --2- 172.21.15.37:0/3916665793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c7c0ffee0 0x7f4c7c0fb8a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c0096d0 tx=0x7f4c6c009e30 comp rx=0 tx=0).stop 2024-04-25T17:19:59.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.701+0000 7f4c84225700 1 -- 172.21.15.37:0/3916665793 shutdown_connections 2024-04-25T17:19:59.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.701+0000 7f4c84225700 1 --2- 172.21.15.37:0/3916665793 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7f4c68076530 0x7f4c680789e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:59.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.701+0000 7f4c84225700 1 --2- 172.21.15.37:0/3916665793 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c7c0662c0 0x7f4c7c0fd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:59.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.701+0000 7f4c84225700 1 --2- 172.21.15.37:0/3916665793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c7c0ffee0 0x7f4c7c0fb8a0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:59.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.701+0000 7f4c84225700 1 -- 172.21.15.37:0/3916665793 >> 172.21.15.37:0/3916665793 conn(0x7f4c7c0f7430 msgr2=0x7f4c7c0f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:19:59.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.701+0000 7f4c84225700 1 -- 172.21.15.37:0/3916665793 shutdown_connections 2024-04-25T17:19:59.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.702+0000 7f4c84225700 1 -- 172.21.15.37:0/3916665793 wait complete. 2024-04-25T17:19:59.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.838+0000 7fb011ab1700 1 -- 172.21.15.37:0/1113707103 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb00c0fbcb0 msgr2=0x7fb00c0fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:19:59.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.838+0000 7fb011ab1700 1 --2- 172.21.15.37:0/1113707103 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb00c0fbcb0 0x7fb00c0fc0c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7faffc004940 tx=0x7faffc009e30 comp rx=0 tx=0).stop 2024-04-25T17:19:59.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.838+0000 7fb011ab1700 1 -- 172.21.15.37:0/1113707103 shutdown_connections 2024-04-25T17:19:59.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.838+0000 7fb011ab1700 1 --2- 172.21.15.37:0/1113707103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb00c0fcf60 0x7fb00c0fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:59.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.838+0000 7fb011ab1700 1 --2- 172.21.15.37:0/1113707103 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb00c0fbcb0 0x7fb00c0fc0c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:59.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.838+0000 7fb011ab1700 1 -- 172.21.15.37:0/1113707103 >> 172.21.15.37:0/1113707103 conn(0x7fb00c0f7410 msgr2=0x7fb00c0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:19:59.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.838+0000 7fb011ab1700 1 -- 172.21.15.37:0/1113707103 shutdown_connections 2024-04-25T17:19:59.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.838+0000 7fb011ab1700 1 -- 172.21.15.37:0/1113707103 wait complete. 2024-04-25T17:19:59.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.839+0000 7fb011ab1700 1 Processor -- start 2024-04-25T17:19:59.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.839+0000 7fb011ab1700 1 -- start start 2024-04-25T17:19:59.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.840+0000 7fb011ab1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb00c0fbcb0 0x7fb00c066d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:19:59.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.840+0000 7fb011ab1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb00c0fcf60 0x7fb00c114a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:19:59.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.840+0000 7fb011ab1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb00c10e430 con 0x7fb00c0fcf60 2024-04-25T17:19:59.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.840+0000 7fb011ab1700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb00c114f90 con 0x7fb00c0fbcb0 2024-04-25T17:19:59.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.840+0000 7fb00b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb00c0fbcb0 0x7fb00c066d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:19:59.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.840+0000 7fb00b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb00c0fbcb0 0x7fb00c066d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.37:45762/0 (socket says 172.21.15.37:45762) 2024-04-25T17:19:59.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.840+0000 7fb00b7fe700 1 -- 172.21.15.37:0/2909876380 learned_addr learned my addr 172.21.15.37:0/2909876380 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:19:59.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.840+0000 7fb00affd700 1 --2- 172.21.15.37:0/2909876380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb00c0fcf60 0x7fb00c114a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:19:59.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.840+0000 7fb00b7fe700 1 -- 172.21.15.37:0/2909876380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb00c0fcf60 msgr2=0x7fb00c114a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:19:59.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.840+0000 7fb00b7fe700 1 --2- 172.21.15.37:0/2909876380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb00c0fcf60 0x7fb00c114a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:19:59.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.840+0000 7fb00b7fe700 1 -- 172.21.15.37:0/2909876380 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faffc005040 con 0x7fb00c0fbcb0 2024-04-25T17:19:59.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.841+0000 7fb00b7fe700 1 --2- 172.21.15.37:0/2909876380 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb00c0fbcb0 0x7fb00c066d10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7faffc013870 tx=0x7faffc009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:19:59.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.841+0000 7fb00affd700 1 --2- 172.21.15.37:0/2909876380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb00c0fcf60 0x7fb00c114a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T17:19:59.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.841+0000 7faff3fff700 1 -- 172.21.15.37:0/2909876380 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faffc00e070 con 0x7fb00c0fbcb0 2024-04-25T17:19:59.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.841+0000 7faff3fff700 1 -- 172.21.15.37:0/2909876380 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faffc01c400 con 0x7fb00c0fbcb0 2024-04-25T17:19:59.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.841+0000 7fb011ab1700 1 -- 172.21.15.37:0/2909876380 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb00c115130 con 0x7fb00c0fbcb0 2024-04-25T17:19:59.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.841+0000 7fb011ab1700 1 -- 172.21.15.37:0/2909876380 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb00c115610 con 0x7fb00c0fbcb0 2024-04-25T17:19:59.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.841+0000 7faff3fff700 1 -- 172.21.15.37:0/2909876380 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faffc00b650 con 0x7fb00c0fbcb0 2024-04-25T17:19:59.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.842+0000 7faff1ffb700 1 -- 172.21.15.37:0/2909876380 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafec0052b0 con 0x7fb00c0fbcb0 2024-04-25T17:19:59.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.844+0000 7faff3fff700 1 -- 172.21.15.37:0/2909876380 <== mon.1 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 31) v1 ==== 98485+0+0 (secure 0 0 0) 0x7faffc013af0 con 0x7fb00c0fbcb0 2024-04-25T17:19:59.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.844+0000 7faff3fff700 1 --2- 172.21.15.37:0/2909876380 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7faff4076670 0x7faff4078b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:19:59.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.844+0000 7faff3fff700 1 -- 172.21.15.37:0/2909876380 <== mon.1 v2:172.21.15.69:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7faffc099230 con 0x7fb00c0fbcb0 2024-04-25T17:19:59.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.845+0000 7fb00affd700 1 --2- 172.21.15.37:0/2909876380 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7faff4076670 0x7faff4078b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:19:59.846 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.846+0000 7fb00affd700 1 --2- 172.21.15.37:0/2909876380 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7faff4076670 0x7faff4078b20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb000004600 tx=0x7fb00000b040 comp rx=0 tx=0).ready entity=mgr.14766 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:19:59.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:19:59.851+0000 7faff3fff700 1 -- 172.21.15.37:0/2909876380 <== mon.1 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7faffc062510 con 0x7fb00c0fbcb0 2024-04-25T17:20:00.321 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:00 smithi037 ceph-mon[26472]: from='client.14794 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:20:00.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:00 smithi037 ceph-mon[26472]: mgrmap e31: smithi037.txrgxl(active, since 9s), standbys: smithi069.mmuhdo 2024-04-25T17:20:00.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:00 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mgr metadata", "who": "smithi069.mmuhdo", "id": "smithi069.mmuhdo"}]: dispatch 2024-04-25T17:20:00.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:00 smithi037 ceph-mon[26472]: from='client.14798 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:20:00.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:00 smithi037 ceph-mon[26472]: overall HEALTH_OK 2024-04-25T17:20:00.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:00.358+0000 7faff1ffb700 1 -- 172.21.15.37:0/2909876380 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fafec005830 con 0x7fb00c0fbcb0 2024-04-25T17:20:00.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:00.359+0000 7faff3fff700 1 -- 172.21.15.37:0/2909876380 <== mon.1 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7faffc061eb0 con 0x7fb00c0fbcb0 2024-04-25T17:20:00.360 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-25T17:20:00.360 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": { 2024-04-25T17:20:00.360 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 2 2024-04-25T17:20:00.360 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:20:00.360 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": { 2024-04-25T17:20:00.360 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 2 2024-04-25T17:20:00.360 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:20:00.360 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": { 2024-04-25T17:20:00.360 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 6 2024-04-25T17:20:00.360 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:20:00.360 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": { 2024-04-25T17:20:00.360 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 4 2024-04-25T17:20:00.360 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:20:00.361 INFO:teuthology.orchestra.run.smithi037.stdout: "overall": { 2024-04-25T17:20:00.361 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 12, 2024-04-25T17:20:00.361 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 2 2024-04-25T17:20:00.361 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-04-25T17:20:00.361 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-25T17:20:00.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:00.362+0000 7faff1ffb700 1 -- 172.21.15.37:0/2909876380 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7faff4076670 msgr2=0x7faff4078b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:20:00.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:00.362+0000 7faff1ffb700 1 --2- 172.21.15.37:0/2909876380 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7faff4076670 0x7faff4078b20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb000004600 tx=0x7fb00000b040 comp rx=0 tx=0).stop 2024-04-25T17:20:00.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:00.362+0000 7faff1ffb700 1 -- 172.21.15.37:0/2909876380 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb00c0fbcb0 msgr2=0x7fb00c066d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:20:00.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:00.362+0000 7faff1ffb700 1 --2- 172.21.15.37:0/2909876380 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb00c0fbcb0 0x7fb00c066d10 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7faffc013870 tx=0x7faffc009e30 comp rx=0 tx=0).stop 2024-04-25T17:20:00.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:00.362+0000 7faff1ffb700 1 -- 172.21.15.37:0/2909876380 shutdown_connections 2024-04-25T17:20:00.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:00.362+0000 7faff1ffb700 1 --2- 172.21.15.37:0/2909876380 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7faff4076670 0x7faff4078b20 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:00.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:00.362+0000 7faff1ffb700 1 --2- 172.21.15.37:0/2909876380 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb00c0fbcb0 0x7fb00c066d10 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:00.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:00.362+0000 7faff1ffb700 1 --2- 172.21.15.37:0/2909876380 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb00c0fcf60 0x7fb00c114a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:00.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:00.362+0000 7faff1ffb700 1 -- 172.21.15.37:0/2909876380 >> 172.21.15.37:0/2909876380 conn(0x7fb00c0f7410 msgr2=0x7fb00c0f8a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:20:00.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:00.362+0000 7faff1ffb700 1 -- 172.21.15.37:0/2909876380 shutdown_connections 2024-04-25T17:20:00.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:00.362+0000 7faff1ffb700 1 -- 172.21.15.37:0/2909876380 wait complete. 2024-04-25T17:20:00.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:00 smithi069 ceph-mon[34527]: from='client.14794 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:20:00.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:00 smithi069 ceph-mon[34527]: mgrmap e31: smithi037.txrgxl(active, since 9s), standbys: smithi069.mmuhdo 2024-04-25T17:20:00.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:00 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mgr metadata", "who": "smithi069.mmuhdo", "id": "smithi069.mmuhdo"}]: dispatch 2024-04-25T17:20:00.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:00 smithi069 ceph-mon[34527]: from='client.14798 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:20:00.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:00 smithi069 ceph-mon[34527]: overall HEALTH_OK 2024-04-25T17:20:00.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:00.503+0000 7fd5036a3700 1 -- 172.21.15.37:0/2606397453 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd4fc0fbcb0 msgr2=0x7fd4fc0fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:20:00.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:00.503+0000 7fd5036a3700 1 --2- 172.21.15.37:0/2606397453 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd4fc0fbcb0 0x7fd4fc0fc0c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8004940 tx=0x7fd4f8009e30 comp rx=0 tx=0).stop 2024-04-25T17:20:00.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:00.503+0000 7fd5036a3700 1 -- 172.21.15.37:0/2606397453 shutdown_connections 2024-04-25T17:20:00.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:00.503+0000 7fd5036a3700 1 --2- 172.21.15.37:0/2606397453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4fc0fcf60 0x7fd4fc0fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:00.504 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:00.503+0000 7fd5036a3700 1 --2- 172.21.15.37:0/2606397453 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd4fc0fbcb0 0x7fd4fc0fc0c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:00.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:00.503+0000 7fd5036a3700 1 -- 172.21.15.37:0/2606397453 >> 172.21.15.37:0/2606397453 conn(0x7fd4fc0f7430 msgr2=0x7fd4fc0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:20:00.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:00.503+0000 7fd5036a3700 1 -- 172.21.15.37:0/2606397453 shutdown_connections 2024-04-25T17:20:00.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:00.504+0000 7fd5036a3700 1 -- 172.21.15.37:0/2606397453 wait complete. 2024-04-25T17:20:00.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:00.504+0000 7fd5036a3700 1 Processor -- start 2024-04-25T17:20:00.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:00.504+0000 7fd5036a3700 1 -- start start 2024-04-25T17:20:00.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:00.505+0000 7fd5036a3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4fc0fbcb0 0x7fd4fc10c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:20:00.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:00.505+0000 7fd5036a3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd4fc0fcf60 0x7fd4fc10cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:20:00.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:00.505+0000 7fd5036a3700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc10d3d0 con 0x7fd4fc0fbcb0 2024-04-25T17:20:00.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:00.505+0000 7fd5036a3700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc10dc20 con 0x7fd4fc0fcf60 2024-04-25T17:20:00.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:00.505+0000 7fd50143f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4fc0fbcb0 0x7fd4fc10c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:20:00.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:00.505+0000 7fd50143f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4fc0fbcb0 0x7fd4fc10c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47004/0 (socket says 172.21.15.37:47004) 2024-04-25T17:20:00.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:00.505+0000 7fd50143f700 1 -- 172.21.15.37:0/3669506335 learned_addr learned my addr 172.21.15.37:0/3669506335 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:20:00.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:00.505+0000 7fd500c3e700 1 --2- 172.21.15.37:0/3669506335 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd4fc0fcf60 0x7fd4fc10cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:20:00.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:00.505+0000 7fd500c3e700 1 -- 172.21.15.37:0/3669506335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4fc0fbcb0 msgr2=0x7fd4fc10c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:20:00.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:00.505+0000 7fd500c3e700 1 --2- 172.21.15.37:0/3669506335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4fc0fbcb0 0x7fd4fc10c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:00.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:00.505+0000 7fd500c3e700 1 -- 172.21.15.37:0/3669506335 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f8005040 con 0x7fd4fc0fcf60 2024-04-25T17:20:00.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:00.505+0000 7fd50143f700 1 --2- 172.21.15.37:0/3669506335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4fc0fbcb0 0x7fd4fc10c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T17:20:00.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:00.505+0000 7fd500c3e700 1 --2- 172.21.15.37:0/3669506335 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd4fc0fcf60 0x7fd4fc10cdd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec009fd0 tx=0x7fd4ec00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:20:00.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:00.506+0000 7fd4f1ffb700 1 -- 172.21.15.37:0/3669506335 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4ec004e70 con 0x7fd4fc0fcf60 2024-04-25T17:20:00.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:00.506+0000 7fd4f1ffb700 1 -- 172.21.15.37:0/3669506335 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd4ec00f040 con 0x7fd4fc0fcf60 2024-04-25T17:20:00.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:00.506+0000 7fd5036a3700 1 -- 172.21.15.37:0/3669506335 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4fc10dea0 con 0x7fd4fc0fcf60 2024-04-25T17:20:00.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:00.506+0000 7fd4f1ffb700 1 -- 172.21.15.37:0/3669506335 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4ec00c980 con 0x7fd4fc0fcf60 2024-04-25T17:20:00.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:00.506+0000 7fd5036a3700 1 -- 172.21.15.37:0/3669506335 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4fc10e3e0 con 0x7fd4fc0fcf60 2024-04-25T17:20:00.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:00.507+0000 7fd5036a3700 1 -- 172.21.15.37:0/3669506335 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4fc05f5c0 con 0x7fd4fc0fcf60 2024-04-25T17:20:00.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:00.508+0000 7fd4f1ffb700 1 -- 172.21.15.37:0/3669506335 <== mon.1 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 31) v1 ==== 98485+0+0 (secure 0 0 0) 0x7fd4ec00cae0 con 0x7fd4fc0fcf60 2024-04-25T17:20:00.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:00.508+0000 7fd4f1ffb700 1 --2- 172.21.15.37:0/3669506335 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7fd4e80765a0 0x7fd4e8078a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:20:00.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:00.509+0000 7fd4f1ffb700 1 -- 172.21.15.37:0/3669506335 <== mon.1 v2:172.21.15.69:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7fd4ec0976f0 con 0x7fd4fc0fcf60 2024-04-25T17:20:00.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:00.509+0000 7fd50143f700 1 --2- 172.21.15.37:0/3669506335 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7fd4e80765a0 0x7fd4e8078a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:20:00.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:00.509+0000 7fd50143f700 1 --2- 172.21.15.37:0/3669506335 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7fd4e80765a0 0x7fd4e8078a50 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8013740 tx=0x7fd4f8009e30 comp rx=0 tx=0).ready entity=mgr.14766 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:20:00.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:00.513+0000 7fd4f1ffb700 1 -- 172.21.15.37:0/3669506335 <== mon.1 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7fd4ec060930 con 0x7fd4fc0fcf60 2024-04-25T17:20:00.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:00.955+0000 7fd5036a3700 1 -- 172.21.15.37:0/3669506335 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd4fc04bed0 con 0x7fd4fc0fcf60 2024-04-25T17:20:00.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:00.955+0000 7fd4f1ffb700 1 -- 172.21.15.37:0/3669506335 <== mon.1 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1830 (secure 0 0 0) 0x7fd4ec0602d0 con 0x7fd4fc0fcf60 2024-04-25T17:20:00.956 INFO:teuthology.orchestra.run.smithi037.stdout:e16 2024-04-25T17:20:00.956 INFO:teuthology.orchestra.run.smithi037.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-25T17:20:00.956 INFO:teuthology.orchestra.run.smithi037.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T17:20:00.956 INFO:teuthology.orchestra.run.smithi037.stdout:legacy client fscid: 1 2024-04-25T17:20:00.956 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:20:00.956 INFO:teuthology.orchestra.run.smithi037.stdout:Filesystem 'cephfs' (1) 2024-04-25T17:20:00.956 INFO:teuthology.orchestra.run.smithi037.stdout:fs_name cephfs 2024-04-25T17:20:00.956 INFO:teuthology.orchestra.run.smithi037.stdout:epoch 16 2024-04-25T17:20:00.956 INFO:teuthology.orchestra.run.smithi037.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-25T17:20:00.956 INFO:teuthology.orchestra.run.smithi037.stdout:created 2024-04-25T17:15:40.586130+0000 2024-04-25T17:20:00.956 INFO:teuthology.orchestra.run.smithi037.stdout:modified 2024-04-25T17:15:57.508740+0000 2024-04-25T17:20:00.957 INFO:teuthology.orchestra.run.smithi037.stdout:tableserver 0 2024-04-25T17:20:00.957 INFO:teuthology.orchestra.run.smithi037.stdout:root 0 2024-04-25T17:20:00.957 INFO:teuthology.orchestra.run.smithi037.stdout:session_timeout 60 2024-04-25T17:20:00.957 INFO:teuthology.orchestra.run.smithi037.stdout:session_autoclose 300 2024-04-25T17:20:00.957 INFO:teuthology.orchestra.run.smithi037.stdout:max_file_size 1099511627776 2024-04-25T17:20:00.957 INFO:teuthology.orchestra.run.smithi037.stdout:required_client_features {} 2024-04-25T17:20:00.957 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure 0 2024-04-25T17:20:00.957 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure_osd_epoch 0 2024-04-25T17:20:00.957 INFO:teuthology.orchestra.run.smithi037.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T17:20:00.957 INFO:teuthology.orchestra.run.smithi037.stdout:max_mds 1 2024-04-25T17:20:00.957 INFO:teuthology.orchestra.run.smithi037.stdout:in 0 2024-04-25T17:20:00.957 INFO:teuthology.orchestra.run.smithi037.stdout:up {0=14470} 2024-04-25T17:20:00.957 INFO:teuthology.orchestra.run.smithi037.stdout:failed 2024-04-25T17:20:00.957 INFO:teuthology.orchestra.run.smithi037.stdout:damaged 2024-04-25T17:20:00.957 INFO:teuthology.orchestra.run.smithi037.stdout:stopped 2024-04-25T17:20:00.958 INFO:teuthology.orchestra.run.smithi037.stdout:data_pools [3] 2024-04-25T17:20:00.958 INFO:teuthology.orchestra.run.smithi037.stdout:metadata_pool 2 2024-04-25T17:20:00.958 INFO:teuthology.orchestra.run.smithi037.stdout:inline_data disabled 2024-04-25T17:20:00.958 INFO:teuthology.orchestra.run.smithi037.stdout:balancer 2024-04-25T17:20:00.958 INFO:teuthology.orchestra.run.smithi037.stdout:standby_count_wanted 1 2024-04-25T17:20:00.958 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi037.ksmixc{0:14470} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.37:6826/1903989494,v1:172.21.15.37:6827/1903989494] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:20:00.958 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi037.ovkrpq{0:14482} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.37:6828/4206394422,v1:172.21.15.37:6829/4206394422] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:20:00.958 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:20:00.958 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:20:00.958 INFO:teuthology.orchestra.run.smithi037.stdout:Standby daemons: 2024-04-25T17:20:00.958 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:20:00.958 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi069.cpprst{-1:24289} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.69:6826/518856100,v1:172.21.15.69:6827/518856100] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:20:00.958 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi069.ytlqcf{-1:24293} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.69:6824/134210439,v1:172.21.15.69:6825/134210439] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:20:00.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:00.957+0000 7fd5036a3700 1 -- 172.21.15.37:0/3669506335 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7fd4e80765a0 msgr2=0x7fd4e8078a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:20:00.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:00.957+0000 7fd5036a3700 1 --2- 172.21.15.37:0/3669506335 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7fd4e80765a0 0x7fd4e8078a50 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8013740 tx=0x7fd4f8009e30 comp rx=0 tx=0).stop 2024-04-25T17:20:00.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:00.957+0000 7fd5036a3700 1 -- 172.21.15.37:0/3669506335 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd4fc0fcf60 msgr2=0x7fd4fc10cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:20:00.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:00.957+0000 7fd5036a3700 1 --2- 172.21.15.37:0/3669506335 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd4fc0fcf60 0x7fd4fc10cdd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec009fd0 tx=0x7fd4ec00b040 comp rx=0 tx=0).stop 2024-04-25T17:20:00.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:00.958+0000 7fd5036a3700 1 -- 172.21.15.37:0/3669506335 shutdown_connections 2024-04-25T17:20:00.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:00.958+0000 7fd5036a3700 1 --2- 172.21.15.37:0/3669506335 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7fd4e80765a0 0x7fd4e8078a50 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:00.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:00.958+0000 7fd5036a3700 1 --2- 172.21.15.37:0/3669506335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4fc0fbcb0 0x7fd4fc10c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:00.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:00.958+0000 7fd5036a3700 1 --2- 172.21.15.37:0/3669506335 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd4fc0fcf60 0x7fd4fc10cdd0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:00.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:00.958+0000 7fd5036a3700 1 -- 172.21.15.37:0/3669506335 >> 172.21.15.37:0/3669506335 conn(0x7fd4fc0f7430 msgr2=0x7fd4fc0f8a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:20:00.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:00.958+0000 7fd5036a3700 1 -- 172.21.15.37:0/3669506335 shutdown_connections 2024-04-25T17:20:00.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:00.958+0000 7fd5036a3700 1 -- 172.21.15.37:0/3669506335 wait complete. 2024-04-25T17:20:00.960 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 16 2024-04-25T17:20:01.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.108+0000 7f9df63ee700 1 -- 172.21.15.37:0/1577468739 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9df0066200 msgr2=0x7f9df00ffa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:20:01.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.108+0000 7f9df63ee700 1 --2- 172.21.15.37:0/1577468739 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9df0066200 0x7f9df00ffa60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9de0004940 tx=0x7f9de0009e30 comp rx=0 tx=0).stop 2024-04-25T17:20:01.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.108+0000 7f9df63ee700 1 -- 172.21.15.37:0/1577468739 shutdown_connections 2024-04-25T17:20:01.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.108+0000 7f9df63ee700 1 --2- 172.21.15.37:0/1577468739 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9df00fffa0 0x7f9df0102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:01.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.108+0000 7f9df63ee700 1 --2- 172.21.15.37:0/1577468739 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9df0066200 0x7f9df00ffa60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:01.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.108+0000 7f9df63ee700 1 -- 172.21.15.37:0/1577468739 >> 172.21.15.37:0/1577468739 conn(0x7f9df00f7430 msgr2=0x7f9df00f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:20:01.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.108+0000 7f9df63ee700 1 -- 172.21.15.37:0/1577468739 shutdown_connections 2024-04-25T17:20:01.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.108+0000 7f9df63ee700 1 -- 172.21.15.37:0/1577468739 wait complete. 2024-04-25T17:20:01.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.109+0000 7f9df63ee700 1 Processor -- start 2024-04-25T17:20:01.110 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.109+0000 7f9df63ee700 1 -- start start 2024-04-25T17:20:01.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.109+0000 7f9df63ee700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9df0066200 0x7f9df010d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:20:01.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.109+0000 7f9df63ee700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9df00fffa0 0x7f9df010df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:20:01.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.109+0000 7f9df63ee700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df010e510 con 0x7f9df00fffa0 2024-04-25T17:20:01.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.109+0000 7f9def7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9df00fffa0 0x7f9df010df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:20:01.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.110+0000 7f9def7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9df00fffa0 0x7f9df010df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47016/0 (socket says 172.21.15.37:47016) 2024-04-25T17:20:01.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.110+0000 7f9def7fe700 1 -- 172.21.15.37:0/490988970 learned_addr learned my addr 172.21.15.37:0/490988970 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:20:01.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.110+0000 7f9deffff700 1 --2- 172.21.15.37:0/490988970 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9df0066200 0x7f9df010d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:20:01.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.110+0000 7f9df63ee700 1 -- 172.21.15.37:0/490988970 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df010ed60 con 0x7f9df0066200 2024-04-25T17:20:01.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.110+0000 7f9deffff700 1 -- 172.21.15.37:0/490988970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9df00fffa0 msgr2=0x7f9df010df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:20:01.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.110+0000 7f9deffff700 1 --2- 172.21.15.37:0/490988970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9df00fffa0 0x7f9df010df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:01.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.110+0000 7f9deffff700 1 -- 172.21.15.37:0/490988970 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9de0005040 con 0x7f9df0066200 2024-04-25T17:20:01.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.110+0000 7f9def7fe700 1 --2- 172.21.15.37:0/490988970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9df00fffa0 0x7f9df010df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T17:20:01.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.110+0000 7f9deffff700 1 --2- 172.21.15.37:0/490988970 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9df0066200 0x7f9df010d9d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9de0000c00 tx=0x7f9de0009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:20:01.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.111+0000 7f9decff9700 1 -- 172.21.15.37:0/490988970 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9de000e040 con 0x7f9df0066200 2024-04-25T17:20:01.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.111+0000 7f9decff9700 1 -- 172.21.15.37:0/490988970 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9de0013c20 con 0x7f9df0066200 2024-04-25T17:20:01.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.111+0000 7f9decff9700 1 -- 172.21.15.37:0/490988970 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9de0012600 con 0x7f9df0066200 2024-04-25T17:20:01.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.111+0000 7f9df63ee700 1 -- 172.21.15.37:0/490988970 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9df010efe0 con 0x7f9df0066200 2024-04-25T17:20:01.112 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.111+0000 7f9df63ee700 1 -- 172.21.15.37:0/490988970 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9df010f4d0 con 0x7f9df0066200 2024-04-25T17:20:01.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.112+0000 7f9df63ee700 1 -- 172.21.15.37:0/490988970 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9df005f5c0 con 0x7f9df0066200 2024-04-25T17:20:01.113 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.113+0000 7f9decff9700 1 -- 172.21.15.37:0/490988970 <== mon.1 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 31) v1 ==== 98485+0+0 (secure 0 0 0) 0x7f9de0012760 con 0x7f9df0066200 2024-04-25T17:20:01.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.113+0000 7f9decff9700 1 --2- 172.21.15.37:0/490988970 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7f9dd80765a0 0x7f9dd8078a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:20:01.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.114+0000 7f9decff9700 1 -- 172.21.15.37:0/490988970 <== mon.1 v2:172.21.15.69:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f9de0098410 con 0x7f9df0066200 2024-04-25T17:20:01.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.114+0000 7f9def7fe700 1 --2- 172.21.15.37:0/490988970 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7f9dd80765a0 0x7f9dd8078a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:20:01.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.114+0000 7f9def7fe700 1 --2- 172.21.15.37:0/490988970 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7f9dd80765a0 0x7f9dd8078a50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9de4009b80 tx=0x7f9de400b040 comp rx=0 tx=0).ready entity=mgr.14766 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:20:01.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.118+0000 7f9decff9700 1 -- 172.21.15.37:0/490988970 <== mon.1 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f9de00615b0 con 0x7f9df0066200 2024-04-25T17:20:01.458 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.458+0000 7f9df63ee700 1 -- 172.21.15.37:0/490988970 --> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9df010f870 con 0x7f9dd80765a0 2024-04-25T17:20:01.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.459+0000 7f9decff9700 1 -- 172.21.15.37:0/490988970 <== mgr.14766 v2:172.21.15.37:6800/709373822 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f9df010f870 con 0x7f9dd80765a0 2024-04-25T17:20:01.460 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-25T17:20:01.460 INFO:teuthology.orchestra.run.smithi037.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385", 2024-04-25T17:20:01.460 INFO:teuthology.orchestra.run.smithi037.stdout: "in_progress": true, 2024-04-25T17:20:01.460 INFO:teuthology.orchestra.run.smithi037.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-25T17:20:01.460 INFO:teuthology.orchestra.run.smithi037.stdout: "services_complete": [ 2024-04-25T17:20:01.460 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr" 2024-04-25T17:20:01.460 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-04-25T17:20:01.460 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": "2/21 daemons upgraded", 2024-04-25T17:20:01.460 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "", 2024-04-25T17:20:01.460 INFO:teuthology.orchestra.run.smithi037.stdout: "is_paused": false 2024-04-25T17:20:01.460 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-25T17:20:01.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.461+0000 7f9df63ee700 1 -- 172.21.15.37:0/490988970 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7f9dd80765a0 msgr2=0x7f9dd8078a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:20:01.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.461+0000 7f9df63ee700 1 --2- 172.21.15.37:0/490988970 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7f9dd80765a0 0x7f9dd8078a50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9de4009b80 tx=0x7f9de400b040 comp rx=0 tx=0).stop 2024-04-25T17:20:01.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.461+0000 7f9df63ee700 1 -- 172.21.15.37:0/490988970 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9df0066200 msgr2=0x7f9df010d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:20:01.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.461+0000 7f9df63ee700 1 --2- 172.21.15.37:0/490988970 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9df0066200 0x7f9df010d9d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9de0000c00 tx=0x7f9de0009e30 comp rx=0 tx=0).stop 2024-04-25T17:20:01.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.461+0000 7f9df63ee700 1 -- 172.21.15.37:0/490988970 shutdown_connections 2024-04-25T17:20:01.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.461+0000 7f9df63ee700 1 --2- 172.21.15.37:0/490988970 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7f9dd80765a0 0x7f9dd8078a50 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:01.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.461+0000 7f9df63ee700 1 --2- 172.21.15.37:0/490988970 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9df0066200 0x7f9df010d9d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:01.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.462+0000 7f9df63ee700 1 --2- 172.21.15.37:0/490988970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9df00fffa0 0x7f9df010df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:01.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.462+0000 7f9df63ee700 1 -- 172.21.15.37:0/490988970 >> 172.21.15.37:0/490988970 conn(0x7f9df00f7430 msgr2=0x7f9df00f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:20:01.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.462+0000 7f9df63ee700 1 -- 172.21.15.37:0/490988970 shutdown_connections 2024-04-25T17:20:01.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.462+0000 7f9df63ee700 1 -- 172.21.15.37:0/490988970 wait complete. 2024-04-25T17:20:01.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:01 smithi037 ceph-mon[26472]: from='client.14802 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:20:01.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:01 smithi037 ceph-mon[26472]: pgmap v8: 65 pgs: 65 active+clean; 508 MiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 730 KiB/s rd, 665 KiB/s wr, 100 op/s 2024-04-25T17:20:01.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:01 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:20:01.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:01 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:20:01.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:01 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/2909876380' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:20:01.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:01 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/3669506335' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T17:20:01.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.631+0000 7f43dd0fc700 1 -- 172.21.15.37:0/2152709557 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43d80fe080 msgr2=0x7f43d80fe4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:20:01.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.631+0000 7f43dd0fc700 1 --2- 172.21.15.37:0/2152709557 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43d80fe080 0x7f43d80fe4f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f43cc004940 tx=0x7f43cc009e30 comp rx=0 tx=0).stop 2024-04-25T17:20:01.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.631+0000 7f43dd0fc700 1 -- 172.21.15.37:0/2152709557 shutdown_connections 2024-04-25T17:20:01.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.631+0000 7f43dd0fc700 1 --2- 172.21.15.37:0/2152709557 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43d80fe080 0x7f43d80fe4f0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:01.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.631+0000 7f43dd0fc700 1 --2- 172.21.15.37:0/2152709557 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f43d80fce80 0x7f43d80fd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:01.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.631+0000 7f43dd0fc700 1 -- 172.21.15.37:0/2152709557 >> 172.21.15.37:0/2152709557 conn(0x7f43d80f8590 msgr2=0x7f43d80fa9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:20:01.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.631+0000 7f43dd0fc700 1 -- 172.21.15.37:0/2152709557 shutdown_connections 2024-04-25T17:20:01.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.631+0000 7f43dd0fc700 1 -- 172.21.15.37:0/2152709557 wait complete. 2024-04-25T17:20:01.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.632+0000 7f43dd0fc700 1 Processor -- start 2024-04-25T17:20:01.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.632+0000 7f43dd0fc700 1 -- start start 2024-04-25T17:20:01.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.632+0000 7f43dd0fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43d80fce80 0x7f43d810da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:20:01.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.632+0000 7f43dd0fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f43d80fe080 0x7f43d810df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:20:01.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.632+0000 7f43dd0fc700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d810e570 con 0x7f43d80fce80 2024-04-25T17:20:01.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.632+0000 7f43dd0fc700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d810edc0 con 0x7f43d80fe080 2024-04-25T17:20:01.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.632+0000 7f43d6d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43d80fce80 0x7f43d810da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:20:01.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.632+0000 7f43d6d9d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43d80fce80 0x7f43d810da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47030/0 (socket says 172.21.15.37:47030) 2024-04-25T17:20:01.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.632+0000 7f43d6d9d700 1 -- 172.21.15.37:0/306008444 learned_addr learned my addr 172.21.15.37:0/306008444 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:20:01.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.633+0000 7f43d6d9d700 1 -- 172.21.15.37:0/306008444 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f43d80fe080 msgr2=0x7f43d810df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:20:01.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.633+0000 7f43d659c700 1 --2- 172.21.15.37:0/306008444 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f43d80fe080 0x7f43d810df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:20:01.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.633+0000 7f43d6d9d700 1 --2- 172.21.15.37:0/306008444 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f43d80fe080 0x7f43d810df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:01.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.633+0000 7f43d6d9d700 1 -- 172.21.15.37:0/306008444 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43cc005040 con 0x7f43d80fce80 2024-04-25T17:20:01.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.633+0000 7f43d6d9d700 1 --2- 172.21.15.37:0/306008444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43d80fce80 0x7f43d810da30 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f43c8002a80 tx=0x7f43c8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:20:01.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.633+0000 7f43bf7fe700 1 -- 172.21.15.37:0/306008444 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43c8007cc0 con 0x7f43d80fce80 2024-04-25T17:20:01.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.633+0000 7f43dd0fc700 1 -- 172.21.15.37:0/306008444 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43d810f0a0 con 0x7f43d80fce80 2024-04-25T17:20:01.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.633+0000 7f43bf7fe700 1 -- 172.21.15.37:0/306008444 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f43c800f040 con 0x7f43d80fce80 2024-04-25T17:20:01.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.633+0000 7f43bf7fe700 1 -- 172.21.15.37:0/306008444 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43c800dae0 con 0x7f43d80fce80 2024-04-25T17:20:01.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.634+0000 7f43dd0fc700 1 -- 172.21.15.37:0/306008444 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43d810f5e0 con 0x7f43d80fce80 2024-04-25T17:20:01.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.635+0000 7f43dd0fc700 1 -- 172.21.15.37:0/306008444 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43d805f5c0 con 0x7f43d80fce80 2024-04-25T17:20:01.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.636+0000 7f43bf7fe700 1 -- 172.21.15.37:0/306008444 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 31) v1 ==== 98485+0+0 (secure 0 0 0) 0x7f43c800dd50 con 0x7f43d80fce80 2024-04-25T17:20:01.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.636+0000 7f43bf7fe700 1 --2- 172.21.15.37:0/306008444 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7f43c00765a0 0x7f43c0078a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:20:01.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.636+0000 7f43bf7fe700 1 -- 172.21.15.37:0/306008444 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f43c8097830 con 0x7f43d80fce80 2024-04-25T17:20:01.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.636+0000 7f43d659c700 1 --2- 172.21.15.37:0/306008444 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7f43c00765a0 0x7f43c0078a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:20:01.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.637+0000 7f43d659c700 1 --2- 172.21.15.37:0/306008444 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7f43c00765a0 0x7f43c0078a50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f43cc000c00 tx=0x7f43cc009e30 comp rx=0 tx=0).ready entity=mgr.14766 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:20:01.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:01.641+0000 7f43bf7fe700 1 -- 172.21.15.37:0/306008444 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f43c80609f0 con 0x7f43d80fce80 2024-04-25T17:20:01.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:01 smithi069 ceph-mon[34527]: from='client.14802 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:20:01.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:01 smithi069 ceph-mon[34527]: pgmap v8: 65 pgs: 65 active+clean; 508 MiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 730 KiB/s rd, 665 KiB/s wr, 100 op/s 2024-04-25T17:20:01.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:01 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:20:01.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:01 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:20:01.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:01 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/2909876380' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:20:01.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:01 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/3669506335' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T17:20:02.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:02.039+0000 7f43dd0fc700 1 -- 172.21.15.37:0/306008444 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f43d804bed0 con 0x7f43d80fce80 2024-04-25T17:20:02.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:02.040+0000 7f43bf7fe700 1 -- 172.21.15.37:0/306008444 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f43c8060390 con 0x7f43d80fce80 2024-04-25T17:20:02.040 INFO:teuthology.orchestra.run.smithi037.stdout:HEALTH_OK 2024-04-25T17:20:02.042 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:02.042+0000 7f43dd0fc700 1 -- 172.21.15.37:0/306008444 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7f43c00765a0 msgr2=0x7f43c0078a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:20:02.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:02.042+0000 7f43dd0fc700 1 --2- 172.21.15.37:0/306008444 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7f43c00765a0 0x7f43c0078a50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f43cc000c00 tx=0x7f43cc009e30 comp rx=0 tx=0).stop 2024-04-25T17:20:02.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:02.042+0000 7f43dd0fc700 1 -- 172.21.15.37:0/306008444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43d80fce80 msgr2=0x7f43d810da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:20:02.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:02.042+0000 7f43dd0fc700 1 --2- 172.21.15.37:0/306008444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43d80fce80 0x7f43d810da30 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f43c8002a80 tx=0x7f43c8004600 comp rx=0 tx=0).stop 2024-04-25T17:20:02.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:02.042+0000 7f43dd0fc700 1 -- 172.21.15.37:0/306008444 shutdown_connections 2024-04-25T17:20:02.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:02.042+0000 7f43dd0fc700 1 --2- 172.21.15.37:0/306008444 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7f43c00765a0 0x7f43c0078a50 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:02.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:02.042+0000 7f43dd0fc700 1 --2- 172.21.15.37:0/306008444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43d80fce80 0x7f43d810da30 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:02.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:02.042+0000 7f43dd0fc700 1 --2- 172.21.15.37:0/306008444 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f43d80fe080 0x7f43d810df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:02.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:02.042+0000 7f43dd0fc700 1 -- 172.21.15.37:0/306008444 >> 172.21.15.37:0/306008444 conn(0x7f43d80f8590 msgr2=0x7f43d80f9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:20:02.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:02.042+0000 7f43dd0fc700 1 -- 172.21.15.37:0/306008444 shutdown_connections 2024-04-25T17:20:02.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:02.042+0000 7f43dd0fc700 1 -- 172.21.15.37:0/306008444 wait complete. 2024-04-25T17:20:02.321 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:02 smithi037 ceph-mon[26472]: from='client.24569 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:20:02.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:02 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:20:02.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:02 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:20:02.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:02 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/306008444' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T17:20:02.670 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:02 smithi069 ceph-mon[34527]: from='client.24569 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:20:02.670 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:02 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:20:02.670 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:02 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:20:02.670 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:02 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/306008444' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T17:20:03.505 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:03 smithi037 ceph-mon[26472]: pgmap v9: 65 pgs: 65 active+clean; 279 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 211 op/s 2024-04-25T17:20:03.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:03 smithi069 ceph-mon[34527]: pgmap v9: 65 pgs: 65 active+clean; 279 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 211 op/s 2024-04-25T17:20:05.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:05 smithi037 ceph-mon[26472]: pgmap v10: 65 pgs: 65 active+clean; 279 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 956 KiB/s rd, 972 KiB/s wr, 193 op/s 2024-04-25T17:20:05.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:05 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:20:05.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:05 smithi069 ceph-mon[34527]: pgmap v10: 65 pgs: 65 active+clean; 279 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 956 KiB/s rd, 972 KiB/s wr, 193 op/s 2024-04-25T17:20:05.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:05 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:20:07.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:07 smithi037 ceph-mon[26472]: pgmap v11: 65 pgs: 65 active+clean; 279 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 956 KiB/s rd, 972 KiB/s wr, 193 op/s 2024-04-25T17:20:07.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:07 smithi069 ceph-mon[34527]: pgmap v11: 65 pgs: 65 active+clean; 279 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 956 KiB/s rd, 972 KiB/s wr, 193 op/s 2024-04-25T17:20:09.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:09 smithi037 ceph-mon[26472]: pgmap v12: 65 pgs: 65 active+clean; 283 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 331 op/s 2024-04-25T17:20:09.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:09 smithi069 ceph-mon[34527]: pgmap v12: 65 pgs: 65 active+clean; 283 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 331 op/s 2024-04-25T17:20:11.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:11 smithi037 ceph-mon[26472]: pgmap v13: 65 pgs: 65 active+clean; 283 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 948 KiB/s rd, 995 KiB/s wr, 256 op/s 2024-04-25T17:20:11.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:11 smithi069 ceph-mon[34527]: pgmap v13: 65 pgs: 65 active+clean; 283 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 948 KiB/s rd, 995 KiB/s wr, 256 op/s 2024-04-25T17:20:13.506 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:13 smithi037 ceph-mon[26472]: pgmap v14: 65 pgs: 65 active+clean; 286 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 395 op/s 2024-04-25T17:20:13.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:13 smithi069 ceph-mon[34527]: pgmap v14: 65 pgs: 65 active+clean; 286 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 395 op/s 2024-04-25T17:20:15.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:15 smithi037 ceph-mon[26472]: pgmap v15: 65 pgs: 65 active+clean; 286 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 982 KiB/s rd, 1019 KiB/s wr, 277 op/s 2024-04-25T17:20:15.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:15 smithi069 ceph-mon[34527]: pgmap v15: 65 pgs: 65 active+clean; 286 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 982 KiB/s rd, 1019 KiB/s wr, 277 op/s 2024-04-25T17:20:16.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:16 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:20:16.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:16 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:20:16.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:16 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:20:16.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:16 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:20:16.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:16 smithi069 ceph-mon[34527]: Updating smithi037:/etc/ceph/ceph.conf 2024-04-25T17:20:16.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:16 smithi069 ceph-mon[34527]: Updating smithi069:/etc/ceph/ceph.conf 2024-04-25T17:20:16.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:16 smithi069 ceph-mon[34527]: Updating smithi069:/var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T17:20:16.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:16 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:20:16.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:16 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:20:16.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:16 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:20:16.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:16 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:20:16.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:16 smithi037 ceph-mon[26472]: Updating smithi037:/etc/ceph/ceph.conf 2024-04-25T17:20:16.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:16 smithi037 ceph-mon[26472]: Updating smithi069:/etc/ceph/ceph.conf 2024-04-25T17:20:16.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:16 smithi037 ceph-mon[26472]: Updating smithi069:/var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T17:20:17.763 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:17 smithi037 ceph-mon[26472]: Updating smithi037:/var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T17:20:17.763 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:17 smithi037 ceph-mon[26472]: pgmap v16: 65 pgs: 65 active+clean; 286 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 982 KiB/s rd, 1019 KiB/s wr, 277 op/s 2024-04-25T17:20:17.763 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:17 smithi037 ceph-mon[26472]: Updating smithi069:/etc/ceph/ceph.client.admin.keyring 2024-04-25T17:20:17.763 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:17 smithi037 ceph-mon[26472]: Updating smithi037:/etc/ceph/ceph.client.admin.keyring 2024-04-25T17:20:17.763 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:17 smithi037 ceph-mon[26472]: Updating smithi069:/var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T17:20:17.763 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:17 smithi037 ceph-mon[26472]: Updating smithi037:/var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T17:20:17.763 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:17 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:20:17.764 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:17 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:20:17.764 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:17 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:20:17.764 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:17 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:20:17.764 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:17 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:20:17.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:17 smithi069 ceph-mon[34527]: Updating smithi037:/var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T17:20:17.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:17 smithi069 ceph-mon[34527]: pgmap v16: 65 pgs: 65 active+clean; 286 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 982 KiB/s rd, 1019 KiB/s wr, 277 op/s 2024-04-25T17:20:17.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:17 smithi069 ceph-mon[34527]: Updating smithi069:/etc/ceph/ceph.client.admin.keyring 2024-04-25T17:20:17.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:17 smithi069 ceph-mon[34527]: Updating smithi037:/etc/ceph/ceph.client.admin.keyring 2024-04-25T17:20:17.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:17 smithi069 ceph-mon[34527]: Updating smithi069:/var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T17:20:17.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:17 smithi069 ceph-mon[34527]: Updating smithi037:/var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T17:20:17.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:17 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:20:17.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:17 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:20:17.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:17 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:20:17.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:17 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:20:17.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:17 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:20:18.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:18 smithi037 ceph-mon[26472]: Reconfiguring prometheus.smithi037 (dependencies changed)... 2024-04-25T17:20:18.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:18 smithi037 ceph-mon[26472]: Reconfiguring daemon prometheus.smithi037 on smithi037 2024-04-25T17:20:18.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:18 smithi069 ceph-mon[34527]: Reconfiguring prometheus.smithi037 (dependencies changed)... 2024-04-25T17:20:18.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:18 smithi069 ceph-mon[34527]: Reconfiguring daemon prometheus.smithi037 on smithi037 2024-04-25T17:20:19.819 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:19 smithi037 ceph-mon[26472]: pgmap v17: 65 pgs: 65 active+clean; 289 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 429 op/s 2024-04-25T17:20:19.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:19 smithi069 ceph-mon[34527]: pgmap v17: 65 pgs: 65 active+clean; 289 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 429 op/s 2024-04-25T17:20:20.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:20 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:20:20.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:20 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:20:21.819 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:21 smithi069 ceph-mon[34527]: pgmap v18: 65 pgs: 65 active+clean; 289 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 290 op/s 2024-04-25T17:20:21.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:21 smithi037 ceph-mon[26472]: pgmap v18: 65 pgs: 65 active+clean; 289 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 290 op/s 2024-04-25T17:20:23.629 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:23 smithi037 ceph-mon[26472]: pgmap v19: 65 pgs: 65 active+clean; 292 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 431 op/s 2024-04-25T17:20:23.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:23 smithi069 ceph-mon[34527]: pgmap v19: 65 pgs: 65 active+clean; 292 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 431 op/s 2024-04-25T17:20:25.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:24 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:20:25.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:24 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:20:25.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:24 smithi037 ceph-mon[26472]: pgmap v20: 65 pgs: 65 active+clean; 292 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 287 op/s 2024-04-25T17:20:25.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:24 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-25T17:20:25.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:24 smithi037 ceph-mon[26472]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-25T17:20:25.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:24 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi037:9095"}]: dispatch 2024-04-25T17:20:25.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:24 smithi037 ceph-mon[26472]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi037:9095"}]: dispatch 2024-04-25T17:20:25.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:24 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:20:25.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:24 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:20:25.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:24 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:20:25.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:24 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:20:25.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:24 smithi069 ceph-mon[34527]: pgmap v20: 65 pgs: 65 active+clean; 292 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 287 op/s 2024-04-25T17:20:25.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:24 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-25T17:20:25.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:24 smithi069 ceph-mon[34527]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-25T17:20:25.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:24 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi037:9095"}]: dispatch 2024-04-25T17:20:25.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:24 smithi069 ceph-mon[34527]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi037:9095"}]: dispatch 2024-04-25T17:20:25.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:24 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:20:25.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:24 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:20:27.446 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:27 smithi069 ceph-mon[34527]: pgmap v21: 65 pgs: 65 active+clean; 283 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 729 op/s 2024-04-25T17:20:27.446 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:27 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi069.mmuhdo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T17:20:27.446 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:27 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T17:20:27.446 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:27 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:20:27.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:27 smithi037 ceph-mon[26472]: pgmap v21: 65 pgs: 65 active+clean; 283 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 729 op/s 2024-04-25T17:20:27.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:27 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi069.mmuhdo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T17:20:27.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:27 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T17:20:27.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:27 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:20:28.449 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:28 smithi069 ceph-mon[34527]: Upgrade: Updating mgr.smithi069.mmuhdo 2024-04-25T17:20:28.449 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:28 smithi069 ceph-mon[34527]: Deploying daemon mgr.smithi069.mmuhdo on smithi069 2024-04-25T17:20:28.472 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:28 smithi037 ceph-mon[26472]: Upgrade: Updating mgr.smithi069.mmuhdo 2024-04-25T17:20:28.472 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:28 smithi037 ceph-mon[26472]: Deploying daemon mgr.smithi069.mmuhdo on smithi069 2024-04-25T17:20:29.342 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:29 smithi069 ceph-mon[34527]: pgmap v22: 65 pgs: 65 active+clean; 283 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 729 op/s 2024-04-25T17:20:29.518 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:29 smithi037 ceph-mon[26472]: pgmap v22: 65 pgs: 65 active+clean; 283 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 729 op/s 2024-04-25T17:20:31.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:31 smithi037 ceph-mon[26472]: pgmap v23: 65 pgs: 65 active+clean; 283 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 580 op/s 2024-04-25T17:20:31.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:31 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:20:31.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:31 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:20:31.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:31 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:20:31.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:31 smithi069 ceph-mon[34527]: pgmap v23: 65 pgs: 65 active+clean; 283 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 580 op/s 2024-04-25T17:20:31.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:31 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:20:31.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:31 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:20:31.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:31 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:20:32.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.203+0000 7f71ebf39700 1 -- 172.21.15.37:0/1230932347 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71e40fd310 msgr2=0x7f71e40fd720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:20:32.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.203+0000 7f71ebf39700 1 --2- 172.21.15.37:0/1230932347 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71e40fd310 0x7f71e40fd720 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f71e0004940 tx=0x7f71e0009e30 comp rx=0 tx=0).stop 2024-04-25T17:20:32.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.204+0000 7f71ebf39700 1 -- 172.21.15.37:0/1230932347 shutdown_connections 2024-04-25T17:20:32.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.204+0000 7f71ebf39700 1 --2- 172.21.15.37:0/1230932347 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f71e40fdc60 0x7f71e41045b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:32.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.204+0000 7f71ebf39700 1 --2- 172.21.15.37:0/1230932347 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71e40fd310 0x7f71e40fd720 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:32.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.204+0000 7f71ebf39700 1 -- 172.21.15.37:0/1230932347 >> 172.21.15.37:0/1230932347 conn(0x7f71e40f6b80 msgr2=0x7f71e40f8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:20:32.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.204+0000 7f71ebf39700 1 -- 172.21.15.37:0/1230932347 shutdown_connections 2024-04-25T17:20:32.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.204+0000 7f71ebf39700 1 -- 172.21.15.37:0/1230932347 wait complete. 2024-04-25T17:20:32.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.205+0000 7f71ebf39700 1 Processor -- start 2024-04-25T17:20:32.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.205+0000 7f71ebf39700 1 -- start start 2024-04-25T17:20:32.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.205+0000 7f71ebf39700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f71e40fd310 0x7f71e410fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:20:32.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.205+0000 7f71ebf39700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71e40fdc60 0x7f71e41100e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:20:32.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.205+0000 7f71ebf39700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e41106e0 con 0x7f71e40fdc60 2024-04-25T17:20:32.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.205+0000 7f71ebf39700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e4110ee0 con 0x7f71e40fd310 2024-04-25T17:20:32.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.205+0000 7f71e9cd5700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f71e40fd310 0x7f71e410fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:20:32.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.205+0000 7f71e9cd5700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f71e40fd310 0x7f71e410fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.37:39418/0 (socket says 172.21.15.37:39418) 2024-04-25T17:20:32.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.205+0000 7f71e9cd5700 1 -- 172.21.15.37:0/1624619558 learned_addr learned my addr 172.21.15.37:0/1624619558 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:20:32.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.205+0000 7f71e94d4700 1 --2- 172.21.15.37:0/1624619558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71e40fdc60 0x7f71e41100e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:20:32.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.205+0000 7f71e9cd5700 1 -- 172.21.15.37:0/1624619558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71e40fdc60 msgr2=0x7f71e41100e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:20:32.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.205+0000 7f71e9cd5700 1 --2- 172.21.15.37:0/1624619558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71e40fdc60 0x7f71e41100e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:32.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.205+0000 7f71e9cd5700 1 -- 172.21.15.37:0/1624619558 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e0005040 con 0x7f71e40fd310 2024-04-25T17:20:32.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.206+0000 7f71e9cd5700 1 --2- 172.21.15.37:0/1624619558 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f71e40fd310 0x7f71e410fba0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f71e000b0d0 tx=0x7f71e0009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:20:32.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.206+0000 7f71da7fc700 1 -- 172.21.15.37:0/1624619558 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71e000e030 con 0x7f71e40fd310 2024-04-25T17:20:32.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.206+0000 7f71da7fc700 1 -- 172.21.15.37:0/1624619558 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f71e001c400 con 0x7f71e40fd310 2024-04-25T17:20:32.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.206+0000 7f71ebf39700 1 -- 172.21.15.37:0/1624619558 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71e4111160 con 0x7f71e40fd310 2024-04-25T17:20:32.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.206+0000 7f71da7fc700 1 -- 172.21.15.37:0/1624619558 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71e000b630 con 0x7f71e40fd310 2024-04-25T17:20:32.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.206+0000 7f71ebf39700 1 -- 172.21.15.37:0/1624619558 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71e41116a0 con 0x7f71e40fd310 2024-04-25T17:20:32.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.207+0000 7f71ebf39700 1 -- 172.21.15.37:0/1624619558 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71e405f5c0 con 0x7f71e40fd310 2024-04-25T17:20:32.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.207+0000 7f71da7fc700 1 -- 172.21.15.37:0/1624619558 <== mon.1 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 31) v1 ==== 98485+0+0 (secure 0 0 0) 0x7f71e001c570 con 0x7f71e40fd310 2024-04-25T17:20:32.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.208+0000 7f71da7fc700 1 --2- 172.21.15.37:0/1624619558 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7f71d00765a0 0x7f71d0078a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:20:32.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.208+0000 7f71da7fc700 1 -- 172.21.15.37:0/1624619558 <== mon.1 v2:172.21.15.69:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f71e00994e0 con 0x7f71e40fd310 2024-04-25T17:20:32.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.208+0000 7f71e94d4700 1 --2- 172.21.15.37:0/1624619558 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7f71d00765a0 0x7f71d0078a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:20:32.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.209+0000 7f71e94d4700 1 --2- 172.21.15.37:0/1624619558 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7f71d00765a0 0x7f71d0078a50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f71d4009b80 tx=0x7f71d400b040 comp rx=0 tx=0).ready entity=mgr.14766 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:20:32.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.213+0000 7f71da7fc700 1 -- 172.21.15.37:0/1624619558 <== mon.1 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f71e0062720 con 0x7f71e40fd310 2024-04-25T17:20:32.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.503+0000 7f71ebf39700 1 -- 172.21.15.37:0/1624619558 --> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f71e41119c0 con 0x7f71d00765a0 2024-04-25T17:20:32.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.505+0000 7f71da7fc700 1 -- 172.21.15.37:0/1624619558 <== mgr.14766 v2:172.21.15.37:6800/709373822 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7f71e41119c0 con 0x7f71d00765a0 2024-04-25T17:20:32.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.507+0000 7f71ebf39700 1 -- 172.21.15.37:0/1624619558 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7f71d00765a0 msgr2=0x7f71d0078a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:20:32.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.507+0000 7f71ebf39700 1 --2- 172.21.15.37:0/1624619558 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7f71d00765a0 0x7f71d0078a50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f71d4009b80 tx=0x7f71d400b040 comp rx=0 tx=0).stop 2024-04-25T17:20:32.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.507+0000 7f71ebf39700 1 -- 172.21.15.37:0/1624619558 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f71e40fd310 msgr2=0x7f71e410fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:20:32.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.507+0000 7f71ebf39700 1 --2- 172.21.15.37:0/1624619558 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f71e40fd310 0x7f71e410fba0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f71e000b0d0 tx=0x7f71e0009e30 comp rx=0 tx=0).stop 2024-04-25T17:20:32.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.507+0000 7f71ebf39700 1 -- 172.21.15.37:0/1624619558 shutdown_connections 2024-04-25T17:20:32.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.507+0000 7f71ebf39700 1 --2- 172.21.15.37:0/1624619558 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7f71d00765a0 0x7f71d0078a50 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:32.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.507+0000 7f71ebf39700 1 --2- 172.21.15.37:0/1624619558 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f71e40fd310 0x7f71e410fba0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:32.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.507+0000 7f71ebf39700 1 --2- 172.21.15.37:0/1624619558 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71e40fdc60 0x7f71e41100e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:32.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.507+0000 7f71ebf39700 1 -- 172.21.15.37:0/1624619558 >> 172.21.15.37:0/1624619558 conn(0x7f71e40f6b80 msgr2=0x7f71e40f6fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:20:32.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.507+0000 7f71ebf39700 1 -- 172.21.15.37:0/1624619558 shutdown_connections 2024-04-25T17:20:32.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.507+0000 7f71ebf39700 1 -- 172.21.15.37:0/1624619558 wait complete. 2024-04-25T17:20:32.526 INFO:teuthology.orchestra.run.smithi037.stdout:true 2024-04-25T17:20:32.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.666+0000 7eff0243d700 1 -- 172.21.15.37:0/4188423111 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efefc0fbcb0 msgr2=0x7efefc0fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:20:32.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.666+0000 7eff0243d700 1 --2- 172.21.15.37:0/4188423111 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efefc0fbcb0 0x7efefc0fc0c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7efeec004940 tx=0x7efeec009e30 comp rx=0 tx=0).stop 2024-04-25T17:20:32.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.666+0000 7eff0243d700 1 -- 172.21.15.37:0/4188423111 shutdown_connections 2024-04-25T17:20:32.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.666+0000 7eff0243d700 1 --2- 172.21.15.37:0/4188423111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efefc0fcf60 0x7efefc0fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:32.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.666+0000 7eff0243d700 1 --2- 172.21.15.37:0/4188423111 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efefc0fbcb0 0x7efefc0fc0c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:32.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.666+0000 7eff0243d700 1 -- 172.21.15.37:0/4188423111 >> 172.21.15.37:0/4188423111 conn(0x7efefc0f7430 msgr2=0x7efefc0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:20:32.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.667+0000 7eff0243d700 1 -- 172.21.15.37:0/4188423111 shutdown_connections 2024-04-25T17:20:32.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.667+0000 7eff0243d700 1 -- 172.21.15.37:0/4188423111 wait complete. 2024-04-25T17:20:32.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.668+0000 7eff0243d700 1 Processor -- start 2024-04-25T17:20:32.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.668+0000 7eff0243d700 1 -- start start 2024-04-25T17:20:32.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.668+0000 7eff0243d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efefc0fbcb0 0x7efefc10fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:20:32.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.668+0000 7eff0243d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efefc0fcf60 0x7efefc110130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:20:32.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.668+0000 7eff0243d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efefc110730 con 0x7efefc0fcf60 2024-04-25T17:20:32.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.668+0000 7eff0243d700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efefc109c00 con 0x7efefc0fbcb0 2024-04-25T17:20:32.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.668+0000 7efefbfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efefc0fbcb0 0x7efefc10fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:20:32.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.669+0000 7efefbfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efefc0fbcb0 0x7efefc10fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.37:39440/0 (socket says 172.21.15.37:39440) 2024-04-25T17:20:32.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.669+0000 7efefbfff700 1 -- 172.21.15.37:0/20320470 learned_addr learned my addr 172.21.15.37:0/20320470 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:20:32.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.669+0000 7efefb7fe700 1 --2- 172.21.15.37:0/20320470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efefc0fcf60 0x7efefc110130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:20:32.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.669+0000 7efefbfff700 1 -- 172.21.15.37:0/20320470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efefc0fcf60 msgr2=0x7efefc110130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:20:32.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.669+0000 7efefbfff700 1 --2- 172.21.15.37:0/20320470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efefc0fcf60 0x7efefc110130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:32.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.669+0000 7efefbfff700 1 -- 172.21.15.37:0/20320470 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeec005040 con 0x7efefc0fbcb0 2024-04-25T17:20:32.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.669+0000 7efefbfff700 1 --2- 172.21.15.37:0/20320470 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efefc0fbcb0 0x7efefc10fbf0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efeec00b0d0 tx=0x7efeec009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:20:32.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.669+0000 7efef8ff9700 1 -- 172.21.15.37:0/20320470 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efeec00e030 con 0x7efefc0fbcb0 2024-04-25T17:20:32.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.670+0000 7efef8ff9700 1 -- 172.21.15.37:0/20320470 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efeec01c400 con 0x7efefc0fbcb0 2024-04-25T17:20:32.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.670+0000 7efef8ff9700 1 -- 172.21.15.37:0/20320470 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efeec00b650 con 0x7efefc0fbcb0 2024-04-25T17:20:32.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.670+0000 7eff0243d700 1 -- 172.21.15.37:0/20320470 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efefc110f30 con 0x7efefc0fbcb0 2024-04-25T17:20:32.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.670+0000 7eff0243d700 1 -- 172.21.15.37:0/20320470 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efefc1113b0 con 0x7efefc0fbcb0 2024-04-25T17:20:32.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.671+0000 7eff0243d700 1 -- 172.21.15.37:0/20320470 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efefc05f5c0 con 0x7efefc0fbcb0 2024-04-25T17:20:32.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.672+0000 7efef8ff9700 1 -- 172.21.15.37:0/20320470 <== mon.1 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 31) v1 ==== 98485+0+0 (secure 0 0 0) 0x7efeec013af0 con 0x7efefc0fbcb0 2024-04-25T17:20:32.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.673+0000 7efef8ff9700 1 --2- 172.21.15.37:0/20320470 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7efee40765a0 0x7efee4078a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:20:32.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.673+0000 7efef8ff9700 1 -- 172.21.15.37:0/20320470 <== mon.1 v2:172.21.15.69:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7efeec099350 con 0x7efefc0fbcb0 2024-04-25T17:20:32.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.673+0000 7efefb7fe700 1 --2- 172.21.15.37:0/20320470 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7efee40765a0 0x7efee4078a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:20:32.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.674+0000 7efefb7fe700 1 --2- 172.21.15.37:0/20320470 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7efee40765a0 0x7efee4078a50 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7efef0004600 tx=0x7efef000b040 comp rx=0 tx=0).ready entity=mgr.14766 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:20:32.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.677+0000 7efef8ff9700 1 -- 172.21.15.37:0/20320470 <== mon.1 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7efeec062630 con 0x7efefc0fbcb0 2024-04-25T17:20:32.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.997+0000 7eff0243d700 1 -- 172.21.15.37:0/20320470 --> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efefc104950 con 0x7efee40765a0 2024-04-25T17:20:33.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:32.999+0000 7efef8ff9700 1 -- 172.21.15.37:0/20320470 <== mgr.14766 v2:172.21.15.37:6800/709373822 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7efef000f040 con 0x7efee40765a0 2024-04-25T17:20:33.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.001+0000 7eff0243d700 1 -- 172.21.15.37:0/20320470 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7efee40765a0 msgr2=0x7efee4078a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:20:33.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.001+0000 7eff0243d700 1 --2- 172.21.15.37:0/20320470 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7efee40765a0 0x7efee4078a50 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7efef0004600 tx=0x7efef000b040 comp rx=0 tx=0).stop 2024-04-25T17:20:33.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.001+0000 7eff0243d700 1 -- 172.21.15.37:0/20320470 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efefc0fbcb0 msgr2=0x7efefc10fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:20:33.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.001+0000 7eff0243d700 1 --2- 172.21.15.37:0/20320470 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efefc0fbcb0 0x7efefc10fbf0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efeec00b0d0 tx=0x7efeec009e30 comp rx=0 tx=0).stop 2024-04-25T17:20:33.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.001+0000 7eff0243d700 1 -- 172.21.15.37:0/20320470 shutdown_connections 2024-04-25T17:20:33.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.001+0000 7eff0243d700 1 --2- 172.21.15.37:0/20320470 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7efee40765a0 0x7efee4078a50 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:33.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.001+0000 7eff0243d700 1 --2- 172.21.15.37:0/20320470 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efefc0fbcb0 0x7efefc10fbf0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:33.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.001+0000 7eff0243d700 1 --2- 172.21.15.37:0/20320470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efefc0fcf60 0x7efefc110130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:33.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.001+0000 7eff0243d700 1 -- 172.21.15.37:0/20320470 >> 172.21.15.37:0/20320470 conn(0x7efefc0f7430 msgr2=0x7efefc065b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:20:33.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.001+0000 7eff0243d700 1 -- 172.21.15.37:0/20320470 shutdown_connections 2024-04-25T17:20:33.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.001+0000 7eff0243d700 1 -- 172.21.15.37:0/20320470 wait complete. 2024-04-25T17:20:33.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.148+0000 7f1fc1b8d700 1 -- 172.21.15.37:0/4231693212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fbc0fdfd0 msgr2=0x7f1fbc0fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:20:33.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.148+0000 7f1fc1b8d700 1 --2- 172.21.15.37:0/4231693212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fbc0fdfd0 0x7f1fbc0fe440 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f1fac004940 tx=0x7f1fac009e30 comp rx=0 tx=0).stop 2024-04-25T17:20:33.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.149+0000 7f1fc1b8d700 1 -- 172.21.15.37:0/4231693212 shutdown_connections 2024-04-25T17:20:33.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.149+0000 7f1fc1b8d700 1 --2- 172.21.15.37:0/4231693212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fbc0fdfd0 0x7f1fbc0fe440 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:33.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.149+0000 7f1fc1b8d700 1 --2- 172.21.15.37:0/4231693212 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1fbc0fce60 0x7f1fbc0fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:33.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.149+0000 7f1fc1b8d700 1 -- 172.21.15.37:0/4231693212 >> 172.21.15.37:0/4231693212 conn(0x7f1fbc0f8540 msgr2=0x7f1fbc0fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:20:33.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.149+0000 7f1fc1b8d700 1 -- 172.21.15.37:0/4231693212 shutdown_connections 2024-04-25T17:20:33.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.149+0000 7f1fc1b8d700 1 -- 172.21.15.37:0/4231693212 wait complete. 2024-04-25T17:20:33.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.149+0000 7f1fc1b8d700 1 Processor -- start 2024-04-25T17:20:33.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.150+0000 7f1fc1b8d700 1 -- start start 2024-04-25T17:20:33.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.150+0000 7f1fc1b8d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fbc0fce60 0x7f1fbc10d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:20:33.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.150+0000 7f1fc1b8d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1fbc0fdfd0 0x7f1fbc10def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:20:33.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.150+0000 7f1fc1b8d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fbc10e4f0 con 0x7f1fbc0fce60 2024-04-25T17:20:33.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.150+0000 7f1fc1b8d700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fbc10ed40 con 0x7f1fbc0fdfd0 2024-04-25T17:20:33.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.150+0000 7f1fbb7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fbc0fce60 0x7f1fbc10d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:20:33.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.150+0000 7f1fbaffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1fbc0fdfd0 0x7f1fbc10def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:20:33.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.150+0000 7f1fbaffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1fbc0fdfd0 0x7f1fbc10def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.37:39462/0 (socket says 172.21.15.37:39462) 2024-04-25T17:20:33.152 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.150+0000 7f1fbaffd700 1 -- 172.21.15.37:0/1705338018 learned_addr learned my addr 172.21.15.37:0/1705338018 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:20:33.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.150+0000 7f1fbaffd700 1 -- 172.21.15.37:0/1705338018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fbc0fce60 msgr2=0x7f1fbc10d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:20:33.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.150+0000 7f1fbaffd700 1 --2- 172.21.15.37:0/1705338018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fbc0fce60 0x7f1fbc10d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:33.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.150+0000 7f1fbaffd700 1 -- 172.21.15.37:0/1705338018 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fac005040 con 0x7f1fbc0fdfd0 2024-04-25T17:20:33.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.151+0000 7f1fbaffd700 1 --2- 172.21.15.37:0/1705338018 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1fbc0fdfd0 0x7f1fbc10def0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1fac00b0d0 tx=0x7f1fac009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:20:33.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.151+0000 7f1fa3fff700 1 -- 172.21.15.37:0/1705338018 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fac00e030 con 0x7f1fbc0fdfd0 2024-04-25T17:20:33.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.151+0000 7f1fc1b8d700 1 -- 172.21.15.37:0/1705338018 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fbc10efc0 con 0x7f1fbc0fdfd0 2024-04-25T17:20:33.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.151+0000 7f1fc1b8d700 1 -- 172.21.15.37:0/1705338018 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fbc10f500 con 0x7f1fbc0fdfd0 2024-04-25T17:20:33.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.151+0000 7f1fa3fff700 1 -- 172.21.15.37:0/1705338018 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1fac01c400 con 0x7f1fbc0fdfd0 2024-04-25T17:20:33.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.151+0000 7f1fa3fff700 1 -- 172.21.15.37:0/1705338018 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fac00b630 con 0x7f1fbc0fdfd0 2024-04-25T17:20:33.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.152+0000 7f1fc1b8d700 1 -- 172.21.15.37:0/1705338018 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fa80052e0 con 0x7f1fbc0fdfd0 2024-04-25T17:20:33.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.153+0000 7f1fa3fff700 1 -- 172.21.15.37:0/1705338018 <== mon.1 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 31) v1 ==== 98485+0+0 (secure 0 0 0) 0x7f1fac00b8a0 con 0x7f1fbc0fdfd0 2024-04-25T17:20:33.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.153+0000 7f1fa3fff700 1 --2- 172.21.15.37:0/1705338018 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7f1fa4076670 0x7f1fa4078b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:20:33.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.154+0000 7f1fa3fff700 1 -- 172.21.15.37:0/1705338018 <== mon.1 v2:172.21.15.69:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f1fac099390 con 0x7f1fbc0fdfd0 2024-04-25T17:20:33.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.154+0000 7f1fbb7fe700 1 --2- 172.21.15.37:0/1705338018 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7f1fa4076670 0x7f1fa4078b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:20:33.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.154+0000 7f1fbb7fe700 1 --2- 172.21.15.37:0/1705338018 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7f1fa4076670 0x7f1fa4078b20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0009b80 tx=0x7f1fb000b040 comp rx=0 tx=0).ready entity=mgr.14766 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:20:33.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.160+0000 7f1fa3fff700 1 -- 172.21.15.37:0/1705338018 <== mon.1 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f1fac0625b0 con 0x7f1fbc0fdfd0 2024-04-25T17:20:33.321 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:33 smithi037 ceph-mon[26472]: pgmap v24: 65 pgs: 65 active+clean; 274 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 839 op/s 2024-04-25T17:20:33.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:33 smithi037 ceph-mon[26472]: from='client.24579 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:20:33.448 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:33 smithi069 ceph-mon[34527]: pgmap v24: 65 pgs: 65 active+clean; 274 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 839 op/s 2024-04-25T17:20:33.448 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:33 smithi069 ceph-mon[34527]: from='client.24579 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:20:33.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.509+0000 7f1fc1b8d700 1 -- 172.21.15.37:0/1705338018 --> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1fa8000bf0 con 0x7f1fa4076670 2024-04-25T17:20:33.524 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.522+0000 7f1fa3fff700 1 -- 172.21.15.37:0/1705338018 <== mgr.14766 v2:172.21.15.37:6800/709373822 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f1fa8000bf0 con 0x7f1fa4076670 2024-04-25T17:20:33.524 INFO:teuthology.orchestra.run.smithi037.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-25T17:20:33.524 INFO:teuthology.orchestra.run.smithi037.stdout:alertmanager.smithi037 smithi037 *:9093,9094 running (2m) 33s ago 10m 27.7M - 0.25.0 c8568f914cd2 18aed8f409ee 2024-04-25T17:20:33.524 INFO:teuthology.orchestra.run.smithi037.stdout:crash.smithi037 smithi037 running (10m) 33s ago 10m 6656k - 17.2.7-902-gc61472c8 0de407c1b3af b3d152574e80 2024-04-25T17:20:33.524 INFO:teuthology.orchestra.run.smithi037.stdout:crash.smithi069 smithi069 running (9m) 39s ago 9m 6660k - 17.2.7-902-gc61472c8 0de407c1b3af aa6086c64cc3 2024-04-25T17:20:33.524 INFO:teuthology.orchestra.run.smithi037.stdout:grafana.smithi037 smithi037 *:3000 running (115s) 33s ago 10m 78.8M - 9.4.7 954c08fa6188 1eff3ea3f9b0 2024-04-25T17:20:33.524 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi037.ksmixc smithi037 running (4m) 33s ago 4m 225M - 17.2.7-902-gc61472c8 0de407c1b3af 394aa56079b4 2024-04-25T17:20:33.524 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi037.ovkrpq smithi037 running (4m) 33s ago 4m 144M - 17.2.7-902-gc61472c8 0de407c1b3af 73ca662174a7 2024-04-25T17:20:33.525 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi069.cpprst smithi069 running (4m) 39s ago 4m 14.2M - 17.2.7-902-gc61472c8 0de407c1b3af dbda101df20e 2024-04-25T17:20:33.525 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi069.ytlqcf smithi069 running (4m) 39s ago 4m 12.4M - 17.2.7-902-gc61472c8 0de407c1b3af 911df6b18215 2024-04-25T17:20:33.525 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.smithi037.txrgxl smithi037 *:8443,9283,8765 running (57s) 33s ago 11m 546M - 19.0.0-3291-g994e2f20 d53c96779a29 e9653fc62df9 2024-04-25T17:20:33.525 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.smithi069.mmuhdo smithi069 *:8443,9283,8765 starting - - - - 2024-04-25T17:20:33.525 INFO:teuthology.orchestra.run.smithi037.stdout:mon.smithi037 smithi037 running (11m) 33s ago 11m 49.5M 2048M 17.2.7-902-gc61472c8 0de407c1b3af 5cfadcf8f2e4 2024-04-25T17:20:33.525 INFO:teuthology.orchestra.run.smithi037.stdout:mon.smithi069 smithi069 running (9m) 39s ago 9m 43.9M 2048M 17.2.7-902-gc61472c8 0de407c1b3af ffcd456d1dce 2024-04-25T17:20:33.525 INFO:teuthology.orchestra.run.smithi037.stdout:node-exporter.smithi037 smithi037 *:9100 running (2m) 33s ago 10m 13.9M - 1.5.0 0da6a335fe13 1e59bbb2aa82 2024-04-25T17:20:33.525 INFO:teuthology.orchestra.run.smithi037.stdout:node-exporter.smithi069 smithi069 *:9100 running (81s) 39s ago 9m 8392k - 1.5.0 0da6a335fe13 0c51a9833fe4 2024-04-25T17:20:33.525 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0 smithi037 running (8m) 33s ago 8m 198M 1559M 17.2.7-902-gc61472c8 0de407c1b3af 8ff4b0f1aae9 2024-04-25T17:20:33.525 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1 smithi037 running (7m) 33s ago 7m 207M 1559M 17.2.7-902-gc61472c8 0de407c1b3af 5715a5da241d 2024-04-25T17:20:33.525 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2 smithi037 running (7m) 33s ago 7m 176M 1559M 17.2.7-902-gc61472c8 0de407c1b3af 2eedaf9886dd 2024-04-25T17:20:33.525 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3 smithi069 running (7m) 39s ago 7m 233M 2581M 17.2.7-902-gc61472c8 0de407c1b3af ebba78fb1923 2024-04-25T17:20:33.525 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4 smithi069 running (6m) 39s ago 6m 214M 2581M 17.2.7-902-gc61472c8 0de407c1b3af ba7b785c50f9 2024-04-25T17:20:33.525 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5 smithi069 running (6m) 39s ago 6m 204M 2581M 17.2.7-902-gc61472c8 0de407c1b3af f6be99c364ff 2024-04-25T17:20:33.525 INFO:teuthology.orchestra.run.smithi037.stdout:prometheus.smithi037 smithi037 *:9095 starting - - - - 2024-04-25T17:20:33.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.525+0000 7f1fc1b8d700 1 -- 172.21.15.37:0/1705338018 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7f1fa4076670 msgr2=0x7f1fa4078b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:20:33.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.526+0000 7f1fc1b8d700 1 --2- 172.21.15.37:0/1705338018 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7f1fa4076670 0x7f1fa4078b20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0009b80 tx=0x7f1fb000b040 comp rx=0 tx=0).stop 2024-04-25T17:20:33.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.526+0000 7f1fc1b8d700 1 -- 172.21.15.37:0/1705338018 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1fbc0fdfd0 msgr2=0x7f1fbc10def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:20:33.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.526+0000 7f1fc1b8d700 1 --2- 172.21.15.37:0/1705338018 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1fbc0fdfd0 0x7f1fbc10def0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1fac00b0d0 tx=0x7f1fac009e30 comp rx=0 tx=0).stop 2024-04-25T17:20:33.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.526+0000 7f1fc1b8d700 1 -- 172.21.15.37:0/1705338018 shutdown_connections 2024-04-25T17:20:33.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.526+0000 7f1fc1b8d700 1 --2- 172.21.15.37:0/1705338018 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7f1fa4076670 0x7f1fa4078b20 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:33.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.526+0000 7f1fc1b8d700 1 --2- 172.21.15.37:0/1705338018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fbc0fce60 0x7f1fbc10d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:33.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.526+0000 7f1fc1b8d700 1 --2- 172.21.15.37:0/1705338018 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1fbc0fdfd0 0x7f1fbc10def0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:33.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.526+0000 7f1fc1b8d700 1 -- 172.21.15.37:0/1705338018 >> 172.21.15.37:0/1705338018 conn(0x7f1fbc0f8540 msgr2=0x7f1fbc0f9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:20:33.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.526+0000 7f1fc1b8d700 1 -- 172.21.15.37:0/1705338018 shutdown_connections 2024-04-25T17:20:33.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.526+0000 7f1fc1b8d700 1 -- 172.21.15.37:0/1705338018 wait complete. 2024-04-25T17:20:33.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.665+0000 7f33f7051700 1 -- 172.21.15.37:0/826347332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33f01046a0 msgr2=0x7f33f0104b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:20:33.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.665+0000 7f33f7051700 1 --2- 172.21.15.37:0/826347332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33f01046a0 0x7f33f0104b10 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f33e4004940 tx=0x7f33e4009e30 comp rx=0 tx=0).stop 2024-04-25T17:20:33.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.665+0000 7f33f7051700 1 -- 172.21.15.37:0/826347332 shutdown_connections 2024-04-25T17:20:33.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.665+0000 7f33f7051700 1 --2- 172.21.15.37:0/826347332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33f01046a0 0x7f33f0104b10 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:33.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.665+0000 7f33f7051700 1 --2- 172.21.15.37:0/826347332 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f33f01033f0 0x7f33f0103800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:33.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.665+0000 7f33f7051700 1 -- 172.21.15.37:0/826347332 >> 172.21.15.37:0/826347332 conn(0x7f33f00725e0 msgr2=0x7f33f0074a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:20:33.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.665+0000 7f33f7051700 1 -- 172.21.15.37:0/826347332 shutdown_connections 2024-04-25T17:20:33.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.665+0000 7f33f7051700 1 -- 172.21.15.37:0/826347332 wait complete. 2024-04-25T17:20:33.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.666+0000 7f33f7051700 1 Processor -- start 2024-04-25T17:20:33.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.666+0000 7f33f7051700 1 -- start start 2024-04-25T17:20:33.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.667+0000 7f33f7051700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33f01033f0 0x7f33f0113ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:20:33.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.667+0000 7f33f7051700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f33f01046a0 0x7f33f0114430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:20:33.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.667+0000 7f33f7051700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f0114a30 con 0x7f33f01033f0 2024-04-25T17:20:33.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.667+0000 7f33f7051700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f0114ba0 con 0x7f33f01046a0 2024-04-25T17:20:33.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.667+0000 7f33effff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f33f01046a0 0x7f33f0114430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:20:33.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.667+0000 7f33effff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f33f01046a0 0x7f33f0114430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.37:39474/0 (socket says 172.21.15.37:39474) 2024-04-25T17:20:33.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.667+0000 7f33effff700 1 -- 172.21.15.37:0/1459836584 learned_addr learned my addr 172.21.15.37:0/1459836584 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:20:33.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.667+0000 7f33f4ded700 1 --2- 172.21.15.37:0/1459836584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33f01033f0 0x7f33f0113ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:20:33.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.668+0000 7f33effff700 1 -- 172.21.15.37:0/1459836584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33f01033f0 msgr2=0x7f33f0113ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:20:33.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.668+0000 7f33effff700 1 --2- 172.21.15.37:0/1459836584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33f01033f0 0x7f33f0113ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:33.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.668+0000 7f33effff700 1 -- 172.21.15.37:0/1459836584 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e4005040 con 0x7f33f01046a0 2024-04-25T17:20:33.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.668+0000 7f33effff700 1 --2- 172.21.15.37:0/1459836584 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f33f01046a0 0x7f33f0114430 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f33e400b970 tx=0x7f33e4009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:20:33.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.668+0000 7f33ed7fa700 1 -- 172.21.15.37:0/1459836584 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33e400e030 con 0x7f33f01046a0 2024-04-25T17:20:33.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.668+0000 7f33ed7fa700 1 -- 172.21.15.37:0/1459836584 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f33e4004290 con 0x7f33f01046a0 2024-04-25T17:20:33.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.668+0000 7f33f7051700 1 -- 172.21.15.37:0/1459836584 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33f01195a0 con 0x7f33f01046a0 2024-04-25T17:20:33.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.669+0000 7f33f7051700 1 -- 172.21.15.37:0/1459836584 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33f0119b00 con 0x7f33f01046a0 2024-04-25T17:20:33.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.669+0000 7f33ed7fa700 1 -- 172.21.15.37:0/1459836584 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33e401c640 con 0x7f33f01046a0 2024-04-25T17:20:33.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.670+0000 7f33f7051700 1 -- 172.21.15.37:0/1459836584 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33dc0052e0 con 0x7f33f01046a0 2024-04-25T17:20:33.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.671+0000 7f33ed7fa700 1 -- 172.21.15.37:0/1459836584 <== mon.1 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 31) v1 ==== 98485+0+0 (secure 0 0 0) 0x7f33e401c8b0 con 0x7f33f01046a0 2024-04-25T17:20:33.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.671+0000 7f33ed7fa700 1 --2- 172.21.15.37:0/1459836584 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7f33d80766c0 0x7f33d8078b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:20:33.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.672+0000 7f33ed7fa700 1 -- 172.21.15.37:0/1459836584 <== mon.1 v2:172.21.15.69:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f33e4099260 con 0x7f33f01046a0 2024-04-25T17:20:33.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.672+0000 7f33f4ded700 1 --2- 172.21.15.37:0/1459836584 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7f33d80766c0 0x7f33d8078b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:20:33.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.673+0000 7f33f4ded700 1 --2- 172.21.15.37:0/1459836584 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7f33d80766c0 0x7f33d8078b70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f33e0004f40 tx=0x7f33e000b040 comp rx=0 tx=0).ready entity=mgr.14766 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:20:33.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:33.676+0000 7f33ed7fa700 1 -- 172.21.15.37:0/1459836584 <== mon.1 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f33e4062480 con 0x7f33f01046a0 2024-04-25T17:20:34.077 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.076+0000 7f33f7051700 1 -- 172.21.15.37:0/1459836584 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f33dc005860 con 0x7f33f01046a0 2024-04-25T17:20:34.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.076+0000 7f33ed7fa700 1 -- 172.21.15.37:0/1459836584 <== mon.1 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f33e4061e20 con 0x7f33f01046a0 2024-04-25T17:20:34.078 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-25T17:20:34.078 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": { 2024-04-25T17:20:34.078 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 2 2024-04-25T17:20:34.078 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:20:34.078 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": { 2024-04-25T17:20:34.078 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 2 2024-04-25T17:20:34.078 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:20:34.078 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": { 2024-04-25T17:20:34.078 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 6 2024-04-25T17:20:34.078 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:20:34.079 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": { 2024-04-25T17:20:34.079 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 4 2024-04-25T17:20:34.079 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:20:34.079 INFO:teuthology.orchestra.run.smithi037.stdout: "overall": { 2024-04-25T17:20:34.079 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 12, 2024-04-25T17:20:34.079 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 2 2024-04-25T17:20:34.079 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-04-25T17:20:34.079 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-25T17:20:34.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.080+0000 7f33f7051700 1 -- 172.21.15.37:0/1459836584 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7f33d80766c0 msgr2=0x7f33d8078b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:20:34.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.080+0000 7f33f7051700 1 --2- 172.21.15.37:0/1459836584 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7f33d80766c0 0x7f33d8078b70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f33e0004f40 tx=0x7f33e000b040 comp rx=0 tx=0).stop 2024-04-25T17:20:34.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.080+0000 7f33f7051700 1 -- 172.21.15.37:0/1459836584 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f33f01046a0 msgr2=0x7f33f0114430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:20:34.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.080+0000 7f33f7051700 1 --2- 172.21.15.37:0/1459836584 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f33f01046a0 0x7f33f0114430 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f33e400b970 tx=0x7f33e4009e30 comp rx=0 tx=0).stop 2024-04-25T17:20:34.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.080+0000 7f33f7051700 1 -- 172.21.15.37:0/1459836584 shutdown_connections 2024-04-25T17:20:34.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.080+0000 7f33f7051700 1 --2- 172.21.15.37:0/1459836584 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7f33d80766c0 0x7f33d8078b70 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:34.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.080+0000 7f33f7051700 1 --2- 172.21.15.37:0/1459836584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f33f01033f0 0x7f33f0113ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:34.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.080+0000 7f33f7051700 1 --2- 172.21.15.37:0/1459836584 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f33f01046a0 0x7f33f0114430 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:34.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.080+0000 7f33f7051700 1 -- 172.21.15.37:0/1459836584 >> 172.21.15.37:0/1459836584 conn(0x7f33f00725e0 msgr2=0x7f33f0073c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:20:34.082 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.080+0000 7f33f7051700 1 -- 172.21.15.37:0/1459836584 shutdown_connections 2024-04-25T17:20:34.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.080+0000 7f33f7051700 1 -- 172.21.15.37:0/1459836584 wait complete. 2024-04-25T17:20:34.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.247+0000 7fb914b61700 1 -- 172.21.15.37:0/131877415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9100fdfd0 msgr2=0x7fb9100fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:20:34.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.247+0000 7fb914b61700 1 --2- 172.21.15.37:0/131877415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9100fdfd0 0x7fb9100fe440 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb904004880 tx=0x7fb904009e30 comp rx=0 tx=0).stop 2024-04-25T17:20:34.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.247+0000 7fb914b61700 1 -- 172.21.15.37:0/131877415 shutdown_connections 2024-04-25T17:20:34.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.247+0000 7fb914b61700 1 --2- 172.21.15.37:0/131877415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9100fdfd0 0x7fb9100fe440 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:34.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.247+0000 7fb914b61700 1 --2- 172.21.15.37:0/131877415 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb9100fce60 0x7fb9100fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:34.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.247+0000 7fb914b61700 1 -- 172.21.15.37:0/131877415 >> 172.21.15.37:0/131877415 conn(0x7fb9100f8560 msgr2=0x7fb9100fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:20:34.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.247+0000 7fb914b61700 1 -- 172.21.15.37:0/131877415 shutdown_connections 2024-04-25T17:20:34.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.249+0000 7fb914b61700 1 -- 172.21.15.37:0/131877415 wait complete. 2024-04-25T17:20:34.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.250+0000 7fb914b61700 1 Processor -- start 2024-04-25T17:20:34.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.250+0000 7fb914b61700 1 -- start start 2024-04-25T17:20:34.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.250+0000 7fb914b61700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9100fce60 0x7fb91010d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:20:34.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.250+0000 7fb914b61700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb9100fdfd0 0x7fb91010df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:20:34.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.250+0000 7fb914b61700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb91010e510 con 0x7fb9100fce60 2024-04-25T17:20:34.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.251+0000 7fb914b61700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb91010ed60 con 0x7fb9100fdfd0 2024-04-25T17:20:34.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.251+0000 7fb90dd9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb9100fdfd0 0x7fb91010df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:20:34.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.251+0000 7fb90dd9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb9100fdfd0 0x7fb91010df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.37:39490/0 (socket says 172.21.15.37:39490) 2024-04-25T17:20:34.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.251+0000 7fb90dd9b700 1 -- 172.21.15.37:0/3974724250 learned_addr learned my addr 172.21.15.37:0/3974724250 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:20:34.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.251+0000 7fb90e59c700 1 --2- 172.21.15.37:0/3974724250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9100fce60 0x7fb91010d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:20:34.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.251+0000 7fb90dd9b700 1 -- 172.21.15.37:0/3974724250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9100fce60 msgr2=0x7fb91010d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:20:34.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.251+0000 7fb90dd9b700 1 --2- 172.21.15.37:0/3974724250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9100fce60 0x7fb91010d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:34.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.251+0000 7fb90dd9b700 1 -- 172.21.15.37:0/3974724250 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb900005040 con 0x7fb9100fdfd0 2024-04-25T17:20:34.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.252+0000 7fb90dd9b700 1 --2- 172.21.15.37:0/3974724250 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb9100fdfd0 0x7fb91010df10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb904008cd0 tx=0x7fb904009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:20:34.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.252+0000 7fb8feffd700 1 -- 172.21.15.37:0/3974724250 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb90400e030 con 0x7fb9100fdfd0 2024-04-25T17:20:34.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.252+0000 7fb914b61700 1 -- 172.21.15.37:0/3974724250 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb904005040 con 0x7fb9100fdfd0 2024-04-25T17:20:34.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.252+0000 7fb8feffd700 1 -- 172.21.15.37:0/3974724250 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb904013e60 con 0x7fb9100fdfd0 2024-04-25T17:20:34.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.252+0000 7fb914b61700 1 -- 172.21.15.37:0/3974724250 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb91010f390 con 0x7fb9100fdfd0 2024-04-25T17:20:34.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.252+0000 7fb8feffd700 1 -- 172.21.15.37:0/3974724250 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb90401ce40 con 0x7fb9100fdfd0 2024-04-25T17:20:34.255 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.254+0000 7fb914b61700 1 -- 172.21.15.37:0/3974724250 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb91005f5c0 con 0x7fb9100fdfd0 2024-04-25T17:20:34.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.255+0000 7fb8feffd700 1 -- 172.21.15.37:0/3974724250 <== mon.1 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 31) v1 ==== 98485+0+0 (secure 0 0 0) 0x7fb90401c620 con 0x7fb9100fdfd0 2024-04-25T17:20:34.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.256+0000 7fb8feffd700 1 --2- 172.21.15.37:0/3974724250 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7fb8f80765a0 0x7fb8f8078a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:20:34.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.256+0000 7fb8feffd700 1 -- 172.21.15.37:0/3974724250 <== mon.1 v2:172.21.15.69:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7fb904099570 con 0x7fb9100fdfd0 2024-04-25T17:20:34.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.256+0000 7fb90e59c700 1 --2- 172.21.15.37:0/3974724250 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7fb8f80765a0 0x7fb8f8078a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:20:34.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.256+0000 7fb90e59c700 1 --2- 172.21.15.37:0/3974724250 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7fb8f80765a0 0x7fb8f8078a50 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb900009fd0 tx=0x7fb90000b040 comp rx=0 tx=0).ready entity=mgr.14766 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:20:34.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.260+0000 7fb8feffd700 1 -- 172.21.15.37:0/3974724250 <== mon.1 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7fb904062850 con 0x7fb9100fdfd0 2024-04-25T17:20:34.322 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:34 smithi069 ceph-mon[34527]: from='client.24583 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:20:34.322 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:34 smithi069 ceph-mon[34527]: from='client.24587 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:20:34.322 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:34 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/1459836584' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:20:34.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:34 smithi037 ceph-mon[26472]: from='client.24583 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:20:34.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:34 smithi037 ceph-mon[26472]: from='client.24587 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:20:34.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:34 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/1459836584' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:20:34.579 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.578+0000 7fb914b61700 1 -- 172.21.15.37:0/3974724250 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb91004bed0 con 0x7fb9100fdfd0 2024-04-25T17:20:34.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.578+0000 7fb8feffd700 1 -- 172.21.15.37:0/3974724250 <== mon.1 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1830 (secure 0 0 0) 0x7fb9040621f0 con 0x7fb9100fdfd0 2024-04-25T17:20:34.580 INFO:teuthology.orchestra.run.smithi037.stdout:e16 2024-04-25T17:20:34.580 INFO:teuthology.orchestra.run.smithi037.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-25T17:20:34.580 INFO:teuthology.orchestra.run.smithi037.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T17:20:34.580 INFO:teuthology.orchestra.run.smithi037.stdout:legacy client fscid: 1 2024-04-25T17:20:34.580 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:20:34.580 INFO:teuthology.orchestra.run.smithi037.stdout:Filesystem 'cephfs' (1) 2024-04-25T17:20:34.580 INFO:teuthology.orchestra.run.smithi037.stdout:fs_name cephfs 2024-04-25T17:20:34.581 INFO:teuthology.orchestra.run.smithi037.stdout:epoch 16 2024-04-25T17:20:34.581 INFO:teuthology.orchestra.run.smithi037.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-25T17:20:34.581 INFO:teuthology.orchestra.run.smithi037.stdout:created 2024-04-25T17:15:40.586130+0000 2024-04-25T17:20:34.581 INFO:teuthology.orchestra.run.smithi037.stdout:modified 2024-04-25T17:15:57.508740+0000 2024-04-25T17:20:34.581 INFO:teuthology.orchestra.run.smithi037.stdout:tableserver 0 2024-04-25T17:20:34.581 INFO:teuthology.orchestra.run.smithi037.stdout:root 0 2024-04-25T17:20:34.581 INFO:teuthology.orchestra.run.smithi037.stdout:session_timeout 60 2024-04-25T17:20:34.581 INFO:teuthology.orchestra.run.smithi037.stdout:session_autoclose 300 2024-04-25T17:20:34.581 INFO:teuthology.orchestra.run.smithi037.stdout:max_file_size 1099511627776 2024-04-25T17:20:34.581 INFO:teuthology.orchestra.run.smithi037.stdout:required_client_features {} 2024-04-25T17:20:34.581 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure 0 2024-04-25T17:20:34.581 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure_osd_epoch 0 2024-04-25T17:20:34.581 INFO:teuthology.orchestra.run.smithi037.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T17:20:34.581 INFO:teuthology.orchestra.run.smithi037.stdout:max_mds 1 2024-04-25T17:20:34.581 INFO:teuthology.orchestra.run.smithi037.stdout:in 0 2024-04-25T17:20:34.582 INFO:teuthology.orchestra.run.smithi037.stdout:up {0=14470} 2024-04-25T17:20:34.582 INFO:teuthology.orchestra.run.smithi037.stdout:failed 2024-04-25T17:20:34.582 INFO:teuthology.orchestra.run.smithi037.stdout:damaged 2024-04-25T17:20:34.582 INFO:teuthology.orchestra.run.smithi037.stdout:stopped 2024-04-25T17:20:34.582 INFO:teuthology.orchestra.run.smithi037.stdout:data_pools [3] 2024-04-25T17:20:34.582 INFO:teuthology.orchestra.run.smithi037.stdout:metadata_pool 2 2024-04-25T17:20:34.582 INFO:teuthology.orchestra.run.smithi037.stdout:inline_data disabled 2024-04-25T17:20:34.582 INFO:teuthology.orchestra.run.smithi037.stdout:balancer 2024-04-25T17:20:34.582 INFO:teuthology.orchestra.run.smithi037.stdout:standby_count_wanted 1 2024-04-25T17:20:34.582 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi037.ksmixc{0:14470} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.37:6826/1903989494,v1:172.21.15.37:6827/1903989494] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:20:34.582 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi037.ovkrpq{0:14482} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.37:6828/4206394422,v1:172.21.15.37:6829/4206394422] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:20:34.582 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:20:34.582 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:20:34.582 INFO:teuthology.orchestra.run.smithi037.stdout:Standby daemons: 2024-04-25T17:20:34.582 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:20:34.583 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi069.cpprst{-1:24289} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.69:6826/518856100,v1:172.21.15.69:6827/518856100] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:20:34.583 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi069.ytlqcf{-1:24293} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.69:6824/134210439,v1:172.21.15.69:6825/134210439] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:20:34.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.582+0000 7fb914b61700 1 -- 172.21.15.37:0/3974724250 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7fb8f80765a0 msgr2=0x7fb8f8078a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:20:34.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.582+0000 7fb914b61700 1 --2- 172.21.15.37:0/3974724250 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7fb8f80765a0 0x7fb8f8078a50 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb900009fd0 tx=0x7fb90000b040 comp rx=0 tx=0).stop 2024-04-25T17:20:34.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.582+0000 7fb914b61700 1 -- 172.21.15.37:0/3974724250 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb9100fdfd0 msgr2=0x7fb91010df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:20:34.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.582+0000 7fb914b61700 1 --2- 172.21.15.37:0/3974724250 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb9100fdfd0 0x7fb91010df10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb904008cd0 tx=0x7fb904009e30 comp rx=0 tx=0).stop 2024-04-25T17:20:34.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.582+0000 7fb914b61700 1 -- 172.21.15.37:0/3974724250 shutdown_connections 2024-04-25T17:20:34.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.582+0000 7fb914b61700 1 --2- 172.21.15.37:0/3974724250 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7fb8f80765a0 0x7fb8f8078a50 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:34.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.582+0000 7fb914b61700 1 --2- 172.21.15.37:0/3974724250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9100fce60 0x7fb91010d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:34.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.582+0000 7fb914b61700 1 --2- 172.21.15.37:0/3974724250 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb9100fdfd0 0x7fb91010df10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:34.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.582+0000 7fb914b61700 1 -- 172.21.15.37:0/3974724250 >> 172.21.15.37:0/3974724250 conn(0x7fb9100f8560 msgr2=0x7fb9100f9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:20:34.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.582+0000 7fb914b61700 1 -- 172.21.15.37:0/3974724250 shutdown_connections 2024-04-25T17:20:34.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.583+0000 7fb914b61700 1 -- 172.21.15.37:0/3974724250 wait complete. 2024-04-25T17:20:34.585 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 16 2024-04-25T17:20:34.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.704+0000 7f1b587af700 1 -- 172.21.15.37:0/3470031309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b500fcfa0 msgr2=0x7f1b500fd410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:20:34.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.704+0000 7f1b587af700 1 --2- 172.21.15.37:0/3470031309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b500fcfa0 0x7f1b500fd410 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f1b40004940 tx=0x7f1b40009e30 comp rx=0 tx=0).stop 2024-04-25T17:20:34.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.705+0000 7f1b587af700 1 -- 172.21.15.37:0/3470031309 shutdown_connections 2024-04-25T17:20:34.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.705+0000 7f1b587af700 1 --2- 172.21.15.37:0/3470031309 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b500fcfa0 0x7f1b500fd410 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:34.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.705+0000 7f1b587af700 1 --2- 172.21.15.37:0/3470031309 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1b500fbe30 0x7f1b500fc240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:34.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.705+0000 7f1b587af700 1 -- 172.21.15.37:0/3470031309 >> 172.21.15.37:0/3470031309 conn(0x7f1b500f7440 msgr2=0x7f1b500f9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:20:34.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.705+0000 7f1b587af700 1 -- 172.21.15.37:0/3470031309 shutdown_connections 2024-04-25T17:20:34.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.705+0000 7f1b587af700 1 -- 172.21.15.37:0/3470031309 wait complete. 2024-04-25T17:20:34.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.705+0000 7f1b587af700 1 Processor -- start 2024-04-25T17:20:34.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.705+0000 7f1b587af700 1 -- start start 2024-04-25T17:20:34.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.706+0000 7f1b587af700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b500fbe30 0x7f1b5010e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:20:34.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.706+0000 7f1b587af700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1b500fcfa0 0x7f1b50110980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:20:34.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.706+0000 7f1b587af700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b50066c20 con 0x7f1b500fbe30 2024-04-25T17:20:34.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.706+0000 7f1b587af700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b50066d60 con 0x7f1b500fcfa0 2024-04-25T17:20:34.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.706+0000 7f1b5654b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b500fbe30 0x7f1b5010e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:20:34.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.706+0000 7f1b55d4a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1b500fcfa0 0x7f1b50110980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:20:34.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.706+0000 7f1b5654b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b500fbe30 0x7f1b5010e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55720/0 (socket says 172.21.15.37:55720) 2024-04-25T17:20:34.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.706+0000 7f1b5654b700 1 -- 172.21.15.37:0/518352337 learned_addr learned my addr 172.21.15.37:0/518352337 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:20:34.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.706+0000 7f1b5654b700 1 -- 172.21.15.37:0/518352337 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1b500fcfa0 msgr2=0x7f1b50110980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:20:34.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.706+0000 7f1b5654b700 1 --2- 172.21.15.37:0/518352337 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1b500fcfa0 0x7f1b50110980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:34.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.706+0000 7f1b5654b700 1 -- 172.21.15.37:0/518352337 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b4c005040 con 0x7f1b500fbe30 2024-04-25T17:20:34.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.706+0000 7f1b5654b700 1 --2- 172.21.15.37:0/518352337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b500fbe30 0x7f1b5010e430 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c0096d0 tx=0x7f1b4c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:20:34.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.707+0000 7f1b46ffd700 1 -- 172.21.15.37:0/518352337 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b4c00e840 con 0x7f1b500fbe30 2024-04-25T17:20:34.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.707+0000 7f1b46ffd700 1 -- 172.21.15.37:0/518352337 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1b4c00f040 con 0x7f1b500fbe30 2024-04-25T17:20:34.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.707+0000 7f1b587af700 1 -- 172.21.15.37:0/518352337 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b40005040 con 0x7f1b500fbe30 2024-04-25T17:20:34.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.707+0000 7f1b46ffd700 1 -- 172.21.15.37:0/518352337 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b4c013dc0 con 0x7f1b500fbe30 2024-04-25T17:20:34.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.707+0000 7f1b587af700 1 -- 172.21.15.37:0/518352337 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b50111290 con 0x7f1b500fbe30 2024-04-25T17:20:34.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.708+0000 7f1b46ffd700 1 -- 172.21.15.37:0/518352337 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 31) v1 ==== 98485+0+0 (secure 0 0 0) 0x7f1b4c00e9a0 con 0x7f1b500fbe30 2024-04-25T17:20:34.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.709+0000 7f1b587af700 1 -- 172.21.15.37:0/518352337 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b5005f5c0 con 0x7f1b500fbe30 2024-04-25T17:20:34.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.709+0000 7f1b46ffd700 1 --2- 172.21.15.37:0/518352337 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7f1b3c0765a0 0x7f1b3c078a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:20:34.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.709+0000 7f1b46ffd700 1 -- 172.21.15.37:0/518352337 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f1b4c0979e0 con 0x7f1b500fbe30 2024-04-25T17:20:34.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.709+0000 7f1b55d4a700 1 --2- 172.21.15.37:0/518352337 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7f1b3c0765a0 0x7f1b3c078a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:20:34.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.710+0000 7f1b55d4a700 1 --2- 172.21.15.37:0/518352337 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7f1b3c0765a0 0x7f1b3c078a50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1b4000b0d0 tx=0x7f1b40009e30 comp rx=0 tx=0).ready entity=mgr.14766 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:20:34.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:34.715+0000 7f1b46ffd700 1 -- 172.21.15.37:0/518352337 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f1b4c060ba0 con 0x7f1b500fbe30 2024-04-25T17:20:35.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:35.088+0000 7f1b587af700 1 -- 172.21.15.37:0/518352337 --> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1b50101240 con 0x7f1b3c0765a0 2024-04-25T17:20:35.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:35.090+0000 7f1b46ffd700 1 -- 172.21.15.37:0/518352337 <== mgr.14766 v2:172.21.15.37:6800/709373822 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f1b50101240 con 0x7f1b3c0765a0 2024-04-25T17:20:35.092 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-25T17:20:35.092 INFO:teuthology.orchestra.run.smithi037.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385", 2024-04-25T17:20:35.092 INFO:teuthology.orchestra.run.smithi037.stdout: "in_progress": true, 2024-04-25T17:20:35.092 INFO:teuthology.orchestra.run.smithi037.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-25T17:20:35.092 INFO:teuthology.orchestra.run.smithi037.stdout: "services_complete": [ 2024-04-25T17:20:35.092 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr" 2024-04-25T17:20:35.092 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-04-25T17:20:35.092 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": "2/21 daemons upgraded", 2024-04-25T17:20:35.092 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "Currently upgrading mgr daemons", 2024-04-25T17:20:35.092 INFO:teuthology.orchestra.run.smithi037.stdout: "is_paused": false 2024-04-25T17:20:35.092 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-25T17:20:35.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:35.097+0000 7f1b587af700 1 -- 172.21.15.37:0/518352337 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7f1b3c0765a0 msgr2=0x7f1b3c078a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:20:35.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:35.097+0000 7f1b587af700 1 --2- 172.21.15.37:0/518352337 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7f1b3c0765a0 0x7f1b3c078a50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1b4000b0d0 tx=0x7f1b40009e30 comp rx=0 tx=0).stop 2024-04-25T17:20:35.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:35.097+0000 7f1b587af700 1 -- 172.21.15.37:0/518352337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b500fbe30 msgr2=0x7f1b5010e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:20:35.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:35.097+0000 7f1b587af700 1 --2- 172.21.15.37:0/518352337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b500fbe30 0x7f1b5010e430 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c0096d0 tx=0x7f1b4c009e30 comp rx=0 tx=0).stop 2024-04-25T17:20:35.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:35.098+0000 7f1b587af700 1 -- 172.21.15.37:0/518352337 shutdown_connections 2024-04-25T17:20:35.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:35.098+0000 7f1b587af700 1 --2- 172.21.15.37:0/518352337 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7f1b3c0765a0 0x7f1b3c078a50 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:35.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:35.098+0000 7f1b587af700 1 --2- 172.21.15.37:0/518352337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b500fbe30 0x7f1b5010e430 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:35.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:35.098+0000 7f1b587af700 1 --2- 172.21.15.37:0/518352337 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1b500fcfa0 0x7f1b50110980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:35.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:35.098+0000 7f1b587af700 1 -- 172.21.15.37:0/518352337 >> 172.21.15.37:0/518352337 conn(0x7f1b500f7440 msgr2=0x7f1b500f8a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:20:35.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:35.101+0000 7f1b587af700 1 -- 172.21.15.37:0/518352337 shutdown_connections 2024-04-25T17:20:35.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:35.102+0000 7f1b587af700 1 -- 172.21.15.37:0/518352337 wait complete. 2024-04-25T17:20:35.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:35.243+0000 7f987db49700 1 -- 172.21.15.37:0/2819469762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9878071de0 msgr2=0x7f98780702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:20:35.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:35.243+0000 7f987db49700 1 --2- 172.21.15.37:0/2819469762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9878071de0 0x7f98780702f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f9868009ce0 tx=0x7f9868004d10 comp rx=0 tx=0).stop 2024-04-25T17:20:35.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:35.243+0000 7f987db49700 1 -- 172.21.15.37:0/2819469762 shutdown_connections 2024-04-25T17:20:35.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:35.243+0000 7f987db49700 1 --2- 172.21.15.37:0/2819469762 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9878070830 0x7f9878070ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:35.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:35.243+0000 7f987db49700 1 --2- 172.21.15.37:0/2819469762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9878071de0 0x7f98780702f0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:35.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:35.243+0000 7f987db49700 1 -- 172.21.15.37:0/2819469762 >> 172.21.15.37:0/2819469762 conn(0x7f98780f85c0 msgr2=0x7f98780fa9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:20:35.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:35.243+0000 7f987db49700 1 -- 172.21.15.37:0/2819469762 shutdown_connections 2024-04-25T17:20:35.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:35.243+0000 7f987db49700 1 -- 172.21.15.37:0/2819469762 wait complete. 2024-04-25T17:20:35.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:35.243+0000 7f987db49700 1 Processor -- start 2024-04-25T17:20:35.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:35.244+0000 7f987db49700 1 -- start start 2024-04-25T17:20:35.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:35.244+0000 7f987db49700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9878070830 0x7f987810fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:20:35.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:35.244+0000 7f987db49700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9878071de0 0x7f98781102e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:20:35.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:35.244+0000 7f987db49700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9878111050 con 0x7f9878070830 2024-04-25T17:20:35.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:35.244+0000 7f987db49700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98781111c0 con 0x7f9878071de0 2024-04-25T17:20:35.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:35.244+0000 7f98777fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9878070830 0x7f987810fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:20:35.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:35.244+0000 7f98777fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9878070830 0x7f987810fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55726/0 (socket says 172.21.15.37:55726) 2024-04-25T17:20:35.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:35.244+0000 7f98777fe700 1 -- 172.21.15.37:0/3438301319 learned_addr learned my addr 172.21.15.37:0/3438301319 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:20:35.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:35.244+0000 7f9876ffd700 1 --2- 172.21.15.37:0/3438301319 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9878071de0 0x7f98781102e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:20:35.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:35.244+0000 7f98777fe700 1 -- 172.21.15.37:0/3438301319 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9878071de0 msgr2=0x7f98781102e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:20:35.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:35.244+0000 7f98777fe700 1 --2- 172.21.15.37:0/3438301319 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9878071de0 0x7f98781102e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:35.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:35.244+0000 7f98777fe700 1 -- 172.21.15.37:0/3438301319 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9868009940 con 0x7f9878070830 2024-04-25T17:20:35.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:35.245+0000 7f98777fe700 1 --2- 172.21.15.37:0/3438301319 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9878070830 0x7f987810fda0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f98680095d0 tx=0x7f9868004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:20:35.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:35.245+0000 7f986ffff700 1 -- 172.21.15.37:0/3438301319 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f986800e040 con 0x7f9878070830 2024-04-25T17:20:35.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:35.245+0000 7f987db49700 1 -- 172.21.15.37:0/3438301319 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98781113e0 con 0x7f9878070830 2024-04-25T17:20:35.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:35.245+0000 7f986ffff700 1 -- 172.21.15.37:0/3438301319 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9868008ea0 con 0x7f9878070830 2024-04-25T17:20:35.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:35.245+0000 7f986ffff700 1 -- 172.21.15.37:0/3438301319 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f986801c930 con 0x7f9878070830 2024-04-25T17:20:35.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:35.245+0000 7f987db49700 1 -- 172.21.15.37:0/3438301319 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98781119a0 con 0x7f9878070830 2024-04-25T17:20:35.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:35.246+0000 7f987db49700 1 -- 172.21.15.37:0/3438301319 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f987805f5c0 con 0x7f9878070830 2024-04-25T17:20:35.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:35.247+0000 7f986ffff700 1 -- 172.21.15.37:0/3438301319 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 31) v1 ==== 98485+0+0 (secure 0 0 0) 0x7f9868012d00 con 0x7f9878070830 2024-04-25T17:20:35.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:35.247+0000 7f986ffff700 1 --2- 172.21.15.37:0/3438301319 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7f98640765a0 0x7f9864078a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:20:35.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:35.247+0000 7f986ffff700 1 -- 172.21.15.37:0/3438301319 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7f9868099690 con 0x7f9878070830 2024-04-25T17:20:35.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:35.247+0000 7f9876ffd700 1 --2- 172.21.15.37:0/3438301319 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7f98640765a0 0x7f9864078a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:20:35.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:35.248+0000 7f9876ffd700 1 --2- 172.21.15.37:0/3438301319 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7f98640765a0 0x7f9864078a50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9860009fd0 tx=0x7f986000b040 comp rx=0 tx=0).ready entity=mgr.14766 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:20:35.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:35.252+0000 7f986ffff700 1 -- 172.21.15.37:0/3438301319 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+186652 (secure 0 0 0) 0x7f98680628d0 con 0x7f9878070830 2024-04-25T17:20:35.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:35.607+0000 7f987db49700 1 -- 172.21.15.37:0/3438301319 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f987804bed0 con 0x7f9878070830 2024-04-25T17:20:35.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:35.608+0000 7f986ffff700 1 -- 172.21.15.37:0/3438301319 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f9868004e10 con 0x7f9878070830 2024-04-25T17:20:35.610 INFO:teuthology.orchestra.run.smithi037.stdout:HEALTH_OK 2024-04-25T17:20:35.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:35.610+0000 7f987db49700 1 -- 172.21.15.37:0/3438301319 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7f98640765a0 msgr2=0x7f9864078a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:20:35.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:35.610+0000 7f987db49700 1 --2- 172.21.15.37:0/3438301319 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7f98640765a0 0x7f9864078a50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9860009fd0 tx=0x7f986000b040 comp rx=0 tx=0).stop 2024-04-25T17:20:35.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:35.610+0000 7f987db49700 1 -- 172.21.15.37:0/3438301319 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9878070830 msgr2=0x7f987810fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:20:35.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:35.610+0000 7f987db49700 1 --2- 172.21.15.37:0/3438301319 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9878070830 0x7f987810fda0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f98680095d0 tx=0x7f9868004d10 comp rx=0 tx=0).stop 2024-04-25T17:20:35.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:35.610+0000 7f987db49700 1 -- 172.21.15.37:0/3438301319 shutdown_connections 2024-04-25T17:20:35.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:35.610+0000 7f987db49700 1 --2- 172.21.15.37:0/3438301319 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7f98640765a0 0x7f9864078a50 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:35.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:35.610+0000 7f987db49700 1 --2- 172.21.15.37:0/3438301319 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9878070830 0x7f987810fda0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:35.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:35.610+0000 7f987db49700 1 --2- 172.21.15.37:0/3438301319 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9878071de0 0x7f98781102e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:20:35.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:35.610+0000 7f987db49700 1 -- 172.21.15.37:0/3438301319 >> 172.21.15.37:0/3438301319 conn(0x7f98780f85c0 msgr2=0x7f98780f9c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:20:35.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:35.610+0000 7f987db49700 1 -- 172.21.15.37:0/3438301319 shutdown_connections 2024-04-25T17:20:35.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:20:35.610+0000 7f987db49700 1 -- 172.21.15.37:0/3438301319 wait complete. 2024-04-25T17:20:35.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:35 smithi069 ceph-mon[34527]: pgmap v25: 65 pgs: 65 active+clean; 274 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 701 op/s 2024-04-25T17:20:35.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:35 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:20:35.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:35 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:20:35.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:35 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/3974724250' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T17:20:35.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:35 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:20:35.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:35 smithi037 ceph-mon[26472]: pgmap v25: 65 pgs: 65 active+clean; 274 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 701 op/s 2024-04-25T17:20:35.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:35 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:20:35.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:35 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:20:35.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:35 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/3974724250' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T17:20:35.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:35 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:20:36.510 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:36 smithi069 ceph-mon[34527]: from='client.14844 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:20:36.510 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:36 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/3438301319' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T17:20:36.510 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:36 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:20:36.510 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:36 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:20:36.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:36 smithi037 ceph-mon[26472]: from='client.14844 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:20:36.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:36 smithi037 ceph-mon[26472]: from='client.? 172.21.15.37:0/3438301319' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T17:20:36.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:36 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:20:36.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:36 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:20:37.548 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:37 smithi069 ceph-mon[34527]: pgmap v26: 65 pgs: 65 active+clean; 263 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 887 op/s 2024-04-25T17:20:37.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:37 smithi037 ceph-mon[26472]: pgmap v26: 65 pgs: 65 active+clean; 263 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 887 op/s 2024-04-25T17:20:39.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:39 smithi069 ceph-mon[34527]: pgmap v27: 65 pgs: 65 active+clean; 263 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 437 op/s 2024-04-25T17:20:39.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:39 smithi069 ceph-mon[34527]: Standby manager daemon smithi069.mmuhdo restarted 2024-04-25T17:20:39.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:39 smithi069 ceph-mon[34527]: Standby manager daemon smithi069.mmuhdo started 2024-04-25T17:20:39.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:39 smithi069 ceph-mon[34527]: from='mgr.? 172.21.15.69:0/3333308194' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi069.mmuhdo/crt"}]: dispatch 2024-04-25T17:20:39.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:39 smithi069 ceph-mon[34527]: from='mgr.? 172.21.15.69:0/3333308194' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T17:20:39.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:39 smithi069 ceph-mon[34527]: from='mgr.? 172.21.15.69:0/3333308194' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi069.mmuhdo/key"}]: dispatch 2024-04-25T17:20:39.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:39 smithi069 ceph-mon[34527]: from='mgr.? 172.21.15.69:0/3333308194' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T17:20:39.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:39 smithi037 ceph-mon[26472]: pgmap v27: 65 pgs: 65 active+clean; 263 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 437 op/s 2024-04-25T17:20:39.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:39 smithi037 ceph-mon[26472]: Standby manager daemon smithi069.mmuhdo restarted 2024-04-25T17:20:39.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:39 smithi037 ceph-mon[26472]: Standby manager daemon smithi069.mmuhdo started 2024-04-25T17:20:39.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:39 smithi037 ceph-mon[26472]: from='mgr.? 172.21.15.69:0/3333308194' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi069.mmuhdo/crt"}]: dispatch 2024-04-25T17:20:39.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:39 smithi037 ceph-mon[26472]: from='mgr.? 172.21.15.69:0/3333308194' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T17:20:39.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:39 smithi037 ceph-mon[26472]: from='mgr.? 172.21.15.69:0/3333308194' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi069.mmuhdo/key"}]: dispatch 2024-04-25T17:20:39.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:39 smithi037 ceph-mon[26472]: from='mgr.? 172.21.15.69:0/3333308194' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T17:20:40.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:40 smithi069 ceph-mon[34527]: mgrmap e32: smithi037.txrgxl(active, since 49s), standbys: smithi069.mmuhdo 2024-04-25T17:20:40.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:40 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:20:40.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:40 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:20:40.468 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:40 smithi037 ceph-mon[26472]: mgrmap e32: smithi037.txrgxl(active, since 49s), standbys: smithi069.mmuhdo 2024-04-25T17:20:40.468 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:40 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:20:40.468 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:40 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:20:41.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:41 smithi069 ceph-mon[34527]: pgmap v28: 65 pgs: 65 active+clean; 263 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 437 op/s 2024-04-25T17:20:41.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:41 smithi037 ceph-mon[26472]: pgmap v28: 65 pgs: 65 active+clean; 263 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 437 op/s 2024-04-25T17:20:43.461 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:43 smithi037 ceph-mon[26472]: pgmap v29: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 660 op/s 2024-04-25T17:20:43.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:43 smithi069 ceph-mon[34527]: pgmap v29: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 660 op/s 2024-04-25T17:20:45.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:45 smithi037 ceph-mon[26472]: pgmap v30: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 967 KiB/s rd, 987 KiB/s wr, 396 op/s 2024-04-25T17:20:45.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:45 smithi069 ceph-mon[34527]: pgmap v30: 65 pgs: 65 active+clean; 255 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 967 KiB/s rd, 987 KiB/s wr, 396 op/s 2024-04-25T17:20:47.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:47 smithi037 ceph-mon[26472]: pgmap v31: 65 pgs: 65 active+clean; 250 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 518 op/s 2024-04-25T17:20:47.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:47 smithi069 ceph-mon[34527]: pgmap v31: 65 pgs: 65 active+clean; 250 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 518 op/s 2024-04-25T17:20:49.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:49 smithi037 ceph-mon[26472]: pgmap v32: 65 pgs: 65 active+clean; 250 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 846 KiB/s rd, 902 KiB/s wr, 344 op/s 2024-04-25T17:20:49.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:49 smithi069 ceph-mon[34527]: pgmap v32: 65 pgs: 65 active+clean; 250 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 846 KiB/s rd, 902 KiB/s wr, 344 op/s 2024-04-25T17:20:50.526 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:50 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:20:50.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:50 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:20:51.569 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:51 smithi069 ceph-mon[34527]: pgmap v33: 65 pgs: 65 active+clean; 250 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 846 KiB/s rd, 902 KiB/s wr, 344 op/s 2024-04-25T17:20:51.569 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:51 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:20:51.569 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:51 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:20:51.569 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:51 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:20:51.569 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:51 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:20:51.569 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:51 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:20:51.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:51 smithi037 ceph-mon[26472]: pgmap v33: 65 pgs: 65 active+clean; 250 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 846 KiB/s rd, 902 KiB/s wr, 344 op/s 2024-04-25T17:20:51.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:51 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:20:51.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:51 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:20:51.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:51 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:20:51.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:51 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:20:51.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:51 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:20:52.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:52 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:20:52.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:52 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:20:52.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:52 smithi037 ceph-mon[26472]: Upgrade: Setting container_image for all mgr 2024-04-25T17:20:52.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:52 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:20:52.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:52 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi037.txrgxl"}]: dispatch 2024-04-25T17:20:52.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:52 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi037.txrgxl"}]': finished 2024-04-25T17:20:52.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:52 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi069.mmuhdo"}]: dispatch 2024-04-25T17:20:52.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:52 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi069.mmuhdo"}]': finished 2024-04-25T17:20:52.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:52 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-04-25T17:20:52.585 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:52 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:20:52.585 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:52 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:20:52.585 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:52 smithi069 ceph-mon[34527]: Upgrade: Setting container_image for all mgr 2024-04-25T17:20:52.585 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:52 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:20:52.585 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:52 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi037.txrgxl"}]: dispatch 2024-04-25T17:20:52.585 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:52 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi037.txrgxl"}]': finished 2024-04-25T17:20:52.585 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:52 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi069.mmuhdo"}]: dispatch 2024-04-25T17:20:52.585 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:52 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi069.mmuhdo"}]': finished 2024-04-25T17:20:52.585 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:52 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-04-25T17:20:53.621 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:53 smithi037 ceph-mon[26472]: pgmap v34: 65 pgs: 65 active+clean; 245 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 492 op/s 2024-04-25T17:20:53.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:53 smithi069 ceph-mon[34527]: pgmap v34: 65 pgs: 65 active+clean; 245 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 492 op/s 2024-04-25T17:20:54.725 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:54 smithi037 ceph-mon[26472]: Upgrade: Updating mon.smithi037 2024-04-25T17:20:54.725 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:54 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:20:54.725 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:54 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T17:20:54.726 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:54 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-25T17:20:54.726 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:54 smithi037 ceph-mon[26472]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:20:54.726 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:54 smithi037 ceph-mon[26472]: Deploying daemon mon.smithi037 on smithi037 2024-04-25T17:20:55.170 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:54 smithi069 ceph-mon[34527]: Upgrade: Updating mon.smithi037 2024-04-25T17:20:55.170 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:54 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' 2024-04-25T17:20:55.170 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:54 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T17:20:55.170 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:54 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-25T17:20:55.170 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:54 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:20:55.170 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:54 smithi069 ceph-mon[34527]: Deploying daemon mon.smithi037 on smithi037 2024-04-25T17:20:56.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:55 smithi037 ceph-mon[26472]: pgmap v35: 65 pgs: 65 active+clean; 245 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 886 KiB/s rd, 966 KiB/s wr, 270 op/s 2024-04-25T17:20:56.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:55 smithi069 ceph-mon[34527]: pgmap v35: 65 pgs: 65 active+clean; 245 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 886 KiB/s rd, 966 KiB/s wr, 270 op/s 2024-04-25T17:20:58.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:57 smithi037 ceph-mon[26472]: pgmap v36: 65 pgs: 65 active+clean; 243 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 410 op/s 2024-04-25T17:20:58.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:20:57 smithi069 ceph-mon[34527]: pgmap v36: 65 pgs: 65 active+clean; 243 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 410 op/s 2024-04-25T17:20:59.536 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:59 smithi037 systemd[1]: Stopping Ceph mon.smithi037 for 599bb7fc-0326-11ef-bc93-c7b262605968... 2024-04-25T17:20:59.801 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:59 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-mon-smithi037[26468]: 2024-04-25T17:20:59.546+0000 7f7735e00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi037 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T17:20:59.801 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:59 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-mon-smithi037[26468]: 2024-04-25T17:20:59.546+0000 7f7735e00700 -1 mon.smithi037@0(leader) e2 *** Got Signal Terminated *** 2024-04-25T17:20:59.801 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:20:59 smithi037 podman[90661]: 2024-04-25 17:20:59.59802495 +0000 UTC m=+0.196546260 container died 5cfadcf8f2e4441b97211566dfaebb19e2bd618f5b66cc2c3fa42383c3ba94f2 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-mon-smithi037, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=quincy-c61472c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-25T17:21:00.382 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:00 smithi037 podman[90661]: 2024-04-25 17:21:00.122278073 +0000 UTC m=+0.720799377 container cleanup 5cfadcf8f2e4441b97211566dfaebb19e2bd618f5b66cc2c3fa42383c3ba94f2 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-mon-smithi037, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=quincy-c61472c, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T17:21:00.385 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:00 smithi037 bash[90661]: ceph-599bb7fc-0326-11ef-bc93-c7b262605968-mon-smithi037 2024-04-25T17:21:00.693 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:00 smithi037 podman[90684]: 2024-04-25 17:21:00.382370349 +0000 UTC m=+0.785563117 container remove 5cfadcf8f2e4441b97211566dfaebb19e2bd618f5b66cc2c3fa42383c3ba94f2 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-mon-smithi037, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=quincy-c61472c, GIT_CLEAN=True) 2024-04-25T17:21:00.964 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:00 smithi037 systemd[1]: ceph-599bb7fc-0326-11ef-bc93-c7b262605968@mon.smithi037.service: Deactivated successfully. 2024-04-25T17:21:00.964 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:00 smithi037 systemd[1]: Stopped Ceph mon.smithi037 for 599bb7fc-0326-11ef-bc93-c7b262605968. 2024-04-25T17:21:00.964 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:00 smithi037 systemd[1]: ceph-599bb7fc-0326-11ef-bc93-c7b262605968@mon.smithi037.service: Consumed 13.020s CPU time. 2024-04-25T17:21:01.220 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:00 smithi037 systemd[1]: Starting Ceph mon.smithi037 for 599bb7fc-0326-11ef-bc93-c7b262605968... 2024-04-25T17:21:01.519 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 podman[90824]: 2024-04-25 17:21:01.124704003 +0000 UTC m=+0.026741174 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T17:21:01.520 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 podman[90824]: 2024-04-25 17:21:01.258584803 +0000 UTC m=+0.160621954 container create 1b349f3af69dda36ba71f13977d5f75b4527bb2df6293dc08ee4c57c48cb2d34 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-mon-smithi037, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS) 2024-04-25T17:21:01.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 podman[90824]: 2024-04-25 17:21:01.519941803 +0000 UTC m=+0.421978957 container init 1b349f3af69dda36ba71f13977d5f75b4527bb2df6293dc08ee4c57c48cb2d34 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-mon-smithi037, ceph=True, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-04-25T17:21:01.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 podman[90824]: 2024-04-25 17:21:01.524022336 +0000 UTC m=+0.426059495 container start 1b349f3af69dda36ba71f13977d5f75b4527bb2df6293dc08ee4c57c48cb2d34 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-mon-smithi037, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.vendor=CentOS) 2024-04-25T17:21:01.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: set uid:gid to 167:167 (ceph:ceph) 2024-04-25T17:21:01.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev), process ceph-mon, pid 2 2024-04-25T17:21:01.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: pidfile_write: ignore empty --pid-file 2024-04-25T17:21:01.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: load: jerasure load: lrc 2024-04-25T17:21:01.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: RocksDB version: 7.9.2 2024-04-25T17:21:01.823 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Git sha 0 2024-04-25T17:21:01.823 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Compile date 2024-04-25 02:57:34 2024-04-25T17:21:01.823 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: DB SUMMARY 2024-04-25T17:21:01.823 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: DB Session ID: D7SM797O04J1071DZCJI 2024-04-25T17:21:01.823 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: CURRENT file: CURRENT 2024-04-25T17:21:01.823 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: IDENTITY file: IDENTITY 2024-04-25T17:21:01.823 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1159 Bytes 2024-04-25T17:21:01.823 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi037/store.db dir, Total Num: 1, files: 000033.sst 2024-04-25T17:21:01.823 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi037/store.db: 000031.log size: 11493 ; 2024-04-25T17:21:01.823 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.error_if_exists: 0 2024-04-25T17:21:01.823 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.create_if_missing: 0 2024-04-25T17:21:01.823 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.paranoid_checks: 1 2024-04-25T17:21:01.824 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-25T17:21:01.824 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-25T17:21:01.824 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-25T17:21:01.824 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.env: 0x55ec1ac27500 2024-04-25T17:21:01.824 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.fs: PosixFileSystem 2024-04-25T17:21:01.824 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.info_log: 0x55ec1c927e80 2024-04-25T17:21:01.824 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.max_file_opening_threads: 16 2024-04-25T17:21:01.825 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.statistics: (nil) 2024-04-25T17:21:01.825 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.use_fsync: 0 2024-04-25T17:21:01.825 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.max_log_file_size: 0 2024-04-25T17:21:01.825 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-25T17:21:01.825 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-25T17:21:01.825 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.keep_log_file_num: 1000 2024-04-25T17:21:01.825 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.recycle_log_file_num: 0 2024-04-25T17:21:01.826 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.allow_fallocate: 1 2024-04-25T17:21:01.826 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.allow_mmap_reads: 0 2024-04-25T17:21:01.826 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.allow_mmap_writes: 0 2024-04-25T17:21:01.826 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.use_direct_reads: 0 2024-04-25T17:21:01.826 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-25T17:21:01.826 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.create_missing_column_families: 0 2024-04-25T17:21:01.826 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.db_log_dir: 2024-04-25T17:21:01.826 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.wal_dir: 2024-04-25T17:21:01.826 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-25T17:21:01.826 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-25T17:21:01.827 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-25T17:21:01.827 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-25T17:21:01.827 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-25T17:21:01.827 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-25T17:21:01.827 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.advise_random_on_open: 1 2024-04-25T17:21:01.827 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.db_write_buffer_size: 0 2024-04-25T17:21:01.827 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.write_buffer_manager: 0x55ec1c8f88c0 2024-04-25T17:21:01.827 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-25T17:21:01.827 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-25T17:21:01.827 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-25T17:21:01.827 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.rate_limiter: (nil) 2024-04-25T17:21:01.827 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-25T17:21:01.827 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.wal_recovery_mode: 2 2024-04-25T17:21:01.827 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.enable_thread_tracking: 0 2024-04-25T17:21:01.827 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.enable_pipelined_write: 0 2024-04-25T17:21:01.828 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.unordered_write: 0 2024-04-25T17:21:01.828 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-25T17:21:01.828 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-25T17:21:01.828 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-25T17:21:01.828 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-25T17:21:01.828 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.row_cache: None 2024-04-25T17:21:01.828 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.wal_filter: None 2024-04-25T17:21:01.828 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-25T17:21:01.828 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.allow_ingest_behind: 0 2024-04-25T17:21:01.828 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.two_write_queues: 0 2024-04-25T17:21:01.828 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.manual_wal_flush: 0 2024-04-25T17:21:01.828 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.wal_compression: 0 2024-04-25T17:21:01.828 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.atomic_flush: 0 2024-04-25T17:21:01.828 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-25T17:21:01.829 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-25T17:21:01.829 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-25T17:21:01.829 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.log_readahead_size: 0 2024-04-25T17:21:01.829 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-25T17:21:01.829 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.best_efforts_recovery: 0 2024-04-25T17:21:01.829 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-25T17:21:01.829 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-25T17:21:01.829 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.allow_data_in_errors: 0 2024-04-25T17:21:01.829 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.db_host_id: __hostname__ 2024-04-25T17:21:01.829 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-25T17:21:01.829 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.max_background_jobs: 2 2024-04-25T17:21:01.829 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.max_background_compactions: -1 2024-04-25T17:21:01.829 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.max_subcompactions: 1 2024-04-25T17:21:01.829 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-25T17:21:01.829 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-25T17:21:01.829 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-25T17:21:01.829 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.max_total_wal_size: 0 2024-04-25T17:21:01.830 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-25T17:21:01.830 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-25T17:21:01.830 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-25T17:21:01.830 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-25T17:21:01.830 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.max_open_files: -1 2024-04-25T17:21:01.830 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.bytes_per_sync: 0 2024-04-25T17:21:01.830 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-25T17:21:01.830 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-25T17:21:01.830 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.compaction_readahead_size: 0 2024-04-25T17:21:01.830 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.max_background_flushes: -1 2024-04-25T17:21:01.830 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Compression algorithms supported: 2024-04-25T17:21:01.830 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-25T17:21:01.830 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: kZSTD supported: 0 2024-04-25T17:21:01.830 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: kXpressCompression supported: 0 2024-04-25T17:21:01.830 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: kLZ4HCCompression supported: 1 2024-04-25T17:21:01.831 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: kZlibCompression supported: 1 2024-04-25T17:21:01.831 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: kSnappyCompression supported: 1 2024-04-25T17:21:01.831 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: kLZ4Compression supported: 1 2024-04-25T17:21:01.831 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: kBZip2Compression supported: 0 2024-04-25T17:21:01.831 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-25T17:21:01.831 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-25T17:21:01.831 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi037/store.db/MANIFEST-000015 2024-04-25T17:21:01.831 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-25T17:21:01.831 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-25T17:21:01.831 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.merge_operator: 2024-04-25T17:21:01.831 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.compaction_filter: None 2024-04-25T17:21:01.831 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.compaction_filter_factory: None 2024-04-25T17:21:01.831 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.sst_partitioner_factory: None 2024-04-25T17:21:01.831 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-25T17:21:01.832 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-25T17:21:01.832 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55ec1ca2e060) 2024-04-25T17:21:01.832 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: cache_index_and_filter_blocks: 1 2024-04-25T17:21:01.832 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-25T17:21:01.832 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-25T17:21:01.832 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: pin_top_level_index_and_filter: 1 2024-04-25T17:21:01.832 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: index_type: 0 2024-04-25T17:21:01.832 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: data_block_index_type: 0 2024-04-25T17:21:01.832 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: index_shortening: 1 2024-04-25T17:21:01.832 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-25T17:21:01.832 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: checksum: 4 2024-04-25T17:21:01.832 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: no_block_cache: 0 2024-04-25T17:21:01.832 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: block_cache: 0x55ec1c92b1f0 2024-04-25T17:21:01.832 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: block_cache_name: BinnedLRUCache 2024-04-25T17:21:01.832 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: block_cache_options: 2024-04-25T17:21:01.833 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: capacity : 536870912 2024-04-25T17:21:01.833 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: num_shard_bits : 4 2024-04-25T17:21:01.833 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: strict_capacity_limit : 0 2024-04-25T17:21:01.833 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: high_pri_pool_ratio: 0.000 2024-04-25T17:21:01.833 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: block_cache_compressed: (nil) 2024-04-25T17:21:01.833 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: persistent_cache: (nil) 2024-04-25T17:21:01.833 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: block_size: 4096 2024-04-25T17:21:01.833 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: block_size_deviation: 10 2024-04-25T17:21:01.833 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: block_restart_interval: 16 2024-04-25T17:21:01.833 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: index_block_restart_interval: 1 2024-04-25T17:21:01.833 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: metadata_block_size: 4096 2024-04-25T17:21:01.833 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: partition_filters: 0 2024-04-25T17:21:01.833 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: use_delta_encoding: 1 2024-04-25T17:21:01.833 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: filter_policy: bloomfilter 2024-04-25T17:21:01.834 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: whole_key_filtering: 1 2024-04-25T17:21:01.834 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: verify_compression: 0 2024-04-25T17:21:01.834 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: read_amp_bytes_per_bit: 0 2024-04-25T17:21:01.834 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: format_version: 5 2024-04-25T17:21:01.834 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: enable_index_compression: 1 2024-04-25T17:21:01.834 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: block_align: 0 2024-04-25T17:21:01.834 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: max_auto_readahead_size: 262144 2024-04-25T17:21:01.834 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: prepopulate_block_cache: 0 2024-04-25T17:21:01.834 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: initial_auto_readahead_size: 8192 2024-04-25T17:21:01.834 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: num_file_reads_for_auto_readahead: 2 2024-04-25T17:21:01.834 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.write_buffer_size: 33554432 2024-04-25T17:21:01.834 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.max_write_buffer_number: 2 2024-04-25T17:21:01.834 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.compression: NoCompression 2024-04-25T17:21:01.835 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.bottommost_compression: Disabled 2024-04-25T17:21:01.835 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.prefix_extractor: nullptr 2024-04-25T17:21:01.835 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-25T17:21:01.835 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.num_levels: 7 2024-04-25T17:21:01.835 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-25T17:21:01.835 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-25T17:21:01.835 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-25T17:21:01.835 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-25T17:21:01.835 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-25T17:21:01.835 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-25T17:21:01.835 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-25T17:21:01.835 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-25T17:21:01.835 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-25T17:21:01.835 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-25T17:21:01.835 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-25T17:21:01.836 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-25T17:21:01.836 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-25T17:21:01.836 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.compression_opts.level: 32767 2024-04-25T17:21:01.836 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.compression_opts.strategy: 0 2024-04-25T17:21:01.836 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-25T17:21:01.836 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-25T17:21:01.836 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-25T17:21:01.836 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-25T17:21:01.836 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.compression_opts.enabled: false 2024-04-25T17:21:01.836 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-25T17:21:01.836 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-25T17:21:01.836 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-25T17:21:01.836 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-25T17:21:01.837 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.target_file_size_base: 67108864 2024-04-25T17:21:01.837 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-25T17:21:01.837 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-25T17:21:01.837 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-25T17:21:01.837 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-25T17:21:01.837 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-25T17:21:01.838 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-25T17:21:01.838 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-25T17:21:01.838 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-25T17:21:01.838 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-25T17:21:01.838 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-25T17:21:01.838 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-25T17:21:01.838 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-25T17:21:01.838 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-25T17:21:01.839 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-25T17:21:01.839 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.arena_block_size: 1048576 2024-04-25T17:21:01.839 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-25T17:21:01.839 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-25T17:21:01.839 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.disable_auto_compactions: 0 2024-04-25T17:21:01.839 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-25T17:21:01.839 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-25T17:21:01.839 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-25T17:21:01.839 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-25T17:21:01.839 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-25T17:21:01.839 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-25T17:21:01.839 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-25T17:21:01.839 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-25T17:21:01.839 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-25T17:21:01.840 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-25T17:21:01.840 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-04-25T17:21:01.840 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.inplace_update_support: 0 2024-04-25T17:21:01.840 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-25T17:21:01.840 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-25T17:21:01.840 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-25T17:21:01.840 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-25T17:21:01.840 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.bloom_locality: 0 2024-04-25T17:21:01.840 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.max_successive_merges: 0 2024-04-25T17:21:01.840 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-25T17:21:01.840 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.paranoid_file_checks: 0 2024-04-25T17:21:01.840 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.force_consistency_checks: 1 2024-04-25T17:21:01.840 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.report_bg_io_stats: 0 2024-04-25T17:21:01.840 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.ttl: 2592000 2024-04-25T17:21:01.841 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-25T17:21:01.841 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-25T17:21:01.841 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-25T17:21:01.841 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.enable_blob_files: false 2024-04-25T17:21:01.841 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.min_blob_size: 0 2024-04-25T17:21:01.841 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.blob_file_size: 268435456 2024-04-25T17:21:01.841 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-25T17:21:01.841 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-25T17:21:01.841 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-25T17:21:01.841 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-25T17:21:01.841 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-25T17:21:01.841 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.blob_file_starting_level: 0 2024-04-25T17:21:01.841 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-25T17:21:01.842 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 33.sst 2024-04-25T17:21:01.842 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-04-25T17:21:01.842 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi037/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 35, last_sequence is 11936, log_number is 31,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-25T17:21:01.842 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 31 2024-04-25T17:21:01.842 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 97684591-619d-4f9a-8c31-238ec8e20352 2024-04-25T17:21:01.842 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714065661580388, "job": 1, "event": "recovery_started", "wal_files": [31]} 2024-04-25T17:21:01.842 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #31 mode 2 2024-04-25T17:21:01.842 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714065661581156, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 36, "file_size": 12572, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 11937, "largest_seqno": 11951, "table_properties": {"data_size": 11409, "index_size": 68, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 289, "raw_average_key_size": 24, "raw_value_size": 11079, "raw_average_value_size": 923, "num_data_blocks": 3, "num_entries": 12, "num_filter_entries": 12, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1714065661, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "97684591-619d-4f9a-8c31-238ec8e20352", "db_session_id": "D7SM797O04J1071DZCJI", "orig_file_number": 36, "seqno_to_time_mapping": "N/A"}} 2024-04-25T17:21:01.842 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714065661581269, "job": 1, "event": "recovery_finished"} 2024-04-25T17:21:01.842 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: [db/version_set.cc:5047] Creating manifest 38 2024-04-25T17:21:01.842 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-04-25T17:21:01.842 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi037/store.db/000031.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-25T17:21:01.843 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55ec1c90fc00 2024-04-25T17:21:01.843 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: DB pointer 0x55ec21702000 2024-04-25T17:21:01.843 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-25T17:21:01.843 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-25T17:21:01.843 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: ** DB Stats ** 2024-04-25T17:21:01.843 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-25T17:21:01.843 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-25T17:21:01.843 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-25T17:21:01.843 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-25T17:21:01.843 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-25T17:21:01.843 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-25T17:21:01.843 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-25T17:21:01.843 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: 2024-04-25T17:21:01.843 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: ** Compaction Stats [default] ** 2024-04-25T17:21:01.843 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-25T17:21:01.844 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-25T17:21:01.844 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: L0 1/0 12.28 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 21.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-25T17:21:01.844 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: L6 1/0 6.83 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-04-25T17:21:01.844 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Sum 2/0 6.85 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 21.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-25T17:21:01.844 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 21.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-25T17:21:01.844 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: 2024-04-25T17:21:01.844 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: ** Compaction Stats [default] ** 2024-04-25T17:21:01.844 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-25T17:21:01.844 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-25T17:21:01.844 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 21.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-04-25T17:21:01.844 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: 2024-04-25T17:21:01.844 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-25T17:21:01.844 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: 2024-04-25T17:21:01.844 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-25T17:21:01.844 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-04-25T17:21:01.844 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-25T17:21:01.845 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-25T17:21:01.845 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-25T17:21:01.845 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-25T17:21:01.845 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Cumulative compaction: 0.00 GB write, 3.29 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-25T17:21:01.845 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Interval compaction: 0.00 GB write, 3.29 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-25T17:21:01.845 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-25T17:21:01.845 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Block cache BinnedLRUCache@0x55ec1c92b1f0#2 capacity: 512.00 MB usage: 0.27 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-04-25T17:21:01.845 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.12 KB,2.23517e-05%) IndexBlock(1,0.16 KB,2.98023e-05%) Misc(1,0.00 KB,0%) 2024-04-25T17:21:01.845 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: 2024-04-25T17:21:01.845 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-25T17:21:01.845 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: starting mon.smithi037 rank 0 at public addrs [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] at bind addrs [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi037 fsid 599bb7fc-0326-11ef-bc93-c7b262605968 2024-04-25T17:21:01.845 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: mon.smithi037@-1(???) e2 preinit fsid 599bb7fc-0326-11ef-bc93-c7b262605968 2024-04-25T17:21:01.845 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: mon.smithi037@-1(???).mds e16 new map 2024-04-25T17:21:01.845 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: mon.smithi037@-1(???).mds e16 print_map 2024-04-25T17:21:01.845 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: e16 2024-04-25T17:21:01.846 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-25T17:21:01.846 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T17:21:01.846 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: legacy client fscid: 1 2024-04-25T17:21:01.846 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: 2024-04-25T17:21:01.846 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Filesystem 'cephfs' (1) 2024-04-25T17:21:01.846 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: fs_name cephfs 2024-04-25T17:21:01.846 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: epoch 16 2024-04-25T17:21:01.846 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-25T17:21:01.846 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: created 2024-04-25T17:15:40.586130+0000 2024-04-25T17:21:01.846 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: modified 2024-04-25T17:15:57.508740+0000 2024-04-25T17:21:01.846 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: tableserver 0 2024-04-25T17:21:01.846 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: root 0 2024-04-25T17:21:01.846 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: session_timeout 60 2024-04-25T17:21:01.846 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: session_autoclose 300 2024-04-25T17:21:01.846 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: max_file_size 1099511627776 2024-04-25T17:21:01.847 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: max_xattr_size 65536 2024-04-25T17:21:01.847 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: required_client_features {} 2024-04-25T17:21:01.847 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: last_failure 0 2024-04-25T17:21:01.847 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: last_failure_osd_epoch 0 2024-04-25T17:21:01.847 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T17:21:01.847 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: max_mds 1 2024-04-25T17:21:01.847 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: in 0 2024-04-25T17:21:01.847 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: up {0=14470} 2024-04-25T17:21:01.847 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: failed 2024-04-25T17:21:01.847 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: damaged 2024-04-25T17:21:01.847 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: stopped 2024-04-25T17:21:01.847 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: data_pools [3] 2024-04-25T17:21:01.847 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: metadata_pool 2 2024-04-25T17:21:01.847 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: inline_data disabled 2024-04-25T17:21:01.848 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: balancer 2024-04-25T17:21:01.848 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: bal_rank_mask -1 2024-04-25T17:21:01.848 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: standby_count_wanted 1 2024-04-25T17:21:01.848 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: qdb_cluster leader: 0 members: 2024-04-25T17:21:01.848 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: [mds.cephfs.smithi037.ksmixc{0:14470} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.37:6826/1903989494,v1:172.21.15.37:6827/1903989494] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:21:01.848 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: [mds.cephfs.smithi037.ovkrpq{0:14482} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.37:6828/4206394422,v1:172.21.15.37:6829/4206394422] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:21:01.848 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: 2024-04-25T17:21:01.848 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: 2024-04-25T17:21:01.848 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: Standby daemons: 2024-04-25T17:21:01.848 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: 2024-04-25T17:21:01.848 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: [mds.cephfs.smithi069.cpprst{-1:24289} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.69:6826/518856100,v1:172.21.15.69:6827/518856100] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:21:01.848 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout: [mds.cephfs.smithi069.ytlqcf{-1:24293} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.69:6824/134210439,v1:172.21.15.69:6825/134210439] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:21:01.848 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: mon.smithi037@-1(???).osd e48 crush map has features 3314933000852226048, adjusting msgr requires 2024-04-25T17:21:01.848 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: mon.smithi037@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-04-25T17:21:01.849 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: mon.smithi037@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-04-25T17:21:01.849 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: mon.smithi037@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-04-25T17:21:01.849 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 ceph-mon[90844]: mon.smithi037@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2024-04-25T17:21:01.849 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 bash[90824]: 1b349f3af69dda36ba71f13977d5f75b4527bb2df6293dc08ee4c57c48cb2d34 2024-04-25T17:21:01.849 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:01 smithi037 systemd[1]: Started Ceph mon.smithi037 for 599bb7fc-0326-11ef-bc93-c7b262605968. 2024-04-25T17:21:03.302 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:03 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mon metadata", "id": "smithi037"}]: dispatch 2024-04-25T17:21:03.303 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:03 smithi069 ceph-mon[34527]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mon metadata", "id": "smithi069"}]: dispatch 2024-04-25T17:21:03.303 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:03 smithi069 ceph-mon[34527]: pgmap v38: 65 pgs: 65 active+clean; 243 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1007 KiB/s rd, 1.0 MiB/s wr, 288 op/s 2024-04-25T17:21:03.303 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:03 smithi069 ceph-mon[34527]: pgmap v39: 65 pgs: 65 active+clean; 235 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 436 op/s 2024-04-25T17:21:03.303 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:03 smithi069 ceph-mon[34527]: mon.smithi037 calling monitor election 2024-04-25T17:21:03.303 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:03 smithi069 ceph-mon[34527]: mon.smithi037 is new leader, mons smithi037,smithi069 in quorum (ranks 0,1) 2024-04-25T17:21:03.303 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:03 smithi069 ceph-mon[34527]: monmap epoch 2 2024-04-25T17:21:03.303 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:03 smithi069 ceph-mon[34527]: fsid 599bb7fc-0326-11ef-bc93-c7b262605968 2024-04-25T17:21:03.303 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:03 smithi069 ceph-mon[34527]: last_changed 2024-04-25T17:11:22.135482+0000 2024-04-25T17:21:03.303 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:03 smithi069 ceph-mon[34527]: created 2024-04-25T17:08:34.994230+0000 2024-04-25T17:21:03.303 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:03 smithi069 ceph-mon[34527]: min_mon_release 17 (quincy) 2024-04-25T17:21:03.303 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:03 smithi069 ceph-mon[34527]: election_strategy: 1 2024-04-25T17:21:03.303 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:03 smithi069 ceph-mon[34527]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.smithi037 2024-04-25T17:21:03.303 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:03 smithi069 ceph-mon[34527]: 1: [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] mon.smithi069 2024-04-25T17:21:03.304 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:03 smithi069 ceph-mon[34527]: fsmap cephfs:1 {0=cephfs.smithi037.ksmixc=up:active} 1 up:standby-replay 2 up:standby 2024-04-25T17:21:03.304 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:03 smithi069 ceph-mon[34527]: osdmap e48: 6 total, 6 up, 6 in 2024-04-25T17:21:03.304 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:03 smithi069 ceph-mon[34527]: mgrmap e32: smithi037.txrgxl(active, since 73s), standbys: smithi069.mmuhdo 2024-04-25T17:21:03.304 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:03 smithi069 ceph-mon[34527]: overall HEALTH_OK 2024-04-25T17:21:03.304 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:03 smithi069 ceph-mon[34527]: mgrmap e33: smithi037.txrgxl(active, since 73s), standbys: smithi069.mmuhdo 2024-04-25T17:21:03.304 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:03 smithi069 ceph-mon[34527]: from='mgr.14766 ' entity='' 2024-04-25T17:21:03.305 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:03 smithi037 ceph-mon[90844]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mon metadata", "id": "smithi037"}]: dispatch 2024-04-25T17:21:03.305 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:03 smithi037 ceph-mon[90844]: from='mgr.14766 172.21.15.37:0/815432735' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mon metadata", "id": "smithi069"}]: dispatch 2024-04-25T17:21:03.305 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:03 smithi037 ceph-mon[90844]: pgmap v38: 65 pgs: 65 active+clean; 243 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1007 KiB/s rd, 1.0 MiB/s wr, 288 op/s 2024-04-25T17:21:03.305 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:03 smithi037 ceph-mon[90844]: pgmap v39: 65 pgs: 65 active+clean; 235 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 436 op/s 2024-04-25T17:21:03.305 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:03 smithi037 ceph-mon[90844]: mon.smithi037 calling monitor election 2024-04-25T17:21:03.306 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:03 smithi037 ceph-mon[90844]: mon.smithi037 is new leader, mons smithi037,smithi069 in quorum (ranks 0,1) 2024-04-25T17:21:03.306 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:03 smithi037 ceph-mon[90844]: monmap epoch 2 2024-04-25T17:21:03.306 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:03 smithi037 ceph-mon[90844]: fsid 599bb7fc-0326-11ef-bc93-c7b262605968 2024-04-25T17:21:03.306 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:03 smithi037 ceph-mon[90844]: last_changed 2024-04-25T17:11:22.135482+0000 2024-04-25T17:21:03.306 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:03 smithi037 ceph-mon[90844]: created 2024-04-25T17:08:34.994230+0000 2024-04-25T17:21:03.306 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:03 smithi037 ceph-mon[90844]: min_mon_release 17 (quincy) 2024-04-25T17:21:03.306 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:03 smithi037 ceph-mon[90844]: election_strategy: 1 2024-04-25T17:21:03.306 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:03 smithi037 ceph-mon[90844]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.smithi037 2024-04-25T17:21:03.306 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:03 smithi037 ceph-mon[90844]: 1: [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] mon.smithi069 2024-04-25T17:21:03.306 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:03 smithi037 ceph-mon[90844]: fsmap cephfs:1 {0=cephfs.smithi037.ksmixc=up:active} 1 up:standby-replay 2 up:standby 2024-04-25T17:21:03.306 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:03 smithi037 ceph-mon[90844]: osdmap e48: 6 total, 6 up, 6 in 2024-04-25T17:21:03.306 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:03 smithi037 ceph-mon[90844]: mgrmap e32: smithi037.txrgxl(active, since 73s), standbys: smithi069.mmuhdo 2024-04-25T17:21:03.306 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:03 smithi037 ceph-mon[90844]: overall HEALTH_OK 2024-04-25T17:21:03.306 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:03 smithi037 ceph-mon[90844]: mgrmap e33: smithi037.txrgxl(active, since 73s), standbys: smithi069.mmuhdo 2024-04-25T17:21:03.306 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:03 smithi037 ceph-mon[90844]: from='mgr.14766 ' entity='' 2024-04-25T17:21:05.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:05.775+0000 7fe9d06af700 1 -- 172.21.15.37:0/1651461032 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9c80fff70 msgr2=0x7fe9c8102350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:21:05.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:05.775+0000 7fe9d06af700 1 --2- 172.21.15.37:0/1651461032 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9c80fff70 0x7fe9c8102350 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe9b8004940 tx=0x7fe9b8009e30 comp rx=0 tx=0).stop 2024-04-25T17:21:05.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:05.776+0000 7fe9d06af700 1 -- 172.21.15.37:0/1651461032 shutdown_connections 2024-04-25T17:21:05.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:05.776+0000 7fe9d06af700 1 --2- 172.21.15.37:0/1651461032 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9c80fff70 0x7fe9c8102350 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:05.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:05.776+0000 7fe9d06af700 1 --2- 172.21.15.37:0/1651461032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9c8066af0 0x7fe9c80ffa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:05.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:05.776+0000 7fe9d06af700 1 -- 172.21.15.37:0/1651461032 >> 172.21.15.37:0/1651461032 conn(0x7fe9c80f7440 msgr2=0x7fe9c80f9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:21:05.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:05.776+0000 7fe9d06af700 1 -- 172.21.15.37:0/1651461032 shutdown_connections 2024-04-25T17:21:05.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:05.776+0000 7fe9d06af700 1 -- 172.21.15.37:0/1651461032 wait complete. 2024-04-25T17:21:05.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:05.776+0000 7fe9d06af700 1 Processor -- start 2024-04-25T17:21:05.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:05.777+0000 7fe9d06af700 1 -- start start 2024-04-25T17:21:05.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:05.777+0000 7fe9d06af700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9c8066af0 0x7fe9c80fd410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:21:05.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:05.777+0000 7fe9d06af700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9c80fff70 0x7fe9c80fb930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:21:05.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:05.777+0000 7fe9d06af700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c80fbec0 con 0x7fe9c80fff70 2024-04-25T17:21:05.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:05.777+0000 7fe9d06af700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9c80fc000 con 0x7fe9c8066af0 2024-04-25T17:21:05.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:05.777+0000 7fe9ce44b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9c8066af0 0x7fe9c80fd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:21:05.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:05.777+0000 7fe9cdc4a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9c80fff70 0x7fe9c80fb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:21:05.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:05.777+0000 7fe9ce44b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9c8066af0 0x7fe9c80fd410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.37:49304/0 (socket says 172.21.15.37:49304) 2024-04-25T17:21:05.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:05.777+0000 7fe9ce44b700 1 -- 172.21.15.37:0/3957430644 learned_addr learned my addr 172.21.15.37:0/3957430644 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:21:05.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:05.777+0000 7fe9ce44b700 1 -- 172.21.15.37:0/3957430644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9c80fff70 msgr2=0x7fe9c80fb930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:21:05.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:05.777+0000 7fe9ce44b700 1 --2- 172.21.15.37:0/3957430644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9c80fff70 0x7fe9c80fb930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:05.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:05.777+0000 7fe9ce44b700 1 -- 172.21.15.37:0/3957430644 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9b8005040 con 0x7fe9c8066af0 2024-04-25T17:21:05.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:05.778+0000 7fe9ce44b700 1 --2- 172.21.15.37:0/3957430644 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9c8066af0 0x7fe9c80fd410 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe9c400eb70 tx=0x7fe9c400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:21:05.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:05.778+0000 7fe9beffd700 1 -- 172.21.15.37:0/3957430644 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9c4007cc0 con 0x7fe9c8066af0 2024-04-25T17:21:05.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:05.778+0000 7fe9beffd700 1 -- 172.21.15.37:0/3957430644 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe9c400f040 con 0x7fe9c8066af0 2024-04-25T17:21:05.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:05.778+0000 7fe9beffd700 1 -- 172.21.15.37:0/3957430644 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9c400cb20 con 0x7fe9c8066af0 2024-04-25T17:21:05.780 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:05.778+0000 7fe9d06af700 1 -- 172.21.15.37:0/3957430644 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9c80fc280 con 0x7fe9c8066af0 2024-04-25T17:21:05.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:05.778+0000 7fe9d06af700 1 -- 172.21.15.37:0/3957430644 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9c81159f0 con 0x7fe9c8066af0 2024-04-25T17:21:05.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:05.780+0000 7fe9d06af700 1 -- 172.21.15.37:0/3957430644 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9ac0052e0 con 0x7fe9c8066af0 2024-04-25T17:21:05.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:05.781+0000 7fe9beffd700 1 -- 172.21.15.37:0/3957430644 <== mon.1 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 33) v1 ==== 98763+0+0 (secure 0 0 0) 0x7fe9c40097c0 con 0x7fe9c8066af0 2024-04-25T17:21:05.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:05.781+0000 7fe9beffd700 1 --2- 172.21.15.37:0/3957430644 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7fe9b4076d70 0x7fe9b4079220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:21:05.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:05.781+0000 7fe9beffd700 1 -- 172.21.15.37:0/3957430644 <== mon.1 v2:172.21.15.69:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5980+0+0 (secure 0 0 0) 0x7fe9c4097d90 con 0x7fe9c8066af0 2024-04-25T17:21:05.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:05.781+0000 7fe9cdc4a700 1 -- 172.21.15.37:0/3957430644 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7fe9b4076d70 msgr2=0x7fe9b4079220 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.37:6800/709373822 2024-04-25T17:21:05.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:05.782+0000 7fe9cdc4a700 1 --2- 172.21.15.37:0/3957430644 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7fe9b4076d70 0x7fe9b4079220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T17:21:05.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:05.790+0000 7fe9beffd700 1 -- 172.21.15.37:0/3957430644 <== mon.1 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fe9c40608e0 con 0x7fe9c8066af0 2024-04-25T17:21:05.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:05.983+0000 7fe9cdc4a700 1 -- 172.21.15.37:0/3957430644 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7fe9b4076d70 msgr2=0x7fe9b4079220 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.37:6800/709373822 2024-04-25T17:21:05.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:05.983+0000 7fe9cdc4a700 1 --2- 172.21.15.37:0/3957430644 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7fe9b4076d70 0x7fe9b4079220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T17:21:06.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:06.067+0000 7fe9d06af700 1 -- 172.21.15.37:0/3957430644 --> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe9ac000bf0 con 0x7fe9b4076d70 2024-04-25T17:21:06.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:06.384+0000 7fe9cdc4a700 1 -- 172.21.15.37:0/3957430644 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7fe9b4076d70 msgr2=0x7fe9b4079220 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.37:6800/709373822 2024-04-25T17:21:06.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:06.384+0000 7fe9cdc4a700 1 --2- 172.21.15.37:0/3957430644 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7fe9b4076d70 0x7fe9b4079220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T17:21:07.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:07.185+0000 7fe9cdc4a700 1 -- 172.21.15.37:0/3957430644 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7fe9b4076d70 msgr2=0x7fe9b4079220 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.37:6800/709373822 2024-04-25T17:21:07.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:07.185+0000 7fe9cdc4a700 1 --2- 172.21.15.37:0/3957430644 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7fe9b4076d70 0x7fe9b4079220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T17:21:08.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:08.786+0000 7fe9cdc4a700 1 -- 172.21.15.37:0/3957430644 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7fe9b4076d70 msgr2=0x7fe9b4079220 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.37:6800/709373822 2024-04-25T17:21:08.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:08.786+0000 7fe9cdc4a700 1 --2- 172.21.15.37:0/3957430644 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7fe9b4076d70 0x7fe9b4079220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-04-25T17:21:10.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:10.935+0000 7fe9beffd700 1 -- 172.21.15.37:0/3957430644 <== mon.1 v2:172.21.15.69:3300/0 7 ==== mgrmap(e 34) v1 ==== 98763+0+0 (secure 0 0 0) 0x7fe9c409e080 con 0x7fe9c8066af0 2024-04-25T17:21:11.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:10 smithi069 ceph-mon[34527]: Standby manager daemon smithi069.mmuhdo restarted 2024-04-25T17:21:11.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:10 smithi069 ceph-mon[34527]: Standby manager daemon smithi069.mmuhdo started 2024-04-25T17:21:11.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:10 smithi069 ceph-mon[34527]: from='mgr.? 172.21.15.69:0/3091324904' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi069.mmuhdo/crt"}]: dispatch 2024-04-25T17:21:11.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:10 smithi069 ceph-mon[34527]: from='mgr.? 172.21.15.69:0/3091324904' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T17:21:11.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:10 smithi069 ceph-mon[34527]: from='mgr.? 172.21.15.69:0/3091324904' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi069.mmuhdo/key"}]: dispatch 2024-04-25T17:21:11.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:10 smithi069 ceph-mon[34527]: from='mgr.? 172.21.15.69:0/3091324904' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T17:21:11.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:10 smithi037 ceph-mon[90844]: Standby manager daemon smithi069.mmuhdo restarted 2024-04-25T17:21:11.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:10 smithi037 ceph-mon[90844]: Standby manager daemon smithi069.mmuhdo started 2024-04-25T17:21:11.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:10 smithi037 ceph-mon[90844]: from='mgr.? 172.21.15.69:0/3091324904' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi069.mmuhdo/crt"}]: dispatch 2024-04-25T17:21:11.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:10 smithi037 ceph-mon[90844]: from='mgr.? 172.21.15.69:0/3091324904' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-04-25T17:21:11.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:10 smithi037 ceph-mon[90844]: from='mgr.? 172.21.15.69:0/3091324904' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi069.mmuhdo/key"}]: dispatch 2024-04-25T17:21:11.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:10 smithi037 ceph-mon[90844]: from='mgr.? 172.21.15.69:0/3091324904' entity='mgr.smithi069.mmuhdo' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-04-25T17:21:11.333 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-04-25T17:21:11.333 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-04-25T17:21:11.699 DEBUG:teuthology.parallel:result is None 2024-04-25T17:21:11.948 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-04-25T17:21:11.948 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-25T17:21:11.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:11.989+0000 7fe9cdc4a700 1 -- 172.21.15.37:0/3957430644 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7fe9b4076d70 msgr2=0x7fe9b4079220 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.37:6800/709373822 2024-04-25T17:21:11.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:11.989+0000 7fe9cdc4a700 1 --2- 172.21.15.37:0/3957430644 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7fe9b4076d70 0x7fe9b4079220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-04-25T17:21:12.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:11 smithi069 ceph-mon[34527]: mgrmap e34: smithi037.txrgxl(active, since 81s), standbys: smithi069.mmuhdo 2024-04-25T17:21:12.200 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:11 smithi037 ceph-mon[90844]: mgrmap e34: smithi037.txrgxl(active, since 81s), standbys: smithi069.mmuhdo 2024-04-25T17:21:12.278 DEBUG:teuthology.parallel:result is None 2024-04-25T17:21:12.279 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-25T17:21:12.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:12.470+0000 7fe9beffd700 1 -- 172.21.15.37:0/3957430644 <== mon.1 v2:172.21.15.69:3300/0 8 ==== mgrmap(e 35) v1 ==== 98286+0+0 (secure 0 0 0) 0x7fe9c405cda0 con 0x7fe9c8066af0 2024-04-25T17:21:12.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:12.470+0000 7fe9beffd700 1 -- 172.21.15.37:0/3957430644 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7fe9b4076d70 msgr2=0x7fe9b4079220 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T17:21:12.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:12.470+0000 7fe9beffd700 1 --2- 172.21.15.37:0/3957430644 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7fe9b4076d70 0x7fe9b4079220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:12.574 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-25T17:21:12.574 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-04-25T17:21:12.618 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-04-25T17:21:12.618 DEBUG:teuthology.parallel:result is None 2024-04-25T17:21:13.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:12 smithi037 ceph-mon[90844]: Active manager daemon smithi037.txrgxl restarted 2024-04-25T17:21:13.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:12 smithi037 ceph-mon[90844]: Activating manager daemon smithi037.txrgxl 2024-04-25T17:21:13.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:12 smithi037 ceph-mon[90844]: osdmap e49: 6 total, 6 up, 6 in 2024-04-25T17:21:13.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:12 smithi037 ceph-mon[90844]: mgrmap e35: smithi037.txrgxl(active, starting, since 0.00672767s), standbys: smithi069.mmuhdo 2024-04-25T17:21:13.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:12 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mon metadata", "id": "smithi037"}]: dispatch 2024-04-25T17:21:13.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:12 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mon metadata", "id": "smithi069"}]: dispatch 2024-04-25T17:21:13.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:12 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi037.ksmixc"}]: dispatch 2024-04-25T17:21:13.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:12 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi037.ovkrpq"}]: dispatch 2024-04-25T17:21:13.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:12 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi069.cpprst"}]: dispatch 2024-04-25T17:21:13.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:12 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi069.ytlqcf"}]: dispatch 2024-04-25T17:21:13.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:12 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mgr metadata", "who": "smithi037.txrgxl", "id": "smithi037.txrgxl"}]: dispatch 2024-04-25T17:21:13.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:12 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mgr metadata", "who": "smithi069.mmuhdo", "id": "smithi069.mmuhdo"}]: dispatch 2024-04-25T17:21:13.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:12 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T17:21:13.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:12 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T17:21:13.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:12 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T17:21:13.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:12 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T17:21:13.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:12 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T17:21:13.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:12 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T17:21:13.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:12 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-25T17:21:13.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:12 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-25T17:21:13.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:12 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-25T17:21:13.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:12 smithi037 ceph-mon[90844]: Manager daemon smithi037.txrgxl is now available 2024-04-25T17:21:13.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:12 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:21:13.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:12 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:21:13.074 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:12 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi037.txrgxl/mirror_snapshot_schedule"}]: dispatch 2024-04-25T17:21:13.074 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:12 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi037.txrgxl/trash_purge_schedule"}]: dispatch 2024-04-25T17:21:13.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:12 smithi069 ceph-mon[34527]: Active manager daemon smithi037.txrgxl restarted 2024-04-25T17:21:13.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:12 smithi069 ceph-mon[34527]: Activating manager daemon smithi037.txrgxl 2024-04-25T17:21:13.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:12 smithi069 ceph-mon[34527]: osdmap e49: 6 total, 6 up, 6 in 2024-04-25T17:21:13.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:12 smithi069 ceph-mon[34527]: mgrmap e35: smithi037.txrgxl(active, starting, since 0.00672767s), standbys: smithi069.mmuhdo 2024-04-25T17:21:13.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:12 smithi069 ceph-mon[34527]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mon metadata", "id": "smithi037"}]: dispatch 2024-04-25T17:21:13.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:12 smithi069 ceph-mon[34527]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mon metadata", "id": "smithi069"}]: dispatch 2024-04-25T17:21:13.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:12 smithi069 ceph-mon[34527]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi037.ksmixc"}]: dispatch 2024-04-25T17:21:13.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:12 smithi069 ceph-mon[34527]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi037.ovkrpq"}]: dispatch 2024-04-25T17:21:13.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:12 smithi069 ceph-mon[34527]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi069.cpprst"}]: dispatch 2024-04-25T17:21:13.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:12 smithi069 ceph-mon[34527]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi069.ytlqcf"}]: dispatch 2024-04-25T17:21:13.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:12 smithi069 ceph-mon[34527]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mgr metadata", "who": "smithi037.txrgxl", "id": "smithi037.txrgxl"}]: dispatch 2024-04-25T17:21:13.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:12 smithi069 ceph-mon[34527]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mgr metadata", "who": "smithi069.mmuhdo", "id": "smithi069.mmuhdo"}]: dispatch 2024-04-25T17:21:13.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:12 smithi069 ceph-mon[34527]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T17:21:13.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:12 smithi069 ceph-mon[34527]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T17:21:13.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:12 smithi069 ceph-mon[34527]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T17:21:13.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:12 smithi069 ceph-mon[34527]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T17:21:13.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:12 smithi069 ceph-mon[34527]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T17:21:13.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:12 smithi069 ceph-mon[34527]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T17:21:13.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:12 smithi069 ceph-mon[34527]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-04-25T17:21:13.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:12 smithi069 ceph-mon[34527]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-04-25T17:21:13.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:12 smithi069 ceph-mon[34527]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-04-25T17:21:13.421 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:12 smithi069 ceph-mon[34527]: Manager daemon smithi037.txrgxl is now available 2024-04-25T17:21:13.421 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:12 smithi069 ceph-mon[34527]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:21:13.421 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:12 smithi069 ceph-mon[34527]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:21:13.421 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:12 smithi069 ceph-mon[34527]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi037.txrgxl/mirror_snapshot_schedule"}]: dispatch 2024-04-25T17:21:13.421 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:12 smithi069 ceph-mon[34527]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi037.txrgxl/trash_purge_schedule"}]: dispatch 2024-04-25T17:21:13.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.479+0000 7fe9beffd700 1 -- 172.21.15.37:0/3957430644 <== mon.1 v2:172.21.15.69:3300/0 9 ==== mgrmap(e 36) v1 ==== 98413+0+0 (secure 0 0 0) 0x7fe9c403a1f0 con 0x7fe9c8066af0 2024-04-25T17:21:13.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.479+0000 7fe9beffd700 1 --2- 172.21.15.37:0/3957430644 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fe9b401e800 0x7fe9b401ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:21:13.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.479+0000 7fe9beffd700 1 -- 172.21.15.37:0/3957430644 --> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe9ac000bf0 con 0x7fe9b401e800 2024-04-25T17:21:13.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.480+0000 7fe9cdc4a700 1 --2- 172.21.15.37:0/3957430644 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fe9b401e800 0x7fe9b401ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:21:13.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.481+0000 7fe9cdc4a700 1 --2- 172.21.15.37:0/3957430644 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fe9b401e800 0x7fe9b401ebd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe9b8004890 tx=0x7fe9b8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:21:13.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.486+0000 7fe9beffd700 1 -- 172.21.15.37:0/3957430644 <== mgr.34104 v2:172.21.15.37:6800/783197737 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7fe9ac000bf0 con 0x7fe9b401e800 2024-04-25T17:21:13.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.490+0000 7fe9d06af700 1 -- 172.21.15.37:0/3957430644 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fe9b401e800 msgr2=0x7fe9b401ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:21:13.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.490+0000 7fe9d06af700 1 --2- 172.21.15.37:0/3957430644 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fe9b401e800 0x7fe9b401ebd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe9b8004890 tx=0x7fe9b8009e30 comp rx=0 tx=0).stop 2024-04-25T17:21:13.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.490+0000 7fe9d06af700 1 -- 172.21.15.37:0/3957430644 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9c8066af0 msgr2=0x7fe9c80fd410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:21:13.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.490+0000 7fe9d06af700 1 --2- 172.21.15.37:0/3957430644 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9c8066af0 0x7fe9c80fd410 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe9c400eb70 tx=0x7fe9c400b040 comp rx=0 tx=0).stop 2024-04-25T17:21:13.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.490+0000 7fe9d06af700 1 -- 172.21.15.37:0/3957430644 shutdown_connections 2024-04-25T17:21:13.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.490+0000 7fe9d06af700 1 --2- 172.21.15.37:0/3957430644 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fe9b401e800 0x7fe9b401ebd0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:13.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.490+0000 7fe9d06af700 1 --2- 172.21.15.37:0/3957430644 >> [v2:172.21.15.37:6800/709373822,v1:172.21.15.37:6801/709373822] conn(0x7fe9b4076d70 0x7fe9b4079220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:13.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.490+0000 7fe9d06af700 1 --2- 172.21.15.37:0/3957430644 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9c8066af0 0x7fe9c80fd410 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:13.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.490+0000 7fe9d06af700 1 --2- 172.21.15.37:0/3957430644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe9c80fff70 0x7fe9c80fb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:13.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.490+0000 7fe9d06af700 1 -- 172.21.15.37:0/3957430644 >> 172.21.15.37:0/3957430644 conn(0x7fe9c80f7440 msgr2=0x7fe9c80f7860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:21:13.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.491+0000 7fe9d06af700 1 -- 172.21.15.37:0/3957430644 shutdown_connections 2024-04-25T17:21:13.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.492+0000 7fe9d06af700 1 -- 172.21.15.37:0/3957430644 wait complete. 2024-04-25T17:21:13.511 INFO:teuthology.orchestra.run.smithi037.stdout:true 2024-04-25T17:21:13.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.618+0000 7f87d624e700 1 -- 172.21.15.37:0/452705059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87d0071de0 msgr2=0x7f87d00702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:21:13.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.618+0000 7f87d624e700 1 --2- 172.21.15.37:0/452705059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87d0071de0 0x7f87d00702f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f87c0004940 tx=0x7f87c0009e30 comp rx=0 tx=0).stop 2024-04-25T17:21:13.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.618+0000 7f87d624e700 1 -- 172.21.15.37:0/452705059 shutdown_connections 2024-04-25T17:21:13.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.618+0000 7f87d624e700 1 --2- 172.21.15.37:0/452705059 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f87d0070830 0x7f87d0070ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:13.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.618+0000 7f87d624e700 1 --2- 172.21.15.37:0/452705059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87d0071de0 0x7f87d00702f0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:13.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.618+0000 7f87d624e700 1 -- 172.21.15.37:0/452705059 >> 172.21.15.37:0/452705059 conn(0x7f87d00f8540 msgr2=0x7f87d00fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:21:13.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.618+0000 7f87d624e700 1 -- 172.21.15.37:0/452705059 shutdown_connections 2024-04-25T17:21:13.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.618+0000 7f87d624e700 1 -- 172.21.15.37:0/452705059 wait complete. 2024-04-25T17:21:13.619 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.618+0000 7f87d624e700 1 Processor -- start 2024-04-25T17:21:13.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.619+0000 7f87d624e700 1 -- start start 2024-04-25T17:21:13.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.619+0000 7f87d624e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f87d0070830 0x7f87d010fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:21:13.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.619+0000 7f87d624e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87d0071de0 0x7f87d0110100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:21:13.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.619+0000 7f87d624e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87d0110700 con 0x7f87d0071de0 2024-04-25T17:21:13.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.619+0000 7f87d624e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87d0110f50 con 0x7f87d0070830 2024-04-25T17:21:13.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.619+0000 7f87ceffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87d0071de0 0x7f87d0110100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:21:13.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.619+0000 7f87ceffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87d0071de0 0x7f87d0110100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53022/0 (socket says 172.21.15.37:53022) 2024-04-25T17:21:13.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.619+0000 7f87ceffd700 1 -- 172.21.15.37:0/720716469 learned_addr learned my addr 172.21.15.37:0/720716469 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:21:13.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.619+0000 7f87cf7fe700 1 --2- 172.21.15.37:0/720716469 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f87d0070830 0x7f87d010fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:21:13.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.619+0000 7f87ceffd700 1 -- 172.21.15.37:0/720716469 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f87d0070830 msgr2=0x7f87d010fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:21:13.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.619+0000 7f87ceffd700 1 --2- 172.21.15.37:0/720716469 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f87d0070830 0x7f87d010fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:13.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.619+0000 7f87ceffd700 1 -- 172.21.15.37:0/720716469 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c0005040 con 0x7f87d0071de0 2024-04-25T17:21:13.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.620+0000 7f87ceffd700 1 --2- 172.21.15.37:0/720716469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87d0071de0 0x7f87d0110100 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f87c400eb40 tx=0x7f87c400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:21:13.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.620+0000 7f87b7fff700 1 -- 172.21.15.37:0/720716469 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87c4007cc0 con 0x7f87d0071de0 2024-04-25T17:21:13.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.620+0000 7f87d624e700 1 -- 172.21.15.37:0/720716469 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87d01111d0 con 0x7f87d0071de0 2024-04-25T17:21:13.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.620+0000 7f87b7fff700 1 -- 172.21.15.37:0/720716469 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f87c400f040 con 0x7f87d0071de0 2024-04-25T17:21:13.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.620+0000 7f87b7fff700 1 -- 172.21.15.37:0/720716469 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87c400ca10 con 0x7f87d0071de0 2024-04-25T17:21:13.622 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.620+0000 7f87d624e700 1 -- 172.21.15.37:0/720716469 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87d0111710 con 0x7f87d0071de0 2024-04-25T17:21:13.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.621+0000 7f87d624e700 1 -- 172.21.15.37:0/720716469 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87d005f5c0 con 0x7f87d0071de0 2024-04-25T17:21:13.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.622+0000 7f87b7fff700 1 -- 172.21.15.37:0/720716469 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 36) v1 ==== 98413+0+0 (secure 0 0 0) 0x7f87c400cc80 con 0x7f87d0071de0 2024-04-25T17:21:13.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.622+0000 7f87b7fff700 1 --2- 172.21.15.37:0/720716469 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f87b8076880 0x7f87b8078d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:21:13.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.622+0000 7f87b7fff700 1 -- 172.21.15.37:0/720716469 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f87c4097a20 con 0x7f87d0071de0 2024-04-25T17:21:13.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.622+0000 7f87cf7fe700 1 --2- 172.21.15.37:0/720716469 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f87b8076880 0x7f87b8078d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:21:13.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.623+0000 7f87cf7fe700 1 --2- 172.21.15.37:0/720716469 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f87b8076880 0x7f87b8078d30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f87c0004890 tx=0x7f87c0009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:21:13.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.628+0000 7f87b7fff700 1 -- 172.21.15.37:0/720716469 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f87c405c9a0 con 0x7f87d0071de0 2024-04-25T17:21:13.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.865+0000 7f87d624e700 1 -- 172.21.15.37:0/720716469 --> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f87d0111980 con 0x7f87b8076880 2024-04-25T17:21:13.866 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.866+0000 7f87b7fff700 1 -- 172.21.15.37:0/720716469 <== mgr.34104 v2:172.21.15.37:6800/783197737 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f87d0111980 con 0x7f87b8076880 2024-04-25T17:21:13.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.868+0000 7f87d624e700 1 -- 172.21.15.37:0/720716469 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f87b8076880 msgr2=0x7f87b8078d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:21:13.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.868+0000 7f87d624e700 1 --2- 172.21.15.37:0/720716469 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f87b8076880 0x7f87b8078d30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f87c0004890 tx=0x7f87c0009e30 comp rx=0 tx=0).stop 2024-04-25T17:21:13.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.868+0000 7f87d624e700 1 -- 172.21.15.37:0/720716469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87d0071de0 msgr2=0x7f87d0110100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:21:13.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.868+0000 7f87d624e700 1 --2- 172.21.15.37:0/720716469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87d0071de0 0x7f87d0110100 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f87c400eb40 tx=0x7f87c400b040 comp rx=0 tx=0).stop 2024-04-25T17:21:13.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.868+0000 7f87d624e700 1 -- 172.21.15.37:0/720716469 shutdown_connections 2024-04-25T17:21:13.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.868+0000 7f87d624e700 1 --2- 172.21.15.37:0/720716469 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f87b8076880 0x7f87b8078d30 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:13.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.868+0000 7f87d624e700 1 --2- 172.21.15.37:0/720716469 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f87d0070830 0x7f87d010fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:13.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.868+0000 7f87d624e700 1 --2- 172.21.15.37:0/720716469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87d0071de0 0x7f87d0110100 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:13.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.868+0000 7f87d624e700 1 -- 172.21.15.37:0/720716469 >> 172.21.15.37:0/720716469 conn(0x7f87d00f8540 msgr2=0x7f87d00f9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:21:13.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.868+0000 7f87d624e700 1 -- 172.21.15.37:0/720716469 shutdown_connections 2024-04-25T17:21:13.869 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.868+0000 7f87d624e700 1 -- 172.21.15.37:0/720716469 wait complete. 2024-04-25T17:21:13.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.975+0000 7f8af0f8b700 1 -- 172.21.15.37:0/3230858018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8aec0662c0 msgr2=0x7f8aec0ff9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:21:13.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.975+0000 7f8af0f8b700 1 --2- 172.21.15.37:0/3230858018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8aec0662c0 0x7f8aec0ff9a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8adc004940 tx=0x7f8adc009e30 comp rx=0 tx=0).stop 2024-04-25T17:21:13.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.976+0000 7f8af0f8b700 1 -- 172.21.15.37:0/3230858018 shutdown_connections 2024-04-25T17:21:13.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.976+0000 7f8af0f8b700 1 --2- 172.21.15.37:0/3230858018 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8aec0ffee0 0x7f8aec102300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:13.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.976+0000 7f8af0f8b700 1 --2- 172.21.15.37:0/3230858018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8aec0662c0 0x7f8aec0ff9a0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:13.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.976+0000 7f8af0f8b700 1 -- 172.21.15.37:0/3230858018 >> 172.21.15.37:0/3230858018 conn(0x7f8aec0f7430 msgr2=0x7f8aec0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:21:13.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.976+0000 7f8af0f8b700 1 -- 172.21.15.37:0/3230858018 shutdown_connections 2024-04-25T17:21:13.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.976+0000 7f8af0f8b700 1 -- 172.21.15.37:0/3230858018 wait complete. 2024-04-25T17:21:13.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.976+0000 7f8af0f8b700 1 Processor -- start 2024-04-25T17:21:13.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.976+0000 7f8af0f8b700 1 -- start start 2024-04-25T17:21:13.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.977+0000 7f8af0f8b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8aec0662c0 0x7f8aec10d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:21:13.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.977+0000 7f8af0f8b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8aec0ffee0 0x7f8aec10df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:21:13.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.977+0000 7f8af0f8b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aec10e520 con 0x7f8aec0ffee0 2024-04-25T17:21:13.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.977+0000 7f8af0f8b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aec10ed20 con 0x7f8aec0662c0 2024-04-25T17:21:13.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.977+0000 7f8ae9d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8aec0ffee0 0x7f8aec10df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:21:13.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.977+0000 7f8ae9d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8aec0ffee0 0x7f8aec10df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53038/0 (socket says 172.21.15.37:53038) 2024-04-25T17:21:13.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.977+0000 7f8ae9d9b700 1 -- 172.21.15.37:0/2986034140 learned_addr learned my addr 172.21.15.37:0/2986034140 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:21:13.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.977+0000 7f8aea59c700 1 --2- 172.21.15.37:0/2986034140 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8aec0662c0 0x7f8aec10d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:21:13.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.977+0000 7f8ae9d9b700 1 -- 172.21.15.37:0/2986034140 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8aec0662c0 msgr2=0x7f8aec10d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:21:13.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.977+0000 7f8ae9d9b700 1 --2- 172.21.15.37:0/2986034140 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8aec0662c0 0x7f8aec10d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:13.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.977+0000 7f8ae9d9b700 1 -- 172.21.15.37:0/2986034140 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8adc005040 con 0x7f8aec0ffee0 2024-04-25T17:21:13.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.977+0000 7f8ae9d9b700 1 --2- 172.21.15.37:0/2986034140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8aec0ffee0 0x7f8aec10df20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8ae0002a80 tx=0x7f8ae00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:21:13.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.978+0000 7f8adaffd700 1 -- 172.21.15.37:0/2986034140 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ae0007cc0 con 0x7f8aec0ffee0 2024-04-25T17:21:13.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.978+0000 7f8adaffd700 1 -- 172.21.15.37:0/2986034140 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8ae000f040 con 0x7f8aec0ffee0 2024-04-25T17:21:13.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.978+0000 7f8adaffd700 1 -- 172.21.15.37:0/2986034140 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ae000dac0 con 0x7f8aec0ffee0 2024-04-25T17:21:13.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.978+0000 7f8af0f8b700 1 -- 172.21.15.37:0/2986034140 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aec10f000 con 0x7f8aec0ffee0 2024-04-25T17:21:13.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.978+0000 7f8af0f8b700 1 -- 172.21.15.37:0/2986034140 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aec10f480 con 0x7f8aec0ffee0 2024-04-25T17:21:13.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.979+0000 7f8af0f8b700 1 -- 172.21.15.37:0/2986034140 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8aec05f5c0 con 0x7f8aec0ffee0 2024-04-25T17:21:13.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.980+0000 7f8adaffd700 1 -- 172.21.15.37:0/2986034140 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 36) v1 ==== 98413+0+0 (secure 0 0 0) 0x7f8ae000dc20 con 0x7f8aec0ffee0 2024-04-25T17:21:13.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.980+0000 7f8adaffd700 1 --2- 172.21.15.37:0/2986034140 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f8ad4076880 0x7f8ad4078d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:21:13.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.980+0000 7f8adaffd700 1 -- 172.21.15.37:0/2986034140 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f8ae0097fe0 con 0x7f8aec0ffee0 2024-04-25T17:21:13.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.980+0000 7f8aea59c700 1 --2- 172.21.15.37:0/2986034140 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f8ad4076880 0x7f8ad4078d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:21:13.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.981+0000 7f8aea59c700 1 --2- 172.21.15.37:0/2986034140 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f8ad4076880 0x7f8ad4078d30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8adc00b970 tx=0x7f8adc009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:21:13.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:13.985+0000 7f8adaffd700 1 -- 172.21.15.37:0/2986034140 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f8ae005cf50 con 0x7f8aec0ffee0 2024-04-25T17:21:14.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.206+0000 7f8af0f8b700 1 -- 172.21.15.37:0/2986034140 --> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8aec10f930 con 0x7f8ad4076880 2024-04-25T17:21:14.207 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:13 smithi037 ceph-mon[90844]: [25/Apr/2024:17:21:12] ENGINE Bus STARTING 2024-04-25T17:21:14.207 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:13 smithi037 ceph-mon[90844]: [25/Apr/2024:17:21:13] ENGINE Serving on http://172.21.15.37:8765 2024-04-25T17:21:14.207 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:13 smithi037 ceph-mon[90844]: mgrmap e36: smithi037.txrgxl(active, since 1.01797s), standbys: smithi069.mmuhdo 2024-04-25T17:21:14.207 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:13 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:14.207 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:13 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:14.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.216+0000 7f8adaffd700 1 -- 172.21.15.37:0/2986034140 <== mgr.34104 v2:172.21.15.37:6800/783197737 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f8aec10f930 con 0x7f8ad4076880 2024-04-25T17:21:14.217 INFO:teuthology.orchestra.run.smithi037.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-25T17:21:14.217 INFO:teuthology.orchestra.run.smithi037.stdout:alertmanager.smithi037 smithi037 *:9093,9094 running (2m) 23s ago 11m 27.7M - 0.25.0 c8568f914cd2 18aed8f409ee 2024-04-25T17:21:14.217 INFO:teuthology.orchestra.run.smithi037.stdout:crash.smithi037 smithi037 running (11m) 23s ago 11m 6656k - 17.2.7-902-gc61472c8 0de407c1b3af b3d152574e80 2024-04-25T17:21:14.217 INFO:teuthology.orchestra.run.smithi037.stdout:crash.smithi069 smithi069 running (10m) 39s ago 10m 6660k - 17.2.7-902-gc61472c8 0de407c1b3af aa6086c64cc3 2024-04-25T17:21:14.217 INFO:teuthology.orchestra.run.smithi037.stdout:grafana.smithi037 smithi037 *:3000 running (2m) 23s ago 10m 81.1M - 9.4.7 954c08fa6188 1eff3ea3f9b0 2024-04-25T17:21:14.217 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi037.ksmixc smithi037 running (5m) 23s ago 5m 230M - 17.2.7-902-gc61472c8 0de407c1b3af 394aa56079b4 2024-04-25T17:21:14.217 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi037.ovkrpq smithi037 running (5m) 23s ago 5m 141M - 17.2.7-902-gc61472c8 0de407c1b3af 73ca662174a7 2024-04-25T17:21:14.217 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi069.cpprst smithi069 running (5m) 39s ago 5m 14.5M - 17.2.7-902-gc61472c8 0de407c1b3af dbda101df20e 2024-04-25T17:21:14.217 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi069.ytlqcf smithi069 running (5m) 39s ago 5m 12.7M - 17.2.7-902-gc61472c8 0de407c1b3af 911df6b18215 2024-04-25T17:21:14.217 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.smithi037.txrgxl smithi037 *:8443,9283,8765 running (98s) 23s ago 12m 567M - 19.0.0-3291-g994e2f20 d53c96779a29 e9653fc62df9 2024-04-25T17:21:14.218 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.smithi069.mmuhdo smithi069 *:8443,9283,8765 running (43s) 39s ago 9m 136M - 19.0.0-3291-g994e2f20 d53c96779a29 6820207b4019 2024-04-25T17:21:14.218 INFO:teuthology.orchestra.run.smithi037.stdout:mon.smithi037 smithi037 running (12m) 23s ago 12m 51.2M 2048M 17.2.7-902-gc61472c8 0de407c1b3af 5cfadcf8f2e4 2024-04-25T17:21:14.218 INFO:teuthology.orchestra.run.smithi037.stdout:mon.smithi069 smithi069 running (9m) 39s ago 9m 42.9M 2048M 17.2.7-902-gc61472c8 0de407c1b3af ffcd456d1dce 2024-04-25T17:21:14.218 INFO:teuthology.orchestra.run.smithi037.stdout:node-exporter.smithi037 smithi037 *:9100 running (2m) 23s ago 11m 14.3M - 1.5.0 0da6a335fe13 1e59bbb2aa82 2024-04-25T17:21:14.218 INFO:teuthology.orchestra.run.smithi037.stdout:node-exporter.smithi069 smithi069 *:9100 running (2m) 39s ago 10m 8606k - 1.5.0 0da6a335fe13 0c51a9833fe4 2024-04-25T17:21:14.218 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0 smithi037 running (9m) 23s ago 9m 214M 1559M 17.2.7-902-gc61472c8 0de407c1b3af 8ff4b0f1aae9 2024-04-25T17:21:14.218 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1 smithi037 running (8m) 23s ago 8m 227M 1559M 17.2.7-902-gc61472c8 0de407c1b3af 5715a5da241d 2024-04-25T17:21:14.218 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2 smithi037 running (8m) 23s ago 8m 191M 1559M 17.2.7-902-gc61472c8 0de407c1b3af 2eedaf9886dd 2024-04-25T17:21:14.218 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3 smithi069 running (7m) 39s ago 7m 249M 2581M 17.2.7-902-gc61472c8 0de407c1b3af ebba78fb1923 2024-04-25T17:21:14.218 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4 smithi069 running (7m) 39s ago 7m 233M 2581M 17.2.7-902-gc61472c8 0de407c1b3af ba7b785c50f9 2024-04-25T17:21:14.218 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5 smithi069 running (7m) 39s ago 7m 213M 2581M 17.2.7-902-gc61472c8 0de407c1b3af f6be99c364ff 2024-04-25T17:21:14.218 INFO:teuthology.orchestra.run.smithi037.stdout:prometheus.smithi037 smithi037 *:9095 running (50s) 23s ago 10m 43.3M - 2.43.0 a07b618ecd1d 2c5a268ffc1f 2024-04-25T17:21:14.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.218+0000 7f8af0f8b700 1 -- 172.21.15.37:0/2986034140 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f8ad4076880 msgr2=0x7f8ad4078d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:21:14.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.218+0000 7f8af0f8b700 1 --2- 172.21.15.37:0/2986034140 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f8ad4076880 0x7f8ad4078d30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8adc00b970 tx=0x7f8adc009e30 comp rx=0 tx=0).stop 2024-04-25T17:21:14.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.218+0000 7f8af0f8b700 1 -- 172.21.15.37:0/2986034140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8aec0ffee0 msgr2=0x7f8aec10df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:21:14.219 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.218+0000 7f8af0f8b700 1 --2- 172.21.15.37:0/2986034140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8aec0ffee0 0x7f8aec10df20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8ae0002a80 tx=0x7f8ae00046b0 comp rx=0 tx=0).stop 2024-04-25T17:21:14.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.218+0000 7f8af0f8b700 1 -- 172.21.15.37:0/2986034140 shutdown_connections 2024-04-25T17:21:14.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.218+0000 7f8af0f8b700 1 --2- 172.21.15.37:0/2986034140 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f8ad4076880 0x7f8ad4078d30 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:14.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.218+0000 7f8af0f8b700 1 --2- 172.21.15.37:0/2986034140 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8aec0662c0 0x7f8aec10d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:14.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.218+0000 7f8af0f8b700 1 --2- 172.21.15.37:0/2986034140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8aec0ffee0 0x7f8aec10df20 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:14.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.218+0000 7f8af0f8b700 1 -- 172.21.15.37:0/2986034140 >> 172.21.15.37:0/2986034140 conn(0x7f8aec0f7430 msgr2=0x7f8aec0f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:21:14.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.218+0000 7f8af0f8b700 1 -- 172.21.15.37:0/2986034140 shutdown_connections 2024-04-25T17:21:14.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.219+0000 7f8af0f8b700 1 -- 172.21.15.37:0/2986034140 wait complete. 2024-04-25T17:21:14.288 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:13 smithi069 ceph-mon[34527]: [25/Apr/2024:17:21:12] ENGINE Bus STARTING 2024-04-25T17:21:14.288 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:13 smithi069 ceph-mon[34527]: [25/Apr/2024:17:21:13] ENGINE Serving on http://172.21.15.37:8765 2024-04-25T17:21:14.288 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:13 smithi069 ceph-mon[34527]: mgrmap e36: smithi037.txrgxl(active, since 1.01797s), standbys: smithi069.mmuhdo 2024-04-25T17:21:14.288 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:13 smithi069 ceph-mon[34527]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:14.288 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:13 smithi069 ceph-mon[34527]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:14.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.321+0000 7f2da7180700 1 -- 172.21.15.37:0/1629099151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2da00fbcc0 msgr2=0x7f2da00fc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:21:14.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.321+0000 7f2da7180700 1 --2- 172.21.15.37:0/1629099151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2da00fbcc0 0x7f2da00fc0d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f2d90004940 tx=0x7f2d90009e30 comp rx=0 tx=0).stop 2024-04-25T17:21:14.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.321+0000 7f2da7180700 1 -- 172.21.15.37:0/1629099151 shutdown_connections 2024-04-25T17:21:14.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.321+0000 7f2da7180700 1 --2- 172.21.15.37:0/1629099151 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2da00fcf70 0x7f2da00fd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:14.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.321+0000 7f2da7180700 1 --2- 172.21.15.37:0/1629099151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2da00fbcc0 0x7f2da00fc0d0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:14.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.321+0000 7f2da7180700 1 -- 172.21.15.37:0/1629099151 >> 172.21.15.37:0/1629099151 conn(0x7f2da00f7440 msgr2=0x7f2da00f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:21:14.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.321+0000 7f2da7180700 1 -- 172.21.15.37:0/1629099151 shutdown_connections 2024-04-25T17:21:14.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.321+0000 7f2da7180700 1 -- 172.21.15.37:0/1629099151 wait complete. 2024-04-25T17:21:14.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.322+0000 7f2da7180700 1 Processor -- start 2024-04-25T17:21:14.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.322+0000 7f2da7180700 1 -- start start 2024-04-25T17:21:14.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.322+0000 7f2da7180700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2da00fbcc0 0x7f2da010fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:21:14.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.322+0000 7f2da7180700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2da00fcf70 0x7f2da0110070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:21:14.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.322+0000 7f2da7180700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da0110670 con 0x7f2da00fcf70 2024-04-25T17:21:14.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.322+0000 7f2da7180700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da01107e0 con 0x7f2da00fbcc0 2024-04-25T17:21:14.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.322+0000 7f2d9ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2da00fcf70 0x7f2da0110070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:21:14.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.322+0000 7f2d9ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2da00fcf70 0x7f2da0110070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53066/0 (socket says 172.21.15.37:53066) 2024-04-25T17:21:14.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.322+0000 7f2d9ffff700 1 -- 172.21.15.37:0/3317712470 learned_addr learned my addr 172.21.15.37:0/3317712470 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:21:14.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.322+0000 7f2da4f1c700 1 --2- 172.21.15.37:0/3317712470 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2da00fbcc0 0x7f2da010fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:21:14.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.323+0000 7f2da4f1c700 1 -- 172.21.15.37:0/3317712470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2da00fcf70 msgr2=0x7f2da0110070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:21:14.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.323+0000 7f2da4f1c700 1 --2- 172.21.15.37:0/3317712470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2da00fcf70 0x7f2da0110070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:14.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.323+0000 7f2da4f1c700 1 -- 172.21.15.37:0/3317712470 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d90005040 con 0x7f2da00fbcc0 2024-04-25T17:21:14.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.323+0000 7f2d9ffff700 1 --2- 172.21.15.37:0/3317712470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2da00fcf70 0x7f2da0110070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T17:21:14.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.323+0000 7f2da4f1c700 1 --2- 172.21.15.37:0/3317712470 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2da00fbcc0 0x7f2da010fb30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2d90004940 tx=0x7f2d90009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:21:14.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.323+0000 7f2d9d7fa700 1 -- 172.21.15.37:0/3317712470 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d9000e070 con 0x7f2da00fbcc0 2024-04-25T17:21:14.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.323+0000 7f2da7180700 1 -- 172.21.15.37:0/3317712470 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2da01151e0 con 0x7f2da00fbcc0 2024-04-25T17:21:14.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.323+0000 7f2d9d7fa700 1 -- 172.21.15.37:0/3317712470 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2d9001c400 con 0x7f2da00fbcc0 2024-04-25T17:21:14.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.323+0000 7f2d9d7fa700 1 -- 172.21.15.37:0/3317712470 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d9000b650 con 0x7f2da00fbcc0 2024-04-25T17:21:14.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.323+0000 7f2da7180700 1 -- 172.21.15.37:0/3317712470 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2da01157a0 con 0x7f2da00fbcc0 2024-04-25T17:21:14.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.324+0000 7f2da7180700 1 -- 172.21.15.37:0/3317712470 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2da0101900 con 0x7f2da00fbcc0 2024-04-25T17:21:14.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.325+0000 7f2d9d7fa700 1 -- 172.21.15.37:0/3317712470 <== mon.1 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 36) v1 ==== 98413+0+0 (secure 0 0 0) 0x7f2d9001ca20 con 0x7f2da00fbcc0 2024-04-25T17:21:14.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.325+0000 7f2d9d7fa700 1 --2- 172.21.15.37:0/3317712470 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f2d88076880 0x7f2d88078d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:21:14.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.325+0000 7f2d9ffff700 1 --2- 172.21.15.37:0/3317712470 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f2d88076880 0x7f2d88078d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:21:14.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.325+0000 7f2d9d7fa700 1 -- 172.21.15.37:0/3317712470 <== mon.1 v2:172.21.15.69:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f2d90099170 con 0x7f2da00fbcc0 2024-04-25T17:21:14.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.326+0000 7f2d9ffff700 1 --2- 172.21.15.37:0/3317712470 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f2d88076880 0x7f2d88078d30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2d940041d0 tx=0x7f2d9400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:21:14.330 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.330+0000 7f2d9d7fa700 1 -- 172.21.15.37:0/3317712470 <== mon.1 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f2d9005e040 con 0x7f2da00fbcc0 2024-04-25T17:21:14.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.639+0000 7f2da7180700 1 -- 172.21.15.37:0/3317712470 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2da002b2d0 con 0x7f2da00fbcc0 2024-04-25T17:21:14.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.639+0000 7f2d9d7fa700 1 -- 172.21.15.37:0/3317712470 <== mon.1 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+843 (secure 0 0 0) 0x7f2d900618f0 con 0x7f2da00fbcc0 2024-04-25T17:21:14.640 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-25T17:21:14.640 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": { 2024-04-25T17:21:14.641 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 1, 2024-04-25T17:21:14.641 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 1 2024-04-25T17:21:14.641 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:21:14.641 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": { 2024-04-25T17:21:14.641 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 2 2024-04-25T17:21:14.642 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:21:14.642 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": { 2024-04-25T17:21:14.642 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 6 2024-04-25T17:21:14.642 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:21:14.642 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": { 2024-04-25T17:21:14.642 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 4 2024-04-25T17:21:14.642 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:21:14.642 INFO:teuthology.orchestra.run.smithi037.stdout: "overall": { 2024-04-25T17:21:14.642 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 11, 2024-04-25T17:21:14.643 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 3 2024-04-25T17:21:14.643 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-04-25T17:21:14.643 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-25T17:21:14.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.641+0000 7f2da7180700 1 -- 172.21.15.37:0/3317712470 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f2d88076880 msgr2=0x7f2d88078d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:21:14.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.641+0000 7f2da7180700 1 --2- 172.21.15.37:0/3317712470 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f2d88076880 0x7f2d88078d30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2d940041d0 tx=0x7f2d9400b040 comp rx=0 tx=0).stop 2024-04-25T17:21:14.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.641+0000 7f2da7180700 1 -- 172.21.15.37:0/3317712470 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2da00fbcc0 msgr2=0x7f2da010fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:21:14.643 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.641+0000 7f2da7180700 1 --2- 172.21.15.37:0/3317712470 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2da00fbcc0 0x7f2da010fb30 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2d90004940 tx=0x7f2d90009e30 comp rx=0 tx=0).stop 2024-04-25T17:21:14.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.641+0000 7f2da7180700 1 -- 172.21.15.37:0/3317712470 shutdown_connections 2024-04-25T17:21:14.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.641+0000 7f2da7180700 1 --2- 172.21.15.37:0/3317712470 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f2d88076880 0x7f2d88078d30 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:14.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.641+0000 7f2da7180700 1 --2- 172.21.15.37:0/3317712470 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2da00fbcc0 0x7f2da010fb30 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:14.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.642+0000 7f2da7180700 1 --2- 172.21.15.37:0/3317712470 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2da00fcf70 0x7f2da0110070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:14.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.642+0000 7f2da7180700 1 -- 172.21.15.37:0/3317712470 >> 172.21.15.37:0/3317712470 conn(0x7f2da00f7440 msgr2=0x7f2da0066840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:21:14.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.642+0000 7f2da7180700 1 -- 172.21.15.37:0/3317712470 shutdown_connections 2024-04-25T17:21:14.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.642+0000 7f2da7180700 1 -- 172.21.15.37:0/3317712470 wait complete. 2024-04-25T17:21:14.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.746+0000 7fb715c4a700 1 -- 172.21.15.37:0/3670839215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7100fce60 msgr2=0x7fb7100fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:21:14.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.746+0000 7fb715c4a700 1 --2- 172.21.15.37:0/3670839215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7100fce60 0x7fb7100fd270 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb700004940 tx=0x7fb700009e30 comp rx=0 tx=0).stop 2024-04-25T17:21:14.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.747+0000 7fb715c4a700 1 -- 172.21.15.37:0/3670839215 shutdown_connections 2024-04-25T17:21:14.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.747+0000 7fb715c4a700 1 --2- 172.21.15.37:0/3670839215 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7100fdfd0 0x7fb7100fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:14.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.747+0000 7fb715c4a700 1 --2- 172.21.15.37:0/3670839215 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7100fce60 0x7fb7100fd270 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:14.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.747+0000 7fb715c4a700 1 -- 172.21.15.37:0/3670839215 >> 172.21.15.37:0/3670839215 conn(0x7fb7100f8540 msgr2=0x7fb7100fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:21:14.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.747+0000 7fb715c4a700 1 -- 172.21.15.37:0/3670839215 shutdown_connections 2024-04-25T17:21:14.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.747+0000 7fb715c4a700 1 -- 172.21.15.37:0/3670839215 wait complete. 2024-04-25T17:21:14.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.747+0000 7fb715c4a700 1 Processor -- start 2024-04-25T17:21:14.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.747+0000 7fb715c4a700 1 -- start start 2024-04-25T17:21:14.749 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.747+0000 7fb715c4a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7100fce60 0x7fb71010d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:21:14.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.747+0000 7fb715c4a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7100fdfd0 0x7fb71010ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:21:14.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.747+0000 7fb715c4a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb71010e3f0 con 0x7fb7100fce60 2024-04-25T17:21:14.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.747+0000 7fb715c4a700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb71010e560 con 0x7fb7100fdfd0 2024-04-25T17:21:14.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.747+0000 7fb70f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7100fce60 0x7fb71010d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:21:14.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.748+0000 7fb70f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7100fce60 0x7fb71010d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53086/0 (socket says 172.21.15.37:53086) 2024-04-25T17:21:14.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.748+0000 7fb70f7fe700 1 -- 172.21.15.37:0/3241458812 learned_addr learned my addr 172.21.15.37:0/3241458812 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:21:14.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.748+0000 7fb707fff700 1 --2- 172.21.15.37:0/3241458812 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7100fdfd0 0x7fb71010ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:21:14.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.748+0000 7fb70f7fe700 1 -- 172.21.15.37:0/3241458812 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7100fdfd0 msgr2=0x7fb71010ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:21:14.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.748+0000 7fb70f7fe700 1 --2- 172.21.15.37:0/3241458812 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7100fdfd0 0x7fb71010ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:14.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.748+0000 7fb70f7fe700 1 -- 172.21.15.37:0/3241458812 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb700005040 con 0x7fb7100fce60 2024-04-25T17:21:14.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.748+0000 7fb70f7fe700 1 --2- 172.21.15.37:0/3241458812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7100fce60 0x7fb71010d8b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb700013870 tx=0x7fb700009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:21:14.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.748+0000 7fb70cff9700 1 -- 172.21.15.37:0/3241458812 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb700021070 con 0x7fb7100fce60 2024-04-25T17:21:14.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.748+0000 7fb715c4a700 1 -- 172.21.15.37:0/3241458812 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb710112f60 con 0x7fb7100fce60 2024-04-25T17:21:14.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.748+0000 7fb70cff9700 1 -- 172.21.15.37:0/3241458812 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb700009430 con 0x7fb7100fce60 2024-04-25T17:21:14.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.748+0000 7fb70cff9700 1 -- 172.21.15.37:0/3241458812 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb70000e070 con 0x7fb7100fce60 2024-04-25T17:21:14.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.748+0000 7fb715c4a700 1 -- 172.21.15.37:0/3241458812 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7101133c0 con 0x7fb7100fce60 2024-04-25T17:21:14.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.749+0000 7fb715c4a700 1 -- 172.21.15.37:0/3241458812 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb71004c710 con 0x7fb7100fce60 2024-04-25T17:21:14.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.750+0000 7fb70cff9700 1 -- 172.21.15.37:0/3241458812 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 36) v1 ==== 98413+0+0 (secure 0 0 0) 0x7fb70001c400 con 0x7fb7100fce60 2024-04-25T17:21:14.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.750+0000 7fb70cff9700 1 --2- 172.21.15.37:0/3241458812 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fb6fc0768d0 0x7fb6fc078d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:21:14.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.750+0000 7fb70cff9700 1 -- 172.21.15.37:0/3241458812 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fb700099120 con 0x7fb7100fce60 2024-04-25T17:21:14.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.750+0000 7fb707fff700 1 --2- 172.21.15.37:0/3241458812 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fb6fc0768d0 0x7fb6fc078d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:21:14.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.751+0000 7fb707fff700 1 --2- 172.21.15.37:0/3241458812 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fb6fc0768d0 0x7fb6fc078d80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8009b80 tx=0x7fb6f800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:21:14.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.755+0000 7fb70cff9700 1 -- 172.21.15.37:0/3241458812 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fb70005dff0 con 0x7fb7100fce60 2024-04-25T17:21:14.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:14.952+0000 7fb70cff9700 1 -- 172.21.15.37:0/3241458812 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mgrmap(e 37) v1 ==== 98707+0+0 (secure 0 0 0) 0x7fb70005e3c0 con 0x7fb7100fce60 2024-04-25T17:21:15.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.034+0000 7fb715c4a700 1 -- 172.21.15.37:0/3241458812 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb7101137e0 con 0x7fb7100fce60 2024-04-25T17:21:15.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.034+0000 7fb70cff9700 1 -- 172.21.15.37:0/3241458812 <== mon.0 v2:172.21.15.37:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1900 (secure 0 0 0) 0x7fb700091670 con 0x7fb7100fce60 2024-04-25T17:21:15.035 INFO:teuthology.orchestra.run.smithi037.stdout:e16 2024-04-25T17:21:15.035 INFO:teuthology.orchestra.run.smithi037.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-25T17:21:15.035 INFO:teuthology.orchestra.run.smithi037.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T17:21:15.035 INFO:teuthology.orchestra.run.smithi037.stdout:legacy client fscid: 1 2024-04-25T17:21:15.035 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:21:15.035 INFO:teuthology.orchestra.run.smithi037.stdout:Filesystem 'cephfs' (1) 2024-04-25T17:21:15.035 INFO:teuthology.orchestra.run.smithi037.stdout:fs_name cephfs 2024-04-25T17:21:15.035 INFO:teuthology.orchestra.run.smithi037.stdout:epoch 16 2024-04-25T17:21:15.035 INFO:teuthology.orchestra.run.smithi037.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-25T17:21:15.036 INFO:teuthology.orchestra.run.smithi037.stdout:created 2024-04-25T17:15:40.586130+0000 2024-04-25T17:21:15.036 INFO:teuthology.orchestra.run.smithi037.stdout:modified 2024-04-25T17:15:57.508740+0000 2024-04-25T17:21:15.036 INFO:teuthology.orchestra.run.smithi037.stdout:tableserver 0 2024-04-25T17:21:15.036 INFO:teuthology.orchestra.run.smithi037.stdout:root 0 2024-04-25T17:21:15.036 INFO:teuthology.orchestra.run.smithi037.stdout:session_timeout 60 2024-04-25T17:21:15.036 INFO:teuthology.orchestra.run.smithi037.stdout:session_autoclose 300 2024-04-25T17:21:15.036 INFO:teuthology.orchestra.run.smithi037.stdout:max_file_size 1099511627776 2024-04-25T17:21:15.036 INFO:teuthology.orchestra.run.smithi037.stdout:max_xattr_size 65536 2024-04-25T17:21:15.036 INFO:teuthology.orchestra.run.smithi037.stdout:required_client_features {} 2024-04-25T17:21:15.036 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure 0 2024-04-25T17:21:15.036 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure_osd_epoch 0 2024-04-25T17:21:15.036 INFO:teuthology.orchestra.run.smithi037.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T17:21:15.036 INFO:teuthology.orchestra.run.smithi037.stdout:max_mds 1 2024-04-25T17:21:15.037 INFO:teuthology.orchestra.run.smithi037.stdout:in 0 2024-04-25T17:21:15.037 INFO:teuthology.orchestra.run.smithi037.stdout:up {0=14470} 2024-04-25T17:21:15.037 INFO:teuthology.orchestra.run.smithi037.stdout:failed 2024-04-25T17:21:15.037 INFO:teuthology.orchestra.run.smithi037.stdout:damaged 2024-04-25T17:21:15.037 INFO:teuthology.orchestra.run.smithi037.stdout:stopped 2024-04-25T17:21:15.037 INFO:teuthology.orchestra.run.smithi037.stdout:data_pools [3] 2024-04-25T17:21:15.037 INFO:teuthology.orchestra.run.smithi037.stdout:metadata_pool 2 2024-04-25T17:21:15.037 INFO:teuthology.orchestra.run.smithi037.stdout:inline_data disabled 2024-04-25T17:21:15.037 INFO:teuthology.orchestra.run.smithi037.stdout:balancer 2024-04-25T17:21:15.037 INFO:teuthology.orchestra.run.smithi037.stdout:bal_rank_mask -1 2024-04-25T17:21:15.037 INFO:teuthology.orchestra.run.smithi037.stdout:standby_count_wanted 1 2024-04-25T17:21:15.037 INFO:teuthology.orchestra.run.smithi037.stdout:qdb_cluster leader: 0 members: 2024-04-25T17:21:15.037 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi037.ksmixc{0:14470} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.37:6826/1903989494,v1:172.21.15.37:6827/1903989494] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:21:15.037 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi037.ovkrpq{0:14482} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.37:6828/4206394422,v1:172.21.15.37:6829/4206394422] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:21:15.037 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:21:15.038 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:21:15.038 INFO:teuthology.orchestra.run.smithi037.stdout:Standby daemons: 2024-04-25T17:21:15.038 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:21:15.038 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi069.cpprst{-1:24289} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.69:6826/518856100,v1:172.21.15.69:6827/518856100] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:21:15.038 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi069.ytlqcf{-1:24293} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.69:6824/134210439,v1:172.21.15.69:6825/134210439] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:21:15.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.037+0000 7fb715c4a700 1 -- 172.21.15.37:0/3241458812 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fb6fc0768d0 msgr2=0x7fb6fc078d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:21:15.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.037+0000 7fb715c4a700 1 --2- 172.21.15.37:0/3241458812 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fb6fc0768d0 0x7fb6fc078d80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8009b80 tx=0x7fb6f800b040 comp rx=0 tx=0).stop 2024-04-25T17:21:15.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.037+0000 7fb715c4a700 1 -- 172.21.15.37:0/3241458812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7100fce60 msgr2=0x7fb71010d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:21:15.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.037+0000 7fb715c4a700 1 --2- 172.21.15.37:0/3241458812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7100fce60 0x7fb71010d8b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb700013870 tx=0x7fb700009e30 comp rx=0 tx=0).stop 2024-04-25T17:21:15.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.037+0000 7fb715c4a700 1 -- 172.21.15.37:0/3241458812 shutdown_connections 2024-04-25T17:21:15.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.037+0000 7fb715c4a700 1 --2- 172.21.15.37:0/3241458812 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fb6fc0768d0 0x7fb6fc078d80 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:15.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.037+0000 7fb715c4a700 1 --2- 172.21.15.37:0/3241458812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb7100fce60 0x7fb71010d8b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:15.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.037+0000 7fb715c4a700 1 --2- 172.21.15.37:0/3241458812 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7100fdfd0 0x7fb71010ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:15.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.037+0000 7fb715c4a700 1 -- 172.21.15.37:0/3241458812 >> 172.21.15.37:0/3241458812 conn(0x7fb7100f8540 msgr2=0x7fb7100f9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:21:15.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.037+0000 7fb715c4a700 1 -- 172.21.15.37:0/3241458812 shutdown_connections 2024-04-25T17:21:15.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.037+0000 7fb715c4a700 1 -- 172.21.15.37:0/3241458812 wait complete. 2024-04-25T17:21:15.039 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 16 2024-04-25T17:21:15.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.149+0000 7f0fbe510700 1 -- 172.21.15.37:0/1101594810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fb80fd350 msgr2=0x7f0fb80fd760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:21:15.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.149+0000 7f0fbe510700 1 --2- 172.21.15.37:0/1101594810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fb80fd350 0x7f0fb80fd760 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0fa8004940 tx=0x7f0fa8009e30 comp rx=0 tx=0).stop 2024-04-25T17:21:15.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.149+0000 7f0fbe510700 1 -- 172.21.15.37:0/1101594810 shutdown_connections 2024-04-25T17:21:15.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.149+0000 7f0fbe510700 1 --2- 172.21.15.37:0/1101594810 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0fb80fdca0 0x7f0fb81045f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:15.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.149+0000 7f0fbe510700 1 --2- 172.21.15.37:0/1101594810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fb80fd350 0x7f0fb80fd760 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:15.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.149+0000 7f0fbe510700 1 -- 172.21.15.37:0/1101594810 >> 172.21.15.37:0/1101594810 conn(0x7f0fb80f6be0 msgr2=0x7f0fb80f8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:21:15.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.150+0000 7f0fbe510700 1 -- 172.21.15.37:0/1101594810 shutdown_connections 2024-04-25T17:21:15.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.150+0000 7f0fbe510700 1 -- 172.21.15.37:0/1101594810 wait complete. 2024-04-25T17:21:15.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.150+0000 7f0fbe510700 1 Processor -- start 2024-04-25T17:21:15.151 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.150+0000 7f0fbe510700 1 -- start start 2024-04-25T17:21:15.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.151+0000 7f0fbe510700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0fb80fd350 0x7f0fb810fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:21:15.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.151+0000 7f0fbe510700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fb80fdca0 0x7f0fb81100c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:21:15.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.151+0000 7f0fbe510700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb81106c0 con 0x7f0fb80fdca0 2024-04-25T17:21:15.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.151+0000 7f0fbe510700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb8110830 con 0x7f0fb80fd350 2024-04-25T17:21:15.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.151+0000 7f0fb77fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fb80fdca0 0x7f0fb81100c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:21:15.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.151+0000 7f0fb77fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fb80fdca0 0x7f0fb81100c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53102/0 (socket says 172.21.15.37:53102) 2024-04-25T17:21:15.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.151+0000 7f0fb77fe700 1 -- 172.21.15.37:0/3399082407 learned_addr learned my addr 172.21.15.37:0/3399082407 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:21:15.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.151+0000 7f0fb7fff700 1 --2- 172.21.15.37:0/3399082407 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0fb80fd350 0x7f0fb810fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:21:15.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.151+0000 7f0fb77fe700 1 -- 172.21.15.37:0/3399082407 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0fb80fd350 msgr2=0x7f0fb810fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:21:15.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.151+0000 7f0fb77fe700 1 --2- 172.21.15.37:0/3399082407 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0fb80fd350 0x7f0fb810fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:15.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.151+0000 7f0fb77fe700 1 -- 172.21.15.37:0/3399082407 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa8005040 con 0x7f0fb80fdca0 2024-04-25T17:21:15.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.151+0000 7f0fb77fe700 1 --2- 172.21.15.37:0/3399082407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fb80fdca0 0x7f0fb81100c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0fac002a50 tx=0x7f0fac004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:21:15.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.151+0000 7f0fb4ff9700 1 -- 172.21.15.37:0/3399082407 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0fac007cc0 con 0x7f0fb80fdca0 2024-04-25T17:21:15.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.151+0000 7f0fbe510700 1 -- 172.21.15.37:0/3399082407 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fb8115240 con 0x7f0fb80fdca0 2024-04-25T17:21:15.153 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.151+0000 7f0fb4ff9700 1 -- 172.21.15.37:0/3399082407 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0fac00f040 con 0x7f0fb80fdca0 2024-04-25T17:21:15.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.151+0000 7f0fb4ff9700 1 -- 172.21.15.37:0/3399082407 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0fac00da30 con 0x7f0fb80fdca0 2024-04-25T17:21:15.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.152+0000 7f0fbe510700 1 -- 172.21.15.37:0/3399082407 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fb8115800 con 0x7f0fb80fdca0 2024-04-25T17:21:15.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.152+0000 7f0fbe510700 1 -- 172.21.15.37:0/3399082407 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fb804c710 con 0x7f0fb80fdca0 2024-04-25T17:21:15.154 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.153+0000 7f0fb4ff9700 1 -- 172.21.15.37:0/3399082407 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 37) v1 ==== 98707+0+0 (secure 0 0 0) 0x7f0fac00dca0 con 0x7f0fb80fdca0 2024-04-25T17:21:15.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.154+0000 7f0fb4ff9700 1 --2- 172.21.15.37:0/3399082407 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f0fa0076c20 0x7f0fa00790d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:21:15.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.154+0000 7f0fb4ff9700 1 -- 172.21.15.37:0/3399082407 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f0fac0981c0 con 0x7f0fb80fdca0 2024-04-25T17:21:15.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.154+0000 7f0fb7fff700 1 --2- 172.21.15.37:0/3399082407 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f0fa0076c20 0x7f0fa00790d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:21:15.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.154+0000 7f0fb7fff700 1 --2- 172.21.15.37:0/3399082407 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f0fa0076c20 0x7f0fa00790d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0fa800b970 tx=0x7f0fa8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:21:15.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.159+0000 7f0fb4ff9700 1 -- 172.21.15.37:0/3399082407 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f0fac060c00 con 0x7f0fb80fdca0 2024-04-25T17:21:15.264 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:14 smithi069 ceph-mon[34527]: [25/Apr/2024:17:21:13] ENGINE Serving on https://172.21.15.37:7150 2024-04-25T17:21:15.264 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:14 smithi069 ceph-mon[34527]: [25/Apr/2024:17:21:13] ENGINE Bus STARTED 2024-04-25T17:21:15.264 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:14 smithi069 ceph-mon[34527]: from='client.24615 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:21:15.264 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:14 smithi069 ceph-mon[34527]: pgmap v3: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-25T17:21:15.264 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:14 smithi069 ceph-mon[34527]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:21:15.264 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:14 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/3317712470' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:21:15.308 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:14 smithi037 ceph-mon[90844]: [25/Apr/2024:17:21:13] ENGINE Serving on https://172.21.15.37:7150 2024-04-25T17:21:15.346 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:14 smithi037 ceph-mon[90844]: [25/Apr/2024:17:21:13] ENGINE Bus STARTED 2024-04-25T17:21:15.347 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:14 smithi037 ceph-mon[90844]: from='client.24615 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:21:15.347 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:14 smithi037 ceph-mon[90844]: pgmap v3: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-25T17:21:15.347 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:14 smithi037 ceph-mon[90844]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:21:15.347 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:14 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/3317712470' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:21:15.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.392+0000 7f0fbe510700 1 -- 172.21.15.37:0/3399082407 --> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0fb80f86d0 con 0x7f0fa0076c20 2024-04-25T17:21:15.393 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.393+0000 7f0fb4ff9700 1 -- 172.21.15.37:0/3399082407 <== mgr.34104 v2:172.21.15.37:6800/783197737 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7f0fb80f86d0 con 0x7f0fa0076c20 2024-04-25T17:21:15.393 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-25T17:21:15.394 INFO:teuthology.orchestra.run.smithi037.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385", 2024-04-25T17:21:15.394 INFO:teuthology.orchestra.run.smithi037.stdout: "in_progress": true, 2024-04-25T17:21:15.394 INFO:teuthology.orchestra.run.smithi037.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-25T17:21:15.394 INFO:teuthology.orchestra.run.smithi037.stdout: "services_complete": [ 2024-04-25T17:21:15.394 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr" 2024-04-25T17:21:15.394 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-04-25T17:21:15.394 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": "2/21 daemons upgraded", 2024-04-25T17:21:15.394 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "", 2024-04-25T17:21:15.394 INFO:teuthology.orchestra.run.smithi037.stdout: "is_paused": false 2024-04-25T17:21:15.394 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-25T17:21:15.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.395+0000 7f0fbe510700 1 -- 172.21.15.37:0/3399082407 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f0fa0076c20 msgr2=0x7f0fa00790d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:21:15.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.395+0000 7f0fbe510700 1 --2- 172.21.15.37:0/3399082407 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f0fa0076c20 0x7f0fa00790d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0fa800b970 tx=0x7f0fa8009e30 comp rx=0 tx=0).stop 2024-04-25T17:21:15.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.395+0000 7f0fbe510700 1 -- 172.21.15.37:0/3399082407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fb80fdca0 msgr2=0x7f0fb81100c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:21:15.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.395+0000 7f0fbe510700 1 --2- 172.21.15.37:0/3399082407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fb80fdca0 0x7f0fb81100c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0fac002a50 tx=0x7f0fac004600 comp rx=0 tx=0).stop 2024-04-25T17:21:15.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.395+0000 7f0fbe510700 1 -- 172.21.15.37:0/3399082407 shutdown_connections 2024-04-25T17:21:15.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.395+0000 7f0fbe510700 1 --2- 172.21.15.37:0/3399082407 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f0fa0076c20 0x7f0fa00790d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:15.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.395+0000 7f0fbe510700 1 --2- 172.21.15.37:0/3399082407 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0fb80fd350 0x7f0fb810fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:15.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.395+0000 7f0fbe510700 1 --2- 172.21.15.37:0/3399082407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0fb80fdca0 0x7f0fb81100c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:15.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.395+0000 7f0fbe510700 1 -- 172.21.15.37:0/3399082407 >> 172.21.15.37:0/3399082407 conn(0x7f0fb80f6be0 msgr2=0x7f0fb80f6fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:21:15.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.396+0000 7f0fbe510700 1 -- 172.21.15.37:0/3399082407 shutdown_connections 2024-04-25T17:21:15.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.396+0000 7f0fbe510700 1 -- 172.21.15.37:0/3399082407 wait complete. 2024-04-25T17:21:15.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.504+0000 7f718cc8f700 1 -- 172.21.15.37:0/2071495348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71880fbce0 msgr2=0x7f71880fc0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:21:15.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.504+0000 7f718cc8f700 1 --2- 172.21.15.37:0/2071495348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71880fbce0 0x7f71880fc0f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7178004940 tx=0x7f7178009e30 comp rx=0 tx=0).stop 2024-04-25T17:21:15.505 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.505+0000 7f718cc8f700 1 -- 172.21.15.37:0/2071495348 shutdown_connections 2024-04-25T17:21:15.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.505+0000 7f718cc8f700 1 --2- 172.21.15.37:0/2071495348 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f71880fcf90 0x7f71880fd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:15.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.505+0000 7f718cc8f700 1 --2- 172.21.15.37:0/2071495348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71880fbce0 0x7f71880fc0f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:15.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.505+0000 7f718cc8f700 1 -- 172.21.15.37:0/2071495348 >> 172.21.15.37:0/2071495348 conn(0x7f71880f7440 msgr2=0x7f71880f9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:21:15.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.505+0000 7f718cc8f700 1 -- 172.21.15.37:0/2071495348 shutdown_connections 2024-04-25T17:21:15.506 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.505+0000 7f718cc8f700 1 -- 172.21.15.37:0/2071495348 wait complete. 2024-04-25T17:21:15.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.505+0000 7f718cc8f700 1 Processor -- start 2024-04-25T17:21:15.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.505+0000 7f718cc8f700 1 -- start start 2024-04-25T17:21:15.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.506+0000 7f718cc8f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71880fbce0 0x7f718810c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:21:15.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.506+0000 7f718cc8f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f71880fcf90 0x7f718810ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:21:15.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.506+0000 7f718cc8f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f718810d2d0 con 0x7f71880fbce0 2024-04-25T17:21:15.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.506+0000 7f718cc8f700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f718810d440 con 0x7f71880fcf90 2024-04-25T17:21:15.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.506+0000 7f718659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71880fbce0 0x7f718810c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:21:15.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.506+0000 7f718659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71880fbce0 0x7f718810c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53114/0 (socket says 172.21.15.37:53114) 2024-04-25T17:21:15.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.506+0000 7f718659c700 1 -- 172.21.15.37:0/1158339660 learned_addr learned my addr 172.21.15.37:0/1158339660 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:21:15.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.506+0000 7f7185d9b700 1 --2- 172.21.15.37:0/1158339660 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f71880fcf90 0x7f718810ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:21:15.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.506+0000 7f718659c700 1 -- 172.21.15.37:0/1158339660 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f71880fcf90 msgr2=0x7f718810ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:21:15.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.506+0000 7f718659c700 1 --2- 172.21.15.37:0/1158339660 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f71880fcf90 0x7f718810ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:15.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.506+0000 7f718659c700 1 -- 172.21.15.37:0/1158339660 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7178005040 con 0x7f71880fbce0 2024-04-25T17:21:15.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.506+0000 7f718659c700 1 --2- 172.21.15.37:0/1158339660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71880fbce0 0x7f718810c790 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7178009150 tx=0x7f7178009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:21:15.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.506+0000 7f7176ffd700 1 -- 172.21.15.37:0/1158339660 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f717800e040 con 0x7f71880fbce0 2024-04-25T17:21:15.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.506+0000 7f7176ffd700 1 -- 172.21.15.37:0/1158339660 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7178004290 con 0x7f71880fbce0 2024-04-25T17:21:15.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.506+0000 7f718cc8f700 1 -- 172.21.15.37:0/1158339660 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7188111e40 con 0x7f71880fbce0 2024-04-25T17:21:15.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.507+0000 7f7176ffd700 1 -- 172.21.15.37:0/1158339660 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f717801c630 con 0x7f71880fbce0 2024-04-25T17:21:15.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.507+0000 7f718cc8f700 1 -- 172.21.15.37:0/1158339660 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7188112370 con 0x7f71880fbce0 2024-04-25T17:21:15.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.507+0000 7f718cc8f700 1 -- 172.21.15.37:0/1158339660 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f718804c710 con 0x7f71880fbce0 2024-04-25T17:21:15.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.508+0000 7f7176ffd700 1 -- 172.21.15.37:0/1158339660 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 37) v1 ==== 98707+0+0 (secure 0 0 0) 0x7f717800bbf0 con 0x7f71880fbce0 2024-04-25T17:21:15.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.508+0000 7f7176ffd700 1 --2- 172.21.15.37:0/1158339660 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f7170076c20 0x7f71700790d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:21:15.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.509+0000 7f7176ffd700 1 -- 172.21.15.37:0/1158339660 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f7178098ff0 con 0x7f71880fbce0 2024-04-25T17:21:15.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.509+0000 7f7185d9b700 1 --2- 172.21.15.37:0/1158339660 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f7170076c20 0x7f71700790d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:21:15.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.509+0000 7f7185d9b700 1 --2- 172.21.15.37:0/1158339660 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f7170076c20 0x7f71700790d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f717c009fd0 tx=0x7f717c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:21:15.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.514+0000 7f7176ffd700 1 -- 172.21.15.37:0/1158339660 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f7178061ab0 con 0x7f71880fbce0 2024-04-25T17:21:15.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.833+0000 7f718cc8f700 1 -- 172.21.15.37:0/1158339660 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f71881047d0 con 0x7f71880fbce0 2024-04-25T17:21:15.834 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.833+0000 7f7176ffd700 1 -- 172.21.15.37:0/1158339660 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f7178061450 con 0x7f71880fbce0 2024-04-25T17:21:15.834 INFO:teuthology.orchestra.run.smithi037.stdout:HEALTH_OK 2024-04-25T17:21:15.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.836+0000 7f718cc8f700 1 -- 172.21.15.37:0/1158339660 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f7170076c20 msgr2=0x7f71700790d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:21:15.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.836+0000 7f718cc8f700 1 --2- 172.21.15.37:0/1158339660 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f7170076c20 0x7f71700790d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f717c009fd0 tx=0x7f717c00b040 comp rx=0 tx=0).stop 2024-04-25T17:21:15.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.836+0000 7f718cc8f700 1 -- 172.21.15.37:0/1158339660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71880fbce0 msgr2=0x7f718810c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:21:15.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.836+0000 7f718cc8f700 1 --2- 172.21.15.37:0/1158339660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71880fbce0 0x7f718810c790 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7178009150 tx=0x7f7178009e30 comp rx=0 tx=0).stop 2024-04-25T17:21:15.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.836+0000 7f718cc8f700 1 -- 172.21.15.37:0/1158339660 shutdown_connections 2024-04-25T17:21:15.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.836+0000 7f718cc8f700 1 --2- 172.21.15.37:0/1158339660 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f7170076c20 0x7f71700790d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:15.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.836+0000 7f718cc8f700 1 --2- 172.21.15.37:0/1158339660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71880fbce0 0x7f718810c790 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:15.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.836+0000 7f718cc8f700 1 --2- 172.21.15.37:0/1158339660 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f71880fcf90 0x7f718810ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:15.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.836+0000 7f718cc8f700 1 -- 172.21.15.37:0/1158339660 >> 172.21.15.37:0/1158339660 conn(0x7f71880f7440 msgr2=0x7f71880f8a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:21:15.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.836+0000 7f718cc8f700 1 -- 172.21.15.37:0/1158339660 shutdown_connections 2024-04-25T17:21:15.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:15.836+0000 7f718cc8f700 1 -- 172.21.15.37:0/1158339660 wait complete. 2024-04-25T17:21:16.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:15 smithi069 ceph-mon[34527]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:21:16.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:15 smithi069 ceph-mon[34527]: pgmap v4: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-25T17:21:16.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:15 smithi069 ceph-mon[34527]: mgrmap e37: smithi037.txrgxl(active, since 2s), standbys: smithi069.mmuhdo 2024-04-25T17:21:16.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:15 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/3241458812' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T17:21:16.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:15 smithi069 ceph-mon[34527]: from='client.? 172.21.15.37:0/1158339660' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T17:21:16.205 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:15 smithi037 ceph-mon[90844]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:21:16.205 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:15 smithi037 ceph-mon[90844]: pgmap v4: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-25T17:21:16.205 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:15 smithi037 ceph-mon[90844]: mgrmap e37: smithi037.txrgxl(active, since 2s), standbys: smithi069.mmuhdo 2024-04-25T17:21:16.206 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:15 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/3241458812' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T17:21:16.206 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:15 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/1158339660' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T17:21:17.183 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:16 smithi037 ceph-mon[90844]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:21:17.183 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:16 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:17.183 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:16 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:17.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:16 smithi069 ceph-mon[34527]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:21:17.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:16 smithi069 ceph-mon[34527]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:17.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:16 smithi069 ceph-mon[34527]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:18.218 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:17 smithi069 ceph-mon[34527]: pgmap v5: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-25T17:21:18.218 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:17 smithi069 ceph-mon[34527]: mgrmap e38: smithi037.txrgxl(active, since 4s), standbys: smithi069.mmuhdo 2024-04-25T17:21:18.218 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:17 smithi069 ceph-mon[34527]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:18.218 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:17 smithi069 ceph-mon[34527]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:18.321 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:17 smithi037 ceph-mon[90844]: pgmap v5: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-25T17:21:18.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:17 smithi037 ceph-mon[90844]: mgrmap e38: smithi037.txrgxl(active, since 4s), standbys: smithi069.mmuhdo 2024-04-25T17:21:18.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:17 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:18.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:17 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:20.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:19 smithi069 ceph-mon[34527]: pgmap v6: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-25T17:21:20.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:19 smithi069 ceph-mon[34527]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:20.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:19 smithi069 ceph-mon[34527]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:20.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:19 smithi037 ceph-mon[90844]: pgmap v6: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail 2024-04-25T17:21:20.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:19 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:20.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:19 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:21.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:21 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:21.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:21 smithi037 ceph-mon[90844]: pgmap v7: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 40 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-04-25T17:21:21.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:21 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:21.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:21 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:21.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:21 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:21.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:21 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:21:21.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:21 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:21:21.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:21 smithi037 ceph-mon[90844]: Updating smithi037:/etc/ceph/ceph.conf 2024-04-25T17:21:21.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:21 smithi037 ceph-mon[90844]: Updating smithi069:/etc/ceph/ceph.conf 2024-04-25T17:21:21.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:21 smithi069 ceph-mon[34527]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:21.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:21 smithi069 ceph-mon[34527]: pgmap v7: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 40 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-04-25T17:21:21.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:21 smithi069 ceph-mon[34527]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:21.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:21 smithi069 ceph-mon[34527]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:21.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:21 smithi069 ceph-mon[34527]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:21.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:21 smithi069 ceph-mon[34527]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:21:21.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:21 smithi069 ceph-mon[34527]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:21:21.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:21 smithi069 ceph-mon[34527]: Updating smithi037:/etc/ceph/ceph.conf 2024-04-25T17:21:21.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:21 smithi069 ceph-mon[34527]: Updating smithi069:/etc/ceph/ceph.conf 2024-04-25T17:21:23.114 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:23 smithi069 ceph-mon[34527]: Updating smithi037:/var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T17:21:23.114 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:23 smithi069 ceph-mon[34527]: Updating smithi069:/var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T17:21:23.114 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:23 smithi069 ceph-mon[34527]: Updating smithi069:/etc/ceph/ceph.client.admin.keyring 2024-04-25T17:21:23.114 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:23 smithi069 ceph-mon[34527]: Updating smithi037:/etc/ceph/ceph.client.admin.keyring 2024-04-25T17:21:23.114 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:23 smithi069 ceph-mon[34527]: Updating smithi069:/var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T17:21:23.114 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:23 smithi069 ceph-mon[34527]: Updating smithi037:/var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T17:21:23.114 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:23 smithi069 ceph-mon[34527]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:23.114 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:23 smithi069 ceph-mon[34527]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:23.115 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:23 smithi069 ceph-mon[34527]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:23.115 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:23 smithi069 ceph-mon[34527]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:23.115 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:23 smithi069 ceph-mon[34527]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:23.115 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:23 smithi069 ceph-mon[34527]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:21:23.115 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:23 smithi069 ceph-mon[34527]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:21:23.115 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:23 smithi069 ceph-mon[34527]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-04-25T17:21:23.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:23 smithi037 ceph-mon[90844]: Updating smithi037:/var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T17:21:23.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:23 smithi037 ceph-mon[90844]: Updating smithi069:/var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/config/ceph.conf 2024-04-25T17:21:23.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:23 smithi037 ceph-mon[90844]: Updating smithi069:/etc/ceph/ceph.client.admin.keyring 2024-04-25T17:21:23.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:23 smithi037 ceph-mon[90844]: Updating smithi037:/etc/ceph/ceph.client.admin.keyring 2024-04-25T17:21:23.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:23 smithi037 ceph-mon[90844]: Updating smithi069:/var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T17:21:23.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:23 smithi037 ceph-mon[90844]: Updating smithi037:/var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/config/ceph.client.admin.keyring 2024-04-25T17:21:23.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:23 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:23.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:23 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:23.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:23 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:23.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:23 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:23.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:23 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:23.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:23 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:21:23.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:23 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:21:23.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:23 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-04-25T17:21:24.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:24 smithi037 ceph-mon[90844]: pgmap v8: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-04-25T17:21:24.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:24 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:24.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:24 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T17:21:24.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:24 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-25T17:21:24.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:24 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:21:24.377 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:24 smithi069 ceph-mon[34527]: pgmap v8: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-04-25T17:21:24.377 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:24 smithi069 ceph-mon[34527]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:24.377 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:24 smithi069 ceph-mon[34527]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T17:21:24.377 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:24 smithi069 ceph-mon[34527]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-25T17:21:24.377 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:24 smithi069 ceph-mon[34527]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:21:25.274 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:25 smithi069 ceph-mon[34527]: Upgrade: Updating mon.smithi069 2024-04-25T17:21:25.274 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:25 smithi069 ceph-mon[34527]: Deploying daemon mon.smithi069 on smithi069 2024-04-25T17:21:25.321 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:25 smithi037 ceph-mon[90844]: Upgrade: Updating mon.smithi069 2024-04-25T17:21:25.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:25 smithi037 ceph-mon[90844]: Deploying daemon mon.smithi069 on smithi069 2024-04-25T17:21:25.804 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:25 smithi069 systemd[1]: Stopping Ceph mon.smithi069 for 599bb7fc-0326-11ef-bc93-c7b262605968... 2024-04-25T17:21:26.120 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:25 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-mon-smithi069[34508]: 2024-04-25T17:21:25.802+0000 7fe3b068b700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi069 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T17:21:26.121 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:25 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-mon-smithi069[34508]: 2024-04-25T17:21:25.803+0000 7fe3b068b700 -1 mon.smithi069@1(peon) e2 *** Got Signal Terminated *** 2024-04-25T17:21:26.121 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:25 smithi069 podman[80077]: 2024-04-25 17:21:25.844253981 +0000 UTC m=+0.171941917 container died ffcd456d1dcec5240f394061a460af207b6842c9e1f283ae49e5be1aae31b4b9 (image=quay.ceph.io/ceph-ci/ceph@sha256:27d43f80a23d3545096a7bb490598a6f37852da2940e69e5a8f3e3d7fb58fd17, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-mon-smithi069, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=quincy-c61472c, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T17:21:26.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:26 smithi069 podman[80077]: 2024-04-25 17:21:26.219947389 +0000 UTC m=+0.547635314 container cleanup ffcd456d1dcec5240f394061a460af207b6842c9e1f283ae49e5be1aae31b4b9 (image=quay.ceph.io/ceph-ci/ceph@sha256:27d43f80a23d3545096a7bb490598a6f37852da2940e69e5a8f3e3d7fb58fd17, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-mon-smithi069, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, RELEASE=quincy-c61472c, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T17:21:26.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:26 smithi069 bash[80077]: ceph-599bb7fc-0326-11ef-bc93-c7b262605968-mon-smithi069 2024-04-25T17:21:26.838 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:26 smithi069 podman[80091]: 2024-04-25 17:21:26.47968086 +0000 UTC m=+0.630869054 container remove ffcd456d1dcec5240f394061a460af207b6842c9e1f283ae49e5be1aae31b4b9 (image=quay.ceph.io/ceph-ci/ceph@sha256:27d43f80a23d3545096a7bb490598a6f37852da2940e69e5a8f3e3d7fb58fd17, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-mon-smithi069, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, RELEASE=quincy-c61472c, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-04-25T17:21:26.838 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:26 smithi069 systemd[1]: ceph-599bb7fc-0326-11ef-bc93-c7b262605968@mon.smithi069.service: Deactivated successfully. 2024-04-25T17:21:26.838 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:26 smithi069 systemd[1]: Stopped Ceph mon.smithi069 for 599bb7fc-0326-11ef-bc93-c7b262605968. 2024-04-25T17:21:26.838 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:26 smithi069 systemd[1]: ceph-599bb7fc-0326-11ef-bc93-c7b262605968@mon.smithi069.service: Consumed 6.148s CPU time. 2024-04-25T17:21:27.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:26 smithi069 systemd[1]: Starting Ceph mon.smithi069 for 599bb7fc-0326-11ef-bc93-c7b262605968... 2024-04-25T17:21:27.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 podman[80220]: 2024-04-25 17:21:27.047271688 +0000 UTC m=+0.111296742 container create 7744dbe81b5036399c1cd4721a3c375b20b4ba05858617737dfc8748df4ad385 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-mon-smithi069, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-04-25T17:21:27.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 podman[80220]: 2024-04-25 17:21:26.953918519 +0000 UTC m=+0.017943609 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T17:21:27.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 podman[80220]: 2024-04-25 17:21:27.258248115 +0000 UTC m=+0.322273181 container init 7744dbe81b5036399c1cd4721a3c375b20b4ba05858617737dfc8748df4ad385 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-mon-smithi069, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, ceph=True) 2024-04-25T17:21:27.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 podman[80220]: 2024-04-25 17:21:27.261375276 +0000 UTC m=+0.325400331 container start 7744dbe81b5036399c1cd4721a3c375b20b4ba05858617737dfc8748df4ad385 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-mon-smithi069, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424) 2024-04-25T17:21:27.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: set uid:gid to 167:167 (ceph:ceph) 2024-04-25T17:21:27.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev), process ceph-mon, pid 2 2024-04-25T17:21:27.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: pidfile_write: ignore empty --pid-file 2024-04-25T17:21:27.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: load: jerasure load: lrc 2024-04-25T17:21:27.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: RocksDB version: 7.9.2 2024-04-25T17:21:27.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Git sha 0 2024-04-25T17:21:27.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Compile date 2024-04-25 02:57:34 2024-04-25T17:21:27.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: DB SUMMARY 2024-04-25T17:21:27.670 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: DB Session ID: YX0IYRTHEGE01A5BTXCF 2024-04-25T17:21:27.670 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: CURRENT file: CURRENT 2024-04-25T17:21:27.670 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: IDENTITY file: IDENTITY 2024-04-25T17:21:27.670 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: MANIFEST file: MANIFEST-000009 size: 1084 Bytes 2024-04-25T17:21:27.670 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi069/store.db dir, Total Num: 1, files: 000027.sst 2024-04-25T17:21:27.670 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi069/store.db: 000025.log size: 3055144 ; 2024-04-25T17:21:27.670 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.error_if_exists: 0 2024-04-25T17:21:27.670 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.create_if_missing: 0 2024-04-25T17:21:27.670 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.paranoid_checks: 1 2024-04-25T17:21:27.670 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.flush_verify_memtable_count: 1 2024-04-25T17:21:27.670 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-04-25T17:21:27.670 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-04-25T17:21:27.670 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.env: 0x563ebf19c500 2024-04-25T17:21:27.670 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.fs: PosixFileSystem 2024-04-25T17:21:27.671 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.info_log: 0x563ec0995e80 2024-04-25T17:21:27.671 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.max_file_opening_threads: 16 2024-04-25T17:21:27.671 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.statistics: (nil) 2024-04-25T17:21:27.671 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.use_fsync: 0 2024-04-25T17:21:27.671 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.max_log_file_size: 0 2024-04-25T17:21:27.671 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-04-25T17:21:27.671 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.log_file_time_to_roll: 0 2024-04-25T17:21:27.671 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.keep_log_file_num: 1000 2024-04-25T17:21:27.671 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.recycle_log_file_num: 0 2024-04-25T17:21:27.671 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.allow_fallocate: 1 2024-04-25T17:21:27.671 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.allow_mmap_reads: 0 2024-04-25T17:21:27.671 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.allow_mmap_writes: 0 2024-04-25T17:21:27.671 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.use_direct_reads: 0 2024-04-25T17:21:27.671 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-04-25T17:21:27.671 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.create_missing_column_families: 0 2024-04-25T17:21:27.672 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.db_log_dir: 2024-04-25T17:21:27.672 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.wal_dir: 2024-04-25T17:21:27.672 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.table_cache_numshardbits: 6 2024-04-25T17:21:27.672 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.WAL_ttl_seconds: 0 2024-04-25T17:21:27.672 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.WAL_size_limit_MB: 0 2024-04-25T17:21:27.672 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-04-25T17:21:27.672 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-04-25T17:21:27.672 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.is_fd_close_on_exec: 1 2024-04-25T17:21:27.672 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.advise_random_on_open: 1 2024-04-25T17:21:27.672 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.db_write_buffer_size: 0 2024-04-25T17:21:27.672 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.write_buffer_manager: 0x563ec09668c0 2024-04-25T17:21:27.672 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-04-25T17:21:27.672 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-04-25T17:21:27.672 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.use_adaptive_mutex: 0 2024-04-25T17:21:27.672 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.rate_limiter: (nil) 2024-04-25T17:21:27.672 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-04-25T17:21:27.673 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.wal_recovery_mode: 2 2024-04-25T17:21:27.673 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.enable_thread_tracking: 0 2024-04-25T17:21:27.673 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.enable_pipelined_write: 0 2024-04-25T17:21:27.673 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.unordered_write: 0 2024-04-25T17:21:27.673 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-04-25T17:21:27.673 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-04-25T17:21:27.673 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-04-25T17:21:27.673 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-04-25T17:21:27.673 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.row_cache: None 2024-04-25T17:21:27.673 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.wal_filter: None 2024-04-25T17:21:27.674 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-04-25T17:21:27.674 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.allow_ingest_behind: 0 2024-04-25T17:21:27.675 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.two_write_queues: 0 2024-04-25T17:21:27.675 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.manual_wal_flush: 0 2024-04-25T17:21:27.675 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.wal_compression: 0 2024-04-25T17:21:27.675 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.atomic_flush: 0 2024-04-25T17:21:27.675 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-04-25T17:21:27.675 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.persist_stats_to_disk: 0 2024-04-25T17:21:27.675 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.write_dbid_to_manifest: 0 2024-04-25T17:21:27.675 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.log_readahead_size: 0 2024-04-25T17:21:27.675 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-04-25T17:21:27.675 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.best_efforts_recovery: 0 2024-04-25T17:21:27.675 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-04-25T17:21:27.675 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-04-25T17:21:27.675 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.allow_data_in_errors: 0 2024-04-25T17:21:27.675 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.db_host_id: __hostname__ 2024-04-25T17:21:27.675 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.enforce_single_del_contracts: true 2024-04-25T17:21:27.676 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.max_background_jobs: 2 2024-04-25T17:21:27.676 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.max_background_compactions: -1 2024-04-25T17:21:27.676 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.max_subcompactions: 1 2024-04-25T17:21:27.676 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-04-25T17:21:27.676 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-04-25T17:21:27.676 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.delayed_write_rate : 16777216 2024-04-25T17:21:27.676 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.max_total_wal_size: 0 2024-04-25T17:21:27.676 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-04-25T17:21:27.676 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.stats_dump_period_sec: 600 2024-04-25T17:21:27.676 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.stats_persist_period_sec: 600 2024-04-25T17:21:27.676 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-04-25T17:21:27.676 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.max_open_files: -1 2024-04-25T17:21:27.676 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.bytes_per_sync: 0 2024-04-25T17:21:27.676 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.wal_bytes_per_sync: 0 2024-04-25T17:21:27.676 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.strict_bytes_per_sync: 0 2024-04-25T17:21:27.676 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.compaction_readahead_size: 0 2024-04-25T17:21:27.676 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.max_background_flushes: -1 2024-04-25T17:21:27.677 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Compression algorithms supported: 2024-04-25T17:21:27.677 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-04-25T17:21:27.677 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: kZSTD supported: 0 2024-04-25T17:21:27.677 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: kXpressCompression supported: 0 2024-04-25T17:21:27.677 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: kLZ4HCCompression supported: 1 2024-04-25T17:21:27.677 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: kZlibCompression supported: 1 2024-04-25T17:21:27.677 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: kSnappyCompression supported: 1 2024-04-25T17:21:27.677 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: kLZ4Compression supported: 1 2024-04-25T17:21:27.677 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: kBZip2Compression supported: 0 2024-04-25T17:21:27.677 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Fast CRC32 supported: Supported on x86 2024-04-25T17:21:27.677 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: DMutex implementation: pthread_mutex_t 2024-04-25T17:21:27.677 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi069/store.db/MANIFEST-000009 2024-04-25T17:21:27.677 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-04-25T17:21:27.677 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-04-25T17:21:27.677 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.merge_operator: 2024-04-25T17:21:27.677 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.compaction_filter: None 2024-04-25T17:21:27.677 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.compaction_filter_factory: None 2024-04-25T17:21:27.678 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.sst_partitioner_factory: None 2024-04-25T17:21:27.678 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.memtable_factory: SkipListFactory 2024-04-25T17:21:27.678 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.table_factory: BlockBasedTable 2024-04-25T17:21:27.678 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x563ec0a9c060) 2024-04-25T17:21:27.678 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: cache_index_and_filter_blocks: 1 2024-04-25T17:21:27.678 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-04-25T17:21:27.678 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-04-25T17:21:27.678 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: pin_top_level_index_and_filter: 1 2024-04-25T17:21:27.678 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: index_type: 0 2024-04-25T17:21:27.678 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: data_block_index_type: 0 2024-04-25T17:21:27.678 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: index_shortening: 1 2024-04-25T17:21:27.678 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: data_block_hash_table_util_ratio: 0.750000 2024-04-25T17:21:27.678 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: checksum: 4 2024-04-25T17:21:27.678 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: no_block_cache: 0 2024-04-25T17:21:27.678 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: block_cache: 0x563ec09991f0 2024-04-25T17:21:27.679 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: block_cache_name: BinnedLRUCache 2024-04-25T17:21:27.679 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: block_cache_options: 2024-04-25T17:21:27.679 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: capacity : 536870912 2024-04-25T17:21:27.679 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: num_shard_bits : 4 2024-04-25T17:21:27.679 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: strict_capacity_limit : 0 2024-04-25T17:21:27.679 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: high_pri_pool_ratio: 0.000 2024-04-25T17:21:27.679 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: block_cache_compressed: (nil) 2024-04-25T17:21:27.679 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: persistent_cache: (nil) 2024-04-25T17:21:27.679 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: block_size: 4096 2024-04-25T17:21:27.679 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: block_size_deviation: 10 2024-04-25T17:21:27.679 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: block_restart_interval: 16 2024-04-25T17:21:27.679 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: index_block_restart_interval: 1 2024-04-25T17:21:27.679 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: metadata_block_size: 4096 2024-04-25T17:21:27.679 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: partition_filters: 0 2024-04-25T17:21:27.679 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: use_delta_encoding: 1 2024-04-25T17:21:27.679 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: filter_policy: bloomfilter 2024-04-25T17:21:27.680 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: whole_key_filtering: 1 2024-04-25T17:21:27.680 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: verify_compression: 0 2024-04-25T17:21:27.680 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: read_amp_bytes_per_bit: 0 2024-04-25T17:21:27.680 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: format_version: 5 2024-04-25T17:21:27.680 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: enable_index_compression: 1 2024-04-25T17:21:27.680 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: block_align: 0 2024-04-25T17:21:27.680 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: max_auto_readahead_size: 262144 2024-04-25T17:21:27.680 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: prepopulate_block_cache: 0 2024-04-25T17:21:27.680 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: initial_auto_readahead_size: 8192 2024-04-25T17:21:27.680 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: num_file_reads_for_auto_readahead: 2 2024-04-25T17:21:27.680 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.write_buffer_size: 33554432 2024-04-25T17:21:27.680 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.max_write_buffer_number: 2 2024-04-25T17:21:27.680 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.compression: NoCompression 2024-04-25T17:21:27.680 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.bottommost_compression: Disabled 2024-04-25T17:21:27.680 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.prefix_extractor: nullptr 2024-04-25T17:21:27.680 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-04-25T17:21:27.681 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.num_levels: 7 2024-04-25T17:21:27.681 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-04-25T17:21:27.681 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-04-25T17:21:27.681 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-04-25T17:21:27.681 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-04-25T17:21:27.681 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-04-25T17:21:27.681 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-04-25T17:21:27.681 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-04-25T17:21:27.681 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-04-25T17:21:27.681 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-04-25T17:21:27.681 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-04-25T17:21:27.681 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-04-25T17:21:27.681 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-04-25T17:21:27.681 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.compression_opts.window_bits: -14 2024-04-25T17:21:27.681 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.compression_opts.level: 32767 2024-04-25T17:21:27.682 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.compression_opts.strategy: 0 2024-04-25T17:21:27.682 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-04-25T17:21:27.682 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-04-25T17:21:27.682 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-04-25T17:21:27.682 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-04-25T17:21:27.682 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.compression_opts.enabled: false 2024-04-25T17:21:27.682 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-04-25T17:21:27.682 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-04-25T17:21:27.682 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-04-25T17:21:27.682 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-04-25T17:21:27.682 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.target_file_size_base: 67108864 2024-04-25T17:21:27.682 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.target_file_size_multiplier: 1 2024-04-25T17:21:27.682 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-04-25T17:21:27.682 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-04-25T17:21:27.682 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-04-25T17:21:27.683 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-04-25T17:21:27.683 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-04-25T17:21:27.683 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-04-25T17:21:27.683 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-04-25T17:21:27.683 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-04-25T17:21:27.683 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-04-25T17:21:27.683 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-04-25T17:21:27.683 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-04-25T17:21:27.683 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-04-25T17:21:27.683 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-04-25T17:21:27.683 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.arena_block_size: 1048576 2024-04-25T17:21:27.683 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-04-25T17:21:27.683 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-04-25T17:21:27.683 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.disable_auto_compactions: 0 2024-04-25T17:21:27.683 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-04-25T17:21:27.684 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-04-25T17:21:27.684 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-04-25T17:21:27.684 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-04-25T17:21:27.684 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-04-25T17:21:27.684 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-04-25T17:21:27.684 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-04-25T17:21:27.684 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-04-25T17:21:27.684 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-04-25T17:21:27.684 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-04-25T17:21:27.684 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-04-25T17:21:27.684 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.inplace_update_support: 0 2024-04-25T17:21:27.684 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.inplace_update_num_locks: 10000 2024-04-25T17:21:27.684 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-04-25T17:21:27.684 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-04-25T17:21:27.684 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.memtable_huge_page_size: 0 2024-04-25T17:21:27.684 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.bloom_locality: 0 2024-04-25T17:21:27.685 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.max_successive_merges: 0 2024-04-25T17:21:27.685 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.optimize_filters_for_hits: 0 2024-04-25T17:21:27.685 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.paranoid_file_checks: 0 2024-04-25T17:21:27.685 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.force_consistency_checks: 1 2024-04-25T17:21:27.685 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.report_bg_io_stats: 0 2024-04-25T17:21:27.685 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.ttl: 2592000 2024-04-25T17:21:27.685 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.periodic_compaction_seconds: 0 2024-04-25T17:21:27.685 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-04-25T17:21:27.685 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-04-25T17:21:27.685 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.enable_blob_files: false 2024-04-25T17:21:27.685 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.min_blob_size: 0 2024-04-25T17:21:27.685 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.blob_file_size: 268435456 2024-04-25T17:21:27.685 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.blob_compression_type: NoCompression 2024-04-25T17:21:27.685 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.enable_blob_garbage_collection: false 2024-04-25T17:21:27.685 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-04-25T17:21:27.685 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-04-25T17:21:27.686 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-04-25T17:21:27.686 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.blob_file_starting_level: 0 2024-04-25T17:21:27.686 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-04-25T17:21:27.686 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 27.sst 2024-04-25T17:21:27.686 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-04-25T17:21:27.686 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi069/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 29, last_sequence is 12143, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-04-25T17:21:27.686 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-04-25T17:21:27.686 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 49172aaa-fcc4-4699-acb2-0e3a41fa376d 2024-04-25T17:21:27.686 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714065687301249, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-04-25T17:21:27.686 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-04-25T17:21:27.686 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714065687308608, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 1955502, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12148, "largest_seqno": 12664, "table_properties": {"data_size": 1952186, "index_size": 1636, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 5981, "raw_average_key_size": 24, "raw_value_size": 1946613, "raw_average_value_size": 7849, "num_data_blocks": 74, "num_entries": 248, "num_filter_entries": 248, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1714065687, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "49172aaa-fcc4-4699-acb2-0e3a41fa376d", "db_session_id": "YX0IYRTHEGE01A5BTXCF", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-04-25T17:21:27.686 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: EVENT_LOG_v1 {"time_micros": 1714065687308725, "job": 1, "event": "recovery_finished"} 2024-04-25T17:21:27.686 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-04-25T17:21:27.686 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-04-25T17:21:27.686 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi069/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-04-25T17:21:27.687 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x563ec097dc00 2024-04-25T17:21:27.687 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: DB pointer 0x563ec5770000 2024-04-25T17:21:27.687 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-04-25T17:21:27.687 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-04-25T17:21:27.687 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: ** DB Stats ** 2024-04-25T17:21:27.687 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-25T17:21:27.687 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-04-25T17:21:27.687 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-25T17:21:27.687 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-25T17:21:27.687 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-04-25T17:21:27.687 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-04-25T17:21:27.687 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-04-25T17:21:27.687 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: 2024-04-25T17:21:27.687 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: ** Compaction Stats [default] ** 2024-04-25T17:21:27.687 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-25T17:21:27.687 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-04-25T17:21:27.688 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: L0 1/0 1.86 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 615.7 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-04-25T17:21:27.688 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: L6 1/0 6.84 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-04-25T17:21:27.688 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: Sum 2/0 8.70 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 615.7 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-04-25T17:21:27.688 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 615.7 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-04-25T17:21:27.688 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: 2024-04-25T17:21:27.688 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: ** Compaction Stats [default] ** 2024-04-25T17:21:27.688 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-04-25T17:21:27.688 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-04-25T17:21:27.688 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 615.7 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-04-25T17:21:27.688 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: 2024-04-25T17:21:27.688 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-04-25T17:21:27.688 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: 2024-04-25T17:21:27.688 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-04-25T17:21:27.688 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-04-25T17:21:27.688 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-04-25T17:21:27.688 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-04-25T17:21:27.689 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-04-25T17:21:27.689 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: AddFile(Keys): cumulative 0, interval 0 2024-04-25T17:21:27.689 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: Cumulative compaction: 0.00 GB write, 185.21 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-25T17:21:27.689 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: Interval compaction: 0.00 GB write, 185.21 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-04-25T17:21:27.689 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-04-25T17:21:27.689 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: Block cache BinnedLRUCache@0x563ec09991f0#2 capacity: 512.00 MB usage: 2.55 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-04-25T17:21:27.689 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.73 KB,0.000138581%) IndexBlock(1,1.83 KB,0.000348687%) Misc(1,0.00 KB,0%) 2024-04-25T17:21:27.689 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: 2024-04-25T17:21:27.689 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: ** File Read Latency Histogram By Level [default] ** 2024-04-25T17:21:27.689 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: starting mon.smithi069 rank 1 at public addrs [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] at bind addrs [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi069 fsid 599bb7fc-0326-11ef-bc93-c7b262605968 2024-04-25T17:21:27.689 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: mon.smithi069@-1(???) e2 preinit fsid 599bb7fc-0326-11ef-bc93-c7b262605968 2024-04-25T17:21:27.689 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: mon.smithi069@-1(???).mds e16 new map 2024-04-25T17:21:27.689 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: mon.smithi069@-1(???).mds e16 print_map 2024-04-25T17:21:27.689 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: e16 2024-04-25T17:21:27.689 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-04-25T17:21:27.689 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T17:21:27.689 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: legacy client fscid: 1 2024-04-25T17:21:27.690 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: 2024-04-25T17:21:27.690 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: Filesystem 'cephfs' (1) 2024-04-25T17:21:27.690 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: fs_name cephfs 2024-04-25T17:21:27.690 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: epoch 16 2024-04-25T17:21:27.690 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-25T17:21:27.690 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: created 2024-04-25T17:15:40.586130+0000 2024-04-25T17:21:27.690 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: modified 2024-04-25T17:15:57.508740+0000 2024-04-25T17:21:27.690 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: tableserver 0 2024-04-25T17:21:27.690 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: root 0 2024-04-25T17:21:27.690 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: session_timeout 60 2024-04-25T17:21:27.690 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: session_autoclose 300 2024-04-25T17:21:27.690 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: max_file_size 1099511627776 2024-04-25T17:21:27.690 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: max_xattr_size 65536 2024-04-25T17:21:27.690 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: required_client_features {} 2024-04-25T17:21:27.690 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: last_failure 0 2024-04-25T17:21:27.691 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: last_failure_osd_epoch 0 2024-04-25T17:21:27.691 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T17:21:27.691 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: max_mds 1 2024-04-25T17:21:27.691 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: in 0 2024-04-25T17:21:27.691 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: up {0=14470} 2024-04-25T17:21:27.691 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: failed 2024-04-25T17:21:27.691 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: damaged 2024-04-25T17:21:27.691 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: stopped 2024-04-25T17:21:27.691 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: data_pools [3] 2024-04-25T17:21:27.691 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: metadata_pool 2 2024-04-25T17:21:27.691 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: inline_data disabled 2024-04-25T17:21:27.691 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: balancer 2024-04-25T17:21:27.691 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: bal_rank_mask -1 2024-04-25T17:21:27.691 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: standby_count_wanted 1 2024-04-25T17:21:27.691 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: qdb_cluster leader: 0 members: 2024-04-25T17:21:27.692 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: [mds.cephfs.smithi037.ksmixc{0:14470} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.37:6826/1903989494,v1:172.21.15.37:6827/1903989494] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:21:27.692 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: [mds.cephfs.smithi037.ovkrpq{0:14482} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.37:6828/4206394422,v1:172.21.15.37:6829/4206394422] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:21:27.692 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: 2024-04-25T17:21:27.692 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: 2024-04-25T17:21:27.692 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: Standby daemons: 2024-04-25T17:21:27.692 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: 2024-04-25T17:21:27.692 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: [mds.cephfs.smithi069.cpprst{-1:24289} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.69:6826/518856100,v1:172.21.15.69:6827/518856100] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:21:27.692 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout: [mds.cephfs.smithi069.ytlqcf{-1:24293} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.69:6824/134210439,v1:172.21.15.69:6825/134210439] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:21:27.692 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: mon.smithi069@-1(???).osd e49 crush map has features 3314933000852226048, adjusting msgr requires 2024-04-25T17:21:27.692 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: mon.smithi069@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-04-25T17:21:27.692 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: mon.smithi069@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-04-25T17:21:27.692 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: mon.smithi069@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-04-25T17:21:27.692 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: mon.smithi069@-1(???).paxosservice(auth 1..22) refresh upgraded, format 0 -> 3 2024-04-25T17:21:27.692 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 bash[80220]: 7744dbe81b5036399c1cd4721a3c375b20b4ba05858617737dfc8748df4ad385 2024-04-25T17:21:27.692 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 systemd[1]: Started Ceph mon.smithi069 for 599bb7fc-0326-11ef-bc93-c7b262605968. 2024-04-25T17:21:27.693 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:27 smithi069 ceph-mon[80239]: pgmap v9: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 9.7 KiB/s wr, 12 op/s 2024-04-25T17:21:27.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:27 smithi037 ceph-mon[90844]: pgmap v9: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 26 KiB/s rd, 9.7 KiB/s wr, 12 op/s 2024-04-25T17:21:28.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:28 smithi069 ceph-mon[80239]: mgrmap e38: smithi037.txrgxl(active, since 14s), standbys: smithi069.mmuhdo 2024-04-25T17:21:28.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:28 smithi069 ceph-mon[80239]: overall HEALTH_OK 2024-04-25T17:21:28.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:28 smithi069 ceph-mon[80239]: mon.smithi037 calling monitor election 2024-04-25T17:21:28.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:28 smithi069 ceph-mon[80239]: mon.smithi069 calling monitor election 2024-04-25T17:21:28.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:28 smithi069 ceph-mon[80239]: mon.smithi037 is new leader, mons smithi037,smithi069 in quorum (ranks 0,1) 2024-04-25T17:21:28.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:28 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mon metadata", "id": "smithi037"}]: dispatch 2024-04-25T17:21:28.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:28 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mon metadata", "id": "smithi069"}]: dispatch 2024-04-25T17:21:28.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:28 smithi069 ceph-mon[80239]: monmap epoch 3 2024-04-25T17:21:28.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:28 smithi069 ceph-mon[80239]: fsid 599bb7fc-0326-11ef-bc93-c7b262605968 2024-04-25T17:21:28.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:28 smithi069 ceph-mon[80239]: last_changed 2024-04-25T17:21:27.413575+0000 2024-04-25T17:21:28.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:28 smithi069 ceph-mon[80239]: created 2024-04-25T17:08:34.994230+0000 2024-04-25T17:21:28.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:28 smithi069 ceph-mon[80239]: min_mon_release 19 (squid) 2024-04-25T17:21:28.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:28 smithi069 ceph-mon[80239]: election_strategy: 1 2024-04-25T17:21:28.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:28 smithi069 ceph-mon[80239]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.smithi037 2024-04-25T17:21:28.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:28 smithi069 ceph-mon[80239]: 1: [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] mon.smithi069 2024-04-25T17:21:28.670 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:28 smithi069 ceph-mon[80239]: fsmap cephfs:1 {0=cephfs.smithi037.ksmixc=up:active} 1 up:standby-replay 2 up:standby 2024-04-25T17:21:28.670 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:28 smithi069 ceph-mon[80239]: osdmap e49: 6 total, 6 up, 6 in 2024-04-25T17:21:28.670 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:28 smithi069 ceph-mon[80239]: mgrmap e38: smithi037.txrgxl(active, since 14s), standbys: smithi069.mmuhdo 2024-04-25T17:21:28.670 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:28 smithi069 ceph-mon[80239]: overall HEALTH_OK 2024-04-25T17:21:28.670 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:28 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:28.670 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:28 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:28.670 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:28 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:21:28.670 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:28 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:21:28.724 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:28 smithi037 ceph-mon[90844]: mgrmap e38: smithi037.txrgxl(active, since 14s), standbys: smithi069.mmuhdo 2024-04-25T17:21:28.724 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:28 smithi037 ceph-mon[90844]: overall HEALTH_OK 2024-04-25T17:21:28.724 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:28 smithi037 ceph-mon[90844]: mon.smithi037 calling monitor election 2024-04-25T17:21:28.724 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:28 smithi037 ceph-mon[90844]: mon.smithi069 calling monitor election 2024-04-25T17:21:28.724 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:28 smithi037 ceph-mon[90844]: mon.smithi037 is new leader, mons smithi037,smithi069 in quorum (ranks 0,1) 2024-04-25T17:21:28.724 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:28 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mon metadata", "id": "smithi037"}]: dispatch 2024-04-25T17:21:28.724 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:28 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mon metadata", "id": "smithi069"}]: dispatch 2024-04-25T17:21:28.724 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:28 smithi037 ceph-mon[90844]: monmap epoch 3 2024-04-25T17:21:28.724 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:28 smithi037 ceph-mon[90844]: fsid 599bb7fc-0326-11ef-bc93-c7b262605968 2024-04-25T17:21:28.725 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:28 smithi037 ceph-mon[90844]: last_changed 2024-04-25T17:21:27.413575+0000 2024-04-25T17:21:28.725 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:28 smithi037 ceph-mon[90844]: created 2024-04-25T17:08:34.994230+0000 2024-04-25T17:21:28.725 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:28 smithi037 ceph-mon[90844]: min_mon_release 19 (squid) 2024-04-25T17:21:28.725 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:28 smithi037 ceph-mon[90844]: election_strategy: 1 2024-04-25T17:21:28.725 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:28 smithi037 ceph-mon[90844]: 0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.smithi037 2024-04-25T17:21:28.725 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:28 smithi037 ceph-mon[90844]: 1: [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] mon.smithi069 2024-04-25T17:21:28.725 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:28 smithi037 ceph-mon[90844]: fsmap cephfs:1 {0=cephfs.smithi037.ksmixc=up:active} 1 up:standby-replay 2 up:standby 2024-04-25T17:21:28.725 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:28 smithi037 ceph-mon[90844]: osdmap e49: 6 total, 6 up, 6 in 2024-04-25T17:21:28.725 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:28 smithi037 ceph-mon[90844]: mgrmap e38: smithi037.txrgxl(active, since 14s), standbys: smithi069.mmuhdo 2024-04-25T17:21:28.725 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:28 smithi037 ceph-mon[90844]: overall HEALTH_OK 2024-04-25T17:21:28.725 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:28 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:28.725 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:28 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:28.725 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:28 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:21:28.725 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:28 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:21:29.691 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:29 smithi069 ceph-mon[80239]: pgmap v11: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 8.8 KiB/s wr, 10 op/s 2024-04-25T17:21:29.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:29 smithi037 ceph-mon[90844]: pgmap v11: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 8.8 KiB/s wr, 10 op/s 2024-04-25T17:21:31.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:31 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:31.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:31 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:31.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:31 smithi069 ceph-mon[80239]: pgmap v12: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 8.8 KiB/s wr, 11 op/s 2024-04-25T17:21:31.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:31 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:31.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:31 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:31.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:31 smithi037 ceph-mon[90844]: pgmap v12: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 8.8 KiB/s wr, 11 op/s 2024-04-25T17:21:32.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:32 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:32.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:32 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:32.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:32 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:32.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:32 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:33.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:33 smithi069 ceph-mon[80239]: pgmap v13: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:21:33.708 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:33 smithi037 ceph-mon[90844]: pgmap v13: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:21:36.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:35 smithi069 ceph-mon[80239]: pgmap v14: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:21:36.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:35 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:36.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:35 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:36.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:35 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:21:36.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:35 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:21:36.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:35 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:36.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:35 smithi069 ceph-mon[80239]: Reconfiguring mon.smithi037 (monmap changed)... 2024-04-25T17:21:36.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:35 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T17:21:36.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:35 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-25T17:21:36.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:35 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:21:36.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:35 smithi069 ceph-mon[80239]: Reconfiguring daemon mon.smithi037 on smithi037 2024-04-25T17:21:36.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:35 smithi037 ceph-mon[90844]: pgmap v14: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:21:36.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:35 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:36.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:35 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:36.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:35 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:21:36.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:35 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:21:36.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:35 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:36.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:35 smithi037 ceph-mon[90844]: Reconfiguring mon.smithi037 (monmap changed)... 2024-04-25T17:21:36.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:35 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T17:21:36.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:35 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-25T17:21:36.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:35 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:21:36.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:35 smithi037 ceph-mon[90844]: Reconfiguring daemon mon.smithi037 on smithi037 2024-04-25T17:21:38.058 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:37 smithi037 ceph-mon[90844]: pgmap v15: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:21:38.058 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:37 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:38.058 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:37 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:38.058 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:37 smithi037 ceph-mon[90844]: Reconfiguring mgr.smithi037.txrgxl (monmap changed)... 2024-04-25T17:21:38.058 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:37 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi037.txrgxl", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T17:21:38.058 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:37 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T17:21:38.058 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:37 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:21:38.058 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:37 smithi037 ceph-mon[90844]: Reconfiguring daemon mgr.smithi037.txrgxl on smithi037 2024-04-25T17:21:38.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:37 smithi069 ceph-mon[80239]: pgmap v15: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:21:38.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:37 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:38.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:37 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:38.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:37 smithi069 ceph-mon[80239]: Reconfiguring mgr.smithi037.txrgxl (monmap changed)... 2024-04-25T17:21:38.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:37 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi037.txrgxl", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T17:21:38.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:37 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T17:21:38.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:37 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:21:38.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:37 smithi069 ceph-mon[80239]: Reconfiguring daemon mgr.smithi037.txrgxl on smithi037 2024-04-25T17:21:39.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:39 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:39.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:39 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:39.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:39 smithi037 ceph-mon[90844]: Reconfiguring crash.smithi037 (monmap changed)... 2024-04-25T17:21:39.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:39 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi037", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-25T17:21:39.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:39 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:21:39.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:39 smithi037 ceph-mon[90844]: Reconfiguring daemon crash.smithi037 on smithi037 2024-04-25T17:21:39.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:39 smithi037 ceph-mon[90844]: pgmap v16: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:21:39.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:39 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:39.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:39 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:39.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:39 smithi069 ceph-mon[80239]: Reconfiguring crash.smithi037 (monmap changed)... 2024-04-25T17:21:39.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:39 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi037", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-25T17:21:39.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:39 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:21:39.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:39 smithi069 ceph-mon[80239]: Reconfiguring daemon crash.smithi037 on smithi037 2024-04-25T17:21:39.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:39 smithi069 ceph-mon[80239]: pgmap v16: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:21:41.305 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:40 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:41.305 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:40 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:41.305 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:40 smithi037 ceph-mon[90844]: Reconfiguring osd.0 (monmap changed)... 2024-04-25T17:21:41.305 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:40 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-25T17:21:41.305 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:40 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:21:41.305 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:40 smithi037 ceph-mon[90844]: Reconfiguring daemon osd.0 on smithi037 2024-04-25T17:21:41.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:40 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:41.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:40 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:41.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:40 smithi069 ceph-mon[80239]: Reconfiguring osd.0 (monmap changed)... 2024-04-25T17:21:41.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:40 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-25T17:21:41.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:40 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:21:41.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:40 smithi069 ceph-mon[80239]: Reconfiguring daemon osd.0 on smithi037 2024-04-25T17:21:42.297 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:41 smithi037 ceph-mon[90844]: pgmap v17: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:21:42.297 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:41 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:42.297 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:41 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:42.297 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:41 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-25T17:21:42.297 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:41 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:21:42.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:41 smithi069 ceph-mon[80239]: pgmap v17: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:21:42.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:41 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:42.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:41 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:42.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:41 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-25T17:21:42.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:41 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:21:43.228 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:42 smithi037 ceph-mon[90844]: Reconfiguring osd.1 (monmap changed)... 2024-04-25T17:21:43.228 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:42 smithi037 ceph-mon[90844]: Reconfiguring daemon osd.1 on smithi037 2024-04-25T17:21:43.228 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:42 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:21:43.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:42 smithi069 ceph-mon[80239]: Reconfiguring osd.1 (monmap changed)... 2024-04-25T17:21:43.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:42 smithi069 ceph-mon[80239]: Reconfiguring daemon osd.1 on smithi037 2024-04-25T17:21:43.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:42 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:21:44.240 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:43 smithi037 ceph-mon[90844]: pgmap v18: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:21:44.240 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:43 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:44.240 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:43 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:44.240 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:43 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-25T17:21:44.240 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:43 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:21:44.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:43 smithi069 ceph-mon[80239]: pgmap v18: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:21:44.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:43 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:44.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:43 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:44.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:43 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-25T17:21:44.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:43 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:21:45.321 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:44 smithi037 ceph-mon[90844]: Reconfiguring osd.2 (monmap changed)... 2024-04-25T17:21:45.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:44 smithi037 ceph-mon[90844]: Reconfiguring daemon osd.2 on smithi037 2024-04-25T17:21:45.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:44 smithi069 ceph-mon[80239]: Reconfiguring osd.2 (monmap changed)... 2024-04-25T17:21:45.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:44 smithi069 ceph-mon[80239]: Reconfiguring daemon osd.2 on smithi037 2024-04-25T17:21:45.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:45.946+0000 7fd38483d700 1 -- 172.21.15.37:0/2136077154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3800fce80 msgr2=0x7fd3800fd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:21:45.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:45.946+0000 7fd38483d700 1 --2- 172.21.15.37:0/2136077154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3800fce80 0x7fd3800fd290 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd370004940 tx=0x7fd370009e30 comp rx=0 tx=0).stop 2024-04-25T17:21:45.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:45.946+0000 7fd38483d700 1 -- 172.21.15.37:0/2136077154 shutdown_connections 2024-04-25T17:21:45.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:45.946+0000 7fd38483d700 1 --2- 172.21.15.37:0/2136077154 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3800fdff0 0x7fd3800fe460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:45.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:45.946+0000 7fd38483d700 1 --2- 172.21.15.37:0/2136077154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3800fce80 0x7fd3800fd290 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:45.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:45.946+0000 7fd38483d700 1 -- 172.21.15.37:0/2136077154 >> 172.21.15.37:0/2136077154 conn(0x7fd3800f8580 msgr2=0x7fd3800fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:21:45.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:45.946+0000 7fd38483d700 1 -- 172.21.15.37:0/2136077154 shutdown_connections 2024-04-25T17:21:45.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:45.946+0000 7fd38483d700 1 -- 172.21.15.37:0/2136077154 wait complete. 2024-04-25T17:21:45.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:45.947+0000 7fd38483d700 1 Processor -- start 2024-04-25T17:21:45.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:45.947+0000 7fd38483d700 1 -- start start 2024-04-25T17:21:45.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:45.947+0000 7fd38483d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3800fce80 0x7fd38010fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:21:45.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:45.947+0000 7fd38483d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3800fdff0 0x7fd380110080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:21:45.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:45.947+0000 7fd38483d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd380110680 con 0x7fd3800fdff0 2024-04-25T17:21:45.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:45.947+0000 7fd38483d700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3801107f0 con 0x7fd3800fce80 2024-04-25T17:21:45.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:45.947+0000 7fd37dd9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3800fdff0 0x7fd380110080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:21:45.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:45.947+0000 7fd37dd9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3800fdff0 0x7fd380110080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47700/0 (socket says 172.21.15.37:47700) 2024-04-25T17:21:45.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:45.947+0000 7fd37dd9b700 1 -- 172.21.15.37:0/1868227166 learned_addr learned my addr 172.21.15.37:0/1868227166 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:21:45.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:45.948+0000 7fd37e59c700 1 --2- 172.21.15.37:0/1868227166 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3800fce80 0x7fd38010fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:21:45.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:45.948+0000 7fd37dd9b700 1 -- 172.21.15.37:0/1868227166 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3800fce80 msgr2=0x7fd38010fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:21:45.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:45.948+0000 7fd37dd9b700 1 --2- 172.21.15.37:0/1868227166 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3800fce80 0x7fd38010fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:45.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:45.948+0000 7fd37dd9b700 1 -- 172.21.15.37:0/1868227166 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd370005040 con 0x7fd3800fdff0 2024-04-25T17:21:45.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:45.948+0000 7fd37e59c700 1 --2- 172.21.15.37:0/1868227166 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3800fce80 0x7fd38010fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T17:21:45.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:45.948+0000 7fd37dd9b700 1 --2- 172.21.15.37:0/1868227166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3800fdff0 0x7fd380110080 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd374002a50 tx=0x7fd3740046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:21:45.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:45.949+0000 7fd36effd700 1 -- 172.21.15.37:0/1868227166 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd374007cc0 con 0x7fd3800fdff0 2024-04-25T17:21:45.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:45.949+0000 7fd36effd700 1 -- 172.21.15.37:0/1868227166 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd37400f040 con 0x7fd3800fdff0 2024-04-25T17:21:45.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:45.949+0000 7fd38483d700 1 -- 172.21.15.37:0/1868227166 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd380115250 con 0x7fd3800fdff0 2024-04-25T17:21:45.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:45.949+0000 7fd36effd700 1 -- 172.21.15.37:0/1868227166 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd37400da30 con 0x7fd3800fdff0 2024-04-25T17:21:45.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:45.949+0000 7fd38483d700 1 -- 172.21.15.37:0/1868227166 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd380115810 con 0x7fd3800fdff0 2024-04-25T17:21:45.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:45.950+0000 7fd38483d700 1 -- 172.21.15.37:0/1868227166 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd380101980 con 0x7fd3800fdff0 2024-04-25T17:21:45.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:45.952+0000 7fd36effd700 1 -- 172.21.15.37:0/1868227166 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 38) v1 ==== 98763+0+0 (secure 0 0 0) 0x7fd37400dbb0 con 0x7fd3800fdff0 2024-04-25T17:21:45.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:45.952+0000 7fd36effd700 1 --2- 172.21.15.37:0/1868227166 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fd368076ca0 0x7fd368079150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:21:45.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:45.952+0000 7fd36effd700 1 -- 172.21.15.37:0/1868227166 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fd374098220 con 0x7fd3800fdff0 2024-04-25T17:21:45.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:45.952+0000 7fd37e59c700 1 --2- 172.21.15.37:0/1868227166 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fd368076ca0 0x7fd368079150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:21:45.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:45.953+0000 7fd37e59c700 1 --2- 172.21.15.37:0/1868227166 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fd368076ca0 0x7fd368079150 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd37000b970 tx=0x7fd370009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:21:45.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:45.957+0000 7fd36effd700 1 -- 172.21.15.37:0/1868227166 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fd374060c00 con 0x7fd3800fdff0 2024-04-25T17:21:46.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:45 smithi037 ceph-mon[90844]: pgmap v19: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:21:46.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:45 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:46.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:45 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:46.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:45 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi037.ksmixc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T17:21:46.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:45 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:21:46.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.190+0000 7fd38483d700 1 -- 172.21.15.37:0/1868227166 --> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd38002b3b0 con 0x7fd368076ca0 2024-04-25T17:21:46.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.192+0000 7fd36effd700 1 -- 172.21.15.37:0/1868227166 <== mgr.34104 v2:172.21.15.37:6800/783197737 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fd38002b3b0 con 0x7fd368076ca0 2024-04-25T17:21:46.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.194+0000 7fd38483d700 1 -- 172.21.15.37:0/1868227166 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fd368076ca0 msgr2=0x7fd368079150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:21:46.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.194+0000 7fd38483d700 1 --2- 172.21.15.37:0/1868227166 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fd368076ca0 0x7fd368079150 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd37000b970 tx=0x7fd370009e30 comp rx=0 tx=0).stop 2024-04-25T17:21:46.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.194+0000 7fd38483d700 1 -- 172.21.15.37:0/1868227166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3800fdff0 msgr2=0x7fd380110080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:21:46.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.194+0000 7fd38483d700 1 --2- 172.21.15.37:0/1868227166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3800fdff0 0x7fd380110080 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd374002a50 tx=0x7fd3740046b0 comp rx=0 tx=0).stop 2024-04-25T17:21:46.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.194+0000 7fd38483d700 1 -- 172.21.15.37:0/1868227166 shutdown_connections 2024-04-25T17:21:46.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.194+0000 7fd38483d700 1 --2- 172.21.15.37:0/1868227166 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fd368076ca0 0x7fd368079150 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:46.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.194+0000 7fd38483d700 1 --2- 172.21.15.37:0/1868227166 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3800fce80 0x7fd38010fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:46.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.194+0000 7fd38483d700 1 --2- 172.21.15.37:0/1868227166 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3800fdff0 0x7fd380110080 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:46.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.194+0000 7fd38483d700 1 -- 172.21.15.37:0/1868227166 >> 172.21.15.37:0/1868227166 conn(0x7fd3800f8580 msgr2=0x7fd3800f9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:21:46.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.194+0000 7fd38483d700 1 -- 172.21.15.37:0/1868227166 shutdown_connections 2024-04-25T17:21:46.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.194+0000 7fd38483d700 1 -- 172.21.15.37:0/1868227166 wait complete. 2024-04-25T17:21:46.206 INFO:teuthology.orchestra.run.smithi037.stdout:true 2024-04-25T17:21:46.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.299+0000 7fd572e9c700 1 -- 172.21.15.37:0/2688574969 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd56c066f30 msgr2=0x7fd56c0ff9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:21:46.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.299+0000 7fd572e9c700 1 --2- 172.21.15.37:0/2688574969 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd56c066f30 0x7fd56c0ff9d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd560004940 tx=0x7fd560009e30 comp rx=0 tx=0).stop 2024-04-25T17:21:46.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.299+0000 7fd572e9c700 1 -- 172.21.15.37:0/2688574969 shutdown_connections 2024-04-25T17:21:46.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.299+0000 7fd572e9c700 1 --2- 172.21.15.37:0/2688574969 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd56c0fff10 0x7fd56c102330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:46.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.299+0000 7fd572e9c700 1 --2- 172.21.15.37:0/2688574969 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd56c066f30 0x7fd56c0ff9d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:46.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.299+0000 7fd572e9c700 1 -- 172.21.15.37:0/2688574969 >> 172.21.15.37:0/2688574969 conn(0x7fd56c0f7440 msgr2=0x7fd56c0f9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:21:46.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.299+0000 7fd572e9c700 1 -- 172.21.15.37:0/2688574969 shutdown_connections 2024-04-25T17:21:46.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.299+0000 7fd572e9c700 1 -- 172.21.15.37:0/2688574969 wait complete. 2024-04-25T17:21:46.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.299+0000 7fd572e9c700 1 Processor -- start 2024-04-25T17:21:46.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.299+0000 7fd572e9c700 1 -- start start 2024-04-25T17:21:46.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.300+0000 7fd572e9c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd56c066f30 0x7fd56c0fd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:21:46.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.300+0000 7fd572e9c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd56c0fff10 0x7fd56c0fb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:21:46.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.300+0000 7fd572e9c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56c0fd7d0 con 0x7fd56c066f30 2024-04-25T17:21:46.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.300+0000 7fd572e9c700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56c0fbe10 con 0x7fd56c0fff10 2024-04-25T17:21:46.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.300+0000 7fd570c38700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd56c066f30 0x7fd56c0fd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:21:46.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.300+0000 7fd570c38700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd56c066f30 0x7fd56c0fd1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47730/0 (socket says 172.21.15.37:47730) 2024-04-25T17:21:46.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.300+0000 7fd570c38700 1 -- 172.21.15.37:0/2974453682 learned_addr learned my addr 172.21.15.37:0/2974453682 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:21:46.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.300+0000 7fd570c38700 1 -- 172.21.15.37:0/2974453682 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd56c0fff10 msgr2=0x7fd56c0fb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:21:46.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.300+0000 7fd570c38700 1 --2- 172.21.15.37:0/2974453682 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd56c0fff10 0x7fd56c0fb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:46.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.300+0000 7fd570c38700 1 -- 172.21.15.37:0/2974453682 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd560005040 con 0x7fd56c066f30 2024-04-25T17:21:46.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.300+0000 7fd570c38700 1 --2- 172.21.15.37:0/2974453682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd56c066f30 0x7fd56c0fd1d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd56000b970 tx=0x7fd560009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:21:46.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.300+0000 7fd5697fa700 1 -- 172.21.15.37:0/2974453682 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd56000e040 con 0x7fd56c066f30 2024-04-25T17:21:46.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.300+0000 7fd5697fa700 1 -- 172.21.15.37:0/2974453682 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd56000bbf0 con 0x7fd56c066f30 2024-04-25T17:21:46.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.300+0000 7fd572e9c700 1 -- 172.21.15.37:0/2974453682 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd56c0fc090 con 0x7fd56c066f30 2024-04-25T17:21:46.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.300+0000 7fd5697fa700 1 -- 172.21.15.37:0/2974453682 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd56001c630 con 0x7fd56c066f30 2024-04-25T17:21:46.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.301+0000 7fd572e9c700 1 -- 172.21.15.37:0/2974453682 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd56c0fc5d0 con 0x7fd56c066f30 2024-04-25T17:21:46.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.301+0000 7fd572e9c700 1 -- 172.21.15.37:0/2974453682 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd56c04c710 con 0x7fd56c066f30 2024-04-25T17:21:46.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.302+0000 7fd5697fa700 1 -- 172.21.15.37:0/2974453682 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 38) v1 ==== 98763+0+0 (secure 0 0 0) 0x7fd56000bd60 con 0x7fd56c066f30 2024-04-25T17:21:46.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.303+0000 7fd5697fa700 1 --2- 172.21.15.37:0/2974453682 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fd55c076ca0 0x7fd55c079150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:21:46.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.303+0000 7fd5697fa700 1 -- 172.21.15.37:0/2974453682 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fd560099800 con 0x7fd56c066f30 2024-04-25T17:21:46.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.303+0000 7fd56bfff700 1 --2- 172.21.15.37:0/2974453682 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fd55c076ca0 0x7fd55c079150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:21:46.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.303+0000 7fd56bfff700 1 --2- 172.21.15.37:0/2974453682 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fd55c076ca0 0x7fd55c079150 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd558004ad0 tx=0x7fd558007d40 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:21:46.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.308+0000 7fd5697fa700 1 -- 172.21.15.37:0/2974453682 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fd560062280 con 0x7fd56c066f30 2024-04-25T17:21:46.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:45 smithi069 ceph-mon[80239]: pgmap v19: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:21:46.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:45 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:46.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:45 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:46.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:45 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi037.ksmixc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T17:21:46.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:45 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:21:46.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.538+0000 7fd572e9c700 1 -- 172.21.15.37:0/2974453682 --> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd56c0f8f80 con 0x7fd55c076ca0 2024-04-25T17:21:46.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.540+0000 7fd5697fa700 1 -- 172.21.15.37:0/2974453682 <== mgr.34104 v2:172.21.15.37:6800/783197737 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fd56c0f8f80 con 0x7fd55c076ca0 2024-04-25T17:21:46.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.542+0000 7fd572e9c700 1 -- 172.21.15.37:0/2974453682 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fd55c076ca0 msgr2=0x7fd55c079150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:21:46.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.542+0000 7fd572e9c700 1 --2- 172.21.15.37:0/2974453682 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fd55c076ca0 0x7fd55c079150 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd558004ad0 tx=0x7fd558007d40 comp rx=0 tx=0).stop 2024-04-25T17:21:46.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.542+0000 7fd572e9c700 1 -- 172.21.15.37:0/2974453682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd56c066f30 msgr2=0x7fd56c0fd1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:21:46.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.542+0000 7fd572e9c700 1 --2- 172.21.15.37:0/2974453682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd56c066f30 0x7fd56c0fd1d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd56000b970 tx=0x7fd560009e30 comp rx=0 tx=0).stop 2024-04-25T17:21:46.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.542+0000 7fd572e9c700 1 -- 172.21.15.37:0/2974453682 shutdown_connections 2024-04-25T17:21:46.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.542+0000 7fd572e9c700 1 --2- 172.21.15.37:0/2974453682 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fd55c076ca0 0x7fd55c079150 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:46.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.542+0000 7fd572e9c700 1 --2- 172.21.15.37:0/2974453682 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd56c066f30 0x7fd56c0fd1d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:46.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.542+0000 7fd572e9c700 1 --2- 172.21.15.37:0/2974453682 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd56c0fff10 0x7fd56c0fb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:46.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.542+0000 7fd572e9c700 1 -- 172.21.15.37:0/2974453682 >> 172.21.15.37:0/2974453682 conn(0x7fd56c0f7440 msgr2=0x7fd56c0f7860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:21:46.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.542+0000 7fd572e9c700 1 -- 172.21.15.37:0/2974453682 shutdown_connections 2024-04-25T17:21:46.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.542+0000 7fd572e9c700 1 -- 172.21.15.37:0/2974453682 wait complete. 2024-04-25T17:21:46.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.648+0000 7f9d8da9a700 1 -- 172.21.15.37:0/31101957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d880fcf10 msgr2=0x7f9d880fd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:21:46.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.648+0000 7f9d8da9a700 1 --2- 172.21.15.37:0/31101957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d880fcf10 0x7f9d880fd320 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9d78004940 tx=0x7f9d78009e30 comp rx=0 tx=0).stop 2024-04-25T17:21:46.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.648+0000 7f9d8da9a700 1 -- 172.21.15.37:0/31101957 shutdown_connections 2024-04-25T17:21:46.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.648+0000 7f9d8da9a700 1 --2- 172.21.15.37:0/31101957 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d880fe080 0x7f9d880fe4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:46.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.648+0000 7f9d8da9a700 1 --2- 172.21.15.37:0/31101957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d880fcf10 0x7f9d880fd320 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:46.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.648+0000 7f9d8da9a700 1 -- 172.21.15.37:0/31101957 >> 172.21.15.37:0/31101957 conn(0x7f9d880f8560 msgr2=0x7f9d880fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:21:46.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.648+0000 7f9d8da9a700 1 -- 172.21.15.37:0/31101957 shutdown_connections 2024-04-25T17:21:46.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.648+0000 7f9d8da9a700 1 -- 172.21.15.37:0/31101957 wait complete. 2024-04-25T17:21:46.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.648+0000 7f9d8da9a700 1 Processor -- start 2024-04-25T17:21:46.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.649+0000 7f9d8da9a700 1 -- start start 2024-04-25T17:21:46.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.649+0000 7f9d8da9a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d880fcf10 0x7f9d88071de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:21:46.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.649+0000 7f9d8da9a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d880fe080 0x7f9d880702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:21:46.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.649+0000 7f9d8da9a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d88070860 con 0x7f9d880fcf10 2024-04-25T17:21:46.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.649+0000 7f9d8da9a700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d880709d0 con 0x7f9d880fe080 2024-04-25T17:21:46.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.649+0000 7f9d877fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d880fcf10 0x7f9d88071de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:21:46.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.649+0000 7f9d877fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d880fcf10 0x7f9d88071de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47740/0 (socket says 172.21.15.37:47740) 2024-04-25T17:21:46.652 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.649+0000 7f9d877fe700 1 -- 172.21.15.37:0/4110491885 learned_addr learned my addr 172.21.15.37:0/4110491885 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:21:46.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.649+0000 7f9d86ffd700 1 --2- 172.21.15.37:0/4110491885 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d880fe080 0x7f9d880702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:21:46.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.649+0000 7f9d877fe700 1 -- 172.21.15.37:0/4110491885 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d880fe080 msgr2=0x7f9d880702b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:21:46.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.649+0000 7f9d877fe700 1 --2- 172.21.15.37:0/4110491885 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d880fe080 0x7f9d880702b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:46.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.649+0000 7f9d877fe700 1 -- 172.21.15.37:0/4110491885 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d78005040 con 0x7f9d880fcf10 2024-04-25T17:21:46.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.649+0000 7f9d877fe700 1 --2- 172.21.15.37:0/4110491885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d880fcf10 0x7f9d88071de0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9d7800b3b0 tx=0x7f9d78009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:21:46.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.650+0000 7f9d6ffff700 1 -- 172.21.15.37:0/4110491885 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d7800e040 con 0x7f9d880fcf10 2024-04-25T17:21:46.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.650+0000 7f9d6ffff700 1 -- 172.21.15.37:0/4110491885 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9d7800bcc0 con 0x7f9d880fcf10 2024-04-25T17:21:46.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.650+0000 7f9d8da9a700 1 -- 172.21.15.37:0/4110491885 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d88070c50 con 0x7f9d880fcf10 2024-04-25T17:21:46.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.650+0000 7f9d6ffff700 1 -- 172.21.15.37:0/4110491885 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d7801c630 con 0x7f9d880fcf10 2024-04-25T17:21:46.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.650+0000 7f9d8da9a700 1 -- 172.21.15.37:0/4110491885 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d88115a10 con 0x7f9d880fcf10 2024-04-25T17:21:46.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.651+0000 7f9d8da9a700 1 -- 172.21.15.37:0/4110491885 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d8805f5c0 con 0x7f9d880fcf10 2024-04-25T17:21:46.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.651+0000 7f9d6ffff700 1 -- 172.21.15.37:0/4110491885 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 38) v1 ==== 98763+0+0 (secure 0 0 0) 0x7f9d78013980 con 0x7f9d880fcf10 2024-04-25T17:21:46.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.652+0000 7f9d6ffff700 1 --2- 172.21.15.37:0/4110491885 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f9d70076ca0 0x7f9d70079150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:21:46.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.652+0000 7f9d6ffff700 1 -- 172.21.15.37:0/4110491885 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f9d78099270 con 0x7f9d880fcf10 2024-04-25T17:21:46.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.652+0000 7f9d86ffd700 1 --2- 172.21.15.37:0/4110491885 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f9d70076ca0 0x7f9d70079150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:21:46.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.652+0000 7f9d86ffd700 1 --2- 172.21.15.37:0/4110491885 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f9d70076ca0 0x7f9d70079150 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c007fd0 tx=0x7f9d7c009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:21:46.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.657+0000 7f9d6ffff700 1 -- 172.21.15.37:0/4110491885 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f9d78061bd0 con 0x7f9d880fcf10 2024-04-25T17:21:46.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.879+0000 7f9d8da9a700 1 -- 172.21.15.37:0/4110491885 --> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9d881023a0 con 0x7f9d70076ca0 2024-04-25T17:21:46.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.890+0000 7f9d6ffff700 1 -- 172.21.15.37:0/4110491885 <== mgr.34104 v2:172.21.15.37:6800/783197737 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f9d881023a0 con 0x7f9d70076ca0 2024-04-25T17:21:46.892 INFO:teuthology.orchestra.run.smithi037.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-25T17:21:46.892 INFO:teuthology.orchestra.run.smithi037.stdout:alertmanager.smithi037 smithi037 *:9093,9094 running (3m) 27s ago 11m 27.7M - 0.25.0 c8568f914cd2 18aed8f409ee 2024-04-25T17:21:46.892 INFO:teuthology.orchestra.run.smithi037.stdout:crash.smithi037 smithi037 running (11m) 27s ago 11m 6656k - 17.2.7-902-gc61472c8 0de407c1b3af b3d152574e80 2024-04-25T17:21:46.892 INFO:teuthology.orchestra.run.smithi037.stdout:crash.smithi069 smithi069 running (10m) 16s ago 10m 6660k - 17.2.7-902-gc61472c8 0de407c1b3af aa6086c64cc3 2024-04-25T17:21:46.892 INFO:teuthology.orchestra.run.smithi037.stdout:grafana.smithi037 smithi037 *:3000 running (3m) 27s ago 11m 85.2M - 9.4.7 954c08fa6188 1eff3ea3f9b0 2024-04-25T17:21:46.892 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi037.ksmixc smithi037 running (6m) 27s ago 6m 163M - 17.2.7-902-gc61472c8 0de407c1b3af 394aa56079b4 2024-04-25T17:21:46.892 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi037.ovkrpq smithi037 running (5m) 27s ago 5m 111M - 17.2.7-902-gc61472c8 0de407c1b3af 73ca662174a7 2024-04-25T17:21:46.892 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi069.cpprst smithi069 running (5m) 16s ago 5m 15.2M - 17.2.7-902-gc61472c8 0de407c1b3af dbda101df20e 2024-04-25T17:21:46.892 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi069.ytlqcf smithi069 running (5m) 16s ago 5m 13.3M - 17.2.7-902-gc61472c8 0de407c1b3af 911df6b18215 2024-04-25T17:21:46.893 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.smithi037.txrgxl smithi037 *:8443,9283,8765 running (2m) 27s ago 13m 547M - 19.0.0-3291-g994e2f20 d53c96779a29 e9653fc62df9 2024-04-25T17:21:46.893 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.smithi069.mmuhdo smithi069 *:8443,9283,8765 running (76s) 16s ago 10m 516M - 19.0.0-3291-g994e2f20 d53c96779a29 6820207b4019 2024-04-25T17:21:46.893 INFO:teuthology.orchestra.run.smithi037.stdout:mon.smithi037 smithi037 running (45s) 27s ago 13m 97.7M 2048M 19.0.0-3291-g994e2f20 d53c96779a29 1b349f3af69d 2024-04-25T17:21:46.893 INFO:teuthology.orchestra.run.smithi037.stdout:mon.smithi069 smithi069 running (19s) 16s ago 10m 87.3M 2048M 19.0.0-3291-g994e2f20 d53c96779a29 7744dbe81b50 2024-04-25T17:21:46.893 INFO:teuthology.orchestra.run.smithi037.stdout:node-exporter.smithi037 smithi037 *:9100 running (3m) 27s ago 11m 14.0M - 1.5.0 0da6a335fe13 1e59bbb2aa82 2024-04-25T17:21:46.893 INFO:teuthology.orchestra.run.smithi037.stdout:node-exporter.smithi069 smithi069 *:9100 running (2m) 16s ago 10m 16.7M - 1.5.0 0da6a335fe13 0c51a9833fe4 2024-04-25T17:21:46.893 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0 smithi037 running (9m) 27s ago 9m 227M 1559M 17.2.7-902-gc61472c8 0de407c1b3af 8ff4b0f1aae9 2024-04-25T17:21:46.893 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1 smithi037 running (9m) 27s ago 9m 242M 1559M 17.2.7-902-gc61472c8 0de407c1b3af 5715a5da241d 2024-04-25T17:21:46.893 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2 smithi037 running (8m) 27s ago 8m 204M 1559M 17.2.7-902-gc61472c8 0de407c1b3af 2eedaf9886dd 2024-04-25T17:21:46.893 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3 smithi069 running (8m) 16s ago 8m 275M 2581M 17.2.7-902-gc61472c8 0de407c1b3af ebba78fb1923 2024-04-25T17:21:46.893 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4 smithi069 running (7m) 16s ago 7m 252M 2581M 17.2.7-902-gc61472c8 0de407c1b3af ba7b785c50f9 2024-04-25T17:21:46.893 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5 smithi069 running (7m) 16s ago 7m 228M 2581M 17.2.7-902-gc61472c8 0de407c1b3af f6be99c364ff 2024-04-25T17:21:46.893 INFO:teuthology.orchestra.run.smithi037.stdout:prometheus.smithi037 smithi037 *:9095 running (83s) 27s ago 10m 53.3M - 2.43.0 a07b618ecd1d 2c5a268ffc1f 2024-04-25T17:21:46.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.892+0000 7f9d8da9a700 1 -- 172.21.15.37:0/4110491885 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f9d70076ca0 msgr2=0x7f9d70079150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:21:46.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.892+0000 7f9d8da9a700 1 --2- 172.21.15.37:0/4110491885 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f9d70076ca0 0x7f9d70079150 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c007fd0 tx=0x7f9d7c009040 comp rx=0 tx=0).stop 2024-04-25T17:21:46.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.892+0000 7f9d8da9a700 1 -- 172.21.15.37:0/4110491885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d880fcf10 msgr2=0x7f9d88071de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:21:46.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.892+0000 7f9d8da9a700 1 --2- 172.21.15.37:0/4110491885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d880fcf10 0x7f9d88071de0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9d7800b3b0 tx=0x7f9d78009e30 comp rx=0 tx=0).stop 2024-04-25T17:21:46.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.893+0000 7f9d8da9a700 1 -- 172.21.15.37:0/4110491885 shutdown_connections 2024-04-25T17:21:46.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.893+0000 7f9d8da9a700 1 --2- 172.21.15.37:0/4110491885 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f9d70076ca0 0x7f9d70079150 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:46.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.893+0000 7f9d8da9a700 1 --2- 172.21.15.37:0/4110491885 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d880fcf10 0x7f9d88071de0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:46.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.893+0000 7f9d8da9a700 1 --2- 172.21.15.37:0/4110491885 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d880fe080 0x7f9d880702b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:46.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.893+0000 7f9d8da9a700 1 -- 172.21.15.37:0/4110491885 >> 172.21.15.37:0/4110491885 conn(0x7f9d880f8560 msgr2=0x7f9d880f9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:21:46.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.893+0000 7f9d8da9a700 1 -- 172.21.15.37:0/4110491885 shutdown_connections 2024-04-25T17:21:46.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:46.893+0000 7f9d8da9a700 1 -- 172.21.15.37:0/4110491885 wait complete. 2024-04-25T17:21:47.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.007+0000 7fb693fa0700 1 -- 172.21.15.37:0/843100300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb68c1023d0 msgr2=0x7fb68c1047b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:21:47.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.007+0000 7fb693fa0700 1 --2- 172.21.15.37:0/843100300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb68c1023d0 0x7fb68c1047b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb67c004940 tx=0x7fb67c009e30 comp rx=0 tx=0).stop 2024-04-25T17:21:47.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.008+0000 7fb693fa0700 1 -- 172.21.15.37:0/843100300 shutdown_connections 2024-04-25T17:21:47.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.008+0000 7fb693fa0700 1 --2- 172.21.15.37:0/843100300 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb68c1023d0 0x7fb68c1047b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:47.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.008+0000 7fb693fa0700 1 --2- 172.21.15.37:0/843100300 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb68c066af0 0x7fb68c101e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:47.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.008+0000 7fb693fa0700 1 -- 172.21.15.37:0/843100300 >> 172.21.15.37:0/843100300 conn(0x7fb68c0f74c0 msgr2=0x7fb68c0f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:21:47.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.008+0000 7fb693fa0700 1 -- 172.21.15.37:0/843100300 shutdown_connections 2024-04-25T17:21:47.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.008+0000 7fb693fa0700 1 -- 172.21.15.37:0/843100300 wait complete. 2024-04-25T17:21:47.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.008+0000 7fb693fa0700 1 Processor -- start 2024-04-25T17:21:47.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.008+0000 7fb693fa0700 1 -- start start 2024-04-25T17:21:47.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.009+0000 7fb693fa0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb68c066af0 0x7fb68c10fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:21:47.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.009+0000 7fb693fa0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb68c1023d0 0x7fb68c110170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:21:47.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.009+0000 7fb693fa0700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb68c110770 con 0x7fb68c066af0 2024-04-25T17:21:47.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.009+0000 7fb693fa0700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb68c110fc0 con 0x7fb68c1023d0 2024-04-25T17:21:47.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.009+0000 7fb691d3c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb68c066af0 0x7fb68c10fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:21:47.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.009+0000 7fb691d3c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb68c066af0 0x7fb68c10fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52772/0 (socket says 172.21.15.37:52772) 2024-04-25T17:21:47.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.009+0000 7fb691d3c700 1 -- 172.21.15.37:0/147368610 learned_addr learned my addr 172.21.15.37:0/147368610 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:21:47.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.009+0000 7fb69153b700 1 --2- 172.21.15.37:0/147368610 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb68c1023d0 0x7fb68c110170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:21:47.012 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.009+0000 7fb691d3c700 1 -- 172.21.15.37:0/147368610 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb68c1023d0 msgr2=0x7fb68c110170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:21:47.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.009+0000 7fb691d3c700 1 --2- 172.21.15.37:0/147368610 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb68c1023d0 0x7fb68c110170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:47.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.009+0000 7fb691d3c700 1 -- 172.21.15.37:0/147368610 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb67c005040 con 0x7fb68c066af0 2024-04-25T17:21:47.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.009+0000 7fb691d3c700 1 --2- 172.21.15.37:0/147368610 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb68c066af0 0x7fb68c10fc30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb68800c8b0 tx=0x7fb688004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:21:47.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.009+0000 7fb6827fc700 1 -- 172.21.15.37:0/147368610 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6880106f0 con 0x7fb68c066af0 2024-04-25T17:21:47.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.009+0000 7fb693fa0700 1 -- 172.21.15.37:0/147368610 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb68c1112a0 con 0x7fb68c066af0 2024-04-25T17:21:47.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.009+0000 7fb6827fc700 1 -- 172.21.15.37:0/147368610 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb688010d20 con 0x7fb68c066af0 2024-04-25T17:21:47.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.009+0000 7fb6827fc700 1 -- 172.21.15.37:0/147368610 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb688012e90 con 0x7fb68c066af0 2024-04-25T17:21:47.013 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.010+0000 7fb693fa0700 1 -- 172.21.15.37:0/147368610 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb68c1117e0 con 0x7fb68c066af0 2024-04-25T17:21:47.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.011+0000 7fb693fa0700 1 -- 172.21.15.37:0/147368610 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb68c05f5c0 con 0x7fb68c066af0 2024-04-25T17:21:47.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.011+0000 7fb6827fc700 1 -- 172.21.15.37:0/147368610 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 38) v1 ==== 98763+0+0 (secure 0 0 0) 0x7fb688010850 con 0x7fb68c066af0 2024-04-25T17:21:47.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.012+0000 7fb6827fc700 1 --2- 172.21.15.37:0/147368610 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fb678076ca0 0x7fb678079150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:21:47.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.012+0000 7fb6827fc700 1 -- 172.21.15.37:0/147368610 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fb6880983b0 con 0x7fb68c066af0 2024-04-25T17:21:47.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.012+0000 7fb69153b700 1 --2- 172.21.15.37:0/147368610 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fb678076ca0 0x7fb678079150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:21:47.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.012+0000 7fb69153b700 1 --2- 172.21.15.37:0/147368610 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fb678076ca0 0x7fb678079150 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb67c00b3b0 tx=0x7fb67c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:21:47.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.017+0000 7fb6827fc700 1 -- 172.21.15.37:0/147368610 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fb688060e20 con 0x7fb68c066af0 2024-04-25T17:21:47.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.317+0000 7fb693fa0700 1 -- 172.21.15.37:0/147368610 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb68c107ab0 con 0x7fb68c066af0 2024-04-25T17:21:47.319 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:46 smithi037 ceph-mon[90844]: Reconfiguring mds.cephfs.smithi037.ksmixc (monmap changed)... 2024-04-25T17:21:47.319 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:46 smithi037 ceph-mon[90844]: Reconfiguring daemon mds.cephfs.smithi037.ksmixc on smithi037 2024-04-25T17:21:47.319 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:46 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:47.319 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:46 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:47.319 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:46 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi037.ovkrpq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T17:21:47.319 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:46 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:21:47.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.318+0000 7fb6827fc700 1 -- 172.21.15.37:0/147368610 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+736 (secure 0 0 0) 0x7fb6880607c0 con 0x7fb68c066af0 2024-04-25T17:21:47.320 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-25T17:21:47.320 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": { 2024-04-25T17:21:47.320 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 2 2024-04-25T17:21:47.320 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:21:47.320 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": { 2024-04-25T17:21:47.320 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 2 2024-04-25T17:21:47.320 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:21:47.320 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": { 2024-04-25T17:21:47.320 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 6 2024-04-25T17:21:47.320 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:21:47.321 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": { 2024-04-25T17:21:47.321 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 4 2024-04-25T17:21:47.321 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:21:47.321 INFO:teuthology.orchestra.run.smithi037.stdout: "overall": { 2024-04-25T17:21:47.321 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 10, 2024-04-25T17:21:47.321 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 4 2024-04-25T17:21:47.321 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-04-25T17:21:47.321 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-25T17:21:47.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.320+0000 7fb693fa0700 1 -- 172.21.15.37:0/147368610 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fb678076ca0 msgr2=0x7fb678079150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:21:47.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.320+0000 7fb693fa0700 1 --2- 172.21.15.37:0/147368610 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fb678076ca0 0x7fb678079150 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb67c00b3b0 tx=0x7fb67c009e30 comp rx=0 tx=0).stop 2024-04-25T17:21:47.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.320+0000 7fb693fa0700 1 -- 172.21.15.37:0/147368610 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb68c066af0 msgr2=0x7fb68c10fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:21:47.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.320+0000 7fb693fa0700 1 --2- 172.21.15.37:0/147368610 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb68c066af0 0x7fb68c10fc30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb68800c8b0 tx=0x7fb688004470 comp rx=0 tx=0).stop 2024-04-25T17:21:47.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.321+0000 7fb693fa0700 1 -- 172.21.15.37:0/147368610 shutdown_connections 2024-04-25T17:21:47.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.321+0000 7fb693fa0700 1 --2- 172.21.15.37:0/147368610 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fb678076ca0 0x7fb678079150 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:47.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.321+0000 7fb693fa0700 1 --2- 172.21.15.37:0/147368610 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb68c066af0 0x7fb68c10fc30 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:47.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.321+0000 7fb693fa0700 1 --2- 172.21.15.37:0/147368610 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb68c1023d0 0x7fb68c110170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:47.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.321+0000 7fb693fa0700 1 -- 172.21.15.37:0/147368610 >> 172.21.15.37:0/147368610 conn(0x7fb68c0f74c0 msgr2=0x7fb68c0f7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:21:47.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.321+0000 7fb693fa0700 1 -- 172.21.15.37:0/147368610 shutdown_connections 2024-04-25T17:21:47.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.321+0000 7fb693fa0700 1 -- 172.21.15.37:0/147368610 wait complete. 2024-04-25T17:21:47.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:46 smithi069 ceph-mon[80239]: Reconfiguring mds.cephfs.smithi037.ksmixc (monmap changed)... 2024-04-25T17:21:47.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:46 smithi069 ceph-mon[80239]: Reconfiguring daemon mds.cephfs.smithi037.ksmixc on smithi037 2024-04-25T17:21:47.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:46 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:47.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:46 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:47.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:46 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi037.ovkrpq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T17:21:47.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:46 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:21:47.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.431+0000 7f79e42f7700 1 -- 172.21.15.37:0/2945781639 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79dc0fbcc0 msgr2=0x7f79dc0fc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:21:47.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.431+0000 7f79e42f7700 1 --2- 172.21.15.37:0/2945781639 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79dc0fbcc0 0x7f79dc0fc0d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f79d8004940 tx=0x7f79d8009e30 comp rx=0 tx=0).stop 2024-04-25T17:21:47.433 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.431+0000 7f79e42f7700 1 -- 172.21.15.37:0/2945781639 shutdown_connections 2024-04-25T17:21:47.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.431+0000 7f79e42f7700 1 --2- 172.21.15.37:0/2945781639 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f79dc0fcf70 0x7f79dc0fd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:47.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.431+0000 7f79e42f7700 1 --2- 172.21.15.37:0/2945781639 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79dc0fbcc0 0x7f79dc0fc0d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:47.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.431+0000 7f79e42f7700 1 -- 172.21.15.37:0/2945781639 >> 172.21.15.37:0/2945781639 conn(0x7f79dc0f7420 msgr2=0x7f79dc0f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:21:47.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.431+0000 7f79e42f7700 1 -- 172.21.15.37:0/2945781639 shutdown_connections 2024-04-25T17:21:47.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.431+0000 7f79e42f7700 1 -- 172.21.15.37:0/2945781639 wait complete. 2024-04-25T17:21:47.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.431+0000 7f79e42f7700 1 Processor -- start 2024-04-25T17:21:47.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.431+0000 7f79e42f7700 1 -- start start 2024-04-25T17:21:47.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.431+0000 7f79e42f7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79dc0fbcc0 0x7f79dc10fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:21:47.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.431+0000 7f79e42f7700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f79dc0fcf70 0x7f79dc110160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:21:47.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.431+0000 7f79e42f7700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc110760 con 0x7f79dc0fbcc0 2024-04-25T17:21:47.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.431+0000 7f79e42f7700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc110fb0 con 0x7f79dc0fcf70 2024-04-25T17:21:47.434 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.432+0000 7f79e2093700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79dc0fbcc0 0x7f79dc10fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:21:47.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.432+0000 7f79e2093700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79dc0fbcc0 0x7f79dc10fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52788/0 (socket says 172.21.15.37:52788) 2024-04-25T17:21:47.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.432+0000 7f79e2093700 1 -- 172.21.15.37:0/2450599921 learned_addr learned my addr 172.21.15.37:0/2450599921 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:21:47.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.432+0000 7f79e1892700 1 --2- 172.21.15.37:0/2450599921 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f79dc0fcf70 0x7f79dc110160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:21:47.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.432+0000 7f79e2093700 1 -- 172.21.15.37:0/2450599921 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f79dc0fcf70 msgr2=0x7f79dc110160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:21:47.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.432+0000 7f79e2093700 1 --2- 172.21.15.37:0/2450599921 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f79dc0fcf70 0x7f79dc110160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:47.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.432+0000 7f79e2093700 1 -- 172.21.15.37:0/2450599921 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d8005040 con 0x7f79dc0fbcc0 2024-04-25T17:21:47.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.432+0000 7f79e2093700 1 --2- 172.21.15.37:0/2450599921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79dc0fbcc0 0x7f79dc10fc20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f79d8009150 tx=0x7f79d8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:21:47.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.432+0000 7f79d2ffd700 1 -- 172.21.15.37:0/2450599921 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79d800e040 con 0x7f79dc0fbcc0 2024-04-25T17:21:47.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.432+0000 7f79e42f7700 1 -- 172.21.15.37:0/2450599921 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79dc111230 con 0x7f79dc0fbcc0 2024-04-25T17:21:47.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.432+0000 7f79d2ffd700 1 -- 172.21.15.37:0/2450599921 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f79d800bcc0 con 0x7f79dc0fbcc0 2024-04-25T17:21:47.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.432+0000 7f79d2ffd700 1 -- 172.21.15.37:0/2450599921 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79d801c630 con 0x7f79dc0fbcc0 2024-04-25T17:21:47.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.432+0000 7f79e42f7700 1 -- 172.21.15.37:0/2450599921 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79dc111770 con 0x7f79dc0fbcc0 2024-04-25T17:21:47.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.433+0000 7f79e42f7700 1 -- 172.21.15.37:0/2450599921 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79dc101900 con 0x7f79dc0fbcc0 2024-04-25T17:21:47.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.434+0000 7f79d2ffd700 1 -- 172.21.15.37:0/2450599921 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 38) v1 ==== 98763+0+0 (secure 0 0 0) 0x7f79d8013420 con 0x7f79dc0fbcc0 2024-04-25T17:21:47.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.435+0000 7f79d2ffd700 1 --2- 172.21.15.37:0/2450599921 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f79c8076ca0 0x7f79c8079150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:21:47.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.435+0000 7f79d2ffd700 1 -- 172.21.15.37:0/2450599921 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f79d8099230 con 0x7f79dc0fbcc0 2024-04-25T17:21:47.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.435+0000 7f79e1892700 1 --2- 172.21.15.37:0/2450599921 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f79c8076ca0 0x7f79c8079150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:21:47.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.435+0000 7f79e1892700 1 --2- 172.21.15.37:0/2450599921 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f79c8076ca0 0x7f79c8079150 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f79cc004c40 tx=0x7f79cc009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:21:47.441 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.440+0000 7f79d2ffd700 1 -- 172.21.15.37:0/2450599921 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f79d8061c10 con 0x7f79dc0fbcc0 2024-04-25T17:21:47.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.698+0000 7f79e42f7700 1 -- 172.21.15.37:0/2450599921 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f79dc04bed0 con 0x7f79dc0fbcc0 2024-04-25T17:21:47.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.699+0000 7f79d2ffd700 1 -- 172.21.15.37:0/2450599921 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1900 (secure 0 0 0) 0x7f79d80615b0 con 0x7f79dc0fbcc0 2024-04-25T17:21:47.700 INFO:teuthology.orchestra.run.smithi037.stdout:e16 2024-04-25T17:21:47.700 INFO:teuthology.orchestra.run.smithi037.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-25T17:21:47.701 INFO:teuthology.orchestra.run.smithi037.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T17:21:47.701 INFO:teuthology.orchestra.run.smithi037.stdout:legacy client fscid: 1 2024-04-25T17:21:47.701 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:21:47.701 INFO:teuthology.orchestra.run.smithi037.stdout:Filesystem 'cephfs' (1) 2024-04-25T17:21:47.701 INFO:teuthology.orchestra.run.smithi037.stdout:fs_name cephfs 2024-04-25T17:21:47.701 INFO:teuthology.orchestra.run.smithi037.stdout:epoch 16 2024-04-25T17:21:47.701 INFO:teuthology.orchestra.run.smithi037.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-25T17:21:47.701 INFO:teuthology.orchestra.run.smithi037.stdout:created 2024-04-25T17:15:40.586130+0000 2024-04-25T17:21:47.701 INFO:teuthology.orchestra.run.smithi037.stdout:modified 2024-04-25T17:15:57.508740+0000 2024-04-25T17:21:47.701 INFO:teuthology.orchestra.run.smithi037.stdout:tableserver 0 2024-04-25T17:21:47.701 INFO:teuthology.orchestra.run.smithi037.stdout:root 0 2024-04-25T17:21:47.701 INFO:teuthology.orchestra.run.smithi037.stdout:session_timeout 60 2024-04-25T17:21:47.701 INFO:teuthology.orchestra.run.smithi037.stdout:session_autoclose 300 2024-04-25T17:21:47.701 INFO:teuthology.orchestra.run.smithi037.stdout:max_file_size 1099511627776 2024-04-25T17:21:47.701 INFO:teuthology.orchestra.run.smithi037.stdout:max_xattr_size 65536 2024-04-25T17:21:47.701 INFO:teuthology.orchestra.run.smithi037.stdout:required_client_features {} 2024-04-25T17:21:47.702 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure 0 2024-04-25T17:21:47.702 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure_osd_epoch 0 2024-04-25T17:21:47.702 INFO:teuthology.orchestra.run.smithi037.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T17:21:47.702 INFO:teuthology.orchestra.run.smithi037.stdout:max_mds 1 2024-04-25T17:21:47.702 INFO:teuthology.orchestra.run.smithi037.stdout:in 0 2024-04-25T17:21:47.702 INFO:teuthology.orchestra.run.smithi037.stdout:up {0=14470} 2024-04-25T17:21:47.702 INFO:teuthology.orchestra.run.smithi037.stdout:failed 2024-04-25T17:21:47.702 INFO:teuthology.orchestra.run.smithi037.stdout:damaged 2024-04-25T17:21:47.702 INFO:teuthology.orchestra.run.smithi037.stdout:stopped 2024-04-25T17:21:47.702 INFO:teuthology.orchestra.run.smithi037.stdout:data_pools [3] 2024-04-25T17:21:47.702 INFO:teuthology.orchestra.run.smithi037.stdout:metadata_pool 2 2024-04-25T17:21:47.702 INFO:teuthology.orchestra.run.smithi037.stdout:inline_data disabled 2024-04-25T17:21:47.702 INFO:teuthology.orchestra.run.smithi037.stdout:balancer 2024-04-25T17:21:47.702 INFO:teuthology.orchestra.run.smithi037.stdout:bal_rank_mask -1 2024-04-25T17:21:47.703 INFO:teuthology.orchestra.run.smithi037.stdout:standby_count_wanted 1 2024-04-25T17:21:47.703 INFO:teuthology.orchestra.run.smithi037.stdout:qdb_cluster leader: 0 members: 2024-04-25T17:21:47.703 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi037.ksmixc{0:14470} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.37:6826/1903989494,v1:172.21.15.37:6827/1903989494] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:21:47.703 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi037.ovkrpq{0:14482} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.37:6828/4206394422,v1:172.21.15.37:6829/4206394422] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:21:47.703 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:21:47.703 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:21:47.703 INFO:teuthology.orchestra.run.smithi037.stdout:Standby daemons: 2024-04-25T17:21:47.703 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:21:47.703 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi069.cpprst{-1:24289} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.69:6826/518856100,v1:172.21.15.69:6827/518856100] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:21:47.703 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi069.ytlqcf{-1:24293} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.69:6824/134210439,v1:172.21.15.69:6825/134210439] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:21:47.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.701+0000 7f79e42f7700 1 -- 172.21.15.37:0/2450599921 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f79c8076ca0 msgr2=0x7f79c8079150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:21:47.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.701+0000 7f79e42f7700 1 --2- 172.21.15.37:0/2450599921 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f79c8076ca0 0x7f79c8079150 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f79cc004c40 tx=0x7f79cc009040 comp rx=0 tx=0).stop 2024-04-25T17:21:47.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.701+0000 7f79e42f7700 1 -- 172.21.15.37:0/2450599921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79dc0fbcc0 msgr2=0x7f79dc10fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:21:47.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.701+0000 7f79e42f7700 1 --2- 172.21.15.37:0/2450599921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79dc0fbcc0 0x7f79dc10fc20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f79d8009150 tx=0x7f79d8009e30 comp rx=0 tx=0).stop 2024-04-25T17:21:47.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.701+0000 7f79e42f7700 1 -- 172.21.15.37:0/2450599921 shutdown_connections 2024-04-25T17:21:47.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.701+0000 7f79e42f7700 1 --2- 172.21.15.37:0/2450599921 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f79c8076ca0 0x7f79c8079150 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:47.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.701+0000 7f79e42f7700 1 --2- 172.21.15.37:0/2450599921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f79dc0fbcc0 0x7f79dc10fc20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:47.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.701+0000 7f79e42f7700 1 --2- 172.21.15.37:0/2450599921 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f79dc0fcf70 0x7f79dc110160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:47.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.701+0000 7f79e42f7700 1 -- 172.21.15.37:0/2450599921 >> 172.21.15.37:0/2450599921 conn(0x7f79dc0f7420 msgr2=0x7f79dc066440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:21:47.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.701+0000 7f79e42f7700 1 -- 172.21.15.37:0/2450599921 shutdown_connections 2024-04-25T17:21:47.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.701+0000 7f79e42f7700 1 -- 172.21.15.37:0/2450599921 wait complete. 2024-04-25T17:21:47.705 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 16 2024-04-25T17:21:47.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.809+0000 7f244067c700 1 -- 172.21.15.37:0/3173448177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24380fff50 msgr2=0x7f2438102330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:21:47.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.809+0000 7f244067c700 1 --2- 172.21.15.37:0/3173448177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24380fff50 0x7f2438102330 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f242c004940 tx=0x7f242c009e30 comp rx=0 tx=0).stop 2024-04-25T17:21:47.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.809+0000 7f244067c700 1 -- 172.21.15.37:0/3173448177 shutdown_connections 2024-04-25T17:21:47.812 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.809+0000 7f244067c700 1 --2- 172.21.15.37:0/3173448177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24380fff50 0x7f2438102330 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:47.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.809+0000 7f244067c700 1 --2- 172.21.15.37:0/3173448177 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2438066ed0 0x7f24380ffa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:47.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.809+0000 7f244067c700 1 -- 172.21.15.37:0/3173448177 >> 172.21.15.37:0/3173448177 conn(0x7f24380f7440 msgr2=0x7f24380f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:21:47.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.809+0000 7f244067c700 1 -- 172.21.15.37:0/3173448177 shutdown_connections 2024-04-25T17:21:47.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.809+0000 7f244067c700 1 -- 172.21.15.37:0/3173448177 wait complete. 2024-04-25T17:21:47.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.809+0000 7f244067c700 1 Processor -- start 2024-04-25T17:21:47.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.809+0000 7f244067c700 1 -- start start 2024-04-25T17:21:47.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.810+0000 7f244067c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2438066ed0 0x7f243810fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:21:47.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.810+0000 7f244067c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24380fff50 0x7f2438110070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:21:47.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.810+0000 7f244067c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2438110670 con 0x7f24380fff50 2024-04-25T17:21:47.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.810+0000 7f244067c700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24381107e0 con 0x7f2438066ed0 2024-04-25T17:21:47.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.810+0000 7f243dc17700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24380fff50 0x7f2438110070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:21:47.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.810+0000 7f243dc17700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24380fff50 0x7f2438110070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52810/0 (socket says 172.21.15.37:52810) 2024-04-25T17:21:47.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.810+0000 7f243dc17700 1 -- 172.21.15.37:0/2066069495 learned_addr learned my addr 172.21.15.37:0/2066069495 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:21:47.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.810+0000 7f243e418700 1 --2- 172.21.15.37:0/2066069495 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2438066ed0 0x7f243810fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:21:47.813 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.810+0000 7f243dc17700 1 -- 172.21.15.37:0/2066069495 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2438066ed0 msgr2=0x7f243810fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:21:47.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.810+0000 7f243dc17700 1 --2- 172.21.15.37:0/2066069495 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2438066ed0 0x7f243810fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:47.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.810+0000 7f243dc17700 1 -- 172.21.15.37:0/2066069495 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f242c005040 con 0x7f24380fff50 2024-04-25T17:21:47.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.810+0000 7f243e418700 1 --2- 172.21.15.37:0/2066069495 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2438066ed0 0x7f243810fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T17:21:47.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.810+0000 7f243dc17700 1 --2- 172.21.15.37:0/2066069495 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24380fff50 0x7f2438110070 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f242c009150 tx=0x7f242c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:21:47.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.811+0000 7f2436ffd700 1 -- 172.21.15.37:0/2066069495 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f242c00e040 con 0x7f24380fff50 2024-04-25T17:21:47.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.811+0000 7f244067c700 1 -- 172.21.15.37:0/2066069495 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24381151e0 con 0x7f24380fff50 2024-04-25T17:21:47.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.811+0000 7f2436ffd700 1 -- 172.21.15.37:0/2066069495 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f242c00bcc0 con 0x7f24380fff50 2024-04-25T17:21:47.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.811+0000 7f244067c700 1 -- 172.21.15.37:0/2066069495 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24381157a0 con 0x7f24380fff50 2024-04-25T17:21:47.814 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.811+0000 7f2436ffd700 1 -- 172.21.15.37:0/2066069495 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f242c01c5d0 con 0x7f24380fff50 2024-04-25T17:21:47.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.812+0000 7f244067c700 1 -- 172.21.15.37:0/2066069495 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f243804c710 con 0x7f24380fff50 2024-04-25T17:21:47.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.812+0000 7f2436ffd700 1 -- 172.21.15.37:0/2066069495 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 38) v1 ==== 98763+0+0 (secure 0 0 0) 0x7f242c013420 con 0x7f24380fff50 2024-04-25T17:21:47.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.813+0000 7f2436ffd700 1 --2- 172.21.15.37:0/2066069495 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f2420076ca0 0x7f2420079150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:21:47.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.813+0000 7f2436ffd700 1 -- 172.21.15.37:0/2066069495 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f242c099200 con 0x7f24380fff50 2024-04-25T17:21:47.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.813+0000 7f243e418700 1 --2- 172.21.15.37:0/2066069495 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f2420076ca0 0x7f2420079150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:21:47.815 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.813+0000 7f243e418700 1 --2- 172.21.15.37:0/2066069495 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f2420076ca0 0x7f2420079150 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2438066c10 tx=0x7f242800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:21:47.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:47.818+0000 7f2436ffd700 1 -- 172.21.15.37:0/2066069495 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f242c061be0 con 0x7f24380fff50 2024-04-25T17:21:48.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:48.050+0000 7f244067c700 1 -- 172.21.15.37:0/2066069495 --> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f24380fd1f0 con 0x7f2420076ca0 2024-04-25T17:21:48.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:48.051+0000 7f2436ffd700 1 -- 172.21.15.37:0/2066069495 <== mgr.34104 v2:172.21.15.37:6800/783197737 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f24380fd1f0 con 0x7f2420076ca0 2024-04-25T17:21:48.053 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-25T17:21:48.053 INFO:teuthology.orchestra.run.smithi037.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385", 2024-04-25T17:21:48.053 INFO:teuthology.orchestra.run.smithi037.stdout: "in_progress": true, 2024-04-25T17:21:48.053 INFO:teuthology.orchestra.run.smithi037.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-25T17:21:48.053 INFO:teuthology.orchestra.run.smithi037.stdout: "services_complete": [ 2024-04-25T17:21:48.053 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr", 2024-04-25T17:21:48.053 INFO:teuthology.orchestra.run.smithi037.stdout: "mon" 2024-04-25T17:21:48.053 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-04-25T17:21:48.053 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": "4/21 daemons upgraded", 2024-04-25T17:21:48.053 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "Currently upgrading mon daemons", 2024-04-25T17:21:48.053 INFO:teuthology.orchestra.run.smithi037.stdout: "is_paused": false 2024-04-25T17:21:48.053 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-25T17:21:48.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:48.053+0000 7f244067c700 1 -- 172.21.15.37:0/2066069495 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f2420076ca0 msgr2=0x7f2420079150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:21:48.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:48.053+0000 7f244067c700 1 --2- 172.21.15.37:0/2066069495 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f2420076ca0 0x7f2420079150 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f2438066c10 tx=0x7f242800b040 comp rx=0 tx=0).stop 2024-04-25T17:21:48.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:48.053+0000 7f244067c700 1 -- 172.21.15.37:0/2066069495 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24380fff50 msgr2=0x7f2438110070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:21:48.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:48.053+0000 7f244067c700 1 --2- 172.21.15.37:0/2066069495 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24380fff50 0x7f2438110070 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f242c009150 tx=0x7f242c009e30 comp rx=0 tx=0).stop 2024-04-25T17:21:48.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:48.053+0000 7f244067c700 1 -- 172.21.15.37:0/2066069495 shutdown_connections 2024-04-25T17:21:48.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:48.053+0000 7f244067c700 1 --2- 172.21.15.37:0/2066069495 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f2420076ca0 0x7f2420079150 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:48.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:48.053+0000 7f244067c700 1 --2- 172.21.15.37:0/2066069495 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2438066ed0 0x7f243810fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:48.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:48.053+0000 7f244067c700 1 --2- 172.21.15.37:0/2066069495 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24380fff50 0x7f2438110070 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:48.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:48.053+0000 7f244067c700 1 -- 172.21.15.37:0/2066069495 >> 172.21.15.37:0/2066069495 conn(0x7f24380f7440 msgr2=0x7f24380fbad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:21:48.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:48.054+0000 7f244067c700 1 -- 172.21.15.37:0/2066069495 shutdown_connections 2024-04-25T17:21:48.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:48.054+0000 7f244067c700 1 -- 172.21.15.37:0/2066069495 wait complete. 2024-04-25T17:21:48.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:48.161+0000 7f1c848ec700 1 -- 172.21.15.37:0/1061897521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c800fdfd0 msgr2=0x7f1c800fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:21:48.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:48.161+0000 7f1c848ec700 1 --2- 172.21.15.37:0/1061897521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c800fdfd0 0x7f1c800fe440 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1c74004940 tx=0x7f1c74009e30 comp rx=0 tx=0).stop 2024-04-25T17:21:48.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:48.161+0000 7f1c848ec700 1 -- 172.21.15.37:0/1061897521 shutdown_connections 2024-04-25T17:21:48.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:48.161+0000 7f1c848ec700 1 --2- 172.21.15.37:0/1061897521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c800fdfd0 0x7f1c800fe440 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:48.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:48.161+0000 7f1c848ec700 1 --2- 172.21.15.37:0/1061897521 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1c800fce60 0x7f1c800fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:48.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:48.161+0000 7f1c848ec700 1 -- 172.21.15.37:0/1061897521 >> 172.21.15.37:0/1061897521 conn(0x7f1c800f8540 msgr2=0x7f1c800fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:21:48.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:48.161+0000 7f1c848ec700 1 -- 172.21.15.37:0/1061897521 shutdown_connections 2024-04-25T17:21:48.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:48.161+0000 7f1c848ec700 1 -- 172.21.15.37:0/1061897521 wait complete. 2024-04-25T17:21:48.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:48.161+0000 7f1c848ec700 1 Processor -- start 2024-04-25T17:21:48.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:48.161+0000 7f1c848ec700 1 -- start start 2024-04-25T17:21:48.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:48.162+0000 7f1c848ec700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c800fce60 0x7f1c8010fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:21:48.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:48.162+0000 7f1c848ec700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1c800fdfd0 0x7f1c80110070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:21:48.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:48.162+0000 7f1c848ec700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c80110670 con 0x7f1c800fce60 2024-04-25T17:21:48.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:48.162+0000 7f1c848ec700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c801107e0 con 0x7f1c800fdfd0 2024-04-25T17:21:48.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:48.162+0000 7f1c7e59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c800fce60 0x7f1c8010fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:21:48.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:48.162+0000 7f1c7e59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c800fce60 0x7f1c8010fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52824/0 (socket says 172.21.15.37:52824) 2024-04-25T17:21:48.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:48.162+0000 7f1c7e59c700 1 -- 172.21.15.37:0/1584213168 learned_addr learned my addr 172.21.15.37:0/1584213168 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:21:48.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:48.162+0000 7f1c7dd9b700 1 --2- 172.21.15.37:0/1584213168 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1c800fdfd0 0x7f1c80110070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:21:48.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:48.162+0000 7f1c7e59c700 1 -- 172.21.15.37:0/1584213168 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1c800fdfd0 msgr2=0x7f1c80110070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:21:48.165 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:48.162+0000 7f1c7e59c700 1 --2- 172.21.15.37:0/1584213168 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1c800fdfd0 0x7f1c80110070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:48.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:48.162+0000 7f1c7e59c700 1 -- 172.21.15.37:0/1584213168 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c74005040 con 0x7f1c800fce60 2024-04-25T17:21:48.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:48.162+0000 7f1c7dd9b700 1 --2- 172.21.15.37:0/1584213168 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1c800fdfd0 0x7f1c80110070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T17:21:48.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:48.162+0000 7f1c7e59c700 1 --2- 172.21.15.37:0/1584213168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c800fce60 0x7f1c8010fb30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1c70002a50 tx=0x7f1c700046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:21:48.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:48.162+0000 7f1c6effd700 1 -- 172.21.15.37:0/1584213168 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c70007cc0 con 0x7f1c800fce60 2024-04-25T17:21:48.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:48.162+0000 7f1c848ec700 1 -- 172.21.15.37:0/1584213168 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c80115240 con 0x7f1c800fce60 2024-04-25T17:21:48.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:48.162+0000 7f1c6effd700 1 -- 172.21.15.37:0/1584213168 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1c7000f040 con 0x7f1c800fce60 2024-04-25T17:21:48.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:48.162+0000 7f1c6effd700 1 -- 172.21.15.37:0/1584213168 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c70009640 con 0x7f1c800fce60 2024-04-25T17:21:48.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:48.162+0000 7f1c848ec700 1 -- 172.21.15.37:0/1584213168 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c80115800 con 0x7f1c800fce60 2024-04-25T17:21:48.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:48.163+0000 7f1c848ec700 1 -- 172.21.15.37:0/1584213168 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c80101960 con 0x7f1c800fce60 2024-04-25T17:21:48.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:48.164+0000 7f1c6effd700 1 -- 172.21.15.37:0/1584213168 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 38) v1 ==== 98763+0+0 (secure 0 0 0) 0x7f1c700097a0 con 0x7f1c800fce60 2024-04-25T17:21:48.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:48.164+0000 7f1c6effd700 1 --2- 172.21.15.37:0/1584213168 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f1c68076ca0 0x7f1c68079150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:21:48.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:48.165+0000 7f1c6effd700 1 -- 172.21.15.37:0/1584213168 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f1c700982f0 con 0x7f1c800fce60 2024-04-25T17:21:48.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:48.165+0000 7f1c7dd9b700 1 --2- 172.21.15.37:0/1584213168 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f1c68076ca0 0x7f1c68079150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:21:48.167 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:48.165+0000 7f1c7dd9b700 1 --2- 172.21.15.37:0/1584213168 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f1c68076ca0 0x7f1c68079150 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1c7400b3b0 tx=0x7f1c74009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:21:48.171 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:48.169+0000 7f1c6effd700 1 -- 172.21.15.37:0/1584213168 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f1c70060c50 con 0x7f1c800fce60 2024-04-25T17:21:48.235 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:47 smithi037 ceph-mon[90844]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:21:48.235 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:47 smithi037 ceph-mon[90844]: pgmap v20: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:21:48.235 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:47 smithi037 ceph-mon[90844]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:21:48.235 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:47 smithi037 ceph-mon[90844]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:21:48.235 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:47 smithi037 ceph-mon[90844]: Reconfiguring mds.cephfs.smithi037.ovkrpq (monmap changed)... 2024-04-25T17:21:48.236 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:47 smithi037 ceph-mon[90844]: Reconfiguring daemon mds.cephfs.smithi037.ovkrpq on smithi037 2024-04-25T17:21:48.236 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:47 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/147368610' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:21:48.236 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:47 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/2450599921' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T17:21:48.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:47 smithi069 ceph-mon[80239]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:21:48.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:47 smithi069 ceph-mon[80239]: pgmap v20: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:21:48.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:47 smithi069 ceph-mon[80239]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:21:48.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:47 smithi069 ceph-mon[80239]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:21:48.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:47 smithi069 ceph-mon[80239]: Reconfiguring mds.cephfs.smithi037.ovkrpq (monmap changed)... 2024-04-25T17:21:48.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:47 smithi069 ceph-mon[80239]: Reconfiguring daemon mds.cephfs.smithi037.ovkrpq on smithi037 2024-04-25T17:21:48.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:47 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/147368610' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:21:48.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:47 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/2450599921' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T17:21:48.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:48.469+0000 7f1c848ec700 1 -- 172.21.15.37:0/1584213168 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f1c801058c0 con 0x7f1c800fce60 2024-04-25T17:21:48.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:48.469+0000 7f1c6effd700 1 -- 172.21.15.37:0/1584213168 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f1c700605f0 con 0x7f1c800fce60 2024-04-25T17:21:48.471 INFO:teuthology.orchestra.run.smithi037.stdout:HEALTH_OK 2024-04-25T17:21:48.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:48.471+0000 7f1c848ec700 1 -- 172.21.15.37:0/1584213168 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f1c68076ca0 msgr2=0x7f1c68079150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:21:48.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:48.471+0000 7f1c848ec700 1 --2- 172.21.15.37:0/1584213168 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f1c68076ca0 0x7f1c68079150 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1c7400b3b0 tx=0x7f1c74009e30 comp rx=0 tx=0).stop 2024-04-25T17:21:48.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:48.471+0000 7f1c848ec700 1 -- 172.21.15.37:0/1584213168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c800fce60 msgr2=0x7f1c8010fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:21:48.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:48.471+0000 7f1c848ec700 1 --2- 172.21.15.37:0/1584213168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c800fce60 0x7f1c8010fb30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1c70002a50 tx=0x7f1c700046b0 comp rx=0 tx=0).stop 2024-04-25T17:21:48.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:48.471+0000 7f1c848ec700 1 -- 172.21.15.37:0/1584213168 shutdown_connections 2024-04-25T17:21:48.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:48.471+0000 7f1c848ec700 1 --2- 172.21.15.37:0/1584213168 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f1c68076ca0 0x7f1c68079150 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:48.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:48.471+0000 7f1c848ec700 1 --2- 172.21.15.37:0/1584213168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c800fce60 0x7f1c8010fb30 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:48.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:48.471+0000 7f1c848ec700 1 --2- 172.21.15.37:0/1584213168 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1c800fdfd0 0x7f1c80110070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:21:48.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:48.471+0000 7f1c848ec700 1 -- 172.21.15.37:0/1584213168 >> 172.21.15.37:0/1584213168 conn(0x7f1c800f8540 msgr2=0x7f1c800f9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:21:48.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:48.471+0000 7f1c848ec700 1 -- 172.21.15.37:0/1584213168 shutdown_connections 2024-04-25T17:21:48.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:21:48.471+0000 7f1c848ec700 1 -- 172.21.15.37:0/1584213168 wait complete. 2024-04-25T17:21:49.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:48 smithi037 ceph-mon[90844]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:21:49.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:48 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/1584213168' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T17:21:49.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:48 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:49.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:48 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:49.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:48 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi069", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-25T17:21:49.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:48 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:21:49.374 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:48 smithi069 ceph-mon[80239]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:21:49.374 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:48 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/1584213168' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T17:21:49.374 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:48 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:49.374 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:48 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:49.374 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:48 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi069", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-25T17:21:49.375 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:48 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:21:50.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:49 smithi037 ceph-mon[90844]: pgmap v21: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:21:50.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:49 smithi037 ceph-mon[90844]: Reconfiguring crash.smithi069 (monmap changed)... 2024-04-25T17:21:50.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:49 smithi037 ceph-mon[90844]: Reconfiguring daemon crash.smithi069 on smithi069 2024-04-25T17:21:50.347 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:49 smithi069 ceph-mon[80239]: pgmap v21: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:21:50.347 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:49 smithi069 ceph-mon[80239]: Reconfiguring crash.smithi069 (monmap changed)... 2024-04-25T17:21:50.347 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:49 smithi069 ceph-mon[80239]: Reconfiguring daemon crash.smithi069 on smithi069 2024-04-25T17:21:51.490 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:51 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:51.491 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:51 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:51.491 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:51 smithi069 ceph-mon[80239]: Reconfiguring mgr.smithi069.mmuhdo (monmap changed)... 2024-04-25T17:21:51.491 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:51 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi069.mmuhdo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T17:21:51.491 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:51 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T17:21:51.491 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:51 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:21:51.491 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:51 smithi069 ceph-mon[80239]: Reconfiguring daemon mgr.smithi069.mmuhdo on smithi069 2024-04-25T17:21:51.491 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:51 smithi069 ceph-mon[80239]: pgmap v22: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:21:51.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:51 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:51.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:51 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:51.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:51 smithi037 ceph-mon[90844]: Reconfiguring mgr.smithi069.mmuhdo (monmap changed)... 2024-04-25T17:21:51.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:51 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi069.mmuhdo", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-04-25T17:21:51.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:51 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-04-25T17:21:51.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:51 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:21:51.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:51 smithi037 ceph-mon[90844]: Reconfiguring daemon mgr.smithi069.mmuhdo on smithi069 2024-04-25T17:21:51.823 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:51 smithi037 ceph-mon[90844]: pgmap v22: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:21:53.412 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:53 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:53.412 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:53 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:53.412 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:53 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T17:21:53.412 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:53 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-25T17:21:53.412 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:53 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:21:53.505 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:53 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:53.505 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:53 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:53.505 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:53 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-04-25T17:21:53.505 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:53 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-04-25T17:21:53.506 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:53 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:21:54.372 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:54 smithi069 ceph-mon[80239]: Reconfiguring mon.smithi069 (monmap changed)... 2024-04-25T17:21:54.372 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:54 smithi069 ceph-mon[80239]: Reconfiguring daemon mon.smithi069 on smithi069 2024-04-25T17:21:54.372 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:54 smithi069 ceph-mon[80239]: pgmap v23: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:21:54.372 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:54 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:54.372 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:54 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:54.372 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:54 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-25T17:21:54.372 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:54 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:21:54.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:54 smithi037 ceph-mon[90844]: Reconfiguring mon.smithi069 (monmap changed)... 2024-04-25T17:21:54.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:54 smithi037 ceph-mon[90844]: Reconfiguring daemon mon.smithi069 on smithi069 2024-04-25T17:21:54.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:54 smithi037 ceph-mon[90844]: pgmap v23: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:21:54.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:54 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:54.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:54 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:54.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:54 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-25T17:21:54.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:54 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:21:55.374 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:55 smithi069 ceph-mon[80239]: Reconfiguring osd.3 (monmap changed)... 2024-04-25T17:21:55.375 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:55 smithi069 ceph-mon[80239]: Reconfiguring daemon osd.3 on smithi069 2024-04-25T17:21:55.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:55 smithi037 ceph-mon[90844]: Reconfiguring osd.3 (monmap changed)... 2024-04-25T17:21:55.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:55 smithi037 ceph-mon[90844]: Reconfiguring daemon osd.3 on smithi069 2024-04-25T17:21:56.263 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:56 smithi069 ceph-mon[80239]: pgmap v24: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:21:56.263 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:56 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:56.263 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:56 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:56.263 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:56 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-25T17:21:56.264 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:56 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:21:56.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:56 smithi037 ceph-mon[90844]: pgmap v24: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:21:56.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:56 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:56.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:56 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:56.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:56 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-25T17:21:56.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:56 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:21:57.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:57 smithi069 ceph-mon[80239]: Reconfiguring osd.4 (monmap changed)... 2024-04-25T17:21:57.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:57 smithi069 ceph-mon[80239]: Reconfiguring daemon osd.4 on smithi069 2024-04-25T17:21:57.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:57 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:57.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:57 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:57.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:57 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-25T17:21:57.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:57 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:21:57.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:57 smithi037 ceph-mon[90844]: Reconfiguring osd.4 (monmap changed)... 2024-04-25T17:21:57.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:57 smithi037 ceph-mon[90844]: Reconfiguring daemon osd.4 on smithi069 2024-04-25T17:21:57.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:57 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:57.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:57 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:57.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:57 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-25T17:21:57.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:57 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:21:58.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:58 smithi069 ceph-mon[80239]: pgmap v25: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:21:58.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:58 smithi069 ceph-mon[80239]: Reconfiguring osd.5 (monmap changed)... 2024-04-25T17:21:58.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:58 smithi069 ceph-mon[80239]: Reconfiguring daemon osd.5 on smithi069 2024-04-25T17:21:58.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:58 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:21:58.473 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:58 smithi037 ceph-mon[90844]: pgmap v25: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:21:58.473 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:58 smithi037 ceph-mon[90844]: Reconfiguring osd.5 (monmap changed)... 2024-04-25T17:21:58.473 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:58 smithi037 ceph-mon[90844]: Reconfiguring daemon osd.5 on smithi069 2024-04-25T17:21:58.473 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:58 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:21:59.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:59 smithi069 ceph-mon[80239]: pgmap v26: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:21:59.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:59 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:59.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:59 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:59.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:59 smithi069 ceph-mon[80239]: Reconfiguring mds.cephfs.smithi069.ytlqcf (monmap changed)... 2024-04-25T17:21:59.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:59 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi069.ytlqcf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T17:21:59.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:59 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:21:59.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:21:59 smithi069 ceph-mon[80239]: Reconfiguring daemon mds.cephfs.smithi069.ytlqcf on smithi069 2024-04-25T17:21:59.756 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:59 smithi037 ceph-mon[90844]: pgmap v26: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:21:59.756 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:59 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:59.756 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:59 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:21:59.756 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:59 smithi037 ceph-mon[90844]: Reconfiguring mds.cephfs.smithi069.ytlqcf (monmap changed)... 2024-04-25T17:21:59.756 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:59 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi069.ytlqcf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T17:21:59.756 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:59 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:21:59.757 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:21:59 smithi037 ceph-mon[90844]: Reconfiguring daemon mds.cephfs.smithi069.ytlqcf on smithi069 2024-04-25T17:22:01.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:01 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:01.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:01 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:01.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:01 smithi069 ceph-mon[80239]: Reconfiguring mds.cephfs.smithi069.cpprst (monmap changed)... 2024-04-25T17:22:01.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:01 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi069.cpprst", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T17:22:01.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:01 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:22:01.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:01 smithi069 ceph-mon[80239]: Reconfiguring daemon mds.cephfs.smithi069.cpprst on smithi069 2024-04-25T17:22:01.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:01 smithi069 ceph-mon[80239]: pgmap v27: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:22:01.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:01 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:01.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:01 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:01.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:01 smithi037 ceph-mon[90844]: Reconfiguring mds.cephfs.smithi069.cpprst (monmap changed)... 2024-04-25T17:22:01.573 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:01 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi069.cpprst", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T17:22:01.573 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:01 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:22:01.573 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:01 smithi037 ceph-mon[90844]: Reconfiguring daemon mds.cephfs.smithi069.cpprst on smithi069 2024-04-25T17:22:01.573 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:01 smithi037 ceph-mon[90844]: pgmap v27: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:22:02.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:02 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:02.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:02 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:02.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:02 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:22:02.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:02 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:22:02.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:02 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:22:02.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:02 smithi069 ceph-mon[80239]: Upgrade: Setting container_image for all mon 2024-04-25T17:22:02.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:02 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:02.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:02 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi037"}]: dispatch 2024-04-25T17:22:02.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:02 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi037"}]': finished 2024-04-25T17:22:02.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:02 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi069"}]: dispatch 2024-04-25T17:22:02.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:02 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi069"}]': finished 2024-04-25T17:22:03.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:02 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:03.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:02 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:03.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:02 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:22:03.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:02 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:22:03.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:02 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:22:03.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:02 smithi037 ceph-mon[90844]: Upgrade: Setting container_image for all mon 2024-04-25T17:22:03.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:02 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:03.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:02 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi037"}]: dispatch 2024-04-25T17:22:03.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:02 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi037"}]': finished 2024-04-25T17:22:03.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:02 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi069"}]: dispatch 2024-04-25T17:22:03.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:02 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi069"}]': finished 2024-04-25T17:22:03.969 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:03 smithi037 ceph-mon[90844]: pgmap v28: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:22:03.969 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:03 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:03.969 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:03 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi037", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-25T17:22:03.969 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:03 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:22:04.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:03 smithi069 ceph-mon[80239]: pgmap v28: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:22:04.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:03 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:04.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:03 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi037", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-25T17:22:04.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:03 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:22:05.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:04 smithi037 ceph-mon[90844]: Upgrade: Updating crash.smithi037 (1/2) 2024-04-25T17:22:05.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:04 smithi037 ceph-mon[90844]: Deploying daemon crash.smithi037 on smithi037 2024-04-25T17:22:05.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:04 smithi069 ceph-mon[80239]: Upgrade: Updating crash.smithi037 (1/2) 2024-04-25T17:22:05.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:04 smithi069 ceph-mon[80239]: Deploying daemon crash.smithi037 on smithi037 2024-04-25T17:22:05.956 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:05 smithi037 ceph-mon[90844]: pgmap v29: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:22:06.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:05 smithi069 ceph-mon[80239]: pgmap v29: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:22:08.047 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:07 smithi069 ceph-mon[80239]: pgmap v30: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:22:08.047 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:07 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:08.047 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:07 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:08.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:07 smithi037 ceph-mon[90844]: pgmap v30: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:22:08.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:07 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:08.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:07 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:10.115 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:09 smithi069 ceph-mon[80239]: pgmap v31: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:22:10.115 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:09 smithi069 ceph-mon[80239]: Upgrade: Updating crash.smithi069 (2/2) 2024-04-25T17:22:10.115 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:09 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:10.115 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:09 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi069", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-25T17:22:10.115 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:09 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:22:10.115 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:09 smithi069 ceph-mon[80239]: Deploying daemon crash.smithi069 on smithi069 2024-04-25T17:22:10.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:09 smithi037 ceph-mon[90844]: pgmap v31: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:22:10.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:09 smithi037 ceph-mon[90844]: Upgrade: Updating crash.smithi069 (2/2) 2024-04-25T17:22:10.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:09 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:10.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:09 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi069", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-04-25T17:22:10.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:09 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:22:10.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:09 smithi037 ceph-mon[90844]: Deploying daemon crash.smithi069 on smithi069 2024-04-25T17:22:11.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:11 smithi069 ceph-mon[80239]: pgmap v32: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:22:12.321 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:11 smithi037 ceph-mon[90844]: pgmap v32: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:22:13.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:13 smithi069 ceph-mon[80239]: pgmap v33: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:22:13.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:13 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:13.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:13 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:13.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:13 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:22:13.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:13 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:22:13.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:13 smithi037 ceph-mon[90844]: pgmap v33: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:22:13.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:13 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:13.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:13 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:13.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:13 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:22:13.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:13 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:22:15.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:15 smithi069 ceph-mon[80239]: pgmap v34: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:22:15.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:15 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:15.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:15 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:15.971 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:15 smithi037 ceph-mon[90844]: pgmap v34: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:22:15.971 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:15 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:15.971 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:15 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:17.883 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:17 smithi069 ceph-mon[80239]: pgmap v35: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:22:17.883 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:17 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:17.883 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:17 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:18.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:17 smithi037 ceph-mon[90844]: pgmap v35: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:22:18.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:17 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:18.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:17 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:18.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.583+0000 7f45e0ef5700 1 -- 172.21.15.37:0/687943899 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45dc0fdfd0 msgr2=0x7f45dc0fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:22:18.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.583+0000 7f45e0ef5700 1 --2- 172.21.15.37:0/687943899 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45dc0fdfd0 0x7f45dc0fe440 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f45d0004940 tx=0x7f45d0009e30 comp rx=0 tx=0).stop 2024-04-25T17:22:18.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.583+0000 7f45e0ef5700 1 -- 172.21.15.37:0/687943899 shutdown_connections 2024-04-25T17:22:18.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.583+0000 7f45e0ef5700 1 --2- 172.21.15.37:0/687943899 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45dc0fdfd0 0x7f45dc0fe440 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:18.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.583+0000 7f45e0ef5700 1 --2- 172.21.15.37:0/687943899 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45dc0fce60 0x7f45dc0fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:18.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.583+0000 7f45e0ef5700 1 -- 172.21.15.37:0/687943899 >> 172.21.15.37:0/687943899 conn(0x7f45dc0f8540 msgr2=0x7f45dc0fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:22:18.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.583+0000 7f45e0ef5700 1 -- 172.21.15.37:0/687943899 shutdown_connections 2024-04-25T17:22:18.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.583+0000 7f45e0ef5700 1 -- 172.21.15.37:0/687943899 wait complete. 2024-04-25T17:22:18.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.584+0000 7f45e0ef5700 1 Processor -- start 2024-04-25T17:22:18.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.584+0000 7f45e0ef5700 1 -- start start 2024-04-25T17:22:18.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.584+0000 7f45e0ef5700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45dc0fce60 0x7f45dc10d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:22:18.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.584+0000 7f45e0ef5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45dc0fdfd0 0x7f45dc10ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:22:18.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.584+0000 7f45e0ef5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45dc10e3c0 con 0x7f45dc0fdfd0 2024-04-25T17:22:18.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.584+0000 7f45e0ef5700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45dc10e530 con 0x7f45dc0fce60 2024-04-25T17:22:18.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.584+0000 7f45d9d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45dc0fdfd0 0x7f45dc10ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:22:18.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.584+0000 7f45da59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45dc0fce60 0x7f45dc10d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:22:18.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.584+0000 7f45d9d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45dc0fdfd0 0x7f45dc10ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48436/0 (socket says 172.21.15.37:48436) 2024-04-25T17:22:18.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.584+0000 7f45d9d9b700 1 -- 172.21.15.37:0/1359643225 learned_addr learned my addr 172.21.15.37:0/1359643225 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:22:18.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.584+0000 7f45d9d9b700 1 -- 172.21.15.37:0/1359643225 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45dc0fce60 msgr2=0x7f45dc10d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:22:18.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.584+0000 7f45d9d9b700 1 --2- 172.21.15.37:0/1359643225 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45dc0fce60 0x7f45dc10d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:18.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.584+0000 7f45d9d9b700 1 -- 172.21.15.37:0/1359643225 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d0005040 con 0x7f45dc0fdfd0 2024-04-25T17:22:18.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.584+0000 7f45da59c700 1 --2- 172.21.15.37:0/1359643225 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45dc0fce60 0x7f45dc10d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T17:22:18.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.585+0000 7f45d9d9b700 1 --2- 172.21.15.37:0/1359643225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45dc0fdfd0 0x7f45dc10ddc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f45d0013870 tx=0x7f45d0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:22:18.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.585+0000 7f45caffd700 1 -- 172.21.15.37:0/1359643225 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45d0021070 con 0x7f45dc0fdfd0 2024-04-25T17:22:18.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.585+0000 7f45e0ef5700 1 -- 172.21.15.37:0/1359643225 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45dc112f30 con 0x7f45dc0fdfd0 2024-04-25T17:22:18.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.585+0000 7f45e0ef5700 1 -- 172.21.15.37:0/1359643225 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45dc113440 con 0x7f45dc0fdfd0 2024-04-25T17:22:18.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.585+0000 7f45caffd700 1 -- 172.21.15.37:0/1359643225 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f45d0009430 con 0x7f45dc0fdfd0 2024-04-25T17:22:18.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.585+0000 7f45caffd700 1 -- 172.21.15.37:0/1359643225 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45d000e070 con 0x7f45dc0fdfd0 2024-04-25T17:22:18.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.586+0000 7f45e0ef5700 1 -- 172.21.15.37:0/1359643225 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45dc04c710 con 0x7f45dc0fdfd0 2024-04-25T17:22:18.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.586+0000 7f45caffd700 1 -- 172.21.15.37:0/1359643225 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 38) v1 ==== 98763+0+0 (secure 0 0 0) 0x7f45d001c750 con 0x7f45dc0fdfd0 2024-04-25T17:22:18.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.587+0000 7f45caffd700 1 --2- 172.21.15.37:0/1359643225 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f45c4076ca0 0x7f45c4079150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:22:18.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.587+0000 7f45caffd700 1 -- 172.21.15.37:0/1359643225 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f45d00995d0 con 0x7f45dc0fdfd0 2024-04-25T17:22:18.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.587+0000 7f45da59c700 1 --2- 172.21.15.37:0/1359643225 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f45c4076ca0 0x7f45c4079150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:22:18.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.588+0000 7f45da59c700 1 --2- 172.21.15.37:0/1359643225 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f45c4076ca0 0x7f45c4079150 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f45cc009b80 tx=0x7f45cc00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:22:18.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.592+0000 7f45caffd700 1 -- 172.21.15.37:0/1359643225 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f45d0062050 con 0x7f45dc0fdfd0 2024-04-25T17:22:18.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.829+0000 7f45e0ef5700 1 -- 172.21.15.37:0/1359643225 --> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f45dc1022a0 con 0x7f45c4076ca0 2024-04-25T17:22:18.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.830+0000 7f45caffd700 1 -- 172.21.15.37:0/1359643225 <== mgr.34104 v2:172.21.15.37:6800/783197737 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+402 (secure 0 0 0) 0x7f45dc1022a0 con 0x7f45c4076ca0 2024-04-25T17:22:18.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.832+0000 7f45e0ef5700 1 -- 172.21.15.37:0/1359643225 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f45c4076ca0 msgr2=0x7f45c4079150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:22:18.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.832+0000 7f45e0ef5700 1 --2- 172.21.15.37:0/1359643225 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f45c4076ca0 0x7f45c4079150 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f45cc009b80 tx=0x7f45cc00b040 comp rx=0 tx=0).stop 2024-04-25T17:22:18.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.832+0000 7f45e0ef5700 1 -- 172.21.15.37:0/1359643225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45dc0fdfd0 msgr2=0x7f45dc10ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:22:18.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.832+0000 7f45e0ef5700 1 --2- 172.21.15.37:0/1359643225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45dc0fdfd0 0x7f45dc10ddc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f45d0013870 tx=0x7f45d0009e30 comp rx=0 tx=0).stop 2024-04-25T17:22:18.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.832+0000 7f45e0ef5700 1 -- 172.21.15.37:0/1359643225 shutdown_connections 2024-04-25T17:22:18.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.832+0000 7f45e0ef5700 1 --2- 172.21.15.37:0/1359643225 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f45c4076ca0 0x7f45c4079150 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:18.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.832+0000 7f45e0ef5700 1 --2- 172.21.15.37:0/1359643225 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45dc0fce60 0x7f45dc10d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:18.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.832+0000 7f45e0ef5700 1 --2- 172.21.15.37:0/1359643225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45dc0fdfd0 0x7f45dc10ddc0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:18.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.832+0000 7f45e0ef5700 1 -- 172.21.15.37:0/1359643225 >> 172.21.15.37:0/1359643225 conn(0x7f45dc0f8540 msgr2=0x7f45dc0f9af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:22:18.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.832+0000 7f45e0ef5700 1 -- 172.21.15.37:0/1359643225 shutdown_connections 2024-04-25T17:22:18.833 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.832+0000 7f45e0ef5700 1 -- 172.21.15.37:0/1359643225 wait complete. 2024-04-25T17:22:18.843 INFO:teuthology.orchestra.run.smithi037.stdout:true 2024-04-25T17:22:18.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.941+0000 7f354009c700 1 -- 172.21.15.37:0/4025899324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3538102340 msgr2=0x7f3538104720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:22:18.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.941+0000 7f354009c700 1 --2- 172.21.15.37:0/4025899324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3538102340 0x7f3538104720 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3528004940 tx=0x7f3528009e30 comp rx=0 tx=0).stop 2024-04-25T17:22:18.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.941+0000 7f354009c700 1 -- 172.21.15.37:0/4025899324 shutdown_connections 2024-04-25T17:22:18.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.941+0000 7f354009c700 1 --2- 172.21.15.37:0/4025899324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3538102340 0x7f3538104720 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:18.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.941+0000 7f354009c700 1 --2- 172.21.15.37:0/4025899324 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3538066260 0x7f3538101e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:18.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.941+0000 7f354009c700 1 -- 172.21.15.37:0/4025899324 >> 172.21.15.37:0/4025899324 conn(0x7f35380f7430 msgr2=0x7f35380f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:22:18.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.941+0000 7f354009c700 1 -- 172.21.15.37:0/4025899324 shutdown_connections 2024-04-25T17:22:18.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.941+0000 7f354009c700 1 -- 172.21.15.37:0/4025899324 wait complete. 2024-04-25T17:22:18.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.942+0000 7f354009c700 1 Processor -- start 2024-04-25T17:22:18.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.942+0000 7f354009c700 1 -- start start 2024-04-25T17:22:18.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.942+0000 7f354009c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3538066260 0x7f353810fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:22:18.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.942+0000 7f354009c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3538102340 0x7f3538110100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:22:18.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.942+0000 7f354009c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3538110700 con 0x7f3538102340 2024-04-25T17:22:18.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.942+0000 7f354009c700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3538110f00 con 0x7f3538066260 2024-04-25T17:22:18.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.942+0000 7f353d637700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3538102340 0x7f3538110100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:22:18.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.942+0000 7f353d637700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3538102340 0x7f3538110100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48456/0 (socket says 172.21.15.37:48456) 2024-04-25T17:22:18.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.942+0000 7f353d637700 1 -- 172.21.15.37:0/1077406803 learned_addr learned my addr 172.21.15.37:0/1077406803 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:22:18.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.942+0000 7f353de38700 1 --2- 172.21.15.37:0/1077406803 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3538066260 0x7f353810fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:22:18.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.942+0000 7f353d637700 1 -- 172.21.15.37:0/1077406803 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3538066260 msgr2=0x7f353810fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:22:18.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.942+0000 7f353d637700 1 --2- 172.21.15.37:0/1077406803 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3538066260 0x7f353810fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:18.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.942+0000 7f353d637700 1 -- 172.21.15.37:0/1077406803 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3528005040 con 0x7f3538102340 2024-04-25T17:22:18.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.943+0000 7f353d637700 1 --2- 172.21.15.37:0/1077406803 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3538102340 0x7f3538110100 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3528009150 tx=0x7f3528009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:22:18.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.943+0000 7f352e7fc700 1 -- 172.21.15.37:0/1077406803 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f352800e040 con 0x7f3538102340 2024-04-25T17:22:18.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.943+0000 7f352e7fc700 1 -- 172.21.15.37:0/1077406803 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3528004290 con 0x7f3538102340 2024-04-25T17:22:18.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.943+0000 7f354009c700 1 -- 172.21.15.37:0/1077406803 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3538111180 con 0x7f3538102340 2024-04-25T17:22:18.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.943+0000 7f352e7fc700 1 -- 172.21.15.37:0/1077406803 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f352801c630 con 0x7f3538102340 2024-04-25T17:22:18.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.944+0000 7f354009c700 1 -- 172.21.15.37:0/1077406803 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35381116c0 con 0x7f3538102340 2024-04-25T17:22:18.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.945+0000 7f354009c700 1 -- 172.21.15.37:0/1077406803 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f353805f5c0 con 0x7f3538102340 2024-04-25T17:22:18.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.946+0000 7f352e7fc700 1 -- 172.21.15.37:0/1077406803 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 38) v1 ==== 98763+0+0 (secure 0 0 0) 0x7f352800bbf0 con 0x7f3538102340 2024-04-25T17:22:18.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.946+0000 7f352e7fc700 1 --2- 172.21.15.37:0/1077406803 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f3524076ca0 0x7f3524079150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:22:18.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.946+0000 7f352e7fc700 1 -- 172.21.15.37:0/1077406803 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f3528099120 con 0x7f3538102340 2024-04-25T17:22:18.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.946+0000 7f353de38700 1 --2- 172.21.15.37:0/1077406803 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f3524076ca0 0x7f3524079150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:22:18.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.947+0000 7f353de38700 1 --2- 172.21.15.37:0/1077406803 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f3524076ca0 0x7f3524079150 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3534009fd0 tx=0x7f353400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:22:18.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:18.951+0000 7f352e7fc700 1 -- 172.21.15.37:0/1077406803 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f3528061b00 con 0x7f3538102340 2024-04-25T17:22:19.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.180+0000 7f354009c700 1 -- 172.21.15.37:0/1077406803 --> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3538111a40 con 0x7f3524076ca0 2024-04-25T17:22:19.181 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:19 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:19.181 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:19 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:19.182 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.182+0000 7f352e7fc700 1 -- 172.21.15.37:0/1077406803 <== mgr.34104 v2:172.21.15.37:6800/783197737 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+402 (secure 0 0 0) 0x7f3538111a40 con 0x7f3524076ca0 2024-04-25T17:22:19.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.184+0000 7f354009c700 1 -- 172.21.15.37:0/1077406803 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f3524076ca0 msgr2=0x7f3524079150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:22:19.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.184+0000 7f354009c700 1 --2- 172.21.15.37:0/1077406803 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f3524076ca0 0x7f3524079150 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3534009fd0 tx=0x7f353400b040 comp rx=0 tx=0).stop 2024-04-25T17:22:19.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.184+0000 7f354009c700 1 -- 172.21.15.37:0/1077406803 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3538102340 msgr2=0x7f3538110100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:22:19.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.184+0000 7f354009c700 1 --2- 172.21.15.37:0/1077406803 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3538102340 0x7f3538110100 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3528009150 tx=0x7f3528009e30 comp rx=0 tx=0).stop 2024-04-25T17:22:19.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.184+0000 7f354009c700 1 -- 172.21.15.37:0/1077406803 shutdown_connections 2024-04-25T17:22:19.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.184+0000 7f354009c700 1 --2- 172.21.15.37:0/1077406803 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f3524076ca0 0x7f3524079150 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:19.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.184+0000 7f354009c700 1 --2- 172.21.15.37:0/1077406803 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3538066260 0x7f353810fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:19.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.184+0000 7f354009c700 1 --2- 172.21.15.37:0/1077406803 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3538102340 0x7f3538110100 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:19.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.184+0000 7f354009c700 1 -- 172.21.15.37:0/1077406803 >> 172.21.15.37:0/1077406803 conn(0x7f35380f7430 msgr2=0x7f35380f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:22:19.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.184+0000 7f354009c700 1 -- 172.21.15.37:0/1077406803 shutdown_connections 2024-04-25T17:22:19.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.184+0000 7f354009c700 1 -- 172.21.15.37:0/1077406803 wait complete. 2024-04-25T17:22:19.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.308+0000 7fcdca573700 1 -- 172.21.15.37:0/2895084514 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdc40fcf60 msgr2=0x7fcdc40fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:22:19.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.308+0000 7fcdca573700 1 --2- 172.21.15.37:0/2895084514 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdc40fcf60 0x7fcdc40fd3d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcdb8004940 tx=0x7fcdb8009e30 comp rx=0 tx=0).stop 2024-04-25T17:22:19.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.308+0000 7fcdca573700 1 -- 172.21.15.37:0/2895084514 shutdown_connections 2024-04-25T17:22:19.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.308+0000 7fcdca573700 1 --2- 172.21.15.37:0/2895084514 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdc40fcf60 0x7fcdc40fd3d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:19.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.308+0000 7fcdca573700 1 --2- 172.21.15.37:0/2895084514 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcdc40fbcb0 0x7fcdc40fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:19.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.308+0000 7fcdca573700 1 -- 172.21.15.37:0/2895084514 >> 172.21.15.37:0/2895084514 conn(0x7fcdc40f7430 msgr2=0x7fcdc40f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:22:19.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.308+0000 7fcdca573700 1 -- 172.21.15.37:0/2895084514 shutdown_connections 2024-04-25T17:22:19.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.308+0000 7fcdca573700 1 -- 172.21.15.37:0/2895084514 wait complete. 2024-04-25T17:22:19.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.308+0000 7fcdca573700 1 Processor -- start 2024-04-25T17:22:19.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.309+0000 7fcdca573700 1 -- start start 2024-04-25T17:22:19.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.309+0000 7fcdca573700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdc40fbcb0 0x7fcdc4112ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:22:19.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.309+0000 7fcdca573700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcdc40fcf60 0x7fcdc4115010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:22:19.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.309+0000 7fcdca573700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc4066220 con 0x7fcdc40fbcb0 2024-04-25T17:22:19.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.309+0000 7fcdca573700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc4066360 con 0x7fcdc40fcf60 2024-04-25T17:22:19.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.309+0000 7fcdc3fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdc40fbcb0 0x7fcdc4112ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:22:19.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.309+0000 7fcdc3fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdc40fbcb0 0x7fcdc4112ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48480/0 (socket says 172.21.15.37:48480) 2024-04-25T17:22:19.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.309+0000 7fcdc3fff700 1 -- 172.21.15.37:0/1917995023 learned_addr learned my addr 172.21.15.37:0/1917995023 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:22:19.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.309+0000 7fcdc37fe700 1 --2- 172.21.15.37:0/1917995023 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcdc40fcf60 0x7fcdc4115010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:22:19.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.309+0000 7fcdc3fff700 1 -- 172.21.15.37:0/1917995023 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcdc40fcf60 msgr2=0x7fcdc4115010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:22:19.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.309+0000 7fcdc3fff700 1 --2- 172.21.15.37:0/1917995023 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcdc40fcf60 0x7fcdc4115010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:19.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.309+0000 7fcdc3fff700 1 -- 172.21.15.37:0/1917995023 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb8005040 con 0x7fcdc40fbcb0 2024-04-25T17:22:19.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.310+0000 7fcdc3fff700 1 --2- 172.21.15.37:0/1917995023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdc40fbcb0 0x7fcdc4112ac0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcdb400eb70 tx=0x7fcdb400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:22:19.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.310+0000 7fcdc0ff9700 1 -- 172.21.15.37:0/1917995023 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcdb4007cc0 con 0x7fcdc40fbcb0 2024-04-25T17:22:19.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.310+0000 7fcdca573700 1 -- 172.21.15.37:0/1917995023 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdc4115550 con 0x7fcdc40fbcb0 2024-04-25T17:22:19.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.310+0000 7fcdca573700 1 -- 172.21.15.37:0/1917995023 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdc41158a0 con 0x7fcdc40fbcb0 2024-04-25T17:22:19.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.310+0000 7fcdc0ff9700 1 -- 172.21.15.37:0/1917995023 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcdb400f040 con 0x7fcdc40fbcb0 2024-04-25T17:22:19.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.310+0000 7fcdc0ff9700 1 -- 172.21.15.37:0/1917995023 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcdb400ca90 con 0x7fcdc40fbcb0 2024-04-25T17:22:19.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.311+0000 7fcdca573700 1 -- 172.21.15.37:0/1917995023 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdb00052e0 con 0x7fcdc40fbcb0 2024-04-25T17:22:19.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.312+0000 7fcdc0ff9700 1 -- 172.21.15.37:0/1917995023 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 38) v1 ==== 98763+0+0 (secure 0 0 0) 0x7fcdb4009710 con 0x7fcdc40fbcb0 2024-04-25T17:22:19.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.313+0000 7fcdc0ff9700 1 --2- 172.21.15.37:0/1917995023 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fcdac076ca0 0x7fcdac079150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:22:19.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.313+0000 7fcdc37fe700 1 --2- 172.21.15.37:0/1917995023 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fcdac076ca0 0x7fcdac079150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:22:19.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.313+0000 7fcdc0ff9700 1 -- 172.21.15.37:0/1917995023 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fcdb4098030 con 0x7fcdc40fbcb0 2024-04-25T17:22:19.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.313+0000 7fcdc37fe700 1 --2- 172.21.15.37:0/1917995023 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fcdac076ca0 0x7fcdac079150 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcdb8009b30 tx=0x7fcdb8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:22:19.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.318+0000 7fcdc0ff9700 1 -- 172.21.15.37:0/1917995023 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fcdb4060990 con 0x7fcdc40fbcb0 2024-04-25T17:22:19.323 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:19 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:19.323 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:19 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:19.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.538+0000 7fcdca573700 1 -- 172.21.15.37:0/1917995023 --> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fcdb0000bf0 con 0x7fcdac076ca0 2024-04-25T17:22:19.550 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.548+0000 7fcdc0ff9700 1 -- 172.21.15.37:0/1917995023 <== mgr.34104 v2:172.21.15.37:6800/783197737 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fcdb0000bf0 con 0x7fcdac076ca0 2024-04-25T17:22:19.550 INFO:teuthology.orchestra.run.smithi037.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-25T17:22:19.550 INFO:teuthology.orchestra.run.smithi037.stdout:alertmanager.smithi037 smithi037 *:9093,9094 running (3m) 1s ago 12m 27.7M - 0.25.0 c8568f914cd2 18aed8f409ee 2024-04-25T17:22:19.550 INFO:teuthology.orchestra.run.smithi037.stdout:crash.smithi037 smithi037 running (12s) 1s ago 12m 6660k - 19.0.0-3291-g994e2f20 d53c96779a29 639584ea5855 2024-04-25T17:22:19.550 INFO:teuthology.orchestra.run.smithi037.stdout:crash.smithi069 smithi069 running (7s) 3s ago 11m 6665k - 19.0.0-3291-g994e2f20 d53c96779a29 ee5db16733a7 2024-04-25T17:22:19.550 INFO:teuthology.orchestra.run.smithi037.stdout:grafana.smithi037 smithi037 *:3000 running (3m) 1s ago 11m 86.6M - 9.4.7 954c08fa6188 1eff3ea3f9b0 2024-04-25T17:22:19.551 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi037.ksmixc smithi037 running (6m) 1s ago 6m 150M - 17.2.7-902-gc61472c8 0de407c1b3af 394aa56079b4 2024-04-25T17:22:19.551 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi037.ovkrpq smithi037 running (6m) 1s ago 6m 102M - 17.2.7-902-gc61472c8 0de407c1b3af 73ca662174a7 2024-04-25T17:22:19.551 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi069.cpprst smithi069 running (6m) 3s ago 6m 15.5M - 17.2.7-902-gc61472c8 0de407c1b3af dbda101df20e 2024-04-25T17:22:19.551 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi069.ytlqcf smithi069 running (6m) 3s ago 6m 13.5M - 17.2.7-902-gc61472c8 0de407c1b3af 911df6b18215 2024-04-25T17:22:19.551 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.smithi037.txrgxl smithi037 *:8443,9283,8765 running (2m) 1s ago 13m 564M - 19.0.0-3291-g994e2f20 d53c96779a29 e9653fc62df9 2024-04-25T17:22:19.551 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.smithi069.mmuhdo smithi069 *:8443,9283,8765 running (109s) 3s ago 11m 518M - 19.0.0-3291-g994e2f20 d53c96779a29 6820207b4019 2024-04-25T17:22:19.551 INFO:teuthology.orchestra.run.smithi037.stdout:mon.smithi037 smithi037 running (78s) 1s ago 13m 107M 2048M 19.0.0-3291-g994e2f20 d53c96779a29 1b349f3af69d 2024-04-25T17:22:19.551 INFO:teuthology.orchestra.run.smithi037.stdout:mon.smithi069 smithi069 running (52s) 3s ago 10m 99.3M 2048M 19.0.0-3291-g994e2f20 d53c96779a29 7744dbe81b50 2024-04-25T17:22:19.551 INFO:teuthology.orchestra.run.smithi037.stdout:node-exporter.smithi037 smithi037 *:9100 running (3m) 1s ago 12m 14.4M - 1.5.0 0da6a335fe13 1e59bbb2aa82 2024-04-25T17:22:19.551 INFO:teuthology.orchestra.run.smithi037.stdout:node-exporter.smithi069 smithi069 *:9100 running (3m) 3s ago 11m 16.7M - 1.5.0 0da6a335fe13 0c51a9833fe4 2024-04-25T17:22:19.551 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0 smithi037 running (10m) 1s ago 10m 228M 1559M 17.2.7-902-gc61472c8 0de407c1b3af 8ff4b0f1aae9 2024-04-25T17:22:19.551 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1 smithi037 running (9m) 1s ago 9m 242M 1559M 17.2.7-902-gc61472c8 0de407c1b3af 5715a5da241d 2024-04-25T17:22:19.551 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2 smithi037 running (9m) 1s ago 9m 204M 1559M 17.2.7-902-gc61472c8 0de407c1b3af 2eedaf9886dd 2024-04-25T17:22:19.551 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3 smithi069 running (8m) 3s ago 8m 276M 2581M 17.2.7-902-gc61472c8 0de407c1b3af ebba78fb1923 2024-04-25T17:22:19.552 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4 smithi069 running (8m) 3s ago 8m 253M 2581M 17.2.7-902-gc61472c8 0de407c1b3af ba7b785c50f9 2024-04-25T17:22:19.552 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5 smithi069 running (8m) 3s ago 8m 228M 2581M 17.2.7-902-gc61472c8 0de407c1b3af f6be99c364ff 2024-04-25T17:22:19.552 INFO:teuthology.orchestra.run.smithi037.stdout:prometheus.smithi037 smithi037 *:9095 running (116s) 1s ago 11m 63.7M - 2.43.0 a07b618ecd1d 2c5a268ffc1f 2024-04-25T17:22:19.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.550+0000 7fcdca573700 1 -- 172.21.15.37:0/1917995023 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fcdac076ca0 msgr2=0x7fcdac079150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:22:19.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.551+0000 7fcdca573700 1 --2- 172.21.15.37:0/1917995023 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fcdac076ca0 0x7fcdac079150 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcdb8009b30 tx=0x7fcdb8009e30 comp rx=0 tx=0).stop 2024-04-25T17:22:19.552 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.551+0000 7fcdca573700 1 -- 172.21.15.37:0/1917995023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdc40fbcb0 msgr2=0x7fcdc4112ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:22:19.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.551+0000 7fcdca573700 1 --2- 172.21.15.37:0/1917995023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdc40fbcb0 0x7fcdc4112ac0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcdb400eb70 tx=0x7fcdb400b040 comp rx=0 tx=0).stop 2024-04-25T17:22:19.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.551+0000 7fcdca573700 1 -- 172.21.15.37:0/1917995023 shutdown_connections 2024-04-25T17:22:19.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.551+0000 7fcdca573700 1 --2- 172.21.15.37:0/1917995023 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fcdac076ca0 0x7fcdac079150 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:19.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.551+0000 7fcdca573700 1 --2- 172.21.15.37:0/1917995023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdc40fbcb0 0x7fcdc4112ac0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:19.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.551+0000 7fcdca573700 1 --2- 172.21.15.37:0/1917995023 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcdc40fcf60 0x7fcdc4115010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:19.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.551+0000 7fcdca573700 1 -- 172.21.15.37:0/1917995023 >> 172.21.15.37:0/1917995023 conn(0x7fcdc40f7430 msgr2=0x7fcdc40f8a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:22:19.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.551+0000 7fcdca573700 1 -- 172.21.15.37:0/1917995023 shutdown_connections 2024-04-25T17:22:19.553 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.551+0000 7fcdca573700 1 -- 172.21.15.37:0/1917995023 wait complete. 2024-04-25T17:22:19.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.657+0000 7fcaee52c700 1 -- 172.21.15.37:0/2926797704 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcae80fcf60 msgr2=0x7fcae80fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:22:19.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.657+0000 7fcaee52c700 1 --2- 172.21.15.37:0/2926797704 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcae80fcf60 0x7fcae80fd3d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcadc004940 tx=0x7fcadc009e30 comp rx=0 tx=0).stop 2024-04-25T17:22:19.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.657+0000 7fcaee52c700 1 -- 172.21.15.37:0/2926797704 shutdown_connections 2024-04-25T17:22:19.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.657+0000 7fcaee52c700 1 --2- 172.21.15.37:0/2926797704 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcae80fcf60 0x7fcae80fd3d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:19.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.657+0000 7fcaee52c700 1 --2- 172.21.15.37:0/2926797704 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcae80fbcb0 0x7fcae80fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:19.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.657+0000 7fcaee52c700 1 -- 172.21.15.37:0/2926797704 >> 172.21.15.37:0/2926797704 conn(0x7fcae80f7430 msgr2=0x7fcae80f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:22:19.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.657+0000 7fcaee52c700 1 -- 172.21.15.37:0/2926797704 shutdown_connections 2024-04-25T17:22:19.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.657+0000 7fcaee52c700 1 -- 172.21.15.37:0/2926797704 wait complete. 2024-04-25T17:22:19.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.658+0000 7fcaee52c700 1 Processor -- start 2024-04-25T17:22:19.659 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.658+0000 7fcaee52c700 1 -- start start 2024-04-25T17:22:19.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.658+0000 7fcaee52c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcae80fbcb0 0x7fcae810da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:22:19.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.658+0000 7fcaee52c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcae80fcf60 0x7fcae810dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:22:19.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.658+0000 7fcaee52c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae810e5c0 con 0x7fcae80fbcb0 2024-04-25T17:22:19.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.658+0000 7fcaee52c700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae810ed70 con 0x7fcae80fcf60 2024-04-25T17:22:19.660 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.658+0000 7fcae7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcae80fbcb0 0x7fcae810da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:22:19.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.658+0000 7fcae7fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcae80fbcb0 0x7fcae810da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48496/0 (socket says 172.21.15.37:48496) 2024-04-25T17:22:19.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.658+0000 7fcae7fff700 1 -- 172.21.15.37:0/1758670884 learned_addr learned my addr 172.21.15.37:0/1758670884 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:22:19.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.659+0000 7fcae77fe700 1 --2- 172.21.15.37:0/1758670884 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcae80fcf60 0x7fcae810dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:22:19.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.659+0000 7fcae7fff700 1 -- 172.21.15.37:0/1758670884 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcae80fcf60 msgr2=0x7fcae810dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:22:19.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.659+0000 7fcae7fff700 1 --2- 172.21.15.37:0/1758670884 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcae80fcf60 0x7fcae810dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:19.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.659+0000 7fcae7fff700 1 -- 172.21.15.37:0/1758670884 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcadc005040 con 0x7fcae80fbcb0 2024-04-25T17:22:19.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.659+0000 7fcae77fe700 1 --2- 172.21.15.37:0/1758670884 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcae80fcf60 0x7fcae810dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T17:22:19.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.659+0000 7fcae7fff700 1 --2- 172.21.15.37:0/1758670884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcae80fbcb0 0x7fcae810da80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcad800eb40 tx=0x7fcad800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:22:19.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.659+0000 7fcae4ff9700 1 -- 172.21.15.37:0/1758670884 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcad8007cc0 con 0x7fcae80fbcb0 2024-04-25T17:22:19.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.659+0000 7fcaee52c700 1 -- 172.21.15.37:0/1758670884 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcae810eff0 con 0x7fcae80fbcb0 2024-04-25T17:22:19.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.659+0000 7fcae4ff9700 1 -- 172.21.15.37:0/1758670884 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcad800f040 con 0x7fcae80fbcb0 2024-04-25T17:22:19.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.659+0000 7fcae4ff9700 1 -- 172.21.15.37:0/1758670884 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcad8009620 con 0x7fcae80fbcb0 2024-04-25T17:22:19.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.659+0000 7fcaee52c700 1 -- 172.21.15.37:0/1758670884 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcae810f530 con 0x7fcae80fbcb0 2024-04-25T17:22:19.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.661+0000 7fcaee52c700 1 -- 172.21.15.37:0/1758670884 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcae8101af0 con 0x7fcae80fbcb0 2024-04-25T17:22:19.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.661+0000 7fcae4ff9700 1 -- 172.21.15.37:0/1758670884 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 38) v1 ==== 98763+0+0 (secure 0 0 0) 0x7fcad8009780 con 0x7fcae80fbcb0 2024-04-25T17:22:19.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.661+0000 7fcae4ff9700 1 --2- 172.21.15.37:0/1758670884 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fcad0076ca0 0x7fcad0079150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:22:19.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.661+0000 7fcae4ff9700 1 -- 172.21.15.37:0/1758670884 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fcad8098100 con 0x7fcae80fbcb0 2024-04-25T17:22:19.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.661+0000 7fcae77fe700 1 --2- 172.21.15.37:0/1758670884 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fcad0076ca0 0x7fcad0079150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:22:19.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.662+0000 7fcae77fe700 1 --2- 172.21.15.37:0/1758670884 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fcad0076ca0 0x7fcad0079150 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fcadc009b30 tx=0x7fcadc009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:22:19.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:19.666+0000 7fcae4ff9700 1 -- 172.21.15.37:0/1758670884 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fcad8060b90 con 0x7fcae80fbcb0 2024-04-25T17:22:20.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.020+0000 7fcaee52c700 1 -- 172.21.15.37:0/1758670884 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fcae8104880 con 0x7fcae80fbcb0 2024-04-25T17:22:20.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.020+0000 7fcae4ff9700 1 -- 172.21.15.37:0/1758670884 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+736 (secure 0 0 0) 0x7fcad8060530 con 0x7fcae80fbcb0 2024-04-25T17:22:20.021 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-25T17:22:20.021 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": { 2024-04-25T17:22:20.021 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 2 2024-04-25T17:22:20.021 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:22:20.021 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": { 2024-04-25T17:22:20.021 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 2 2024-04-25T17:22:20.022 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:22:20.022 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": { 2024-04-25T17:22:20.022 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 6 2024-04-25T17:22:20.022 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:22:20.022 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": { 2024-04-25T17:22:20.022 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 4 2024-04-25T17:22:20.022 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:22:20.022 INFO:teuthology.orchestra.run.smithi037.stdout: "overall": { 2024-04-25T17:22:20.022 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 10, 2024-04-25T17:22:20.022 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 4 2024-04-25T17:22:20.022 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-04-25T17:22:20.022 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-25T17:22:20.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.022+0000 7fcaee52c700 1 -- 172.21.15.37:0/1758670884 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fcad0076ca0 msgr2=0x7fcad0079150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:22:20.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.022+0000 7fcaee52c700 1 --2- 172.21.15.37:0/1758670884 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fcad0076ca0 0x7fcad0079150 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fcadc009b30 tx=0x7fcadc009e30 comp rx=0 tx=0).stop 2024-04-25T17:22:20.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.022+0000 7fcaee52c700 1 -- 172.21.15.37:0/1758670884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcae80fbcb0 msgr2=0x7fcae810da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:22:20.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.022+0000 7fcaee52c700 1 --2- 172.21.15.37:0/1758670884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcae80fbcb0 0x7fcae810da80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcad800eb40 tx=0x7fcad800b040 comp rx=0 tx=0).stop 2024-04-25T17:22:20.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.022+0000 7fcaee52c700 1 -- 172.21.15.37:0/1758670884 shutdown_connections 2024-04-25T17:22:20.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.022+0000 7fcaee52c700 1 --2- 172.21.15.37:0/1758670884 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fcad0076ca0 0x7fcad0079150 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:20.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.022+0000 7fcaee52c700 1 --2- 172.21.15.37:0/1758670884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcae80fbcb0 0x7fcae810da80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:20.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.022+0000 7fcaee52c700 1 --2- 172.21.15.37:0/1758670884 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcae80fcf60 0x7fcae810dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:20.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.022+0000 7fcaee52c700 1 -- 172.21.15.37:0/1758670884 >> 172.21.15.37:0/1758670884 conn(0x7fcae80f7430 msgr2=0x7fcae8065c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:22:20.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.022+0000 7fcaee52c700 1 -- 172.21.15.37:0/1758670884 shutdown_connections 2024-04-25T17:22:20.024 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.022+0000 7fcaee52c700 1 -- 172.21.15.37:0/1758670884 wait complete. 2024-04-25T17:22:20.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.132+0000 7f750ab67700 1 -- 172.21.15.37:0/3908688236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7504070810 msgr2=0x7f7504070c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:22:20.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.132+0000 7f750ab67700 1 --2- 172.21.15.37:0/3908688236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7504070810 0x7f7504070c80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f74f8004940 tx=0x7f74f8009e30 comp rx=0 tx=0).stop 2024-04-25T17:22:20.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.132+0000 7f750ab67700 1 -- 172.21.15.37:0/3908688236 shutdown_connections 2024-04-25T17:22:20.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.132+0000 7f750ab67700 1 --2- 172.21.15.37:0/3908688236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7504070810 0x7f7504070c80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:20.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.132+0000 7f750ab67700 1 --2- 172.21.15.37:0/3908688236 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7504071dc0 0x7f75040702d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:20.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.132+0000 7f750ab67700 1 -- 172.21.15.37:0/3908688236 >> 172.21.15.37:0/3908688236 conn(0x7f75040f8540 msgr2=0x7f75040fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:22:20.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.132+0000 7f750ab67700 1 -- 172.21.15.37:0/3908688236 shutdown_connections 2024-04-25T17:22:20.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.132+0000 7f750ab67700 1 -- 172.21.15.37:0/3908688236 wait complete. 2024-04-25T17:22:20.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.133+0000 7f750ab67700 1 Processor -- start 2024-04-25T17:22:20.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.133+0000 7f750ab67700 1 -- start start 2024-04-25T17:22:20.135 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.133+0000 7f750ab67700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7504070810 0x7f750410fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:22:20.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.133+0000 7f750ab67700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7504071dc0 0x7f75041101a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:22:20.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.133+0000 7f750ab67700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7504110830 con 0x7f7504071dc0 2024-04-25T17:22:20.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.133+0000 7f750ab67700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7504111020 con 0x7f7504070810 2024-04-25T17:22:20.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.133+0000 7f7503fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7504071dc0 0x7f75041101a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:22:20.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.133+0000 7f7503fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7504071dc0 0x7f75041101a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48506/0 (socket says 172.21.15.37:48506) 2024-04-25T17:22:20.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.133+0000 7f7503fff700 1 -- 172.21.15.37:0/3556018415 learned_addr learned my addr 172.21.15.37:0/3556018415 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:22:20.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.133+0000 7f7508903700 1 --2- 172.21.15.37:0/3556018415 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7504070810 0x7f750410fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:22:20.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.133+0000 7f7503fff700 1 -- 172.21.15.37:0/3556018415 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7504070810 msgr2=0x7f750410fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:22:20.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.133+0000 7f7503fff700 1 --2- 172.21.15.37:0/3556018415 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7504070810 0x7f750410fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:20.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.133+0000 7f7503fff700 1 -- 172.21.15.37:0/3556018415 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74f8005040 con 0x7f7504071dc0 2024-04-25T17:22:20.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.134+0000 7f7503fff700 1 --2- 172.21.15.37:0/3556018415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7504071dc0 0x7f75041101a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f74f800b3b0 tx=0x7f74f8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:22:20.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.134+0000 7f75017fa700 1 -- 172.21.15.37:0/3556018415 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74f800e040 con 0x7f7504071dc0 2024-04-25T17:22:20.136 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.134+0000 7f750ab67700 1 -- 172.21.15.37:0/3556018415 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75041112a0 con 0x7f7504071dc0 2024-04-25T17:22:20.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.134+0000 7f75017fa700 1 -- 172.21.15.37:0/3556018415 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f74f800bcc0 con 0x7f7504071dc0 2024-04-25T17:22:20.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.134+0000 7f75017fa700 1 -- 172.21.15.37:0/3556018415 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74f801c630 con 0x7f7504071dc0 2024-04-25T17:22:20.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.134+0000 7f750ab67700 1 -- 172.21.15.37:0/3556018415 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7504111860 con 0x7f7504071dc0 2024-04-25T17:22:20.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.135+0000 7f750ab67700 1 -- 172.21.15.37:0/3556018415 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f750405f5c0 con 0x7f7504071dc0 2024-04-25T17:22:20.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.136+0000 7f75017fa700 1 -- 172.21.15.37:0/3556018415 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 38) v1 ==== 98763+0+0 (secure 0 0 0) 0x7f74f8013980 con 0x7f7504071dc0 2024-04-25T17:22:20.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.136+0000 7f75017fa700 1 --2- 172.21.15.37:0/3556018415 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f74ec076ca0 0x7f74ec079150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:22:20.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.136+0000 7f75017fa700 1 -- 172.21.15.37:0/3556018415 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f74f80991c0 con 0x7f7504071dc0 2024-04-25T17:22:20.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.136+0000 7f7508903700 1 --2- 172.21.15.37:0/3556018415 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f74ec076ca0 0x7f74ec079150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:22:20.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.137+0000 7f7508903700 1 --2- 172.21.15.37:0/3556018415 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f74ec076ca0 0x7f74ec079150 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7504071b00 tx=0x7f74fc009620 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:22:20.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.141+0000 7f75017fa700 1 -- 172.21.15.37:0/3556018415 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f74f8061ba0 con 0x7f7504071dc0 2024-04-25T17:22:20.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:20 smithi069 ceph-mon[80239]: pgmap v36: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:22:20.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:20 smithi069 ceph-mon[80239]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:22:20.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:20 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:20.170 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:20 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:20.170 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:20 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:20.170 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:20 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:20.170 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:20 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/1758670884' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:22:20.259 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:20 smithi037 ceph-mon[90844]: pgmap v36: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:22:20.259 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:20 smithi037 ceph-mon[90844]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:22:20.260 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:20 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:20.260 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:20 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:20.260 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:20 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:20.260 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:20 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:20.260 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:20 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/1758670884' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:22:20.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.399+0000 7f750ab67700 1 -- 172.21.15.37:0/3556018415 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f750404bed0 con 0x7f7504071dc0 2024-04-25T17:22:20.400 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.400+0000 7f75017fa700 1 -- 172.21.15.37:0/3556018415 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1900 (secure 0 0 0) 0x7f74f8061540 con 0x7f7504071dc0 2024-04-25T17:22:20.400 INFO:teuthology.orchestra.run.smithi037.stdout:e16 2024-04-25T17:22:20.401 INFO:teuthology.orchestra.run.smithi037.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-25T17:22:20.401 INFO:teuthology.orchestra.run.smithi037.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T17:22:20.401 INFO:teuthology.orchestra.run.smithi037.stdout:legacy client fscid: 1 2024-04-25T17:22:20.401 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:22:20.401 INFO:teuthology.orchestra.run.smithi037.stdout:Filesystem 'cephfs' (1) 2024-04-25T17:22:20.401 INFO:teuthology.orchestra.run.smithi037.stdout:fs_name cephfs 2024-04-25T17:22:20.401 INFO:teuthology.orchestra.run.smithi037.stdout:epoch 16 2024-04-25T17:22:20.401 INFO:teuthology.orchestra.run.smithi037.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-25T17:22:20.401 INFO:teuthology.orchestra.run.smithi037.stdout:created 2024-04-25T17:15:40.586130+0000 2024-04-25T17:22:20.401 INFO:teuthology.orchestra.run.smithi037.stdout:modified 2024-04-25T17:15:57.508740+0000 2024-04-25T17:22:20.401 INFO:teuthology.orchestra.run.smithi037.stdout:tableserver 0 2024-04-25T17:22:20.401 INFO:teuthology.orchestra.run.smithi037.stdout:root 0 2024-04-25T17:22:20.401 INFO:teuthology.orchestra.run.smithi037.stdout:session_timeout 60 2024-04-25T17:22:20.402 INFO:teuthology.orchestra.run.smithi037.stdout:session_autoclose 300 2024-04-25T17:22:20.402 INFO:teuthology.orchestra.run.smithi037.stdout:max_file_size 1099511627776 2024-04-25T17:22:20.402 INFO:teuthology.orchestra.run.smithi037.stdout:max_xattr_size 65536 2024-04-25T17:22:20.402 INFO:teuthology.orchestra.run.smithi037.stdout:required_client_features {} 2024-04-25T17:22:20.402 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure 0 2024-04-25T17:22:20.402 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure_osd_epoch 0 2024-04-25T17:22:20.402 INFO:teuthology.orchestra.run.smithi037.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T17:22:20.402 INFO:teuthology.orchestra.run.smithi037.stdout:max_mds 1 2024-04-25T17:22:20.402 INFO:teuthology.orchestra.run.smithi037.stdout:in 0 2024-04-25T17:22:20.402 INFO:teuthology.orchestra.run.smithi037.stdout:up {0=14470} 2024-04-25T17:22:20.402 INFO:teuthology.orchestra.run.smithi037.stdout:failed 2024-04-25T17:22:20.402 INFO:teuthology.orchestra.run.smithi037.stdout:damaged 2024-04-25T17:22:20.402 INFO:teuthology.orchestra.run.smithi037.stdout:stopped 2024-04-25T17:22:20.402 INFO:teuthology.orchestra.run.smithi037.stdout:data_pools [3] 2024-04-25T17:22:20.403 INFO:teuthology.orchestra.run.smithi037.stdout:metadata_pool 2 2024-04-25T17:22:20.403 INFO:teuthology.orchestra.run.smithi037.stdout:inline_data disabled 2024-04-25T17:22:20.403 INFO:teuthology.orchestra.run.smithi037.stdout:balancer 2024-04-25T17:22:20.403 INFO:teuthology.orchestra.run.smithi037.stdout:bal_rank_mask -1 2024-04-25T17:22:20.403 INFO:teuthology.orchestra.run.smithi037.stdout:standby_count_wanted 1 2024-04-25T17:22:20.403 INFO:teuthology.orchestra.run.smithi037.stdout:qdb_cluster leader: 0 members: 2024-04-25T17:22:20.403 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi037.ksmixc{0:14470} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.37:6826/1903989494,v1:172.21.15.37:6827/1903989494] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:22:20.403 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi037.ovkrpq{0:14482} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.37:6828/4206394422,v1:172.21.15.37:6829/4206394422] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:22:20.403 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:22:20.403 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:22:20.403 INFO:teuthology.orchestra.run.smithi037.stdout:Standby daemons: 2024-04-25T17:22:20.403 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:22:20.403 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi069.cpprst{-1:24289} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.69:6826/518856100,v1:172.21.15.69:6827/518856100] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:22:20.403 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi069.ytlqcf{-1:24293} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.69:6824/134210439,v1:172.21.15.69:6825/134210439] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:22:20.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.402+0000 7f750ab67700 1 -- 172.21.15.37:0/3556018415 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f74ec076ca0 msgr2=0x7f74ec079150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:22:20.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.402+0000 7f750ab67700 1 --2- 172.21.15.37:0/3556018415 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f74ec076ca0 0x7f74ec079150 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7504071b00 tx=0x7f74fc009620 comp rx=0 tx=0).stop 2024-04-25T17:22:20.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.402+0000 7f750ab67700 1 -- 172.21.15.37:0/3556018415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7504071dc0 msgr2=0x7f75041101a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:22:20.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.402+0000 7f750ab67700 1 --2- 172.21.15.37:0/3556018415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7504071dc0 0x7f75041101a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f74f800b3b0 tx=0x7f74f8009e30 comp rx=0 tx=0).stop 2024-04-25T17:22:20.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.402+0000 7f750ab67700 1 -- 172.21.15.37:0/3556018415 shutdown_connections 2024-04-25T17:22:20.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.402+0000 7f750ab67700 1 --2- 172.21.15.37:0/3556018415 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f74ec076ca0 0x7f74ec079150 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:20.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.402+0000 7f750ab67700 1 --2- 172.21.15.37:0/3556018415 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7504070810 0x7f750410fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:20.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.402+0000 7f750ab67700 1 --2- 172.21.15.37:0/3556018415 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7504071dc0 0x7f75041101a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:20.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.402+0000 7f750ab67700 1 -- 172.21.15.37:0/3556018415 >> 172.21.15.37:0/3556018415 conn(0x7f75040f8540 msgr2=0x7f75040f9f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:22:20.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.402+0000 7f750ab67700 1 -- 172.21.15.37:0/3556018415 shutdown_connections 2024-04-25T17:22:20.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.402+0000 7f750ab67700 1 -- 172.21.15.37:0/3556018415 wait complete. 2024-04-25T17:22:20.405 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 16 2024-04-25T17:22:20.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.509+0000 7fef79d8f700 1 -- 172.21.15.37:0/1872308904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef74071e40 msgr2=0x7fef74070350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:22:20.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.509+0000 7fef79d8f700 1 --2- 172.21.15.37:0/1872308904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef74071e40 0x7fef74070350 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fef64004940 tx=0x7fef64009e30 comp rx=0 tx=0).stop 2024-04-25T17:22:20.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.510+0000 7fef79d8f700 1 -- 172.21.15.37:0/1872308904 shutdown_connections 2024-04-25T17:22:20.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.510+0000 7fef79d8f700 1 --2- 172.21.15.37:0/1872308904 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fef74070890 0x7fef74070d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:20.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.510+0000 7fef79d8f700 1 --2- 172.21.15.37:0/1872308904 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef74071e40 0x7fef74070350 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:20.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.510+0000 7fef79d8f700 1 -- 172.21.15.37:0/1872308904 >> 172.21.15.37:0/1872308904 conn(0x7fef740f8540 msgr2=0x7fef740fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:22:20.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.510+0000 7fef79d8f700 1 -- 172.21.15.37:0/1872308904 shutdown_connections 2024-04-25T17:22:20.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.510+0000 7fef79d8f700 1 -- 172.21.15.37:0/1872308904 wait complete. 2024-04-25T17:22:20.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.510+0000 7fef79d8f700 1 Processor -- start 2024-04-25T17:22:20.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.510+0000 7fef79d8f700 1 -- start start 2024-04-25T17:22:20.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.511+0000 7fef79d8f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fef74070890 0x7fef7410fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:22:20.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.511+0000 7fef79d8f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef74071e40 0x7fef74110020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:22:20.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.511+0000 7fef79d8f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef74110620 con 0x7fef74071e40 2024-04-25T17:22:20.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.511+0000 7fef79d8f700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef74110790 con 0x7fef74070890 2024-04-25T17:22:20.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.511+0000 7fef72ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef74071e40 0x7fef74110020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:22:20.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.511+0000 7fef72ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef74071e40 0x7fef74110020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48528/0 (socket says 172.21.15.37:48528) 2024-04-25T17:22:20.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.511+0000 7fef72ffd700 1 -- 172.21.15.37:0/786649641 learned_addr learned my addr 172.21.15.37:0/786649641 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:22:20.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.511+0000 7fef737fe700 1 --2- 172.21.15.37:0/786649641 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fef74070890 0x7fef7410fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:22:20.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.511+0000 7fef72ffd700 1 -- 172.21.15.37:0/786649641 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fef74070890 msgr2=0x7fef7410fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:22:20.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.511+0000 7fef72ffd700 1 --2- 172.21.15.37:0/786649641 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fef74070890 0x7fef7410fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:20.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.511+0000 7fef72ffd700 1 -- 172.21.15.37:0/786649641 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef64005040 con 0x7fef74071e40 2024-04-25T17:22:20.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.511+0000 7fef72ffd700 1 --2- 172.21.15.37:0/786649641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef74071e40 0x7fef74110020 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fef6800eb40 tx=0x7fef6800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:22:20.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.512+0000 7fef5bfff700 1 -- 172.21.15.37:0/786649641 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef68007cc0 con 0x7fef74071e40 2024-04-25T17:22:20.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.512+0000 7fef79d8f700 1 -- 172.21.15.37:0/786649641 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef74115190 con 0x7fef74071e40 2024-04-25T17:22:20.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.512+0000 7fef5bfff700 1 -- 172.21.15.37:0/786649641 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fef6800f040 con 0x7fef74071e40 2024-04-25T17:22:20.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.512+0000 7fef5bfff700 1 -- 172.21.15.37:0/786649641 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef6800ca10 con 0x7fef74071e40 2024-04-25T17:22:20.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.512+0000 7fef79d8f700 1 -- 172.21.15.37:0/786649641 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef741156d0 con 0x7fef74071e40 2024-04-25T17:22:20.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.513+0000 7fef79d8f700 1 -- 172.21.15.37:0/786649641 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef7404c710 con 0x7fef74071e40 2024-04-25T17:22:20.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.514+0000 7fef5bfff700 1 -- 172.21.15.37:0/786649641 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 38) v1 ==== 98763+0+0 (secure 0 0 0) 0x7fef6800cb70 con 0x7fef74071e40 2024-04-25T17:22:20.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.514+0000 7fef5bfff700 1 --2- 172.21.15.37:0/786649641 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fef5c076ca0 0x7fef5c079150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:22:20.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.514+0000 7fef5bfff700 1 -- 172.21.15.37:0/786649641 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fef68098030 con 0x7fef74071e40 2024-04-25T17:22:20.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.515+0000 7fef737fe700 1 --2- 172.21.15.37:0/786649641 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fef5c076ca0 0x7fef5c079150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:22:20.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.515+0000 7fef737fe700 1 --2- 172.21.15.37:0/786649641 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fef5c076ca0 0x7fef5c079150 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fef64004890 tx=0x7fef64009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:22:20.521 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.521+0000 7fef5bfff700 1 -- 172.21.15.37:0/786649641 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fef68060ac0 con 0x7fef74071e40 2024-04-25T17:22:20.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.751+0000 7fef79d8f700 1 -- 172.21.15.37:0/786649641 --> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fef74103d00 con 0x7fef5c076ca0 2024-04-25T17:22:20.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.752+0000 7fef5bfff700 1 -- 172.21.15.37:0/786649641 <== mgr.34104 v2:172.21.15.37:6800/783197737 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+402 (secure 0 0 0) 0x7fef74103d00 con 0x7fef5c076ca0 2024-04-25T17:22:20.753 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-25T17:22:20.753 INFO:teuthology.orchestra.run.smithi037.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385", 2024-04-25T17:22:20.753 INFO:teuthology.orchestra.run.smithi037.stdout: "in_progress": true, 2024-04-25T17:22:20.753 INFO:teuthology.orchestra.run.smithi037.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-25T17:22:20.753 INFO:teuthology.orchestra.run.smithi037.stdout: "services_complete": [ 2024-04-25T17:22:20.753 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr", 2024-04-25T17:22:20.753 INFO:teuthology.orchestra.run.smithi037.stdout: "crash", 2024-04-25T17:22:20.753 INFO:teuthology.orchestra.run.smithi037.stdout: "mon" 2024-04-25T17:22:20.753 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-04-25T17:22:20.753 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": "6/21 daemons upgraded", 2024-04-25T17:22:20.753 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "Currently upgrading crash daemons", 2024-04-25T17:22:20.753 INFO:teuthology.orchestra.run.smithi037.stdout: "is_paused": false 2024-04-25T17:22:20.753 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-25T17:22:20.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.754+0000 7fef79d8f700 1 -- 172.21.15.37:0/786649641 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fef5c076ca0 msgr2=0x7fef5c079150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:22:20.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.754+0000 7fef79d8f700 1 --2- 172.21.15.37:0/786649641 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fef5c076ca0 0x7fef5c079150 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fef64004890 tx=0x7fef64009e30 comp rx=0 tx=0).stop 2024-04-25T17:22:20.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.754+0000 7fef79d8f700 1 -- 172.21.15.37:0/786649641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef74071e40 msgr2=0x7fef74110020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:22:20.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.754+0000 7fef79d8f700 1 --2- 172.21.15.37:0/786649641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef74071e40 0x7fef74110020 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fef6800eb40 tx=0x7fef6800b040 comp rx=0 tx=0).stop 2024-04-25T17:22:20.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.754+0000 7fef79d8f700 1 -- 172.21.15.37:0/786649641 shutdown_connections 2024-04-25T17:22:20.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.754+0000 7fef79d8f700 1 --2- 172.21.15.37:0/786649641 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fef5c076ca0 0x7fef5c079150 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:20.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.754+0000 7fef79d8f700 1 --2- 172.21.15.37:0/786649641 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fef74070890 0x7fef7410fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:20.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.754+0000 7fef79d8f700 1 --2- 172.21.15.37:0/786649641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef74071e40 0x7fef74110020 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:20.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.754+0000 7fef79d8f700 1 -- 172.21.15.37:0/786649641 >> 172.21.15.37:0/786649641 conn(0x7fef740f8540 msgr2=0x7fef740f9f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:22:20.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.755+0000 7fef79d8f700 1 -- 172.21.15.37:0/786649641 shutdown_connections 2024-04-25T17:22:20.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.755+0000 7fef79d8f700 1 -- 172.21.15.37:0/786649641 wait complete. 2024-04-25T17:22:20.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.859+0000 7ff49677d700 1 -- 172.21.15.37:0/4226565977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4900fcc80 msgr2=0x7ff4900fd0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:22:20.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.859+0000 7ff49677d700 1 --2- 172.21.15.37:0/4226565977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4900fcc80 0x7ff4900fd0f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff478004940 tx=0x7ff478009e30 comp rx=0 tx=0).stop 2024-04-25T17:22:20.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.859+0000 7ff49677d700 1 -- 172.21.15.37:0/4226565977 shutdown_connections 2024-04-25T17:22:20.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.859+0000 7ff49677d700 1 --2- 172.21.15.37:0/4226565977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4900fcc80 0x7ff4900fd0f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:20.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.859+0000 7ff49677d700 1 --2- 172.21.15.37:0/4226565977 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff4900fc330 0x7ff4900fc740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:20.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.859+0000 7ff49677d700 1 -- 172.21.15.37:0/4226565977 >> 172.21.15.37:0/4226565977 conn(0x7ff4900f6be0 msgr2=0x7ff4900f8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:22:20.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.859+0000 7ff49677d700 1 -- 172.21.15.37:0/4226565977 shutdown_connections 2024-04-25T17:22:20.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.859+0000 7ff49677d700 1 -- 172.21.15.37:0/4226565977 wait complete. 2024-04-25T17:22:20.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.859+0000 7ff49677d700 1 Processor -- start 2024-04-25T17:22:20.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.859+0000 7ff49677d700 1 -- start start 2024-04-25T17:22:20.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.860+0000 7ff49677d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff4900fc330 0x7ff4900fba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:22:20.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.860+0000 7ff49677d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4900fcc80 0x7ff490112680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:22:20.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.860+0000 7ff49677d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff490112bc0 con 0x7ff4900fcc80 2024-04-25T17:22:20.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.860+0000 7ff49677d700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff490112d00 con 0x7ff4900fc330 2024-04-25T17:22:20.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.860+0000 7ff48f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4900fcc80 0x7ff490112680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:22:20.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.860+0000 7ff48f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4900fcc80 0x7ff490112680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48544/0 (socket says 172.21.15.37:48544) 2024-04-25T17:22:20.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.860+0000 7ff48f7fe700 1 -- 172.21.15.37:0/3211713343 learned_addr learned my addr 172.21.15.37:0/3211713343 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:22:20.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.860+0000 7ff48ffff700 1 --2- 172.21.15.37:0/3211713343 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff4900fc330 0x7ff4900fba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:22:20.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.860+0000 7ff48f7fe700 1 -- 172.21.15.37:0/3211713343 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff4900fc330 msgr2=0x7ff4900fba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:22:20.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.860+0000 7ff48f7fe700 1 --2- 172.21.15.37:0/3211713343 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff4900fc330 0x7ff4900fba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:20.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.860+0000 7ff48f7fe700 1 -- 172.21.15.37:0/3211713343 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff478005040 con 0x7ff4900fcc80 2024-04-25T17:22:20.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.860+0000 7ff48f7fe700 1 --2- 172.21.15.37:0/3211713343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4900fcc80 0x7ff490112680 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff478009150 tx=0x7ff478009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:22:20.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.860+0000 7ff48cff9700 1 -- 172.21.15.37:0/3211713343 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff47800e040 con 0x7ff4900fcc80 2024-04-25T17:22:20.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.861+0000 7ff49677d700 1 -- 172.21.15.37:0/3211713343 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff490112f00 con 0x7ff4900fcc80 2024-04-25T17:22:20.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.861+0000 7ff48cff9700 1 -- 172.21.15.37:0/3211713343 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff478004290 con 0x7ff4900fcc80 2024-04-25T17:22:20.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.861+0000 7ff48cff9700 1 -- 172.21.15.37:0/3211713343 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff47801c630 con 0x7ff4900fcc80 2024-04-25T17:22:20.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.861+0000 7ff49677d700 1 -- 172.21.15.37:0/3211713343 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff490113490 con 0x7ff4900fcc80 2024-04-25T17:22:20.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.862+0000 7ff49677d700 1 -- 172.21.15.37:0/3211713343 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff49004c710 con 0x7ff4900fcc80 2024-04-25T17:22:20.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.862+0000 7ff48cff9700 1 -- 172.21.15.37:0/3211713343 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 38) v1 ==== 98763+0+0 (secure 0 0 0) 0x7ff47800bbf0 con 0x7ff4900fcc80 2024-04-25T17:22:20.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.863+0000 7ff48cff9700 1 --2- 172.21.15.37:0/3211713343 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7ff47c076ca0 0x7ff47c079150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:22:20.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.863+0000 7ff48ffff700 1 --2- 172.21.15.37:0/3211713343 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7ff47c076ca0 0x7ff47c079150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:22:20.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.863+0000 7ff48cff9700 1 -- 172.21.15.37:0/3211713343 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6324+0+0 (secure 0 0 0) 0x7ff4780991a0 con 0x7ff4900fcc80 2024-04-25T17:22:20.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.864+0000 7ff48ffff700 1 --2- 172.21.15.37:0/3211713343 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7ff47c076ca0 0x7ff47c079150 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff480009fd0 tx=0x7ff48000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:22:20.868 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:20.868+0000 7ff48cff9700 1 -- 172.21.15.37:0/3211713343 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7ff478061ae0 con 0x7ff4900fcc80 2024-04-25T17:22:21.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:21.177+0000 7ff49677d700 1 -- 172.21.15.37:0/3211713343 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff490113970 con 0x7ff4900fcc80 2024-04-25T17:22:21.178 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:21 smithi037 ceph-mon[90844]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:22:21.178 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:21 smithi037 ceph-mon[90844]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:22:21.178 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:21 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/3556018415' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T17:22:21.178 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:21.177+0000 7ff48cff9700 1 -- 172.21.15.37:0/3211713343 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7ff478061480 con 0x7ff4900fcc80 2024-04-25T17:22:21.179 INFO:teuthology.orchestra.run.smithi037.stdout:HEALTH_OK 2024-04-25T17:22:21.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:21.179+0000 7ff49677d700 1 -- 172.21.15.37:0/3211713343 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7ff47c076ca0 msgr2=0x7ff47c079150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:22:21.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:21.179+0000 7ff49677d700 1 --2- 172.21.15.37:0/3211713343 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7ff47c076ca0 0x7ff47c079150 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff480009fd0 tx=0x7ff48000b040 comp rx=0 tx=0).stop 2024-04-25T17:22:21.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:21.179+0000 7ff49677d700 1 -- 172.21.15.37:0/3211713343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4900fcc80 msgr2=0x7ff490112680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:22:21.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:21.179+0000 7ff49677d700 1 --2- 172.21.15.37:0/3211713343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4900fcc80 0x7ff490112680 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff478009150 tx=0x7ff478009e30 comp rx=0 tx=0).stop 2024-04-25T17:22:21.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:21.179+0000 7ff49677d700 1 -- 172.21.15.37:0/3211713343 shutdown_connections 2024-04-25T17:22:21.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:21.179+0000 7ff49677d700 1 --2- 172.21.15.37:0/3211713343 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7ff47c076ca0 0x7ff47c079150 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:21.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:21.179+0000 7ff49677d700 1 --2- 172.21.15.37:0/3211713343 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff4900fc330 0x7ff4900fba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:21.180 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:21.179+0000 7ff49677d700 1 --2- 172.21.15.37:0/3211713343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4900fcc80 0x7ff490112680 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:21.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:21.179+0000 7ff49677d700 1 -- 172.21.15.37:0/3211713343 >> 172.21.15.37:0/3211713343 conn(0x7ff4900f6be0 msgr2=0x7ff4900f81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:22:21.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:21.180+0000 7ff49677d700 1 -- 172.21.15.37:0/3211713343 shutdown_connections 2024-04-25T17:22:21.181 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:21.180+0000 7ff49677d700 1 -- 172.21.15.37:0/3211713343 wait complete. 2024-04-25T17:22:21.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:21 smithi069 ceph-mon[80239]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:22:21.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:21 smithi069 ceph-mon[80239]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:22:21.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:21 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/3556018415' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T17:22:22.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:22 smithi069 ceph-mon[80239]: pgmap v37: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:22:22.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:22 smithi069 ceph-mon[80239]: from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:22:22.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:22 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/3211713343' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T17:22:22.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:22 smithi037 ceph-mon[90844]: pgmap v37: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:22:22.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:22 smithi037 ceph-mon[90844]: from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:22:22.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:22 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/3211713343' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T17:22:24.178 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:24 smithi037 ceph-mon[90844]: pgmap v38: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:22:24.178 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:24 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:24.178 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:24 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:24.178 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:24 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:22:24.178 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:24 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:22:24.178 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:24 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:24.178 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:24 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:22:24.179 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:24 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:22:24.179 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:24 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:22:24.179 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:24 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:22:24.179 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:24 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:24.179 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:24 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi037"}]: dispatch 2024-04-25T17:22:24.179 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:24 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi037"}]': finished 2024-04-25T17:22:24.179 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:24 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi069"}]: dispatch 2024-04-25T17:22:24.179 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:24 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi069"}]': finished 2024-04-25T17:22:24.179 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:24 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-04-25T17:22:24.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:24 smithi069 ceph-mon[80239]: pgmap v38: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:22:24.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:24 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:24.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:24 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:24.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:24 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:22:24.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:24 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:22:24.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:24 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:24.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:24 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:22:24.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:24 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:22:24.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:24 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:22:24.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:24 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:22:24.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:24 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:24.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:24 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi037"}]: dispatch 2024-04-25T17:22:24.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:24 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi037"}]': finished 2024-04-25T17:22:24.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:24 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi069"}]: dispatch 2024-04-25T17:22:24.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:24 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi069"}]': finished 2024-04-25T17:22:24.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:24 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-04-25T17:22:25.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:25 smithi069 ceph-mon[80239]: Upgrade: Setting container_image for all crash 2024-04-25T17:22:25.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:25 smithi069 ceph-mon[80239]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-04-25T17:22:25.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:25 smithi069 ceph-mon[80239]: Upgrade: osd.0 is safe to restart 2024-04-25T17:22:25.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:25 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:25.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:25 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-25T17:22:25.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:25 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:22:25.482 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:25 smithi037 ceph-mon[90844]: Upgrade: Setting container_image for all crash 2024-04-25T17:22:25.482 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:25 smithi037 ceph-mon[90844]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-04-25T17:22:25.482 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:25 smithi037 ceph-mon[90844]: Upgrade: osd.0 is safe to restart 2024-04-25T17:22:25.482 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:25 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:25.482 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:25 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-04-25T17:22:25.482 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:25 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:22:26.363 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:26 smithi037 ceph-mon[90844]: pgmap v39: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:22:26.364 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:26 smithi037 ceph-mon[90844]: Upgrade: Updating osd.0 2024-04-25T17:22:26.364 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:26 smithi037 ceph-mon[90844]: Deploying daemon osd.0 on smithi037 2024-04-25T17:22:26.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:26 smithi069 ceph-mon[80239]: pgmap v39: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:22:26.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:26 smithi069 ceph-mon[80239]: Upgrade: Updating osd.0 2024-04-25T17:22:26.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:26 smithi069 ceph-mon[80239]: Deploying daemon osd.0 on smithi037 2024-04-25T17:22:28.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:28 smithi037 ceph-mon[90844]: pgmap v40: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:22:28.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:28 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:22:28.323 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:22:28 smithi037 systemd[1]: Stopping Ceph osd.0 for 599bb7fc-0326-11ef-bc93-c7b262605968... 2024-04-25T17:22:28.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:28 smithi069 ceph-mon[80239]: pgmap v40: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:22:28.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:28 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:22:28.822 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:22:28 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-0[44618]: 2024-04-25T17:22:28.433+0000 7f00f19da700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T17:22:28.822 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:22:28 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-0[44618]: 2024-04-25T17:22:28.433+0000 7f00f19da700 -1 osd.0 49 *** Got signal Terminated *** 2024-04-25T17:22:28.822 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:22:28 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-0[44618]: 2024-04-25T17:22:28.433+0000 7f00f19da700 -1 osd.0 49 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T17:22:29.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:29 smithi069 ceph-mon[80239]: osd.0 marked itself down and dead 2024-04-25T17:22:29.531 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:29 smithi037 ceph-mon[90844]: osd.0 marked itself down and dead 2024-04-25T17:22:29.822 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:22:29 smithi037 podman[99147]: 2024-04-25 17:22:29.53134467 +0000 UTC m=+1.349396334 container died 8ff4b0f1aae94009e8e6b80814f3f082a4d9c7478357064e9bcb44a0a041aae4 (image=quay.ceph.io/ceph-ci/ceph@sha256:27d43f80a23d3545096a7bb490598a6f37852da2940e69e5a8f3e3d7fb58fd17, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, RELEASE=quincy-c61472c, org.label-schema.vendor=CentOS) 2024-04-25T17:22:30.110 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:22:29 smithi037 podman[99147]: 2024-04-25 17:22:29.900417567 +0000 UTC m=+1.718469233 container cleanup 8ff4b0f1aae94009e8e6b80814f3f082a4d9c7478357064e9bcb44a0a041aae4 (image=quay.ceph.io/ceph-ci/ceph@sha256:27d43f80a23d3545096a7bb490598a6f37852da2940e69e5a8f3e3d7fb58fd17, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=quincy-c61472c, ceph=True, GIT_CLEAN=True) 2024-04-25T17:22:30.110 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:22:29 smithi037 bash[99147]: ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-0 2024-04-25T17:22:30.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:30 smithi069 ceph-mon[80239]: pgmap v41: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:22:30.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:30 smithi069 ceph-mon[80239]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-25T17:22:30.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:30 smithi069 ceph-mon[80239]: osdmap e50: 6 total, 5 up, 6 in 2024-04-25T17:22:30.470 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:22:30 smithi037 podman[99166]: 2024-04-25 17:22:30.151608665 +0000 UTC m=+0.622624774 container remove 8ff4b0f1aae94009e8e6b80814f3f082a4d9c7478357064e9bcb44a0a041aae4 (image=quay.ceph.io/ceph-ci/ceph@sha256:27d43f80a23d3545096a7bb490598a6f37852da2940e69e5a8f3e3d7fb58fd17, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-0, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=quincy-c61472c, io.buildah.version=1.33.5) 2024-04-25T17:22:30.470 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:30 smithi037 ceph-mon[90844]: pgmap v41: 65 pgs: 65 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:22:30.470 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:30 smithi037 ceph-mon[90844]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-25T17:22:30.471 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:30 smithi037 ceph-mon[90844]: osdmap e50: 6 total, 5 up, 6 in 2024-04-25T17:22:30.751 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:22:30 smithi037 podman[99253]: 2024-04-25 17:22:30.373949695 +0000 UTC m=+0.019315691 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T17:22:30.752 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:22:30 smithi037 podman[99253]: 2024-04-25 17:22:30.51123217 +0000 UTC m=+0.156598174 container create 6ecd2b97d3c8320671a5f6767582625329af0bb049db331c13752f8389c56b20 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-04-25T17:22:30.752 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:22:30 smithi037 podman[99253]: 2024-04-25 17:22:30.751393529 +0000 UTC m=+0.396759502 container init 6ecd2b97d3c8320671a5f6767582625329af0bb049db331c13752f8389c56b20 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True) 2024-04-25T17:22:31.065 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:22:30 smithi037 podman[99253]: 2024-04-25 17:22:30.754895881 +0000 UTC m=+0.400261849 container start 6ecd2b97d3c8320671a5f6767582625329af0bb049db331c13752f8389c56b20 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-0-deactivate, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-04-25T17:22:31.065 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:22:30 smithi037 podman[99253]: 2024-04-25 17:22:30.88049267 +0000 UTC m=+0.525858645 container attach 6ecd2b97d3c8320671a5f6767582625329af0bb049db331c13752f8389c56b20 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, ceph=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T17:22:31.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:31 smithi037 ceph-mon[90844]: osdmap e51: 6 total, 5 up, 6 in 2024-04-25T17:22:31.322 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:22:31 smithi037 podman[99253]: 2024-04-25 17:22:31.067448255 +0000 UTC m=+0.712814220 container died 6ecd2b97d3c8320671a5f6767582625329af0bb049db331c13752f8389c56b20 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T17:22:31.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:31 smithi069 ceph-mon[80239]: osdmap e51: 6 total, 5 up, 6 in 2024-04-25T17:22:31.886 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:22:31 smithi037 podman[99287]: 2024-04-25 17:22:31.633841964 +0000 UTC m=+0.557958012 container remove 6ecd2b97d3c8320671a5f6767582625329af0bb049db331c13752f8389c56b20 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-0-deactivate, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-04-25T17:22:31.886 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:22:31 smithi037 systemd[1]: ceph-599bb7fc-0326-11ef-bc93-c7b262605968@osd.0.service: Deactivated successfully. 2024-04-25T17:22:31.886 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:22:31 smithi037 systemd[1]: Stopped Ceph osd.0 for 599bb7fc-0326-11ef-bc93-c7b262605968. 2024-04-25T17:22:31.886 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:22:31 smithi037 systemd[1]: ceph-599bb7fc-0326-11ef-bc93-c7b262605968@osd.0.service: Consumed 1min 4.556s CPU time. 2024-04-25T17:22:31.886 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:22:31 smithi037 systemd[1]: Starting Ceph osd.0 for 599bb7fc-0326-11ef-bc93-c7b262605968... 2024-04-25T17:22:32.225 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:32 smithi037 ceph-mon[90844]: pgmap v44: 65 pgs: 9 stale+active+clean, 56 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:22:32.225 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:22:32 smithi037 podman[99393]: 2024-04-25 17:22:31.98748327 +0000 UTC m=+0.018702443 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T17:22:32.225 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:22:32 smithi037 podman[99393]: 2024-04-25 17:22:32.102210363 +0000 UTC m=+0.133429501 container create 841a6e22219591ac6905b62ba6afc807ec79b9f91d1fed547256f07a97609130 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-0-activate, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True) 2024-04-25T17:22:32.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:32 smithi069 ceph-mon[80239]: pgmap v44: 65 pgs: 9 stale+active+clean, 56 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:22:32.572 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:22:32 smithi037 podman[99393]: 2024-04-25 17:22:32.3367473 +0000 UTC m=+0.367966449 container init 841a6e22219591ac6905b62ba6afc807ec79b9f91d1fed547256f07a97609130 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-0-activate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True) 2024-04-25T17:22:32.572 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:22:32 smithi037 podman[99393]: 2024-04-25 17:22:32.34035816 +0000 UTC m=+0.371577306 container start 841a6e22219591ac6905b62ba6afc807ec79b9f91d1fed547256f07a97609130 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-0-activate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_CLEAN=True, org.label-schema.build-date=20240424, io.buildah.version=1.33.5) 2024-04-25T17:22:32.572 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:22:32 smithi037 podman[99393]: 2024-04-25 17:22:32.4298242 +0000 UTC m=+0.461043341 container attach 841a6e22219591ac6905b62ba6afc807ec79b9f91d1fed547256f07a97609130 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-0-activate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240424) 2024-04-25T17:22:33.267 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:22:32 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-0-activate[99408]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-25T17:22:33.267 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:22:32 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-0-activate[99408]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-25T17:22:33.267 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:22:32 smithi037 bash[99393]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-25T17:22:33.267 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:22:32 smithi037 bash[99393]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-25T17:22:33.268 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:22:32 smithi037 bash[99393]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-25T17:22:33.268 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:22:32 smithi037 bash[99393]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-04-25T17:22:33.268 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:22:32 smithi037 bash[99393]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-04-25T17:22:33.268 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:22:32 smithi037 bash[99393]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-04-25T17:22:33.268 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:22:32 smithi037 bash[99393]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-04-25T17:22:33.268 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:22:32 smithi037 bash[99393]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-25T17:22:33.268 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:22:32 smithi037 bash[99393]: --> ceph-volume raw activate successful for osd ID: 0 2024-04-25T17:22:33.268 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:22:32 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-0-activate[99408]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-25T17:22:33.268 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:22:32 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-0-activate[99408]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-04-25T17:22:33.268 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:22:32 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-0-activate[99408]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-04-25T17:22:33.268 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:22:32 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-0-activate[99408]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-04-25T17:22:33.268 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:22:32 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-0-activate[99408]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-04-25T17:22:33.268 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:22:32 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-0-activate[99408]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-25T17:22:33.268 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:22:32 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-0-activate[99408]: --> ceph-volume raw activate successful for osd ID: 0 2024-04-25T17:22:33.269 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:22:32 smithi037 podman[99393]: 2024-04-25 17:22:32.970512425 +0000 UTC m=+1.001731576 container died 841a6e22219591ac6905b62ba6afc807ec79b9f91d1fed547256f07a97609130 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-0-activate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True) 2024-04-25T17:22:33.959 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:22:33 smithi037 podman[99543]: 2024-04-25 17:22:33.717074977 +0000 UTC m=+0.740219209 container remove 841a6e22219591ac6905b62ba6afc807ec79b9f91d1fed547256f07a97609130 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-0-activate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T17:22:33.960 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:22:33 smithi037 podman[99609]: 2024-04-25 17:22:33.849722467 +0000 UTC m=+0.019482487 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T17:22:33.960 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:22:33 smithi037 podman[99609]: 2024-04-25 17:22:33.959699813 +0000 UTC m=+0.129459818 container create e97538cb8b4fc8cd48a9c618f3f202b5df7698c17a1368923938c4bcbe232d9a (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0) 2024-04-25T17:22:34.213 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:34 smithi037 ceph-mon[90844]: pgmap v45: 65 pgs: 9 stale+active+clean, 56 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-04-25T17:22:34.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:34 smithi069 ceph-mon[80239]: pgmap v45: 65 pgs: 9 stale+active+clean, 56 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-04-25T17:22:34.572 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:22:34 smithi037 podman[99609]: 2024-04-25 17:22:34.213106475 +0000 UTC m=+0.382866487 container init e97538cb8b4fc8cd48a9c618f3f202b5df7698c17a1368923938c4bcbe232d9a (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-25T17:22:34.572 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:22:34 smithi037 podman[99609]: 2024-04-25 17:22:34.216622564 +0000 UTC m=+0.386382575 container start e97538cb8b4fc8cd48a9c618f3f202b5df7698c17a1368923938c4bcbe232d9a (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T17:22:34.572 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:22:34 smithi037 ceph-osd[99627]: -- 172.21.15.37:0/1000069693 <== mon.0 v2:172.21.15.37:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558af9725680 con 0x558af97ccd00 2024-04-25T17:22:34.572 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:22:34 smithi037 bash[99609]: e97538cb8b4fc8cd48a9c618f3f202b5df7698c17a1368923938c4bcbe232d9a 2024-04-25T17:22:34.572 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:22:34 smithi037 systemd[1]: Started Ceph osd.0 for 599bb7fc-0326-11ef-bc93-c7b262605968. 2024-04-25T17:22:35.071 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:22:34 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-0[99623]: 2024-04-25T17:22:34.769+0000 7ff7bcf817c0 -1 Falling back to public interface 2024-04-25T17:22:35.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:35 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:35.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:35 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:35.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:35 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:22:35.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:35 smithi037 ceph-mon[90844]: pgmap v46: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 41/228 objects degraded (17.982%) 2024-04-25T17:22:35.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:35 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:35.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:35 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:35.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:35 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:22:35.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:35 smithi069 ceph-mon[80239]: pgmap v46: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 41/228 objects degraded (17.982%) 2024-04-25T17:22:36.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:36 smithi069 ceph-mon[80239]: Health check failed: Degraded data redundancy: 41/228 objects degraded (17.982%), 18 pgs degraded (PG_DEGRADED) 2024-04-25T17:22:36.742 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:36 smithi037 ceph-mon[90844]: Health check failed: Degraded data redundancy: 41/228 objects degraded (17.982%), 18 pgs degraded (PG_DEGRADED) 2024-04-25T17:22:37.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:37 smithi037 ceph-mon[90844]: pgmap v47: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 41/228 objects degraded (17.982%) 2024-04-25T17:22:37.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:37 smithi069 ceph-mon[80239]: pgmap v47: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 41/228 objects degraded (17.982%) 2024-04-25T17:22:39.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:39 smithi037 ceph-mon[90844]: pgmap v48: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s; 41/228 objects degraded (17.982%) 2024-04-25T17:22:39.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:39 smithi069 ceph-mon[80239]: pgmap v48: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s; 41/228 objects degraded (17.982%) 2024-04-25T17:22:40.551 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:22:40 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-0[99623]: 2024-04-25T17:22:40.225+0000 7ff7bcf817c0 -1 osd.0 49 log_to_monitors true 2024-04-25T17:22:40.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:40 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:40.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:40 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:40.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:40 smithi037 ceph-mon[90844]: from='osd.0 [v2:172.21.15.37:6802/2283035048,v1:172.21.15.37:6803/2283035048]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-25T17:22:40.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:40 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:40.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:40 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:40.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:40 smithi069 ceph-mon[80239]: from='osd.0 [v2:172.21.15.37:6802/2283035048,v1:172.21.15.37:6803/2283035048]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-04-25T17:22:41.695 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:22:41 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-0[99623]: 2024-04-25T17:22:41.513+0000 7ff7aa393700 -1 osd.0 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T17:22:41.695 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:41 smithi037 ceph-mon[90844]: pgmap v49: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 987 B/s rd, 1 op/s; 41/228 objects degraded (17.982%) 2024-04-25T17:22:41.695 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:41 smithi037 ceph-mon[90844]: from='osd.0 [v2:172.21.15.37:6802/2283035048,v1:172.21.15.37:6803/2283035048]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-25T17:22:41.695 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:41 smithi037 ceph-mon[90844]: osdmap e52: 6 total, 5 up, 6 in 2024-04-25T17:22:41.695 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:41 smithi037 ceph-mon[90844]: from='osd.0 [v2:172.21.15.37:6802/2283035048,v1:172.21.15.37:6803/2283035048]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-04-25T17:22:41.695 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:41 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:41.695 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:41 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:41.695 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:41 smithi037 ceph-mon[90844]: from='osd.0 [v2:172.21.15.37:6802/2283035048,v1:172.21.15.37:6803/2283035048]' entity='osd.0' 2024-04-25T17:22:41.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:41 smithi069 ceph-mon[80239]: pgmap v49: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 208 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 987 B/s rd, 1 op/s; 41/228 objects degraded (17.982%) 2024-04-25T17:22:41.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:41 smithi069 ceph-mon[80239]: from='osd.0 [v2:172.21.15.37:6802/2283035048,v1:172.21.15.37:6803/2283035048]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-04-25T17:22:41.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:41 smithi069 ceph-mon[80239]: osdmap e52: 6 total, 5 up, 6 in 2024-04-25T17:22:41.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:41 smithi069 ceph-mon[80239]: from='osd.0 [v2:172.21.15.37:6802/2283035048,v1:172.21.15.37:6803/2283035048]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-04-25T17:22:41.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:41 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:41.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:41 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:41.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:41 smithi069 ceph-mon[80239]: from='osd.0 [v2:172.21.15.37:6802/2283035048,v1:172.21.15.37:6803/2283035048]' entity='osd.0' 2024-04-25T17:22:42.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:42 smithi037 ceph-mon[90844]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-25T17:22:42.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:42 smithi037 ceph-mon[90844]: osd.0 [v2:172.21.15.37:6802/2283035048,v1:172.21.15.37:6803/2283035048] boot 2024-04-25T17:22:42.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:42 smithi037 ceph-mon[90844]: osdmap e53: 6 total, 6 up, 6 in 2024-04-25T17:22:42.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:42 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T17:22:42.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:42 smithi069 ceph-mon[80239]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-25T17:22:42.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:42 smithi069 ceph-mon[80239]: osd.0 [v2:172.21.15.37:6802/2283035048,v1:172.21.15.37:6803/2283035048] boot 2024-04-25T17:22:42.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:42 smithi069 ceph-mon[80239]: osdmap e53: 6 total, 6 up, 6 in 2024-04-25T17:22:42.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:42 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-04-25T17:22:43.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:43 smithi037 ceph-mon[90844]: pgmap v51: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 208 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 41/228 objects degraded (17.982%) 2024-04-25T17:22:43.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:43 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:43.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:43 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:22:43.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:43 smithi037 ceph-mon[90844]: osdmap e54: 6 total, 6 up, 6 in 2024-04-25T17:22:43.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:43 smithi069 ceph-mon[80239]: pgmap v51: 65 pgs: 18 active+undersized+degraded, 16 active+undersized, 31 active+clean; 208 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 41/228 objects degraded (17.982%) 2024-04-25T17:22:43.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:43 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:43.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:43 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:22:43.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:43 smithi069 ceph-mon[80239]: osdmap e54: 6 total, 6 up, 6 in 2024-04-25T17:22:44.913 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:44 smithi037 ceph-mon[90844]: Health check update: Degraded data redundancy: 7/228 objects degraded (3.070%), 3 pgs degraded (PG_DEGRADED) 2024-04-25T17:22:44.913 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:44 smithi037 ceph-mon[90844]: mgrmap e39: smithi037.txrgxl(active, since 92s), standbys: smithi069.mmuhdo 2024-04-25T17:22:44.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:44 smithi069 ceph-mon[80239]: Health check update: Degraded data redundancy: 7/228 objects degraded (3.070%), 3 pgs degraded (PG_DEGRADED) 2024-04-25T17:22:44.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:44 smithi069 ceph-mon[80239]: mgrmap e39: smithi037.txrgxl(active, since 92s), standbys: smithi069.mmuhdo 2024-04-25T17:22:46.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:45 smithi037 ceph-mon[90844]: pgmap v54: 65 pgs: 25 peering, 3 active+undersized+degraded, 6 active+undersized, 31 active+clean; 208 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 170 B/s wr, 2 op/s; 7/228 objects degraded (3.070%) 2024-04-25T17:22:46.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:45 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:46.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:45 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:46.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:45 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:22:46.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:45 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:22:46.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:45 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:46.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:45 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:22:46.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:45 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:22:46.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:45 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:22:46.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:45 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:22:46.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:45 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-25T17:22:46.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:45 smithi037 ceph-mon[90844]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-25T17:22:46.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:45 smithi037 ceph-mon[90844]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-04-25T17:22:46.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:45 smithi069 ceph-mon[80239]: pgmap v54: 65 pgs: 25 peering, 3 active+undersized+degraded, 6 active+undersized, 31 active+clean; 208 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 170 B/s wr, 2 op/s; 7/228 objects degraded (3.070%) 2024-04-25T17:22:46.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:45 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:46.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:45 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:46.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:45 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:22:46.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:45 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:22:46.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:45 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:46.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:45 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:22:46.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:45 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:22:46.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:45 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:22:46.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:45 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:22:46.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:45 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-25T17:22:46.170 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:45 smithi069 ceph-mon[80239]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-25T17:22:46.170 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:45 smithi069 ceph-mon[80239]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-04-25T17:22:47.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:46 smithi037 ceph-mon[90844]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/228 objects degraded (3.070%), 3 pgs degraded) 2024-04-25T17:22:47.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:46 smithi037 ceph-mon[90844]: Cluster is now healthy 2024-04-25T17:22:47.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:46 smithi069 ceph-mon[80239]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/228 objects degraded (3.070%), 3 pgs degraded) 2024-04-25T17:22:47.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:46 smithi069 ceph-mon[80239]: Cluster is now healthy 2024-04-25T17:22:48.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:47 smithi037 ceph-mon[90844]: pgmap v55: 65 pgs: 25 peering, 40 active+clean; 208 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 170 B/s wr, 1 op/s 2024-04-25T17:22:48.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:47 smithi069 ceph-mon[80239]: pgmap v55: 65 pgs: 25 peering, 40 active+clean; 208 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 170 B/s wr, 1 op/s 2024-04-25T17:22:50.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:49 smithi037 ceph-mon[90844]: pgmap v56: 65 pgs: 11 peering, 54 active+clean; 208 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.1 KiB/s rd, 129 B/s wr, 1 op/s 2024-04-25T17:22:50.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:49 smithi069 ceph-mon[80239]: pgmap v56: 65 pgs: 11 peering, 54 active+clean; 208 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.1 KiB/s rd, 129 B/s wr, 1 op/s 2024-04-25T17:22:51.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.300+0000 7f17bad96700 1 -- 172.21.15.37:0/4025755257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17b40fce60 msgr2=0x7f17b40fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:22:51.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.300+0000 7f17bad96700 1 --2- 172.21.15.37:0/4025755257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17b40fce60 0x7f17b40fd270 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f17a8004940 tx=0x7f17a8009e30 comp rx=0 tx=0).stop 2024-04-25T17:22:51.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.300+0000 7f17bad96700 1 -- 172.21.15.37:0/4025755257 shutdown_connections 2024-04-25T17:22:51.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.300+0000 7f17bad96700 1 --2- 172.21.15.37:0/4025755257 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17b40fdfd0 0x7f17b40fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:51.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.300+0000 7f17bad96700 1 --2- 172.21.15.37:0/4025755257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17b40fce60 0x7f17b40fd270 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:51.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.300+0000 7f17bad96700 1 -- 172.21.15.37:0/4025755257 >> 172.21.15.37:0/4025755257 conn(0x7f17b40f8520 msgr2=0x7f17b40fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:22:51.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.300+0000 7f17bad96700 1 -- 172.21.15.37:0/4025755257 shutdown_connections 2024-04-25T17:22:51.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.300+0000 7f17bad96700 1 -- 172.21.15.37:0/4025755257 wait complete. 2024-04-25T17:22:51.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.300+0000 7f17bad96700 1 Processor -- start 2024-04-25T17:22:51.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.300+0000 7f17bad96700 1 -- start start 2024-04-25T17:22:51.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.301+0000 7f17bad96700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17b40fce60 0x7f17b410d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:22:51.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.301+0000 7f17bad96700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17b40fdfd0 0x7f17b410de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:22:51.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.301+0000 7f17bad96700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b410e430 con 0x7f17b40fdfd0 2024-04-25T17:22:51.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.301+0000 7f17bad96700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b410e5a0 con 0x7f17b40fce60 2024-04-25T17:22:51.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.301+0000 7f17b3fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17b40fdfd0 0x7f17b410de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:22:51.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.301+0000 7f17b3fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17b40fdfd0 0x7f17b410de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54942/0 (socket says 172.21.15.37:54942) 2024-04-25T17:22:51.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.301+0000 7f17b3fff700 1 -- 172.21.15.37:0/4292800962 learned_addr learned my addr 172.21.15.37:0/4292800962 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:22:51.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.301+0000 7f17b8b32700 1 --2- 172.21.15.37:0/4292800962 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17b40fce60 0x7f17b410d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:22:51.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.301+0000 7f17b3fff700 1 -- 172.21.15.37:0/4292800962 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17b40fce60 msgr2=0x7f17b410d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:22:51.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.301+0000 7f17b3fff700 1 --2- 172.21.15.37:0/4292800962 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17b40fce60 0x7f17b410d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:51.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.301+0000 7f17b3fff700 1 -- 172.21.15.37:0/4292800962 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a8005040 con 0x7f17b40fdfd0 2024-04-25T17:22:51.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.302+0000 7f17b3fff700 1 --2- 172.21.15.37:0/4292800962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17b40fdfd0 0x7f17b410de30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f17a000eb40 tx=0x7f17a000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:22:51.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.302+0000 7f17b17fa700 1 -- 172.21.15.37:0/4292800962 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17a0007cc0 con 0x7f17b40fdfd0 2024-04-25T17:22:51.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.302+0000 7f17b17fa700 1 -- 172.21.15.37:0/4292800962 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f17a000f040 con 0x7f17b40fdfd0 2024-04-25T17:22:51.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.302+0000 7f17bad96700 1 -- 172.21.15.37:0/4292800962 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17b4112fa0 con 0x7f17b40fdfd0 2024-04-25T17:22:51.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.302+0000 7f17b17fa700 1 -- 172.21.15.37:0/4292800962 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17a0009620 con 0x7f17b40fdfd0 2024-04-25T17:22:51.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.302+0000 7f17bad96700 1 -- 172.21.15.37:0/4292800962 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17b41134b0 con 0x7f17b40fdfd0 2024-04-25T17:22:51.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.303+0000 7f17bad96700 1 -- 172.21.15.37:0/4292800962 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17b404c710 con 0x7f17b40fdfd0 2024-04-25T17:22:51.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.304+0000 7f17b17fa700 1 -- 172.21.15.37:0/4292800962 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f17a0009780 con 0x7f17b40fdfd0 2024-04-25T17:22:51.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.304+0000 7f17b17fa700 1 --2- 172.21.15.37:0/4292800962 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f17a4076b90 0x7f17a4079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:22:51.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.304+0000 7f17b17fa700 1 -- 172.21.15.37:0/4292800962 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f17a0097f20 con 0x7f17b40fdfd0 2024-04-25T17:22:51.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.304+0000 7f17b8b32700 1 --2- 172.21.15.37:0/4292800962 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f17a4076b90 0x7f17a4079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:22:51.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.305+0000 7f17b8b32700 1 --2- 172.21.15.37:0/4292800962 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f17a4076b90 0x7f17a4079040 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f17a8009b30 tx=0x7f17a8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:22:51.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.309+0000 7f17b17fa700 1 -- 172.21.15.37:0/4292800962 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f17a00ccff0 con 0x7f17b40fdfd0 2024-04-25T17:22:51.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.541+0000 7f17bad96700 1 -- 172.21.15.37:0/4292800962 --> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f17b41022c0 con 0x7f17a4076b90 2024-04-25T17:22:51.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.542+0000 7f17b17fa700 1 -- 172.21.15.37:0/4292800962 <== mgr.34104 v2:172.21.15.37:6800/783197737 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f17b41022c0 con 0x7f17a4076b90 2024-04-25T17:22:51.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.544+0000 7f17bad96700 1 -- 172.21.15.37:0/4292800962 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f17a4076b90 msgr2=0x7f17a4079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:22:51.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.544+0000 7f17bad96700 1 --2- 172.21.15.37:0/4292800962 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f17a4076b90 0x7f17a4079040 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f17a8009b30 tx=0x7f17a8009e30 comp rx=0 tx=0).stop 2024-04-25T17:22:51.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.544+0000 7f17bad96700 1 -- 172.21.15.37:0/4292800962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17b40fdfd0 msgr2=0x7f17b410de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:22:51.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.544+0000 7f17bad96700 1 --2- 172.21.15.37:0/4292800962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17b40fdfd0 0x7f17b410de30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f17a000eb40 tx=0x7f17a000b040 comp rx=0 tx=0).stop 2024-04-25T17:22:51.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.544+0000 7f17bad96700 1 -- 172.21.15.37:0/4292800962 shutdown_connections 2024-04-25T17:22:51.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.544+0000 7f17bad96700 1 --2- 172.21.15.37:0/4292800962 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f17a4076b90 0x7f17a4079040 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:51.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.544+0000 7f17bad96700 1 --2- 172.21.15.37:0/4292800962 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17b40fce60 0x7f17b410d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:51.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.544+0000 7f17bad96700 1 --2- 172.21.15.37:0/4292800962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f17b40fdfd0 0x7f17b410de30 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:51.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.544+0000 7f17bad96700 1 -- 172.21.15.37:0/4292800962 >> 172.21.15.37:0/4292800962 conn(0x7f17b40f8520 msgr2=0x7f17b40f9c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:22:51.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.544+0000 7f17bad96700 1 -- 172.21.15.37:0/4292800962 shutdown_connections 2024-04-25T17:22:51.546 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.544+0000 7f17bad96700 1 -- 172.21.15.37:0/4292800962 wait complete. 2024-04-25T17:22:51.557 INFO:teuthology.orchestra.run.smithi037.stdout:true 2024-04-25T17:22:51.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.651+0000 7ffa2ae15700 1 -- 172.21.15.37:0/3836317114 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa240fce60 msgr2=0x7ffa240fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:22:51.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.651+0000 7ffa2ae15700 1 --2- 172.21.15.37:0/3836317114 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa240fce60 0x7ffa240fd270 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ffa14004940 tx=0x7ffa14009e30 comp rx=0 tx=0).stop 2024-04-25T17:22:51.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.651+0000 7ffa2ae15700 1 -- 172.21.15.37:0/3836317114 shutdown_connections 2024-04-25T17:22:51.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.651+0000 7ffa2ae15700 1 --2- 172.21.15.37:0/3836317114 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffa240fdfd0 0x7ffa240fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:51.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.651+0000 7ffa2ae15700 1 --2- 172.21.15.37:0/3836317114 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa240fce60 0x7ffa240fd270 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:51.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.651+0000 7ffa2ae15700 1 -- 172.21.15.37:0/3836317114 >> 172.21.15.37:0/3836317114 conn(0x7ffa240f8540 msgr2=0x7ffa240fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:22:51.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.651+0000 7ffa2ae15700 1 -- 172.21.15.37:0/3836317114 shutdown_connections 2024-04-25T17:22:51.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.651+0000 7ffa2ae15700 1 -- 172.21.15.37:0/3836317114 wait complete. 2024-04-25T17:22:51.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.652+0000 7ffa2ae15700 1 Processor -- start 2024-04-25T17:22:51.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.652+0000 7ffa2ae15700 1 -- start start 2024-04-25T17:22:51.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.652+0000 7ffa2ae15700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa240fce60 0x7ffa24071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:22:51.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.652+0000 7ffa2ae15700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffa240fdfd0 0x7ffa240702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:22:51.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.652+0000 7ffa2ae15700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa24072200 con 0x7ffa240fce60 2024-04-25T17:22:51.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.652+0000 7ffa2ae15700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa240707f0 con 0x7ffa240fdfd0 2024-04-25T17:22:51.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.652+0000 7ffa28bb1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa240fce60 0x7ffa24071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:22:51.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.652+0000 7ffa28bb1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa240fce60 0x7ffa24071c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54960/0 (socket says 172.21.15.37:54960) 2024-04-25T17:22:51.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.652+0000 7ffa28bb1700 1 -- 172.21.15.37:0/3289379955 learned_addr learned my addr 172.21.15.37:0/3289379955 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:22:51.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.652+0000 7ffa23fff700 1 --2- 172.21.15.37:0/3289379955 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffa240fdfd0 0x7ffa240702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:22:51.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.653+0000 7ffa28bb1700 1 -- 172.21.15.37:0/3289379955 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffa240fdfd0 msgr2=0x7ffa240702b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:22:51.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.653+0000 7ffa28bb1700 1 --2- 172.21.15.37:0/3289379955 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffa240fdfd0 0x7ffa240702b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:51.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.653+0000 7ffa28bb1700 1 -- 172.21.15.37:0/3289379955 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa14005040 con 0x7ffa240fce60 2024-04-25T17:22:51.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.653+0000 7ffa28bb1700 1 --2- 172.21.15.37:0/3289379955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa240fce60 0x7ffa24071c00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ffa1400b3b0 tx=0x7ffa14009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:22:51.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.653+0000 7ffa217fa700 1 -- 172.21.15.37:0/3289379955 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa1400e040 con 0x7ffa240fce60 2024-04-25T17:22:51.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.653+0000 7ffa217fa700 1 -- 172.21.15.37:0/3289379955 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffa1400bbf0 con 0x7ffa240fce60 2024-04-25T17:22:51.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.653+0000 7ffa2ae15700 1 -- 172.21.15.37:0/3289379955 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa24070a40 con 0x7ffa240fce60 2024-04-25T17:22:51.656 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.653+0000 7ffa217fa700 1 -- 172.21.15.37:0/3289379955 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa1401c630 con 0x7ffa240fce60 2024-04-25T17:22:51.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.653+0000 7ffa2ae15700 1 -- 172.21.15.37:0/3289379955 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa24071000 con 0x7ffa240fce60 2024-04-25T17:22:51.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.654+0000 7ffa2ae15700 1 -- 172.21.15.37:0/3289379955 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa2404c710 con 0x7ffa240fce60 2024-04-25T17:22:51.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.655+0000 7ffa217fa700 1 -- 172.21.15.37:0/3289379955 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7ffa1400bd60 con 0x7ffa240fce60 2024-04-25T17:22:51.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.655+0000 7ffa217fa700 1 --2- 172.21.15.37:0/3289379955 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7ffa0c076b90 0x7ffa0c079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:22:51.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.655+0000 7ffa217fa700 1 -- 172.21.15.37:0/3289379955 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6324+0+0 (secure 0 0 0) 0x7ffa14098db0 con 0x7ffa240fce60 2024-04-25T17:22:51.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.655+0000 7ffa23fff700 1 --2- 172.21.15.37:0/3289379955 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7ffa0c076b90 0x7ffa0c079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:22:51.658 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.656+0000 7ffa23fff700 1 --2- 172.21.15.37:0/3289379955 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7ffa0c076b90 0x7ffa0c079040 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ffa180041d0 tx=0x7ffa180043c0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:22:51.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.660+0000 7ffa217fa700 1 -- 172.21.15.37:0/3289379955 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7ffa14061a50 con 0x7ffa240fce60 2024-04-25T17:22:51.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.891+0000 7ffa2ae15700 1 -- 172.21.15.37:0/3289379955 --> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffa24102330 con 0x7ffa0c076b90 2024-04-25T17:22:51.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.892+0000 7ffa217fa700 1 -- 172.21.15.37:0/3289379955 <== mgr.34104 v2:172.21.15.37:6800/783197737 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7ffa24102330 con 0x7ffa0c076b90 2024-04-25T17:22:51.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.894+0000 7ffa2ae15700 1 -- 172.21.15.37:0/3289379955 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7ffa0c076b90 msgr2=0x7ffa0c079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:22:51.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.894+0000 7ffa2ae15700 1 --2- 172.21.15.37:0/3289379955 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7ffa0c076b90 0x7ffa0c079040 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ffa180041d0 tx=0x7ffa180043c0 comp rx=0 tx=0).stop 2024-04-25T17:22:51.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.894+0000 7ffa2ae15700 1 -- 172.21.15.37:0/3289379955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa240fce60 msgr2=0x7ffa24071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:22:51.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.894+0000 7ffa2ae15700 1 --2- 172.21.15.37:0/3289379955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa240fce60 0x7ffa24071c00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ffa1400b3b0 tx=0x7ffa14009e30 comp rx=0 tx=0).stop 2024-04-25T17:22:51.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.894+0000 7ffa2ae15700 1 -- 172.21.15.37:0/3289379955 shutdown_connections 2024-04-25T17:22:51.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.894+0000 7ffa2ae15700 1 --2- 172.21.15.37:0/3289379955 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7ffa0c076b90 0x7ffa0c079040 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:51.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.894+0000 7ffa2ae15700 1 --2- 172.21.15.37:0/3289379955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffa240fce60 0x7ffa24071c00 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:51.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.894+0000 7ffa2ae15700 1 --2- 172.21.15.37:0/3289379955 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffa240fdfd0 0x7ffa240702b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:51.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.894+0000 7ffa2ae15700 1 -- 172.21.15.37:0/3289379955 >> 172.21.15.37:0/3289379955 conn(0x7ffa240f8540 msgr2=0x7ffa240f9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:22:51.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.894+0000 7ffa2ae15700 1 -- 172.21.15.37:0/3289379955 shutdown_connections 2024-04-25T17:22:51.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.894+0000 7ffa2ae15700 1 -- 172.21.15.37:0/3289379955 wait complete. 2024-04-25T17:22:52.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.999+0000 7fd9ddc7d700 1 -- 172.21.15.37:0/2199312331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9d80fcf60 msgr2=0x7fd9d80fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:22:52.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.999+0000 7fd9ddc7d700 1 --2- 172.21.15.37:0/2199312331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9d80fcf60 0x7fd9d80fd3d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc004940 tx=0x7fd9cc009e30 comp rx=0 tx=0).stop 2024-04-25T17:22:52.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.999+0000 7fd9ddc7d700 1 -- 172.21.15.37:0/2199312331 shutdown_connections 2024-04-25T17:22:52.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.999+0000 7fd9ddc7d700 1 --2- 172.21.15.37:0/2199312331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9d80fcf60 0x7fd9d80fd3d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:52.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.999+0000 7fd9ddc7d700 1 --2- 172.21.15.37:0/2199312331 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9d80fbcb0 0x7fd9d80fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:52.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.999+0000 7fd9ddc7d700 1 -- 172.21.15.37:0/2199312331 >> 172.21.15.37:0/2199312331 conn(0x7fd9d80f7430 msgr2=0x7fd9d80f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:22:52.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.999+0000 7fd9ddc7d700 1 -- 172.21.15.37:0/2199312331 shutdown_connections 2024-04-25T17:22:52.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:51.999+0000 7fd9ddc7d700 1 -- 172.21.15.37:0/2199312331 wait complete. 2024-04-25T17:22:52.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.000+0000 7fd9ddc7d700 1 Processor -- start 2024-04-25T17:22:52.003 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.000+0000 7fd9ddc7d700 1 -- start start 2024-04-25T17:22:52.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.000+0000 7fd9ddc7d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9d80fbcb0 0x7fd9d80ffd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:22:52.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.000+0000 7fd9ddc7d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9d80fcf60 0x7fd9d80fe2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:22:52.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.000+0000 7fd9ddc7d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d80fe7e0 con 0x7fd9d80fcf60 2024-04-25T17:22:52.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.000+0000 7fd9ddc7d700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d80fe920 con 0x7fd9d80fbcb0 2024-04-25T17:22:52.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.000+0000 7fd9d6ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9d80fcf60 0x7fd9d80fe2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:22:52.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.000+0000 7fd9d6ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9d80fcf60 0x7fd9d80fe2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54982/0 (socket says 172.21.15.37:54982) 2024-04-25T17:22:52.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.000+0000 7fd9d6ffd700 1 -- 172.21.15.37:0/1968622625 learned_addr learned my addr 172.21.15.37:0/1968622625 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:22:52.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.000+0000 7fd9d77fe700 1 --2- 172.21.15.37:0/1968622625 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9d80fbcb0 0x7fd9d80ffd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:22:52.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.000+0000 7fd9d6ffd700 1 -- 172.21.15.37:0/1968622625 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9d80fbcb0 msgr2=0x7fd9d80ffd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:22:52.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.000+0000 7fd9d6ffd700 1 --2- 172.21.15.37:0/1968622625 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9d80fbcb0 0x7fd9d80ffd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:52.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.000+0000 7fd9d6ffd700 1 -- 172.21.15.37:0/1968622625 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9cc005040 con 0x7fd9d80fcf60 2024-04-25T17:22:52.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.001+0000 7fd9d6ffd700 1 --2- 172.21.15.37:0/1968622625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9d80fcf60 0x7fd9d80fe2a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc00b3b0 tx=0x7fd9cc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:22:52.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.001+0000 7fd9bffff700 1 -- 172.21.15.37:0/1968622625 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9cc00e040 con 0x7fd9d80fcf60 2024-04-25T17:22:52.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.001+0000 7fd9bffff700 1 -- 172.21.15.37:0/1968622625 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd9cc00bbf0 con 0x7fd9d80fcf60 2024-04-25T17:22:52.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.001+0000 7fd9ddc7d700 1 -- 172.21.15.37:0/1968622625 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9d80feba0 con 0x7fd9d80fcf60 2024-04-25T17:22:52.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.001+0000 7fd9bffff700 1 -- 172.21.15.37:0/1968622625 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9cc01c630 con 0x7fd9d80fcf60 2024-04-25T17:22:52.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.001+0000 7fd9ddc7d700 1 -- 172.21.15.37:0/1968622625 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9d8115b30 con 0x7fd9d80fcf60 2024-04-25T17:22:52.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.002+0000 7fd9ddc7d700 1 -- 172.21.15.37:0/1968622625 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9d8101af0 con 0x7fd9d80fcf60 2024-04-25T17:22:52.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.002+0000 7fd9bffff700 1 -- 172.21.15.37:0/1968622625 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7fd9cc00bd60 con 0x7fd9d80fcf60 2024-04-25T17:22:52.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.003+0000 7fd9bffff700 1 --2- 172.21.15.37:0/1968622625 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fd9c0076b90 0x7fd9c0079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:22:52.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.003+0000 7fd9bffff700 1 -- 172.21.15.37:0/1968622625 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fd9cc098f20 con 0x7fd9d80fcf60 2024-04-25T17:22:52.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.003+0000 7fd9d77fe700 1 --2- 172.21.15.37:0/1968622625 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fd9c0076b90 0x7fd9c0079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:22:52.006 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.004+0000 7fd9d77fe700 1 --2- 172.21.15.37:0/1968622625 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fd9c0076b90 0x7fd9c0079040 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd9d80ffac0 tx=0x7fd9c800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:22:52.010 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.008+0000 7fd9bffff700 1 -- 172.21.15.37:0/1968622625 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fd9cc061b20 con 0x7fd9d80fcf60 2024-04-25T17:22:52.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:51 smithi037 ceph-mon[90844]: pgmap v57: 65 pgs: 65 active+clean; 208 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 383 B/s wr, 2 op/s 2024-04-25T17:22:52.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:51 smithi069 ceph-mon[80239]: pgmap v57: 65 pgs: 65 active+clean; 208 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 383 B/s wr, 2 op/s 2024-04-25T17:22:52.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.227+0000 7fd9ddc7d700 1 -- 172.21.15.37:0/1968622625 --> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd9d805e3a0 con 0x7fd9c0076b90 2024-04-25T17:22:52.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.237+0000 7fd9bffff700 1 -- 172.21.15.37:0/1968622625 <== mgr.34104 v2:172.21.15.37:6800/783197737 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fd9d805e3a0 con 0x7fd9c0076b90 2024-04-25T17:22:52.239 INFO:teuthology.orchestra.run.smithi037.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-25T17:22:52.239 INFO:teuthology.orchestra.run.smithi037.stdout:alertmanager.smithi037 smithi037 *:9093,9094 running (4m) 12s ago 12m 24.9M - 0.25.0 c8568f914cd2 18aed8f409ee 2024-04-25T17:22:52.239 INFO:teuthology.orchestra.run.smithi037.stdout:crash.smithi037 smithi037 running (45s) 12s ago 12m 6660k - 19.0.0-3291-g994e2f20 d53c96779a29 639584ea5855 2024-04-25T17:22:52.239 INFO:teuthology.orchestra.run.smithi037.stdout:crash.smithi069 smithi069 running (40s) 36s ago 11m 6665k - 19.0.0-3291-g994e2f20 d53c96779a29 ee5db16733a7 2024-04-25T17:22:52.239 INFO:teuthology.orchestra.run.smithi037.stdout:grafana.smithi037 smithi037 *:3000 running (4m) 12s ago 12m 86.7M - 9.4.7 954c08fa6188 1eff3ea3f9b0 2024-04-25T17:22:52.240 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi037.ksmixc smithi037 running (7m) 12s ago 7m 149M - 17.2.7-902-gc61472c8 0de407c1b3af 394aa56079b4 2024-04-25T17:22:52.240 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi037.ovkrpq smithi037 running (7m) 12s ago 7m 102M - 17.2.7-902-gc61472c8 0de407c1b3af 73ca662174a7 2024-04-25T17:22:52.240 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi069.cpprst smithi069 running (6m) 36s ago 6m 15.5M - 17.2.7-902-gc61472c8 0de407c1b3af dbda101df20e 2024-04-25T17:22:52.240 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi069.ytlqcf smithi069 running (7m) 36s ago 7m 13.5M - 17.2.7-902-gc61472c8 0de407c1b3af 911df6b18215 2024-04-25T17:22:52.240 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.smithi037.txrgxl smithi037 *:8443,9283,8765 running (3m) 12s ago 14m 567M - 19.0.0-3291-g994e2f20 d53c96779a29 e9653fc62df9 2024-04-25T17:22:52.240 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.smithi069.mmuhdo smithi069 *:8443,9283,8765 running (2m) 36s ago 11m 518M - 19.0.0-3291-g994e2f20 d53c96779a29 6820207b4019 2024-04-25T17:22:52.240 INFO:teuthology.orchestra.run.smithi037.stdout:mon.smithi037 smithi037 running (111s) 12s ago 14m 109M 2048M 19.0.0-3291-g994e2f20 d53c96779a29 1b349f3af69d 2024-04-25T17:22:52.240 INFO:teuthology.orchestra.run.smithi037.stdout:mon.smithi069 smithi069 running (85s) 36s ago 11m 99.3M 2048M 19.0.0-3291-g994e2f20 d53c96779a29 7744dbe81b50 2024-04-25T17:22:52.240 INFO:teuthology.orchestra.run.smithi037.stdout:node-exporter.smithi037 smithi037 *:9100 running (4m) 12s ago 12m 14.2M - 1.5.0 0da6a335fe13 1e59bbb2aa82 2024-04-25T17:22:52.240 INFO:teuthology.orchestra.run.smithi037.stdout:node-exporter.smithi069 smithi069 *:9100 running (3m) 36s ago 11m 16.7M - 1.5.0 0da6a335fe13 0c51a9833fe4 2024-04-25T17:22:52.240 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0 smithi037 running (18s) 12s ago 10m 79.0M 1559M 19.0.0-3291-g994e2f20 d53c96779a29 e97538cb8b4f 2024-04-25T17:22:52.240 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1 smithi037 running (10m) 12s ago 10m 242M 1559M 17.2.7-902-gc61472c8 0de407c1b3af 5715a5da241d 2024-04-25T17:22:52.240 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2 smithi037 running (9m) 12s ago 9m 204M 1559M 17.2.7-902-gc61472c8 0de407c1b3af 2eedaf9886dd 2024-04-25T17:22:52.241 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3 smithi069 running (9m) 36s ago 9m 276M 2581M 17.2.7-902-gc61472c8 0de407c1b3af ebba78fb1923 2024-04-25T17:22:52.241 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4 smithi069 running (9m) 36s ago 9m 253M 2581M 17.2.7-902-gc61472c8 0de407c1b3af ba7b785c50f9 2024-04-25T17:22:52.241 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5 smithi069 running (8m) 36s ago 8m 228M 2581M 17.2.7-902-gc61472c8 0de407c1b3af f6be99c364ff 2024-04-25T17:22:52.241 INFO:teuthology.orchestra.run.smithi037.stdout:prometheus.smithi037 smithi037 *:9095 running (2m) 12s ago 12m 63.7M - 2.43.0 a07b618ecd1d 2c5a268ffc1f 2024-04-25T17:22:52.241 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.239+0000 7fd9ddc7d700 1 -- 172.21.15.37:0/1968622625 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fd9c0076b90 msgr2=0x7fd9c0079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:22:52.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.239+0000 7fd9ddc7d700 1 --2- 172.21.15.37:0/1968622625 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fd9c0076b90 0x7fd9c0079040 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd9d80ffac0 tx=0x7fd9c800b040 comp rx=0 tx=0).stop 2024-04-25T17:22:52.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.239+0000 7fd9ddc7d700 1 -- 172.21.15.37:0/1968622625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9d80fcf60 msgr2=0x7fd9d80fe2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:22:52.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.239+0000 7fd9ddc7d700 1 --2- 172.21.15.37:0/1968622625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9d80fcf60 0x7fd9d80fe2a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc00b3b0 tx=0x7fd9cc009e30 comp rx=0 tx=0).stop 2024-04-25T17:22:52.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.239+0000 7fd9ddc7d700 1 -- 172.21.15.37:0/1968622625 shutdown_connections 2024-04-25T17:22:52.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.239+0000 7fd9ddc7d700 1 --2- 172.21.15.37:0/1968622625 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fd9c0076b90 0x7fd9c0079040 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:52.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.239+0000 7fd9ddc7d700 1 --2- 172.21.15.37:0/1968622625 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9d80fbcb0 0x7fd9d80ffd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:52.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.239+0000 7fd9ddc7d700 1 --2- 172.21.15.37:0/1968622625 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd9d80fcf60 0x7fd9d80fe2a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:52.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.239+0000 7fd9ddc7d700 1 -- 172.21.15.37:0/1968622625 >> 172.21.15.37:0/1968622625 conn(0x7fd9d80f7430 msgr2=0x7fd9d8065c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:22:52.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.240+0000 7fd9ddc7d700 1 -- 172.21.15.37:0/1968622625 shutdown_connections 2024-04-25T17:22:52.242 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.240+0000 7fd9ddc7d700 1 -- 172.21.15.37:0/1968622625 wait complete. 2024-04-25T17:22:52.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.343+0000 7f96db52c700 1 -- 172.21.15.37:0/2444071962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96d40fbcb0 msgr2=0x7f96d40fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:22:52.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.343+0000 7f96db52c700 1 --2- 172.21.15.37:0/2444071962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96d40fbcb0 0x7f96d40fc0c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f96c4009ce0 tx=0x7f96c4004d10 comp rx=0 tx=0).stop 2024-04-25T17:22:52.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.343+0000 7f96db52c700 1 -- 172.21.15.37:0/2444071962 shutdown_connections 2024-04-25T17:22:52.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.343+0000 7f96db52c700 1 --2- 172.21.15.37:0/2444071962 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96d40fcf60 0x7f96d40fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:52.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.343+0000 7f96db52c700 1 --2- 172.21.15.37:0/2444071962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96d40fbcb0 0x7f96d40fc0c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:52.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.343+0000 7f96db52c700 1 -- 172.21.15.37:0/2444071962 >> 172.21.15.37:0/2444071962 conn(0x7f96d40f7430 msgr2=0x7f96d40f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:22:52.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.343+0000 7f96db52c700 1 -- 172.21.15.37:0/2444071962 shutdown_connections 2024-04-25T17:22:52.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.343+0000 7f96db52c700 1 -- 172.21.15.37:0/2444071962 wait complete. 2024-04-25T17:22:52.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.344+0000 7f96db52c700 1 Processor -- start 2024-04-25T17:22:52.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.344+0000 7f96db52c700 1 -- start start 2024-04-25T17:22:52.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.344+0000 7f96db52c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96d40fbcb0 0x7f96d410dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:22:52.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.344+0000 7f96db52c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96d40fcf60 0x7f96d410dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:22:52.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.344+0000 7f96db52c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d410e5f0 con 0x7f96d40fcf60 2024-04-25T17:22:52.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.344+0000 7f96db52c700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d410eda0 con 0x7f96d40fbcb0 2024-04-25T17:22:52.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.344+0000 7f96d92c8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96d40fbcb0 0x7f96d410dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:22:52.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.344+0000 7f96d8ac7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96d40fcf60 0x7f96d410dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:22:52.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.344+0000 7f96d92c8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96d40fbcb0 0x7f96d410dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.37:36334/0 (socket says 172.21.15.37:36334) 2024-04-25T17:22:52.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.344+0000 7f96d92c8700 1 -- 172.21.15.37:0/628000928 learned_addr learned my addr 172.21.15.37:0/628000928 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:22:52.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.344+0000 7f96d8ac7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96d40fcf60 0x7f96d410dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54996/0 (socket says 172.21.15.37:54996) 2024-04-25T17:22:52.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.344+0000 7f96d92c8700 1 -- 172.21.15.37:0/628000928 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96d40fcf60 msgr2=0x7f96d410dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:22:52.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.344+0000 7f96d92c8700 1 --2- 172.21.15.37:0/628000928 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96d40fcf60 0x7f96d410dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:52.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.344+0000 7f96d92c8700 1 -- 172.21.15.37:0/628000928 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c4009940 con 0x7f96d40fbcb0 2024-04-25T17:22:52.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.344+0000 7f96d92c8700 1 --2- 172.21.15.37:0/628000928 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96d40fbcb0 0x7f96d410dab0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f96c400bfd0 tx=0x7f96c4004d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:22:52.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.345+0000 7f96d1ffb700 1 -- 172.21.15.37:0/628000928 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96c400e040 con 0x7f96d40fbcb0 2024-04-25T17:22:52.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.345+0000 7f96db52c700 1 -- 172.21.15.37:0/628000928 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96d410f020 con 0x7f96d40fbcb0 2024-04-25T17:22:52.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.345+0000 7f96d1ffb700 1 -- 172.21.15.37:0/628000928 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f96c401cd00 con 0x7f96d40fbcb0 2024-04-25T17:22:52.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.345+0000 7f96d1ffb700 1 -- 172.21.15.37:0/628000928 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f96c4012c40 con 0x7f96d40fbcb0 2024-04-25T17:22:52.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.345+0000 7f96db52c700 1 -- 172.21.15.37:0/628000928 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96d410f560 con 0x7f96d40fbcb0 2024-04-25T17:22:52.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.346+0000 7f96db52c700 1 -- 172.21.15.37:0/628000928 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96d4101af0 con 0x7f96d40fbcb0 2024-04-25T17:22:52.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.347+0000 7f96d1ffb700 1 -- 172.21.15.37:0/628000928 <== mon.1 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f96c40124a0 con 0x7f96d40fbcb0 2024-04-25T17:22:52.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.347+0000 7f96d1ffb700 1 --2- 172.21.15.37:0/628000928 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f96bc076b90 0x7f96bc079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:22:52.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.347+0000 7f96d1ffb700 1 -- 172.21.15.37:0/628000928 <== mon.1 v2:172.21.15.69:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f96c409a940 con 0x7f96d40fbcb0 2024-04-25T17:22:52.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.347+0000 7f96d8ac7700 1 --2- 172.21.15.37:0/628000928 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f96bc076b90 0x7f96bc079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:22:52.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.348+0000 7f96d8ac7700 1 --2- 172.21.15.37:0/628000928 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f96bc076b90 0x7f96bc079040 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f96c8009b80 tx=0x7f96c800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:22:52.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.352+0000 7f96d1ffb700 1 -- 172.21.15.37:0/628000928 <== mon.1 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f96c40634a0 con 0x7f96d40fbcb0 2024-04-25T17:22:52.655 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.654+0000 7f96db52c700 1 -- 172.21.15.37:0/628000928 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f96d404bed0 con 0x7f96d40fbcb0 2024-04-25T17:22:52.657 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.655+0000 7f96d1ffb700 1 -- 172.21.15.37:0/628000928 <== mon.1 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7f96c405de60 con 0x7f96d40fbcb0 2024-04-25T17:22:52.657 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-25T17:22:52.657 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": { 2024-04-25T17:22:52.657 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 2 2024-04-25T17:22:52.657 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:22:52.657 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": { 2024-04-25T17:22:52.658 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 2 2024-04-25T17:22:52.658 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:22:52.658 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": { 2024-04-25T17:22:52.658 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 5, 2024-04-25T17:22:52.658 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 1 2024-04-25T17:22:52.658 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:22:52.659 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": { 2024-04-25T17:22:52.659 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 4 2024-04-25T17:22:52.659 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:22:52.659 INFO:teuthology.orchestra.run.smithi037.stdout: "overall": { 2024-04-25T17:22:52.659 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 9, 2024-04-25T17:22:52.659 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 5 2024-04-25T17:22:52.659 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-04-25T17:22:52.660 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-25T17:22:52.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.657+0000 7f96db52c700 1 -- 172.21.15.37:0/628000928 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f96bc076b90 msgr2=0x7f96bc079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:22:52.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.657+0000 7f96db52c700 1 --2- 172.21.15.37:0/628000928 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f96bc076b90 0x7f96bc079040 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f96c8009b80 tx=0x7f96c800b040 comp rx=0 tx=0).stop 2024-04-25T17:22:52.661 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.657+0000 7f96db52c700 1 -- 172.21.15.37:0/628000928 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96d40fbcb0 msgr2=0x7f96d410dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:22:52.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.657+0000 7f96db52c700 1 --2- 172.21.15.37:0/628000928 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96d40fbcb0 0x7f96d410dab0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f96c400bfd0 tx=0x7f96c4004d10 comp rx=0 tx=0).stop 2024-04-25T17:22:52.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.657+0000 7f96db52c700 1 -- 172.21.15.37:0/628000928 shutdown_connections 2024-04-25T17:22:52.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.657+0000 7f96db52c700 1 --2- 172.21.15.37:0/628000928 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f96bc076b90 0x7f96bc079040 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:52.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.657+0000 7f96db52c700 1 --2- 172.21.15.37:0/628000928 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96d40fbcb0 0x7f96d410dab0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:52.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.657+0000 7f96db52c700 1 --2- 172.21.15.37:0/628000928 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96d40fcf60 0x7f96d410dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:52.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.657+0000 7f96db52c700 1 -- 172.21.15.37:0/628000928 >> 172.21.15.37:0/628000928 conn(0x7f96d40f7430 msgr2=0x7f96d4065b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:22:52.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.657+0000 7f96db52c700 1 -- 172.21.15.37:0/628000928 shutdown_connections 2024-04-25T17:22:52.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.658+0000 7f96db52c700 1 -- 172.21.15.37:0/628000928 wait complete. 2024-04-25T17:22:52.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.761+0000 7f5e3dd95700 1 -- 172.21.15.37:0/3372191722 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e380fe410 msgr2=0x7f5e380fe820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:22:52.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.761+0000 7f5e3dd95700 1 --2- 172.21.15.37:0/3372191722 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e380fe410 0x7f5e380fe820 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5e28004940 tx=0x7f5e28009e30 comp rx=0 tx=0).stop 2024-04-25T17:22:52.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.761+0000 7f5e3dd95700 1 -- 172.21.15.37:0/3372191722 shutdown_connections 2024-04-25T17:22:52.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.761+0000 7f5e3dd95700 1 --2- 172.21.15.37:0/3372191722 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5e380fed60 0x7f5e380faea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:52.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.761+0000 7f5e3dd95700 1 --2- 172.21.15.37:0/3372191722 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e380fe410 0x7f5e380fe820 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:52.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.761+0000 7f5e3dd95700 1 -- 172.21.15.37:0/3372191722 >> 172.21.15.37:0/3372191722 conn(0x7f5e380f6bd0 msgr2=0x7f5e380f8fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:22:52.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.761+0000 7f5e3dd95700 1 -- 172.21.15.37:0/3372191722 shutdown_connections 2024-04-25T17:22:52.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.761+0000 7f5e3dd95700 1 -- 172.21.15.37:0/3372191722 wait complete. 2024-04-25T17:22:52.764 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.762+0000 7f5e3dd95700 1 Processor -- start 2024-04-25T17:22:52.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.762+0000 7f5e3dd95700 1 -- start start 2024-04-25T17:22:52.765 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.762+0000 7f5e3dd95700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e380fe410 0x7f5e380fda20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:22:52.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.762+0000 7f5e3dd95700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5e380fed60 0x7f5e380fc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:22:52.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.762+0000 7f5e3dd95700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e380fe020 con 0x7f5e380fe410 2024-04-25T17:22:52.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.762+0000 7f5e3dd95700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e380fc610 con 0x7f5e380fed60 2024-04-25T17:22:52.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.762+0000 7f5e377fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e380fe410 0x7f5e380fda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:22:52.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.762+0000 7f5e377fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e380fe410 0x7f5e380fda20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55006/0 (socket says 172.21.15.37:55006) 2024-04-25T17:22:52.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.762+0000 7f5e377fe700 1 -- 172.21.15.37:0/2349397092 learned_addr learned my addr 172.21.15.37:0/2349397092 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:22:52.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.763+0000 7f5e36ffd700 1 --2- 172.21.15.37:0/2349397092 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5e380fed60 0x7f5e380fc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:22:52.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.763+0000 7f5e377fe700 1 -- 172.21.15.37:0/2349397092 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5e380fed60 msgr2=0x7f5e380fc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:22:52.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.763+0000 7f5e377fe700 1 --2- 172.21.15.37:0/2349397092 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5e380fed60 0x7f5e380fc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:52.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.763+0000 7f5e377fe700 1 -- 172.21.15.37:0/2349397092 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e28005040 con 0x7f5e380fe410 2024-04-25T17:22:52.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.763+0000 7f5e377fe700 1 --2- 172.21.15.37:0/2349397092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e380fe410 0x7f5e380fda20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5e28013870 tx=0x7f5e28009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:22:52.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.763+0000 7f5e1ffff700 1 -- 172.21.15.37:0/2349397092 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e28021070 con 0x7f5e380fe410 2024-04-25T17:22:52.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.763+0000 7f5e3dd95700 1 -- 172.21.15.37:0/2349397092 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e380fc860 con 0x7f5e380fe410 2024-04-25T17:22:52.766 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.763+0000 7f5e1ffff700 1 -- 172.21.15.37:0/2349397092 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5e28009430 con 0x7f5e380fe410 2024-04-25T17:22:52.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.763+0000 7f5e1ffff700 1 -- 172.21.15.37:0/2349397092 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e2800e070 con 0x7f5e380fe410 2024-04-25T17:22:52.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.763+0000 7f5e3dd95700 1 -- 172.21.15.37:0/2349397092 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e380fcda0 con 0x7f5e380fe410 2024-04-25T17:22:52.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.764+0000 7f5e3dd95700 1 -- 172.21.15.37:0/2349397092 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e3804c710 con 0x7f5e380fe410 2024-04-25T17:22:52.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.765+0000 7f5e1ffff700 1 -- 172.21.15.37:0/2349397092 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f5e2801c750 con 0x7f5e380fe410 2024-04-25T17:22:52.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.766+0000 7f5e1ffff700 1 --2- 172.21.15.37:0/2349397092 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f5e20076b20 0x7f5e20078fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:22:52.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.766+0000 7f5e1ffff700 1 -- 172.21.15.37:0/2349397092 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f5e28099ab0 con 0x7f5e380fe410 2024-04-25T17:22:52.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.766+0000 7f5e36ffd700 1 --2- 172.21.15.37:0/2349397092 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f5e20076b20 0x7f5e20078fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:22:52.768 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.766+0000 7f5e36ffd700 1 --2- 172.21.15.37:0/2349397092 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f5e20076b20 0x7f5e20078fd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c009b80 tx=0x7f5e2c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:22:52.772 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:52.770+0000 7f5e1ffff700 1 -- 172.21.15.37:0/2349397092 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f5e28062810 con 0x7f5e380fe410 2024-04-25T17:22:53.028 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.026+0000 7f5e3dd95700 1 -- 172.21.15.37:0/2349397092 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5e38115b90 con 0x7f5e380fe410 2024-04-25T17:22:53.029 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:52 smithi037 ceph-mon[90844]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:22:53.029 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:52 smithi037 ceph-mon[90844]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:22:53.029 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:52 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/628000928' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:22:53.029 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.027+0000 7f5e1ffff700 1 -- 172.21.15.37:0/2349397092 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1900 (secure 0 0 0) 0x7f5e28004490 con 0x7f5e380fe410 2024-04-25T17:22:53.030 INFO:teuthology.orchestra.run.smithi037.stdout:e16 2024-04-25T17:22:53.030 INFO:teuthology.orchestra.run.smithi037.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-25T17:22:53.030 INFO:teuthology.orchestra.run.smithi037.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T17:22:53.030 INFO:teuthology.orchestra.run.smithi037.stdout:legacy client fscid: 1 2024-04-25T17:22:53.030 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:22:53.030 INFO:teuthology.orchestra.run.smithi037.stdout:Filesystem 'cephfs' (1) 2024-04-25T17:22:53.030 INFO:teuthology.orchestra.run.smithi037.stdout:fs_name cephfs 2024-04-25T17:22:53.031 INFO:teuthology.orchestra.run.smithi037.stdout:epoch 16 2024-04-25T17:22:53.031 INFO:teuthology.orchestra.run.smithi037.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-25T17:22:53.031 INFO:teuthology.orchestra.run.smithi037.stdout:created 2024-04-25T17:15:40.586130+0000 2024-04-25T17:22:53.031 INFO:teuthology.orchestra.run.smithi037.stdout:modified 2024-04-25T17:15:57.508740+0000 2024-04-25T17:22:53.031 INFO:teuthology.orchestra.run.smithi037.stdout:tableserver 0 2024-04-25T17:22:53.031 INFO:teuthology.orchestra.run.smithi037.stdout:root 0 2024-04-25T17:22:53.031 INFO:teuthology.orchestra.run.smithi037.stdout:session_timeout 60 2024-04-25T17:22:53.031 INFO:teuthology.orchestra.run.smithi037.stdout:session_autoclose 300 2024-04-25T17:22:53.032 INFO:teuthology.orchestra.run.smithi037.stdout:max_file_size 1099511627776 2024-04-25T17:22:53.032 INFO:teuthology.orchestra.run.smithi037.stdout:max_xattr_size 65536 2024-04-25T17:22:53.032 INFO:teuthology.orchestra.run.smithi037.stdout:required_client_features {} 2024-04-25T17:22:53.032 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure 0 2024-04-25T17:22:53.032 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure_osd_epoch 0 2024-04-25T17:22:53.032 INFO:teuthology.orchestra.run.smithi037.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T17:22:53.032 INFO:teuthology.orchestra.run.smithi037.stdout:max_mds 1 2024-04-25T17:22:53.032 INFO:teuthology.orchestra.run.smithi037.stdout:in 0 2024-04-25T17:22:53.032 INFO:teuthology.orchestra.run.smithi037.stdout:up {0=14470} 2024-04-25T17:22:53.032 INFO:teuthology.orchestra.run.smithi037.stdout:failed 2024-04-25T17:22:53.032 INFO:teuthology.orchestra.run.smithi037.stdout:damaged 2024-04-25T17:22:53.032 INFO:teuthology.orchestra.run.smithi037.stdout:stopped 2024-04-25T17:22:53.032 INFO:teuthology.orchestra.run.smithi037.stdout:data_pools [3] 2024-04-25T17:22:53.033 INFO:teuthology.orchestra.run.smithi037.stdout:metadata_pool 2 2024-04-25T17:22:53.033 INFO:teuthology.orchestra.run.smithi037.stdout:inline_data disabled 2024-04-25T17:22:53.033 INFO:teuthology.orchestra.run.smithi037.stdout:balancer 2024-04-25T17:22:53.033 INFO:teuthology.orchestra.run.smithi037.stdout:bal_rank_mask -1 2024-04-25T17:22:53.033 INFO:teuthology.orchestra.run.smithi037.stdout:standby_count_wanted 1 2024-04-25T17:22:53.033 INFO:teuthology.orchestra.run.smithi037.stdout:qdb_cluster leader: 0 members: 2024-04-25T17:22:53.033 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi037.ksmixc{0:14470} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.37:6826/1903989494,v1:172.21.15.37:6827/1903989494] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:22:53.033 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi037.ovkrpq{0:14482} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.37:6828/4206394422,v1:172.21.15.37:6829/4206394422] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:22:53.033 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:22:53.033 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:22:53.033 INFO:teuthology.orchestra.run.smithi037.stdout:Standby daemons: 2024-04-25T17:22:53.034 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:22:53.034 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi069.cpprst{-1:24289} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.69:6826/518856100,v1:172.21.15.69:6827/518856100] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:22:53.034 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi069.ytlqcf{-1:24293} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.69:6824/134210439,v1:172.21.15.69:6825/134210439] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:22:53.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.029+0000 7f5e3dd95700 1 -- 172.21.15.37:0/2349397092 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f5e20076b20 msgr2=0x7f5e20078fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:22:53.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.029+0000 7f5e3dd95700 1 --2- 172.21.15.37:0/2349397092 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f5e20076b20 0x7f5e20078fd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c009b80 tx=0x7f5e2c00b040 comp rx=0 tx=0).stop 2024-04-25T17:22:53.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.029+0000 7f5e3dd95700 1 -- 172.21.15.37:0/2349397092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e380fe410 msgr2=0x7f5e380fda20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:22:53.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.029+0000 7f5e3dd95700 1 --2- 172.21.15.37:0/2349397092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e380fe410 0x7f5e380fda20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5e28013870 tx=0x7f5e28009e30 comp rx=0 tx=0).stop 2024-04-25T17:22:53.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.029+0000 7f5e3dd95700 1 -- 172.21.15.37:0/2349397092 shutdown_connections 2024-04-25T17:22:53.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.029+0000 7f5e3dd95700 1 --2- 172.21.15.37:0/2349397092 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f5e20076b20 0x7f5e20078fd0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:53.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.029+0000 7f5e3dd95700 1 --2- 172.21.15.37:0/2349397092 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e380fe410 0x7f5e380fda20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:53.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.029+0000 7f5e3dd95700 1 --2- 172.21.15.37:0/2349397092 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5e380fed60 0x7f5e380fc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:53.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.029+0000 7f5e3dd95700 1 -- 172.21.15.37:0/2349397092 >> 172.21.15.37:0/2349397092 conn(0x7f5e380f6bd0 msgr2=0x7f5e380f81e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:22:53.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.029+0000 7f5e3dd95700 1 -- 172.21.15.37:0/2349397092 shutdown_connections 2024-04-25T17:22:53.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.029+0000 7f5e3dd95700 1 -- 172.21.15.37:0/2349397092 wait complete. 2024-04-25T17:22:53.036 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 16 2024-04-25T17:22:53.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.135+0000 7f2ecd5fb700 1 -- 172.21.15.37:0/236848730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ec80fce70 msgr2=0x7f2ec80fd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:22:53.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.135+0000 7f2ecd5fb700 1 --2- 172.21.15.37:0/236848730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ec80fce70 0x7f2ec80fd280 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0004940 tx=0x7f2eb0009e30 comp rx=0 tx=0).stop 2024-04-25T17:22:53.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.135+0000 7f2ecd5fb700 1 -- 172.21.15.37:0/236848730 shutdown_connections 2024-04-25T17:22:53.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.135+0000 7f2ecd5fb700 1 --2- 172.21.15.37:0/236848730 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ec80fdfe0 0x7f2ec80fe450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:53.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.135+0000 7f2ecd5fb700 1 --2- 172.21.15.37:0/236848730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ec80fce70 0x7f2ec80fd280 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:53.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.135+0000 7f2ecd5fb700 1 -- 172.21.15.37:0/236848730 >> 172.21.15.37:0/236848730 conn(0x7f2ec80f8550 msgr2=0x7f2ec80fa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:22:53.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.135+0000 7f2ecd5fb700 1 -- 172.21.15.37:0/236848730 shutdown_connections 2024-04-25T17:22:53.138 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.135+0000 7f2ecd5fb700 1 -- 172.21.15.37:0/236848730 wait complete. 2024-04-25T17:22:53.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.136+0000 7f2ecd5fb700 1 Processor -- start 2024-04-25T17:22:53.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.136+0000 7f2ecd5fb700 1 -- start start 2024-04-25T17:22:53.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.136+0000 7f2ecd5fb700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ec80fce70 0x7f2ec810fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:22:53.139 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.136+0000 7f2ecd5fb700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ec80fdfe0 0x7f2ec810fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:22:53.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.136+0000 7f2ecd5fb700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec81105f0 con 0x7f2ec80fce70 2024-04-25T17:22:53.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.136+0000 7f2ecd5fb700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec8110760 con 0x7f2ec80fdfe0 2024-04-25T17:22:53.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.136+0000 7f2ec6ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ec80fce70 0x7f2ec810fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:22:53.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.136+0000 7f2ec6ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ec80fce70 0x7f2ec810fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55034/0 (socket says 172.21.15.37:55034) 2024-04-25T17:22:53.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.136+0000 7f2ec6ffd700 1 -- 172.21.15.37:0/783101224 learned_addr learned my addr 172.21.15.37:0/783101224 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:22:53.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.136+0000 7f2ec67fc700 1 --2- 172.21.15.37:0/783101224 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ec80fdfe0 0x7f2ec810fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:22:53.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.137+0000 7f2ec67fc700 1 -- 172.21.15.37:0/783101224 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ec80fce70 msgr2=0x7f2ec810fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:22:53.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.137+0000 7f2ec67fc700 1 --2- 172.21.15.37:0/783101224 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ec80fce70 0x7f2ec810fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:53.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.137+0000 7f2ec67fc700 1 -- 172.21.15.37:0/783101224 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb0005040 con 0x7f2ec80fdfe0 2024-04-25T17:22:53.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.137+0000 7f2ec6ffd700 1 --2- 172.21.15.37:0/783101224 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ec80fce70 0x7f2ec810fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T17:22:53.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.137+0000 7f2ec67fc700 1 --2- 172.21.15.37:0/783101224 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ec80fdfe0 0x7f2ec810fff0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f2eb8009fd0 tx=0x7f2eb800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:22:53.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.137+0000 7f2ebf7fe700 1 -- 172.21.15.37:0/783101224 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2eb8004e90 con 0x7f2ec80fdfe0 2024-04-25T17:22:53.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.137+0000 7f2ecd5fb700 1 -- 172.21.15.37:0/783101224 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ec8115160 con 0x7f2ec80fdfe0 2024-04-25T17:22:53.140 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.137+0000 7f2ebf7fe700 1 -- 172.21.15.37:0/783101224 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2eb800f040 con 0x7f2ec80fdfe0 2024-04-25T17:22:53.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.137+0000 7f2ebf7fe700 1 -- 172.21.15.37:0/783101224 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2eb800ca50 con 0x7f2ec80fdfe0 2024-04-25T17:22:53.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.137+0000 7f2ecd5fb700 1 -- 172.21.15.37:0/783101224 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ec81156a0 con 0x7f2ec80fdfe0 2024-04-25T17:22:53.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.138+0000 7f2ecd5fb700 1 -- 172.21.15.37:0/783101224 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ec8101970 con 0x7f2ec80fdfe0 2024-04-25T17:22:53.141 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.139+0000 7f2ebf7fe700 1 -- 172.21.15.37:0/783101224 <== mon.1 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f2eb8007cc0 con 0x7f2ec80fdfe0 2024-04-25T17:22:53.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.139+0000 7f2ebf7fe700 1 --2- 172.21.15.37:0/783101224 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f2eb4076b90 0x7f2eb4079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:22:53.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.140+0000 7f2ebf7fe700 1 -- 172.21.15.37:0/783101224 <== mon.1 v2:172.21.15.69:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f2eb8097db0 con 0x7f2ec80fdfe0 2024-04-25T17:22:53.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.140+0000 7f2ec6ffd700 1 --2- 172.21.15.37:0/783101224 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f2eb4076b90 0x7f2eb4079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:22:53.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.140+0000 7f2ec6ffd700 1 --2- 172.21.15.37:0/783101224 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f2eb4076b90 0x7f2eb4079040 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2eb000b0d0 tx=0x7f2eb0009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:22:53.150 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.149+0000 7f2ebf7fe700 1 -- 172.21.15.37:0/783101224 <== mon.1 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f2eb8060940 con 0x7f2ec80fdfe0 2024-04-25T17:22:53.171 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:52 smithi069 ceph-mon[80239]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:22:53.171 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:52 smithi069 ceph-mon[80239]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:22:53.171 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:52 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/628000928' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:22:53.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.382+0000 7f2ecd5fb700 1 -- 172.21.15.37:0/783101224 --> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ec802b3b0 con 0x7f2eb4076b90 2024-04-25T17:22:53.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.383+0000 7f2ebf7fe700 1 -- 172.21.15.37:0/783101224 <== mgr.34104 v2:172.21.15.37:6800/783197737 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f2ec802b3b0 con 0x7f2eb4076b90 2024-04-25T17:22:53.385 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-25T17:22:53.385 INFO:teuthology.orchestra.run.smithi037.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385", 2024-04-25T17:22:53.385 INFO:teuthology.orchestra.run.smithi037.stdout: "in_progress": true, 2024-04-25T17:22:53.385 INFO:teuthology.orchestra.run.smithi037.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-25T17:22:53.385 INFO:teuthology.orchestra.run.smithi037.stdout: "services_complete": [ 2024-04-25T17:22:53.385 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr", 2024-04-25T17:22:53.385 INFO:teuthology.orchestra.run.smithi037.stdout: "crash", 2024-04-25T17:22:53.385 INFO:teuthology.orchestra.run.smithi037.stdout: "mon" 2024-04-25T17:22:53.385 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-04-25T17:22:53.386 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": "7/21 daemons upgraded", 2024-04-25T17:22:53.386 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "Currently upgrading osd daemons", 2024-04-25T17:22:53.386 INFO:teuthology.orchestra.run.smithi037.stdout: "is_paused": false 2024-04-25T17:22:53.386 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-25T17:22:53.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.385+0000 7f2ecd5fb700 1 -- 172.21.15.37:0/783101224 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f2eb4076b90 msgr2=0x7f2eb4079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:22:53.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.385+0000 7f2ecd5fb700 1 --2- 172.21.15.37:0/783101224 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f2eb4076b90 0x7f2eb4079040 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2eb000b0d0 tx=0x7f2eb0009e30 comp rx=0 tx=0).stop 2024-04-25T17:22:53.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.385+0000 7f2ecd5fb700 1 -- 172.21.15.37:0/783101224 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ec80fdfe0 msgr2=0x7f2ec810fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:22:53.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.385+0000 7f2ecd5fb700 1 --2- 172.21.15.37:0/783101224 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ec80fdfe0 0x7f2ec810fff0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f2eb8009fd0 tx=0x7f2eb800b040 comp rx=0 tx=0).stop 2024-04-25T17:22:53.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.385+0000 7f2ecd5fb700 1 -- 172.21.15.37:0/783101224 shutdown_connections 2024-04-25T17:22:53.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.385+0000 7f2ecd5fb700 1 --2- 172.21.15.37:0/783101224 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f2eb4076b90 0x7f2eb4079040 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:53.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.385+0000 7f2ecd5fb700 1 --2- 172.21.15.37:0/783101224 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ec80fce70 0x7f2ec810fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:53.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.385+0000 7f2ecd5fb700 1 --2- 172.21.15.37:0/783101224 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ec80fdfe0 0x7f2ec810fff0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:53.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.385+0000 7f2ecd5fb700 1 -- 172.21.15.37:0/783101224 >> 172.21.15.37:0/783101224 conn(0x7f2ec80f8550 msgr2=0x7f2ec80f9ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:22:53.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.385+0000 7f2ecd5fb700 1 -- 172.21.15.37:0/783101224 shutdown_connections 2024-04-25T17:22:53.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.385+0000 7f2ecd5fb700 1 -- 172.21.15.37:0/783101224 wait complete. 2024-04-25T17:22:53.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.490+0000 7efe4af10700 1 -- 172.21.15.37:0/2159070430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe440fce60 msgr2=0x7efe440fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:22:53.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.490+0000 7efe4af10700 1 --2- 172.21.15.37:0/2159070430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe440fce60 0x7efe440fd270 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7efe38004940 tx=0x7efe38009e30 comp rx=0 tx=0).stop 2024-04-25T17:22:53.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.490+0000 7efe4af10700 1 -- 172.21.15.37:0/2159070430 shutdown_connections 2024-04-25T17:22:53.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.490+0000 7efe4af10700 1 --2- 172.21.15.37:0/2159070430 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efe440fdfd0 0x7efe440fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:53.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.490+0000 7efe4af10700 1 --2- 172.21.15.37:0/2159070430 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe440fce60 0x7efe440fd270 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:53.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.490+0000 7efe4af10700 1 -- 172.21.15.37:0/2159070430 >> 172.21.15.37:0/2159070430 conn(0x7efe440f8560 msgr2=0x7efe440fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:22:53.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.490+0000 7efe4af10700 1 -- 172.21.15.37:0/2159070430 shutdown_connections 2024-04-25T17:22:53.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.490+0000 7efe4af10700 1 -- 172.21.15.37:0/2159070430 wait complete. 2024-04-25T17:22:53.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.491+0000 7efe4af10700 1 Processor -- start 2024-04-25T17:22:53.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.491+0000 7efe4af10700 1 -- start start 2024-04-25T17:22:53.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.491+0000 7efe4af10700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efe440fce60 0x7efe44071de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:22:53.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.491+0000 7efe4af10700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe440fdfd0 0x7efe440702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:22:53.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.491+0000 7efe4af10700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe44070860 con 0x7efe440fdfd0 2024-04-25T17:22:53.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.491+0000 7efe4af10700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe440709d0 con 0x7efe440fce60 2024-04-25T17:22:53.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.491+0000 7efe43fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe440fdfd0 0x7efe440702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:22:53.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.491+0000 7efe43fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe440fdfd0 0x7efe440702b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55054/0 (socket says 172.21.15.37:55054) 2024-04-25T17:22:53.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.491+0000 7efe43fff700 1 -- 172.21.15.37:0/694591623 learned_addr learned my addr 172.21.15.37:0/694591623 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:22:53.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.492+0000 7efe48cac700 1 --2- 172.21.15.37:0/694591623 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efe440fce60 0x7efe44071de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:22:53.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.492+0000 7efe43fff700 1 -- 172.21.15.37:0/694591623 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efe440fce60 msgr2=0x7efe44071de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:22:53.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.492+0000 7efe43fff700 1 --2- 172.21.15.37:0/694591623 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efe440fce60 0x7efe44071de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:53.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.492+0000 7efe43fff700 1 -- 172.21.15.37:0/694591623 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe38005040 con 0x7efe440fdfd0 2024-04-25T17:22:53.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.492+0000 7efe43fff700 1 --2- 172.21.15.37:0/694591623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe440fdfd0 0x7efe440702b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7efe3000eb40 tx=0x7efe3000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:22:53.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.492+0000 7efe417fa700 1 -- 172.21.15.37:0/694591623 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe30007cc0 con 0x7efe440fdfd0 2024-04-25T17:22:53.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.492+0000 7efe417fa700 1 -- 172.21.15.37:0/694591623 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efe3000f040 con 0x7efe440fdfd0 2024-04-25T17:22:53.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.492+0000 7efe4af10700 1 -- 172.21.15.37:0/694591623 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe44070c50 con 0x7efe440fdfd0 2024-04-25T17:22:53.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.492+0000 7efe417fa700 1 -- 172.21.15.37:0/694591623 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe3000ca10 con 0x7efe440fdfd0 2024-04-25T17:22:53.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.492+0000 7efe4af10700 1 -- 172.21.15.37:0/694591623 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe44115990 con 0x7efe440fdfd0 2024-04-25T17:22:53.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.493+0000 7efe4af10700 1 -- 172.21.15.37:0/694591623 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe4405f5c0 con 0x7efe440fdfd0 2024-04-25T17:22:53.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.494+0000 7efe417fa700 1 -- 172.21.15.37:0/694591623 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7efe3000cb70 con 0x7efe440fdfd0 2024-04-25T17:22:53.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.494+0000 7efe417fa700 1 --2- 172.21.15.37:0/694591623 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7efe34076b90 0x7efe34079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:22:53.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.494+0000 7efe417fa700 1 -- 172.21.15.37:0/694591623 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6324+0+0 (secure 0 0 0) 0x7efe30097db0 con 0x7efe440fdfd0 2024-04-25T17:22:53.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.494+0000 7efe48cac700 1 --2- 172.21.15.37:0/694591623 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7efe34076b90 0x7efe34079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:22:53.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.495+0000 7efe48cac700 1 --2- 172.21.15.37:0/694591623 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7efe34076b90 0x7efe34079040 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efe38013870 tx=0x7efe38009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:22:53.501 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.500+0000 7efe417fa700 1 -- 172.21.15.37:0/694591623 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7efe30060a60 con 0x7efe440fdfd0 2024-04-25T17:22:53.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.800+0000 7efe4af10700 1 -- 172.21.15.37:0/694591623 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7efe4404bed0 con 0x7efe440fdfd0 2024-04-25T17:22:53.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.800+0000 7efe417fa700 1 -- 172.21.15.37:0/694591623 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7efe30060400 con 0x7efe440fdfd0 2024-04-25T17:22:53.802 INFO:teuthology.orchestra.run.smithi037.stdout:HEALTH_OK 2024-04-25T17:22:53.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.802+0000 7efe4af10700 1 -- 172.21.15.37:0/694591623 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7efe34076b90 msgr2=0x7efe34079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:22:53.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.803+0000 7efe4af10700 1 --2- 172.21.15.37:0/694591623 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7efe34076b90 0x7efe34079040 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efe38013870 tx=0x7efe38009e30 comp rx=0 tx=0).stop 2024-04-25T17:22:53.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.803+0000 7efe4af10700 1 -- 172.21.15.37:0/694591623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe440fdfd0 msgr2=0x7efe440702b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:22:53.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.803+0000 7efe4af10700 1 --2- 172.21.15.37:0/694591623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe440fdfd0 0x7efe440702b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7efe3000eb40 tx=0x7efe3000b040 comp rx=0 tx=0).stop 2024-04-25T17:22:53.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.803+0000 7efe4af10700 1 -- 172.21.15.37:0/694591623 shutdown_connections 2024-04-25T17:22:53.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.803+0000 7efe4af10700 1 --2- 172.21.15.37:0/694591623 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7efe34076b90 0x7efe34079040 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:53.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.803+0000 7efe4af10700 1 --2- 172.21.15.37:0/694591623 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efe440fce60 0x7efe44071de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:53.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.803+0000 7efe4af10700 1 --2- 172.21.15.37:0/694591623 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe440fdfd0 0x7efe440702b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:22:53.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.803+0000 7efe4af10700 1 -- 172.21.15.37:0/694591623 >> 172.21.15.37:0/694591623 conn(0x7efe440f8560 msgr2=0x7efe440f9b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:22:53.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.803+0000 7efe4af10700 1 -- 172.21.15.37:0/694591623 shutdown_connections 2024-04-25T17:22:53.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:22:53.803+0000 7efe4af10700 1 -- 172.21.15.37:0/694591623 wait complete. 2024-04-25T17:22:54.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:53 smithi037 ceph-mon[90844]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:22:54.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:53 smithi037 ceph-mon[90844]: pgmap v58: 65 pgs: 65 active+clean; 208 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.0 KiB/s rd, 307 B/s wr, 2 op/s 2024-04-25T17:22:54.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:53 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/2349397092' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T17:22:54.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:53 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/694591623' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T17:22:54.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:53 smithi069 ceph-mon[80239]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:22:54.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:53 smithi069 ceph-mon[80239]: pgmap v58: 65 pgs: 65 active+clean; 208 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.0 KiB/s rd, 307 B/s wr, 2 op/s 2024-04-25T17:22:54.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:53 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/2349397092' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T17:22:54.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:53 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/694591623' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T17:22:55.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:54 smithi069 ceph-mon[80239]: from='client.44163 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:22:55.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:54 smithi037 ceph-mon[90844]: from='client.44163 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:22:56.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:55 smithi069 ceph-mon[80239]: pgmap v59: 65 pgs: 65 active+clean; 208 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 932 B/s rd, 186 B/s wr, 2 op/s 2024-04-25T17:22:56.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:55 smithi037 ceph-mon[90844]: pgmap v59: 65 pgs: 65 active+clean; 208 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 932 B/s rd, 186 B/s wr, 2 op/s 2024-04-25T17:22:58.124 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:57 smithi037 ceph-mon[90844]: pgmap v60: 65 pgs: 65 active+clean; 208 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 170 B/s wr, 1 op/s 2024-04-25T17:22:58.124 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:57 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:58.124 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:57 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:22:58.124 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:57 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:58.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:57 smithi069 ceph-mon[80239]: pgmap v60: 65 pgs: 65 active+clean; 208 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 170 B/s wr, 1 op/s 2024-04-25T17:22:58.248 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:57 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:22:58.248 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:57 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:22:58.248 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:57 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:23:00.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:22:59 smithi069 ceph-mon[80239]: pgmap v61: 65 pgs: 65 active+clean; 208 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-25T17:23:00.321 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:22:59 smithi037 ceph-mon[90844]: pgmap v61: 65 pgs: 65 active+clean; 208 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 170 B/s wr, 2 op/s 2024-04-25T17:23:01.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:00 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-25T17:23:01.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:00 smithi037 ceph-mon[90844]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-25T17:23:01.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:00 smithi037 ceph-mon[90844]: Upgrade: osd.1 is safe to restart 2024-04-25T17:23:01.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:00 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-25T17:23:01.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:00 smithi069 ceph-mon[80239]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-04-25T17:23:01.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:00 smithi069 ceph-mon[80239]: Upgrade: osd.1 is safe to restart 2024-04-25T17:23:02.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:01 smithi069 ceph-mon[80239]: pgmap v62: 65 pgs: 65 active+clean; 208 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 938 B/s rd, 170 B/s wr, 2 op/s 2024-04-25T17:23:02.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:01 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:23:02.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:01 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-25T17:23:02.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:01 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:23:02.200 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:01 smithi037 ceph-mon[90844]: pgmap v62: 65 pgs: 65 active+clean; 208 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 938 B/s rd, 170 B/s wr, 2 op/s 2024-04-25T17:23:02.201 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:01 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:23:02.201 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:01 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-04-25T17:23:02.201 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:01 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:23:03.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:02 smithi069 ceph-mon[80239]: Upgrade: Updating osd.1 2024-04-25T17:23:03.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:02 smithi069 ceph-mon[80239]: Deploying daemon osd.1 on smithi037 2024-04-25T17:23:03.189 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:02 smithi037 ceph-mon[90844]: Upgrade: Updating osd.1 2024-04-25T17:23:03.189 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:02 smithi037 ceph-mon[90844]: Deploying daemon osd.1 on smithi037 2024-04-25T17:23:04.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:03 smithi037 ceph-mon[90844]: pgmap v63: 65 pgs: 65 active+clean; 208 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:23:04.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:03 smithi069 ceph-mon[80239]: pgmap v63: 65 pgs: 65 active+clean; 208 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:23:05.160 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:23:04 smithi037 systemd[1]: Stopping Ceph osd.1 for 599bb7fc-0326-11ef-bc93-c7b262605968... 2024-04-25T17:23:05.572 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:23:05 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-1[51671]: 2024-04-25T17:23:05.158+0000 7f825d2bc700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T17:23:05.572 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:23:05 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-1[51671]: 2024-04-25T17:23:05.158+0000 7f825d2bc700 -1 osd.1 54 *** Got signal Terminated *** 2024-04-25T17:23:05.572 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:23:05 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-1[51671]: 2024-04-25T17:23:05.158+0000 7f825d2bc700 -1 osd.1 54 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T17:23:06.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:05 smithi069 ceph-mon[80239]: pgmap v64: 65 pgs: 65 active+clean; 208 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:23:06.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:05 smithi069 ceph-mon[80239]: osd.1 marked itself down and dead 2024-04-25T17:23:06.238 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:05 smithi037 ceph-mon[90844]: pgmap v64: 65 pgs: 65 active+clean; 208 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:23:06.238 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:05 smithi037 ceph-mon[90844]: osd.1 marked itself down and dead 2024-04-25T17:23:06.520 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:23:06 smithi037 podman[104538]: 2024-04-25 17:23:06.238049966 +0000 UTC m=+1.189112388 container died 5715a5da241d72cebd3dc472a204fcf1f73468546ae7d313be519103f6bed472 (image=quay.ceph.io/ceph-ci/ceph@sha256:27d43f80a23d3545096a7bb490598a6f37852da2940e69e5a8f3e3d7fb58fd17, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=quincy-c61472c, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424) 2024-04-25T17:23:06.822 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:23:06 smithi037 podman[104538]: 2024-04-25 17:23:06.609856499 +0000 UTC m=+1.560918923 container cleanup 5715a5da241d72cebd3dc472a204fcf1f73468546ae7d313be519103f6bed472 (image=quay.ceph.io/ceph-ci/ceph@sha256:27d43f80a23d3545096a7bb490598a6f37852da2940e69e5a8f3e3d7fb58fd17, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=quincy-c61472c, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=) 2024-04-25T17:23:06.822 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:23:06 smithi037 bash[104538]: ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-1 2024-04-25T17:23:07.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:06 smithi069 ceph-mon[80239]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-25T17:23:07.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:06 smithi069 ceph-mon[80239]: osdmap e55: 6 total, 5 up, 6 in 2024-04-25T17:23:07.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:06 smithi069 ceph-mon[80239]: osdmap e56: 6 total, 5 up, 6 in 2024-04-25T17:23:07.201 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:06 smithi037 ceph-mon[90844]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-25T17:23:07.201 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:06 smithi037 ceph-mon[90844]: osdmap e55: 6 total, 5 up, 6 in 2024-04-25T17:23:07.201 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:06 smithi037 ceph-mon[90844]: osdmap e56: 6 total, 5 up, 6 in 2024-04-25T17:23:07.201 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:23:06 smithi037 podman[104557]: 2024-04-25 17:23:06.861225408 +0000 UTC m=+0.624563444 container remove 5715a5da241d72cebd3dc472a204fcf1f73468546ae7d313be519103f6bed472 (image=quay.ceph.io/ceph-ci/ceph@sha256:27d43f80a23d3545096a7bb490598a6f37852da2940e69e5a8f3e3d7fb58fd17, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-c61472c, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T17:23:07.523 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:23:07 smithi037 podman[104651]: 2024-04-25 17:23:07.104161607 +0000 UTC m=+0.018454522 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T17:23:07.523 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:23:07 smithi037 podman[104651]: 2024-04-25 17:23:07.203799409 +0000 UTC m=+0.118092289 container create 5202d6d3f1f84ab44b3aea7781b333e7b241accbe546ece26718e5a92845b685 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-1-deactivate, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-04-25T17:23:07.523 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:23:07 smithi037 podman[104651]: 2024-04-25 17:23:07.423251402 +0000 UTC m=+0.337544296 container init 5202d6d3f1f84ab44b3aea7781b333e7b241accbe546ece26718e5a92845b685 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-04-25T17:23:07.523 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:23:07 smithi037 podman[104651]: 2024-04-25 17:23:07.426925499 +0000 UTC m=+0.341218393 container start 5202d6d3f1f84ab44b3aea7781b333e7b241accbe546ece26718e5a92845b685 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-04-25T17:23:07.523 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:23:07 smithi037 podman[104651]: 2024-04-25 17:23:07.523050551 +0000 UTC m=+0.437343432 container attach 5202d6d3f1f84ab44b3aea7781b333e7b241accbe546ece26718e5a92845b685 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-25T17:23:07.822 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:23:07 smithi037 podman[104651]: 2024-04-25 17:23:07.728930168 +0000 UTC m=+0.643223053 container died 5202d6d3f1f84ab44b3aea7781b333e7b241accbe546ece26718e5a92845b685 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-04-25T17:23:08.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:07 smithi069 ceph-mon[80239]: pgmap v66: 65 pgs: 12 stale+active+clean, 53 active+clean; 208 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-04-25T17:23:08.321 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:07 smithi037 ceph-mon[90844]: pgmap v66: 65 pgs: 12 stale+active+clean, 53 active+clean; 208 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-04-25T17:23:08.591 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:23:08 smithi037 podman[104677]: 2024-04-25 17:23:08.335369119 +0000 UTC m=+0.600730734 container remove 5202d6d3f1f84ab44b3aea7781b333e7b241accbe546ece26718e5a92845b685 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T17:23:08.591 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:23:08 smithi037 systemd[1]: ceph-599bb7fc-0326-11ef-bc93-c7b262605968@osd.1.service: Deactivated successfully. 2024-04-25T17:23:08.591 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:23:08 smithi037 systemd[1]: Stopped Ceph osd.1 for 599bb7fc-0326-11ef-bc93-c7b262605968. 2024-04-25T17:23:08.591 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:23:08 smithi037 systemd[1]: ceph-599bb7fc-0326-11ef-bc93-c7b262605968@osd.1.service: Consumed 1min 10.875s CPU time. 2024-04-25T17:23:08.852 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:23:08 smithi037 systemd[1]: Starting Ceph osd.1 for 599bb7fc-0326-11ef-bc93-c7b262605968... 2024-04-25T17:23:08.852 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:23:08 smithi037 podman[104777]: 2024-04-25 17:23:08.715171551 +0000 UTC m=+0.018716091 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T17:23:08.852 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:23:08 smithi037 podman[104777]: 2024-04-25 17:23:08.828517479 +0000 UTC m=+0.132061991 container create 2c83b00206bb12eef214f9db6a6b24d487d0a08cb905732176fefd3dbc7adbca (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-1-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.license=GPLv2) 2024-04-25T17:23:09.206 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:08 smithi037 ceph-mon[90844]: Health check failed: Degraded data redundancy: 19/228 objects degraded (8.333%), 9 pgs degraded (PG_DEGRADED) 2024-04-25T17:23:09.207 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:23:09 smithi037 podman[104777]: 2024-04-25 17:23:09.089736924 +0000 UTC m=+0.393281436 container init 2c83b00206bb12eef214f9db6a6b24d487d0a08cb905732176fefd3dbc7adbca (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-1-activate, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, CEPH_POINT_RELEASE=) 2024-04-25T17:23:09.207 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:23:09 smithi037 podman[104777]: 2024-04-25 17:23:09.093105557 +0000 UTC m=+0.396650071 container start 2c83b00206bb12eef214f9db6a6b24d487d0a08cb905732176fefd3dbc7adbca (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-1-activate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-04-25T17:23:09.207 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:23:09 smithi037 podman[104777]: 2024-04-25 17:23:09.206630354 +0000 UTC m=+0.510174875 container attach 2c83b00206bb12eef214f9db6a6b24d487d0a08cb905732176fefd3dbc7adbca (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-1-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-04-25T17:23:09.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:08 smithi069 ceph-mon[80239]: Health check failed: Degraded data redundancy: 19/228 objects degraded (8.333%), 9 pgs degraded (PG_DEGRADED) 2024-04-25T17:23:10.026 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:09 smithi037 ceph-mon[90844]: pgmap v68: 65 pgs: 9 active+undersized+degraded, 5 stale+active+clean, 12 active+undersized, 39 active+clean; 208 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 19/228 objects degraded (8.333%) 2024-04-25T17:23:10.027 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:23:09 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-1-activate[104793]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-25T17:23:10.027 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:23:09 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-1-activate[104793]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-25T17:23:10.027 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:23:09 smithi037 bash[104777]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-25T17:23:10.027 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:23:09 smithi037 bash[104777]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-25T17:23:10.027 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:23:09 smithi037 bash[104777]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-25T17:23:10.027 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:23:09 smithi037 bash[104777]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-04-25T17:23:10.027 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:23:09 smithi037 bash[104777]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-04-25T17:23:10.027 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:23:09 smithi037 bash[104777]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-04-25T17:23:10.027 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:23:09 smithi037 bash[104777]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-04-25T17:23:10.027 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:23:09 smithi037 bash[104777]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-25T17:23:10.028 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:23:09 smithi037 bash[104777]: --> ceph-volume raw activate successful for osd ID: 1 2024-04-25T17:23:10.028 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:23:09 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-1-activate[104793]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-25T17:23:10.028 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:23:09 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-1-activate[104793]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-04-25T17:23:10.028 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:23:09 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-1-activate[104793]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-04-25T17:23:10.028 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:23:09 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-1-activate[104793]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-04-25T17:23:10.028 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:23:09 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-1-activate[104793]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-04-25T17:23:10.028 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:23:09 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-1-activate[104793]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-25T17:23:10.028 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:23:09 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-1-activate[104793]: --> ceph-volume raw activate successful for osd ID: 1 2024-04-25T17:23:10.028 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:23:09 smithi037 podman[104777]: 2024-04-25 17:23:09.729652262 +0000 UTC m=+1.033196786 container died 2c83b00206bb12eef214f9db6a6b24d487d0a08cb905732176fefd3dbc7adbca (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-1-activate, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_BRANCH=HEAD) 2024-04-25T17:23:10.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:09 smithi069 ceph-mon[80239]: pgmap v68: 65 pgs: 9 active+undersized+degraded, 5 stale+active+clean, 12 active+undersized, 39 active+clean; 208 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 19/228 objects degraded (8.333%) 2024-04-25T17:23:10.687 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:23:10 smithi037 podman[104928]: 2024-04-25 17:23:10.335420903 +0000 UTC m=+0.597269828 container remove 2c83b00206bb12eef214f9db6a6b24d487d0a08cb905732176fefd3dbc7adbca (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-1-activate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-04-25T17:23:10.688 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:23:10 smithi037 podman[104990]: 2024-04-25 17:23:10.454762722 +0000 UTC m=+0.018689412 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T17:23:10.688 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:23:10 smithi037 podman[104990]: 2024-04-25 17:23:10.553009055 +0000 UTC m=+0.116935733 container create 6cf158192aae6a97e14c26a91bee902570f2f329e4fc13d921434c022377f626 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-1, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-04-25T17:23:11.322 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:23:10 smithi037 podman[104990]: 2024-04-25 17:23:10.823012947 +0000 UTC m=+0.386939630 container init 6cf158192aae6a97e14c26a91bee902570f2f329e4fc13d921434c022377f626 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-1, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-04-25T17:23:11.322 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:23:10 smithi037 podman[104990]: 2024-04-25 17:23:10.826417001 +0000 UTC m=+0.390343676 container start 6cf158192aae6a97e14c26a91bee902570f2f329e4fc13d921434c022377f626 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-1, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-04-25T17:23:11.322 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:23:10 smithi037 ceph-osd[105009]: -- 172.21.15.37:0/4103644659 <== mon.0 v2:172.21.15.37:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55cad2565680 con 0x55cad260c880 2024-04-25T17:23:11.322 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:23:10 smithi037 bash[104990]: 6cf158192aae6a97e14c26a91bee902570f2f329e4fc13d921434c022377f626 2024-04-25T17:23:11.322 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:23:10 smithi037 systemd[1]: Started Ceph osd.1 for 599bb7fc-0326-11ef-bc93-c7b262605968. 2024-04-25T17:23:11.822 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:23:11 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-1[105005]: 2024-04-25T17:23:11.377+0000 7f0d4f2207c0 -1 Falling back to public interface 2024-04-25T17:23:12.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:11 smithi037 ceph-mon[90844]: pgmap v69: 65 pgs: 11 active+undersized+degraded, 3 stale+active+clean, 18 active+undersized, 33 active+clean; 208 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 27/228 objects degraded (11.842%) 2024-04-25T17:23:12.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:11 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:23:12.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:11 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:23:12.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:11 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:23:12.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:11 smithi069 ceph-mon[80239]: pgmap v69: 65 pgs: 11 active+undersized+degraded, 3 stale+active+clean, 18 active+undersized, 33 active+clean; 208 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 27/228 objects degraded (11.842%) 2024-04-25T17:23:12.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:11 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:23:12.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:11 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:23:12.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:11 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:23:13.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:13 smithi037 ceph-mon[90844]: pgmap v70: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 208 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 28/228 objects degraded (12.281%) 2024-04-25T17:23:13.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:13 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:23:13.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:13 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:23:13.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:13 smithi069 ceph-mon[80239]: pgmap v70: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 208 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 28/228 objects degraded (12.281%) 2024-04-25T17:23:13.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:13 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:23:13.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:13 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:23:15.922 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:15 smithi069 ceph-mon[80239]: pgmap v71: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 208 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 28/228 objects degraded (12.281%) 2024-04-25T17:23:15.932 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:15 smithi037 ceph-mon[90844]: pgmap v71: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 208 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 28/228 objects degraded (12.281%) 2024-04-25T17:23:17.572 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:23:17 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-1[105005]: 2024-04-25T17:23:17.477+0000 7f0d4f2207c0 -1 osd.1 54 log_to_monitors true 2024-04-25T17:23:17.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:17 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:23:17.573 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:17 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:23:17.573 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:17 smithi037 ceph-mon[90844]: pgmap v72: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 208 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 28/228 objects degraded (12.281%) 2024-04-25T17:23:17.573 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:17 smithi037 ceph-mon[90844]: Health check update: Degraded data redundancy: 28/228 objects degraded (12.281%), 12 pgs degraded (PG_DEGRADED) 2024-04-25T17:23:17.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:17 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:23:17.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:17 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:23:17.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:17 smithi069 ceph-mon[80239]: pgmap v72: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 208 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 28/228 objects degraded (12.281%) 2024-04-25T17:23:17.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:17 smithi069 ceph-mon[80239]: Health check update: Degraded data redundancy: 28/228 objects degraded (12.281%), 12 pgs degraded (PG_DEGRADED) 2024-04-25T17:23:18.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:18 smithi037 ceph-mon[90844]: from='osd.1 [v2:172.21.15.37:6810/914750118,v1:172.21.15.37:6811/914750118]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-25T17:23:18.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:18 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:23:18.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:18 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:23:18.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:18 smithi069 ceph-mon[80239]: from='osd.1 [v2:172.21.15.37:6810/914750118,v1:172.21.15.37:6811/914750118]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-04-25T17:23:18.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:18 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:23:18.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:18 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:23:19.556 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:23:19 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-1[105005]: 2024-04-25T17:23:19.274+0000 7f0d3c632700 -1 osd.1 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T17:23:19.556 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:19 smithi037 ceph-mon[90844]: from='osd.1 [v2:172.21.15.37:6810/914750118,v1:172.21.15.37:6811/914750118]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-25T17:23:19.556 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:19 smithi037 ceph-mon[90844]: osdmap e57: 6 total, 5 up, 6 in 2024-04-25T17:23:19.556 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:19 smithi037 ceph-mon[90844]: from='osd.1 [v2:172.21.15.37:6810/914750118,v1:172.21.15.37:6811/914750118]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-04-25T17:23:19.556 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:19 smithi037 ceph-mon[90844]: pgmap v74: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 208 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 28/228 objects degraded (12.281%) 2024-04-25T17:23:19.556 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:19 smithi037 ceph-mon[90844]: from='osd.1 [v2:172.21.15.37:6810/914750118,v1:172.21.15.37:6811/914750118]' entity='osd.1' 2024-04-25T17:23:19.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:19 smithi069 ceph-mon[80239]: from='osd.1 [v2:172.21.15.37:6810/914750118,v1:172.21.15.37:6811/914750118]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-04-25T17:23:19.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:19 smithi069 ceph-mon[80239]: osdmap e57: 6 total, 5 up, 6 in 2024-04-25T17:23:19.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:19 smithi069 ceph-mon[80239]: from='osd.1 [v2:172.21.15.37:6810/914750118,v1:172.21.15.37:6811/914750118]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-04-25T17:23:19.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:19 smithi069 ceph-mon[80239]: pgmap v74: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 208 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 28/228 objects degraded (12.281%) 2024-04-25T17:23:19.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:19 smithi069 ceph-mon[80239]: from='osd.1 [v2:172.21.15.37:6810/914750118,v1:172.21.15.37:6811/914750118]' entity='osd.1' 2024-04-25T17:23:20.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:20 smithi037 ceph-mon[90844]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-25T17:23:20.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:20 smithi037 ceph-mon[90844]: osd.1 [v2:172.21.15.37:6810/914750118,v1:172.21.15.37:6811/914750118] boot 2024-04-25T17:23:20.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:20 smithi037 ceph-mon[90844]: osdmap e58: 6 total, 6 up, 6 in 2024-04-25T17:23:20.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:20 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T17:23:20.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:20 smithi069 ceph-mon[80239]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-25T17:23:20.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:20 smithi069 ceph-mon[80239]: osd.1 [v2:172.21.15.37:6810/914750118,v1:172.21.15.37:6811/914750118] boot 2024-04-25T17:23:20.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:20 smithi069 ceph-mon[80239]: osdmap e58: 6 total, 6 up, 6 in 2024-04-25T17:23:20.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:20 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-04-25T17:23:21.570 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:21 smithi069 ceph-mon[80239]: pgmap v76: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 208 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 28/228 objects degraded (12.281%) 2024-04-25T17:23:21.570 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:21 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:23:21.570 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:21 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:23:21.570 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:21 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:23:21.570 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:21 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:23:21.570 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:21 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:23:21.570 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:21 smithi069 ceph-mon[80239]: osdmap e59: 6 total, 6 up, 6 in 2024-04-25T17:23:21.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:21 smithi037 ceph-mon[90844]: pgmap v76: 65 pgs: 12 active+undersized+degraded, 22 active+undersized, 31 active+clean; 208 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 28/228 objects degraded (12.281%) 2024-04-25T17:23:21.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:21 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:23:21.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:21 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:23:21.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:21 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:23:21.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:21 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:23:21.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:21 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:23:21.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:21 smithi037 ceph-mon[90844]: osdmap e59: 6 total, 6 up, 6 in 2024-04-25T17:23:22.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:23:22.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:23:22.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:23:22.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:23:22.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-25T17:23:22.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:22 smithi037 ceph-mon[90844]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-25T17:23:22.573 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:22 smithi037 ceph-mon[90844]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-04-25T17:23:22.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:23:22.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:23:22.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:23:22.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:23:22.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-25T17:23:22.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:22 smithi069 ceph-mon[80239]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-25T17:23:22.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:22 smithi069 ceph-mon[80239]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-04-25T17:23:23.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:23 smithi037 ceph-mon[90844]: pgmap v78: 65 pgs: 2 peering, 12 active+undersized+degraded, 20 active+undersized, 31 active+clean; 208 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 28/228 objects degraded (12.281%) 2024-04-25T17:23:23.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:23 smithi069 ceph-mon[80239]: pgmap v78: 65 pgs: 2 peering, 12 active+undersized+degraded, 20 active+undersized, 31 active+clean; 208 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s; 28/228 objects degraded (12.281%) 2024-04-25T17:23:23.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:23.923+0000 7fea3939a700 1 -- 172.21.15.37:0/3416164937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea34070810 msgr2=0x7fea34070c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:23:23.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:23.923+0000 7fea3939a700 1 --2- 172.21.15.37:0/3416164937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea34070810 0x7fea34070c80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fea28004940 tx=0x7fea28009e30 comp rx=0 tx=0).stop 2024-04-25T17:23:23.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:23.923+0000 7fea3939a700 1 -- 172.21.15.37:0/3416164937 shutdown_connections 2024-04-25T17:23:23.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:23.923+0000 7fea3939a700 1 --2- 172.21.15.37:0/3416164937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea34070810 0x7fea34070c80 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:23.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:23.923+0000 7fea3939a700 1 --2- 172.21.15.37:0/3416164937 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea34071dc0 0x7fea340702d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:23.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:23.923+0000 7fea3939a700 1 -- 172.21.15.37:0/3416164937 >> 172.21.15.37:0/3416164937 conn(0x7fea340f8560 msgr2=0x7fea340fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:23:23.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:23.923+0000 7fea3939a700 1 -- 172.21.15.37:0/3416164937 shutdown_connections 2024-04-25T17:23:23.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:23.923+0000 7fea3939a700 1 -- 172.21.15.37:0/3416164937 wait complete. 2024-04-25T17:23:23.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:23.924+0000 7fea3939a700 1 Processor -- start 2024-04-25T17:23:23.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:23.924+0000 7fea3939a700 1 -- start start 2024-04-25T17:23:23.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:23.924+0000 7fea3939a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea34070810 0x7fea3410fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:23:23.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:23.924+0000 7fea3939a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea34071dc0 0x7fea341101a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:23:23.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:23.924+0000 7fea3939a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea341107a0 con 0x7fea34070810 2024-04-25T17:23:23.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:23.924+0000 7fea3939a700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea34110fa0 con 0x7fea34071dc0 2024-04-25T17:23:23.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:23.924+0000 7fea32ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea34070810 0x7fea3410fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:23:23.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:23.924+0000 7fea32ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea34070810 0x7fea3410fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47710/0 (socket says 172.21.15.37:47710) 2024-04-25T17:23:23.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:23.924+0000 7fea32ffd700 1 -- 172.21.15.37:0/3921297669 learned_addr learned my addr 172.21.15.37:0/3921297669 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:23:23.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:23.924+0000 7fea327fc700 1 --2- 172.21.15.37:0/3921297669 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea34071dc0 0x7fea341101a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:23:23.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:23.925+0000 7fea32ffd700 1 -- 172.21.15.37:0/3921297669 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea34071dc0 msgr2=0x7fea341101a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:23:23.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:23.925+0000 7fea32ffd700 1 --2- 172.21.15.37:0/3921297669 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea34071dc0 0x7fea341101a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:23.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:23.925+0000 7fea32ffd700 1 -- 172.21.15.37:0/3921297669 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea28005040 con 0x7fea34070810 2024-04-25T17:23:23.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:23.925+0000 7fea32ffd700 1 --2- 172.21.15.37:0/3921297669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea34070810 0x7fea3410fc60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fea24002a80 tx=0x7fea24004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:23:23.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:23.925+0000 7fea1b7fe700 1 -- 172.21.15.37:0/3921297669 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea24007cc0 con 0x7fea34070810 2024-04-25T17:23:23.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:23.925+0000 7fea1b7fe700 1 -- 172.21.15.37:0/3921297669 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fea2400f040 con 0x7fea34070810 2024-04-25T17:23:23.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:23.925+0000 7fea3939a700 1 -- 172.21.15.37:0/3921297669 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea34111280 con 0x7fea34070810 2024-04-25T17:23:23.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:23.925+0000 7fea1b7fe700 1 -- 172.21.15.37:0/3921297669 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea2400da30 con 0x7fea34070810 2024-04-25T17:23:23.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:23.925+0000 7fea3939a700 1 -- 172.21.15.37:0/3921297669 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea341117c0 con 0x7fea34070810 2024-04-25T17:23:23.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:23.926+0000 7fea3939a700 1 -- 172.21.15.37:0/3921297669 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea3405f5c0 con 0x7fea34070810 2024-04-25T17:23:23.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:23.927+0000 7fea1b7fe700 1 -- 172.21.15.37:0/3921297669 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7fea2400db90 con 0x7fea34070810 2024-04-25T17:23:23.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:23.927+0000 7fea1b7fe700 1 --2- 172.21.15.37:0/3921297669 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fea1c076b80 0x7fea1c079030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:23:23.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:23.928+0000 7fea1b7fe700 1 -- 172.21.15.37:0/3921297669 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fea24097fa0 con 0x7fea34070810 2024-04-25T17:23:23.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:23.928+0000 7fea327fc700 1 --2- 172.21.15.37:0/3921297669 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fea1c076b80 0x7fea1c079030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:23:23.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:23.928+0000 7fea327fc700 1 --2- 172.21.15.37:0/3921297669 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fea1c076b80 0x7fea1c079030 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fea2800b3b0 tx=0x7fea28009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:23:23.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:23.933+0000 7fea1b7fe700 1 -- 172.21.15.37:0/3921297669 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fea24060ba0 con 0x7fea34070810 2024-04-25T17:23:24.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.165+0000 7fea3939a700 1 -- 172.21.15.37:0/3921297669 --> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fea34111ba0 con 0x7fea1c076b80 2024-04-25T17:23:24.166 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.166+0000 7fea1b7fe700 1 -- 172.21.15.37:0/3921297669 <== mgr.34104 v2:172.21.15.37:6800/783197737 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fea34111ba0 con 0x7fea1c076b80 2024-04-25T17:23:24.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.168+0000 7fea3939a700 1 -- 172.21.15.37:0/3921297669 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fea1c076b80 msgr2=0x7fea1c079030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:23:24.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.168+0000 7fea3939a700 1 --2- 172.21.15.37:0/3921297669 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fea1c076b80 0x7fea1c079030 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fea2800b3b0 tx=0x7fea28009e30 comp rx=0 tx=0).stop 2024-04-25T17:23:24.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.168+0000 7fea3939a700 1 -- 172.21.15.37:0/3921297669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea34070810 msgr2=0x7fea3410fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:23:24.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.168+0000 7fea3939a700 1 --2- 172.21.15.37:0/3921297669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea34070810 0x7fea3410fc60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fea24002a80 tx=0x7fea24004600 comp rx=0 tx=0).stop 2024-04-25T17:23:24.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.168+0000 7fea3939a700 1 -- 172.21.15.37:0/3921297669 shutdown_connections 2024-04-25T17:23:24.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.168+0000 7fea3939a700 1 --2- 172.21.15.37:0/3921297669 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fea1c076b80 0x7fea1c079030 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:24.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.168+0000 7fea3939a700 1 --2- 172.21.15.37:0/3921297669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fea34070810 0x7fea3410fc60 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:24.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.168+0000 7fea3939a700 1 --2- 172.21.15.37:0/3921297669 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea34071dc0 0x7fea341101a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:24.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.168+0000 7fea3939a700 1 -- 172.21.15.37:0/3921297669 >> 172.21.15.37:0/3921297669 conn(0x7fea340f8560 msgr2=0x7fea340f9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:23:24.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.168+0000 7fea3939a700 1 -- 172.21.15.37:0/3921297669 shutdown_connections 2024-04-25T17:23:24.169 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.168+0000 7fea3939a700 1 -- 172.21.15.37:0/3921297669 wait complete. 2024-04-25T17:23:24.179 INFO:teuthology.orchestra.run.smithi037.stdout:true 2024-04-25T17:23:24.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.273+0000 7f6372742700 1 -- 172.21.15.37:0/1604086618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f636c0fdfd0 msgr2=0x7f636c0fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:23:24.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.273+0000 7f6372742700 1 --2- 172.21.15.37:0/1604086618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f636c0fdfd0 0x7f636c0fe440 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6360004940 tx=0x7f6360009e30 comp rx=0 tx=0).stop 2024-04-25T17:23:24.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.274+0000 7f6372742700 1 -- 172.21.15.37:0/1604086618 shutdown_connections 2024-04-25T17:23:24.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.274+0000 7f6372742700 1 --2- 172.21.15.37:0/1604086618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f636c0fdfd0 0x7f636c0fe440 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:24.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.274+0000 7f6372742700 1 --2- 172.21.15.37:0/1604086618 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f636c0fce60 0x7f636c0fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:24.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.274+0000 7f6372742700 1 -- 172.21.15.37:0/1604086618 >> 172.21.15.37:0/1604086618 conn(0x7f636c0f8540 msgr2=0x7f636c0fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:23:24.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.274+0000 7f6372742700 1 -- 172.21.15.37:0/1604086618 shutdown_connections 2024-04-25T17:23:24.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.274+0000 7f6372742700 1 -- 172.21.15.37:0/1604086618 wait complete. 2024-04-25T17:23:24.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.274+0000 7f6372742700 1 Processor -- start 2024-04-25T17:23:24.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.274+0000 7f6372742700 1 -- start start 2024-04-25T17:23:24.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.274+0000 7f6372742700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f636c0fce60 0x7f636c10d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:23:24.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.274+0000 7f6372742700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f636c0fdfd0 0x7f636c10de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:23:24.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.274+0000 7f6372742700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f636c10e440 con 0x7f636c0fce60 2024-04-25T17:23:24.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.275+0000 7f6372742700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f636c10e5b0 con 0x7f636c0fdfd0 2024-04-25T17:23:24.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.275+0000 7f636bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f636c0fce60 0x7f636c10d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:23:24.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.275+0000 7f636bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f636c0fce60 0x7f636c10d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47736/0 (socket says 172.21.15.37:47736) 2024-04-25T17:23:24.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.275+0000 7f636bfff700 1 -- 172.21.15.37:0/1145454756 learned_addr learned my addr 172.21.15.37:0/1145454756 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:23:24.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.275+0000 7f636b7fe700 1 --2- 172.21.15.37:0/1145454756 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f636c0fdfd0 0x7f636c10de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:23:24.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.275+0000 7f636bfff700 1 -- 172.21.15.37:0/1145454756 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f636c0fdfd0 msgr2=0x7f636c10de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:23:24.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.275+0000 7f636bfff700 1 --2- 172.21.15.37:0/1145454756 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f636c0fdfd0 0x7f636c10de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:24.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.275+0000 7f636bfff700 1 -- 172.21.15.37:0/1145454756 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6360005040 con 0x7f636c0fce60 2024-04-25T17:23:24.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.275+0000 7f636bfff700 1 --2- 172.21.15.37:0/1145454756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f636c0fce60 0x7f636c10d900 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f635c002a50 tx=0x7f635c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:23:24.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.275+0000 7f6368ff9700 1 -- 172.21.15.37:0/1145454756 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f635c007cc0 con 0x7f636c0fce60 2024-04-25T17:23:24.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.275+0000 7f6372742700 1 -- 172.21.15.37:0/1145454756 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f636c112fb0 con 0x7f636c0fce60 2024-04-25T17:23:24.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.275+0000 7f6368ff9700 1 -- 172.21.15.37:0/1145454756 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f635c00f040 con 0x7f636c0fce60 2024-04-25T17:23:24.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.275+0000 7f6368ff9700 1 -- 172.21.15.37:0/1145454756 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f635c00db70 con 0x7f636c0fce60 2024-04-25T17:23:24.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.275+0000 7f6372742700 1 -- 172.21.15.37:0/1145454756 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f636c113540 con 0x7f636c0fce60 2024-04-25T17:23:24.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.276+0000 7f6372742700 1 -- 172.21.15.37:0/1145454756 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f636c04c710 con 0x7f636c0fce60 2024-04-25T17:23:24.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.278+0000 7f6368ff9700 1 -- 172.21.15.37:0/1145454756 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f635c00dcd0 con 0x7f636c0fce60 2024-04-25T17:23:24.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.278+0000 7f6368ff9700 1 --2- 172.21.15.37:0/1145454756 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f6354076b90 0x7f6354079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:23:24.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.278+0000 7f6368ff9700 1 -- 172.21.15.37:0/1145454756 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f635c097b80 con 0x7f636c0fce60 2024-04-25T17:23:24.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.278+0000 7f636b7fe700 1 --2- 172.21.15.37:0/1145454756 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f6354076b90 0x7f6354079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:23:24.279 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.279+0000 7f636b7fe700 1 --2- 172.21.15.37:0/1145454756 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f6354076b90 0x7f6354079040 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f636000b3b0 tx=0x7f6360009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:23:24.283 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.282+0000 7f6368ff9700 1 -- 172.21.15.37:0/1145454756 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f635c060780 con 0x7f636c0fce60 2024-04-25T17:23:24.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.513+0000 7f6372742700 1 -- 172.21.15.37:0/1145454756 --> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f636c1022f0 con 0x7f6354076b90 2024-04-25T17:23:24.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.514+0000 7f6368ff9700 1 -- 172.21.15.37:0/1145454756 <== mgr.34104 v2:172.21.15.37:6800/783197737 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f636c1022f0 con 0x7f6354076b90 2024-04-25T17:23:24.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.517+0000 7f6372742700 1 -- 172.21.15.37:0/1145454756 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f6354076b90 msgr2=0x7f6354079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:23:24.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.517+0000 7f6372742700 1 --2- 172.21.15.37:0/1145454756 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f6354076b90 0x7f6354079040 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f636000b3b0 tx=0x7f6360009e30 comp rx=0 tx=0).stop 2024-04-25T17:23:24.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.517+0000 7f6372742700 1 -- 172.21.15.37:0/1145454756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f636c0fce60 msgr2=0x7f636c10d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:23:24.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.517+0000 7f6372742700 1 --2- 172.21.15.37:0/1145454756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f636c0fce60 0x7f636c10d900 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f635c002a50 tx=0x7f635c0046b0 comp rx=0 tx=0).stop 2024-04-25T17:23:24.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.517+0000 7f6372742700 1 -- 172.21.15.37:0/1145454756 shutdown_connections 2024-04-25T17:23:24.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.517+0000 7f6372742700 1 --2- 172.21.15.37:0/1145454756 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f6354076b90 0x7f6354079040 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:24.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.517+0000 7f6372742700 1 --2- 172.21.15.37:0/1145454756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f636c0fce60 0x7f636c10d900 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:24.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.517+0000 7f6372742700 1 --2- 172.21.15.37:0/1145454756 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f636c0fdfd0 0x7f636c10de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:24.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.517+0000 7f6372742700 1 -- 172.21.15.37:0/1145454756 >> 172.21.15.37:0/1145454756 conn(0x7f636c0f8540 msgr2=0x7f636c0f9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:23:24.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.517+0000 7f6372742700 1 -- 172.21.15.37:0/1145454756 shutdown_connections 2024-04-25T17:23:24.519 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.517+0000 7f6372742700 1 -- 172.21.15.37:0/1145454756 wait complete. 2024-04-25T17:23:24.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.622+0000 7fb24b097700 1 -- 172.21.15.37:0/2865212511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb244066eb0 msgr2=0x7fb2440ffa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:23:24.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.622+0000 7fb24b097700 1 --2- 172.21.15.37:0/2865212511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb244066eb0 0x7fb2440ffa50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb238004940 tx=0x7fb238009e30 comp rx=0 tx=0).stop 2024-04-25T17:23:24.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.622+0000 7fb24b097700 1 -- 172.21.15.37:0/2865212511 shutdown_connections 2024-04-25T17:23:24.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.622+0000 7fb24b097700 1 --2- 172.21.15.37:0/2865212511 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb2440fff90 0x7fb244102370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:24.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.622+0000 7fb24b097700 1 --2- 172.21.15.37:0/2865212511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb244066eb0 0x7fb2440ffa50 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:24.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.622+0000 7fb24b097700 1 -- 172.21.15.37:0/2865212511 >> 172.21.15.37:0/2865212511 conn(0x7fb2440f7440 msgr2=0x7fb2440f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:23:24.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.622+0000 7fb24b097700 1 -- 172.21.15.37:0/2865212511 shutdown_connections 2024-04-25T17:23:24.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.622+0000 7fb24b097700 1 -- 172.21.15.37:0/2865212511 wait complete. 2024-04-25T17:23:24.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.623+0000 7fb24b097700 1 Processor -- start 2024-04-25T17:23:24.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.623+0000 7fb24b097700 1 -- start start 2024-04-25T17:23:24.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.623+0000 7fb24b097700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb244066eb0 0x7fb24410d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:23:24.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.623+0000 7fb24b097700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2440fff90 0x7fb24410df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:23:24.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.623+0000 7fb24b097700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb24410e510 con 0x7fb2440fff90 2024-04-25T17:23:24.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.623+0000 7fb24b097700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb24410e680 con 0x7fb244066eb0 2024-04-25T17:23:24.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.623+0000 7fb243fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2440fff90 0x7fb24410df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:23:24.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.623+0000 7fb243fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2440fff90 0x7fb24410df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47748/0 (socket says 172.21.15.37:47748) 2024-04-25T17:23:24.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.623+0000 7fb243fff700 1 -- 172.21.15.37:0/1906216206 learned_addr learned my addr 172.21.15.37:0/1906216206 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:23:24.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.623+0000 7fb248e33700 1 --2- 172.21.15.37:0/1906216206 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb244066eb0 0x7fb24410d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:23:24.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.624+0000 7fb243fff700 1 -- 172.21.15.37:0/1906216206 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb244066eb0 msgr2=0x7fb24410d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:23:24.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.624+0000 7fb243fff700 1 --2- 172.21.15.37:0/1906216206 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb244066eb0 0x7fb24410d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:24.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.624+0000 7fb243fff700 1 -- 172.21.15.37:0/1906216206 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb238005040 con 0x7fb2440fff90 2024-04-25T17:23:24.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.624+0000 7fb243fff700 1 --2- 172.21.15.37:0/1906216206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2440fff90 0x7fb24410df10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb23000c830 tx=0x7fb230004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:23:24.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.624+0000 7fb2417fa700 1 -- 172.21.15.37:0/1906216206 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2300106f0 con 0x7fb2440fff90 2024-04-25T17:23:24.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.624+0000 7fb24b097700 1 -- 172.21.15.37:0/1906216206 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2441130e0 con 0x7fb2440fff90 2024-04-25T17:23:24.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.624+0000 7fb2417fa700 1 -- 172.21.15.37:0/1906216206 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb230010d20 con 0x7fb2440fff90 2024-04-25T17:23:24.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.624+0000 7fb2417fa700 1 -- 172.21.15.37:0/1906216206 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2300113a0 con 0x7fb2440fff90 2024-04-25T17:23:24.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.624+0000 7fb24b097700 1 -- 172.21.15.37:0/1906216206 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2441136a0 con 0x7fb2440fff90 2024-04-25T17:23:24.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.625+0000 7fb24b097700 1 -- 172.21.15.37:0/1906216206 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb24404c710 con 0x7fb2440fff90 2024-04-25T17:23:24.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.626+0000 7fb2417fa700 1 -- 172.21.15.37:0/1906216206 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7fb230012400 con 0x7fb2440fff90 2024-04-25T17:23:24.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.626+0000 7fb2417fa700 1 --2- 172.21.15.37:0/1906216206 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fb234076b80 0x7fb234079030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:23:24.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.626+0000 7fb2417fa700 1 -- 172.21.15.37:0/1906216206 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fb230098260 con 0x7fb2440fff90 2024-04-25T17:23:24.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.626+0000 7fb248e33700 1 --2- 172.21.15.37:0/1906216206 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fb234076b80 0x7fb234079030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:23:24.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.627+0000 7fb248e33700 1 --2- 172.21.15.37:0/1906216206 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fb234076b80 0x7fb234079030 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb23800b020 tx=0x7fb238009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:23:24.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.631+0000 7fb2417fa700 1 -- 172.21.15.37:0/1906216206 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fb230060e60 con 0x7fb2440fff90 2024-04-25T17:23:24.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:24 smithi037 ceph-mon[90844]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 28/228 objects degraded (12.281%), 12 pgs degraded) 2024-04-25T17:23:24.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:24 smithi037 ceph-mon[90844]: Cluster is now healthy 2024-04-25T17:23:24.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.849+0000 7fb24b097700 1 -- 172.21.15.37:0/1906216206 --> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb2440f8f30 con 0x7fb234076b80 2024-04-25T17:23:24.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.859+0000 7fb2417fa700 1 -- 172.21.15.37:0/1906216206 <== mgr.34104 v2:172.21.15.37:6800/783197737 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fb2440f8f30 con 0x7fb234076b80 2024-04-25T17:23:24.860 INFO:teuthology.orchestra.run.smithi037.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-25T17:23:24.860 INFO:teuthology.orchestra.run.smithi037.stdout:alertmanager.smithi037 smithi037 *:9093,9094 running (4m) 8s ago 13m 24.9M - 0.25.0 c8568f914cd2 18aed8f409ee 2024-04-25T17:23:24.860 INFO:teuthology.orchestra.run.smithi037.stdout:crash.smithi037 smithi037 running (78s) 8s ago 13m 6660k - 19.0.0-3291-g994e2f20 d53c96779a29 639584ea5855 2024-04-25T17:23:24.860 INFO:teuthology.orchestra.run.smithi037.stdout:crash.smithi069 smithi069 running (72s) 69s ago 12m 6665k - 19.0.0-3291-g994e2f20 d53c96779a29 ee5db16733a7 2024-04-25T17:23:24.860 INFO:teuthology.orchestra.run.smithi037.stdout:grafana.smithi037 smithi037 *:3000 running (4m) 8s ago 12m 84.3M - 9.4.7 954c08fa6188 1eff3ea3f9b0 2024-04-25T17:23:24.860 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi037.ksmixc smithi037 running (7m) 8s ago 7m 150M - 17.2.7-902-gc61472c8 0de407c1b3af 394aa56079b4 2024-04-25T17:23:24.860 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi037.ovkrpq smithi037 running (7m) 8s ago 7m 102M - 17.2.7-902-gc61472c8 0de407c1b3af 73ca662174a7 2024-04-25T17:23:24.860 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi069.cpprst smithi069 running (7m) 69s ago 7m 15.5M - 17.2.7-902-gc61472c8 0de407c1b3af dbda101df20e 2024-04-25T17:23:24.860 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi069.ytlqcf smithi069 running (7m) 69s ago 7m 13.5M - 17.2.7-902-gc61472c8 0de407c1b3af 911df6b18215 2024-04-25T17:23:24.860 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.smithi037.txrgxl smithi037 *:8443,9283,8765 running (3m) 8s ago 14m 572M - 19.0.0-3291-g994e2f20 d53c96779a29 e9653fc62df9 2024-04-25T17:23:24.860 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.smithi069.mmuhdo smithi069 *:8443,9283,8765 running (2m) 69s ago 12m 518M - 19.0.0-3291-g994e2f20 d53c96779a29 6820207b4019 2024-04-25T17:23:24.860 INFO:teuthology.orchestra.run.smithi037.stdout:mon.smithi037 smithi037 running (2m) 8s ago 14m 111M 2048M 19.0.0-3291-g994e2f20 d53c96779a29 1b349f3af69d 2024-04-25T17:23:24.861 INFO:teuthology.orchestra.run.smithi037.stdout:mon.smithi069 smithi069 running (117s) 69s ago 12m 99.3M 2048M 19.0.0-3291-g994e2f20 d53c96779a29 7744dbe81b50 2024-04-25T17:23:24.861 INFO:teuthology.orchestra.run.smithi037.stdout:node-exporter.smithi037 smithi037 *:9100 running (4m) 8s ago 13m 14.2M - 1.5.0 0da6a335fe13 1e59bbb2aa82 2024-04-25T17:23:24.861 INFO:teuthology.orchestra.run.smithi037.stdout:node-exporter.smithi069 smithi069 *:9100 running (4m) 69s ago 12m 16.7M - 1.5.0 0da6a335fe13 0c51a9833fe4 2024-04-25T17:23:24.861 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0 smithi037 running (51s) 8s ago 11m 162M 1559M 19.0.0-3291-g994e2f20 d53c96779a29 e97538cb8b4f 2024-04-25T17:23:24.861 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1 smithi037 running (14s) 8s ago 10m 80.0M 1559M 19.0.0-3291-g994e2f20 d53c96779a29 6cf158192aae 2024-04-25T17:23:24.861 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2 smithi037 running (10m) 8s ago 10m 204M 1559M 17.2.7-902-gc61472c8 0de407c1b3af 2eedaf9886dd 2024-04-25T17:23:24.861 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3 smithi069 running (10m) 69s ago 10m 276M 2581M 17.2.7-902-gc61472c8 0de407c1b3af ebba78fb1923 2024-04-25T17:23:24.861 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4 smithi069 running (9m) 69s ago 9m 253M 2581M 17.2.7-902-gc61472c8 0de407c1b3af ba7b785c50f9 2024-04-25T17:23:24.861 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5 smithi069 running (9m) 69s ago 9m 228M 2581M 17.2.7-902-gc61472c8 0de407c1b3af f6be99c364ff 2024-04-25T17:23:24.862 INFO:teuthology.orchestra.run.smithi037.stdout:prometheus.smithi037 smithi037 *:9095 running (3m) 8s ago 12m 65.9M - 2.43.0 a07b618ecd1d 2c5a268ffc1f 2024-04-25T17:23:24.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.861+0000 7fb24b097700 1 -- 172.21.15.37:0/1906216206 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fb234076b80 msgr2=0x7fb234079030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:23:24.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.861+0000 7fb24b097700 1 --2- 172.21.15.37:0/1906216206 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fb234076b80 0x7fb234079030 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb23800b020 tx=0x7fb238009e30 comp rx=0 tx=0).stop 2024-04-25T17:23:24.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.861+0000 7fb24b097700 1 -- 172.21.15.37:0/1906216206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2440fff90 msgr2=0x7fb24410df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:23:24.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.861+0000 7fb24b097700 1 --2- 172.21.15.37:0/1906216206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2440fff90 0x7fb24410df10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb23000c830 tx=0x7fb230004470 comp rx=0 tx=0).stop 2024-04-25T17:23:24.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.861+0000 7fb24b097700 1 -- 172.21.15.37:0/1906216206 shutdown_connections 2024-04-25T17:23:24.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.861+0000 7fb24b097700 1 --2- 172.21.15.37:0/1906216206 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fb234076b80 0x7fb234079030 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:24.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.861+0000 7fb24b097700 1 --2- 172.21.15.37:0/1906216206 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb244066eb0 0x7fb24410d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:24.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.861+0000 7fb24b097700 1 --2- 172.21.15.37:0/1906216206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb2440fff90 0x7fb24410df10 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:24.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.861+0000 7fb24b097700 1 -- 172.21.15.37:0/1906216206 >> 172.21.15.37:0/1906216206 conn(0x7fb2440f7440 msgr2=0x7fb2440f7810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:23:24.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.861+0000 7fb24b097700 1 -- 172.21.15.37:0/1906216206 shutdown_connections 2024-04-25T17:23:24.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.861+0000 7fb24b097700 1 -- 172.21.15.37:0/1906216206 wait complete. 2024-04-25T17:23:24.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:24 smithi069 ceph-mon[80239]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 28/228 objects degraded (12.281%), 12 pgs degraded) 2024-04-25T17:23:24.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:24 smithi069 ceph-mon[80239]: Cluster is now healthy 2024-04-25T17:23:24.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.964+0000 7f391b26e700 1 -- 172.21.15.37:0/169141340 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39140fdff0 msgr2=0x7f39140fe460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:23:24.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.964+0000 7f391b26e700 1 --2- 172.21.15.37:0/169141340 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39140fdff0 0x7f39140fe460 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3910004940 tx=0x7f3910009e30 comp rx=0 tx=0).stop 2024-04-25T17:23:24.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.964+0000 7f391b26e700 1 -- 172.21.15.37:0/169141340 shutdown_connections 2024-04-25T17:23:24.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.964+0000 7f391b26e700 1 --2- 172.21.15.37:0/169141340 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39140fdff0 0x7f39140fe460 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:24.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.964+0000 7f391b26e700 1 --2- 172.21.15.37:0/169141340 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f39140fce80 0x7f39140fd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:24.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.964+0000 7f391b26e700 1 -- 172.21.15.37:0/169141340 >> 172.21.15.37:0/169141340 conn(0x7f39140f8580 msgr2=0x7f39140fa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:23:24.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.964+0000 7f391b26e700 1 -- 172.21.15.37:0/169141340 shutdown_connections 2024-04-25T17:23:24.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.964+0000 7f391b26e700 1 -- 172.21.15.37:0/169141340 wait complete. 2024-04-25T17:23:24.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.965+0000 7f391b26e700 1 Processor -- start 2024-04-25T17:23:24.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.965+0000 7f391b26e700 1 -- start start 2024-04-25T17:23:24.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.965+0000 7f391b26e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f39140fce80 0x7f3914071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:23:24.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.965+0000 7f391b26e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39140fdff0 0x7f39140702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:23:24.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.965+0000 7f391b26e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3914072200 con 0x7f39140fdff0 2024-04-25T17:23:24.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.965+0000 7f391b26e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39140707f0 con 0x7f39140fce80 2024-04-25T17:23:24.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.965+0000 7f3918809700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39140fdff0 0x7f39140702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:23:24.967 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.965+0000 7f3918809700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39140fdff0 0x7f39140702b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47780/0 (socket says 172.21.15.37:47780) 2024-04-25T17:23:24.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.965+0000 7f3918809700 1 -- 172.21.15.37:0/4094718239 learned_addr learned my addr 172.21.15.37:0/4094718239 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:23:24.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.965+0000 7f391900a700 1 --2- 172.21.15.37:0/4094718239 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f39140fce80 0x7f3914071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:23:24.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.965+0000 7f3918809700 1 -- 172.21.15.37:0/4094718239 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f39140fce80 msgr2=0x7f3914071c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:23:24.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.965+0000 7f3918809700 1 --2- 172.21.15.37:0/4094718239 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f39140fce80 0x7f3914071c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:24.968 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.965+0000 7f3918809700 1 -- 172.21.15.37:0/4094718239 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3910005040 con 0x7f39140fdff0 2024-04-25T17:23:24.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.966+0000 7f3918809700 1 --2- 172.21.15.37:0/4094718239 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39140fdff0 0x7f39140702b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f391000b3b0 tx=0x7f3910009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:23:24.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.966+0000 7f3909ffb700 1 -- 172.21.15.37:0/4094718239 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f391000e040 con 0x7f39140fdff0 2024-04-25T17:23:24.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.966+0000 7f3909ffb700 1 -- 172.21.15.37:0/4094718239 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f391000bcc0 con 0x7f39140fdff0 2024-04-25T17:23:24.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.966+0000 7f391b26e700 1 -- 172.21.15.37:0/4094718239 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3914070a40 con 0x7f39140fdff0 2024-04-25T17:23:24.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.966+0000 7f3909ffb700 1 -- 172.21.15.37:0/4094718239 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f391001c630 con 0x7f39140fdff0 2024-04-25T17:23:24.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.966+0000 7f391b26e700 1 -- 172.21.15.37:0/4094718239 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3914071000 con 0x7f39140fdff0 2024-04-25T17:23:24.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.967+0000 7f391b26e700 1 -- 172.21.15.37:0/4094718239 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f391404c710 con 0x7f39140fdff0 2024-04-25T17:23:24.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.968+0000 7f3909ffb700 1 -- 172.21.15.37:0/4094718239 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f3910013980 con 0x7f39140fdff0 2024-04-25T17:23:24.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.968+0000 7f3909ffb700 1 --2- 172.21.15.37:0/4094718239 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f3900076b90 0x7f3900079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:23:24.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.968+0000 7f3909ffb700 1 -- 172.21.15.37:0/4094718239 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f3910098ff0 con 0x7f39140fdff0 2024-04-25T17:23:24.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.968+0000 7f391900a700 1 --2- 172.21.15.37:0/4094718239 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f3900076b90 0x7f3900079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:23:24.970 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.969+0000 7f391900a700 1 --2- 172.21.15.37:0/4094718239 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f3900076b90 0x7f3900079040 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3904007fd0 tx=0x7f3904009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:23:24.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:24.973+0000 7f3909ffb700 1 -- 172.21.15.37:0/4094718239 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f3910061b70 con 0x7f39140fdff0 2024-04-25T17:23:25.272 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.271+0000 7f391b26e700 1 -- 172.21.15.37:0/4094718239 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f39141058e0 con 0x7f39140fdff0 2024-04-25T17:23:25.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.272+0000 7f3909ffb700 1 -- 172.21.15.37:0/4094718239 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7f3910061510 con 0x7f39140fdff0 2024-04-25T17:23:25.273 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-25T17:23:25.273 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": { 2024-04-25T17:23:25.273 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 2 2024-04-25T17:23:25.273 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:23:25.273 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": { 2024-04-25T17:23:25.273 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 2 2024-04-25T17:23:25.273 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:23:25.274 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": { 2024-04-25T17:23:25.274 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 4, 2024-04-25T17:23:25.274 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 2 2024-04-25T17:23:25.274 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:23:25.274 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": { 2024-04-25T17:23:25.274 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 4 2024-04-25T17:23:25.274 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:23:25.274 INFO:teuthology.orchestra.run.smithi037.stdout: "overall": { 2024-04-25T17:23:25.274 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 8, 2024-04-25T17:23:25.274 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 6 2024-04-25T17:23:25.274 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-04-25T17:23:25.275 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-25T17:23:25.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.274+0000 7f391b26e700 1 -- 172.21.15.37:0/4094718239 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f3900076b90 msgr2=0x7f3900079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:23:25.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.274+0000 7f391b26e700 1 --2- 172.21.15.37:0/4094718239 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f3900076b90 0x7f3900079040 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3904007fd0 tx=0x7f3904009040 comp rx=0 tx=0).stop 2024-04-25T17:23:25.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.274+0000 7f391b26e700 1 -- 172.21.15.37:0/4094718239 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39140fdff0 msgr2=0x7f39140702b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:23:25.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.274+0000 7f391b26e700 1 --2- 172.21.15.37:0/4094718239 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39140fdff0 0x7f39140702b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f391000b3b0 tx=0x7f3910009e30 comp rx=0 tx=0).stop 2024-04-25T17:23:25.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.274+0000 7f391b26e700 1 -- 172.21.15.37:0/4094718239 shutdown_connections 2024-04-25T17:23:25.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.274+0000 7f391b26e700 1 --2- 172.21.15.37:0/4094718239 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f3900076b90 0x7f3900079040 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:25.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.274+0000 7f391b26e700 1 --2- 172.21.15.37:0/4094718239 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f39140fce80 0x7f3914071c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:25.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.274+0000 7f391b26e700 1 --2- 172.21.15.37:0/4094718239 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39140fdff0 0x7f39140702b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:25.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.274+0000 7f391b26e700 1 -- 172.21.15.37:0/4094718239 >> 172.21.15.37:0/4094718239 conn(0x7f39140f8580 msgr2=0x7f39140f9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:23:25.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.274+0000 7f391b26e700 1 -- 172.21.15.37:0/4094718239 shutdown_connections 2024-04-25T17:23:25.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.274+0000 7f391b26e700 1 -- 172.21.15.37:0/4094718239 wait complete. 2024-04-25T17:23:25.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.379+0000 7fc38d84d700 1 -- 172.21.15.37:0/598085957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3880fed70 msgr2=0x7fc3880faeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:23:25.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.379+0000 7fc38d84d700 1 --2- 172.21.15.37:0/598085957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3880fed70 0x7fc3880faeb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc37c004940 tx=0x7fc37c009e30 comp rx=0 tx=0).stop 2024-04-25T17:23:25.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.379+0000 7fc38d84d700 1 -- 172.21.15.37:0/598085957 shutdown_connections 2024-04-25T17:23:25.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.379+0000 7fc38d84d700 1 --2- 172.21.15.37:0/598085957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3880fed70 0x7fc3880faeb0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:25.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.379+0000 7fc38d84d700 1 --2- 172.21.15.37:0/598085957 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3880fe420 0x7fc3880fe830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:25.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.379+0000 7fc38d84d700 1 -- 172.21.15.37:0/598085957 >> 172.21.15.37:0/598085957 conn(0x7fc3880f6be0 msgr2=0x7fc3880f8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:23:25.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.380+0000 7fc38d84d700 1 -- 172.21.15.37:0/598085957 shutdown_connections 2024-04-25T17:23:25.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.380+0000 7fc38d84d700 1 -- 172.21.15.37:0/598085957 wait complete. 2024-04-25T17:23:25.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.380+0000 7fc38d84d700 1 Processor -- start 2024-04-25T17:23:25.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.380+0000 7fc38d84d700 1 -- start start 2024-04-25T17:23:25.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.380+0000 7fc38d84d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3880fe420 0x7fc38810d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:23:25.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.380+0000 7fc38d84d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3880fed70 0x7fc38810ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:23:25.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.381+0000 7fc38d84d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc38810e3b0 con 0x7fc3880fe420 2024-04-25T17:23:25.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.381+0000 7fc38d84d700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc38810e520 con 0x7fc3880fed70 2024-04-25T17:23:25.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.381+0000 7fc386ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3880fe420 0x7fc38810d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:23:25.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.381+0000 7fc386ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3880fe420 0x7fc38810d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47790/0 (socket says 172.21.15.37:47790) 2024-04-25T17:23:25.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.381+0000 7fc386ffd700 1 -- 172.21.15.37:0/3089932387 learned_addr learned my addr 172.21.15.37:0/3089932387 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:23:25.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.381+0000 7fc3867fc700 1 --2- 172.21.15.37:0/3089932387 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3880fed70 0x7fc38810ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:23:25.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.381+0000 7fc386ffd700 1 -- 172.21.15.37:0/3089932387 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3880fed70 msgr2=0x7fc38810ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:23:25.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.381+0000 7fc386ffd700 1 --2- 172.21.15.37:0/3089932387 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3880fed70 0x7fc38810ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:25.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.381+0000 7fc386ffd700 1 -- 172.21.15.37:0/3089932387 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc37c005040 con 0x7fc3880fe420 2024-04-25T17:23:25.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.381+0000 7fc386ffd700 1 --2- 172.21.15.37:0/3089932387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3880fe420 0x7fc38810d870 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc37800eb40 tx=0x7fc37800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:23:25.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.381+0000 7fc36f7fe700 1 -- 172.21.15.37:0/3089932387 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc378007cc0 con 0x7fc3880fe420 2024-04-25T17:23:25.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.381+0000 7fc38d84d700 1 -- 172.21.15.37:0/3089932387 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc388112f20 con 0x7fc3880fe420 2024-04-25T17:23:25.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.381+0000 7fc36f7fe700 1 -- 172.21.15.37:0/3089932387 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc37800f040 con 0x7fc3880fe420 2024-04-25T17:23:25.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.381+0000 7fc36f7fe700 1 -- 172.21.15.37:0/3089932387 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc37800ca10 con 0x7fc3880fe420 2024-04-25T17:23:25.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.381+0000 7fc38d84d700 1 -- 172.21.15.37:0/3089932387 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3881133d0 con 0x7fc3880fe420 2024-04-25T17:23:25.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.382+0000 7fc38d84d700 1 -- 172.21.15.37:0/3089932387 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc38804c710 con 0x7fc3880fe420 2024-04-25T17:23:25.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.383+0000 7fc36f7fe700 1 -- 172.21.15.37:0/3089932387 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7fc37800cc80 con 0x7fc3880fe420 2024-04-25T17:23:25.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.383+0000 7fc36f7fe700 1 --2- 172.21.15.37:0/3089932387 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fc370076b80 0x7fc370079030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:23:25.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.384+0000 7fc36f7fe700 1 -- 172.21.15.37:0/3089932387 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fc378097e70 con 0x7fc3880fe420 2024-04-25T17:23:25.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.384+0000 7fc3867fc700 1 --2- 172.21.15.37:0/3089932387 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fc370076b80 0x7fc370079030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:23:25.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.384+0000 7fc3867fc700 1 --2- 172.21.15.37:0/3089932387 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fc370076b80 0x7fc370079030 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc37c00b0d0 tx=0x7fc37c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:23:25.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.389+0000 7fc36f7fe700 1 -- 172.21.15.37:0/3089932387 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fc378060aa0 con 0x7fc3880fe420 2024-04-25T17:23:25.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.648+0000 7fc38d84d700 1 -- 172.21.15.37:0/3089932387 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc3881139b0 con 0x7fc3880fe420 2024-04-25T17:23:25.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.648+0000 7fc36f7fe700 1 -- 172.21.15.37:0/3089932387 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1900 (secure 0 0 0) 0x7fc378060440 con 0x7fc3880fe420 2024-04-25T17:23:25.649 INFO:teuthology.orchestra.run.smithi037.stdout:e16 2024-04-25T17:23:25.649 INFO:teuthology.orchestra.run.smithi037.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-25T17:23:25.650 INFO:teuthology.orchestra.run.smithi037.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T17:23:25.650 INFO:teuthology.orchestra.run.smithi037.stdout:legacy client fscid: 1 2024-04-25T17:23:25.650 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:23:25.650 INFO:teuthology.orchestra.run.smithi037.stdout:Filesystem 'cephfs' (1) 2024-04-25T17:23:25.650 INFO:teuthology.orchestra.run.smithi037.stdout:fs_name cephfs 2024-04-25T17:23:25.650 INFO:teuthology.orchestra.run.smithi037.stdout:epoch 16 2024-04-25T17:23:25.650 INFO:teuthology.orchestra.run.smithi037.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-25T17:23:25.650 INFO:teuthology.orchestra.run.smithi037.stdout:created 2024-04-25T17:15:40.586130+0000 2024-04-25T17:23:25.650 INFO:teuthology.orchestra.run.smithi037.stdout:modified 2024-04-25T17:15:57.508740+0000 2024-04-25T17:23:25.650 INFO:teuthology.orchestra.run.smithi037.stdout:tableserver 0 2024-04-25T17:23:25.650 INFO:teuthology.orchestra.run.smithi037.stdout:root 0 2024-04-25T17:23:25.650 INFO:teuthology.orchestra.run.smithi037.stdout:session_timeout 60 2024-04-25T17:23:25.651 INFO:teuthology.orchestra.run.smithi037.stdout:session_autoclose 300 2024-04-25T17:23:25.651 INFO:teuthology.orchestra.run.smithi037.stdout:max_file_size 1099511627776 2024-04-25T17:23:25.651 INFO:teuthology.orchestra.run.smithi037.stdout:max_xattr_size 65536 2024-04-25T17:23:25.651 INFO:teuthology.orchestra.run.smithi037.stdout:required_client_features {} 2024-04-25T17:23:25.651 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure 0 2024-04-25T17:23:25.651 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure_osd_epoch 0 2024-04-25T17:23:25.651 INFO:teuthology.orchestra.run.smithi037.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T17:23:25.651 INFO:teuthology.orchestra.run.smithi037.stdout:max_mds 1 2024-04-25T17:23:25.651 INFO:teuthology.orchestra.run.smithi037.stdout:in 0 2024-04-25T17:23:25.651 INFO:teuthology.orchestra.run.smithi037.stdout:up {0=14470} 2024-04-25T17:23:25.651 INFO:teuthology.orchestra.run.smithi037.stdout:failed 2024-04-25T17:23:25.651 INFO:teuthology.orchestra.run.smithi037.stdout:damaged 2024-04-25T17:23:25.651 INFO:teuthology.orchestra.run.smithi037.stdout:stopped 2024-04-25T17:23:25.652 INFO:teuthology.orchestra.run.smithi037.stdout:data_pools [3] 2024-04-25T17:23:25.652 INFO:teuthology.orchestra.run.smithi037.stdout:metadata_pool 2 2024-04-25T17:23:25.652 INFO:teuthology.orchestra.run.smithi037.stdout:inline_data disabled 2024-04-25T17:23:25.652 INFO:teuthology.orchestra.run.smithi037.stdout:balancer 2024-04-25T17:23:25.652 INFO:teuthology.orchestra.run.smithi037.stdout:bal_rank_mask -1 2024-04-25T17:23:25.652 INFO:teuthology.orchestra.run.smithi037.stdout:standby_count_wanted 1 2024-04-25T17:23:25.652 INFO:teuthology.orchestra.run.smithi037.stdout:qdb_cluster leader: 0 members: 2024-04-25T17:23:25.652 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi037.ksmixc{0:14470} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.37:6826/1903989494,v1:172.21.15.37:6827/1903989494] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:23:25.652 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi037.ovkrpq{0:14482} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.37:6828/4206394422,v1:172.21.15.37:6829/4206394422] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:23:25.652 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:23:25.652 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:23:25.652 INFO:teuthology.orchestra.run.smithi037.stdout:Standby daemons: 2024-04-25T17:23:25.653 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:23:25.653 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi069.cpprst{-1:24289} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.69:6826/518856100,v1:172.21.15.69:6827/518856100] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:23:25.653 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi069.ytlqcf{-1:24293} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.69:6824/134210439,v1:172.21.15.69:6825/134210439] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:23:25.653 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.651+0000 7fc38d84d700 1 -- 172.21.15.37:0/3089932387 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fc370076b80 msgr2=0x7fc370079030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:23:25.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.651+0000 7fc38d84d700 1 --2- 172.21.15.37:0/3089932387 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fc370076b80 0x7fc370079030 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc37c00b0d0 tx=0x7fc37c009e30 comp rx=0 tx=0).stop 2024-04-25T17:23:25.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.652+0000 7fc38d84d700 1 -- 172.21.15.37:0/3089932387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3880fe420 msgr2=0x7fc38810d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:23:25.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.652+0000 7fc38d84d700 1 --2- 172.21.15.37:0/3089932387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3880fe420 0x7fc38810d870 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc37800eb40 tx=0x7fc37800b040 comp rx=0 tx=0).stop 2024-04-25T17:23:25.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.652+0000 7fc38d84d700 1 -- 172.21.15.37:0/3089932387 shutdown_connections 2024-04-25T17:23:25.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.652+0000 7fc38d84d700 1 --2- 172.21.15.37:0/3089932387 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fc370076b80 0x7fc370079030 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:25.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.652+0000 7fc38d84d700 1 --2- 172.21.15.37:0/3089932387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3880fe420 0x7fc38810d870 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:25.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.652+0000 7fc38d84d700 1 --2- 172.21.15.37:0/3089932387 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3880fed70 0x7fc38810ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:25.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.652+0000 7fc38d84d700 1 -- 172.21.15.37:0/3089932387 >> 172.21.15.37:0/3089932387 conn(0x7fc3880f6be0 msgr2=0x7fc3880f8200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:23:25.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.652+0000 7fc38d84d700 1 -- 172.21.15.37:0/3089932387 shutdown_connections 2024-04-25T17:23:25.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.652+0000 7fc38d84d700 1 -- 172.21.15.37:0/3089932387 wait complete. 2024-04-25T17:23:25.654 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 16 2024-04-25T17:23:25.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.757+0000 7fd40d0fd700 1 -- 172.21.15.37:0/663604840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4080fdfd0 msgr2=0x7fd4080fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:23:25.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.757+0000 7fd40d0fd700 1 --2- 172.21.15.37:0/663604840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4080fdfd0 0x7fd4080fe440 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc004940 tx=0x7fd3fc009e30 comp rx=0 tx=0).stop 2024-04-25T17:23:25.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.757+0000 7fd40d0fd700 1 -- 172.21.15.37:0/663604840 shutdown_connections 2024-04-25T17:23:25.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.757+0000 7fd40d0fd700 1 --2- 172.21.15.37:0/663604840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4080fdfd0 0x7fd4080fe440 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:25.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.757+0000 7fd40d0fd700 1 --2- 172.21.15.37:0/663604840 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd4080fce60 0x7fd4080fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:25.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.757+0000 7fd40d0fd700 1 -- 172.21.15.37:0/663604840 >> 172.21.15.37:0/663604840 conn(0x7fd4080f8540 msgr2=0x7fd4080fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:23:25.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.758+0000 7fd40d0fd700 1 -- 172.21.15.37:0/663604840 shutdown_connections 2024-04-25T17:23:25.759 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.758+0000 7fd40d0fd700 1 -- 172.21.15.37:0/663604840 wait complete. 2024-04-25T17:23:25.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.758+0000 7fd40d0fd700 1 Processor -- start 2024-04-25T17:23:25.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.758+0000 7fd40d0fd700 1 -- start start 2024-04-25T17:23:25.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.758+0000 7fd40d0fd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd4080fce60 0x7fd40810d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:23:25.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.758+0000 7fd40d0fd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4080fdfd0 0x7fd40810de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:23:25.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.758+0000 7fd40d0fd700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd40810e450 con 0x7fd4080fdfd0 2024-04-25T17:23:25.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.758+0000 7fd40d0fd700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd40810e5c0 con 0x7fd4080fce60 2024-04-25T17:23:25.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.759+0000 7fd40659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4080fdfd0 0x7fd40810de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:23:25.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.759+0000 7fd40659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4080fdfd0 0x7fd40810de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47812/0 (socket says 172.21.15.37:47812) 2024-04-25T17:23:25.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.759+0000 7fd40659c700 1 -- 172.21.15.37:0/2920382269 learned_addr learned my addr 172.21.15.37:0/2920382269 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:23:25.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.759+0000 7fd406d9d700 1 --2- 172.21.15.37:0/2920382269 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd4080fce60 0x7fd40810d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:23:25.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.759+0000 7fd40659c700 1 -- 172.21.15.37:0/2920382269 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd4080fce60 msgr2=0x7fd40810d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:23:25.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.759+0000 7fd40659c700 1 --2- 172.21.15.37:0/2920382269 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd4080fce60 0x7fd40810d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:25.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.759+0000 7fd40659c700 1 -- 172.21.15.37:0/2920382269 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3fc005040 con 0x7fd4080fdfd0 2024-04-25T17:23:25.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.759+0000 7fd40659c700 1 --2- 172.21.15.37:0/2920382269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4080fdfd0 0x7fd40810de50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc009150 tx=0x7fd3fc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:23:25.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.759+0000 7fd3ef7fe700 1 -- 172.21.15.37:0/2920382269 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3fc00e040 con 0x7fd4080fdfd0 2024-04-25T17:23:25.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.759+0000 7fd40d0fd700 1 -- 172.21.15.37:0/2920382269 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd408112fc0 con 0x7fd4080fdfd0 2024-04-25T17:23:25.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.759+0000 7fd3ef7fe700 1 -- 172.21.15.37:0/2920382269 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd3fc004290 con 0x7fd4080fdfd0 2024-04-25T17:23:25.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.759+0000 7fd3ef7fe700 1 -- 172.21.15.37:0/2920382269 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3fc01c630 con 0x7fd4080fdfd0 2024-04-25T17:23:25.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.759+0000 7fd40d0fd700 1 -- 172.21.15.37:0/2920382269 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd408113550 con 0x7fd4080fdfd0 2024-04-25T17:23:25.762 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.760+0000 7fd40d0fd700 1 -- 172.21.15.37:0/2920382269 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd40804c710 con 0x7fd4080fdfd0 2024-04-25T17:23:25.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.761+0000 7fd3ef7fe700 1 -- 172.21.15.37:0/2920382269 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7fd3fc00bbf0 con 0x7fd4080fdfd0 2024-04-25T17:23:25.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.761+0000 7fd3ef7fe700 1 --2- 172.21.15.37:0/2920382269 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fd3f0076b90 0x7fd3f0079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:23:25.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.762+0000 7fd406d9d700 1 --2- 172.21.15.37:0/2920382269 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fd3f0076b90 0x7fd3f0079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:23:25.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.762+0000 7fd3ef7fe700 1 -- 172.21.15.37:0/2920382269 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fd3fc098f20 con 0x7fd4080fdfd0 2024-04-25T17:23:25.763 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.762+0000 7fd406d9d700 1 --2- 172.21.15.37:0/2920382269 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fd3f0076b90 0x7fd3f0079040 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd3f8004f40 tx=0x7fd3f800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:23:25.767 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.766+0000 7fd3ef7fe700 1 -- 172.21.15.37:0/2920382269 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fd3fc061a80 con 0x7fd4080fdfd0 2024-04-25T17:23:25.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:25 smithi069 ceph-mon[80239]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:23:25.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:25 smithi069 ceph-mon[80239]: pgmap v79: 65 pgs: 2 peering, 63 active+clean; 208 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 0 op/s 2024-04-25T17:23:25.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:25 smithi069 ceph-mon[80239]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:23:25.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:25 smithi069 ceph-mon[80239]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:23:25.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:25 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/4094718239' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:23:25.993 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.992+0000 7fd40d0fd700 1 -- 172.21.15.37:0/2920382269 --> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd408102390 con 0x7fd3f0076b90 2024-04-25T17:23:25.993 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:25 smithi037 ceph-mon[90844]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:23:25.993 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:25 smithi037 ceph-mon[90844]: pgmap v79: 65 pgs: 2 peering, 63 active+clean; 208 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 0 op/s 2024-04-25T17:23:25.994 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:25 smithi037 ceph-mon[90844]: from='client.34256 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:23:25.994 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:25 smithi037 ceph-mon[90844]: from='client.34260 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:23:25.994 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:25 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/4094718239' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:23:25.994 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.994+0000 7fd3ef7fe700 1 -- 172.21.15.37:0/2920382269 <== mgr.34104 v2:172.21.15.37:6800/783197737 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fd408102390 con 0x7fd3f0076b90 2024-04-25T17:23:25.995 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-25T17:23:25.995 INFO:teuthology.orchestra.run.smithi037.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385", 2024-04-25T17:23:25.995 INFO:teuthology.orchestra.run.smithi037.stdout: "in_progress": true, 2024-04-25T17:23:25.995 INFO:teuthology.orchestra.run.smithi037.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-25T17:23:25.995 INFO:teuthology.orchestra.run.smithi037.stdout: "services_complete": [ 2024-04-25T17:23:25.995 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr", 2024-04-25T17:23:25.995 INFO:teuthology.orchestra.run.smithi037.stdout: "crash", 2024-04-25T17:23:25.995 INFO:teuthology.orchestra.run.smithi037.stdout: "mon" 2024-04-25T17:23:25.995 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-04-25T17:23:25.995 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": "8/21 daemons upgraded", 2024-04-25T17:23:25.995 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "Currently upgrading osd daemons", 2024-04-25T17:23:25.995 INFO:teuthology.orchestra.run.smithi037.stdout: "is_paused": false 2024-04-25T17:23:25.995 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-25T17:23:25.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.996+0000 7fd40d0fd700 1 -- 172.21.15.37:0/2920382269 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fd3f0076b90 msgr2=0x7fd3f0079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:23:25.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.996+0000 7fd40d0fd700 1 --2- 172.21.15.37:0/2920382269 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fd3f0076b90 0x7fd3f0079040 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd3f8004f40 tx=0x7fd3f800b040 comp rx=0 tx=0).stop 2024-04-25T17:23:25.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.996+0000 7fd40d0fd700 1 -- 172.21.15.37:0/2920382269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4080fdfd0 msgr2=0x7fd40810de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:23:25.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.996+0000 7fd40d0fd700 1 --2- 172.21.15.37:0/2920382269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4080fdfd0 0x7fd40810de50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc009150 tx=0x7fd3fc009e30 comp rx=0 tx=0).stop 2024-04-25T17:23:25.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.996+0000 7fd40d0fd700 1 -- 172.21.15.37:0/2920382269 shutdown_connections 2024-04-25T17:23:25.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.996+0000 7fd40d0fd700 1 --2- 172.21.15.37:0/2920382269 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fd3f0076b90 0x7fd3f0079040 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:25.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.996+0000 7fd40d0fd700 1 --2- 172.21.15.37:0/2920382269 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd4080fce60 0x7fd40810d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:25.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.996+0000 7fd40d0fd700 1 --2- 172.21.15.37:0/2920382269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd4080fdfd0 0x7fd40810de50 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:25.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.996+0000 7fd40d0fd700 1 -- 172.21.15.37:0/2920382269 >> 172.21.15.37:0/2920382269 conn(0x7fd4080f8540 msgr2=0x7fd4080f9be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:23:25.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.997+0000 7fd40d0fd700 1 -- 172.21.15.37:0/2920382269 shutdown_connections 2024-04-25T17:23:25.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:25.997+0000 7fd40d0fd700 1 -- 172.21.15.37:0/2920382269 wait complete. 2024-04-25T17:23:26.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:26.101+0000 7fdd45935700 1 -- 172.21.15.37:0/1546483096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd400fe4e0 msgr2=0x7fdd400fe8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:23:26.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:26.101+0000 7fdd45935700 1 --2- 172.21.15.37:0/1546483096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd400fe4e0 0x7fdd400fe8f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdd30004940 tx=0x7fdd30009e30 comp rx=0 tx=0).stop 2024-04-25T17:23:26.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:26.102+0000 7fdd45935700 1 -- 172.21.15.37:0/1546483096 shutdown_connections 2024-04-25T17:23:26.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:26.102+0000 7fdd45935700 1 --2- 172.21.15.37:0/1546483096 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdd400fee30 0x7fdd400faf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:26.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:26.102+0000 7fdd45935700 1 --2- 172.21.15.37:0/1546483096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd400fe4e0 0x7fdd400fe8f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:26.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:26.102+0000 7fdd45935700 1 -- 172.21.15.37:0/1546483096 >> 172.21.15.37:0/1546483096 conn(0x7fdd400f6be0 msgr2=0x7fdd400f8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:23:26.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:26.102+0000 7fdd45935700 1 -- 172.21.15.37:0/1546483096 shutdown_connections 2024-04-25T17:23:26.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:26.102+0000 7fdd45935700 1 -- 172.21.15.37:0/1546483096 wait complete. 2024-04-25T17:23:26.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:26.102+0000 7fdd45935700 1 Processor -- start 2024-04-25T17:23:26.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:26.102+0000 7fdd45935700 1 -- start start 2024-04-25T17:23:26.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:26.103+0000 7fdd45935700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd400fe4e0 0x7fdd4010d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:23:26.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:26.103+0000 7fdd45935700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdd400fee30 0x7fdd4010de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:23:26.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:26.103+0000 7fdd45935700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4010e480 con 0x7fdd400fe4e0 2024-04-25T17:23:26.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:26.103+0000 7fdd45935700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4010e5f0 con 0x7fdd400fee30 2024-04-25T17:23:26.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:26.103+0000 7fdd3effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd400fe4e0 0x7fdd4010d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:23:26.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:26.103+0000 7fdd3effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd400fe4e0 0x7fdd4010d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47834/0 (socket says 172.21.15.37:47834) 2024-04-25T17:23:26.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:26.103+0000 7fdd3effd700 1 -- 172.21.15.37:0/572620458 learned_addr learned my addr 172.21.15.37:0/572620458 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:23:26.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:26.103+0000 7fdd3e7fc700 1 --2- 172.21.15.37:0/572620458 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdd400fee30 0x7fdd4010de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:23:26.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:26.103+0000 7fdd3effd700 1 -- 172.21.15.37:0/572620458 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdd400fee30 msgr2=0x7fdd4010de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:23:26.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:26.103+0000 7fdd3effd700 1 --2- 172.21.15.37:0/572620458 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdd400fee30 0x7fdd4010de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:26.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:26.103+0000 7fdd3effd700 1 -- 172.21.15.37:0/572620458 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd30005040 con 0x7fdd400fe4e0 2024-04-25T17:23:26.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:26.103+0000 7fdd3effd700 1 --2- 172.21.15.37:0/572620458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd400fe4e0 0x7fdd4010d940 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdd3000b3b0 tx=0x7fdd30009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:23:26.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:26.103+0000 7fdd277fe700 1 -- 172.21.15.37:0/572620458 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd3000e040 con 0x7fdd400fe4e0 2024-04-25T17:23:26.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:26.104+0000 7fdd277fe700 1 -- 172.21.15.37:0/572620458 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdd3000bbf0 con 0x7fdd400fe4e0 2024-04-25T17:23:26.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:26.104+0000 7fdd45935700 1 -- 172.21.15.37:0/572620458 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd40112ff0 con 0x7fdd400fe4e0 2024-04-25T17:23:26.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:26.104+0000 7fdd277fe700 1 -- 172.21.15.37:0/572620458 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd3001c630 con 0x7fdd400fe4e0 2024-04-25T17:23:26.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:26.104+0000 7fdd45935700 1 -- 172.21.15.37:0/572620458 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd40113520 con 0x7fdd400fe4e0 2024-04-25T17:23:26.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:26.104+0000 7fdd45935700 1 -- 172.21.15.37:0/572620458 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd4004c710 con 0x7fdd400fe4e0 2024-04-25T17:23:26.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:26.105+0000 7fdd277fe700 1 -- 172.21.15.37:0/572620458 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7fdd3000bd60 con 0x7fdd400fe4e0 2024-04-25T17:23:26.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:26.106+0000 7fdd277fe700 1 --2- 172.21.15.37:0/572620458 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fdd28076b90 0x7fdd28079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:23:26.108 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:26.106+0000 7fdd277fe700 1 -- 172.21.15.37:0/572620458 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fdd30098db0 con 0x7fdd400fe4e0 2024-04-25T17:23:26.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:26.106+0000 7fdd3e7fc700 1 --2- 172.21.15.37:0/572620458 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fdd28076b90 0x7fdd28079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:23:26.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:26.106+0000 7fdd3e7fc700 1 --2- 172.21.15.37:0/572620458 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fdd28076b90 0x7fdd28079040 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdd34004f40 tx=0x7fdd3400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:23:26.111 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:26.111+0000 7fdd277fe700 1 -- 172.21.15.37:0/572620458 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fdd30061a50 con 0x7fdd400fe4e0 2024-04-25T17:23:26.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:26.410+0000 7fdd45935700 1 -- 172.21.15.37:0/572620458 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fdd401058f0 con 0x7fdd400fe4e0 2024-04-25T17:23:26.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:26.410+0000 7fdd277fe700 1 -- 172.21.15.37:0/572620458 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fdd300613f0 con 0x7fdd400fe4e0 2024-04-25T17:23:26.411 INFO:teuthology.orchestra.run.smithi037.stdout:HEALTH_OK 2024-04-25T17:23:26.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:26.412+0000 7fdd45935700 1 -- 172.21.15.37:0/572620458 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fdd28076b90 msgr2=0x7fdd28079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:23:26.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:26.412+0000 7fdd45935700 1 --2- 172.21.15.37:0/572620458 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fdd28076b90 0x7fdd28079040 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdd34004f40 tx=0x7fdd3400b040 comp rx=0 tx=0).stop 2024-04-25T17:23:26.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:26.412+0000 7fdd45935700 1 -- 172.21.15.37:0/572620458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd400fe4e0 msgr2=0x7fdd4010d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:23:26.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:26.412+0000 7fdd45935700 1 --2- 172.21.15.37:0/572620458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd400fe4e0 0x7fdd4010d940 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdd3000b3b0 tx=0x7fdd30009e30 comp rx=0 tx=0).stop 2024-04-25T17:23:26.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:26.412+0000 7fdd45935700 1 -- 172.21.15.37:0/572620458 shutdown_connections 2024-04-25T17:23:26.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:26.412+0000 7fdd45935700 1 --2- 172.21.15.37:0/572620458 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fdd28076b90 0x7fdd28079040 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:26.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:26.412+0000 7fdd45935700 1 --2- 172.21.15.37:0/572620458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd400fe4e0 0x7fdd4010d940 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:26.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:26.412+0000 7fdd45935700 1 --2- 172.21.15.37:0/572620458 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdd400fee30 0x7fdd4010de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:26.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:26.412+0000 7fdd45935700 1 -- 172.21.15.37:0/572620458 >> 172.21.15.37:0/572620458 conn(0x7fdd400f6be0 msgr2=0x7fdd400f8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:23:26.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:26.412+0000 7fdd45935700 1 -- 172.21.15.37:0/572620458 shutdown_connections 2024-04-25T17:23:26.413 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:26.412+0000 7fdd45935700 1 -- 172.21.15.37:0/572620458 wait complete. 2024-04-25T17:23:26.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:26 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/3089932387' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T17:23:26.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:26 smithi037 ceph-mon[90844]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:23:26.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:26 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/572620458' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T17:23:26.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:26 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/3089932387' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T17:23:26.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:26 smithi069 ceph-mon[80239]: from='client.34272 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:23:26.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:26 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/572620458' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T17:23:27.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:27 smithi069 ceph-mon[80239]: pgmap v80: 65 pgs: 65 active+clean; 208 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:23:27.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:27 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:23:28.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:27 smithi037 ceph-mon[90844]: pgmap v80: 65 pgs: 65 active+clean; 208 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail 2024-04-25T17:23:28.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:27 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:23:28.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:28 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:23:28.973 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:28 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:23:29.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:29 smithi069 ceph-mon[80239]: pgmap v81: 65 pgs: 65 active+clean; 208 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-04-25T17:23:30.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:29 smithi037 ceph-mon[90844]: pgmap v81: 65 pgs: 65 active+clean; 208 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-04-25T17:23:31.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:31 smithi069 ceph-mon[80239]: pgmap v82: 65 pgs: 65 active+clean; 208 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 0 op/s 2024-04-25T17:23:32.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:31 smithi037 ceph-mon[90844]: pgmap v82: 65 pgs: 65 active+clean; 208 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 0 op/s 2024-04-25T17:23:33.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:33 smithi037 ceph-mon[90844]: pgmap v83: 65 pgs: 65 active+clean; 208 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 911 B/s rd, 0 op/s 2024-04-25T17:23:33.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:33 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:23:33.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:33 smithi069 ceph-mon[80239]: pgmap v83: 65 pgs: 65 active+clean; 208 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 911 B/s rd, 0 op/s 2024-04-25T17:23:33.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:33 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:23:35.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:35 smithi069 ceph-mon[80239]: pgmap v84: 65 pgs: 65 active+clean; 208 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-25T17:23:36.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:35 smithi037 ceph-mon[90844]: pgmap v84: 65 pgs: 65 active+clean; 208 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-25T17:23:36.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:36 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-25T17:23:36.967 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:36 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-25T17:23:37.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:37 smithi069 ceph-mon[80239]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-25T17:23:37.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:37 smithi069 ceph-mon[80239]: Upgrade: osd.2 is safe to restart 2024-04-25T17:23:37.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:37 smithi069 ceph-mon[80239]: pgmap v85: 65 pgs: 65 active+clean; 208 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:23:37.981 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:37 smithi037 ceph-mon[90844]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-04-25T17:23:37.981 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:37 smithi037 ceph-mon[90844]: Upgrade: osd.2 is safe to restart 2024-04-25T17:23:37.981 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:37 smithi037 ceph-mon[90844]: pgmap v85: 65 pgs: 65 active+clean; 208 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:23:39.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:39 smithi037 ceph-mon[90844]: Upgrade: Updating osd.2 2024-04-25T17:23:39.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:39 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:23:39.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:39 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-25T17:23:39.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:39 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:23:39.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:39 smithi037 ceph-mon[90844]: Deploying daemon osd.2 on smithi037 2024-04-25T17:23:39.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:39 smithi069 ceph-mon[80239]: Upgrade: Updating osd.2 2024-04-25T17:23:39.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:39 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:23:39.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:39 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-04-25T17:23:39.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:39 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:23:39.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:39 smithi069 ceph-mon[80239]: Deploying daemon osd.2 on smithi037 2024-04-25T17:23:40.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:40 smithi037 ceph-mon[90844]: pgmap v86: 65 pgs: 65 active+clean; 208 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:23:40.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:40 smithi069 ceph-mon[80239]: pgmap v86: 65 pgs: 65 active+clean; 208 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:23:41.822 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:23:41 smithi037 systemd[1]: Stopping Ceph osd.2 for 599bb7fc-0326-11ef-bc93-c7b262605968... 2024-04-25T17:23:41.822 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:23:41 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-2[59490]: 2024-04-25T17:23:41.728+0000 7ffb37cbf700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T17:23:41.822 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:23:41 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-2[59490]: 2024-04-25T17:23:41.728+0000 7ffb37cbf700 -1 osd.2 59 *** Got signal Terminated *** 2024-04-25T17:23:41.822 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:23:41 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-2[59490]: 2024-04-25T17:23:41.728+0000 7ffb37cbf700 -1 osd.2 59 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T17:23:42.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:42 smithi069 ceph-mon[80239]: pgmap v87: 65 pgs: 65 active+clean; 208 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:23:42.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:42 smithi069 ceph-mon[80239]: osd.2 marked itself down and dead 2024-04-25T17:23:42.537 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:42 smithi037 ceph-mon[90844]: pgmap v87: 65 pgs: 65 active+clean; 208 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:23:42.537 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:42 smithi037 ceph-mon[90844]: osd.2 marked itself down and dead 2024-04-25T17:23:42.821 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:23:42 smithi037 podman[109921]: 2024-04-25 17:23:42.537193647 +0000 UTC m=+0.901833038 container died 2eedaf9886dddb31b02cbc687b81a77de0cb86298c7e51360c840634db1fb315 (image=quay.ceph.io/ceph-ci/ceph@sha256:27d43f80a23d3545096a7bb490598a6f37852da2940e69e5a8f3e3d7fb58fd17, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-2, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=quincy-c61472c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T17:23:43.099 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:23:43 smithi037 podman[109921]: 2024-04-25 17:23:43.011758408 +0000 UTC m=+1.376397800 container cleanup 2eedaf9886dddb31b02cbc687b81a77de0cb86298c7e51360c840634db1fb315 (image=quay.ceph.io/ceph-ci/ceph@sha256:27d43f80a23d3545096a7bb490598a6f37852da2940e69e5a8f3e3d7fb58fd17, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-2, ceph=True, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=quincy-c61472c, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T17:23:43.099 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:23:43 smithi037 bash[109921]: ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-2 2024-04-25T17:23:43.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:43 smithi069 ceph-mon[80239]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-25T17:23:43.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:43 smithi069 ceph-mon[80239]: osdmap e60: 6 total, 5 up, 6 in 2024-04-25T17:23:43.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:43 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:23:43.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:43 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:23:43.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:43 smithi069 ceph-mon[80239]: osdmap e61: 6 total, 5 up, 6 in 2024-04-25T17:23:43.504 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:23:43 smithi037 podman[109940]: 2024-04-25 17:23:43.280410575 +0000 UTC m=+0.741729443 container remove 2eedaf9886dddb31b02cbc687b81a77de0cb86298c7e51360c840634db1fb315 (image=quay.ceph.io/ceph-ci/ceph@sha256:27d43f80a23d3545096a7bb490598a6f37852da2940e69e5a8f3e3d7fb58fd17, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-2, RELEASE=quincy-c61472c, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, io.buildah.version=1.33.5) 2024-04-25T17:23:43.505 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:43 smithi037 ceph-mon[90844]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-25T17:23:43.505 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:43 smithi037 ceph-mon[90844]: osdmap e60: 6 total, 5 up, 6 in 2024-04-25T17:23:43.505 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:43 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:23:43.505 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:43 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:23:43.505 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:43 smithi037 ceph-mon[90844]: osdmap e61: 6 total, 5 up, 6 in 2024-04-25T17:23:43.818 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:23:43 smithi037 podman[110033]: 2024-04-25 17:23:43.503464711 +0000 UTC m=+0.019472053 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T17:23:43.818 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:23:43 smithi037 podman[110033]: 2024-04-25 17:23:43.60632635 +0000 UTC m=+0.122333691 container create 6de0d8299f93455e68d2138e50ddb6b482a2b3dd06ce9796e9b86d3ae8a3bf91 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T17:23:43.818 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:23:43 smithi037 podman[110033]: 2024-04-25 17:23:43.817712099 +0000 UTC m=+0.333719442 container init 6de0d8299f93455e68d2138e50ddb6b482a2b3dd06ce9796e9b86d3ae8a3bf91 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T17:23:44.072 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:23:43 smithi037 podman[110033]: 2024-04-25 17:23:43.820975124 +0000 UTC m=+0.336982467 container start 6de0d8299f93455e68d2138e50ddb6b482a2b3dd06ce9796e9b86d3ae8a3bf91 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-04-25T17:23:44.072 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:23:43 smithi037 podman[110033]: 2024-04-25 17:23:43.900696738 +0000 UTC m=+0.416704096 container attach 6de0d8299f93455e68d2138e50ddb6b482a2b3dd06ce9796e9b86d3ae8a3bf91 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-2-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_BRANCH=HEAD) 2024-04-25T17:23:44.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:44 smithi069 ceph-mon[80239]: pgmap v89: 65 pgs: 9 stale+active+clean, 56 active+clean; 208 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-04-25T17:23:44.446 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:44 smithi037 ceph-mon[90844]: pgmap v89: 65 pgs: 9 stale+active+clean, 56 active+clean; 208 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-04-25T17:23:44.447 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:23:44 smithi037 podman[110033]: 2024-04-25 17:23:44.124035662 +0000 UTC m=+0.640043005 container died 6de0d8299f93455e68d2138e50ddb6b482a2b3dd06ce9796e9b86d3ae8a3bf91 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-2-deactivate, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-04-25T17:23:45.072 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:23:44 smithi037 podman[110059]: 2024-04-25 17:23:44.737925181 +0000 UTC m=+0.606955632 container remove 6de0d8299f93455e68d2138e50ddb6b482a2b3dd06ce9796e9b86d3ae8a3bf91 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-2-deactivate, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True) 2024-04-25T17:23:45.073 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:23:44 smithi037 systemd[1]: ceph-599bb7fc-0326-11ef-bc93-c7b262605968@osd.2.service: Deactivated successfully. 2024-04-25T17:23:45.073 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:23:44 smithi037 systemd[1]: Stopped Ceph osd.2 for 599bb7fc-0326-11ef-bc93-c7b262605968. 2024-04-25T17:23:45.073 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:23:44 smithi037 systemd[1]: ceph-599bb7fc-0326-11ef-bc93-c7b262605968@osd.2.service: Consumed 1min 63ms CPU time. 2024-04-25T17:23:45.073 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:23:44 smithi037 systemd[1]: Starting Ceph osd.2 for 599bb7fc-0326-11ef-bc93-c7b262605968... 2024-04-25T17:23:45.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:45 smithi069 ceph-mon[80239]: pgmap v91: 65 pgs: 8 active+undersized+degraded, 3 stale+active+clean, 11 active+undersized, 43 active+clean; 208 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 2 op/s; 21/228 objects degraded (9.211%) 2024-04-25T17:23:45.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:45 smithi069 ceph-mon[80239]: Health check failed: Degraded data redundancy: 21/228 objects degraded (9.211%), 8 pgs degraded (PG_DEGRADED) 2024-04-25T17:23:45.450 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:45 smithi037 ceph-mon[90844]: pgmap v91: 65 pgs: 8 active+undersized+degraded, 3 stale+active+clean, 11 active+undersized, 43 active+clean; 208 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 2 op/s; 21/228 objects degraded (9.211%) 2024-04-25T17:23:45.451 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:45 smithi037 ceph-mon[90844]: Health check failed: Degraded data redundancy: 21/228 objects degraded (9.211%), 8 pgs degraded (PG_DEGRADED) 2024-04-25T17:23:45.451 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:23:45 smithi037 podman[110159]: 2024-04-25 17:23:45.094520911 +0000 UTC m=+0.018750746 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T17:23:45.451 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:23:45 smithi037 podman[110159]: 2024-04-25 17:23:45.214485518 +0000 UTC m=+0.138715345 container create 886c18a295ee3d6a80dc776f51f8da1565dfcf12d6a6d8dcedfa0db135023574 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-2-activate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, ceph=True) 2024-04-25T17:23:45.451 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:23:45 smithi037 podman[110159]: 2024-04-25 17:23:45.450655916 +0000 UTC m=+0.374885733 container init 886c18a295ee3d6a80dc776f51f8da1565dfcf12d6a6d8dcedfa0db135023574 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-2-activate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-04-25T17:23:45.822 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:23:45 smithi037 podman[110159]: 2024-04-25 17:23:45.454084135 +0000 UTC m=+0.378313945 container start 886c18a295ee3d6a80dc776f51f8da1565dfcf12d6a6d8dcedfa0db135023574 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-2-activate, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-04-25T17:23:45.822 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:23:45 smithi037 podman[110159]: 2024-04-25 17:23:45.567454583 +0000 UTC m=+0.491684401 container attach 886c18a295ee3d6a80dc776f51f8da1565dfcf12d6a6d8dcedfa0db135023574 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-2-activate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240424, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2) 2024-04-25T17:23:46.323 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:23:46 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-2-activate[110174]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-25T17:23:46.323 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:23:46 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-2-activate[110174]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-25T17:23:46.323 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:23:46 smithi037 bash[110159]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-25T17:23:46.323 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:23:46 smithi037 bash[110159]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-25T17:23:46.323 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:23:46 smithi037 bash[110159]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-25T17:23:46.323 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:23:46 smithi037 bash[110159]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-04-25T17:23:46.323 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:23:46 smithi037 bash[110159]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-04-25T17:23:46.323 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:23:46 smithi037 bash[110159]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-04-25T17:23:46.323 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:23:46 smithi037 bash[110159]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-04-25T17:23:46.323 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:23:46 smithi037 bash[110159]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-25T17:23:46.324 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:23:46 smithi037 bash[110159]: --> ceph-volume raw activate successful for osd ID: 2 2024-04-25T17:23:46.324 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:23:46 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-2-activate[110174]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-25T17:23:46.324 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:23:46 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-2-activate[110174]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-04-25T17:23:46.324 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:23:46 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-2-activate[110174]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-04-25T17:23:46.324 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:23:46 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-2-activate[110174]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-04-25T17:23:46.324 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:23:46 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-2-activate[110174]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-04-25T17:23:46.324 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:23:46 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-2-activate[110174]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-25T17:23:46.324 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:23:46 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-2-activate[110174]: --> ceph-volume raw activate successful for osd ID: 2 2024-04-25T17:23:46.324 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:23:46 smithi037 podman[110159]: 2024-04-25 17:23:46.080225748 +0000 UTC m=+1.004455575 container died 886c18a295ee3d6a80dc776f51f8da1565dfcf12d6a6d8dcedfa0db135023574 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-2-activate, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T17:23:47.045 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:23:46 smithi037 podman[110303]: 2024-04-25 17:23:46.713306786 +0000 UTC m=+0.628005830 container remove 886c18a295ee3d6a80dc776f51f8da1565dfcf12d6a6d8dcedfa0db135023574 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-2-activate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS) 2024-04-25T17:23:47.046 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:23:46 smithi037 podman[110366]: 2024-04-25 17:23:46.841197267 +0000 UTC m=+0.019321932 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T17:23:47.046 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:23:46 smithi037 podman[110366]: 2024-04-25 17:23:46.93917394 +0000 UTC m=+0.117298628 container create a0b57bba2ebff1805b6d62177a4734e9cfcf509bb8da4c8835605041d96d4118 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, ceph=True, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-04-25T17:23:47.318 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:23:47 smithi037 podman[110366]: 2024-04-25 17:23:47.283421076 +0000 UTC m=+0.461545724 container init a0b57bba2ebff1805b6d62177a4734e9cfcf509bb8da4c8835605041d96d4118 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux ) 2024-04-25T17:23:47.319 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:23:47 smithi037 podman[110366]: 2024-04-25 17:23:47.286942241 +0000 UTC m=+0.465066896 container start a0b57bba2ebff1805b6d62177a4734e9cfcf509bb8da4c8835605041d96d4118 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-2, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T17:23:47.572 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:23:47 smithi037 ceph-osd[110385]: -- 172.21.15.37:0/3260728348 <== mon.0 v2:172.21.15.37:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558394c87680 con 0x558394d2ed00 2024-04-25T17:23:47.572 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:23:47 smithi037 bash[110366]: a0b57bba2ebff1805b6d62177a4734e9cfcf509bb8da4c8835605041d96d4118 2024-04-25T17:23:47.572 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:23:47 smithi037 systemd[1]: Started Ceph osd.2 for 599bb7fc-0326-11ef-bc93-c7b262605968. 2024-04-25T17:23:47.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:47 smithi037 ceph-mon[90844]: pgmap v92: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 208 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 30/228 objects degraded (13.158%) 2024-04-25T17:23:47.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:47 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:23:47.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:47 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:23:47.573 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:47 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:23:47.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:47 smithi069 ceph-mon[80239]: pgmap v92: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 208 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 30/228 objects degraded (13.158%) 2024-04-25T17:23:47.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:47 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:23:47.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:47 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:23:47.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:47 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:23:48.271 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:23:47 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-2[110381]: 2024-04-25T17:23:47.835+0000 7f93873717c0 -1 Falling back to public interface 2024-04-25T17:23:49.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:49 smithi037 ceph-mon[90844]: pgmap v93: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 208 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 30/228 objects degraded (13.158%) 2024-04-25T17:23:49.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:49 smithi069 ceph-mon[80239]: pgmap v93: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 208 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 30/228 objects degraded (13.158%) 2024-04-25T17:23:51.611 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:51 smithi037 ceph-mon[90844]: pgmap v94: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 208 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 30/228 objects degraded (13.158%) 2024-04-25T17:23:51.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:51 smithi069 ceph-mon[80239]: pgmap v94: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 208 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 30/228 objects degraded (13.158%) 2024-04-25T17:23:52.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:52 smithi037 ceph-mon[90844]: Health check update: Degraded data redundancy: 30/228 objects degraded (13.158%), 12 pgs degraded (PG_DEGRADED) 2024-04-25T17:23:52.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:52 smithi069 ceph-mon[80239]: Health check update: Degraded data redundancy: 30/228 objects degraded (13.158%), 12 pgs degraded (PG_DEGRADED) 2024-04-25T17:23:53.321 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:23:52 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-2[110381]: 2024-04-25T17:23:52.994+0000 7f93873717c0 -1 osd.2 59 log_to_monitors true 2024-04-25T17:23:54.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:53 smithi037 ceph-mon[90844]: pgmap v95: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 208 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 30/228 objects degraded (13.158%) 2024-04-25T17:23:54.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:53 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:23:54.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:53 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:23:54.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:53 smithi037 ceph-mon[90844]: from='osd.2 [v2:172.21.15.37:6818/1533738118,v1:172.21.15.37:6819/1533738118]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-25T17:23:54.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:53 smithi069 ceph-mon[80239]: pgmap v95: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 208 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 30/228 objects degraded (13.158%) 2024-04-25T17:23:54.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:53 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:23:54.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:53 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:23:54.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:53 smithi069 ceph-mon[80239]: from='osd.2 [v2:172.21.15.37:6818/1533738118,v1:172.21.15.37:6819/1533738118]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-04-25T17:23:55.072 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:23:54 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-2[110381]: 2024-04-25T17:23:54.765+0000 7f9374783700 -1 osd.2 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T17:23:55.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:54 smithi037 ceph-mon[90844]: from='osd.2 [v2:172.21.15.37:6818/1533738118,v1:172.21.15.37:6819/1533738118]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-25T17:23:55.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:54 smithi037 ceph-mon[90844]: osdmap e62: 6 total, 5 up, 6 in 2024-04-25T17:23:55.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:54 smithi037 ceph-mon[90844]: from='osd.2 [v2:172.21.15.37:6818/1533738118,v1:172.21.15.37:6819/1533738118]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-04-25T17:23:55.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:54 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:23:55.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:54 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:23:55.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:54 smithi037 ceph-mon[90844]: from='osd.2 [v2:172.21.15.37:6818/1533738118,v1:172.21.15.37:6819/1533738118]' entity='osd.2' 2024-04-25T17:23:55.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:54 smithi069 ceph-mon[80239]: from='osd.2 [v2:172.21.15.37:6818/1533738118,v1:172.21.15.37:6819/1533738118]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-04-25T17:23:55.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:54 smithi069 ceph-mon[80239]: osdmap e62: 6 total, 5 up, 6 in 2024-04-25T17:23:55.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:54 smithi069 ceph-mon[80239]: from='osd.2 [v2:172.21.15.37:6818/1533738118,v1:172.21.15.37:6819/1533738118]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi037", "root=default"]}]: dispatch 2024-04-25T17:23:55.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:54 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:23:55.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:54 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:23:55.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:54 smithi069 ceph-mon[80239]: from='osd.2 [v2:172.21.15.37:6818/1533738118,v1:172.21.15.37:6819/1533738118]' entity='osd.2' 2024-04-25T17:23:56.261 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:55 smithi037 ceph-mon[90844]: pgmap v97: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 208 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 30/228 objects degraded (13.158%) 2024-04-25T17:23:56.261 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:55 smithi037 ceph-mon[90844]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-25T17:23:56.261 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:55 smithi037 ceph-mon[90844]: osd.2 [v2:172.21.15.37:6818/1533738118,v1:172.21.15.37:6819/1533738118] boot 2024-04-25T17:23:56.261 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:55 smithi037 ceph-mon[90844]: osdmap e63: 6 total, 6 up, 6 in 2024-04-25T17:23:56.261 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:55 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T17:23:56.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:55 smithi069 ceph-mon[80239]: pgmap v97: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 208 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 30/228 objects degraded (13.158%) 2024-04-25T17:23:56.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:55 smithi069 ceph-mon[80239]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-25T17:23:56.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:55 smithi069 ceph-mon[80239]: osd.2 [v2:172.21.15.37:6818/1533738118,v1:172.21.15.37:6819/1533738118] boot 2024-04-25T17:23:56.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:55 smithi069 ceph-mon[80239]: osdmap e63: 6 total, 6 up, 6 in 2024-04-25T17:23:56.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:55 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-04-25T17:23:56.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.522+0000 7f80bbdbd700 1 -- 172.21.15.37:0/2612902672 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80b40fbcb0 msgr2=0x7f80b40fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:23:56.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.522+0000 7f80bbdbd700 1 --2- 172.21.15.37:0/2612902672 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80b40fbcb0 0x7f80b40fc0c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f80b0004940 tx=0x7f80b0009e30 comp rx=0 tx=0).stop 2024-04-25T17:23:56.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.522+0000 7f80bbdbd700 1 -- 172.21.15.37:0/2612902672 shutdown_connections 2024-04-25T17:23:56.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.522+0000 7f80bbdbd700 1 --2- 172.21.15.37:0/2612902672 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f80b40fcf60 0x7f80b40fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:56.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.522+0000 7f80bbdbd700 1 --2- 172.21.15.37:0/2612902672 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80b40fbcb0 0x7f80b40fc0c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:56.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.522+0000 7f80bbdbd700 1 -- 172.21.15.37:0/2612902672 >> 172.21.15.37:0/2612902672 conn(0x7f80b40f7430 msgr2=0x7f80b40f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:23:56.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.522+0000 7f80bbdbd700 1 -- 172.21.15.37:0/2612902672 shutdown_connections 2024-04-25T17:23:56.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.522+0000 7f80bbdbd700 1 -- 172.21.15.37:0/2612902672 wait complete. 2024-04-25T17:23:56.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.522+0000 7f80bbdbd700 1 Processor -- start 2024-04-25T17:23:56.525 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.522+0000 7f80bbdbd700 1 -- start start 2024-04-25T17:23:56.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.523+0000 7f80bbdbd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80b40fbcb0 0x7f80b410fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:23:56.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.523+0000 7f80bbdbd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f80b40fcf60 0x7f80b41101b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:23:56.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.523+0000 7f80bbdbd700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b41107b0 con 0x7f80b40fbcb0 2024-04-25T17:23:56.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.523+0000 7f80bbdbd700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b4110fb0 con 0x7f80b40fcf60 2024-04-25T17:23:56.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.523+0000 7f80b9b59700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80b40fbcb0 0x7f80b410fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:23:56.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.523+0000 7f80b9b59700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80b40fbcb0 0x7f80b410fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60602/0 (socket says 172.21.15.37:60602) 2024-04-25T17:23:56.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.523+0000 7f80b9b59700 1 -- 172.21.15.37:0/3133059814 learned_addr learned my addr 172.21.15.37:0/3133059814 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:23:56.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.523+0000 7f80b9358700 1 --2- 172.21.15.37:0/3133059814 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f80b40fcf60 0x7f80b41101b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:23:56.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.523+0000 7f80b9b59700 1 -- 172.21.15.37:0/3133059814 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f80b40fcf60 msgr2=0x7f80b41101b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:23:56.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.523+0000 7f80b9b59700 1 --2- 172.21.15.37:0/3133059814 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f80b40fcf60 0x7f80b41101b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:56.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.523+0000 7f80b9b59700 1 -- 172.21.15.37:0/3133059814 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b0005040 con 0x7f80b40fbcb0 2024-04-25T17:23:56.526 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.523+0000 7f80b9358700 1 --2- 172.21.15.37:0/3133059814 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f80b40fcf60 0x7f80b41101b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T17:23:56.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.524+0000 7f80b9b59700 1 --2- 172.21.15.37:0/3133059814 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80b40fbcb0 0x7f80b410fc70 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f80b000b3b0 tx=0x7f80b0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:23:56.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.524+0000 7f80a67fc700 1 -- 172.21.15.37:0/3133059814 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80b000e040 con 0x7f80b40fbcb0 2024-04-25T17:23:56.527 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.524+0000 7f80bbdbd700 1 -- 172.21.15.37:0/3133059814 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80b4111230 con 0x7f80b40fbcb0 2024-04-25T17:23:56.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.524+0000 7f80a67fc700 1 -- 172.21.15.37:0/3133059814 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f80b0004290 con 0x7f80b40fbcb0 2024-04-25T17:23:56.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.524+0000 7f80bbdbd700 1 -- 172.21.15.37:0/3133059814 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80b4111770 con 0x7f80b40fbcb0 2024-04-25T17:23:56.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.524+0000 7f80a67fc700 1 -- 172.21.15.37:0/3133059814 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80b001c630 con 0x7f80b40fbcb0 2024-04-25T17:23:56.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.525+0000 7f80bbdbd700 1 -- 172.21.15.37:0/3133059814 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80980052b0 con 0x7f80b40fbcb0 2024-04-25T17:23:56.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.526+0000 7f80a67fc700 1 -- 172.21.15.37:0/3133059814 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f80b000bbf0 con 0x7f80b40fbcb0 2024-04-25T17:23:56.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.526+0000 7f80a67fc700 1 --2- 172.21.15.37:0/3133059814 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f80a0076b80 0x7f80a0079030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:23:56.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.527+0000 7f80a67fc700 1 -- 172.21.15.37:0/3133059814 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f80b0099570 con 0x7f80b40fbcb0 2024-04-25T17:23:56.528 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.527+0000 7f80b9358700 1 --2- 172.21.15.37:0/3133059814 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f80a0076b80 0x7f80a0079030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:23:56.529 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.527+0000 7f80b9358700 1 --2- 172.21.15.37:0/3133059814 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f80a0076b80 0x7f80a0079030 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f80a8007fd0 tx=0x7f80a8009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:23:56.532 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.532+0000 7f80a67fc700 1 -- 172.21.15.37:0/3133059814 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f80b0062210 con 0x7f80b40fbcb0 2024-04-25T17:23:56.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.817+0000 7f80bbdbd700 1 -- 172.21.15.37:0/3133059814 --> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8098000bc0 con 0x7f80a0076b80 2024-04-25T17:23:56.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.819+0000 7f80a67fc700 1 -- 172.21.15.37:0/3133059814 <== mgr.34104 v2:172.21.15.37:6800/783197737 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f8098000bc0 con 0x7f80a0076b80 2024-04-25T17:23:56.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.822+0000 7f80bbdbd700 1 -- 172.21.15.37:0/3133059814 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f80a0076b80 msgr2=0x7f80a0079030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:23:56.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.822+0000 7f80bbdbd700 1 --2- 172.21.15.37:0/3133059814 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f80a0076b80 0x7f80a0079030 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f80a8007fd0 tx=0x7f80a8009040 comp rx=0 tx=0).stop 2024-04-25T17:23:56.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.822+0000 7f80bbdbd700 1 -- 172.21.15.37:0/3133059814 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80b40fbcb0 msgr2=0x7f80b410fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:23:56.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.822+0000 7f80bbdbd700 1 --2- 172.21.15.37:0/3133059814 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80b40fbcb0 0x7f80b410fc70 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f80b000b3b0 tx=0x7f80b0009e30 comp rx=0 tx=0).stop 2024-04-25T17:23:56.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.822+0000 7f80bbdbd700 1 -- 172.21.15.37:0/3133059814 shutdown_connections 2024-04-25T17:23:56.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.822+0000 7f80bbdbd700 1 --2- 172.21.15.37:0/3133059814 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f80a0076b80 0x7f80a0079030 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:56.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.822+0000 7f80bbdbd700 1 --2- 172.21.15.37:0/3133059814 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f80b40fbcb0 0x7f80b410fc70 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:56.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.822+0000 7f80bbdbd700 1 --2- 172.21.15.37:0/3133059814 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f80b40fcf60 0x7f80b41101b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:56.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.822+0000 7f80bbdbd700 1 -- 172.21.15.37:0/3133059814 >> 172.21.15.37:0/3133059814 conn(0x7f80b40f7430 msgr2=0x7f80b4065b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:23:56.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.823+0000 7f80bbdbd700 1 -- 172.21.15.37:0/3133059814 shutdown_connections 2024-04-25T17:23:56.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.823+0000 7f80bbdbd700 1 -- 172.21.15.37:0/3133059814 wait complete. 2024-04-25T17:23:56.834 INFO:teuthology.orchestra.run.smithi037.stdout:true 2024-04-25T17:23:56.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.933+0000 7fd0cc555700 1 -- 172.21.15.37:0/1504188806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0c40fce90 msgr2=0x7fd0c40fd2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:23:56.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.933+0000 7fd0cc555700 1 --2- 172.21.15.37:0/1504188806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0c40fce90 0x7fd0c40fd2a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd0c0004940 tx=0x7fd0c0009e30 comp rx=0 tx=0).stop 2024-04-25T17:23:56.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.933+0000 7fd0cc555700 1 -- 172.21.15.37:0/1504188806 shutdown_connections 2024-04-25T17:23:56.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.933+0000 7fd0cc555700 1 --2- 172.21.15.37:0/1504188806 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd0c40fe090 0x7fd0c40fe500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:56.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.933+0000 7fd0cc555700 1 --2- 172.21.15.37:0/1504188806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0c40fce90 0x7fd0c40fd2a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:56.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.933+0000 7fd0cc555700 1 -- 172.21.15.37:0/1504188806 >> 172.21.15.37:0/1504188806 conn(0x7fd0c40f85c0 msgr2=0x7fd0c40fa9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:23:56.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.933+0000 7fd0cc555700 1 -- 172.21.15.37:0/1504188806 shutdown_connections 2024-04-25T17:23:56.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.933+0000 7fd0cc555700 1 -- 172.21.15.37:0/1504188806 wait complete. 2024-04-25T17:23:56.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.934+0000 7fd0cc555700 1 Processor -- start 2024-04-25T17:23:56.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.934+0000 7fd0cc555700 1 -- start start 2024-04-25T17:23:56.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.934+0000 7fd0cc555700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd0c40fce90 0x7fd0c410da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:23:56.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.934+0000 7fd0cc555700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0c40fe090 0x7fd0c410dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:23:56.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.934+0000 7fd0cc555700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c410e5b0 con 0x7fd0c40fe090 2024-04-25T17:23:56.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.934+0000 7fd0cc555700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c410ee00 con 0x7fd0c40fce90 2024-04-25T17:23:56.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.934+0000 7fd0c9af0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0c40fe090 0x7fd0c410dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:23:56.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.934+0000 7fd0c9af0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0c40fe090 0x7fd0c410dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49716/0 (socket says 172.21.15.37:49716) 2024-04-25T17:23:56.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.934+0000 7fd0c9af0700 1 -- 172.21.15.37:0/4007548945 learned_addr learned my addr 172.21.15.37:0/4007548945 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:23:56.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.934+0000 7fd0ca2f1700 1 --2- 172.21.15.37:0/4007548945 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd0c40fce90 0x7fd0c410da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:23:56.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.934+0000 7fd0c9af0700 1 -- 172.21.15.37:0/4007548945 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd0c40fce90 msgr2=0x7fd0c410da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:23:56.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.934+0000 7fd0c9af0700 1 --2- 172.21.15.37:0/4007548945 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd0c40fce90 0x7fd0c410da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:56.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.934+0000 7fd0c9af0700 1 -- 172.21.15.37:0/4007548945 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c0005040 con 0x7fd0c40fe090 2024-04-25T17:23:56.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.935+0000 7fd0c9af0700 1 --2- 172.21.15.37:0/4007548945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0c40fe090 0x7fd0c410dfb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4002a50 tx=0x7fd0b40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:23:56.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.935+0000 7fd0baffd700 1 -- 172.21.15.37:0/4007548945 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0b4007cc0 con 0x7fd0c40fe090 2024-04-25T17:23:56.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.935+0000 7fd0baffd700 1 -- 172.21.15.37:0/4007548945 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd0b400f040 con 0x7fd0c40fe090 2024-04-25T17:23:56.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.935+0000 7fd0cc555700 1 -- 172.21.15.37:0/4007548945 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0c410f0e0 con 0x7fd0c40fe090 2024-04-25T17:23:56.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.935+0000 7fd0baffd700 1 -- 172.21.15.37:0/4007548945 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0b400da30 con 0x7fd0c40fe090 2024-04-25T17:23:56.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.935+0000 7fd0cc555700 1 -- 172.21.15.37:0/4007548945 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0c410f620 con 0x7fd0c40fe090 2024-04-25T17:23:56.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.936+0000 7fd0cc555700 1 -- 172.21.15.37:0/4007548945 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0c405f5c0 con 0x7fd0c40fe090 2024-04-25T17:23:56.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.937+0000 7fd0baffd700 1 -- 172.21.15.37:0/4007548945 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7fd0b400db90 con 0x7fd0c40fe090 2024-04-25T17:23:56.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.937+0000 7fd0baffd700 1 --2- 172.21.15.37:0/4007548945 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fd0b0076b80 0x7fd0b0079030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:23:56.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.938+0000 7fd0baffd700 1 -- 172.21.15.37:0/4007548945 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fd0b4097fa0 con 0x7fd0c40fe090 2024-04-25T17:23:56.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.938+0000 7fd0ca2f1700 1 --2- 172.21.15.37:0/4007548945 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fd0b0076b80 0x7fd0b0079030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:23:56.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.938+0000 7fd0ca2f1700 1 --2- 172.21.15.37:0/4007548945 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fd0b0076b80 0x7fd0b0079030 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd0c000b3b0 tx=0x7fd0c0009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:23:56.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:56.943+0000 7fd0baffd700 1 -- 172.21.15.37:0/4007548945 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fd0b4060ba0 con 0x7fd0c40fe090 2024-04-25T17:23:57.195 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.194+0000 7fd0cc555700 1 -- 172.21.15.37:0/4007548945 --> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd0c410f9f0 con 0x7fd0b0076b80 2024-04-25T17:23:57.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.195+0000 7fd0baffd700 1 -- 172.21.15.37:0/4007548945 <== mgr.34104 v2:172.21.15.37:6800/783197737 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fd0c410f9f0 con 0x7fd0b0076b80 2024-04-25T17:23:57.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.197+0000 7fd0cc555700 1 -- 172.21.15.37:0/4007548945 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fd0b0076b80 msgr2=0x7fd0b0079030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:23:57.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.197+0000 7fd0cc555700 1 --2- 172.21.15.37:0/4007548945 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fd0b0076b80 0x7fd0b0079030 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd0c000b3b0 tx=0x7fd0c0009e30 comp rx=0 tx=0).stop 2024-04-25T17:23:57.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.197+0000 7fd0cc555700 1 -- 172.21.15.37:0/4007548945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0c40fe090 msgr2=0x7fd0c410dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:23:57.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.197+0000 7fd0cc555700 1 --2- 172.21.15.37:0/4007548945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0c40fe090 0x7fd0c410dfb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4002a50 tx=0x7fd0b40046b0 comp rx=0 tx=0).stop 2024-04-25T17:23:57.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.197+0000 7fd0cc555700 1 -- 172.21.15.37:0/4007548945 shutdown_connections 2024-04-25T17:23:57.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.197+0000 7fd0cc555700 1 --2- 172.21.15.37:0/4007548945 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fd0b0076b80 0x7fd0b0079030 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:57.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.198+0000 7fd0cc555700 1 --2- 172.21.15.37:0/4007548945 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd0c40fce90 0x7fd0c410da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:57.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.198+0000 7fd0cc555700 1 --2- 172.21.15.37:0/4007548945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd0c40fe090 0x7fd0c410dfb0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:57.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.198+0000 7fd0cc555700 1 -- 172.21.15.37:0/4007548945 >> 172.21.15.37:0/4007548945 conn(0x7fd0c40f85c0 msgr2=0x7fd0c40f9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:23:57.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.198+0000 7fd0cc555700 1 -- 172.21.15.37:0/4007548945 shutdown_connections 2024-04-25T17:23:57.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.198+0000 7fd0cc555700 1 -- 172.21.15.37:0/4007548945 wait complete. 2024-04-25T17:23:57.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.304+0000 7f382f0a3700 1 -- 172.21.15.37:0/3167031305 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38280fcf60 msgr2=0x7f38280fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:23:57.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.304+0000 7f382f0a3700 1 --2- 172.21.15.37:0/3167031305 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38280fcf60 0x7f38280fd3d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3814004940 tx=0x7f3814009e30 comp rx=0 tx=0).stop 2024-04-25T17:23:57.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.304+0000 7f382f0a3700 1 -- 172.21.15.37:0/3167031305 shutdown_connections 2024-04-25T17:23:57.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.304+0000 7f382f0a3700 1 --2- 172.21.15.37:0/3167031305 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38280fcf60 0x7f38280fd3d0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:57.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.304+0000 7f382f0a3700 1 --2- 172.21.15.37:0/3167031305 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f38280fbcb0 0x7f38280fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:57.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.304+0000 7f382f0a3700 1 -- 172.21.15.37:0/3167031305 >> 172.21.15.37:0/3167031305 conn(0x7f38280f7430 msgr2=0x7f38280f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:23:57.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.304+0000 7f382f0a3700 1 -- 172.21.15.37:0/3167031305 shutdown_connections 2024-04-25T17:23:57.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.304+0000 7f382f0a3700 1 -- 172.21.15.37:0/3167031305 wait complete. 2024-04-25T17:23:57.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.305+0000 7f382f0a3700 1 Processor -- start 2024-04-25T17:23:57.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.305+0000 7f382f0a3700 1 -- start start 2024-04-25T17:23:57.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.305+0000 7f382f0a3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38280fbcb0 0x7f382810daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:23:57.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.305+0000 7f382f0a3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f38280fcf60 0x7f382810dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:23:57.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.305+0000 7f382f0a3700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f382810e5e0 con 0x7f38280fbcb0 2024-04-25T17:23:57.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.305+0000 7f382f0a3700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f382810ede0 con 0x7f38280fcf60 2024-04-25T17:23:57.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.305+0000 7f382ce3f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38280fbcb0 0x7f382810daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:23:57.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.306+0000 7f382ce3f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38280fbcb0 0x7f382810daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49728/0 (socket says 172.21.15.37:49728) 2024-04-25T17:23:57.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.306+0000 7f382ce3f700 1 -- 172.21.15.37:0/3422788841 learned_addr learned my addr 172.21.15.37:0/3422788841 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:23:57.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.306+0000 7f3827fff700 1 --2- 172.21.15.37:0/3422788841 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f38280fcf60 0x7f382810dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:23:57.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.306+0000 7f382ce3f700 1 -- 172.21.15.37:0/3422788841 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f38280fcf60 msgr2=0x7f382810dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:23:57.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.306+0000 7f382ce3f700 1 --2- 172.21.15.37:0/3422788841 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f38280fcf60 0x7f382810dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:57.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.306+0000 7f382ce3f700 1 -- 172.21.15.37:0/3422788841 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3814005040 con 0x7f38280fbcb0 2024-04-25T17:23:57.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.306+0000 7f382ce3f700 1 --2- 172.21.15.37:0/3422788841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38280fbcb0 0x7f382810daa0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f381c002a50 tx=0x7f381c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:23:57.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.306+0000 7f38257fa700 1 -- 172.21.15.37:0/3422788841 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f381c007cc0 con 0x7f38280fbcb0 2024-04-25T17:23:57.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.306+0000 7f382f0a3700 1 -- 172.21.15.37:0/3422788841 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f382810f0c0 con 0x7f38280fbcb0 2024-04-25T17:23:57.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.306+0000 7f38257fa700 1 -- 172.21.15.37:0/3422788841 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f381c00f040 con 0x7f38280fbcb0 2024-04-25T17:23:57.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.306+0000 7f38257fa700 1 -- 172.21.15.37:0/3422788841 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f381c00da70 con 0x7f38280fbcb0 2024-04-25T17:23:57.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.306+0000 7f382f0a3700 1 -- 172.21.15.37:0/3422788841 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f382810f600 con 0x7f38280fbcb0 2024-04-25T17:23:57.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.308+0000 7f382f0a3700 1 -- 172.21.15.37:0/3422788841 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3828101af0 con 0x7f38280fbcb0 2024-04-25T17:23:57.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.308+0000 7f38257fa700 1 -- 172.21.15.37:0/3422788841 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f381c00dc10 con 0x7f38280fbcb0 2024-04-25T17:23:57.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.308+0000 7f38257fa700 1 --2- 172.21.15.37:0/3422788841 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f3818076b80 0x7f3818079030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:23:57.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.309+0000 7f38257fa700 1 -- 172.21.15.37:0/3422788841 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f381c0979a0 con 0x7f38280fbcb0 2024-04-25T17:23:57.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.309+0000 7f3827fff700 1 --2- 172.21.15.37:0/3422788841 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f3818076b80 0x7f3818079030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:23:57.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.309+0000 7f3827fff700 1 --2- 172.21.15.37:0/3422788841 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f3818076b80 0x7f3818079030 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3814009fd0 tx=0x7f3814009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:23:57.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.314+0000 7f38257fa700 1 -- 172.21.15.37:0/3422788841 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f381c060520 con 0x7f38280fbcb0 2024-04-25T17:23:57.548 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.547+0000 7f382f0a3700 1 -- 172.21.15.37:0/3422788841 --> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3828104930 con 0x7f3818076b80 2024-04-25T17:23:57.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.557+0000 7f38257fa700 1 -- 172.21.15.37:0/3422788841 <== mgr.34104 v2:172.21.15.37:6800/783197737 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f3828104930 con 0x7f3818076b80 2024-04-25T17:23:57.558 INFO:teuthology.orchestra.run.smithi037.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-25T17:23:57.558 INFO:teuthology.orchestra.run.smithi037.stdout:alertmanager.smithi037 smithi037 *:9093,9094 running (5m) 4s ago 13m 24.9M - 0.25.0 c8568f914cd2 18aed8f409ee 2024-04-25T17:23:57.558 INFO:teuthology.orchestra.run.smithi037.stdout:crash.smithi037 smithi037 running (110s) 4s ago 14m 6660k - 19.0.0-3291-g994e2f20 d53c96779a29 639584ea5855 2024-04-25T17:23:57.558 INFO:teuthology.orchestra.run.smithi037.stdout:crash.smithi069 smithi069 running (105s) 102s ago 12m 6665k - 19.0.0-3291-g994e2f20 d53c96779a29 ee5db16733a7 2024-04-25T17:23:57.558 INFO:teuthology.orchestra.run.smithi037.stdout:grafana.smithi037 smithi037 *:3000 running (5m) 4s ago 13m 84.2M - 9.4.7 954c08fa6188 1eff3ea3f9b0 2024-04-25T17:23:57.559 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi037.ksmixc smithi037 running (8m) 4s ago 8m 149M - 17.2.7-902-gc61472c8 0de407c1b3af 394aa56079b4 2024-04-25T17:23:57.559 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi037.ovkrpq smithi037 running (8m) 4s ago 8m 102M - 17.2.7-902-gc61472c8 0de407c1b3af 73ca662174a7 2024-04-25T17:23:57.559 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi069.cpprst smithi069 running (8m) 101s ago 8m 15.5M - 17.2.7-902-gc61472c8 0de407c1b3af dbda101df20e 2024-04-25T17:23:57.559 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi069.ytlqcf smithi069 running (8m) 101s ago 8m 13.5M - 17.2.7-902-gc61472c8 0de407c1b3af 911df6b18215 2024-04-25T17:23:57.559 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.smithi037.txrgxl smithi037 *:8443,9283,8765 running (4m) 4s ago 15m 573M - 19.0.0-3291-g994e2f20 d53c96779a29 e9653fc62df9 2024-04-25T17:23:57.559 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.smithi069.mmuhdo smithi069 *:8443,9283,8765 running (3m) 102s ago 12m 518M - 19.0.0-3291-g994e2f20 d53c96779a29 6820207b4019 2024-04-25T17:23:57.559 INFO:teuthology.orchestra.run.smithi037.stdout:mon.smithi037 smithi037 running (2m) 4s ago 15m 113M 2048M 19.0.0-3291-g994e2f20 d53c96779a29 1b349f3af69d 2024-04-25T17:23:57.559 INFO:teuthology.orchestra.run.smithi037.stdout:mon.smithi069 smithi069 running (2m) 102s ago 12m 99.3M 2048M 19.0.0-3291-g994e2f20 d53c96779a29 7744dbe81b50 2024-04-25T17:23:57.559 INFO:teuthology.orchestra.run.smithi037.stdout:node-exporter.smithi037 smithi037 *:9100 running (5m) 4s ago 13m 14.4M - 1.5.0 0da6a335fe13 1e59bbb2aa82 2024-04-25T17:23:57.559 INFO:teuthology.orchestra.run.smithi037.stdout:node-exporter.smithi069 smithi069 *:9100 running (4m) 102s ago 12m 16.7M - 1.5.0 0da6a335fe13 0c51a9833fe4 2024-04-25T17:23:57.559 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0 smithi037 running (83s) 4s ago 11m 163M 1559M 19.0.0-3291-g994e2f20 d53c96779a29 e97538cb8b4f 2024-04-25T17:23:57.559 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1 smithi037 running (47s) 4s ago 11m 166M 1559M 19.0.0-3291-g994e2f20 d53c96779a29 6cf158192aae 2024-04-25T17:23:57.559 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2 smithi037 running (10s) 4s ago 10m 79.6M 1559M 19.0.0-3291-g994e2f20 d53c96779a29 a0b57bba2ebf 2024-04-25T17:23:57.559 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3 smithi069 running (10m) 102s ago 10m 276M 2581M 17.2.7-902-gc61472c8 0de407c1b3af ebba78fb1923 2024-04-25T17:23:57.559 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4 smithi069 running (10m) 102s ago 10m 253M 2581M 17.2.7-902-gc61472c8 0de407c1b3af ba7b785c50f9 2024-04-25T17:23:57.560 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5 smithi069 running (9m) 102s ago 9m 228M 2581M 17.2.7-902-gc61472c8 0de407c1b3af f6be99c364ff 2024-04-25T17:23:57.560 INFO:teuthology.orchestra.run.smithi037.stdout:prometheus.smithi037 smithi037 *:9095 running (3m) 4s ago 13m 65.9M - 2.43.0 a07b618ecd1d 2c5a268ffc1f 2024-04-25T17:23:57.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.559+0000 7f382f0a3700 1 -- 172.21.15.37:0/3422788841 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f3818076b80 msgr2=0x7f3818079030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:23:57.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.560+0000 7f382f0a3700 1 --2- 172.21.15.37:0/3422788841 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f3818076b80 0x7f3818079030 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3814009fd0 tx=0x7f3814009e30 comp rx=0 tx=0).stop 2024-04-25T17:23:57.560 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.560+0000 7f382f0a3700 1 -- 172.21.15.37:0/3422788841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38280fbcb0 msgr2=0x7f382810daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:23:57.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.560+0000 7f382f0a3700 1 --2- 172.21.15.37:0/3422788841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38280fbcb0 0x7f382810daa0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f381c002a50 tx=0x7f381c0046b0 comp rx=0 tx=0).stop 2024-04-25T17:23:57.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.560+0000 7f382f0a3700 1 -- 172.21.15.37:0/3422788841 shutdown_connections 2024-04-25T17:23:57.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.560+0000 7f382f0a3700 1 --2- 172.21.15.37:0/3422788841 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f3818076b80 0x7f3818079030 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:57.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.560+0000 7f382f0a3700 1 --2- 172.21.15.37:0/3422788841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38280fbcb0 0x7f382810daa0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:57.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.560+0000 7f382f0a3700 1 --2- 172.21.15.37:0/3422788841 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f38280fcf60 0x7f382810dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:57.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.560+0000 7f382f0a3700 1 -- 172.21.15.37:0/3422788841 >> 172.21.15.37:0/3422788841 conn(0x7f38280f7430 msgr2=0x7f3828065c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:23:57.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.560+0000 7f382f0a3700 1 -- 172.21.15.37:0/3422788841 shutdown_connections 2024-04-25T17:23:57.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.560+0000 7f382f0a3700 1 -- 172.21.15.37:0/3422788841 wait complete. 2024-04-25T17:23:57.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.666+0000 7fbb905b7700 1 -- 172.21.15.37:0/3942054752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb880ffee0 msgr2=0x7fbb88102300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:23:57.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.666+0000 7fbb905b7700 1 --2- 172.21.15.37:0/3942054752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb880ffee0 0x7fbb88102300 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fbb78004940 tx=0x7fbb78009e30 comp rx=0 tx=0).stop 2024-04-25T17:23:57.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.666+0000 7fbb905b7700 1 -- 172.21.15.37:0/3942054752 shutdown_connections 2024-04-25T17:23:57.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.666+0000 7fbb905b7700 1 --2- 172.21.15.37:0/3942054752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb880ffee0 0x7fbb88102300 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:57.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.666+0000 7fbb905b7700 1 --2- 172.21.15.37:0/3942054752 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb880662c0 0x7fbb880ff9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:57.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.666+0000 7fbb905b7700 1 -- 172.21.15.37:0/3942054752 >> 172.21.15.37:0/3942054752 conn(0x7fbb880f7430 msgr2=0x7fbb880f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:23:57.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.666+0000 7fbb905b7700 1 -- 172.21.15.37:0/3942054752 shutdown_connections 2024-04-25T17:23:57.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.666+0000 7fbb905b7700 1 -- 172.21.15.37:0/3942054752 wait complete. 2024-04-25T17:23:57.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.667+0000 7fbb905b7700 1 Processor -- start 2024-04-25T17:23:57.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.667+0000 7fbb905b7700 1 -- start start 2024-04-25T17:23:57.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.667+0000 7fbb905b7700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb880662c0 0x7fbb8810da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:23:57.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.667+0000 7fbb905b7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb880ffee0 0x7fbb8810df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:23:57.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.667+0000 7fbb905b7700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8810e540 con 0x7fbb880ffee0 2024-04-25T17:23:57.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.667+0000 7fbb905b7700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8810ed90 con 0x7fbb880662c0 2024-04-25T17:23:57.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.667+0000 7fbb8db52700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb880ffee0 0x7fbb8810df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:23:57.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.667+0000 7fbb8db52700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb880ffee0 0x7fbb8810df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49746/0 (socket says 172.21.15.37:49746) 2024-04-25T17:23:57.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.667+0000 7fbb8db52700 1 -- 172.21.15.37:0/4188837003 learned_addr learned my addr 172.21.15.37:0/4188837003 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:23:57.669 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.667+0000 7fbb8e353700 1 --2- 172.21.15.37:0/4188837003 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb880662c0 0x7fbb8810da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:23:57.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.668+0000 7fbb8db52700 1 -- 172.21.15.37:0/4188837003 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb880662c0 msgr2=0x7fbb8810da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:23:57.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.668+0000 7fbb8db52700 1 --2- 172.21.15.37:0/4188837003 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb880662c0 0x7fbb8810da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:57.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.668+0000 7fbb8db52700 1 -- 172.21.15.37:0/4188837003 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb78005040 con 0x7fbb880ffee0 2024-04-25T17:23:57.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.668+0000 7fbb8db52700 1 --2- 172.21.15.37:0/4188837003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb880ffee0 0x7fbb8810df40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbb78009150 tx=0x7fbb78009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:23:57.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.668+0000 7fbb7effd700 1 -- 172.21.15.37:0/4188837003 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb7800e040 con 0x7fbb880ffee0 2024-04-25T17:23:57.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.668+0000 7fbb7effd700 1 -- 172.21.15.37:0/4188837003 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbb7800bbf0 con 0x7fbb880ffee0 2024-04-25T17:23:57.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.668+0000 7fbb905b7700 1 -- 172.21.15.37:0/4188837003 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb8810f010 con 0x7fbb880ffee0 2024-04-25T17:23:57.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.668+0000 7fbb7effd700 1 -- 172.21.15.37:0/4188837003 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb7801c630 con 0x7fbb880ffee0 2024-04-25T17:23:57.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.668+0000 7fbb905b7700 1 -- 172.21.15.37:0/4188837003 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb8810f550 con 0x7fbb880ffee0 2024-04-25T17:23:57.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.669+0000 7fbb905b7700 1 -- 172.21.15.37:0/4188837003 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb8805f5c0 con 0x7fbb880ffee0 2024-04-25T17:23:57.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.670+0000 7fbb7effd700 1 -- 172.21.15.37:0/4188837003 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7fbb7800bd60 con 0x7fbb880ffee0 2024-04-25T17:23:57.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.670+0000 7fbb7effd700 1 --2- 172.21.15.37:0/4188837003 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fbb74076b80 0x7fbb74079030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:23:57.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.670+0000 7fbb7effd700 1 -- 172.21.15.37:0/4188837003 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fbb78099520 con 0x7fbb880ffee0 2024-04-25T17:23:57.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.670+0000 7fbb8e353700 1 --2- 172.21.15.37:0/4188837003 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fbb74076b80 0x7fbb74079030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:23:57.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.671+0000 7fbb8e353700 1 --2- 172.21.15.37:0/4188837003 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fbb74076b80 0x7fbb74079030 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbb88066000 tx=0x7fbb84009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:23:57.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.675+0000 7fbb7effd700 1 -- 172.21.15.37:0/4188837003 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fbb780621c0 con 0x7fbb880ffee0 2024-04-25T17:23:57.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.984+0000 7fbb905b7700 1 -- 172.21.15.37:0/4188837003 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbb881058b0 con 0x7fbb880ffee0 2024-04-25T17:23:57.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.985+0000 7fbb7effd700 1 -- 172.21.15.37:0/4188837003 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7fbb78013e60 con 0x7fbb880ffee0 2024-04-25T17:23:57.986 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-25T17:23:57.986 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": { 2024-04-25T17:23:57.986 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 2 2024-04-25T17:23:57.986 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:23:57.986 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": { 2024-04-25T17:23:57.986 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 2 2024-04-25T17:23:57.986 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:23:57.986 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": { 2024-04-25T17:23:57.987 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 3, 2024-04-25T17:23:57.987 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 3 2024-04-25T17:23:57.987 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:23:57.987 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": { 2024-04-25T17:23:57.987 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 4 2024-04-25T17:23:57.987 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:23:57.987 INFO:teuthology.orchestra.run.smithi037.stdout: "overall": { 2024-04-25T17:23:57.987 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 7, 2024-04-25T17:23:57.987 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 7 2024-04-25T17:23:57.987 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-04-25T17:23:57.987 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-25T17:23:57.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.987+0000 7fbb905b7700 1 -- 172.21.15.37:0/4188837003 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fbb74076b80 msgr2=0x7fbb74079030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:23:57.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.987+0000 7fbb905b7700 1 --2- 172.21.15.37:0/4188837003 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fbb74076b80 0x7fbb74079030 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbb88066000 tx=0x7fbb84009da0 comp rx=0 tx=0).stop 2024-04-25T17:23:57.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.987+0000 7fbb905b7700 1 -- 172.21.15.37:0/4188837003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb880ffee0 msgr2=0x7fbb8810df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:23:57.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.987+0000 7fbb905b7700 1 --2- 172.21.15.37:0/4188837003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb880ffee0 0x7fbb8810df40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbb78009150 tx=0x7fbb78009e30 comp rx=0 tx=0).stop 2024-04-25T17:23:57.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.987+0000 7fbb905b7700 1 -- 172.21.15.37:0/4188837003 shutdown_connections 2024-04-25T17:23:57.988 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.987+0000 7fbb905b7700 1 --2- 172.21.15.37:0/4188837003 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fbb74076b80 0x7fbb74079030 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:57.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.987+0000 7fbb905b7700 1 --2- 172.21.15.37:0/4188837003 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb880662c0 0x7fbb8810da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:57.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.987+0000 7fbb905b7700 1 --2- 172.21.15.37:0/4188837003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb880ffee0 0x7fbb8810df40 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:57.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.987+0000 7fbb905b7700 1 -- 172.21.15.37:0/4188837003 >> 172.21.15.37:0/4188837003 conn(0x7fbb880f7430 msgr2=0x7fbb880f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:23:57.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.988+0000 7fbb905b7700 1 -- 172.21.15.37:0/4188837003 shutdown_connections 2024-04-25T17:23:57.989 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:57.988+0000 7fbb905b7700 1 -- 172.21.15.37:0/4188837003 wait complete. 2024-04-25T17:23:58.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:57 smithi037 ceph-mon[90844]: pgmap v99: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 208 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 30/228 objects degraded (13.158%) 2024-04-25T17:23:58.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:57 smithi037 ceph-mon[90844]: osdmap e64: 6 total, 6 up, 6 in 2024-04-25T17:23:58.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:57 smithi037 ceph-mon[90844]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:23:58.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:57 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:23:58.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:57 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:23:58.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.096+0000 7f38e3ae6700 1 -- 172.21.15.37:0/3843664863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38dc0fe3e0 msgr2=0x7f38dc0fe7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:23:58.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.096+0000 7f38e3ae6700 1 --2- 172.21.15.37:0/3843664863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38dc0fe3e0 0x7f38dc0fe7f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f38d8004940 tx=0x7f38d8009e30 comp rx=0 tx=0).stop 2024-04-25T17:23:58.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.096+0000 7f38e3ae6700 1 -- 172.21.15.37:0/3843664863 shutdown_connections 2024-04-25T17:23:58.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.096+0000 7f38e3ae6700 1 --2- 172.21.15.37:0/3843664863 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f38dc0fed30 0x7f38dc0fae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:58.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.096+0000 7f38e3ae6700 1 --2- 172.21.15.37:0/3843664863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38dc0fe3e0 0x7f38dc0fe7f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:58.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.096+0000 7f38e3ae6700 1 -- 172.21.15.37:0/3843664863 >> 172.21.15.37:0/3843664863 conn(0x7f38dc0f6b80 msgr2=0x7f38dc0f8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:23:58.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.096+0000 7f38e3ae6700 1 -- 172.21.15.37:0/3843664863 shutdown_connections 2024-04-25T17:23:58.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.096+0000 7f38e3ae6700 1 -- 172.21.15.37:0/3843664863 wait complete. 2024-04-25T17:23:58.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.097+0000 7f38e3ae6700 1 Processor -- start 2024-04-25T17:23:58.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.097+0000 7f38e3ae6700 1 -- start start 2024-04-25T17:23:58.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.097+0000 7f38e3ae6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38dc0fe3e0 0x7f38dc0fdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:23:58.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.097+0000 7f38e3ae6700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f38dc0fed30 0x7f38dc0fc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:23:58.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.097+0000 7f38e3ae6700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc0fc650 con 0x7f38dc0fe3e0 2024-04-25T17:23:58.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.097+0000 7f38e3ae6700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc0fc7c0 con 0x7f38dc0fed30 2024-04-25T17:23:58.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.097+0000 7f38e1882700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38dc0fe3e0 0x7f38dc0fdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:23:58.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.097+0000 7f38e1882700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38dc0fe3e0 0x7f38dc0fdbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49762/0 (socket says 172.21.15.37:49762) 2024-04-25T17:23:58.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.097+0000 7f38e1882700 1 -- 172.21.15.37:0/1943869357 learned_addr learned my addr 172.21.15.37:0/1943869357 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:23:58.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.097+0000 7f38e1081700 1 --2- 172.21.15.37:0/1943869357 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f38dc0fed30 0x7f38dc0fc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:23:58.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.098+0000 7f38e1882700 1 -- 172.21.15.37:0/1943869357 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f38dc0fed30 msgr2=0x7f38dc0fc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:23:58.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.098+0000 7f38e1882700 1 --2- 172.21.15.37:0/1943869357 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f38dc0fed30 0x7f38dc0fc0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:58.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.098+0000 7f38e1882700 1 -- 172.21.15.37:0/1943869357 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d8005040 con 0x7f38dc0fe3e0 2024-04-25T17:23:58.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.098+0000 7f38e1882700 1 --2- 172.21.15.37:0/1943869357 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38dc0fe3e0 0x7f38dc0fdbd0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f38d8013870 tx=0x7f38d8009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:23:58.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.098+0000 7f38ce7fc700 1 -- 172.21.15.37:0/1943869357 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38d800e070 con 0x7f38dc0fe3e0 2024-04-25T17:23:58.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.098+0000 7f38e3ae6700 1 -- 172.21.15.37:0/1943869357 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38dc0fca40 con 0x7f38dc0fe3e0 2024-04-25T17:23:58.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.098+0000 7f38ce7fc700 1 -- 172.21.15.37:0/1943869357 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f38d8013de0 con 0x7f38dc0fe3e0 2024-04-25T17:23:58.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.098+0000 7f38ce7fc700 1 -- 172.21.15.37:0/1943869357 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38d801cea0 con 0x7f38dc0fe3e0 2024-04-25T17:23:58.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.098+0000 7f38e3ae6700 1 -- 172.21.15.37:0/1943869357 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38dc0fcf20 con 0x7f38dc0fe3e0 2024-04-25T17:23:58.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.099+0000 7f38e3ae6700 1 -- 172.21.15.37:0/1943869357 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38dc05f5c0 con 0x7f38dc0fe3e0 2024-04-25T17:23:58.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.100+0000 7f38ce7fc700 1 -- 172.21.15.37:0/1943869357 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f38d801c690 con 0x7f38dc0fe3e0 2024-04-25T17:23:58.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.100+0000 7f38ce7fc700 1 --2- 172.21.15.37:0/1943869357 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f38c8076b80 0x7f38c8079030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:23:58.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.100+0000 7f38ce7fc700 1 -- 172.21.15.37:0/1943869357 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f38d80999f0 con 0x7f38dc0fe3e0 2024-04-25T17:23:58.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.100+0000 7f38e1081700 1 --2- 172.21.15.37:0/1943869357 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f38c8076b80 0x7f38c8079030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:23:58.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.101+0000 7f38e1081700 1 --2- 172.21.15.37:0/1943869357 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f38c8076b80 0x7f38c8079030 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f38d0004fd0 tx=0x7f38d000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:23:58.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.105+0000 7f38ce7fc700 1 -- 172.21.15.37:0/1943869357 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f38d809be60 con 0x7f38dc0fe3e0 2024-04-25T17:23:58.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:57 smithi069 ceph-mon[80239]: pgmap v99: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 208 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 30/228 objects degraded (13.158%) 2024-04-25T17:23:58.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:57 smithi069 ceph-mon[80239]: osdmap e64: 6 total, 6 up, 6 in 2024-04-25T17:23:58.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:57 smithi069 ceph-mon[80239]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:23:58.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:57 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:23:58.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:57 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:23:58.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.364+0000 7f38e3ae6700 1 -- 172.21.15.37:0/1943869357 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f38dc115b30 con 0x7f38dc0fe3e0 2024-04-25T17:23:58.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.364+0000 7f38ce7fc700 1 -- 172.21.15.37:0/1943869357 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1900 (secure 0 0 0) 0x7f38d80625f0 con 0x7f38dc0fe3e0 2024-04-25T17:23:58.366 INFO:teuthology.orchestra.run.smithi037.stdout:e16 2024-04-25T17:23:58.366 INFO:teuthology.orchestra.run.smithi037.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-25T17:23:58.366 INFO:teuthology.orchestra.run.smithi037.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T17:23:58.366 INFO:teuthology.orchestra.run.smithi037.stdout:legacy client fscid: 1 2024-04-25T17:23:58.366 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:23:58.366 INFO:teuthology.orchestra.run.smithi037.stdout:Filesystem 'cephfs' (1) 2024-04-25T17:23:58.366 INFO:teuthology.orchestra.run.smithi037.stdout:fs_name cephfs 2024-04-25T17:23:58.366 INFO:teuthology.orchestra.run.smithi037.stdout:epoch 16 2024-04-25T17:23:58.366 INFO:teuthology.orchestra.run.smithi037.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-25T17:23:58.366 INFO:teuthology.orchestra.run.smithi037.stdout:created 2024-04-25T17:15:40.586130+0000 2024-04-25T17:23:58.366 INFO:teuthology.orchestra.run.smithi037.stdout:modified 2024-04-25T17:15:57.508740+0000 2024-04-25T17:23:58.367 INFO:teuthology.orchestra.run.smithi037.stdout:tableserver 0 2024-04-25T17:23:58.367 INFO:teuthology.orchestra.run.smithi037.stdout:root 0 2024-04-25T17:23:58.367 INFO:teuthology.orchestra.run.smithi037.stdout:session_timeout 60 2024-04-25T17:23:58.367 INFO:teuthology.orchestra.run.smithi037.stdout:session_autoclose 300 2024-04-25T17:23:58.367 INFO:teuthology.orchestra.run.smithi037.stdout:max_file_size 1099511627776 2024-04-25T17:23:58.367 INFO:teuthology.orchestra.run.smithi037.stdout:max_xattr_size 65536 2024-04-25T17:23:58.367 INFO:teuthology.orchestra.run.smithi037.stdout:required_client_features {} 2024-04-25T17:23:58.367 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure 0 2024-04-25T17:23:58.367 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure_osd_epoch 0 2024-04-25T17:23:58.367 INFO:teuthology.orchestra.run.smithi037.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T17:23:58.367 INFO:teuthology.orchestra.run.smithi037.stdout:max_mds 1 2024-04-25T17:23:58.367 INFO:teuthology.orchestra.run.smithi037.stdout:in 0 2024-04-25T17:23:58.368 INFO:teuthology.orchestra.run.smithi037.stdout:up {0=14470} 2024-04-25T17:23:58.368 INFO:teuthology.orchestra.run.smithi037.stdout:failed 2024-04-25T17:23:58.368 INFO:teuthology.orchestra.run.smithi037.stdout:damaged 2024-04-25T17:23:58.368 INFO:teuthology.orchestra.run.smithi037.stdout:stopped 2024-04-25T17:23:58.368 INFO:teuthology.orchestra.run.smithi037.stdout:data_pools [3] 2024-04-25T17:23:58.368 INFO:teuthology.orchestra.run.smithi037.stdout:metadata_pool 2 2024-04-25T17:23:58.368 INFO:teuthology.orchestra.run.smithi037.stdout:inline_data disabled 2024-04-25T17:23:58.368 INFO:teuthology.orchestra.run.smithi037.stdout:balancer 2024-04-25T17:23:58.368 INFO:teuthology.orchestra.run.smithi037.stdout:bal_rank_mask -1 2024-04-25T17:23:58.368 INFO:teuthology.orchestra.run.smithi037.stdout:standby_count_wanted 1 2024-04-25T17:23:58.368 INFO:teuthology.orchestra.run.smithi037.stdout:qdb_cluster leader: 0 members: 2024-04-25T17:23:58.368 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi037.ksmixc{0:14470} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.37:6826/1903989494,v1:172.21.15.37:6827/1903989494] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:23:58.369 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi037.ovkrpq{0:14482} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.37:6828/4206394422,v1:172.21.15.37:6829/4206394422] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:23:58.369 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:23:58.369 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:23:58.369 INFO:teuthology.orchestra.run.smithi037.stdout:Standby daemons: 2024-04-25T17:23:58.369 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:23:58.369 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi069.cpprst{-1:24289} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.69:6826/518856100,v1:172.21.15.69:6827/518856100] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:23:58.369 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi069.ytlqcf{-1:24293} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.69:6824/134210439,v1:172.21.15.69:6825/134210439] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:23:58.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.367+0000 7f38e3ae6700 1 -- 172.21.15.37:0/1943869357 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f38c8076b80 msgr2=0x7f38c8079030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:23:58.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.367+0000 7f38e3ae6700 1 --2- 172.21.15.37:0/1943869357 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f38c8076b80 0x7f38c8079030 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f38d0004fd0 tx=0x7f38d000b040 comp rx=0 tx=0).stop 2024-04-25T17:23:58.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.367+0000 7f38e3ae6700 1 -- 172.21.15.37:0/1943869357 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38dc0fe3e0 msgr2=0x7f38dc0fdbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:23:58.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.367+0000 7f38e3ae6700 1 --2- 172.21.15.37:0/1943869357 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38dc0fe3e0 0x7f38dc0fdbd0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f38d8013870 tx=0x7f38d8009e30 comp rx=0 tx=0).stop 2024-04-25T17:23:58.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.368+0000 7f38e3ae6700 1 -- 172.21.15.37:0/1943869357 shutdown_connections 2024-04-25T17:23:58.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.368+0000 7f38e3ae6700 1 --2- 172.21.15.37:0/1943869357 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f38c8076b80 0x7f38c8079030 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:58.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.368+0000 7f38e3ae6700 1 --2- 172.21.15.37:0/1943869357 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f38dc0fe3e0 0x7f38dc0fdbd0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:58.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.368+0000 7f38e3ae6700 1 --2- 172.21.15.37:0/1943869357 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f38dc0fed30 0x7f38dc0fc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:58.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.368+0000 7f38e3ae6700 1 -- 172.21.15.37:0/1943869357 >> 172.21.15.37:0/1943869357 conn(0x7f38dc0f6b80 msgr2=0x7f38dc0f81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:23:58.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.368+0000 7f38e3ae6700 1 -- 172.21.15.37:0/1943869357 shutdown_connections 2024-04-25T17:23:58.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.368+0000 7f38e3ae6700 1 -- 172.21.15.37:0/1943869357 wait complete. 2024-04-25T17:23:58.371 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 16 2024-04-25T17:23:58.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.473+0000 7f1197bc0700 1 -- 172.21.15.37:0/1012138321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11900fcf70 msgr2=0x7f11900fd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:23:58.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.473+0000 7f1197bc0700 1 --2- 172.21.15.37:0/1012138321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11900fcf70 0x7f11900fd3e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1180004940 tx=0x7f1180009e30 comp rx=0 tx=0).stop 2024-04-25T17:23:58.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.474+0000 7f1197bc0700 1 -- 172.21.15.37:0/1012138321 shutdown_connections 2024-04-25T17:23:58.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.474+0000 7f1197bc0700 1 --2- 172.21.15.37:0/1012138321 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11900fcf70 0x7f11900fd3e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:58.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.474+0000 7f1197bc0700 1 --2- 172.21.15.37:0/1012138321 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11900fbcc0 0x7f11900fc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:58.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.474+0000 7f1197bc0700 1 -- 172.21.15.37:0/1012138321 >> 172.21.15.37:0/1012138321 conn(0x7f11900f7440 msgr2=0x7f11900f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:23:58.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.474+0000 7f1197bc0700 1 -- 172.21.15.37:0/1012138321 shutdown_connections 2024-04-25T17:23:58.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.474+0000 7f1197bc0700 1 -- 172.21.15.37:0/1012138321 wait complete. 2024-04-25T17:23:58.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.474+0000 7f1197bc0700 1 Processor -- start 2024-04-25T17:23:58.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.474+0000 7f1197bc0700 1 -- start start 2024-04-25T17:23:58.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.474+0000 7f1197bc0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11900fbcc0 0x7f119010d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:23:58.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.474+0000 7f1197bc0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11900fcf70 0x7f119010de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:23:58.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.474+0000 7f1197bc0700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119010e430 con 0x7f11900fcf70 2024-04-25T17:23:58.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.474+0000 7f1197bc0700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119010e5a0 con 0x7f11900fbcc0 2024-04-25T17:23:58.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.474+0000 7f119515b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11900fcf70 0x7f119010de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:23:58.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.474+0000 7f119515b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11900fcf70 0x7f119010de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49780/0 (socket says 172.21.15.37:49780) 2024-04-25T17:23:58.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.474+0000 7f119515b700 1 -- 172.21.15.37:0/1265064895 learned_addr learned my addr 172.21.15.37:0/1265064895 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:23:58.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.475+0000 7f119595c700 1 --2- 172.21.15.37:0/1265064895 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11900fbcc0 0x7f119010d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:23:58.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.475+0000 7f119515b700 1 -- 172.21.15.37:0/1265064895 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11900fbcc0 msgr2=0x7f119010d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:23:58.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.475+0000 7f119515b700 1 --2- 172.21.15.37:0/1265064895 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11900fbcc0 0x7f119010d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:58.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.475+0000 7f119515b700 1 -- 172.21.15.37:0/1265064895 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1180005040 con 0x7f11900fcf70 2024-04-25T17:23:58.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.475+0000 7f119515b700 1 --2- 172.21.15.37:0/1265064895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11900fcf70 0x7f119010de30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1180013870 tx=0x7f1180009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:23:58.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.475+0000 7f11867fc700 1 -- 172.21.15.37:0/1265064895 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1180021070 con 0x7f11900fcf70 2024-04-25T17:23:58.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.475+0000 7f11867fc700 1 -- 172.21.15.37:0/1265064895 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f118001c400 con 0x7f11900fcf70 2024-04-25T17:23:58.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.475+0000 7f1197bc0700 1 -- 172.21.15.37:0/1265064895 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1190112fa0 con 0x7f11900fcf70 2024-04-25T17:23:58.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.475+0000 7f11867fc700 1 -- 172.21.15.37:0/1265064895 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f118000e070 con 0x7f11900fcf70 2024-04-25T17:23:58.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.475+0000 7f1197bc0700 1 -- 172.21.15.37:0/1265064895 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1190113450 con 0x7f11900fcf70 2024-04-25T17:23:58.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.476+0000 7f1197bc0700 1 -- 172.21.15.37:0/1265064895 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1190101b00 con 0x7f11900fcf70 2024-04-25T17:23:58.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.477+0000 7f11867fc700 1 -- 172.21.15.37:0/1265064895 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f118001ca70 con 0x7f11900fcf70 2024-04-25T17:23:58.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.477+0000 7f11867fc700 1 --2- 172.21.15.37:0/1265064895 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f117c076b90 0x7f117c079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:23:58.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.478+0000 7f11867fc700 1 -- 172.21.15.37:0/1265064895 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f1180099440 con 0x7f11900fcf70 2024-04-25T17:23:58.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.478+0000 7f119595c700 1 --2- 172.21.15.37:0/1265064895 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f117c076b90 0x7f117c079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:23:58.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.478+0000 7f119595c700 1 --2- 172.21.15.37:0/1265064895 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f117c076b90 0x7f117c079040 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f118c009b80 tx=0x7f118c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:23:58.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.483+0000 7f11867fc700 1 -- 172.21.15.37:0/1265064895 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f1180062040 con 0x7f11900fcf70 2024-04-25T17:23:58.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.712+0000 7f1197bc0700 1 -- 172.21.15.37:0/1265064895 --> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f119002b410 con 0x7f117c076b90 2024-04-25T17:23:58.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.714+0000 7f11867fc700 1 -- 172.21.15.37:0/1265064895 <== mgr.34104 v2:172.21.15.37:6800/783197737 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f119002b410 con 0x7f117c076b90 2024-04-25T17:23:58.714 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-25T17:23:58.714 INFO:teuthology.orchestra.run.smithi037.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385", 2024-04-25T17:23:58.715 INFO:teuthology.orchestra.run.smithi037.stdout: "in_progress": true, 2024-04-25T17:23:58.715 INFO:teuthology.orchestra.run.smithi037.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-25T17:23:58.715 INFO:teuthology.orchestra.run.smithi037.stdout: "services_complete": [ 2024-04-25T17:23:58.715 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr", 2024-04-25T17:23:58.715 INFO:teuthology.orchestra.run.smithi037.stdout: "crash", 2024-04-25T17:23:58.715 INFO:teuthology.orchestra.run.smithi037.stdout: "mon" 2024-04-25T17:23:58.715 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-04-25T17:23:58.715 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": "9/21 daemons upgraded", 2024-04-25T17:23:58.715 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "Currently upgrading osd daemons", 2024-04-25T17:23:58.715 INFO:teuthology.orchestra.run.smithi037.stdout: "is_paused": false 2024-04-25T17:23:58.715 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-25T17:23:58.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.716+0000 7f1197bc0700 1 -- 172.21.15.37:0/1265064895 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f117c076b90 msgr2=0x7f117c079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:23:58.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.716+0000 7f1197bc0700 1 --2- 172.21.15.37:0/1265064895 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f117c076b90 0x7f117c079040 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f118c009b80 tx=0x7f118c00b040 comp rx=0 tx=0).stop 2024-04-25T17:23:58.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.716+0000 7f1197bc0700 1 -- 172.21.15.37:0/1265064895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11900fcf70 msgr2=0x7f119010de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:23:58.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.716+0000 7f1197bc0700 1 --2- 172.21.15.37:0/1265064895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11900fcf70 0x7f119010de30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1180013870 tx=0x7f1180009e30 comp rx=0 tx=0).stop 2024-04-25T17:23:58.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.716+0000 7f1197bc0700 1 -- 172.21.15.37:0/1265064895 shutdown_connections 2024-04-25T17:23:58.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.716+0000 7f1197bc0700 1 --2- 172.21.15.37:0/1265064895 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f117c076b90 0x7f117c079040 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:58.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.716+0000 7f1197bc0700 1 --2- 172.21.15.37:0/1265064895 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11900fbcc0 0x7f119010d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:58.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.716+0000 7f1197bc0700 1 --2- 172.21.15.37:0/1265064895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11900fcf70 0x7f119010de30 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:58.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.716+0000 7f1197bc0700 1 -- 172.21.15.37:0/1265064895 >> 172.21.15.37:0/1265064895 conn(0x7f11900f7440 msgr2=0x7f11900667f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:23:58.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.717+0000 7f1197bc0700 1 -- 172.21.15.37:0/1265064895 shutdown_connections 2024-04-25T17:23:58.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.717+0000 7f1197bc0700 1 -- 172.21.15.37:0/1265064895 wait complete. 2024-04-25T17:23:58.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.821+0000 7fa090438700 1 -- 172.21.15.37:0/995209334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0880fed30 msgr2=0x7fa0880fae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:23:58.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.821+0000 7fa090438700 1 --2- 172.21.15.37:0/995209334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0880fed30 0x7fa0880fae70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa07c004940 tx=0x7fa07c009e30 comp rx=0 tx=0).stop 2024-04-25T17:23:58.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.821+0000 7fa090438700 1 -- 172.21.15.37:0/995209334 shutdown_connections 2024-04-25T17:23:58.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.821+0000 7fa090438700 1 --2- 172.21.15.37:0/995209334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0880fed30 0x7fa0880fae70 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:58.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.821+0000 7fa090438700 1 --2- 172.21.15.37:0/995209334 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa0880fe3e0 0x7fa0880fe7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:58.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.821+0000 7fa090438700 1 -- 172.21.15.37:0/995209334 >> 172.21.15.37:0/995209334 conn(0x7fa0880f6b80 msgr2=0x7fa0880f8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:23:58.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.821+0000 7fa090438700 1 -- 172.21.15.37:0/995209334 shutdown_connections 2024-04-25T17:23:58.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.821+0000 7fa090438700 1 -- 172.21.15.37:0/995209334 wait complete. 2024-04-25T17:23:58.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.822+0000 7fa090438700 1 Processor -- start 2024-04-25T17:23:58.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.822+0000 7fa090438700 1 -- start start 2024-04-25T17:23:58.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.822+0000 7fa090438700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa0880fe3e0 0x7fa08810fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:23:58.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.822+0000 7fa090438700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0880fed30 0x7fa0881100b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:23:58.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.822+0000 7fa090438700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0881106b0 con 0x7fa0880fed30 2024-04-25T17:23:58.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.822+0000 7fa090438700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa088110f00 con 0x7fa0880fe3e0 2024-04-25T17:23:58.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.822+0000 7fa08d9d3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0880fed30 0x7fa0881100b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:23:58.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.822+0000 7fa08d9d3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0880fed30 0x7fa0881100b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:49810/0 (socket says 172.21.15.37:49810) 2024-04-25T17:23:58.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.822+0000 7fa08d9d3700 1 -- 172.21.15.37:0/1531089516 learned_addr learned my addr 172.21.15.37:0/1531089516 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:23:58.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.822+0000 7fa08e1d4700 1 --2- 172.21.15.37:0/1531089516 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa0880fe3e0 0x7fa08810fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:23:58.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.822+0000 7fa08d9d3700 1 -- 172.21.15.37:0/1531089516 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa0880fe3e0 msgr2=0x7fa08810fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:23:58.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.822+0000 7fa08d9d3700 1 --2- 172.21.15.37:0/1531089516 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa0880fe3e0 0x7fa08810fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:58.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.823+0000 7fa08d9d3700 1 -- 172.21.15.37:0/1531089516 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa07c005040 con 0x7fa0880fed30 2024-04-25T17:23:58.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.823+0000 7fa08d9d3700 1 --2- 172.21.15.37:0/1531089516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0880fed30 0x7fa0881100b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa07c013870 tx=0x7fa07c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:23:58.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.823+0000 7fa086ffd700 1 -- 172.21.15.37:0/1531089516 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa07c021070 con 0x7fa0880fed30 2024-04-25T17:23:58.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.823+0000 7fa086ffd700 1 -- 172.21.15.37:0/1531089516 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa07c01c400 con 0x7fa0880fed30 2024-04-25T17:23:58.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.823+0000 7fa090438700 1 -- 172.21.15.37:0/1531089516 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa088111180 con 0x7fa0880fed30 2024-04-25T17:23:58.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.823+0000 7fa086ffd700 1 -- 172.21.15.37:0/1531089516 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa07c00e070 con 0x7fa0880fed30 2024-04-25T17:23:58.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.823+0000 7fa090438700 1 -- 172.21.15.37:0/1531089516 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0881116c0 con 0x7fa0880fed30 2024-04-25T17:23:58.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.824+0000 7fa090438700 1 -- 172.21.15.37:0/1531089516 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa088101b20 con 0x7fa0880fed30 2024-04-25T17:23:58.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.825+0000 7fa086ffd700 1 -- 172.21.15.37:0/1531089516 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7fa07c01ca20 con 0x7fa0880fed30 2024-04-25T17:23:58.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.825+0000 7fa086ffd700 1 --2- 172.21.15.37:0/1531089516 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fa070076b90 0x7fa070079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:23:58.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.825+0000 7fa086ffd700 1 -- 172.21.15.37:0/1531089516 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fa07c099510 con 0x7fa0880fed30 2024-04-25T17:23:58.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.825+0000 7fa08e1d4700 1 --2- 172.21.15.37:0/1531089516 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fa070076b90 0x7fa070079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:23:58.827 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.826+0000 7fa08e1d4700 1 --2- 172.21.15.37:0/1531089516 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fa070076b90 0x7fa070079040 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa080004600 tx=0x7fa08000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:23:58.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:58.830+0000 7fa086ffd700 1 -- 172.21.15.37:0/1531089516 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fa07c062110 con 0x7fa0880fed30 2024-04-25T17:23:58.964 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:58 smithi037 ceph-mon[90844]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:23:58.964 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:58 smithi037 ceph-mon[90844]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:23:58.964 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:58 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:23:58.964 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:58 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:23:58.964 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:58 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:23:58.964 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:58 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:23:58.964 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:58 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:23:58.964 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:58 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/4188837003' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:23:58.964 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:58 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:23:58.964 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:58 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:23:59.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:59.126+0000 7fa090438700 1 -- 172.21.15.37:0/1531089516 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fa08805f5c0 con 0x7fa0880fed30 2024-04-25T17:23:59.127 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:59.126+0000 7fa086ffd700 1 -- 172.21.15.37:0/1531089516 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+570 (secure 0 0 0) 0x7fa07c004490 con 0x7fa0880fed30 2024-04-25T17:23:59.127 INFO:teuthology.orchestra.run.smithi037.stdout:HEALTH_WARN Degraded data redundancy: 18/228 objects degraded (7.895%), 7 pgs degraded 2024-04-25T17:23:59.127 INFO:teuthology.orchestra.run.smithi037.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 18/228 objects degraded (7.895%), 7 pgs degraded 2024-04-25T17:23:59.127 INFO:teuthology.orchestra.run.smithi037.stdout: pg 2.1 is active+undersized+degraded, acting [1,0] 2024-04-25T17:23:59.127 INFO:teuthology.orchestra.run.smithi037.stdout: pg 2.c is active+undersized+degraded, acting [3,0] 2024-04-25T17:23:59.127 INFO:teuthology.orchestra.run.smithi037.stdout: pg 2.e is active+undersized+degraded, acting [0,3] 2024-04-25T17:23:59.127 INFO:teuthology.orchestra.run.smithi037.stdout: pg 2.10 is active+undersized+degraded, acting [1,0] 2024-04-25T17:23:59.127 INFO:teuthology.orchestra.run.smithi037.stdout: pg 2.13 is active+undersized+degraded, acting [0,4] 2024-04-25T17:23:59.128 INFO:teuthology.orchestra.run.smithi037.stdout: pg 2.19 is active+undersized+degraded, acting [0,4] 2024-04-25T17:23:59.128 INFO:teuthology.orchestra.run.smithi037.stdout: pg 2.1e is active+undersized+degraded, acting [0,5] 2024-04-25T17:23:59.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:59.128+0000 7fa090438700 1 -- 172.21.15.37:0/1531089516 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fa070076b90 msgr2=0x7fa070079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:23:59.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:59.128+0000 7fa090438700 1 --2- 172.21.15.37:0/1531089516 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fa070076b90 0x7fa070079040 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa080004600 tx=0x7fa08000b040 comp rx=0 tx=0).stop 2024-04-25T17:23:59.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:59.128+0000 7fa090438700 1 -- 172.21.15.37:0/1531089516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0880fed30 msgr2=0x7fa0881100b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:23:59.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:59.128+0000 7fa090438700 1 --2- 172.21.15.37:0/1531089516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0880fed30 0x7fa0881100b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa07c013870 tx=0x7fa07c009e30 comp rx=0 tx=0).stop 2024-04-25T17:23:59.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:59.128+0000 7fa090438700 1 -- 172.21.15.37:0/1531089516 shutdown_connections 2024-04-25T17:23:59.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:59.128+0000 7fa090438700 1 --2- 172.21.15.37:0/1531089516 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fa070076b90 0x7fa070079040 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:59.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:59.128+0000 7fa090438700 1 --2- 172.21.15.37:0/1531089516 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa0880fe3e0 0x7fa08810fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:59.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:59.128+0000 7fa090438700 1 --2- 172.21.15.37:0/1531089516 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa0880fed30 0x7fa0881100b0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:23:59.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:59.128+0000 7fa090438700 1 -- 172.21.15.37:0/1531089516 >> 172.21.15.37:0/1531089516 conn(0x7fa0880f6b80 msgr2=0x7fa0880f8160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:23:59.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:59.128+0000 7fa090438700 1 -- 172.21.15.37:0/1531089516 shutdown_connections 2024-04-25T17:23:59.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:23:59.128+0000 7fa090438700 1 -- 172.21.15.37:0/1531089516 wait complete. 2024-04-25T17:23:59.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:58 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:23:59.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:58 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:23:59.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:58 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-25T17:23:59.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:58 smithi037 ceph-mon[90844]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-25T17:23:59.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:58 smithi037 ceph-mon[90844]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-04-25T17:23:59.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:58 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/1943869357' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T17:23:59.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:58 smithi069 ceph-mon[80239]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:23:59.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:58 smithi069 ceph-mon[80239]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:23:59.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:58 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:23:59.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:58 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:23:59.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:58 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:23:59.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:58 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:23:59.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:58 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:23:59.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:58 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/4188837003' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:23:59.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:58 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:23:59.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:58 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:23:59.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:58 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:23:59.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:58 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:23:59.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:58 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-25T17:23:59.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:58 smithi069 ceph-mon[80239]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-25T17:23:59.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:58 smithi069 ceph-mon[80239]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-04-25T17:23:59.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:58 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/1943869357' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T17:24:00.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:59 smithi037 ceph-mon[90844]: pgmap v101: 65 pgs: 7 active+undersized+degraded, 7 active+undersized, 51 active+clean; 208 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 18/228 objects degraded (7.895%) 2024-04-25T17:24:00.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:59 smithi037 ceph-mon[90844]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:24:00.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:59 smithi037 ceph-mon[90844]: Health check update: Degraded data redundancy: 18/228 objects degraded (7.895%), 7 pgs degraded (PG_DEGRADED) 2024-04-25T17:24:00.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:23:59 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/1531089516' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T17:24:00.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:59 smithi069 ceph-mon[80239]: pgmap v101: 65 pgs: 7 active+undersized+degraded, 7 active+undersized, 51 active+clean; 208 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 18/228 objects degraded (7.895%) 2024-04-25T17:24:00.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:59 smithi069 ceph-mon[80239]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:24:00.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:59 smithi069 ceph-mon[80239]: Health check update: Degraded data redundancy: 18/228 objects degraded (7.895%), 7 pgs degraded (PG_DEGRADED) 2024-04-25T17:24:00.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:23:59 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/1531089516' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T17:24:02.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:01 smithi037 ceph-mon[90844]: pgmap v102: 65 pgs: 2 active+undersized+degraded, 3 active+undersized, 60 active+clean; 208 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 760 B/s rd, 1 op/s; 4/228 objects degraded (1.754%) 2024-04-25T17:24:02.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:01 smithi069 ceph-mon[80239]: pgmap v102: 65 pgs: 2 active+undersized+degraded, 3 active+undersized, 60 active+clean; 208 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 760 B/s rd, 1 op/s; 4/228 objects degraded (1.754%) 2024-04-25T17:24:03.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:03 smithi037 ceph-mon[90844]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 4/228 objects degraded (1.754%), 2 pgs degraded) 2024-04-25T17:24:03.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:03 smithi037 ceph-mon[90844]: Cluster is now healthy 2024-04-25T17:24:03.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:03 smithi069 ceph-mon[80239]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 4/228 objects degraded (1.754%), 2 pgs degraded) 2024-04-25T17:24:03.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:03 smithi069 ceph-mon[80239]: Cluster is now healthy 2024-04-25T17:24:04.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:04 smithi037 ceph-mon[90844]: pgmap v103: 65 pgs: 65 active+clean; 208 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-04-25T17:24:04.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:04 smithi069 ceph-mon[80239]: pgmap v103: 65 pgs: 65 active+clean; 208 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-04-25T17:24:06.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:06 smithi037 ceph-mon[90844]: pgmap v104: 65 pgs: 65 active+clean; 208 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-25T17:24:06.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:06 smithi069 ceph-mon[80239]: pgmap v104: 65 pgs: 65 active+clean; 208 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-04-25T17:24:08.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:08 smithi037 ceph-mon[90844]: pgmap v105: 65 pgs: 65 active+clean; 208 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-04-25T17:24:08.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:08 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:24:08.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:08 smithi069 ceph-mon[80239]: pgmap v105: 65 pgs: 65 active+clean; 208 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-04-25T17:24:08.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:08 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:24:10.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:10 smithi037 ceph-mon[90844]: pgmap v106: 65 pgs: 65 active+clean; 208 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-25T17:24:10.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:10 smithi069 ceph-mon[80239]: pgmap v106: 65 pgs: 65 active+clean; 208 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-04-25T17:24:12.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:12 smithi037 ceph-mon[90844]: pgmap v107: 65 pgs: 65 active+clean; 208 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:24:12.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:12 smithi069 ceph-mon[80239]: pgmap v107: 65 pgs: 65 active+clean; 208 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:24:13.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:13 smithi069 ceph-mon[80239]: pgmap v108: 65 pgs: 65 active+clean; 208 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:24:13.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:13 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:24:13.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:13 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:24:13.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:13 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-25T17:24:13.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:13 smithi069 ceph-mon[80239]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-25T17:24:14.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:13 smithi037 ceph-mon[90844]: pgmap v108: 65 pgs: 65 active+clean; 208 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:24:14.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:13 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:24:14.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:13 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:24:14.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:13 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-25T17:24:14.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:13 smithi037 ceph-mon[90844]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-04-25T17:24:14.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:14 smithi069 ceph-mon[80239]: Upgrade: osd.3 is safe to restart 2024-04-25T17:24:15.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:14 smithi037 ceph-mon[90844]: Upgrade: osd.3 is safe to restart 2024-04-25T17:24:15.848 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:15 smithi069 ceph-mon[80239]: pgmap v109: 65 pgs: 65 active+clean; 208 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:24:15.848 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:15 smithi069 ceph-mon[80239]: Upgrade: Updating osd.3 2024-04-25T17:24:15.849 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:15 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:24:15.849 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:15 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-25T17:24:15.849 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:15 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:24:15.849 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:15 smithi069 ceph-mon[80239]: Deploying daemon osd.3 on smithi069 2024-04-25T17:24:16.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:15 smithi037 ceph-mon[90844]: pgmap v109: 65 pgs: 65 active+clean; 208 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:24:16.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:15 smithi037 ceph-mon[90844]: Upgrade: Updating osd.3 2024-04-25T17:24:16.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:15 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:24:16.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:15 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-04-25T17:24:16.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:15 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:24:16.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:15 smithi037 ceph-mon[90844]: Deploying daemon osd.3 on smithi069 2024-04-25T17:24:18.049 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:17 smithi069 ceph-mon[80239]: pgmap v110: 65 pgs: 65 active+clean; 208 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:24:18.050 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:24:17 smithi069 systemd[1]: Stopping Ceph osd.3 for 599bb7fc-0326-11ef-bc93-c7b262605968... 2024-04-25T17:24:18.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:17 smithi037 ceph-mon[90844]: pgmap v110: 65 pgs: 65 active+clean; 208 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:24:18.418 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:24:18 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-3[40102]: 2024-04-25T17:24:18.051+0000 7fbc2dfac700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T17:24:18.419 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:24:18 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-3[40102]: 2024-04-25T17:24:18.051+0000 7fbc2dfac700 -1 osd.3 64 *** Got signal Terminated *** 2024-04-25T17:24:18.419 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:24:18 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-3[40102]: 2024-04-25T17:24:18.051+0000 7fbc2dfac700 -1 osd.3 64 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T17:24:18.981 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:18 smithi069 ceph-mon[80239]: osd.3 marked itself down and dead 2024-04-25T17:24:19.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:18 smithi037 ceph-mon[90844]: osd.3 marked itself down and dead 2024-04-25T17:24:19.419 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:24:19 smithi069 podman[89179]: 2024-04-25 17:24:19.161528259 +0000 UTC m=+1.215713913 container died ebba78fb192391b38353c082564e9b67706f16e2d319c80c09b0c00d6754e494 (image=quay.ceph.io/ceph-ci/ceph@sha256:27d43f80a23d3545096a7bb490598a6f37852da2940e69e5a8f3e3d7fb58fd17, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-3, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=quincy-c61472c, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS) 2024-04-25T17:24:19.728 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:24:19 smithi069 podman[89179]: 2024-04-25 17:24:19.535158886 +0000 UTC m=+1.589344529 container cleanup ebba78fb192391b38353c082564e9b67706f16e2d319c80c09b0c00d6754e494 (image=quay.ceph.io/ceph-ci/ceph@sha256:27d43f80a23d3545096a7bb490598a6f37852da2940e69e5a8f3e3d7fb58fd17, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-3, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.vendor=CentOS, RELEASE=quincy-c61472c, maintainer=Guillaume Abrioux ) 2024-04-25T17:24:19.728 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:24:19 smithi069 bash[89179]: ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-3 2024-04-25T17:24:19.728 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:24:19 smithi069 podman[89208]: 2024-04-25 17:24:19.694571422 +0000 UTC m=+0.535278016 container remove ebba78fb192391b38353c082564e9b67706f16e2d319c80c09b0c00d6754e494 (image=quay.ceph.io/ceph-ci/ceph@sha256:27d43f80a23d3545096a7bb490598a6f37852da2940e69e5a8f3e3d7fb58fd17, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-3, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, RELEASE=quincy-c61472c, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T17:24:20.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:19 smithi037 ceph-mon[90844]: pgmap v111: 65 pgs: 65 active+clean; 208 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:24:20.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:19 smithi037 ceph-mon[90844]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-25T17:24:20.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:19 smithi037 ceph-mon[90844]: osdmap e65: 6 total, 5 up, 6 in 2024-04-25T17:24:20.095 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:19 smithi069 ceph-mon[80239]: pgmap v111: 65 pgs: 65 active+clean; 208 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:24:20.096 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:19 smithi069 ceph-mon[80239]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-25T17:24:20.096 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:19 smithi069 ceph-mon[80239]: osdmap e65: 6 total, 5 up, 6 in 2024-04-25T17:24:20.406 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:24:20 smithi069 podman[89303]: 2024-04-25 17:24:20.095474839 +0000 UTC m=+0.103860656 container create 57e14b085f892d86bba162d52c0278b46adede2d60023b171ebeba021cafc02b (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-3-deactivate, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-04-25T17:24:20.406 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:24:20 smithi069 podman[89303]: 2024-04-25 17:24:20.009789686 +0000 UTC m=+0.018175531 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T17:24:20.406 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:24:20 smithi069 podman[89303]: 2024-04-25 17:24:20.331333831 +0000 UTC m=+0.339719648 container init 57e14b085f892d86bba162d52c0278b46adede2d60023b171ebeba021cafc02b (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-3-deactivate, ceph=True, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux ) 2024-04-25T17:24:20.407 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:24:20 smithi069 podman[89303]: 2024-04-25 17:24:20.334564687 +0000 UTC m=+0.342950511 container start 57e14b085f892d86bba162d52c0278b46adede2d60023b171ebeba021cafc02b (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-04-25T17:24:20.407 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:24:20 smithi069 podman[89303]: 2024-04-25 17:24:20.40620715 +0000 UTC m=+0.414592975 container attach 57e14b085f892d86bba162d52c0278b46adede2d60023b171ebeba021cafc02b (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux ) 2024-04-25T17:24:20.668 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:24:20 smithi069 podman[89303]: 2024-04-25 17:24:20.618035113 +0000 UTC m=+0.626420930 container died 57e14b085f892d86bba162d52c0278b46adede2d60023b171ebeba021cafc02b (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-04-25T17:24:21.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:20 smithi037 ceph-mon[90844]: osdmap e66: 6 total, 5 up, 6 in 2024-04-25T17:24:21.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:20 smithi069 ceph-mon[80239]: osdmap e66: 6 total, 5 up, 6 in 2024-04-25T17:24:21.440 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:24:21 smithi069 podman[89329]: 2024-04-25 17:24:21.218047918 +0000 UTC m=+0.594624257 container remove 57e14b085f892d86bba162d52c0278b46adede2d60023b171ebeba021cafc02b (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-04-25T17:24:21.441 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:24:21 smithi069 systemd[1]: ceph-599bb7fc-0326-11ef-bc93-c7b262605968@osd.3.service: Deactivated successfully. 2024-04-25T17:24:21.441 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:24:21 smithi069 systemd[1]: Stopped Ceph osd.3 for 599bb7fc-0326-11ef-bc93-c7b262605968. 2024-04-25T17:24:21.441 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:24:21 smithi069 systemd[1]: ceph-599bb7fc-0326-11ef-bc93-c7b262605968@osd.3.service: Consumed 1min 17.115s CPU time. 2024-04-25T17:24:21.739 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:24:21 smithi069 systemd[1]: Starting Ceph osd.3 for 599bb7fc-0326-11ef-bc93-c7b262605968... 2024-04-25T17:24:21.739 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:24:21 smithi069 podman[89430]: 2024-04-25 17:24:21.559053496 +0000 UTC m=+0.017991587 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T17:24:21.740 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:24:21 smithi069 podman[89430]: 2024-04-25 17:24:21.669101105 +0000 UTC m=+0.128039183 container create fd38b54bffc0c98a7abf1f9b02f41ffc5e260b66004e31e3d8eae00e1d147f0d (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-3-activate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424) 2024-04-25T17:24:22.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:21 smithi037 ceph-mon[90844]: pgmap v114: 65 pgs: 4 peering, 15 stale+active+clean, 46 active+clean; 208 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:24:22.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:21 smithi037 ceph-mon[90844]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-04-25T17:24:22.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:21 smithi069 ceph-mon[80239]: pgmap v114: 65 pgs: 4 peering, 15 stale+active+clean, 46 active+clean; 208 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:24:22.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:21 smithi069 ceph-mon[80239]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-04-25T17:24:22.169 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:24:21 smithi069 podman[89430]: 2024-04-25 17:24:21.896408837 +0000 UTC m=+0.355346915 container init fd38b54bffc0c98a7abf1f9b02f41ffc5e260b66004e31e3d8eae00e1d147f0d (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-3-activate, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-25T17:24:22.169 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:24:21 smithi069 podman[89430]: 2024-04-25 17:24:21.899901184 +0000 UTC m=+0.358839262 container start fd38b54bffc0c98a7abf1f9b02f41ffc5e260b66004e31e3d8eae00e1d147f0d (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-3-activate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2) 2024-04-25T17:24:22.169 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:24:21 smithi069 podman[89430]: 2024-04-25 17:24:21.979919664 +0000 UTC m=+0.438857753 container attach fd38b54bffc0c98a7abf1f9b02f41ffc5e260b66004e31e3d8eae00e1d147f0d (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-3-activate, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T17:24:22.792 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:24:22 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-3-activate[89444]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-25T17:24:22.792 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:24:22 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-3-activate[89444]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-25T17:24:22.792 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:24:22 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-3-activate[89444]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-25T17:24:22.792 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:24:22 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-3-activate[89444]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-04-25T17:24:22.792 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:24:22 smithi069 bash[89430]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-25T17:24:22.792 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:24:22 smithi069 bash[89430]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-25T17:24:22.792 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:24:22 smithi069 bash[89430]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-25T17:24:22.792 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:24:22 smithi069 bash[89430]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-04-25T17:24:22.792 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:24:22 smithi069 bash[89430]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-04-25T17:24:22.792 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:24:22 smithi069 bash[89430]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-04-25T17:24:22.792 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:24:22 smithi069 bash[89430]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-04-25T17:24:22.793 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:24:22 smithi069 bash[89430]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-25T17:24:22.793 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:24:22 smithi069 bash[89430]: --> ceph-volume raw activate successful for osd ID: 3 2024-04-25T17:24:22.793 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:24:22 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-3-activate[89444]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-04-25T17:24:22.793 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:24:22 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-3-activate[89444]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-04-25T17:24:22.793 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:24:22 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-3-activate[89444]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-04-25T17:24:22.793 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:24:22 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-3-activate[89444]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-25T17:24:22.793 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:24:22 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-3-activate[89444]: --> ceph-volume raw activate successful for osd ID: 3 2024-04-25T17:24:22.793 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:24:22 smithi069 podman[89430]: 2024-04-25 17:24:22.51298367 +0000 UTC m=+0.971921751 container died fd38b54bffc0c98a7abf1f9b02f41ffc5e260b66004e31e3d8eae00e1d147f0d (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-3-activate, ceph=True, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-04-25T17:24:23.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:22 smithi037 ceph-mon[90844]: Health check failed: Degraded data redundancy: 7/228 objects degraded (3.070%), 3 pgs degraded (PG_DEGRADED) 2024-04-25T17:24:23.117 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:22 smithi069 ceph-mon[80239]: Health check failed: Degraded data redundancy: 7/228 objects degraded (3.070%), 3 pgs degraded (PG_DEGRADED) 2024-04-25T17:24:23.419 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:24:23 smithi069 podman[89576]: 2024-04-25 17:24:23.116896954 +0000 UTC m=+0.598829620 container remove fd38b54bffc0c98a7abf1f9b02f41ffc5e260b66004e31e3d8eae00e1d147f0d (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-3-activate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-04-25T17:24:23.419 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:24:23 smithi069 podman[89640]: 2024-04-25 17:24:23.233577359 +0000 UTC m=+0.017842734 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T17:24:23.419 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:24:23 smithi069 podman[89640]: 2024-04-25 17:24:23.334277937 +0000 UTC m=+0.118543302 container create d1aa15d6b575a3cabcc36964c69b0727441790233d66a7e4bc61861702e77963 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-04-25T17:24:23.794 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:24:23 smithi069 podman[89640]: 2024-04-25 17:24:23.545745159 +0000 UTC m=+0.330010532 container init d1aa15d6b575a3cabcc36964c69b0727441790233d66a7e4bc61861702e77963 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-3, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, maintainer=Guillaume Abrioux ) 2024-04-25T17:24:23.795 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:24:23 smithi069 podman[89640]: 2024-04-25 17:24:23.548839501 +0000 UTC m=+0.333104858 container start d1aa15d6b575a3cabcc36964c69b0727441790233d66a7e4bc61861702e77963 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-3, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-04-25T17:24:23.795 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:24:23 smithi069 ceph-osd[89658]: -- 172.21.15.69:0/926262280 <== mon.1 v2:172.21.15.69:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55de89213680 con 0x55de892ba880 2024-04-25T17:24:23.795 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:24:23 smithi069 bash[89640]: d1aa15d6b575a3cabcc36964c69b0727441790233d66a7e4bc61861702e77963 2024-04-25T17:24:23.795 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:24:23 smithi069 systemd[1]: Started Ceph osd.3 for 599bb7fc-0326-11ef-bc93-c7b262605968. 2024-04-25T17:24:24.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:23 smithi037 ceph-mon[90844]: pgmap v115: 65 pgs: 3 active+undersized+degraded, 4 peering, 12 stale+active+clean, 4 active+undersized, 42 active+clean; 208 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 7/228 objects degraded (3.070%) 2024-04-25T17:24:24.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:23 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:24:24.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:23 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:24:24.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:23 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:24:24.112 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:23 smithi069 ceph-mon[80239]: pgmap v115: 65 pgs: 3 active+undersized+degraded, 4 peering, 12 stale+active+clean, 4 active+undersized, 42 active+clean; 208 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 7/228 objects degraded (3.070%) 2024-04-25T17:24:24.113 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:23 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:24:24.113 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:23 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:24:24.113 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:23 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:24:24.418 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:24:24 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-3[89654]: 2024-04-25T17:24:24.111+0000 7f96aad1e7c0 -1 Falling back to public interface 2024-04-25T17:24:25.142 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:24 smithi069 ceph-mon[80239]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-04-25T17:24:25.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:24 smithi037 ceph-mon[90844]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-04-25T17:24:26.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:25 smithi069 ceph-mon[80239]: pgmap v116: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 208 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 54/228 objects degraded (23.684%) 2024-04-25T17:24:26.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:25 smithi037 ceph-mon[90844]: pgmap v116: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 208 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 54/228 objects degraded (23.684%) 2024-04-25T17:24:27.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:27 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:24:27.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:27 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:24:27.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:27 smithi037 ceph-mon[90844]: pgmap v117: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 208 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 54/228 objects degraded (23.684%) 2024-04-25T17:24:27.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:27 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:24:27.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:27 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:24:27.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:27 smithi069 ceph-mon[80239]: pgmap v117: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 208 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 54/228 objects degraded (23.684%) 2024-04-25T17:24:28.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:28 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:24:28.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:28 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:24:28.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:28 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:24:28.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:28 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:24:29.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:28 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:24:29.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:28 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:24:29.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:28 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:24:29.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:28 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:24:29.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.247+0000 7f197434c700 1 -- 172.21.15.37:0/1864236949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f196c0fdfd0 msgr2=0x7f196c0fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:24:29.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.247+0000 7f197434c700 1 --2- 172.21.15.37:0/1864236949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f196c0fdfd0 0x7f196c0fe440 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f195c004940 tx=0x7f195c009e30 comp rx=0 tx=0).stop 2024-04-25T17:24:29.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.247+0000 7f197434c700 1 -- 172.21.15.37:0/1864236949 shutdown_connections 2024-04-25T17:24:29.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.247+0000 7f197434c700 1 --2- 172.21.15.37:0/1864236949 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f196c0fdfd0 0x7f196c0fe440 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:24:29.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.247+0000 7f197434c700 1 --2- 172.21.15.37:0/1864236949 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f196c0fce60 0x7f196c0fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:24:29.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.247+0000 7f197434c700 1 -- 172.21.15.37:0/1864236949 >> 172.21.15.37:0/1864236949 conn(0x7f196c0f8540 msgr2=0x7f196c0fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:24:29.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.247+0000 7f197434c700 1 -- 172.21.15.37:0/1864236949 shutdown_connections 2024-04-25T17:24:29.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.247+0000 7f197434c700 1 -- 172.21.15.37:0/1864236949 wait complete. 2024-04-25T17:24:29.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.248+0000 7f197434c700 1 Processor -- start 2024-04-25T17:24:29.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.248+0000 7f197434c700 1 -- start start 2024-04-25T17:24:29.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.248+0000 7f197434c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f196c0fce60 0x7f196c10d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:24:29.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.248+0000 7f197434c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f196c0fdfd0 0x7f196c10ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:24:29.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.248+0000 7f197434c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196c10e3c0 con 0x7f196c0fdfd0 2024-04-25T17:24:29.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.248+0000 7f197434c700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196c10e530 con 0x7f196c0fce60 2024-04-25T17:24:29.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.248+0000 7f19718e7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f196c0fdfd0 0x7f196c10ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:24:29.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.248+0000 7f19720e8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f196c0fce60 0x7f196c10d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:24:29.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.248+0000 7f19718e7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f196c0fdfd0 0x7f196c10ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46686/0 (socket says 172.21.15.37:46686) 2024-04-25T17:24:29.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.248+0000 7f19720e8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f196c0fce60 0x7f196c10d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.37:35666/0 (socket says 172.21.15.37:35666) 2024-04-25T17:24:29.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.248+0000 7f19718e7700 1 -- 172.21.15.37:0/2117032508 learned_addr learned my addr 172.21.15.37:0/2117032508 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:24:29.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.248+0000 7f19718e7700 1 -- 172.21.15.37:0/2117032508 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f196c0fce60 msgr2=0x7f196c10d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:24:29.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.248+0000 7f19718e7700 1 --2- 172.21.15.37:0/2117032508 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f196c0fce60 0x7f196c10d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:24:29.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.248+0000 7f19718e7700 1 -- 172.21.15.37:0/2117032508 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f195c005040 con 0x7f196c0fdfd0 2024-04-25T17:24:29.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.248+0000 7f19720e8700 1 --2- 172.21.15.37:0/2117032508 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f196c0fce60 0x7f196c10d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T17:24:29.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.249+0000 7f19718e7700 1 --2- 172.21.15.37:0/2117032508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f196c0fdfd0 0x7f196c10ddc0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f195c013870 tx=0x7f195c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:24:29.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.249+0000 7f1962ffd700 1 -- 172.21.15.37:0/2117032508 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f195c021070 con 0x7f196c0fdfd0 2024-04-25T17:24:29.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.249+0000 7f197434c700 1 -- 172.21.15.37:0/2117032508 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f196c112f30 con 0x7f196c0fdfd0 2024-04-25T17:24:29.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.249+0000 7f1962ffd700 1 -- 172.21.15.37:0/2117032508 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f195c009430 con 0x7f196c0fdfd0 2024-04-25T17:24:29.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.249+0000 7f1962ffd700 1 -- 172.21.15.37:0/2117032508 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f195c00e070 con 0x7f196c0fdfd0 2024-04-25T17:24:29.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.249+0000 7f197434c700 1 -- 172.21.15.37:0/2117032508 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f196c113440 con 0x7f196c0fdfd0 2024-04-25T17:24:29.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.250+0000 7f197434c700 1 -- 172.21.15.37:0/2117032508 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f196c04c710 con 0x7f196c0fdfd0 2024-04-25T17:24:29.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.251+0000 7f1962ffd700 1 -- 172.21.15.37:0/2117032508 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f195c01c750 con 0x7f196c0fdfd0 2024-04-25T17:24:29.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.251+0000 7f1962ffd700 1 --2- 172.21.15.37:0/2117032508 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f1958076b20 0x7f1958078fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:24:29.253 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.251+0000 7f1962ffd700 1 -- 172.21.15.37:0/2117032508 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f195c099b00 con 0x7f196c0fdfd0 2024-04-25T17:24:29.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.251+0000 7f19720e8700 1 --2- 172.21.15.37:0/2117032508 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f1958076b20 0x7f1958078fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:24:29.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.252+0000 7f19720e8700 1 --2- 172.21.15.37:0/2117032508 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f1958076b20 0x7f1958078fd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1968009b80 tx=0x7f196800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:24:29.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.256+0000 7f1962ffd700 1 -- 172.21.15.37:0/2117032508 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f195c0627a0 con 0x7f196c0fdfd0 2024-04-25T17:24:29.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.488+0000 7f197434c700 1 -- 172.21.15.37:0/2117032508 --> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f196c1022a0 con 0x7f1958076b20 2024-04-25T17:24:29.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.489+0000 7f1962ffd700 1 -- 172.21.15.37:0/2117032508 <== mgr.34104 v2:172.21.15.37:6800/783197737 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f196c1022a0 con 0x7f1958076b20 2024-04-25T17:24:29.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.491+0000 7f197434c700 1 -- 172.21.15.37:0/2117032508 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f1958076b20 msgr2=0x7f1958078fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:24:29.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.491+0000 7f197434c700 1 --2- 172.21.15.37:0/2117032508 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f1958076b20 0x7f1958078fd0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1968009b80 tx=0x7f196800b040 comp rx=0 tx=0).stop 2024-04-25T17:24:29.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.491+0000 7f197434c700 1 -- 172.21.15.37:0/2117032508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f196c0fdfd0 msgr2=0x7f196c10ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:24:29.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.491+0000 7f197434c700 1 --2- 172.21.15.37:0/2117032508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f196c0fdfd0 0x7f196c10ddc0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f195c013870 tx=0x7f195c009e30 comp rx=0 tx=0).stop 2024-04-25T17:24:29.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.491+0000 7f197434c700 1 -- 172.21.15.37:0/2117032508 shutdown_connections 2024-04-25T17:24:29.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.491+0000 7f197434c700 1 --2- 172.21.15.37:0/2117032508 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f1958076b20 0x7f1958078fd0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:24:29.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.491+0000 7f197434c700 1 --2- 172.21.15.37:0/2117032508 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f196c0fce60 0x7f196c10d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:24:29.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.491+0000 7f197434c700 1 --2- 172.21.15.37:0/2117032508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f196c0fdfd0 0x7f196c10ddc0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:24:29.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.491+0000 7f197434c700 1 -- 172.21.15.37:0/2117032508 >> 172.21.15.37:0/2117032508 conn(0x7f196c0f8540 msgr2=0x7f196c0f9af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:24:29.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.491+0000 7f197434c700 1 -- 172.21.15.37:0/2117032508 shutdown_connections 2024-04-25T17:24:29.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.491+0000 7f197434c700 1 -- 172.21.15.37:0/2117032508 wait complete. 2024-04-25T17:24:29.504 INFO:teuthology.orchestra.run.smithi037.stdout:true 2024-04-25T17:24:29.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.598+0000 7f0585dc6700 1 -- 172.21.15.37:0/2613409439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05800fcfb0 msgr2=0x7f05800fd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:24:29.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.598+0000 7f0585dc6700 1 --2- 172.21.15.37:0/2613409439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05800fcfb0 0x7f05800fd420 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0574004940 tx=0x7f0574009e30 comp rx=0 tx=0).stop 2024-04-25T17:24:29.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.598+0000 7f0585dc6700 1 -- 172.21.15.37:0/2613409439 shutdown_connections 2024-04-25T17:24:29.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.598+0000 7f0585dc6700 1 --2- 172.21.15.37:0/2613409439 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05800fcfb0 0x7f05800fd420 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:24:29.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.598+0000 7f0585dc6700 1 --2- 172.21.15.37:0/2613409439 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f05800fbd00 0x7f05800fc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:24:29.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.598+0000 7f0585dc6700 1 -- 172.21.15.37:0/2613409439 >> 172.21.15.37:0/2613409439 conn(0x7f05800f7480 msgr2=0x7f05800f9890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:24:29.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.598+0000 7f0585dc6700 1 -- 172.21.15.37:0/2613409439 shutdown_connections 2024-04-25T17:24:29.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.598+0000 7f0585dc6700 1 -- 172.21.15.37:0/2613409439 wait complete. 2024-04-25T17:24:29.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.598+0000 7f0585dc6700 1 Processor -- start 2024-04-25T17:24:29.600 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.598+0000 7f0585dc6700 1 -- start start 2024-04-25T17:24:29.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.599+0000 7f0585dc6700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f05800fbd00 0x7f05800ffc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:24:29.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.599+0000 7f0585dc6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05800fcfb0 0x7f05800fe2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:24:29.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.599+0000 7f0585dc6700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0580100240 con 0x7f05800fcfb0 2024-04-25T17:24:29.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.599+0000 7f0585dc6700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05800fe830 con 0x7f05800fbd00 2024-04-25T17:24:29.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.599+0000 7f057effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05800fcfb0 0x7f05800fe2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:24:29.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.599+0000 7f057effd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05800fcfb0 0x7f05800fe2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46702/0 (socket says 172.21.15.37:46702) 2024-04-25T17:24:29.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.599+0000 7f057effd700 1 -- 172.21.15.37:0/2820819230 learned_addr learned my addr 172.21.15.37:0/2820819230 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:24:29.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.599+0000 7f057f7fe700 1 --2- 172.21.15.37:0/2820819230 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f05800fbd00 0x7f05800ffc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:24:29.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.599+0000 7f057effd700 1 -- 172.21.15.37:0/2820819230 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f05800fbd00 msgr2=0x7f05800ffc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:24:29.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.599+0000 7f057effd700 1 --2- 172.21.15.37:0/2820819230 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f05800fbd00 0x7f05800ffc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:24:29.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.599+0000 7f057effd700 1 -- 172.21.15.37:0/2820819230 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0574005040 con 0x7f05800fcfb0 2024-04-25T17:24:29.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.599+0000 7f057effd700 1 --2- 172.21.15.37:0/2820819230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05800fcfb0 0x7f05800fe2f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0574009150 tx=0x7f0574009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:24:29.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.599+0000 7f0567fff700 1 -- 172.21.15.37:0/2820819230 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f057400e040 con 0x7f05800fcfb0 2024-04-25T17:24:29.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.599+0000 7f0585dc6700 1 -- 172.21.15.37:0/2820819230 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05800fea80 con 0x7f05800fcfb0 2024-04-25T17:24:29.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.599+0000 7f0567fff700 1 -- 172.21.15.37:0/2820819230 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0574004290 con 0x7f05800fcfb0 2024-04-25T17:24:29.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.599+0000 7f0567fff700 1 -- 172.21.15.37:0/2820819230 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f057401c630 con 0x7f05800fcfb0 2024-04-25T17:24:29.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.599+0000 7f0585dc6700 1 -- 172.21.15.37:0/2820819230 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05800ff040 con 0x7f05800fcfb0 2024-04-25T17:24:29.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.601+0000 7f0585dc6700 1 -- 172.21.15.37:0/2820819230 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0580101b40 con 0x7f05800fcfb0 2024-04-25T17:24:29.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.601+0000 7f0567fff700 1 -- 172.21.15.37:0/2820819230 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f057400bbf0 con 0x7f05800fcfb0 2024-04-25T17:24:29.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.602+0000 7f0567fff700 1 --2- 172.21.15.37:0/2820819230 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f0568076b90 0x7f0568079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:24:29.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.602+0000 7f0567fff700 1 -- 172.21.15.37:0/2820819230 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f0574098ea0 con 0x7f05800fcfb0 2024-04-25T17:24:29.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.602+0000 7f057f7fe700 1 --2- 172.21.15.37:0/2820819230 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f0568076b90 0x7f0568079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:24:29.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.602+0000 7f057f7fe700 1 --2- 172.21.15.37:0/2820819230 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f0568076b90 0x7f0568079040 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0570009fd0 tx=0x7f057000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:24:29.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.607+0000 7f0567fff700 1 -- 172.21.15.37:0/2820819230 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f0574061aa0 con 0x7f05800fcfb0 2024-04-25T17:24:29.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:29 smithi037 ceph-mon[90844]: pgmap v118: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 208 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 54/228 objects degraded (23.684%) 2024-04-25T17:24:29.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.836+0000 7f0585dc6700 1 -- 172.21.15.37:0/2820819230 --> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f058005e3a0 con 0x7f0568076b90 2024-04-25T17:24:29.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.837+0000 7f0567fff700 1 -- 172.21.15.37:0/2820819230 <== mgr.34104 v2:172.21.15.37:6800/783197737 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f058005e3a0 con 0x7f0568076b90 2024-04-25T17:24:29.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.839+0000 7f0585dc6700 1 -- 172.21.15.37:0/2820819230 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f0568076b90 msgr2=0x7f0568079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:24:29.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.839+0000 7f0585dc6700 1 --2- 172.21.15.37:0/2820819230 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f0568076b90 0x7f0568079040 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0570009fd0 tx=0x7f057000b040 comp rx=0 tx=0).stop 2024-04-25T17:24:29.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.839+0000 7f0585dc6700 1 -- 172.21.15.37:0/2820819230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05800fcfb0 msgr2=0x7f05800fe2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:24:29.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.839+0000 7f0585dc6700 1 --2- 172.21.15.37:0/2820819230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05800fcfb0 0x7f05800fe2f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0574009150 tx=0x7f0574009e30 comp rx=0 tx=0).stop 2024-04-25T17:24:29.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.839+0000 7f0585dc6700 1 -- 172.21.15.37:0/2820819230 shutdown_connections 2024-04-25T17:24:29.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.839+0000 7f0585dc6700 1 --2- 172.21.15.37:0/2820819230 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f0568076b90 0x7f0568079040 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:24:29.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.839+0000 7f0585dc6700 1 --2- 172.21.15.37:0/2820819230 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f05800fbd00 0x7f05800ffc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:24:29.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.839+0000 7f0585dc6700 1 --2- 172.21.15.37:0/2820819230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f05800fcfb0 0x7f05800fe2f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:24:29.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.839+0000 7f0585dc6700 1 -- 172.21.15.37:0/2820819230 >> 172.21.15.37:0/2820819230 conn(0x7f05800f7480 msgr2=0x7f05800667a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:24:29.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.840+0000 7f0585dc6700 1 -- 172.21.15.37:0/2820819230 shutdown_connections 2024-04-25T17:24:29.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.840+0000 7f0585dc6700 1 -- 172.21.15.37:0/2820819230 wait complete. 2024-04-25T17:24:29.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:29 smithi069 ceph-mon[80239]: pgmap v118: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 208 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 54/228 objects degraded (23.684%) 2024-04-25T17:24:29.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.944+0000 7fc6d9bbc700 1 -- 172.21.15.37:0/3703970839 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6d40fcf60 msgr2=0x7fc6d40fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:24:29.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.944+0000 7fc6d9bbc700 1 --2- 172.21.15.37:0/3703970839 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6d40fcf60 0x7fc6d40fd3d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc004940 tx=0x7fc6bc009e30 comp rx=0 tx=0).stop 2024-04-25T17:24:29.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.944+0000 7fc6d9bbc700 1 -- 172.21.15.37:0/3703970839 shutdown_connections 2024-04-25T17:24:29.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.944+0000 7fc6d9bbc700 1 --2- 172.21.15.37:0/3703970839 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6d40fcf60 0x7fc6d40fd3d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:24:29.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.944+0000 7fc6d9bbc700 1 --2- 172.21.15.37:0/3703970839 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6d40fbcb0 0x7fc6d40fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:24:29.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.944+0000 7fc6d9bbc700 1 -- 172.21.15.37:0/3703970839 >> 172.21.15.37:0/3703970839 conn(0x7fc6d40f7430 msgr2=0x7fc6d40f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:24:29.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.945+0000 7fc6d9bbc700 1 -- 172.21.15.37:0/3703970839 shutdown_connections 2024-04-25T17:24:29.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.945+0000 7fc6d9bbc700 1 -- 172.21.15.37:0/3703970839 wait complete. 2024-04-25T17:24:29.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.945+0000 7fc6d9bbc700 1 Processor -- start 2024-04-25T17:24:29.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.945+0000 7fc6d9bbc700 1 -- start start 2024-04-25T17:24:29.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.945+0000 7fc6d9bbc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6d40fbcb0 0x7fc6d4112af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:24:29.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.945+0000 7fc6d9bbc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6d40fcf60 0x7fc6d4115040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:24:29.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.945+0000 7fc6d9bbc700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d4066280 con 0x7fc6d40fcf60 2024-04-25T17:24:29.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.945+0000 7fc6d9bbc700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d40663c0 con 0x7fc6d40fbcb0 2024-04-25T17:24:29.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.945+0000 7fc6cbfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6d40fcf60 0x7fc6d4115040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:24:29.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.945+0000 7fc6d37fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6d40fbcb0 0x7fc6d4112af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:24:29.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.945+0000 7fc6cbfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6d40fcf60 0x7fc6d4115040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46724/0 (socket says 172.21.15.37:46724) 2024-04-25T17:24:29.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.945+0000 7fc6cbfff700 1 -- 172.21.15.37:0/1963584520 learned_addr learned my addr 172.21.15.37:0/1963584520 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:24:29.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.946+0000 7fc6cbfff700 1 -- 172.21.15.37:0/1963584520 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6d40fbcb0 msgr2=0x7fc6d4112af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:24:29.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.946+0000 7fc6cbfff700 1 --2- 172.21.15.37:0/1963584520 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6d40fbcb0 0x7fc6d4112af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:24:29.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.946+0000 7fc6cbfff700 1 -- 172.21.15.37:0/1963584520 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6bc005040 con 0x7fc6d40fcf60 2024-04-25T17:24:29.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.946+0000 7fc6cbfff700 1 --2- 172.21.15.37:0/1963584520 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6d40fcf60 0x7fc6d4115040 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc00b3b0 tx=0x7fc6bc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:24:29.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.946+0000 7fc6d0ff9700 1 -- 172.21.15.37:0/1963584520 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6bc00e040 con 0x7fc6d40fcf60 2024-04-25T17:24:29.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.946+0000 7fc6d0ff9700 1 -- 172.21.15.37:0/1963584520 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc6bc00bbf0 con 0x7fc6d40fcf60 2024-04-25T17:24:29.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.946+0000 7fc6d9bbc700 1 -- 172.21.15.37:0/1963584520 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6d4115580 con 0x7fc6d40fcf60 2024-04-25T17:24:29.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.946+0000 7fc6d0ff9700 1 -- 172.21.15.37:0/1963584520 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6bc01c630 con 0x7fc6d40fcf60 2024-04-25T17:24:29.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.946+0000 7fc6d9bbc700 1 -- 172.21.15.37:0/1963584520 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6d41159a0 con 0x7fc6d40fcf60 2024-04-25T17:24:29.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.947+0000 7fc6d9bbc700 1 -- 172.21.15.37:0/1963584520 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6d405f5c0 con 0x7fc6d40fcf60 2024-04-25T17:24:29.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.948+0000 7fc6d0ff9700 1 -- 172.21.15.37:0/1963584520 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7fc6bc00bd60 con 0x7fc6d40fcf60 2024-04-25T17:24:29.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.948+0000 7fc6d0ff9700 1 --2- 172.21.15.37:0/1963584520 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fc6c0076b90 0x7fc6c0079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:24:29.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.948+0000 7fc6d37fe700 1 --2- 172.21.15.37:0/1963584520 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fc6c0076b90 0x7fc6c0079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:24:29.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.948+0000 7fc6d0ff9700 1 -- 172.21.15.37:0/1963584520 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fc6bc098f70 con 0x7fc6d40fcf60 2024-04-25T17:24:29.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.949+0000 7fc6d37fe700 1 --2- 172.21.15.37:0/1963584520 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fc6c0076b90 0x7fc6c0079040 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4066010 tx=0x7fc6c400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:24:29.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:29.953+0000 7fc6d0ff9700 1 -- 172.21.15.37:0/1963584520 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fc6bc061ad0 con 0x7fc6d40fcf60 2024-04-25T17:24:30.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.173+0000 7fc6d9bbc700 1 -- 172.21.15.37:0/1963584520 --> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc6d41012c0 con 0x7fc6c0076b90 2024-04-25T17:24:30.185 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.184+0000 7fc6d0ff9700 1 -- 172.21.15.37:0/1963584520 <== mgr.34104 v2:172.21.15.37:6800/783197737 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fc6d41012c0 con 0x7fc6c0076b90 2024-04-25T17:24:30.186 INFO:teuthology.orchestra.run.smithi037.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-25T17:24:30.186 INFO:teuthology.orchestra.run.smithi037.stdout:alertmanager.smithi037 smithi037 *:9093,9094 running (5m) 37s ago 14m 24.9M - 0.25.0 c8568f914cd2 18aed8f409ee 2024-04-25T17:24:30.186 INFO:teuthology.orchestra.run.smithi037.stdout:crash.smithi037 smithi037 running (2m) 37s ago 14m 6660k - 19.0.0-3291-g994e2f20 d53c96779a29 639584ea5855 2024-04-25T17:24:30.186 INFO:teuthology.orchestra.run.smithi037.stdout:crash.smithi069 smithi069 running (2m) 3s ago 13m 6665k - 19.0.0-3291-g994e2f20 d53c96779a29 ee5db16733a7 2024-04-25T17:24:30.186 INFO:teuthology.orchestra.run.smithi037.stdout:grafana.smithi037 smithi037 *:3000 running (5m) 37s ago 13m 84.2M - 9.4.7 954c08fa6188 1eff3ea3f9b0 2024-04-25T17:24:30.186 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi037.ksmixc smithi037 running (8m) 37s ago 8m 149M - 17.2.7-902-gc61472c8 0de407c1b3af 394aa56079b4 2024-04-25T17:24:30.186 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi037.ovkrpq smithi037 running (8m) 37s ago 8m 102M - 17.2.7-902-gc61472c8 0de407c1b3af 73ca662174a7 2024-04-25T17:24:30.186 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi069.cpprst smithi069 running (8m) 3s ago 8m 16.0M - 17.2.7-902-gc61472c8 0de407c1b3af dbda101df20e 2024-04-25T17:24:30.186 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi069.ytlqcf smithi069 running (8m) 3s ago 8m 14.0M - 17.2.7-902-gc61472c8 0de407c1b3af 911df6b18215 2024-04-25T17:24:30.186 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.smithi037.txrgxl smithi037 *:8443,9283,8765 running (4m) 37s ago 15m 573M - 19.0.0-3291-g994e2f20 d53c96779a29 e9653fc62df9 2024-04-25T17:24:30.186 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.smithi069.mmuhdo smithi069 *:8443,9283,8765 running (3m) 3s ago 13m 520M - 19.0.0-3291-g994e2f20 d53c96779a29 6820207b4019 2024-04-25T17:24:30.186 INFO:teuthology.orchestra.run.smithi037.stdout:mon.smithi037 smithi037 running (3m) 37s ago 15m 113M 2048M 19.0.0-3291-g994e2f20 d53c96779a29 1b349f3af69d 2024-04-25T17:24:30.187 INFO:teuthology.orchestra.run.smithi037.stdout:mon.smithi069 smithi069 running (3m) 3s ago 13m 104M 2048M 19.0.0-3291-g994e2f20 d53c96779a29 7744dbe81b50 2024-04-25T17:24:30.187 INFO:teuthology.orchestra.run.smithi037.stdout:node-exporter.smithi037 smithi037 *:9100 running (6m) 37s ago 14m 14.4M - 1.5.0 0da6a335fe13 1e59bbb2aa82 2024-04-25T17:24:30.187 INFO:teuthology.orchestra.run.smithi037.stdout:node-exporter.smithi069 smithi069 *:9100 running (5m) 3s ago 13m 16.4M - 1.5.0 0da6a335fe13 0c51a9833fe4 2024-04-25T17:24:30.187 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0 smithi037 running (116s) 37s ago 12m 163M 1559M 19.0.0-3291-g994e2f20 d53c96779a29 e97538cb8b4f 2024-04-25T17:24:30.187 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1 smithi037 running (79s) 37s ago 11m 166M 1559M 19.0.0-3291-g994e2f20 d53c96779a29 6cf158192aae 2024-04-25T17:24:30.187 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2 smithi037 running (43s) 37s ago 11m 79.6M 1559M 19.0.0-3291-g994e2f20 d53c96779a29 a0b57bba2ebf 2024-04-25T17:24:30.187 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3 smithi069 running (6s) 3s ago 11m 82.5M 2581M 19.0.0-3291-g994e2f20 d53c96779a29 d1aa15d6b575 2024-04-25T17:24:30.187 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4 smithi069 running (10m) 3s ago 10m 254M 2581M 17.2.7-902-gc61472c8 0de407c1b3af ba7b785c50f9 2024-04-25T17:24:30.187 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5 smithi069 running (10m) 3s ago 10m 227M 2581M 17.2.7-902-gc61472c8 0de407c1b3af f6be99c364ff 2024-04-25T17:24:30.187 INFO:teuthology.orchestra.run.smithi037.stdout:prometheus.smithi037 smithi037 *:9095 running (4m) 37s ago 13m 65.9M - 2.43.0 a07b618ecd1d 2c5a268ffc1f 2024-04-25T17:24:30.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.186+0000 7fc6d9bbc700 1 -- 172.21.15.37:0/1963584520 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fc6c0076b90 msgr2=0x7fc6c0079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:24:30.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.186+0000 7fc6d9bbc700 1 --2- 172.21.15.37:0/1963584520 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fc6c0076b90 0x7fc6c0079040 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4066010 tx=0x7fc6c400b040 comp rx=0 tx=0).stop 2024-04-25T17:24:30.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.186+0000 7fc6d9bbc700 1 -- 172.21.15.37:0/1963584520 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6d40fcf60 msgr2=0x7fc6d4115040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:24:30.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.186+0000 7fc6d9bbc700 1 --2- 172.21.15.37:0/1963584520 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6d40fcf60 0x7fc6d4115040 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc00b3b0 tx=0x7fc6bc009e30 comp rx=0 tx=0).stop 2024-04-25T17:24:30.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.186+0000 7fc6d9bbc700 1 -- 172.21.15.37:0/1963584520 shutdown_connections 2024-04-25T17:24:30.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.186+0000 7fc6d9bbc700 1 --2- 172.21.15.37:0/1963584520 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fc6c0076b90 0x7fc6c0079040 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:24:30.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.186+0000 7fc6d9bbc700 1 --2- 172.21.15.37:0/1963584520 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6d40fbcb0 0x7fc6d4112af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:24:30.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.186+0000 7fc6d9bbc700 1 --2- 172.21.15.37:0/1963584520 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6d40fcf60 0x7fc6d4115040 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:24:30.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.186+0000 7fc6d9bbc700 1 -- 172.21.15.37:0/1963584520 >> 172.21.15.37:0/1963584520 conn(0x7fc6d40f7430 msgr2=0x7fc6d40f8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:24:30.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.186+0000 7fc6d9bbc700 1 -- 172.21.15.37:0/1963584520 shutdown_connections 2024-04-25T17:24:30.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.186+0000 7fc6d9bbc700 1 -- 172.21.15.37:0/1963584520 wait complete. 2024-04-25T17:24:30.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.289+0000 7f0df2e59700 1 -- 172.21.15.37:0/4131356736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dec0fff80 msgr2=0x7f0dec102360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:24:30.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.289+0000 7f0df2e59700 1 --2- 172.21.15.37:0/4131356736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dec0fff80 0x7f0dec102360 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc004940 tx=0x7f0ddc009e30 comp rx=0 tx=0).stop 2024-04-25T17:24:30.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.289+0000 7f0df2e59700 1 -- 172.21.15.37:0/4131356736 shutdown_connections 2024-04-25T17:24:30.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.289+0000 7f0df2e59700 1 --2- 172.21.15.37:0/4131356736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dec0fff80 0x7f0dec102360 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:24:30.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.289+0000 7f0df2e59700 1 --2- 172.21.15.37:0/4131356736 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0dec066220 0x7f0dec0ffa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:24:30.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.289+0000 7f0df2e59700 1 -- 172.21.15.37:0/4131356736 >> 172.21.15.37:0/4131356736 conn(0x7f0dec0f7430 msgr2=0x7f0dec0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:24:30.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.290+0000 7f0df2e59700 1 -- 172.21.15.37:0/4131356736 shutdown_connections 2024-04-25T17:24:30.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.290+0000 7f0df2e59700 1 -- 172.21.15.37:0/4131356736 wait complete. 2024-04-25T17:24:30.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.290+0000 7f0df2e59700 1 Processor -- start 2024-04-25T17:24:30.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.290+0000 7f0df2e59700 1 -- start start 2024-04-25T17:24:30.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.290+0000 7f0df2e59700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dec066220 0x7f0dec10d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:24:30.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.290+0000 7f0df2e59700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0dec0fff80 0x7f0dec10ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:24:30.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.290+0000 7f0df2e59700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dec10e4d0 con 0x7f0dec066220 2024-04-25T17:24:30.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.290+0000 7f0df2e59700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dec10ed20 con 0x7f0dec0fff80 2024-04-25T17:24:30.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.291+0000 7f0df0bf5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dec066220 0x7f0dec10d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:24:30.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.291+0000 7f0df0bf5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dec066220 0x7f0dec10d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46730/0 (socket says 172.21.15.37:46730) 2024-04-25T17:24:30.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.291+0000 7f0df0bf5700 1 -- 172.21.15.37:0/2879957813 learned_addr learned my addr 172.21.15.37:0/2879957813 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:24:30.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.291+0000 7f0debfff700 1 --2- 172.21.15.37:0/2879957813 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0dec0fff80 0x7f0dec10ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:24:30.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.291+0000 7f0df0bf5700 1 -- 172.21.15.37:0/2879957813 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0dec0fff80 msgr2=0x7f0dec10ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:24:30.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.291+0000 7f0df0bf5700 1 --2- 172.21.15.37:0/2879957813 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0dec0fff80 0x7f0dec10ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:24:30.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.291+0000 7f0df0bf5700 1 -- 172.21.15.37:0/2879957813 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ddc005040 con 0x7f0dec066220 2024-04-25T17:24:30.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.291+0000 7f0df0bf5700 1 --2- 172.21.15.37:0/2879957813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dec066220 0x7f0dec10d990 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0dd400eb70 tx=0x7f0dd400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:24:30.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.291+0000 7f0de97fa700 1 -- 172.21.15.37:0/2879957813 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0dd4007cc0 con 0x7f0dec066220 2024-04-25T17:24:30.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.291+0000 7f0de97fa700 1 -- 172.21.15.37:0/2879957813 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0dd400f040 con 0x7f0dec066220 2024-04-25T17:24:30.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.291+0000 7f0df2e59700 1 -- 172.21.15.37:0/2879957813 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dec10efa0 con 0x7f0dec066220 2024-04-25T17:24:30.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.292+0000 7f0df2e59700 1 -- 172.21.15.37:0/2879957813 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dec10f4e0 con 0x7f0dec066220 2024-04-25T17:24:30.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.292+0000 7f0de97fa700 1 -- 172.21.15.37:0/2879957813 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0dd400cac0 con 0x7f0dec066220 2024-04-25T17:24:30.295 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.292+0000 7f0df2e59700 1 -- 172.21.15.37:0/2879957813 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dec05f5c0 con 0x7f0dec066220 2024-04-25T17:24:30.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.293+0000 7f0de97fa700 1 -- 172.21.15.37:0/2879957813 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f0dd400cc20 con 0x7f0dec066220 2024-04-25T17:24:30.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.293+0000 7f0de97fa700 1 --2- 172.21.15.37:0/2879957813 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f0dd8076b90 0x7f0dd8079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:24:30.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.294+0000 7f0de97fa700 1 -- 172.21.15.37:0/2879957813 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f0dd4097d40 con 0x7f0dec066220 2024-04-25T17:24:30.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.294+0000 7f0debfff700 1 --2- 172.21.15.37:0/2879957813 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f0dd8076b90 0x7f0dd8079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:24:30.296 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.294+0000 7f0debfff700 1 --2- 172.21.15.37:0/2879957813 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f0dd8076b90 0x7f0dd8079040 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc009b30 tx=0x7f0ddc009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:24:30.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.299+0000 7f0de97fa700 1 -- 172.21.15.37:0/2879957813 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f0dd4060970 con 0x7f0dec066220 2024-04-25T17:24:30.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.600+0000 7f0df2e59700 1 -- 172.21.15.37:0/2879957813 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0dec04bed0 con 0x7f0dec066220 2024-04-25T17:24:30.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.600+0000 7f0de97fa700 1 -- 172.21.15.37:0/2879957813 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7f0dd4060310 con 0x7f0dec066220 2024-04-25T17:24:30.602 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-25T17:24:30.602 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": { 2024-04-25T17:24:30.602 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 2 2024-04-25T17:24:30.602 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:24:30.603 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": { 2024-04-25T17:24:30.603 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 2 2024-04-25T17:24:30.603 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:24:30.603 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": { 2024-04-25T17:24:30.603 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 2, 2024-04-25T17:24:30.603 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 3 2024-04-25T17:24:30.603 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:24:30.603 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": { 2024-04-25T17:24:30.603 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 4 2024-04-25T17:24:30.603 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:24:30.603 INFO:teuthology.orchestra.run.smithi037.stdout: "overall": { 2024-04-25T17:24:30.603 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 6, 2024-04-25T17:24:30.603 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 7 2024-04-25T17:24:30.603 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-04-25T17:24:30.604 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-25T17:24:30.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.602+0000 7f0df2e59700 1 -- 172.21.15.37:0/2879957813 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f0dd8076b90 msgr2=0x7f0dd8079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:24:30.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.602+0000 7f0df2e59700 1 --2- 172.21.15.37:0/2879957813 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f0dd8076b90 0x7f0dd8079040 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc009b30 tx=0x7f0ddc009e30 comp rx=0 tx=0).stop 2024-04-25T17:24:30.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.602+0000 7f0df2e59700 1 -- 172.21.15.37:0/2879957813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dec066220 msgr2=0x7f0dec10d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:24:30.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.602+0000 7f0df2e59700 1 --2- 172.21.15.37:0/2879957813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dec066220 0x7f0dec10d990 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0dd400eb70 tx=0x7f0dd400b040 comp rx=0 tx=0).stop 2024-04-25T17:24:30.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.603+0000 7f0df2e59700 1 -- 172.21.15.37:0/2879957813 shutdown_connections 2024-04-25T17:24:30.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.603+0000 7f0df2e59700 1 --2- 172.21.15.37:0/2879957813 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f0dd8076b90 0x7f0dd8079040 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:24:30.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.603+0000 7f0df2e59700 1 --2- 172.21.15.37:0/2879957813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0dec066220 0x7f0dec10d990 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:24:30.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.603+0000 7f0df2e59700 1 --2- 172.21.15.37:0/2879957813 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0dec0fff80 0x7f0dec10ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:24:30.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.603+0000 7f0df2e59700 1 -- 172.21.15.37:0/2879957813 >> 172.21.15.37:0/2879957813 conn(0x7f0dec0f7430 msgr2=0x7f0dec0f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:24:30.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.603+0000 7f0df2e59700 1 -- 172.21.15.37:0/2879957813 shutdown_connections 2024-04-25T17:24:30.605 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.603+0000 7f0df2e59700 1 -- 172.21.15.37:0/2879957813 wait complete. 2024-04-25T17:24:30.657 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:24:30 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-3[89654]: 2024-04-25T17:24:30.474+0000 7f96aad1e7c0 -1 osd.3 64 log_to_monitors true 2024-04-25T17:24:30.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.710+0000 7f11e278b700 1 -- 172.21.15.37:0/3469423288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11dc0fce60 msgr2=0x7f11dc0fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:24:30.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.710+0000 7f11e278b700 1 --2- 172.21.15.37:0/3469423288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11dc0fce60 0x7f11dc0fd270 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f11cc004940 tx=0x7f11cc009e30 comp rx=0 tx=0).stop 2024-04-25T17:24:30.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.710+0000 7f11e278b700 1 -- 172.21.15.37:0/3469423288 shutdown_connections 2024-04-25T17:24:30.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.710+0000 7f11e278b700 1 --2- 172.21.15.37:0/3469423288 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11dc0fdfd0 0x7f11dc0fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:24:30.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.710+0000 7f11e278b700 1 --2- 172.21.15.37:0/3469423288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11dc0fce60 0x7f11dc0fd270 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:24:30.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.710+0000 7f11e278b700 1 -- 172.21.15.37:0/3469423288 >> 172.21.15.37:0/3469423288 conn(0x7f11dc0f8540 msgr2=0x7f11dc0fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:24:30.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.710+0000 7f11e278b700 1 -- 172.21.15.37:0/3469423288 shutdown_connections 2024-04-25T17:24:30.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.710+0000 7f11e278b700 1 -- 172.21.15.37:0/3469423288 wait complete. 2024-04-25T17:24:30.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.710+0000 7f11e278b700 1 Processor -- start 2024-04-25T17:24:30.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.711+0000 7f11e278b700 1 -- start start 2024-04-25T17:24:30.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.711+0000 7f11e278b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11dc0fce60 0x7f11dc071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:24:30.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.711+0000 7f11e278b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11dc0fdfd0 0x7f11dc0702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:24:30.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.711+0000 7f11e278b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11dc072200 con 0x7f11dc0fce60 2024-04-25T17:24:30.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.711+0000 7f11e278b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11dc0707f0 con 0x7f11dc0fdfd0 2024-04-25T17:24:30.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.711+0000 7f11dbfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11dc0fce60 0x7f11dc071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:24:30.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.711+0000 7f11dbfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11dc0fce60 0x7f11dc071c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46740/0 (socket says 172.21.15.37:46740) 2024-04-25T17:24:30.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.711+0000 7f11dbfff700 1 -- 172.21.15.37:0/1823172635 learned_addr learned my addr 172.21.15.37:0/1823172635 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:24:30.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.711+0000 7f11db7fe700 1 --2- 172.21.15.37:0/1823172635 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11dc0fdfd0 0x7f11dc0702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:24:30.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.711+0000 7f11dbfff700 1 -- 172.21.15.37:0/1823172635 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11dc0fdfd0 msgr2=0x7f11dc0702b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:24:30.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.711+0000 7f11dbfff700 1 --2- 172.21.15.37:0/1823172635 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11dc0fdfd0 0x7f11dc0702b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:24:30.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.711+0000 7f11dbfff700 1 -- 172.21.15.37:0/1823172635 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11cc005040 con 0x7f11dc0fce60 2024-04-25T17:24:30.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.711+0000 7f11dbfff700 1 --2- 172.21.15.37:0/1823172635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11dc0fce60 0x7f11dc071c00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f11cc013870 tx=0x7f11cc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:24:30.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.711+0000 7f11d8ff9700 1 -- 172.21.15.37:0/1823172635 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11cc021070 con 0x7f11dc0fce60 2024-04-25T17:24:30.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.712+0000 7f11e278b700 1 -- 172.21.15.37:0/1823172635 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11dc070a40 con 0x7f11dc0fce60 2024-04-25T17:24:30.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.712+0000 7f11d8ff9700 1 -- 172.21.15.37:0/1823172635 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f11cc009430 con 0x7f11dc0fce60 2024-04-25T17:24:30.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.712+0000 7f11d8ff9700 1 -- 172.21.15.37:0/1823172635 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11cc00e070 con 0x7f11dc0fce60 2024-04-25T17:24:30.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.712+0000 7f11e278b700 1 -- 172.21.15.37:0/1823172635 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11dc070f80 con 0x7f11dc0fce60 2024-04-25T17:24:30.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.713+0000 7f11e278b700 1 -- 172.21.15.37:0/1823172635 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11dc04c710 con 0x7f11dc0fce60 2024-04-25T17:24:30.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.713+0000 7f11d8ff9700 1 -- 172.21.15.37:0/1823172635 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f11cc01c750 con 0x7f11dc0fce60 2024-04-25T17:24:30.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.714+0000 7f11d8ff9700 1 --2- 172.21.15.37:0/1823172635 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f11c4076b20 0x7f11c4078fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:24:30.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.714+0000 7f11d8ff9700 1 -- 172.21.15.37:0/1823172635 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f11cc0994b0 con 0x7f11dc0fce60 2024-04-25T17:24:30.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.714+0000 7f11db7fe700 1 --2- 172.21.15.37:0/1823172635 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f11c4076b20 0x7f11c4078fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:24:30.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.714+0000 7f11db7fe700 1 --2- 172.21.15.37:0/1823172635 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f11c4076b20 0x7f11c4078fd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f11d0009b80 tx=0x7f11d000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:24:30.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.719+0000 7f11d8ff9700 1 -- 172.21.15.37:0/1823172635 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f11cc062010 con 0x7f11dc0fce60 2024-04-25T17:24:30.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:30 smithi069 ceph-mon[80239]: from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:24:30.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:30 smithi069 ceph-mon[80239]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:24:30.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:30 smithi069 ceph-mon[80239]: from='osd.3 [v2:172.21.15.69:6800/1489573886,v1:172.21.15.69:6801/1489573886]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-25T17:24:30.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:30 smithi069 ceph-mon[80239]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-25T17:24:30.920 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:30 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/2879957813' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:24:30.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.977+0000 7f11e278b700 1 -- 172.21.15.37:0/1823172635 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f11dc115b50 con 0x7f11dc0fce60 2024-04-25T17:24:30.979 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:30 smithi037 ceph-mon[90844]: from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:24:30.979 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:30 smithi037 ceph-mon[90844]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:24:30.979 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:30 smithi037 ceph-mon[90844]: from='osd.3 [v2:172.21.15.69:6800/1489573886,v1:172.21.15.69:6801/1489573886]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-25T17:24:30.979 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:30 smithi037 ceph-mon[90844]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-04-25T17:24:30.979 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:30 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/2879957813' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:24:30.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.977+0000 7f11d8ff9700 1 -- 172.21.15.37:0/1823172635 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1900 (secure 0 0 0) 0x7f11cc0619b0 con 0x7f11dc0fce60 2024-04-25T17:24:30.980 INFO:teuthology.orchestra.run.smithi037.stdout:e16 2024-04-25T17:24:30.980 INFO:teuthology.orchestra.run.smithi037.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-25T17:24:30.980 INFO:teuthology.orchestra.run.smithi037.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T17:24:30.980 INFO:teuthology.orchestra.run.smithi037.stdout:legacy client fscid: 1 2024-04-25T17:24:30.980 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:24:30.980 INFO:teuthology.orchestra.run.smithi037.stdout:Filesystem 'cephfs' (1) 2024-04-25T17:24:30.980 INFO:teuthology.orchestra.run.smithi037.stdout:fs_name cephfs 2024-04-25T17:24:30.981 INFO:teuthology.orchestra.run.smithi037.stdout:epoch 16 2024-04-25T17:24:30.981 INFO:teuthology.orchestra.run.smithi037.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-25T17:24:30.981 INFO:teuthology.orchestra.run.smithi037.stdout:created 2024-04-25T17:15:40.586130+0000 2024-04-25T17:24:30.981 INFO:teuthology.orchestra.run.smithi037.stdout:modified 2024-04-25T17:15:57.508740+0000 2024-04-25T17:24:30.981 INFO:teuthology.orchestra.run.smithi037.stdout:tableserver 0 2024-04-25T17:24:30.981 INFO:teuthology.orchestra.run.smithi037.stdout:root 0 2024-04-25T17:24:30.981 INFO:teuthology.orchestra.run.smithi037.stdout:session_timeout 60 2024-04-25T17:24:30.981 INFO:teuthology.orchestra.run.smithi037.stdout:session_autoclose 300 2024-04-25T17:24:30.981 INFO:teuthology.orchestra.run.smithi037.stdout:max_file_size 1099511627776 2024-04-25T17:24:30.981 INFO:teuthology.orchestra.run.smithi037.stdout:max_xattr_size 65536 2024-04-25T17:24:30.981 INFO:teuthology.orchestra.run.smithi037.stdout:required_client_features {} 2024-04-25T17:24:30.982 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure 0 2024-04-25T17:24:30.982 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure_osd_epoch 0 2024-04-25T17:24:30.982 INFO:teuthology.orchestra.run.smithi037.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T17:24:30.982 INFO:teuthology.orchestra.run.smithi037.stdout:max_mds 1 2024-04-25T17:24:30.982 INFO:teuthology.orchestra.run.smithi037.stdout:in 0 2024-04-25T17:24:30.982 INFO:teuthology.orchestra.run.smithi037.stdout:up {0=14470} 2024-04-25T17:24:30.982 INFO:teuthology.orchestra.run.smithi037.stdout:failed 2024-04-25T17:24:30.982 INFO:teuthology.orchestra.run.smithi037.stdout:damaged 2024-04-25T17:24:30.982 INFO:teuthology.orchestra.run.smithi037.stdout:stopped 2024-04-25T17:24:30.982 INFO:teuthology.orchestra.run.smithi037.stdout:data_pools [3] 2024-04-25T17:24:30.983 INFO:teuthology.orchestra.run.smithi037.stdout:metadata_pool 2 2024-04-25T17:24:30.983 INFO:teuthology.orchestra.run.smithi037.stdout:inline_data disabled 2024-04-25T17:24:30.983 INFO:teuthology.orchestra.run.smithi037.stdout:balancer 2024-04-25T17:24:30.983 INFO:teuthology.orchestra.run.smithi037.stdout:bal_rank_mask -1 2024-04-25T17:24:30.983 INFO:teuthology.orchestra.run.smithi037.stdout:standby_count_wanted 1 2024-04-25T17:24:30.983 INFO:teuthology.orchestra.run.smithi037.stdout:qdb_cluster leader: 0 members: 2024-04-25T17:24:30.983 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi037.ksmixc{0:14470} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.37:6826/1903989494,v1:172.21.15.37:6827/1903989494] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:24:30.983 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi037.ovkrpq{0:14482} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.37:6828/4206394422,v1:172.21.15.37:6829/4206394422] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:24:30.983 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:24:30.983 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:24:30.983 INFO:teuthology.orchestra.run.smithi037.stdout:Standby daemons: 2024-04-25T17:24:30.983 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:24:30.983 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi069.cpprst{-1:24289} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.69:6826/518856100,v1:172.21.15.69:6827/518856100] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:24:30.984 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi069.ytlqcf{-1:24293} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.69:6824/134210439,v1:172.21.15.69:6825/134210439] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:24:30.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.980+0000 7f11e278b700 1 -- 172.21.15.37:0/1823172635 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f11c4076b20 msgr2=0x7f11c4078fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:24:30.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.980+0000 7f11e278b700 1 --2- 172.21.15.37:0/1823172635 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f11c4076b20 0x7f11c4078fd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f11d0009b80 tx=0x7f11d000b040 comp rx=0 tx=0).stop 2024-04-25T17:24:30.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.980+0000 7f11e278b700 1 -- 172.21.15.37:0/1823172635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11dc0fce60 msgr2=0x7f11dc071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:24:30.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.980+0000 7f11e278b700 1 --2- 172.21.15.37:0/1823172635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11dc0fce60 0x7f11dc071c00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f11cc013870 tx=0x7f11cc009e30 comp rx=0 tx=0).stop 2024-04-25T17:24:30.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.980+0000 7f11e278b700 1 -- 172.21.15.37:0/1823172635 shutdown_connections 2024-04-25T17:24:30.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.980+0000 7f11e278b700 1 --2- 172.21.15.37:0/1823172635 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f11c4076b20 0x7f11c4078fd0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:24:30.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.980+0000 7f11e278b700 1 --2- 172.21.15.37:0/1823172635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f11dc0fce60 0x7f11dc071c00 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:24:30.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.980+0000 7f11e278b700 1 --2- 172.21.15.37:0/1823172635 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11dc0fdfd0 0x7f11dc0702b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:24:30.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.980+0000 7f11e278b700 1 -- 172.21.15.37:0/1823172635 >> 172.21.15.37:0/1823172635 conn(0x7f11dc0f8540 msgr2=0x7f11dc0f9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:24:30.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.980+0000 7f11e278b700 1 -- 172.21.15.37:0/1823172635 shutdown_connections 2024-04-25T17:24:30.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:30.980+0000 7f11e278b700 1 -- 172.21.15.37:0/1823172635 wait complete. 2024-04-25T17:24:30.986 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 16 2024-04-25T17:24:31.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.086+0000 7fd25db26700 1 -- 172.21.15.37:0/329713020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2580fce90 msgr2=0x7fd2580fd2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:24:31.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.086+0000 7fd25db26700 1 --2- 172.21.15.37:0/329713020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2580fce90 0x7fd2580fd2a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd248004940 tx=0x7fd248009e30 comp rx=0 tx=0).stop 2024-04-25T17:24:31.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.086+0000 7fd25db26700 1 -- 172.21.15.37:0/329713020 shutdown_connections 2024-04-25T17:24:31.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.086+0000 7fd25db26700 1 --2- 172.21.15.37:0/329713020 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd2580fe090 0x7fd2580fe500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:24:31.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.086+0000 7fd25db26700 1 --2- 172.21.15.37:0/329713020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2580fce90 0x7fd2580fd2a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:24:31.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.086+0000 7fd25db26700 1 -- 172.21.15.37:0/329713020 >> 172.21.15.37:0/329713020 conn(0x7fd2580f85c0 msgr2=0x7fd2580fa9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:24:31.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.086+0000 7fd25db26700 1 -- 172.21.15.37:0/329713020 shutdown_connections 2024-04-25T17:24:31.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.086+0000 7fd25db26700 1 -- 172.21.15.37:0/329713020 wait complete. 2024-04-25T17:24:31.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.087+0000 7fd25db26700 1 Processor -- start 2024-04-25T17:24:31.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.087+0000 7fd25db26700 1 -- start start 2024-04-25T17:24:31.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.087+0000 7fd25db26700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2580fce90 0x7fd25810d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:24:31.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.087+0000 7fd25db26700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd2580fe090 0x7fd25810df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:24:31.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.087+0000 7fd25db26700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd25810e510 con 0x7fd2580fce90 2024-04-25T17:24:31.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.087+0000 7fd25db26700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd25810ed60 con 0x7fd2580fe090 2024-04-25T17:24:31.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.088+0000 7fd2577fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2580fce90 0x7fd25810d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:24:31.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.088+0000 7fd2577fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2580fce90 0x7fd25810d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46758/0 (socket says 172.21.15.37:46758) 2024-04-25T17:24:31.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.088+0000 7fd2577fe700 1 -- 172.21.15.37:0/3452337393 learned_addr learned my addr 172.21.15.37:0/3452337393 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:24:31.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.088+0000 7fd256ffd700 1 --2- 172.21.15.37:0/3452337393 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd2580fe090 0x7fd25810df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:24:31.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.088+0000 7fd256ffd700 1 -- 172.21.15.37:0/3452337393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2580fce90 msgr2=0x7fd25810d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:24:31.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.088+0000 7fd256ffd700 1 --2- 172.21.15.37:0/3452337393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2580fce90 0x7fd25810d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:24:31.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.088+0000 7fd256ffd700 1 -- 172.21.15.37:0/3452337393 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd248005040 con 0x7fd2580fe090 2024-04-25T17:24:31.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.088+0000 7fd2577fe700 1 --2- 172.21.15.37:0/3452337393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2580fce90 0x7fd25810d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T17:24:31.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.088+0000 7fd256ffd700 1 --2- 172.21.15.37:0/3452337393 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd2580fe090 0x7fd25810df10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd24c009fd0 tx=0x7fd24c00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:24:31.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.088+0000 7fd23ffff700 1 -- 172.21.15.37:0/3452337393 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd24c004e90 con 0x7fd2580fe090 2024-04-25T17:24:31.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.088+0000 7fd25db26700 1 -- 172.21.15.37:0/3452337393 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd25810efe0 con 0x7fd2580fe090 2024-04-25T17:24:31.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.088+0000 7fd23ffff700 1 -- 172.21.15.37:0/3452337393 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd24c00f040 con 0x7fd2580fe090 2024-04-25T17:24:31.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.088+0000 7fd23ffff700 1 -- 172.21.15.37:0/3452337393 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd24c00ca50 con 0x7fd2580fe090 2024-04-25T17:24:31.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.088+0000 7fd25db26700 1 -- 172.21.15.37:0/3452337393 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd25810f520 con 0x7fd2580fe090 2024-04-25T17:24:31.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.090+0000 7fd25db26700 1 -- 172.21.15.37:0/3452337393 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd25805f5c0 con 0x7fd2580fe090 2024-04-25T17:24:31.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.090+0000 7fd23ffff700 1 -- 172.21.15.37:0/3452337393 <== mon.1 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7fd24c00cc00 con 0x7fd2580fe090 2024-04-25T17:24:31.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.091+0000 7fd23ffff700 1 --2- 172.21.15.37:0/3452337393 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fd240076b90 0x7fd240079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:24:31.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.091+0000 7fd23ffff700 1 -- 172.21.15.37:0/3452337393 <== mon.1 v2:172.21.15.69:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fd24c097da0 con 0x7fd2580fe090 2024-04-25T17:24:31.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.091+0000 7fd2577fe700 1 --2- 172.21.15.37:0/3452337393 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fd240076b90 0x7fd240079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:24:31.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.091+0000 7fd2577fe700 1 --2- 172.21.15.37:0/3452337393 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fd240076b90 0x7fd240079040 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd2480045a0 tx=0x7fd248009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:24:31.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.098+0000 7fd23ffff700 1 -- 172.21.15.37:0/3452337393 <== mon.1 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fd24c060930 con 0x7fd2580fe090 2024-04-25T17:24:31.337 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.335+0000 7fd25db26700 1 -- 172.21.15.37:0/3452337393 --> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd25810f790 con 0x7fd240076b90 2024-04-25T17:24:31.338 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.337+0000 7fd23ffff700 1 -- 172.21.15.37:0/3452337393 <== mgr.34104 v2:172.21.15.37:6800/783197737 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fd25810f790 con 0x7fd240076b90 2024-04-25T17:24:31.338 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-25T17:24:31.339 INFO:teuthology.orchestra.run.smithi037.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385", 2024-04-25T17:24:31.339 INFO:teuthology.orchestra.run.smithi037.stdout: "in_progress": true, 2024-04-25T17:24:31.339 INFO:teuthology.orchestra.run.smithi037.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-25T17:24:31.339 INFO:teuthology.orchestra.run.smithi037.stdout: "services_complete": [ 2024-04-25T17:24:31.339 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr", 2024-04-25T17:24:31.339 INFO:teuthology.orchestra.run.smithi037.stdout: "crash", 2024-04-25T17:24:31.339 INFO:teuthology.orchestra.run.smithi037.stdout: "mon" 2024-04-25T17:24:31.339 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-04-25T17:24:31.339 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": "10/21 daemons upgraded", 2024-04-25T17:24:31.339 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "Currently upgrading osd daemons", 2024-04-25T17:24:31.339 INFO:teuthology.orchestra.run.smithi037.stdout: "is_paused": false 2024-04-25T17:24:31.339 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-25T17:24:31.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.339+0000 7fd25db26700 1 -- 172.21.15.37:0/3452337393 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fd240076b90 msgr2=0x7fd240079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:24:31.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.339+0000 7fd25db26700 1 --2- 172.21.15.37:0/3452337393 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fd240076b90 0x7fd240079040 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd2480045a0 tx=0x7fd248009e30 comp rx=0 tx=0).stop 2024-04-25T17:24:31.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.339+0000 7fd25db26700 1 -- 172.21.15.37:0/3452337393 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd2580fe090 msgr2=0x7fd25810df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:24:31.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.339+0000 7fd25db26700 1 --2- 172.21.15.37:0/3452337393 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd2580fe090 0x7fd25810df10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd24c009fd0 tx=0x7fd24c00b040 comp rx=0 tx=0).stop 2024-04-25T17:24:31.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.339+0000 7fd25db26700 1 -- 172.21.15.37:0/3452337393 shutdown_connections 2024-04-25T17:24:31.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.339+0000 7fd25db26700 1 --2- 172.21.15.37:0/3452337393 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fd240076b90 0x7fd240079040 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:24:31.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.339+0000 7fd25db26700 1 --2- 172.21.15.37:0/3452337393 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2580fce90 0x7fd25810d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:24:31.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.339+0000 7fd25db26700 1 --2- 172.21.15.37:0/3452337393 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd2580fe090 0x7fd25810df10 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:24:31.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.339+0000 7fd25db26700 1 -- 172.21.15.37:0/3452337393 >> 172.21.15.37:0/3452337393 conn(0x7fd2580f85c0 msgr2=0x7fd2580f9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:24:31.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.339+0000 7fd25db26700 1 -- 172.21.15.37:0/3452337393 shutdown_connections 2024-04-25T17:24:31.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.339+0000 7fd25db26700 1 -- 172.21.15.37:0/3452337393 wait complete. 2024-04-25T17:24:31.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.444+0000 7f524f337700 1 -- 172.21.15.37:0/1470410132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52480fbd40 msgr2=0x7f52480fc150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:24:31.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.444+0000 7f524f337700 1 --2- 172.21.15.37:0/1470410132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52480fbd40 0x7f52480fc150 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5238004940 tx=0x7f5238009e30 comp rx=0 tx=0).stop 2024-04-25T17:24:31.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.444+0000 7f524f337700 1 -- 172.21.15.37:0/1470410132 shutdown_connections 2024-04-25T17:24:31.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.444+0000 7f524f337700 1 --2- 172.21.15.37:0/1470410132 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f52480fcff0 0x7f52480fd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:24:31.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.444+0000 7f524f337700 1 --2- 172.21.15.37:0/1470410132 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52480fbd40 0x7f52480fc150 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:24:31.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.444+0000 7f524f337700 1 -- 172.21.15.37:0/1470410132 >> 172.21.15.37:0/1470410132 conn(0x7f52480f74c0 msgr2=0x7f52480f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:24:31.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.444+0000 7f524f337700 1 -- 172.21.15.37:0/1470410132 shutdown_connections 2024-04-25T17:24:31.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.444+0000 7f524f337700 1 -- 172.21.15.37:0/1470410132 wait complete. 2024-04-25T17:24:31.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.445+0000 7f524f337700 1 Processor -- start 2024-04-25T17:24:31.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.445+0000 7f524f337700 1 -- start start 2024-04-25T17:24:31.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.445+0000 7f524f337700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52480fbd40 0x7f52481106b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:24:31.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.445+0000 7f524f337700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f52480fcff0 0x7f5248112c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:24:31.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.445+0000 7f524f337700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5248066be0 con 0x7f52480fbd40 2024-04-25T17:24:31.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.445+0000 7f524f337700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5248066d20 con 0x7f52480fcff0 2024-04-25T17:24:31.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.445+0000 7f524d0d3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52480fbd40 0x7f52481106b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:24:31.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.445+0000 7f524d0d3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52480fbd40 0x7f52481106b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46784/0 (socket says 172.21.15.37:46784) 2024-04-25T17:24:31.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.445+0000 7f524d0d3700 1 -- 172.21.15.37:0/605344238 learned_addr learned my addr 172.21.15.37:0/605344238 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:24:31.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.445+0000 7f524c8d2700 1 --2- 172.21.15.37:0/605344238 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f52480fcff0 0x7f5248112c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:24:31.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.446+0000 7f524d0d3700 1 -- 172.21.15.37:0/605344238 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f52480fcff0 msgr2=0x7f5248112c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:24:31.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.446+0000 7f524d0d3700 1 --2- 172.21.15.37:0/605344238 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f52480fcff0 0x7f5248112c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:24:31.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.446+0000 7f524d0d3700 1 -- 172.21.15.37:0/605344238 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5238005040 con 0x7f52480fbd40 2024-04-25T17:24:31.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.446+0000 7f524d0d3700 1 --2- 172.21.15.37:0/605344238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52480fbd40 0x7f52481106b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5238013870 tx=0x7f5238009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:24:31.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.446+0000 7f523dffb700 1 -- 172.21.15.37:0/605344238 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5238021070 con 0x7f52480fbd40 2024-04-25T17:24:31.450 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.446+0000 7f523dffb700 1 -- 172.21.15.37:0/605344238 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5238009430 con 0x7f52480fbd40 2024-04-25T17:24:31.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.446+0000 7f524f337700 1 -- 172.21.15.37:0/605344238 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52481131a0 con 0x7f52480fbd40 2024-04-25T17:24:31.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.446+0000 7f523dffb700 1 -- 172.21.15.37:0/605344238 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f523800e070 con 0x7f52480fbd40 2024-04-25T17:24:31.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.446+0000 7f524f337700 1 -- 172.21.15.37:0/605344238 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52481136b0 con 0x7f52480fbd40 2024-04-25T17:24:31.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.447+0000 7f524f337700 1 -- 172.21.15.37:0/605344238 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f524805f5c0 con 0x7f52480fbd40 2024-04-25T17:24:31.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.448+0000 7f523dffb700 1 -- 172.21.15.37:0/605344238 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f523801c750 con 0x7f52480fbd40 2024-04-25T17:24:31.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.449+0000 7f523dffb700 1 --2- 172.21.15.37:0/605344238 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f5234076b90 0x7f5234079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:24:31.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.449+0000 7f524c8d2700 1 --2- 172.21.15.37:0/605344238 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f5234076b90 0x7f5234079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:24:31.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.449+0000 7f523dffb700 1 -- 172.21.15.37:0/605344238 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f5238099bd0 con 0x7f52480fbd40 2024-04-25T17:24:31.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.449+0000 7f524c8d2700 1 --2- 172.21.15.37:0/605344238 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f5234076b90 0x7f5234079040 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5244009b80 tx=0x7f524400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:24:31.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.453+0000 7f523dffb700 1 -- 172.21.15.37:0/605344238 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f52380627b0 con 0x7f52480fbd40 2024-04-25T17:24:31.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.751+0000 7f524f337700 1 -- 172.21.15.37:0/605344238 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f524804bed0 con 0x7f52480fbd40 2024-04-25T17:24:31.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.751+0000 7f523dffb700 1 -- 172.21.15.37:0/605344238 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1271 (secure 0 0 0) 0x7f523805e020 con 0x7f52480fbd40 2024-04-25T17:24:31.753 INFO:teuthology.orchestra.run.smithi037.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 54/228 objects degraded (23.684%), 18 pgs degraded 2024-04-25T17:24:31.753 INFO:teuthology.orchestra.run.smithi037.stdout:[WRN] OSD_DOWN: 1 osds down 2024-04-25T17:24:31.753 INFO:teuthology.orchestra.run.smithi037.stdout: osd.3 (root=default,host=smithi069) is down 2024-04-25T17:24:31.753 INFO:teuthology.orchestra.run.smithi037.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 54/228 objects degraded (23.684%), 18 pgs degraded 2024-04-25T17:24:31.753 INFO:teuthology.orchestra.run.smithi037.stdout: pg 1.0 is active+undersized+degraded, acting [0,1] 2024-04-25T17:24:31.753 INFO:teuthology.orchestra.run.smithi037.stdout: pg 2.0 is active+undersized+degraded, acting [1,0] 2024-04-25T17:24:31.753 INFO:teuthology.orchestra.run.smithi037.stdout: pg 2.5 is active+undersized+degraded, acting [0,4] 2024-04-25T17:24:31.754 INFO:teuthology.orchestra.run.smithi037.stdout: pg 2.6 is active+undersized+degraded, acting [1,4] 2024-04-25T17:24:31.754 INFO:teuthology.orchestra.run.smithi037.stdout: pg 2.7 is active+undersized+degraded, acting [4,2] 2024-04-25T17:24:31.754 INFO:teuthology.orchestra.run.smithi037.stdout: pg 2.8 is active+undersized+degraded, acting [5,0] 2024-04-25T17:24:31.754 INFO:teuthology.orchestra.run.smithi037.stdout: pg 2.a is active+undersized+degraded, acting [1,4] 2024-04-25T17:24:31.754 INFO:teuthology.orchestra.run.smithi037.stdout: pg 2.b is active+undersized+degraded, acting [4,5] 2024-04-25T17:24:31.754 INFO:teuthology.orchestra.run.smithi037.stdout: pg 2.c is active+undersized+degraded, acting [2,0] 2024-04-25T17:24:31.754 INFO:teuthology.orchestra.run.smithi037.stdout: pg 2.d is active+undersized+degraded, acting [1,2] 2024-04-25T17:24:31.754 INFO:teuthology.orchestra.run.smithi037.stdout: pg 2.e is active+undersized+degraded, acting [2,0] 2024-04-25T17:24:31.754 INFO:teuthology.orchestra.run.smithi037.stdout: pg 2.14 is active+undersized+degraded, acting [4,5] 2024-04-25T17:24:31.754 INFO:teuthology.orchestra.run.smithi037.stdout: pg 2.15 is active+undersized+degraded, acting [1,0] 2024-04-25T17:24:31.754 INFO:teuthology.orchestra.run.smithi037.stdout: pg 2.16 is active+undersized+degraded, acting [5,2] 2024-04-25T17:24:31.754 INFO:teuthology.orchestra.run.smithi037.stdout: pg 2.18 is active+undersized+degraded, acting [5,4] 2024-04-25T17:24:31.754 INFO:teuthology.orchestra.run.smithi037.stdout: pg 2.1a is active+undersized+degraded, acting [4,5] 2024-04-25T17:24:31.754 INFO:teuthology.orchestra.run.smithi037.stdout: pg 2.1d is active+undersized+degraded, acting [5,0] 2024-04-25T17:24:31.754 INFO:teuthology.orchestra.run.smithi037.stdout: pg 2.1f is active+undersized+degraded, acting [0,4] 2024-04-25T17:24:31.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.753+0000 7f524f337700 1 -- 172.21.15.37:0/605344238 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f5234076b90 msgr2=0x7f5234079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:24:31.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.753+0000 7f524f337700 1 --2- 172.21.15.37:0/605344238 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f5234076b90 0x7f5234079040 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5244009b80 tx=0x7f524400b040 comp rx=0 tx=0).stop 2024-04-25T17:24:31.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.753+0000 7f524f337700 1 -- 172.21.15.37:0/605344238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52480fbd40 msgr2=0x7f52481106b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:24:31.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.753+0000 7f524f337700 1 --2- 172.21.15.37:0/605344238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52480fbd40 0x7f52481106b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5238013870 tx=0x7f5238009e30 comp rx=0 tx=0).stop 2024-04-25T17:24:31.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.753+0000 7f524f337700 1 -- 172.21.15.37:0/605344238 shutdown_connections 2024-04-25T17:24:31.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.754+0000 7f524f337700 1 --2- 172.21.15.37:0/605344238 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f5234076b90 0x7f5234079040 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:24:31.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.754+0000 7f524f337700 1 --2- 172.21.15.37:0/605344238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52480fbd40 0x7f52481106b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:24:31.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.754+0000 7f524f337700 1 --2- 172.21.15.37:0/605344238 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f52480fcff0 0x7f5248112c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:24:31.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.754+0000 7f524f337700 1 -- 172.21.15.37:0/605344238 >> 172.21.15.37:0/605344238 conn(0x7f52480f74c0 msgr2=0x7f52480f8ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:24:31.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.754+0000 7f524f337700 1 -- 172.21.15.37:0/605344238 shutdown_connections 2024-04-25T17:24:31.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:24:31.754+0000 7f524f337700 1 -- 172.21.15.37:0/605344238 wait complete. 2024-04-25T17:24:31.919 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:24:31 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-3[89654]: 2024-04-25T17:24:31.632+0000 7f9698130700 -1 osd.3 64 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T17:24:31.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:31 smithi069 ceph-mon[80239]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:24:31.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:31 smithi069 ceph-mon[80239]: pgmap v119: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 208 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 54/228 objects degraded (23.684%) 2024-04-25T17:24:31.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:31 smithi069 ceph-mon[80239]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-25T17:24:31.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:31 smithi069 ceph-mon[80239]: from='osd.3 [v2:172.21.15.69:6800/1489573886,v1:172.21.15.69:6801/1489573886]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2024-04-25T17:24:31.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:31 smithi069 ceph-mon[80239]: osdmap e67: 6 total, 5 up, 6 in 2024-04-25T17:24:31.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:31 smithi069 ceph-mon[80239]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2024-04-25T17:24:31.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:31 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/1823172635' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T17:24:31.920 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:31 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:24:31.920 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:31 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:24:31.920 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:31 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:24:31.920 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:31 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:24:31.920 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:31 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:24:31.920 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:31 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:24:31.920 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:31 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:24:31.920 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:31 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:24:31.920 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:31 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:24:31.920 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:31 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-25T17:24:31.920 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:31 smithi069 ceph-mon[80239]: from='osd.3 ' entity='osd.3' 2024-04-25T17:24:31.920 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:31 smithi069 ceph-mon[80239]: Health check update: Degraded data redundancy: 54/228 objects degraded (23.684%), 18 pgs degraded (PG_DEGRADED) 2024-04-25T17:24:32.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:31 smithi037 ceph-mon[90844]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:24:32.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:31 smithi037 ceph-mon[90844]: pgmap v119: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 208 MiB data, 1.6 GiB used, 535 GiB / 536 GiB avail; 54/228 objects degraded (23.684%) 2024-04-25T17:24:32.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:31 smithi037 ceph-mon[90844]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-04-25T17:24:32.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:31 smithi037 ceph-mon[90844]: from='osd.3 [v2:172.21.15.69:6800/1489573886,v1:172.21.15.69:6801/1489573886]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2024-04-25T17:24:32.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:31 smithi037 ceph-mon[90844]: osdmap e67: 6 total, 5 up, 6 in 2024-04-25T17:24:32.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:31 smithi037 ceph-mon[90844]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2024-04-25T17:24:32.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:31 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/1823172635' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T17:24:32.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:31 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:24:32.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:31 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:24:32.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:31 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:24:32.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:31 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:24:32.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:31 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:24:32.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:31 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:24:32.074 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:31 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:24:32.074 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:31 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:24:32.074 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:31 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:24:32.074 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:31 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-25T17:24:32.074 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:31 smithi037 ceph-mon[90844]: from='osd.3 ' entity='osd.3' 2024-04-25T17:24:32.074 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:31 smithi037 ceph-mon[90844]: Health check update: Degraded data redundancy: 54/228 objects degraded (23.684%), 18 pgs degraded (PG_DEGRADED) 2024-04-25T17:24:32.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:32 smithi069 ceph-mon[80239]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-25T17:24:32.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:32 smithi069 ceph-mon[80239]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-04-25T17:24:32.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:32 smithi069 ceph-mon[80239]: from='client.44253 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:24:32.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:32 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/605344238' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T17:24:32.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:32 smithi069 ceph-mon[80239]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-25T17:24:32.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:32 smithi069 ceph-mon[80239]: osd.3 [v2:172.21.15.69:6800/1489573886,v1:172.21.15.69:6801/1489573886] boot 2024-04-25T17:24:32.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:32 smithi069 ceph-mon[80239]: osdmap e68: 6 total, 6 up, 6 in 2024-04-25T17:24:32.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:32 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T17:24:33.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:32 smithi037 ceph-mon[90844]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-25T17:24:33.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:32 smithi037 ceph-mon[90844]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-04-25T17:24:33.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:32 smithi037 ceph-mon[90844]: from='client.44253 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:24:33.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:32 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/605344238' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T17:24:33.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:32 smithi037 ceph-mon[90844]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-25T17:24:33.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:32 smithi037 ceph-mon[90844]: osd.3 [v2:172.21.15.69:6800/1489573886,v1:172.21.15.69:6801/1489573886] boot 2024-04-25T17:24:33.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:32 smithi037 ceph-mon[90844]: osdmap e68: 6 total, 6 up, 6 in 2024-04-25T17:24:33.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:32 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-04-25T17:24:33.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:33 smithi069 ceph-mon[80239]: pgmap v121: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 208 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 54/228 objects degraded (23.684%) 2024-04-25T17:24:33.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:33 smithi069 ceph-mon[80239]: osdmap e69: 6 total, 6 up, 6 in 2024-04-25T17:24:34.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:33 smithi037 ceph-mon[90844]: pgmap v121: 65 pgs: 18 active+undersized+degraded, 20 active+undersized, 27 active+clean; 208 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 54/228 objects degraded (23.684%) 2024-04-25T17:24:34.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:33 smithi037 ceph-mon[90844]: osdmap e69: 6 total, 6 up, 6 in 2024-04-25T17:24:36.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:35 smithi037 ceph-mon[90844]: pgmap v124: 65 pgs: 15 peering, 10 active+undersized+degraded, 10 active+undersized, 30 active+clean; 208 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 28/228 objects degraded (12.281%) 2024-04-25T17:24:36.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:35 smithi069 ceph-mon[80239]: pgmap v124: 65 pgs: 15 peering, 10 active+undersized+degraded, 10 active+undersized, 30 active+clean; 208 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 28/228 objects degraded (12.281%) 2024-04-25T17:24:37.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:36 smithi037 ceph-mon[90844]: Health check update: Degraded data redundancy: 28/228 objects degraded (12.281%), 10 pgs degraded (PG_DEGRADED) 2024-04-25T17:24:37.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:36 smithi069 ceph-mon[80239]: Health check update: Degraded data redundancy: 28/228 objects degraded (12.281%), 10 pgs degraded (PG_DEGRADED) 2024-04-25T17:24:38.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:37 smithi037 ceph-mon[90844]: pgmap v125: 65 pgs: 15 peering, 50 active+clean; 208 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:24:38.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:37 smithi037 ceph-mon[90844]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 28/228 objects degraded (12.281%), 10 pgs degraded) 2024-04-25T17:24:38.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:37 smithi037 ceph-mon[90844]: Cluster is now healthy 2024-04-25T17:24:38.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:37 smithi069 ceph-mon[80239]: pgmap v125: 65 pgs: 15 peering, 50 active+clean; 208 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:24:38.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:37 smithi069 ceph-mon[80239]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 28/228 objects degraded (12.281%), 10 pgs degraded) 2024-04-25T17:24:38.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:37 smithi069 ceph-mon[80239]: Cluster is now healthy 2024-04-25T17:24:40.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:39 smithi037 ceph-mon[90844]: pgmap v126: 65 pgs: 65 active+clean; 208 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 651 B/s rd, 1 op/s 2024-04-25T17:24:40.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:39 smithi069 ceph-mon[80239]: pgmap v126: 65 pgs: 65 active+clean; 208 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 651 B/s rd, 1 op/s 2024-04-25T17:24:42.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:41 smithi037 ceph-mon[90844]: pgmap v127: 65 pgs: 65 active+clean; 208 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-04-25T17:24:42.175 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:41 smithi069 ceph-mon[80239]: pgmap v127: 65 pgs: 65 active+clean; 208 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-04-25T17:24:43.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:43 smithi069 ceph-mon[80239]: pgmap v128: 65 pgs: 65 active+clean; 208 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 930 B/s rd, 1 op/s 2024-04-25T17:24:43.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:43 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:24:43.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:43 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:24:44.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:43 smithi037 ceph-mon[90844]: pgmap v128: 65 pgs: 65 active+clean; 208 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 930 B/s rd, 1 op/s 2024-04-25T17:24:44.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:43 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:24:44.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:43 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:24:45.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:45 smithi069 ceph-mon[80239]: pgmap v129: 65 pgs: 65 active+clean; 208 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 845 B/s rd, 1 op/s 2024-04-25T17:24:46.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:45 smithi037 ceph-mon[90844]: pgmap v129: 65 pgs: 65 active+clean; 208 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 845 B/s rd, 1 op/s 2024-04-25T17:24:46.911 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:46 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-25T17:24:47.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:46 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-25T17:24:47.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:47 smithi069 ceph-mon[80239]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-25T17:24:47.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:47 smithi069 ceph-mon[80239]: Upgrade: osd.4 is safe to restart 2024-04-25T17:24:47.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:47 smithi069 ceph-mon[80239]: pgmap v130: 65 pgs: 65 active+clean; 208 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-25T17:24:48.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:47 smithi037 ceph-mon[90844]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-04-25T17:24:48.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:47 smithi037 ceph-mon[90844]: Upgrade: osd.4 is safe to restart 2024-04-25T17:24:48.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:47 smithi037 ceph-mon[90844]: pgmap v130: 65 pgs: 65 active+clean; 208 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-25T17:24:48.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:48 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:24:48.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:48 smithi069 ceph-mon[80239]: Upgrade: Updating osd.4 2024-04-25T17:24:48.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:48 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:24:48.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:48 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-25T17:24:48.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:48 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:24:48.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:48 smithi069 ceph-mon[80239]: Deploying daemon osd.4 on smithi069 2024-04-25T17:24:49.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:48 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:24:49.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:48 smithi037 ceph-mon[90844]: Upgrade: Updating osd.4 2024-04-25T17:24:49.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:48 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:24:49.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:48 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-04-25T17:24:49.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:48 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:24:49.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:48 smithi037 ceph-mon[90844]: Deploying daemon osd.4 on smithi069 2024-04-25T17:24:49.769 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:49 smithi069 ceph-mon[80239]: pgmap v131: 65 pgs: 65 active+clean; 208 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-25T17:24:50.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:49 smithi037 ceph-mon[90844]: pgmap v131: 65 pgs: 65 active+clean; 208 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-25T17:24:51.261 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:24:51 smithi069 systemd[1]: Stopping Ceph osd.4 for 599bb7fc-0326-11ef-bc93-c7b262605968... 2024-04-25T17:24:51.261 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:24:51 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4[46528]: 2024-04-25T17:24:51.251+0000 7f291ce0f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T17:24:51.261 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:24:51 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4[46528]: 2024-04-25T17:24:51.251+0000 7f291ce0f700 -1 osd.4 69 *** Got signal Terminated *** 2024-04-25T17:24:51.261 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:24:51 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4[46528]: 2024-04-25T17:24:51.251+0000 7f291ce0f700 -1 osd.4 69 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T17:24:52.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:51 smithi037 ceph-mon[90844]: pgmap v132: 65 pgs: 65 active+clean; 208 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-25T17:24:52.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:51 smithi037 ceph-mon[90844]: osd.4 marked itself down and dead 2024-04-25T17:24:52.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:51 smithi069 ceph-mon[80239]: pgmap v132: 65 pgs: 65 active+clean; 208 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-04-25T17:24:52.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:51 smithi069 ceph-mon[80239]: osd.4 marked itself down and dead 2024-04-25T17:24:52.461 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:24:52 smithi069 podman[94052]: 2024-04-25 17:24:52.190965622 +0000 UTC m=+1.038154383 container died ba7b785c50f91a4d4a440afbe55dc61bd4f484872ac740ef5a9a418a2c5b99bc (image=quay.ceph.io/ceph-ci/ceph@sha256:27d43f80a23d3545096a7bb490598a6f37852da2940e69e5a8f3e3d7fb58fd17, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=quincy-c61472c, org.label-schema.schema-version=1.0) 2024-04-25T17:24:52.828 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:52 smithi069 ceph-mon[80239]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-25T17:24:52.828 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:52 smithi069 ceph-mon[80239]: osdmap e70: 6 total, 5 up, 6 in 2024-04-25T17:24:52.828 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:52 smithi069 ceph-mon[80239]: osdmap e71: 6 total, 5 up, 6 in 2024-04-25T17:24:52.828 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:24:52 smithi069 podman[94052]: 2024-04-25 17:24:52.56798239 +0000 UTC m=+1.415171147 container cleanup ba7b785c50f91a4d4a440afbe55dc61bd4f484872ac740ef5a9a418a2c5b99bc (image=quay.ceph.io/ceph-ci/ceph@sha256:27d43f80a23d3545096a7bb490598a6f37852da2940e69e5a8f3e3d7fb58fd17, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, RELEASE=quincy-c61472c, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-04-25T17:24:52.828 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:24:52 smithi069 bash[94052]: ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4 2024-04-25T17:24:53.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:52 smithi037 ceph-mon[90844]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-25T17:24:53.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:52 smithi037 ceph-mon[90844]: osdmap e70: 6 total, 5 up, 6 in 2024-04-25T17:24:53.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:52 smithi037 ceph-mon[90844]: osdmap e71: 6 total, 5 up, 6 in 2024-04-25T17:24:53.168 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:24:52 smithi069 podman[94071]: 2024-04-25 17:24:52.827964467 +0000 UTC m=+0.634712067 container remove ba7b785c50f91a4d4a440afbe55dc61bd4f484872ac740ef5a9a418a2c5b99bc (image=quay.ceph.io/ceph-ci/ceph@sha256:27d43f80a23d3545096a7bb490598a6f37852da2940e69e5a8f3e3d7fb58fd17, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4, RELEASE=quincy-c61472c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.license=GPLv2, ceph=True) 2024-04-25T17:24:53.454 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:24:53 smithi069 podman[94162]: 2024-04-25 17:24:53.178779523 +0000 UTC m=+0.108986750 container create 90c43d8b064389dbdfaa7447d02d24e6beb1b528d916776b938c2d880e3c8398 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240424) 2024-04-25T17:24:53.454 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:24:53 smithi069 podman[94162]: 2024-04-25 17:24:53.087807714 +0000 UTC m=+0.018014932 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T17:24:53.904 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:53 smithi069 ceph-mon[80239]: pgmap v134: 65 pgs: 6 stale+active+clean, 59 active+clean; 208 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-04-25T17:24:53.904 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:24:53 smithi069 podman[94162]: 2024-04-25 17:24:53.606605293 +0000 UTC m=+0.536812520 container init 90c43d8b064389dbdfaa7447d02d24e6beb1b528d916776b938c2d880e3c8398 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4-deactivate, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424) 2024-04-25T17:24:53.904 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:24:53 smithi069 podman[94162]: 2024-04-25 17:24:53.609883725 +0000 UTC m=+0.540090952 container start 90c43d8b064389dbdfaa7447d02d24e6beb1b528d916776b938c2d880e3c8398 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-04-25T17:24:53.904 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:24:53 smithi069 podman[94162]: 2024-04-25 17:24:53.68107376 +0000 UTC m=+0.611280992 container attach 90c43d8b064389dbdfaa7447d02d24e6beb1b528d916776b938c2d880e3c8398 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4-deactivate, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_CLEAN=True, ceph=True) 2024-04-25T17:24:54.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:53 smithi037 ceph-mon[90844]: pgmap v134: 65 pgs: 6 stale+active+clean, 59 active+clean; 208 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-04-25T17:24:54.169 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:24:53 smithi069 podman[94162]: 2024-04-25 17:24:53.90429534 +0000 UTC m=+0.834502559 container died 90c43d8b064389dbdfaa7447d02d24e6beb1b528d916776b938c2d880e3c8398 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T17:24:54.454 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:24:54 smithi069 podman[94188]: 2024-04-25 17:24:54.434178626 +0000 UTC m=+0.524663627 container remove 90c43d8b064389dbdfaa7447d02d24e6beb1b528d916776b938c2d880e3c8398 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4-deactivate, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-04-25T17:24:54.751 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:24:54 smithi069 systemd[1]: ceph-599bb7fc-0326-11ef-bc93-c7b262605968@osd.4.service: Deactivated successfully. 2024-04-25T17:24:54.751 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:24:54 smithi069 systemd[1]: Stopped Ceph osd.4 for 599bb7fc-0326-11ef-bc93-c7b262605968. 2024-04-25T17:24:54.751 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:24:54 smithi069 systemd[1]: ceph-599bb7fc-0326-11ef-bc93-c7b262605968@osd.4.service: Consumed 1min 4.922s CPU time. 2024-04-25T17:24:54.752 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:24:54 smithi069 systemd[1]: Starting Ceph osd.4 for 599bb7fc-0326-11ef-bc93-c7b262605968... 2024-04-25T17:24:55.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:54 smithi037 ceph-mon[90844]: Health check failed: Degraded data redundancy: 13/228 objects degraded (5.702%), 6 pgs degraded (PG_DEGRADED) 2024-04-25T17:24:55.113 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:54 smithi069 ceph-mon[80239]: Health check failed: Degraded data redundancy: 13/228 objects degraded (5.702%), 6 pgs degraded (PG_DEGRADED) 2024-04-25T17:24:55.113 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:24:54 smithi069 podman[94292]: 2024-04-25 17:24:54.774281195 +0000 UTC m=+0.018316953 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T17:24:55.113 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:24:54 smithi069 podman[94292]: 2024-04-25 17:24:54.877073212 +0000 UTC m=+0.121108938 container create c4e4e55ef8f92d1a6885d56b75d17ef9048f3c56cafcc20a5c60ba3827807794 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, ceph=True) 2024-04-25T17:24:55.419 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:24:55 smithi069 podman[94292]: 2024-04-25 17:24:55.112955683 +0000 UTC m=+0.356991414 container init c4e4e55ef8f92d1a6885d56b75d17ef9048f3c56cafcc20a5c60ba3827807794 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4-activate, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424) 2024-04-25T17:24:55.419 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:24:55 smithi069 podman[94292]: 2024-04-25 17:24:55.116324028 +0000 UTC m=+0.360359755 container start c4e4e55ef8f92d1a6885d56b75d17ef9048f3c56cafcc20a5c60ba3827807794 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4-activate, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-04-25T17:24:55.419 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:24:55 smithi069 podman[94292]: 2024-04-25 17:24:55.212727578 +0000 UTC m=+0.456763301 container attach c4e4e55ef8f92d1a6885d56b75d17ef9048f3c56cafcc20a5c60ba3827807794 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4-activate, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-04-25T17:24:56.007 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:55 smithi069 ceph-mon[80239]: pgmap v136: 65 pgs: 6 active+undersized+degraded, 3 stale+active+clean, 9 active+undersized, 47 active+clean; 208 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 13/228 objects degraded (5.702%) 2024-04-25T17:24:56.007 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:24:55 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4-activate[94306]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-25T17:24:56.007 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:24:55 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4-activate[94306]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-25T17:24:56.008 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:24:55 smithi069 bash[94292]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-25T17:24:56.008 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:24:55 smithi069 bash[94292]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-25T17:24:56.008 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:24:55 smithi069 bash[94292]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-25T17:24:56.008 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:24:55 smithi069 bash[94292]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-04-25T17:24:56.008 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:24:55 smithi069 bash[94292]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-04-25T17:24:56.008 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:24:55 smithi069 bash[94292]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-04-25T17:24:56.008 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:24:55 smithi069 bash[94292]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-04-25T17:24:56.008 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:24:55 smithi069 bash[94292]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-25T17:24:56.008 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:24:55 smithi069 bash[94292]: --> ceph-volume raw activate successful for osd ID: 4 2024-04-25T17:24:56.008 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:24:55 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4-activate[94306]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-25T17:24:56.008 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:24:55 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4-activate[94306]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-04-25T17:24:56.008 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:24:55 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4-activate[94306]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-04-25T17:24:56.008 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:24:55 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4-activate[94306]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-04-25T17:24:56.008 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:24:55 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4-activate[94306]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-04-25T17:24:56.009 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:24:55 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4-activate[94306]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-25T17:24:56.009 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:24:55 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4-activate[94306]: --> ceph-volume raw activate successful for osd ID: 4 2024-04-25T17:24:56.009 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:24:55 smithi069 podman[94292]: 2024-04-25 17:24:55.729071383 +0000 UTC m=+0.973107121 container died c4e4e55ef8f92d1a6885d56b75d17ef9048f3c56cafcc20a5c60ba3827807794 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4-activate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-04-25T17:24:56.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:55 smithi037 ceph-mon[90844]: pgmap v136: 65 pgs: 6 active+undersized+degraded, 3 stale+active+clean, 9 active+undersized, 47 active+clean; 208 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 13/228 objects degraded (5.702%) 2024-04-25T17:24:56.614 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:24:56 smithi069 podman[94432]: 2024-04-25 17:24:56.274380364 +0000 UTC m=+0.535224100 container remove c4e4e55ef8f92d1a6885d56b75d17ef9048f3c56cafcc20a5c60ba3827807794 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4-activate, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0) 2024-04-25T17:24:56.614 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:24:56 smithi069 podman[94493]: 2024-04-25 17:24:56.390162396 +0000 UTC m=+0.018569492 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T17:24:56.614 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:24:56 smithi069 podman[94493]: 2024-04-25 17:24:56.500333513 +0000 UTC m=+0.128740590 container create ad76a3d0fecb0b96eda72e1b4d946fa60cd6a8e6713342939fdbdf71c7200034 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-04-25T17:24:57.169 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:24:56 smithi069 podman[94493]: 2024-04-25 17:24:56.728065832 +0000 UTC m=+0.356472910 container init ad76a3d0fecb0b96eda72e1b4d946fa60cd6a8e6713342939fdbdf71c7200034 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-04-25T17:24:57.169 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:24:56 smithi069 podman[94493]: 2024-04-25 17:24:56.731148448 +0000 UTC m=+0.359555535 container start ad76a3d0fecb0b96eda72e1b4d946fa60cd6a8e6713342939fdbdf71c7200034 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-04-25T17:24:57.169 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:24:56 smithi069 ceph-osd[94512]: -- 172.21.15.69:0/2712223585 <== mon.1 v2:172.21.15.69:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b598663680 con 0x55b59870a880 2024-04-25T17:24:57.169 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:24:56 smithi069 bash[94493]: ad76a3d0fecb0b96eda72e1b4d946fa60cd6a8e6713342939fdbdf71c7200034 2024-04-25T17:24:57.169 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:24:56 smithi069 systemd[1]: Started Ceph osd.4 for 599bb7fc-0326-11ef-bc93-c7b262605968. 2024-04-25T17:24:57.678 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:24:57 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4[94508]: 2024-04-25T17:24:57.288+0000 7ffb395c77c0 -1 Falling back to public interface 2024-04-25T17:24:58.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:57 smithi069 ceph-mon[80239]: pgmap v137: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 208 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 895 B/s rd, 1 op/s; 40/228 objects degraded (17.544%) 2024-04-25T17:24:58.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:57 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:24:58.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:57 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:24:58.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:57 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:24:58.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:57 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:24:58.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:57 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:24:58.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:57 smithi037 ceph-mon[90844]: pgmap v137: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 208 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 895 B/s rd, 1 op/s; 40/228 objects degraded (17.544%) 2024-04-25T17:24:58.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:57 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:24:58.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:57 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:24:58.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:57 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:24:58.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:57 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:24:58.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:57 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:25:00.123 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:59 smithi037 ceph-mon[90844]: pgmap v138: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 208 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 895 B/s rd, 1 op/s; 40/228 objects degraded (17.544%) 2024-04-25T17:25:00.124 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:59 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:25:00.124 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:24:59 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:25:00.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:59 smithi069 ceph-mon[80239]: pgmap v138: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 208 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 895 B/s rd, 1 op/s; 40/228 objects degraded (17.544%) 2024-04-25T17:25:00.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:59 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:25:00.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:24:59 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:25:01.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:01.874+0000 7fed63218700 1 -- 172.21.15.37:0/1263588686 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed5c0fc340 msgr2=0x7fed5c0fc750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:25:01.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:01.874+0000 7fed63218700 1 --2- 172.21.15.37:0/1263588686 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed5c0fc340 0x7fed5c0fc750 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fed4c004940 tx=0x7fed4c009e30 comp rx=0 tx=0).stop 2024-04-25T17:25:01.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:01.874+0000 7fed63218700 1 -- 172.21.15.37:0/1263588686 shutdown_connections 2024-04-25T17:25:01.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:01.874+0000 7fed63218700 1 --2- 172.21.15.37:0/1263588686 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fed5c0fcc90 0x7fed5c0fd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:01.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:01.874+0000 7fed63218700 1 --2- 172.21.15.37:0/1263588686 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed5c0fc340 0x7fed5c0fc750 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:01.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:01.874+0000 7fed63218700 1 -- 172.21.15.37:0/1263588686 >> 172.21.15.37:0/1263588686 conn(0x7fed5c0f6bd0 msgr2=0x7fed5c0f8fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:25:01.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:01.874+0000 7fed63218700 1 -- 172.21.15.37:0/1263588686 shutdown_connections 2024-04-25T17:25:01.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:01.874+0000 7fed63218700 1 -- 172.21.15.37:0/1263588686 wait complete. 2024-04-25T17:25:01.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:01.875+0000 7fed63218700 1 Processor -- start 2024-04-25T17:25:01.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:01.875+0000 7fed63218700 1 -- start start 2024-04-25T17:25:01.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:01.875+0000 7fed63218700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed5c0fc340 0x7fed5c10d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:25:01.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:01.875+0000 7fed63218700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fed5c0fcc90 0x7fed5c10de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:25:01.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:01.875+0000 7fed63218700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed5c10e420 con 0x7fed5c0fc340 2024-04-25T17:25:01.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:01.875+0000 7fed63218700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed5c10e590 con 0x7fed5c0fcc90 2024-04-25T17:25:01.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:01.875+0000 7fed60fb4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed5c0fc340 0x7fed5c10d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:25:01.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:01.875+0000 7fed60fb4700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed5c0fc340 0x7fed5c10d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33874/0 (socket says 172.21.15.37:33874) 2024-04-25T17:25:01.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:01.875+0000 7fed60fb4700 1 -- 172.21.15.37:0/4070276364 learned_addr learned my addr 172.21.15.37:0/4070276364 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:25:01.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:01.875+0000 7fed5bfff700 1 --2- 172.21.15.37:0/4070276364 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fed5c0fcc90 0x7fed5c10de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:25:01.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:01.875+0000 7fed60fb4700 1 -- 172.21.15.37:0/4070276364 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fed5c0fcc90 msgr2=0x7fed5c10de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:25:01.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:01.875+0000 7fed60fb4700 1 --2- 172.21.15.37:0/4070276364 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fed5c0fcc90 0x7fed5c10de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:01.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:01.875+0000 7fed60fb4700 1 -- 172.21.15.37:0/4070276364 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed4c005040 con 0x7fed5c0fc340 2024-04-25T17:25:01.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:01.876+0000 7fed60fb4700 1 --2- 172.21.15.37:0/4070276364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed5c0fc340 0x7fed5c10d8e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fed4c013870 tx=0x7fed4c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:25:01.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:01.876+0000 7fed597fa700 1 -- 172.21.15.37:0/4070276364 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed4c021070 con 0x7fed5c0fc340 2024-04-25T17:25:01.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:01.876+0000 7fed597fa700 1 -- 172.21.15.37:0/4070276364 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fed4c009430 con 0x7fed5c0fc340 2024-04-25T17:25:01.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:01.876+0000 7fed63218700 1 -- 172.21.15.37:0/4070276364 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed5c112f40 con 0x7fed5c0fc340 2024-04-25T17:25:01.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:01.876+0000 7fed597fa700 1 -- 172.21.15.37:0/4070276364 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed4c00e070 con 0x7fed5c0fc340 2024-04-25T17:25:01.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:01.876+0000 7fed63218700 1 -- 172.21.15.37:0/4070276364 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed5c1133f0 con 0x7fed5c0fc340 2024-04-25T17:25:01.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:01.877+0000 7fed63218700 1 -- 172.21.15.37:0/4070276364 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed5c101c90 con 0x7fed5c0fc340 2024-04-25T17:25:01.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:01.878+0000 7fed597fa700 1 -- 172.21.15.37:0/4070276364 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7fed4c01c7e0 con 0x7fed5c0fc340 2024-04-25T17:25:01.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:01.878+0000 7fed597fa700 1 --2- 172.21.15.37:0/4070276364 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fed44076b20 0x7fed44078fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:25:01.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:01.878+0000 7fed597fa700 1 -- 172.21.15.37:0/4070276364 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fed4c099550 con 0x7fed5c0fc340 2024-04-25T17:25:01.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:01.878+0000 7fed5bfff700 1 --2- 172.21.15.37:0/4070276364 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fed44076b20 0x7fed44078fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:25:01.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:01.879+0000 7fed5bfff700 1 --2- 172.21.15.37:0/4070276364 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fed44076b20 0x7fed44078fd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fed50009b80 tx=0x7fed5000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:25:01.884 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:01.883+0000 7fed597fa700 1 -- 172.21.15.37:0/4070276364 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fed4c062150 con 0x7fed5c0fc340 2024-04-25T17:25:02.118 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.117+0000 7fed63218700 1 -- 172.21.15.37:0/4070276364 --> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fed5c02b3b0 con 0x7fed44076b20 2024-04-25T17:25:02.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.119+0000 7fed597fa700 1 -- 172.21.15.37:0/4070276364 <== mgr.34104 v2:172.21.15.37:6800/783197737 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fed5c02b3b0 con 0x7fed44076b20 2024-04-25T17:25:02.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.121+0000 7fed63218700 1 -- 172.21.15.37:0/4070276364 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fed44076b20 msgr2=0x7fed44078fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:25:02.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.121+0000 7fed63218700 1 --2- 172.21.15.37:0/4070276364 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fed44076b20 0x7fed44078fd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fed50009b80 tx=0x7fed5000b040 comp rx=0 tx=0).stop 2024-04-25T17:25:02.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.121+0000 7fed63218700 1 -- 172.21.15.37:0/4070276364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed5c0fc340 msgr2=0x7fed5c10d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:25:02.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.121+0000 7fed63218700 1 --2- 172.21.15.37:0/4070276364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed5c0fc340 0x7fed5c10d8e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fed4c013870 tx=0x7fed4c009e30 comp rx=0 tx=0).stop 2024-04-25T17:25:02.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.121+0000 7fed63218700 1 -- 172.21.15.37:0/4070276364 shutdown_connections 2024-04-25T17:25:02.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.121+0000 7fed63218700 1 --2- 172.21.15.37:0/4070276364 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fed44076b20 0x7fed44078fd0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:02.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.121+0000 7fed63218700 1 --2- 172.21.15.37:0/4070276364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fed5c0fc340 0x7fed5c10d8e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:02.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.121+0000 7fed63218700 1 --2- 172.21.15.37:0/4070276364 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fed5c0fcc90 0x7fed5c10de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:02.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.121+0000 7fed63218700 1 -- 172.21.15.37:0/4070276364 >> 172.21.15.37:0/4070276364 conn(0x7fed5c0f6bd0 msgr2=0x7fed5c0fb4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:25:02.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.121+0000 7fed63218700 1 -- 172.21.15.37:0/4070276364 shutdown_connections 2024-04-25T17:25:02.122 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.121+0000 7fed63218700 1 -- 172.21.15.37:0/4070276364 wait complete. 2024-04-25T17:25:02.132 INFO:teuthology.orchestra.run.smithi037.stdout:true 2024-04-25T17:25:02.132 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:01 smithi037 ceph-mon[90844]: pgmap v139: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 208 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 231 B/s rd, 1 op/s; 40/228 objects degraded (17.544%) 2024-04-25T17:25:02.133 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:01 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:25:02.133 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:01 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:25:02.133 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:01 smithi037 ceph-mon[90844]: Health check update: Degraded data redundancy: 40/228 objects degraded (17.544%), 15 pgs degraded (PG_DEGRADED) 2024-04-25T17:25:02.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:01 smithi069 ceph-mon[80239]: pgmap v139: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 208 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 231 B/s rd, 1 op/s; 40/228 objects degraded (17.544%) 2024-04-25T17:25:02.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:01 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:25:02.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:01 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:25:02.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:01 smithi069 ceph-mon[80239]: Health check update: Degraded data redundancy: 40/228 objects degraded (17.544%), 15 pgs degraded (PG_DEGRADED) 2024-04-25T17:25:02.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.228+0000 7f597bb51700 1 -- 172.21.15.37:0/1312848143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59740fff90 msgr2=0x7f5974102370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:25:02.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.228+0000 7f597bb51700 1 --2- 172.21.15.37:0/1312848143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59740fff90 0x7f5974102370 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5968004940 tx=0x7f5968009e30 comp rx=0 tx=0).stop 2024-04-25T17:25:02.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.228+0000 7f597bb51700 1 -- 172.21.15.37:0/1312848143 shutdown_connections 2024-04-25T17:25:02.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.228+0000 7f597bb51700 1 --2- 172.21.15.37:0/1312848143 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59740fff90 0x7f5974102370 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:02.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.228+0000 7f597bb51700 1 --2- 172.21.15.37:0/1312848143 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5974066ed0 0x7f59740ffa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:02.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.228+0000 7f597bb51700 1 -- 172.21.15.37:0/1312848143 >> 172.21.15.37:0/1312848143 conn(0x7f59740f7480 msgr2=0x7f59740f9890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:25:02.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.228+0000 7f597bb51700 1 -- 172.21.15.37:0/1312848143 shutdown_connections 2024-04-25T17:25:02.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.228+0000 7f597bb51700 1 -- 172.21.15.37:0/1312848143 wait complete. 2024-04-25T17:25:02.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.229+0000 7f597bb51700 1 Processor -- start 2024-04-25T17:25:02.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.229+0000 7f597bb51700 1 -- start start 2024-04-25T17:25:02.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.229+0000 7f597bb51700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5974066ed0 0x7f597410d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:25:02.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.229+0000 7f597bb51700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59740fff90 0x7f597410deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:25:02.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.229+0000 7f597bb51700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f597410e4b0 con 0x7f59740fff90 2024-04-25T17:25:02.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.229+0000 7f597bb51700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f597410e620 con 0x7f5974066ed0 2024-04-25T17:25:02.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.229+0000 7f59790ec700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59740fff90 0x7f597410deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:25:02.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.229+0000 7f59798ed700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5974066ed0 0x7f597410d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:25:02.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.229+0000 7f59790ec700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59740fff90 0x7f597410deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33896/0 (socket says 172.21.15.37:33896) 2024-04-25T17:25:02.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.229+0000 7f59790ec700 1 -- 172.21.15.37:0/3065247030 learned_addr learned my addr 172.21.15.37:0/3065247030 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:25:02.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.230+0000 7f59790ec700 1 -- 172.21.15.37:0/3065247030 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5974066ed0 msgr2=0x7f597410d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:25:02.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.230+0000 7f59790ec700 1 --2- 172.21.15.37:0/3065247030 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5974066ed0 0x7f597410d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:02.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.230+0000 7f59790ec700 1 -- 172.21.15.37:0/3065247030 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5968005040 con 0x7f59740fff90 2024-04-25T17:25:02.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.230+0000 7f59790ec700 1 --2- 172.21.15.37:0/3065247030 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59740fff90 0x7f597410deb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f596800b3b0 tx=0x7f5968009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:25:02.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.230+0000 7f59727fc700 1 -- 172.21.15.37:0/3065247030 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f596800e040 con 0x7f59740fff90 2024-04-25T17:25:02.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.230+0000 7f59727fc700 1 -- 172.21.15.37:0/3065247030 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f596800bbf0 con 0x7f59740fff90 2024-04-25T17:25:02.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.230+0000 7f597bb51700 1 -- 172.21.15.37:0/3065247030 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5974112fd0 con 0x7f59740fff90 2024-04-25T17:25:02.232 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.230+0000 7f59727fc700 1 -- 172.21.15.37:0/3065247030 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f596801c630 con 0x7f59740fff90 2024-04-25T17:25:02.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.230+0000 7f597bb51700 1 -- 172.21.15.37:0/3065247030 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5974113560 con 0x7f59740fff90 2024-04-25T17:25:02.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.231+0000 7f597bb51700 1 -- 172.21.15.37:0/3065247030 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f597404c710 con 0x7f59740fff90 2024-04-25T17:25:02.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.232+0000 7f59727fc700 1 -- 172.21.15.37:0/3065247030 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f596800bd60 con 0x7f59740fff90 2024-04-25T17:25:02.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.232+0000 7f59727fc700 1 --2- 172.21.15.37:0/3065247030 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f595c076b90 0x7f595c079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:25:02.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.232+0000 7f59727fc700 1 -- 172.21.15.37:0/3065247030 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f5968098d80 con 0x7f59740fff90 2024-04-25T17:25:02.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.232+0000 7f59798ed700 1 --2- 172.21.15.37:0/3065247030 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f595c076b90 0x7f595c079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:25:02.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.233+0000 7f59798ed700 1 --2- 172.21.15.37:0/3065247030 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f595c076b90 0x7f595c079040 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5974066c10 tx=0x7f5964009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:25:02.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.237+0000 7f59727fc700 1 -- 172.21.15.37:0/3065247030 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f5968061a20 con 0x7f59740fff90 2024-04-25T17:25:02.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.471+0000 7f597bb51700 1 -- 172.21.15.37:0/3065247030 --> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5974113860 con 0x7f595c076b90 2024-04-25T17:25:02.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.473+0000 7f59727fc700 1 -- 172.21.15.37:0/3065247030 <== mgr.34104 v2:172.21.15.37:6800/783197737 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f5974113860 con 0x7f595c076b90 2024-04-25T17:25:02.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.475+0000 7f597bb51700 1 -- 172.21.15.37:0/3065247030 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f595c076b90 msgr2=0x7f595c079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:25:02.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.475+0000 7f597bb51700 1 --2- 172.21.15.37:0/3065247030 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f595c076b90 0x7f595c079040 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5974066c10 tx=0x7f5964009040 comp rx=0 tx=0).stop 2024-04-25T17:25:02.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.475+0000 7f597bb51700 1 -- 172.21.15.37:0/3065247030 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59740fff90 msgr2=0x7f597410deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:25:02.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.475+0000 7f597bb51700 1 --2- 172.21.15.37:0/3065247030 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59740fff90 0x7f597410deb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f596800b3b0 tx=0x7f5968009e30 comp rx=0 tx=0).stop 2024-04-25T17:25:02.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.475+0000 7f597bb51700 1 -- 172.21.15.37:0/3065247030 shutdown_connections 2024-04-25T17:25:02.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.475+0000 7f597bb51700 1 --2- 172.21.15.37:0/3065247030 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f595c076b90 0x7f595c079040 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:02.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.475+0000 7f597bb51700 1 --2- 172.21.15.37:0/3065247030 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5974066ed0 0x7f597410d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:02.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.475+0000 7f597bb51700 1 --2- 172.21.15.37:0/3065247030 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f59740fff90 0x7f597410deb0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:02.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.475+0000 7f597bb51700 1 -- 172.21.15.37:0/3065247030 >> 172.21.15.37:0/3065247030 conn(0x7f59740f7480 msgr2=0x7f59740f7850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:25:02.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.475+0000 7f597bb51700 1 -- 172.21.15.37:0/3065247030 shutdown_connections 2024-04-25T17:25:02.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.475+0000 7f597bb51700 1 -- 172.21.15.37:0/3065247030 wait complete. 2024-04-25T17:25:02.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.580+0000 7f71e33f3700 1 -- 172.21.15.37:0/2346715424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71dc0fcf60 msgr2=0x7f71dc0fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:25:02.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.580+0000 7f71e33f3700 1 --2- 172.21.15.37:0/2346715424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71dc0fcf60 0x7f71dc0fd3d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f71cc004940 tx=0x7f71cc009e30 comp rx=0 tx=0).stop 2024-04-25T17:25:02.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.580+0000 7f71e33f3700 1 -- 172.21.15.37:0/2346715424 shutdown_connections 2024-04-25T17:25:02.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.580+0000 7f71e33f3700 1 --2- 172.21.15.37:0/2346715424 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71dc0fcf60 0x7f71dc0fd3d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:02.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.580+0000 7f71e33f3700 1 --2- 172.21.15.37:0/2346715424 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f71dc0fbcb0 0x7f71dc0fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:02.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.580+0000 7f71e33f3700 1 -- 172.21.15.37:0/2346715424 >> 172.21.15.37:0/2346715424 conn(0x7f71dc0f7430 msgr2=0x7f71dc0f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:25:02.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.580+0000 7f71e33f3700 1 -- 172.21.15.37:0/2346715424 shutdown_connections 2024-04-25T17:25:02.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.580+0000 7f71e33f3700 1 -- 172.21.15.37:0/2346715424 wait complete. 2024-04-25T17:25:02.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.580+0000 7f71e33f3700 1 Processor -- start 2024-04-25T17:25:02.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.581+0000 7f71e33f3700 1 -- start start 2024-04-25T17:25:02.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.581+0000 7f71e33f3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f71dc0fbcb0 0x7f71dc110730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:25:02.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.581+0000 7f71e33f3700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71dc0fcf60 0x7f71dc112c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:25:02.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.581+0000 7f71e33f3700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc066350 con 0x7f71dc0fcf60 2024-04-25T17:25:02.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.581+0000 7f71e33f3700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71dc066490 con 0x7f71dc0fbcb0 2024-04-25T17:25:02.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.581+0000 7f71e098e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71dc0fcf60 0x7f71dc112c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:25:02.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.581+0000 7f71e118f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f71dc0fbcb0 0x7f71dc110730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:25:02.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.581+0000 7f71e098e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71dc0fcf60 0x7f71dc112c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33910/0 (socket says 172.21.15.37:33910) 2024-04-25T17:25:02.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.581+0000 7f71e098e700 1 -- 172.21.15.37:0/3688290663 learned_addr learned my addr 172.21.15.37:0/3688290663 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:25:02.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.581+0000 7f71e098e700 1 -- 172.21.15.37:0/3688290663 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f71dc0fbcb0 msgr2=0x7f71dc110730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:25:02.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.581+0000 7f71e098e700 1 --2- 172.21.15.37:0/3688290663 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f71dc0fbcb0 0x7f71dc110730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:02.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.581+0000 7f71e098e700 1 -- 172.21.15.37:0/3688290663 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71cc005040 con 0x7f71dc0fcf60 2024-04-25T17:25:02.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.581+0000 7f71e098e700 1 --2- 172.21.15.37:0/3688290663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71dc0fcf60 0x7f71dc112c80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f71cc00b970 tx=0x7f71cc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:25:02.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.582+0000 7f71d1ffb700 1 -- 172.21.15.37:0/3688290663 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71cc00e040 con 0x7f71dc0fcf60 2024-04-25T17:25:02.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.582+0000 7f71e33f3700 1 -- 172.21.15.37:0/3688290663 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71dc113220 con 0x7f71dc0fcf60 2024-04-25T17:25:02.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.582+0000 7f71d1ffb700 1 -- 172.21.15.37:0/3688290663 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f71cc00bbf0 con 0x7f71dc0fcf60 2024-04-25T17:25:02.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.582+0000 7f71d1ffb700 1 -- 172.21.15.37:0/3688290663 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f71cc01c630 con 0x7f71dc0fcf60 2024-04-25T17:25:02.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.582+0000 7f71e33f3700 1 -- 172.21.15.37:0/3688290663 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71dc1137b0 con 0x7f71dc0fcf60 2024-04-25T17:25:02.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.583+0000 7f71e33f3700 1 -- 172.21.15.37:0/3688290663 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71dc05f5c0 con 0x7f71dc0fcf60 2024-04-25T17:25:02.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.584+0000 7f71d1ffb700 1 -- 172.21.15.37:0/3688290663 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f71cc00bd60 con 0x7f71dc0fcf60 2024-04-25T17:25:02.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.584+0000 7f71d1ffb700 1 --2- 172.21.15.37:0/3688290663 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f71c8076b90 0x7f71c8079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:25:02.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.584+0000 7f71d1ffb700 1 -- 172.21.15.37:0/3688290663 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f71cc09a090 con 0x7f71dc0fcf60 2024-04-25T17:25:02.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.584+0000 7f71e118f700 1 --2- 172.21.15.37:0/3688290663 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f71c8076b90 0x7f71c8079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:25:02.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.585+0000 7f71e118f700 1 --2- 172.21.15.37:0/3688290663 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f71c8076b90 0x7f71c8079040 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f71dc065fd0 tx=0x7f71d800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:25:02.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.589+0000 7f71d1ffb700 1 -- 172.21.15.37:0/3688290663 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f71cc062c70 con 0x7f71dc0fcf60 2024-04-25T17:25:02.809 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.808+0000 7f71e33f3700 1 -- 172.21.15.37:0/3688290663 --> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f71dc1012c0 con 0x7f71c8076b90 2024-04-25T17:25:02.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.819+0000 7f71d1ffb700 1 -- 172.21.15.37:0/3688290663 <== mgr.34104 v2:172.21.15.37:6800/783197737 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f71dc1012c0 con 0x7f71c8076b90 2024-04-25T17:25:02.820 INFO:teuthology.orchestra.run.smithi037.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-25T17:25:02.820 INFO:teuthology.orchestra.run.smithi037.stdout:alertmanager.smithi037 smithi037 *:9093,9094 running (6m) 70s ago 14m 24.9M - 0.25.0 c8568f914cd2 18aed8f409ee 2024-04-25T17:25:02.820 INFO:teuthology.orchestra.run.smithi037.stdout:crash.smithi037 smithi037 running (2m) 70s ago 15m 6660k - 19.0.0-3291-g994e2f20 d53c96779a29 639584ea5855 2024-04-25T17:25:02.820 INFO:teuthology.orchestra.run.smithi037.stdout:crash.smithi069 smithi069 running (2m) 2s ago 13m 6665k - 19.0.0-3291-g994e2f20 d53c96779a29 ee5db16733a7 2024-04-25T17:25:02.820 INFO:teuthology.orchestra.run.smithi037.stdout:grafana.smithi037 smithi037 *:3000 running (6m) 70s ago 14m 84.2M - 9.4.7 954c08fa6188 1eff3ea3f9b0 2024-04-25T17:25:02.820 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi037.ksmixc smithi037 running (9m) 70s ago 9m 149M - 17.2.7-902-gc61472c8 0de407c1b3af 394aa56079b4 2024-04-25T17:25:02.820 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi037.ovkrpq smithi037 running (9m) 70s ago 9m 102M - 17.2.7-902-gc61472c8 0de407c1b3af 73ca662174a7 2024-04-25T17:25:02.820 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi069.cpprst smithi069 running (9m) 2s ago 9m 16.2M - 17.2.7-902-gc61472c8 0de407c1b3af dbda101df20e 2024-04-25T17:25:02.820 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi069.ytlqcf smithi069 running (9m) 2s ago 9m 14.2M - 17.2.7-902-gc61472c8 0de407c1b3af 911df6b18215 2024-04-25T17:25:02.820 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.smithi037.txrgxl smithi037 *:8443,9283,8765 running (5m) 70s ago 16m 573M - 19.0.0-3291-g994e2f20 d53c96779a29 e9653fc62df9 2024-04-25T17:25:02.820 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.smithi069.mmuhdo smithi069 *:8443,9283,8765 running (4m) 2s ago 13m 520M - 19.0.0-3291-g994e2f20 d53c96779a29 6820207b4019 2024-04-25T17:25:02.820 INFO:teuthology.orchestra.run.smithi037.stdout:mon.smithi037 smithi037 running (4m) 70s ago 16m 113M 2048M 19.0.0-3291-g994e2f20 d53c96779a29 1b349f3af69d 2024-04-25T17:25:02.820 INFO:teuthology.orchestra.run.smithi037.stdout:mon.smithi069 smithi069 running (3m) 2s ago 13m 105M 2048M 19.0.0-3291-g994e2f20 d53c96779a29 7744dbe81b50 2024-04-25T17:25:02.821 INFO:teuthology.orchestra.run.smithi037.stdout:node-exporter.smithi037 smithi037 *:9100 running (6m) 70s ago 15m 14.4M - 1.5.0 0da6a335fe13 1e59bbb2aa82 2024-04-25T17:25:02.821 INFO:teuthology.orchestra.run.smithi037.stdout:node-exporter.smithi069 smithi069 *:9100 running (5m) 2s ago 13m 16.4M - 1.5.0 0da6a335fe13 0c51a9833fe4 2024-04-25T17:25:02.821 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0 smithi037 running (2m) 70s ago 12m 163M 1559M 19.0.0-3291-g994e2f20 d53c96779a29 e97538cb8b4f 2024-04-25T17:25:02.821 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1 smithi037 running (112s) 70s ago 12m 166M 1559M 19.0.0-3291-g994e2f20 d53c96779a29 6cf158192aae 2024-04-25T17:25:02.821 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2 smithi037 running (75s) 70s ago 12m 79.6M 1559M 19.0.0-3291-g994e2f20 d53c96779a29 a0b57bba2ebf 2024-04-25T17:25:02.821 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3 smithi069 running (39s) 2s ago 11m 177M 2581M 19.0.0-3291-g994e2f20 d53c96779a29 d1aa15d6b575 2024-04-25T17:25:02.821 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4 smithi069 running (6s) 2s ago 11m 79.8M 2581M 19.0.0-3291-g994e2f20 d53c96779a29 ad76a3d0fecb 2024-04-25T17:25:02.821 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5 smithi069 running (10m) 2s ago 10m 228M 2581M 17.2.7-902-gc61472c8 0de407c1b3af f6be99c364ff 2024-04-25T17:25:02.821 INFO:teuthology.orchestra.run.smithi037.stdout:prometheus.smithi037 smithi037 *:9095 running (4m) 70s ago 14m 65.9M - 2.43.0 a07b618ecd1d 2c5a268ffc1f 2024-04-25T17:25:02.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.821+0000 7f71e33f3700 1 -- 172.21.15.37:0/3688290663 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f71c8076b90 msgr2=0x7f71c8079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:25:02.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.821+0000 7f71e33f3700 1 --2- 172.21.15.37:0/3688290663 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f71c8076b90 0x7f71c8079040 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f71dc065fd0 tx=0x7f71d800b040 comp rx=0 tx=0).stop 2024-04-25T17:25:02.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.821+0000 7f71e33f3700 1 -- 172.21.15.37:0/3688290663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71dc0fcf60 msgr2=0x7f71dc112c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:25:02.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.821+0000 7f71e33f3700 1 --2- 172.21.15.37:0/3688290663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71dc0fcf60 0x7f71dc112c80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f71cc00b970 tx=0x7f71cc009e30 comp rx=0 tx=0).stop 2024-04-25T17:25:02.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.821+0000 7f71e33f3700 1 -- 172.21.15.37:0/3688290663 shutdown_connections 2024-04-25T17:25:02.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.821+0000 7f71e33f3700 1 --2- 172.21.15.37:0/3688290663 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f71c8076b90 0x7f71c8079040 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:02.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.821+0000 7f71e33f3700 1 --2- 172.21.15.37:0/3688290663 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f71dc0fbcb0 0x7f71dc110730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:02.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.821+0000 7f71e33f3700 1 --2- 172.21.15.37:0/3688290663 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f71dc0fcf60 0x7f71dc112c80 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:02.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.821+0000 7f71e33f3700 1 -- 172.21.15.37:0/3688290663 >> 172.21.15.37:0/3688290663 conn(0x7f71dc0f7430 msgr2=0x7f71dc0f8b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:25:02.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.821+0000 7f71e33f3700 1 -- 172.21.15.37:0/3688290663 shutdown_connections 2024-04-25T17:25:02.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.821+0000 7f71e33f3700 1 -- 172.21.15.37:0/3688290663 wait complete. 2024-04-25T17:25:02.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.925+0000 7f8a9c8a7700 1 -- 172.21.15.37:0/71180664 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a98066ed0 msgr2=0x7f8a980ffa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:25:02.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.925+0000 7f8a9c8a7700 1 --2- 172.21.15.37:0/71180664 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a98066ed0 0x7f8a980ffa10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8a80004940 tx=0x7f8a80009e30 comp rx=0 tx=0).stop 2024-04-25T17:25:02.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.925+0000 7f8a9c8a7700 1 -- 172.21.15.37:0/71180664 shutdown_connections 2024-04-25T17:25:02.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.925+0000 7f8a9c8a7700 1 --2- 172.21.15.37:0/71180664 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a980fff50 0x7f8a98102330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:02.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.925+0000 7f8a9c8a7700 1 --2- 172.21.15.37:0/71180664 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a98066ed0 0x7f8a980ffa10 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:02.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.925+0000 7f8a9c8a7700 1 -- 172.21.15.37:0/71180664 >> 172.21.15.37:0/71180664 conn(0x7f8a980f7440 msgr2=0x7f8a980f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:25:02.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.925+0000 7f8a9c8a7700 1 -- 172.21.15.37:0/71180664 shutdown_connections 2024-04-25T17:25:02.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.925+0000 7f8a9c8a7700 1 -- 172.21.15.37:0/71180664 wait complete. 2024-04-25T17:25:02.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.925+0000 7f8a9c8a7700 1 Processor -- start 2024-04-25T17:25:02.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.925+0000 7f8a9c8a7700 1 -- start start 2024-04-25T17:25:02.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.925+0000 7f8a9c8a7700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a98066ed0 0x7f8a980fd210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:25:02.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.925+0000 7f8a9c8a7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a980fff50 0x7f8a980fb910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:25:02.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.925+0000 7f8a9c8a7700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a980fd810 con 0x7f8a980fff50 2024-04-25T17:25:02.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.925+0000 7f8a9c8a7700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a980fbe50 con 0x7f8a98066ed0 2024-04-25T17:25:02.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.926+0000 7f8a95d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a980fff50 0x7f8a980fb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:25:02.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.926+0000 7f8a95d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a980fff50 0x7f8a980fb910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33936/0 (socket says 172.21.15.37:33936) 2024-04-25T17:25:02.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.926+0000 7f8a95d9b700 1 -- 172.21.15.37:0/2243187891 learned_addr learned my addr 172.21.15.37:0/2243187891 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:25:02.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.926+0000 7f8a9659c700 1 --2- 172.21.15.37:0/2243187891 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a98066ed0 0x7f8a980fd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:25:02.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.926+0000 7f8a95d9b700 1 -- 172.21.15.37:0/2243187891 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a98066ed0 msgr2=0x7f8a980fd210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:25:02.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.926+0000 7f8a95d9b700 1 --2- 172.21.15.37:0/2243187891 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a98066ed0 0x7f8a980fd210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:02.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.926+0000 7f8a95d9b700 1 -- 172.21.15.37:0/2243187891 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a80005040 con 0x7f8a980fff50 2024-04-25T17:25:02.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.926+0000 7f8a95d9b700 1 --2- 172.21.15.37:0/2243187891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a980fff50 0x7f8a980fb910 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8a8800eb40 tx=0x7f8a8800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:25:02.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.926+0000 7f8a8effd700 1 -- 172.21.15.37:0/2243187891 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a88007cc0 con 0x7f8a980fff50 2024-04-25T17:25:02.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.926+0000 7f8a8effd700 1 -- 172.21.15.37:0/2243187891 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8a8800f040 con 0x7f8a980fff50 2024-04-25T17:25:02.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.926+0000 7f8a9c8a7700 1 -- 172.21.15.37:0/2243187891 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a980fc0d0 con 0x7f8a980fff50 2024-04-25T17:25:02.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.926+0000 7f8a8effd700 1 -- 172.21.15.37:0/2243187891 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a8800ca10 con 0x7f8a980fff50 2024-04-25T17:25:02.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.926+0000 7f8a9c8a7700 1 -- 172.21.15.37:0/2243187891 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a980fc610 con 0x7f8a980fff50 2024-04-25T17:25:02.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.927+0000 7f8a9c8a7700 1 -- 172.21.15.37:0/2243187891 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a9804c710 con 0x7f8a980fff50 2024-04-25T17:25:02.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.928+0000 7f8a8effd700 1 -- 172.21.15.37:0/2243187891 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f8a8800cb70 con 0x7f8a980fff50 2024-04-25T17:25:02.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.928+0000 7f8a8effd700 1 --2- 172.21.15.37:0/2243187891 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f8a84076b90 0x7f8a84079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:25:02.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.928+0000 7f8a8effd700 1 -- 172.21.15.37:0/2243187891 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f8a88097de0 con 0x7f8a980fff50 2024-04-25T17:25:02.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.929+0000 7f8a9659c700 1 --2- 172.21.15.37:0/2243187891 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f8a84076b90 0x7f8a84079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:25:02.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.929+0000 7f8a9659c700 1 --2- 172.21.15.37:0/2243187891 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f8a84076b90 0x7f8a84079040 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8a80004890 tx=0x7f8a80009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:25:02.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:02.933+0000 7f8a8effd700 1 -- 172.21.15.37:0/2243187891 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f8a88060a90 con 0x7f8a980fff50 2024-04-25T17:25:03.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:02 smithi037 ceph-mon[90844]: from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:25:03.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.232+0000 7f8a9c8a7700 1 -- 172.21.15.37:0/2243187891 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8a981058b0 con 0x7f8a980fff50 2024-04-25T17:25:03.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.232+0000 7f8a8effd700 1 -- 172.21.15.37:0/2243187891 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+839 (secure 0 0 0) 0x7f8a88060430 con 0x7f8a980fff50 2024-04-25T17:25:03.233 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-25T17:25:03.233 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": { 2024-04-25T17:25:03.233 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 2 2024-04-25T17:25:03.233 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:25:03.233 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": { 2024-04-25T17:25:03.233 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 2 2024-04-25T17:25:03.234 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:25:03.234 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": { 2024-04-25T17:25:03.234 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 1, 2024-04-25T17:25:03.234 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 4 2024-04-25T17:25:03.234 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:25:03.234 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": { 2024-04-25T17:25:03.234 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 4 2024-04-25T17:25:03.234 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:25:03.234 INFO:teuthology.orchestra.run.smithi037.stdout: "overall": { 2024-04-25T17:25:03.234 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 5, 2024-04-25T17:25:03.234 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 8 2024-04-25T17:25:03.234 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-04-25T17:25:03.235 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-25T17:25:03.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.235+0000 7f8a9c8a7700 1 -- 172.21.15.37:0/2243187891 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f8a84076b90 msgr2=0x7f8a84079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:25:03.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.235+0000 7f8a9c8a7700 1 --2- 172.21.15.37:0/2243187891 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f8a84076b90 0x7f8a84079040 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8a80004890 tx=0x7f8a80009e30 comp rx=0 tx=0).stop 2024-04-25T17:25:03.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.235+0000 7f8a9c8a7700 1 -- 172.21.15.37:0/2243187891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a980fff50 msgr2=0x7f8a980fb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:25:03.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.235+0000 7f8a9c8a7700 1 --2- 172.21.15.37:0/2243187891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a980fff50 0x7f8a980fb910 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8a8800eb40 tx=0x7f8a8800b040 comp rx=0 tx=0).stop 2024-04-25T17:25:03.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.235+0000 7f8a9c8a7700 1 -- 172.21.15.37:0/2243187891 shutdown_connections 2024-04-25T17:25:03.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.235+0000 7f8a9c8a7700 1 --2- 172.21.15.37:0/2243187891 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f8a84076b90 0x7f8a84079040 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:03.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.235+0000 7f8a9c8a7700 1 --2- 172.21.15.37:0/2243187891 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a98066ed0 0x7f8a980fd210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:03.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.235+0000 7f8a9c8a7700 1 --2- 172.21.15.37:0/2243187891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8a980fff50 0x7f8a980fb910 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:03.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.235+0000 7f8a9c8a7700 1 -- 172.21.15.37:0/2243187891 >> 172.21.15.37:0/2243187891 conn(0x7f8a980f7440 msgr2=0x7f8a980f7810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:25:03.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.235+0000 7f8a9c8a7700 1 -- 172.21.15.37:0/2243187891 shutdown_connections 2024-04-25T17:25:03.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.235+0000 7f8a9c8a7700 1 -- 172.21.15.37:0/2243187891 wait complete. 2024-04-25T17:25:03.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.339+0000 7f8d1e054700 1 -- 172.21.15.37:0/1132814882 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d180fffd0 msgr2=0x7f8d181023b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:25:03.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.339+0000 7f8d1e054700 1 --2- 172.21.15.37:0/1132814882 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d180fffd0 0x7f8d181023b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8d00004940 tx=0x7f8d00009e30 comp rx=0 tx=0).stop 2024-04-25T17:25:03.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.339+0000 7f8d1e054700 1 -- 172.21.15.37:0/1132814882 shutdown_connections 2024-04-25T17:25:03.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.339+0000 7f8d1e054700 1 --2- 172.21.15.37:0/1132814882 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d180fffd0 0x7f8d181023b0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:03.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.339+0000 7f8d1e054700 1 --2- 172.21.15.37:0/1132814882 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d18066af0 0x7f8d180ffa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:03.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.339+0000 7f8d1e054700 1 -- 172.21.15.37:0/1132814882 >> 172.21.15.37:0/1132814882 conn(0x7f8d180f74c0 msgr2=0x7f8d180f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:25:03.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.339+0000 7f8d1e054700 1 -- 172.21.15.37:0/1132814882 shutdown_connections 2024-04-25T17:25:03.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.339+0000 7f8d1e054700 1 -- 172.21.15.37:0/1132814882 wait complete. 2024-04-25T17:25:03.341 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.340+0000 7f8d1e054700 1 Processor -- start 2024-04-25T17:25:03.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.340+0000 7f8d1e054700 1 -- start start 2024-04-25T17:25:03.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.340+0000 7f8d1e054700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d18066af0 0x7f8d1810d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:25:03.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.340+0000 7f8d1e054700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d180fffd0 0x7f8d1810dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:25:03.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.340+0000 7f8d1e054700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1810e4e0 con 0x7f8d180fffd0 2024-04-25T17:25:03.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.340+0000 7f8d1e054700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1810ed30 con 0x7f8d18066af0 2024-04-25T17:25:03.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.341+0000 7f8d16ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d180fffd0 0x7f8d1810dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:25:03.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.341+0000 7f8d16ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d180fffd0 0x7f8d1810dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33946/0 (socket says 172.21.15.37:33946) 2024-04-25T17:25:03.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.341+0000 7f8d16ffd700 1 -- 172.21.15.37:0/3412952831 learned_addr learned my addr 172.21.15.37:0/3412952831 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:25:03.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.341+0000 7f8d177fe700 1 --2- 172.21.15.37:0/3412952831 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d18066af0 0x7f8d1810d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:25:03.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.341+0000 7f8d16ffd700 1 -- 172.21.15.37:0/3412952831 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d18066af0 msgr2=0x7f8d1810d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:25:03.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.341+0000 7f8d16ffd700 1 --2- 172.21.15.37:0/3412952831 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d18066af0 0x7f8d1810d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:03.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.341+0000 7f8d16ffd700 1 -- 172.21.15.37:0/3412952831 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d00005040 con 0x7f8d180fffd0 2024-04-25T17:25:03.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.341+0000 7f8d16ffd700 1 --2- 172.21.15.37:0/3412952831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d180fffd0 0x7f8d1810dee0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8d0000b0d0 tx=0x7f8d00009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:25:03.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.341+0000 7f8d0ffff700 1 -- 172.21.15.37:0/3412952831 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d0000e030 con 0x7f8d180fffd0 2024-04-25T17:25:03.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.341+0000 7f8d1e054700 1 -- 172.21.15.37:0/3412952831 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d1810efb0 con 0x7f8d180fffd0 2024-04-25T17:25:03.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.341+0000 7f8d0ffff700 1 -- 172.21.15.37:0/3412952831 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8d0001c400 con 0x7f8d180fffd0 2024-04-25T17:25:03.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.341+0000 7f8d0ffff700 1 -- 172.21.15.37:0/3412952831 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d0000b630 con 0x7f8d180fffd0 2024-04-25T17:25:03.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.341+0000 7f8d1e054700 1 -- 172.21.15.37:0/3412952831 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d1810f4f0 con 0x7f8d180fffd0 2024-04-25T17:25:03.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.342+0000 7f8d1e054700 1 -- 172.21.15.37:0/3412952831 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d1805f5c0 con 0x7f8d180fffd0 2024-04-25T17:25:03.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.343+0000 7f8d0ffff700 1 -- 172.21.15.37:0/3412952831 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f8d0001c570 con 0x7f8d180fffd0 2024-04-25T17:25:03.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.343+0000 7f8d0ffff700 1 --2- 172.21.15.37:0/3412952831 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f8d04076b90 0x7f8d04079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:25:03.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.343+0000 7f8d0ffff700 1 -- 172.21.15.37:0/3412952831 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f8d00099bd0 con 0x7f8d180fffd0 2024-04-25T17:25:03.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.343+0000 7f8d177fe700 1 --2- 172.21.15.37:0/3412952831 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f8d04076b90 0x7f8d04079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:25:03.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.344+0000 7f8d177fe700 1 --2- 172.21.15.37:0/3412952831 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f8d04076b90 0x7f8d04079040 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8d18066830 tx=0x7f8d1000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:25:03.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.348+0000 7f8d0ffff700 1 -- 172.21.15.37:0/3412952831 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f8d000627d0 con 0x7f8d180fffd0 2024-04-25T17:25:03.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:02 smithi069 ceph-mon[80239]: from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:25:03.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.605+0000 7f8d1e054700 1 -- 172.21.15.37:0/3412952831 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8d181058b0 con 0x7f8d180fffd0 2024-04-25T17:25:03.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.606+0000 7f8d0ffff700 1 -- 172.21.15.37:0/3412952831 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1900 (secure 0 0 0) 0x7f8d0001c820 con 0x7f8d180fffd0 2024-04-25T17:25:03.607 INFO:teuthology.orchestra.run.smithi037.stdout:e16 2024-04-25T17:25:03.607 INFO:teuthology.orchestra.run.smithi037.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-25T17:25:03.607 INFO:teuthology.orchestra.run.smithi037.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T17:25:03.607 INFO:teuthology.orchestra.run.smithi037.stdout:legacy client fscid: 1 2024-04-25T17:25:03.607 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:25:03.607 INFO:teuthology.orchestra.run.smithi037.stdout:Filesystem 'cephfs' (1) 2024-04-25T17:25:03.607 INFO:teuthology.orchestra.run.smithi037.stdout:fs_name cephfs 2024-04-25T17:25:03.607 INFO:teuthology.orchestra.run.smithi037.stdout:epoch 16 2024-04-25T17:25:03.607 INFO:teuthology.orchestra.run.smithi037.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-25T17:25:03.607 INFO:teuthology.orchestra.run.smithi037.stdout:created 2024-04-25T17:15:40.586130+0000 2024-04-25T17:25:03.607 INFO:teuthology.orchestra.run.smithi037.stdout:modified 2024-04-25T17:15:57.508740+0000 2024-04-25T17:25:03.607 INFO:teuthology.orchestra.run.smithi037.stdout:tableserver 0 2024-04-25T17:25:03.607 INFO:teuthology.orchestra.run.smithi037.stdout:root 0 2024-04-25T17:25:03.608 INFO:teuthology.orchestra.run.smithi037.stdout:session_timeout 60 2024-04-25T17:25:03.608 INFO:teuthology.orchestra.run.smithi037.stdout:session_autoclose 300 2024-04-25T17:25:03.608 INFO:teuthology.orchestra.run.smithi037.stdout:max_file_size 1099511627776 2024-04-25T17:25:03.608 INFO:teuthology.orchestra.run.smithi037.stdout:max_xattr_size 65536 2024-04-25T17:25:03.608 INFO:teuthology.orchestra.run.smithi037.stdout:required_client_features {} 2024-04-25T17:25:03.608 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure 0 2024-04-25T17:25:03.608 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure_osd_epoch 0 2024-04-25T17:25:03.608 INFO:teuthology.orchestra.run.smithi037.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T17:25:03.608 INFO:teuthology.orchestra.run.smithi037.stdout:max_mds 1 2024-04-25T17:25:03.608 INFO:teuthology.orchestra.run.smithi037.stdout:in 0 2024-04-25T17:25:03.608 INFO:teuthology.orchestra.run.smithi037.stdout:up {0=14470} 2024-04-25T17:25:03.608 INFO:teuthology.orchestra.run.smithi037.stdout:failed 2024-04-25T17:25:03.608 INFO:teuthology.orchestra.run.smithi037.stdout:damaged 2024-04-25T17:25:03.608 INFO:teuthology.orchestra.run.smithi037.stdout:stopped 2024-04-25T17:25:03.608 INFO:teuthology.orchestra.run.smithi037.stdout:data_pools [3] 2024-04-25T17:25:03.609 INFO:teuthology.orchestra.run.smithi037.stdout:metadata_pool 2 2024-04-25T17:25:03.609 INFO:teuthology.orchestra.run.smithi037.stdout:inline_data disabled 2024-04-25T17:25:03.609 INFO:teuthology.orchestra.run.smithi037.stdout:balancer 2024-04-25T17:25:03.609 INFO:teuthology.orchestra.run.smithi037.stdout:bal_rank_mask -1 2024-04-25T17:25:03.609 INFO:teuthology.orchestra.run.smithi037.stdout:standby_count_wanted 1 2024-04-25T17:25:03.609 INFO:teuthology.orchestra.run.smithi037.stdout:qdb_cluster leader: 0 members: 2024-04-25T17:25:03.609 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi037.ksmixc{0:14470} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.37:6826/1903989494,v1:172.21.15.37:6827/1903989494] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:25:03.609 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi037.ovkrpq{0:14482} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.37:6828/4206394422,v1:172.21.15.37:6829/4206394422] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:25:03.609 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:25:03.609 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:25:03.609 INFO:teuthology.orchestra.run.smithi037.stdout:Standby daemons: 2024-04-25T17:25:03.609 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:25:03.610 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi069.cpprst{-1:24289} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.69:6826/518856100,v1:172.21.15.69:6827/518856100] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:25:03.610 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi069.ytlqcf{-1:24293} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.69:6824/134210439,v1:172.21.15.69:6825/134210439] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:25:03.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.608+0000 7f8d1e054700 1 -- 172.21.15.37:0/3412952831 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f8d04076b90 msgr2=0x7f8d04079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:25:03.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.608+0000 7f8d1e054700 1 --2- 172.21.15.37:0/3412952831 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f8d04076b90 0x7f8d04079040 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8d18066830 tx=0x7f8d1000b040 comp rx=0 tx=0).stop 2024-04-25T17:25:03.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.608+0000 7f8d1e054700 1 -- 172.21.15.37:0/3412952831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d180fffd0 msgr2=0x7f8d1810dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:25:03.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.608+0000 7f8d1e054700 1 --2- 172.21.15.37:0/3412952831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d180fffd0 0x7f8d1810dee0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8d0000b0d0 tx=0x7f8d00009e30 comp rx=0 tx=0).stop 2024-04-25T17:25:03.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.608+0000 7f8d1e054700 1 -- 172.21.15.37:0/3412952831 shutdown_connections 2024-04-25T17:25:03.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.608+0000 7f8d1e054700 1 --2- 172.21.15.37:0/3412952831 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f8d04076b90 0x7f8d04079040 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:03.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.608+0000 7f8d1e054700 1 --2- 172.21.15.37:0/3412952831 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d18066af0 0x7f8d1810d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:03.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.608+0000 7f8d1e054700 1 --2- 172.21.15.37:0/3412952831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d180fffd0 0x7f8d1810dee0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:03.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.608+0000 7f8d1e054700 1 -- 172.21.15.37:0/3412952831 >> 172.21.15.37:0/3412952831 conn(0x7f8d180f74c0 msgr2=0x7f8d180f7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:25:03.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.608+0000 7f8d1e054700 1 -- 172.21.15.37:0/3412952831 shutdown_connections 2024-04-25T17:25:03.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.608+0000 7f8d1e054700 1 -- 172.21.15.37:0/3412952831 wait complete. 2024-04-25T17:25:03.611 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 16 2024-04-25T17:25:03.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.713+0000 7f629ba6c700 1 -- 172.21.15.37:0/3918367759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62940fcf70 msgr2=0x7f62940fd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:25:03.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.713+0000 7f629ba6c700 1 --2- 172.21.15.37:0/3918367759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62940fcf70 0x7f62940fd3e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6284004940 tx=0x7f6284009e30 comp rx=0 tx=0).stop 2024-04-25T17:25:03.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.713+0000 7f629ba6c700 1 -- 172.21.15.37:0/3918367759 shutdown_connections 2024-04-25T17:25:03.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.713+0000 7f629ba6c700 1 --2- 172.21.15.37:0/3918367759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62940fcf70 0x7f62940fd3e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:03.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.713+0000 7f629ba6c700 1 --2- 172.21.15.37:0/3918367759 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f62940fbcc0 0x7f62940fc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:03.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.713+0000 7f629ba6c700 1 -- 172.21.15.37:0/3918367759 >> 172.21.15.37:0/3918367759 conn(0x7f62940f7440 msgr2=0x7f62940f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:25:03.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.713+0000 7f629ba6c700 1 -- 172.21.15.37:0/3918367759 shutdown_connections 2024-04-25T17:25:03.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.713+0000 7f629ba6c700 1 -- 172.21.15.37:0/3918367759 wait complete. 2024-04-25T17:25:03.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.714+0000 7f629ba6c700 1 Processor -- start 2024-04-25T17:25:03.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.714+0000 7f629ba6c700 1 -- start start 2024-04-25T17:25:03.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.714+0000 7f629ba6c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f62940fbcc0 0x7f629410c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:25:03.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.714+0000 7f629ba6c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62940fcf70 0x7f629410cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:25:03.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.714+0000 7f629ba6c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f629410d320 con 0x7f62940fcf70 2024-04-25T17:25:03.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.714+0000 7f629ba6c700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f629410d490 con 0x7f62940fbcc0 2024-04-25T17:25:03.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.714+0000 7f6299007700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62940fcf70 0x7f629410cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:25:03.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.714+0000 7f6299007700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62940fcf70 0x7f629410cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33960/0 (socket says 172.21.15.37:33960) 2024-04-25T17:25:03.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.714+0000 7f6299007700 1 -- 172.21.15.37:0/4286964751 learned_addr learned my addr 172.21.15.37:0/4286964751 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:25:03.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.714+0000 7f6299808700 1 --2- 172.21.15.37:0/4286964751 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f62940fbcc0 0x7f629410c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:25:03.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.715+0000 7f6299007700 1 -- 172.21.15.37:0/4286964751 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f62940fbcc0 msgr2=0x7f629410c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:25:03.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.715+0000 7f6299007700 1 --2- 172.21.15.37:0/4286964751 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f62940fbcc0 0x7f629410c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:03.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.715+0000 7f6299007700 1 -- 172.21.15.37:0/4286964751 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6284005040 con 0x7f62940fcf70 2024-04-25T17:25:03.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.715+0000 7f6299007700 1 --2- 172.21.15.37:0/4286964751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62940fcf70 0x7f629410cd20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6284013870 tx=0x7f6284009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:25:03.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.715+0000 7f628a7fc700 1 -- 172.21.15.37:0/4286964751 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6284021070 con 0x7f62940fcf70 2024-04-25T17:25:03.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.715+0000 7f629ba6c700 1 -- 172.21.15.37:0/4286964751 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6294111e90 con 0x7f62940fcf70 2024-04-25T17:25:03.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.715+0000 7f628a7fc700 1 -- 172.21.15.37:0/4286964751 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f628401c400 con 0x7f62940fcf70 2024-04-25T17:25:03.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.715+0000 7f628a7fc700 1 -- 172.21.15.37:0/4286964751 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f628400e070 con 0x7f62940fcf70 2024-04-25T17:25:03.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.715+0000 7f629ba6c700 1 -- 172.21.15.37:0/4286964751 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6294112340 con 0x7f62940fcf70 2024-04-25T17:25:03.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.716+0000 7f629ba6c700 1 -- 172.21.15.37:0/4286964751 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f629404c710 con 0x7f62940fcf70 2024-04-25T17:25:03.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.717+0000 7f628a7fc700 1 -- 172.21.15.37:0/4286964751 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f628401ca70 con 0x7f62940fcf70 2024-04-25T17:25:03.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.717+0000 7f628a7fc700 1 --2- 172.21.15.37:0/4286964751 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f6280076b90 0x7f6280079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:25:03.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.717+0000 7f628a7fc700 1 -- 172.21.15.37:0/4286964751 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f6284099440 con 0x7f62940fcf70 2024-04-25T17:25:03.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.717+0000 7f6299808700 1 --2- 172.21.15.37:0/4286964751 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f6280076b90 0x7f6280079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:25:03.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.718+0000 7f6299808700 1 --2- 172.21.15.37:0/4286964751 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f6280076b90 0x7f6280079040 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6290009b80 tx=0x7f629000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:25:03.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.722+0000 7f628a7fc700 1 -- 172.21.15.37:0/4286964751 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f6284062040 con 0x7f62940fcf70 2024-04-25T17:25:03.818 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:25:03 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4[94508]: 2024-04-25T17:25:03.469+0000 7ffb395c77c0 -1 osd.4 69 log_to_monitors true 2024-04-25T17:25:03.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.953+0000 7f629ba6c700 1 -- 172.21.15.37:0/4286964751 --> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f62941012e0 con 0x7f6280076b90 2024-04-25T17:25:03.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.954+0000 7f628a7fc700 1 -- 172.21.15.37:0/4286964751 <== mgr.34104 v2:172.21.15.37:6800/783197737 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f62941012e0 con 0x7f6280076b90 2024-04-25T17:25:03.955 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-25T17:25:03.955 INFO:teuthology.orchestra.run.smithi037.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385", 2024-04-25T17:25:03.956 INFO:teuthology.orchestra.run.smithi037.stdout: "in_progress": true, 2024-04-25T17:25:03.956 INFO:teuthology.orchestra.run.smithi037.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-25T17:25:03.956 INFO:teuthology.orchestra.run.smithi037.stdout: "services_complete": [ 2024-04-25T17:25:03.956 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr", 2024-04-25T17:25:03.956 INFO:teuthology.orchestra.run.smithi037.stdout: "crash", 2024-04-25T17:25:03.956 INFO:teuthology.orchestra.run.smithi037.stdout: "mon" 2024-04-25T17:25:03.956 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-04-25T17:25:03.956 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": "11/21 daemons upgraded", 2024-04-25T17:25:03.956 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "Currently upgrading osd daemons", 2024-04-25T17:25:03.956 INFO:teuthology.orchestra.run.smithi037.stdout: "is_paused": false 2024-04-25T17:25:03.956 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-25T17:25:03.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.957+0000 7f629ba6c700 1 -- 172.21.15.37:0/4286964751 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f6280076b90 msgr2=0x7f6280079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:25:03.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.957+0000 7f629ba6c700 1 --2- 172.21.15.37:0/4286964751 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f6280076b90 0x7f6280079040 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6290009b80 tx=0x7f629000b040 comp rx=0 tx=0).stop 2024-04-25T17:25:03.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.957+0000 7f629ba6c700 1 -- 172.21.15.37:0/4286964751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62940fcf70 msgr2=0x7f629410cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:25:03.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.957+0000 7f629ba6c700 1 --2- 172.21.15.37:0/4286964751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62940fcf70 0x7f629410cd20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6284013870 tx=0x7f6284009e30 comp rx=0 tx=0).stop 2024-04-25T17:25:03.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.957+0000 7f629ba6c700 1 -- 172.21.15.37:0/4286964751 shutdown_connections 2024-04-25T17:25:03.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.957+0000 7f629ba6c700 1 --2- 172.21.15.37:0/4286964751 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f6280076b90 0x7f6280079040 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:03.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.957+0000 7f629ba6c700 1 --2- 172.21.15.37:0/4286964751 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f62940fbcc0 0x7f629410c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:03.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.957+0000 7f629ba6c700 1 --2- 172.21.15.37:0/4286964751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62940fcf70 0x7f629410cd20 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:03.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.958+0000 7f629ba6c700 1 -- 172.21.15.37:0/4286964751 >> 172.21.15.37:0/4286964751 conn(0x7f62940f7440 msgr2=0x7f62940f8ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:25:03.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.958+0000 7f629ba6c700 1 -- 172.21.15.37:0/4286964751 shutdown_connections 2024-04-25T17:25:03.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:03.958+0000 7f629ba6c700 1 -- 172.21.15.37:0/4286964751 wait complete. 2024-04-25T17:25:04.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:04.068+0000 7fc5d8fa0700 1 -- 172.21.15.37:0/2984443688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5d40fcf50 msgr2=0x7fc5d40fd3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:25:04.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:04.068+0000 7fc5d8fa0700 1 --2- 172.21.15.37:0/2984443688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5d40fcf50 0x7fc5d40fd3c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8004940 tx=0x7fc5c8009e30 comp rx=0 tx=0).stop 2024-04-25T17:25:04.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:04.068+0000 7fc5d8fa0700 1 -- 172.21.15.37:0/2984443688 shutdown_connections 2024-04-25T17:25:04.070 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:04.068+0000 7fc5d8fa0700 1 --2- 172.21.15.37:0/2984443688 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5d40fcf50 0x7fc5d40fd3c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:04.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:04.068+0000 7fc5d8fa0700 1 --2- 172.21.15.37:0/2984443688 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc5d40fbca0 0x7fc5d40fc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:04.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:04.068+0000 7fc5d8fa0700 1 -- 172.21.15.37:0/2984443688 >> 172.21.15.37:0/2984443688 conn(0x7fc5d40f7420 msgr2=0x7fc5d40f9830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:25:04.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:04.068+0000 7fc5d8fa0700 1 -- 172.21.15.37:0/2984443688 shutdown_connections 2024-04-25T17:25:04.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:04.068+0000 7fc5d8fa0700 1 -- 172.21.15.37:0/2984443688 wait complete. 2024-04-25T17:25:04.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:04.068+0000 7fc5d8fa0700 1 Processor -- start 2024-04-25T17:25:04.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:04.068+0000 7fc5d8fa0700 1 -- start start 2024-04-25T17:25:04.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:04.069+0000 7fc5d8fa0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc5d40fbca0 0x7fc5d410d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:25:04.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:04.069+0000 7fc5d8fa0700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5d40fcf50 0x7fc5d410de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:25:04.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:04.069+0000 7fc5d8fa0700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d410e470 con 0x7fc5d40fcf50 2024-04-25T17:25:04.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:04.069+0000 7fc5d8fa0700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d410e5e0 con 0x7fc5d40fbca0 2024-04-25T17:25:04.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:04.069+0000 7fc5d1d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5d40fcf50 0x7fc5d410de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:25:04.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:04.069+0000 7fc5d1d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5d40fcf50 0x7fc5d410de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:33976/0 (socket says 172.21.15.37:33976) 2024-04-25T17:25:04.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:04.069+0000 7fc5d1d9b700 1 -- 172.21.15.37:0/2480206103 learned_addr learned my addr 172.21.15.37:0/2480206103 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:25:04.071 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:04.069+0000 7fc5d259c700 1 --2- 172.21.15.37:0/2480206103 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc5d40fbca0 0x7fc5d410d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:25:04.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:04.069+0000 7fc5d259c700 1 -- 172.21.15.37:0/2480206103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5d40fcf50 msgr2=0x7fc5d410de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:25:04.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:04.069+0000 7fc5d259c700 1 --2- 172.21.15.37:0/2480206103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5d40fcf50 0x7fc5d410de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:04.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:04.069+0000 7fc5d259c700 1 -- 172.21.15.37:0/2480206103 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c8005040 con 0x7fc5d40fbca0 2024-04-25T17:25:04.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:04.069+0000 7fc5d259c700 1 --2- 172.21.15.37:0/2480206103 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc5d40fbca0 0x7fc5d410d930 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc5c4009fd0 tx=0x7fc5c400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:25:04.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:04.069+0000 7fc5c2ffd700 1 -- 172.21.15.37:0/2480206103 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5c4004e90 con 0x7fc5d40fbca0 2024-04-25T17:25:04.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:04.070+0000 7fc5c2ffd700 1 -- 172.21.15.37:0/2480206103 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc5c400f040 con 0x7fc5d40fbca0 2024-04-25T17:25:04.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:04.070+0000 7fc5d8fa0700 1 -- 172.21.15.37:0/2480206103 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5d4112f40 con 0x7fc5d40fbca0 2024-04-25T17:25:04.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:04.070+0000 7fc5c2ffd700 1 -- 172.21.15.37:0/2480206103 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc5c400ca50 con 0x7fc5d40fbca0 2024-04-25T17:25:04.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:04.070+0000 7fc5d8fa0700 1 -- 172.21.15.37:0/2480206103 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5d41133f0 con 0x7fc5d40fbca0 2024-04-25T17:25:04.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:04.070+0000 7fc5d8fa0700 1 -- 172.21.15.37:0/2480206103 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5d4101ae0 con 0x7fc5d40fbca0 2024-04-25T17:25:04.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:04.071+0000 7fc5c2ffd700 1 -- 172.21.15.37:0/2480206103 <== mon.1 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7fc5c4007cc0 con 0x7fc5d40fbca0 2024-04-25T17:25:04.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:04.072+0000 7fc5c2ffd700 1 --2- 172.21.15.37:0/2480206103 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fc5bc076bd0 0x7fc5bc079080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:25:04.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:04.072+0000 7fc5d1d9b700 1 --2- 172.21.15.37:0/2480206103 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fc5bc076bd0 0x7fc5bc079080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:25:04.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:04.072+0000 7fc5c2ffd700 1 -- 172.21.15.37:0/2480206103 <== mon.1 v2:172.21.15.69:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fc5c4097d90 con 0x7fc5d40fbca0 2024-04-25T17:25:04.073 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:04.072+0000 7fc5d1d9b700 1 --2- 172.21.15.37:0/2480206103 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fc5bc076bd0 0x7fc5bc079080 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8013740 tx=0x7fc5c8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:25:04.078 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:04.077+0000 7fc5c2ffd700 1 -- 172.21.15.37:0/2480206103 <== mon.1 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fc5c4060920 con 0x7fc5d40fbca0 2024-04-25T17:25:04.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:04 smithi069 ceph-mon[80239]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:25:04.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:04 smithi069 ceph-mon[80239]: pgmap v140: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 208 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 716 B/s rd, 1 op/s; 40/228 objects degraded (17.544%) 2024-04-25T17:25:04.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:04 smithi069 ceph-mon[80239]: from='client.34354 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:25:04.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:04 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/2243187891' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:25:04.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:04 smithi069 ceph-mon[80239]: from='osd.4 [v2:172.21.15.69:6808/2690453136,v1:172.21.15.69:6809/2690453136]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-25T17:25:04.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:04 smithi069 ceph-mon[80239]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-25T17:25:04.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:04 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/3412952831' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T17:25:04.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:03 smithi037 ceph-mon[90844]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:25:04.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:03 smithi037 ceph-mon[90844]: pgmap v140: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 208 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 716 B/s rd, 1 op/s; 40/228 objects degraded (17.544%) 2024-04-25T17:25:04.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:03 smithi037 ceph-mon[90844]: from='client.34354 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:25:04.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:03 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/2243187891' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:25:04.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:03 smithi037 ceph-mon[90844]: from='osd.4 [v2:172.21.15.69:6808/2690453136,v1:172.21.15.69:6809/2690453136]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-25T17:25:04.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:03 smithi037 ceph-mon[90844]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-04-25T17:25:04.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:03 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/3412952831' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T17:25:04.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:04.372+0000 7fc5d8fa0700 1 -- 172.21.15.37:0/2480206103 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc5d402b510 con 0x7fc5d40fbca0 2024-04-25T17:25:04.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:04.373+0000 7fc5c2ffd700 1 -- 172.21.15.37:0/2480206103 <== mon.1 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1106 (secure 0 0 0) 0x7fc5c40602c0 con 0x7fc5d40fbca0 2024-04-25T17:25:04.374 INFO:teuthology.orchestra.run.smithi037.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 40/228 objects degraded (17.544%), 15 pgs degraded 2024-04-25T17:25:04.374 INFO:teuthology.orchestra.run.smithi037.stdout:[WRN] OSD_DOWN: 1 osds down 2024-04-25T17:25:04.374 INFO:teuthology.orchestra.run.smithi037.stdout: osd.4 (root=default,host=smithi069) is down 2024-04-25T17:25:04.374 INFO:teuthology.orchestra.run.smithi037.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 40/228 objects degraded (17.544%), 15 pgs degraded 2024-04-25T17:25:04.374 INFO:teuthology.orchestra.run.smithi037.stdout: pg 2.4 is active+undersized+degraded, acting [1,0] 2024-04-25T17:25:04.374 INFO:teuthology.orchestra.run.smithi037.stdout: pg 2.5 is active+undersized+degraded, acting [3,0] 2024-04-25T17:25:04.374 INFO:teuthology.orchestra.run.smithi037.stdout: pg 2.6 is active+undersized+degraded, acting [1,3] 2024-04-25T17:25:04.374 INFO:teuthology.orchestra.run.smithi037.stdout: pg 2.7 is active+undersized+degraded, acting [3,2] 2024-04-25T17:25:04.374 INFO:teuthology.orchestra.run.smithi037.stdout: pg 2.9 is active+undersized+degraded, acting [1,0] 2024-04-25T17:25:04.375 INFO:teuthology.orchestra.run.smithi037.stdout: pg 2.a is active+undersized+degraded, acting [1,3] 2024-04-25T17:25:04.375 INFO:teuthology.orchestra.run.smithi037.stdout: pg 2.b is active+undersized+degraded, acting [3,5] 2024-04-25T17:25:04.375 INFO:teuthology.orchestra.run.smithi037.stdout: pg 2.f is active+undersized+degraded, acting [0,5] 2024-04-25T17:25:04.375 INFO:teuthology.orchestra.run.smithi037.stdout: pg 2.13 is active+undersized+degraded, acting [0,2] 2024-04-25T17:25:04.375 INFO:teuthology.orchestra.run.smithi037.stdout: pg 2.14 is active+undersized+degraded, acting [3,5] 2024-04-25T17:25:04.375 INFO:teuthology.orchestra.run.smithi037.stdout: pg 2.18 is active+undersized+degraded, acting [5,3] 2024-04-25T17:25:04.375 INFO:teuthology.orchestra.run.smithi037.stdout: pg 2.19 is active+undersized+degraded, acting [0,2] 2024-04-25T17:25:04.375 INFO:teuthology.orchestra.run.smithi037.stdout: pg 2.1a is active+undersized+degraded, acting [3,5] 2024-04-25T17:25:04.375 INFO:teuthology.orchestra.run.smithi037.stdout: pg 2.1c is active+undersized+degraded, acting [5,2] 2024-04-25T17:25:04.375 INFO:teuthology.orchestra.run.smithi037.stdout: pg 2.1f is active+undersized+degraded, acting [0,3] 2024-04-25T17:25:04.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:04.375+0000 7fc5d8fa0700 1 -- 172.21.15.37:0/2480206103 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fc5bc076bd0 msgr2=0x7fc5bc079080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:25:04.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:04.375+0000 7fc5d8fa0700 1 --2- 172.21.15.37:0/2480206103 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fc5bc076bd0 0x7fc5bc079080 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8013740 tx=0x7fc5c8009e30 comp rx=0 tx=0).stop 2024-04-25T17:25:04.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:04.375+0000 7fc5d8fa0700 1 -- 172.21.15.37:0/2480206103 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc5d40fbca0 msgr2=0x7fc5d410d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:25:04.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:04.375+0000 7fc5d8fa0700 1 --2- 172.21.15.37:0/2480206103 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc5d40fbca0 0x7fc5d410d930 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc5c4009fd0 tx=0x7fc5c400b040 comp rx=0 tx=0).stop 2024-04-25T17:25:04.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:04.375+0000 7fc5d8fa0700 1 -- 172.21.15.37:0/2480206103 shutdown_connections 2024-04-25T17:25:04.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:04.375+0000 7fc5d8fa0700 1 --2- 172.21.15.37:0/2480206103 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fc5bc076bd0 0x7fc5bc079080 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:04.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:04.375+0000 7fc5d8fa0700 1 --2- 172.21.15.37:0/2480206103 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc5d40fbca0 0x7fc5d410d930 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:04.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:04.375+0000 7fc5d8fa0700 1 --2- 172.21.15.37:0/2480206103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5d40fcf50 0x7fc5d410de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:04.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:04.375+0000 7fc5d8fa0700 1 -- 172.21.15.37:0/2480206103 >> 172.21.15.37:0/2480206103 conn(0x7fc5d40f7420 msgr2=0x7fc5d4066790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:25:04.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:04.376+0000 7fc5d8fa0700 1 -- 172.21.15.37:0/2480206103 shutdown_connections 2024-04-25T17:25:04.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:04.376+0000 7fc5d8fa0700 1 -- 172.21.15.37:0/2480206103 wait complete. 2024-04-25T17:25:05.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:05 smithi037 ceph-mon[90844]: from='client.34368 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:25:05.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:05 smithi037 ceph-mon[90844]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-25T17:25:05.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:05 smithi037 ceph-mon[90844]: osdmap e72: 6 total, 5 up, 6 in 2024-04-25T17:25:05.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:05 smithi037 ceph-mon[90844]: from='osd.4 [v2:172.21.15.69:6808/2690453136,v1:172.21.15.69:6809/2690453136]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2024-04-25T17:25:05.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:05 smithi037 ceph-mon[90844]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2024-04-25T17:25:05.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:05 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/2480206103' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T17:25:05.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:05 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:25:05.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:05 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:25:05.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:05 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:25:05.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:05 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:25:05.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:05 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:25:05.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:05 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:25:05.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:05 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:25:05.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:05 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:25:05.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:05 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:25:05.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:05 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-25T17:25:05.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:05 smithi037 ceph-mon[90844]: from='osd.4 ' entity='osd.4' 2024-04-25T17:25:05.418 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:25:04 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4[94508]: 2024-04-25T17:25:04.942+0000 7ffb269d9700 -1 osd.4 69 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T17:25:05.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:05 smithi069 ceph-mon[80239]: from='client.34368 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:25:05.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:05 smithi069 ceph-mon[80239]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-04-25T17:25:05.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:05 smithi069 ceph-mon[80239]: osdmap e72: 6 total, 5 up, 6 in 2024-04-25T17:25:05.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:05 smithi069 ceph-mon[80239]: from='osd.4 [v2:172.21.15.69:6808/2690453136,v1:172.21.15.69:6809/2690453136]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2024-04-25T17:25:05.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:05 smithi069 ceph-mon[80239]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2024-04-25T17:25:05.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:05 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/2480206103' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T17:25:05.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:05 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:25:05.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:05 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:25:05.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:05 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:25:05.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:05 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:25:05.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:05 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:25:05.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:05 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:25:05.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:05 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:25:05.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:05 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:25:05.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:05 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:25:05.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:05 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-25T17:25:05.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:05 smithi069 ceph-mon[80239]: from='osd.4 ' entity='osd.4' 2024-04-25T17:25:06.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:06 smithi037 ceph-mon[90844]: pgmap v142: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 208 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 716 B/s rd, 1 op/s; 40/228 objects degraded (17.544%) 2024-04-25T17:25:06.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:06 smithi037 ceph-mon[90844]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-25T17:25:06.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:06 smithi037 ceph-mon[90844]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-04-25T17:25:06.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:06 smithi037 ceph-mon[90844]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-25T17:25:06.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:06 smithi037 ceph-mon[90844]: osd.4 [v2:172.21.15.69:6808/2690453136,v1:172.21.15.69:6809/2690453136] boot 2024-04-25T17:25:06.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:06 smithi037 ceph-mon[90844]: osdmap e73: 6 total, 6 up, 6 in 2024-04-25T17:25:06.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:06 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T17:25:06.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:06 smithi069 ceph-mon[80239]: pgmap v142: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 208 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 716 B/s rd, 1 op/s; 40/228 objects degraded (17.544%) 2024-04-25T17:25:06.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:06 smithi069 ceph-mon[80239]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-25T17:25:06.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:06 smithi069 ceph-mon[80239]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-04-25T17:25:06.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:06 smithi069 ceph-mon[80239]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-25T17:25:06.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:06 smithi069 ceph-mon[80239]: osd.4 [v2:172.21.15.69:6808/2690453136,v1:172.21.15.69:6809/2690453136] boot 2024-04-25T17:25:06.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:06 smithi069 ceph-mon[80239]: osdmap e73: 6 total, 6 up, 6 in 2024-04-25T17:25:06.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:06 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-04-25T17:25:08.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:07 smithi037 ceph-mon[90844]: pgmap v144: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 208 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s; 40/228 objects degraded (17.544%) 2024-04-25T17:25:08.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:07 smithi037 ceph-mon[90844]: osdmap e74: 6 total, 6 up, 6 in 2024-04-25T17:25:08.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:07 smithi069 ceph-mon[80239]: pgmap v144: 65 pgs: 15 active+undersized+degraded, 19 active+undersized, 31 active+clean; 208 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s; 40/228 objects degraded (17.544%) 2024-04-25T17:25:08.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:07 smithi069 ceph-mon[80239]: osdmap e74: 6 total, 6 up, 6 in 2024-04-25T17:25:09.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:08 smithi037 ceph-mon[90844]: Health check update: Degraded data redundancy: 29/228 objects degraded (12.719%), 10 pgs degraded (PG_DEGRADED) 2024-04-25T17:25:09.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:08 smithi069 ceph-mon[80239]: Health check update: Degraded data redundancy: 29/228 objects degraded (12.719%), 10 pgs degraded (PG_DEGRADED) 2024-04-25T17:25:10.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:09 smithi037 ceph-mon[90844]: pgmap v146: 65 pgs: 10 active+undersized+degraded, 13 active+undersized, 42 active+clean; 208 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s; 29/228 objects degraded (12.719%) 2024-04-25T17:25:10.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:09 smithi069 ceph-mon[80239]: pgmap v146: 65 pgs: 10 active+undersized+degraded, 13 active+undersized, 42 active+clean; 208 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s; 29/228 objects degraded (12.719%) 2024-04-25T17:25:12.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:11 smithi037 ceph-mon[90844]: pgmap v147: 65 pgs: 8 active+undersized+degraded, 8 active+undersized, 49 active+clean; 208 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 785 B/s rd, 1 op/s; 25/228 objects degraded (10.965%) 2024-04-25T17:25:12.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:11 smithi069 ceph-mon[80239]: pgmap v147: 65 pgs: 8 active+undersized+degraded, 8 active+undersized, 49 active+clean; 208 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 785 B/s rd, 1 op/s; 25/228 objects degraded (10.965%) 2024-04-25T17:25:13.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:13 smithi069 ceph-mon[80239]: pgmap v148: 65 pgs: 65 active+clean; 208 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-04-25T17:25:13.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:13 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:25:13.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:13 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:25:13.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:13 smithi069 ceph-mon[80239]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 25/228 objects degraded (10.965%), 8 pgs degraded) 2024-04-25T17:25:13.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:13 smithi069 ceph-mon[80239]: Cluster is now healthy 2024-04-25T17:25:14.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:13 smithi037 ceph-mon[90844]: pgmap v148: 65 pgs: 65 active+clean; 208 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-04-25T17:25:14.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:13 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:25:14.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:13 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:25:14.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:13 smithi037 ceph-mon[90844]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 25/228 objects degraded (10.965%), 8 pgs degraded) 2024-04-25T17:25:14.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:13 smithi037 ceph-mon[90844]: Cluster is now healthy 2024-04-25T17:25:15.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:15 smithi069 ceph-mon[80239]: pgmap v149: 65 pgs: 65 active+clean; 208 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 357 B/s rd, 1 op/s 2024-04-25T17:25:16.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:15 smithi037 ceph-mon[90844]: pgmap v149: 65 pgs: 65 active+clean; 208 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 357 B/s rd, 1 op/s 2024-04-25T17:25:17.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:17 smithi069 ceph-mon[80239]: pgmap v150: 65 pgs: 65 active+clean; 208 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 818 B/s rd, 1 op/s 2024-04-25T17:25:18.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:17 smithi037 ceph-mon[90844]: pgmap v150: 65 pgs: 65 active+clean; 208 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 818 B/s rd, 1 op/s 2024-04-25T17:25:18.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:18 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:25:19.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:18 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:25:20.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:19 smithi037 ceph-mon[90844]: pgmap v151: 65 pgs: 65 active+clean; 208 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 706 B/s rd, 1 op/s 2024-04-25T17:25:20.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:19 smithi069 ceph-mon[80239]: pgmap v151: 65 pgs: 65 active+clean; 208 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 706 B/s rd, 1 op/s 2024-04-25T17:25:20.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:20 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-25T17:25:20.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:20 smithi069 ceph-mon[80239]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-25T17:25:20.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:20 smithi069 ceph-mon[80239]: Upgrade: osd.5 is safe to restart 2024-04-25T17:25:21.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:20 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-25T17:25:21.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:20 smithi037 ceph-mon[90844]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-04-25T17:25:21.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:20 smithi037 ceph-mon[90844]: Upgrade: osd.5 is safe to restart 2024-04-25T17:25:21.985 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:21 smithi069 ceph-mon[80239]: pgmap v152: 65 pgs: 65 active+clean; 208 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 682 B/s rd, 1 op/s 2024-04-25T17:25:21.985 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:21 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:25:21.985 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:21 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-25T17:25:21.985 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:21 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:25:22.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:21 smithi037 ceph-mon[90844]: pgmap v152: 65 pgs: 65 active+clean; 208 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 682 B/s rd, 1 op/s 2024-04-25T17:25:22.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:21 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:25:22.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:21 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-04-25T17:25:22.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:21 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:25:23.027 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:22 smithi069 ceph-mon[80239]: Upgrade: Updating osd.5 2024-04-25T17:25:23.027 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:22 smithi069 ceph-mon[80239]: Deploying daemon osd.5 on smithi069 2024-04-25T17:25:23.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:22 smithi037 ceph-mon[90844]: Upgrade: Updating osd.5 2024-04-25T17:25:23.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:22 smithi037 ceph-mon[90844]: Deploying daemon osd.5 on smithi069 2024-04-25T17:25:24.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:23 smithi037 ceph-mon[90844]: pgmap v153: 65 pgs: 65 active+clean; 208 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-25T17:25:24.140 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:23 smithi069 ceph-mon[80239]: pgmap v153: 65 pgs: 65 active+clean; 208 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-04-25T17:25:24.737 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:25:24 smithi069 systemd[1]: Stopping Ceph osd.5 for 599bb7fc-0326-11ef-bc93-c7b262605968... 2024-04-25T17:25:25.168 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:25:24 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5[53009]: 2024-04-25T17:25:24.735+0000 7ff7cfbd5700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T17:25:25.168 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:25:24 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5[53009]: 2024-04-25T17:25:24.735+0000 7ff7cfbd5700 -1 osd.5 74 *** Got signal Terminated *** 2024-04-25T17:25:25.169 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:25:24 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5[53009]: 2024-04-25T17:25:24.735+0000 7ff7cfbd5700 -1 osd.5 74 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T17:25:26.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:25 smithi037 ceph-mon[90844]: pgmap v154: 65 pgs: 65 active+clean; 208 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:25:26.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:25 smithi037 ceph-mon[90844]: osd.5 marked itself down and dead 2024-04-25T17:25:26.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:25 smithi069 ceph-mon[80239]: pgmap v154: 65 pgs: 65 active+clean; 208 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:25:26.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:25 smithi069 ceph-mon[80239]: osd.5 marked itself down and dead 2024-04-25T17:25:26.504 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:25:26 smithi069 podman[98907]: 2024-04-25 17:25:26.249880589 +0000 UTC m=+1.605996604 container died f6be99c364ffe2e9e9f70dafbcf5e2b1fc20a5d001134bf5bc5f54a63c0606ec (image=quay.ceph.io/ceph-ci/ceph@sha256:27d43f80a23d3545096a7bb490598a6f37852da2940e69e5a8f3e3d7fb58fd17, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, RELEASE=quincy-c61472c, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67) 2024-04-25T17:25:26.896 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:26 smithi069 ceph-mon[80239]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-25T17:25:26.896 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:26 smithi069 ceph-mon[80239]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-04-25T17:25:26.896 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:26 smithi069 ceph-mon[80239]: osdmap e75: 6 total, 5 up, 6 in 2024-04-25T17:25:26.896 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:25:26 smithi069 podman[98907]: 2024-04-25 17:25:26.661144538 +0000 UTC m=+2.017260607 container cleanup f6be99c364ffe2e9e9f70dafbcf5e2b1fc20a5d001134bf5bc5f54a63c0606ec (image=quay.ceph.io/ceph-ci/ceph@sha256:27d43f80a23d3545096a7bb490598a6f37852da2940e69e5a8f3e3d7fb58fd17, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5, org.label-schema.license=GPLv2, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, RELEASE=quincy-c61472c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-04-25T17:25:26.896 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:25:26 smithi069 bash[98907]: ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5 2024-04-25T17:25:27.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:26 smithi037 ceph-mon[90844]: Health check failed: 1 osds down (OSD_DOWN) 2024-04-25T17:25:27.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:26 smithi037 ceph-mon[90844]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-04-25T17:25:27.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:26 smithi037 ceph-mon[90844]: osdmap e75: 6 total, 5 up, 6 in 2024-04-25T17:25:27.169 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:25:26 smithi069 podman[98928]: 2024-04-25 17:25:26.895972195 +0000 UTC m=+0.642374696 container remove f6be99c364ffe2e9e9f70dafbcf5e2b1fc20a5d001134bf5bc5f54a63c0606ec (image=quay.ceph.io/ceph-ci/ceph@sha256:27d43f80a23d3545096a7bb490598a6f37852da2940e69e5a8f3e3d7fb58fd17, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=quincy-c61472c, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=e83daab126629de4b83b70f7819e84da953b5b67, org.label-schema.build-date=20240424) 2024-04-25T17:25:27.466 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:25:27 smithi069 podman[99021]: 2024-04-25 17:25:27.102917137 +0000 UTC m=+0.018553100 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T17:25:27.466 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:25:27 smithi069 podman[99021]: 2024-04-25 17:25:27.213489661 +0000 UTC m=+0.129125619 container create de089a2cee2dd4a2ffd834ba7c67703fd2edf3cb064b4a0d0cc42a6b5d4e6ec0 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-04-25T17:25:27.466 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:25:27 smithi069 podman[99021]: 2024-04-25 17:25:27.407402709 +0000 UTC m=+0.323038667 container init de089a2cee2dd4a2ffd834ba7c67703fd2edf3cb064b4a0d0cc42a6b5d4e6ec0 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T17:25:27.466 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:25:27 smithi069 podman[99021]: 2024-04-25 17:25:27.410636661 +0000 UTC m=+0.326272626 container start de089a2cee2dd4a2ffd834ba7c67703fd2edf3cb064b4a0d0cc42a6b5d4e6ec0 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2) 2024-04-25T17:25:27.466 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:25:27 smithi069 podman[99021]: 2024-04-25 17:25:27.465800538 +0000 UTC m=+0.381436505 container attach de089a2cee2dd4a2ffd834ba7c67703fd2edf3cb064b4a0d0cc42a6b5d4e6ec0 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.license=GPLv2) 2024-04-25T17:25:27.918 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:25:27 smithi069 podman[99021]: 2024-04-25 17:25:27.700197069 +0000 UTC m=+0.615833031 container died de089a2cee2dd4a2ffd834ba7c67703fd2edf3cb064b4a0d0cc42a6b5d4e6ec0 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, ceph=True, GIT_CLEAN=True) 2024-04-25T17:25:27.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:27 smithi069 ceph-mon[80239]: pgmap v156: 65 pgs: 13 stale+active+clean, 52 active+clean; 208 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-04-25T17:25:27.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:27 smithi069 ceph-mon[80239]: osdmap e76: 6 total, 5 up, 6 in 2024-04-25T17:25:27.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:27 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:25:27.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:27 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:25:28.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:27 smithi037 ceph-mon[90844]: pgmap v156: 65 pgs: 13 stale+active+clean, 52 active+clean; 208 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-04-25T17:25:28.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:27 smithi037 ceph-mon[90844]: osdmap e76: 6 total, 5 up, 6 in 2024-04-25T17:25:28.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:27 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:25:28.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:27 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:25:28.669 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:25:28 smithi069 podman[99047]: 2024-04-25 17:25:28.328106799 +0000 UTC m=+0.622980664 container remove de089a2cee2dd4a2ffd834ba7c67703fd2edf3cb064b4a0d0cc42a6b5d4e6ec0 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5-deactivate, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-04-25T17:25:28.669 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:25:28 smithi069 systemd[1]: ceph-599bb7fc-0326-11ef-bc93-c7b262605968@osd.5.service: Deactivated successfully. 2024-04-25T17:25:28.669 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:25:28 smithi069 systemd[1]: Stopped Ceph osd.5 for 599bb7fc-0326-11ef-bc93-c7b262605968. 2024-04-25T17:25:28.669 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:25:28 smithi069 systemd[1]: ceph-599bb7fc-0326-11ef-bc93-c7b262605968@osd.5.service: Consumed 1min 3.345s CPU time. 2024-04-25T17:25:28.669 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:25:28 smithi069 systemd[1]: Starting Ceph osd.5 for 599bb7fc-0326-11ef-bc93-c7b262605968... 2024-04-25T17:25:29.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:28 smithi037 ceph-mon[90844]: Health check failed: Degraded data redundancy: 1/228 objects degraded (0.439%), 1 pg degraded (PG_DEGRADED) 2024-04-25T17:25:29.073 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:28 smithi069 ceph-mon[80239]: Health check failed: Degraded data redundancy: 1/228 objects degraded (0.439%), 1 pg degraded (PG_DEGRADED) 2024-04-25T17:25:29.073 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:25:28 smithi069 podman[99150]: 2024-04-25 17:25:28.671856118 +0000 UTC m=+0.018135150 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T17:25:29.073 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:25:28 smithi069 podman[99150]: 2024-04-25 17:25:28.795860842 +0000 UTC m=+0.142139874 container create 29b86af28bc8ccd636f819e86c8087b798693c50ec5cc57b365f06fe2a4f7874 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5-activate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-04-25T17:25:29.073 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:25:28 smithi069 podman[99150]: 2024-04-25 17:25:28.998180396 +0000 UTC m=+0.344459429 container init 29b86af28bc8ccd636f819e86c8087b798693c50ec5cc57b365f06fe2a4f7874 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240424, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-04-25T17:25:29.074 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:25:29 smithi069 podman[99150]: 2024-04-25 17:25:29.001266145 +0000 UTC m=+0.347545182 container start 29b86af28bc8ccd636f819e86c8087b798693c50ec5cc57b365f06fe2a4f7874 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-04-25T17:25:29.074 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:25:29 smithi069 podman[99150]: 2024-04-25 17:25:29.073082731 +0000 UTC m=+0.419361763 container attach 29b86af28bc8ccd636f819e86c8087b798693c50ec5cc57b365f06fe2a4f7874 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5-activate, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-25T17:25:29.910 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:29 smithi069 ceph-mon[80239]: pgmap v158: 65 pgs: 1 active+undersized+degraded, 12 stale+active+clean, 2 active+undersized, 50 active+clean; 208 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 1/228 objects degraded (0.439%) 2024-04-25T17:25:29.910 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:25:29 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5-activate[99165]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-25T17:25:29.910 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:25:29 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5-activate[99165]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-25T17:25:29.910 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:25:29 smithi069 bash[99150]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-25T17:25:29.910 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:25:29 smithi069 bash[99150]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-04-25T17:25:29.910 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:25:29 smithi069 bash[99150]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-25T17:25:29.910 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:25:29 smithi069 bash[99150]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-04-25T17:25:29.910 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:25:29 smithi069 bash[99150]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-04-25T17:25:29.910 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:25:29 smithi069 bash[99150]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-04-25T17:25:29.911 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:25:29 smithi069 bash[99150]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-04-25T17:25:29.911 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:25:29 smithi069 bash[99150]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-25T17:25:29.911 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:25:29 smithi069 bash[99150]: --> ceph-volume raw activate successful for osd ID: 5 2024-04-25T17:25:29.911 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:25:29 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5-activate[99165]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-25T17:25:29.911 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:25:29 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5-activate[99165]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-04-25T17:25:29.911 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:25:29 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5-activate[99165]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-04-25T17:25:29.911 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:25:29 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5-activate[99165]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-04-25T17:25:29.911 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:25:29 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5-activate[99165]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-04-25T17:25:29.911 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:25:29 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5-activate[99165]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-25T17:25:29.911 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:25:29 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5-activate[99165]: --> ceph-volume raw activate successful for osd ID: 5 2024-04-25T17:25:29.911 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:25:29 smithi069 podman[99150]: 2024-04-25 17:25:29.609304577 +0000 UTC m=+0.955583611 container died 29b86af28bc8ccd636f819e86c8087b798693c50ec5cc57b365f06fe2a4f7874 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5-activate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-25T17:25:30.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:29 smithi037 ceph-mon[90844]: pgmap v158: 65 pgs: 1 active+undersized+degraded, 12 stale+active+clean, 2 active+undersized, 50 active+clean; 208 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 1/228 objects degraded (0.439%) 2024-04-25T17:25:30.487 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:25:30 smithi069 podman[99296]: 2024-04-25 17:25:30.227363398 +0000 UTC m=+0.612617267 container remove 29b86af28bc8ccd636f819e86c8087b798693c50ec5cc57b365f06fe2a4f7874 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5-activate, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T17:25:30.487 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:25:30 smithi069 podman[99356]: 2024-04-25 17:25:30.345051647 +0000 UTC m=+0.017940108 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T17:25:30.487 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:25:30 smithi069 podman[99356]: 2024-04-25 17:25:30.486763754 +0000 UTC m=+0.159652257 container create dea8b059441b7f9d7d295988959ff7cad1fd754bb4b2315eb5da774ff3855106 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5, ceph=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-25T17:25:30.772 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:25:30 smithi069 podman[99356]: 2024-04-25 17:25:30.697837076 +0000 UTC m=+0.370725539 container init dea8b059441b7f9d7d295988959ff7cad1fd754bb4b2315eb5da774ff3855106 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5) 2024-04-25T17:25:30.772 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:25:30 smithi069 podman[99356]: 2024-04-25 17:25:30.701154197 +0000 UTC m=+0.374042655 container start dea8b059441b7f9d7d295988959ff7cad1fd754bb4b2315eb5da774ff3855106 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0) 2024-04-25T17:25:30.772 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:25:30 smithi069 ceph-osd[99375]: -- 172.21.15.69:0/2159977229 <== mon.1 v2:172.21.15.69:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fdff4c1680 con 0x55fdff568d00 2024-04-25T17:25:31.168 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:25:30 smithi069 bash[99356]: dea8b059441b7f9d7d295988959ff7cad1fd754bb4b2315eb5da774ff3855106 2024-04-25T17:25:31.169 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:25:30 smithi069 systemd[1]: Started Ceph osd.5 for 599bb7fc-0326-11ef-bc93-c7b262605968. 2024-04-25T17:25:31.668 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:25:31 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5[99370]: 2024-04-25T17:25:31.249+0000 7f68b2e717c0 -1 Falling back to public interface 2024-04-25T17:25:32.009 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:31 smithi069 ceph-mon[80239]: pgmap v159: 65 pgs: 6 active+undersized+degraded, 5 stale+active+clean, 9 active+undersized, 45 active+clean; 208 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 13/228 objects degraded (5.702%) 2024-04-25T17:25:32.009 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:31 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:25:32.010 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:31 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:25:32.010 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:31 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:25:32.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:31 smithi037 ceph-mon[90844]: pgmap v159: 65 pgs: 6 active+undersized+degraded, 5 stale+active+clean, 9 active+undersized, 45 active+clean; 208 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 13/228 objects degraded (5.702%) 2024-04-25T17:25:32.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:31 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:25:32.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:31 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:25:32.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:31 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:25:34.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:33 smithi037 ceph-mon[90844]: pgmap v160: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 208 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s; 35/228 objects degraded (15.351%) 2024-04-25T17:25:34.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:33 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:25:34.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:33 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:25:34.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:33 smithi069 ceph-mon[80239]: pgmap v160: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 208 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s; 35/228 objects degraded (15.351%) 2024-04-25T17:25:34.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:33 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:25:34.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:33 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:25:34.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.488+0000 7f8faf5f7700 1 -- 172.21.15.37:0/2181780703 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fa80662c0 msgr2=0x7f8fa80ff9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:25:34.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.488+0000 7f8faf5f7700 1 --2- 172.21.15.37:0/2181780703 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fa80662c0 0x7f8fa80ff9a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4004940 tx=0x7f8fa4009e30 comp rx=0 tx=0).stop 2024-04-25T17:25:34.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.488+0000 7f8faf5f7700 1 -- 172.21.15.37:0/2181780703 shutdown_connections 2024-04-25T17:25:34.492 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.488+0000 7f8faf5f7700 1 --2- 172.21.15.37:0/2181780703 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8fa80ffee0 0x7f8fa8102300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:34.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.488+0000 7f8faf5f7700 1 --2- 172.21.15.37:0/2181780703 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fa80662c0 0x7f8fa80ff9a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:34.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.488+0000 7f8faf5f7700 1 -- 172.21.15.37:0/2181780703 >> 172.21.15.37:0/2181780703 conn(0x7f8fa80f7430 msgr2=0x7f8fa80f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:25:34.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.489+0000 7f8faf5f7700 1 -- 172.21.15.37:0/2181780703 shutdown_connections 2024-04-25T17:25:34.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.489+0000 7f8faf5f7700 1 -- 172.21.15.37:0/2181780703 wait complete. 2024-04-25T17:25:34.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.489+0000 7f8faf5f7700 1 Processor -- start 2024-04-25T17:25:34.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.489+0000 7f8faf5f7700 1 -- start start 2024-04-25T17:25:34.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.489+0000 7f8faf5f7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fa80662c0 0x7f8fa810da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:25:34.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.489+0000 7f8faf5f7700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8fa80ffee0 0x7f8fa810df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:25:34.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.489+0000 7f8faf5f7700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa810e540 con 0x7f8fa80662c0 2024-04-25T17:25:34.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.489+0000 7f8faf5f7700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa810ed40 con 0x7f8fa80ffee0 2024-04-25T17:25:34.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.489+0000 7f8fad393700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fa80662c0 0x7f8fa810da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:25:34.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.489+0000 7f8fad393700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fa80662c0 0x7f8fa810da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44030/0 (socket says 172.21.15.37:44030) 2024-04-25T17:25:34.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.489+0000 7f8fad393700 1 -- 172.21.15.37:0/1632052884 learned_addr learned my addr 172.21.15.37:0/1632052884 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:25:34.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.490+0000 7f8facb92700 1 --2- 172.21.15.37:0/1632052884 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8fa80ffee0 0x7f8fa810df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:25:34.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.490+0000 7f8fad393700 1 -- 172.21.15.37:0/1632052884 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8fa80ffee0 msgr2=0x7f8fa810df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:25:34.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.490+0000 7f8fad393700 1 --2- 172.21.15.37:0/1632052884 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8fa80ffee0 0x7f8fa810df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:34.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.490+0000 7f8fad393700 1 -- 172.21.15.37:0/1632052884 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa4005040 con 0x7f8fa80662c0 2024-04-25T17:25:34.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.490+0000 7f8fad393700 1 --2- 172.21.15.37:0/1632052884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fa80662c0 0x7f8fa810da00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4000c00 tx=0x7f8fa4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:25:34.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.490+0000 7f8f9dffb700 1 -- 172.21.15.37:0/1632052884 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8fa400e040 con 0x7f8fa80662c0 2024-04-25T17:25:34.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.490+0000 7f8faf5f7700 1 -- 172.21.15.37:0/1632052884 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fa810efc0 con 0x7f8fa80662c0 2024-04-25T17:25:34.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.490+0000 7f8f9dffb700 1 -- 172.21.15.37:0/1632052884 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8fa400bcc0 con 0x7f8fa80662c0 2024-04-25T17:25:34.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.490+0000 7f8f9dffb700 1 -- 172.21.15.37:0/1632052884 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8fa401c630 con 0x7f8fa80662c0 2024-04-25T17:25:34.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.490+0000 7f8faf5f7700 1 -- 172.21.15.37:0/1632052884 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fa810f500 con 0x7f8fa80662c0 2024-04-25T17:25:34.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.491+0000 7f8faf5f7700 1 -- 172.21.15.37:0/1632052884 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fa805f5c0 con 0x7f8fa80662c0 2024-04-25T17:25:34.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.493+0000 7f8f9dffb700 1 -- 172.21.15.37:0/1632052884 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f8fa4013980 con 0x7f8fa80662c0 2024-04-25T17:25:34.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.493+0000 7f8f9dffb700 1 --2- 172.21.15.37:0/1632052884 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f8f94076b90 0x7f8f94079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:25:34.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.493+0000 7f8f9dffb700 1 -- 172.21.15.37:0/1632052884 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f8fa409a0f0 con 0x7f8fa80662c0 2024-04-25T17:25:34.495 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.493+0000 7f8facb92700 1 --2- 172.21.15.37:0/1632052884 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f8f94076b90 0x7f8f94079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:25:34.496 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.494+0000 7f8facb92700 1 --2- 172.21.15.37:0/1632052884 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f8f94076b90 0x7f8f94079040 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8f98009fd0 tx=0x7f8f98009f60 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:25:34.499 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.497+0000 7f8f9dffb700 1 -- 172.21.15.37:0/1632052884 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f8fa4062d90 con 0x7f8fa80662c0 2024-04-25T17:25:34.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.729+0000 7f8faf5f7700 1 -- 172.21.15.37:0/1632052884 --> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8fa810f8a0 con 0x7f8f94076b90 2024-04-25T17:25:34.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.730+0000 7f8f9dffb700 1 -- 172.21.15.37:0/1632052884 <== mgr.34104 v2:172.21.15.37:6800/783197737 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f8fa810f8a0 con 0x7f8f94076b90 2024-04-25T17:25:34.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.732+0000 7f8faf5f7700 1 -- 172.21.15.37:0/1632052884 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f8f94076b90 msgr2=0x7f8f94079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:25:34.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.732+0000 7f8faf5f7700 1 --2- 172.21.15.37:0/1632052884 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f8f94076b90 0x7f8f94079040 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8f98009fd0 tx=0x7f8f98009f60 comp rx=0 tx=0).stop 2024-04-25T17:25:34.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.732+0000 7f8faf5f7700 1 -- 172.21.15.37:0/1632052884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fa80662c0 msgr2=0x7f8fa810da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:25:34.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.732+0000 7f8faf5f7700 1 --2- 172.21.15.37:0/1632052884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fa80662c0 0x7f8fa810da00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4000c00 tx=0x7f8fa4009e30 comp rx=0 tx=0).stop 2024-04-25T17:25:34.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.732+0000 7f8faf5f7700 1 -- 172.21.15.37:0/1632052884 shutdown_connections 2024-04-25T17:25:34.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.732+0000 7f8faf5f7700 1 --2- 172.21.15.37:0/1632052884 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f8f94076b90 0x7f8f94079040 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:34.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.732+0000 7f8faf5f7700 1 --2- 172.21.15.37:0/1632052884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fa80662c0 0x7f8fa810da00 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:34.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.732+0000 7f8faf5f7700 1 --2- 172.21.15.37:0/1632052884 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8fa80ffee0 0x7f8fa810df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:34.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.732+0000 7f8faf5f7700 1 -- 172.21.15.37:0/1632052884 >> 172.21.15.37:0/1632052884 conn(0x7f8fa80f7430 msgr2=0x7f8fa80f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:25:34.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.732+0000 7f8faf5f7700 1 -- 172.21.15.37:0/1632052884 shutdown_connections 2024-04-25T17:25:34.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.732+0000 7f8faf5f7700 1 -- 172.21.15.37:0/1632052884 wait complete. 2024-04-25T17:25:34.744 INFO:teuthology.orchestra.run.smithi037.stdout:true 2024-04-25T17:25:34.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.838+0000 7fc33a1fc700 1 -- 172.21.15.37:0/3536593149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3340fbcb0 msgr2=0x7fc3340fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:25:34.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.838+0000 7fc33a1fc700 1 --2- 172.21.15.37:0/3536593149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3340fbcb0 0x7fc3340fc0c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc324009ce0 tx=0x7fc324004d10 comp rx=0 tx=0).stop 2024-04-25T17:25:34.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.838+0000 7fc33a1fc700 1 -- 172.21.15.37:0/3536593149 shutdown_connections 2024-04-25T17:25:34.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.838+0000 7fc33a1fc700 1 --2- 172.21.15.37:0/3536593149 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3340fcf60 0x7fc3340fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:34.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.838+0000 7fc33a1fc700 1 --2- 172.21.15.37:0/3536593149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3340fbcb0 0x7fc3340fc0c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:34.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.838+0000 7fc33a1fc700 1 -- 172.21.15.37:0/3536593149 >> 172.21.15.37:0/3536593149 conn(0x7fc3340f7430 msgr2=0x7fc3340f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:25:34.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.838+0000 7fc33a1fc700 1 -- 172.21.15.37:0/3536593149 shutdown_connections 2024-04-25T17:25:34.841 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.838+0000 7fc33a1fc700 1 -- 172.21.15.37:0/3536593149 wait complete. 2024-04-25T17:25:34.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.839+0000 7fc33a1fc700 1 Processor -- start 2024-04-25T17:25:34.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.839+0000 7fc33a1fc700 1 -- start start 2024-04-25T17:25:34.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.839+0000 7fc33a1fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3340fbcb0 0x7fc33410dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:25:34.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.839+0000 7fc33a1fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3340fcf60 0x7fc33410dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:25:34.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.839+0000 7fc33a1fc700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc33410e5f0 con 0x7fc3340fbcb0 2024-04-25T17:25:34.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.839+0000 7fc33a1fc700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc33410eda0 con 0x7fc3340fcf60 2024-04-25T17:25:34.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.839+0000 7fc3337fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3340fbcb0 0x7fc33410dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:25:34.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.839+0000 7fc3337fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3340fbcb0 0x7fc33410dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44052/0 (socket says 172.21.15.37:44052) 2024-04-25T17:25:34.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.839+0000 7fc3337fe700 1 -- 172.21.15.37:0/1194164523 learned_addr learned my addr 172.21.15.37:0/1194164523 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:25:34.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.839+0000 7fc332ffd700 1 --2- 172.21.15.37:0/1194164523 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3340fcf60 0x7fc33410dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:25:34.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.840+0000 7fc3337fe700 1 -- 172.21.15.37:0/1194164523 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3340fcf60 msgr2=0x7fc33410dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:25:34.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.840+0000 7fc3337fe700 1 --2- 172.21.15.37:0/1194164523 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3340fcf60 0x7fc33410dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:34.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.840+0000 7fc3337fe700 1 -- 172.21.15.37:0/1194164523 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc324009940 con 0x7fc3340fbcb0 2024-04-25T17:25:34.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.840+0000 7fc3337fe700 1 --2- 172.21.15.37:0/1194164523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3340fbcb0 0x7fc33410dab0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc32400bfd0 tx=0x7fc324004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:25:34.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.840+0000 7fc32bfff700 1 -- 172.21.15.37:0/1194164523 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc32400e040 con 0x7fc3340fbcb0 2024-04-25T17:25:34.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.840+0000 7fc32bfff700 1 -- 172.21.15.37:0/1194164523 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc32401cd00 con 0x7fc3340fbcb0 2024-04-25T17:25:34.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.840+0000 7fc33a1fc700 1 -- 172.21.15.37:0/1194164523 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc33410f020 con 0x7fc3340fbcb0 2024-04-25T17:25:34.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.840+0000 7fc32bfff700 1 -- 172.21.15.37:0/1194164523 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc324012c40 con 0x7fc3340fbcb0 2024-04-25T17:25:34.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.840+0000 7fc33a1fc700 1 -- 172.21.15.37:0/1194164523 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc33410f560 con 0x7fc3340fbcb0 2024-04-25T17:25:34.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.841+0000 7fc33a1fc700 1 -- 172.21.15.37:0/1194164523 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc334101af0 con 0x7fc3340fbcb0 2024-04-25T17:25:34.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.842+0000 7fc32bfff700 1 -- 172.21.15.37:0/1194164523 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7fc3240124a0 con 0x7fc3340fbcb0 2024-04-25T17:25:34.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.842+0000 7fc32bfff700 1 --2- 172.21.15.37:0/1194164523 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fc320076b90 0x7fc320079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:25:34.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.842+0000 7fc32bfff700 1 -- 172.21.15.37:0/1194164523 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fc32409a5c0 con 0x7fc3340fbcb0 2024-04-25T17:25:34.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.842+0000 7fc332ffd700 1 --2- 172.21.15.37:0/1194164523 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fc320076b90 0x7fc320079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:25:34.845 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.843+0000 7fc332ffd700 1 --2- 172.21.15.37:0/1194164523 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fc320076b90 0x7fc320079040 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc31c009b80 tx=0x7fc31c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:25:34.849 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:34.847+0000 7fc32bfff700 1 -- 172.21.15.37:0/1194164523 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fc324063140 con 0x7fc3340fbcb0 2024-04-25T17:25:35.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.078+0000 7fc33a1fc700 1 -- 172.21.15.37:0/1194164523 --> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc33410f6f0 con 0x7fc320076b90 2024-04-25T17:25:35.080 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.079+0000 7fc32bfff700 1 -- 172.21.15.37:0/1194164523 <== mgr.34104 v2:172.21.15.37:6800/783197737 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fc33410f6f0 con 0x7fc320076b90 2024-04-25T17:25:35.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.081+0000 7fc33a1fc700 1 -- 172.21.15.37:0/1194164523 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fc320076b90 msgr2=0x7fc320079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:25:35.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.081+0000 7fc33a1fc700 1 --2- 172.21.15.37:0/1194164523 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fc320076b90 0x7fc320079040 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc31c009b80 tx=0x7fc31c00b040 comp rx=0 tx=0).stop 2024-04-25T17:25:35.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.081+0000 7fc33a1fc700 1 -- 172.21.15.37:0/1194164523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3340fbcb0 msgr2=0x7fc33410dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:25:35.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.081+0000 7fc33a1fc700 1 --2- 172.21.15.37:0/1194164523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3340fbcb0 0x7fc33410dab0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc32400bfd0 tx=0x7fc324004d10 comp rx=0 tx=0).stop 2024-04-25T17:25:35.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.081+0000 7fc33a1fc700 1 -- 172.21.15.37:0/1194164523 shutdown_connections 2024-04-25T17:25:35.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.081+0000 7fc33a1fc700 1 --2- 172.21.15.37:0/1194164523 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fc320076b90 0x7fc320079040 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:35.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.081+0000 7fc33a1fc700 1 --2- 172.21.15.37:0/1194164523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc3340fbcb0 0x7fc33410dab0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:35.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.081+0000 7fc33a1fc700 1 --2- 172.21.15.37:0/1194164523 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3340fcf60 0x7fc33410dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:35.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.081+0000 7fc33a1fc700 1 -- 172.21.15.37:0/1194164523 >> 172.21.15.37:0/1194164523 conn(0x7fc3340f7430 msgr2=0x7fc334065b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:25:35.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.081+0000 7fc33a1fc700 1 -- 172.21.15.37:0/1194164523 shutdown_connections 2024-04-25T17:25:35.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.081+0000 7fc33a1fc700 1 -- 172.21.15.37:0/1194164523 wait complete. 2024-04-25T17:25:35.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.186+0000 7fae42cd6700 1 -- 172.21.15.37:0/2834695640 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae3c0fce60 msgr2=0x7fae3c0fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:25:35.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.186+0000 7fae42cd6700 1 --2- 172.21.15.37:0/2834695640 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae3c0fce60 0x7fae3c0fd270 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fae30004940 tx=0x7fae30009e30 comp rx=0 tx=0).stop 2024-04-25T17:25:35.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.186+0000 7fae42cd6700 1 -- 172.21.15.37:0/2834695640 shutdown_connections 2024-04-25T17:25:35.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.186+0000 7fae42cd6700 1 --2- 172.21.15.37:0/2834695640 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae3c0fdfd0 0x7fae3c0fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:35.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.186+0000 7fae42cd6700 1 --2- 172.21.15.37:0/2834695640 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae3c0fce60 0x7fae3c0fd270 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:35.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.186+0000 7fae42cd6700 1 -- 172.21.15.37:0/2834695640 >> 172.21.15.37:0/2834695640 conn(0x7fae3c0f8560 msgr2=0x7fae3c0fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:25:35.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.186+0000 7fae42cd6700 1 -- 172.21.15.37:0/2834695640 shutdown_connections 2024-04-25T17:25:35.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.186+0000 7fae42cd6700 1 -- 172.21.15.37:0/2834695640 wait complete. 2024-04-25T17:25:35.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.186+0000 7fae42cd6700 1 Processor -- start 2024-04-25T17:25:35.189 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.186+0000 7fae42cd6700 1 -- start start 2024-04-25T17:25:35.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.187+0000 7fae42cd6700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae3c0fce60 0x7fae3c10fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:25:35.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.187+0000 7fae42cd6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae3c0fdfd0 0x7fae3c110140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:25:35.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.187+0000 7fae42cd6700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c110740 con 0x7fae3c0fdfd0 2024-04-25T17:25:35.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.187+0000 7fae42cd6700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c110f90 con 0x7fae3c0fce60 2024-04-25T17:25:35.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.187+0000 7fae3bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae3c0fdfd0 0x7fae3c110140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:25:35.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.187+0000 7fae3bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae3c0fdfd0 0x7fae3c110140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44070/0 (socket says 172.21.15.37:44070) 2024-04-25T17:25:35.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.187+0000 7fae3bfff700 1 -- 172.21.15.37:0/357945506 learned_addr learned my addr 172.21.15.37:0/357945506 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:25:35.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.187+0000 7fae40a72700 1 --2- 172.21.15.37:0/357945506 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae3c0fce60 0x7fae3c10fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:25:35.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.187+0000 7fae3bfff700 1 -- 172.21.15.37:0/357945506 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae3c0fce60 msgr2=0x7fae3c10fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:25:35.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.187+0000 7fae3bfff700 1 --2- 172.21.15.37:0/357945506 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae3c0fce60 0x7fae3c10fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:35.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.187+0000 7fae3bfff700 1 -- 172.21.15.37:0/357945506 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae30005040 con 0x7fae3c0fdfd0 2024-04-25T17:25:35.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.187+0000 7fae3bfff700 1 --2- 172.21.15.37:0/357945506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae3c0fdfd0 0x7fae3c110140 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fae28002a50 tx=0x7fae280046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:25:35.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.187+0000 7fae397fa700 1 -- 172.21.15.37:0/357945506 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae28007cc0 con 0x7fae3c0fdfd0 2024-04-25T17:25:35.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.187+0000 7fae397fa700 1 -- 172.21.15.37:0/357945506 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fae2800f040 con 0x7fae3c0fdfd0 2024-04-25T17:25:35.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.187+0000 7fae42cd6700 1 -- 172.21.15.37:0/357945506 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae3c111270 con 0x7fae3c0fdfd0 2024-04-25T17:25:35.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.187+0000 7fae397fa700 1 -- 172.21.15.37:0/357945506 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae2800da30 con 0x7fae3c0fdfd0 2024-04-25T17:25:35.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.188+0000 7fae42cd6700 1 -- 172.21.15.37:0/357945506 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae3c1117b0 con 0x7fae3c0fdfd0 2024-04-25T17:25:35.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.188+0000 7fae42cd6700 1 -- 172.21.15.37:0/357945506 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae3c101960 con 0x7fae3c0fdfd0 2024-04-25T17:25:35.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.189+0000 7fae397fa700 1 -- 172.21.15.37:0/357945506 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7fae2800db90 con 0x7fae3c0fdfd0 2024-04-25T17:25:35.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.190+0000 7fae397fa700 1 --2- 172.21.15.37:0/357945506 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fae2c076b80 0x7fae2c079030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:25:35.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.190+0000 7fae397fa700 1 -- 172.21.15.37:0/357945506 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fae28098060 con 0x7fae3c0fdfd0 2024-04-25T17:25:35.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.190+0000 7fae40a72700 1 --2- 172.21.15.37:0/357945506 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fae2c076b80 0x7fae2c079030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:25:35.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.190+0000 7fae40a72700 1 --2- 172.21.15.37:0/357945506 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fae2c076b80 0x7fae2c079030 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fae30009fd0 tx=0x7fae30009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:25:35.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.195+0000 7fae397fa700 1 -- 172.21.15.37:0/357945506 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fae28060be0 con 0x7fae3c0fdfd0 2024-04-25T17:25:35.418 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.416+0000 7fae42cd6700 1 -- 172.21.15.37:0/357945506 --> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fae3c1119d0 con 0x7fae2c076b80 2024-04-25T17:25:35.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.426+0000 7fae397fa700 1 -- 172.21.15.37:0/357945506 <== mgr.34104 v2:172.21.15.37:6800/783197737 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fae3c1119d0 con 0x7fae2c076b80 2024-04-25T17:25:35.428 INFO:teuthology.orchestra.run.smithi037.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-25T17:25:35.428 INFO:teuthology.orchestra.run.smithi037.stdout:alertmanager.smithi037 smithi037 *:9093,9094 running (7m) 102s ago 15m 24.9M - 0.25.0 c8568f914cd2 18aed8f409ee 2024-04-25T17:25:35.428 INFO:teuthology.orchestra.run.smithi037.stdout:crash.smithi037 smithi037 running (3m) 102s ago 15m 6660k - 19.0.0-3291-g994e2f20 d53c96779a29 639584ea5855 2024-04-25T17:25:35.428 INFO:teuthology.orchestra.run.smithi037.stdout:crash.smithi069 smithi069 running (3m) 1s ago 14m 6665k - 19.0.0-3291-g994e2f20 d53c96779a29 ee5db16733a7 2024-04-25T17:25:35.428 INFO:teuthology.orchestra.run.smithi037.stdout:grafana.smithi037 smithi037 *:3000 running (6m) 102s ago 15m 84.2M - 9.4.7 954c08fa6188 1eff3ea3f9b0 2024-04-25T17:25:35.428 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi037.ksmixc smithi037 running (9m) 102s ago 9m 149M - 17.2.7-902-gc61472c8 0de407c1b3af 394aa56079b4 2024-04-25T17:25:35.428 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi037.ovkrpq smithi037 running (9m) 102s ago 9m 102M - 17.2.7-902-gc61472c8 0de407c1b3af 73ca662174a7 2024-04-25T17:25:35.428 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi069.cpprst smithi069 running (9m) 1s ago 9m 16.3M - 17.2.7-902-gc61472c8 0de407c1b3af dbda101df20e 2024-04-25T17:25:35.429 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi069.ytlqcf smithi069 running (9m) 1s ago 9m 14.3M - 17.2.7-902-gc61472c8 0de407c1b3af 911df6b18215 2024-04-25T17:25:35.429 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.smithi037.txrgxl smithi037 *:8443,9283,8765 running (5m) 102s ago 16m 573M - 19.0.0-3291-g994e2f20 d53c96779a29 e9653fc62df9 2024-04-25T17:25:35.429 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.smithi069.mmuhdo smithi069 *:8443,9283,8765 running (5m) 1s ago 14m 520M - 19.0.0-3291-g994e2f20 d53c96779a29 6820207b4019 2024-04-25T17:25:35.429 INFO:teuthology.orchestra.run.smithi037.stdout:mon.smithi037 smithi037 running (4m) 102s ago 16m 113M 2048M 19.0.0-3291-g994e2f20 d53c96779a29 1b349f3af69d 2024-04-25T17:25:35.429 INFO:teuthology.orchestra.run.smithi037.stdout:mon.smithi069 smithi069 running (4m) 1s ago 14m 103M 2048M 19.0.0-3291-g994e2f20 d53c96779a29 7744dbe81b50 2024-04-25T17:25:35.429 INFO:teuthology.orchestra.run.smithi037.stdout:node-exporter.smithi037 smithi037 *:9100 running (7m) 102s ago 15m 14.4M - 1.5.0 0da6a335fe13 1e59bbb2aa82 2024-04-25T17:25:35.429 INFO:teuthology.orchestra.run.smithi037.stdout:node-exporter.smithi069 smithi069 *:9100 running (6m) 1s ago 14m 16.3M - 1.5.0 0da6a335fe13 0c51a9833fe4 2024-04-25T17:25:35.429 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0 smithi037 running (3m) 102s ago 13m 163M 1559M 19.0.0-3291-g994e2f20 d53c96779a29 e97538cb8b4f 2024-04-25T17:25:35.429 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1 smithi037 running (2m) 102s ago 13m 166M 1559M 19.0.0-3291-g994e2f20 d53c96779a29 6cf158192aae 2024-04-25T17:25:35.429 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2 smithi037 running (108s) 102s ago 12m 79.6M 1559M 19.0.0-3291-g994e2f20 d53c96779a29 a0b57bba2ebf 2024-04-25T17:25:35.429 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3 smithi069 running (72s) 1s ago 12m 179M 2581M 19.0.0-3291-g994e2f20 d53c96779a29 d1aa15d6b575 2024-04-25T17:25:35.429 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4 smithi069 running (39s) 1s ago 11m 170M 2581M 19.0.0-3291-g994e2f20 d53c96779a29 ad76a3d0fecb 2024-04-25T17:25:35.430 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5 smithi069 running (5s) 1s ago 11m 81.5M 2581M 19.0.0-3291-g994e2f20 d53c96779a29 dea8b059441b 2024-04-25T17:25:35.430 INFO:teuthology.orchestra.run.smithi037.stdout:prometheus.smithi037 smithi037 *:9095 running (5m) 102s ago 14m 65.9M - 2.43.0 a07b618ecd1d 2c5a268ffc1f 2024-04-25T17:25:35.430 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.428+0000 7fae42cd6700 1 -- 172.21.15.37:0/357945506 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fae2c076b80 msgr2=0x7fae2c079030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:25:35.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.428+0000 7fae42cd6700 1 --2- 172.21.15.37:0/357945506 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fae2c076b80 0x7fae2c079030 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fae30009fd0 tx=0x7fae30009e30 comp rx=0 tx=0).stop 2024-04-25T17:25:35.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.428+0000 7fae42cd6700 1 -- 172.21.15.37:0/357945506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae3c0fdfd0 msgr2=0x7fae3c110140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:25:35.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.428+0000 7fae42cd6700 1 --2- 172.21.15.37:0/357945506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae3c0fdfd0 0x7fae3c110140 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fae28002a50 tx=0x7fae280046b0 comp rx=0 tx=0).stop 2024-04-25T17:25:35.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.428+0000 7fae42cd6700 1 -- 172.21.15.37:0/357945506 shutdown_connections 2024-04-25T17:25:35.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.428+0000 7fae42cd6700 1 --2- 172.21.15.37:0/357945506 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fae2c076b80 0x7fae2c079030 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:35.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.428+0000 7fae42cd6700 1 --2- 172.21.15.37:0/357945506 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae3c0fce60 0x7fae3c10fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:35.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.428+0000 7fae42cd6700 1 --2- 172.21.15.37:0/357945506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae3c0fdfd0 0x7fae3c110140 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:35.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.428+0000 7fae42cd6700 1 -- 172.21.15.37:0/357945506 >> 172.21.15.37:0/357945506 conn(0x7fae3c0f8560 msgr2=0x7fae3c0f9bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:25:35.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.428+0000 7fae42cd6700 1 -- 172.21.15.37:0/357945506 shutdown_connections 2024-04-25T17:25:35.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.428+0000 7fae42cd6700 1 -- 172.21.15.37:0/357945506 wait complete. 2024-04-25T17:25:35.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.532+0000 7f69dd704700 1 -- 172.21.15.37:0/1856233028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69d80fff60 msgr2=0x7f69d8102340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:25:35.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.532+0000 7f69dd704700 1 --2- 172.21.15.37:0/1856233028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69d80fff60 0x7f69d8102340 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f69c8004940 tx=0x7f69c8009e30 comp rx=0 tx=0).stop 2024-04-25T17:25:35.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.532+0000 7f69dd704700 1 -- 172.21.15.37:0/1856233028 shutdown_connections 2024-04-25T17:25:35.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.532+0000 7f69dd704700 1 --2- 172.21.15.37:0/1856233028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69d80fff60 0x7f69d8102340 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:35.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.532+0000 7f69dd704700 1 --2- 172.21.15.37:0/1856233028 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f69d8066240 0x7f69d80ffa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:35.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.532+0000 7f69dd704700 1 -- 172.21.15.37:0/1856233028 >> 172.21.15.37:0/1856233028 conn(0x7f69d80f7430 msgr2=0x7f69d80f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:25:35.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.532+0000 7f69dd704700 1 -- 172.21.15.37:0/1856233028 shutdown_connections 2024-04-25T17:25:35.535 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.532+0000 7f69dd704700 1 -- 172.21.15.37:0/1856233028 wait complete. 2024-04-25T17:25:35.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.533+0000 7f69dd704700 1 Processor -- start 2024-04-25T17:25:35.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.533+0000 7f69dd704700 1 -- start start 2024-04-25T17:25:35.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.533+0000 7f69dd704700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69d8066240 0x7f69d810d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:25:35.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.533+0000 7f69dd704700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f69d80fff60 0x7f69d810df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:25:35.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.533+0000 7f69dd704700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d810e530 con 0x7f69d8066240 2024-04-25T17:25:35.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.533+0000 7f69dd704700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69d810ed30 con 0x7f69d80fff60 2024-04-25T17:25:35.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.533+0000 7f69d6ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69d8066240 0x7f69d810d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:25:35.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.533+0000 7f69d6ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69d8066240 0x7f69d810d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44092/0 (socket says 172.21.15.37:44092) 2024-04-25T17:25:35.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.533+0000 7f69d6ffd700 1 -- 172.21.15.37:0/3511026058 learned_addr learned my addr 172.21.15.37:0/3511026058 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:25:35.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.533+0000 7f69d67fc700 1 --2- 172.21.15.37:0/3511026058 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f69d80fff60 0x7f69d810df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:25:35.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.534+0000 7f69d6ffd700 1 -- 172.21.15.37:0/3511026058 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f69d80fff60 msgr2=0x7f69d810df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:25:35.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.534+0000 7f69d6ffd700 1 --2- 172.21.15.37:0/3511026058 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f69d80fff60 0x7f69d810df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:35.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.534+0000 7f69d6ffd700 1 -- 172.21.15.37:0/3511026058 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69c8005040 con 0x7f69d8066240 2024-04-25T17:25:35.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.534+0000 7f69d6ffd700 1 --2- 172.21.15.37:0/3511026058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69d8066240 0x7f69d810d9f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f69cc00eb70 tx=0x7f69cc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:25:35.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.534+0000 7f69bf7fe700 1 -- 172.21.15.37:0/3511026058 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69cc007cc0 con 0x7f69d8066240 2024-04-25T17:25:35.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.534+0000 7f69dd704700 1 -- 172.21.15.37:0/3511026058 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69d810efb0 con 0x7f69d8066240 2024-04-25T17:25:35.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.534+0000 7f69bf7fe700 1 -- 172.21.15.37:0/3511026058 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f69cc00f040 con 0x7f69d8066240 2024-04-25T17:25:35.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.534+0000 7f69bf7fe700 1 -- 172.21.15.37:0/3511026058 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69cc00cb20 con 0x7f69d8066240 2024-04-25T17:25:35.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.534+0000 7f69dd704700 1 -- 172.21.15.37:0/3511026058 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69d810f4f0 con 0x7f69d8066240 2024-04-25T17:25:35.538 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.535+0000 7f69dd704700 1 -- 172.21.15.37:0/3511026058 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69d805f5c0 con 0x7f69d8066240 2024-04-25T17:25:35.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.536+0000 7f69bf7fe700 1 -- 172.21.15.37:0/3511026058 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f69cc00cc80 con 0x7f69d8066240 2024-04-25T17:25:35.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.536+0000 7f69bf7fe700 1 --2- 172.21.15.37:0/3511026058 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f69c0076b80 0x7f69c0079030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:25:35.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.536+0000 7f69bf7fe700 1 -- 172.21.15.37:0/3511026058 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f69cc097da0 con 0x7f69d8066240 2024-04-25T17:25:35.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.536+0000 7f69d67fc700 1 --2- 172.21.15.37:0/3511026058 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f69c0076b80 0x7f69c0079030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:25:35.539 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.537+0000 7f69d67fc700 1 --2- 172.21.15.37:0/3511026058 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f69c0076b80 0x7f69c0079030 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f69c8009fd0 tx=0x7f69c8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:25:35.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.541+0000 7f69bf7fe700 1 -- 172.21.15.37:0/3511026058 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f69cc060930 con 0x7f69d8066240 2024-04-25T17:25:35.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.837+0000 7f69dd704700 1 -- 172.21.15.37:0/3511026058 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f69d810f810 con 0x7f69d8066240 2024-04-25T17:25:35.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.838+0000 7f69bf7fe700 1 -- 172.21.15.37:0/3511026058 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+732 (secure 0 0 0) 0x7f69cc0602d0 con 0x7f69d8066240 2024-04-25T17:25:35.839 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-25T17:25:35.840 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": { 2024-04-25T17:25:35.840 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 2 2024-04-25T17:25:35.840 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:25:35.840 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": { 2024-04-25T17:25:35.840 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 2 2024-04-25T17:25:35.840 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:25:35.840 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": { 2024-04-25T17:25:35.840 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 5 2024-04-25T17:25:35.840 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:25:35.840 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": { 2024-04-25T17:25:35.840 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 4 2024-04-25T17:25:35.840 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:25:35.840 INFO:teuthology.orchestra.run.smithi037.stdout: "overall": { 2024-04-25T17:25:35.841 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 4, 2024-04-25T17:25:35.841 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 9 2024-04-25T17:25:35.841 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-04-25T17:25:35.841 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-25T17:25:35.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.840+0000 7f69dd704700 1 -- 172.21.15.37:0/3511026058 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f69c0076b80 msgr2=0x7f69c0079030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:25:35.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.840+0000 7f69dd704700 1 --2- 172.21.15.37:0/3511026058 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f69c0076b80 0x7f69c0079030 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f69c8009fd0 tx=0x7f69c8009e30 comp rx=0 tx=0).stop 2024-04-25T17:25:35.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.840+0000 7f69dd704700 1 -- 172.21.15.37:0/3511026058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69d8066240 msgr2=0x7f69d810d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:25:35.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.840+0000 7f69dd704700 1 --2- 172.21.15.37:0/3511026058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69d8066240 0x7f69d810d9f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f69cc00eb70 tx=0x7f69cc00b040 comp rx=0 tx=0).stop 2024-04-25T17:25:35.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.840+0000 7f69dd704700 1 -- 172.21.15.37:0/3511026058 shutdown_connections 2024-04-25T17:25:35.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.840+0000 7f69dd704700 1 --2- 172.21.15.37:0/3511026058 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f69c0076b80 0x7f69c0079030 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:35.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.840+0000 7f69dd704700 1 --2- 172.21.15.37:0/3511026058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69d8066240 0x7f69d810d9f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:35.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.840+0000 7f69dd704700 1 --2- 172.21.15.37:0/3511026058 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f69d80fff60 0x7f69d810df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:35.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.840+0000 7f69dd704700 1 -- 172.21.15.37:0/3511026058 >> 172.21.15.37:0/3511026058 conn(0x7f69d80f7430 msgr2=0x7f69d80f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:25:35.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.840+0000 7f69dd704700 1 -- 172.21.15.37:0/3511026058 shutdown_connections 2024-04-25T17:25:35.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.840+0000 7f69dd704700 1 -- 172.21.15.37:0/3511026058 wait complete. 2024-04-25T17:25:35.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.944+0000 7f8bb6d4b700 1 -- 172.21.15.37:0/1107584973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bb00662c0 msgr2=0x7f8bb00ff9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:25:35.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.944+0000 7f8bb6d4b700 1 --2- 172.21.15.37:0/1107584973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bb00662c0 0x7f8bb00ff9a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8ba0004940 tx=0x7f8ba0009e30 comp rx=0 tx=0).stop 2024-04-25T17:25:35.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.944+0000 7f8bb6d4b700 1 -- 172.21.15.37:0/1107584973 shutdown_connections 2024-04-25T17:25:35.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.944+0000 7f8bb6d4b700 1 --2- 172.21.15.37:0/1107584973 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bb00ffee0 0x7f8bb0102300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:35.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.944+0000 7f8bb6d4b700 1 --2- 172.21.15.37:0/1107584973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bb00662c0 0x7f8bb00ff9a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:35.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.944+0000 7f8bb6d4b700 1 -- 172.21.15.37:0/1107584973 >> 172.21.15.37:0/1107584973 conn(0x7f8bb00f7430 msgr2=0x7f8bb00f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:25:35.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.944+0000 7f8bb6d4b700 1 -- 172.21.15.37:0/1107584973 shutdown_connections 2024-04-25T17:25:35.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.944+0000 7f8bb6d4b700 1 -- 172.21.15.37:0/1107584973 wait complete. 2024-04-25T17:25:35.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.944+0000 7f8bb6d4b700 1 Processor -- start 2024-04-25T17:25:35.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.944+0000 7f8bb6d4b700 1 -- start start 2024-04-25T17:25:35.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.945+0000 7f8bb6d4b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bb00662c0 0x7f8bb010d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:25:35.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.945+0000 7f8bb6d4b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bb00ffee0 0x7f8bb010df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:25:35.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.945+0000 7f8bb6d4b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb010e520 con 0x7f8bb00ffee0 2024-04-25T17:25:35.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.945+0000 7f8bb6d4b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb010ed20 con 0x7f8bb00662c0 2024-04-25T17:25:35.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.945+0000 7f8baffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bb00ffee0 0x7f8bb010df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:25:35.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.945+0000 7f8baffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bb00ffee0 0x7f8bb010df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44104/0 (socket says 172.21.15.37:44104) 2024-04-25T17:25:35.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.945+0000 7f8baffff700 1 -- 172.21.15.37:0/2574634396 learned_addr learned my addr 172.21.15.37:0/2574634396 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:25:35.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.945+0000 7f8bb4ae7700 1 --2- 172.21.15.37:0/2574634396 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bb00662c0 0x7f8bb010d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:25:35.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.945+0000 7f8baffff700 1 -- 172.21.15.37:0/2574634396 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bb00662c0 msgr2=0x7f8bb010d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:25:35.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.945+0000 7f8baffff700 1 --2- 172.21.15.37:0/2574634396 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bb00662c0 0x7f8bb010d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:35.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.945+0000 7f8baffff700 1 -- 172.21.15.37:0/2574634396 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ba0005040 con 0x7f8bb00ffee0 2024-04-25T17:25:35.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.945+0000 7f8baffff700 1 --2- 172.21.15.37:0/2574634396 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bb00ffee0 0x7f8bb010df20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8ba400eb40 tx=0x7f8ba400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:25:35.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.945+0000 7f8bad7fa700 1 -- 172.21.15.37:0/2574634396 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ba4007cc0 con 0x7f8bb00ffee0 2024-04-25T17:25:35.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.946+0000 7f8bad7fa700 1 -- 172.21.15.37:0/2574634396 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8ba400f040 con 0x7f8bb00ffee0 2024-04-25T17:25:35.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.946+0000 7f8bad7fa700 1 -- 172.21.15.37:0/2574634396 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ba400ca10 con 0x7f8bb00ffee0 2024-04-25T17:25:35.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.946+0000 7f8bb6d4b700 1 -- 172.21.15.37:0/2574634396 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bb010efa0 con 0x7f8bb00ffee0 2024-04-25T17:25:35.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.946+0000 7f8bb6d4b700 1 -- 172.21.15.37:0/2574634396 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bb010f4e0 con 0x7f8bb00ffee0 2024-04-25T17:25:35.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.947+0000 7f8bb6d4b700 1 -- 172.21.15.37:0/2574634396 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bb005f5c0 con 0x7f8bb00ffee0 2024-04-25T17:25:35.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.947+0000 7f8bad7fa700 1 -- 172.21.15.37:0/2574634396 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f8ba400cb70 con 0x7f8bb00ffee0 2024-04-25T17:25:35.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.948+0000 7f8bad7fa700 1 --2- 172.21.15.37:0/2574634396 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f8b98076b90 0x7f8b98079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:25:35.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.948+0000 7f8bad7fa700 1 -- 172.21.15.37:0/2574634396 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f8ba4097db0 con 0x7f8bb00ffee0 2024-04-25T17:25:35.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.948+0000 7f8bb4ae7700 1 --2- 172.21.15.37:0/2574634396 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f8b98076b90 0x7f8b98079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:25:35.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.948+0000 7f8bb4ae7700 1 --2- 172.21.15.37:0/2574634396 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f8b98076b90 0x7f8b98079040 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8ba0004890 tx=0x7f8ba0009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:25:35.954 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:35.953+0000 7f8bad7fa700 1 -- 172.21.15.37:0/2574634396 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f8ba4060a60 con 0x7f8bb00ffee0 2024-04-25T17:25:36.170 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:35 smithi069 ceph-mon[80239]: pgmap v161: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 208 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 115 B/s rd, 1 op/s; 35/228 objects degraded (15.351%) 2024-04-25T17:25:36.170 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:35 smithi069 ceph-mon[80239]: from='client.34378 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:25:36.170 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:35 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:25:36.170 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:35 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:25:36.171 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:35 smithi069 ceph-mon[80239]: from='client.34382 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:25:36.171 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:35 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/3511026058' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:25:36.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.207+0000 7f8bb6d4b700 1 -- 172.21.15.37:0/2574634396 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8bb004bed0 con 0x7f8bb00ffee0 2024-04-25T17:25:36.209 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:35 smithi037 ceph-mon[90844]: pgmap v161: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 208 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 115 B/s rd, 1 op/s; 35/228 objects degraded (15.351%) 2024-04-25T17:25:36.209 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:35 smithi037 ceph-mon[90844]: from='client.34378 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:25:36.209 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:35 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:25:36.209 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:35 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:25:36.209 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:35 smithi037 ceph-mon[90844]: from='client.34382 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:25:36.209 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:35 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/3511026058' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:25:36.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.207+0000 7f8bad7fa700 1 -- 172.21.15.37:0/2574634396 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1900 (secure 0 0 0) 0x7f8ba4060400 con 0x7f8bb00ffee0 2024-04-25T17:25:36.210 INFO:teuthology.orchestra.run.smithi037.stdout:e16 2024-04-25T17:25:36.210 INFO:teuthology.orchestra.run.smithi037.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-25T17:25:36.210 INFO:teuthology.orchestra.run.smithi037.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T17:25:36.210 INFO:teuthology.orchestra.run.smithi037.stdout:legacy client fscid: 1 2024-04-25T17:25:36.211 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:25:36.211 INFO:teuthology.orchestra.run.smithi037.stdout:Filesystem 'cephfs' (1) 2024-04-25T17:25:36.211 INFO:teuthology.orchestra.run.smithi037.stdout:fs_name cephfs 2024-04-25T17:25:36.211 INFO:teuthology.orchestra.run.smithi037.stdout:epoch 16 2024-04-25T17:25:36.211 INFO:teuthology.orchestra.run.smithi037.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-25T17:25:36.211 INFO:teuthology.orchestra.run.smithi037.stdout:created 2024-04-25T17:15:40.586130+0000 2024-04-25T17:25:36.211 INFO:teuthology.orchestra.run.smithi037.stdout:modified 2024-04-25T17:15:57.508740+0000 2024-04-25T17:25:36.212 INFO:teuthology.orchestra.run.smithi037.stdout:tableserver 0 2024-04-25T17:25:36.212 INFO:teuthology.orchestra.run.smithi037.stdout:root 0 2024-04-25T17:25:36.212 INFO:teuthology.orchestra.run.smithi037.stdout:session_timeout 60 2024-04-25T17:25:36.212 INFO:teuthology.orchestra.run.smithi037.stdout:session_autoclose 300 2024-04-25T17:25:36.212 INFO:teuthology.orchestra.run.smithi037.stdout:max_file_size 1099511627776 2024-04-25T17:25:36.212 INFO:teuthology.orchestra.run.smithi037.stdout:max_xattr_size 65536 2024-04-25T17:25:36.212 INFO:teuthology.orchestra.run.smithi037.stdout:required_client_features {} 2024-04-25T17:25:36.212 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure 0 2024-04-25T17:25:36.212 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure_osd_epoch 0 2024-04-25T17:25:36.213 INFO:teuthology.orchestra.run.smithi037.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T17:25:36.213 INFO:teuthology.orchestra.run.smithi037.stdout:max_mds 1 2024-04-25T17:25:36.213 INFO:teuthology.orchestra.run.smithi037.stdout:in 0 2024-04-25T17:25:36.213 INFO:teuthology.orchestra.run.smithi037.stdout:up {0=14470} 2024-04-25T17:25:36.213 INFO:teuthology.orchestra.run.smithi037.stdout:failed 2024-04-25T17:25:36.213 INFO:teuthology.orchestra.run.smithi037.stdout:damaged 2024-04-25T17:25:36.213 INFO:teuthology.orchestra.run.smithi037.stdout:stopped 2024-04-25T17:25:36.213 INFO:teuthology.orchestra.run.smithi037.stdout:data_pools [3] 2024-04-25T17:25:36.213 INFO:teuthology.orchestra.run.smithi037.stdout:metadata_pool 2 2024-04-25T17:25:36.213 INFO:teuthology.orchestra.run.smithi037.stdout:inline_data disabled 2024-04-25T17:25:36.214 INFO:teuthology.orchestra.run.smithi037.stdout:balancer 2024-04-25T17:25:36.214 INFO:teuthology.orchestra.run.smithi037.stdout:bal_rank_mask -1 2024-04-25T17:25:36.214 INFO:teuthology.orchestra.run.smithi037.stdout:standby_count_wanted 1 2024-04-25T17:25:36.214 INFO:teuthology.orchestra.run.smithi037.stdout:qdb_cluster leader: 0 members: 2024-04-25T17:25:36.214 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi037.ksmixc{0:14470} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.37:6826/1903989494,v1:172.21.15.37:6827/1903989494] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:25:36.214 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi037.ovkrpq{0:14482} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.37:6828/4206394422,v1:172.21.15.37:6829/4206394422] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:25:36.214 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:25:36.214 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:25:36.214 INFO:teuthology.orchestra.run.smithi037.stdout:Standby daemons: 2024-04-25T17:25:36.214 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:25:36.214 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi069.cpprst{-1:24289} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.69:6826/518856100,v1:172.21.15.69:6827/518856100] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:25:36.215 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi069.ytlqcf{-1:24293} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.69:6824/134210439,v1:172.21.15.69:6825/134210439] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:25:36.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.209+0000 7f8bb6d4b700 1 -- 172.21.15.37:0/2574634396 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f8b98076b90 msgr2=0x7f8b98079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:25:36.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.209+0000 7f8bb6d4b700 1 --2- 172.21.15.37:0/2574634396 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f8b98076b90 0x7f8b98079040 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8ba0004890 tx=0x7f8ba0009e30 comp rx=0 tx=0).stop 2024-04-25T17:25:36.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.209+0000 7f8bb6d4b700 1 -- 172.21.15.37:0/2574634396 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bb00ffee0 msgr2=0x7f8bb010df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:25:36.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.209+0000 7f8bb6d4b700 1 --2- 172.21.15.37:0/2574634396 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bb00ffee0 0x7f8bb010df20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8ba400eb40 tx=0x7f8ba400b040 comp rx=0 tx=0).stop 2024-04-25T17:25:36.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.209+0000 7f8bb6d4b700 1 -- 172.21.15.37:0/2574634396 shutdown_connections 2024-04-25T17:25:36.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.209+0000 7f8bb6d4b700 1 --2- 172.21.15.37:0/2574634396 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f8b98076b90 0x7f8b98079040 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:36.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.209+0000 7f8bb6d4b700 1 --2- 172.21.15.37:0/2574634396 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bb00662c0 0x7f8bb010d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:36.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.209+0000 7f8bb6d4b700 1 --2- 172.21.15.37:0/2574634396 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bb00ffee0 0x7f8bb010df20 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:36.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.209+0000 7f8bb6d4b700 1 -- 172.21.15.37:0/2574634396 >> 172.21.15.37:0/2574634396 conn(0x7f8bb00f7430 msgr2=0x7f8bb00f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:25:36.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.209+0000 7f8bb6d4b700 1 -- 172.21.15.37:0/2574634396 shutdown_connections 2024-04-25T17:25:36.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.209+0000 7f8bb6d4b700 1 -- 172.21.15.37:0/2574634396 wait complete. 2024-04-25T17:25:36.216 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 16 2024-04-25T17:25:36.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.315+0000 7fb5c75d7700 1 -- 172.21.15.37:0/3804482743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5c00fcf90 msgr2=0x7fb5c00fd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:25:36.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.315+0000 7fb5c75d7700 1 --2- 172.21.15.37:0/3804482743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5c00fcf90 0x7fb5c00fd400 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb5b4004940 tx=0x7fb5b4009e30 comp rx=0 tx=0).stop 2024-04-25T17:25:36.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.315+0000 7fb5c75d7700 1 -- 172.21.15.37:0/3804482743 shutdown_connections 2024-04-25T17:25:36.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.315+0000 7fb5c75d7700 1 --2- 172.21.15.37:0/3804482743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5c00fcf90 0x7fb5c00fd400 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:36.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.315+0000 7fb5c75d7700 1 --2- 172.21.15.37:0/3804482743 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5c00fbce0 0x7fb5c00fc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:36.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.315+0000 7fb5c75d7700 1 -- 172.21.15.37:0/3804482743 >> 172.21.15.37:0/3804482743 conn(0x7fb5c00f7440 msgr2=0x7fb5c00f9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:25:36.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.315+0000 7fb5c75d7700 1 -- 172.21.15.37:0/3804482743 shutdown_connections 2024-04-25T17:25:36.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.315+0000 7fb5c75d7700 1 -- 172.21.15.37:0/3804482743 wait complete. 2024-04-25T17:25:36.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.315+0000 7fb5c75d7700 1 Processor -- start 2024-04-25T17:25:36.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.316+0000 7fb5c75d7700 1 -- start start 2024-04-25T17:25:36.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.316+0000 7fb5c75d7700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5c00fbce0 0x7fb5c010da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:25:36.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.316+0000 7fb5c75d7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5c00fcf90 0x7fb5c010dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:25:36.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.316+0000 7fb5c75d7700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c010e640 con 0x7fb5c00fcf90 2024-04-25T17:25:36.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.316+0000 7fb5c75d7700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c010ede0 con 0x7fb5c00fbce0 2024-04-25T17:25:36.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.316+0000 7fb5c4b72700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5c00fcf90 0x7fb5c010dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:25:36.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.316+0000 7fb5c5373700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5c00fbce0 0x7fb5c010da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:25:36.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.316+0000 7fb5c4b72700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5c00fcf90 0x7fb5c010dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44130/0 (socket says 172.21.15.37:44130) 2024-04-25T17:25:36.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.316+0000 7fb5c4b72700 1 -- 172.21.15.37:0/1691223922 learned_addr learned my addr 172.21.15.37:0/1691223922 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:25:36.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.316+0000 7fb5c4b72700 1 -- 172.21.15.37:0/1691223922 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5c00fbce0 msgr2=0x7fb5c010da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:25:36.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.316+0000 7fb5c4b72700 1 --2- 172.21.15.37:0/1691223922 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5c00fbce0 0x7fb5c010da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:36.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.316+0000 7fb5c4b72700 1 -- 172.21.15.37:0/1691223922 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b4005040 con 0x7fb5c00fcf90 2024-04-25T17:25:36.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.316+0000 7fb5c4b72700 1 --2- 172.21.15.37:0/1691223922 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5c00fcf90 0x7fb5c010dfb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb5b4009150 tx=0x7fb5b4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:25:36.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.316+0000 7fb5bdffb700 1 -- 172.21.15.37:0/1691223922 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5b400e040 con 0x7fb5c00fcf90 2024-04-25T17:25:36.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.317+0000 7fb5bdffb700 1 -- 172.21.15.37:0/1691223922 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb5b400bbf0 con 0x7fb5c00fcf90 2024-04-25T17:25:36.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.317+0000 7fb5c75d7700 1 -- 172.21.15.37:0/1691223922 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5c010f060 con 0x7fb5c00fcf90 2024-04-25T17:25:36.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.317+0000 7fb5bdffb700 1 -- 172.21.15.37:0/1691223922 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5b401c630 con 0x7fb5c00fcf90 2024-04-25T17:25:36.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.317+0000 7fb5c75d7700 1 -- 172.21.15.37:0/1691223922 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5c010f620 con 0x7fb5c00fcf90 2024-04-25T17:25:36.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.318+0000 7fb5c75d7700 1 -- 172.21.15.37:0/1691223922 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5c0101b20 con 0x7fb5c00fcf90 2024-04-25T17:25:36.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.318+0000 7fb5bdffb700 1 -- 172.21.15.37:0/1691223922 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7fb5b400bd60 con 0x7fb5c00fcf90 2024-04-25T17:25:36.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.319+0000 7fb5bdffb700 1 --2- 172.21.15.37:0/1691223922 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fb5a8076b80 0x7fb5a8079030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:25:36.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.319+0000 7fb5bdffb700 1 -- 172.21.15.37:0/1691223922 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6324+0+0 (secure 0 0 0) 0x7fb5b40995e0 con 0x7fb5c00fcf90 2024-04-25T17:25:36.322 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.319+0000 7fb5c5373700 1 --2- 172.21.15.37:0/1691223922 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fb5a8076b80 0x7fb5a8079030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:25:36.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.319+0000 7fb5c5373700 1 --2- 172.21.15.37:0/1691223922 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fb5a8076b80 0x7fb5a8079030 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb5b0007580 tx=0x7fb5b0009780 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:25:36.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.324+0000 7fb5bdffb700 1 -- 172.21.15.37:0/1691223922 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fb5b40621c0 con 0x7fb5c00fcf90 2024-04-25T17:25:36.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.552+0000 7fb5c75d7700 1 -- 172.21.15.37:0/1691223922 --> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb5c010f890 con 0x7fb5a8076b80 2024-04-25T17:25:36.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.554+0000 7fb5bdffb700 1 -- 172.21.15.37:0/1691223922 <== mgr.34104 v2:172.21.15.37:6800/783197737 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fb5c010f890 con 0x7fb5a8076b80 2024-04-25T17:25:36.555 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-25T17:25:36.555 INFO:teuthology.orchestra.run.smithi037.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385", 2024-04-25T17:25:36.555 INFO:teuthology.orchestra.run.smithi037.stdout: "in_progress": true, 2024-04-25T17:25:36.556 INFO:teuthology.orchestra.run.smithi037.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-25T17:25:36.556 INFO:teuthology.orchestra.run.smithi037.stdout: "services_complete": [ 2024-04-25T17:25:36.556 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr", 2024-04-25T17:25:36.556 INFO:teuthology.orchestra.run.smithi037.stdout: "crash", 2024-04-25T17:25:36.556 INFO:teuthology.orchestra.run.smithi037.stdout: "mon", 2024-04-25T17:25:36.556 INFO:teuthology.orchestra.run.smithi037.stdout: "osd" 2024-04-25T17:25:36.556 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-04-25T17:25:36.556 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": "12/21 daemons upgraded", 2024-04-25T17:25:36.556 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "Currently upgrading osd daemons", 2024-04-25T17:25:36.556 INFO:teuthology.orchestra.run.smithi037.stdout: "is_paused": false 2024-04-25T17:25:36.556 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-25T17:25:36.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.556+0000 7fb5c75d7700 1 -- 172.21.15.37:0/1691223922 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fb5a8076b80 msgr2=0x7fb5a8079030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:25:36.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.556+0000 7fb5c75d7700 1 --2- 172.21.15.37:0/1691223922 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fb5a8076b80 0x7fb5a8079030 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb5b0007580 tx=0x7fb5b0009780 comp rx=0 tx=0).stop 2024-04-25T17:25:36.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.556+0000 7fb5c75d7700 1 -- 172.21.15.37:0/1691223922 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5c00fcf90 msgr2=0x7fb5c010dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:25:36.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.556+0000 7fb5c75d7700 1 --2- 172.21.15.37:0/1691223922 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5c00fcf90 0x7fb5c010dfb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb5b4009150 tx=0x7fb5b4009e30 comp rx=0 tx=0).stop 2024-04-25T17:25:36.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.556+0000 7fb5c75d7700 1 -- 172.21.15.37:0/1691223922 shutdown_connections 2024-04-25T17:25:36.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.556+0000 7fb5c75d7700 1 --2- 172.21.15.37:0/1691223922 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fb5a8076b80 0x7fb5a8079030 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:36.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.556+0000 7fb5c75d7700 1 --2- 172.21.15.37:0/1691223922 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5c00fbce0 0x7fb5c010da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:36.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.556+0000 7fb5c75d7700 1 --2- 172.21.15.37:0/1691223922 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb5c00fcf90 0x7fb5c010dfb0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:36.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.556+0000 7fb5c75d7700 1 -- 172.21.15.37:0/1691223922 >> 172.21.15.37:0/1691223922 conn(0x7fb5c00f7440 msgr2=0x7fb5c0066360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:25:36.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.556+0000 7fb5c75d7700 1 -- 172.21.15.37:0/1691223922 shutdown_connections 2024-04-25T17:25:36.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.556+0000 7fb5c75d7700 1 -- 172.21.15.37:0/1691223922 wait complete. 2024-04-25T17:25:36.620 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:25:36 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5[99370]: 2024-04-25T17:25:36.346+0000 7f68b2e717c0 -1 osd.5 74 log_to_monitors true 2024-04-25T17:25:36.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.660+0000 7f1f4e22b700 1 -- 172.21.15.37:0/3340699036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f480fdfd0 msgr2=0x7f1f480fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:25:36.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.660+0000 7f1f4e22b700 1 --2- 172.21.15.37:0/3340699036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f480fdfd0 0x7f1f480fe440 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c004940 tx=0x7f1f3c009e30 comp rx=0 tx=0).stop 2024-04-25T17:25:36.662 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.660+0000 7f1f4e22b700 1 -- 172.21.15.37:0/3340699036 shutdown_connections 2024-04-25T17:25:36.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.660+0000 7f1f4e22b700 1 --2- 172.21.15.37:0/3340699036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f480fdfd0 0x7f1f480fe440 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:36.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.660+0000 7f1f4e22b700 1 --2- 172.21.15.37:0/3340699036 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1f480fce60 0x7f1f480fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:36.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.660+0000 7f1f4e22b700 1 -- 172.21.15.37:0/3340699036 >> 172.21.15.37:0/3340699036 conn(0x7f1f480f8540 msgr2=0x7f1f480fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:25:36.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.660+0000 7f1f4e22b700 1 -- 172.21.15.37:0/3340699036 shutdown_connections 2024-04-25T17:25:36.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.660+0000 7f1f4e22b700 1 -- 172.21.15.37:0/3340699036 wait complete. 2024-04-25T17:25:36.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.661+0000 7f1f4e22b700 1 Processor -- start 2024-04-25T17:25:36.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.661+0000 7f1f4e22b700 1 -- start start 2024-04-25T17:25:36.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.661+0000 7f1f4e22b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f480fce60 0x7f1f4810d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:25:36.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.661+0000 7f1f477fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f480fce60 0x7f1f4810d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:25:36.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.661+0000 7f1f477fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f480fce60 0x7f1f4810d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44154/0 (socket says 172.21.15.37:44154) 2024-04-25T17:25:36.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.661+0000 7f1f4e22b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1f480fdfd0 0x7f1f4810de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:25:36.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.661+0000 7f1f477fe700 1 -- 172.21.15.37:0/2403758067 learned_addr learned my addr 172.21.15.37:0/2403758067 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:25:36.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.661+0000 7f1f4e22b700 1 -- 172.21.15.37:0/2403758067 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4810e400 con 0x7f1f480fce60 2024-04-25T17:25:36.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.661+0000 7f1f4e22b700 1 -- 172.21.15.37:0/2403758067 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4810e570 con 0x7f1f480fdfd0 2024-04-25T17:25:36.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.662+0000 7f1f477fe700 1 -- 172.21.15.37:0/2403758067 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1f480fdfd0 msgr2=0x7f1f4810de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:25:36.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.662+0000 7f1f46ffd700 1 --2- 172.21.15.37:0/2403758067 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1f480fdfd0 0x7f1f4810de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:25:36.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.662+0000 7f1f477fe700 1 --2- 172.21.15.37:0/2403758067 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1f480fdfd0 0x7f1f4810de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:36.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.662+0000 7f1f477fe700 1 -- 172.21.15.37:0/2403758067 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f3c005040 con 0x7f1f480fce60 2024-04-25T17:25:36.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.662+0000 7f1f46ffd700 1 --2- 172.21.15.37:0/2403758067 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1f480fdfd0 0x7f1f4810de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T17:25:36.665 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.662+0000 7f1f477fe700 1 --2- 172.21.15.37:0/2403758067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f480fce60 0x7f1f4810d8c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1f3800eb40 tx=0x7f1f3800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:25:36.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.662+0000 7f1f2ffff700 1 -- 172.21.15.37:0/2403758067 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f38007cc0 con 0x7f1f480fce60 2024-04-25T17:25:36.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.662+0000 7f1f4e22b700 1 -- 172.21.15.37:0/2403758067 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f48112f70 con 0x7f1f480fce60 2024-04-25T17:25:36.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.662+0000 7f1f2ffff700 1 -- 172.21.15.37:0/2403758067 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1f3800f040 con 0x7f1f480fce60 2024-04-25T17:25:36.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.662+0000 7f1f2ffff700 1 -- 172.21.15.37:0/2403758067 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f38009620 con 0x7f1f480fce60 2024-04-25T17:25:36.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.662+0000 7f1f4e22b700 1 -- 172.21.15.37:0/2403758067 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f48113420 con 0x7f1f480fce60 2024-04-25T17:25:36.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.663+0000 7f1f4e22b700 1 -- 172.21.15.37:0/2403758067 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f4804c710 con 0x7f1f480fce60 2024-04-25T17:25:36.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.664+0000 7f1f2ffff700 1 -- 172.21.15.37:0/2403758067 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f1f38009780 con 0x7f1f480fce60 2024-04-25T17:25:36.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.664+0000 7f1f2ffff700 1 --2- 172.21.15.37:0/2403758067 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f1f30076b90 0x7f1f30079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:25:36.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.665+0000 7f1f2ffff700 1 -- 172.21.15.37:0/2403758067 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6324+0+0 (secure 0 0 0) 0x7f1f38097f20 con 0x7f1f480fce60 2024-04-25T17:25:36.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.665+0000 7f1f46ffd700 1 --2- 172.21.15.37:0/2403758067 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f1f30076b90 0x7f1f30079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:25:36.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.665+0000 7f1f46ffd700 1 --2- 172.21.15.37:0/2403758067 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f1f30076b90 0x7f1f30079040 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c000c00 tx=0x7f1f3c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:25:36.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.670+0000 7f1f2ffff700 1 -- 172.21.15.37:0/2403758067 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f1f380ccff0 con 0x7f1f480fce60 2024-04-25T17:25:36.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.973+0000 7f1f4e22b700 1 -- 172.21.15.37:0/2403758067 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f1f481058c0 con 0x7f1f480fce60 2024-04-25T17:25:36.975 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.974+0000 7f1f2ffff700 1 -- 172.21.15.37:0/2403758067 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1178 (secure 0 0 0) 0x7f1f38060b50 con 0x7f1f480fce60 2024-04-25T17:25:36.976 INFO:teuthology.orchestra.run.smithi037.stdout:HEALTH_WARN 1 osds down; all OSDs are running squid or later but require_osd_release < squid; Degraded data redundancy: 35/228 objects degraded (15.351%), 12 pgs degraded 2024-04-25T17:25:36.976 INFO:teuthology.orchestra.run.smithi037.stdout:[WRN] OSD_DOWN: 1 osds down 2024-04-25T17:25:36.976 INFO:teuthology.orchestra.run.smithi037.stdout: osd.5 (root=default,host=smithi069) is down 2024-04-25T17:25:36.976 INFO:teuthology.orchestra.run.smithi037.stdout:[WRN] OSD_UPGRADE_FINISHED: all OSDs are running squid or later but require_osd_release < squid 2024-04-25T17:25:36.976 INFO:teuthology.orchestra.run.smithi037.stdout: all OSDs are running squid or later but require_osd_release < squid 2024-04-25T17:25:36.976 INFO:teuthology.orchestra.run.smithi037.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 35/228 objects degraded (15.351%), 12 pgs degraded 2024-04-25T17:25:36.976 INFO:teuthology.orchestra.run.smithi037.stdout: pg 2.2 is active+undersized+degraded, acting [1,0] 2024-04-25T17:25:36.976 INFO:teuthology.orchestra.run.smithi037.stdout: pg 2.3 is active+undersized+degraded, acting [2,1] 2024-04-25T17:25:36.976 INFO:teuthology.orchestra.run.smithi037.stdout: pg 2.8 is active+undersized+degraded, acting [3,0] 2024-04-25T17:25:36.976 INFO:teuthology.orchestra.run.smithi037.stdout: pg 2.b is active+undersized+degraded, acting [3,4] 2024-04-25T17:25:36.976 INFO:teuthology.orchestra.run.smithi037.stdout: pg 2.f is active+undersized+degraded, acting [4,0] 2024-04-25T17:25:36.976 INFO:teuthology.orchestra.run.smithi037.stdout: pg 2.14 is active+undersized+degraded, acting [3,4] 2024-04-25T17:25:36.976 INFO:teuthology.orchestra.run.smithi037.stdout: pg 2.16 is active+undersized+degraded, acting [3,2] 2024-04-25T17:25:36.976 INFO:teuthology.orchestra.run.smithi037.stdout: pg 2.18 is active+undersized+degraded, acting [4,3] 2024-04-25T17:25:36.977 INFO:teuthology.orchestra.run.smithi037.stdout: pg 2.1a is active+undersized+degraded, acting [3,4] 2024-04-25T17:25:36.977 INFO:teuthology.orchestra.run.smithi037.stdout: pg 2.1c is active+undersized+degraded, acting [4,2] 2024-04-25T17:25:36.977 INFO:teuthology.orchestra.run.smithi037.stdout: pg 2.1d is active+undersized+degraded, acting [3,0] 2024-04-25T17:25:36.977 INFO:teuthology.orchestra.run.smithi037.stdout: pg 2.1e is active+undersized+degraded, acting [2,0] 2024-04-25T17:25:36.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.976+0000 7f1f4e22b700 1 -- 172.21.15.37:0/2403758067 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f1f30076b90 msgr2=0x7f1f30079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:25:36.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.976+0000 7f1f4e22b700 1 --2- 172.21.15.37:0/2403758067 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f1f30076b90 0x7f1f30079040 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c000c00 tx=0x7f1f3c009e30 comp rx=0 tx=0).stop 2024-04-25T17:25:36.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.976+0000 7f1f4e22b700 1 -- 172.21.15.37:0/2403758067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f480fce60 msgr2=0x7f1f4810d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:25:36.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.976+0000 7f1f4e22b700 1 --2- 172.21.15.37:0/2403758067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f480fce60 0x7f1f4810d8c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1f3800eb40 tx=0x7f1f3800b040 comp rx=0 tx=0).stop 2024-04-25T17:25:36.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.976+0000 7f1f4e22b700 1 -- 172.21.15.37:0/2403758067 shutdown_connections 2024-04-25T17:25:36.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.976+0000 7f1f4e22b700 1 --2- 172.21.15.37:0/2403758067 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f1f30076b90 0x7f1f30079040 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:36.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.976+0000 7f1f4e22b700 1 --2- 172.21.15.37:0/2403758067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1f480fce60 0x7f1f4810d8c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:36.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.976+0000 7f1f4e22b700 1 --2- 172.21.15.37:0/2403758067 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1f480fdfd0 0x7f1f4810de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:25:36.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.976+0000 7f1f4e22b700 1 -- 172.21.15.37:0/2403758067 >> 172.21.15.37:0/2403758067 conn(0x7f1f480f8540 msgr2=0x7f1f480f9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:25:36.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.976+0000 7f1f4e22b700 1 -- 172.21.15.37:0/2403758067 shutdown_connections 2024-04-25T17:25:36.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:25:36.976+0000 7f1f4e22b700 1 -- 172.21.15.37:0/2403758067 wait complete. 2024-04-25T17:25:37.252 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:36 smithi069 ceph-mon[80239]: from='client.34386 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:25:37.252 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:36 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/2574634396' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T17:25:37.252 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:36 smithi069 ceph-mon[80239]: from='osd.5 [v2:172.21.15.69:6816/1114217891,v1:172.21.15.69:6817/1114217891]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-25T17:25:37.252 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:36 smithi069 ceph-mon[80239]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-25T17:25:37.252 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:36 smithi069 ceph-mon[80239]: Health check update: Degraded data redundancy: 35/228 objects degraded (15.351%), 12 pgs degraded (PG_DEGRADED) 2024-04-25T17:25:37.252 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:25:36 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5[99370]: 2024-04-25T17:25:36.962+0000 7f68a428b700 -1 osd.5 74 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T17:25:37.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:36 smithi037 ceph-mon[90844]: from='client.34386 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:25:37.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:36 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/2574634396' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T17:25:37.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:36 smithi037 ceph-mon[90844]: from='osd.5 [v2:172.21.15.69:6816/1114217891,v1:172.21.15.69:6817/1114217891]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-25T17:25:37.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:36 smithi037 ceph-mon[90844]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-04-25T17:25:37.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:36 smithi037 ceph-mon[90844]: Health check update: Degraded data redundancy: 35/228 objects degraded (15.351%), 12 pgs degraded (PG_DEGRADED) 2024-04-25T17:25:38.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:37 smithi069 ceph-mon[80239]: pgmap v162: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 208 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 614 B/s rd, 1 op/s; 35/228 objects degraded (15.351%) 2024-04-25T17:25:38.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:37 smithi069 ceph-mon[80239]: from='client.34398 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:25:38.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:37 smithi069 ceph-mon[80239]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-25T17:25:38.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:37 smithi069 ceph-mon[80239]: from='osd.5 [v2:172.21.15.69:6816/1114217891,v1:172.21.15.69:6817/1114217891]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2024-04-25T17:25:38.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:37 smithi069 ceph-mon[80239]: osdmap e77: 6 total, 5 up, 6 in 2024-04-25T17:25:38.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:37 smithi069 ceph-mon[80239]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2024-04-25T17:25:38.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:37 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/2403758067' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T17:25:38.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:37 smithi037 ceph-mon[90844]: pgmap v162: 65 pgs: 12 active+undersized+degraded, 16 active+undersized, 37 active+clean; 208 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 614 B/s rd, 1 op/s; 35/228 objects degraded (15.351%) 2024-04-25T17:25:38.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:37 smithi037 ceph-mon[90844]: from='client.34398 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:25:38.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:37 smithi037 ceph-mon[90844]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-04-25T17:25:38.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:37 smithi037 ceph-mon[90844]: from='osd.5 [v2:172.21.15.69:6816/1114217891,v1:172.21.15.69:6817/1114217891]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2024-04-25T17:25:38.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:37 smithi037 ceph-mon[90844]: osdmap e77: 6 total, 5 up, 6 in 2024-04-25T17:25:38.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:37 smithi037 ceph-mon[90844]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2024-04-25T17:25:38.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:37 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/2403758067' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T17:25:39.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:38 smithi037 ceph-mon[90844]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-25T17:25:39.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:38 smithi037 ceph-mon[90844]: osd.5 [v2:172.21.15.69:6816/1114217891,v1:172.21.15.69:6817/1114217891] boot 2024-04-25T17:25:39.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:38 smithi037 ceph-mon[90844]: osdmap e78: 6 total, 6 up, 6 in 2024-04-25T17:25:39.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:38 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T17:25:39.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:38 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:25:39.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:38 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:25:39.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:38 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:25:39.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:38 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:25:39.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:38 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:25:39.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:38 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:25:39.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:38 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:25:39.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:38 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:25:39.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:38 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:25:39.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:38 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:25:39.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:38 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:25:39.324 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:38 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-04-25T17:25:39.324 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:38 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-04-25T17:25:39.324 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:38 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-04-25T17:25:39.324 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:38 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-04-25T17:25:39.324 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:38 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-04-25T17:25:39.324 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:38 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-04-25T17:25:39.324 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:38 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-04-25T17:25:39.324 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:38 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-04-25T17:25:39.324 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:38 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-04-25T17:25:39.324 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:38 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-04-25T17:25:39.324 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:38 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-04-25T17:25:39.324 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:38 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-04-25T17:25:39.324 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:38 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-04-25T17:25:39.324 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:38 smithi037 ceph-mon[90844]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-04-25T17:25:39.325 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:38 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-04-25T17:25:39.325 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:38 smithi037 ceph-mon[90844]: osdmap e79: 6 total, 6 up, 6 in 2024-04-25T17:25:39.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:38 smithi069 ceph-mon[80239]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-04-25T17:25:39.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:38 smithi069 ceph-mon[80239]: osd.5 [v2:172.21.15.69:6816/1114217891,v1:172.21.15.69:6817/1114217891] boot 2024-04-25T17:25:39.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:38 smithi069 ceph-mon[80239]: osdmap e78: 6 total, 6 up, 6 in 2024-04-25T17:25:39.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:38 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-04-25T17:25:39.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:38 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:25:39.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:38 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:25:39.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:38 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:25:39.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:38 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:25:39.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:38 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:25:39.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:38 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:25:39.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:38 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:25:39.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:38 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:25:39.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:38 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:25:39.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:38 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:25:39.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:38 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:25:39.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:38 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-04-25T17:25:39.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:38 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-04-25T17:25:39.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:38 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-04-25T17:25:39.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:38 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-04-25T17:25:39.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:38 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-04-25T17:25:39.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:38 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-04-25T17:25:39.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:38 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-04-25T17:25:39.421 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:38 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-04-25T17:25:39.421 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:38 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-04-25T17:25:39.421 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:38 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-04-25T17:25:39.421 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:38 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-04-25T17:25:39.421 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:38 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-04-25T17:25:39.421 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:38 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-04-25T17:25:39.421 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:38 smithi069 ceph-mon[80239]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-04-25T17:25:39.421 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:38 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-04-25T17:25:39.421 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:38 smithi069 ceph-mon[80239]: osdmap e79: 6 total, 6 up, 6 in 2024-04-25T17:25:40.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:39 smithi037 ceph-mon[90844]: pgmap v165: 65 pgs: 2 peering, 12 active+undersized+degraded, 14 active+undersized, 37 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s; 35/228 objects degraded (15.351%) 2024-04-25T17:25:40.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:39 smithi037 ceph-mon[90844]: Upgrade: Setting container_image for all osd 2024-04-25T17:25:40.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:39 smithi037 ceph-mon[90844]: Upgrade: Setting require_osd_release to 19 squid 2024-04-25T17:25:40.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:39 smithi037 ceph-mon[90844]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-04-25T17:25:40.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:39 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:25:40.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:39 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-04-25T17:25:40.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:39 smithi069 ceph-mon[80239]: pgmap v165: 65 pgs: 2 peering, 12 active+undersized+degraded, 14 active+undersized, 37 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s; 35/228 objects degraded (15.351%) 2024-04-25T17:25:40.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:39 smithi069 ceph-mon[80239]: Upgrade: Setting container_image for all osd 2024-04-25T17:25:40.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:39 smithi069 ceph-mon[80239]: Upgrade: Setting require_osd_release to 19 squid 2024-04-25T17:25:40.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:39 smithi069 ceph-mon[80239]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-04-25T17:25:40.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:39 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:25:40.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:39 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-04-25T17:25:41.027 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:40 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-04-25T17:25:41.027 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:40 smithi037 ceph-mon[90844]: osdmap e80: 6 total, 6 up, 6 in 2024-04-25T17:25:41.028 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:40 smithi037 ceph-mon[90844]: fsmap cephfs:1 {0=cephfs.smithi037.ksmixc=up:active} 2 up:standby 2024-04-25T17:25:41.028 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:40 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:25:41.028 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:40 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:25:41.028 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:40 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:25:41.028 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:40 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:25:41.028 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:40 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:25:41.028 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:40 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:25:41.028 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:40 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:25:41.028 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:40 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:25:41.028 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:40 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:25:41.028 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:40 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi037.ksmixc"]}]: dispatch 2024-04-25T17:25:41.028 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:40 smithi037 ceph-mon[90844]: Upgrade: It appears safe to stop mds.cephfs.smithi037.ksmixc 2024-04-25T17:25:41.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:40 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-04-25T17:25:41.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:40 smithi069 ceph-mon[80239]: osdmap e80: 6 total, 6 up, 6 in 2024-04-25T17:25:41.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:40 smithi069 ceph-mon[80239]: fsmap cephfs:1 {0=cephfs.smithi037.ksmixc=up:active} 2 up:standby 2024-04-25T17:25:41.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:40 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:25:41.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:40 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:25:41.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:40 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:25:41.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:40 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:25:41.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:40 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:25:41.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:40 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:25:41.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:40 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:25:41.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:40 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:25:41.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:40 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:25:41.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:40 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi037.ksmixc"]}]: dispatch 2024-04-25T17:25:41.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:40 smithi069 ceph-mon[80239]: Upgrade: It appears safe to stop mds.cephfs.smithi037.ksmixc 2024-04-25T17:25:42.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:41 smithi037 ceph-mon[90844]: pgmap v168: 65 pgs: 4 peering, 9 active+undersized+degraded, 12 active+undersized, 40 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 29/228 objects degraded (12.719%) 2024-04-25T17:25:42.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:41 smithi037 ceph-mon[90844]: mds.? [v2:172.21.15.37:6828/2492925669,v1:172.21.15.37:6829/2492925669] up:boot 2024-04-25T17:25:42.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:42 smithi037 ceph-mon[90844]: fsmap cephfs:1 {0=cephfs.smithi037.ksmixc=up:active} 3 up:standby 2024-04-25T17:25:42.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:42 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi037.ovkrpq"}]: dispatch 2024-04-25T17:25:42.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:42 smithi037 ceph-mon[90844]: Health check update: Degraded data redundancy: 29/228 objects degraded (12.719%), 9 pgs degraded (PG_DEGRADED) 2024-04-25T17:25:42.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:42 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:25:42.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:42 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi037.ksmixc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T17:25:42.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:42 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:25:42.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:42 smithi069 ceph-mon[80239]: pgmap v168: 65 pgs: 4 peering, 9 active+undersized+degraded, 12 active+undersized, 40 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 29/228 objects degraded (12.719%) 2024-04-25T17:25:42.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:42 smithi069 ceph-mon[80239]: mds.? [v2:172.21.15.37:6828/2492925669,v1:172.21.15.37:6829/2492925669] up:boot 2024-04-25T17:25:42.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:42 smithi069 ceph-mon[80239]: fsmap cephfs:1 {0=cephfs.smithi037.ksmixc=up:active} 3 up:standby 2024-04-25T17:25:42.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:42 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi037.ovkrpq"}]: dispatch 2024-04-25T17:25:42.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:42 smithi069 ceph-mon[80239]: Health check update: Degraded data redundancy: 29/228 objects degraded (12.719%), 9 pgs degraded (PG_DEGRADED) 2024-04-25T17:25:42.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:42 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:25:42.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:42 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi037.ksmixc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T17:25:42.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:42 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:25:43.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:43 smithi037 ceph-mon[90844]: Upgrade: Updating mds.cephfs.smithi037.ksmixc 2024-04-25T17:25:43.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:43 smithi037 ceph-mon[90844]: Deploying daemon mds.cephfs.smithi037.ksmixc on smithi037 2024-04-25T17:25:43.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:43 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:25:43.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:43 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:25:43.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:43 smithi069 ceph-mon[80239]: Upgrade: Updating mds.cephfs.smithi037.ksmixc 2024-04-25T17:25:43.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:43 smithi069 ceph-mon[80239]: Deploying daemon mds.cephfs.smithi037.ksmixc on smithi037 2024-04-25T17:25:43.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:43 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:25:43.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:43 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:25:44.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:43 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-mon-smithi037[90840]: 2024-04-25T17:25:43.984+0000 7f5c53c75700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T17:25:44.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:44 smithi037 ceph-mon[90844]: pgmap v169: 65 pgs: 4 peering, 61 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 548 B/s rd, 1 op/s 2024-04-25T17:25:44.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:44 smithi037 ceph-mon[90844]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 29/228 objects degraded (12.719%), 9 pgs degraded) 2024-04-25T17:25:44.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:44 smithi037 ceph-mon[90844]: Cluster is now healthy 2024-04-25T17:25:44.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:44 smithi037 ceph-mon[90844]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-25T17:25:44.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:44 smithi037 ceph-mon[90844]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T17:25:44.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:44 smithi037 ceph-mon[90844]: osdmap e81: 6 total, 6 up, 6 in 2024-04-25T17:25:44.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:44 smithi037 ceph-mon[90844]: Standby daemon mds.cephfs.smithi069.cpprst assigned to filesystem cephfs as rank 0 2024-04-25T17:25:44.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:44 smithi037 ceph-mon[90844]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-25T17:25:44.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:44 smithi037 ceph-mon[90844]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-25T17:25:44.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:44 smithi037 ceph-mon[90844]: fsmap cephfs:1/1 {0=cephfs.smithi069.cpprst=up:replay} 2 up:standby 2024-04-25T17:25:44.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:44 smithi069 ceph-mon[80239]: pgmap v169: 65 pgs: 4 peering, 61 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 548 B/s rd, 1 op/s 2024-04-25T17:25:44.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:44 smithi069 ceph-mon[80239]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 29/228 objects degraded (12.719%), 9 pgs degraded) 2024-04-25T17:25:44.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:44 smithi069 ceph-mon[80239]: Cluster is now healthy 2024-04-25T17:25:44.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:44 smithi069 ceph-mon[80239]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-25T17:25:44.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:44 smithi069 ceph-mon[80239]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T17:25:44.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:44 smithi069 ceph-mon[80239]: osdmap e81: 6 total, 6 up, 6 in 2024-04-25T17:25:44.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:44 smithi069 ceph-mon[80239]: Standby daemon mds.cephfs.smithi069.cpprst assigned to filesystem cephfs as rank 0 2024-04-25T17:25:44.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:44 smithi069 ceph-mon[80239]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-25T17:25:44.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:44 smithi069 ceph-mon[80239]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-25T17:25:44.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:44 smithi069 ceph-mon[80239]: fsmap cephfs:1/1 {0=cephfs.smithi069.cpprst=up:replay} 2 up:standby 2024-04-25T17:25:46.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:46 smithi037 ceph-mon[90844]: pgmap v171: 65 pgs: 65 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 1 op/s 2024-04-25T17:25:46.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:46 smithi069 ceph-mon[80239]: pgmap v171: 65 pgs: 65 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 1 op/s 2024-04-25T17:25:48.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:48 smithi037 ceph-mon[90844]: pgmap v172: 65 pgs: 65 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 5.8 MiB/s rd, 3 op/s 2024-04-25T17:25:48.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:48 smithi069 ceph-mon[80239]: pgmap v172: 65 pgs: 65 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 5.8 MiB/s rd, 3 op/s 2024-04-25T17:25:50.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:50 smithi037 ceph-mon[90844]: pgmap v173: 65 pgs: 65 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 4 op/s 2024-04-25T17:25:50.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:50 smithi069 ceph-mon[80239]: pgmap v173: 65 pgs: 65 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 4 op/s 2024-04-25T17:25:52.211 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:52 smithi037 ceph-mon[90844]: pgmap v174: 65 pgs: 65 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4 op/s 2024-04-25T17:25:52.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:52 smithi069 ceph-mon[80239]: pgmap v174: 65 pgs: 65 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4 op/s 2024-04-25T17:25:54.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:53 smithi037 ceph-mon[90844]: pgmap v175: 65 pgs: 65 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-04-25T17:25:54.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:53 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:25:54.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:53 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:25:54.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:53 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:25:54.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:53 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:25:54.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:53 smithi069 ceph-mon[80239]: pgmap v175: 65 pgs: 65 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-04-25T17:25:54.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:53 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:25:54.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:53 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:25:54.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:53 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:25:54.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:53 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:25:54.724 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:54 smithi037 ceph-mon[90844]: reconnect by client.24331 192.168.0.1:0/3631080618 after 0.000999978 2024-04-25T17:25:54.724 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:54 smithi037 ceph-mon[90844]: reconnect by client.14538 192.168.0.1:0/2684522872 after 0.00199995 2024-04-25T17:25:54.724 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:54 smithi037 ceph-mon[90844]: mds.? [v2:172.21.15.69:6826/518856100,v1:172.21.15.69:6827/518856100] up:reconnect 2024-04-25T17:25:54.724 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:54 smithi037 ceph-mon[90844]: mds.? [v2:172.21.15.37:6826/2514248612,v1:172.21.15.37:6827/2514248612] up:boot 2024-04-25T17:25:54.724 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:54 smithi037 ceph-mon[90844]: fsmap cephfs:1/1 {0=cephfs.smithi069.cpprst=up:reconnect} 3 up:standby 2024-04-25T17:25:54.724 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:54 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi037.ksmixc"}]: dispatch 2024-04-25T17:25:55.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:54 smithi069 ceph-mon[80239]: reconnect by client.24331 192.168.0.1:0/3631080618 after 0.000999978 2024-04-25T17:25:55.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:54 smithi069 ceph-mon[80239]: reconnect by client.14538 192.168.0.1:0/2684522872 after 0.00199995 2024-04-25T17:25:55.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:54 smithi069 ceph-mon[80239]: mds.? [v2:172.21.15.69:6826/518856100,v1:172.21.15.69:6827/518856100] up:reconnect 2024-04-25T17:25:55.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:54 smithi069 ceph-mon[80239]: mds.? [v2:172.21.15.37:6826/2514248612,v1:172.21.15.37:6827/2514248612] up:boot 2024-04-25T17:25:55.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:54 smithi069 ceph-mon[80239]: fsmap cephfs:1/1 {0=cephfs.smithi069.cpprst=up:reconnect} 3 up:standby 2024-04-25T17:25:55.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:54 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi037.ksmixc"}]: dispatch 2024-04-25T17:25:55.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:55 smithi037 ceph-mon[90844]: pgmap v176: 65 pgs: 65 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-04-25T17:25:55.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:55 smithi037 ceph-mon[90844]: mds.? [v2:172.21.15.69:6826/518856100,v1:172.21.15.69:6827/518856100] up:rejoin 2024-04-25T17:25:55.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:55 smithi037 ceph-mon[90844]: fsmap cephfs:1/1 {0=cephfs.smithi069.cpprst=up:rejoin} 3 up:standby 2024-04-25T17:25:55.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:55 smithi037 ceph-mon[90844]: daemon mds.cephfs.smithi069.cpprst is now active in filesystem cephfs as rank 0 2024-04-25T17:25:56.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:55 smithi069 ceph-mon[80239]: pgmap v176: 65 pgs: 65 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-04-25T17:25:56.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:55 smithi069 ceph-mon[80239]: mds.? [v2:172.21.15.69:6826/518856100,v1:172.21.15.69:6827/518856100] up:rejoin 2024-04-25T17:25:56.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:55 smithi069 ceph-mon[80239]: fsmap cephfs:1/1 {0=cephfs.smithi069.cpprst=up:rejoin} 3 up:standby 2024-04-25T17:25:56.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:55 smithi069 ceph-mon[80239]: daemon mds.cephfs.smithi069.cpprst is now active in filesystem cephfs as rank 0 2024-04-25T17:25:56.978 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:56 smithi037 ceph-mon[90844]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-25T17:25:56.978 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:56 smithi037 ceph-mon[90844]: Cluster is now healthy 2024-04-25T17:25:56.978 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:56 smithi037 ceph-mon[90844]: mds.? [v2:172.21.15.69:6826/518856100,v1:172.21.15.69:6827/518856100] up:active 2024-04-25T17:25:56.978 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:56 smithi037 ceph-mon[90844]: fsmap cephfs:1 {0=cephfs.smithi069.cpprst=up:active} 3 up:standby 2024-04-25T17:25:57.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:56 smithi069 ceph-mon[80239]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-25T17:25:57.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:56 smithi069 ceph-mon[80239]: Cluster is now healthy 2024-04-25T17:25:57.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:56 smithi069 ceph-mon[80239]: mds.? [v2:172.21.15.69:6826/518856100,v1:172.21.15.69:6827/518856100] up:active 2024-04-25T17:25:57.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:56 smithi069 ceph-mon[80239]: fsmap cephfs:1 {0=cephfs.smithi069.cpprst=up:active} 3 up:standby 2024-04-25T17:25:57.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:57 smithi037 ceph-mon[90844]: pgmap v177: 65 pgs: 65 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 85 B/s wr, 5 op/s 2024-04-25T17:25:57.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:57 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:25:57.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:57 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:25:58.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:57 smithi069 ceph-mon[80239]: pgmap v177: 65 pgs: 65 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 85 B/s wr, 5 op/s 2024-04-25T17:25:58.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:57 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:25:58.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:57 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:26:00.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:59 smithi037 ceph-mon[90844]: pgmap v178: 65 pgs: 65 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-04-25T17:26:00.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:59 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:00.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:25:59 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:00.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:59 smithi069 ceph-mon[80239]: pgmap v178: 65 pgs: 65 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-04-25T17:26:00.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:59 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:00.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:25:59 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:01.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:01 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:01.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:01 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:01.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:01 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:01.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:01 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:02.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:02 smithi037 ceph-mon[90844]: pgmap v179: 65 pgs: 65 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 8.7 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-04-25T17:26:02.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:02 smithi069 ceph-mon[80239]: pgmap v179: 65 pgs: 65 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 8.7 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-04-25T17:26:04.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:04 smithi069 ceph-mon[80239]: pgmap v180: 65 pgs: 65 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 6.8 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-04-25T17:26:04.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:04 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:04.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:04 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:04.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:04 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:26:04.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:04 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:26:04.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:04 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:04.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:04 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:26:04.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:04 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:26:04.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:04 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:26:04.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:04 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:26:04.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:04 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:26:04.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:04 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi037.ovkrpq"]}]: dispatch 2024-04-25T17:26:04.434 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:04 smithi037 ceph-mon[90844]: pgmap v180: 65 pgs: 65 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 6.8 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-04-25T17:26:04.435 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:04 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:04.435 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:04 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:04.435 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:04 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:26:04.435 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:04 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:26:04.435 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:04 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:04.435 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:04 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:26:04.435 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:04 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:26:04.435 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:04 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:26:04.435 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:04 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:26:04.435 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:04 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:26:04.435 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:04 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi037.ovkrpq"]}]: dispatch 2024-04-25T17:26:05.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:05 smithi069 ceph-mon[80239]: Detected new or changed devices on smithi037 2024-04-25T17:26:05.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:05 smithi069 ceph-mon[80239]: Upgrade: It appears safe to stop mds.cephfs.smithi037.ovkrpq 2024-04-25T17:26:05.520 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:05 smithi037 ceph-mon[90844]: Detected new or changed devices on smithi037 2024-04-25T17:26:05.520 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:05 smithi037 ceph-mon[90844]: Upgrade: It appears safe to stop mds.cephfs.smithi037.ovkrpq 2024-04-25T17:26:06.406 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:06 smithi037 ceph-mon[90844]: pgmap v181: 65 pgs: 65 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.8 MiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-04-25T17:26:06.407 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:06 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:06.407 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:06 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi037.ovkrpq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T17:26:06.407 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:06 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:26:06.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:06 smithi069 ceph-mon[80239]: pgmap v181: 65 pgs: 65 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.8 MiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-04-25T17:26:06.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:06 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:06.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:06 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi037.ovkrpq", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T17:26:06.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:06 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:26:07.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.096+0000 7f238ea36700 1 -- 172.21.15.37:0/2328002308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23880fce60 msgr2=0x7f23880fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:26:07.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.096+0000 7f238ea36700 1 --2- 172.21.15.37:0/2328002308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23880fce60 0x7f23880fd270 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2378004940 tx=0x7f2378009e30 comp rx=0 tx=0).stop 2024-04-25T17:26:07.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.096+0000 7f238ea36700 1 -- 172.21.15.37:0/2328002308 shutdown_connections 2024-04-25T17:26:07.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.096+0000 7f238ea36700 1 --2- 172.21.15.37:0/2328002308 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f23880fdfd0 0x7f23880fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:07.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.096+0000 7f238ea36700 1 --2- 172.21.15.37:0/2328002308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23880fce60 0x7f23880fd270 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:07.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.096+0000 7f238ea36700 1 -- 172.21.15.37:0/2328002308 >> 172.21.15.37:0/2328002308 conn(0x7f23880f8540 msgr2=0x7f23880fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:26:07.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.096+0000 7f238ea36700 1 -- 172.21.15.37:0/2328002308 shutdown_connections 2024-04-25T17:26:07.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.096+0000 7f238ea36700 1 -- 172.21.15.37:0/2328002308 wait complete. 2024-04-25T17:26:07.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.097+0000 7f238ea36700 1 Processor -- start 2024-04-25T17:26:07.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.097+0000 7f238ea36700 1 -- start start 2024-04-25T17:26:07.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.098+0000 7f238ea36700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f23880fce60 0x7f238810d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:26:07.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.098+0000 7f238ea36700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23880fdfd0 0x7f238810de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:26:07.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.098+0000 7f238ea36700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f238810e400 con 0x7f23880fdfd0 2024-04-25T17:26:07.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.098+0000 7f238ea36700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f238810e570 con 0x7f23880fce60 2024-04-25T17:26:07.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.098+0000 7f23877fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23880fdfd0 0x7f238810de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:26:07.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.098+0000 7f23877fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23880fdfd0 0x7f238810de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50936/0 (socket says 172.21.15.37:50936) 2024-04-25T17:26:07.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.098+0000 7f23877fe700 1 -- 172.21.15.37:0/1493494209 learned_addr learned my addr 172.21.15.37:0/1493494209 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:26:07.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.098+0000 7f2387fff700 1 --2- 172.21.15.37:0/1493494209 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f23880fce60 0x7f238810d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:26:07.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.098+0000 7f23877fe700 1 -- 172.21.15.37:0/1493494209 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f23880fce60 msgr2=0x7f238810d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:26:07.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.098+0000 7f23877fe700 1 --2- 172.21.15.37:0/1493494209 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f23880fce60 0x7f238810d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:07.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.098+0000 7f23877fe700 1 -- 172.21.15.37:0/1493494209 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2378005040 con 0x7f23880fdfd0 2024-04-25T17:26:07.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.098+0000 7f2387fff700 1 --2- 172.21.15.37:0/1493494209 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f23880fce60 0x7f238810d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T17:26:07.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.098+0000 7f23877fe700 1 --2- 172.21.15.37:0/1493494209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23880fdfd0 0x7f238810de00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2370002a80 tx=0x7f23700046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:26:07.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.098+0000 7f2384ff9700 1 -- 172.21.15.37:0/1493494209 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2370007cc0 con 0x7f23880fdfd0 2024-04-25T17:26:07.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.099+0000 7f2384ff9700 1 -- 172.21.15.37:0/1493494209 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f237000f040 con 0x7f23880fdfd0 2024-04-25T17:26:07.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.099+0000 7f238ea36700 1 -- 172.21.15.37:0/1493494209 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2388112fd0 con 0x7f23880fdfd0 2024-04-25T17:26:07.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.099+0000 7f2384ff9700 1 -- 172.21.15.37:0/1493494209 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23700096f0 con 0x7f23880fdfd0 2024-04-25T17:26:07.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.099+0000 7f238ea36700 1 -- 172.21.15.37:0/1493494209 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2388113560 con 0x7f23880fdfd0 2024-04-25T17:26:07.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.100+0000 7f238ea36700 1 -- 172.21.15.37:0/1493494209 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f238804c710 con 0x7f23880fdfd0 2024-04-25T17:26:07.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.101+0000 7f2384ff9700 1 -- 172.21.15.37:0/1493494209 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f237000d690 con 0x7f23880fdfd0 2024-04-25T17:26:07.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.101+0000 7f2384ff9700 1 --2- 172.21.15.37:0/1493494209 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f2374076b90 0x7f2374079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:26:07.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.101+0000 7f2387fff700 1 --2- 172.21.15.37:0/1493494209 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f2374076b90 0x7f2374079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:26:07.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.101+0000 7f2384ff9700 1 -- 172.21.15.37:0/1493494209 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f2370097ae0 con 0x7f23880fdfd0 2024-04-25T17:26:07.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.102+0000 7f2387fff700 1 --2- 172.21.15.37:0/1493494209 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f2374076b90 0x7f2374079040 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f237800b3b0 tx=0x7f2378009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:26:07.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.107+0000 7f2384ff9700 1 -- 172.21.15.37:0/1493494209 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f2370060610 con 0x7f23880fdfd0 2024-04-25T17:26:07.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.346+0000 7f238ea36700 1 -- 172.21.15.37:0/1493494209 --> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f23881022a0 con 0x7f2374076b90 2024-04-25T17:26:07.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.347+0000 7f2384ff9700 1 -- 172.21.15.37:0/1493494209 <== mgr.34104 v2:172.21.15.37:6800/783197737 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f23881022a0 con 0x7f2374076b90 2024-04-25T17:26:07.348 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:07 smithi037 ceph-mon[90844]: Upgrade: Updating mds.cephfs.smithi037.ovkrpq 2024-04-25T17:26:07.348 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:07 smithi037 ceph-mon[90844]: Deploying daemon mds.cephfs.smithi037.ovkrpq on smithi037 2024-04-25T17:26:07.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.350+0000 7f238ea36700 1 -- 172.21.15.37:0/1493494209 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f2374076b90 msgr2=0x7f2374079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:26:07.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.350+0000 7f238ea36700 1 --2- 172.21.15.37:0/1493494209 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f2374076b90 0x7f2374079040 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f237800b3b0 tx=0x7f2378009e30 comp rx=0 tx=0).stop 2024-04-25T17:26:07.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.350+0000 7f238ea36700 1 -- 172.21.15.37:0/1493494209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23880fdfd0 msgr2=0x7f238810de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:26:07.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.350+0000 7f238ea36700 1 --2- 172.21.15.37:0/1493494209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23880fdfd0 0x7f238810de00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2370002a80 tx=0x7f23700046b0 comp rx=0 tx=0).stop 2024-04-25T17:26:07.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.350+0000 7f238ea36700 1 -- 172.21.15.37:0/1493494209 shutdown_connections 2024-04-25T17:26:07.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.350+0000 7f238ea36700 1 --2- 172.21.15.37:0/1493494209 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f2374076b90 0x7f2374079040 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:07.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.350+0000 7f238ea36700 1 --2- 172.21.15.37:0/1493494209 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f23880fce60 0x7f238810d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:07.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.350+0000 7f238ea36700 1 --2- 172.21.15.37:0/1493494209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23880fdfd0 0x7f238810de00 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:07.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.350+0000 7f238ea36700 1 -- 172.21.15.37:0/1493494209 >> 172.21.15.37:0/1493494209 conn(0x7f23880f8540 msgr2=0x7f23880f9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:26:07.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.350+0000 7f238ea36700 1 -- 172.21.15.37:0/1493494209 shutdown_connections 2024-04-25T17:26:07.351 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.350+0000 7f238ea36700 1 -- 172.21.15.37:0/1493494209 wait complete. 2024-04-25T17:26:07.361 INFO:teuthology.orchestra.run.smithi037.stdout:true 2024-04-25T17:26:07.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:07 smithi069 ceph-mon[80239]: Upgrade: Updating mds.cephfs.smithi037.ovkrpq 2024-04-25T17:26:07.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:07 smithi069 ceph-mon[80239]: Deploying daemon mds.cephfs.smithi037.ovkrpq on smithi037 2024-04-25T17:26:07.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.458+0000 7f6162476700 1 -- 172.21.15.37:0/4249871361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f615c070810 msgr2=0x7f615c070c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:26:07.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.458+0000 7f6162476700 1 --2- 172.21.15.37:0/4249871361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f615c070810 0x7f615c070c80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6150004940 tx=0x7f6150009e30 comp rx=0 tx=0).stop 2024-04-25T17:26:07.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.458+0000 7f6162476700 1 -- 172.21.15.37:0/4249871361 shutdown_connections 2024-04-25T17:26:07.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.458+0000 7f6162476700 1 --2- 172.21.15.37:0/4249871361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f615c070810 0x7f615c070c80 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:07.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.458+0000 7f6162476700 1 --2- 172.21.15.37:0/4249871361 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f615c071dc0 0x7f615c0702d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:07.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.458+0000 7f6162476700 1 -- 172.21.15.37:0/4249871361 >> 172.21.15.37:0/4249871361 conn(0x7f615c0f8560 msgr2=0x7f615c0fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:26:07.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.458+0000 7f6162476700 1 -- 172.21.15.37:0/4249871361 shutdown_connections 2024-04-25T17:26:07.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.458+0000 7f6162476700 1 -- 172.21.15.37:0/4249871361 wait complete. 2024-04-25T17:26:07.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.459+0000 7f6162476700 1 Processor -- start 2024-04-25T17:26:07.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.459+0000 7f6162476700 1 -- start start 2024-04-25T17:26:07.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.459+0000 7f6162476700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f615c070810 0x7f615c10fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:26:07.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.459+0000 7f6162476700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f615c071dc0 0x7f615c1101c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:26:07.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.459+0000 7f6162476700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615c110850 con 0x7f615c070810 2024-04-25T17:26:07.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.459+0000 7f6162476700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615c110ff0 con 0x7f615c071dc0 2024-04-25T17:26:07.462 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.460+0000 7f615bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f615c070810 0x7f615c10fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:26:07.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.460+0000 7f615bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f615c070810 0x7f615c10fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50944/0 (socket says 172.21.15.37:50944) 2024-04-25T17:26:07.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.460+0000 7f615bfff700 1 -- 172.21.15.37:0/3707871293 learned_addr learned my addr 172.21.15.37:0/3707871293 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:26:07.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.460+0000 7f615b7fe700 1 --2- 172.21.15.37:0/3707871293 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f615c071dc0 0x7f615c1101c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:26:07.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.460+0000 7f615bfff700 1 -- 172.21.15.37:0/3707871293 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f615c071dc0 msgr2=0x7f615c1101c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:26:07.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.460+0000 7f615bfff700 1 --2- 172.21.15.37:0/3707871293 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f615c071dc0 0x7f615c1101c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:07.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.460+0000 7f615bfff700 1 -- 172.21.15.37:0/3707871293 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6150005040 con 0x7f615c070810 2024-04-25T17:26:07.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.460+0000 7f615bfff700 1 --2- 172.21.15.37:0/3707871293 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f615c070810 0x7f615c10fc80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f614c00b790 tx=0x7f614c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:26:07.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.460+0000 7f6158ff9700 1 -- 172.21.15.37:0/3707871293 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f614c00f6f0 con 0x7f615c070810 2024-04-25T17:26:07.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.460+0000 7f6162476700 1 -- 172.21.15.37:0/3707871293 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f615c1112d0 con 0x7f615c070810 2024-04-25T17:26:07.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.460+0000 7f6158ff9700 1 -- 172.21.15.37:0/3707871293 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f614c00fd20 con 0x7f615c070810 2024-04-25T17:26:07.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.460+0000 7f6158ff9700 1 -- 172.21.15.37:0/3707871293 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f614c0103a0 con 0x7f615c070810 2024-04-25T17:26:07.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.460+0000 7f6162476700 1 -- 172.21.15.37:0/3707871293 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f615c111890 con 0x7f615c070810 2024-04-25T17:26:07.463 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.462+0000 7f6162476700 1 -- 172.21.15.37:0/3707871293 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f615c05f5c0 con 0x7f615c070810 2024-04-25T17:26:07.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.463+0000 7f6158ff9700 1 -- 172.21.15.37:0/3707871293 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f614c011400 con 0x7f615c070810 2024-04-25T17:26:07.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.463+0000 7f6158ff9700 1 --2- 172.21.15.37:0/3707871293 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f6144076b90 0x7f6144079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:26:07.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.463+0000 7f6158ff9700 1 -- 172.21.15.37:0/3707871293 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f614c098150 con 0x7f615c070810 2024-04-25T17:26:07.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.463+0000 7f615b7fe700 1 --2- 172.21.15.37:0/3707871293 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f6144076b90 0x7f6144079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:26:07.464 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.464+0000 7f615b7fe700 1 --2- 172.21.15.37:0/3707871293 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f6144076b90 0x7f6144079040 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f615000b3b0 tx=0x7f6150009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:26:07.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.468+0000 7f6158ff9700 1 -- 172.21.15.37:0/3707871293 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f614c060c80 con 0x7f615c070810 2024-04-25T17:26:07.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.710+0000 7f6162476700 1 -- 172.21.15.37:0/3707871293 --> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f615c111c70 con 0x7f6144076b90 2024-04-25T17:26:07.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.712+0000 7f6158ff9700 1 -- 172.21.15.37:0/3707871293 <== mgr.34104 v2:172.21.15.37:6800/783197737 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f615c111c70 con 0x7f6144076b90 2024-04-25T17:26:07.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.714+0000 7f6162476700 1 -- 172.21.15.37:0/3707871293 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f6144076b90 msgr2=0x7f6144079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:26:07.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.714+0000 7f6162476700 1 --2- 172.21.15.37:0/3707871293 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f6144076b90 0x7f6144079040 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f615000b3b0 tx=0x7f6150009e30 comp rx=0 tx=0).stop 2024-04-25T17:26:07.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.714+0000 7f6162476700 1 -- 172.21.15.37:0/3707871293 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f615c070810 msgr2=0x7f615c10fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:26:07.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.714+0000 7f6162476700 1 --2- 172.21.15.37:0/3707871293 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f615c070810 0x7f615c10fc80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f614c00b790 tx=0x7f614c009220 comp rx=0 tx=0).stop 2024-04-25T17:26:07.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.714+0000 7f6162476700 1 -- 172.21.15.37:0/3707871293 shutdown_connections 2024-04-25T17:26:07.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.714+0000 7f6162476700 1 --2- 172.21.15.37:0/3707871293 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f6144076b90 0x7f6144079040 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:07.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.714+0000 7f6162476700 1 --2- 172.21.15.37:0/3707871293 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f615c070810 0x7f615c10fc80 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:07.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.714+0000 7f6162476700 1 --2- 172.21.15.37:0/3707871293 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f615c071dc0 0x7f615c1101c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:07.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.714+0000 7f6162476700 1 -- 172.21.15.37:0/3707871293 >> 172.21.15.37:0/3707871293 conn(0x7f615c0f8560 msgr2=0x7f615c0f9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:26:07.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.714+0000 7f6162476700 1 -- 172.21.15.37:0/3707871293 shutdown_connections 2024-04-25T17:26:07.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.714+0000 7f6162476700 1 -- 172.21.15.37:0/3707871293 wait complete. 2024-04-25T17:26:07.821 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.820+0000 7f74fdf8c700 1 -- 172.21.15.37:0/685190028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74f80fdfd0 msgr2=0x7f74f80fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:26:07.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.820+0000 7f74fdf8c700 1 --2- 172.21.15.37:0/685190028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74f80fdfd0 0x7f74f80fe440 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f74ec004940 tx=0x7f74ec009e30 comp rx=0 tx=0).stop 2024-04-25T17:26:07.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.821+0000 7f74fdf8c700 1 -- 172.21.15.37:0/685190028 shutdown_connections 2024-04-25T17:26:07.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.821+0000 7f74fdf8c700 1 --2- 172.21.15.37:0/685190028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74f80fdfd0 0x7f74f80fe440 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:07.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.821+0000 7f74fdf8c700 1 --2- 172.21.15.37:0/685190028 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f74f80fce60 0x7f74f80fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:07.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.821+0000 7f74fdf8c700 1 -- 172.21.15.37:0/685190028 >> 172.21.15.37:0/685190028 conn(0x7f74f80f8540 msgr2=0x7f74f80fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:26:07.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.821+0000 7f74fdf8c700 1 -- 172.21.15.37:0/685190028 shutdown_connections 2024-04-25T17:26:07.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.821+0000 7f74fdf8c700 1 -- 172.21.15.37:0/685190028 wait complete. 2024-04-25T17:26:07.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.821+0000 7f74fdf8c700 1 Processor -- start 2024-04-25T17:26:07.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.821+0000 7f74fdf8c700 1 -- start start 2024-04-25T17:26:07.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.821+0000 7f74fdf8c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f74f80fce60 0x7f74f8071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:26:07.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.821+0000 7f74fdf8c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74f80fdfd0 0x7f74f80702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:26:07.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.821+0000 7f74fdf8c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f8072200 con 0x7f74f80fdfd0 2024-04-25T17:26:07.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.821+0000 7f74fdf8c700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f80707f0 con 0x7f74f80fce60 2024-04-25T17:26:07.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.822+0000 7f74f6ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74f80fdfd0 0x7f74f80702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:26:07.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.822+0000 7f74f6ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74f80fdfd0 0x7f74f80702b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50960/0 (socket says 172.21.15.37:50960) 2024-04-25T17:26:07.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.822+0000 7f74f6ffd700 1 -- 172.21.15.37:0/3072634299 learned_addr learned my addr 172.21.15.37:0/3072634299 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:26:07.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.822+0000 7f74f77fe700 1 --2- 172.21.15.37:0/3072634299 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f74f80fce60 0x7f74f8071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:26:07.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.822+0000 7f74f6ffd700 1 -- 172.21.15.37:0/3072634299 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f74f80fce60 msgr2=0x7f74f8071c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:26:07.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.822+0000 7f74f6ffd700 1 --2- 172.21.15.37:0/3072634299 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f74f80fce60 0x7f74f8071c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:07.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.822+0000 7f74f6ffd700 1 -- 172.21.15.37:0/3072634299 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74ec005040 con 0x7f74f80fdfd0 2024-04-25T17:26:07.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.822+0000 7f74f77fe700 1 --2- 172.21.15.37:0/3072634299 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f74f80fce60 0x7f74f8071c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T17:26:07.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.822+0000 7f74f6ffd700 1 --2- 172.21.15.37:0/3072634299 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74f80fdfd0 0x7f74f80702b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f74ec013870 tx=0x7f74ec009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:26:07.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.822+0000 7f74dffff700 1 -- 172.21.15.37:0/3072634299 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74ec021070 con 0x7f74f80fdfd0 2024-04-25T17:26:07.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.822+0000 7f74dffff700 1 -- 172.21.15.37:0/3072634299 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f74ec01c400 con 0x7f74f80fdfd0 2024-04-25T17:26:07.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.822+0000 7f74fdf8c700 1 -- 172.21.15.37:0/3072634299 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74f8070a40 con 0x7f74f80fdfd0 2024-04-25T17:26:07.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.822+0000 7f74dffff700 1 -- 172.21.15.37:0/3072634299 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74ec00e070 con 0x7f74f80fdfd0 2024-04-25T17:26:07.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.822+0000 7f74fdf8c700 1 -- 172.21.15.37:0/3072634299 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74f8070f80 con 0x7f74f80fdfd0 2024-04-25T17:26:07.825 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.823+0000 7f74fdf8c700 1 -- 172.21.15.37:0/3072634299 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74f804c710 con 0x7f74f80fdfd0 2024-04-25T17:26:07.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.824+0000 7f74dffff700 1 -- 172.21.15.37:0/3072634299 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f74ec01ca20 con 0x7f74f80fdfd0 2024-04-25T17:26:07.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.824+0000 7f74dffff700 1 --2- 172.21.15.37:0/3072634299 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f74e0076b90 0x7f74e0079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:26:07.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.825+0000 7f74dffff700 1 -- 172.21.15.37:0/3072634299 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f74ec099560 con 0x7f74f80fdfd0 2024-04-25T17:26:07.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.825+0000 7f74f77fe700 1 --2- 172.21.15.37:0/3072634299 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f74e0076b90 0x7f74e0079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:26:07.826 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.825+0000 7f74f77fe700 1 --2- 172.21.15.37:0/3072634299 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f74e0076b90 0x7f74e0079040 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f74e8004600 tx=0x7f74e800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:26:07.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:07.829+0000 7f74dffff700 1 -- 172.21.15.37:0/3072634299 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f74ec062110 con 0x7f74f80fdfd0 2024-04-25T17:26:08.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.052+0000 7f74fdf8c700 1 -- 172.21.15.37:0/3072634299 --> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f74f81022a0 con 0x7f74e0076b90 2024-04-25T17:26:08.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.062+0000 7f74dffff700 1 -- 172.21.15.37:0/3072634299 <== mgr.34104 v2:172.21.15.37:6800/783197737 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f74f81022a0 con 0x7f74e0076b90 2024-04-25T17:26:08.063 INFO:teuthology.orchestra.run.smithi037.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-25T17:26:08.063 INFO:teuthology.orchestra.run.smithi037.stdout:alertmanager.smithi037 smithi037 *:9093,9094 running (7m) 9s ago 15m 24.8M - 0.25.0 c8568f914cd2 18aed8f409ee 2024-04-25T17:26:08.063 INFO:teuthology.orchestra.run.smithi037.stdout:crash.smithi037 smithi037 running (4m) 9s ago 16m 6660k - 19.0.0-3291-g994e2f20 d53c96779a29 639584ea5855 2024-04-25T17:26:08.063 INFO:teuthology.orchestra.run.smithi037.stdout:crash.smithi069 smithi069 running (3m) 34s ago 15m 6665k - 19.0.0-3291-g994e2f20 d53c96779a29 ee5db16733a7 2024-04-25T17:26:08.063 INFO:teuthology.orchestra.run.smithi037.stdout:grafana.smithi037 smithi037 *:3000 running (7m) 9s ago 15m 85.6M - 9.4.7 954c08fa6188 1eff3ea3f9b0 2024-04-25T17:26:08.063 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi037.ksmixc smithi037 running (14s) 9s ago 10m 79.1M - 19.0.0-3291-g994e2f20 d53c96779a29 398075bc956a 2024-04-25T17:26:08.064 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi037.ovkrpq smithi037 running (10m) 9s ago 10m 10.5M - 17.2.7-902-gc61472c8 0de407c1b3af 73ca662174a7 2024-04-25T17:26:08.064 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi069.cpprst smithi069 running (10m) 34s ago 10m 16.3M - 17.2.7-902-gc61472c8 0de407c1b3af dbda101df20e 2024-04-25T17:26:08.064 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi069.ytlqcf smithi069 running (10m) 34s ago 10m 14.3M - 17.2.7-902-gc61472c8 0de407c1b3af 911df6b18215 2024-04-25T17:26:08.064 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.smithi037.txrgxl smithi037 *:8443,9283,8765 running (6m) 9s ago 17m 577M - 19.0.0-3291-g994e2f20 d53c96779a29 e9653fc62df9 2024-04-25T17:26:08.064 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.smithi069.mmuhdo smithi069 *:8443,9283,8765 running (5m) 34s ago 14m 520M - 19.0.0-3291-g994e2f20 d53c96779a29 6820207b4019 2024-04-25T17:26:08.064 INFO:teuthology.orchestra.run.smithi037.stdout:mon.smithi037 smithi037 running (5m) 9s ago 17m 114M 2048M 19.0.0-3291-g994e2f20 d53c96779a29 1b349f3af69d 2024-04-25T17:26:08.064 INFO:teuthology.orchestra.run.smithi037.stdout:mon.smithi069 smithi069 running (4m) 34s ago 14m 103M 2048M 19.0.0-3291-g994e2f20 d53c96779a29 7744dbe81b50 2024-04-25T17:26:08.064 INFO:teuthology.orchestra.run.smithi037.stdout:node-exporter.smithi037 smithi037 *:9100 running (7m) 9s ago 16m 14.4M - 1.5.0 0da6a335fe13 1e59bbb2aa82 2024-04-25T17:26:08.064 INFO:teuthology.orchestra.run.smithi037.stdout:node-exporter.smithi069 smithi069 *:9100 running (6m) 34s ago 14m 16.3M - 1.5.0 0da6a335fe13 0c51a9833fe4 2024-04-25T17:26:08.064 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0 smithi037 running (3m) 9s ago 14m 171M 1559M 19.0.0-3291-g994e2f20 d53c96779a29 e97538cb8b4f 2024-04-25T17:26:08.064 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1 smithi037 running (2m) 9s ago 13m 178M 1559M 19.0.0-3291-g994e2f20 d53c96779a29 6cf158192aae 2024-04-25T17:26:08.064 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2 smithi037 running (2m) 9s ago 13m 166M 1559M 19.0.0-3291-g994e2f20 d53c96779a29 a0b57bba2ebf 2024-04-25T17:26:08.064 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3 smithi069 running (104s) 34s ago 12m 179M 2581M 19.0.0-3291-g994e2f20 d53c96779a29 d1aa15d6b575 2024-04-25T17:26:08.065 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4 smithi069 running (71s) 34s ago 12m 170M 2581M 19.0.0-3291-g994e2f20 d53c96779a29 ad76a3d0fecb 2024-04-25T17:26:08.065 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5 smithi069 running (37s) 34s ago 11m 81.5M 2581M 19.0.0-3291-g994e2f20 d53c96779a29 dea8b059441b 2024-04-25T17:26:08.065 INFO:teuthology.orchestra.run.smithi037.stdout:prometheus.smithi037 smithi037 *:9095 running (5m) 9s ago 15m 62.7M - 2.43.0 a07b618ecd1d 2c5a268ffc1f 2024-04-25T17:26:08.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.064+0000 7f74fdf8c700 1 -- 172.21.15.37:0/3072634299 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f74e0076b90 msgr2=0x7f74e0079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:26:08.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.064+0000 7f74fdf8c700 1 --2- 172.21.15.37:0/3072634299 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f74e0076b90 0x7f74e0079040 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f74e8004600 tx=0x7f74e800b040 comp rx=0 tx=0).stop 2024-04-25T17:26:08.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.064+0000 7f74fdf8c700 1 -- 172.21.15.37:0/3072634299 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74f80fdfd0 msgr2=0x7f74f80702b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:26:08.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.064+0000 7f74fdf8c700 1 --2- 172.21.15.37:0/3072634299 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74f80fdfd0 0x7f74f80702b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f74ec013870 tx=0x7f74ec009e30 comp rx=0 tx=0).stop 2024-04-25T17:26:08.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.064+0000 7f74fdf8c700 1 -- 172.21.15.37:0/3072634299 shutdown_connections 2024-04-25T17:26:08.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.064+0000 7f74fdf8c700 1 --2- 172.21.15.37:0/3072634299 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f74e0076b90 0x7f74e0079040 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:08.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.064+0000 7f74fdf8c700 1 --2- 172.21.15.37:0/3072634299 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f74f80fce60 0x7f74f8071c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:08.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.064+0000 7f74fdf8c700 1 --2- 172.21.15.37:0/3072634299 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f74f80fdfd0 0x7f74f80702b0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:08.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.064+0000 7f74fdf8c700 1 -- 172.21.15.37:0/3072634299 >> 172.21.15.37:0/3072634299 conn(0x7f74f80f8540 msgr2=0x7f74f80f9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:26:08.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.064+0000 7f74fdf8c700 1 -- 172.21.15.37:0/3072634299 shutdown_connections 2024-04-25T17:26:08.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.064+0000 7f74fdf8c700 1 -- 172.21.15.37:0/3072634299 wait complete. 2024-04-25T17:26:08.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.170+0000 7f874ff63700 1 -- 172.21.15.37:0/3002251587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87480fcf60 msgr2=0x7f87480fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:26:08.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.170+0000 7f874ff63700 1 --2- 172.21.15.37:0/3002251587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87480fcf60 0x7f87480fd3d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f873c004940 tx=0x7f873c009e30 comp rx=0 tx=0).stop 2024-04-25T17:26:08.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.170+0000 7f874ff63700 1 -- 172.21.15.37:0/3002251587 shutdown_connections 2024-04-25T17:26:08.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.170+0000 7f874ff63700 1 --2- 172.21.15.37:0/3002251587 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87480fcf60 0x7f87480fd3d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:08.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.170+0000 7f874ff63700 1 --2- 172.21.15.37:0/3002251587 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f87480fbcb0 0x7f87480fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:08.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.170+0000 7f874ff63700 1 -- 172.21.15.37:0/3002251587 >> 172.21.15.37:0/3002251587 conn(0x7f87480f7430 msgr2=0x7f87480f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:26:08.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.170+0000 7f874ff63700 1 -- 172.21.15.37:0/3002251587 shutdown_connections 2024-04-25T17:26:08.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.170+0000 7f874ff63700 1 -- 172.21.15.37:0/3002251587 wait complete. 2024-04-25T17:26:08.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.170+0000 7f874ff63700 1 Processor -- start 2024-04-25T17:26:08.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.171+0000 7f874ff63700 1 -- start start 2024-04-25T17:26:08.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.171+0000 7f874ff63700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f87480fbcb0 0x7f87480ffd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:26:08.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.171+0000 7f874ff63700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87480fcf60 0x7f87480fe2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:26:08.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.171+0000 7f874ff63700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87480fe7e0 con 0x7f87480fcf60 2024-04-25T17:26:08.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.171+0000 7f874ff63700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87480fe920 con 0x7f87480fbcb0 2024-04-25T17:26:08.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.171+0000 7f874d4fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87480fcf60 0x7f87480fe2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:26:08.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.171+0000 7f874d4fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87480fcf60 0x7f87480fe2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50978/0 (socket says 172.21.15.37:50978) 2024-04-25T17:26:08.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.171+0000 7f874d4fe700 1 -- 172.21.15.37:0/321331445 learned_addr learned my addr 172.21.15.37:0/321331445 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:26:08.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.171+0000 7f874dcff700 1 --2- 172.21.15.37:0/321331445 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f87480fbcb0 0x7f87480ffd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:26:08.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.171+0000 7f874d4fe700 1 -- 172.21.15.37:0/321331445 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f87480fbcb0 msgr2=0x7f87480ffd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:26:08.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.171+0000 7f874d4fe700 1 --2- 172.21.15.37:0/321331445 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f87480fbcb0 0x7f87480ffd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:08.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.171+0000 7f874d4fe700 1 -- 172.21.15.37:0/321331445 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f873c005040 con 0x7f87480fcf60 2024-04-25T17:26:08.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.171+0000 7f874d4fe700 1 --2- 172.21.15.37:0/321331445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87480fcf60 0x7f87480fe2a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f873c00b3b0 tx=0x7f873c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:26:08.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.171+0000 7f873a7fc700 1 -- 172.21.15.37:0/321331445 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f873c00e040 con 0x7f87480fcf60 2024-04-25T17:26:08.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.172+0000 7f874ff63700 1 -- 172.21.15.37:0/321331445 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87480feba0 con 0x7f87480fcf60 2024-04-25T17:26:08.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.172+0000 7f873a7fc700 1 -- 172.21.15.37:0/321331445 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f873c00bbf0 con 0x7f87480fcf60 2024-04-25T17:26:08.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.172+0000 7f873a7fc700 1 -- 172.21.15.37:0/321331445 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f873c01c630 con 0x7f87480fcf60 2024-04-25T17:26:08.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.172+0000 7f874ff63700 1 -- 172.21.15.37:0/321331445 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8748115b30 con 0x7f87480fcf60 2024-04-25T17:26:08.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.173+0000 7f874ff63700 1 -- 172.21.15.37:0/321331445 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8748101af0 con 0x7f87480fcf60 2024-04-25T17:26:08.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.173+0000 7f873a7fc700 1 -- 172.21.15.37:0/321331445 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f873c00bd60 con 0x7f87480fcf60 2024-04-25T17:26:08.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.174+0000 7f873a7fc700 1 --2- 172.21.15.37:0/321331445 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f8734076b90 0x7f8734079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:26:08.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.174+0000 7f873a7fc700 1 -- 172.21.15.37:0/321331445 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f873c098f20 con 0x7f87480fcf60 2024-04-25T17:26:08.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.174+0000 7f874dcff700 1 --2- 172.21.15.37:0/321331445 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f8734076b90 0x7f8734079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:26:08.177 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.174+0000 7f874dcff700 1 --2- 172.21.15.37:0/321331445 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f8734076b90 0x7f8734079040 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f87480ffac0 tx=0x7f874400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:26:08.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.179+0000 7f873a7fc700 1 -- 172.21.15.37:0/321331445 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f873c061ad0 con 0x7f87480fcf60 2024-04-25T17:26:08.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:08 smithi037 ceph-mon[90844]: pgmap v182: 65 pgs: 65 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 3.2 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-04-25T17:26:08.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:08 smithi069 ceph-mon[80239]: pgmap v182: 65 pgs: 65 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 3.2 KiB/s rd, 4.3 KiB/s wr, 5 op/s 2024-04-25T17:26:08.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.478+0000 7f874ff63700 1 -- 172.21.15.37:0/321331445 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f87481048d0 con 0x7f87480fcf60 2024-04-25T17:26:08.479 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.479+0000 7f873a7fc700 1 -- 172.21.15.37:0/321331445 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+837 (secure 0 0 0) 0x7f873c061470 con 0x7f87480fcf60 2024-04-25T17:26:08.479 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-25T17:26:08.480 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": { 2024-04-25T17:26:08.480 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 2 2024-04-25T17:26:08.480 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:26:08.480 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": { 2024-04-25T17:26:08.480 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 2 2024-04-25T17:26:08.480 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:26:08.480 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": { 2024-04-25T17:26:08.480 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 6 2024-04-25T17:26:08.480 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:26:08.480 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": { 2024-04-25T17:26:08.480 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 2, 2024-04-25T17:26:08.480 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 1 2024-04-25T17:26:08.480 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:26:08.480 INFO:teuthology.orchestra.run.smithi037.stdout: "overall": { 2024-04-25T17:26:08.480 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 2, 2024-04-25T17:26:08.481 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 11 2024-04-25T17:26:08.481 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-04-25T17:26:08.481 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-25T17:26:08.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.481+0000 7f874ff63700 1 -- 172.21.15.37:0/321331445 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f8734076b90 msgr2=0x7f8734079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:26:08.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.481+0000 7f874ff63700 1 --2- 172.21.15.37:0/321331445 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f8734076b90 0x7f8734079040 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f87480ffac0 tx=0x7f874400b040 comp rx=0 tx=0).stop 2024-04-25T17:26:08.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.481+0000 7f874ff63700 1 -- 172.21.15.37:0/321331445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87480fcf60 msgr2=0x7f87480fe2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:26:08.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.481+0000 7f874ff63700 1 --2- 172.21.15.37:0/321331445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87480fcf60 0x7f87480fe2a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f873c00b3b0 tx=0x7f873c009e30 comp rx=0 tx=0).stop 2024-04-25T17:26:08.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.481+0000 7f874ff63700 1 -- 172.21.15.37:0/321331445 shutdown_connections 2024-04-25T17:26:08.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.481+0000 7f874ff63700 1 --2- 172.21.15.37:0/321331445 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f8734076b90 0x7f8734079040 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:08.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.481+0000 7f874ff63700 1 --2- 172.21.15.37:0/321331445 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f87480fbcb0 0x7f87480ffd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:08.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.481+0000 7f874ff63700 1 --2- 172.21.15.37:0/321331445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87480fcf60 0x7f87480fe2a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:08.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.481+0000 7f874ff63700 1 -- 172.21.15.37:0/321331445 >> 172.21.15.37:0/321331445 conn(0x7f87480f7430 msgr2=0x7f8748065c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:26:08.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.481+0000 7f874ff63700 1 -- 172.21.15.37:0/321331445 shutdown_connections 2024-04-25T17:26:08.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.481+0000 7f874ff63700 1 -- 172.21.15.37:0/321331445 wait complete. 2024-04-25T17:26:08.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.586+0000 7f9639d65700 1 -- 172.21.15.37:0/1102199612 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96340fdfd0 msgr2=0x7f96340fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:26:08.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.586+0000 7f9639d65700 1 --2- 172.21.15.37:0/1102199612 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96340fdfd0 0x7f96340fe440 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9628004940 tx=0x7f9628009e30 comp rx=0 tx=0).stop 2024-04-25T17:26:08.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.586+0000 7f9639d65700 1 -- 172.21.15.37:0/1102199612 shutdown_connections 2024-04-25T17:26:08.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.586+0000 7f9639d65700 1 --2- 172.21.15.37:0/1102199612 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96340fdfd0 0x7f96340fe440 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:08.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.586+0000 7f9639d65700 1 --2- 172.21.15.37:0/1102199612 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96340fce60 0x7f96340fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:08.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.586+0000 7f9639d65700 1 -- 172.21.15.37:0/1102199612 >> 172.21.15.37:0/1102199612 conn(0x7f96340f8540 msgr2=0x7f96340fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:26:08.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.586+0000 7f9639d65700 1 -- 172.21.15.37:0/1102199612 shutdown_connections 2024-04-25T17:26:08.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.586+0000 7f9639d65700 1 -- 172.21.15.37:0/1102199612 wait complete. 2024-04-25T17:26:08.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.587+0000 7f9639d65700 1 Processor -- start 2024-04-25T17:26:08.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.587+0000 7f9639d65700 1 -- start start 2024-04-25T17:26:08.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.587+0000 7f9639d65700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96340fce60 0x7f963410d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:26:08.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.587+0000 7f9639d65700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96340fdfd0 0x7f963410de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:26:08.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.587+0000 7f9639d65700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f963410e450 con 0x7f96340fdfd0 2024-04-25T17:26:08.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.587+0000 7f9639d65700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f963410e5c0 con 0x7f96340fce60 2024-04-25T17:26:08.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.587+0000 7f9632ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96340fdfd0 0x7f963410de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:26:08.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.587+0000 7f9632ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96340fdfd0 0x7f963410de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:50996/0 (socket says 172.21.15.37:50996) 2024-04-25T17:26:08.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.587+0000 7f9632ffd700 1 -- 172.21.15.37:0/1358571473 learned_addr learned my addr 172.21.15.37:0/1358571473 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:26:08.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.587+0000 7f96337fe700 1 --2- 172.21.15.37:0/1358571473 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96340fce60 0x7f963410d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:26:08.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.587+0000 7f9632ffd700 1 -- 172.21.15.37:0/1358571473 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96340fce60 msgr2=0x7f963410d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:26:08.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.587+0000 7f9632ffd700 1 --2- 172.21.15.37:0/1358571473 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96340fce60 0x7f963410d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:08.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.587+0000 7f9632ffd700 1 -- 172.21.15.37:0/1358571473 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9628005040 con 0x7f96340fdfd0 2024-04-25T17:26:08.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.588+0000 7f9632ffd700 1 --2- 172.21.15.37:0/1358571473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96340fdfd0 0x7f963410de50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f962800b3b0 tx=0x7f9628009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:26:08.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.588+0000 7f961bfff700 1 -- 172.21.15.37:0/1358571473 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f962800e040 con 0x7f96340fdfd0 2024-04-25T17:26:08.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.588+0000 7f961bfff700 1 -- 172.21.15.37:0/1358571473 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f962800bbf0 con 0x7f96340fdfd0 2024-04-25T17:26:08.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.588+0000 7f9639d65700 1 -- 172.21.15.37:0/1358571473 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9634112fc0 con 0x7f96340fdfd0 2024-04-25T17:26:08.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.588+0000 7f961bfff700 1 -- 172.21.15.37:0/1358571473 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f962801c630 con 0x7f96340fdfd0 2024-04-25T17:26:08.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.588+0000 7f9639d65700 1 -- 172.21.15.37:0/1358571473 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9634113550 con 0x7f96340fdfd0 2024-04-25T17:26:08.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.589+0000 7f9639d65700 1 -- 172.21.15.37:0/1358571473 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f963404c710 con 0x7f96340fdfd0 2024-04-25T17:26:08.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.589+0000 7f961bfff700 1 -- 172.21.15.37:0/1358571473 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f962800bd60 con 0x7f96340fdfd0 2024-04-25T17:26:08.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.590+0000 7f961bfff700 1 --2- 172.21.15.37:0/1358571473 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f961c076b90 0x7f961c079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:26:08.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.590+0000 7f961bfff700 1 -- 172.21.15.37:0/1358571473 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f9628098f20 con 0x7f96340fdfd0 2024-04-25T17:26:08.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.590+0000 7f96337fe700 1 --2- 172.21.15.37:0/1358571473 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f961c076b90 0x7f961c079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:26:08.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.590+0000 7f96337fe700 1 --2- 172.21.15.37:0/1358571473 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f961c076b90 0x7f961c079040 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9624004f40 tx=0x7f962400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:26:08.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.595+0000 7f961bfff700 1 -- 172.21.15.37:0/1358571473 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f9628061ad0 con 0x7f96340fdfd0 2024-04-25T17:26:08.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.852+0000 7f9639d65700 1 -- 172.21.15.37:0/1358571473 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9634113a00 con 0x7f96340fdfd0 2024-04-25T17:26:08.853 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.852+0000 7f961bfff700 1 -- 172.21.15.37:0/1358571473 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) v1 ==== 76+0+1710 (secure 0 0 0) 0x7f9628061470 con 0x7f96340fdfd0 2024-04-25T17:26:08.853 INFO:teuthology.orchestra.run.smithi037.stdout:e24 2024-04-25T17:26:08.853 INFO:teuthology.orchestra.run.smithi037.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-25T17:26:08.853 INFO:teuthology.orchestra.run.smithi037.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T17:26:08.853 INFO:teuthology.orchestra.run.smithi037.stdout:legacy client fscid: 1 2024-04-25T17:26:08.853 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:26:08.854 INFO:teuthology.orchestra.run.smithi037.stdout:Filesystem 'cephfs' (1) 2024-04-25T17:26:08.854 INFO:teuthology.orchestra.run.smithi037.stdout:fs_name cephfs 2024-04-25T17:26:08.854 INFO:teuthology.orchestra.run.smithi037.stdout:epoch 23 2024-04-25T17:26:08.854 INFO:teuthology.orchestra.run.smithi037.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-25T17:26:08.854 INFO:teuthology.orchestra.run.smithi037.stdout:created 2024-04-25T17:15:40.586130+0000 2024-04-25T17:26:08.854 INFO:teuthology.orchestra.run.smithi037.stdout:modified 2024-04-25T17:25:55.686969+0000 2024-04-25T17:26:08.854 INFO:teuthology.orchestra.run.smithi037.stdout:tableserver 0 2024-04-25T17:26:08.854 INFO:teuthology.orchestra.run.smithi037.stdout:root 0 2024-04-25T17:26:08.854 INFO:teuthology.orchestra.run.smithi037.stdout:session_timeout 60 2024-04-25T17:26:08.854 INFO:teuthology.orchestra.run.smithi037.stdout:session_autoclose 300 2024-04-25T17:26:08.854 INFO:teuthology.orchestra.run.smithi037.stdout:max_file_size 1099511627776 2024-04-25T17:26:08.854 INFO:teuthology.orchestra.run.smithi037.stdout:max_xattr_size 65536 2024-04-25T17:26:08.855 INFO:teuthology.orchestra.run.smithi037.stdout:required_client_features {} 2024-04-25T17:26:08.855 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure 0 2024-04-25T17:26:08.855 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure_osd_epoch 81 2024-04-25T17:26:08.855 INFO:teuthology.orchestra.run.smithi037.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T17:26:08.855 INFO:teuthology.orchestra.run.smithi037.stdout:max_mds 1 2024-04-25T17:26:08.855 INFO:teuthology.orchestra.run.smithi037.stdout:in 0 2024-04-25T17:26:08.855 INFO:teuthology.orchestra.run.smithi037.stdout:up {0=24289} 2024-04-25T17:26:08.855 INFO:teuthology.orchestra.run.smithi037.stdout:failed 2024-04-25T17:26:08.855 INFO:teuthology.orchestra.run.smithi037.stdout:damaged 2024-04-25T17:26:08.855 INFO:teuthology.orchestra.run.smithi037.stdout:stopped 2024-04-25T17:26:08.855 INFO:teuthology.orchestra.run.smithi037.stdout:data_pools [3] 2024-04-25T17:26:08.855 INFO:teuthology.orchestra.run.smithi037.stdout:metadata_pool 2 2024-04-25T17:26:08.855 INFO:teuthology.orchestra.run.smithi037.stdout:inline_data disabled 2024-04-25T17:26:08.855 INFO:teuthology.orchestra.run.smithi037.stdout:balancer 2024-04-25T17:26:08.856 INFO:teuthology.orchestra.run.smithi037.stdout:bal_rank_mask -1 2024-04-25T17:26:08.856 INFO:teuthology.orchestra.run.smithi037.stdout:standby_count_wanted 1 2024-04-25T17:26:08.856 INFO:teuthology.orchestra.run.smithi037.stdout:qdb_cluster leader: 24289 members: 24289 2024-04-25T17:26:08.856 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi069.cpprst{0:24289} state up:active seq 154 join_fscid=1 addr [v2:172.21.15.69:6826/518856100,v1:172.21.15.69:6827/518856100] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:26:08.856 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:26:08.856 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:26:08.856 INFO:teuthology.orchestra.run.smithi037.stdout:Standby daemons: 2024-04-25T17:26:08.856 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:26:08.856 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi069.ytlqcf{-1:24293} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.69:6824/134210439,v1:172.21.15.69:6825/134210439] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:26:08.856 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi037.ksmixc{-1:34412} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.37:6826/2514248612,v1:172.21.15.37:6827/2514248612] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T17:26:08.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.854+0000 7f9639d65700 1 -- 172.21.15.37:0/1358571473 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f961c076b90 msgr2=0x7f961c079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:26:08.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.854+0000 7f9639d65700 1 --2- 172.21.15.37:0/1358571473 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f961c076b90 0x7f961c079040 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9624004f40 tx=0x7f962400b040 comp rx=0 tx=0).stop 2024-04-25T17:26:08.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.854+0000 7f9639d65700 1 -- 172.21.15.37:0/1358571473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96340fdfd0 msgr2=0x7f963410de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:26:08.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.854+0000 7f9639d65700 1 --2- 172.21.15.37:0/1358571473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96340fdfd0 0x7f963410de50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f962800b3b0 tx=0x7f9628009e30 comp rx=0 tx=0).stop 2024-04-25T17:26:08.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.854+0000 7f9639d65700 1 -- 172.21.15.37:0/1358571473 shutdown_connections 2024-04-25T17:26:08.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.854+0000 7f9639d65700 1 --2- 172.21.15.37:0/1358571473 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f961c076b90 0x7f961c079040 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:08.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.854+0000 7f9639d65700 1 --2- 172.21.15.37:0/1358571473 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96340fce60 0x7f963410d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:08.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.854+0000 7f9639d65700 1 --2- 172.21.15.37:0/1358571473 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96340fdfd0 0x7f963410de50 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:08.857 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.854+0000 7f9639d65700 1 -- 172.21.15.37:0/1358571473 >> 172.21.15.37:0/1358571473 conn(0x7f96340f8540 msgr2=0x7f96340f9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:26:08.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.854+0000 7f9639d65700 1 -- 172.21.15.37:0/1358571473 shutdown_connections 2024-04-25T17:26:08.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.855+0000 7f9639d65700 1 -- 172.21.15.37:0/1358571473 wait complete. 2024-04-25T17:26:08.858 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 24 2024-04-25T17:26:08.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.960+0000 7ff339275700 1 -- 172.21.15.37:0/3749477638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3340fcf70 msgr2=0x7ff3340fd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:26:08.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.960+0000 7ff339275700 1 --2- 172.21.15.37:0/3749477638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3340fcf70 0x7ff3340fd3e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff328004940 tx=0x7ff328009e30 comp rx=0 tx=0).stop 2024-04-25T17:26:08.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.960+0000 7ff339275700 1 -- 172.21.15.37:0/3749477638 shutdown_connections 2024-04-25T17:26:08.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.960+0000 7ff339275700 1 --2- 172.21.15.37:0/3749477638 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3340fcf70 0x7ff3340fd3e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:08.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.960+0000 7ff339275700 1 --2- 172.21.15.37:0/3749477638 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff3340fbcc0 0x7ff3340fc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:08.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.960+0000 7ff339275700 1 -- 172.21.15.37:0/3749477638 >> 172.21.15.37:0/3749477638 conn(0x7ff3340f7440 msgr2=0x7ff3340f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:26:08.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.960+0000 7ff339275700 1 -- 172.21.15.37:0/3749477638 shutdown_connections 2024-04-25T17:26:08.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.960+0000 7ff339275700 1 -- 172.21.15.37:0/3749477638 wait complete. 2024-04-25T17:26:08.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.960+0000 7ff339275700 1 Processor -- start 2024-04-25T17:26:08.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.960+0000 7ff339275700 1 -- start start 2024-04-25T17:26:08.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.961+0000 7ff339275700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff3340fbcc0 0x7ff33410d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:26:08.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.961+0000 7ff339275700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3340fcf70 0x7ff33410df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:26:08.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.961+0000 7ff339275700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff33410e500 con 0x7ff3340fcf70 2024-04-25T17:26:08.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.961+0000 7ff339275700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff33410e670 con 0x7ff3340fbcc0 2024-04-25T17:26:08.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.961+0000 7ff3327fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3340fcf70 0x7ff33410df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:26:08.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.961+0000 7ff3327fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3340fcf70 0x7ff33410df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51018/0 (socket says 172.21.15.37:51018) 2024-04-25T17:26:08.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.961+0000 7ff3327fc700 1 -- 172.21.15.37:0/981928736 learned_addr learned my addr 172.21.15.37:0/981928736 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:26:08.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.961+0000 7ff332ffd700 1 --2- 172.21.15.37:0/981928736 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff3340fbcc0 0x7ff33410d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:26:08.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.961+0000 7ff3327fc700 1 -- 172.21.15.37:0/981928736 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff3340fbcc0 msgr2=0x7ff33410d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:26:08.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.961+0000 7ff3327fc700 1 --2- 172.21.15.37:0/981928736 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff3340fbcc0 0x7ff33410d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:08.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.961+0000 7ff3327fc700 1 -- 172.21.15.37:0/981928736 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff328005040 con 0x7ff3340fcf70 2024-04-25T17:26:08.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.961+0000 7ff3327fc700 1 --2- 172.21.15.37:0/981928736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3340fcf70 0x7ff33410df00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff32800b3b0 tx=0x7ff328009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:26:08.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.961+0000 7ff31b7fe700 1 -- 172.21.15.37:0/981928736 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff32800e040 con 0x7ff3340fcf70 2024-04-25T17:26:08.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.961+0000 7ff31b7fe700 1 -- 172.21.15.37:0/981928736 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff32800bbf0 con 0x7ff3340fcf70 2024-04-25T17:26:08.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.961+0000 7ff339275700 1 -- 172.21.15.37:0/981928736 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff334112fd0 con 0x7ff3340fcf70 2024-04-25T17:26:08.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.961+0000 7ff31b7fe700 1 -- 172.21.15.37:0/981928736 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff32801c630 con 0x7ff3340fcf70 2024-04-25T17:26:08.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.961+0000 7ff339275700 1 -- 172.21.15.37:0/981928736 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff334113560 con 0x7ff3340fcf70 2024-04-25T17:26:08.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.962+0000 7ff339275700 1 -- 172.21.15.37:0/981928736 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff334101b00 con 0x7ff3340fcf70 2024-04-25T17:26:08.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.963+0000 7ff31b7fe700 1 -- 172.21.15.37:0/981928736 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7ff32800bd60 con 0x7ff3340fcf70 2024-04-25T17:26:08.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.963+0000 7ff31b7fe700 1 --2- 172.21.15.37:0/981928736 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7ff31c076b90 0x7ff31c079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:26:08.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.964+0000 7ff31b7fe700 1 -- 172.21.15.37:0/981928736 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6410+0+0 (secure 0 0 0) 0x7ff328098f20 con 0x7ff3340fcf70 2024-04-25T17:26:08.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.964+0000 7ff332ffd700 1 --2- 172.21.15.37:0/981928736 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7ff31c076b90 0x7ff31c079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:26:08.966 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.964+0000 7ff332ffd700 1 --2- 172.21.15.37:0/981928736 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7ff31c076b90 0x7ff31c079040 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff324004550 tx=0x7ff324007ed0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:26:08.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:08.968+0000 7ff31b7fe700 1 -- 172.21.15.37:0/981928736 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7ff328061ad0 con 0x7ff3340fcf70 2024-04-25T17:26:09.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:09.197+0000 7ff339275700 1 -- 172.21.15.37:0/981928736 --> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff33402b400 con 0x7ff31c076b90 2024-04-25T17:26:09.199 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:09.199+0000 7ff31b7fe700 1 -- 172.21.15.37:0/981928736 <== mgr.34104 v2:172.21.15.37:6800/783197737 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7ff33402b400 con 0x7ff31c076b90 2024-04-25T17:26:09.200 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-25T17:26:09.200 INFO:teuthology.orchestra.run.smithi037.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385", 2024-04-25T17:26:09.200 INFO:teuthology.orchestra.run.smithi037.stdout: "in_progress": true, 2024-04-25T17:26:09.200 INFO:teuthology.orchestra.run.smithi037.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-25T17:26:09.200 INFO:teuthology.orchestra.run.smithi037.stdout: "services_complete": [ 2024-04-25T17:26:09.200 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr", 2024-04-25T17:26:09.200 INFO:teuthology.orchestra.run.smithi037.stdout: "crash", 2024-04-25T17:26:09.200 INFO:teuthology.orchestra.run.smithi037.stdout: "mon", 2024-04-25T17:26:09.200 INFO:teuthology.orchestra.run.smithi037.stdout: "osd" 2024-04-25T17:26:09.200 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-04-25T17:26:09.200 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": "13/21 daemons upgraded", 2024-04-25T17:26:09.200 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "Currently upgrading mds daemons", 2024-04-25T17:26:09.200 INFO:teuthology.orchestra.run.smithi037.stdout: "is_paused": false 2024-04-25T17:26:09.200 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-25T17:26:09.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:09.201+0000 7ff339275700 1 -- 172.21.15.37:0/981928736 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7ff31c076b90 msgr2=0x7ff31c079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:26:09.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:09.201+0000 7ff339275700 1 --2- 172.21.15.37:0/981928736 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7ff31c076b90 0x7ff31c079040 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff324004550 tx=0x7ff324007ed0 comp rx=0 tx=0).stop 2024-04-25T17:26:09.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:09.201+0000 7ff339275700 1 -- 172.21.15.37:0/981928736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3340fcf70 msgr2=0x7ff33410df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:26:09.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:09.201+0000 7ff339275700 1 --2- 172.21.15.37:0/981928736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3340fcf70 0x7ff33410df00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff32800b3b0 tx=0x7ff328009e30 comp rx=0 tx=0).stop 2024-04-25T17:26:09.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:09.201+0000 7ff339275700 1 -- 172.21.15.37:0/981928736 shutdown_connections 2024-04-25T17:26:09.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:09.201+0000 7ff339275700 1 --2- 172.21.15.37:0/981928736 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7ff31c076b90 0x7ff31c079040 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:09.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:09.201+0000 7ff339275700 1 --2- 172.21.15.37:0/981928736 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff3340fbcc0 0x7ff33410d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:09.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:09.201+0000 7ff339275700 1 --2- 172.21.15.37:0/981928736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3340fcf70 0x7ff33410df00 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:09.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:09.201+0000 7ff339275700 1 -- 172.21.15.37:0/981928736 >> 172.21.15.37:0/981928736 conn(0x7ff3340f7440 msgr2=0x7ff334066820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:26:09.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:09.201+0000 7ff339275700 1 -- 172.21.15.37:0/981928736 shutdown_connections 2024-04-25T17:26:09.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:09.201+0000 7ff339275700 1 -- 172.21.15.37:0/981928736 wait complete. 2024-04-25T17:26:09.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:09.305+0000 7fbe0f7f5700 1 -- 172.21.15.37:0/2930231400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe080fce60 msgr2=0x7fbe080fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:26:09.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:09.305+0000 7fbe0f7f5700 1 --2- 172.21.15.37:0/2930231400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe080fce60 0x7fbe080fd270 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8004940 tx=0x7fbdf8009e30 comp rx=0 tx=0).stop 2024-04-25T17:26:09.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:09.305+0000 7fbe0f7f5700 1 -- 172.21.15.37:0/2930231400 shutdown_connections 2024-04-25T17:26:09.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:09.305+0000 7fbe0f7f5700 1 --2- 172.21.15.37:0/2930231400 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe080fdfd0 0x7fbe080fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:09.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:09.305+0000 7fbe0f7f5700 1 --2- 172.21.15.37:0/2930231400 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe080fce60 0x7fbe080fd270 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:09.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:09.305+0000 7fbe0f7f5700 1 -- 172.21.15.37:0/2930231400 >> 172.21.15.37:0/2930231400 conn(0x7fbe080f8560 msgr2=0x7fbe080fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:26:09.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:09.305+0000 7fbe0f7f5700 1 -- 172.21.15.37:0/2930231400 shutdown_connections 2024-04-25T17:26:09.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:09.305+0000 7fbe0f7f5700 1 -- 172.21.15.37:0/2930231400 wait complete. 2024-04-25T17:26:09.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:09.306+0000 7fbe0f7f5700 1 Processor -- start 2024-04-25T17:26:09.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:09.306+0000 7fbe0f7f5700 1 -- start start 2024-04-25T17:26:09.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:09.306+0000 7fbe0f7f5700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe080fce60 0x7fbe0810d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:26:09.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:09.306+0000 7fbe0f7f5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe080fdfd0 0x7fbe0810df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:26:09.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:09.306+0000 7fbe0f7f5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0810e5b0 con 0x7fbe080fdfd0 2024-04-25T17:26:09.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:09.306+0000 7fbe0f7f5700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0810eda0 con 0x7fbe080fce60 2024-04-25T17:26:09.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:09.306+0000 7fbe0cd90700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe080fdfd0 0x7fbe0810df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:26:09.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:09.306+0000 7fbe0cd90700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe080fdfd0 0x7fbe0810df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51024/0 (socket says 172.21.15.37:51024) 2024-04-25T17:26:09.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:09.306+0000 7fbe0cd90700 1 -- 172.21.15.37:0/2224233474 learned_addr learned my addr 172.21.15.37:0/2224233474 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:26:09.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:09.306+0000 7fbe0d591700 1 --2- 172.21.15.37:0/2224233474 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe080fce60 0x7fbe0810d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:26:09.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:09.306+0000 7fbe0cd90700 1 -- 172.21.15.37:0/2224233474 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe080fce60 msgr2=0x7fbe0810d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:26:09.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:09.306+0000 7fbe0cd90700 1 --2- 172.21.15.37:0/2224233474 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe080fce60 0x7fbe0810d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:09.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:09.306+0000 7fbe0cd90700 1 -- 172.21.15.37:0/2224233474 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf8005040 con 0x7fbe080fdfd0 2024-04-25T17:26:09.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:09.306+0000 7fbe0cd90700 1 --2- 172.21.15.37:0/2224233474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe080fdfd0 0x7fbe0810df20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fbe0400b790 tx=0x7fbe04009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:26:09.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:09.307+0000 7fbdfdffb700 1 -- 172.21.15.37:0/2224233474 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe0400f6f0 con 0x7fbe080fdfd0 2024-04-25T17:26:09.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:09.307+0000 7fbdfdffb700 1 -- 172.21.15.37:0/2224233474 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbe0400fd20 con 0x7fbe080fdfd0 2024-04-25T17:26:09.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:09.307+0000 7fbe0f7f5700 1 -- 172.21.15.37:0/2224233474 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe0810f080 con 0x7fbe080fdfd0 2024-04-25T17:26:09.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:09.307+0000 7fbdfdffb700 1 -- 172.21.15.37:0/2224233474 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe040103a0 con 0x7fbe080fdfd0 2024-04-25T17:26:09.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:09.307+0000 7fbe0f7f5700 1 -- 172.21.15.37:0/2224233474 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe0810f640 con 0x7fbe080fdfd0 2024-04-25T17:26:09.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:09.308+0000 7fbe0f7f5700 1 -- 172.21.15.37:0/2224233474 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe0805f5c0 con 0x7fbe080fdfd0 2024-04-25T17:26:09.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:09.308+0000 7fbdfdffb700 1 -- 172.21.15.37:0/2224233474 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7fbe04011400 con 0x7fbe080fdfd0 2024-04-25T17:26:09.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:09.309+0000 7fbdfdffb700 1 --2- 172.21.15.37:0/2224233474 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fbdf4076b80 0x7fbdf4079030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:26:09.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:09.309+0000 7fbdfdffb700 1 -- 172.21.15.37:0/2224233474 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fbe04098130 con 0x7fbe080fdfd0 2024-04-25T17:26:09.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:09.309+0000 7fbe0d591700 1 --2- 172.21.15.37:0/2224233474 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fbdf4076b80 0x7fbdf4079030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:26:09.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:09.310+0000 7fbe0d591700 1 --2- 172.21.15.37:0/2224233474 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fbdf4076b80 0x7fbdf4079030 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8009fd0 tx=0x7fbdf8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:26:09.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:09.314+0000 7fbdfdffb700 1 -- 172.21.15.37:0/2224233474 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fbe04060ce0 con 0x7fbe080fdfd0 2024-04-25T17:26:09.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:09 smithi069 ceph-mon[80239]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:26:09.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:09 smithi069 ceph-mon[80239]: from='client.34420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:26:09.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:09 smithi069 ceph-mon[80239]: from='client.34424 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:26:09.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:09 smithi069 ceph-mon[80239]: osdmap e82: 6 total, 6 up, 6 in 2024-04-25T17:26:09.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:09 smithi069 ceph-mon[80239]: fsmap cephfs:1 {0=cephfs.smithi069.cpprst=up:active} 2 up:standby 2024-04-25T17:26:09.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:09 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/321331445' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:26:09.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:09 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/1358571473' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T17:26:09.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:09 smithi037 ceph-mon[90844]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:26:09.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:09 smithi037 ceph-mon[90844]: from='client.34420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:26:09.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:09 smithi037 ceph-mon[90844]: from='client.34424 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:26:09.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:09 smithi037 ceph-mon[90844]: osdmap e82: 6 total, 6 up, 6 in 2024-04-25T17:26:09.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:09 smithi037 ceph-mon[90844]: fsmap cephfs:1 {0=cephfs.smithi069.cpprst=up:active} 2 up:standby 2024-04-25T17:26:09.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:09 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/321331445' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:26:09.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:09 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/1358571473' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T17:26:09.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:09.610+0000 7fbe0f7f5700 1 -- 172.21.15.37:0/2224233474 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fbe0804bed0 con 0x7fbe080fdfd0 2024-04-25T17:26:09.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:09.611+0000 7fbdfdffb700 1 -- 172.21.15.37:0/2224233474 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fbe04060680 con 0x7fbe080fdfd0 2024-04-25T17:26:09.612 INFO:teuthology.orchestra.run.smithi037.stdout:HEALTH_OK 2024-04-25T17:26:09.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:09.613+0000 7fbe0f7f5700 1 -- 172.21.15.37:0/2224233474 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fbdf4076b80 msgr2=0x7fbdf4079030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:26:09.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:09.613+0000 7fbe0f7f5700 1 --2- 172.21.15.37:0/2224233474 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fbdf4076b80 0x7fbdf4079030 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8009fd0 tx=0x7fbdf8009e30 comp rx=0 tx=0).stop 2024-04-25T17:26:09.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:09.613+0000 7fbe0f7f5700 1 -- 172.21.15.37:0/2224233474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe080fdfd0 msgr2=0x7fbe0810df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:26:09.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:09.613+0000 7fbe0f7f5700 1 --2- 172.21.15.37:0/2224233474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe080fdfd0 0x7fbe0810df20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fbe0400b790 tx=0x7fbe04009250 comp rx=0 tx=0).stop 2024-04-25T17:26:09.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:09.613+0000 7fbe0f7f5700 1 -- 172.21.15.37:0/2224233474 shutdown_connections 2024-04-25T17:26:09.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:09.613+0000 7fbe0f7f5700 1 --2- 172.21.15.37:0/2224233474 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fbdf4076b80 0x7fbdf4079030 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:09.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:09.613+0000 7fbe0f7f5700 1 --2- 172.21.15.37:0/2224233474 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe080fce60 0x7fbe0810d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:09.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:09.613+0000 7fbe0f7f5700 1 --2- 172.21.15.37:0/2224233474 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbe080fdfd0 0x7fbe0810df20 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:09.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:09.613+0000 7fbe0f7f5700 1 -- 172.21.15.37:0/2224233474 >> 172.21.15.37:0/2224233474 conn(0x7fbe080f8560 msgr2=0x7fbe080f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:26:09.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:09.613+0000 7fbe0f7f5700 1 -- 172.21.15.37:0/2224233474 shutdown_connections 2024-04-25T17:26:09.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:09.613+0000 7fbe0f7f5700 1 -- 172.21.15.37:0/2224233474 wait complete. 2024-04-25T17:26:10.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:10 smithi069 ceph-mon[80239]: pgmap v184: 65 pgs: 65 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 3.6 KiB/s rd, 3 op/s 2024-04-25T17:26:10.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:10 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/2224233474' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T17:26:10.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:10 smithi037 ceph-mon[90844]: pgmap v184: 65 pgs: 65 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 3.6 KiB/s rd, 3 op/s 2024-04-25T17:26:10.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:10 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/2224233474' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T17:26:11.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:11 smithi069 ceph-mon[80239]: from='client.34436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:26:11.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:11 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi037.ovkrpq"}]: dispatch 2024-04-25T17:26:11.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:11 smithi037 ceph-mon[90844]: from='client.34436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:26:11.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:11 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi037.ovkrpq"}]: dispatch 2024-04-25T17:26:12.383 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:12 smithi037 ceph-mon[90844]: pgmap v185: 65 pgs: 65 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-04-25T17:26:12.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:12 smithi069 ceph-mon[80239]: pgmap v185: 65 pgs: 65 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 1 op/s 2024-04-25T17:26:13.311 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:13 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:26:13.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:13 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:26:14.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:14 smithi069 ceph-mon[80239]: pgmap v186: 65 pgs: 65 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-04-25T17:26:14.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:14 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:14.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:14 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:14.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:14 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:26:14.425 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:14 smithi037 ceph-mon[90844]: pgmap v186: 65 pgs: 65 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-04-25T17:26:14.425 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:14 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:14.425 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:14 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:14.425 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:14 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:26:15.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:15 smithi069 ceph-mon[80239]: mds.? [v2:172.21.15.37:6828/2067664560,v1:172.21.15.37:6829/2067664560] up:boot 2024-04-25T17:26:15.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:15 smithi069 ceph-mon[80239]: fsmap cephfs:1 {0=cephfs.smithi069.cpprst=up:active} 3 up:standby 2024-04-25T17:26:15.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:15 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi037.ovkrpq"}]: dispatch 2024-04-25T17:26:15.430 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:15 smithi037 ceph-mon[90844]: mds.? [v2:172.21.15.37:6828/2067664560,v1:172.21.15.37:6829/2067664560] up:boot 2024-04-25T17:26:15.430 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:15 smithi037 ceph-mon[90844]: fsmap cephfs:1 {0=cephfs.smithi069.cpprst=up:active} 3 up:standby 2024-04-25T17:26:15.430 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:15 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi037.ovkrpq"}]: dispatch 2024-04-25T17:26:16.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:16 smithi037 ceph-mon[90844]: pgmap v187: 65 pgs: 65 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-04-25T17:26:16.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:16 smithi069 ceph-mon[80239]: pgmap v187: 65 pgs: 65 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-04-25T17:26:18.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:18 smithi069 ceph-mon[80239]: pgmap v188: 65 pgs: 65 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-04-25T17:26:18.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:18 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:18.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:18 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:18.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:18 smithi037 ceph-mon[90844]: pgmap v188: 65 pgs: 65 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-04-25T17:26:18.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:18 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:18.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:18 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:20.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:20 smithi069 ceph-mon[80239]: pgmap v189: 65 pgs: 65 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-04-25T17:26:20.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:20 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:20.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:20 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:20.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:20 smithi037 ceph-mon[90844]: pgmap v189: 65 pgs: 65 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-04-25T17:26:20.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:20 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:20.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:20 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:22.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:22 smithi069 ceph-mon[80239]: pgmap v190: 65 pgs: 65 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-04-25T17:26:22.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:22 smithi037 ceph-mon[90844]: pgmap v190: 65 pgs: 65 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-04-25T17:26:23.667 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:23 smithi069 ceph-mon[80239]: pgmap v191: 65 pgs: 65 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-04-25T17:26:23.667 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:23 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:23.667 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:23 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:23.667 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:23 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:26:23.667 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:23 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:26:23.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:23 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:23.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:23 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:26:23.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:23 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:26:23.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:23 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:26:23.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:23 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:26:23.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:23 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:26:23.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:23 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi069.ytlqcf"]}]: dispatch 2024-04-25T17:26:23.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:23 smithi069 ceph-mon[80239]: Upgrade: It appears safe to stop mds.cephfs.smithi069.ytlqcf 2024-04-25T17:26:24.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:23 smithi037 ceph-mon[90844]: pgmap v191: 65 pgs: 65 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-04-25T17:26:24.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:23 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:24.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:23 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:24.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:23 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:26:24.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:23 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:26:24.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:23 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:24.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:23 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:26:24.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:23 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:26:24.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:23 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:26:24.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:23 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:26:24.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:23 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:26:24.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:23 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi069.ytlqcf"]}]: dispatch 2024-04-25T17:26:24.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:23 smithi037 ceph-mon[90844]: Upgrade: It appears safe to stop mds.cephfs.smithi069.ytlqcf 2024-04-25T17:26:25.877 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:25 smithi069 ceph-mon[80239]: pgmap v192: 65 pgs: 65 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-04-25T17:26:25.878 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:25 smithi069 ceph-mon[80239]: Upgrade: Updating mds.cephfs.smithi069.ytlqcf 2024-04-25T17:26:25.878 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:25 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:25.878 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:25 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi069.ytlqcf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T17:26:25.878 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:25 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:26:25.878 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:25 smithi069 ceph-mon[80239]: Deploying daemon mds.cephfs.smithi069.ytlqcf on smithi069 2024-04-25T17:26:26.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:25 smithi037 ceph-mon[90844]: pgmap v192: 65 pgs: 65 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-04-25T17:26:26.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:25 smithi037 ceph-mon[90844]: Upgrade: Updating mds.cephfs.smithi069.ytlqcf 2024-04-25T17:26:26.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:25 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:26.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:25 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi069.ytlqcf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T17:26:26.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:25 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:26:26.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:25 smithi037 ceph-mon[90844]: Deploying daemon mds.cephfs.smithi069.ytlqcf on smithi069 2024-04-25T17:26:27.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:27 smithi069 ceph-mon[80239]: pgmap v193: 65 pgs: 65 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-04-25T17:26:27.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:27 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:26:28.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:27 smithi037 ceph-mon[90844]: pgmap v193: 65 pgs: 65 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-04-25T17:26:28.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:27 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:26:28.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:28 smithi069 ceph-mon[80239]: osdmap e83: 6 total, 6 up, 6 in 2024-04-25T17:26:28.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:28 smithi069 ceph-mon[80239]: fsmap cephfs:1 {0=cephfs.smithi069.cpprst=up:active} 2 up:standby 2024-04-25T17:26:28.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:28 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi069.ytlqcf"}]: dispatch 2024-04-25T17:26:29.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:28 smithi037 ceph-mon[90844]: osdmap e83: 6 total, 6 up, 6 in 2024-04-25T17:26:29.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:28 smithi037 ceph-mon[90844]: fsmap cephfs:1 {0=cephfs.smithi069.cpprst=up:active} 2 up:standby 2024-04-25T17:26:29.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:28 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi069.ytlqcf"}]: dispatch 2024-04-25T17:26:29.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:29 smithi069 ceph-mon[80239]: pgmap v195: 65 pgs: 65 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-04-25T17:26:30.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:29 smithi037 ceph-mon[90844]: pgmap v195: 65 pgs: 65 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-04-25T17:26:31.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:31 smithi069 ceph-mon[80239]: pgmap v196: 65 pgs: 65 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-04-25T17:26:32.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:31 smithi037 ceph-mon[90844]: pgmap v196: 65 pgs: 65 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-04-25T17:26:33.474 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:33 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:33.474 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:33 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:33.474 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:33 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:26:33.474 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:33 smithi069 ceph-mon[80239]: pgmap v197: 65 pgs: 65 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-04-25T17:26:33.474 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:33 smithi069 ceph-mon[80239]: mds.? [v2:172.21.15.69:6824/3424891497,v1:172.21.15.69:6825/3424891497] up:boot 2024-04-25T17:26:33.475 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:33 smithi069 ceph-mon[80239]: fsmap cephfs:1 {0=cephfs.smithi069.cpprst=up:active} 3 up:standby 2024-04-25T17:26:33.475 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:33 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi069.ytlqcf"}]: dispatch 2024-04-25T17:26:33.709 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:33 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:33.709 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:33 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:33.709 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:33 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:26:33.709 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:33 smithi037 ceph-mon[90844]: pgmap v197: 65 pgs: 65 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-04-25T17:26:33.709 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:33 smithi037 ceph-mon[90844]: mds.? [v2:172.21.15.69:6824/3424891497,v1:172.21.15.69:6825/3424891497] up:boot 2024-04-25T17:26:33.709 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:33 smithi037 ceph-mon[90844]: fsmap cephfs:1 {0=cephfs.smithi069.cpprst=up:active} 3 up:standby 2024-04-25T17:26:33.709 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:33 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi069.ytlqcf"}]: dispatch 2024-04-25T17:26:35.920 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:35 smithi069 ceph-mon[80239]: pgmap v198: 65 pgs: 65 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-04-25T17:26:35.920 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:35 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:35.920 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:35 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:36.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:35 smithi037 ceph-mon[90844]: pgmap v198: 65 pgs: 65 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-04-25T17:26:36.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:35 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:36.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:35 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:37.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:37 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:37.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:37 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:37.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:37 smithi069 ceph-mon[80239]: pgmap v199: 65 pgs: 65 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-04-25T17:26:37.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:37 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:37.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:37 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:37.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:37 smithi037 ceph-mon[90844]: pgmap v199: 65 pgs: 65 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-04-25T17:26:39.720 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:39 smithi069 ceph-mon[80239]: pgmap v200: 65 pgs: 65 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-04-25T17:26:39.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:39.733+0000 7f6d56e86700 1 -- 172.21.15.37:0/3416178414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d500fce60 msgr2=0x7f6d500fd270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:26:39.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:39.733+0000 7f6d56e86700 1 --2- 172.21.15.37:0/3416178414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d500fce60 0x7f6d500fd270 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6d38004940 tx=0x7f6d38009e30 comp rx=0 tx=0).stop 2024-04-25T17:26:39.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:39.733+0000 7f6d56e86700 1 -- 172.21.15.37:0/3416178414 shutdown_connections 2024-04-25T17:26:39.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:39.733+0000 7f6d56e86700 1 --2- 172.21.15.37:0/3416178414 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6d500fdfd0 0x7f6d500fe440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:39.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:39.733+0000 7f6d56e86700 1 --2- 172.21.15.37:0/3416178414 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d500fce60 0x7f6d500fd270 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:39.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:39.733+0000 7f6d56e86700 1 -- 172.21.15.37:0/3416178414 >> 172.21.15.37:0/3416178414 conn(0x7f6d500f8560 msgr2=0x7f6d500fa970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:26:39.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:39.733+0000 7f6d56e86700 1 -- 172.21.15.37:0/3416178414 shutdown_connections 2024-04-25T17:26:39.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:39.734+0000 7f6d56e86700 1 -- 172.21.15.37:0/3416178414 wait complete. 2024-04-25T17:26:39.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:39.734+0000 7f6d56e86700 1 Processor -- start 2024-04-25T17:26:39.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:39.734+0000 7f6d56e86700 1 -- start start 2024-04-25T17:26:39.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:39.734+0000 7f6d56e86700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d500fce60 0x7f6d50071de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:26:39.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:39.734+0000 7f6d56e86700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6d500fdfd0 0x7f6d500702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:26:39.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:39.734+0000 7f6d56e86700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d50070860 con 0x7f6d500fce60 2024-04-25T17:26:39.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:39.734+0000 7f6d56e86700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d500709d0 con 0x7f6d500fdfd0 2024-04-25T17:26:39.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:39.735+0000 7f6d54c22700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d500fce60 0x7f6d50071de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:26:39.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:39.735+0000 7f6d54c22700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d500fce60 0x7f6d50071de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56108/0 (socket says 172.21.15.37:56108) 2024-04-25T17:26:39.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:39.735+0000 7f6d54c22700 1 -- 172.21.15.37:0/3500686941 learned_addr learned my addr 172.21.15.37:0/3500686941 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:26:39.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:39.735+0000 7f6d4ffff700 1 --2- 172.21.15.37:0/3500686941 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6d500fdfd0 0x7f6d500702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:26:39.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:39.735+0000 7f6d54c22700 1 -- 172.21.15.37:0/3500686941 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6d500fdfd0 msgr2=0x7f6d500702b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:26:39.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:39.735+0000 7f6d54c22700 1 --2- 172.21.15.37:0/3500686941 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6d500fdfd0 0x7f6d500702b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:39.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:39.735+0000 7f6d54c22700 1 -- 172.21.15.37:0/3500686941 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d38005040 con 0x7f6d500fce60 2024-04-25T17:26:39.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:39.735+0000 7f6d54c22700 1 --2- 172.21.15.37:0/3500686941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d500fce60 0x7f6d50071de0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6d38013870 tx=0x7f6d38009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:26:39.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:39.735+0000 7f6d4d7fa700 1 -- 172.21.15.37:0/3500686941 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d38021070 con 0x7f6d500fce60 2024-04-25T17:26:39.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:39.735+0000 7f6d56e86700 1 -- 172.21.15.37:0/3500686941 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d50070c50 con 0x7f6d500fce60 2024-04-25T17:26:39.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:39.735+0000 7f6d4d7fa700 1 -- 172.21.15.37:0/3500686941 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6d38009430 con 0x7f6d500fce60 2024-04-25T17:26:39.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:39.735+0000 7f6d4d7fa700 1 -- 172.21.15.37:0/3500686941 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6d3800e070 con 0x7f6d500fce60 2024-04-25T17:26:39.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:39.735+0000 7f6d56e86700 1 -- 172.21.15.37:0/3500686941 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d50115990 con 0x7f6d500fce60 2024-04-25T17:26:39.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:39.736+0000 7f6d56e86700 1 -- 172.21.15.37:0/3500686941 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d5005f5c0 con 0x7f6d500fce60 2024-04-25T17:26:39.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:39.737+0000 7f6d4d7fa700 1 -- 172.21.15.37:0/3500686941 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f6d3801c750 con 0x7f6d500fce60 2024-04-25T17:26:39.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:39.738+0000 7f6d4d7fa700 1 --2- 172.21.15.37:0/3500686941 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f6d3c076b10 0x7f6d3c078fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:26:39.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:39.738+0000 7f6d4d7fa700 1 -- 172.21.15.37:0/3500686941 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f6d380995a0 con 0x7f6d500fce60 2024-04-25T17:26:39.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:39.738+0000 7f6d4ffff700 1 --2- 172.21.15.37:0/3500686941 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f6d3c076b10 0x7f6d3c078fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:26:39.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:39.738+0000 7f6d4ffff700 1 --2- 172.21.15.37:0/3500686941 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f6d3c076b10 0x7f6d3c078fc0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6d40001510 tx=0x7f6d4000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:26:39.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:39.743+0000 7f6d4d7fa700 1 -- 172.21.15.37:0/3500686941 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f6d380620b0 con 0x7f6d500fce60 2024-04-25T17:26:39.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:39.976+0000 7f6d56e86700 1 -- 172.21.15.37:0/3500686941 --> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6d50102270 con 0x7f6d3c076b10 2024-04-25T17:26:39.977 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:39 smithi037 ceph-mon[90844]: pgmap v200: 65 pgs: 65 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-04-25T17:26:39.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:39.977+0000 7f6d4d7fa700 1 -- 172.21.15.37:0/3500686941 <== mgr.34104 v2:172.21.15.37:6800/783197737 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f6d50102270 con 0x7f6d3c076b10 2024-04-25T17:26:39.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:39.980+0000 7f6d56e86700 1 -- 172.21.15.37:0/3500686941 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f6d3c076b10 msgr2=0x7f6d3c078fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:26:39.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:39.980+0000 7f6d56e86700 1 --2- 172.21.15.37:0/3500686941 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f6d3c076b10 0x7f6d3c078fc0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6d40001510 tx=0x7f6d4000b040 comp rx=0 tx=0).stop 2024-04-25T17:26:39.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:39.980+0000 7f6d56e86700 1 -- 172.21.15.37:0/3500686941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d500fce60 msgr2=0x7f6d50071de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:26:39.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:39.980+0000 7f6d56e86700 1 --2- 172.21.15.37:0/3500686941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d500fce60 0x7f6d50071de0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6d38013870 tx=0x7f6d38009e30 comp rx=0 tx=0).stop 2024-04-25T17:26:39.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:39.980+0000 7f6d56e86700 1 -- 172.21.15.37:0/3500686941 shutdown_connections 2024-04-25T17:26:39.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:39.980+0000 7f6d56e86700 1 --2- 172.21.15.37:0/3500686941 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f6d3c076b10 0x7f6d3c078fc0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:39.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:39.980+0000 7f6d56e86700 1 --2- 172.21.15.37:0/3500686941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6d500fce60 0x7f6d50071de0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:39.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:39.980+0000 7f6d56e86700 1 --2- 172.21.15.37:0/3500686941 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6d500fdfd0 0x7f6d500702b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:39.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:39.980+0000 7f6d56e86700 1 -- 172.21.15.37:0/3500686941 >> 172.21.15.37:0/3500686941 conn(0x7f6d500f8560 msgr2=0x7f6d500f9bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:26:39.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:39.980+0000 7f6d56e86700 1 -- 172.21.15.37:0/3500686941 shutdown_connections 2024-04-25T17:26:39.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:39.980+0000 7f6d56e86700 1 -- 172.21.15.37:0/3500686941 wait complete. 2024-04-25T17:26:39.991 INFO:teuthology.orchestra.run.smithi037.stdout:true 2024-04-25T17:26:40.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.085+0000 7f1e8183d700 1 -- 172.21.15.37:0/228160186 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e7c0fcf70 msgr2=0x7f1e7c0fd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:26:40.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.085+0000 7f1e8183d700 1 --2- 172.21.15.37:0/228160186 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e7c0fcf70 0x7f1e7c0fd3e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1e70004940 tx=0x7f1e70009e30 comp rx=0 tx=0).stop 2024-04-25T17:26:40.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.085+0000 7f1e8183d700 1 -- 172.21.15.37:0/228160186 shutdown_connections 2024-04-25T17:26:40.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.085+0000 7f1e8183d700 1 --2- 172.21.15.37:0/228160186 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e7c0fcf70 0x7f1e7c0fd3e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:40.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.085+0000 7f1e8183d700 1 --2- 172.21.15.37:0/228160186 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1e7c0fbcc0 0x7f1e7c0fc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:40.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.085+0000 7f1e8183d700 1 -- 172.21.15.37:0/228160186 >> 172.21.15.37:0/228160186 conn(0x7f1e7c0f7440 msgr2=0x7f1e7c0f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:26:40.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.085+0000 7f1e8183d700 1 -- 172.21.15.37:0/228160186 shutdown_connections 2024-04-25T17:26:40.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.085+0000 7f1e8183d700 1 -- 172.21.15.37:0/228160186 wait complete. 2024-04-25T17:26:40.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.086+0000 7f1e8183d700 1 Processor -- start 2024-04-25T17:26:40.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.086+0000 7f1e8183d700 1 -- start start 2024-04-25T17:26:40.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.086+0000 7f1e8183d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e7c0fbcc0 0x7f1e7c066c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:26:40.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.086+0000 7f1e8183d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1e7c0fcf70 0x7f1e7c112780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:26:40.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.086+0000 7f1e8183d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7c112cc0 con 0x7f1e7c0fbcc0 2024-04-25T17:26:40.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.086+0000 7f1e8183d700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7c112e00 con 0x7f1e7c0fcf70 2024-04-25T17:26:40.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.086+0000 7f1e7affd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e7c0fbcc0 0x7f1e7c066c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:26:40.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.087+0000 7f1e7affd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e7c0fbcc0 0x7f1e7c066c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56120/0 (socket says 172.21.15.37:56120) 2024-04-25T17:26:40.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.087+0000 7f1e7affd700 1 -- 172.21.15.37:0/2740477338 learned_addr learned my addr 172.21.15.37:0/2740477338 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:26:40.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.087+0000 7f1e7a7fc700 1 --2- 172.21.15.37:0/2740477338 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1e7c0fcf70 0x7f1e7c112780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:26:40.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.087+0000 7f1e7affd700 1 -- 172.21.15.37:0/2740477338 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1e7c0fcf70 msgr2=0x7f1e7c112780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:26:40.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.087+0000 7f1e7affd700 1 --2- 172.21.15.37:0/2740477338 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1e7c0fcf70 0x7f1e7c112780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:40.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.087+0000 7f1e7affd700 1 -- 172.21.15.37:0/2740477338 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e70005040 con 0x7f1e7c0fbcc0 2024-04-25T17:26:40.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.087+0000 7f1e7affd700 1 --2- 172.21.15.37:0/2740477338 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e7c0fbcc0 0x7f1e7c066c60 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c002a50 tx=0x7f1e6c0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:26:40.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.087+0000 7f1e637fe700 1 -- 172.21.15.37:0/2740477338 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e6c007cc0 con 0x7f1e7c0fbcc0 2024-04-25T17:26:40.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.087+0000 7f1e8183d700 1 -- 172.21.15.37:0/2740477338 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e7c113060 con 0x7f1e7c0fbcc0 2024-04-25T17:26:40.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.087+0000 7f1e637fe700 1 -- 172.21.15.37:0/2740477338 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1e6c00f040 con 0x7f1e7c0fbcc0 2024-04-25T17:26:40.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.087+0000 7f1e637fe700 1 -- 172.21.15.37:0/2740477338 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e6c00da30 con 0x7f1e7c0fbcc0 2024-04-25T17:26:40.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.087+0000 7f1e8183d700 1 -- 172.21.15.37:0/2740477338 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e7c1135d0 con 0x7f1e7c0fbcc0 2024-04-25T17:26:40.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.088+0000 7f1e8183d700 1 -- 172.21.15.37:0/2740477338 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e7c04c710 con 0x7f1e7c0fbcc0 2024-04-25T17:26:40.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.089+0000 7f1e637fe700 1 -- 172.21.15.37:0/2740477338 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f1e6c00db90 con 0x7f1e7c0fbcc0 2024-04-25T17:26:40.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.090+0000 7f1e637fe700 1 --2- 172.21.15.37:0/2740477338 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f1e64076b90 0x7f1e64079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:26:40.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.090+0000 7f1e7a7fc700 1 --2- 172.21.15.37:0/2740477338 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f1e64076b90 0x7f1e64079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:26:40.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.090+0000 7f1e637fe700 1 -- 172.21.15.37:0/2740477338 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f1e6c0980b0 con 0x7f1e7c0fbcc0 2024-04-25T17:26:40.091 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.090+0000 7f1e7a7fc700 1 --2- 172.21.15.37:0/2740477338 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f1e64076b90 0x7f1e64079040 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1e7000b3b0 tx=0x7f1e70009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:26:40.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.095+0000 7f1e637fe700 1 -- 172.21.15.37:0/2740477338 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f1e6c060be0 con 0x7f1e7c0fbcc0 2024-04-25T17:26:40.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.324+0000 7f1e8183d700 1 -- 172.21.15.37:0/2740477338 --> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1e7c1012e0 con 0x7f1e64076b90 2024-04-25T17:26:40.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.325+0000 7f1e637fe700 1 -- 172.21.15.37:0/2740477338 <== mgr.34104 v2:172.21.15.37:6800/783197737 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f1e7c1012e0 con 0x7f1e64076b90 2024-04-25T17:26:40.328 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.327+0000 7f1e8183d700 1 -- 172.21.15.37:0/2740477338 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f1e64076b90 msgr2=0x7f1e64079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:26:40.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.327+0000 7f1e8183d700 1 --2- 172.21.15.37:0/2740477338 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f1e64076b90 0x7f1e64079040 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1e7000b3b0 tx=0x7f1e70009e30 comp rx=0 tx=0).stop 2024-04-25T17:26:40.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.327+0000 7f1e8183d700 1 -- 172.21.15.37:0/2740477338 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e7c0fbcc0 msgr2=0x7f1e7c066c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:26:40.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.327+0000 7f1e8183d700 1 --2- 172.21.15.37:0/2740477338 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e7c0fbcc0 0x7f1e7c066c60 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c002a50 tx=0x7f1e6c0046b0 comp rx=0 tx=0).stop 2024-04-25T17:26:40.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.328+0000 7f1e8183d700 1 -- 172.21.15.37:0/2740477338 shutdown_connections 2024-04-25T17:26:40.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.328+0000 7f1e8183d700 1 --2- 172.21.15.37:0/2740477338 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f1e64076b90 0x7f1e64079040 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:40.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.328+0000 7f1e8183d700 1 --2- 172.21.15.37:0/2740477338 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1e7c0fbcc0 0x7f1e7c066c60 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:40.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.328+0000 7f1e8183d700 1 --2- 172.21.15.37:0/2740477338 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1e7c0fcf70 0x7f1e7c112780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:40.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.328+0000 7f1e8183d700 1 -- 172.21.15.37:0/2740477338 >> 172.21.15.37:0/2740477338 conn(0x7f1e7c0f7440 msgr2=0x7f1e7c0f8b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:26:40.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.328+0000 7f1e8183d700 1 -- 172.21.15.37:0/2740477338 shutdown_connections 2024-04-25T17:26:40.329 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.328+0000 7f1e8183d700 1 -- 172.21.15.37:0/2740477338 wait complete. 2024-04-25T17:26:40.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.432+0000 7fd3b7f3d700 1 -- 172.21.15.37:0/2673336462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3b00fdfd0 msgr2=0x7fd3b00fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:26:40.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.432+0000 7fd3b7f3d700 1 --2- 172.21.15.37:0/2673336462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3b00fdfd0 0x7fd3b00fe440 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac004940 tx=0x7fd3ac009e30 comp rx=0 tx=0).stop 2024-04-25T17:26:40.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.432+0000 7fd3b7f3d700 1 -- 172.21.15.37:0/2673336462 shutdown_connections 2024-04-25T17:26:40.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.432+0000 7fd3b7f3d700 1 --2- 172.21.15.37:0/2673336462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3b00fdfd0 0x7fd3b00fe440 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:40.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.432+0000 7fd3b7f3d700 1 --2- 172.21.15.37:0/2673336462 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3b00fce60 0x7fd3b00fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:40.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.432+0000 7fd3b7f3d700 1 -- 172.21.15.37:0/2673336462 >> 172.21.15.37:0/2673336462 conn(0x7fd3b00f8540 msgr2=0x7fd3b00fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:26:40.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.433+0000 7fd3b7f3d700 1 -- 172.21.15.37:0/2673336462 shutdown_connections 2024-04-25T17:26:40.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.433+0000 7fd3b7f3d700 1 -- 172.21.15.37:0/2673336462 wait complete. 2024-04-25T17:26:40.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.433+0000 7fd3b7f3d700 1 Processor -- start 2024-04-25T17:26:40.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.433+0000 7fd3b7f3d700 1 -- start start 2024-04-25T17:26:40.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.433+0000 7fd3b7f3d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3b00fce60 0x7fd3b0071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:26:40.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.433+0000 7fd3b7f3d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3b00fdfd0 0x7fd3b00702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:26:40.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.433+0000 7fd3b7f3d700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b0072200 con 0x7fd3b00fce60 2024-04-25T17:26:40.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.433+0000 7fd3b7f3d700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b00707f0 con 0x7fd3b00fdfd0 2024-04-25T17:26:40.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.433+0000 7fd3b5cd9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3b00fce60 0x7fd3b0071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:26:40.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.433+0000 7fd3b5cd9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3b00fce60 0x7fd3b0071c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56148/0 (socket says 172.21.15.37:56148) 2024-04-25T17:26:40.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.433+0000 7fd3b5cd9700 1 -- 172.21.15.37:0/3310247134 learned_addr learned my addr 172.21.15.37:0/3310247134 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:26:40.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.434+0000 7fd3b54d8700 1 --2- 172.21.15.37:0/3310247134 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3b00fdfd0 0x7fd3b00702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:26:40.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.434+0000 7fd3b5cd9700 1 -- 172.21.15.37:0/3310247134 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3b00fdfd0 msgr2=0x7fd3b00702b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:26:40.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.434+0000 7fd3b5cd9700 1 --2- 172.21.15.37:0/3310247134 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3b00fdfd0 0x7fd3b00702b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:40.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.434+0000 7fd3b5cd9700 1 -- 172.21.15.37:0/3310247134 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3ac005040 con 0x7fd3b00fce60 2024-04-25T17:26:40.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.434+0000 7fd3b5cd9700 1 --2- 172.21.15.37:0/3310247134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3b00fce60 0x7fd3b0071c00 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd3a0002a80 tx=0x7fd3a00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:26:40.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.434+0000 7fd3a67fc700 1 -- 172.21.15.37:0/3310247134 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3a0007cc0 con 0x7fd3b00fce60 2024-04-25T17:26:40.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.434+0000 7fd3a67fc700 1 -- 172.21.15.37:0/3310247134 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd3a000f040 con 0x7fd3b00fce60 2024-04-25T17:26:40.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.434+0000 7fd3b7f3d700 1 -- 172.21.15.37:0/3310247134 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3b0070aa0 con 0x7fd3b00fce60 2024-04-25T17:26:40.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.434+0000 7fd3a67fc700 1 -- 172.21.15.37:0/3310247134 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3a000dac0 con 0x7fd3b00fce60 2024-04-25T17:26:40.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.434+0000 7fd3b7f3d700 1 -- 172.21.15.37:0/3310247134 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3b0071060 con 0x7fd3b00fce60 2024-04-25T17:26:40.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.435+0000 7fd3b7f3d700 1 -- 172.21.15.37:0/3310247134 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3b004c710 con 0x7fd3b00fce60 2024-04-25T17:26:40.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.436+0000 7fd3a67fc700 1 -- 172.21.15.37:0/3310247134 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7fd3a000dc20 con 0x7fd3b00fce60 2024-04-25T17:26:40.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.436+0000 7fd3a67fc700 1 --2- 172.21.15.37:0/3310247134 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fd39c076b90 0x7fd39c079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:26:40.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.437+0000 7fd3b54d8700 1 --2- 172.21.15.37:0/3310247134 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fd39c076b90 0x7fd39c079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:26:40.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.437+0000 7fd3a67fc700 1 -- 172.21.15.37:0/3310247134 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fd3a0098050 con 0x7fd3b00fce60 2024-04-25T17:26:40.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.437+0000 7fd3b54d8700 1 --2- 172.21.15.37:0/3310247134 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fd39c076b90 0x7fd39c079040 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac00b3b0 tx=0x7fd3ac009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:26:40.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.441+0000 7fd3a67fc700 1 -- 172.21.15.37:0/3310247134 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fd3a0060ae0 con 0x7fd3b00fce60 2024-04-25T17:26:40.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.663+0000 7fd3b7f3d700 1 -- 172.21.15.37:0/3310247134 --> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd3b01022a0 con 0x7fd39c076b90 2024-04-25T17:26:40.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.674+0000 7fd3a67fc700 1 -- 172.21.15.37:0/3310247134 <== mgr.34104 v2:172.21.15.37:6800/783197737 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fd3b01022a0 con 0x7fd39c076b90 2024-04-25T17:26:40.675 INFO:teuthology.orchestra.run.smithi037.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-25T17:26:40.675 INFO:teuthology.orchestra.run.smithi037.stdout:alertmanager.smithi037 smithi037 *:9093,9094 running (8m) 22s ago 16m 24.8M - 0.25.0 c8568f914cd2 18aed8f409ee 2024-04-25T17:26:40.676 INFO:teuthology.orchestra.run.smithi037.stdout:crash.smithi037 smithi037 running (4m) 22s ago 16m 6660k - 19.0.0-3291-g994e2f20 d53c96779a29 639584ea5855 2024-04-25T17:26:40.676 INFO:teuthology.orchestra.run.smithi037.stdout:crash.smithi069 smithi069 running (4m) 5s ago 15m 6665k - 19.0.0-3291-g994e2f20 d53c96779a29 ee5db16733a7 2024-04-25T17:26:40.676 INFO:teuthology.orchestra.run.smithi037.stdout:grafana.smithi037 smithi037 *:3000 running (8m) 22s ago 16m 85.6M - 9.4.7 954c08fa6188 1eff3ea3f9b0 2024-04-25T17:26:40.676 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi037.ksmixc smithi037 running (47s) 22s ago 10m 79.3M - 19.0.0-3291-g994e2f20 d53c96779a29 398075bc956a 2024-04-25T17:26:40.676 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi037.ovkrpq smithi037 running (27s) 22s ago 10m 78.9M - 19.0.0-3291-g994e2f20 d53c96779a29 ab3bcb631150 2024-04-25T17:26:40.676 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi069.cpprst smithi069 running (10m) 5s ago 10m 85.7M - 17.2.7-902-gc61472c8 0de407c1b3af dbda101df20e 2024-04-25T17:26:40.676 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi069.ytlqcf smithi069 running (8s) 5s ago 10m 80.2M - 19.0.0-3291-g994e2f20 d53c96779a29 0e58af66f5b5 2024-04-25T17:26:40.676 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.smithi037.txrgxl smithi037 *:8443,9283,8765 running (7m) 22s ago 17m 578M - 19.0.0-3291-g994e2f20 d53c96779a29 e9653fc62df9 2024-04-25T17:26:40.676 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.smithi069.mmuhdo smithi069 *:8443,9283,8765 running (6m) 5s ago 15m 521M - 19.0.0-3291-g994e2f20 d53c96779a29 6820207b4019 2024-04-25T17:26:40.676 INFO:teuthology.orchestra.run.smithi037.stdout:mon.smithi037 smithi037 running (5m) 22s ago 18m 115M 2048M 19.0.0-3291-g994e2f20 d53c96779a29 1b349f3af69d 2024-04-25T17:26:40.676 INFO:teuthology.orchestra.run.smithi037.stdout:mon.smithi069 smithi069 running (5m) 5s ago 15m 106M 2048M 19.0.0-3291-g994e2f20 d53c96779a29 7744dbe81b50 2024-04-25T17:26:40.676 INFO:teuthology.orchestra.run.smithi037.stdout:node-exporter.smithi037 smithi037 *:9100 running (8m) 22s ago 16m 14.7M - 1.5.0 0da6a335fe13 1e59bbb2aa82 2024-04-25T17:26:40.676 INFO:teuthology.orchestra.run.smithi037.stdout:node-exporter.smithi069 smithi069 *:9100 running (7m) 5s ago 15m 16.5M - 1.5.0 0da6a335fe13 0c51a9833fe4 2024-04-25T17:26:40.676 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0 smithi037 running (4m) 22s ago 14m 172M 1559M 19.0.0-3291-g994e2f20 d53c96779a29 e97538cb8b4f 2024-04-25T17:26:40.677 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1 smithi037 running (3m) 22s ago 14m 178M 1559M 19.0.0-3291-g994e2f20 d53c96779a29 6cf158192aae 2024-04-25T17:26:40.677 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2 smithi037 running (2m) 22s ago 13m 166M 1559M 19.0.0-3291-g994e2f20 d53c96779a29 a0b57bba2ebf 2024-04-25T17:26:40.677 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3 smithi069 running (2m) 5s ago 13m 187M 2581M 19.0.0-3291-g994e2f20 d53c96779a29 d1aa15d6b575 2024-04-25T17:26:40.677 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4 smithi069 running (104s) 5s ago 12m 174M 2581M 19.0.0-3291-g994e2f20 d53c96779a29 ad76a3d0fecb 2024-04-25T17:26:40.677 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5 smithi069 running (70s) 5s ago 12m 163M 2581M 19.0.0-3291-g994e2f20 d53c96779a29 dea8b059441b 2024-04-25T17:26:40.677 INFO:teuthology.orchestra.run.smithi037.stdout:prometheus.smithi037 smithi037 *:9095 running (6m) 22s ago 15m 64.6M - 2.43.0 a07b618ecd1d 2c5a268ffc1f 2024-04-25T17:26:40.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.677+0000 7fd3b7f3d700 1 -- 172.21.15.37:0/3310247134 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fd39c076b90 msgr2=0x7fd39c079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:26:40.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.677+0000 7fd3b7f3d700 1 --2- 172.21.15.37:0/3310247134 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fd39c076b90 0x7fd39c079040 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac00b3b0 tx=0x7fd3ac009e30 comp rx=0 tx=0).stop 2024-04-25T17:26:40.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.677+0000 7fd3b7f3d700 1 -- 172.21.15.37:0/3310247134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3b00fce60 msgr2=0x7fd3b0071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:26:40.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.677+0000 7fd3b7f3d700 1 --2- 172.21.15.37:0/3310247134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3b00fce60 0x7fd3b0071c00 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd3a0002a80 tx=0x7fd3a00046b0 comp rx=0 tx=0).stop 2024-04-25T17:26:40.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.677+0000 7fd3b7f3d700 1 -- 172.21.15.37:0/3310247134 shutdown_connections 2024-04-25T17:26:40.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.677+0000 7fd3b7f3d700 1 --2- 172.21.15.37:0/3310247134 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fd39c076b90 0x7fd39c079040 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:40.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.677+0000 7fd3b7f3d700 1 --2- 172.21.15.37:0/3310247134 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd3b00fce60 0x7fd3b0071c00 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:40.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.677+0000 7fd3b7f3d700 1 --2- 172.21.15.37:0/3310247134 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd3b00fdfd0 0x7fd3b00702b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:40.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.677+0000 7fd3b7f3d700 1 -- 172.21.15.37:0/3310247134 >> 172.21.15.37:0/3310247134 conn(0x7fd3b00f8540 msgr2=0x7fd3b00f9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:26:40.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.677+0000 7fd3b7f3d700 1 -- 172.21.15.37:0/3310247134 shutdown_connections 2024-04-25T17:26:40.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.677+0000 7fd3b7f3d700 1 -- 172.21.15.37:0/3310247134 wait complete. 2024-04-25T17:26:40.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.781+0000 7f2d18513700 1 -- 172.21.15.37:0/773310018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d100fbcb0 msgr2=0x7f2d100fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:26:40.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.781+0000 7f2d18513700 1 --2- 172.21.15.37:0/773310018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d100fbcb0 0x7f2d100fc0c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c009ce0 tx=0x7f2d0c004d10 comp rx=0 tx=0).stop 2024-04-25T17:26:40.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.781+0000 7f2d18513700 1 -- 172.21.15.37:0/773310018 shutdown_connections 2024-04-25T17:26:40.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.781+0000 7f2d18513700 1 --2- 172.21.15.37:0/773310018 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2d100fcf60 0x7f2d100fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:40.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.781+0000 7f2d18513700 1 --2- 172.21.15.37:0/773310018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d100fbcb0 0x7f2d100fc0c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:40.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.781+0000 7f2d18513700 1 -- 172.21.15.37:0/773310018 >> 172.21.15.37:0/773310018 conn(0x7f2d100f7430 msgr2=0x7f2d100f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:26:40.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.781+0000 7f2d18513700 1 -- 172.21.15.37:0/773310018 shutdown_connections 2024-04-25T17:26:40.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.781+0000 7f2d18513700 1 -- 172.21.15.37:0/773310018 wait complete. 2024-04-25T17:26:40.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.781+0000 7f2d18513700 1 Processor -- start 2024-04-25T17:26:40.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.781+0000 7f2d18513700 1 -- start start 2024-04-25T17:26:40.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.782+0000 7f2d18513700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d100fbcb0 0x7f2d1010dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:26:40.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.782+0000 7f2d18513700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2d100fcf60 0x7f2d1010e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:26:40.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.782+0000 7f2d18513700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1010e610 con 0x7f2d100fbcb0 2024-04-25T17:26:40.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.782+0000 7f2d18513700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1010edc0 con 0x7f2d100fcf60 2024-04-25T17:26:40.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.782+0000 7f2d162af700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d100fbcb0 0x7f2d1010dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:26:40.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.782+0000 7f2d162af700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d100fbcb0 0x7f2d1010dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56162/0 (socket says 172.21.15.37:56162) 2024-04-25T17:26:40.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.782+0000 7f2d162af700 1 -- 172.21.15.37:0/3809432014 learned_addr learned my addr 172.21.15.37:0/3809432014 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:26:40.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.782+0000 7f2d15aae700 1 --2- 172.21.15.37:0/3809432014 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2d100fcf60 0x7f2d1010e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:26:40.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.782+0000 7f2d162af700 1 -- 172.21.15.37:0/3809432014 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2d100fcf60 msgr2=0x7f2d1010e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:26:40.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.782+0000 7f2d162af700 1 --2- 172.21.15.37:0/3809432014 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2d100fcf60 0x7f2d1010e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:40.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.782+0000 7f2d162af700 1 -- 172.21.15.37:0/3809432014 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d0c009940 con 0x7f2d100fbcb0 2024-04-25T17:26:40.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.782+0000 7f2d15aae700 1 --2- 172.21.15.37:0/3809432014 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2d100fcf60 0x7f2d1010e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T17:26:40.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.782+0000 7f2d162af700 1 --2- 172.21.15.37:0/3809432014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d100fbcb0 0x7f2d1010dad0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c00bfd0 tx=0x7f2d0c004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:26:40.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.782+0000 7f2d06ffd700 1 -- 172.21.15.37:0/3809432014 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d0c00e040 con 0x7f2d100fbcb0 2024-04-25T17:26:40.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.783+0000 7f2d06ffd700 1 -- 172.21.15.37:0/3809432014 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2d0c01cd00 con 0x7f2d100fbcb0 2024-04-25T17:26:40.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.783+0000 7f2d18513700 1 -- 172.21.15.37:0/3809432014 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d1010f040 con 0x7f2d100fbcb0 2024-04-25T17:26:40.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.783+0000 7f2d06ffd700 1 -- 172.21.15.37:0/3809432014 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2d0c012c40 con 0x7f2d100fbcb0 2024-04-25T17:26:40.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.783+0000 7f2d18513700 1 -- 172.21.15.37:0/3809432014 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d1010f580 con 0x7f2d100fbcb0 2024-04-25T17:26:40.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.784+0000 7f2d18513700 1 -- 172.21.15.37:0/3809432014 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d10101af0 con 0x7f2d100fbcb0 2024-04-25T17:26:40.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.784+0000 7f2d06ffd700 1 -- 172.21.15.37:0/3809432014 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f2d0c0124a0 con 0x7f2d100fbcb0 2024-04-25T17:26:40.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.785+0000 7f2d06ffd700 1 --2- 172.21.15.37:0/3809432014 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f2cfc076b90 0x7f2cfc079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:26:40.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.785+0000 7f2d06ffd700 1 -- 172.21.15.37:0/3809432014 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f2d0c09a610 con 0x7f2d100fbcb0 2024-04-25T17:26:40.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.785+0000 7f2d15aae700 1 --2- 172.21.15.37:0/3809432014 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f2cfc076b90 0x7f2cfc079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:26:40.787 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.785+0000 7f2d15aae700 1 --2- 172.21.15.37:0/3809432014 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f2cfc076b90 0x7f2cfc079040 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2d00004fd0 tx=0x7f2d0000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:26:40.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:40.790+0000 7f2d06ffd700 1 -- 172.21.15.37:0/3809432014 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f2d0c063140 con 0x7f2d100fbcb0 2024-04-25T17:26:41.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:40 smithi037 ceph-mon[90844]: Detected new or changed devices on smithi069 2024-04-25T17:26:41.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:40 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:41.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:40 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:41.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:40 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:26:41.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:40 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:26:41.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:40 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:41.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:40 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:26:41.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:40 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:26:41.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:40 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:26:41.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:40 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:26:41.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:40 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:26:41.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:40 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi069.cpprst"]}]: dispatch 2024-04-25T17:26:41.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:40 smithi037 ceph-mon[90844]: Upgrade: It appears safe to stop mds.cephfs.smithi069.cpprst 2024-04-25T17:26:41.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:40 smithi037 ceph-mon[90844]: from='client.34450 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:26:41.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.091+0000 7f2d18513700 1 -- 172.21.15.37:0/3809432014 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2d10104940 con 0x7f2d100fbcb0 2024-04-25T17:26:41.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.092+0000 7f2d06ffd700 1 -- 172.21.15.37:0/3809432014 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+837 (secure 0 0 0) 0x7f2d0c062ae0 con 0x7f2d100fbcb0 2024-04-25T17:26:41.093 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-25T17:26:41.093 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": { 2024-04-25T17:26:41.093 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 2 2024-04-25T17:26:41.093 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:26:41.093 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": { 2024-04-25T17:26:41.093 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 2 2024-04-25T17:26:41.093 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:26:41.093 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": { 2024-04-25T17:26:41.093 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 6 2024-04-25T17:26:41.093 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:26:41.093 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": { 2024-04-25T17:26:41.093 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 1, 2024-04-25T17:26:41.093 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 3 2024-04-25T17:26:41.093 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:26:41.094 INFO:teuthology.orchestra.run.smithi037.stdout: "overall": { 2024-04-25T17:26:41.094 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 1, 2024-04-25T17:26:41.094 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 13 2024-04-25T17:26:41.094 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-04-25T17:26:41.094 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-25T17:26:41.094 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.094+0000 7f2d18513700 1 -- 172.21.15.37:0/3809432014 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f2cfc076b90 msgr2=0x7f2cfc079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:26:41.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.094+0000 7f2d18513700 1 --2- 172.21.15.37:0/3809432014 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f2cfc076b90 0x7f2cfc079040 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2d00004fd0 tx=0x7f2d0000b040 comp rx=0 tx=0).stop 2024-04-25T17:26:41.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.094+0000 7f2d18513700 1 -- 172.21.15.37:0/3809432014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d100fbcb0 msgr2=0x7f2d1010dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:26:41.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.094+0000 7f2d18513700 1 --2- 172.21.15.37:0/3809432014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d100fbcb0 0x7f2d1010dad0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c00bfd0 tx=0x7f2d0c004d10 comp rx=0 tx=0).stop 2024-04-25T17:26:41.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.094+0000 7f2d18513700 1 -- 172.21.15.37:0/3809432014 shutdown_connections 2024-04-25T17:26:41.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.094+0000 7f2d18513700 1 --2- 172.21.15.37:0/3809432014 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f2cfc076b90 0x7f2cfc079040 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:41.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.094+0000 7f2d18513700 1 --2- 172.21.15.37:0/3809432014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d100fbcb0 0x7f2d1010dad0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:41.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.094+0000 7f2d18513700 1 --2- 172.21.15.37:0/3809432014 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2d100fcf60 0x7f2d1010e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:41.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.094+0000 7f2d18513700 1 -- 172.21.15.37:0/3809432014 >> 172.21.15.37:0/3809432014 conn(0x7f2d100f7430 msgr2=0x7f2d10065b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:26:41.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.094+0000 7f2d18513700 1 -- 172.21.15.37:0/3809432014 shutdown_connections 2024-04-25T17:26:41.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.094+0000 7f2d18513700 1 -- 172.21.15.37:0/3809432014 wait complete. 2024-04-25T17:26:41.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:40 smithi069 ceph-mon[80239]: Detected new or changed devices on smithi069 2024-04-25T17:26:41.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:40 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:41.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:40 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:41.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:40 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:26:41.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:40 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:26:41.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:40 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:41.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:40 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:26:41.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:40 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:26:41.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:40 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:26:41.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:40 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:26:41.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:40 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:26:41.170 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:40 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi069.cpprst"]}]: dispatch 2024-04-25T17:26:41.170 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:40 smithi069 ceph-mon[80239]: Upgrade: It appears safe to stop mds.cephfs.smithi069.cpprst 2024-04-25T17:26:41.170 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:40 smithi069 ceph-mon[80239]: from='client.34450 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:26:41.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.198+0000 7f6156635700 1 -- 172.21.15.37:0/1026396976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61500fcbe0 msgr2=0x7f61500fd050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:26:41.202 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.198+0000 7f6156635700 1 --2- 172.21.15.37:0/1026396976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61500fcbe0 0x7f61500fd050 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6140004940 tx=0x7f6140009e30 comp rx=0 tx=0).stop 2024-04-25T17:26:41.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.198+0000 7f6156635700 1 -- 172.21.15.37:0/1026396976 shutdown_connections 2024-04-25T17:26:41.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.198+0000 7f6156635700 1 --2- 172.21.15.37:0/1026396976 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61500fcbe0 0x7f61500fd050 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:41.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.198+0000 7f6156635700 1 --2- 172.21.15.37:0/1026396976 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f61500fc290 0x7f61500fc6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:41.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.198+0000 7f6156635700 1 -- 172.21.15.37:0/1026396976 >> 172.21.15.37:0/1026396976 conn(0x7f61500f6b80 msgr2=0x7f61500f8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:26:41.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.198+0000 7f6156635700 1 -- 172.21.15.37:0/1026396976 shutdown_connections 2024-04-25T17:26:41.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.198+0000 7f6156635700 1 -- 172.21.15.37:0/1026396976 wait complete. 2024-04-25T17:26:41.203 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.199+0000 7f6156635700 1 Processor -- start 2024-04-25T17:26:41.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.199+0000 7f6156635700 1 -- start start 2024-04-25T17:26:41.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.199+0000 7f6156635700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61500fc290 0x7f615010fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:26:41.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.199+0000 7f6156635700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f61500fcbe0 0x7f61501101b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:26:41.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.199+0000 7f6156635700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61501107b0 con 0x7f61500fc290 2024-04-25T17:26:41.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.199+0000 7f6156635700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6150110fb0 con 0x7f61500fcbe0 2024-04-25T17:26:41.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.199+0000 7f614ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61500fc290 0x7f615010fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:26:41.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.199+0000 7f614ffff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61500fc290 0x7f615010fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56178/0 (socket says 172.21.15.37:56178) 2024-04-25T17:26:41.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.199+0000 7f614ffff700 1 -- 172.21.15.37:0/2088344487 learned_addr learned my addr 172.21.15.37:0/2088344487 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:26:41.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.199+0000 7f614f7fe700 1 --2- 172.21.15.37:0/2088344487 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f61500fcbe0 0x7f61501101b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:26:41.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.200+0000 7f614ffff700 1 -- 172.21.15.37:0/2088344487 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f61500fcbe0 msgr2=0x7f61501101b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:26:41.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.200+0000 7f614ffff700 1 --2- 172.21.15.37:0/2088344487 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f61500fcbe0 0x7f61501101b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:41.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.200+0000 7f614ffff700 1 -- 172.21.15.37:0/2088344487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6140005040 con 0x7f61500fc290 2024-04-25T17:26:41.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.200+0000 7f614ffff700 1 --2- 172.21.15.37:0/2088344487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61500fc290 0x7f615010fc70 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6144002a80 tx=0x7f6144004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:26:41.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.200+0000 7f614cff9700 1 -- 172.21.15.37:0/2088344487 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6144007cc0 con 0x7f61500fc290 2024-04-25T17:26:41.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.200+0000 7f614cff9700 1 -- 172.21.15.37:0/2088344487 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f614400f040 con 0x7f61500fc290 2024-04-25T17:26:41.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.200+0000 7f614cff9700 1 -- 172.21.15.37:0/2088344487 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f614400da30 con 0x7f61500fc290 2024-04-25T17:26:41.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.200+0000 7f6156635700 1 -- 172.21.15.37:0/2088344487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6150111290 con 0x7f61500fc290 2024-04-25T17:26:41.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.200+0000 7f6156635700 1 -- 172.21.15.37:0/2088344487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61501117d0 con 0x7f61500fc290 2024-04-25T17:26:41.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.201+0000 7f6156635700 1 -- 172.21.15.37:0/2088344487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61501019e0 con 0x7f61500fc290 2024-04-25T17:26:41.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.202+0000 7f614cff9700 1 -- 172.21.15.37:0/2088344487 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f614400db90 con 0x7f61500fc290 2024-04-25T17:26:41.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.202+0000 7f614cff9700 1 --2- 172.21.15.37:0/2088344487 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f6138076b90 0x7f6138079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:26:41.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.202+0000 7f614cff9700 1 -- 172.21.15.37:0/2088344487 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f6144098070 con 0x7f61500fc290 2024-04-25T17:26:41.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.202+0000 7f614f7fe700 1 --2- 172.21.15.37:0/2088344487 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f6138076b90 0x7f6138079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:26:41.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.203+0000 7f614f7fe700 1 --2- 172.21.15.37:0/2088344487 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f6138076b90 0x7f6138079040 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f614000b970 tx=0x7f6140009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:26:41.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.207+0000 7f614cff9700 1 -- 172.21.15.37:0/2088344487 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f6144060ba0 con 0x7f61500fc290 2024-04-25T17:26:41.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.470+0000 7f6156635700 1 -- 172.21.15.37:0/2088344487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f615005f5c0 con 0x7f61500fc290 2024-04-25T17:26:41.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.471+0000 7f614cff9700 1 -- 172.21.15.37:0/2088344487 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) v1 ==== 76+0+1890 (secure 0 0 0) 0x7f6144060540 con 0x7f61500fc290 2024-04-25T17:26:41.472 INFO:teuthology.orchestra.run.smithi037.stdout:e27 2024-04-25T17:26:41.472 INFO:teuthology.orchestra.run.smithi037.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-25T17:26:41.472 INFO:teuthology.orchestra.run.smithi037.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T17:26:41.472 INFO:teuthology.orchestra.run.smithi037.stdout:legacy client fscid: 1 2024-04-25T17:26:41.472 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:26:41.472 INFO:teuthology.orchestra.run.smithi037.stdout:Filesystem 'cephfs' (1) 2024-04-25T17:26:41.472 INFO:teuthology.orchestra.run.smithi037.stdout:fs_name cephfs 2024-04-25T17:26:41.472 INFO:teuthology.orchestra.run.smithi037.stdout:epoch 23 2024-04-25T17:26:41.472 INFO:teuthology.orchestra.run.smithi037.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-04-25T17:26:41.472 INFO:teuthology.orchestra.run.smithi037.stdout:created 2024-04-25T17:15:40.586130+0000 2024-04-25T17:26:41.472 INFO:teuthology.orchestra.run.smithi037.stdout:modified 2024-04-25T17:25:55.686969+0000 2024-04-25T17:26:41.472 INFO:teuthology.orchestra.run.smithi037.stdout:tableserver 0 2024-04-25T17:26:41.473 INFO:teuthology.orchestra.run.smithi037.stdout:root 0 2024-04-25T17:26:41.473 INFO:teuthology.orchestra.run.smithi037.stdout:session_timeout 60 2024-04-25T17:26:41.473 INFO:teuthology.orchestra.run.smithi037.stdout:session_autoclose 300 2024-04-25T17:26:41.473 INFO:teuthology.orchestra.run.smithi037.stdout:max_file_size 1099511627776 2024-04-25T17:26:41.473 INFO:teuthology.orchestra.run.smithi037.stdout:max_xattr_size 65536 2024-04-25T17:26:41.473 INFO:teuthology.orchestra.run.smithi037.stdout:required_client_features {} 2024-04-25T17:26:41.473 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure 0 2024-04-25T17:26:41.473 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure_osd_epoch 81 2024-04-25T17:26:41.473 INFO:teuthology.orchestra.run.smithi037.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T17:26:41.473 INFO:teuthology.orchestra.run.smithi037.stdout:max_mds 1 2024-04-25T17:26:41.473 INFO:teuthology.orchestra.run.smithi037.stdout:in 0 2024-04-25T17:26:41.473 INFO:teuthology.orchestra.run.smithi037.stdout:up {0=24289} 2024-04-25T17:26:41.473 INFO:teuthology.orchestra.run.smithi037.stdout:failed 2024-04-25T17:26:41.473 INFO:teuthology.orchestra.run.smithi037.stdout:damaged 2024-04-25T17:26:41.474 INFO:teuthology.orchestra.run.smithi037.stdout:stopped 2024-04-25T17:26:41.474 INFO:teuthology.orchestra.run.smithi037.stdout:data_pools [3] 2024-04-25T17:26:41.474 INFO:teuthology.orchestra.run.smithi037.stdout:metadata_pool 2 2024-04-25T17:26:41.474 INFO:teuthology.orchestra.run.smithi037.stdout:inline_data disabled 2024-04-25T17:26:41.474 INFO:teuthology.orchestra.run.smithi037.stdout:balancer 2024-04-25T17:26:41.474 INFO:teuthology.orchestra.run.smithi037.stdout:bal_rank_mask -1 2024-04-25T17:26:41.474 INFO:teuthology.orchestra.run.smithi037.stdout:standby_count_wanted 1 2024-04-25T17:26:41.474 INFO:teuthology.orchestra.run.smithi037.stdout:qdb_cluster leader: 24289 members: 24289 2024-04-25T17:26:41.474 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi069.cpprst{0:24289} state up:active seq 154 join_fscid=1 addr [v2:172.21.15.69:6826/518856100,v1:172.21.15.69:6827/518856100] compat {c=[1],r=[1],i=[7ff]}] 2024-04-25T17:26:41.474 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:26:41.474 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:26:41.474 INFO:teuthology.orchestra.run.smithi037.stdout:Standby daemons: 2024-04-25T17:26:41.474 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:26:41.475 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi037.ksmixc{-1:34412} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.37:6826/2514248612,v1:172.21.15.37:6827/2514248612] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T17:26:41.475 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi037.ovkrpq{-1:34444} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.37:6828/2067664560,v1:172.21.15.37:6829/2067664560] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T17:26:41.475 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi069.ytlqcf{-1:44347} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.69:6824/3424891497,v1:172.21.15.69:6825/3424891497] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T17:26:41.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.473+0000 7f6156635700 1 -- 172.21.15.37:0/2088344487 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f6138076b90 msgr2=0x7f6138079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:26:41.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.473+0000 7f6156635700 1 --2- 172.21.15.37:0/2088344487 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f6138076b90 0x7f6138079040 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f614000b970 tx=0x7f6140009e30 comp rx=0 tx=0).stop 2024-04-25T17:26:41.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.473+0000 7f6156635700 1 -- 172.21.15.37:0/2088344487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61500fc290 msgr2=0x7f615010fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:26:41.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.473+0000 7f6156635700 1 --2- 172.21.15.37:0/2088344487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61500fc290 0x7f615010fc70 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6144002a80 tx=0x7f6144004600 comp rx=0 tx=0).stop 2024-04-25T17:26:41.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.473+0000 7f6156635700 1 -- 172.21.15.37:0/2088344487 shutdown_connections 2024-04-25T17:26:41.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.473+0000 7f6156635700 1 --2- 172.21.15.37:0/2088344487 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f6138076b90 0x7f6138079040 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:41.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.473+0000 7f6156635700 1 --2- 172.21.15.37:0/2088344487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f61500fc290 0x7f615010fc70 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:41.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.473+0000 7f6156635700 1 --2- 172.21.15.37:0/2088344487 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f61500fcbe0 0x7f61501101b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:41.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.473+0000 7f6156635700 1 -- 172.21.15.37:0/2088344487 >> 172.21.15.37:0/2088344487 conn(0x7f61500f6b80 msgr2=0x7f61500fb4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:26:41.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.473+0000 7f6156635700 1 -- 172.21.15.37:0/2088344487 shutdown_connections 2024-04-25T17:26:41.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.473+0000 7f6156635700 1 -- 172.21.15.37:0/2088344487 wait complete. 2024-04-25T17:26:41.476 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 27 2024-04-25T17:26:41.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.580+0000 7fada8abc700 1 -- 172.21.15.37:0/1193191419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fada40662c0 msgr2=0x7fada40ff9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:26:41.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.580+0000 7fada8abc700 1 --2- 172.21.15.37:0/1193191419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fada40662c0 0x7fada40ff9a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fad9c004940 tx=0x7fad9c009e30 comp rx=0 tx=0).stop 2024-04-25T17:26:41.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.580+0000 7fada8abc700 1 -- 172.21.15.37:0/1193191419 shutdown_connections 2024-04-25T17:26:41.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.580+0000 7fada8abc700 1 --2- 172.21.15.37:0/1193191419 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fada40ffee0 0x7fada4102300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:41.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.580+0000 7fada8abc700 1 --2- 172.21.15.37:0/1193191419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fada40662c0 0x7fada40ff9a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:41.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.580+0000 7fada8abc700 1 -- 172.21.15.37:0/1193191419 >> 172.21.15.37:0/1193191419 conn(0x7fada40f7430 msgr2=0x7fada40f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:26:41.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.580+0000 7fada8abc700 1 -- 172.21.15.37:0/1193191419 shutdown_connections 2024-04-25T17:26:41.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.580+0000 7fada8abc700 1 -- 172.21.15.37:0/1193191419 wait complete. 2024-04-25T17:26:41.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.581+0000 7fada8abc700 1 Processor -- start 2024-04-25T17:26:41.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.581+0000 7fada8abc700 1 -- start start 2024-04-25T17:26:41.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.581+0000 7fada8abc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fada40662c0 0x7fada410da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:26:41.582 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.581+0000 7fada8abc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fada40ffee0 0x7fada410df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:26:41.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.581+0000 7fada8abc700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada410e540 con 0x7fada40662c0 2024-04-25T17:26:41.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.581+0000 7fada8abc700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada410ed40 con 0x7fada40ffee0 2024-04-25T17:26:41.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.581+0000 7fada259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fada40662c0 0x7fada410da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:26:41.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.581+0000 7fada259c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fada40662c0 0x7fada410da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56186/0 (socket says 172.21.15.37:56186) 2024-04-25T17:26:41.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.581+0000 7fada259c700 1 -- 172.21.15.37:0/2016490606 learned_addr learned my addr 172.21.15.37:0/2016490606 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:26:41.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.581+0000 7fada1d9b700 1 --2- 172.21.15.37:0/2016490606 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fada40ffee0 0x7fada410df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:26:41.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.581+0000 7fada259c700 1 -- 172.21.15.37:0/2016490606 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fada40ffee0 msgr2=0x7fada410df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:26:41.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.581+0000 7fada259c700 1 --2- 172.21.15.37:0/2016490606 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fada40ffee0 0x7fada410df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:41.583 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.581+0000 7fada259c700 1 -- 172.21.15.37:0/2016490606 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad9c005040 con 0x7fada40662c0 2024-04-25T17:26:41.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.581+0000 7fada259c700 1 --2- 172.21.15.37:0/2016490606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fada40662c0 0x7fada410da00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fad9c000c00 tx=0x7fad9c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:26:41.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.582+0000 7fad9affd700 1 -- 172.21.15.37:0/2016490606 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad9c00e040 con 0x7fada40662c0 2024-04-25T17:26:41.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.582+0000 7fad9affd700 1 -- 172.21.15.37:0/2016490606 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fad9c00bbf0 con 0x7fada40662c0 2024-04-25T17:26:41.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.582+0000 7fada8abc700 1 -- 172.21.15.37:0/2016490606 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fada410efc0 con 0x7fada40662c0 2024-04-25T17:26:41.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.582+0000 7fad9affd700 1 -- 172.21.15.37:0/2016490606 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad9c01c630 con 0x7fada40662c0 2024-04-25T17:26:41.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.582+0000 7fada8abc700 1 -- 172.21.15.37:0/2016490606 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fada410f500 con 0x7fada40662c0 2024-04-25T17:26:41.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.583+0000 7fada8abc700 1 -- 172.21.15.37:0/2016490606 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fada405f5c0 con 0x7fada40662c0 2024-04-25T17:26:41.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.583+0000 7fad9affd700 1 -- 172.21.15.37:0/2016490606 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7fad9c00bd60 con 0x7fada40662c0 2024-04-25T17:26:41.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.584+0000 7fad9affd700 1 --2- 172.21.15.37:0/2016490606 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fad90076b90 0x7fad90079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:26:41.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.584+0000 7fad9affd700 1 -- 172.21.15.37:0/2016490606 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6410+0+0 (secure 0 0 0) 0x7fad9c099610 con 0x7fada40662c0 2024-04-25T17:26:41.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.584+0000 7fada1d9b700 1 --2- 172.21.15.37:0/2016490606 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fad90076b90 0x7fad90079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:26:41.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.584+0000 7fada1d9b700 1 --2- 172.21.15.37:0/2016490606 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fad90076b90 0x7fad90079040 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fad8c009fd0 tx=0x7fad8c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:26:41.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.589+0000 7fad9affd700 1 -- 172.21.15.37:0/2016490606 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fad9c0621c0 con 0x7fada40662c0 2024-04-25T17:26:41.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.822+0000 7fada8abc700 1 -- 172.21.15.37:0/2016490606 --> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fada410f8f0 con 0x7fad90076b90 2024-04-25T17:26:41.824 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.823+0000 7fad9affd700 1 -- 172.21.15.37:0/2016490606 <== mgr.34104 v2:172.21.15.37:6800/783197737 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fada410f8f0 con 0x7fad90076b90 2024-04-25T17:26:41.824 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-25T17:26:41.825 INFO:teuthology.orchestra.run.smithi037.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385", 2024-04-25T17:26:41.825 INFO:teuthology.orchestra.run.smithi037.stdout: "in_progress": true, 2024-04-25T17:26:41.825 INFO:teuthology.orchestra.run.smithi037.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-25T17:26:41.825 INFO:teuthology.orchestra.run.smithi037.stdout: "services_complete": [ 2024-04-25T17:26:41.825 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr", 2024-04-25T17:26:41.826 INFO:teuthology.orchestra.run.smithi037.stdout: "crash", 2024-04-25T17:26:41.826 INFO:teuthology.orchestra.run.smithi037.stdout: "mon", 2024-04-25T17:26:41.826 INFO:teuthology.orchestra.run.smithi037.stdout: "osd" 2024-04-25T17:26:41.826 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-04-25T17:26:41.826 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": "15/21 daemons upgraded", 2024-04-25T17:26:41.826 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "Currently upgrading mds daemons", 2024-04-25T17:26:41.827 INFO:teuthology.orchestra.run.smithi037.stdout: "is_paused": false 2024-04-25T17:26:41.827 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-25T17:26:41.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.826+0000 7fada8abc700 1 -- 172.21.15.37:0/2016490606 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fad90076b90 msgr2=0x7fad90079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:26:41.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.826+0000 7fada8abc700 1 --2- 172.21.15.37:0/2016490606 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fad90076b90 0x7fad90079040 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fad8c009fd0 tx=0x7fad8c00b040 comp rx=0 tx=0).stop 2024-04-25T17:26:41.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.826+0000 7fada8abc700 1 -- 172.21.15.37:0/2016490606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fada40662c0 msgr2=0x7fada410da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:26:41.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.826+0000 7fada8abc700 1 --2- 172.21.15.37:0/2016490606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fada40662c0 0x7fada410da00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fad9c000c00 tx=0x7fad9c009e30 comp rx=0 tx=0).stop 2024-04-25T17:26:41.829 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.826+0000 7fada8abc700 1 -- 172.21.15.37:0/2016490606 shutdown_connections 2024-04-25T17:26:41.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.826+0000 7fada8abc700 1 --2- 172.21.15.37:0/2016490606 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fad90076b90 0x7fad90079040 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:41.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.826+0000 7fada8abc700 1 --2- 172.21.15.37:0/2016490606 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fada40662c0 0x7fada410da00 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:41.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.826+0000 7fada8abc700 1 --2- 172.21.15.37:0/2016490606 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fada40ffee0 0x7fada410df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:41.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.826+0000 7fada8abc700 1 -- 172.21.15.37:0/2016490606 >> 172.21.15.37:0/2016490606 conn(0x7fada40f7430 msgr2=0x7fada40f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:26:41.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.826+0000 7fada8abc700 1 -- 172.21.15.37:0/2016490606 shutdown_connections 2024-04-25T17:26:41.831 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.826+0000 7fada8abc700 1 -- 172.21.15.37:0/2016490606 wait complete. 2024-04-25T17:26:41.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.929+0000 7f40df5ac700 1 -- 172.21.15.37:0/1688008325 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40d8066ef0 msgr2=0x7f40d80ffa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:26:41.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.929+0000 7f40df5ac700 1 --2- 172.21.15.37:0/1688008325 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40d8066ef0 0x7f40d80ffa10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f40d4004940 tx=0x7f40d4009e30 comp rx=0 tx=0).stop 2024-04-25T17:26:41.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.930+0000 7f40df5ac700 1 -- 172.21.15.37:0/1688008325 shutdown_connections 2024-04-25T17:26:41.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.930+0000 7f40df5ac700 1 --2- 172.21.15.37:0/1688008325 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40d80fff50 0x7f40d8102330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:41.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.930+0000 7f40df5ac700 1 --2- 172.21.15.37:0/1688008325 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40d8066ef0 0x7f40d80ffa10 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:41.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.930+0000 7f40df5ac700 1 -- 172.21.15.37:0/1688008325 >> 172.21.15.37:0/1688008325 conn(0x7f40d80f7440 msgr2=0x7f40d80f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:26:41.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.930+0000 7f40df5ac700 1 -- 172.21.15.37:0/1688008325 shutdown_connections 2024-04-25T17:26:41.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.930+0000 7f40df5ac700 1 -- 172.21.15.37:0/1688008325 wait complete. 2024-04-25T17:26:41.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.930+0000 7f40df5ac700 1 Processor -- start 2024-04-25T17:26:41.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.930+0000 7f40df5ac700 1 -- start start 2024-04-25T17:26:41.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.930+0000 7f40df5ac700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40d8066ef0 0x7f40d810d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:26:41.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.930+0000 7f40df5ac700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40d80fff50 0x7f40d810def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:26:41.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.930+0000 7f40df5ac700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d810e4f0 con 0x7f40d80fff50 2024-04-25T17:26:41.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.930+0000 7f40df5ac700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d810e660 con 0x7f40d8066ef0 2024-04-25T17:26:41.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.931+0000 7f40dcb47700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40d80fff50 0x7f40d810def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:26:41.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.931+0000 7f40dcb47700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40d80fff50 0x7f40d810def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56192/0 (socket says 172.21.15.37:56192) 2024-04-25T17:26:41.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.931+0000 7f40dcb47700 1 -- 172.21.15.37:0/3652974597 learned_addr learned my addr 172.21.15.37:0/3652974597 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:26:41.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.931+0000 7f40dd348700 1 --2- 172.21.15.37:0/3652974597 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40d8066ef0 0x7f40d810d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:26:41.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.931+0000 7f40dcb47700 1 -- 172.21.15.37:0/3652974597 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40d8066ef0 msgr2=0x7f40d810d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:26:41.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.931+0000 7f40dcb47700 1 --2- 172.21.15.37:0/3652974597 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40d8066ef0 0x7f40d810d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:41.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.931+0000 7f40dcb47700 1 -- 172.21.15.37:0/3652974597 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d4005040 con 0x7f40d80fff50 2024-04-25T17:26:41.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.931+0000 7f40dcb47700 1 --2- 172.21.15.37:0/3652974597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40d80fff50 0x7f40d810def0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f40c8002a50 tx=0x7f40c80046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:26:41.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.931+0000 7f40cdffb700 1 -- 172.21.15.37:0/3652974597 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40c8007cc0 con 0x7f40d80fff50 2024-04-25T17:26:41.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.931+0000 7f40cdffb700 1 -- 172.21.15.37:0/3652974597 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f40c800f040 con 0x7f40d80fff50 2024-04-25T17:26:41.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.931+0000 7f40cdffb700 1 -- 172.21.15.37:0/3652974597 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f40c800da30 con 0x7f40d80fff50 2024-04-25T17:26:41.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.931+0000 7f40df5ac700 1 -- 172.21.15.37:0/3652974597 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40d81130c0 con 0x7f40d80fff50 2024-04-25T17:26:41.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.932+0000 7f40df5ac700 1 -- 172.21.15.37:0/3652974597 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40d8113630 con 0x7f40d80fff50 2024-04-25T17:26:41.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.932+0000 7f40df5ac700 1 -- 172.21.15.37:0/3652974597 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40d804c710 con 0x7f40d80fff50 2024-04-25T17:26:41.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.933+0000 7f40cdffb700 1 -- 172.21.15.37:0/3652974597 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f40c800db90 con 0x7f40d80fff50 2024-04-25T17:26:41.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.933+0000 7f40cdffb700 1 --2- 172.21.15.37:0/3652974597 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f40c4076b90 0x7f40c4079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:26:41.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.934+0000 7f40cdffb700 1 -- 172.21.15.37:0/3652974597 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 6410+0+0 (secure 0 0 0) 0x7f40c8098150 con 0x7f40d80fff50 2024-04-25T17:26:41.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.934+0000 7f40dd348700 1 --2- 172.21.15.37:0/3652974597 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f40c4076b90 0x7f40c4079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:26:41.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.934+0000 7f40dd348700 1 --2- 172.21.15.37:0/3652974597 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f40c4076b90 0x7f40c4079040 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f40d400b970 tx=0x7f40d4009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:26:41.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:41.939+0000 7f40cdffb700 1 -- 172.21.15.37:0/3652974597 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f40c8060be0 con 0x7f40d80fff50 2024-04-25T17:26:42.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:41 smithi037 ceph-mon[90844]: from='client.34454 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:26:42.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:41 smithi037 ceph-mon[90844]: pgmap v201: 65 pgs: 65 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-04-25T17:26:42.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:41 smithi037 ceph-mon[90844]: from='client.34458 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:26:42.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:41 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/3809432014' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:26:42.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:41 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:42.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:41 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi069.cpprst", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T17:26:42.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:41 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:26:42.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:41 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/2088344487' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T17:26:42.120 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:41 smithi069 ceph-mon[80239]: from='client.34454 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:26:42.120 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:41 smithi069 ceph-mon[80239]: pgmap v201: 65 pgs: 65 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-04-25T17:26:42.120 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:41 smithi069 ceph-mon[80239]: from='client.34458 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:26:42.120 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:41 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/3809432014' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:26:42.120 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:41 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:42.120 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:41 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi069.cpprst", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-04-25T17:26:42.120 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:41 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:26:42.120 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:41 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/2088344487' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T17:26:42.233 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:42.233+0000 7f40df5ac700 1 -- 172.21.15.37:0/3652974597 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f40d8113ab0 con 0x7f40d80fff50 2024-04-25T17:26:42.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:42.233+0000 7f40cdffb700 1 -- 172.21.15.37:0/3652974597 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f40c8060580 con 0x7f40d80fff50 2024-04-25T17:26:42.234 INFO:teuthology.orchestra.run.smithi037.stdout:HEALTH_OK 2024-04-25T17:26:42.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:42.235+0000 7f40df5ac700 1 -- 172.21.15.37:0/3652974597 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f40c4076b90 msgr2=0x7f40c4079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:26:42.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:42.235+0000 7f40df5ac700 1 --2- 172.21.15.37:0/3652974597 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f40c4076b90 0x7f40c4079040 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f40d400b970 tx=0x7f40d4009e30 comp rx=0 tx=0).stop 2024-04-25T17:26:42.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:42.235+0000 7f40df5ac700 1 -- 172.21.15.37:0/3652974597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40d80fff50 msgr2=0x7f40d810def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:26:42.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:42.235+0000 7f40df5ac700 1 --2- 172.21.15.37:0/3652974597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40d80fff50 0x7f40d810def0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f40c8002a50 tx=0x7f40c80046b0 comp rx=0 tx=0).stop 2024-04-25T17:26:42.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:42.235+0000 7f40df5ac700 1 -- 172.21.15.37:0/3652974597 shutdown_connections 2024-04-25T17:26:42.236 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:42.235+0000 7f40df5ac700 1 --2- 172.21.15.37:0/3652974597 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f40c4076b90 0x7f40c4079040 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:42.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:42.235+0000 7f40df5ac700 1 --2- 172.21.15.37:0/3652974597 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40d8066ef0 0x7f40d810d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:42.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:42.235+0000 7f40df5ac700 1 --2- 172.21.15.37:0/3652974597 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f40d80fff50 0x7f40d810def0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:26:42.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:42.235+0000 7f40df5ac700 1 -- 172.21.15.37:0/3652974597 >> 172.21.15.37:0/3652974597 conn(0x7f40d80f7440 msgr2=0x7f40d80f7810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:26:42.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:42.235+0000 7f40df5ac700 1 -- 172.21.15.37:0/3652974597 shutdown_connections 2024-04-25T17:26:42.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:26:42.235+0000 7f40df5ac700 1 -- 172.21.15.37:0/3652974597 wait complete. 2024-04-25T17:26:42.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:42 smithi069 ceph-mon[80239]: Upgrade: Updating mds.cephfs.smithi069.cpprst 2024-04-25T17:26:42.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:42 smithi069 ceph-mon[80239]: Deploying daemon mds.cephfs.smithi069.cpprst on smithi069 2024-04-25T17:26:42.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:42 smithi069 ceph-mon[80239]: from='client.34470 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:26:42.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:42 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/3652974597' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T17:26:42.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:42 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:26:43.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:42 smithi037 ceph-mon[90844]: Upgrade: Updating mds.cephfs.smithi069.cpprst 2024-04-25T17:26:43.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:42 smithi037 ceph-mon[90844]: Deploying daemon mds.cephfs.smithi069.cpprst on smithi069 2024-04-25T17:26:43.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:42 smithi037 ceph-mon[90844]: from='client.34470 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:26:43.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:42 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/3652974597' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T17:26:43.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:42 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:26:43.801 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:43 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-mon-smithi037[90840]: 2024-04-25T17:26:43.462+0000 7f5c53c75700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T17:26:44.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:43 smithi037 ceph-mon[90844]: pgmap v202: 65 pgs: 65 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-04-25T17:26:44.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:43 smithi037 ceph-mon[90844]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-25T17:26:44.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:43 smithi037 ceph-mon[90844]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T17:26:44.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:43 smithi037 ceph-mon[90844]: osdmap e84: 6 total, 6 up, 6 in 2024-04-25T17:26:44.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:43 smithi037 ceph-mon[90844]: Standby daemon mds.cephfs.smithi037.ksmixc assigned to filesystem cephfs as rank 0 2024-04-25T17:26:44.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:43 smithi037 ceph-mon[90844]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-25T17:26:44.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:43 smithi037 ceph-mon[90844]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-25T17:26:44.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:43 smithi037 ceph-mon[90844]: fsmap cephfs:1/1 {0=cephfs.smithi037.ksmixc=up:replay} 2 up:standby 2024-04-25T17:26:44.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:43 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi069.cpprst"}]: dispatch 2024-04-25T17:26:44.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:43 smithi069 ceph-mon[80239]: pgmap v202: 65 pgs: 65 active+clean; 208 MiB data, 868 MiB used, 536 GiB / 536 GiB avail 2024-04-25T17:26:44.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:43 smithi069 ceph-mon[80239]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-04-25T17:26:44.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:43 smithi069 ceph-mon[80239]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T17:26:44.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:43 smithi069 ceph-mon[80239]: osdmap e84: 6 total, 6 up, 6 in 2024-04-25T17:26:44.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:43 smithi069 ceph-mon[80239]: Standby daemon mds.cephfs.smithi037.ksmixc assigned to filesystem cephfs as rank 0 2024-04-25T17:26:44.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:43 smithi069 ceph-mon[80239]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-04-25T17:26:44.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:43 smithi069 ceph-mon[80239]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-04-25T17:26:44.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:43 smithi069 ceph-mon[80239]: fsmap cephfs:1/1 {0=cephfs.smithi037.ksmixc=up:replay} 2 up:standby 2024-04-25T17:26:44.170 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:43 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi069.cpprst"}]: dispatch 2024-04-25T17:26:46.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:45 smithi037 ceph-mon[90844]: pgmap v204: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 MiB/s rd, 0 op/s 2024-04-25T17:26:46.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:45 smithi069 ceph-mon[80239]: pgmap v204: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 MiB/s rd, 0 op/s 2024-04-25T17:26:48.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:47 smithi037 ceph-mon[90844]: pgmap v205: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 5.6 MiB/s rd, 2 op/s 2024-04-25T17:26:48.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:47 smithi069 ceph-mon[80239]: pgmap v205: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 5.6 MiB/s rd, 2 op/s 2024-04-25T17:26:50.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:49 smithi037 ceph-mon[90844]: pgmap v206: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 4 op/s 2024-04-25T17:26:50.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:49 smithi069 ceph-mon[80239]: pgmap v206: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 4 op/s 2024-04-25T17:26:51.920 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:51 smithi069 ceph-mon[80239]: pgmap v207: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-04-25T17:26:52.076 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:51 smithi037 ceph-mon[90844]: pgmap v207: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-04-25T17:26:53.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:53 smithi069 ceph-mon[80239]: pgmap v208: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-04-25T17:26:53.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:53 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:53.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:53 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:53.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:53 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:26:53.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:53 smithi069 ceph-mon[80239]: mds.? [v2:172.21.15.69:6826/3383509929,v1:172.21.15.69:6827/3383509929] up:boot 2024-04-25T17:26:53.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:53 smithi069 ceph-mon[80239]: fsmap cephfs:1/1 {0=cephfs.smithi037.ksmixc=up:replay} 3 up:standby 2024-04-25T17:26:53.670 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:53 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi069.cpprst"}]: dispatch 2024-04-25T17:26:54.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:53 smithi037 ceph-mon[90844]: pgmap v208: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-04-25T17:26:54.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:53 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:54.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:53 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:54.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:53 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:26:54.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:53 smithi037 ceph-mon[90844]: mds.? [v2:172.21.15.69:6826/3383509929,v1:172.21.15.69:6827/3383509929] up:boot 2024-04-25T17:26:54.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:53 smithi037 ceph-mon[90844]: fsmap cephfs:1/1 {0=cephfs.smithi037.ksmixc=up:replay} 3 up:standby 2024-04-25T17:26:54.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:53 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi069.cpprst"}]: dispatch 2024-04-25T17:26:55.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:54 smithi069 ceph-mon[80239]: reconnect by client.24331 192.168.0.1:0/3631080618 after 0.000999987 2024-04-25T17:26:55.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:54 smithi069 ceph-mon[80239]: reconnect by client.14538 192.168.0.1:0/2684522872 after 0.000999987 2024-04-25T17:26:55.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:54 smithi069 ceph-mon[80239]: mds.? [v2:172.21.15.37:6826/2514248612,v1:172.21.15.37:6827/2514248612] up:reconnect 2024-04-25T17:26:55.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:54 smithi069 ceph-mon[80239]: fsmap cephfs:1/1 {0=cephfs.smithi037.ksmixc=up:reconnect} 3 up:standby 2024-04-25T17:26:55.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:54 smithi037 ceph-mon[90844]: reconnect by client.24331 192.168.0.1:0/3631080618 after 0.000999987 2024-04-25T17:26:55.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:54 smithi037 ceph-mon[90844]: reconnect by client.14538 192.168.0.1:0/2684522872 after 0.000999987 2024-04-25T17:26:55.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:54 smithi037 ceph-mon[90844]: mds.? [v2:172.21.15.37:6826/2514248612,v1:172.21.15.37:6827/2514248612] up:reconnect 2024-04-25T17:26:55.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:54 smithi037 ceph-mon[90844]: fsmap cephfs:1/1 {0=cephfs.smithi037.ksmixc=up:reconnect} 3 up:standby 2024-04-25T17:26:56.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:55 smithi069 ceph-mon[80239]: pgmap v209: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-04-25T17:26:56.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:55 smithi069 ceph-mon[80239]: mds.? [v2:172.21.15.37:6826/2514248612,v1:172.21.15.37:6827/2514248612] up:rejoin 2024-04-25T17:26:56.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:55 smithi069 ceph-mon[80239]: fsmap cephfs:1/1 {0=cephfs.smithi037.ksmixc=up:rejoin} 3 up:standby 2024-04-25T17:26:56.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:55 smithi069 ceph-mon[80239]: daemon mds.cephfs.smithi037.ksmixc is now active in filesystem cephfs as rank 0 2024-04-25T17:26:56.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:55 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:56.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:55 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:56.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:55 smithi037 ceph-mon[90844]: pgmap v209: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-04-25T17:26:56.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:55 smithi037 ceph-mon[90844]: mds.? [v2:172.21.15.37:6826/2514248612,v1:172.21.15.37:6827/2514248612] up:rejoin 2024-04-25T17:26:56.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:55 smithi037 ceph-mon[90844]: fsmap cephfs:1/1 {0=cephfs.smithi037.ksmixc=up:rejoin} 3 up:standby 2024-04-25T17:26:56.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:55 smithi037 ceph-mon[90844]: daemon mds.cephfs.smithi037.ksmixc is now active in filesystem cephfs as rank 0 2024-04-25T17:26:56.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:55 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:56.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:55 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:56.936 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:56 smithi069 ceph-mon[80239]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-25T17:26:56.936 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:56 smithi069 ceph-mon[80239]: Cluster is now healthy 2024-04-25T17:26:56.936 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:56 smithi069 ceph-mon[80239]: mds.? [v2:172.21.15.37:6826/2514248612,v1:172.21.15.37:6827/2514248612] up:active 2024-04-25T17:26:56.936 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:56 smithi069 ceph-mon[80239]: fsmap cephfs:1 {0=cephfs.smithi037.ksmixc=up:active} 3 up:standby 2024-04-25T17:26:56.936 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:56 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:56.936 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:56 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:57.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:56 smithi037 ceph-mon[90844]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-25T17:26:57.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:56 smithi037 ceph-mon[90844]: Cluster is now healthy 2024-04-25T17:26:57.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:56 smithi037 ceph-mon[90844]: mds.? [v2:172.21.15.37:6826/2514248612,v1:172.21.15.37:6827/2514248612] up:active 2024-04-25T17:26:57.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:56 smithi037 ceph-mon[90844]: fsmap cephfs:1 {0=cephfs.smithi037.ksmixc=up:active} 3 up:standby 2024-04-25T17:26:57.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:56 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:57.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:56 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:26:58.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:58 smithi037 ceph-mon[90844]: pgmap v210: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 85 B/s wr, 5 op/s 2024-04-25T17:26:58.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:26:58 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:26:58.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:58 smithi069 ceph-mon[80239]: pgmap v210: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 16 MiB/s rd, 85 B/s wr, 5 op/s 2024-04-25T17:26:58.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:26:58 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:27:00.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:00 smithi069 ceph-mon[80239]: pgmap v211: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 170 B/s wr, 3 op/s 2024-04-25T17:27:00.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:00 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:00.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:00 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:00.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:00 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:27:00.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:00 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:27:00.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:00 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:00.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:00 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:27:00.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:00 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:00.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:00 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:00.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:00 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:00.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:00 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:00.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:00 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:00.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:00 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:00.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:00 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi037.ksmixc"}]: dispatch 2024-04-25T17:27:00.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:00 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi037.ksmixc"}]': finished 2024-04-25T17:27:00.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:00 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi037.ovkrpq"}]: dispatch 2024-04-25T17:27:00.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:00 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi037.ovkrpq"}]': finished 2024-04-25T17:27:00.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:00 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi069.cpprst"}]: dispatch 2024-04-25T17:27:00.421 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:00 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi069.cpprst"}]': finished 2024-04-25T17:27:00.421 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:00 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi069.ytlqcf"}]: dispatch 2024-04-25T17:27:00.421 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:00 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi069.ytlqcf"}]': finished 2024-04-25T17:27:00.421 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:00 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-04-25T17:27:00.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:00 smithi037 ceph-mon[90844]: pgmap v211: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 170 B/s wr, 3 op/s 2024-04-25T17:27:00.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:00 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:00.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:00 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:00.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:00 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:27:00.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:00 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:27:00.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:00 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:00.573 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:00 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:27:00.573 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:00 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:00.573 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:00 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:00.573 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:00 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:00.573 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:00 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:00.573 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:00 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:00.573 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:00 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:00.573 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:00 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi037.ksmixc"}]: dispatch 2024-04-25T17:27:00.573 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:00 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi037.ksmixc"}]': finished 2024-04-25T17:27:00.573 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:00 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi037.ovkrpq"}]: dispatch 2024-04-25T17:27:00.573 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:00 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi037.ovkrpq"}]': finished 2024-04-25T17:27:00.573 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:00 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi069.cpprst"}]: dispatch 2024-04-25T17:27:00.573 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:00 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi069.cpprst"}]': finished 2024-04-25T17:27:00.573 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:00 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi069.ytlqcf"}]: dispatch 2024-04-25T17:27:00.574 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:00 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi069.ytlqcf"}]': finished 2024-04-25T17:27:00.574 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:00 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-04-25T17:27:01.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:01 smithi069 ceph-mon[80239]: Upgrade: Setting container_image for all mds 2024-04-25T17:27:01.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:01 smithi069 ceph-mon[80239]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-04-25T17:27:01.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:01 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-04-25T17:27:01.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:01 smithi069 ceph-mon[80239]: fsmap cephfs:1 {0=cephfs.smithi037.ksmixc=up:active} 3 up:standby 2024-04-25T17:27:01.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:01 smithi069 ceph-mon[80239]: fsmap cephfs:1 {0=cephfs.smithi037.ksmixc=up:active} 1 up:standby-replay 2 up:standby 2024-04-25T17:27:01.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:01 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:01.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:01 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:01.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:01 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:01.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:01 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:01.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:01 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:01.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:01 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:01.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:01 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:01.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:01 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:01.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:01 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:01.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:01 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:01.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:01 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:01.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:01 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:01.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:01 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:01.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:01 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:01.475 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:01 smithi037 ceph-mon[90844]: Upgrade: Setting container_image for all mds 2024-04-25T17:27:01.475 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:01 smithi037 ceph-mon[90844]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-04-25T17:27:01.475 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:01 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-04-25T17:27:01.475 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:01 smithi037 ceph-mon[90844]: fsmap cephfs:1 {0=cephfs.smithi037.ksmixc=up:active} 3 up:standby 2024-04-25T17:27:01.475 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:01 smithi037 ceph-mon[90844]: fsmap cephfs:1 {0=cephfs.smithi037.ksmixc=up:active} 1 up:standby-replay 2 up:standby 2024-04-25T17:27:01.475 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:01 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:01.475 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:01 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:01.475 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:01 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:01.476 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:01 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:01.476 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:01 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:01.476 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:01 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:01.476 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:01 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:01.476 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:01 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:01.476 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:01 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:01.476 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:01 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:01.476 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:01 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:01.476 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:01 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:01.476 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:01 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:01.476 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:01 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:02.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:02 smithi037 ceph-mon[90844]: pgmap v212: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 7.8 MiB/s rd, 170 B/s wr, 3 op/s 2024-04-25T17:27:02.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:02 smithi037 ceph-mon[90844]: Upgrade: Setting container_image for all rgw 2024-04-25T17:27:02.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:02 smithi037 ceph-mon[90844]: Upgrade: Setting container_image for all rbd-mirror 2024-04-25T17:27:02.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:02 smithi037 ceph-mon[90844]: Upgrade: Setting container_image for all ceph-exporter 2024-04-25T17:27:02.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:02 smithi037 ceph-mon[90844]: Upgrade: Setting container_image for all iscsi 2024-04-25T17:27:02.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:02 smithi037 ceph-mon[90844]: Upgrade: Setting container_image for all nfs 2024-04-25T17:27:02.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:02 smithi037 ceph-mon[90844]: Upgrade: Setting container_image for all nvmeof 2024-04-25T17:27:02.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:02 smithi069 ceph-mon[80239]: pgmap v212: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 7.8 MiB/s rd, 170 B/s wr, 3 op/s 2024-04-25T17:27:02.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:02 smithi069 ceph-mon[80239]: Upgrade: Setting container_image for all rgw 2024-04-25T17:27:02.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:02 smithi069 ceph-mon[80239]: Upgrade: Setting container_image for all rbd-mirror 2024-04-25T17:27:02.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:02 smithi069 ceph-mon[80239]: Upgrade: Setting container_image for all ceph-exporter 2024-04-25T17:27:02.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:02 smithi069 ceph-mon[80239]: Upgrade: Setting container_image for all iscsi 2024-04-25T17:27:02.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:02 smithi069 ceph-mon[80239]: Upgrade: Setting container_image for all nfs 2024-04-25T17:27:02.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:02 smithi069 ceph-mon[80239]: Upgrade: Setting container_image for all nvmeof 2024-04-25T17:27:04.392 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:04 smithi069 ceph-mon[80239]: pgmap v213: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 7.4 MiB/s rd, 170 B/s wr, 5 op/s 2024-04-25T17:27:04.392 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:04 smithi069 ceph-mon[80239]: Upgrade: Updating node-exporter.smithi037 (1/2) 2024-04-25T17:27:04.392 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:04 smithi069 ceph-mon[80239]: Deploying daemon node-exporter.smithi037 on smithi037 2024-04-25T17:27:04.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:04 smithi037 ceph-mon[90844]: pgmap v213: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 7.4 MiB/s rd, 170 B/s wr, 5 op/s 2024-04-25T17:27:04.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:04 smithi037 ceph-mon[90844]: Upgrade: Updating node-exporter.smithi037 (1/2) 2024-04-25T17:27:04.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:04 smithi037 ceph-mon[90844]: Deploying daemon node-exporter.smithi037 on smithi037 2024-04-25T17:27:06.315 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:06 smithi037 ceph-mon[90844]: pgmap v214: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 6.1 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-04-25T17:27:06.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:06 smithi069 ceph-mon[80239]: pgmap v214: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 6.1 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-04-25T17:27:07.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:07 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:07.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:07 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:07.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:07 smithi069 ceph-mon[80239]: pgmap v215: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 9.7 MiB/s rd, 4.3 KiB/s wr, 8 op/s 2024-04-25T17:27:07.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:07 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:07.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:07 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:07.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:07 smithi037 ceph-mon[90844]: pgmap v215: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 9.7 MiB/s rd, 4.3 KiB/s wr, 8 op/s 2024-04-25T17:27:08.768 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:08 smithi069 ceph-mon[80239]: Upgrade: Updating node-exporter.smithi069 (2/2) 2024-04-25T17:27:08.768 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:08 smithi069 ceph-mon[80239]: Deploying daemon node-exporter.smithi069 on smithi069 2024-04-25T17:27:08.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:08 smithi037 ceph-mon[90844]: Upgrade: Updating node-exporter.smithi069 (2/2) 2024-04-25T17:27:08.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:08 smithi037 ceph-mon[90844]: Deploying daemon node-exporter.smithi069 on smithi069 2024-04-25T17:27:09.817 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:09 smithi069 ceph-mon[80239]: pgmap v216: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4.2 KiB/s wr, 9 op/s 2024-04-25T17:27:09.821 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:09 smithi037 ceph-mon[90844]: pgmap v216: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 4.2 KiB/s wr, 9 op/s 2024-04-25T17:27:11.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:11 smithi069 ceph-mon[80239]: pgmap v217: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 4.2 KiB/s wr, 9 op/s 2024-04-25T17:27:11.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:11 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:11.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:11 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:11.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:11 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:27:12.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:11 smithi037 ceph-mon[90844]: pgmap v217: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 4.2 KiB/s wr, 9 op/s 2024-04-25T17:27:12.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:11 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:12.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:11 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:12.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:11 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:27:12.359 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.356+0000 7f83612d6700 1 -- 172.21.15.37:0/59440838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f835c0fdfd0 msgr2=0x7f835c0fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:27:12.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.356+0000 7f83612d6700 1 --2- 172.21.15.37:0/59440838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f835c0fdfd0 0x7f835c0fe440 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8350004940 tx=0x7f8350009e30 comp rx=0 tx=0).stop 2024-04-25T17:27:12.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.356+0000 7f83612d6700 1 -- 172.21.15.37:0/59440838 shutdown_connections 2024-04-25T17:27:12.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.356+0000 7f83612d6700 1 --2- 172.21.15.37:0/59440838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f835c0fdfd0 0x7f835c0fe440 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:12.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.356+0000 7f83612d6700 1 --2- 172.21.15.37:0/59440838 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f835c0fce60 0x7f835c0fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:12.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.356+0000 7f83612d6700 1 -- 172.21.15.37:0/59440838 >> 172.21.15.37:0/59440838 conn(0x7f835c0f8540 msgr2=0x7f835c0fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:27:12.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.356+0000 7f83612d6700 1 -- 172.21.15.37:0/59440838 shutdown_connections 2024-04-25T17:27:12.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.356+0000 7f83612d6700 1 -- 172.21.15.37:0/59440838 wait complete. 2024-04-25T17:27:12.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.357+0000 7f83612d6700 1 Processor -- start 2024-04-25T17:27:12.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.357+0000 7f83612d6700 1 -- start start 2024-04-25T17:27:12.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.357+0000 7f83612d6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f835c0fce60 0x7f835c10d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:27:12.360 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.357+0000 7f83612d6700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f835c0fdfd0 0x7f835c10de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:27:12.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.357+0000 7f83612d6700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f835c10e400 con 0x7f835c0fce60 2024-04-25T17:27:12.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.357+0000 7f83612d6700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f835c10e570 con 0x7f835c0fdfd0 2024-04-25T17:27:12.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.357+0000 7f835affd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f835c0fce60 0x7f835c10d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:27:12.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.357+0000 7f835affd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f835c0fce60 0x7f835c10d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53910/0 (socket says 172.21.15.37:53910) 2024-04-25T17:27:12.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.357+0000 7f835affd700 1 -- 172.21.15.37:0/2131333619 learned_addr learned my addr 172.21.15.37:0/2131333619 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:27:12.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.357+0000 7f835a7fc700 1 --2- 172.21.15.37:0/2131333619 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f835c0fdfd0 0x7f835c10de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:27:12.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.358+0000 7f835affd700 1 -- 172.21.15.37:0/2131333619 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f835c0fdfd0 msgr2=0x7f835c10de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:27:12.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.358+0000 7f835affd700 1 --2- 172.21.15.37:0/2131333619 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f835c0fdfd0 0x7f835c10de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:12.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.358+0000 7f835affd700 1 -- 172.21.15.37:0/2131333619 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8350005040 con 0x7f835c0fce60 2024-04-25T17:27:12.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.358+0000 7f835affd700 1 --2- 172.21.15.37:0/2131333619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f835c0fce60 0x7f835c10d8c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f834c00eb40 tx=0x7f834c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:27:12.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.358+0000 7f83437fe700 1 -- 172.21.15.37:0/2131333619 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f834c007cc0 con 0x7f835c0fce60 2024-04-25T17:27:12.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.358+0000 7f83437fe700 1 -- 172.21.15.37:0/2131333619 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f834c00f040 con 0x7f835c0fce60 2024-04-25T17:27:12.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.358+0000 7f83612d6700 1 -- 172.21.15.37:0/2131333619 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f835c112f70 con 0x7f835c0fce60 2024-04-25T17:27:12.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.358+0000 7f83437fe700 1 -- 172.21.15.37:0/2131333619 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f834c009620 con 0x7f835c0fce60 2024-04-25T17:27:12.362 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.358+0000 7f83612d6700 1 -- 172.21.15.37:0/2131333619 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f835c113420 con 0x7f835c0fce60 2024-04-25T17:27:12.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.359+0000 7f83612d6700 1 -- 172.21.15.37:0/2131333619 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f835c04c710 con 0x7f835c0fce60 2024-04-25T17:27:12.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.360+0000 7f83437fe700 1 -- 172.21.15.37:0/2131333619 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f834c009780 con 0x7f835c0fce60 2024-04-25T17:27:12.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.360+0000 7f83437fe700 1 --2- 172.21.15.37:0/2131333619 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f8344076b80 0x7f8344079030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:27:12.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.360+0000 7f83437fe700 1 -- 172.21.15.37:0/2131333619 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f834c097fd0 con 0x7f835c0fce60 2024-04-25T17:27:12.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.360+0000 7f835a7fc700 1 --2- 172.21.15.37:0/2131333619 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f8344076b80 0x7f8344079030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:27:12.363 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.361+0000 7f835a7fc700 1 --2- 172.21.15.37:0/2131333619 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f8344076b80 0x7f8344079030 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f835000b0d0 tx=0x7f8350009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:27:12.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.365+0000 7f83437fe700 1 -- 172.21.15.37:0/2131333619 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f834c060b60 con 0x7f835c0fce60 2024-04-25T17:27:12.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.597+0000 7f83612d6700 1 -- 172.21.15.37:0/2131333619 --> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f835c1022a0 con 0x7f8344076b80 2024-04-25T17:27:12.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.598+0000 7f83437fe700 1 -- 172.21.15.37:0/2131333619 <== mgr.34104 v2:172.21.15.37:6800/783197737 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7f835c1022a0 con 0x7f8344076b80 2024-04-25T17:27:12.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.600+0000 7f83612d6700 1 -- 172.21.15.37:0/2131333619 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f8344076b80 msgr2=0x7f8344079030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:27:12.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.601+0000 7f83612d6700 1 --2- 172.21.15.37:0/2131333619 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f8344076b80 0x7f8344079030 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f835000b0d0 tx=0x7f8350009e30 comp rx=0 tx=0).stop 2024-04-25T17:27:12.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.601+0000 7f83612d6700 1 -- 172.21.15.37:0/2131333619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f835c0fce60 msgr2=0x7f835c10d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:27:12.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.601+0000 7f83612d6700 1 --2- 172.21.15.37:0/2131333619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f835c0fce60 0x7f835c10d8c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f834c00eb40 tx=0x7f834c00b040 comp rx=0 tx=0).stop 2024-04-25T17:27:12.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.601+0000 7f83612d6700 1 -- 172.21.15.37:0/2131333619 shutdown_connections 2024-04-25T17:27:12.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.601+0000 7f83612d6700 1 --2- 172.21.15.37:0/2131333619 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f8344076b80 0x7f8344079030 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:12.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.601+0000 7f83612d6700 1 --2- 172.21.15.37:0/2131333619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f835c0fce60 0x7f835c10d8c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:12.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.601+0000 7f83612d6700 1 --2- 172.21.15.37:0/2131333619 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f835c0fdfd0 0x7f835c10de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:12.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.601+0000 7f83612d6700 1 -- 172.21.15.37:0/2131333619 >> 172.21.15.37:0/2131333619 conn(0x7f835c0f8540 msgr2=0x7f835c0f9b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:27:12.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.601+0000 7f83612d6700 1 -- 172.21.15.37:0/2131333619 shutdown_connections 2024-04-25T17:27:12.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.601+0000 7f83612d6700 1 -- 172.21.15.37:0/2131333619 wait complete. 2024-04-25T17:27:12.612 INFO:teuthology.orchestra.run.smithi037.stdout:true 2024-04-25T17:27:12.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.708+0000 7f280d0d7700 1 -- 172.21.15.37:0/1350191891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2808066ed0 msgr2=0x7f28080ff9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:27:12.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.708+0000 7f280d0d7700 1 --2- 172.21.15.37:0/1350191891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2808066ed0 0x7f28080ff9a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f27f8004940 tx=0x7f27f8009e30 comp rx=0 tx=0).stop 2024-04-25T17:27:12.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.708+0000 7f280d0d7700 1 -- 172.21.15.37:0/1350191891 shutdown_connections 2024-04-25T17:27:12.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.708+0000 7f280d0d7700 1 --2- 172.21.15.37:0/1350191891 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f28080ffee0 0x7f2808102300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:12.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.708+0000 7f280d0d7700 1 --2- 172.21.15.37:0/1350191891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2808066ed0 0x7f28080ff9a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:12.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.709+0000 7f280d0d7700 1 -- 172.21.15.37:0/1350191891 >> 172.21.15.37:0/1350191891 conn(0x7f28080f7430 msgr2=0x7f28080f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:27:12.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.709+0000 7f280d0d7700 1 -- 172.21.15.37:0/1350191891 shutdown_connections 2024-04-25T17:27:12.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.709+0000 7f280d0d7700 1 -- 172.21.15.37:0/1350191891 wait complete. 2024-04-25T17:27:12.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.709+0000 7f280d0d7700 1 Processor -- start 2024-04-25T17:27:12.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.709+0000 7f280d0d7700 1 -- start start 2024-04-25T17:27:12.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.709+0000 7f280d0d7700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2808066ed0 0x7f28080fd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:27:12.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.709+0000 7f280d0d7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28080ffee0 0x7f28080fb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:27:12.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.709+0000 7f280d0d7700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28080fd7a0 con 0x7f28080ffee0 2024-04-25T17:27:12.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.709+0000 7f280d0d7700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28080fbde0 con 0x7f2808066ed0 2024-04-25T17:27:12.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.710+0000 7f280659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28080ffee0 0x7f28080fb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:27:12.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.710+0000 7f2806d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2808066ed0 0x7f28080fd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:27:12.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.710+0000 7f280659c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28080ffee0 0x7f28080fb8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53918/0 (socket says 172.21.15.37:53918) 2024-04-25T17:27:12.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.710+0000 7f280659c700 1 -- 172.21.15.37:0/527640331 learned_addr learned my addr 172.21.15.37:0/527640331 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:27:12.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.710+0000 7f280659c700 1 -- 172.21.15.37:0/527640331 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2808066ed0 msgr2=0x7f28080fd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:27:12.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.710+0000 7f280659c700 1 --2- 172.21.15.37:0/527640331 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2808066ed0 0x7f28080fd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:12.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.710+0000 7f280659c700 1 -- 172.21.15.37:0/527640331 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f8005040 con 0x7f28080ffee0 2024-04-25T17:27:12.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.710+0000 7f2806d9d700 1 --2- 172.21.15.37:0/527640331 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2808066ed0 0x7f28080fd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T17:27:12.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.710+0000 7f280659c700 1 --2- 172.21.15.37:0/527640331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28080ffee0 0x7f28080fb8a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f27fc00eb40 tx=0x7f27fc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:27:12.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.710+0000 7f27ef7fe700 1 -- 172.21.15.37:0/527640331 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27fc007cc0 con 0x7f28080ffee0 2024-04-25T17:27:12.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.710+0000 7f27ef7fe700 1 -- 172.21.15.37:0/527640331 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f27fc00f040 con 0x7f28080ffee0 2024-04-25T17:27:12.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.710+0000 7f280d0d7700 1 -- 172.21.15.37:0/527640331 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28080fc060 con 0x7f28080ffee0 2024-04-25T17:27:12.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.710+0000 7f27ef7fe700 1 -- 172.21.15.37:0/527640331 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27fc00ca10 con 0x7f28080ffee0 2024-04-25T17:27:12.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.710+0000 7f280d0d7700 1 -- 172.21.15.37:0/527640331 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28080fc5a0 con 0x7f28080ffee0 2024-04-25T17:27:12.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.711+0000 7f280d0d7700 1 -- 172.21.15.37:0/527640331 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f280804c710 con 0x7f28080ffee0 2024-04-25T17:27:12.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.712+0000 7f27ef7fe700 1 -- 172.21.15.37:0/527640331 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f27fc00cc80 con 0x7f28080ffee0 2024-04-25T17:27:12.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.712+0000 7f27ef7fe700 1 --2- 172.21.15.37:0/527640331 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f27f0076b80 0x7f27f0079030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:27:12.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.713+0000 7f27ef7fe700 1 -- 172.21.15.37:0/527640331 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f27fc097f60 con 0x7f28080ffee0 2024-04-25T17:27:12.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.713+0000 7f2806d9d700 1 --2- 172.21.15.37:0/527640331 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f27f0076b80 0x7f27f0079030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:27:12.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.713+0000 7f2806d9d700 1 --2- 172.21.15.37:0/527640331 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f27f0076b80 0x7f27f0079030 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f27f8013870 tx=0x7f27f8009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:27:12.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.718+0000 7f27ef7fe700 1 -- 172.21.15.37:0/527640331 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f27fc0ccff0 con 0x7f28080ffee0 2024-04-25T17:27:12.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.950+0000 7f280d0d7700 1 -- 172.21.15.37:0/527640331 --> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f28080f8f20 con 0x7f27f0076b80 2024-04-25T17:27:12.951 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:12 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:27:12.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.952+0000 7f27ef7fe700 1 -- 172.21.15.37:0/527640331 <== mgr.34104 v2:172.21.15.37:6800/783197737 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7f28080f8f20 con 0x7f27f0076b80 2024-04-25T17:27:12.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.954+0000 7f280d0d7700 1 -- 172.21.15.37:0/527640331 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f27f0076b80 msgr2=0x7f27f0079030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:27:12.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.954+0000 7f280d0d7700 1 --2- 172.21.15.37:0/527640331 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f27f0076b80 0x7f27f0079030 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f27f8013870 tx=0x7f27f8009e30 comp rx=0 tx=0).stop 2024-04-25T17:27:12.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.954+0000 7f280d0d7700 1 -- 172.21.15.37:0/527640331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28080ffee0 msgr2=0x7f28080fb8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:27:12.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.954+0000 7f280d0d7700 1 --2- 172.21.15.37:0/527640331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28080ffee0 0x7f28080fb8a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f27fc00eb40 tx=0x7f27fc00b040 comp rx=0 tx=0).stop 2024-04-25T17:27:12.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.954+0000 7f280d0d7700 1 -- 172.21.15.37:0/527640331 shutdown_connections 2024-04-25T17:27:12.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.954+0000 7f280d0d7700 1 --2- 172.21.15.37:0/527640331 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f27f0076b80 0x7f27f0079030 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:12.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.954+0000 7f280d0d7700 1 --2- 172.21.15.37:0/527640331 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2808066ed0 0x7f28080fd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:12.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.954+0000 7f280d0d7700 1 --2- 172.21.15.37:0/527640331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28080ffee0 0x7f28080fb8a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:12.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.954+0000 7f280d0d7700 1 -- 172.21.15.37:0/527640331 >> 172.21.15.37:0/527640331 conn(0x7f28080f7430 msgr2=0x7f28080f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:27:12.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.954+0000 7f280d0d7700 1 -- 172.21.15.37:0/527640331 shutdown_connections 2024-04-25T17:27:12.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:12.954+0000 7f280d0d7700 1 -- 172.21.15.37:0/527640331 wait complete. 2024-04-25T17:27:13.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.060+0000 7f1a684b1700 1 -- 172.21.15.37:0/3339176687 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a600fe080 msgr2=0x7f1a600fe4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:27:13.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.060+0000 7f1a684b1700 1 --2- 172.21.15.37:0/3339176687 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a600fe080 0x7f1a600fe4f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1a50004940 tx=0x7f1a50009e30 comp rx=0 tx=0).stop 2024-04-25T17:27:13.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.060+0000 7f1a684b1700 1 -- 172.21.15.37:0/3339176687 shutdown_connections 2024-04-25T17:27:13.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.060+0000 7f1a684b1700 1 --2- 172.21.15.37:0/3339176687 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a600fe080 0x7f1a600fe4f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:13.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.060+0000 7f1a684b1700 1 --2- 172.21.15.37:0/3339176687 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a600fce80 0x7f1a600fd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:13.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.060+0000 7f1a684b1700 1 -- 172.21.15.37:0/3339176687 >> 172.21.15.37:0/3339176687 conn(0x7f1a600f8590 msgr2=0x7f1a600fa9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:27:13.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.060+0000 7f1a684b1700 1 -- 172.21.15.37:0/3339176687 shutdown_connections 2024-04-25T17:27:13.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.060+0000 7f1a684b1700 1 -- 172.21.15.37:0/3339176687 wait complete. 2024-04-25T17:27:13.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.060+0000 7f1a684b1700 1 Processor -- start 2024-04-25T17:27:13.061 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.060+0000 7f1a684b1700 1 -- start start 2024-04-25T17:27:13.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.061+0000 7f1a684b1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a600fce80 0x7f1a6010da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:27:13.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.061+0000 7f1a684b1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a600fe080 0x7f1a6010df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:27:13.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.061+0000 7f1a684b1700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6010e570 con 0x7f1a600fce80 2024-04-25T17:27:13.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.061+0000 7f1a684b1700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6010edc0 con 0x7f1a600fe080 2024-04-25T17:27:13.063 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.061+0000 7f1a6624d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a600fce80 0x7f1a6010da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:27:13.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.061+0000 7f1a6624d700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a600fce80 0x7f1a6010da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53924/0 (socket says 172.21.15.37:53924) 2024-04-25T17:27:13.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.061+0000 7f1a6624d700 1 -- 172.21.15.37:0/2533950508 learned_addr learned my addr 172.21.15.37:0/2533950508 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:27:13.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.061+0000 7f1a65a4c700 1 --2- 172.21.15.37:0/2533950508 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a600fe080 0x7f1a6010df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:27:13.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.061+0000 7f1a6624d700 1 -- 172.21.15.37:0/2533950508 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a600fe080 msgr2=0x7f1a6010df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:27:13.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.061+0000 7f1a6624d700 1 --2- 172.21.15.37:0/2533950508 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a600fe080 0x7f1a6010df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:13.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.061+0000 7f1a6624d700 1 -- 172.21.15.37:0/2533950508 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a50005040 con 0x7f1a600fce80 2024-04-25T17:27:13.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.061+0000 7f1a6624d700 1 --2- 172.21.15.37:0/2533950508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a600fce80 0x7f1a6010da30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c002a80 tx=0x7f1a5c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:27:13.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.061+0000 7f1a56ffd700 1 -- 172.21.15.37:0/2533950508 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a5c007cc0 con 0x7f1a600fce80 2024-04-25T17:27:13.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.061+0000 7f1a56ffd700 1 -- 172.21.15.37:0/2533950508 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1a5c00f040 con 0x7f1a600fce80 2024-04-25T17:27:13.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.061+0000 7f1a684b1700 1 -- 172.21.15.37:0/2533950508 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a6010f0a0 con 0x7f1a600fce80 2024-04-25T17:27:13.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.061+0000 7f1a56ffd700 1 -- 172.21.15.37:0/2533950508 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a5c00da30 con 0x7f1a600fce80 2024-04-25T17:27:13.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.062+0000 7f1a684b1700 1 -- 172.21.15.37:0/2533950508 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a6010f5e0 con 0x7f1a600fce80 2024-04-25T17:27:13.064 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.062+0000 7f1a684b1700 1 -- 172.21.15.37:0/2533950508 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a6005f5c0 con 0x7f1a600fce80 2024-04-25T17:27:13.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.063+0000 7f1a56ffd700 1 -- 172.21.15.37:0/2533950508 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f1a5c00db90 con 0x7f1a600fce80 2024-04-25T17:27:13.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.064+0000 7f1a56ffd700 1 --2- 172.21.15.37:0/2533950508 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f1a4c076b80 0x7f1a4c079030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:27:13.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.064+0000 7f1a56ffd700 1 -- 172.21.15.37:0/2533950508 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f1a5c0980d0 con 0x7f1a600fce80 2024-04-25T17:27:13.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.064+0000 7f1a65a4c700 1 --2- 172.21.15.37:0/2533950508 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f1a4c076b80 0x7f1a4c079030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:27:13.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.064+0000 7f1a65a4c700 1 --2- 172.21.15.37:0/2533950508 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f1a4c076b80 0x7f1a4c079030 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1a50009fd0 tx=0x7f1a50009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:27:13.069 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.069+0000 7f1a56ffd700 1 -- 172.21.15.37:0/2533950508 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f1a5c060bb0 con 0x7f1a600fce80 2024-04-25T17:27:13.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:12 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:27:13.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.289+0000 7f1a684b1700 1 -- 172.21.15.37:0/2533950508 --> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1a6010f9d0 con 0x7f1a4c076b80 2024-04-25T17:27:13.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.299+0000 7f1a56ffd700 1 -- 172.21.15.37:0/2533950508 <== mgr.34104 v2:172.21.15.37:6800/783197737 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f1a6010f9d0 con 0x7f1a4c076b80 2024-04-25T17:27:13.300 INFO:teuthology.orchestra.run.smithi037.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-25T17:27:13.300 INFO:teuthology.orchestra.run.smithi037.stdout:alertmanager.smithi037 smithi037 *:9093,9094 running (8m) 55s ago 17m 24.8M - 0.25.0 c8568f914cd2 18aed8f409ee 2024-04-25T17:27:13.300 INFO:teuthology.orchestra.run.smithi037.stdout:crash.smithi037 smithi037 running (5m) 55s ago 17m 6660k - 19.0.0-3291-g994e2f20 d53c96779a29 639584ea5855 2024-04-25T17:27:13.300 INFO:teuthology.orchestra.run.smithi037.stdout:crash.smithi069 smithi069 running (5m) 0s ago 16m 6665k - 19.0.0-3291-g994e2f20 d53c96779a29 ee5db16733a7 2024-04-25T17:27:13.300 INFO:teuthology.orchestra.run.smithi037.stdout:grafana.smithi037 smithi037 *:3000 running (8m) 55s ago 16m 85.6M - 9.4.7 954c08fa6188 1eff3ea3f9b0 2024-04-25T17:27:13.300 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi037.ksmixc smithi037 running (80s) 55s ago 11m 79.3M - 19.0.0-3291-g994e2f20 d53c96779a29 398075bc956a 2024-04-25T17:27:13.300 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi037.ovkrpq smithi037 running (60s) 55s ago 11m 78.9M - 19.0.0-3291-g994e2f20 d53c96779a29 ab3bcb631150 2024-04-25T17:27:13.300 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi069.cpprst smithi069 running (21s) 0s ago 11m 80.1M - 19.0.0-3291-g994e2f20 d53c96779a29 8172e0b6da3e 2024-04-25T17:27:13.300 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi069.ytlqcf smithi069 running (41s) 0s ago 11m 80.4M - 19.0.0-3291-g994e2f20 d53c96779a29 0e58af66f5b5 2024-04-25T17:27:13.301 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.smithi037.txrgxl smithi037 *:8443,9283,8765 running (7m) 55s ago 18m 578M - 19.0.0-3291-g994e2f20 d53c96779a29 e9653fc62df9 2024-04-25T17:27:13.301 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.smithi069.mmuhdo smithi069 *:8443,9283,8765 running (6m) 0s ago 15m 521M - 19.0.0-3291-g994e2f20 d53c96779a29 6820207b4019 2024-04-25T17:27:13.301 INFO:teuthology.orchestra.run.smithi037.stdout:mon.smithi037 smithi037 running (6m) 55s ago 18m 115M 2048M 19.0.0-3291-g994e2f20 d53c96779a29 1b349f3af69d 2024-04-25T17:27:13.301 INFO:teuthology.orchestra.run.smithi037.stdout:mon.smithi069 smithi069 running (5m) 0s ago 15m 106M 2048M 19.0.0-3291-g994e2f20 d53c96779a29 7744dbe81b50 2024-04-25T17:27:13.301 INFO:teuthology.orchestra.run.smithi037.stdout:node-exporter.smithi037 smithi037 *:9100 starting - - - - 2024-04-25T17:27:13.301 INFO:teuthology.orchestra.run.smithi037.stdout:node-exporter.smithi069 smithi069 *:9100 running (3s) 0s ago 15m 5444k - 1.5.0 0da6a335fe13 3f61f3499944 2024-04-25T17:27:13.301 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0 smithi037 running (4m) 55s ago 15m 172M 1559M 19.0.0-3291-g994e2f20 d53c96779a29 e97538cb8b4f 2024-04-25T17:27:13.301 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1 smithi037 running (4m) 55s ago 14m 178M 1559M 19.0.0-3291-g994e2f20 d53c96779a29 6cf158192aae 2024-04-25T17:27:13.301 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2 smithi037 running (3m) 55s ago 14m 166M 1559M 19.0.0-3291-g994e2f20 d53c96779a29 a0b57bba2ebf 2024-04-25T17:27:13.301 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3 smithi069 running (2m) 0s ago 13m 191M 2581M 19.0.0-3291-g994e2f20 d53c96779a29 d1aa15d6b575 2024-04-25T17:27:13.301 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4 smithi069 running (2m) 0s ago 13m 175M 2581M 19.0.0-3291-g994e2f20 d53c96779a29 ad76a3d0fecb 2024-04-25T17:27:13.301 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5 smithi069 running (102s) 0s ago 12m 165M 2581M 19.0.0-3291-g994e2f20 d53c96779a29 dea8b059441b 2024-04-25T17:27:13.301 INFO:teuthology.orchestra.run.smithi037.stdout:prometheus.smithi037 smithi037 *:9095 running (6m) 55s ago 16m 64.6M - 2.43.0 a07b618ecd1d 2c5a268ffc1f 2024-04-25T17:27:13.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.301+0000 7f1a684b1700 1 -- 172.21.15.37:0/2533950508 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f1a4c076b80 msgr2=0x7f1a4c079030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:27:13.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.301+0000 7f1a684b1700 1 --2- 172.21.15.37:0/2533950508 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f1a4c076b80 0x7f1a4c079030 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1a50009fd0 tx=0x7f1a50009e30 comp rx=0 tx=0).stop 2024-04-25T17:27:13.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.301+0000 7f1a684b1700 1 -- 172.21.15.37:0/2533950508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a600fce80 msgr2=0x7f1a6010da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:27:13.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.301+0000 7f1a684b1700 1 --2- 172.21.15.37:0/2533950508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a600fce80 0x7f1a6010da30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c002a80 tx=0x7f1a5c004600 comp rx=0 tx=0).stop 2024-04-25T17:27:13.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.301+0000 7f1a684b1700 1 -- 172.21.15.37:0/2533950508 shutdown_connections 2024-04-25T17:27:13.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.301+0000 7f1a684b1700 1 --2- 172.21.15.37:0/2533950508 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f1a4c076b80 0x7f1a4c079030 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:13.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.301+0000 7f1a684b1700 1 --2- 172.21.15.37:0/2533950508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a600fce80 0x7f1a6010da30 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:13.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.301+0000 7f1a684b1700 1 --2- 172.21.15.37:0/2533950508 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a600fe080 0x7f1a6010df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:13.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.301+0000 7f1a684b1700 1 -- 172.21.15.37:0/2533950508 >> 172.21.15.37:0/2533950508 conn(0x7f1a600f8590 msgr2=0x7f1a600f9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:27:13.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.301+0000 7f1a684b1700 1 -- 172.21.15.37:0/2533950508 shutdown_connections 2024-04-25T17:27:13.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.301+0000 7f1a684b1700 1 -- 172.21.15.37:0/2533950508 wait complete. 2024-04-25T17:27:13.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.404+0000 7fbb3656b700 1 -- 172.21.15.37:0/285667873 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb30066f50 msgr2=0x7fbb30101db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:27:13.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.404+0000 7fbb3656b700 1 --2- 172.21.15.37:0/285667873 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb30066f50 0x7fbb30101db0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbb20004940 tx=0x7fbb20009e30 comp rx=0 tx=0).stop 2024-04-25T17:27:13.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.405+0000 7fbb3656b700 1 -- 172.21.15.37:0/285667873 shutdown_connections 2024-04-25T17:27:13.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.405+0000 7fbb3656b700 1 --2- 172.21.15.37:0/285667873 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb301022f0 0x7fbb301046d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:13.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.405+0000 7fbb3656b700 1 --2- 172.21.15.37:0/285667873 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb30066f50 0x7fbb30101db0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:13.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.405+0000 7fbb3656b700 1 -- 172.21.15.37:0/285667873 >> 172.21.15.37:0/285667873 conn(0x7fbb300f7440 msgr2=0x7fbb300f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:27:13.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.405+0000 7fbb3656b700 1 -- 172.21.15.37:0/285667873 shutdown_connections 2024-04-25T17:27:13.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.405+0000 7fbb3656b700 1 -- 172.21.15.37:0/285667873 wait complete. 2024-04-25T17:27:13.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.405+0000 7fbb3656b700 1 Processor -- start 2024-04-25T17:27:13.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.405+0000 7fbb3656b700 1 -- start start 2024-04-25T17:27:13.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.406+0000 7fbb3656b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb30066f50 0x7fbb3010fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:27:13.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.406+0000 7fbb3656b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb301022f0 0x7fbb30110080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:27:13.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.406+0000 7fbb3656b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb30110680 con 0x7fbb301022f0 2024-04-25T17:27:13.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.406+0000 7fbb3656b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb301107f0 con 0x7fbb30066f50 2024-04-25T17:27:13.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.406+0000 7fbb2f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb301022f0 0x7fbb30110080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:27:13.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.406+0000 7fbb2ffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb30066f50 0x7fbb3010fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:27:13.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.406+0000 7fbb2f7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb301022f0 0x7fbb30110080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53940/0 (socket says 172.21.15.37:53940) 2024-04-25T17:27:13.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.406+0000 7fbb2f7fe700 1 -- 172.21.15.37:0/1125521626 learned_addr learned my addr 172.21.15.37:0/1125521626 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:27:13.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.406+0000 7fbb2f7fe700 1 -- 172.21.15.37:0/1125521626 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb30066f50 msgr2=0x7fbb3010fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:27:13.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.406+0000 7fbb2f7fe700 1 --2- 172.21.15.37:0/1125521626 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb30066f50 0x7fbb3010fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:13.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.406+0000 7fbb2f7fe700 1 -- 172.21.15.37:0/1125521626 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb20005040 con 0x7fbb301022f0 2024-04-25T17:27:13.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.406+0000 7fbb2f7fe700 1 --2- 172.21.15.37:0/1125521626 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb301022f0 0x7fbb30110080 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbb2400eb40 tx=0x7fbb2400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:27:13.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.406+0000 7fbb2cff9700 1 -- 172.21.15.37:0/1125521626 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb24007cc0 con 0x7fbb301022f0 2024-04-25T17:27:13.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.406+0000 7fbb3656b700 1 -- 172.21.15.37:0/1125521626 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb301151f0 con 0x7fbb301022f0 2024-04-25T17:27:13.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.406+0000 7fbb2cff9700 1 -- 172.21.15.37:0/1125521626 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbb2400f040 con 0x7fbb301022f0 2024-04-25T17:27:13.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.407+0000 7fbb2cff9700 1 -- 172.21.15.37:0/1125521626 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbb2400ca10 con 0x7fbb301022f0 2024-04-25T17:27:13.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.407+0000 7fbb3656b700 1 -- 172.21.15.37:0/1125521626 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb30115730 con 0x7fbb301022f0 2024-04-25T17:27:13.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.408+0000 7fbb3656b700 1 -- 172.21.15.37:0/1125521626 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb3004c710 con 0x7fbb301022f0 2024-04-25T17:27:13.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.408+0000 7fbb2cff9700 1 -- 172.21.15.37:0/1125521626 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7fbb2400cc80 con 0x7fbb301022f0 2024-04-25T17:27:13.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.409+0000 7fbb2cff9700 1 --2- 172.21.15.37:0/1125521626 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fbb18076b90 0x7fbb18079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:27:13.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.409+0000 7fbb2cff9700 1 -- 172.21.15.37:0/1125521626 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fbb24097f40 con 0x7fbb301022f0 2024-04-25T17:27:13.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.409+0000 7fbb2ffff700 1 --2- 172.21.15.37:0/1125521626 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fbb18076b90 0x7fbb18079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:27:13.410 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.409+0000 7fbb2ffff700 1 --2- 172.21.15.37:0/1125521626 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fbb18076b90 0x7fbb18079040 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbb20009b30 tx=0x7fbb20009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:27:13.414 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.414+0000 7fbb2cff9700 1 -- 172.21.15.37:0/1125521626 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fbb24060ad0 con 0x7fbb301022f0 2024-04-25T17:27:13.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.726+0000 7fbb3656b700 1 -- 172.21.15.37:0/1125521626 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbb30115b60 con 0x7fbb301022f0 2024-04-25T17:27:13.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.727+0000 7fbb2cff9700 1 -- 172.21.15.37:0/1125521626 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7fbb24060470 con 0x7fbb301022f0 2024-04-25T17:27:13.728 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-25T17:27:13.728 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": { 2024-04-25T17:27:13.728 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 2 2024-04-25T17:27:13.728 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:27:13.728 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": { 2024-04-25T17:27:13.729 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 2 2024-04-25T17:27:13.729 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:27:13.729 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": { 2024-04-25T17:27:13.729 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 6 2024-04-25T17:27:13.729 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:27:13.729 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": { 2024-04-25T17:27:13.729 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 4 2024-04-25T17:27:13.729 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:27:13.729 INFO:teuthology.orchestra.run.smithi037.stdout: "overall": { 2024-04-25T17:27:13.729 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 14 2024-04-25T17:27:13.729 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-04-25T17:27:13.729 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-25T17:27:13.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.729+0000 7fbb3656b700 1 -- 172.21.15.37:0/1125521626 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fbb18076b90 msgr2=0x7fbb18079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:27:13.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.729+0000 7fbb3656b700 1 --2- 172.21.15.37:0/1125521626 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fbb18076b90 0x7fbb18079040 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbb20009b30 tx=0x7fbb20009e30 comp rx=0 tx=0).stop 2024-04-25T17:27:13.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.729+0000 7fbb3656b700 1 -- 172.21.15.37:0/1125521626 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb301022f0 msgr2=0x7fbb30110080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:27:13.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.729+0000 7fbb3656b700 1 --2- 172.21.15.37:0/1125521626 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb301022f0 0x7fbb30110080 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbb2400eb40 tx=0x7fbb2400b040 comp rx=0 tx=0).stop 2024-04-25T17:27:13.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.729+0000 7fbb3656b700 1 -- 172.21.15.37:0/1125521626 shutdown_connections 2024-04-25T17:27:13.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.729+0000 7fbb3656b700 1 --2- 172.21.15.37:0/1125521626 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fbb18076b90 0x7fbb18079040 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:13.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.729+0000 7fbb3656b700 1 --2- 172.21.15.37:0/1125521626 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb30066f50 0x7fbb3010fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:13.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.729+0000 7fbb3656b700 1 --2- 172.21.15.37:0/1125521626 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbb301022f0 0x7fbb30110080 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:13.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.729+0000 7fbb3656b700 1 -- 172.21.15.37:0/1125521626 >> 172.21.15.37:0/1125521626 conn(0x7fbb300f7440 msgr2=0x7fbb300f7810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:27:13.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.729+0000 7fbb3656b700 1 -- 172.21.15.37:0/1125521626 shutdown_connections 2024-04-25T17:27:13.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.729+0000 7fbb3656b700 1 -- 172.21.15.37:0/1125521626 wait complete. 2024-04-25T17:27:13.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.834+0000 7f5201519700 1 -- 172.21.15.37:0/3679740689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51fc0fbce0 msgr2=0x7f51fc0fc0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:27:13.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.834+0000 7f5201519700 1 --2- 172.21.15.37:0/3679740689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51fc0fbce0 0x7f51fc0fc0f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f51ec004940 tx=0x7f51ec009e30 comp rx=0 tx=0).stop 2024-04-25T17:27:13.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.834+0000 7f5201519700 1 -- 172.21.15.37:0/3679740689 shutdown_connections 2024-04-25T17:27:13.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.834+0000 7f5201519700 1 --2- 172.21.15.37:0/3679740689 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51fc0fcf90 0x7f51fc0fd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:13.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.834+0000 7f5201519700 1 --2- 172.21.15.37:0/3679740689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51fc0fbce0 0x7f51fc0fc0f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:13.835 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.834+0000 7f5201519700 1 -- 172.21.15.37:0/3679740689 >> 172.21.15.37:0/3679740689 conn(0x7f51fc0f7440 msgr2=0x7f51fc0f9870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:27:13.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.835+0000 7f5201519700 1 -- 172.21.15.37:0/3679740689 shutdown_connections 2024-04-25T17:27:13.836 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.835+0000 7f5201519700 1 -- 172.21.15.37:0/3679740689 wait complete. 2024-04-25T17:27:13.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.835+0000 7f5201519700 1 Processor -- start 2024-04-25T17:27:13.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.835+0000 7f5201519700 1 -- start start 2024-04-25T17:27:13.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.835+0000 7f5201519700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51fc0fbce0 0x7f51fc10c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:27:13.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.835+0000 7f5201519700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51fc0fcf90 0x7f51fc10ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:27:13.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.835+0000 7f5201519700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51fc10d2d0 con 0x7f51fc0fcf90 2024-04-25T17:27:13.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.835+0000 7f5201519700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51fc10d440 con 0x7f51fc0fbce0 2024-04-25T17:27:13.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.836+0000 7f51fa7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51fc0fcf90 0x7f51fc10ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:27:13.837 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.836+0000 7f51fa7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51fc0fcf90 0x7f51fc10ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53954/0 (socket says 172.21.15.37:53954) 2024-04-25T17:27:13.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.836+0000 7f51fa7fc700 1 -- 172.21.15.37:0/3472011427 learned_addr learned my addr 172.21.15.37:0/3472011427 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:27:13.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.836+0000 7f51faffd700 1 --2- 172.21.15.37:0/3472011427 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51fc0fbce0 0x7f51fc10c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:27:13.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.836+0000 7f51fa7fc700 1 -- 172.21.15.37:0/3472011427 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51fc0fbce0 msgr2=0x7f51fc10c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:27:13.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.836+0000 7f51fa7fc700 1 --2- 172.21.15.37:0/3472011427 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51fc0fbce0 0x7f51fc10c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:13.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.836+0000 7f51fa7fc700 1 -- 172.21.15.37:0/3472011427 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ec005040 con 0x7f51fc0fcf90 2024-04-25T17:27:13.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.836+0000 7f51fa7fc700 1 --2- 172.21.15.37:0/3472011427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51fc0fcf90 0x7f51fc10ccd0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f51f0002a80 tx=0x7f51f00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:27:13.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.836+0000 7f51e37fe700 1 -- 172.21.15.37:0/3472011427 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51f0007cc0 con 0x7f51fc0fcf90 2024-04-25T17:27:13.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.836+0000 7f51e37fe700 1 -- 172.21.15.37:0/3472011427 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f51f000f040 con 0x7f51fc0fcf90 2024-04-25T17:27:13.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.836+0000 7f5201519700 1 -- 172.21.15.37:0/3472011427 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51fc111ea0 con 0x7f51fc0fcf90 2024-04-25T17:27:13.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.836+0000 7f51e37fe700 1 -- 172.21.15.37:0/3472011427 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51f000dac0 con 0x7f51fc0fcf90 2024-04-25T17:27:13.838 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.836+0000 7f5201519700 1 -- 172.21.15.37:0/3472011427 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51fc112430 con 0x7f51fc0fcf90 2024-04-25T17:27:13.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.837+0000 7f5201519700 1 -- 172.21.15.37:0/3472011427 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51fc04c710 con 0x7f51fc0fcf90 2024-04-25T17:27:13.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.838+0000 7f51e37fe700 1 -- 172.21.15.37:0/3472011427 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f51f000dc20 con 0x7f51fc0fcf90 2024-04-25T17:27:13.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.838+0000 7f51e37fe700 1 --2- 172.21.15.37:0/3472011427 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f51e4076b80 0x7f51e4079030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:27:13.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.838+0000 7f51e37fe700 1 -- 172.21.15.37:0/3472011427 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f51f0097fd0 con 0x7f51fc0fcf90 2024-04-25T17:27:13.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.838+0000 7f51faffd700 1 --2- 172.21.15.37:0/3472011427 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f51e4076b80 0x7f51e4079030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:27:13.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.839+0000 7f51faffd700 1 --2- 172.21.15.37:0/3472011427 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f51e4076b80 0x7f51e4079030 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f51ec009fd0 tx=0x7f51ec009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:27:13.844 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:13.843+0000 7f51e37fe700 1 -- 172.21.15.37:0/3472011427 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f51f0060ab0 con 0x7f51fc0fcf90 2024-04-25T17:27:14.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.101+0000 7f5201519700 1 -- 172.21.15.37:0/3472011427 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f51fc1047d0 con 0x7f51fc0fcf90 2024-04-25T17:27:14.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.101+0000 7f51e37fe700 1 -- 172.21.15.37:0/3472011427 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 35 v35) v1 ==== 76+0+1963 (secure 0 0 0) 0x7f51f0060450 con 0x7f51fc0fcf90 2024-04-25T17:27:14.102 INFO:teuthology.orchestra.run.smithi037.stdout:e35 2024-04-25T17:27:14.102 INFO:teuthology.orchestra.run.smithi037.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-25T17:27:14.103 INFO:teuthology.orchestra.run.smithi037.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T17:27:14.103 INFO:teuthology.orchestra.run.smithi037.stdout:legacy client fscid: 1 2024-04-25T17:27:14.103 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:27:14.103 INFO:teuthology.orchestra.run.smithi037.stdout:Filesystem 'cephfs' (1) 2024-04-25T17:27:14.103 INFO:teuthology.orchestra.run.smithi037.stdout:fs_name cephfs 2024-04-25T17:27:14.103 INFO:teuthology.orchestra.run.smithi037.stdout:epoch 35 2024-04-25T17:27:14.103 INFO:teuthology.orchestra.run.smithi037.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-25T17:27:14.103 INFO:teuthology.orchestra.run.smithi037.stdout:created 2024-04-25T17:15:40.586130+0000 2024-04-25T17:27:14.103 INFO:teuthology.orchestra.run.smithi037.stdout:modified 2024-04-25T17:27:00.988207+0000 2024-04-25T17:27:14.103 INFO:teuthology.orchestra.run.smithi037.stdout:tableserver 0 2024-04-25T17:27:14.103 INFO:teuthology.orchestra.run.smithi037.stdout:root 0 2024-04-25T17:27:14.103 INFO:teuthology.orchestra.run.smithi037.stdout:session_timeout 60 2024-04-25T17:27:14.103 INFO:teuthology.orchestra.run.smithi037.stdout:session_autoclose 300 2024-04-25T17:27:14.103 INFO:teuthology.orchestra.run.smithi037.stdout:max_file_size 1099511627776 2024-04-25T17:27:14.103 INFO:teuthology.orchestra.run.smithi037.stdout:max_xattr_size 65536 2024-04-25T17:27:14.104 INFO:teuthology.orchestra.run.smithi037.stdout:required_client_features {} 2024-04-25T17:27:14.104 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure 0 2024-04-25T17:27:14.104 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure_osd_epoch 84 2024-04-25T17:27:14.104 INFO:teuthology.orchestra.run.smithi037.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-25T17:27:14.104 INFO:teuthology.orchestra.run.smithi037.stdout:max_mds 1 2024-04-25T17:27:14.104 INFO:teuthology.orchestra.run.smithi037.stdout:in 0 2024-04-25T17:27:14.104 INFO:teuthology.orchestra.run.smithi037.stdout:up {0=34412} 2024-04-25T17:27:14.104 INFO:teuthology.orchestra.run.smithi037.stdout:failed 2024-04-25T17:27:14.104 INFO:teuthology.orchestra.run.smithi037.stdout:damaged 2024-04-25T17:27:14.104 INFO:teuthology.orchestra.run.smithi037.stdout:stopped 2024-04-25T17:27:14.104 INFO:teuthology.orchestra.run.smithi037.stdout:data_pools [3] 2024-04-25T17:27:14.104 INFO:teuthology.orchestra.run.smithi037.stdout:metadata_pool 2 2024-04-25T17:27:14.104 INFO:teuthology.orchestra.run.smithi037.stdout:inline_data disabled 2024-04-25T17:27:14.104 INFO:teuthology.orchestra.run.smithi037.stdout:balancer 2024-04-25T17:27:14.105 INFO:teuthology.orchestra.run.smithi037.stdout:bal_rank_mask -1 2024-04-25T17:27:14.105 INFO:teuthology.orchestra.run.smithi037.stdout:standby_count_wanted 1 2024-04-25T17:27:14.105 INFO:teuthology.orchestra.run.smithi037.stdout:qdb_cluster leader: 34412 members: 34412 2024-04-25T17:27:14.105 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi037.ksmixc{0:34412} state up:active seq 18 join_fscid=1 addr [v2:172.21.15.37:6826/2514248612,v1:172.21.15.37:6827/2514248612] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T17:27:14.105 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi037.ovkrpq{0:34444} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.37:6828/2067664560,v1:172.21.15.37:6829/2067664560] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T17:27:14.105 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:27:14.105 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:27:14.105 INFO:teuthology.orchestra.run.smithi037.stdout:Standby daemons: 2024-04-25T17:27:14.105 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:27:14.105 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi069.ytlqcf{-1:44347} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.69:6824/3424891497,v1:172.21.15.69:6825/3424891497] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T17:27:14.105 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi069.cpprst{-1:44379} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.69:6826/3383509929,v1:172.21.15.69:6827/3383509929] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T17:27:14.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.104+0000 7f5201519700 1 -- 172.21.15.37:0/3472011427 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f51e4076b80 msgr2=0x7f51e4079030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:27:14.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.104+0000 7f5201519700 1 --2- 172.21.15.37:0/3472011427 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f51e4076b80 0x7f51e4079030 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f51ec009fd0 tx=0x7f51ec009e30 comp rx=0 tx=0).stop 2024-04-25T17:27:14.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.104+0000 7f5201519700 1 -- 172.21.15.37:0/3472011427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51fc0fcf90 msgr2=0x7f51fc10ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:27:14.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.104+0000 7f5201519700 1 --2- 172.21.15.37:0/3472011427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51fc0fcf90 0x7f51fc10ccd0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f51f0002a80 tx=0x7f51f00046b0 comp rx=0 tx=0).stop 2024-04-25T17:27:14.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.104+0000 7f5201519700 1 -- 172.21.15.37:0/3472011427 shutdown_connections 2024-04-25T17:27:14.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.104+0000 7f5201519700 1 --2- 172.21.15.37:0/3472011427 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f51e4076b80 0x7f51e4079030 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:14.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.104+0000 7f5201519700 1 --2- 172.21.15.37:0/3472011427 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51fc0fbce0 0x7f51fc10c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:14.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.104+0000 7f5201519700 1 --2- 172.21.15.37:0/3472011427 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51fc0fcf90 0x7f51fc10ccd0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:14.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.104+0000 7f5201519700 1 -- 172.21.15.37:0/3472011427 >> 172.21.15.37:0/3472011427 conn(0x7f51fc0f7440 msgr2=0x7f51fc0f8a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:27:14.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.104+0000 7f5201519700 1 -- 172.21.15.37:0/3472011427 shutdown_connections 2024-04-25T17:27:14.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.104+0000 7f5201519700 1 -- 172.21.15.37:0/3472011427 wait complete. 2024-04-25T17:27:14.107 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 35 2024-04-25T17:27:14.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.211+0000 7f0c0760b700 1 -- 172.21.15.37:0/4062914965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c000fdfd0 msgr2=0x7f0c000fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:27:14.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.211+0000 7f0c0760b700 1 --2- 172.21.15.37:0/4062914965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c000fdfd0 0x7f0c000fe440 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0bf0004940 tx=0x7f0bf0009e30 comp rx=0 tx=0).stop 2024-04-25T17:27:14.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.211+0000 7f0c0760b700 1 -- 172.21.15.37:0/4062914965 shutdown_connections 2024-04-25T17:27:14.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.211+0000 7f0c0760b700 1 --2- 172.21.15.37:0/4062914965 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c000fdfd0 0x7f0c000fe440 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:14.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.211+0000 7f0c0760b700 1 --2- 172.21.15.37:0/4062914965 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0c000fce60 0x7f0c000fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:14.212 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.211+0000 7f0c0760b700 1 -- 172.21.15.37:0/4062914965 >> 172.21.15.37:0/4062914965 conn(0x7f0c000f8540 msgr2=0x7f0c000fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:27:14.212 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:13 smithi037 ceph-mon[90844]: pgmap v218: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 4.2 KiB/s wr, 8 op/s 2024-04-25T17:27:14.212 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:13 smithi037 ceph-mon[90844]: from='client.34482 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:27:14.213 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:13 smithi037 ceph-mon[90844]: from='client.34486 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:27:14.213 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:13 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:14.213 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:13 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:14.213 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:13 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/1125521626' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:14.214 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.211+0000 7f0c0760b700 1 -- 172.21.15.37:0/4062914965 shutdown_connections 2024-04-25T17:27:14.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.211+0000 7f0c0760b700 1 -- 172.21.15.37:0/4062914965 wait complete. 2024-04-25T17:27:14.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.211+0000 7f0c0760b700 1 Processor -- start 2024-04-25T17:27:14.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.212+0000 7f0c0760b700 1 -- start start 2024-04-25T17:27:14.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.212+0000 7f0c0760b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0c000fce60 0x7f0c0010d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:27:14.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.212+0000 7f0c0760b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c000fdfd0 0x7f0c0010ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:27:14.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.212+0000 7f0c0760b700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0010e3c0 con 0x7f0c000fdfd0 2024-04-25T17:27:14.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.212+0000 7f0c0760b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0010e530 con 0x7f0c000fce60 2024-04-25T17:27:14.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.212+0000 7f0c04ba6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c000fdfd0 0x7f0c0010ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:27:14.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.212+0000 7f0c04ba6700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c000fdfd0 0x7f0c0010ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53976/0 (socket says 172.21.15.37:53976) 2024-04-25T17:27:14.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.212+0000 7f0c04ba6700 1 -- 172.21.15.37:0/2389254405 learned_addr learned my addr 172.21.15.37:0/2389254405 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:27:14.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.212+0000 7f0c053a7700 1 --2- 172.21.15.37:0/2389254405 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0c000fce60 0x7f0c0010d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:27:14.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.212+0000 7f0c04ba6700 1 -- 172.21.15.37:0/2389254405 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0c000fce60 msgr2=0x7f0c0010d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:27:14.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.212+0000 7f0c04ba6700 1 --2- 172.21.15.37:0/2389254405 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0c000fce60 0x7f0c0010d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:14.215 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.212+0000 7f0c04ba6700 1 -- 172.21.15.37:0/2389254405 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf0005040 con 0x7f0c000fdfd0 2024-04-25T17:27:14.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.212+0000 7f0c053a7700 1 --2- 172.21.15.37:0/2389254405 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0c000fce60 0x7f0c0010d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T17:27:14.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.212+0000 7f0c04ba6700 1 --2- 172.21.15.37:0/2389254405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c000fdfd0 0x7f0c0010ddc0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0bf0013870 tx=0x7f0bf0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:27:14.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.213+0000 7f0bf5ffb700 1 -- 172.21.15.37:0/2389254405 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0bf0021070 con 0x7f0c000fdfd0 2024-04-25T17:27:14.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.213+0000 7f0bf5ffb700 1 -- 172.21.15.37:0/2389254405 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0bf0009430 con 0x7f0c000fdfd0 2024-04-25T17:27:14.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.213+0000 7f0c0760b700 1 -- 172.21.15.37:0/2389254405 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c00112f30 con 0x7f0c000fdfd0 2024-04-25T17:27:14.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.213+0000 7f0bf5ffb700 1 -- 172.21.15.37:0/2389254405 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0bf000e070 con 0x7f0c000fdfd0 2024-04-25T17:27:14.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.213+0000 7f0c0760b700 1 -- 172.21.15.37:0/2389254405 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c00113440 con 0x7f0c000fdfd0 2024-04-25T17:27:14.216 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.214+0000 7f0c0760b700 1 -- 172.21.15.37:0/2389254405 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c0004c710 con 0x7f0c000fdfd0 2024-04-25T17:27:14.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.215+0000 7f0bf5ffb700 1 -- 172.21.15.37:0/2389254405 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f0bf001c750 con 0x7f0c000fdfd0 2024-04-25T17:27:14.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.215+0000 7f0bf5ffb700 1 --2- 172.21.15.37:0/2389254405 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f0bec076b90 0x7f0bec079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:27:14.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.215+0000 7f0bf5ffb700 1 -- 172.21.15.37:0/2389254405 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f0bf0099490 con 0x7f0c000fdfd0 2024-04-25T17:27:14.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.215+0000 7f0c053a7700 1 --2- 172.21.15.37:0/2389254405 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f0bec076b90 0x7f0bec079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:27:14.217 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.216+0000 7f0c053a7700 1 --2- 172.21.15.37:0/2389254405 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f0bec076b90 0x7f0bec079040 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc001880 tx=0x7f0bfc00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:27:14.221 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.220+0000 7f0bf5ffb700 1 -- 172.21.15.37:0/2389254405 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f0bf0061ff0 con 0x7f0c000fdfd0 2024-04-25T17:27:14.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:13 smithi069 ceph-mon[80239]: pgmap v218: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 4.2 KiB/s wr, 8 op/s 2024-04-25T17:27:14.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:13 smithi069 ceph-mon[80239]: from='client.34482 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:27:14.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:13 smithi069 ceph-mon[80239]: from='client.34486 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:27:14.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:13 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:14.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:13 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:14.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:13 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/1125521626' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:14.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.452+0000 7f0c0760b700 1 -- 172.21.15.37:0/2389254405 --> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0c001022a0 con 0x7f0bec076b90 2024-04-25T17:27:14.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.453+0000 7f0bf5ffb700 1 -- 172.21.15.37:0/2389254405 <== mgr.34104 v2:172.21.15.37:6800/783197737 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7f0c001022a0 con 0x7f0bec076b90 2024-04-25T17:27:14.454 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-25T17:27:14.454 INFO:teuthology.orchestra.run.smithi037.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385", 2024-04-25T17:27:14.454 INFO:teuthology.orchestra.run.smithi037.stdout: "in_progress": true, 2024-04-25T17:27:14.454 INFO:teuthology.orchestra.run.smithi037.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-25T17:27:14.454 INFO:teuthology.orchestra.run.smithi037.stdout: "services_complete": [ 2024-04-25T17:27:14.454 INFO:teuthology.orchestra.run.smithi037.stdout: "mds", 2024-04-25T17:27:14.454 INFO:teuthology.orchestra.run.smithi037.stdout: "mon", 2024-04-25T17:27:14.454 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr", 2024-04-25T17:27:14.454 INFO:teuthology.orchestra.run.smithi037.stdout: "osd", 2024-04-25T17:27:14.455 INFO:teuthology.orchestra.run.smithi037.stdout: "crash" 2024-04-25T17:27:14.455 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-04-25T17:27:14.455 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": "16/21 daemons upgraded", 2024-04-25T17:27:14.455 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "Currently upgrading node-exporter daemons", 2024-04-25T17:27:14.455 INFO:teuthology.orchestra.run.smithi037.stdout: "is_paused": false 2024-04-25T17:27:14.455 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-25T17:27:14.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.455+0000 7f0c0760b700 1 -- 172.21.15.37:0/2389254405 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f0bec076b90 msgr2=0x7f0bec079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:27:14.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.456+0000 7f0c0760b700 1 --2- 172.21.15.37:0/2389254405 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f0bec076b90 0x7f0bec079040 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc001880 tx=0x7f0bfc00b040 comp rx=0 tx=0).stop 2024-04-25T17:27:14.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.456+0000 7f0c0760b700 1 -- 172.21.15.37:0/2389254405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c000fdfd0 msgr2=0x7f0c0010ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:27:14.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.456+0000 7f0c0760b700 1 --2- 172.21.15.37:0/2389254405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c000fdfd0 0x7f0c0010ddc0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0bf0013870 tx=0x7f0bf0009e30 comp rx=0 tx=0).stop 2024-04-25T17:27:14.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.456+0000 7f0c0760b700 1 -- 172.21.15.37:0/2389254405 shutdown_connections 2024-04-25T17:27:14.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.456+0000 7f0c0760b700 1 --2- 172.21.15.37:0/2389254405 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f0bec076b90 0x7f0bec079040 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:14.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.456+0000 7f0c0760b700 1 --2- 172.21.15.37:0/2389254405 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0c000fce60 0x7f0c0010d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:14.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.456+0000 7f0c0760b700 1 --2- 172.21.15.37:0/2389254405 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c000fdfd0 0x7f0c0010ddc0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:14.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.456+0000 7f0c0760b700 1 -- 172.21.15.37:0/2389254405 >> 172.21.15.37:0/2389254405 conn(0x7f0c000f8540 msgr2=0x7f0c000f9af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:27:14.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.456+0000 7f0c0760b700 1 -- 172.21.15.37:0/2389254405 shutdown_connections 2024-04-25T17:27:14.457 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.456+0000 7f0c0760b700 1 -- 172.21.15.37:0/2389254405 wait complete. 2024-04-25T17:27:14.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.560+0000 7fe326c55700 1 -- 172.21.15.37:0/520384016 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3200ffef0 msgr2=0x7fe320102310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:27:14.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.560+0000 7fe326c55700 1 --2- 172.21.15.37:0/520384016 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3200ffef0 0x7fe320102310 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe30c004940 tx=0x7fe30c009e30 comp rx=0 tx=0).stop 2024-04-25T17:27:14.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.560+0000 7fe326c55700 1 -- 172.21.15.37:0/520384016 shutdown_connections 2024-04-25T17:27:14.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.560+0000 7fe326c55700 1 --2- 172.21.15.37:0/520384016 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe3200ffef0 0x7fe320102310 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:14.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.560+0000 7fe326c55700 1 --2- 172.21.15.37:0/520384016 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe320066b50 0x7fe3200ff9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:14.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.560+0000 7fe326c55700 1 -- 172.21.15.37:0/520384016 >> 172.21.15.37:0/520384016 conn(0x7fe3200f7420 msgr2=0x7fe3200f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:27:14.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.560+0000 7fe326c55700 1 -- 172.21.15.37:0/520384016 shutdown_connections 2024-04-25T17:27:14.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.561+0000 7fe326c55700 1 -- 172.21.15.37:0/520384016 wait complete. 2024-04-25T17:27:14.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.561+0000 7fe326c55700 1 Processor -- start 2024-04-25T17:27:14.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.561+0000 7fe326c55700 1 -- start start 2024-04-25T17:27:14.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.562+0000 7fe326c55700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe320066b50 0x7fe32010d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:27:14.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.562+0000 7fe326c55700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3200ffef0 0x7fe32010df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:27:14.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.562+0000 7fe326c55700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32010e530 con 0x7fe320066b50 2024-04-25T17:27:14.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.562+0000 7fe326c55700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32010ed80 con 0x7fe3200ffef0 2024-04-25T17:27:14.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.562+0000 7fe31ffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3200ffef0 0x7fe32010df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:27:14.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.562+0000 7fe3249f1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe320066b50 0x7fe32010d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:27:14.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.562+0000 7fe31ffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3200ffef0 0x7fe32010df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.37:59888/0 (socket says 172.21.15.37:59888) 2024-04-25T17:27:14.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.562+0000 7fe3249f1700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe320066b50 0x7fe32010d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:53998/0 (socket says 172.21.15.37:53998) 2024-04-25T17:27:14.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.562+0000 7fe31ffff700 1 -- 172.21.15.37:0/2688555334 learned_addr learned my addr 172.21.15.37:0/2688555334 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:27:14.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.562+0000 7fe31ffff700 1 -- 172.21.15.37:0/2688555334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe320066b50 msgr2=0x7fe32010d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:27:14.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.562+0000 7fe31ffff700 1 --2- 172.21.15.37:0/2688555334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe320066b50 0x7fe32010d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:14.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.562+0000 7fe31ffff700 1 -- 172.21.15.37:0/2688555334 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe30c005040 con 0x7fe3200ffef0 2024-04-25T17:27:14.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.562+0000 7fe3249f1700 1 --2- 172.21.15.37:0/2688555334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe320066b50 0x7fe32010d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T17:27:14.564 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.563+0000 7fe31ffff700 1 --2- 172.21.15.37:0/2688555334 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3200ffef0 0x7fe32010df30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe30c013870 tx=0x7fe30c009e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:27:14.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.563+0000 7fe31d7fa700 1 -- 172.21.15.37:0/2688555334 <== mon.1 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe30c021070 con 0x7fe3200ffef0 2024-04-25T17:27:14.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.563+0000 7fe326c55700 1 -- 172.21.15.37:0/2688555334 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe32010f000 con 0x7fe3200ffef0 2024-04-25T17:27:14.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.563+0000 7fe31d7fa700 1 -- 172.21.15.37:0/2688555334 <== mon.1 v2:172.21.15.69:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe30c009430 con 0x7fe3200ffef0 2024-04-25T17:27:14.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.563+0000 7fe326c55700 1 -- 172.21.15.37:0/2688555334 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe32010f540 con 0x7fe3200ffef0 2024-04-25T17:27:14.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.563+0000 7fe31d7fa700 1 -- 172.21.15.37:0/2688555334 <== mon.1 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe30c00e070 con 0x7fe3200ffef0 2024-04-25T17:27:14.565 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.564+0000 7fe326c55700 1 -- 172.21.15.37:0/2688555334 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3040052e0 con 0x7fe3200ffef0 2024-04-25T17:27:14.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.565+0000 7fe31d7fa700 1 -- 172.21.15.37:0/2688555334 <== mon.1 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7fe30c013af0 con 0x7fe3200ffef0 2024-04-25T17:27:14.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.566+0000 7fe31d7fa700 1 --2- 172.21.15.37:0/2688555334 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fe310076b90 0x7fe310079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:27:14.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.566+0000 7fe31d7fa700 1 -- 172.21.15.37:0/2688555334 <== mon.1 v2:172.21.15.69:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fe30c0992b0 con 0x7fe3200ffef0 2024-04-25T17:27:14.566 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.566+0000 7fe3249f1700 1 --2- 172.21.15.37:0/2688555334 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fe310076b90 0x7fe310079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:27:14.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.566+0000 7fe3249f1700 1 --2- 172.21.15.37:0/2688555334 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fe310076b90 0x7fe310079040 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe314009b80 tx=0x7fe31400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:27:14.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.571+0000 7fe31d7fa700 1 -- 172.21.15.37:0/2688555334 <== mon.1 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fe30c061ed0 con 0x7fe3200ffef0 2024-04-25T17:27:14.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.891+0000 7fe326c55700 1 -- 172.21.15.37:0/2688555334 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe304005590 con 0x7fe3200ffef0 2024-04-25T17:27:14.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.892+0000 7fe31d7fa700 1 -- 172.21.15.37:0/2688555334 <== mon.1 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fe30c004490 con 0x7fe3200ffef0 2024-04-25T17:27:14.892 INFO:teuthology.orchestra.run.smithi037.stdout:HEALTH_OK 2024-04-25T17:27:14.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.894+0000 7fe326c55700 1 -- 172.21.15.37:0/2688555334 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fe310076b90 msgr2=0x7fe310079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:27:14.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.894+0000 7fe326c55700 1 --2- 172.21.15.37:0/2688555334 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fe310076b90 0x7fe310079040 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe314009b80 tx=0x7fe31400b040 comp rx=0 tx=0).stop 2024-04-25T17:27:14.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.894+0000 7fe326c55700 1 -- 172.21.15.37:0/2688555334 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3200ffef0 msgr2=0x7fe32010df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:27:14.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.894+0000 7fe326c55700 1 --2- 172.21.15.37:0/2688555334 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3200ffef0 0x7fe32010df30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe30c013870 tx=0x7fe30c009e30 comp rx=0 tx=0).stop 2024-04-25T17:27:14.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.894+0000 7fe326c55700 1 -- 172.21.15.37:0/2688555334 shutdown_connections 2024-04-25T17:27:14.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.894+0000 7fe326c55700 1 --2- 172.21.15.37:0/2688555334 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fe310076b90 0x7fe310079040 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:14.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.894+0000 7fe326c55700 1 --2- 172.21.15.37:0/2688555334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe320066b50 0x7fe32010d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:14.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.894+0000 7fe326c55700 1 --2- 172.21.15.37:0/2688555334 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3200ffef0 0x7fe32010df30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:14.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.894+0000 7fe326c55700 1 -- 172.21.15.37:0/2688555334 >> 172.21.15.37:0/2688555334 conn(0x7fe3200f7420 msgr2=0x7fe3200f7840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:27:14.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.894+0000 7fe326c55700 1 -- 172.21.15.37:0/2688555334 shutdown_connections 2024-04-25T17:27:14.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:14.894+0000 7fe326c55700 1 -- 172.21.15.37:0/2688555334 wait complete. 2024-04-25T17:27:14.989 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:14 smithi069 ceph-mon[80239]: from='client.34490 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:27:14.989 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:14 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/3472011427' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T17:27:14.989 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:14 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:14.989 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:14 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:14.989 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:14 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/2688555334' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T17:27:15.151 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:14 smithi037 ceph-mon[90844]: from='client.34490 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:27:15.151 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:14 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/3472011427' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T17:27:15.151 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:14 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:15.151 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:14 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:15.151 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:14 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/2688555334' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T17:27:16.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:16 smithi069 ceph-mon[80239]: from='client.34502 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:27:16.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:16 smithi069 ceph-mon[80239]: pgmap v219: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-04-25T17:27:16.482 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:16 smithi037 ceph-mon[90844]: from='client.34502 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:27:16.482 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:16 smithi037 ceph-mon[90844]: pgmap v219: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-04-25T17:27:18.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:18 smithi069 ceph-mon[80239]: pgmap v220: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4 op/s 2024-04-25T17:27:18.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:18 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:18.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:18 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:18.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:18 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:18.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:18 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:18.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:18 smithi037 ceph-mon[90844]: pgmap v220: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4 op/s 2024-04-25T17:27:18.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:18 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:18.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:18 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:18.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:18 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:18.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:18 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:20.295 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:19 smithi037 ceph-mon[90844]: pgmap v221: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 7.1 MiB/s rd, 2 op/s 2024-04-25T17:27:20.295 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:19 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:20.296 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:19 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:20.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:19 smithi069 ceph-mon[80239]: pgmap v221: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 7.1 MiB/s rd, 2 op/s 2024-04-25T17:27:20.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:19 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:20.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:19 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:22.221 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:21 smithi069 ceph-mon[80239]: pgmap v222: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 3.1 MiB/s rd, 1 op/s 2024-04-25T17:27:22.245 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:21 smithi037 ceph-mon[90844]: pgmap v222: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 3.1 MiB/s rd, 1 op/s 2024-04-25T17:27:23.682 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:23 smithi037 ceph-mon[90844]: pgmap v223: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.4 MiB/s rd, 1 op/s 2024-04-25T17:27:23.682 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:23 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:23.682 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:23 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:23.683 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:23 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:27:23.683 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:23 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:27:23.683 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:23 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:23.683 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:23 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:27:23.683 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:23 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:23.683 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:23 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:23.683 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:23 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:23.683 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:23 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:23.683 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:23 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:23.683 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:23 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:23.683 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:23 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:23.683 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:23 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:23.683 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:23 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:23.684 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:23 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:23.684 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:23 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:23.684 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:23 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:23.684 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:23 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:23.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:23 smithi069 ceph-mon[80239]: pgmap v223: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.4 MiB/s rd, 1 op/s 2024-04-25T17:27:23.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:23 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:23.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:23 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:23.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:23 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:27:23.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:23 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:27:23.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:23 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:23.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:23 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:27:23.920 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:23 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:23.920 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:23 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:23.920 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:23 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:23.920 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:23 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:23.920 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:23 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:23.920 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:23 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:23.920 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:23 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:23.920 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:23 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:23.920 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:23 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:23.920 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:23 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:23.920 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:23 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:23.920 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:23 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:23.920 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:23 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:25.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:25 smithi069 ceph-mon[80239]: Upgrade: Updating prometheus.smithi037 2024-04-25T17:27:25.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:25 smithi069 ceph-mon[80239]: pgmap v224: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 92 KiB/s rd, 1 op/s 2024-04-25T17:27:25.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:25 smithi069 ceph-mon[80239]: Deploying daemon prometheus.smithi037 on smithi037 2024-04-25T17:27:25.933 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:25 smithi037 ceph-mon[90844]: Upgrade: Updating prometheus.smithi037 2024-04-25T17:27:25.933 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:25 smithi037 ceph-mon[90844]: pgmap v224: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 92 KiB/s rd, 1 op/s 2024-04-25T17:27:25.933 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:25 smithi037 ceph-mon[90844]: Deploying daemon prometheus.smithi037 on smithi037 2024-04-25T17:27:27.992 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:27 smithi037 ceph-mon[90844]: pgmap v225: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-25T17:27:27.992 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:27 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:27:28.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:27 smithi069 ceph-mon[80239]: pgmap v225: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-25T17:27:28.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:27 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:27:30.036 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:29 smithi037 ceph-mon[90844]: pgmap v226: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:27:30.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:29 smithi069 ceph-mon[80239]: pgmap v226: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:27:31.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:31 smithi037 ceph-mon[90844]: pgmap v227: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:27:31.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:31 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:31.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:31 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:31.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:31 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:27:31.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:31 smithi069 ceph-mon[80239]: pgmap v227: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:27:31.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:31 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:31.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:31 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:31.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:31 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:27:33.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:33 smithi069 ceph-mon[80239]: pgmap v228: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:27:33.974 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:33 smithi037 ceph-mon[90844]: pgmap v228: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:27:35.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:35 smithi069 ceph-mon[80239]: pgmap v229: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:27:35.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:35 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:35.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:35 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:36.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:35 smithi037 ceph-mon[90844]: pgmap v229: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:27:36.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:35 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:36.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:35 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:37.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:37 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:37.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:37 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:37.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:37 smithi037 ceph-mon[90844]: pgmap v230: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:27:37.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:37 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:37.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:37 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:37.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:37 smithi069 ceph-mon[80239]: pgmap v230: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:27:39.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:39 smithi069 ceph-mon[80239]: pgmap v231: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:27:40.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:39 smithi037 ceph-mon[90844]: pgmap v231: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:27:41.163 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:41 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:41.163 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:41 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:41.163 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:41 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:27:41.163 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:41 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:27:41.163 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:41 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:41.163 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:41 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-25T17:27:41.163 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:41 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:27:41.163 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:41 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:41.163 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:41 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:41.163 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:41 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:41.163 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:41 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:41.164 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:41 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:41.164 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:41 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:41.164 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:41 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:41.164 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:41 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:41.164 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:41 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:41.164 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:41 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:41.164 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:41 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:41.164 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:41 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:41.164 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:41 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:41.164 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:41 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:41.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:41 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:41.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:41 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:41.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:41 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:27:41.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:41 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:27:41.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:41 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:41.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:41 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-25T17:27:41.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:41 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:27:41.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:41 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:41.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:41 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:41.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:41 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:41.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:41 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:41.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:41 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:41.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:41 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:41.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:41 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:41.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:41 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:41.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:41 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:41.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:41 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:41.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:41 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:41.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:41 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:41.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:41 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:41.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:41 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:42.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:42 smithi069 ceph-mon[80239]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-25T17:27:42.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:42 smithi069 ceph-mon[80239]: pgmap v232: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:27:42.419 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:42 smithi037 ceph-mon[90844]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-04-25T17:27:42.419 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:42 smithi037 ceph-mon[90844]: pgmap v232: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:27:43.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:43 smithi069 ceph-mon[80239]: Upgrade: Updating alertmanager.smithi037 2024-04-25T17:27:43.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:43 smithi069 ceph-mon[80239]: Deploying daemon alertmanager.smithi037 on smithi037 2024-04-25T17:27:43.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:43 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:27:43.521 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:43 smithi037 ceph-mon[90844]: Upgrade: Updating alertmanager.smithi037 2024-04-25T17:27:43.521 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:43 smithi037 ceph-mon[90844]: Deploying daemon alertmanager.smithi037 on smithi037 2024-04-25T17:27:43.521 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:43 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:27:44.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:44 smithi069 ceph-mon[80239]: pgmap v233: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:27:44.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:44 smithi037 ceph-mon[90844]: pgmap v233: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:27:45.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.013+0000 7f5c2935c700 1 -- 172.21.15.37:0/2220694759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c24071dc0 msgr2=0x7f5c240702d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:27:45.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.013+0000 7f5c2935c700 1 --2- 172.21.15.37:0/2220694759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c24071dc0 0x7f5c240702d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5c14009ce0 tx=0x7f5c14004d10 comp rx=0 tx=0).stop 2024-04-25T17:27:45.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.013+0000 7f5c2935c700 1 -- 172.21.15.37:0/2220694759 shutdown_connections 2024-04-25T17:27:45.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.013+0000 7f5c2935c700 1 --2- 172.21.15.37:0/2220694759 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c24070810 0x7f5c24070c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:45.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.013+0000 7f5c2935c700 1 --2- 172.21.15.37:0/2220694759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c24071dc0 0x7f5c240702d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:45.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.013+0000 7f5c2935c700 1 -- 172.21.15.37:0/2220694759 >> 172.21.15.37:0/2220694759 conn(0x7f5c240f8540 msgr2=0x7f5c240fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:27:45.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.013+0000 7f5c2935c700 1 -- 172.21.15.37:0/2220694759 shutdown_connections 2024-04-25T17:27:45.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.013+0000 7f5c2935c700 1 -- 172.21.15.37:0/2220694759 wait complete. 2024-04-25T17:27:45.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.014+0000 7f5c2935c700 1 Processor -- start 2024-04-25T17:27:45.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.014+0000 7f5c2935c700 1 -- start start 2024-04-25T17:27:45.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.014+0000 7f5c2935c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c24070810 0x7f5c2410fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:27:45.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.014+0000 7f5c2935c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c24071dc0 0x7f5c24110230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:27:45.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.014+0000 7f5c2935c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c241108b0 con 0x7f5c24070810 2024-04-25T17:27:45.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.014+0000 7f5c2935c700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c24115250 con 0x7f5c24071dc0 2024-04-25T17:27:45.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.014+0000 7f5c22ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c24070810 0x7f5c2410fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:27:45.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.015+0000 7f5c22ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c24070810 0x7f5c2410fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41720/0 (socket says 172.21.15.37:41720) 2024-04-25T17:27:45.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.015+0000 7f5c22ffd700 1 -- 172.21.15.37:0/2775713142 learned_addr learned my addr 172.21.15.37:0/2775713142 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:27:45.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.015+0000 7f5c227fc700 1 --2- 172.21.15.37:0/2775713142 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c24071dc0 0x7f5c24110230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:27:45.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.015+0000 7f5c22ffd700 1 -- 172.21.15.37:0/2775713142 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c24071dc0 msgr2=0x7f5c24110230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:27:45.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.015+0000 7f5c22ffd700 1 --2- 172.21.15.37:0/2775713142 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c24071dc0 0x7f5c24110230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:45.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.015+0000 7f5c22ffd700 1 -- 172.21.15.37:0/2775713142 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c14009940 con 0x7f5c24070810 2024-04-25T17:27:45.017 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.015+0000 7f5c22ffd700 1 --2- 172.21.15.37:0/2775713142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c24070810 0x7f5c2410fcf0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5c140095d0 tx=0x7f5c14004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:27:45.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.015+0000 7f5c1b7fe700 1 -- 172.21.15.37:0/2775713142 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c1400e040 con 0x7f5c24070810 2024-04-25T17:27:45.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.015+0000 7f5c2935c700 1 -- 172.21.15.37:0/2775713142 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c241153f0 con 0x7f5c24070810 2024-04-25T17:27:45.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.015+0000 7f5c1b7fe700 1 -- 172.21.15.37:0/2775713142 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5c140128e0 con 0x7f5c24070810 2024-04-25T17:27:45.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.015+0000 7f5c1b7fe700 1 -- 172.21.15.37:0/2775713142 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c1401ca10 con 0x7f5c24070810 2024-04-25T17:27:45.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.015+0000 7f5c2935c700 1 -- 172.21.15.37:0/2775713142 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c24115960 con 0x7f5c24070810 2024-04-25T17:27:45.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.017+0000 7f5c2935c700 1 -- 172.21.15.37:0/2775713142 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c2404c710 con 0x7f5c24070810 2024-04-25T17:27:45.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.017+0000 7f5c1b7fe700 1 -- 172.21.15.37:0/2775713142 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f5c14012a50 con 0x7f5c24070810 2024-04-25T17:27:45.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.018+0000 7f5c1b7fe700 1 --2- 172.21.15.37:0/2775713142 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f5c10076b90 0x7f5c10079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:27:45.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.018+0000 7f5c1b7fe700 1 -- 172.21.15.37:0/2775713142 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f5c1409a0b0 con 0x7f5c24070810 2024-04-25T17:27:45.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.018+0000 7f5c227fc700 1 --2- 172.21.15.37:0/2775713142 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f5c10076b90 0x7f5c10079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:27:45.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.018+0000 7f5c227fc700 1 --2- 172.21.15.37:0/2775713142 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f5c10076b90 0x7f5c10079040 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c007fd0 tx=0x7f5c0c009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:27:45.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.023+0000 7f5c1b7fe700 1 -- 172.21.15.37:0/2775713142 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f5c14062b90 con 0x7f5c24070810 2024-04-25T17:27:45.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.265+0000 7f5c2935c700 1 -- 172.21.15.37:0/2775713142 --> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5c24103f00 con 0x7f5c10076b90 2024-04-25T17:27:45.267 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.267+0000 7f5c1b7fe700 1 -- 172.21.15.37:0/2775713142 <== mgr.34104 v2:172.21.15.37:6800/783197737 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+440 (secure 0 0 0) 0x7f5c24103f00 con 0x7f5c10076b90 2024-04-25T17:27:45.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.269+0000 7f5c2935c700 1 -- 172.21.15.37:0/2775713142 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f5c10076b90 msgr2=0x7f5c10079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:27:45.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.269+0000 7f5c2935c700 1 --2- 172.21.15.37:0/2775713142 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f5c10076b90 0x7f5c10079040 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c007fd0 tx=0x7f5c0c009040 comp rx=0 tx=0).stop 2024-04-25T17:27:45.270 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.269+0000 7f5c2935c700 1 -- 172.21.15.37:0/2775713142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c24070810 msgr2=0x7f5c2410fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:27:45.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.269+0000 7f5c2935c700 1 --2- 172.21.15.37:0/2775713142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c24070810 0x7f5c2410fcf0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5c140095d0 tx=0x7f5c14004d10 comp rx=0 tx=0).stop 2024-04-25T17:27:45.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.270+0000 7f5c2935c700 1 -- 172.21.15.37:0/2775713142 shutdown_connections 2024-04-25T17:27:45.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.270+0000 7f5c2935c700 1 --2- 172.21.15.37:0/2775713142 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f5c10076b90 0x7f5c10079040 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:45.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.270+0000 7f5c2935c700 1 --2- 172.21.15.37:0/2775713142 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5c24070810 0x7f5c2410fcf0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:45.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.270+0000 7f5c2935c700 1 --2- 172.21.15.37:0/2775713142 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c24071dc0 0x7f5c24110230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:45.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.270+0000 7f5c2935c700 1 -- 172.21.15.37:0/2775713142 >> 172.21.15.37:0/2775713142 conn(0x7f5c240f8540 msgr2=0x7f5c240f9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:27:45.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.270+0000 7f5c2935c700 1 -- 172.21.15.37:0/2775713142 shutdown_connections 2024-04-25T17:27:45.271 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.270+0000 7f5c2935c700 1 -- 172.21.15.37:0/2775713142 wait complete. 2024-04-25T17:27:45.281 INFO:teuthology.orchestra.run.smithi037.stdout:true 2024-04-25T17:27:45.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.384+0000 7fb19eb60700 1 -- 172.21.15.37:0/3756137677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1980fbcb0 msgr2=0x7fb1980fc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:27:45.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.384+0000 7fb19eb60700 1 --2- 172.21.15.37:0/3756137677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1980fbcb0 0x7fb1980fc0c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb18c004940 tx=0x7fb18c009e30 comp rx=0 tx=0).stop 2024-04-25T17:27:45.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.384+0000 7fb19eb60700 1 -- 172.21.15.37:0/3756137677 shutdown_connections 2024-04-25T17:27:45.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.384+0000 7fb19eb60700 1 --2- 172.21.15.37:0/3756137677 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1980fcf60 0x7fb1980fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:45.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.384+0000 7fb19eb60700 1 --2- 172.21.15.37:0/3756137677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1980fbcb0 0x7fb1980fc0c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:45.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.384+0000 7fb19eb60700 1 -- 172.21.15.37:0/3756137677 >> 172.21.15.37:0/3756137677 conn(0x7fb1980f7430 msgr2=0x7fb1980f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:27:45.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.384+0000 7fb19eb60700 1 -- 172.21.15.37:0/3756137677 shutdown_connections 2024-04-25T17:27:45.386 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.384+0000 7fb19eb60700 1 -- 172.21.15.37:0/3756137677 wait complete. 2024-04-25T17:27:45.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.385+0000 7fb19eb60700 1 Processor -- start 2024-04-25T17:27:45.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.385+0000 7fb19eb60700 1 -- start start 2024-04-25T17:27:45.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.385+0000 7fb19eb60700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1980fbcb0 0x7fb19810c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:27:45.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.386+0000 7fb19eb60700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1980fcf60 0x7fb19810ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:27:45.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.386+0000 7fb19eb60700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19810d440 con 0x7fb1980fcf60 2024-04-25T17:27:45.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.386+0000 7fb197fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1980fcf60 0x7fb19810ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:27:45.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.386+0000 7fb197fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1980fcf60 0x7fb19810ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41744/0 (socket says 172.21.15.37:41744) 2024-04-25T17:27:45.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.386+0000 7fb197fff700 1 -- 172.21.15.37:0/2897495302 learned_addr learned my addr 172.21.15.37:0/2897495302 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:27:45.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.386+0000 7fb19eb60700 1 -- 172.21.15.37:0/2897495302 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19810dc90 con 0x7fb1980fbcb0 2024-04-25T17:27:45.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.386+0000 7fb19c8fc700 1 --2- 172.21.15.37:0/2897495302 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1980fbcb0 0x7fb19810c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:27:45.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.386+0000 7fb197fff700 1 -- 172.21.15.37:0/2897495302 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1980fbcb0 msgr2=0x7fb19810c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:27:45.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.386+0000 7fb197fff700 1 --2- 172.21.15.37:0/2897495302 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1980fbcb0 0x7fb19810c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:45.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.386+0000 7fb197fff700 1 -- 172.21.15.37:0/2897495302 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb18c005040 con 0x7fb1980fcf60 2024-04-25T17:27:45.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.386+0000 7fb197fff700 1 --2- 172.21.15.37:0/2897495302 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1980fcf60 0x7fb19810ce40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb184004ee0 tx=0x7fb1840046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:27:45.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.386+0000 7fb1957fa700 1 -- 172.21.15.37:0/2897495302 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb184007ea0 con 0x7fb1980fcf60 2024-04-25T17:27:45.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.387+0000 7fb1957fa700 1 -- 172.21.15.37:0/2897495302 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb1840095a0 con 0x7fb1980fcf60 2024-04-25T17:27:45.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.387+0000 7fb19eb60700 1 -- 172.21.15.37:0/2897495302 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb19810df10 con 0x7fb1980fcf60 2024-04-25T17:27:45.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.387+0000 7fb1957fa700 1 -- 172.21.15.37:0/2897495302 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb18400dd80 con 0x7fb1980fcf60 2024-04-25T17:27:45.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.387+0000 7fb19eb60700 1 -- 172.21.15.37:0/2897495302 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb19810e4d0 con 0x7fb1980fcf60 2024-04-25T17:27:45.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.388+0000 7fb19eb60700 1 -- 172.21.15.37:0/2897495302 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb19805f5c0 con 0x7fb1980fcf60 2024-04-25T17:27:45.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.388+0000 7fb1957fa700 1 -- 172.21.15.37:0/2897495302 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7fb184009710 con 0x7fb1980fcf60 2024-04-25T17:27:45.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.389+0000 7fb1957fa700 1 --2- 172.21.15.37:0/2897495302 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fb188076b90 0x7fb188079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:27:45.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.389+0000 7fb1957fa700 1 -- 172.21.15.37:0/2897495302 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fb18409a530 con 0x7fb1980fcf60 2024-04-25T17:27:45.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.389+0000 7fb19c8fc700 1 --2- 172.21.15.37:0/2897495302 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fb188076b90 0x7fb188079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:27:45.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.389+0000 7fb19c8fc700 1 --2- 172.21.15.37:0/2897495302 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fb188076b90 0x7fb188079040 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb18c00b3b0 tx=0x7fb18c009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:27:45.394 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.394+0000 7fb1957fa700 1 -- 172.21.15.37:0/2897495302 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fb184063090 con 0x7fb1980fcf60 2024-04-25T17:27:45.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.629+0000 7fb19eb60700 1 -- 172.21.15.37:0/2897495302 --> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb19810e880 con 0x7fb188076b90 2024-04-25T17:27:45.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.630+0000 7fb1957fa700 1 -- 172.21.15.37:0/2897495302 <== mgr.34104 v2:172.21.15.37:6800/783197737 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+440 (secure 0 0 0) 0x7fb19810e880 con 0x7fb188076b90 2024-04-25T17:27:45.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.632+0000 7fb19eb60700 1 -- 172.21.15.37:0/2897495302 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fb188076b90 msgr2=0x7fb188079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:27:45.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.632+0000 7fb19eb60700 1 --2- 172.21.15.37:0/2897495302 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fb188076b90 0x7fb188079040 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb18c00b3b0 tx=0x7fb18c009e30 comp rx=0 tx=0).stop 2024-04-25T17:27:45.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.632+0000 7fb19eb60700 1 -- 172.21.15.37:0/2897495302 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1980fcf60 msgr2=0x7fb19810ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:27:45.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.632+0000 7fb19eb60700 1 --2- 172.21.15.37:0/2897495302 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1980fcf60 0x7fb19810ce40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb184004ee0 tx=0x7fb1840046b0 comp rx=0 tx=0).stop 2024-04-25T17:27:45.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.632+0000 7fb19eb60700 1 -- 172.21.15.37:0/2897495302 shutdown_connections 2024-04-25T17:27:45.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.633+0000 7fb19eb60700 1 --2- 172.21.15.37:0/2897495302 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fb188076b90 0x7fb188079040 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:45.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.633+0000 7fb19eb60700 1 --2- 172.21.15.37:0/2897495302 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1980fbcb0 0x7fb19810c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:45.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.633+0000 7fb19eb60700 1 --2- 172.21.15.37:0/2897495302 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb1980fcf60 0x7fb19810ce40 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:45.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.633+0000 7fb19eb60700 1 -- 172.21.15.37:0/2897495302 >> 172.21.15.37:0/2897495302 conn(0x7fb1980f7430 msgr2=0x7fb1980f8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:27:45.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.633+0000 7fb19eb60700 1 -- 172.21.15.37:0/2897495302 shutdown_connections 2024-04-25T17:27:45.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.633+0000 7fb19eb60700 1 -- 172.21.15.37:0/2897495302 wait complete. 2024-04-25T17:27:45.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.740+0000 7f8f69584700 1 -- 172.21.15.37:0/4226004353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f640fc2d0 msgr2=0x7f8f640fc6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:27:45.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.740+0000 7f8f69584700 1 --2- 172.21.15.37:0/4226004353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f640fc2d0 0x7f8f640fc6e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8f54004940 tx=0x7f8f54009e30 comp rx=0 tx=0).stop 2024-04-25T17:27:45.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.740+0000 7f8f69584700 1 -- 172.21.15.37:0/4226004353 shutdown_connections 2024-04-25T17:27:45.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.740+0000 7f8f69584700 1 --2- 172.21.15.37:0/4226004353 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8f640fcc20 0x7f8f640fd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:45.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.740+0000 7f8f69584700 1 --2- 172.21.15.37:0/4226004353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f640fc2d0 0x7f8f640fc6e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:45.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.740+0000 7f8f69584700 1 -- 172.21.15.37:0/4226004353 >> 172.21.15.37:0/4226004353 conn(0x7f8f640f6be0 msgr2=0x7f8f640f8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:27:45.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.740+0000 7f8f69584700 1 -- 172.21.15.37:0/4226004353 shutdown_connections 2024-04-25T17:27:45.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.740+0000 7f8f69584700 1 -- 172.21.15.37:0/4226004353 wait complete. 2024-04-25T17:27:45.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.741+0000 7f8f69584700 1 Processor -- start 2024-04-25T17:27:45.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.741+0000 7f8f69584700 1 -- start start 2024-04-25T17:27:45.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.741+0000 7f8f69584700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8f640fc2d0 0x7f8f640fb980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:27:45.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.741+0000 7f8f69584700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f640fcc20 0x7f8f64112790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:27:45.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.741+0000 7f8f69584700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f64112cd0 con 0x7f8f640fcc20 2024-04-25T17:27:45.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.741+0000 7f8f69584700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f64112e10 con 0x7f8f640fc2d0 2024-04-25T17:27:45.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.741+0000 7f8f627fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f640fcc20 0x7f8f64112790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:27:45.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.741+0000 7f8f627fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f640fcc20 0x7f8f64112790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41752/0 (socket says 172.21.15.37:41752) 2024-04-25T17:27:45.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.741+0000 7f8f627fc700 1 -- 172.21.15.37:0/3954182847 learned_addr learned my addr 172.21.15.37:0/3954182847 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:27:45.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.742+0000 7f8f62ffd700 1 --2- 172.21.15.37:0/3954182847 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8f640fc2d0 0x7f8f640fb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:27:45.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.742+0000 7f8f627fc700 1 -- 172.21.15.37:0/3954182847 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8f640fc2d0 msgr2=0x7f8f640fb980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:27:45.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.742+0000 7f8f627fc700 1 --2- 172.21.15.37:0/3954182847 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8f640fc2d0 0x7f8f640fb980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:45.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.742+0000 7f8f627fc700 1 -- 172.21.15.37:0/3954182847 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f54005040 con 0x7f8f640fcc20 2024-04-25T17:27:45.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.742+0000 7f8f627fc700 1 --2- 172.21.15.37:0/3954182847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f640fcc20 0x7f8f64112790 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8f5800c830 tx=0x7f8f58004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:27:45.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.742+0000 7f8f4b7fe700 1 -- 172.21.15.37:0/3954182847 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f580106f0 con 0x7f8f640fcc20 2024-04-25T17:27:45.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.742+0000 7f8f69584700 1 -- 172.21.15.37:0/3954182847 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f64113070 con 0x7f8f640fcc20 2024-04-25T17:27:45.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.742+0000 7f8f4b7fe700 1 -- 172.21.15.37:0/3954182847 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8f58010d20 con 0x7f8f640fcc20 2024-04-25T17:27:45.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.742+0000 7f8f4b7fe700 1 -- 172.21.15.37:0/3954182847 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f580113a0 con 0x7f8f640fcc20 2024-04-25T17:27:45.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.742+0000 7f8f69584700 1 -- 172.21.15.37:0/3954182847 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f641135e0 con 0x7f8f640fcc20 2024-04-25T17:27:45.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.743+0000 7f8f69584700 1 -- 172.21.15.37:0/3954182847 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f6404c710 con 0x7f8f640fcc20 2024-04-25T17:27:45.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.744+0000 7f8f4b7fe700 1 -- 172.21.15.37:0/3954182847 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f8f58012400 con 0x7f8f640fcc20 2024-04-25T17:27:45.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.744+0000 7f8f4b7fe700 1 --2- 172.21.15.37:0/3954182847 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f8f4c076b90 0x7f8f4c079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:27:45.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.744+0000 7f8f4b7fe700 1 -- 172.21.15.37:0/3954182847 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f8f58098300 con 0x7f8f640fcc20 2024-04-25T17:27:45.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.744+0000 7f8f62ffd700 1 --2- 172.21.15.37:0/3954182847 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f8f4c076b90 0x7f8f4c079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:27:45.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.745+0000 7f8f62ffd700 1 --2- 172.21.15.37:0/3954182847 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f8f4c076b90 0x7f8f4c079040 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8f54004890 tx=0x7f8f54009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:27:45.750 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.749+0000 7f8f4b7fe700 1 -- 172.21.15.37:0/3954182847 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f8f58060e60 con 0x7f8f640fcc20 2024-04-25T17:27:45.973 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.972+0000 7f8f69584700 1 -- 172.21.15.37:0/3954182847 --> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8f64113860 con 0x7f8f4c076b90 2024-04-25T17:27:45.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.983+0000 7f8f4b7fe700 1 -- 172.21.15.37:0/3954182847 <== mgr.34104 v2:172.21.15.37:6800/783197737 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f8f64113860 con 0x7f8f4c076b90 2024-04-25T17:27:45.983 INFO:teuthology.orchestra.run.smithi037.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-25T17:27:45.983 INFO:teuthology.orchestra.run.smithi037.stdout:alertmanager.smithi037 smithi037 *:9093,9094 running (9m) 10s ago 17m 24.8M - 0.25.0 c8568f914cd2 18aed8f409ee 2024-04-25T17:27:45.984 INFO:teuthology.orchestra.run.smithi037.stdout:crash.smithi037 smithi037 running (5m) 10s ago 17m 6660k - 19.0.0-3291-g994e2f20 d53c96779a29 639584ea5855 2024-04-25T17:27:45.984 INFO:teuthology.orchestra.run.smithi037.stdout:crash.smithi069 smithi069 running (5m) 33s ago 16m 6665k - 19.0.0-3291-g994e2f20 d53c96779a29 ee5db16733a7 2024-04-25T17:27:45.984 INFO:teuthology.orchestra.run.smithi037.stdout:grafana.smithi037 smithi037 *:3000 running (9m) 10s ago 17m 86.8M - 9.4.7 954c08fa6188 1eff3ea3f9b0 2024-04-25T17:27:45.984 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi037.ksmixc smithi037 running (112s) 10s ago 12m 151M - 19.0.0-3291-g994e2f20 d53c96779a29 398075bc956a 2024-04-25T17:27:45.984 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi037.ovkrpq smithi037 running (93s) 10s ago 11m 153M - 19.0.0-3291-g994e2f20 d53c96779a29 ab3bcb631150 2024-04-25T17:27:45.984 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi069.cpprst smithi069 running (53s) 33s ago 11m 80.1M - 19.0.0-3291-g994e2f20 d53c96779a29 8172e0b6da3e 2024-04-25T17:27:45.984 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi069.ytlqcf smithi069 running (74s) 33s ago 11m 80.4M - 19.0.0-3291-g994e2f20 d53c96779a29 0e58af66f5b5 2024-04-25T17:27:45.984 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.smithi037.txrgxl smithi037 *:8443,9283,8765 running (8m) 10s ago 19m 582M - 19.0.0-3291-g994e2f20 d53c96779a29 e9653fc62df9 2024-04-25T17:27:45.984 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.smithi069.mmuhdo smithi069 *:8443,9283,8765 running (7m) 33s ago 16m 521M - 19.0.0-3291-g994e2f20 d53c96779a29 6820207b4019 2024-04-25T17:27:45.984 INFO:teuthology.orchestra.run.smithi037.stdout:mon.smithi037 smithi037 running (6m) 10s ago 19m 123M 2048M 19.0.0-3291-g994e2f20 d53c96779a29 1b349f3af69d 2024-04-25T17:27:45.984 INFO:teuthology.orchestra.run.smithi037.stdout:mon.smithi069 smithi069 running (6m) 33s ago 16m 106M 2048M 19.0.0-3291-g994e2f20 d53c96779a29 7744dbe81b50 2024-04-25T17:27:45.984 INFO:teuthology.orchestra.run.smithi037.stdout:node-exporter.smithi037 smithi037 *:9100 running (40s) 10s ago 17m 7612k - 1.5.0 0da6a335fe13 e08c36465372 2024-04-25T17:27:45.984 INFO:teuthology.orchestra.run.smithi037.stdout:node-exporter.smithi069 smithi069 *:9100 running (35s) 33s ago 16m 5444k - 1.5.0 0da6a335fe13 3f61f3499944 2024-04-25T17:27:45.984 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0 smithi037 running (5m) 10s ago 15m 173M 1559M 19.0.0-3291-g994e2f20 d53c96779a29 e97538cb8b4f 2024-04-25T17:27:45.984 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1 smithi037 running (4m) 10s ago 15m 182M 1559M 19.0.0-3291-g994e2f20 d53c96779a29 6cf158192aae 2024-04-25T17:27:45.985 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2 smithi037 running (3m) 10s ago 14m 168M 1559M 19.0.0-3291-g994e2f20 d53c96779a29 a0b57bba2ebf 2024-04-25T17:27:45.985 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3 smithi069 running (3m) 33s ago 14m 191M 2581M 19.0.0-3291-g994e2f20 d53c96779a29 d1aa15d6b575 2024-04-25T17:27:45.985 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4 smithi069 running (2m) 33s ago 13m 175M 2581M 19.0.0-3291-g994e2f20 d53c96779a29 ad76a3d0fecb 2024-04-25T17:27:45.985 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5 smithi069 running (2m) 33s ago 13m 165M 2581M 19.0.0-3291-g994e2f20 d53c96779a29 dea8b059441b 2024-04-25T17:27:45.985 INFO:teuthology.orchestra.run.smithi037.stdout:prometheus.smithi037 smithi037 *:9095 running (15s) 10s ago 16m 45.1M - 2.43.0 a07b618ecd1d b75cea846339 2024-04-25T17:27:45.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.985+0000 7f8f69584700 1 -- 172.21.15.37:0/3954182847 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f8f4c076b90 msgr2=0x7f8f4c079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:27:45.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.985+0000 7f8f69584700 1 --2- 172.21.15.37:0/3954182847 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f8f4c076b90 0x7f8f4c079040 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8f54004890 tx=0x7f8f54009e30 comp rx=0 tx=0).stop 2024-04-25T17:27:45.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.985+0000 7f8f69584700 1 -- 172.21.15.37:0/3954182847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f640fcc20 msgr2=0x7f8f64112790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:27:45.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.985+0000 7f8f69584700 1 --2- 172.21.15.37:0/3954182847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f640fcc20 0x7f8f64112790 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8f5800c830 tx=0x7f8f58004470 comp rx=0 tx=0).stop 2024-04-25T17:27:45.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.985+0000 7f8f69584700 1 -- 172.21.15.37:0/3954182847 shutdown_connections 2024-04-25T17:27:45.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.985+0000 7f8f69584700 1 --2- 172.21.15.37:0/3954182847 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f8f4c076b90 0x7f8f4c079040 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:45.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.985+0000 7f8f69584700 1 --2- 172.21.15.37:0/3954182847 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8f640fc2d0 0x7f8f640fb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:45.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.985+0000 7f8f69584700 1 --2- 172.21.15.37:0/3954182847 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f640fcc20 0x7f8f64112790 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:45.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.985+0000 7f8f69584700 1 -- 172.21.15.37:0/3954182847 >> 172.21.15.37:0/3954182847 conn(0x7f8f640f6be0 msgr2=0x7f8f640f8300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:27:45.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.985+0000 7f8f69584700 1 -- 172.21.15.37:0/3954182847 shutdown_connections 2024-04-25T17:27:45.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:45.985+0000 7f8f69584700 1 -- 172.21.15.37:0/3954182847 wait complete. 2024-04-25T17:27:46.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.091+0000 7fbbc485c700 1 -- 172.21.15.37:0/211776029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbc00fdfd0 msgr2=0x7fbbc00fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:27:46.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.091+0000 7fbbc485c700 1 --2- 172.21.15.37:0/211776029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbc00fdfd0 0x7fbbc00fe440 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4004940 tx=0x7fbbb4009e30 comp rx=0 tx=0).stop 2024-04-25T17:27:46.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.092+0000 7fbbc485c700 1 -- 172.21.15.37:0/211776029 shutdown_connections 2024-04-25T17:27:46.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.092+0000 7fbbc485c700 1 --2- 172.21.15.37:0/211776029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbc00fdfd0 0x7fbbc00fe440 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:46.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.092+0000 7fbbc485c700 1 --2- 172.21.15.37:0/211776029 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbbc00fce60 0x7fbbc00fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:46.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.092+0000 7fbbc485c700 1 -- 172.21.15.37:0/211776029 >> 172.21.15.37:0/211776029 conn(0x7fbbc00f8500 msgr2=0x7fbbc00fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:27:46.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.092+0000 7fbbc485c700 1 -- 172.21.15.37:0/211776029 shutdown_connections 2024-04-25T17:27:46.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.092+0000 7fbbc485c700 1 -- 172.21.15.37:0/211776029 wait complete. 2024-04-25T17:27:46.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.092+0000 7fbbc485c700 1 Processor -- start 2024-04-25T17:27:46.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.092+0000 7fbbc485c700 1 -- start start 2024-04-25T17:27:46.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.093+0000 7fbbc485c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbbc00fce60 0x7fbbc010da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:27:46.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.093+0000 7fbbc485c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbc00fdfd0 0x7fbbc010df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:27:46.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.093+0000 7fbbc485c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc010e560 con 0x7fbbc00fdfd0 2024-04-25T17:27:46.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.093+0000 7fbbc485c700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc010edb0 con 0x7fbbc00fce60 2024-04-25T17:27:46.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.093+0000 7fbbbdd9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbc00fdfd0 0x7fbbc010df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:27:46.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.093+0000 7fbbbdd9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbc00fdfd0 0x7fbbc010df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41764/0 (socket says 172.21.15.37:41764) 2024-04-25T17:27:46.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.093+0000 7fbbbdd9b700 1 -- 172.21.15.37:0/3967912184 learned_addr learned my addr 172.21.15.37:0/3967912184 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:27:46.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.093+0000 7fbbbe59c700 1 --2- 172.21.15.37:0/3967912184 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbbc00fce60 0x7fbbc010da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:27:46.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.093+0000 7fbbbdd9b700 1 -- 172.21.15.37:0/3967912184 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbbc00fce60 msgr2=0x7fbbc010da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:27:46.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.093+0000 7fbbbdd9b700 1 --2- 172.21.15.37:0/3967912184 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbbc00fce60 0x7fbbc010da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:46.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.093+0000 7fbbbdd9b700 1 -- 172.21.15.37:0/3967912184 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb4005040 con 0x7fbbc00fdfd0 2024-04-25T17:27:46.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.093+0000 7fbbbdd9b700 1 --2- 172.21.15.37:0/3967912184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbc00fdfd0 0x7fbbc010df60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fbbb400b3b0 tx=0x7fbbb4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:27:46.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.094+0000 7fbbaeffd700 1 -- 172.21.15.37:0/3967912184 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbbb400e040 con 0x7fbbc00fdfd0 2024-04-25T17:27:46.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.094+0000 7fbbc485c700 1 -- 172.21.15.37:0/3967912184 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbc010f030 con 0x7fbbc00fdfd0 2024-04-25T17:27:46.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.094+0000 7fbbc485c700 1 -- 172.21.15.37:0/3967912184 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbc010f570 con 0x7fbbc00fdfd0 2024-04-25T17:27:46.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.094+0000 7fbbaeffd700 1 -- 172.21.15.37:0/3967912184 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbbb400bcc0 con 0x7fbbc00fdfd0 2024-04-25T17:27:46.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.094+0000 7fbbaeffd700 1 -- 172.21.15.37:0/3967912184 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbbb401c630 con 0x7fbbc00fdfd0 2024-04-25T17:27:46.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.095+0000 7fbbc485c700 1 -- 172.21.15.37:0/3967912184 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbba00052e0 con 0x7fbbc00fdfd0 2024-04-25T17:27:46.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.096+0000 7fbbaeffd700 1 -- 172.21.15.37:0/3967912184 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7fbbb4013420 con 0x7fbbc00fdfd0 2024-04-25T17:27:46.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.096+0000 7fbbaeffd700 1 --2- 172.21.15.37:0/3967912184 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fbba8076b90 0x7fbba8079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:27:46.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.096+0000 7fbbaeffd700 1 -- 172.21.15.37:0/3967912184 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fbbb4098f10 con 0x7fbbc00fdfd0 2024-04-25T17:27:46.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.096+0000 7fbbbe59c700 1 --2- 172.21.15.37:0/3967912184 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fbba8076b90 0x7fbba8079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:27:46.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.097+0000 7fbbbe59c700 1 --2- 172.21.15.37:0/3967912184 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fbba8076b90 0x7fbba8079040 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0004990 tx=0x7fbbb0009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:27:46.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.106+0000 7fbbaeffd700 1 -- 172.21.15.37:0/3967912184 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fbbb4061a70 con 0x7fbbc00fdfd0 2024-04-25T17:27:46.282 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:46 smithi037 ceph-mon[90844]: pgmap v234: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:27:46.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:46 smithi069 ceph-mon[80239]: pgmap v234: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:27:46.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.428+0000 7fbbc485c700 1 -- 172.21.15.37:0/3967912184 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbba0005da0 con 0x7fbbc00fdfd0 2024-04-25T17:27:46.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.429+0000 7fbbaeffd700 1 -- 172.21.15.37:0/3967912184 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7fbbb4061410 con 0x7fbbc00fdfd0 2024-04-25T17:27:46.430 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-25T17:27:46.430 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": { 2024-04-25T17:27:46.430 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 2 2024-04-25T17:27:46.430 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:27:46.430 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": { 2024-04-25T17:27:46.430 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 2 2024-04-25T17:27:46.430 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:27:46.430 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": { 2024-04-25T17:27:46.430 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 6 2024-04-25T17:27:46.430 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:27:46.430 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": { 2024-04-25T17:27:46.430 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 4 2024-04-25T17:27:46.431 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:27:46.431 INFO:teuthology.orchestra.run.smithi037.stdout: "overall": { 2024-04-25T17:27:46.431 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 14 2024-04-25T17:27:46.431 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-04-25T17:27:46.431 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-25T17:27:46.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.431+0000 7fbbc485c700 1 -- 172.21.15.37:0/3967912184 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fbba8076b90 msgr2=0x7fbba8079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:27:46.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.431+0000 7fbbc485c700 1 --2- 172.21.15.37:0/3967912184 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fbba8076b90 0x7fbba8079040 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0004990 tx=0x7fbbb0009ee0 comp rx=0 tx=0).stop 2024-04-25T17:27:46.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.431+0000 7fbbc485c700 1 -- 172.21.15.37:0/3967912184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbc00fdfd0 msgr2=0x7fbbc010df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:27:46.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.431+0000 7fbbc485c700 1 --2- 172.21.15.37:0/3967912184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbc00fdfd0 0x7fbbc010df60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fbbb400b3b0 tx=0x7fbbb4009e30 comp rx=0 tx=0).stop 2024-04-25T17:27:46.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.431+0000 7fbbc485c700 1 -- 172.21.15.37:0/3967912184 shutdown_connections 2024-04-25T17:27:46.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.431+0000 7fbbc485c700 1 --2- 172.21.15.37:0/3967912184 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fbba8076b90 0x7fbba8079040 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:46.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.431+0000 7fbbc485c700 1 --2- 172.21.15.37:0/3967912184 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbbc00fce60 0x7fbbc010da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:46.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.431+0000 7fbbc485c700 1 --2- 172.21.15.37:0/3967912184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbc00fdfd0 0x7fbbc010df60 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:46.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.431+0000 7fbbc485c700 1 -- 172.21.15.37:0/3967912184 >> 172.21.15.37:0/3967912184 conn(0x7fbbc00f8500 msgr2=0x7fbbc00f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:27:46.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.431+0000 7fbbc485c700 1 -- 172.21.15.37:0/3967912184 shutdown_connections 2024-04-25T17:27:46.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.431+0000 7fbbc485c700 1 -- 172.21.15.37:0/3967912184 wait complete. 2024-04-25T17:27:46.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.538+0000 7f7016dcb700 1 -- 172.21.15.37:0/293616915 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70100662c0 msgr2=0x7f70100ff9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:27:46.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.538+0000 7f7016dcb700 1 --2- 172.21.15.37:0/293616915 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70100662c0 0x7f70100ff9a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7004004940 tx=0x7f7004009e30 comp rx=0 tx=0).stop 2024-04-25T17:27:46.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.538+0000 7f7016dcb700 1 -- 172.21.15.37:0/293616915 shutdown_connections 2024-04-25T17:27:46.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.538+0000 7f7016dcb700 1 --2- 172.21.15.37:0/293616915 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70100ffee0 0x7f7010102300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:46.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.539+0000 7f7016dcb700 1 --2- 172.21.15.37:0/293616915 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70100662c0 0x7f70100ff9a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:46.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.539+0000 7f7016dcb700 1 -- 172.21.15.37:0/293616915 >> 172.21.15.37:0/293616915 conn(0x7f70100f7430 msgr2=0x7f70100f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:27:46.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.539+0000 7f7016dcb700 1 -- 172.21.15.37:0/293616915 shutdown_connections 2024-04-25T17:27:46.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.539+0000 7f7016dcb700 1 -- 172.21.15.37:0/293616915 wait complete. 2024-04-25T17:27:46.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.539+0000 7f7016dcb700 1 Processor -- start 2024-04-25T17:27:46.540 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.539+0000 7f7016dcb700 1 -- start start 2024-04-25T17:27:46.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.540+0000 7f7016dcb700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70100662c0 0x7f70100fd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:27:46.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.540+0000 7f7016dcb700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70100ffee0 0x7f70100fb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:27:46.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.540+0000 7f7016dcb700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70100fbe50 con 0x7f70100662c0 2024-04-25T17:27:46.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.540+0000 7f7016dcb700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70100fbfc0 con 0x7f70100ffee0 2024-04-25T17:27:46.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.540+0000 7f7014b67700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70100662c0 0x7f70100fd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:27:46.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.540+0000 7f7014b67700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70100662c0 0x7f70100fd3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41792/0 (socket says 172.21.15.37:41792) 2024-04-25T17:27:46.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.540+0000 7f7014b67700 1 -- 172.21.15.37:0/905447336 learned_addr learned my addr 172.21.15.37:0/905447336 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:27:46.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.540+0000 7f700ffff700 1 --2- 172.21.15.37:0/905447336 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70100ffee0 0x7f70100fb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:27:46.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.540+0000 7f7014b67700 1 -- 172.21.15.37:0/905447336 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70100ffee0 msgr2=0x7f70100fb8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:27:46.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.540+0000 7f7014b67700 1 --2- 172.21.15.37:0/905447336 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70100ffee0 0x7f70100fb8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:46.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.540+0000 7f7014b67700 1 -- 172.21.15.37:0/905447336 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7004005040 con 0x7f70100662c0 2024-04-25T17:27:46.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.540+0000 7f700ffff700 1 --2- 172.21.15.37:0/905447336 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70100ffee0 0x7f70100fb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T17:27:46.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.540+0000 7f7014b67700 1 --2- 172.21.15.37:0/905447336 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70100662c0 0x7f70100fd3d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7004000c00 tx=0x7f7004009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:27:46.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.541+0000 7f700d7fa700 1 -- 172.21.15.37:0/905447336 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f700400e040 con 0x7f70100662c0 2024-04-25T17:27:46.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.541+0000 7f7016dcb700 1 -- 172.21.15.37:0/905447336 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70100fc240 con 0x7f70100662c0 2024-04-25T17:27:46.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.541+0000 7f7016dcb700 1 -- 172.21.15.37:0/905447336 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7010115a50 con 0x7f70100662c0 2024-04-25T17:27:46.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.541+0000 7f700d7fa700 1 -- 172.21.15.37:0/905447336 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f700400bcc0 con 0x7f70100662c0 2024-04-25T17:27:46.543 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.541+0000 7f700d7fa700 1 -- 172.21.15.37:0/905447336 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f700401c630 con 0x7f70100662c0 2024-04-25T17:27:46.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.542+0000 7f7016dcb700 1 -- 172.21.15.37:0/905447336 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f701005f5c0 con 0x7f70100662c0 2024-04-25T17:27:46.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.543+0000 7f700d7fa700 1 -- 172.21.15.37:0/905447336 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f7004013980 con 0x7f70100662c0 2024-04-25T17:27:46.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.544+0000 7f700d7fa700 1 --2- 172.21.15.37:0/905447336 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f7000076b90 0x7f7000079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:27:46.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.544+0000 7f700d7fa700 1 -- 172.21.15.37:0/905447336 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f7004099640 con 0x7f70100662c0 2024-04-25T17:27:46.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.544+0000 7f700ffff700 1 --2- 172.21.15.37:0/905447336 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f7000076b90 0x7f7000079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:27:46.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.544+0000 7f700ffff700 1 --2- 172.21.15.37:0/905447336 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f7000076b90 0x7f7000079040 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc0095c0 tx=0x7f6ffc007f20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:27:46.549 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.549+0000 7f700d7fa700 1 -- 172.21.15.37:0/905447336 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f7004062260 con 0x7f70100662c0 2024-04-25T17:27:46.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.815+0000 7f7016dcb700 1 -- 172.21.15.37:0/905447336 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f70100fc3d0 con 0x7f70100662c0 2024-04-25T17:27:46.818 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.816+0000 7f700d7fa700 1 -- 172.21.15.37:0/905447336 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 35 v35) v1 ==== 76+0+1963 (secure 0 0 0) 0x7f70100fc3d0 con 0x7f70100662c0 2024-04-25T17:27:46.818 INFO:teuthology.orchestra.run.smithi037.stdout:e35 2024-04-25T17:27:46.818 INFO:teuthology.orchestra.run.smithi037.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-25T17:27:46.818 INFO:teuthology.orchestra.run.smithi037.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T17:27:46.819 INFO:teuthology.orchestra.run.smithi037.stdout:legacy client fscid: 1 2024-04-25T17:27:46.819 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:27:46.819 INFO:teuthology.orchestra.run.smithi037.stdout:Filesystem 'cephfs' (1) 2024-04-25T17:27:46.819 INFO:teuthology.orchestra.run.smithi037.stdout:fs_name cephfs 2024-04-25T17:27:46.819 INFO:teuthology.orchestra.run.smithi037.stdout:epoch 35 2024-04-25T17:27:46.819 INFO:teuthology.orchestra.run.smithi037.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-25T17:27:46.819 INFO:teuthology.orchestra.run.smithi037.stdout:created 2024-04-25T17:15:40.586130+0000 2024-04-25T17:27:46.819 INFO:teuthology.orchestra.run.smithi037.stdout:modified 2024-04-25T17:27:00.988207+0000 2024-04-25T17:27:46.819 INFO:teuthology.orchestra.run.smithi037.stdout:tableserver 0 2024-04-25T17:27:46.819 INFO:teuthology.orchestra.run.smithi037.stdout:root 0 2024-04-25T17:27:46.819 INFO:teuthology.orchestra.run.smithi037.stdout:session_timeout 60 2024-04-25T17:27:46.819 INFO:teuthology.orchestra.run.smithi037.stdout:session_autoclose 300 2024-04-25T17:27:46.819 INFO:teuthology.orchestra.run.smithi037.stdout:max_file_size 1099511627776 2024-04-25T17:27:46.819 INFO:teuthology.orchestra.run.smithi037.stdout:max_xattr_size 65536 2024-04-25T17:27:46.819 INFO:teuthology.orchestra.run.smithi037.stdout:required_client_features {} 2024-04-25T17:27:46.820 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure 0 2024-04-25T17:27:46.820 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure_osd_epoch 84 2024-04-25T17:27:46.820 INFO:teuthology.orchestra.run.smithi037.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-25T17:27:46.820 INFO:teuthology.orchestra.run.smithi037.stdout:max_mds 1 2024-04-25T17:27:46.820 INFO:teuthology.orchestra.run.smithi037.stdout:in 0 2024-04-25T17:27:46.820 INFO:teuthology.orchestra.run.smithi037.stdout:up {0=34412} 2024-04-25T17:27:46.820 INFO:teuthology.orchestra.run.smithi037.stdout:failed 2024-04-25T17:27:46.820 INFO:teuthology.orchestra.run.smithi037.stdout:damaged 2024-04-25T17:27:46.820 INFO:teuthology.orchestra.run.smithi037.stdout:stopped 2024-04-25T17:27:46.820 INFO:teuthology.orchestra.run.smithi037.stdout:data_pools [3] 2024-04-25T17:27:46.820 INFO:teuthology.orchestra.run.smithi037.stdout:metadata_pool 2 2024-04-25T17:27:46.820 INFO:teuthology.orchestra.run.smithi037.stdout:inline_data disabled 2024-04-25T17:27:46.820 INFO:teuthology.orchestra.run.smithi037.stdout:balancer 2024-04-25T17:27:46.820 INFO:teuthology.orchestra.run.smithi037.stdout:bal_rank_mask -1 2024-04-25T17:27:46.820 INFO:teuthology.orchestra.run.smithi037.stdout:standby_count_wanted 1 2024-04-25T17:27:46.821 INFO:teuthology.orchestra.run.smithi037.stdout:qdb_cluster leader: 34412 members: 34412 2024-04-25T17:27:46.821 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi037.ksmixc{0:34412} state up:active seq 18 join_fscid=1 addr [v2:172.21.15.37:6826/2514248612,v1:172.21.15.37:6827/2514248612] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T17:27:46.821 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi037.ovkrpq{0:34444} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.37:6828/2067664560,v1:172.21.15.37:6829/2067664560] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T17:27:46.821 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:27:46.821 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:27:46.821 INFO:teuthology.orchestra.run.smithi037.stdout:Standby daemons: 2024-04-25T17:27:46.821 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:27:46.821 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi069.ytlqcf{-1:44347} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.69:6824/3424891497,v1:172.21.15.69:6825/3424891497] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T17:27:46.821 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi069.cpprst{-1:44379} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.69:6826/3383509929,v1:172.21.15.69:6827/3383509929] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T17:27:46.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.819+0000 7f7016dcb700 1 -- 172.21.15.37:0/905447336 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f7000076b90 msgr2=0x7f7000079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:27:46.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.819+0000 7f7016dcb700 1 --2- 172.21.15.37:0/905447336 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f7000076b90 0x7f7000079040 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc0095c0 tx=0x7f6ffc007f20 comp rx=0 tx=0).stop 2024-04-25T17:27:46.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.819+0000 7f7016dcb700 1 -- 172.21.15.37:0/905447336 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70100662c0 msgr2=0x7f70100fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:27:46.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.819+0000 7f7016dcb700 1 --2- 172.21.15.37:0/905447336 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70100662c0 0x7f70100fd3d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7004000c00 tx=0x7f7004009e30 comp rx=0 tx=0).stop 2024-04-25T17:27:46.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.819+0000 7f7016dcb700 1 -- 172.21.15.37:0/905447336 shutdown_connections 2024-04-25T17:27:46.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.819+0000 7f7016dcb700 1 --2- 172.21.15.37:0/905447336 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f7000076b90 0x7f7000079040 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:46.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.819+0000 7f7016dcb700 1 --2- 172.21.15.37:0/905447336 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f70100662c0 0x7f70100fd3d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:46.822 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.819+0000 7f7016dcb700 1 --2- 172.21.15.37:0/905447336 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f70100ffee0 0x7f70100fb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:46.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.819+0000 7f7016dcb700 1 -- 172.21.15.37:0/905447336 >> 172.21.15.37:0/905447336 conn(0x7f70100f7430 msgr2=0x7f70100f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:27:46.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.819+0000 7f7016dcb700 1 -- 172.21.15.37:0/905447336 shutdown_connections 2024-04-25T17:27:46.823 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.819+0000 7f7016dcb700 1 -- 172.21.15.37:0/905447336 wait complete. 2024-04-25T17:27:46.823 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 35 2024-04-25T17:27:46.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.941+0000 7f2ff5faa700 1 -- 172.21.15.37:0/2420925814 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ff01022f0 msgr2=0x7f2ff01046d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:27:46.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.941+0000 7f2ff5faa700 1 --2- 172.21.15.37:0/2420925814 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ff01022f0 0x7f2ff01046d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4004940 tx=0x7f2fe4009e30 comp rx=0 tx=0).stop 2024-04-25T17:27:46.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.942+0000 7f2ff5faa700 1 -- 172.21.15.37:0/2420925814 shutdown_connections 2024-04-25T17:27:46.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.942+0000 7f2ff5faa700 1 --2- 172.21.15.37:0/2420925814 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ff01022f0 0x7f2ff01046d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:46.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.942+0000 7f2ff5faa700 1 --2- 172.21.15.37:0/2420925814 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ff0066f50 0x7f2ff0101db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:46.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.942+0000 7f2ff5faa700 1 -- 172.21.15.37:0/2420925814 >> 172.21.15.37:0/2420925814 conn(0x7f2ff00f7440 msgr2=0x7f2ff00f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:27:46.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.942+0000 7f2ff5faa700 1 -- 172.21.15.37:0/2420925814 shutdown_connections 2024-04-25T17:27:46.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.942+0000 7f2ff5faa700 1 -- 172.21.15.37:0/2420925814 wait complete. 2024-04-25T17:27:46.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.942+0000 7f2ff5faa700 1 Processor -- start 2024-04-25T17:27:46.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.942+0000 7f2ff5faa700 1 -- start start 2024-04-25T17:27:46.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.942+0000 7f2ff5faa700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ff0066f50 0x7f2ff010fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:27:46.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.942+0000 7f2ff5faa700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ff01022f0 0x7f2ff01100b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:27:46.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.942+0000 7f2ff5faa700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff01106b0 con 0x7f2ff0066f50 2024-04-25T17:27:46.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.942+0000 7f2ff5faa700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff0110820 con 0x7f2ff01022f0 2024-04-25T17:27:46.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.943+0000 7f2fef7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ff0066f50 0x7f2ff010fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:27:46.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.943+0000 7f2fef7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ff0066f50 0x7f2ff010fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35704/0 (socket says 172.21.15.37:35704) 2024-04-25T17:27:46.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.943+0000 7f2fef7fe700 1 -- 172.21.15.37:0/3549576806 learned_addr learned my addr 172.21.15.37:0/3549576806 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:27:46.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.943+0000 7f2feeffd700 1 --2- 172.21.15.37:0/3549576806 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ff01022f0 0x7f2ff01100b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:27:46.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.943+0000 7f2fef7fe700 1 -- 172.21.15.37:0/3549576806 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ff01022f0 msgr2=0x7f2ff01100b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:27:46.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.943+0000 7f2fef7fe700 1 --2- 172.21.15.37:0/3549576806 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ff01022f0 0x7f2ff01100b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:46.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.943+0000 7f2fef7fe700 1 -- 172.21.15.37:0/3549576806 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe4005040 con 0x7f2ff0066f50 2024-04-25T17:27:46.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.943+0000 7f2fef7fe700 1 --2- 172.21.15.37:0/3549576806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ff0066f50 0x7f2ff010fb70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0002a50 tx=0x7f2fe00046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:27:46.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.943+0000 7f2fd7fff700 1 -- 172.21.15.37:0/3549576806 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fe0007cc0 con 0x7f2ff0066f50 2024-04-25T17:27:46.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.943+0000 7f2fd7fff700 1 -- 172.21.15.37:0/3549576806 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2fe000f040 con 0x7f2ff0066f50 2024-04-25T17:27:46.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.943+0000 7f2ff5faa700 1 -- 172.21.15.37:0/3549576806 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ff0115230 con 0x7f2ff0066f50 2024-04-25T17:27:46.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.943+0000 7f2fd7fff700 1 -- 172.21.15.37:0/3549576806 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fe000db30 con 0x7f2ff0066f50 2024-04-25T17:27:46.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.943+0000 7f2ff5faa700 1 -- 172.21.15.37:0/3549576806 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ff01157f0 con 0x7f2ff0066f50 2024-04-25T17:27:46.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.945+0000 7f2ff5faa700 1 -- 172.21.15.37:0/3549576806 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ff004c710 con 0x7f2ff0066f50 2024-04-25T17:27:46.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.945+0000 7f2fd7fff700 1 -- 172.21.15.37:0/3549576806 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f2fe000dc90 con 0x7f2ff0066f50 2024-04-25T17:27:46.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.945+0000 7f2fd7fff700 1 --2- 172.21.15.37:0/3549576806 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f2fd8076b90 0x7f2fd8079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:27:46.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.946+0000 7f2fd7fff700 1 -- 172.21.15.37:0/3549576806 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f2fe0097fb0 con 0x7f2ff0066f50 2024-04-25T17:27:46.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.946+0000 7f2feeffd700 1 --2- 172.21.15.37:0/3549576806 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f2fd8076b90 0x7f2fd8079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:27:46.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.946+0000 7f2feeffd700 1 --2- 172.21.15.37:0/3549576806 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f2fd8076b90 0x7f2fd8079040 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4004f90 tx=0x7f2fe4009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:27:46.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:46.951+0000 7f2fd7fff700 1 -- 172.21.15.37:0/3549576806 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f2fe00ccff0 con 0x7f2ff0066f50 2024-04-25T17:27:47.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:47.192+0000 7f2ff5faa700 1 -- 172.21.15.37:0/3549576806 --> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ff00f8f30 con 0x7f2fd8076b90 2024-04-25T17:27:47.194 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:47.193+0000 7f2fd7fff700 1 -- 172.21.15.37:0/3549576806 <== mgr.34104 v2:172.21.15.37:6800/783197737 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+440 (secure 0 0 0) 0x7f2ff00f8f30 con 0x7f2fd8076b90 2024-04-25T17:27:47.194 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-25T17:27:47.194 INFO:teuthology.orchestra.run.smithi037.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385", 2024-04-25T17:27:47.194 INFO:teuthology.orchestra.run.smithi037.stdout: "in_progress": true, 2024-04-25T17:27:47.194 INFO:teuthology.orchestra.run.smithi037.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-25T17:27:47.194 INFO:teuthology.orchestra.run.smithi037.stdout: "services_complete": [ 2024-04-25T17:27:47.194 INFO:teuthology.orchestra.run.smithi037.stdout: "mds", 2024-04-25T17:27:47.194 INFO:teuthology.orchestra.run.smithi037.stdout: "mon", 2024-04-25T17:27:47.194 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr", 2024-04-25T17:27:47.194 INFO:teuthology.orchestra.run.smithi037.stdout: "osd", 2024-04-25T17:27:47.195 INFO:teuthology.orchestra.run.smithi037.stdout: "crash" 2024-04-25T17:27:47.195 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-04-25T17:27:47.195 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": "16/21 daemons upgraded", 2024-04-25T17:27:47.195 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "Currently upgrading alertmanager daemons", 2024-04-25T17:27:47.195 INFO:teuthology.orchestra.run.smithi037.stdout: "is_paused": false 2024-04-25T17:27:47.195 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-25T17:27:47.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:47.195+0000 7f2ff5faa700 1 -- 172.21.15.37:0/3549576806 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f2fd8076b90 msgr2=0x7f2fd8079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:27:47.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:47.195+0000 7f2ff5faa700 1 --2- 172.21.15.37:0/3549576806 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f2fd8076b90 0x7f2fd8079040 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4004f90 tx=0x7f2fe4009e30 comp rx=0 tx=0).stop 2024-04-25T17:27:47.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:47.195+0000 7f2ff5faa700 1 -- 172.21.15.37:0/3549576806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ff0066f50 msgr2=0x7f2ff010fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:27:47.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:47.195+0000 7f2ff5faa700 1 --2- 172.21.15.37:0/3549576806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ff0066f50 0x7f2ff010fb70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0002a50 tx=0x7f2fe00046b0 comp rx=0 tx=0).stop 2024-04-25T17:27:47.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:47.195+0000 7f2ff5faa700 1 -- 172.21.15.37:0/3549576806 shutdown_connections 2024-04-25T17:27:47.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:47.195+0000 7f2ff5faa700 1 --2- 172.21.15.37:0/3549576806 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f2fd8076b90 0x7f2fd8079040 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:47.196 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:47.195+0000 7f2ff5faa700 1 --2- 172.21.15.37:0/3549576806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2ff0066f50 0x7f2ff010fb70 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:47.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:47.195+0000 7f2ff5faa700 1 --2- 172.21.15.37:0/3549576806 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ff01022f0 0x7f2ff01100b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:47.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:47.195+0000 7f2ff5faa700 1 -- 172.21.15.37:0/3549576806 >> 172.21.15.37:0/3549576806 conn(0x7f2ff00f7440 msgr2=0x7f2ff00f7810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:27:47.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:47.196+0000 7f2ff5faa700 1 -- 172.21.15.37:0/3549576806 shutdown_connections 2024-04-25T17:27:47.197 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:47.196+0000 7f2ff5faa700 1 -- 172.21.15.37:0/3549576806 wait complete. 2024-04-25T17:27:47.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:47.300+0000 7f8411e2f700 1 -- 172.21.15.37:0/1261401957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f840c066f30 msgr2=0x7f840c0ff9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:27:47.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:47.300+0000 7f8411e2f700 1 --2- 172.21.15.37:0/1261401957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f840c066f30 0x7f840c0ff9e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f83fc004940 tx=0x7f83fc009e30 comp rx=0 tx=0).stop 2024-04-25T17:27:47.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:47.301+0000 7f8411e2f700 1 -- 172.21.15.37:0/1261401957 shutdown_connections 2024-04-25T17:27:47.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:47.301+0000 7f8411e2f700 1 --2- 172.21.15.37:0/1261401957 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f840c0fff20 0x7f840c102340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:47.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:47.301+0000 7f8411e2f700 1 --2- 172.21.15.37:0/1261401957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f840c066f30 0x7f840c0ff9e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:47.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:47.301+0000 7f8411e2f700 1 -- 172.21.15.37:0/1261401957 >> 172.21.15.37:0/1261401957 conn(0x7f840c0f7450 msgr2=0x7f840c0f9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:27:47.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:47.301+0000 7f8411e2f700 1 -- 172.21.15.37:0/1261401957 shutdown_connections 2024-04-25T17:27:47.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:47.301+0000 7f8411e2f700 1 -- 172.21.15.37:0/1261401957 wait complete. 2024-04-25T17:27:47.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:47.301+0000 7f8411e2f700 1 Processor -- start 2024-04-25T17:27:47.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:47.301+0000 7f8411e2f700 1 -- start start 2024-04-25T17:27:47.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:47.302+0000 7f8411e2f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f840c066f30 0x7f840c10d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:27:47.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:47.302+0000 7f8411e2f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f840c0fff20 0x7f840c10dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:27:47.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:47.302+0000 7f8411e2f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f840c10e4c0 con 0x7f840c0fff20 2024-04-25T17:27:47.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:47.302+0000 7f8411e2f700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f840c10e630 con 0x7f840c066f30 2024-04-25T17:27:47.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:47.302+0000 7f840affd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f840c0fff20 0x7f840c10dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:27:47.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:47.302+0000 7f840affd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f840c0fff20 0x7f840c10dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35714/0 (socket says 172.21.15.37:35714) 2024-04-25T17:27:47.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:47.302+0000 7f840affd700 1 -- 172.21.15.37:0/3393834260 learned_addr learned my addr 172.21.15.37:0/3393834260 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:27:47.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:47.302+0000 7f840b7fe700 1 --2- 172.21.15.37:0/3393834260 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f840c066f30 0x7f840c10d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:27:47.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:47.302+0000 7f840affd700 1 -- 172.21.15.37:0/3393834260 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f840c066f30 msgr2=0x7f840c10d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:27:47.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:47.302+0000 7f840affd700 1 --2- 172.21.15.37:0/3393834260 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f840c066f30 0x7f840c10d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:47.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:47.302+0000 7f840affd700 1 -- 172.21.15.37:0/3393834260 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83fc005040 con 0x7f840c0fff20 2024-04-25T17:27:47.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:47.302+0000 7f840affd700 1 --2- 172.21.15.37:0/3393834260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f840c0fff20 0x7f840c10dec0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f840000c830 tx=0x7f8400004470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:27:47.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:47.302+0000 7f83f3fff700 1 -- 172.21.15.37:0/3393834260 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84000106f0 con 0x7f840c0fff20 2024-04-25T17:27:47.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:47.303+0000 7f8411e2f700 1 -- 172.21.15.37:0/3393834260 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f840c113040 con 0x7f840c0fff20 2024-04-25T17:27:47.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:47.303+0000 7f83f3fff700 1 -- 172.21.15.37:0/3393834260 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8400010d20 con 0x7f840c0fff20 2024-04-25T17:27:47.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:47.303+0000 7f83f3fff700 1 -- 172.21.15.37:0/3393834260 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f84000113a0 con 0x7f840c0fff20 2024-04-25T17:27:47.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:47.303+0000 7f8411e2f700 1 -- 172.21.15.37:0/3393834260 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f840c1135d0 con 0x7f840c0fff20 2024-04-25T17:27:47.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:47.303+0000 7f8411e2f700 1 -- 172.21.15.37:0/3393834260 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f840c04c710 con 0x7f840c0fff20 2024-04-25T17:27:47.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:47.304+0000 7f83f3fff700 1 -- 172.21.15.37:0/3393834260 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f8400012400 con 0x7f840c0fff20 2024-04-25T17:27:47.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:47.305+0000 7f83f3fff700 1 --2- 172.21.15.37:0/3393834260 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f83f4076b90 0x7f83f4079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:27:47.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:47.305+0000 7f83f3fff700 1 -- 172.21.15.37:0/3393834260 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f8400098220 con 0x7f840c0fff20 2024-04-25T17:27:47.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:47.305+0000 7f840b7fe700 1 --2- 172.21.15.37:0/3393834260 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f83f4076b90 0x7f83f4079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:27:47.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:47.305+0000 7f840b7fe700 1 --2- 172.21.15.37:0/3393834260 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f83f4076b90 0x7f83f4079040 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f83fc00b970 tx=0x7f83fc009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:27:47.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:47.310+0000 7f83f3fff700 1 -- 172.21.15.37:0/3393834260 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f8400060e40 con 0x7f840c0fff20 2024-04-25T17:27:47.377 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:47 smithi037 ceph-mon[90844]: from='client.34510 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:27:47.378 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:47 smithi037 ceph-mon[90844]: from='client.34514 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:27:47.378 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:47 smithi037 ceph-mon[90844]: from='client.34518 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:27:47.378 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:47 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/3967912184' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:47.378 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:47 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/905447336' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T17:27:47.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:47 smithi069 ceph-mon[80239]: from='client.34510 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:27:47.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:47 smithi069 ceph-mon[80239]: from='client.34514 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:27:47.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:47 smithi069 ceph-mon[80239]: from='client.34518 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:27:47.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:47 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/3967912184' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:47.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:47 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/905447336' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T17:27:47.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:47.614+0000 7f8411e2f700 1 -- 172.21.15.37:0/3393834260 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f840c113ba0 con 0x7f840c0fff20 2024-04-25T17:27:47.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:47.614+0000 7f83f3fff700 1 -- 172.21.15.37:0/3393834260 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f84000607e0 con 0x7f840c0fff20 2024-04-25T17:27:47.615 INFO:teuthology.orchestra.run.smithi037.stdout:HEALTH_OK 2024-04-25T17:27:47.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:47.616+0000 7f8411e2f700 1 -- 172.21.15.37:0/3393834260 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f83f4076b90 msgr2=0x7f83f4079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:27:47.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:47.616+0000 7f8411e2f700 1 --2- 172.21.15.37:0/3393834260 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f83f4076b90 0x7f83f4079040 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f83fc00b970 tx=0x7f83fc009e30 comp rx=0 tx=0).stop 2024-04-25T17:27:47.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:47.616+0000 7f8411e2f700 1 -- 172.21.15.37:0/3393834260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f840c0fff20 msgr2=0x7f840c10dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:27:47.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:47.616+0000 7f8411e2f700 1 --2- 172.21.15.37:0/3393834260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f840c0fff20 0x7f840c10dec0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f840000c830 tx=0x7f8400004470 comp rx=0 tx=0).stop 2024-04-25T17:27:47.617 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:47.616+0000 7f8411e2f700 1 -- 172.21.15.37:0/3393834260 shutdown_connections 2024-04-25T17:27:47.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:47.616+0000 7f8411e2f700 1 --2- 172.21.15.37:0/3393834260 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f83f4076b90 0x7f83f4079040 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:47.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:47.616+0000 7f8411e2f700 1 --2- 172.21.15.37:0/3393834260 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f840c066f30 0x7f840c10d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:47.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:47.617+0000 7f8411e2f700 1 --2- 172.21.15.37:0/3393834260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f840c0fff20 0x7f840c10dec0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:27:47.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:47.617+0000 7f8411e2f700 1 -- 172.21.15.37:0/3393834260 >> 172.21.15.37:0/3393834260 conn(0x7f840c0f7450 msgr2=0x7f840c0f7870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:27:47.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:47.617+0000 7f8411e2f700 1 -- 172.21.15.37:0/3393834260 shutdown_connections 2024-04-25T17:27:47.618 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:27:47.617+0000 7f8411e2f700 1 -- 172.21.15.37:0/3393834260 wait complete. 2024-04-25T17:27:48.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:48 smithi069 ceph-mon[80239]: pgmap v235: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:27:48.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:48 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/3393834260' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T17:27:48.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:48 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:48.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:48 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:48.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:48 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:27:48.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:48 smithi037 ceph-mon[90844]: pgmap v235: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:27:48.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:48 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/3393834260' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T17:27:48.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:48 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:48.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:48 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:48.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:48 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:27:49.398 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:49 smithi037 ceph-mon[90844]: from='client.34530 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:27:49.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:49 smithi069 ceph-mon[80239]: from='client.34530 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:27:50.374 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:50 smithi037 ceph-mon[90844]: pgmap v236: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:27:50.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:50 smithi069 ceph-mon[80239]: pgmap v236: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:27:52.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:52 smithi069 ceph-mon[80239]: pgmap v237: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:27:52.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:52 smithi037 ceph-mon[90844]: pgmap v237: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:27:53.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:53 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:53.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:53 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:53.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:53 smithi037 ceph-mon[90844]: pgmap v238: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:27:53.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:53 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:53.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:53 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:53.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:53 smithi069 ceph-mon[80239]: pgmap v238: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:27:54.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:54 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:54.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:54 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:54.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:54 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:54.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:54 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:55.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:55 smithi037 ceph-mon[90844]: pgmap v239: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:27:55.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:55 smithi069 ceph-mon[80239]: pgmap v239: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:27:58.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:58 smithi037 ceph-mon[90844]: pgmap v240: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:27:58.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:58 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:58.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:58 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:58.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:58 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:27:58.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:58 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:27:58.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:58 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:58.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:58 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-25T17:27:58.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:58 smithi037 ceph-mon[90844]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-25T17:27:58.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:58 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi037:9093"}]: dispatch 2024-04-25T17:27:58.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:58 smithi037 ceph-mon[90844]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi037:9093"}]: dispatch 2024-04-25T17:27:58.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:58 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:58.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:58 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:27:58.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:58 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:58.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:58 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:58.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:58 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:58.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:58 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:58.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:58 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:58.073 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:58 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:58.074 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:58 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:58.074 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:58 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:58.074 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:58 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:58.074 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:58 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:58.074 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:58 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:58.074 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:58 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:58.074 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:58 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:58.074 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:58 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:58.074 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:58 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:58.074 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:27:58 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:27:58.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:58 smithi069 ceph-mon[80239]: pgmap v240: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:27:58.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:58 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:58.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:58 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:58.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:58 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:27:58.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:58 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:27:58.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:58 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:58.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:58 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-25T17:27:58.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:58 smithi069 ceph-mon[80239]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-04-25T17:27:58.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:58 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi037:9093"}]: dispatch 2024-04-25T17:27:58.420 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:58 smithi069 ceph-mon[80239]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi037:9093"}]: dispatch 2024-04-25T17:27:58.421 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:58 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:27:58.421 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:58 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:27:58.421 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:58 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:58.421 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:58 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:58.421 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:58 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:58.421 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:58 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:58.421 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:58 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:58.422 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:58 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:58.422 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:58 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:58.422 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:58 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:58.422 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:58 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:58.422 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:58 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:58.422 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:58 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:58.422 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:58 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:58.423 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:58 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:58.423 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:58 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:58.423 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:58 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:27:58.423 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:27:58 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:28:00.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:00 smithi037 ceph-mon[90844]: pgmap v241: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:28:00.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:00 smithi037 ceph-mon[90844]: Upgrade: Updating grafana.smithi037 2024-04-25T17:28:00.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:00 smithi037 ceph-mon[90844]: Deploying daemon grafana.smithi037 on smithi037 2024-04-25T17:28:00.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:00 smithi069 ceph-mon[80239]: pgmap v241: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:28:00.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:00 smithi069 ceph-mon[80239]: Upgrade: Updating grafana.smithi037 2024-04-25T17:28:00.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:00 smithi069 ceph-mon[80239]: Deploying daemon grafana.smithi037 on smithi037 2024-04-25T17:28:02.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:02 smithi037 ceph-mon[90844]: pgmap v242: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:28:02.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:02 smithi069 ceph-mon[80239]: pgmap v242: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:28:04.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:04 smithi037 ceph-mon[90844]: pgmap v243: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:28:04.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:04 smithi069 ceph-mon[80239]: pgmap v243: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:28:06.180 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:06 smithi037 ceph-mon[90844]: pgmap v244: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:28:06.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:06 smithi069 ceph-mon[80239]: pgmap v244: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:28:08.232 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:08 smithi037 ceph-mon[90844]: pgmap v245: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:28:08.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:08 smithi069 ceph-mon[80239]: pgmap v245: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:28:10.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:10 smithi037 ceph-mon[90844]: pgmap v246: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:28:10.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:10 smithi069 ceph-mon[80239]: pgmap v246: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:28:12.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:11 smithi037 ceph-mon[90844]: pgmap v247: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:28:12.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:11 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:28:12.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:11 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:28:12.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:11 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:28:12.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:11 smithi069 ceph-mon[80239]: pgmap v247: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:28:12.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:11 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:28:12.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:11 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:28:12.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:11 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:28:13.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:12 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:28:13.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:12 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:28:14.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:13 smithi037 ceph-mon[90844]: pgmap v248: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:28:14.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:13 smithi069 ceph-mon[80239]: pgmap v248: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:28:16.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:15 smithi037 ceph-mon[90844]: pgmap v249: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:28:16.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:15 smithi069 ceph-mon[80239]: pgmap v249: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:28:17.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:17 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:28:17.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:17 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:28:17.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:17 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:28:17.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:17 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:28:17.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:17.736+0000 7f5027d0c700 1 -- 172.21.15.37:0/4277176401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50200fcf60 msgr2=0x7f50200fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:28:17.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:17.736+0000 7f5027d0c700 1 --2- 172.21.15.37:0/4277176401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50200fcf60 0x7f50200fd3d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5010004940 tx=0x7f5010009e30 comp rx=0 tx=0).stop 2024-04-25T17:28:17.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:17.736+0000 7f5027d0c700 1 -- 172.21.15.37:0/4277176401 shutdown_connections 2024-04-25T17:28:17.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:17.736+0000 7f5027d0c700 1 --2- 172.21.15.37:0/4277176401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50200fcf60 0x7f50200fd3d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:17.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:17.736+0000 7f5027d0c700 1 --2- 172.21.15.37:0/4277176401 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f50200fbcb0 0x7f50200fc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:17.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:17.736+0000 7f5027d0c700 1 -- 172.21.15.37:0/4277176401 >> 172.21.15.37:0/4277176401 conn(0x7f50200f7430 msgr2=0x7f50200f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:28:17.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:17.736+0000 7f5027d0c700 1 -- 172.21.15.37:0/4277176401 shutdown_connections 2024-04-25T17:28:17.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:17.736+0000 7f5027d0c700 1 -- 172.21.15.37:0/4277176401 wait complete. 2024-04-25T17:28:17.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:17.737+0000 7f5027d0c700 1 Processor -- start 2024-04-25T17:28:17.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:17.737+0000 7f5027d0c700 1 -- start start 2024-04-25T17:28:17.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:17.737+0000 7f5027d0c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50200fbcb0 0x7f502010da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:28:17.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:17.737+0000 7f5027d0c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f50200fcf60 0x7f502010dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:28:17.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:17.737+0000 7f5027d0c700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f502010e5c0 con 0x7f50200fbcb0 2024-04-25T17:28:17.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:17.737+0000 7f5027d0c700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f502010edc0 con 0x7f50200fcf60 2024-04-25T17:28:17.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:17.737+0000 7f5025aa8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50200fbcb0 0x7f502010da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:28:17.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:17.737+0000 7f5025aa8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50200fbcb0 0x7f502010da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59258/0 (socket says 172.21.15.37:59258) 2024-04-25T17:28:17.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:17.737+0000 7f5025aa8700 1 -- 172.21.15.37:0/3633730571 learned_addr learned my addr 172.21.15.37:0/3633730571 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:28:17.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:17.737+0000 7f50252a7700 1 --2- 172.21.15.37:0/3633730571 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f50200fcf60 0x7f502010dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:28:17.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:17.738+0000 7f5025aa8700 1 -- 172.21.15.37:0/3633730571 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f50200fcf60 msgr2=0x7f502010dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:28:17.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:17.738+0000 7f5025aa8700 1 --2- 172.21.15.37:0/3633730571 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f50200fcf60 0x7f502010dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:17.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:17.738+0000 7f5025aa8700 1 -- 172.21.15.37:0/3633730571 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5010005040 con 0x7f50200fbcb0 2024-04-25T17:28:17.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:17.738+0000 7f5025aa8700 1 --2- 172.21.15.37:0/3633730571 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50200fbcb0 0x7f502010da80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f501c00c8c0 tx=0x7f501c0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:28:17.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:17.738+0000 7f50167fc700 1 -- 172.21.15.37:0/3633730571 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f501c00a760 con 0x7f50200fbcb0 2024-04-25T17:28:17.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:17.738+0000 7f5027d0c700 1 -- 172.21.15.37:0/3633730571 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f502010f0a0 con 0x7f50200fbcb0 2024-04-25T17:28:17.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:17.738+0000 7f50167fc700 1 -- 172.21.15.37:0/3633730571 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f501c00ad90 con 0x7f50200fbcb0 2024-04-25T17:28:17.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:17.738+0000 7f50167fc700 1 -- 172.21.15.37:0/3633730571 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f501c0113a0 con 0x7f50200fbcb0 2024-04-25T17:28:17.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:17.738+0000 7f5027d0c700 1 -- 172.21.15.37:0/3633730571 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f502010f5e0 con 0x7f50200fbcb0 2024-04-25T17:28:17.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:17.739+0000 7f5027d0c700 1 -- 172.21.15.37:0/3633730571 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5020101af0 con 0x7f50200fbcb0 2024-04-25T17:28:17.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:17.740+0000 7f50167fc700 1 -- 172.21.15.37:0/3633730571 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f501c012400 con 0x7f50200fbcb0 2024-04-25T17:28:17.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:17.740+0000 7f50167fc700 1 --2- 172.21.15.37:0/3633730571 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f500c076b90 0x7f500c079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:28:17.742 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:17.740+0000 7f50167fc700 1 -- 172.21.15.37:0/3633730571 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f501c0982f0 con 0x7f50200fbcb0 2024-04-25T17:28:17.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:17.740+0000 7f50252a7700 1 --2- 172.21.15.37:0/3633730571 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f500c076b90 0x7f500c079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:28:17.743 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:17.741+0000 7f50252a7700 1 --2- 172.21.15.37:0/3633730571 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f500c076b90 0x7f500c079040 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f501000b970 tx=0x7f5010009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:28:17.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:17.745+0000 7f50167fc700 1 -- 172.21.15.37:0/3633730571 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f501c060f10 con 0x7f50200fbcb0 2024-04-25T17:28:17.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:17.978+0000 7f5027d0c700 1 -- 172.21.15.37:0/3633730571 --> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5020104920 con 0x7f500c076b90 2024-04-25T17:28:17.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:17.980+0000 7f50167fc700 1 -- 172.21.15.37:0/3633730571 <== mgr.34104 v2:172.21.15.37:6800/783197737 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+435 (secure 0 0 0) 0x7f5020104920 con 0x7f500c076b90 2024-04-25T17:28:17.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:17.982+0000 7f5027d0c700 1 -- 172.21.15.37:0/3633730571 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f500c076b90 msgr2=0x7f500c079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:28:17.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:17.982+0000 7f5027d0c700 1 --2- 172.21.15.37:0/3633730571 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f500c076b90 0x7f500c079040 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f501000b970 tx=0x7f5010009e30 comp rx=0 tx=0).stop 2024-04-25T17:28:17.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:17.982+0000 7f5027d0c700 1 -- 172.21.15.37:0/3633730571 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50200fbcb0 msgr2=0x7f502010da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:28:17.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:17.982+0000 7f5027d0c700 1 --2- 172.21.15.37:0/3633730571 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50200fbcb0 0x7f502010da80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f501c00c8c0 tx=0x7f501c0044c0 comp rx=0 tx=0).stop 2024-04-25T17:28:17.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:17.982+0000 7f5027d0c700 1 -- 172.21.15.37:0/3633730571 shutdown_connections 2024-04-25T17:28:17.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:17.982+0000 7f5027d0c700 1 --2- 172.21.15.37:0/3633730571 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f500c076b90 0x7f500c079040 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:17.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:17.982+0000 7f5027d0c700 1 --2- 172.21.15.37:0/3633730571 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50200fbcb0 0x7f502010da80 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:17.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:17.982+0000 7f5027d0c700 1 --2- 172.21.15.37:0/3633730571 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f50200fcf60 0x7f502010dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:17.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:17.982+0000 7f5027d0c700 1 -- 172.21.15.37:0/3633730571 >> 172.21.15.37:0/3633730571 conn(0x7f50200f7430 msgr2=0x7f5020065b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:28:17.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:17.982+0000 7f5027d0c700 1 -- 172.21.15.37:0/3633730571 shutdown_connections 2024-04-25T17:28:17.985 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:17.982+0000 7f5027d0c700 1 -- 172.21.15.37:0/3633730571 wait complete. 2024-04-25T17:28:17.994 INFO:teuthology.orchestra.run.smithi037.stdout:true 2024-04-25T17:28:18.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.090+0000 7f03f138a700 1 -- 172.21.15.37:0/850174509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03ec066f30 msgr2=0x7f03ec0ff9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:28:18.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.090+0000 7f03f138a700 1 --2- 172.21.15.37:0/850174509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03ec066f30 0x7f03ec0ff9b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f03e4009ce0 tx=0x7f03e4004d10 comp rx=0 tx=0).stop 2024-04-25T17:28:18.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.090+0000 7f03f138a700 1 -- 172.21.15.37:0/850174509 shutdown_connections 2024-04-25T17:28:18.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.090+0000 7f03f138a700 1 --2- 172.21.15.37:0/850174509 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f03ec0ffef0 0x7f03ec102310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:18.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.090+0000 7f03f138a700 1 --2- 172.21.15.37:0/850174509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03ec066f30 0x7f03ec0ff9b0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:18.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.090+0000 7f03f138a700 1 -- 172.21.15.37:0/850174509 >> 172.21.15.37:0/850174509 conn(0x7f03ec0f7440 msgr2=0x7f03ec0f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:28:18.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.091+0000 7f03f138a700 1 -- 172.21.15.37:0/850174509 shutdown_connections 2024-04-25T17:28:18.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.091+0000 7f03f138a700 1 -- 172.21.15.37:0/850174509 wait complete. 2024-04-25T17:28:18.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.091+0000 7f03f138a700 1 Processor -- start 2024-04-25T17:28:18.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.091+0000 7f03f138a700 1 -- start start 2024-04-25T17:28:18.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.091+0000 7f03f138a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f03ec066f30 0x7f03ec10dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:28:18.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.091+0000 7f03f138a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03ec0ffef0 0x7f03ec10e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:28:18.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.091+0000 7f03f138a700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03ec10e600 con 0x7f03ec0ffef0 2024-04-25T17:28:18.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.091+0000 7f03f138a700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03ec10e770 con 0x7f03ec066f30 2024-04-25T17:28:18.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.092+0000 7f03ea7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03ec0ffef0 0x7f03ec10e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:28:18.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.092+0000 7f03ea7fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03ec0ffef0 0x7f03ec10e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59270/0 (socket says 172.21.15.37:59270) 2024-04-25T17:28:18.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.092+0000 7f03ea7fc700 1 -- 172.21.15.37:0/464875807 learned_addr learned my addr 172.21.15.37:0/464875807 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:28:18.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.092+0000 7f03eaffd700 1 --2- 172.21.15.37:0/464875807 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f03ec066f30 0x7f03ec10dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:28:18.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.092+0000 7f03ea7fc700 1 -- 172.21.15.37:0/464875807 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f03ec066f30 msgr2=0x7f03ec10dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:28:18.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.092+0000 7f03ea7fc700 1 --2- 172.21.15.37:0/464875807 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f03ec066f30 0x7f03ec10dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:18.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.092+0000 7f03ea7fc700 1 -- 172.21.15.37:0/464875807 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e4009940 con 0x7f03ec0ffef0 2024-04-25T17:28:18.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.092+0000 7f03ea7fc700 1 --2- 172.21.15.37:0/464875807 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03ec0ffef0 0x7f03ec10e000 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f03d4002a50 tx=0x7f03d40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:28:18.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.092+0000 7f03e37fe700 1 -- 172.21.15.37:0/464875807 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03d4007cc0 con 0x7f03ec0ffef0 2024-04-25T17:28:18.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.092+0000 7f03e37fe700 1 -- 172.21.15.37:0/464875807 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f03d400f040 con 0x7f03ec0ffef0 2024-04-25T17:28:18.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.092+0000 7f03e37fe700 1 -- 172.21.15.37:0/464875807 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03d4009640 con 0x7f03ec0ffef0 2024-04-25T17:28:18.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.092+0000 7f03f138a700 1 -- 172.21.15.37:0/464875807 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03ec1131d0 con 0x7f03ec0ffef0 2024-04-25T17:28:18.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.092+0000 7f03f138a700 1 -- 172.21.15.37:0/464875807 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03ec113740 con 0x7f03ec0ffef0 2024-04-25T17:28:18.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.093+0000 7f03f138a700 1 -- 172.21.15.37:0/464875807 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03ec04c710 con 0x7f03ec0ffef0 2024-04-25T17:28:18.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.094+0000 7f03e37fe700 1 -- 172.21.15.37:0/464875807 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f03d40097a0 con 0x7f03ec0ffef0 2024-04-25T17:28:18.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.094+0000 7f03e37fe700 1 --2- 172.21.15.37:0/464875807 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f03d8076b90 0x7f03d8079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:28:18.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.095+0000 7f03e37fe700 1 -- 172.21.15.37:0/464875807 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f03d4098110 con 0x7f03ec0ffef0 2024-04-25T17:28:18.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.095+0000 7f03eaffd700 1 --2- 172.21.15.37:0/464875807 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f03d8076b90 0x7f03d8079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:28:18.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.095+0000 7f03eaffd700 1 --2- 172.21.15.37:0/464875807 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f03d8076b90 0x7f03d8079040 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f03e40095a0 tx=0x7f03e4004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:28:18.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.100+0000 7f03e37fe700 1 -- 172.21.15.37:0/464875807 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f03d4060bf0 con 0x7f03ec0ffef0 2024-04-25T17:28:18.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:18 smithi037 ceph-mon[90844]: pgmap v250: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:28:18.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:18 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:28:18.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:18 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:28:18.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.340+0000 7f03f138a700 1 -- 172.21.15.37:0/464875807 --> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f03ec0f8f30 con 0x7f03d8076b90 2024-04-25T17:28:18.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.342+0000 7f03e37fe700 1 -- 172.21.15.37:0/464875807 <== mgr.34104 v2:172.21.15.37:6800/783197737 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+435 (secure 0 0 0) 0x7f03ec0f8f30 con 0x7f03d8076b90 2024-04-25T17:28:18.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.344+0000 7f03f138a700 1 -- 172.21.15.37:0/464875807 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f03d8076b90 msgr2=0x7f03d8079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:28:18.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.344+0000 7f03f138a700 1 --2- 172.21.15.37:0/464875807 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f03d8076b90 0x7f03d8079040 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f03e40095a0 tx=0x7f03e4004d10 comp rx=0 tx=0).stop 2024-04-25T17:28:18.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.344+0000 7f03f138a700 1 -- 172.21.15.37:0/464875807 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03ec0ffef0 msgr2=0x7f03ec10e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:28:18.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.344+0000 7f03f138a700 1 --2- 172.21.15.37:0/464875807 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03ec0ffef0 0x7f03ec10e000 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f03d4002a50 tx=0x7f03d40046b0 comp rx=0 tx=0).stop 2024-04-25T17:28:18.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.344+0000 7f03f138a700 1 -- 172.21.15.37:0/464875807 shutdown_connections 2024-04-25T17:28:18.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.344+0000 7f03f138a700 1 --2- 172.21.15.37:0/464875807 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f03d8076b90 0x7f03d8079040 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:18.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.344+0000 7f03f138a700 1 --2- 172.21.15.37:0/464875807 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f03ec066f30 0x7f03ec10dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:18.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.344+0000 7f03f138a700 1 --2- 172.21.15.37:0/464875807 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f03ec0ffef0 0x7f03ec10e000 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:18.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.344+0000 7f03f138a700 1 -- 172.21.15.37:0/464875807 >> 172.21.15.37:0/464875807 conn(0x7f03ec0f7440 msgr2=0x7f03ec0f7810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:28:18.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.344+0000 7f03f138a700 1 -- 172.21.15.37:0/464875807 shutdown_connections 2024-04-25T17:28:18.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.344+0000 7f03f138a700 1 -- 172.21.15.37:0/464875807 wait complete. 2024-04-25T17:28:18.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.449+0000 7f75a48c5700 1 -- 172.21.15.37:0/2439211284 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75a0071de0 msgr2=0x7f75a00702f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:28:18.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.449+0000 7f75a48c5700 1 --2- 172.21.15.37:0/2439211284 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75a0071de0 0x7f75a00702f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7590004940 tx=0x7f7590009e30 comp rx=0 tx=0).stop 2024-04-25T17:28:18.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.449+0000 7f75a48c5700 1 -- 172.21.15.37:0/2439211284 shutdown_connections 2024-04-25T17:28:18.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.449+0000 7f75a48c5700 1 --2- 172.21.15.37:0/2439211284 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f75a0070830 0x7f75a0070ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:18.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.449+0000 7f75a48c5700 1 --2- 172.21.15.37:0/2439211284 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75a0071de0 0x7f75a00702f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:18.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.449+0000 7f75a48c5700 1 -- 172.21.15.37:0/2439211284 >> 172.21.15.37:0/2439211284 conn(0x7f75a00f8540 msgr2=0x7f75a00fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:28:18.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.449+0000 7f75a48c5700 1 -- 172.21.15.37:0/2439211284 shutdown_connections 2024-04-25T17:28:18.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.449+0000 7f75a48c5700 1 -- 172.21.15.37:0/2439211284 wait complete. 2024-04-25T17:28:18.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.449+0000 7f75a48c5700 1 Processor -- start 2024-04-25T17:28:18.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.449+0000 7f75a48c5700 1 -- start start 2024-04-25T17:28:18.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.449+0000 7f75a48c5700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f75a0070830 0x7f75a010fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:28:18.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.449+0000 7f75a48c5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75a0071de0 0x7f75a0110000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:28:18.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.449+0000 7f75a48c5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a0110600 con 0x7f75a0071de0 2024-04-25T17:28:18.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.449+0000 7f75a48c5700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a0110770 con 0x7f75a0070830 2024-04-25T17:28:18.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.450+0000 7f759dd9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75a0071de0 0x7f75a0110000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:28:18.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.450+0000 7f759dd9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75a0071de0 0x7f75a0110000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59298/0 (socket says 172.21.15.37:59298) 2024-04-25T17:28:18.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.450+0000 7f759dd9b700 1 -- 172.21.15.37:0/1272443068 learned_addr learned my addr 172.21.15.37:0/1272443068 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:28:18.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.450+0000 7f759e59c700 1 --2- 172.21.15.37:0/1272443068 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f75a0070830 0x7f75a010fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:28:18.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.450+0000 7f759dd9b700 1 -- 172.21.15.37:0/1272443068 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f75a0070830 msgr2=0x7f75a010fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:28:18.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.450+0000 7f759dd9b700 1 --2- 172.21.15.37:0/1272443068 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f75a0070830 0x7f75a010fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:18.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.450+0000 7f759dd9b700 1 -- 172.21.15.37:0/1272443068 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7590005040 con 0x7f75a0071de0 2024-04-25T17:28:18.453 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.450+0000 7f759dd9b700 1 --2- 172.21.15.37:0/1272443068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75a0071de0 0x7f75a0110000 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f759400eb40 tx=0x7f759400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:28:18.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.450+0000 7f758effd700 1 -- 172.21.15.37:0/1272443068 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7594007cc0 con 0x7f75a0071de0 2024-04-25T17:28:18.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.450+0000 7f75a48c5700 1 -- 172.21.15.37:0/1272443068 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75a0115170 con 0x7f75a0071de0 2024-04-25T17:28:18.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.450+0000 7f758effd700 1 -- 172.21.15.37:0/1272443068 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f759400f040 con 0x7f75a0071de0 2024-04-25T17:28:18.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.450+0000 7f758effd700 1 -- 172.21.15.37:0/1272443068 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f759400ca10 con 0x7f75a0071de0 2024-04-25T17:28:18.454 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.450+0000 7f75a48c5700 1 -- 172.21.15.37:0/1272443068 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75a01156b0 con 0x7f75a0071de0 2024-04-25T17:28:18.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.451+0000 7f75a48c5700 1 -- 172.21.15.37:0/1272443068 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75a004c710 con 0x7f75a0071de0 2024-04-25T17:28:18.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.452+0000 7f758effd700 1 -- 172.21.15.37:0/1272443068 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f759400cc80 con 0x7f75a0071de0 2024-04-25T17:28:18.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.452+0000 7f758effd700 1 --2- 172.21.15.37:0/1272443068 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f7588076b90 0x7f7588079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:28:18.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.453+0000 7f758effd700 1 -- 172.21.15.37:0/1272443068 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f7594097f60 con 0x7f75a0071de0 2024-04-25T17:28:18.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.453+0000 7f759e59c700 1 --2- 172.21.15.37:0/1272443068 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f7588076b90 0x7f7588079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:28:18.456 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.453+0000 7f759e59c700 1 --2- 172.21.15.37:0/1272443068 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f7588076b90 0x7f7588079040 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7590004890 tx=0x7f7590009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:28:18.459 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.458+0000 7f758effd700 1 -- 172.21.15.37:0/1272443068 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f75940ccff0 con 0x7f75a0071de0 2024-04-25T17:28:18.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:18 smithi069 ceph-mon[80239]: pgmap v250: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:28:18.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:18 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:28:18.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:18 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:28:18.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.684+0000 7f75a48c5700 1 -- 172.21.15.37:0/1272443068 --> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f75a0103e00 con 0x7f7588076b90 2024-04-25T17:28:18.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.695+0000 7f758effd700 1 -- 172.21.15.37:0/1272443068 <== mgr.34104 v2:172.21.15.37:6800/783197737 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f75a0103e00 con 0x7f7588076b90 2024-04-25T17:28:18.696 INFO:teuthology.orchestra.run.smithi037.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-25T17:28:18.697 INFO:teuthology.orchestra.run.smithi037.stdout:alertmanager.smithi037 smithi037 *:9093,9094 running (31s) 2s ago 18m 15.3M - 0.25.0 c8568f914cd2 c67858406cb5 2024-04-25T17:28:18.697 INFO:teuthology.orchestra.run.smithi037.stdout:crash.smithi037 smithi037 running (6m) 2s ago 18m 6660k - 19.0.0-3291-g994e2f20 d53c96779a29 639584ea5855 2024-04-25T17:28:18.697 INFO:teuthology.orchestra.run.smithi037.stdout:crash.smithi069 smithi069 running (6m) 65s ago 17m 6665k - 19.0.0-3291-g994e2f20 d53c96779a29 ee5db16733a7 2024-04-25T17:28:18.697 INFO:teuthology.orchestra.run.smithi037.stdout:grafana.smithi037 smithi037 *:3000 running (8s) 2s ago 17m 52.2M - 9.4.12 2bacad6d85d8 6e325226d190 2024-04-25T17:28:18.697 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi037.ksmixc smithi037 running (2m) 2s ago 12m 151M - 19.0.0-3291-g994e2f20 d53c96779a29 398075bc956a 2024-04-25T17:28:18.697 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi037.ovkrpq smithi037 running (2m) 2s ago 12m 153M - 19.0.0-3291-g994e2f20 d53c96779a29 ab3bcb631150 2024-04-25T17:28:18.697 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi069.cpprst smithi069 running (86s) 65s ago 12m 80.1M - 19.0.0-3291-g994e2f20 d53c96779a29 8172e0b6da3e 2024-04-25T17:28:18.697 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi069.ytlqcf smithi069 running (106s) 65s ago 12m 80.4M - 19.0.0-3291-g994e2f20 d53c96779a29 0e58af66f5b5 2024-04-25T17:28:18.697 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.smithi037.txrgxl smithi037 *:8443,9283,8765 running (8m) 2s ago 19m 590M - 19.0.0-3291-g994e2f20 d53c96779a29 e9653fc62df9 2024-04-25T17:28:18.697 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.smithi069.mmuhdo smithi069 *:8443,9283,8765 running (7m) 65s ago 17m 521M - 19.0.0-3291-g994e2f20 d53c96779a29 6820207b4019 2024-04-25T17:28:18.697 INFO:teuthology.orchestra.run.smithi037.stdout:mon.smithi037 smithi037 running (7m) 2s ago 19m 122M 2048M 19.0.0-3291-g994e2f20 d53c96779a29 1b349f3af69d 2024-04-25T17:28:18.697 INFO:teuthology.orchestra.run.smithi037.stdout:mon.smithi069 smithi069 running (6m) 65s ago 16m 106M 2048M 19.0.0-3291-g994e2f20 d53c96779a29 7744dbe81b50 2024-04-25T17:28:18.697 INFO:teuthology.orchestra.run.smithi037.stdout:node-exporter.smithi037 smithi037 *:9100 running (72s) 2s ago 18m 7880k - 1.5.0 0da6a335fe13 e08c36465372 2024-04-25T17:28:18.698 INFO:teuthology.orchestra.run.smithi037.stdout:node-exporter.smithi069 smithi069 *:9100 running (68s) 65s ago 17m 5444k - 1.5.0 0da6a335fe13 3f61f3499944 2024-04-25T17:28:18.698 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0 smithi037 running (5m) 2s ago 16m 173M 1559M 19.0.0-3291-g994e2f20 d53c96779a29 e97538cb8b4f 2024-04-25T17:28:18.698 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1 smithi037 running (5m) 2s ago 15m 182M 1559M 19.0.0-3291-g994e2f20 d53c96779a29 6cf158192aae 2024-04-25T17:28:18.698 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2 smithi037 running (4m) 2s ago 15m 168M 1559M 19.0.0-3291-g994e2f20 d53c96779a29 a0b57bba2ebf 2024-04-25T17:28:18.698 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3 smithi069 running (3m) 65s ago 14m 191M 2581M 19.0.0-3291-g994e2f20 d53c96779a29 d1aa15d6b575 2024-04-25T17:28:18.698 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4 smithi069 running (3m) 65s ago 14m 175M 2581M 19.0.0-3291-g994e2f20 d53c96779a29 ad76a3d0fecb 2024-04-25T17:28:18.698 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5 smithi069 running (2m) 65s ago 14m 165M 2581M 19.0.0-3291-g994e2f20 d53c96779a29 dea8b059441b 2024-04-25T17:28:18.698 INFO:teuthology.orchestra.run.smithi037.stdout:prometheus.smithi037 smithi037 *:9095 running (48s) 2s ago 17m 52.1M - 2.43.0 a07b618ecd1d b75cea846339 2024-04-25T17:28:18.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.697+0000 7f75a48c5700 1 -- 172.21.15.37:0/1272443068 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f7588076b90 msgr2=0x7f7588079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:28:18.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.697+0000 7f75a48c5700 1 --2- 172.21.15.37:0/1272443068 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f7588076b90 0x7f7588079040 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7590004890 tx=0x7f7590009e30 comp rx=0 tx=0).stop 2024-04-25T17:28:18.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.697+0000 7f75a48c5700 1 -- 172.21.15.37:0/1272443068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75a0071de0 msgr2=0x7f75a0110000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:28:18.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.697+0000 7f75a48c5700 1 --2- 172.21.15.37:0/1272443068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75a0071de0 0x7f75a0110000 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f759400eb40 tx=0x7f759400b040 comp rx=0 tx=0).stop 2024-04-25T17:28:18.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.697+0000 7f75a48c5700 1 -- 172.21.15.37:0/1272443068 shutdown_connections 2024-04-25T17:28:18.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.697+0000 7f75a48c5700 1 --2- 172.21.15.37:0/1272443068 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f7588076b90 0x7f7588079040 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:18.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.697+0000 7f75a48c5700 1 --2- 172.21.15.37:0/1272443068 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f75a0070830 0x7f75a010fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:18.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.697+0000 7f75a48c5700 1 --2- 172.21.15.37:0/1272443068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75a0071de0 0x7f75a0110000 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:18.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.697+0000 7f75a48c5700 1 -- 172.21.15.37:0/1272443068 >> 172.21.15.37:0/1272443068 conn(0x7f75a00f8540 msgr2=0x7f75a00f9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:28:18.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.697+0000 7f75a48c5700 1 -- 172.21.15.37:0/1272443068 shutdown_connections 2024-04-25T17:28:18.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.698+0000 7f75a48c5700 1 -- 172.21.15.37:0/1272443068 wait complete. 2024-04-25T17:28:18.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.800+0000 7f7b29862700 1 -- 172.21.15.37:0/2764414121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b240fdfd0 msgr2=0x7f7b240fe440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:28:18.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.800+0000 7f7b29862700 1 --2- 172.21.15.37:0/2764414121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b240fdfd0 0x7f7b240fe440 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7b14004940 tx=0x7f7b14009e30 comp rx=0 tx=0).stop 2024-04-25T17:28:18.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.800+0000 7f7b29862700 1 -- 172.21.15.37:0/2764414121 shutdown_connections 2024-04-25T17:28:18.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.800+0000 7f7b29862700 1 --2- 172.21.15.37:0/2764414121 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b240fdfd0 0x7f7b240fe440 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:18.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.800+0000 7f7b29862700 1 --2- 172.21.15.37:0/2764414121 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b240fce60 0x7f7b240fd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:18.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.800+0000 7f7b29862700 1 -- 172.21.15.37:0/2764414121 >> 172.21.15.37:0/2764414121 conn(0x7f7b240f8540 msgr2=0x7f7b240fa950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:28:18.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.800+0000 7f7b29862700 1 -- 172.21.15.37:0/2764414121 shutdown_connections 2024-04-25T17:28:18.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.800+0000 7f7b29862700 1 -- 172.21.15.37:0/2764414121 wait complete. 2024-04-25T17:28:18.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.801+0000 7f7b29862700 1 Processor -- start 2024-04-25T17:28:18.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.801+0000 7f7b29862700 1 -- start start 2024-04-25T17:28:18.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.801+0000 7f7b29862700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b240fce60 0x7f7b24071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:28:18.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.801+0000 7f7b29862700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b240fdfd0 0x7f7b240702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:28:18.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.801+0000 7f7b29862700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b24072200 con 0x7f7b240fdfd0 2024-04-25T17:28:18.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.801+0000 7f7b29862700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b240707f0 con 0x7f7b240fce60 2024-04-25T17:28:18.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.801+0000 7f7b227fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b240fdfd0 0x7f7b240702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:28:18.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.801+0000 7f7b227fc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b240fdfd0 0x7f7b240702b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59310/0 (socket says 172.21.15.37:59310) 2024-04-25T17:28:18.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.801+0000 7f7b227fc700 1 -- 172.21.15.37:0/1243370332 learned_addr learned my addr 172.21.15.37:0/1243370332 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:28:18.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.802+0000 7f7b22ffd700 1 --2- 172.21.15.37:0/1243370332 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b240fce60 0x7f7b24071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:28:18.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.802+0000 7f7b227fc700 1 -- 172.21.15.37:0/1243370332 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b240fce60 msgr2=0x7f7b24071c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:28:18.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.802+0000 7f7b227fc700 1 --2- 172.21.15.37:0/1243370332 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b240fce60 0x7f7b24071c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:18.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.802+0000 7f7b227fc700 1 -- 172.21.15.37:0/1243370332 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b14005040 con 0x7f7b240fdfd0 2024-04-25T17:28:18.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.802+0000 7f7b227fc700 1 --2- 172.21.15.37:0/1243370332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b240fdfd0 0x7f7b240702b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7b1400b3b0 tx=0x7f7b14009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:28:18.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.802+0000 7f7b1b7fe700 1 -- 172.21.15.37:0/1243370332 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b1400e040 con 0x7f7b240fdfd0 2024-04-25T17:28:18.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.802+0000 7f7b1b7fe700 1 -- 172.21.15.37:0/1243370332 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7b1400bcc0 con 0x7f7b240fdfd0 2024-04-25T17:28:18.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.802+0000 7f7b29862700 1 -- 172.21.15.37:0/1243370332 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b24070a40 con 0x7f7b240fdfd0 2024-04-25T17:28:18.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.802+0000 7f7b1b7fe700 1 -- 172.21.15.37:0/1243370332 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b1401c630 con 0x7f7b240fdfd0 2024-04-25T17:28:18.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.802+0000 7f7b29862700 1 -- 172.21.15.37:0/1243370332 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b24071000 con 0x7f7b240fdfd0 2024-04-25T17:28:18.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.803+0000 7f7b29862700 1 -- 172.21.15.37:0/1243370332 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b2404c710 con 0x7f7b240fdfd0 2024-04-25T17:28:18.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.804+0000 7f7b1b7fe700 1 -- 172.21.15.37:0/1243370332 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f7b14013980 con 0x7f7b240fdfd0 2024-04-25T17:28:18.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.804+0000 7f7b1b7fe700 1 --2- 172.21.15.37:0/1243370332 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f7b10076b90 0x7f7b10079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:28:18.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.804+0000 7f7b1b7fe700 1 -- 172.21.15.37:0/1243370332 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f7b14099090 con 0x7f7b240fdfd0 2024-04-25T17:28:18.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.804+0000 7f7b22ffd700 1 --2- 172.21.15.37:0/1243370332 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f7b10076b90 0x7f7b10079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:28:18.807 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.805+0000 7f7b22ffd700 1 --2- 172.21.15.37:0/1243370332 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f7b10076b90 0x7f7b10079040 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c0041d0 tx=0x7f7b0c009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:28:18.811 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:18.809+0000 7f7b1b7fe700 1 -- 172.21.15.37:0/1243370332 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f7b14061b70 con 0x7f7b240fdfd0 2024-04-25T17:28:19.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.112+0000 7f7b29862700 1 -- 172.21.15.37:0/1243370332 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7b241058e0 con 0x7f7b240fdfd0 2024-04-25T17:28:19.114 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.113+0000 7f7b1b7fe700 1 -- 172.21.15.37:0/1243370332 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f7b14061510 con 0x7f7b240fdfd0 2024-04-25T17:28:19.114 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-25T17:28:19.114 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": { 2024-04-25T17:28:19.115 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 2 2024-04-25T17:28:19.115 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:28:19.115 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": { 2024-04-25T17:28:19.115 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 2 2024-04-25T17:28:19.115 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:28:19.115 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": { 2024-04-25T17:28:19.115 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 6 2024-04-25T17:28:19.115 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:28:19.115 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": { 2024-04-25T17:28:19.115 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 4 2024-04-25T17:28:19.115 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:28:19.115 INFO:teuthology.orchestra.run.smithi037.stdout: "overall": { 2024-04-25T17:28:19.115 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 14 2024-04-25T17:28:19.115 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-04-25T17:28:19.116 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-25T17:28:19.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.115+0000 7f7b29862700 1 -- 172.21.15.37:0/1243370332 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f7b10076b90 msgr2=0x7f7b10079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:28:19.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.115+0000 7f7b29862700 1 --2- 172.21.15.37:0/1243370332 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f7b10076b90 0x7f7b10079040 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c0041d0 tx=0x7f7b0c009040 comp rx=0 tx=0).stop 2024-04-25T17:28:19.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.115+0000 7f7b29862700 1 -- 172.21.15.37:0/1243370332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b240fdfd0 msgr2=0x7f7b240702b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:28:19.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.115+0000 7f7b29862700 1 --2- 172.21.15.37:0/1243370332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b240fdfd0 0x7f7b240702b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7b1400b3b0 tx=0x7f7b14009e30 comp rx=0 tx=0).stop 2024-04-25T17:28:19.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.115+0000 7f7b29862700 1 -- 172.21.15.37:0/1243370332 shutdown_connections 2024-04-25T17:28:19.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.115+0000 7f7b29862700 1 --2- 172.21.15.37:0/1243370332 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f7b10076b90 0x7f7b10079040 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:19.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.115+0000 7f7b29862700 1 --2- 172.21.15.37:0/1243370332 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b240fce60 0x7f7b24071c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:19.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.115+0000 7f7b29862700 1 --2- 172.21.15.37:0/1243370332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b240fdfd0 0x7f7b240702b0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:19.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.115+0000 7f7b29862700 1 -- 172.21.15.37:0/1243370332 >> 172.21.15.37:0/1243370332 conn(0x7f7b240f8540 msgr2=0x7f7b240f9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:28:19.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.115+0000 7f7b29862700 1 -- 172.21.15.37:0/1243370332 shutdown_connections 2024-04-25T17:28:19.117 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.115+0000 7f7b29862700 1 -- 172.21.15.37:0/1243370332 wait complete. 2024-04-25T17:28:19.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.219+0000 7f247dc88700 1 -- 172.21.15.37:0/2184069128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24780fbb30 msgr2=0x7f24780fe390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:28:19.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.219+0000 7f247dc88700 1 --2- 172.21.15.37:0/2184069128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24780fbb30 0x7f24780fe390 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f246c004940 tx=0x7f246c009e30 comp rx=0 tx=0).stop 2024-04-25T17:28:19.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.220+0000 7f247dc88700 1 -- 172.21.15.37:0/2184069128 shutdown_connections 2024-04-25T17:28:19.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.220+0000 7f247dc88700 1 --2- 172.21.15.37:0/2184069128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24780fbb30 0x7f24780fe390 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:19.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.220+0000 7f247dc88700 1 --2- 172.21.15.37:0/2184069128 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24780fb1e0 0x7f24780fb5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:19.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.220+0000 7f247dc88700 1 -- 172.21.15.37:0/2184069128 >> 172.21.15.37:0/2184069128 conn(0x7f24780f6be0 msgr2=0x7f24780f8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:28:19.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.220+0000 7f247dc88700 1 -- 172.21.15.37:0/2184069128 shutdown_connections 2024-04-25T17:28:19.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.220+0000 7f247dc88700 1 -- 172.21.15.37:0/2184069128 wait complete. 2024-04-25T17:28:19.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.220+0000 7f247dc88700 1 Processor -- start 2024-04-25T17:28:19.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.220+0000 7f247dc88700 1 -- start start 2024-04-25T17:28:19.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.221+0000 7f247dc88700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24780fb1e0 0x7f247810fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:28:19.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.221+0000 7f247dc88700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24780fbb30 0x7f2478110280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:28:19.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.221+0000 7f247dc88700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24781108d0 con 0x7f24780fbb30 2024-04-25T17:28:19.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.221+0000 7f247dc88700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2478115270 con 0x7f24780fb1e0 2024-04-25T17:28:19.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.221+0000 7f2476ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24780fbb30 0x7f2478110280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:28:19.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.221+0000 7f2476ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24780fbb30 0x7f2478110280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59320/0 (socket says 172.21.15.37:59320) 2024-04-25T17:28:19.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.221+0000 7f2476ffd700 1 -- 172.21.15.37:0/4014566094 learned_addr learned my addr 172.21.15.37:0/4014566094 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:28:19.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.221+0000 7f24777fe700 1 --2- 172.21.15.37:0/4014566094 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24780fb1e0 0x7f247810fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:28:19.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.221+0000 7f2476ffd700 1 -- 172.21.15.37:0/4014566094 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24780fb1e0 msgr2=0x7f247810fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:28:19.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.221+0000 7f2476ffd700 1 --2- 172.21.15.37:0/4014566094 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24780fb1e0 0x7f247810fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:19.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.221+0000 7f2476ffd700 1 -- 172.21.15.37:0/4014566094 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f246c005040 con 0x7f24780fbb30 2024-04-25T17:28:19.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.221+0000 7f2476ffd700 1 --2- 172.21.15.37:0/4014566094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24780fbb30 0x7f2478110280 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f246c00b3b0 tx=0x7f246c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:28:19.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.221+0000 7f245ffff700 1 -- 172.21.15.37:0/4014566094 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f246c00e040 con 0x7f24780fbb30 2024-04-25T17:28:19.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.221+0000 7f245ffff700 1 -- 172.21.15.37:0/4014566094 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f246c00bcc0 con 0x7f24780fbb30 2024-04-25T17:28:19.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.221+0000 7f247dc88700 1 -- 172.21.15.37:0/4014566094 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24781153b0 con 0x7f24780fbb30 2024-04-25T17:28:19.225 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.222+0000 7f245ffff700 1 -- 172.21.15.37:0/4014566094 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f246c01c630 con 0x7f24780fbb30 2024-04-25T17:28:19.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.222+0000 7f247dc88700 1 -- 172.21.15.37:0/4014566094 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2478115910 con 0x7f24780fbb30 2024-04-25T17:28:19.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.222+0000 7f247dc88700 1 -- 172.21.15.37:0/4014566094 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2478101d20 con 0x7f24780fbb30 2024-04-25T17:28:19.226 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.223+0000 7f245ffff700 1 -- 172.21.15.37:0/4014566094 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f246c013980 con 0x7f24780fbb30 2024-04-25T17:28:19.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.224+0000 7f245ffff700 1 --2- 172.21.15.37:0/4014566094 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f2460076b90 0x7f2460079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:28:19.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.224+0000 7f245ffff700 1 -- 172.21.15.37:0/4014566094 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f246c0991b0 con 0x7f24780fbb30 2024-04-25T17:28:19.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.224+0000 7f24777fe700 1 --2- 172.21.15.37:0/4014566094 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f2460076b90 0x7f2460079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:28:19.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.224+0000 7f24777fe700 1 --2- 172.21.15.37:0/4014566094 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f2460076b90 0x7f2460079040 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f24680041d0 tx=0x7f2468009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:28:19.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.229+0000 7f245ffff700 1 -- 172.21.15.37:0/4014566094 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f246c061c10 con 0x7f24780fbb30 2024-04-25T17:28:19.427 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:19 smithi037 ceph-mon[90844]: from='client.34538 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:28:19.428 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:19 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/1243370332' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:28:19.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.495+0000 7f247dc88700 1 -- 172.21.15.37:0/4014566094 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f247804c710 con 0x7f24780fbb30 2024-04-25T17:28:19.497 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.496+0000 7f245ffff700 1 -- 172.21.15.37:0/4014566094 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 35 v35) v1 ==== 76+0+1963 (secure 0 0 0) 0x7f246c0615b0 con 0x7f24780fbb30 2024-04-25T17:28:19.498 INFO:teuthology.orchestra.run.smithi037.stdout:e35 2024-04-25T17:28:19.498 INFO:teuthology.orchestra.run.smithi037.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-25T17:28:19.498 INFO:teuthology.orchestra.run.smithi037.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T17:28:19.498 INFO:teuthology.orchestra.run.smithi037.stdout:legacy client fscid: 1 2024-04-25T17:28:19.498 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:28:19.498 INFO:teuthology.orchestra.run.smithi037.stdout:Filesystem 'cephfs' (1) 2024-04-25T17:28:19.498 INFO:teuthology.orchestra.run.smithi037.stdout:fs_name cephfs 2024-04-25T17:28:19.498 INFO:teuthology.orchestra.run.smithi037.stdout:epoch 35 2024-04-25T17:28:19.498 INFO:teuthology.orchestra.run.smithi037.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-25T17:28:19.498 INFO:teuthology.orchestra.run.smithi037.stdout:created 2024-04-25T17:15:40.586130+0000 2024-04-25T17:28:19.498 INFO:teuthology.orchestra.run.smithi037.stdout:modified 2024-04-25T17:27:00.988207+0000 2024-04-25T17:28:19.499 INFO:teuthology.orchestra.run.smithi037.stdout:tableserver 0 2024-04-25T17:28:19.499 INFO:teuthology.orchestra.run.smithi037.stdout:root 0 2024-04-25T17:28:19.499 INFO:teuthology.orchestra.run.smithi037.stdout:session_timeout 60 2024-04-25T17:28:19.499 INFO:teuthology.orchestra.run.smithi037.stdout:session_autoclose 300 2024-04-25T17:28:19.499 INFO:teuthology.orchestra.run.smithi037.stdout:max_file_size 1099511627776 2024-04-25T17:28:19.499 INFO:teuthology.orchestra.run.smithi037.stdout:max_xattr_size 65536 2024-04-25T17:28:19.499 INFO:teuthology.orchestra.run.smithi037.stdout:required_client_features {} 2024-04-25T17:28:19.499 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure 0 2024-04-25T17:28:19.499 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure_osd_epoch 84 2024-04-25T17:28:19.499 INFO:teuthology.orchestra.run.smithi037.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-25T17:28:19.499 INFO:teuthology.orchestra.run.smithi037.stdout:max_mds 1 2024-04-25T17:28:19.499 INFO:teuthology.orchestra.run.smithi037.stdout:in 0 2024-04-25T17:28:19.499 INFO:teuthology.orchestra.run.smithi037.stdout:up {0=34412} 2024-04-25T17:28:19.499 INFO:teuthology.orchestra.run.smithi037.stdout:failed 2024-04-25T17:28:19.500 INFO:teuthology.orchestra.run.smithi037.stdout:damaged 2024-04-25T17:28:19.500 INFO:teuthology.orchestra.run.smithi037.stdout:stopped 2024-04-25T17:28:19.500 INFO:teuthology.orchestra.run.smithi037.stdout:data_pools [3] 2024-04-25T17:28:19.500 INFO:teuthology.orchestra.run.smithi037.stdout:metadata_pool 2 2024-04-25T17:28:19.500 INFO:teuthology.orchestra.run.smithi037.stdout:inline_data disabled 2024-04-25T17:28:19.500 INFO:teuthology.orchestra.run.smithi037.stdout:balancer 2024-04-25T17:28:19.500 INFO:teuthology.orchestra.run.smithi037.stdout:bal_rank_mask -1 2024-04-25T17:28:19.500 INFO:teuthology.orchestra.run.smithi037.stdout:standby_count_wanted 1 2024-04-25T17:28:19.500 INFO:teuthology.orchestra.run.smithi037.stdout:qdb_cluster leader: 34412 members: 34412 2024-04-25T17:28:19.500 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi037.ksmixc{0:34412} state up:active seq 18 join_fscid=1 addr [v2:172.21.15.37:6826/2514248612,v1:172.21.15.37:6827/2514248612] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T17:28:19.500 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi037.ovkrpq{0:34444} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.37:6828/2067664560,v1:172.21.15.37:6829/2067664560] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T17:28:19.500 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:28:19.500 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:28:19.500 INFO:teuthology.orchestra.run.smithi037.stdout:Standby daemons: 2024-04-25T17:28:19.501 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:28:19.501 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi069.ytlqcf{-1:44347} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.69:6824/3424891497,v1:172.21.15.69:6825/3424891497] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T17:28:19.501 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi069.cpprst{-1:44379} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.69:6826/3383509929,v1:172.21.15.69:6827/3383509929] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T17:28:19.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.498+0000 7f247dc88700 1 -- 172.21.15.37:0/4014566094 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f2460076b90 msgr2=0x7f2460079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:28:19.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.498+0000 7f247dc88700 1 --2- 172.21.15.37:0/4014566094 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f2460076b90 0x7f2460079040 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f24680041d0 tx=0x7f2468009040 comp rx=0 tx=0).stop 2024-04-25T17:28:19.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.498+0000 7f247dc88700 1 -- 172.21.15.37:0/4014566094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24780fbb30 msgr2=0x7f2478110280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:28:19.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.498+0000 7f247dc88700 1 --2- 172.21.15.37:0/4014566094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24780fbb30 0x7f2478110280 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f246c00b3b0 tx=0x7f246c009e30 comp rx=0 tx=0).stop 2024-04-25T17:28:19.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.498+0000 7f247dc88700 1 -- 172.21.15.37:0/4014566094 shutdown_connections 2024-04-25T17:28:19.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.498+0000 7f247dc88700 1 --2- 172.21.15.37:0/4014566094 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f2460076b90 0x7f2460079040 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:19.502 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.498+0000 7f247dc88700 1 --2- 172.21.15.37:0/4014566094 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24780fb1e0 0x7f247810fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:19.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.498+0000 7f247dc88700 1 --2- 172.21.15.37:0/4014566094 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24780fbb30 0x7f2478110280 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:19.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.498+0000 7f247dc88700 1 -- 172.21.15.37:0/4014566094 >> 172.21.15.37:0/4014566094 conn(0x7f24780f6be0 msgr2=0x7f24780f8180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:28:19.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.498+0000 7f247dc88700 1 -- 172.21.15.37:0/4014566094 shutdown_connections 2024-04-25T17:28:19.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.498+0000 7f247dc88700 1 -- 172.21.15.37:0/4014566094 wait complete. 2024-04-25T17:28:19.503 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 35 2024-04-25T17:28:19.610 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.608+0000 7fc4acf8e700 1 -- 172.21.15.37:0/1423729693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4a80662c0 msgr2=0x7fc4a80ff9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:28:19.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.608+0000 7fc4acf8e700 1 --2- 172.21.15.37:0/1423729693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4a80662c0 0x7fc4a80ff9a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc498009ce0 tx=0x7fc498004d10 comp rx=0 tx=0).stop 2024-04-25T17:28:19.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.608+0000 7fc4acf8e700 1 -- 172.21.15.37:0/1423729693 shutdown_connections 2024-04-25T17:28:19.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.608+0000 7fc4acf8e700 1 --2- 172.21.15.37:0/1423729693 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc4a80ffee0 0x7fc4a8102300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:19.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.608+0000 7fc4acf8e700 1 --2- 172.21.15.37:0/1423729693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4a80662c0 0x7fc4a80ff9a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:19.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.608+0000 7fc4acf8e700 1 -- 172.21.15.37:0/1423729693 >> 172.21.15.37:0/1423729693 conn(0x7fc4a80f7430 msgr2=0x7fc4a80f9840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:28:19.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.608+0000 7fc4acf8e700 1 -- 172.21.15.37:0/1423729693 shutdown_connections 2024-04-25T17:28:19.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.608+0000 7fc4acf8e700 1 -- 172.21.15.37:0/1423729693 wait complete. 2024-04-25T17:28:19.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.608+0000 7fc4acf8e700 1 Processor -- start 2024-04-25T17:28:19.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.609+0000 7fc4acf8e700 1 -- start start 2024-04-25T17:28:19.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.609+0000 7fc4acf8e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc4a80662c0 0x7fc4a80fd380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:28:19.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.609+0000 7fc4acf8e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4a80ffee0 0x7fc4a80fb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:28:19.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.609+0000 7fc4acf8e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a81117e0 con 0x7fc4a80ffee0 2024-04-25T17:28:19.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.609+0000 7fc4acf8e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a8111920 con 0x7fc4a80662c0 2024-04-25T17:28:19.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.609+0000 7fc4a5d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4a80ffee0 0x7fc4a80fb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:28:19.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.609+0000 7fc4a5d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4a80ffee0 0x7fc4a80fb8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59336/0 (socket says 172.21.15.37:59336) 2024-04-25T17:28:19.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.609+0000 7fc4a5d9b700 1 -- 172.21.15.37:0/1856003149 learned_addr learned my addr 172.21.15.37:0/1856003149 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:28:19.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.609+0000 7fc4a659c700 1 --2- 172.21.15.37:0/1856003149 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc4a80662c0 0x7fc4a80fd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:28:19.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.609+0000 7fc4a5d9b700 1 -- 172.21.15.37:0/1856003149 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc4a80662c0 msgr2=0x7fc4a80fd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:28:19.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.609+0000 7fc4a5d9b700 1 --2- 172.21.15.37:0/1856003149 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc4a80662c0 0x7fc4a80fd380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:19.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.609+0000 7fc4a5d9b700 1 -- 172.21.15.37:0/1856003149 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc498009940 con 0x7fc4a80ffee0 2024-04-25T17:28:19.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.609+0000 7fc4a5d9b700 1 --2- 172.21.15.37:0/1856003149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4a80ffee0 0x7fc4a80fb8a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc490002a80 tx=0x7fc4900046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:28:19.614 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.610+0000 7fc49effd700 1 -- 172.21.15.37:0/1856003149 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc490007cc0 con 0x7fc4a80ffee0 2024-04-25T17:28:19.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.610+0000 7fc49effd700 1 -- 172.21.15.37:0/1856003149 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc49000f040 con 0x7fc4a80ffee0 2024-04-25T17:28:19.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.610+0000 7fc4acf8e700 1 -- 172.21.15.37:0/1856003149 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4a80fbea0 con 0x7fc4a80ffee0 2024-04-25T17:28:19.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.610+0000 7fc49effd700 1 -- 172.21.15.37:0/1856003149 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc4900096f0 con 0x7fc4a80ffee0 2024-04-25T17:28:19.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.610+0000 7fc4acf8e700 1 -- 172.21.15.37:0/1856003149 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4a80fc460 con 0x7fc4a80ffee0 2024-04-25T17:28:19.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.611+0000 7fc4acf8e700 1 -- 172.21.15.37:0/1856003149 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4a805f5c0 con 0x7fc4a80ffee0 2024-04-25T17:28:19.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.611+0000 7fc49effd700 1 -- 172.21.15.37:0/1856003149 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7fc49000d690 con 0x7fc4a80ffee0 2024-04-25T17:28:19.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.612+0000 7fc49effd700 1 --2- 172.21.15.37:0/1856003149 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fc494076b90 0x7fc494079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:28:19.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.612+0000 7fc49effd700 1 -- 172.21.15.37:0/1856003149 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fc490097b10 con 0x7fc4a80ffee0 2024-04-25T17:28:19.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.612+0000 7fc4a659c700 1 --2- 172.21.15.37:0/1856003149 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fc494076b90 0x7fc494079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:28:19.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.612+0000 7fc4a659c700 1 --2- 172.21.15.37:0/1856003149 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fc494076b90 0x7fc494079040 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc498009470 tx=0x7fc498004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:28:19.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.617+0000 7fc49effd700 1 -- 172.21.15.37:0/1856003149 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fc4900605f0 con 0x7fc4a80ffee0 2024-04-25T17:28:19.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:19 smithi069 ceph-mon[80239]: from='client.34538 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:28:19.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:19 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/1243370332' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:28:19.850 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.848+0000 7fc4acf8e700 1 -- 172.21.15.37:0/1856003149 --> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc4a8105a30 con 0x7fc494076b90 2024-04-25T17:28:19.851 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.849+0000 7fc49effd700 1 -- 172.21.15.37:0/1856003149 <== mgr.34104 v2:172.21.15.37:6800/783197737 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+435 (secure 0 0 0) 0x7fc4a8105a30 con 0x7fc494076b90 2024-04-25T17:28:19.851 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-25T17:28:19.852 INFO:teuthology.orchestra.run.smithi037.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385", 2024-04-25T17:28:19.852 INFO:teuthology.orchestra.run.smithi037.stdout: "in_progress": true, 2024-04-25T17:28:19.852 INFO:teuthology.orchestra.run.smithi037.stdout: "which": "Upgrading all daemon types on all hosts", 2024-04-25T17:28:19.852 INFO:teuthology.orchestra.run.smithi037.stdout: "services_complete": [ 2024-04-25T17:28:19.852 INFO:teuthology.orchestra.run.smithi037.stdout: "mds", 2024-04-25T17:28:19.852 INFO:teuthology.orchestra.run.smithi037.stdout: "mon", 2024-04-25T17:28:19.852 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr", 2024-04-25T17:28:19.852 INFO:teuthology.orchestra.run.smithi037.stdout: "osd", 2024-04-25T17:28:19.852 INFO:teuthology.orchestra.run.smithi037.stdout: "crash" 2024-04-25T17:28:19.852 INFO:teuthology.orchestra.run.smithi037.stdout: ], 2024-04-25T17:28:19.852 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": "16/21 daemons upgraded", 2024-04-25T17:28:19.852 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "Currently upgrading grafana daemons", 2024-04-25T17:28:19.852 INFO:teuthology.orchestra.run.smithi037.stdout: "is_paused": false 2024-04-25T17:28:19.852 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-25T17:28:19.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.852+0000 7fc4acf8e700 1 -- 172.21.15.37:0/1856003149 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fc494076b90 msgr2=0x7fc494079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:28:19.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.852+0000 7fc4acf8e700 1 --2- 172.21.15.37:0/1856003149 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fc494076b90 0x7fc494079040 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc498009470 tx=0x7fc498004d10 comp rx=0 tx=0).stop 2024-04-25T17:28:19.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.852+0000 7fc4acf8e700 1 -- 172.21.15.37:0/1856003149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4a80ffee0 msgr2=0x7fc4a80fb8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:28:19.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.852+0000 7fc4acf8e700 1 --2- 172.21.15.37:0/1856003149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4a80ffee0 0x7fc4a80fb8a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc490002a80 tx=0x7fc4900046b0 comp rx=0 tx=0).stop 2024-04-25T17:28:19.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.852+0000 7fc4acf8e700 1 -- 172.21.15.37:0/1856003149 shutdown_connections 2024-04-25T17:28:19.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.852+0000 7fc4acf8e700 1 --2- 172.21.15.37:0/1856003149 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fc494076b90 0x7fc494079040 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:19.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.852+0000 7fc4acf8e700 1 --2- 172.21.15.37:0/1856003149 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc4a80662c0 0x7fc4a80fd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:19.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.852+0000 7fc4acf8e700 1 --2- 172.21.15.37:0/1856003149 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc4a80ffee0 0x7fc4a80fb8a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:19.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.852+0000 7fc4acf8e700 1 -- 172.21.15.37:0/1856003149 >> 172.21.15.37:0/1856003149 conn(0x7fc4a80f7430 msgr2=0x7fc4a80f7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:28:19.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.852+0000 7fc4acf8e700 1 -- 172.21.15.37:0/1856003149 shutdown_connections 2024-04-25T17:28:19.854 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.852+0000 7fc4acf8e700 1 -- 172.21.15.37:0/1856003149 wait complete. 2024-04-25T17:28:19.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.958+0000 7f7e296c8700 1 -- 172.21.15.37:0/1977167690 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e24066af0 msgr2=0x7f7e240ffa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:28:19.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.958+0000 7f7e296c8700 1 --2- 172.21.15.37:0/1977167690 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e24066af0 0x7f7e240ffa90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7e14004940 tx=0x7f7e14009e30 comp rx=0 tx=0).stop 2024-04-25T17:28:19.960 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.958+0000 7f7e296c8700 1 -- 172.21.15.37:0/1977167690 shutdown_connections 2024-04-25T17:28:19.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.958+0000 7f7e296c8700 1 --2- 172.21.15.37:0/1977167690 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7e240fffd0 0x7f7e241023b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:19.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.958+0000 7f7e296c8700 1 --2- 172.21.15.37:0/1977167690 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e24066af0 0x7f7e240ffa90 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:19.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.958+0000 7f7e296c8700 1 -- 172.21.15.37:0/1977167690 >> 172.21.15.37:0/1977167690 conn(0x7f7e240f74c0 msgr2=0x7f7e240f98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:28:19.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.959+0000 7f7e296c8700 1 -- 172.21.15.37:0/1977167690 shutdown_connections 2024-04-25T17:28:19.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.959+0000 7f7e296c8700 1 -- 172.21.15.37:0/1977167690 wait complete. 2024-04-25T17:28:19.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.959+0000 7f7e296c8700 1 Processor -- start 2024-04-25T17:28:19.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.959+0000 7f7e296c8700 1 -- start start 2024-04-25T17:28:19.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.959+0000 7f7e296c8700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e24066af0 0x7f7e2410da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:28:19.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.959+0000 7f7e296c8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7e240fffd0 0x7f7e2410dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:28:19.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.959+0000 7f7e296c8700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2410e5b0 con 0x7f7e24066af0 2024-04-25T17:28:19.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.959+0000 7f7e296c8700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2410ee00 con 0x7f7e240fffd0 2024-04-25T17:28:19.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.960+0000 7f7e22ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e24066af0 0x7f7e2410da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:28:19.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.960+0000 7f7e22ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e24066af0 0x7f7e2410da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:59364/0 (socket says 172.21.15.37:59364) 2024-04-25T17:28:19.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.960+0000 7f7e22ffd700 1 -- 172.21.15.37:0/2947484743 learned_addr learned my addr 172.21.15.37:0/2947484743 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:28:19.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.960+0000 7f7e227fc700 1 --2- 172.21.15.37:0/2947484743 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7e240fffd0 0x7f7e2410dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:28:19.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.960+0000 7f7e22ffd700 1 -- 172.21.15.37:0/2947484743 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7e240fffd0 msgr2=0x7f7e2410dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:28:19.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.960+0000 7f7e22ffd700 1 --2- 172.21.15.37:0/2947484743 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7e240fffd0 0x7f7e2410dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:19.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.960+0000 7f7e22ffd700 1 -- 172.21.15.37:0/2947484743 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e14005040 con 0x7f7e24066af0 2024-04-25T17:28:19.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.960+0000 7f7e22ffd700 1 --2- 172.21.15.37:0/2947484743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e24066af0 0x7f7e2410da70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7e1400b970 tx=0x7f7e14009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:28:19.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.960+0000 7f7e0b7fe700 1 -- 172.21.15.37:0/2947484743 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e1400e040 con 0x7f7e24066af0 2024-04-25T17:28:19.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.960+0000 7f7e0b7fe700 1 -- 172.21.15.37:0/2947484743 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7e14004290 con 0x7f7e24066af0 2024-04-25T17:28:19.963 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.960+0000 7f7e296c8700 1 -- 172.21.15.37:0/2947484743 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e2410f080 con 0x7f7e24066af0 2024-04-25T17:28:19.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.961+0000 7f7e0b7fe700 1 -- 172.21.15.37:0/2947484743 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e1401c630 con 0x7f7e24066af0 2024-04-25T17:28:19.964 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.961+0000 7f7e296c8700 1 -- 172.21.15.37:0/2947484743 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e2410f5c0 con 0x7f7e24066af0 2024-04-25T17:28:19.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.962+0000 7f7e0b7fe700 1 -- 172.21.15.37:0/2947484743 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f7e14013420 con 0x7f7e24066af0 2024-04-25T17:28:19.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.962+0000 7f7e296c8700 1 -- 172.21.15.37:0/2947484743 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e2405f5c0 con 0x7f7e24066af0 2024-04-25T17:28:19.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.962+0000 7f7e0b7fe700 1 --2- 172.21.15.37:0/2947484743 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f7e0c076970 0x7f7e0c078e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:28:19.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.963+0000 7f7e0b7fe700 1 -- 172.21.15.37:0/2947484743 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f7e14098e50 con 0x7f7e24066af0 2024-04-25T17:28:19.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.963+0000 7f7e227fc700 1 --2- 172.21.15.37:0/2947484743 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f7e0c076970 0x7f7e0c078e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:28:19.965 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.963+0000 7f7e227fc700 1 --2- 172.21.15.37:0/2947484743 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f7e0c076970 0x7f7e0c078e20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7e18007fd0 tx=0x7f7e18009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:28:19.969 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:19.968+0000 7f7e0b7fe700 1 -- 172.21.15.37:0/2947484743 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f7e1409e060 con 0x7f7e24066af0 2024-04-25T17:28:20.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:20.297+0000 7f7e296c8700 1 -- 172.21.15.37:0/2947484743 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f7e2404bed0 con 0x7f7e24066af0 2024-04-25T17:28:20.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:20.298+0000 7f7e0b7fe700 1 -- 172.21.15.37:0/2947484743 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f7e14013e60 con 0x7f7e24066af0 2024-04-25T17:28:20.300 INFO:teuthology.orchestra.run.smithi037.stdout:HEALTH_OK 2024-04-25T17:28:20.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:20.300+0000 7f7e296c8700 1 -- 172.21.15.37:0/2947484743 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f7e0c076970 msgr2=0x7f7e0c078e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:28:20.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:20.300+0000 7f7e296c8700 1 --2- 172.21.15.37:0/2947484743 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f7e0c076970 0x7f7e0c078e20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7e18007fd0 tx=0x7f7e18009040 comp rx=0 tx=0).stop 2024-04-25T17:28:20.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:20.300+0000 7f7e296c8700 1 -- 172.21.15.37:0/2947484743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e24066af0 msgr2=0x7f7e2410da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:28:20.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:20.300+0000 7f7e296c8700 1 --2- 172.21.15.37:0/2947484743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e24066af0 0x7f7e2410da70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7e1400b970 tx=0x7f7e14009e30 comp rx=0 tx=0).stop 2024-04-25T17:28:20.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:20.300+0000 7f7e296c8700 1 -- 172.21.15.37:0/2947484743 shutdown_connections 2024-04-25T17:28:20.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:20.300+0000 7f7e296c8700 1 --2- 172.21.15.37:0/2947484743 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f7e0c076970 0x7f7e0c078e20 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:20.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:20.300+0000 7f7e296c8700 1 --2- 172.21.15.37:0/2947484743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e24066af0 0x7f7e2410da70 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:20.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:20.300+0000 7f7e296c8700 1 --2- 172.21.15.37:0/2947484743 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7e240fffd0 0x7f7e2410dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:20.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:20.300+0000 7f7e296c8700 1 -- 172.21.15.37:0/2947484743 >> 172.21.15.37:0/2947484743 conn(0x7f7e240f74c0 msgr2=0x7f7e240f7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:28:20.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:20.300+0000 7f7e296c8700 1 -- 172.21.15.37:0/2947484743 shutdown_connections 2024-04-25T17:28:20.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:20.300+0000 7f7e296c8700 1 -- 172.21.15.37:0/2947484743 wait complete. 2024-04-25T17:28:20.511 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:20 smithi037 ceph-mon[90844]: from='client.34542 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:28:20.511 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:20 smithi037 ceph-mon[90844]: pgmap v251: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:28:20.511 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:20 smithi037 ceph-mon[90844]: from='client.34546 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:28:20.511 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:20 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/4014566094' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T17:28:20.511 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:20 smithi037 ceph-mon[90844]: from='client.34558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:28:20.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:20 smithi069 ceph-mon[80239]: from='client.34542 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:28:20.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:20 smithi069 ceph-mon[80239]: pgmap v251: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:28:20.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:20 smithi069 ceph-mon[80239]: from='client.34546 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:28:20.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:20 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/4014566094' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T17:28:20.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:20 smithi069 ceph-mon[80239]: from='client.34558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:28:21.526 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:21 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/2947484743' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T17:28:21.526 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:21 smithi037 ceph-mon[90844]: pgmap v252: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:28:21.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:21 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/2947484743' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T17:28:21.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:21 smithi069 ceph-mon[80239]: pgmap v252: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:28:22.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:28:22.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:28:22.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:28:22.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:28:22.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:28:22.670 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-25T17:28:22.670 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-25T17:28:22.670 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi037:3000"}]: dispatch 2024-04-25T17:28:22.670 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi037:3000"}]: dispatch 2024-04-25T17:28:22.670 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:28:22.670 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:28:22.670 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:28:22.670 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:28:22.670 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:28:22.670 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:28:22.670 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:28:22.670 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:28:22.670 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:28:22.670 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:28:22.671 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:28:22.671 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:28:22.671 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:28:22.671 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:28:22.671 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:28:22.671 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:28:22.671 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:28:22.671 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:28:22.671 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:28:22.671 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:28:22.671 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: Upgrade: Finalizing container_image settings 2024-04-25T17:28:22.671 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:28:22.672 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-04-25T17:28:22.672 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-04-25T17:28:22.672 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-25T17:28:22.672 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-04-25T17:28:22.672 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-04-25T17:28:22.672 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-04-25T17:28:22.672 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-04-25T17:28:22.672 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-04-25T17:28:22.672 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-04-25T17:28:22.672 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-04-25T17:28:22.672 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-04-25T17:28:22.672 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-04-25T17:28:22.672 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-04-25T17:28:22.672 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-04-25T17:28:22.673 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-25T17:28:22.673 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-04-25T17:28:22.673 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-04-25T17:28:22.673 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-04-25T17:28:22.673 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-04-25T17:28:22.673 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-04-25T17:28:22.673 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-04-25T17:28:22.673 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-04-25T17:28:22.673 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-04-25T17:28:22.673 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-25T17:28:22.673 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-25T17:28:22.673 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-25T17:28:22.673 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-25T17:28:22.673 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-25T17:28:22.674 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-25T17:28:22.674 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: Upgrade: Complete! 2024-04-25T17:28:22.674 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-04-25T17:28:22.674 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-04-25T17:28:22.674 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:28:22.674 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:28:22.674 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:28:22.674 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:28:22.674 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:28:22.674 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:28:22.675 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:28:22.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:28:22.823 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:28:22.823 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:28:22.823 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:28:22.823 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:28:22.823 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-25T17:28:22.823 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-04-25T17:28:22.823 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi037:3000"}]: dispatch 2024-04-25T17:28:22.823 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi037:3000"}]: dispatch 2024-04-25T17:28:22.823 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:28:22.823 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:28:22.823 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:28:22.823 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:28:22.823 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:28:22.823 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:28:22.824 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:28:22.824 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:28:22.824 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:28:22.824 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:28:22.824 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:28:22.824 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:28:22.824 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:28:22.824 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:28:22.824 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:28:22.824 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:28:22.824 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:28:22.825 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:28:22.825 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:28:22.825 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:28:22.825 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: Upgrade: Finalizing container_image settings 2024-04-25T17:28:22.825 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:28:22.825 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-04-25T17:28:22.825 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-04-25T17:28:22.825 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-25T17:28:22.825 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-04-25T17:28:22.825 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-04-25T17:28:22.825 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-04-25T17:28:22.825 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-04-25T17:28:22.826 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-04-25T17:28:22.826 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-04-25T17:28:22.826 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-04-25T17:28:22.826 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-04-25T17:28:22.826 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-04-25T17:28:22.826 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-04-25T17:28:22.826 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-04-25T17:28:22.826 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-25T17:28:22.826 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-04-25T17:28:22.826 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-04-25T17:28:22.826 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-04-25T17:28:22.826 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-04-25T17:28:22.826 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-04-25T17:28:22.826 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-04-25T17:28:22.827 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-04-25T17:28:22.827 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-04-25T17:28:22.827 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-25T17:28:22.827 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-25T17:28:22.827 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-25T17:28:22.827 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-25T17:28:22.827 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-25T17:28:22.827 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-04-25T17:28:22.827 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: Upgrade: Complete! 2024-04-25T17:28:22.827 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-04-25T17:28:22.827 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-04-25T17:28:22.827 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:28:22.827 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:28:22.827 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:28:22.827 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:28:22.828 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:28:22.828 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:28:22.828 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:28:23.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:23 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:28:23.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:23 smithi069 ceph-mon[80239]: pgmap v253: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:28:23.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:23 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:28:23.708 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:23 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:28:23.709 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:23 smithi037 ceph-mon[90844]: pgmap v253: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:28:23.709 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:23 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:28:25.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:25 smithi069 ceph-mon[80239]: pgmap v254: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:28:26.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:25 smithi037 ceph-mon[90844]: pgmap v254: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:28:27.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:27 smithi069 ceph-mon[80239]: pgmap v255: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:28:27.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:27 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:28:28.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:27 smithi037 ceph-mon[90844]: pgmap v255: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:28:28.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:27 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:28:29.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:29 smithi069 ceph-mon[80239]: pgmap v256: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:28:30.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:29 smithi037 ceph-mon[90844]: pgmap v256: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:28:31.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:31 smithi069 ceph-mon[80239]: pgmap v257: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:28:32.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:31 smithi037 ceph-mon[90844]: pgmap v257: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:28:33.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:33 smithi069 ceph-mon[80239]: pgmap v258: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:28:34.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:33 smithi037 ceph-mon[90844]: pgmap v258: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:28:35.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:35 smithi069 ceph-mon[80239]: pgmap v259: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:28:36.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:35 smithi037 ceph-mon[90844]: pgmap v259: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:28:37.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:37 smithi069 ceph-mon[80239]: pgmap v260: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:28:38.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:37 smithi037 ceph-mon[90844]: pgmap v260: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:28:39.919 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:39 smithi069 ceph-mon[80239]: pgmap v261: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:28:40.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:39 smithi037 ceph-mon[90844]: pgmap v261: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:28:41.918 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:41 smithi069 ceph-mon[80239]: pgmap v262: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:28:42.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:41 smithi037 ceph-mon[90844]: pgmap v262: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:28:43.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:42 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:28:43.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:42 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:28:44.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:43 smithi037 ceph-mon[90844]: pgmap v263: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:28:44.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:43 smithi069 ceph-mon[80239]: pgmap v263: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:28:46.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:45 smithi037 ceph-mon[90844]: pgmap v264: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:28:46.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:45 smithi069 ceph-mon[80239]: pgmap v264: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:28:48.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:47 smithi037 ceph-mon[90844]: pgmap v265: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:28:48.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:47 smithi069 ceph-mon[80239]: pgmap v265: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:28:50.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:49 smithi037 ceph-mon[90844]: pgmap v266: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:28:50.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:49 smithi069 ceph-mon[80239]: pgmap v266: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:28:50.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:50.421+0000 7f83af86e700 1 -- 172.21.15.37:0/4140500613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83a80fbcc0 msgr2=0x7f83a80fc0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:28:50.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:50.421+0000 7f83af86e700 1 --2- 172.21.15.37:0/4140500613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83a80fbcc0 0x7f83a80fc0d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f83a4004940 tx=0x7f83a4009e30 comp rx=0 tx=0).stop 2024-04-25T17:28:50.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:50.421+0000 7f83af86e700 1 -- 172.21.15.37:0/4140500613 shutdown_connections 2024-04-25T17:28:50.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:50.421+0000 7f83af86e700 1 --2- 172.21.15.37:0/4140500613 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f83a80fcf70 0x7f83a80fd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:50.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:50.421+0000 7f83af86e700 1 --2- 172.21.15.37:0/4140500613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83a80fbcc0 0x7f83a80fc0d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:50.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:50.421+0000 7f83af86e700 1 -- 172.21.15.37:0/4140500613 >> 172.21.15.37:0/4140500613 conn(0x7f83a80f7440 msgr2=0x7f83a80f9850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:28:50.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:50.421+0000 7f83af86e700 1 -- 172.21.15.37:0/4140500613 shutdown_connections 2024-04-25T17:28:50.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:50.421+0000 7f83af86e700 1 -- 172.21.15.37:0/4140500613 wait complete. 2024-04-25T17:28:50.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:50.422+0000 7f83af86e700 1 Processor -- start 2024-04-25T17:28:50.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:50.422+0000 7f83af86e700 1 -- start start 2024-04-25T17:28:50.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:50.422+0000 7f83af86e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f83a80fbcc0 0x7f83a8066cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:28:50.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:50.422+0000 7f83af86e700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83a80fcf70 0x7f83a8114b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:28:50.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:50.422+0000 7f83af86e700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a810e540 con 0x7f83a80fcf70 2024-04-25T17:28:50.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:50.422+0000 7f83af86e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a81150a0 con 0x7f83a80fbcc0 2024-04-25T17:28:50.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:50.422+0000 7f83ace09700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83a80fcf70 0x7f83a8114b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:28:50.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:50.422+0000 7f83ace09700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83a80fcf70 0x7f83a8114b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34162/0 (socket says 172.21.15.37:34162) 2024-04-25T17:28:50.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:50.422+0000 7f83ace09700 1 -- 172.21.15.37:0/1058927374 learned_addr learned my addr 172.21.15.37:0/1058927374 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:28:50.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:50.422+0000 7f83ad60a700 1 --2- 172.21.15.37:0/1058927374 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f83a80fbcc0 0x7f83a8066cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:28:50.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:50.423+0000 7f83ace09700 1 -- 172.21.15.37:0/1058927374 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f83a80fbcc0 msgr2=0x7f83a8066cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:28:50.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:50.423+0000 7f83ace09700 1 --2- 172.21.15.37:0/1058927374 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f83a80fbcc0 0x7f83a8066cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:50.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:50.423+0000 7f83ace09700 1 -- 172.21.15.37:0/1058927374 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a4005040 con 0x7f83a80fcf70 2024-04-25T17:28:50.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:50.423+0000 7f83ace09700 1 --2- 172.21.15.37:0/1058927374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83a80fcf70 0x7f83a8114b60 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8398002a80 tx=0x7f83980046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:28:50.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:50.423+0000 7f839dffb700 1 -- 172.21.15.37:0/1058927374 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8398007cc0 con 0x7f83a80fcf70 2024-04-25T17:28:50.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:50.423+0000 7f839dffb700 1 -- 172.21.15.37:0/1058927374 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f839800f040 con 0x7f83a80fcf70 2024-04-25T17:28:50.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:50.423+0000 7f83af86e700 1 -- 172.21.15.37:0/1058927374 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83a81152a0 con 0x7f83a80fcf70 2024-04-25T17:28:50.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:50.423+0000 7f839dffb700 1 -- 172.21.15.37:0/1058927374 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f839800daf0 con 0x7f83a80fcf70 2024-04-25T17:28:50.426 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:50.423+0000 7f83af86e700 1 -- 172.21.15.37:0/1058927374 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83a8115810 con 0x7f83a80fcf70 2024-04-25T17:28:50.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:50.424+0000 7f83af86e700 1 -- 172.21.15.37:0/1058927374 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83a804c710 con 0x7f83a80fcf70 2024-04-25T17:28:50.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:50.425+0000 7f839dffb700 1 -- 172.21.15.37:0/1058927374 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f839800dc50 con 0x7f83a80fcf70 2024-04-25T17:28:50.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:50.425+0000 7f839dffb700 1 --2- 172.21.15.37:0/1058927374 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f8394076b90 0x7f8394079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:28:50.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:50.425+0000 7f839dffb700 1 -- 172.21.15.37:0/1058927374 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f8398097f90 con 0x7f83a80fcf70 2024-04-25T17:28:50.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:50.425+0000 7f83ad60a700 1 --2- 172.21.15.37:0/1058927374 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f8394076b90 0x7f8394079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:28:50.427 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:50.426+0000 7f83ad60a700 1 --2- 172.21.15.37:0/1058927374 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f8394076b90 0x7f8394079040 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f83a400b970 tx=0x7f83a4009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:28:50.431 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:50.430+0000 7f839dffb700 1 -- 172.21.15.37:0/1058927374 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f83980ccff0 con 0x7f83a80fcf70 2024-04-25T17:28:50.663 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:50.662+0000 7f83af86e700 1 -- 172.21.15.37:0/1058927374 --> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f83a8101280 con 0x7f8394076b90 2024-04-25T17:28:50.664 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:50.664+0000 7f839dffb700 1 -- 172.21.15.37:0/1058927374 <== mgr.34104 v2:172.21.15.37:6800/783197737 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f83a8101280 con 0x7f8394076b90 2024-04-25T17:28:50.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:50.666+0000 7f83af86e700 1 -- 172.21.15.37:0/1058927374 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f8394076b90 msgr2=0x7f8394079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:28:50.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:50.666+0000 7f83af86e700 1 --2- 172.21.15.37:0/1058927374 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f8394076b90 0x7f8394079040 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f83a400b970 tx=0x7f83a4009e30 comp rx=0 tx=0).stop 2024-04-25T17:28:50.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:50.666+0000 7f83af86e700 1 -- 172.21.15.37:0/1058927374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83a80fcf70 msgr2=0x7f83a8114b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:28:50.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:50.666+0000 7f83af86e700 1 --2- 172.21.15.37:0/1058927374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83a80fcf70 0x7f83a8114b60 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8398002a80 tx=0x7f83980046b0 comp rx=0 tx=0).stop 2024-04-25T17:28:50.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:50.666+0000 7f83af86e700 1 -- 172.21.15.37:0/1058927374 shutdown_connections 2024-04-25T17:28:50.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:50.666+0000 7f83af86e700 1 --2- 172.21.15.37:0/1058927374 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f8394076b90 0x7f8394079040 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:50.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:50.666+0000 7f83af86e700 1 --2- 172.21.15.37:0/1058927374 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f83a80fbcc0 0x7f83a8066cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:50.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:50.666+0000 7f83af86e700 1 --2- 172.21.15.37:0/1058927374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83a80fcf70 0x7f83a8114b60 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:50.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:50.666+0000 7f83af86e700 1 -- 172.21.15.37:0/1058927374 >> 172.21.15.37:0/1058927374 conn(0x7f83a80f7440 msgr2=0x7f83a80f8b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:28:50.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:50.666+0000 7f83af86e700 1 -- 172.21.15.37:0/1058927374 shutdown_connections 2024-04-25T17:28:50.668 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:50.666+0000 7f83af86e700 1 -- 172.21.15.37:0/1058927374 wait complete. 2024-04-25T17:28:51.508 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -e sha1=994e2f20102a20fa9a27966c14b625cc01884df8 -- bash -c 'ceph orch ps' 2024-04-25T17:28:51.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:51 smithi037 ceph-mon[90844]: pgmap v267: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:28:51.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:51 smithi037 ceph-mon[90844]: from='client.34566 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:28:51.824 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:28:52.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:51 smithi069 ceph-mon[80239]: pgmap v267: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:28:52.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:51 smithi069 ceph-mon[80239]: from='client.34566 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:28:53.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:53.351+0000 7f1c8e0b5700 1 -- 172.21.15.37:0/1298462004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c88103780 msgr2=0x7f1c880fcdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:28:53.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:53.351+0000 7f1c8e0b5700 1 --2- 172.21.15.37:0/1298462004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c88103780 0x7f1c880fcdf0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1c78004940 tx=0x7f1c78009e30 comp rx=0 tx=0).stop 2024-04-25T17:28:53.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:53.351+0000 7f1c8e0b5700 1 -- 172.21.15.37:0/1298462004 shutdown_connections 2024-04-25T17:28:53.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:53.351+0000 7f1c8e0b5700 1 --2- 172.21.15.37:0/1298462004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c88103780 0x7f1c880fcdf0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:53.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:53.351+0000 7f1c8e0b5700 1 --2- 172.21.15.37:0/1298462004 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1c88102de0 0x7f1c881031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:53.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:53.351+0000 7f1c8e0b5700 1 -- 172.21.15.37:0/1298462004 >> 172.21.15.37:0/1298462004 conn(0x7f1c880f8990 msgr2=0x7f1c880fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:28:53.352 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:53.351+0000 7f1c8e0b5700 1 -- 172.21.15.37:0/1298462004 shutdown_connections 2024-04-25T17:28:53.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:53.351+0000 7f1c8e0b5700 1 -- 172.21.15.37:0/1298462004 wait complete. 2024-04-25T17:28:53.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:53.351+0000 7f1c8e0b5700 1 Processor -- start 2024-04-25T17:28:53.353 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:53.352+0000 7f1c8e0b5700 1 -- start start 2024-04-25T17:28:53.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:53.352+0000 7f1c8e0b5700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1c88102de0 0x7f1c88113980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:28:53.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:53.352+0000 7f1c8e0b5700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c88103780 0x7f1c88113ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:28:53.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:53.352+0000 7f1c8e0b5700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c881145a0 con 0x7f1c88103780 2024-04-25T17:28:53.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:53.352+0000 7f1c8e0b5700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8810db60 con 0x7f1c88102de0 2024-04-25T17:28:53.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:53.352+0000 7f1c86ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c88103780 0x7f1c88113ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:28:53.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:53.352+0000 7f1c86ffd700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c88103780 0x7f1c88113ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34186/0 (socket says 172.21.15.37:34186) 2024-04-25T17:28:53.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:53.352+0000 7f1c86ffd700 1 -- 172.21.15.37:0/718065496 learned_addr learned my addr 172.21.15.37:0/718065496 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:28:53.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:53.352+0000 7f1c877fe700 1 --2- 172.21.15.37:0/718065496 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1c88102de0 0x7f1c88113980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:28:53.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:53.352+0000 7f1c86ffd700 1 -- 172.21.15.37:0/718065496 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1c88102de0 msgr2=0x7f1c88113980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:28:53.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:53.352+0000 7f1c86ffd700 1 --2- 172.21.15.37:0/718065496 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1c88102de0 0x7f1c88113980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:53.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:53.352+0000 7f1c86ffd700 1 -- 172.21.15.37:0/718065496 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c78005040 con 0x7f1c88103780 2024-04-25T17:28:53.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:53.352+0000 7f1c86ffd700 1 --2- 172.21.15.37:0/718065496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c88103780 0x7f1c88113ec0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1c78009100 tx=0x7f1c78009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:28:53.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:53.353+0000 7f1c6ffff700 1 -- 172.21.15.37:0/718065496 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c7800e040 con 0x7f1c88103780 2024-04-25T17:28:53.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:53.353+0000 7f1c8e0b5700 1 -- 172.21.15.37:0/718065496 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c8810dde0 con 0x7f1c88103780 2024-04-25T17:28:53.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:53.353+0000 7f1c6ffff700 1 -- 172.21.15.37:0/718065496 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1c78009af0 con 0x7f1c88103780 2024-04-25T17:28:53.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:53.353+0000 7f1c6ffff700 1 -- 172.21.15.37:0/718065496 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c7801c3f0 con 0x7f1c88103780 2024-04-25T17:28:53.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:53.353+0000 7f1c8e0b5700 1 -- 172.21.15.37:0/718065496 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c8810e3a0 con 0x7f1c88103780 2024-04-25T17:28:53.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:53.354+0000 7f1c8e0b5700 1 -- 172.21.15.37:0/718065496 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c881000f0 con 0x7f1c88103780 2024-04-25T17:28:53.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:53.354+0000 7f1c6ffff700 1 -- 172.21.15.37:0/718065496 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f1c7800baf0 con 0x7f1c88103780 2024-04-25T17:28:53.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:53.355+0000 7f1c6ffff700 1 --2- 172.21.15.37:0/718065496 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f1c70076b90 0x7f1c70079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:28:53.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:53.355+0000 7f1c6ffff700 1 -- 172.21.15.37:0/718065496 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f1c780995a0 con 0x7f1c88103780 2024-04-25T17:28:53.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:53.355+0000 7f1c877fe700 1 --2- 172.21.15.37:0/718065496 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f1c70076b90 0x7f1c70079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:28:53.356 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:53.355+0000 7f1c877fe700 1 --2- 172.21.15.37:0/718065496 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f1c70076b90 0x7f1c70079040 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c009b60 tx=0x7f1c7c0091a0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:28:53.361 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:53.360+0000 7f1c6ffff700 1 -- 172.21.15.37:0/718065496 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f1c78062100 con 0x7f1c88103780 2024-04-25T17:28:53.580 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:53.580+0000 7f1c8e0b5700 1 -- 172.21.15.37:0/718065496 --> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1c88109f30 con 0x7f1c70076b90 2024-04-25T17:28:53.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:53.590+0000 7f1c6ffff700 1 -- 172.21.15.37:0/718065496 <== mgr.34104 v2:172.21.15.37:6800/783197737 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f1c88109f30 con 0x7f1c70076b90 2024-04-25T17:28:53.591 INFO:teuthology.orchestra.run.smithi037.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-25T17:28:53.591 INFO:teuthology.orchestra.run.smithi037.stdout:alertmanager.smithi037 smithi037 *:9093,9094 running (66s) 37s ago 18m 15.3M - 0.25.0 c8568f914cd2 c67858406cb5 2024-04-25T17:28:53.591 INFO:teuthology.orchestra.run.smithi037.stdout:crash.smithi037 smithi037 running (6m) 37s ago 18m 6660k - 19.0.0-3291-g994e2f20 d53c96779a29 639584ea5855 2024-04-25T17:28:53.591 INFO:teuthology.orchestra.run.smithi037.stdout:crash.smithi069 smithi069 running (6m) 100s ago 17m 6665k - 19.0.0-3291-g994e2f20 d53c96779a29 ee5db16733a7 2024-04-25T17:28:53.591 INFO:teuthology.orchestra.run.smithi037.stdout:grafana.smithi037 smithi037 *:3000 running (43s) 37s ago 18m 52.2M - 9.4.12 2bacad6d85d8 6e325226d190 2024-04-25T17:28:53.591 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi037.ksmixc smithi037 running (3m) 37s ago 13m 151M - 19.0.0-3291-g994e2f20 d53c96779a29 398075bc956a 2024-04-25T17:28:53.591 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi037.ovkrpq smithi037 running (2m) 37s ago 13m 153M - 19.0.0-3291-g994e2f20 d53c96779a29 ab3bcb631150 2024-04-25T17:28:53.591 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi069.cpprst smithi069 running (2m) 100s ago 13m 80.1M - 19.0.0-3291-g994e2f20 d53c96779a29 8172e0b6da3e 2024-04-25T17:28:53.591 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi069.ytlqcf smithi069 running (2m) 100s ago 13m 80.4M - 19.0.0-3291-g994e2f20 d53c96779a29 0e58af66f5b5 2024-04-25T17:28:53.591 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.smithi037.txrgxl smithi037 *:8443,9283,8765 running (9m) 37s ago 20m 590M - 19.0.0-3291-g994e2f20 d53c96779a29 e9653fc62df9 2024-04-25T17:28:53.591 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.smithi069.mmuhdo smithi069 *:8443,9283,8765 running (8m) 100s ago 17m 521M - 19.0.0-3291-g994e2f20 d53c96779a29 6820207b4019 2024-04-25T17:28:53.591 INFO:teuthology.orchestra.run.smithi037.stdout:mon.smithi037 smithi037 running (7m) 37s ago 20m 122M 2048M 19.0.0-3291-g994e2f20 d53c96779a29 1b349f3af69d 2024-04-25T17:28:53.591 INFO:teuthology.orchestra.run.smithi037.stdout:mon.smithi069 smithi069 running (7m) 100s ago 17m 106M 2048M 19.0.0-3291-g994e2f20 d53c96779a29 7744dbe81b50 2024-04-25T17:28:53.591 INFO:teuthology.orchestra.run.smithi037.stdout:node-exporter.smithi037 smithi037 *:9100 running (107s) 37s ago 18m 7880k - 1.5.0 0da6a335fe13 e08c36465372 2024-04-25T17:28:53.592 INFO:teuthology.orchestra.run.smithi037.stdout:node-exporter.smithi069 smithi069 *:9100 running (103s) 100s ago 17m 5444k - 1.5.0 0da6a335fe13 3f61f3499944 2024-04-25T17:28:53.592 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0 smithi037 running (6m) 37s ago 16m 173M 1559M 19.0.0-3291-g994e2f20 d53c96779a29 e97538cb8b4f 2024-04-25T17:28:53.592 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1 smithi037 running (5m) 37s ago 16m 182M 1559M 19.0.0-3291-g994e2f20 d53c96779a29 6cf158192aae 2024-04-25T17:28:53.592 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2 smithi037 running (5m) 37s ago 15m 168M 1559M 19.0.0-3291-g994e2f20 d53c96779a29 a0b57bba2ebf 2024-04-25T17:28:53.592 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3 smithi069 running (4m) 100s ago 15m 191M 2581M 19.0.0-3291-g994e2f20 d53c96779a29 d1aa15d6b575 2024-04-25T17:28:53.592 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4 smithi069 running (3m) 100s ago 15m 175M 2581M 19.0.0-3291-g994e2f20 d53c96779a29 ad76a3d0fecb 2024-04-25T17:28:53.592 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5 smithi069 running (3m) 100s ago 14m 165M 2581M 19.0.0-3291-g994e2f20 d53c96779a29 dea8b059441b 2024-04-25T17:28:53.592 INFO:teuthology.orchestra.run.smithi037.stdout:prometheus.smithi037 smithi037 *:9095 running (83s) 37s ago 18m 52.1M - 2.43.0 a07b618ecd1d b75cea846339 2024-04-25T17:28:53.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:53.592+0000 7f1c8e0b5700 1 -- 172.21.15.37:0/718065496 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f1c70076b90 msgr2=0x7f1c70079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:28:53.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:53.592+0000 7f1c8e0b5700 1 --2- 172.21.15.37:0/718065496 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f1c70076b90 0x7f1c70079040 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c009b60 tx=0x7f1c7c0091a0 comp rx=0 tx=0).stop 2024-04-25T17:28:53.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:53.592+0000 7f1c8e0b5700 1 -- 172.21.15.37:0/718065496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c88103780 msgr2=0x7f1c88113ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:28:53.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:53.592+0000 7f1c8e0b5700 1 --2- 172.21.15.37:0/718065496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c88103780 0x7f1c88113ec0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1c78009100 tx=0x7f1c78009e30 comp rx=0 tx=0).stop 2024-04-25T17:28:53.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:53.592+0000 7f1c8e0b5700 1 -- 172.21.15.37:0/718065496 shutdown_connections 2024-04-25T17:28:53.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:53.592+0000 7f1c8e0b5700 1 --2- 172.21.15.37:0/718065496 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f1c70076b90 0x7f1c70079040 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:53.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:53.592+0000 7f1c8e0b5700 1 --2- 172.21.15.37:0/718065496 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1c88102de0 0x7f1c88113980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:53.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:53.592+0000 7f1c8e0b5700 1 --2- 172.21.15.37:0/718065496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c88103780 0x7f1c88113ec0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:53.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:53.592+0000 7f1c8e0b5700 1 -- 172.21.15.37:0/718065496 >> 172.21.15.37:0/718065496 conn(0x7f1c880f8990 msgr2=0x7f1c88107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:28:53.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:53.592+0000 7f1c8e0b5700 1 -- 172.21.15.37:0/718065496 shutdown_connections 2024-04-25T17:28:53.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:53.592+0000 7f1c8e0b5700 1 -- 172.21.15.37:0/718065496 wait complete. 2024-04-25T17:28:53.971 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:53 smithi069 ceph-mon[80239]: pgmap v268: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:28:54.013 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:53 smithi037 ceph-mon[90844]: pgmap v268: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:28:54.314 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -e sha1=994e2f20102a20fa9a27966c14b625cc01884df8 -- bash -c 'ceph orch upgrade status' 2024-04-25T17:28:54.591 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:28:54.954 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:54 smithi037 ceph-mon[90844]: from='client.34570 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:28:55.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:54 smithi069 ceph-mon[80239]: from='client.34570 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:28:56.044 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:55 smithi037 ceph-mon[90844]: pgmap v269: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:28:56.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:55 smithi069 ceph-mon[80239]: pgmap v269: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:28:56.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:56.373+0000 7fc8f5a8f700 1 -- 172.21.15.37:0/2642143618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8f0102de0 msgr2=0x7fc8f01031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:28:56.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:56.373+0000 7fc8f5a8f700 1 --2- 172.21.15.37:0/2642143618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8f0102de0 0x7fc8f01031b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0004940 tx=0x7fc8e0009e30 comp rx=0 tx=0).stop 2024-04-25T17:28:56.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:56.373+0000 7fc8f5a8f700 1 -- 172.21.15.37:0/2642143618 shutdown_connections 2024-04-25T17:28:56.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:56.373+0000 7fc8f5a8f700 1 --2- 172.21.15.37:0/2642143618 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8f0103780 0x7fc8f00fcdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:56.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:56.373+0000 7fc8f5a8f700 1 --2- 172.21.15.37:0/2642143618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8f0102de0 0x7fc8f01031b0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:56.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:56.373+0000 7fc8f5a8f700 1 -- 172.21.15.37:0/2642143618 >> 172.21.15.37:0/2642143618 conn(0x7fc8f00f8990 msgr2=0x7fc8f00fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:28:56.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:56.373+0000 7fc8f5a8f700 1 -- 172.21.15.37:0/2642143618 shutdown_connections 2024-04-25T17:28:56.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:56.373+0000 7fc8f5a8f700 1 -- 172.21.15.37:0/2642143618 wait complete. 2024-04-25T17:28:56.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:56.374+0000 7fc8f5a8f700 1 Processor -- start 2024-04-25T17:28:56.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:56.374+0000 7fc8f5a8f700 1 -- start start 2024-04-25T17:28:56.396 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:56.374+0000 7fc8f5a8f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8f0102de0 0x7fc8f01138f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:28:56.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:56.374+0000 7fc8f5a8f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8f0103780 0x7fc8f0113e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:28:56.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:56.374+0000 7fc8f5a8f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f0114510 con 0x7fc8f0102de0 2024-04-25T17:28:56.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:56.374+0000 7fc8f5a8f700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f010da80 con 0x7fc8f0103780 2024-04-25T17:28:56.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:56.374+0000 7fc8ef7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8f0102de0 0x7fc8f01138f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:28:56.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:56.374+0000 7fc8ef7fe700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8f0102de0 0x7fc8f01138f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34198/0 (socket says 172.21.15.37:34198) 2024-04-25T17:28:56.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:56.374+0000 7fc8ef7fe700 1 -- 172.21.15.37:0/3692809057 learned_addr learned my addr 172.21.15.37:0/3692809057 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:28:56.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:56.375+0000 7fc8eeffd700 1 --2- 172.21.15.37:0/3692809057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8f0103780 0x7fc8f0113e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:28:56.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:56.375+0000 7fc8ef7fe700 1 -- 172.21.15.37:0/3692809057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8f0103780 msgr2=0x7fc8f0113e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:28:56.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:56.375+0000 7fc8ef7fe700 1 --2- 172.21.15.37:0/3692809057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8f0103780 0x7fc8f0113e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:56.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:56.375+0000 7fc8ef7fe700 1 -- 172.21.15.37:0/3692809057 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e0005040 con 0x7fc8f0102de0 2024-04-25T17:28:56.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:56.375+0000 7fc8ef7fe700 1 --2- 172.21.15.37:0/3692809057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8f0102de0 0x7fc8f01138f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc8e000b3b0 tx=0x7fc8e0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:28:56.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:56.375+0000 7fc8d7fff700 1 -- 172.21.15.37:0/3692809057 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8e000e040 con 0x7fc8f0102de0 2024-04-25T17:28:56.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:56.375+0000 7fc8f5a8f700 1 -- 172.21.15.37:0/3692809057 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8f010dd00 con 0x7fc8f0102de0 2024-04-25T17:28:56.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:56.375+0000 7fc8d7fff700 1 -- 172.21.15.37:0/3692809057 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc8e000bbc0 con 0x7fc8f0102de0 2024-04-25T17:28:56.397 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:56.375+0000 7fc8d7fff700 1 -- 172.21.15.37:0/3692809057 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8e001c3f0 con 0x7fc8f0102de0 2024-04-25T17:28:56.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:56.375+0000 7fc8f5a8f700 1 -- 172.21.15.37:0/3692809057 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8f010e2c0 con 0x7fc8f0102de0 2024-04-25T17:28:56.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:56.376+0000 7fc8f5a8f700 1 -- 172.21.15.37:0/3692809057 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8f01000f0 con 0x7fc8f0102de0 2024-04-25T17:28:56.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:56.377+0000 7fc8d7fff700 1 -- 172.21.15.37:0/3692809057 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7fc8e000bd30 con 0x7fc8f0102de0 2024-04-25T17:28:56.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:56.378+0000 7fc8d7fff700 1 --2- 172.21.15.37:0/3692809057 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fc8d8076b90 0x7fc8d8079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:28:56.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:56.378+0000 7fc8eeffd700 1 --2- 172.21.15.37:0/3692809057 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fc8d8076b90 0x7fc8d8079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:28:56.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:56.378+0000 7fc8d7fff700 1 -- 172.21.15.37:0/3692809057 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fc8e0099610 con 0x7fc8f0102de0 2024-04-25T17:28:56.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:56.378+0000 7fc8eeffd700 1 --2- 172.21.15.37:0/3692809057 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fc8d8076b90 0x7fc8d8079040 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc8e4006fd0 tx=0x7fc8e4008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:28:56.398 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:56.383+0000 7fc8d7fff700 1 -- 172.21.15.37:0/3692809057 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fc8e00620f0 con 0x7fc8f0102de0 2024-04-25T17:28:56.611 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:56.610+0000 7fc8f5a8f700 1 -- 172.21.15.37:0/3692809057 --> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc8f010ef40 con 0x7fc8d8076b90 2024-04-25T17:28:56.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:56.612+0000 7fc8d7fff700 1 -- 172.21.15.37:0/3692809057 <== mgr.34104 v2:172.21.15.37:6800/783197737 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7fc8f010ef40 con 0x7fc8d8076b90 2024-04-25T17:28:56.612 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-25T17:28:56.612 INFO:teuthology.orchestra.run.smithi037.stdout: "target_image": null, 2024-04-25T17:28:56.613 INFO:teuthology.orchestra.run.smithi037.stdout: "in_progress": false, 2024-04-25T17:28:56.613 INFO:teuthology.orchestra.run.smithi037.stdout: "which": "", 2024-04-25T17:28:56.613 INFO:teuthology.orchestra.run.smithi037.stdout: "services_complete": [], 2024-04-25T17:28:56.613 INFO:teuthology.orchestra.run.smithi037.stdout: "progress": null, 2024-04-25T17:28:56.613 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "", 2024-04-25T17:28:56.613 INFO:teuthology.orchestra.run.smithi037.stdout: "is_paused": false 2024-04-25T17:28:56.613 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-25T17:28:56.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:56.614+0000 7fc8f5a8f700 1 -- 172.21.15.37:0/3692809057 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fc8d8076b90 msgr2=0x7fc8d8079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:28:56.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:56.614+0000 7fc8f5a8f700 1 --2- 172.21.15.37:0/3692809057 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fc8d8076b90 0x7fc8d8079040 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc8e4006fd0 tx=0x7fc8e4008040 comp rx=0 tx=0).stop 2024-04-25T17:28:56.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:56.614+0000 7fc8f5a8f700 1 -- 172.21.15.37:0/3692809057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8f0102de0 msgr2=0x7fc8f01138f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:28:56.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:56.614+0000 7fc8f5a8f700 1 --2- 172.21.15.37:0/3692809057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8f0102de0 0x7fc8f01138f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc8e000b3b0 tx=0x7fc8e0009e30 comp rx=0 tx=0).stop 2024-04-25T17:28:56.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:56.614+0000 7fc8f5a8f700 1 -- 172.21.15.37:0/3692809057 shutdown_connections 2024-04-25T17:28:56.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:56.614+0000 7fc8f5a8f700 1 --2- 172.21.15.37:0/3692809057 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fc8d8076b90 0x7fc8d8079040 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:56.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:56.614+0000 7fc8f5a8f700 1 --2- 172.21.15.37:0/3692809057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8f0102de0 0x7fc8f01138f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:56.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:56.614+0000 7fc8f5a8f700 1 --2- 172.21.15.37:0/3692809057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8f0103780 0x7fc8f0113e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:56.615 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:56.614+0000 7fc8f5a8f700 1 -- 172.21.15.37:0/3692809057 >> 172.21.15.37:0/3692809057 conn(0x7fc8f00f8990 msgr2=0x7fc8f00fa650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:28:56.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:56.614+0000 7fc8f5a8f700 1 -- 172.21.15.37:0/3692809057 shutdown_connections 2024-04-25T17:28:56.616 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:56.614+0000 7fc8f5a8f700 1 -- 172.21.15.37:0/3692809057 wait complete. 2024-04-25T17:28:57.335 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -e sha1=994e2f20102a20fa9a27966c14b625cc01884df8 -- bash -c 'ceph health detail' 2024-04-25T17:28:57.608 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:28:58.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:57 smithi037 ceph-mon[90844]: pgmap v270: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:28:58.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:57 smithi037 ceph-mon[90844]: from='client.34574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:28:58.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:57 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:28:58.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:57 smithi069 ceph-mon[80239]: pgmap v270: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:28:58.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:57 smithi069 ceph-mon[80239]: from='client.34574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:28:58.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:57 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:28:59.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:59.256+0000 7fa6f0a76700 1 -- 172.21.15.37:0/3188089752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6ec0fe7e0 msgr2=0x7fa6ec106e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:28:59.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:59.256+0000 7fa6f0a76700 1 --2- 172.21.15.37:0/3188089752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6ec0fe7e0 0x7fa6ec106e20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa6d4004940 tx=0x7fa6d4009e30 comp rx=0 tx=0).stop 2024-04-25T17:28:59.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:59.256+0000 7fa6f0a76700 1 -- 172.21.15.37:0/3188089752 shutdown_connections 2024-04-25T17:28:59.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:59.256+0000 7fa6f0a76700 1 --2- 172.21.15.37:0/3188089752 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6ec0fe7e0 0x7fa6ec106e20 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:59.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:59.256+0000 7fa6f0a76700 1 --2- 172.21.15.37:0/3188089752 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6ec0fde40 0x7fa6ec0fe210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:59.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:59.256+0000 7fa6f0a76700 1 -- 172.21.15.37:0/3188089752 >> 172.21.15.37:0/3188089752 conn(0x7fa6ec0f7850 msgr2=0x7fa6ec0f9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:28:59.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:59.256+0000 7fa6f0a76700 1 -- 172.21.15.37:0/3188089752 shutdown_connections 2024-04-25T17:28:59.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:59.256+0000 7fa6f0a76700 1 -- 172.21.15.37:0/3188089752 wait complete. 2024-04-25T17:28:59.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:59.257+0000 7fa6f0a76700 1 Processor -- start 2024-04-25T17:28:59.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:59.257+0000 7fa6f0a76700 1 -- start start 2024-04-25T17:28:59.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:59.257+0000 7fa6f0a76700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6ec0fde40 0x7fa6ec0fbc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:28:59.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:59.257+0000 7fa6f0a76700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6ec0fe7e0 0x7fa6ec0fc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:28:59.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:59.257+0000 7fa6f0a76700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ec0fc7d0 con 0x7fa6ec0fe7e0 2024-04-25T17:28:59.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:59.257+0000 7fa6f0a76700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ec0fc910 con 0x7fa6ec0fde40 2024-04-25T17:28:59.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:59.257+0000 7fa6e9d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6ec0fe7e0 0x7fa6ec0fc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:28:59.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:59.257+0000 7fa6e9d9b700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6ec0fe7e0 0x7fa6ec0fc1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54486/0 (socket says 172.21.15.37:54486) 2024-04-25T17:28:59.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:59.257+0000 7fa6e9d9b700 1 -- 172.21.15.37:0/3630515144 learned_addr learned my addr 172.21.15.37:0/3630515144 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:28:59.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:59.257+0000 7fa6ea59c700 1 --2- 172.21.15.37:0/3630515144 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6ec0fde40 0x7fa6ec0fbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:28:59.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:59.258+0000 7fa6e9d9b700 1 -- 172.21.15.37:0/3630515144 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6ec0fde40 msgr2=0x7fa6ec0fbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:28:59.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:59.258+0000 7fa6e9d9b700 1 --2- 172.21.15.37:0/3630515144 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6ec0fde40 0x7fa6ec0fbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:59.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:59.258+0000 7fa6e9d9b700 1 -- 172.21.15.37:0/3630515144 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d4005040 con 0x7fa6ec0fe7e0 2024-04-25T17:28:59.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:59.258+0000 7fa6e9d9b700 1 --2- 172.21.15.37:0/3630515144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6ec0fe7e0 0x7fa6ec0fc1b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa6d4009380 tx=0x7fa6d4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:28:59.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:59.258+0000 7fa6e2ffd700 1 -- 172.21.15.37:0/3630515144 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6d400e040 con 0x7fa6ec0fe7e0 2024-04-25T17:28:59.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:59.258+0000 7fa6e2ffd700 1 -- 172.21.15.37:0/3630515144 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa6d4009af0 con 0x7fa6ec0fe7e0 2024-04-25T17:28:59.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:59.258+0000 7fa6f0a76700 1 -- 172.21.15.37:0/3630515144 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6ec119d90 con 0x7fa6ec0fe7e0 2024-04-25T17:28:59.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:59.258+0000 7fa6e2ffd700 1 -- 172.21.15.37:0/3630515144 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6d401c3f0 con 0x7fa6ec0fe7e0 2024-04-25T17:28:59.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:59.258+0000 7fa6f0a76700 1 -- 172.21.15.37:0/3630515144 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6ec11a220 con 0x7fa6ec0fe7e0 2024-04-25T17:28:59.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:59.259+0000 7fa6f0a76700 1 -- 172.21.15.37:0/3630515144 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6ec0666f0 con 0x7fa6ec0fe7e0 2024-04-25T17:28:59.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:59.260+0000 7fa6e2ffd700 1 -- 172.21.15.37:0/3630515144 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7fa6d4013420 con 0x7fa6ec0fe7e0 2024-04-25T17:28:59.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:59.260+0000 7fa6e2ffd700 1 --2- 172.21.15.37:0/3630515144 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fa6d8076b90 0x7fa6d8079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:28:59.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:59.261+0000 7fa6e2ffd700 1 -- 172.21.15.37:0/3630515144 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fa6d4099680 con 0x7fa6ec0fe7e0 2024-04-25T17:28:59.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:59.261+0000 7fa6ea59c700 1 --2- 172.21.15.37:0/3630515144 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fa6d8076b90 0x7fa6d8079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:28:59.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:59.261+0000 7fa6ea59c700 1 --2- 172.21.15.37:0/3630515144 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fa6d8076b90 0x7fa6d8079040 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa6e4007580 tx=0x7fa6e4009780 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:28:59.268 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:59.268+0000 7fa6e2ffd700 1 -- 172.21.15.37:0/3630515144 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fa6d4062160 con 0x7fa6ec0fe7e0 2024-04-25T17:28:59.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:59.565+0000 7fa6f0a76700 1 -- 172.21.15.37:0/3630515144 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fa6ec04bed0 con 0x7fa6ec0fe7e0 2024-04-25T17:28:59.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:59.566+0000 7fa6e2ffd700 1 -- 172.21.15.37:0/3630515144 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fa6d4061b00 con 0x7fa6ec0fe7e0 2024-04-25T17:28:59.567 INFO:teuthology.orchestra.run.smithi037.stdout:HEALTH_OK 2024-04-25T17:28:59.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:59.568+0000 7fa6f0a76700 1 -- 172.21.15.37:0/3630515144 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fa6d8076b90 msgr2=0x7fa6d8079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:28:59.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:59.568+0000 7fa6f0a76700 1 --2- 172.21.15.37:0/3630515144 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fa6d8076b90 0x7fa6d8079040 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa6e4007580 tx=0x7fa6e4009780 comp rx=0 tx=0).stop 2024-04-25T17:28:59.569 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:59.568+0000 7fa6f0a76700 1 -- 172.21.15.37:0/3630515144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6ec0fe7e0 msgr2=0x7fa6ec0fc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:28:59.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:59.568+0000 7fa6f0a76700 1 --2- 172.21.15.37:0/3630515144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6ec0fe7e0 0x7fa6ec0fc1b0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa6d4009380 tx=0x7fa6d4009e30 comp rx=0 tx=0).stop 2024-04-25T17:28:59.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:59.568+0000 7fa6f0a76700 1 -- 172.21.15.37:0/3630515144 shutdown_connections 2024-04-25T17:28:59.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:59.568+0000 7fa6f0a76700 1 --2- 172.21.15.37:0/3630515144 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fa6d8076b90 0x7fa6d8079040 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:59.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:59.568+0000 7fa6f0a76700 1 --2- 172.21.15.37:0/3630515144 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6ec0fde40 0x7fa6ec0fbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:59.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:59.568+0000 7fa6f0a76700 1 --2- 172.21.15.37:0/3630515144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa6ec0fe7e0 0x7fa6ec0fc1b0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:28:59.570 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:59.568+0000 7fa6f0a76700 1 -- 172.21.15.37:0/3630515144 >> 172.21.15.37:0/3630515144 conn(0x7fa6ec0f7850 msgr2=0x7fa6ec0f8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:28:59.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:59.568+0000 7fa6f0a76700 1 -- 172.21.15.37:0/3630515144 shutdown_connections 2024-04-25T17:28:59.571 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:28:59.568+0000 7fa6f0a76700 1 -- 172.21.15.37:0/3630515144 wait complete. 2024-04-25T17:28:59.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:59 smithi037 ceph-mon[90844]: pgmap v271: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:28:59.822 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:28:59 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/3630515144' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T17:29:00.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:59 smithi069 ceph-mon[80239]: pgmap v271: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:29:00.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:28:59 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/3630515144' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-04-25T17:29:00.202 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -e sha1=994e2f20102a20fa9a27966c14b625cc01884df8 -- bash -c 'ceph versions' 2024-04-25T17:29:00.473 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:29:01.959 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:29:01 smithi037 ceph-mon[90844]: pgmap v272: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:29:02.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:29:01 smithi069 ceph-mon[80239]: pgmap v272: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:29:02.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:29:02.288+0000 7f42c4dd7700 1 -- 172.21.15.37:0/1076598967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42c0102de0 msgr2=0x7f42c01031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:29:02.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:29:02.288+0000 7f42c4dd7700 1 --2- 172.21.15.37:0/1076598967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42c0102de0 0x7f42c01031b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f42b0004940 tx=0x7f42b0009e30 comp rx=0 tx=0).stop 2024-04-25T17:29:02.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:29:02.288+0000 7f42c4dd7700 1 -- 172.21.15.37:0/1076598967 shutdown_connections 2024-04-25T17:29:02.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:29:02.288+0000 7f42c4dd7700 1 --2- 172.21.15.37:0/1076598967 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f42c0103780 0x7f42c00fcdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:29:02.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:29:02.288+0000 7f42c4dd7700 1 --2- 172.21.15.37:0/1076598967 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42c0102de0 0x7f42c01031b0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:29:02.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:29:02.288+0000 7f42c4dd7700 1 -- 172.21.15.37:0/1076598967 >> 172.21.15.37:0/1076598967 conn(0x7f42c00f89b0 msgr2=0x7f42c00fadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:29:02.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:29:02.288+0000 7f42c4dd7700 1 -- 172.21.15.37:0/1076598967 shutdown_connections 2024-04-25T17:29:02.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:29:02.288+0000 7f42c4dd7700 1 -- 172.21.15.37:0/1076598967 wait complete. 2024-04-25T17:29:02.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:29:02.288+0000 7f42c4dd7700 1 Processor -- start 2024-04-25T17:29:02.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:29:02.289+0000 7f42c4dd7700 1 -- start start 2024-04-25T17:29:02.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:29:02.289+0000 7f42c4dd7700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42c0102de0 0x7f42c0113b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:29:02.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:29:02.289+0000 7f42c4dd7700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f42c0103780 0x7f42c01140c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:29:02.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:29:02.289+0000 7f42c4dd7700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c0114710 con 0x7f42c0102de0 2024-04-25T17:29:02.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:29:02.289+0000 7f42c4dd7700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c010db50 con 0x7f42c0103780 2024-04-25T17:29:02.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:29:02.289+0000 7f42be59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42c0102de0 0x7f42c0113b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:29:02.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:29:02.289+0000 7f42be59c700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42c0102de0 0x7f42c0113b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:54508/0 (socket says 172.21.15.37:54508) 2024-04-25T17:29:02.291 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:29:02.289+0000 7f42be59c700 1 -- 172.21.15.37:0/2971796681 learned_addr learned my addr 172.21.15.37:0/2971796681 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:29:02.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:29:02.289+0000 7f42bdd9b700 1 --2- 172.21.15.37:0/2971796681 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f42c0103780 0x7f42c01140c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:29:02.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:29:02.289+0000 7f42be59c700 1 -- 172.21.15.37:0/2971796681 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f42c0103780 msgr2=0x7f42c01140c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:29:02.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:29:02.289+0000 7f42be59c700 1 --2- 172.21.15.37:0/2971796681 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f42c0103780 0x7f42c01140c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:29:02.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:29:02.289+0000 7f42be59c700 1 -- 172.21.15.37:0/2971796681 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b0005040 con 0x7f42c0102de0 2024-04-25T17:29:02.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:29:02.290+0000 7f42be59c700 1 --2- 172.21.15.37:0/2971796681 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42c0102de0 0x7f42c0113b80 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f42b000b3b0 tx=0x7f42b0009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:29:02.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:29:02.290+0000 7f42aeffd700 1 -- 172.21.15.37:0/2971796681 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42b000e040 con 0x7f42c0102de0 2024-04-25T17:29:02.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:29:02.290+0000 7f42aeffd700 1 -- 172.21.15.37:0/2971796681 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f42b0013420 con 0x7f42c0102de0 2024-04-25T17:29:02.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:29:02.290+0000 7f42c4dd7700 1 -- 172.21.15.37:0/2971796681 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42c010ddd0 con 0x7f42c0102de0 2024-04-25T17:29:02.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:29:02.290+0000 7f42aeffd700 1 -- 172.21.15.37:0/2971796681 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42b001c630 con 0x7f42c0102de0 2024-04-25T17:29:02.292 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:29:02.290+0000 7f42c4dd7700 1 -- 172.21.15.37:0/2971796681 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42c010e390 con 0x7f42c0102de0 2024-04-25T17:29:02.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:29:02.291+0000 7f42c4dd7700 1 -- 172.21.15.37:0/2971796681 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42c01000f0 con 0x7f42c0102de0 2024-04-25T17:29:02.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:29:02.292+0000 7f42aeffd700 1 -- 172.21.15.37:0/2971796681 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f42b0013590 con 0x7f42c0102de0 2024-04-25T17:29:02.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:29:02.292+0000 7f42aeffd700 1 --2- 172.21.15.37:0/2971796681 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f42a8076b90 0x7f42a8079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:29:02.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:29:02.293+0000 7f42aeffd700 1 -- 172.21.15.37:0/2971796681 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f42b0099580 con 0x7f42c0102de0 2024-04-25T17:29:02.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:29:02.293+0000 7f42bdd9b700 1 --2- 172.21.15.37:0/2971796681 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f42a8076b90 0x7f42a8079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:29:02.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:29:02.293+0000 7f42bdd9b700 1 --2- 172.21.15.37:0/2971796681 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f42a8076b90 0x7f42a8079040 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f42c010ecc0 tx=0x7f42b400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:29:02.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:29:02.298+0000 7f42aeffd700 1 -- 172.21.15.37:0/2971796681 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f42b00620e0 con 0x7f42c0102de0 2024-04-25T17:29:02.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:29:02.594+0000 7f42c4dd7700 1 -- 172.21.15.37:0/2971796681 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f42c010f1d0 con 0x7f42c0102de0 2024-04-25T17:29:02.595 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:29:02.594+0000 7f42aeffd700 1 -- 172.21.15.37:0/2971796681 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f42b0061a80 con 0x7f42c0102de0 2024-04-25T17:29:02.595 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-25T17:29:02.595 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": { 2024-04-25T17:29:02.595 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 2 2024-04-25T17:29:02.595 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:29:02.595 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": { 2024-04-25T17:29:02.596 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 2 2024-04-25T17:29:02.596 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:29:02.596 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": { 2024-04-25T17:29:02.596 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 6 2024-04-25T17:29:02.596 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:29:02.596 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": { 2024-04-25T17:29:02.596 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 4 2024-04-25T17:29:02.596 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:29:02.596 INFO:teuthology.orchestra.run.smithi037.stdout: "overall": { 2024-04-25T17:29:02.596 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 14 2024-04-25T17:29:02.596 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-04-25T17:29:02.596 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-25T17:29:02.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:29:02.596+0000 7f42c4dd7700 1 -- 172.21.15.37:0/2971796681 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f42a8076b90 msgr2=0x7f42a8079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:29:02.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:29:02.596+0000 7f42c4dd7700 1 --2- 172.21.15.37:0/2971796681 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f42a8076b90 0x7f42a8079040 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f42c010ecc0 tx=0x7f42b400b040 comp rx=0 tx=0).stop 2024-04-25T17:29:02.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:29:02.596+0000 7f42c4dd7700 1 -- 172.21.15.37:0/2971796681 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42c0102de0 msgr2=0x7f42c0113b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:29:02.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:29:02.596+0000 7f42c4dd7700 1 --2- 172.21.15.37:0/2971796681 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42c0102de0 0x7f42c0113b80 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f42b000b3b0 tx=0x7f42b0009e30 comp rx=0 tx=0).stop 2024-04-25T17:29:02.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:29:02.596+0000 7f42c4dd7700 1 -- 172.21.15.37:0/2971796681 shutdown_connections 2024-04-25T17:29:02.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:29:02.596+0000 7f42c4dd7700 1 --2- 172.21.15.37:0/2971796681 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f42a8076b90 0x7f42a8079040 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:29:02.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:29:02.596+0000 7f42c4dd7700 1 --2- 172.21.15.37:0/2971796681 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42c0102de0 0x7f42c0113b80 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:29:02.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:29:02.596+0000 7f42c4dd7700 1 --2- 172.21.15.37:0/2971796681 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f42c0103780 0x7f42c01140c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:29:02.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:29:02.596+0000 7f42c4dd7700 1 -- 172.21.15.37:0/2971796681 >> 172.21.15.37:0/2971796681 conn(0x7f42c00f89b0 msgr2=0x7f42c0107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:29:02.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:29:02.597+0000 7f42c4dd7700 1 -- 172.21.15.37:0/2971796681 shutdown_connections 2024-04-25T17:29:02.598 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:29:02.597+0000 7f42c4dd7700 1 -- 172.21.15.37:0/2971796681 wait complete. 2024-04-25T17:29:02.929 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:29:02 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/2971796681' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:29:03.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:29:02 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/2971796681' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:29:03.241 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -e sha1=994e2f20102a20fa9a27966c14b625cc01884df8 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-04-25T17:29:03.512 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:29:03.882 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:29:03 smithi037 ceph-mon[90844]: pgmap v273: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:29:04.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:29:03 smithi069 ceph-mon[80239]: pgmap v273: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:29:05.199 INFO:teuthology.orchestra.run.smithi037.stdout:wait for servicemap items w/ changing names to refresh 2024-04-25T17:29:05.784 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -e sha1=994e2f20102a20fa9a27966c14b625cc01884df8 -- bash -c 'sleep 60' 2024-04-25T17:29:06.058 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:29:06.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:29:05 smithi037 ceph-mon[90844]: pgmap v274: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:29:06.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:29:05 smithi069 ceph-mon[80239]: pgmap v274: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:29:08.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:29:07 smithi037 ceph-mon[90844]: pgmap v275: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:29:08.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:29:07 smithi069 ceph-mon[80239]: pgmap v275: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:29:10.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:29:09 smithi037 ceph-mon[90844]: pgmap v276: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:29:10.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:29:09 smithi069 ceph-mon[80239]: pgmap v276: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:29:12.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:29:11 smithi037 ceph-mon[90844]: pgmap v277: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:29:12.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:29:11 smithi069 ceph-mon[80239]: pgmap v277: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:29:13.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:29:12 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:29:13.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:29:12 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:29:14.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:29:13 smithi037 ceph-mon[90844]: pgmap v278: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:29:14.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:29:13 smithi069 ceph-mon[80239]: pgmap v278: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:29:16.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:29:15 smithi037 ceph-mon[90844]: pgmap v279: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:29:16.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:29:15 smithi069 ceph-mon[80239]: pgmap v279: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:29:18.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:29:17 smithi037 ceph-mon[90844]: pgmap v280: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:29:18.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:29:17 smithi069 ceph-mon[80239]: pgmap v280: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:29:20.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:29:19 smithi037 ceph-mon[90844]: pgmap v281: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:29:20.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:29:19 smithi069 ceph-mon[80239]: pgmap v281: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:29:22.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:29:21 smithi037 ceph-mon[90844]: pgmap v282: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:29:22.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:29:21 smithi069 ceph-mon[80239]: pgmap v282: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:29:23.070 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:29:22 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:29:23.071 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:29:22 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:29:24.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:29:23 smithi037 ceph-mon[90844]: pgmap v283: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:29:24.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:29:23 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:29:24.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:29:23 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:29:24.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:29:23 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:29:24.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:29:23 smithi069 ceph-mon[80239]: pgmap v283: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:29:24.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:29:23 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:29:24.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:29:23 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:29:24.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:29:23 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:29:26.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:29:25 smithi037 ceph-mon[90844]: pgmap v284: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:29:26.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:29:25 smithi069 ceph-mon[80239]: pgmap v284: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:29:28.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:29:27 smithi037 ceph-mon[90844]: pgmap v285: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:29:28.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:29:27 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:29:28.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:29:27 smithi069 ceph-mon[80239]: pgmap v285: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:29:28.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:29:27 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:29:30.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:29:29 smithi037 ceph-mon[90844]: pgmap v286: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:29:30.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:29:29 smithi069 ceph-mon[80239]: pgmap v286: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:29:32.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:29:31 smithi037 ceph-mon[90844]: pgmap v287: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:29:32.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:29:31 smithi069 ceph-mon[80239]: pgmap v287: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:29:34.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:29:33 smithi037 ceph-mon[90844]: pgmap v288: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:29:34.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:29:33 smithi069 ceph-mon[80239]: pgmap v288: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:29:36.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:29:35 smithi037 ceph-mon[90844]: pgmap v289: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:29:36.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:29:35 smithi069 ceph-mon[80239]: pgmap v289: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:29:38.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:29:37 smithi037 ceph-mon[90844]: pgmap v290: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:29:38.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:29:37 smithi069 ceph-mon[80239]: pgmap v290: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:29:40.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:29:39 smithi037 ceph-mon[90844]: pgmap v291: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:29:40.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:29:39 smithi069 ceph-mon[80239]: pgmap v291: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:29:42.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:29:41 smithi037 ceph-mon[90844]: pgmap v292: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:29:42.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:29:41 smithi069 ceph-mon[80239]: pgmap v292: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:29:43.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:29:42 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:29:43.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:29:42 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:29:44.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:29:43 smithi037 ceph-mon[90844]: pgmap v293: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:29:44.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:29:43 smithi069 ceph-mon[80239]: pgmap v293: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:29:46.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:29:45 smithi037 ceph-mon[90844]: pgmap v294: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:29:46.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:29:45 smithi069 ceph-mon[80239]: pgmap v294: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:29:48.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:29:47 smithi037 ceph-mon[90844]: pgmap v295: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:29:48.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:29:47 smithi069 ceph-mon[80239]: pgmap v295: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:29:50.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:29:49 smithi069 ceph-mon[80239]: pgmap v296: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:29:50.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:29:49 smithi037 ceph-mon[90844]: pgmap v296: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:29:52.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:29:51 smithi069 ceph-mon[80239]: pgmap v297: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:29:52.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:29:51 smithi037 ceph-mon[90844]: pgmap v297: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:29:54.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:29:53 smithi037 ceph-mon[90844]: pgmap v298: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:29:54.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:29:53 smithi069 ceph-mon[80239]: pgmap v298: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:29:56.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:29:55 smithi069 ceph-mon[80239]: pgmap v299: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:29:56.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:29:55 smithi037 ceph-mon[90844]: pgmap v299: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:29:58.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:29:57 smithi069 ceph-mon[80239]: pgmap v300: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:29:58.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:29:57 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:29:58.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:29:57 smithi037 ceph-mon[90844]: pgmap v300: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:29:58.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:29:57 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:30:00.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:29:59 smithi069 ceph-mon[80239]: pgmap v301: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:30:00.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:29:59 smithi037 ceph-mon[90844]: pgmap v301: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:30:01.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:00 smithi069 ceph-mon[80239]: overall HEALTH_OK 2024-04-25T17:30:01.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:00 smithi037 ceph-mon[90844]: overall HEALTH_OK 2024-04-25T17:30:02.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:01 smithi069 ceph-mon[80239]: pgmap v302: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:30:02.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:01 smithi037 ceph-mon[90844]: pgmap v302: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:30:04.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:03 smithi037 ceph-mon[90844]: pgmap v303: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:30:04.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:03 smithi069 ceph-mon[80239]: pgmap v303: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:30:06.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:05 smithi069 ceph-mon[80239]: pgmap v304: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:30:06.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:05 smithi037 ceph-mon[90844]: pgmap v304: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:30:08.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:07 smithi037 ceph-mon[90844]: pgmap v305: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:30:08.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:07 smithi069 ceph-mon[80239]: pgmap v305: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:30:08.406 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -e sha1=994e2f20102a20fa9a27966c14b625cc01884df8 -- bash -c 'ceph orch ps' 2024-04-25T17:30:08.684 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:30:10.069 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:09 smithi037 ceph-mon[90844]: pgmap v306: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:30:10.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:09 smithi069 ceph-mon[80239]: pgmap v306: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:30:10.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:10.271+0000 7f39c7f30700 1 -- 172.21.15.37:0/2182135952 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39c0102de0 msgr2=0x7f39c01031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:10.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:10.271+0000 7f39c7f30700 1 --2- 172.21.15.37:0/2182135952 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39c0102de0 0x7f39c01031b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f39b4004940 tx=0x7f39b4009e30 comp rx=0 tx=0).stop 2024-04-25T17:30:10.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:10.272+0000 7f39c7f30700 1 -- 172.21.15.37:0/2182135952 shutdown_connections 2024-04-25T17:30:10.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:10.272+0000 7f39c7f30700 1 --2- 172.21.15.37:0/2182135952 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f39c0103780 0x7f39c00fcdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:10.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:10.272+0000 7f39c7f30700 1 --2- 172.21.15.37:0/2182135952 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39c0102de0 0x7f39c01031b0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:10.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:10.272+0000 7f39c7f30700 1 -- 172.21.15.37:0/2182135952 >> 172.21.15.37:0/2182135952 conn(0x7f39c00f8990 msgr2=0x7f39c00fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:10.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:10.272+0000 7f39c7f30700 1 -- 172.21.15.37:0/2182135952 shutdown_connections 2024-04-25T17:30:10.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:10.272+0000 7f39c7f30700 1 -- 172.21.15.37:0/2182135952 wait complete. 2024-04-25T17:30:10.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:10.272+0000 7f39c7f30700 1 Processor -- start 2024-04-25T17:30:10.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:10.272+0000 7f39c7f30700 1 -- start start 2024-04-25T17:30:10.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:10.272+0000 7f39c7f30700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39c0102de0 0x7f39c0113970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:10.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:10.272+0000 7f39c7f30700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f39c0103780 0x7f39c0113eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:10.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:10.272+0000 7f39c7f30700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c0114500 con 0x7f39c0102de0 2024-04-25T17:30:10.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:10.272+0000 7f39c7f30700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c010db50 con 0x7f39c0103780 2024-04-25T17:30:10.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:10.273+0000 7f39c5ccc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39c0102de0 0x7f39c0113970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:10.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:10.273+0000 7f39c5ccc700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39c0102de0 0x7f39c0113970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52492/0 (socket says 172.21.15.37:52492) 2024-04-25T17:30:10.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:10.273+0000 7f39c5ccc700 1 -- 172.21.15.37:0/162013128 learned_addr learned my addr 172.21.15.37:0/162013128 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:30:10.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:10.273+0000 7f39c54cb700 1 --2- 172.21.15.37:0/162013128 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f39c0103780 0x7f39c0113eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:10.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:10.273+0000 7f39c5ccc700 1 -- 172.21.15.37:0/162013128 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f39c0103780 msgr2=0x7f39c0113eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:10.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:10.273+0000 7f39c5ccc700 1 --2- 172.21.15.37:0/162013128 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f39c0103780 0x7f39c0113eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:10.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:10.273+0000 7f39c5ccc700 1 -- 172.21.15.37:0/162013128 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b4005040 con 0x7f39c0102de0 2024-04-25T17:30:10.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:10.273+0000 7f39c5ccc700 1 --2- 172.21.15.37:0/162013128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39c0102de0 0x7f39c0113970 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f39b4009150 tx=0x7f39b4009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:10.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:10.273+0000 7f39b27fc700 1 -- 172.21.15.37:0/162013128 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39b400e040 con 0x7f39c0102de0 2024-04-25T17:30:10.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:10.273+0000 7f39b27fc700 1 -- 172.21.15.37:0/162013128 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f39b4013420 con 0x7f39c0102de0 2024-04-25T17:30:10.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:10.273+0000 7f39c7f30700 1 -- 172.21.15.37:0/162013128 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39c010ddd0 con 0x7f39c0102de0 2024-04-25T17:30:10.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:10.273+0000 7f39b27fc700 1 -- 172.21.15.37:0/162013128 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39b401c630 con 0x7f39c0102de0 2024-04-25T17:30:10.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:10.273+0000 7f39c7f30700 1 -- 172.21.15.37:0/162013128 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39c010e390 con 0x7f39c0102de0 2024-04-25T17:30:10.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:10.274+0000 7f39c7f30700 1 -- 172.21.15.37:0/162013128 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39c01000f0 con 0x7f39c0102de0 2024-04-25T17:30:10.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:10.275+0000 7f39b27fc700 1 -- 172.21.15.37:0/162013128 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f39b4013590 con 0x7f39c0102de0 2024-04-25T17:30:10.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:10.275+0000 7f39b27fc700 1 --2- 172.21.15.37:0/162013128 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f39ac076b80 0x7f39ac079030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:10.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:10.275+0000 7f39b27fc700 1 -- 172.21.15.37:0/162013128 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f39b40994f0 con 0x7f39c0102de0 2024-04-25T17:30:10.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:10.276+0000 7f39c54cb700 1 --2- 172.21.15.37:0/162013128 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f39ac076b80 0x7f39ac079030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:10.278 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:10.276+0000 7f39c54cb700 1 --2- 172.21.15.37:0/162013128 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f39ac076b80 0x7f39ac079030 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f39c010ecc0 tx=0x7f39bc009ee0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:10.281 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:10.281+0000 7f39b27fc700 1 -- 172.21.15.37:0/162013128 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f39b4062110 con 0x7f39c0102de0 2024-04-25T17:30:10.503 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:10.502+0000 7f39c7f30700 1 -- 172.21.15.37:0/162013128 --> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f39c010f030 con 0x7f39ac076b80 2024-04-25T17:30:10.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:10.513+0000 7f39b27fc700 1 -- 172.21.15.37:0/162013128 <== mgr.34104 v2:172.21.15.37:6800/783197737 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f39c010f030 con 0x7f39ac076b80 2024-04-25T17:30:10.514 INFO:teuthology.orchestra.run.smithi037.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-04-25T17:30:10.514 INFO:teuthology.orchestra.run.smithi037.stdout:alertmanager.smithi037 smithi037 *:9093,9094 running (2m) 114s ago 19m 15.3M - 0.25.0 c8568f914cd2 c67858406cb5 2024-04-25T17:30:10.514 INFO:teuthology.orchestra.run.smithi037.stdout:crash.smithi037 smithi037 running (8m) 114s ago 20m 6660k - 19.0.0-3291-g994e2f20 d53c96779a29 639584ea5855 2024-04-25T17:30:10.514 INFO:teuthology.orchestra.run.smithi037.stdout:crash.smithi069 smithi069 running (7m) 2m ago 19m 6665k - 19.0.0-3291-g994e2f20 d53c96779a29 ee5db16733a7 2024-04-25T17:30:10.514 INFO:teuthology.orchestra.run.smithi037.stdout:grafana.smithi037 smithi037 *:3000 running (2m) 114s ago 19m 52.2M - 9.4.12 2bacad6d85d8 6e325226d190 2024-04-25T17:30:10.514 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi037.ksmixc smithi037 running (4m) 114s ago 14m 151M - 19.0.0-3291-g994e2f20 d53c96779a29 398075bc956a 2024-04-25T17:30:10.514 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi037.ovkrpq smithi037 running (3m) 114s ago 14m 153M - 19.0.0-3291-g994e2f20 d53c96779a29 ab3bcb631150 2024-04-25T17:30:10.514 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi069.cpprst smithi069 running (3m) 2m ago 14m 80.1M - 19.0.0-3291-g994e2f20 d53c96779a29 8172e0b6da3e 2024-04-25T17:30:10.514 INFO:teuthology.orchestra.run.smithi037.stdout:mds.cephfs.smithi069.ytlqcf smithi069 running (3m) 2m ago 14m 80.4M - 19.0.0-3291-g994e2f20 d53c96779a29 0e58af66f5b5 2024-04-25T17:30:10.514 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.smithi037.txrgxl smithi037 *:8443,9283,8765 running (10m) 114s ago 21m 590M - 19.0.0-3291-g994e2f20 d53c96779a29 e9653fc62df9 2024-04-25T17:30:10.515 INFO:teuthology.orchestra.run.smithi037.stdout:mgr.smithi069.mmuhdo smithi069 *:8443,9283,8765 running (9m) 2m ago 18m 521M - 19.0.0-3291-g994e2f20 d53c96779a29 6820207b4019 2024-04-25T17:30:10.515 INFO:teuthology.orchestra.run.smithi037.stdout:mon.smithi037 smithi037 running (9m) 114s ago 21m 122M 2048M 19.0.0-3291-g994e2f20 d53c96779a29 1b349f3af69d 2024-04-25T17:30:10.515 INFO:teuthology.orchestra.run.smithi037.stdout:mon.smithi069 smithi069 running (8m) 2m ago 18m 106M 2048M 19.0.0-3291-g994e2f20 d53c96779a29 7744dbe81b50 2024-04-25T17:30:10.515 INFO:teuthology.orchestra.run.smithi037.stdout:node-exporter.smithi037 smithi037 *:9100 running (3m) 114s ago 20m 7880k - 1.5.0 0da6a335fe13 e08c36465372 2024-04-25T17:30:10.515 INFO:teuthology.orchestra.run.smithi037.stdout:node-exporter.smithi069 smithi069 *:9100 running (3m) 2m ago 18m 5444k - 1.5.0 0da6a335fe13 3f61f3499944 2024-04-25T17:30:10.515 INFO:teuthology.orchestra.run.smithi037.stdout:osd.0 smithi037 running (7m) 114s ago 18m 173M 1559M 19.0.0-3291-g994e2f20 d53c96779a29 e97538cb8b4f 2024-04-25T17:30:10.515 INFO:teuthology.orchestra.run.smithi037.stdout:osd.1 smithi037 running (7m) 114s ago 17m 182M 1559M 19.0.0-3291-g994e2f20 d53c96779a29 6cf158192aae 2024-04-25T17:30:10.515 INFO:teuthology.orchestra.run.smithi037.stdout:osd.2 smithi037 running (6m) 114s ago 17m 168M 1559M 19.0.0-3291-g994e2f20 d53c96779a29 a0b57bba2ebf 2024-04-25T17:30:10.515 INFO:teuthology.orchestra.run.smithi037.stdout:osd.3 smithi069 running (5m) 2m ago 16m 191M 2581M 19.0.0-3291-g994e2f20 d53c96779a29 d1aa15d6b575 2024-04-25T17:30:10.515 INFO:teuthology.orchestra.run.smithi037.stdout:osd.4 smithi069 running (5m) 2m ago 16m 175M 2581M 19.0.0-3291-g994e2f20 d53c96779a29 ad76a3d0fecb 2024-04-25T17:30:10.515 INFO:teuthology.orchestra.run.smithi037.stdout:osd.5 smithi069 running (4m) 2m ago 15m 165M 2581M 19.0.0-3291-g994e2f20 d53c96779a29 dea8b059441b 2024-04-25T17:30:10.515 INFO:teuthology.orchestra.run.smithi037.stdout:prometheus.smithi037 smithi037 *:9095 running (2m) 114s ago 19m 52.1M - 2.43.0 a07b618ecd1d b75cea846339 2024-04-25T17:30:10.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:10.515+0000 7f39c7f30700 1 -- 172.21.15.37:0/162013128 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f39ac076b80 msgr2=0x7f39ac079030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:10.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:10.515+0000 7f39c7f30700 1 --2- 172.21.15.37:0/162013128 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f39ac076b80 0x7f39ac079030 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f39c010ecc0 tx=0x7f39bc009ee0 comp rx=0 tx=0).stop 2024-04-25T17:30:10.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:10.515+0000 7f39c7f30700 1 -- 172.21.15.37:0/162013128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39c0102de0 msgr2=0x7f39c0113970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:10.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:10.515+0000 7f39c7f30700 1 --2- 172.21.15.37:0/162013128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39c0102de0 0x7f39c0113970 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f39b4009150 tx=0x7f39b4009e30 comp rx=0 tx=0).stop 2024-04-25T17:30:10.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:10.515+0000 7f39c7f30700 1 -- 172.21.15.37:0/162013128 shutdown_connections 2024-04-25T17:30:10.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:10.515+0000 7f39c7f30700 1 --2- 172.21.15.37:0/162013128 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f39ac076b80 0x7f39ac079030 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:10.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:10.515+0000 7f39c7f30700 1 --2- 172.21.15.37:0/162013128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f39c0102de0 0x7f39c0113970 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:10.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:10.515+0000 7f39c7f30700 1 --2- 172.21.15.37:0/162013128 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f39c0103780 0x7f39c0113eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:10.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:10.515+0000 7f39c7f30700 1 -- 172.21.15.37:0/162013128 >> 172.21.15.37:0/162013128 conn(0x7f39c00f8990 msgr2=0x7f39c0107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:10.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:10.515+0000 7f39c7f30700 1 -- 172.21.15.37:0/162013128 shutdown_connections 2024-04-25T17:30:10.517 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:10.515+0000 7f39c7f30700 1 -- 172.21.15.37:0/162013128 wait complete. 2024-04-25T17:30:11.205 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -e sha1=994e2f20102a20fa9a27966c14b625cc01884df8 -- bash -c 'ceph versions' 2024-04-25T17:30:11.474 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:30:12.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:11 smithi069 ceph-mon[80239]: from='client.34586 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:30:12.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:11 smithi069 ceph-mon[80239]: pgmap v307: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:30:12.287 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:11 smithi037 ceph-mon[90844]: from='client.34586 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-04-25T17:30:12.287 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:11 smithi037 ceph-mon[90844]: pgmap v307: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:30:13.128 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:13.127+0000 7f45a41a9700 1 -- 172.21.15.37:0/1700903506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f459c102de0 msgr2=0x7f459c1031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:13.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:13.127+0000 7f45a41a9700 1 --2- 172.21.15.37:0/1700903506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f459c102de0 0x7f459c1031b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4598004940 tx=0x7f4598009e30 comp rx=0 tx=0).stop 2024-04-25T17:30:13.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:13.127+0000 7f45a41a9700 1 -- 172.21.15.37:0/1700903506 shutdown_connections 2024-04-25T17:30:13.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:13.127+0000 7f45a41a9700 1 --2- 172.21.15.37:0/1700903506 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f459c103780 0x7f459c0fcdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:13.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:13.127+0000 7f45a41a9700 1 --2- 172.21.15.37:0/1700903506 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f459c102de0 0x7f459c1031b0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:13.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:13.127+0000 7f45a41a9700 1 -- 172.21.15.37:0/1700903506 >> 172.21.15.37:0/1700903506 conn(0x7f459c0f8990 msgr2=0x7f459c0fada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:13.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:13.127+0000 7f45a41a9700 1 -- 172.21.15.37:0/1700903506 shutdown_connections 2024-04-25T17:30:13.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:13.127+0000 7f45a41a9700 1 -- 172.21.15.37:0/1700903506 wait complete. 2024-04-25T17:30:13.129 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:12 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:30:13.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:13.128+0000 7f45a41a9700 1 Processor -- start 2024-04-25T17:30:13.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:13.128+0000 7f45a41a9700 1 -- start start 2024-04-25T17:30:13.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:13.128+0000 7f45a41a9700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f459c102de0 0x7f459c113970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:13.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:13.128+0000 7f45a41a9700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f459c103780 0x7f459c113eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:13.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:13.128+0000 7f45a41a9700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f459c114500 con 0x7f459c102de0 2024-04-25T17:30:13.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:13.128+0000 7f45a41a9700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f459c10db50 con 0x7f459c103780 2024-04-25T17:30:13.131 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:13.129+0000 7f45a1f45700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f459c102de0 0x7f459c113970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:13.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:13.129+0000 7f45a1f45700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f459c102de0 0x7f459c113970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52506/0 (socket says 172.21.15.37:52506) 2024-04-25T17:30:13.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:13.129+0000 7f45a1f45700 1 -- 172.21.15.37:0/3974825690 learned_addr learned my addr 172.21.15.37:0/3974825690 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:30:13.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:13.129+0000 7f45a1744700 1 --2- 172.21.15.37:0/3974825690 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f459c103780 0x7f459c113eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:13.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:13.129+0000 7f45a1f45700 1 -- 172.21.15.37:0/3974825690 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f459c103780 msgr2=0x7f459c113eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:13.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:13.129+0000 7f45a1f45700 1 --2- 172.21.15.37:0/3974825690 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f459c103780 0x7f459c113eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:13.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:13.129+0000 7f45a1f45700 1 -- 172.21.15.37:0/3974825690 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4598005040 con 0x7f459c102de0 2024-04-25T17:30:13.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:13.129+0000 7f45a1f45700 1 --2- 172.21.15.37:0/3974825690 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f459c102de0 0x7f459c113970 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f459800b3b0 tx=0x7f4598009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:13.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:13.129+0000 7f458e7fc700 1 -- 172.21.15.37:0/3974825690 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f459800e040 con 0x7f459c102de0 2024-04-25T17:30:13.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:13.129+0000 7f45a41a9700 1 -- 172.21.15.37:0/3974825690 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f459c10ddd0 con 0x7f459c102de0 2024-04-25T17:30:13.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:13.130+0000 7f45a41a9700 1 -- 172.21.15.37:0/3974825690 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f459c10e390 con 0x7f459c102de0 2024-04-25T17:30:13.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:13.130+0000 7f458e7fc700 1 -- 172.21.15.37:0/3974825690 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4598013420 con 0x7f459c102de0 2024-04-25T17:30:13.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:13.130+0000 7f458e7fc700 1 -- 172.21.15.37:0/3974825690 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f459801c630 con 0x7f459c102de0 2024-04-25T17:30:13.132 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:13.131+0000 7f45a41a9700 1 -- 172.21.15.37:0/3974825690 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f459c1000f0 con 0x7f459c102de0 2024-04-25T17:30:13.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:13.131+0000 7f458e7fc700 1 -- 172.21.15.37:0/3974825690 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f4598013590 con 0x7f459c102de0 2024-04-25T17:30:13.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:13.132+0000 7f458e7fc700 1 --2- 172.21.15.37:0/3974825690 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f4588076b90 0x7f4588079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:13.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:13.132+0000 7f458e7fc700 1 -- 172.21.15.37:0/3974825690 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f4598099440 con 0x7f459c102de0 2024-04-25T17:30:13.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:13.132+0000 7f45a1744700 1 --2- 172.21.15.37:0/3974825690 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f4588076b90 0x7f4588079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:13.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:13.132+0000 7f45a1744700 1 --2- 172.21.15.37:0/3974825690 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f4588076b90 0x7f4588079040 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f459c10ecc0 tx=0x7f459000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:13.137 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:13.137+0000 7f458e7fc700 1 -- 172.21.15.37:0/3974825690 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f4598062060 con 0x7f459c102de0 2024-04-25T17:30:13.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:12 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:30:13.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:13.434+0000 7f45a41a9700 1 -- 172.21.15.37:0/3974825690 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f459c109ee0 con 0x7f459c102de0 2024-04-25T17:30:13.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:13.435+0000 7f458e7fc700 1 -- 172.21.15.37:0/3974825690 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f4598061a00 con 0x7f459c102de0 2024-04-25T17:30:13.436 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-04-25T17:30:13.436 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": { 2024-04-25T17:30:13.436 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 2 2024-04-25T17:30:13.436 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:30:13.437 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": { 2024-04-25T17:30:13.437 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 2 2024-04-25T17:30:13.437 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:30:13.437 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": { 2024-04-25T17:30:13.437 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 6 2024-04-25T17:30:13.437 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:30:13.437 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": { 2024-04-25T17:30:13.437 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 4 2024-04-25T17:30:13.437 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2024-04-25T17:30:13.437 INFO:teuthology.orchestra.run.smithi037.stdout: "overall": { 2024-04-25T17:30:13.437 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)": 14 2024-04-25T17:30:13.437 INFO:teuthology.orchestra.run.smithi037.stdout: } 2024-04-25T17:30:13.437 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-04-25T17:30:13.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:13.437+0000 7f45a41a9700 1 -- 172.21.15.37:0/3974825690 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f4588076b90 msgr2=0x7f4588079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:13.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:13.438+0000 7f45a41a9700 1 --2- 172.21.15.37:0/3974825690 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f4588076b90 0x7f4588079040 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f459c10ecc0 tx=0x7f459000b040 comp rx=0 tx=0).stop 2024-04-25T17:30:13.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:13.438+0000 7f45a41a9700 1 -- 172.21.15.37:0/3974825690 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f459c102de0 msgr2=0x7f459c113970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:13.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:13.438+0000 7f45a41a9700 1 --2- 172.21.15.37:0/3974825690 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f459c102de0 0x7f459c113970 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f459800b3b0 tx=0x7f4598009e30 comp rx=0 tx=0).stop 2024-04-25T17:30:13.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:13.438+0000 7f45a41a9700 1 -- 172.21.15.37:0/3974825690 shutdown_connections 2024-04-25T17:30:13.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:13.438+0000 7f45a41a9700 1 --2- 172.21.15.37:0/3974825690 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f4588076b90 0x7f4588079040 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:13.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:13.438+0000 7f45a41a9700 1 --2- 172.21.15.37:0/3974825690 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f459c102de0 0x7f459c113970 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:13.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:13.438+0000 7f45a41a9700 1 --2- 172.21.15.37:0/3974825690 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f459c103780 0x7f459c113eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:13.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:13.438+0000 7f45a41a9700 1 -- 172.21.15.37:0/3974825690 >> 172.21.15.37:0/3974825690 conn(0x7f459c0f8990 msgr2=0x7f459c107380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:13.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:13.438+0000 7f45a41a9700 1 -- 172.21.15.37:0/3974825690 shutdown_connections 2024-04-25T17:30:13.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:13.438+0000 7f45a41a9700 1 -- 172.21.15.37:0/3974825690 wait complete. 2024-04-25T17:30:14.050 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:13 smithi037 ceph-mon[90844]: pgmap v308: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:30:14.051 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:13 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/3974825690' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:30:14.084 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -e sha1=994e2f20102a20fa9a27966c14b625cc01884df8 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-04-25T17:30:14.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:13 smithi069 ceph-mon[80239]: pgmap v308: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:30:14.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:13 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/3974825690' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:30:14.356 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:30:15.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:15.974+0000 7fb4522ec700 1 -- 172.21.15.37:0/1315301733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb44c103790 msgr2=0x7fb44c0fce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:15.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:15.974+0000 7fb4522ec700 1 --2- 172.21.15.37:0/1315301733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb44c103790 0x7fb44c0fce00 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb440004940 tx=0x7fb440009e30 comp rx=0 tx=0).stop 2024-04-25T17:30:15.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:15.974+0000 7fb4522ec700 1 -- 172.21.15.37:0/1315301733 shutdown_connections 2024-04-25T17:30:15.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:15.974+0000 7fb4522ec700 1 --2- 172.21.15.37:0/1315301733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb44c103790 0x7fb44c0fce00 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:15.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:15.974+0000 7fb4522ec700 1 --2- 172.21.15.37:0/1315301733 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb44c102df0 0x7fb44c1031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:15.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:15.974+0000 7fb4522ec700 1 -- 172.21.15.37:0/1315301733 >> 172.21.15.37:0/1315301733 conn(0x7fb44c0f8980 msgr2=0x7fb44c0fad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:15.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:15.974+0000 7fb4522ec700 1 -- 172.21.15.37:0/1315301733 shutdown_connections 2024-04-25T17:30:15.976 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:15.974+0000 7fb4522ec700 1 -- 172.21.15.37:0/1315301733 wait complete. 2024-04-25T17:30:15.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:15.975+0000 7fb4522ec700 1 Processor -- start 2024-04-25T17:30:15.977 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:15.975+0000 7fb4522ec700 1 -- start start 2024-04-25T17:30:15.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:15.976+0000 7fb4522ec700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb44c102df0 0x7fb44c113b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:15.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:15.976+0000 7fb4522ec700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb44c103790 0x7fb44c1140d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:15.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:15.976+0000 7fb4522ec700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44c114720 con 0x7fb44c102df0 2024-04-25T17:30:15.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:15.976+0000 7fb4522ec700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44c10db10 con 0x7fb44c103790 2024-04-25T17:30:15.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:15.976+0000 7fb44bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb44c102df0 0x7fb44c113b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:15.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:15.976+0000 7fb44bfff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb44c102df0 0x7fb44c113b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:52512/0 (socket says 172.21.15.37:52512) 2024-04-25T17:30:15.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:15.976+0000 7fb44bfff700 1 -- 172.21.15.37:0/983361363 learned_addr learned my addr 172.21.15.37:0/983361363 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:30:15.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:15.976+0000 7fb44b7fe700 1 --2- 172.21.15.37:0/983361363 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb44c103790 0x7fb44c1140d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:15.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:15.976+0000 7fb44bfff700 1 -- 172.21.15.37:0/983361363 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb44c103790 msgr2=0x7fb44c1140d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:15.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:15.976+0000 7fb44bfff700 1 --2- 172.21.15.37:0/983361363 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb44c103790 0x7fb44c1140d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:15.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:15.976+0000 7fb44bfff700 1 -- 172.21.15.37:0/983361363 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb440005040 con 0x7fb44c102df0 2024-04-25T17:30:15.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:15.976+0000 7fb44bfff700 1 --2- 172.21.15.37:0/983361363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb44c102df0 0x7fb44c113b90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb43c00c8c0 tx=0x7fb43c0044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:15.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:15.977+0000 7fb448ff9700 1 -- 172.21.15.37:0/983361363 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb43c00a760 con 0x7fb44c102df0 2024-04-25T17:30:15.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:15.977+0000 7fb448ff9700 1 -- 172.21.15.37:0/983361363 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb43c00ad90 con 0x7fb44c102df0 2024-04-25T17:30:15.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:15.977+0000 7fb4522ec700 1 -- 172.21.15.37:0/983361363 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb44c10ddf0 con 0x7fb44c102df0 2024-04-25T17:30:15.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:15.977+0000 7fb448ff9700 1 -- 172.21.15.37:0/983361363 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb43c0113a0 con 0x7fb44c102df0 2024-04-25T17:30:15.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:15.977+0000 7fb4522ec700 1 -- 172.21.15.37:0/983361363 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb44c10e380 con 0x7fb44c102df0 2024-04-25T17:30:15.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:15.978+0000 7fb4522ec700 1 -- 172.21.15.37:0/983361363 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb44c0fe540 con 0x7fb44c102df0 2024-04-25T17:30:15.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:15.978+0000 7fb448ff9700 1 -- 172.21.15.37:0/983361363 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7fb43c012400 con 0x7fb44c102df0 2024-04-25T17:30:15.980 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:15 smithi037 ceph-mon[90844]: pgmap v309: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:30:15.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:15.979+0000 7fb448ff9700 1 --2- 172.21.15.37:0/983361363 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fb434076b90 0x7fb434079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:15.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:15.979+0000 7fb448ff9700 1 -- 172.21.15.37:0/983361363 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fb43c0983d0 con 0x7fb44c102df0 2024-04-25T17:30:15.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:15.979+0000 7fb44b7fe700 1 --2- 172.21.15.37:0/983361363 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fb434076b90 0x7fb434079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:15.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:15.980+0000 7fb44b7fe700 1 --2- 172.21.15.37:0/983361363 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fb434076b90 0x7fb434079040 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb440004890 tx=0x7fb440009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:15.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:15.984+0000 7fb448ff9700 1 -- 172.21.15.37:0/983361363 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fb43c060f30 con 0x7fb44c102df0 2024-04-25T17:30:16.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:15 smithi069 ceph-mon[80239]: pgmap v309: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:30:16.286 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:16.286+0000 7fb4522ec700 1 -- 172.21.15.37:0/983361363 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb44c109ed0 con 0x7fb44c102df0 2024-04-25T17:30:16.287 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:16.286+0000 7fb448ff9700 1 -- 172.21.15.37:0/983361363 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7fb43c0608d0 con 0x7fb44c102df0 2024-04-25T17:30:16.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:16.288+0000 7fb4522ec700 1 -- 172.21.15.37:0/983361363 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fb434076b90 msgr2=0x7fb434079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:16.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:16.288+0000 7fb4522ec700 1 --2- 172.21.15.37:0/983361363 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fb434076b90 0x7fb434079040 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb440004890 tx=0x7fb440009e30 comp rx=0 tx=0).stop 2024-04-25T17:30:16.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:16.288+0000 7fb4522ec700 1 -- 172.21.15.37:0/983361363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb44c102df0 msgr2=0x7fb44c113b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:16.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:16.288+0000 7fb4522ec700 1 --2- 172.21.15.37:0/983361363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb44c102df0 0x7fb44c113b90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb43c00c8c0 tx=0x7fb43c0044c0 comp rx=0 tx=0).stop 2024-04-25T17:30:16.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:16.288+0000 7fb4522ec700 1 -- 172.21.15.37:0/983361363 shutdown_connections 2024-04-25T17:30:16.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:16.288+0000 7fb4522ec700 1 --2- 172.21.15.37:0/983361363 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fb434076b90 0x7fb434079040 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:16.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:16.288+0000 7fb4522ec700 1 --2- 172.21.15.37:0/983361363 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb44c102df0 0x7fb44c113b90 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:16.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:16.288+0000 7fb4522ec700 1 --2- 172.21.15.37:0/983361363 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb44c103790 0x7fb44c1140d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:16.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:16.288+0000 7fb4522ec700 1 -- 172.21.15.37:0/983361363 >> 172.21.15.37:0/983361363 conn(0x7fb44c0f8980 msgr2=0x7fb44c0f9990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:16.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:16.289+0000 7fb4522ec700 1 -- 172.21.15.37:0/983361363 shutdown_connections 2024-04-25T17:30:16.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:16.289+0000 7fb4522ec700 1 -- 172.21.15.37:0/983361363 wait complete. 2024-04-25T17:30:16.299 INFO:teuthology.orchestra.run.smithi037.stdout:true 2024-04-25T17:30:16.983 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:16 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/983361363' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:30:17.011 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -e sha1=994e2f20102a20fa9a27966c14b625cc01884df8 -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-04-25T17:30:17.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:16 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/983361363' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:30:17.279 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:30:18.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:17 smithi037 ceph-mon[90844]: pgmap v310: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:30:18.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:17 smithi069 ceph-mon[80239]: pgmap v310: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:30:18.877 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:18.871+0000 7fa83f48f700 1 -- 172.21.15.37:0/2692640331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa838102f60 msgr2=0x7fa838103330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:18.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:18.871+0000 7fa83f48f700 1 --2- 172.21.15.37:0/2692640331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa838102f60 0x7fa838103330 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa834004940 tx=0x7fa834009e30 comp rx=0 tx=0).stop 2024-04-25T17:30:18.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:18.871+0000 7fa83f48f700 1 -- 172.21.15.37:0/2692640331 shutdown_connections 2024-04-25T17:30:18.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:18.871+0000 7fa83f48f700 1 --2- 172.21.15.37:0/2692640331 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa8380fb520 0x7fa8380fb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:18.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:18.871+0000 7fa83f48f700 1 --2- 172.21.15.37:0/2692640331 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa838102f60 0x7fa838103330 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:18.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:18.871+0000 7fa83f48f700 1 -- 172.21.15.37:0/2692640331 >> 172.21.15.37:0/2692640331 conn(0x7fa8380714d0 msgr2=0x7fa8380718d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:18.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:18.871+0000 7fa83f48f700 1 -- 172.21.15.37:0/2692640331 shutdown_connections 2024-04-25T17:30:18.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:18.871+0000 7fa83f48f700 1 -- 172.21.15.37:0/2692640331 wait complete. 2024-04-25T17:30:18.878 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:18.871+0000 7fa83f48f700 1 Processor -- start 2024-04-25T17:30:18.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:18.871+0000 7fa83f48f700 1 -- start start 2024-04-25T17:30:18.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:18.872+0000 7fa83f48f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa8380fb520 0x7fa8381139a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:18.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:18.872+0000 7fa83f48f700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa838102f60 0x7fa838113ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:18.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:18.872+0000 7fa83f48f700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa838114530 con 0x7fa838102f60 2024-04-25T17:30:18.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:18.872+0000 7fa83f48f700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83810db30 con 0x7fa8380fb520 2024-04-25T17:30:18.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:18.872+0000 7fa83ca2a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa838102f60 0x7fa838113ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:18.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:18.872+0000 7fa83ca2a700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa838102f60 0x7fa838113ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34410/0 (socket says 172.21.15.37:34410) 2024-04-25T17:30:18.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:18.872+0000 7fa83ca2a700 1 -- 172.21.15.37:0/702149811 learned_addr learned my addr 172.21.15.37:0/702149811 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:30:18.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:18.872+0000 7fa83d22b700 1 --2- 172.21.15.37:0/702149811 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa8380fb520 0x7fa8381139a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:18.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:18.872+0000 7fa83ca2a700 1 -- 172.21.15.37:0/702149811 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa8380fb520 msgr2=0x7fa8381139a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:18.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:18.872+0000 7fa83ca2a700 1 --2- 172.21.15.37:0/702149811 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa8380fb520 0x7fa8381139a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:18.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:18.872+0000 7fa83ca2a700 1 -- 172.21.15.37:0/702149811 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa834005040 con 0x7fa838102f60 2024-04-25T17:30:18.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:18.872+0000 7fa83ca2a700 1 --2- 172.21.15.37:0/702149811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa838102f60 0x7fa838113ee0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa82800c8c0 tx=0x7fa8280044c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:18.879 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:18.872+0000 7fa82dffb700 1 -- 172.21.15.37:0/702149811 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa82800a980 con 0x7fa838102f60 2024-04-25T17:30:18.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:18.872+0000 7fa82dffb700 1 -- 172.21.15.37:0/702149811 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa82800ce60 con 0x7fa838102f60 2024-04-25T17:30:18.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:18.872+0000 7fa83f48f700 1 -- 172.21.15.37:0/702149811 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa83810de10 con 0x7fa838102f60 2024-04-25T17:30:18.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:18.872+0000 7fa82dffb700 1 -- 172.21.15.37:0/702149811 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8280115e0 con 0x7fa838102f60 2024-04-25T17:30:18.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:18.873+0000 7fa83f48f700 1 -- 172.21.15.37:0/702149811 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa83810e350 con 0x7fa838102f60 2024-04-25T17:30:18.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:18.874+0000 7fa83f48f700 1 -- 172.21.15.37:0/702149811 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa838100250 con 0x7fa838102f60 2024-04-25T17:30:18.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:18.874+0000 7fa82dffb700 1 -- 172.21.15.37:0/702149811 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7fa828012400 con 0x7fa838102f60 2024-04-25T17:30:18.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:18.875+0000 7fa82dffb700 1 --2- 172.21.15.37:0/702149811 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fa824076b90 0x7fa824079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:18.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:18.875+0000 7fa82dffb700 1 -- 172.21.15.37:0/702149811 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fa828098490 con 0x7fa838102f60 2024-04-25T17:30:18.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:18.875+0000 7fa83d22b700 1 --2- 172.21.15.37:0/702149811 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fa824076b90 0x7fa824079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:18.880 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:18.875+0000 7fa83d22b700 1 --2- 172.21.15.37:0/702149811 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fa824076b90 0x7fa824079040 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa834004f90 tx=0x7fa834009e30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:18.881 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:18.880+0000 7fa82dffb700 1 -- 172.21.15.37:0/702149811 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fa828060ff0 con 0x7fa838102f60 2024-04-25T17:30:19.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:19.187+0000 7fa83f48f700 1 -- 172.21.15.37:0/702149811 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa83810eff0 con 0x7fa838102f60 2024-04-25T17:30:19.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:19.187+0000 7fa82dffb700 1 -- 172.21.15.37:0/702149811 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7fa8280126b0 con 0x7fa838102f60 2024-04-25T17:30:19.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:19.190+0000 7fa83f48f700 1 -- 172.21.15.37:0/702149811 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fa824076b90 msgr2=0x7fa824079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:19.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:19.190+0000 7fa83f48f700 1 --2- 172.21.15.37:0/702149811 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fa824076b90 0x7fa824079040 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa834004f90 tx=0x7fa834009e30 comp rx=0 tx=0).stop 2024-04-25T17:30:19.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:19.190+0000 7fa83f48f700 1 -- 172.21.15.37:0/702149811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa838102f60 msgr2=0x7fa838113ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:19.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:19.190+0000 7fa83f48f700 1 --2- 172.21.15.37:0/702149811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa838102f60 0x7fa838113ee0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa82800c8c0 tx=0x7fa8280044c0 comp rx=0 tx=0).stop 2024-04-25T17:30:19.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:19.190+0000 7fa83f48f700 1 -- 172.21.15.37:0/702149811 shutdown_connections 2024-04-25T17:30:19.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:19.190+0000 7fa83f48f700 1 --2- 172.21.15.37:0/702149811 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fa824076b90 0x7fa824079040 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:19.192 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:19.190+0000 7fa83f48f700 1 --2- 172.21.15.37:0/702149811 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa8380fb520 0x7fa8381139a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:19.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:19.190+0000 7fa83f48f700 1 --2- 172.21.15.37:0/702149811 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa838102f60 0x7fa838113ee0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:19.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:19.190+0000 7fa83f48f700 1 -- 172.21.15.37:0/702149811 >> 172.21.15.37:0/702149811 conn(0x7fa8380714d0 msgr2=0x7fa8380fa7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:19.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:19.190+0000 7fa83f48f700 1 -- 172.21.15.37:0/702149811 shutdown_connections 2024-04-25T17:30:19.193 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:19.190+0000 7fa83f48f700 1 -- 172.21.15.37:0/702149811 wait complete. 2024-04-25T17:30:19.201 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph version 19.0.0-3291-g994e2f20 (994e2f20102a20fa9a27966c14b625cc01884df8) squid (dev)" 2024-04-25T17:30:19.854 DEBUG:teuthology.parallel:result is None 2024-04-25T17:30:19.855 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-04-25T17:30:19.867 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi037.front.sepia.ceph.com 2024-04-25T17:30:19.867 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 -- bash -c 'ceph fs dump' 2024-04-25T17:30:20.145 INFO:teuthology.orchestra.run.smithi037.stderr:Inferring config /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/mon.smithi037/config 2024-04-25T17:30:20.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:19 smithi069 ceph-mon[80239]: pgmap v311: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:30:20.170 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:19 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/702149811' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:30:20.257 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:19 smithi037 ceph-mon[90844]: pgmap v311: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:30:20.257 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:19 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/702149811' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-04-25T17:30:21.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:21.751+0000 7fc8cab13700 1 -- 172.21.15.37:0/1742378456 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8c4101d90 msgr2=0x7fc8c4102160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:21.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:21.751+0000 7fc8cab13700 1 --2- 172.21.15.37:0/1742378456 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8c4101d90 0x7fc8c4102160 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc009ce0 tx=0x7fc8bc004d10 comp rx=0 tx=0).stop 2024-04-25T17:30:21.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:21.751+0000 7fc8cab13700 1 -- 172.21.15.37:0/1742378456 shutdown_connections 2024-04-25T17:30:21.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:21.751+0000 7fc8cab13700 1 --2- 172.21.15.37:0/1742378456 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8c40fbd40 0x7fc8c40fc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:21.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:21.751+0000 7fc8cab13700 1 --2- 172.21.15.37:0/1742378456 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8c4101d90 0x7fc8c4102160 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:21.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:21.751+0000 7fc8cab13700 1 -- 172.21.15.37:0/1742378456 >> 172.21.15.37:0/1742378456 conn(0x7fc8c4071d00 msgr2=0x7fc8c4072100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:21.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:21.751+0000 7fc8cab13700 1 -- 172.21.15.37:0/1742378456 shutdown_connections 2024-04-25T17:30:21.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:21.751+0000 7fc8cab13700 1 -- 172.21.15.37:0/1742378456 wait complete. 2024-04-25T17:30:21.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:21.752+0000 7fc8cab13700 1 Processor -- start 2024-04-25T17:30:21.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:21.752+0000 7fc8cab13700 1 -- start start 2024-04-25T17:30:21.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:21.752+0000 7fc8cab13700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8c40fbd40 0x7fc8c4113cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:21.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:21.752+0000 7fc8cab13700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8c4101d90 0x7fc8c41141f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:21.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:21.752+0000 7fc8cab13700 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c4114840 con 0x7fc8c4101d90 2024-04-25T17:30:21.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:21.752+0000 7fc8cab13700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c410dca0 con 0x7fc8c40fbd40 2024-04-25T17:30:21.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:21.752+0000 7fc8c3fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8c4101d90 0x7fc8c41141f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:21.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:21.752+0000 7fc8c3fff700 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8c4101d90 0x7fc8c41141f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34430/0 (socket says 172.21.15.37:34430) 2024-04-25T17:30:21.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:21.752+0000 7fc8c3fff700 1 -- 172.21.15.37:0/1437012810 learned_addr learned my addr 172.21.15.37:0/1437012810 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:30:21.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:21.752+0000 7fc8c88af700 1 --2- 172.21.15.37:0/1437012810 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8c40fbd40 0x7fc8c4113cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:21.755 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:21.753+0000 7fc8c3fff700 1 -- 172.21.15.37:0/1437012810 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8c40fbd40 msgr2=0x7fc8c4113cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:21.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:21.753+0000 7fc8c3fff700 1 --2- 172.21.15.37:0/1437012810 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8c40fbd40 0x7fc8c4113cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:21.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:21.753+0000 7fc8c3fff700 1 -- 172.21.15.37:0/1437012810 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8bc009940 con 0x7fc8c4101d90 2024-04-25T17:30:21.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:21.753+0000 7fc8c3fff700 1 --2- 172.21.15.37:0/1437012810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8c4101d90 0x7fc8c41141f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4002a50 tx=0x7fc8b40046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:21.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:21.753+0000 7fc8c17fa700 1 -- 172.21.15.37:0/1437012810 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8b4007cc0 con 0x7fc8c4101d90 2024-04-25T17:30:21.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:21.753+0000 7fc8c17fa700 1 -- 172.21.15.37:0/1437012810 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc8b400f040 con 0x7fc8c4101d90 2024-04-25T17:30:21.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:21.753+0000 7fc8c17fa700 1 -- 172.21.15.37:0/1437012810 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8b400da70 con 0x7fc8c4101d90 2024-04-25T17:30:21.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:21.753+0000 7fc8cab13700 1 -- 172.21.15.37:0/1437012810 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8c410df80 con 0x7fc8c4101d90 2024-04-25T17:30:21.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:21.753+0000 7fc8cab13700 1 -- 172.21.15.37:0/1437012810 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8c410e4f0 con 0x7fc8c4101d90 2024-04-25T17:30:21.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:21.754+0000 7fc8cab13700 1 -- 172.21.15.37:0/1437012810 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8c40fd430 con 0x7fc8c4101d90 2024-04-25T17:30:21.756 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:21.755+0000 7fc8c17fa700 1 -- 172.21.15.37:0/1437012810 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7fc8b400dc10 con 0x7fc8c4101d90 2024-04-25T17:30:21.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:21.755+0000 7fc8c17fa700 1 --2- 172.21.15.37:0/1437012810 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fc8b0076b90 0x7fc8b0079040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:21.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:21.755+0000 7fc8c17fa700 1 -- 172.21.15.37:0/1437012810 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fc8b4097a40 con 0x7fc8c4101d90 2024-04-25T17:30:21.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:21.755+0000 7fc8c88af700 1 --2- 172.21.15.37:0/1437012810 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fc8b0076b90 0x7fc8b0079040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:21.757 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:21.756+0000 7fc8c88af700 1 --2- 172.21.15.37:0/1437012810 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fc8b0076b90 0x7fc8b0079040 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc00b740 tx=0x7fc8bc004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:21.761 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:21.760+0000 7fc8c17fa700 1 -- 172.21.15.37:0/1437012810 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fc8b4060520 con 0x7fc8c4101d90 2024-04-25T17:30:22.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:22.017+0000 7fc8cab13700 1 -- 172.21.15.37:0/1437012810 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc8c410f370 con 0x7fc8c4101d90 2024-04-25T17:30:22.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:22.018+0000 7fc8c17fa700 1 -- 172.21.15.37:0/1437012810 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 35 v35) v1 ==== 76+0+1963 (secure 0 0 0) 0x7fc8b405fec0 con 0x7fc8c4101d90 2024-04-25T17:30:22.019 INFO:teuthology.orchestra.run.smithi037.stdout:e35 2024-04-25T17:30:22.019 INFO:teuthology.orchestra.run.smithi037.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-04-25T17:30:22.019 INFO:teuthology.orchestra.run.smithi037.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-04-25T17:30:22.019 INFO:teuthology.orchestra.run.smithi037.stdout:legacy client fscid: 1 2024-04-25T17:30:22.019 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:30:22.019 INFO:teuthology.orchestra.run.smithi037.stdout:Filesystem 'cephfs' (1) 2024-04-25T17:30:22.019 INFO:teuthology.orchestra.run.smithi037.stdout:fs_name cephfs 2024-04-25T17:30:22.019 INFO:teuthology.orchestra.run.smithi037.stdout:epoch 35 2024-04-25T17:30:22.019 INFO:teuthology.orchestra.run.smithi037.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-04-25T17:30:22.020 INFO:teuthology.orchestra.run.smithi037.stdout:created 2024-04-25T17:15:40.586130+0000 2024-04-25T17:30:22.020 INFO:teuthology.orchestra.run.smithi037.stdout:modified 2024-04-25T17:27:00.988207+0000 2024-04-25T17:30:22.020 INFO:teuthology.orchestra.run.smithi037.stdout:tableserver 0 2024-04-25T17:30:22.020 INFO:teuthology.orchestra.run.smithi037.stdout:root 0 2024-04-25T17:30:22.020 INFO:teuthology.orchestra.run.smithi037.stdout:session_timeout 60 2024-04-25T17:30:22.020 INFO:teuthology.orchestra.run.smithi037.stdout:session_autoclose 300 2024-04-25T17:30:22.020 INFO:teuthology.orchestra.run.smithi037.stdout:max_file_size 1099511627776 2024-04-25T17:30:22.020 INFO:teuthology.orchestra.run.smithi037.stdout:max_xattr_size 65536 2024-04-25T17:30:22.020 INFO:teuthology.orchestra.run.smithi037.stdout:required_client_features {} 2024-04-25T17:30:22.020 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure 0 2024-04-25T17:30:22.020 INFO:teuthology.orchestra.run.smithi037.stdout:last_failure_osd_epoch 84 2024-04-25T17:30:22.020 INFO:teuthology.orchestra.run.smithi037.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-04-25T17:30:22.020 INFO:teuthology.orchestra.run.smithi037.stdout:max_mds 1 2024-04-25T17:30:22.020 INFO:teuthology.orchestra.run.smithi037.stdout:in 0 2024-04-25T17:30:22.020 INFO:teuthology.orchestra.run.smithi037.stdout:up {0=34412} 2024-04-25T17:30:22.021 INFO:teuthology.orchestra.run.smithi037.stdout:failed 2024-04-25T17:30:22.021 INFO:teuthology.orchestra.run.smithi037.stdout:damaged 2024-04-25T17:30:22.021 INFO:teuthology.orchestra.run.smithi037.stdout:stopped 2024-04-25T17:30:22.021 INFO:teuthology.orchestra.run.smithi037.stdout:data_pools [3] 2024-04-25T17:30:22.021 INFO:teuthology.orchestra.run.smithi037.stdout:metadata_pool 2 2024-04-25T17:30:22.021 INFO:teuthology.orchestra.run.smithi037.stdout:inline_data disabled 2024-04-25T17:30:22.021 INFO:teuthology.orchestra.run.smithi037.stdout:balancer 2024-04-25T17:30:22.021 INFO:teuthology.orchestra.run.smithi037.stdout:bal_rank_mask -1 2024-04-25T17:30:22.021 INFO:teuthology.orchestra.run.smithi037.stdout:standby_count_wanted 1 2024-04-25T17:30:22.021 INFO:teuthology.orchestra.run.smithi037.stdout:qdb_cluster leader: 34412 members: 34412 2024-04-25T17:30:22.021 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi037.ksmixc{0:34412} state up:active seq 18 join_fscid=1 addr [v2:172.21.15.37:6826/2514248612,v1:172.21.15.37:6827/2514248612] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T17:30:22.021 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi037.ovkrpq{0:34444} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.37:6828/2067664560,v1:172.21.15.37:6829/2067664560] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T17:30:22.021 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:30:22.021 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:30:22.022 INFO:teuthology.orchestra.run.smithi037.stdout:Standby daemons: 2024-04-25T17:30:22.022 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:30:22.022 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi069.ytlqcf{-1:44347} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.69:6824/3424891497,v1:172.21.15.69:6825/3424891497] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T17:30:22.022 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.cephfs.smithi069.cpprst{-1:44379} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.69:6826/3383509929,v1:172.21.15.69:6827/3383509929] compat {c=[1],r=[1],i=[1fff]}] 2024-04-25T17:30:22.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:22.021+0000 7fc8cab13700 1 -- 172.21.15.37:0/1437012810 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fc8b0076b90 msgr2=0x7fc8b0079040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:22.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:22.021+0000 7fc8cab13700 1 --2- 172.21.15.37:0/1437012810 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fc8b0076b90 0x7fc8b0079040 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc00b740 tx=0x7fc8bc004d10 comp rx=0 tx=0).stop 2024-04-25T17:30:22.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:22.021+0000 7fc8cab13700 1 -- 172.21.15.37:0/1437012810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8c4101d90 msgr2=0x7fc8c41141f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:22.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:22.021+0000 7fc8cab13700 1 --2- 172.21.15.37:0/1437012810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8c4101d90 0x7fc8c41141f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4002a50 tx=0x7fc8b40046b0 comp rx=0 tx=0).stop 2024-04-25T17:30:22.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:22.021+0000 7fc8cab13700 1 -- 172.21.15.37:0/1437012810 shutdown_connections 2024-04-25T17:30:22.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:22.021+0000 7fc8cab13700 1 --2- 172.21.15.37:0/1437012810 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fc8b0076b90 0x7fc8b0079040 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:22.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:22.021+0000 7fc8cab13700 1 --2- 172.21.15.37:0/1437012810 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8c40fbd40 0x7fc8c4113cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:22.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:22.021+0000 7fc8cab13700 1 --2- 172.21.15.37:0/1437012810 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8c4101d90 0x7fc8c41141f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:22.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:22.021+0000 7fc8cab13700 1 -- 172.21.15.37:0/1437012810 >> 172.21.15.37:0/1437012810 conn(0x7fc8c4071d00 msgr2=0x7fc8c40fa100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:22.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:22.021+0000 7fc8cab13700 1 -- 172.21.15.37:0/1437012810 shutdown_connections 2024-04-25T17:30:22.023 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:22.021+0000 7fc8cab13700 1 -- 172.21.15.37:0/1437012810 wait complete. 2024-04-25T17:30:22.023 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 35 2024-04-25T17:30:22.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:21 smithi069 ceph-mon[80239]: pgmap v312: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:30:22.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:21 smithi037 ceph-mon[90844]: pgmap v312: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:30:22.668 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-04-25T17:30:22.680 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T17:30:22.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:22.786+0000 7f9cc0e6e640 1 -- 172.21.15.37:0/4074152192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cbc102220 msgr2=0x7f9cbc1025f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:22.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:22.786+0000 7f9cc0e6e640 1 --2- 172.21.15.37:0/4074152192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cbc102220 0x7f9cbc1025f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9cac0048d0 tx=0x7f9cac009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:22.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:22.786+0000 7f9cc0e6e640 1 -- 172.21.15.37:0/4074152192 shutdown_connections 2024-04-25T17:30:22.788 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:22.786+0000 7f9cc0e6e640 1 --2- 172.21.15.37:0/4074152192 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9cbc0fa7f0 0x7f9cbc0fac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:22.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:22.786+0000 7f9cc0e6e640 1 --2- 172.21.15.37:0/4074152192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cbc102220 0x7f9cbc1025f0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:22.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:22.786+0000 7f9cc0e6e640 1 -- 172.21.15.37:0/4074152192 >> 172.21.15.37:0/4074152192 conn(0x7f9cbc071770 msgr2=0x7f9cbc071b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:22.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:22.786+0000 7f9cc0e6e640 1 -- 172.21.15.37:0/4074152192 shutdown_connections 2024-04-25T17:30:22.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:22.786+0000 7f9cc0e6e640 1 -- 172.21.15.37:0/4074152192 wait complete. 2024-04-25T17:30:22.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:22.786+0000 7f9cc0e6e640 1 Processor -- start 2024-04-25T17:30:22.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:22.786+0000 7f9cc0e6e640 1 -- start start 2024-04-25T17:30:22.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:22.787+0000 7f9cc0e6e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cbc0fa7f0 0x7f9cbc0fb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:22.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:22.787+0000 7f9cc0e6e640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9cbc102220 0x7f9cbc0fbf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:22.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:22.787+0000 7f9cc0e6e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cbc0fd8b0 con 0x7f9cbc0fa7f0 2024-04-25T17:30:22.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:22.787+0000 7f9cc0e6e640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cbc0fc450 con 0x7f9cbc102220 2024-04-25T17:30:22.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:22.787+0000 7f9cba59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cbc0fa7f0 0x7f9cbc0fb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:22.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:22.787+0000 7f9cba59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cbc0fa7f0 0x7f9cbc0fb9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34446/0 (socket says 172.21.15.37:34446) 2024-04-25T17:30:22.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:22.787+0000 7f9cba59c640 1 -- 172.21.15.37:0/850623286 learned_addr learned my addr 172.21.15.37:0/850623286 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:30:22.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:22.787+0000 7f9cb9d9b640 1 --2- 172.21.15.37:0/850623286 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9cbc102220 0x7f9cbc0fbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:22.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:22.787+0000 7f9cba59c640 1 -- 172.21.15.37:0/850623286 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9cbc102220 msgr2=0x7f9cbc0fbf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:22.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:22.787+0000 7f9cba59c640 1 --2- 172.21.15.37:0/850623286 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9cbc102220 0x7f9cbc0fbf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:22.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:22.787+0000 7f9cba59c640 1 -- 172.21.15.37:0/850623286 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cac005040 con 0x7f9cbc0fa7f0 2024-04-25T17:30:22.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:22.787+0000 7f9cba59c640 1 --2- 172.21.15.37:0/850623286 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cbc0fa7f0 0x7f9cbc0fb9d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f9cac0047f0 tx=0x7f9cac009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:22.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:22.787+0000 7f9caaffd640 1 -- 172.21.15.37:0/850623286 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9cac0094c0 con 0x7f9cbc0fa7f0 2024-04-25T17:30:22.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:22.787+0000 7f9cc0e6e640 1 -- 172.21.15.37:0/850623286 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cbc0fc6d0 con 0x7f9cbc0fa7f0 2024-04-25T17:30:22.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:22.787+0000 7f9caaffd640 1 -- 172.21.15.37:0/850623286 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9cac032e50 con 0x7f9cbc0fa7f0 2024-04-25T17:30:22.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:22.787+0000 7f9caaffd640 1 -- 172.21.15.37:0/850623286 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9cac0435f0 con 0x7f9cbc0fa7f0 2024-04-25T17:30:22.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:22.787+0000 7f9cc0e6e640 1 -- 172.21.15.37:0/850623286 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cbc1193e0 con 0x7f9cbc0fa7f0 2024-04-25T17:30:22.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:22.788+0000 7f9cc0e6e640 1 -- 172.21.15.37:0/850623286 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cbc04bcc0 con 0x7f9cbc0fa7f0 2024-04-25T17:30:22.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:22.789+0000 7f9caaffd640 1 -- 172.21.15.37:0/850623286 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f9cac02f070 con 0x7f9cbc0fa7f0 2024-04-25T17:30:22.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:22.789+0000 7f9caaffd640 1 --2- 172.21.15.37:0/850623286 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f9ca4076af0 0x7f9ca4078fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:22.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:22.790+0000 7f9cb9d9b640 1 --2- 172.21.15.37:0/850623286 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f9ca4076af0 0x7f9ca4078fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:22.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:22.790+0000 7f9caaffd640 1 -- 172.21.15.37:0/850623286 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f9cac0ba320 con 0x7f9cbc0fa7f0 2024-04-25T17:30:22.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:22.790+0000 7f9cb9d9b640 1 --2- 172.21.15.37:0/850623286 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f9ca4076af0 0x7f9ca4078fa0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc0fd100 tx=0x7f9cb0009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:22.795 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:22.795+0000 7f9caaffd640 1 -- 172.21.15.37:0/850623286 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f9cac082d80 con 0x7f9cbc0fa7f0 2024-04-25T17:30:22.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:22.982+0000 7f9cc0e6e640 1 -- 172.21.15.37:0/850623286 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9cbc0fcf50 con 0x7f9cbc0fa7f0 2024-04-25T17:30:22.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:22.983+0000 7f9caaffd640 1 -- 172.21.15.37:0/850623286 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+16604 (secure 0 0 0) 0x7f9cac082720 con 0x7f9cbc0fa7f0 2024-04-25T17:30:22.984 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:30:22.984 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":84,"fsid":"599bb7fc-0326-11ef-bc93-c7b262605968","created":"2024-04-25T17:08:37.882631+0000","modified":"2024-04-25T17:26:43.463070+0000","last_up_change":"2024-04-25T17:25:37.943415+0000","last_in_change":"2024-04-25T17:14:01.927070+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T17:13:09.960202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-04-25T17:15:39.512161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-04-25T17:15:40.014896+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c142de25-7aff-4c4b-b351-14e7b18de11d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":49,"up_from":53,"up_thru":78,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2283035048},{"type":"v1","addr":"172.21.15.37:6803","nonce":2283035048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2283035048},{"type":"v1","addr":"172.21.15.37:6805","nonce":2283035048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2283035048},{"type":"v1","addr":"172.21.15.37:6809","nonce":2283035048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2283035048},{"type":"v1","addr":"172.21.15.37:6807","nonce":2283035048}]},"public_addr":"172.21.15.37:6803/2283035048","cluster_addr":"172.21.15.37:6805/2283035048","heartbeat_back_addr":"172.21.15.37:6809/2283035048","heartbeat_front_addr":"172.21.15.37:6807/2283035048","state":["exists","up"]},{"osd":1,"uuid":"ec683da0-f3c1-44b5-8f1d-69bec27fbe5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":54,"up_from":58,"up_thru":78,"down_at":55,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":914750118},{"type":"v1","addr":"172.21.15.37:6811","nonce":914750118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":914750118},{"type":"v1","addr":"172.21.15.37:6813","nonce":914750118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":914750118},{"type":"v1","addr":"172.21.15.37:6817","nonce":914750118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":914750118},{"type":"v1","addr":"172.21.15.37:6815","nonce":914750118}]},"public_addr":"172.21.15.37:6811/914750118","cluster_addr":"172.21.15.37:6813/914750118","heartbeat_back_addr":"172.21.15.37:6817/914750118","heartbeat_front_addr":"172.21.15.37:6815/914750118","state":["exists","up"]},{"osd":2,"uuid":"8bf4e67b-e95f-44d3-b51f-afd8a2d30e31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":59,"up_from":63,"up_thru":78,"down_at":60,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1533738118},{"type":"v1","addr":"172.21.15.37:6819","nonce":1533738118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1533738118},{"type":"v1","addr":"172.21.15.37:6821","nonce":1533738118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1533738118},{"type":"v1","addr":"172.21.15.37:6825","nonce":1533738118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1533738118},{"type":"v1","addr":"172.21.15.37:6823","nonce":1533738118}]},"public_addr":"172.21.15.37:6819/1533738118","cluster_addr":"172.21.15.37:6821/1533738118","heartbeat_back_addr":"172.21.15.37:6825/1533738118","heartbeat_front_addr":"172.21.15.37:6823/1533738118","state":["exists","up"]},{"osd":3,"uuid":"ce5ff1f7-472a-4515-b851-e434ee545b27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":27,"last_clean_end":64,"up_from":68,"up_thru":78,"down_at":65,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":1489573886},{"type":"v1","addr":"172.21.15.69:6801","nonce":1489573886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":1489573886},{"type":"v1","addr":"172.21.15.69:6803","nonce":1489573886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":1489573886},{"type":"v1","addr":"172.21.15.69:6807","nonce":1489573886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":1489573886},{"type":"v1","addr":"172.21.15.69:6805","nonce":1489573886}]},"public_addr":"172.21.15.69:6801/1489573886","cluster_addr":"172.21.15.69:6803/1489573886","heartbeat_back_addr":"172.21.15.69:6807/1489573886","heartbeat_front_addr":"172.21.15.69:6805/1489573886","state":["exists","up"]},{"osd":4,"uuid":"26cf2aeb-fc85-4d14-b936-08b8280489e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":35,"last_clean_end":69,"up_from":73,"up_thru":78,"down_at":70,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":2690453136},{"type":"v1","addr":"172.21.15.69:6809","nonce":2690453136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":2690453136},{"type":"v1","addr":"172.21.15.69:6811","nonce":2690453136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":2690453136},{"type":"v1","addr":"172.21.15.69:6815","nonce":2690453136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":2690453136},{"type":"v1","addr":"172.21.15.69:6813","nonce":2690453136}]},"public_addr":"172.21.15.69:6809/2690453136","cluster_addr":"172.21.15.69:6811/2690453136","heartbeat_back_addr":"172.21.15.69:6815/2690453136","heartbeat_front_addr":"172.21.15.69:6813/2690453136","state":["exists","up"]},{"osd":5,"uuid":"fb3edb82-8f78-40d6-a339-5c469ef08371","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":40,"last_clean_end":74,"up_from":78,"up_thru":78,"down_at":75,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":1114217891},{"type":"v1","addr":"172.21.15.69:6817","nonce":1114217891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":1114217891},{"type":"v1","addr":"172.21.15.69:6819","nonce":1114217891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":1114217891},{"type":"v1","addr":"172.21.15.69:6823","nonce":1114217891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":1114217891},{"type":"v1","addr":"172.21.15.69:6821","nonce":1114217891}]},"public_addr":"172.21.15.69:6817/1114217891","cluster_addr":"172.21.15.69:6819/1114217891","heartbeat_back_addr":"172.21.15.69:6823/1114217891","heartbeat_front_addr":"172.21.15.69:6821/1114217891","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T17:12:12.145795+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T17:12:39.059274+0000","dead_epoch":54},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T17:13:06.628770+0000","dead_epoch":59},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T17:13:29.779894+0000","dead_epoch":64},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T17:13:54.338391+0000","dead_epoch":69},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T17:14:18.637188+0000","dead_epoch":74}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:6826/518856100":"2024-04-26T17:26:43.463024+0000","172.21.15.37:0/2586714806":"2024-04-26T17:09:09.103933+0000","172.21.15.37:0/94916634":"2024-04-26T17:21:12.458619+0000","172.21.15.69:0/1328964531":"2024-04-26T17:19:49.912987+0000","172.21.15.37:0/2176923815":"2024-04-26T17:18:04.184013+0000","172.21.15.37:6801/3566135606":"2024-04-26T17:18:04.184013+0000","172.21.15.37:6800/3653320894":"2024-04-26T17:09:39.480662+0000","172.21.15.37:6827/1903989494":"2024-04-26T17:25:43.985393+0000","172.21.15.69:0/4008065866":"2024-04-26T17:19:49.912987+0000","172.21.15.37:6800/3566135606":"2024-04-26T17:18:04.184013+0000","172.21.15.37:6800/2509847167":"2024-04-26T17:09:09.103933+0000","172.21.15.69:0/1519610648":"2024-04-26T17:19:49.912987+0000","172.21.15.69:0/1505731340":"2024-04-26T17:19:49.912987+0000","172.21.15.37:0/1749794583":"2024-04-26T17:10:55.431694+0000","172.21.15.37:0/3729273779":"2024-04-26T17:21:12.458619+0000","172.21.15.37:0/3089604872":"2024-04-26T17:09:39.480662+0000","172.21.15.69:6827/518856100":"2024-04-26T17:26:43.463024+0000","172.21.15.37:0/3148505482":"2024-04-26T17:21:12.458619+0000","172.21.15.37:0/1135030866":"2024-04-26T17:09:39.480662+0000","172.21.15.37:0/767276846":"2024-04-26T17:18:04.184013+0000","172.21.15.37:6801/2509847167":"2024-04-26T17:09:09.103933+0000","172.21.15.37:0/1487666224":"2024-04-26T17:09:09.103933+0000","172.21.15.37:6800/1299348474":"2024-04-26T17:10:55.431694+0000","172.21.15.37:0/3689680514":"2024-04-26T17:09:39.480662+0000","172.21.15.37:0/3277643196":"2024-04-26T17:09:09.103933+0000","172.21.15.37:6801/3653320894":"2024-04-26T17:09:39.480662+0000","172.21.15.37:0/2627363304":"2024-04-26T17:18:04.184013+0000","172.21.15.69:6828/2602478":"2024-04-26T17:19:49.912987+0000","172.21.15.69:6829/2602478":"2024-04-26T17:19:49.912987+0000","172.21.15.37:0/4258551295":"2024-04-26T17:10:55.431694+0000","172.21.15.37:6800/709373822":"2024-04-26T17:21:12.458619+0000","172.21.15.37:6826/1903989494":"2024-04-26T17:25:43.985393+0000","172.21.15.37:0/350553669":"2024-04-26T17:10:55.431694+0000","172.21.15.37:0/4179549689":"2024-04-26T17:18:04.184013+0000","172.21.15.37:6801/1299348474":"2024-04-26T17:10:55.431694+0000","172.21.15.37:0/2626647662":"2024-04-26T17:21:12.458619+0000","172.21.15.37:6801/709373822":"2024-04-26T17:21:12.458619+0000","172.21.15.37:0/2702902167":"2024-04-26T17:21:12.458619+0000","172.21.15.37:0/3806998167":"2024-04-26T17:21:12.458619+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T17:30:22.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:22.985+0000 7f9cc0e6e640 1 -- 172.21.15.37:0/850623286 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f9ca4076af0 msgr2=0x7f9ca4078fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:22.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:22.985+0000 7f9cc0e6e640 1 --2- 172.21.15.37:0/850623286 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f9ca4076af0 0x7f9ca4078fa0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc0fd100 tx=0x7f9cb0009040 comp rx=0 tx=0).stop 2024-04-25T17:30:22.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:22.985+0000 7f9cc0e6e640 1 -- 172.21.15.37:0/850623286 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cbc0fa7f0 msgr2=0x7f9cbc0fb9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:22.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:22.985+0000 7f9cc0e6e640 1 --2- 172.21.15.37:0/850623286 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cbc0fa7f0 0x7f9cbc0fb9d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f9cac0047f0 tx=0x7f9cac009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:22.986 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:22.985+0000 7f9cc0e6e640 1 -- 172.21.15.37:0/850623286 shutdown_connections 2024-04-25T17:30:22.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:22.985+0000 7f9cc0e6e640 1 --2- 172.21.15.37:0/850623286 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f9ca4076af0 0x7f9ca4078fa0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:22.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:22.985+0000 7f9cc0e6e640 1 --2- 172.21.15.37:0/850623286 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9cbc102220 0x7f9cbc0fbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:22.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:22.985+0000 7f9cc0e6e640 1 --2- 172.21.15.37:0/850623286 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cbc0fa7f0 0x7f9cbc0fb9d0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:22.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:22.985+0000 7f9cc0e6e640 1 -- 172.21.15.37:0/850623286 >> 172.21.15.37:0/850623286 conn(0x7f9cbc071770 msgr2=0x7f9cbc0f9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:22.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:22.985+0000 7f9cc0e6e640 1 -- 172.21.15.37:0/850623286 shutdown_connections 2024-04-25T17:30:22.987 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:22.985+0000 7f9cc0e6e640 1 -- 172.21.15.37:0/850623286 wait complete. 2024-04-25T17:30:22.997 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T17:13:09.960202+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-04-25T17:15:39.512161+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-04-25T17:15:40.014896+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T17:30:22.997 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T17:30:23.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.098+0000 7f2567b1d640 1 -- 172.21.15.37:0/2960647741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2560101110 msgr2=0x7f25601014e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:23.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.098+0000 7f2567b1d640 1 --2- 172.21.15.37:0/2960647741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2560101110 0x7f25601014e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f25540048d0 tx=0x7f2554009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:23.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.098+0000 7f2567b1d640 1 -- 172.21.15.37:0/2960647741 shutdown_connections 2024-04-25T17:30:23.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.098+0000 7f2567b1d640 1 --2- 172.21.15.37:0/2960647741 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25600fb0e0 0x7f25600fb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:23.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.098+0000 7f2567b1d640 1 --2- 172.21.15.37:0/2960647741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2560101110 0x7f25601014e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:23.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.098+0000 7f2567b1d640 1 -- 172.21.15.37:0/2960647741 >> 172.21.15.37:0/2960647741 conn(0x7f25600710c0 msgr2=0x7f25600714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:23.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.098+0000 7f2567b1d640 1 -- 172.21.15.37:0/2960647741 shutdown_connections 2024-04-25T17:30:23.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.098+0000 7f2567b1d640 1 -- 172.21.15.37:0/2960647741 wait complete. 2024-04-25T17:30:23.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.098+0000 7f2567b1d640 1 Processor -- start 2024-04-25T17:30:23.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.098+0000 7f2567b1d640 1 -- start start 2024-04-25T17:30:23.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.099+0000 7f2567b1d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25600fb0e0 0x7f256010de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:23.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.099+0000 7f2567b1d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2560101110 0x7f256010e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:23.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.099+0000 7f2567b1d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25600652f0 con 0x7f25600fb0e0 2024-04-25T17:30:23.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.099+0000 7f2567b1d640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f256010e8b0 con 0x7f2560101110 2024-04-25T17:30:23.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.099+0000 7f25658b9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25600fb0e0 0x7f256010de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:23.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.099+0000 7f25658b9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25600fb0e0 0x7f256010de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34470/0 (socket says 172.21.15.37:34470) 2024-04-25T17:30:23.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.099+0000 7f25658b9640 1 -- 172.21.15.37:0/332037768 learned_addr learned my addr 172.21.15.37:0/332037768 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:30:23.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.099+0000 7f25650b8640 1 --2- 172.21.15.37:0/332037768 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2560101110 0x7f256010e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:23.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.099+0000 7f25658b9640 1 -- 172.21.15.37:0/332037768 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2560101110 msgr2=0x7f256010e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:23.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.099+0000 7f25658b9640 1 --2- 172.21.15.37:0/332037768 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2560101110 0x7f256010e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:23.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.099+0000 7f25658b9640 1 -- 172.21.15.37:0/332037768 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2554005040 con 0x7f25600fb0e0 2024-04-25T17:30:23.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.099+0000 7f25650b8640 1 --2- 172.21.15.37:0/332037768 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2560101110 0x7f256010e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T17:30:23.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.099+0000 7f25658b9640 1 --2- 172.21.15.37:0/332037768 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25600fb0e0 0x7f256010de30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f25540041d0 tx=0x7f2554009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:23.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.099+0000 7f25527fc640 1 -- 172.21.15.37:0/332037768 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2554030870 con 0x7f25600fb0e0 2024-04-25T17:30:23.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.100+0000 7f25527fc640 1 -- 172.21.15.37:0/332037768 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f25540092e0 con 0x7f25600fb0e0 2024-04-25T17:30:23.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.100+0000 7f2567b1d640 1 -- 172.21.15.37:0/332037768 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f256010eb30 con 0x7f25600fb0e0 2024-04-25T17:30:23.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.100+0000 7f25527fc640 1 -- 172.21.15.37:0/332037768 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2554043400 con 0x7f25600fb0e0 2024-04-25T17:30:23.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.100+0000 7f2567b1d640 1 -- 172.21.15.37:0/332037768 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25601170f0 con 0x7f25600fb0e0 2024-04-25T17:30:23.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.100+0000 7f2567b1d640 1 -- 172.21.15.37:0/332037768 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25600fc7d0 con 0x7f25600fb0e0 2024-04-25T17:30:23.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.101+0000 7f25527fc640 1 -- 172.21.15.37:0/332037768 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f255403b420 con 0x7f25600fb0e0 2024-04-25T17:30:23.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.102+0000 7f25527fc640 1 --2- 172.21.15.37:0/332037768 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f254c076b00 0x7f254c078fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:23.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.102+0000 7f25527fc640 1 -- 172.21.15.37:0/332037768 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f25540bb100 con 0x7f25600fb0e0 2024-04-25T17:30:23.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.102+0000 7f25650b8640 1 --2- 172.21.15.37:0/332037768 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f254c076b00 0x7f254c078fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:23.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.102+0000 7f25650b8640 1 --2- 172.21.15.37:0/332037768 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f254c076b00 0x7f254c078fb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2560064b40 tx=0x7f255c009ed0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:23.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.107+0000 7f25527fc640 1 -- 172.21.15.37:0/332037768 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f2554083c60 con 0x7f25600fb0e0 2024-04-25T17:30:23.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:22 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/1437012810' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T17:30:23.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.316+0000 7f2567b1d640 1 -- 172.21.15.37:0/332037768 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2560108250 con 0x7f25600fb0e0 2024-04-25T17:30:23.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.317+0000 7f25527fc640 1 -- 172.21.15.37:0/332037768 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2560108250 con 0x7f25600fb0e0 2024-04-25T17:30:23.318 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-04-25T17:30:23.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.319+0000 7f2567b1d640 1 -- 172.21.15.37:0/332037768 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f254c076b00 msgr2=0x7f254c078fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:23.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.319+0000 7f2567b1d640 1 --2- 172.21.15.37:0/332037768 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f254c076b00 0x7f254c078fb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2560064b40 tx=0x7f255c009ed0 comp rx=0 tx=0).stop 2024-04-25T17:30:23.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.319+0000 7f2567b1d640 1 -- 172.21.15.37:0/332037768 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25600fb0e0 msgr2=0x7f256010de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:23.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.319+0000 7f2567b1d640 1 --2- 172.21.15.37:0/332037768 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25600fb0e0 0x7f256010de30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f25540041d0 tx=0x7f2554009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:23.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.319+0000 7f2567b1d640 1 -- 172.21.15.37:0/332037768 shutdown_connections 2024-04-25T17:30:23.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.319+0000 7f2567b1d640 1 --2- 172.21.15.37:0/332037768 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f254c076b00 0x7f254c078fb0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:23.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.319+0000 7f2567b1d640 1 --2- 172.21.15.37:0/332037768 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2560101110 0x7f256010e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:23.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.319+0000 7f2567b1d640 1 --2- 172.21.15.37:0/332037768 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f25600fb0e0 0x7f256010de30 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:23.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.319+0000 7f2567b1d640 1 -- 172.21.15.37:0/332037768 >> 172.21.15.37:0/332037768 conn(0x7f25600710c0 msgr2=0x7f25600f9510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:23.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.319+0000 7f2567b1d640 1 -- 172.21.15.37:0/332037768 shutdown_connections 2024-04-25T17:30:23.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.319+0000 7f2567b1d640 1 -- 172.21.15.37:0/332037768 wait complete. 2024-04-25T17:30:23.321 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:22 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/1437012810' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-04-25T17:30:23.331 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-04-25T17:30:23.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.432+0000 7ffbbef5d640 1 -- 172.21.15.37:0/1517488955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbb80fb0e0 msgr2=0x7ffbb80fb530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:23.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.432+0000 7ffbbef5d640 1 --2- 172.21.15.37:0/1517488955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbb80fb0e0 0x7ffbb80fb530 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ffba80048d0 tx=0x7ffba8009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:23.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.432+0000 7ffbbef5d640 1 -- 172.21.15.37:0/1517488955 shutdown_connections 2024-04-25T17:30:23.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.432+0000 7ffbbef5d640 1 --2- 172.21.15.37:0/1517488955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbb80fb0e0 0x7ffbb80fb530 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:23.435 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.432+0000 7ffbbef5d640 1 --2- 172.21.15.37:0/1517488955 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffbb8101110 0x7ffbb81014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:23.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.432+0000 7ffbbef5d640 1 -- 172.21.15.37:0/1517488955 >> 172.21.15.37:0/1517488955 conn(0x7ffbb80710c0 msgr2=0x7ffbb80714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:23.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.432+0000 7ffbbef5d640 1 -- 172.21.15.37:0/1517488955 shutdown_connections 2024-04-25T17:30:23.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.432+0000 7ffbbef5d640 1 -- 172.21.15.37:0/1517488955 wait complete. 2024-04-25T17:30:23.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.433+0000 7ffbbef5d640 1 Processor -- start 2024-04-25T17:30:23.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.433+0000 7ffbbef5d640 1 -- start start 2024-04-25T17:30:23.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.433+0000 7ffbbef5d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffbb80fb0e0 0x7ffbb8111bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:23.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.433+0000 7ffbbef5d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbb8101110 0x7ffbb8112130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:23.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.433+0000 7ffbbef5d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb8112730 con 0x7ffbb8101110 2024-04-25T17:30:23.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.433+0000 7ffbbef5d640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb810bd80 con 0x7ffbb80fb0e0 2024-04-25T17:30:23.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.433+0000 7ffbaffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbb8101110 0x7ffbb8112130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:23.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.433+0000 7ffbaffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbb8101110 0x7ffbb8112130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34498/0 (socket says 172.21.15.37:34498) 2024-04-25T17:30:23.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.433+0000 7ffbaffff640 1 -- 172.21.15.37:0/936516438 learned_addr learned my addr 172.21.15.37:0/936516438 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:30:23.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.434+0000 7ffbbccf9640 1 --2- 172.21.15.37:0/936516438 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffbb80fb0e0 0x7ffbb8111bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:23.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.434+0000 7ffbaffff640 1 -- 172.21.15.37:0/936516438 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffbb80fb0e0 msgr2=0x7ffbb8111bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:23.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.434+0000 7ffbaffff640 1 --2- 172.21.15.37:0/936516438 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffbb80fb0e0 0x7ffbb8111bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:23.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.434+0000 7ffbaffff640 1 -- 172.21.15.37:0/936516438 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba8005040 con 0x7ffbb8101110 2024-04-25T17:30:23.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.434+0000 7ffbaffff640 1 --2- 172.21.15.37:0/936516438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbb8101110 0x7ffbb8112130 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ffba80306c0 tx=0x7ffba8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:23.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.434+0000 7ffbad7fa640 1 -- 172.21.15.37:0/936516438 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffba803e070 con 0x7ffbb8101110 2024-04-25T17:30:23.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.434+0000 7ffbbef5d640 1 -- 172.21.15.37:0/936516438 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbb810c000 con 0x7ffbb8101110 2024-04-25T17:30:23.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.434+0000 7ffbad7fa640 1 -- 172.21.15.37:0/936516438 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffba80094c0 con 0x7ffbb8101110 2024-04-25T17:30:23.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.434+0000 7ffbad7fa640 1 -- 172.21.15.37:0/936516438 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffba8042650 con 0x7ffbb8101110 2024-04-25T17:30:23.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.434+0000 7ffbbef5d640 1 -- 172.21.15.37:0/936516438 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbb810c520 con 0x7ffbb8101110 2024-04-25T17:30:23.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.435+0000 7ffbbef5d640 1 -- 172.21.15.37:0/936516438 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbb80fc7d0 con 0x7ffbb8101110 2024-04-25T17:30:23.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.436+0000 7ffbad7fa640 1 -- 172.21.15.37:0/936516438 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7ffba80384c0 con 0x7ffbb8101110 2024-04-25T17:30:23.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.436+0000 7ffbad7fa640 1 --2- 172.21.15.37:0/936516438 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7ffba0076b00 0x7ffba0078fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:23.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.436+0000 7ffbad7fa640 1 -- 172.21.15.37:0/936516438 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7ffba80bc1e0 con 0x7ffbb8101110 2024-04-25T17:30:23.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.437+0000 7ffbbccf9640 1 --2- 172.21.15.37:0/936516438 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7ffba0076b00 0x7ffba0078fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:23.438 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.437+0000 7ffbbccf9640 1 --2- 172.21.15.37:0/936516438 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7ffba0076b00 0x7ffba0078fb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ffbb4009af0 tx=0x7ffbb400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:23.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.441+0000 7ffbad7fa640 1 -- 172.21.15.37:0/936516438 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7ffba8084df0 con 0x7ffbb8101110 2024-04-25T17:30:23.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.629+0000 7ffbbef5d640 1 -- 172.21.15.37:0/936516438 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7ffbb81081f0 con 0x7ffbb8101110 2024-04-25T17:30:23.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.629+0000 7ffbad7fa640 1 -- 172.21.15.37:0/936516438 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v84) v1 ==== 107+0+11 (secure 0 0 0) 0x7ffba8084790 con 0x7ffbb8101110 2024-04-25T17:30:23.630 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2024-04-25T17:30:23.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.631+0000 7ffbbef5d640 1 -- 172.21.15.37:0/936516438 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7ffba0076b00 msgr2=0x7ffba0078fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:23.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.631+0000 7ffbbef5d640 1 --2- 172.21.15.37:0/936516438 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7ffba0076b00 0x7ffba0078fb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ffbb4009af0 tx=0x7ffbb400b040 comp rx=0 tx=0).stop 2024-04-25T17:30:23.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.631+0000 7ffbbef5d640 1 -- 172.21.15.37:0/936516438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbb8101110 msgr2=0x7ffbb8112130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:23.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.631+0000 7ffbbef5d640 1 --2- 172.21.15.37:0/936516438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbb8101110 0x7ffbb8112130 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ffba80306c0 tx=0x7ffba8009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:23.632 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.631+0000 7ffbbef5d640 1 -- 172.21.15.37:0/936516438 shutdown_connections 2024-04-25T17:30:23.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.631+0000 7ffbbef5d640 1 --2- 172.21.15.37:0/936516438 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7ffba0076b00 0x7ffba0078fb0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:23.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.631+0000 7ffbbef5d640 1 --2- 172.21.15.37:0/936516438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ffbb8101110 0x7ffbb8112130 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:23.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.631+0000 7ffbbef5d640 1 --2- 172.21.15.37:0/936516438 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffbb80fb0e0 0x7ffbb8111bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:23.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.631+0000 7ffbbef5d640 1 -- 172.21.15.37:0/936516438 >> 172.21.15.37:0/936516438 conn(0x7ffbb80710c0 msgr2=0x7ffbb80fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:23.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.631+0000 7ffbbef5d640 1 -- 172.21.15.37:0/936516438 shutdown_connections 2024-04-25T17:30:23.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.631+0000 7ffbbef5d640 1 -- 172.21.15.37:0/936516438 wait complete. 2024-04-25T17:30:23.643 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-04-25T17:30:23.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.748+0000 7fd754b9d640 1 -- 172.21.15.37:0/620222886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7501010b0 msgr2=0x7fd750101480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:23.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.748+0000 7fd754b9d640 1 --2- 172.21.15.37:0/620222886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7501010b0 0x7fd750101480 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd7400048d0 tx=0x7fd740009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:23.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.748+0000 7fd754b9d640 1 -- 172.21.15.37:0/620222886 shutdown_connections 2024-04-25T17:30:23.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.748+0000 7fd754b9d640 1 --2- 172.21.15.37:0/620222886 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd750101a50 0x7fd7500fb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:23.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.748+0000 7fd754b9d640 1 --2- 172.21.15.37:0/620222886 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7501010b0 0x7fd750101480 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:23.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.748+0000 7fd754b9d640 1 -- 172.21.15.37:0/620222886 >> 172.21.15.37:0/620222886 conn(0x7fd7500f6c60 msgr2=0x7fd7500f9070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:23.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.748+0000 7fd754b9d640 1 -- 172.21.15.37:0/620222886 shutdown_connections 2024-04-25T17:30:23.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.748+0000 7fd754b9d640 1 -- 172.21.15.37:0/620222886 wait complete. 2024-04-25T17:30:23.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.749+0000 7fd754b9d640 1 Processor -- start 2024-04-25T17:30:23.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.749+0000 7fd754b9d640 1 -- start start 2024-04-25T17:30:23.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.749+0000 7fd754b9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd7501010b0 0x7fd750113010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:23.751 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.749+0000 7fd754b9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd750101a50 0x7fd750113550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:23.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.749+0000 7fd754b9d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd750113b50 con 0x7fd750101a50 2024-04-25T17:30:23.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.749+0000 7fd754b9d640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd750113cc0 con 0x7fd7501010b0 2024-04-25T17:30:23.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.749+0000 7fd74dd9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd750101a50 0x7fd750113550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:23.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.749+0000 7fd74dd9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd750101a50 0x7fd750113550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34518/0 (socket says 172.21.15.37:34518) 2024-04-25T17:30:23.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.749+0000 7fd74dd9b640 1 -- 172.21.15.37:0/2212528469 learned_addr learned my addr 172.21.15.37:0/2212528469 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:30:23.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.749+0000 7fd74e59c640 1 --2- 172.21.15.37:0/2212528469 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd7501010b0 0x7fd750113010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:23.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.749+0000 7fd74dd9b640 1 -- 172.21.15.37:0/2212528469 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd7501010b0 msgr2=0x7fd750113010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:23.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.749+0000 7fd74dd9b640 1 --2- 172.21.15.37:0/2212528469 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd7501010b0 0x7fd750113010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:23.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.749+0000 7fd74dd9b640 1 -- 172.21.15.37:0/2212528469 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd740005040 con 0x7fd750101a50 2024-04-25T17:30:23.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.750+0000 7fd74e59c640 1 --2- 172.21.15.37:0/2212528469 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd7501010b0 0x7fd750113010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T17:30:23.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.750+0000 7fd74dd9b640 1 --2- 172.21.15.37:0/2212528469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd750101a50 0x7fd750113550 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd73800eb70 tx=0x7fd73800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:23.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.750+0000 7fd746ffd640 1 -- 172.21.15.37:0/2212528469 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd738007c30 con 0x7fd750101a50 2024-04-25T17:30:23.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.750+0000 7fd754b9d640 1 -- 172.21.15.37:0/2212528469 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd75010d2f0 con 0x7fd750101a50 2024-04-25T17:30:23.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.750+0000 7fd746ffd640 1 -- 172.21.15.37:0/2212528469 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd73800f040 con 0x7fd750101a50 2024-04-25T17:30:23.752 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.750+0000 7fd746ffd640 1 -- 172.21.15.37:0/2212528469 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7380095b0 con 0x7fd750101a50 2024-04-25T17:30:23.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.750+0000 7fd754b9d640 1 -- 172.21.15.37:0/2212528469 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd75010d810 con 0x7fd750101a50 2024-04-25T17:30:23.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.751+0000 7fd754b9d640 1 -- 172.21.15.37:0/2212528469 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7500fc820 con 0x7fd750101a50 2024-04-25T17:30:23.753 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.752+0000 7fd746ffd640 1 -- 172.21.15.37:0/2212528469 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7fd738009730 con 0x7fd750101a50 2024-04-25T17:30:23.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.752+0000 7fd746ffd640 1 --2- 172.21.15.37:0/2212528469 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fd73c076b00 0x7fd73c078fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:23.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.752+0000 7fd746ffd640 1 -- 172.21.15.37:0/2212528469 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fd738098100 con 0x7fd750101a50 2024-04-25T17:30:23.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.752+0000 7fd74e59c640 1 --2- 172.21.15.37:0/2212528469 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fd73c076b00 0x7fd73c078fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:23.754 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.753+0000 7fd74e59c640 1 --2- 172.21.15.37:0/2212528469 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fd73c076b00 0x7fd73c078fb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd740003080 tx=0x7fd740009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:23.758 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.758+0000 7fd746ffd640 1 -- 172.21.15.37:0/2212528469 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fd738060c10 con 0x7fd750101a50 2024-04-25T17:30:23.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.949+0000 7fd754b9d640 1 -- 172.21.15.37:0/2212528469 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fd75004bcc0 con 0x7fd750101a50 2024-04-25T17:30:23.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.949+0000 7fd746ffd640 1 -- 172.21.15.37:0/2212528469 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v84) v1 ==== 107+0+11 (secure 0 0 0) 0x7fd7380605b0 con 0x7fd750101a50 2024-04-25T17:30:23.950 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2024-04-25T17:30:23.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.951+0000 7fd754b9d640 1 -- 172.21.15.37:0/2212528469 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fd73c076b00 msgr2=0x7fd73c078fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:23.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.951+0000 7fd754b9d640 1 --2- 172.21.15.37:0/2212528469 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fd73c076b00 0x7fd73c078fb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd740003080 tx=0x7fd740009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:23.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.951+0000 7fd754b9d640 1 -- 172.21.15.37:0/2212528469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd750101a50 msgr2=0x7fd750113550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:23.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.951+0000 7fd754b9d640 1 --2- 172.21.15.37:0/2212528469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd750101a50 0x7fd750113550 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd73800eb70 tx=0x7fd73800b040 comp rx=0 tx=0).stop 2024-04-25T17:30:23.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.951+0000 7fd754b9d640 1 -- 172.21.15.37:0/2212528469 shutdown_connections 2024-04-25T17:30:23.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.951+0000 7fd754b9d640 1 --2- 172.21.15.37:0/2212528469 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fd73c076b00 0x7fd73c078fb0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:23.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.951+0000 7fd754b9d640 1 --2- 172.21.15.37:0/2212528469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd750101a50 0x7fd750113550 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:23.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.951+0000 7fd754b9d640 1 --2- 172.21.15.37:0/2212528469 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd7501010b0 0x7fd750113010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:23.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.951+0000 7fd754b9d640 1 -- 172.21.15.37:0/2212528469 >> 172.21.15.37:0/2212528469 conn(0x7fd7500f6c60 msgr2=0x7fd750065510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:23.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.951+0000 7fd754b9d640 1 -- 172.21.15.37:0/2212528469 shutdown_connections 2024-04-25T17:30:23.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:23.951+0000 7fd754b9d640 1 -- 172.21.15.37:0/2212528469 wait complete. 2024-04-25T17:30:23.964 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T17:30:24.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.062+0000 7f223559d640 1 -- 172.21.15.37:0/4179010511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2230101100 msgr2=0x7f22301014d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:24.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.062+0000 7f223559d640 1 --2- 172.21.15.37:0/4179010511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2230101100 0x7f22301014d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f22200048d0 tx=0x7f2220009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:24.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.062+0000 7f223559d640 1 -- 172.21.15.37:0/4179010511 shutdown_connections 2024-04-25T17:30:24.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.062+0000 7f223559d640 1 --2- 172.21.15.37:0/4179010511 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2230101aa0 0x7f22300fb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:24.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.062+0000 7f223559d640 1 --2- 172.21.15.37:0/4179010511 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2230101100 0x7f22301014d0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:24.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.062+0000 7f223559d640 1 -- 172.21.15.37:0/4179010511 >> 172.21.15.37:0/4179010511 conn(0x7f22300711c0 msgr2=0x7f22300715c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:24.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.062+0000 7f223559d640 1 -- 172.21.15.37:0/4179010511 shutdown_connections 2024-04-25T17:30:24.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.062+0000 7f223559d640 1 -- 172.21.15.37:0/4179010511 wait complete. 2024-04-25T17:30:24.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.063+0000 7f223559d640 1 Processor -- start 2024-04-25T17:30:24.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.063+0000 7f223559d640 1 -- start start 2024-04-25T17:30:24.065 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.063+0000 7f223559d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2230101100 0x7f223010df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:24.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.063+0000 7f223559d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2230101aa0 0x7f223010e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:24.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.063+0000 7f223559d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22300652f0 con 0x7f2230101aa0 2024-04-25T17:30:24.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.063+0000 7f223559d640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f223010e9a0 con 0x7f2230101100 2024-04-25T17:30:24.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.063+0000 7f222e7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2230101aa0 0x7f223010e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:24.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.063+0000 7f222e7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2230101aa0 0x7f223010e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34534/0 (socket says 172.21.15.37:34534) 2024-04-25T17:30:24.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.063+0000 7f222e7fc640 1 -- 172.21.15.37:0/432606301 learned_addr learned my addr 172.21.15.37:0/432606301 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:30:24.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.063+0000 7f222effd640 1 --2- 172.21.15.37:0/432606301 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2230101100 0x7f223010df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:24.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.063+0000 7f222e7fc640 1 -- 172.21.15.37:0/432606301 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2230101100 msgr2=0x7f223010df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:24.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.063+0000 7f222e7fc640 1 --2- 172.21.15.37:0/432606301 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2230101100 0x7f223010df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:24.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.063+0000 7f222e7fc640 1 -- 172.21.15.37:0/432606301 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2220005040 con 0x7f2230101aa0 2024-04-25T17:30:24.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.064+0000 7f222e7fc640 1 --2- 172.21.15.37:0/432606301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2230101aa0 0x7f223010e460 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f22180044e0 tx=0x7f221800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:24.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.064+0000 7f22277fe640 1 -- 172.21.15.37:0/432606301 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2218007c30 con 0x7f2230101aa0 2024-04-25T17:30:24.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.064+0000 7f223559d640 1 -- 172.21.15.37:0/432606301 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f223010ec20 con 0x7f2230101aa0 2024-04-25T17:30:24.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.064+0000 7f22277fe640 1 -- 172.21.15.37:0/432606301 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f221800f040 con 0x7f2230101aa0 2024-04-25T17:30:24.066 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.064+0000 7f22277fe640 1 -- 172.21.15.37:0/432606301 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f221800cba0 con 0x7f2230101aa0 2024-04-25T17:30:24.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.064+0000 7f223559d640 1 -- 172.21.15.37:0/432606301 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22301171e0 con 0x7f2230101aa0 2024-04-25T17:30:24.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.065+0000 7f223559d640 1 -- 172.21.15.37:0/432606301 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22300fc880 con 0x7f2230101aa0 2024-04-25T17:30:24.067 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.066+0000 7f22277fe640 1 -- 172.21.15.37:0/432606301 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f221800cd00 con 0x7f2230101aa0 2024-04-25T17:30:24.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.066+0000 7f22277fe640 1 --2- 172.21.15.37:0/432606301 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f221c076b00 0x7f221c078fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:24.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.066+0000 7f22277fe640 1 -- 172.21.15.37:0/432606301 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f2218097fd0 con 0x7f2230101aa0 2024-04-25T17:30:24.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.066+0000 7f222effd640 1 --2- 172.21.15.37:0/432606301 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f221c076b00 0x7f221c078fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:24.068 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.067+0000 7f222effd640 1 --2- 172.21.15.37:0/432606301 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f221c076b00 0x7f221c078fb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2220003080 tx=0x7f2220009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:24.072 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.071+0000 7f22277fe640 1 -- 172.21.15.37:0/432606301 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f2218060b60 con 0x7f2230101aa0 2024-04-25T17:30:24.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:23 smithi069 ceph-mon[80239]: pgmap v313: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:30:24.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:23 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/850623286' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T17:30:24.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:23 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:30:24.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:23 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/332037768' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T17:30:24.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:23 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/936516438' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-25T17:30:24.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:23 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:30:24.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:23 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:30:24.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.302+0000 7f223559d640 1 -- 172.21.15.37:0/432606301 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f22300fe3b0 con 0x7f2230101aa0 2024-04-25T17:30:24.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.302+0000 7f22277fe640 1 -- 172.21.15.37:0/432606301 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+5215 (secure 0 0 0) 0x7f2218060500 con 0x7f2230101aa0 2024-04-25T17:30:24.303 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:30:24.304 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44347,"name":"cephfs.smithi069.ytlqcf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6825/3424891497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":3424891497},{"type":"v1","addr":"172.21.15.69:6825","nonce":3424891497}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":44379,"name":"cephfs.smithi069.cpprst","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6827/3383509929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":3383509929},{"type":"v1","addr":"172.21.15.69:6827","nonce":3383509929}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T17:15:40.586130+0000","modified":"2024-04-25T17:27:00.988207+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34412},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34412":{"gid":34412,"name":"cephfs.smithi037.ksmixc","rank":0,"incarnation":29,"state":"up:active","state_seq":18,"addr":"172.21.15.37:6827/2514248612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":2514248612},{"type":"v1","addr":"172.21.15.37:6827","nonce":2514248612}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34444":{"gid":34444,"name":"cephfs.smithi037.ovkrpq","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.37:6829/2067664560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2067664560},{"type":"v1","addr":"172.21.15.37:6829","nonce":2067664560}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34412,"qdb_cluster":[34412]},"id":1}]} 2024-04-25T17:30:24.304 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 35 2024-04-25T17:30:24.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.304+0000 7f223559d640 1 -- 172.21.15.37:0/432606301 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f221c076b00 msgr2=0x7f221c078fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:24.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.304+0000 7f223559d640 1 --2- 172.21.15.37:0/432606301 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f221c076b00 0x7f221c078fb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2220003080 tx=0x7f2220009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:24.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.304+0000 7f223559d640 1 -- 172.21.15.37:0/432606301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2230101aa0 msgr2=0x7f223010e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:24.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.304+0000 7f223559d640 1 --2- 172.21.15.37:0/432606301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2230101aa0 0x7f223010e460 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f22180044e0 tx=0x7f221800b040 comp rx=0 tx=0).stop 2024-04-25T17:30:24.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.304+0000 7f223559d640 1 -- 172.21.15.37:0/432606301 shutdown_connections 2024-04-25T17:30:24.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.304+0000 7f223559d640 1 --2- 172.21.15.37:0/432606301 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f221c076b00 0x7f221c078fb0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:24.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.305+0000 7f223559d640 1 --2- 172.21.15.37:0/432606301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2230101aa0 0x7f223010e460 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:24.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.305+0000 7f223559d640 1 --2- 172.21.15.37:0/432606301 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2230101100 0x7f223010df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:24.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.305+0000 7f223559d640 1 -- 172.21.15.37:0/432606301 >> 172.21.15.37:0/432606301 conn(0x7f22300711c0 msgr2=0x7f22300faa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:24.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.305+0000 7f223559d640 1 -- 172.21.15.37:0/432606301 shutdown_connections 2024-04-25T17:30:24.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.305+0000 7f223559d640 1 -- 172.21.15.37:0/432606301 wait complete. 2024-04-25T17:30:24.315 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:23 smithi037 ceph-mon[90844]: pgmap v313: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:30:24.317 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:23 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/850623286' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T17:30:24.317 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:23 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:30:24.317 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:23 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/332037768' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T17:30:24.317 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:23 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/936516438' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-25T17:30:24.317 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:23 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:30:24.317 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:23 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:30:24.318 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 16, 'max_mds': 1, 'flags': 50} 2024-04-25T17:30:24.319 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 17 2024-04-25T17:30:24.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.418+0000 7f463719d640 1 -- 172.21.15.37:0/280057526 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4630102270 msgr2=0x7f4630102640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:24.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.418+0000 7f463719d640 1 --2- 172.21.15.37:0/280057526 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4630102270 0x7f4630102640 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f46240048d0 tx=0x7f4624009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:24.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.418+0000 7f463719d640 1 -- 172.21.15.37:0/280057526 shutdown_connections 2024-04-25T17:30:24.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.418+0000 7f463719d640 1 --2- 172.21.15.37:0/280057526 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4630064390 0x7f4630064800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:24.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.418+0000 7f463719d640 1 --2- 172.21.15.37:0/280057526 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4630102270 0x7f4630102640 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:24.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.418+0000 7f463719d640 1 -- 172.21.15.37:0/280057526 >> 172.21.15.37:0/280057526 conn(0x7f4630071fd0 msgr2=0x7f46300723d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:24.421 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.418+0000 7f463719d640 1 -- 172.21.15.37:0/280057526 shutdown_connections 2024-04-25T17:30:24.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.418+0000 7f463719d640 1 -- 172.21.15.37:0/280057526 wait complete. 2024-04-25T17:30:24.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.418+0000 7f463719d640 1 Processor -- start 2024-04-25T17:30:24.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.419+0000 7f463719d640 1 -- start start 2024-04-25T17:30:24.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.419+0000 7f463719d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4630064390 0x7f4630112c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:24.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.419+0000 7f463719d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4630102270 0x7f4630113170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:24.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.419+0000 7f463719d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4630113770 con 0x7f4630064390 2024-04-25T17:30:24.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.419+0000 7f463719d640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f463010cdc0 con 0x7f4630102270 2024-04-25T17:30:24.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.419+0000 7f4634f39640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4630064390 0x7f4630112c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:24.422 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.419+0000 7f4634f39640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4630064390 0x7f4630112c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34554/0 (socket says 172.21.15.37:34554) 2024-04-25T17:30:24.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.419+0000 7f4634f39640 1 -- 172.21.15.37:0/1931785943 learned_addr learned my addr 172.21.15.37:0/1931785943 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:30:24.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.419+0000 7f462ffff640 1 --2- 172.21.15.37:0/1931785943 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4630102270 0x7f4630113170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:24.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.419+0000 7f4634f39640 1 -- 172.21.15.37:0/1931785943 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4630102270 msgr2=0x7f4630113170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:24.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.419+0000 7f4634f39640 1 --2- 172.21.15.37:0/1931785943 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4630102270 0x7f4630113170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:24.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.419+0000 7f4634f39640 1 -- 172.21.15.37:0/1931785943 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4624005040 con 0x7f4630064390 2024-04-25T17:30:24.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.419+0000 7f462ffff640 1 --2- 172.21.15.37:0/1931785943 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4630102270 0x7f4630113170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T17:30:24.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.420+0000 7f4634f39640 1 --2- 172.21.15.37:0/1931785943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4630064390 0x7f4630112c30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f46240047f0 tx=0x7f4624009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:24.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.420+0000 7f462d7fa640 1 -- 172.21.15.37:0/1931785943 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46240092b0 con 0x7f4630064390 2024-04-25T17:30:24.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.420+0000 7f463719d640 1 -- 172.21.15.37:0/1931785943 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f463010d040 con 0x7f4630064390 2024-04-25T17:30:24.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.420+0000 7f462d7fa640 1 -- 172.21.15.37:0/1931785943 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f462403b400 con 0x7f4630064390 2024-04-25T17:30:24.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.420+0000 7f462d7fa640 1 -- 172.21.15.37:0/1931785943 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46240435b0 con 0x7f4630064390 2024-04-25T17:30:24.423 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.420+0000 7f463719d640 1 -- 172.21.15.37:0/1931785943 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f463010d500 con 0x7f4630064390 2024-04-25T17:30:24.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.421+0000 7f463719d640 1 -- 172.21.15.37:0/1931785943 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46300fd970 con 0x7f4630064390 2024-04-25T17:30:24.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.422+0000 7f462d7fa640 1 -- 172.21.15.37:0/1931785943 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f462402f070 con 0x7f4630064390 2024-04-25T17:30:24.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.422+0000 7f462d7fa640 1 --2- 172.21.15.37:0/1931785943 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f4620076af0 0x7f4620078fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:24.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.422+0000 7f462d7fa640 1 -- 172.21.15.37:0/1931785943 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f46240ba090 con 0x7f4630064390 2024-04-25T17:30:24.424 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.422+0000 7f462ffff640 1 --2- 172.21.15.37:0/1931785943 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f4620076af0 0x7f4620078fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:24.425 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.423+0000 7f462ffff640 1 --2- 172.21.15.37:0/1931785943 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f4620076af0 0x7f4620078fa0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f461c004fd0 tx=0x7f461c00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:24.432 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.432+0000 7f462d7fa640 1 -- 172.21.15.37:0/1931785943 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f4624082c20 con 0x7f4630064390 2024-04-25T17:30:24.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.682+0000 7f463719d640 1 -- 172.21.15.37:0/1931785943 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 17, "format": "json"} v 0) v1 -- 0x7f463010e2a0 con 0x7f4630064390 2024-04-25T17:30:24.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.683+0000 7f462d7fa640 1 -- 172.21.15.37:0/1931785943 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 17, "format": "json"}]=0 dumped fsmap epoch 17 v35) v1 ==== 107+0+4081 (secure 0 0 0) 0x7f46240825c0 con 0x7f4630064390 2024-04-25T17:30:24.684 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:30:24.684 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24289,"name":"cephfs.smithi069.cpprst","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.69:6827/518856100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":518856100},{"type":"v1","addr":"172.21.15.69:6827","nonce":518856100}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":24293,"name":"cephfs.smithi069.ytlqcf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6825/134210439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":134210439},{"type":"v1","addr":"172.21.15.69:6825","nonce":134210439}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T17:15:40.586130+0000","modified":"2024-04-25T17:25:39.970500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14470":{"gid":14470,"name":"cephfs.smithi037.ksmixc","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.37:6827/1903989494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1903989494},{"type":"v1","addr":"172.21.15.37:6827","nonce":1903989494}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14470,"qdb_cluster":[14470]},"id":1}]} 2024-04-25T17:30:24.684 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 17 2024-04-25T17:30:24.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.685+0000 7f463719d640 1 -- 172.21.15.37:0/1931785943 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f4620076af0 msgr2=0x7f4620078fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:24.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.685+0000 7f463719d640 1 --2- 172.21.15.37:0/1931785943 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f4620076af0 0x7f4620078fa0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f461c004fd0 tx=0x7f461c00b040 comp rx=0 tx=0).stop 2024-04-25T17:30:24.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.685+0000 7f463719d640 1 -- 172.21.15.37:0/1931785943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4630064390 msgr2=0x7f4630112c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:24.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.685+0000 7f463719d640 1 --2- 172.21.15.37:0/1931785943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4630064390 0x7f4630112c30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f46240047f0 tx=0x7f4624009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:24.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.685+0000 7f463719d640 1 -- 172.21.15.37:0/1931785943 shutdown_connections 2024-04-25T17:30:24.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.685+0000 7f463719d640 1 --2- 172.21.15.37:0/1931785943 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f4620076af0 0x7f4620078fa0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:24.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.685+0000 7f463719d640 1 --2- 172.21.15.37:0/1931785943 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4630102270 0x7f4630113170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:24.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.685+0000 7f463719d640 1 --2- 172.21.15.37:0/1931785943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4630064390 0x7f4630112c30 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:24.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.685+0000 7f463719d640 1 -- 172.21.15.37:0/1931785943 >> 172.21.15.37:0/1931785943 conn(0x7f4630071fd0 msgr2=0x7f46300fa260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:24.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.685+0000 7f463719d640 1 -- 172.21.15.37:0/1931785943 shutdown_connections 2024-04-25T17:30:24.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.685+0000 7f463719d640 1 -- 172.21.15.37:0/1931785943 wait complete. 2024-04-25T17:30:24.697 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 17 2024-04-25T17:30:24.697 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 18 2024-04-25T17:30:24.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.794+0000 7f9199d9d640 1 -- 172.21.15.37:0/3605905016 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9194064390 msgr2=0x7f9194064800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:24.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.794+0000 7f9199d9d640 1 --2- 172.21.15.37:0/3605905016 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9194064390 0x7f9194064800 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f91880048d0 tx=0x7f9188009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:24.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.794+0000 7f9199d9d640 1 -- 172.21.15.37:0/3605905016 shutdown_connections 2024-04-25T17:30:24.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.794+0000 7f9199d9d640 1 --2- 172.21.15.37:0/3605905016 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9194064390 0x7f9194064800 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:24.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.794+0000 7f9199d9d640 1 --2- 172.21.15.37:0/3605905016 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9194102270 0x7f9194102640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:24.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.794+0000 7f9199d9d640 1 -- 172.21.15.37:0/3605905016 >> 172.21.15.37:0/3605905016 conn(0x7f9194071fd0 msgr2=0x7f91940723d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:24.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.795+0000 7f9199d9d640 1 -- 172.21.15.37:0/3605905016 shutdown_connections 2024-04-25T17:30:24.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.795+0000 7f9199d9d640 1 -- 172.21.15.37:0/3605905016 wait complete. 2024-04-25T17:30:24.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.795+0000 7f9199d9d640 1 Processor -- start 2024-04-25T17:30:24.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.795+0000 7f9199d9d640 1 -- start start 2024-04-25T17:30:24.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.795+0000 7f9199d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9194064390 0x7f9194112c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:24.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.795+0000 7f9199d9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9194102270 0x7f91941131c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:24.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.795+0000 7f9199d9d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91941137c0 con 0x7f9194064390 2024-04-25T17:30:24.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.795+0000 7f9199d9d640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f919410ce10 con 0x7f9194102270 2024-04-25T17:30:24.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.796+0000 7f91937fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9194064390 0x7f9194112c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:24.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.796+0000 7f91937fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9194064390 0x7f9194112c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34562/0 (socket says 172.21.15.37:34562) 2024-04-25T17:30:24.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.796+0000 7f91937fe640 1 -- 172.21.15.37:0/279450311 learned_addr learned my addr 172.21.15.37:0/279450311 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:30:24.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.796+0000 7f9192ffd640 1 --2- 172.21.15.37:0/279450311 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9194102270 0x7f91941131c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:24.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.796+0000 7f91937fe640 1 -- 172.21.15.37:0/279450311 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9194102270 msgr2=0x7f91941131c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:24.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.796+0000 7f91937fe640 1 --2- 172.21.15.37:0/279450311 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9194102270 0x7f91941131c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:24.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.796+0000 7f91937fe640 1 -- 172.21.15.37:0/279450311 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9188005040 con 0x7f9194064390 2024-04-25T17:30:24.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.796+0000 7f91937fe640 1 --2- 172.21.15.37:0/279450311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9194064390 0x7f9194112c80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9184002a50 tx=0x7f9184004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:24.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.796+0000 7f917bfff640 1 -- 172.21.15.37:0/279450311 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9184007c30 con 0x7f9194064390 2024-04-25T17:30:24.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.796+0000 7f917bfff640 1 -- 172.21.15.37:0/279450311 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f918400f040 con 0x7f9194064390 2024-04-25T17:30:24.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.796+0000 7f9199d9d640 1 -- 172.21.15.37:0/279450311 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f919410d0f0 con 0x7f9194064390 2024-04-25T17:30:24.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.796+0000 7f917bfff640 1 -- 172.21.15.37:0/279450311 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f918400dad0 con 0x7f9194064390 2024-04-25T17:30:24.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.796+0000 7f9199d9d640 1 -- 172.21.15.37:0/279450311 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f919410d5e0 con 0x7f9194064390 2024-04-25T17:30:24.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.797+0000 7f9199d9d640 1 -- 172.21.15.37:0/279450311 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91940fd970 con 0x7f9194064390 2024-04-25T17:30:24.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.798+0000 7f917bfff640 1 -- 172.21.15.37:0/279450311 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f918400dc70 con 0x7f9194064390 2024-04-25T17:30:24.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.798+0000 7f917bfff640 1 --2- 172.21.15.37:0/279450311 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f917c076af0 0x7f917c078fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:24.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.798+0000 7f917bfff640 1 -- 172.21.15.37:0/279450311 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f9184097ab0 con 0x7f9194064390 2024-04-25T17:30:24.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.798+0000 7f9192ffd640 1 --2- 172.21.15.37:0/279450311 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f917c076af0 0x7f917c078fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:24.800 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.799+0000 7f9192ffd640 1 --2- 172.21.15.37:0/279450311 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f917c076af0 0x7f917c078fa0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9188000c00 tx=0x7f9188009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:24.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:24.803+0000 7f917bfff640 1 -- 172.21.15.37:0/279450311 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f91840606c0 con 0x7f9194064390 2024-04-25T17:30:25.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.031+0000 7f9199d9d640 1 -- 172.21.15.37:0/279450311 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 18, "format": "json"} v 0) v1 -- 0x7f91940ff4a0 con 0x7f9194064390 2024-04-25T17:30:25.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.032+0000 7f917bfff640 1 -- 172.21.15.37:0/279450311 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 18, "format": "json"}]=0 dumped fsmap epoch 18 v35) v1 ==== 107+0+4860 (secure 0 0 0) 0x7f9184060060 con 0x7f9194064390 2024-04-25T17:30:25.033 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:30:25.033 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24289,"name":"cephfs.smithi069.cpprst","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.69:6827/518856100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":518856100},{"type":"v1","addr":"172.21.15.69:6827","nonce":518856100}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":24293,"name":"cephfs.smithi069.ytlqcf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6825/134210439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":134210439},{"type":"v1","addr":"172.21.15.69:6825","nonce":134210439}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34408,"name":"cephfs.smithi037.ovkrpq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6829/2492925669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2492925669},{"type":"v1","addr":"172.21.15.37:6829","nonce":2492925669}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T17:15:40.586130+0000","modified":"2024-04-25T17:25:39.970500+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14470":{"gid":14470,"name":"cephfs.smithi037.ksmixc","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.37:6827/1903989494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":1903989494},{"type":"v1","addr":"172.21.15.37:6827","nonce":1903989494}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14470,"qdb_cluster":[14470]},"id":1}]} 2024-04-25T17:30:25.033 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 18 2024-04-25T17:30:25.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.034+0000 7f9199d9d640 1 -- 172.21.15.37:0/279450311 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f917c076af0 msgr2=0x7f917c078fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:25.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.034+0000 7f9199d9d640 1 --2- 172.21.15.37:0/279450311 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f917c076af0 0x7f917c078fa0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9188000c00 tx=0x7f9188009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:25.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.034+0000 7f9199d9d640 1 -- 172.21.15.37:0/279450311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9194064390 msgr2=0x7f9194112c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:25.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.034+0000 7f9199d9d640 1 --2- 172.21.15.37:0/279450311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9194064390 0x7f9194112c80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9184002a50 tx=0x7f9184004600 comp rx=0 tx=0).stop 2024-04-25T17:30:25.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.034+0000 7f9199d9d640 1 -- 172.21.15.37:0/279450311 shutdown_connections 2024-04-25T17:30:25.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.034+0000 7f9199d9d640 1 --2- 172.21.15.37:0/279450311 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f917c076af0 0x7f917c078fa0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:25.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.034+0000 7f9199d9d640 1 --2- 172.21.15.37:0/279450311 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9194102270 0x7f91941131c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:25.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.034+0000 7f9199d9d640 1 --2- 172.21.15.37:0/279450311 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9194064390 0x7f9194112c80 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:25.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.034+0000 7f9199d9d640 1 -- 172.21.15.37:0/279450311 >> 172.21.15.37:0/279450311 conn(0x7f9194071fd0 msgr2=0x7f91940fa320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:25.035 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.034+0000 7f9199d9d640 1 -- 172.21.15.37:0/279450311 shutdown_connections 2024-04-25T17:30:25.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.034+0000 7f9199d9d640 1 -- 172.21.15.37:0/279450311 wait complete. 2024-04-25T17:30:25.046 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:24 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/2212528469' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-25T17:30:25.046 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:24 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/432606301' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T17:30:25.046 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:24 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:30:25.046 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:24 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:30:25.046 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:24 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:30:25.046 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:24 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/1931785943' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-04-25T17:30:25.048 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 18 2024-04-25T17:30:25.048 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 19 2024-04-25T17:30:25.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.150+0000 7f441e51d640 1 -- 172.21.15.37:0/720950914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4418102b50 msgr2=0x7f44180fc1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:25.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.150+0000 7f441e51d640 1 --2- 172.21.15.37:0/720950914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4418102b50 0x7f44180fc1e0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f440c0048d0 tx=0x7f440c009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:25.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.150+0000 7f441e51d640 1 -- 172.21.15.37:0/720950914 shutdown_connections 2024-04-25T17:30:25.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.150+0000 7f441e51d640 1 --2- 172.21.15.37:0/720950914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4418102b50 0x7f44180fc1e0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:25.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.150+0000 7f441e51d640 1 --2- 172.21.15.37:0/720950914 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f44181021b0 0x7f4418102580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:25.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.150+0000 7f441e51d640 1 -- 172.21.15.37:0/720950914 >> 172.21.15.37:0/720950914 conn(0x7f44180f7d80 msgr2=0x7f44180fa190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:25.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.150+0000 7f441e51d640 1 -- 172.21.15.37:0/720950914 shutdown_connections 2024-04-25T17:30:25.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.150+0000 7f441e51d640 1 -- 172.21.15.37:0/720950914 wait complete. 2024-04-25T17:30:25.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.150+0000 7f441e51d640 1 Processor -- start 2024-04-25T17:30:25.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.150+0000 7f441e51d640 1 -- start start 2024-04-25T17:30:25.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.151+0000 7f441e51d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44181021b0 0x7f441806f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:25.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.151+0000 7f441e51d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4418102b50 0x7f441806fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:25.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.151+0000 7f441e51d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4418071650 con 0x7f44181021b0 2024-04-25T17:30:25.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.151+0000 7f441e51d640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44180701f0 con 0x7f4418102b50 2024-04-25T17:30:25.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.151+0000 7f4417fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44181021b0 0x7f441806f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:25.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.151+0000 7f4417fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44181021b0 0x7f441806f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34580/0 (socket says 172.21.15.37:34580) 2024-04-25T17:30:25.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.151+0000 7f4417fff640 1 -- 172.21.15.37:0/1941686797 learned_addr learned my addr 172.21.15.37:0/1941686797 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:30:25.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.151+0000 7f44177fe640 1 --2- 172.21.15.37:0/1941686797 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4418102b50 0x7f441806fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:25.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.151+0000 7f4417fff640 1 -- 172.21.15.37:0/1941686797 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4418102b50 msgr2=0x7f441806fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:25.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.151+0000 7f4417fff640 1 --2- 172.21.15.37:0/1941686797 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4418102b50 0x7f441806fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:25.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.151+0000 7f4417fff640 1 -- 172.21.15.37:0/1941686797 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f440c005040 con 0x7f44181021b0 2024-04-25T17:30:25.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.151+0000 7f4417fff640 1 --2- 172.21.15.37:0/1941686797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44181021b0 0x7f441806f770 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4408002a50 tx=0x7f4408004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:25.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.151+0000 7f4414ff9640 1 -- 172.21.15.37:0/1941686797 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4408007c30 con 0x7f44181021b0 2024-04-25T17:30:25.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.152+0000 7f441e51d640 1 -- 172.21.15.37:0/1941686797 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44180704d0 con 0x7f44181021b0 2024-04-25T17:30:25.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.152+0000 7f4414ff9640 1 -- 172.21.15.37:0/1941686797 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f440800f040 con 0x7f44181021b0 2024-04-25T17:30:25.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.152+0000 7f4414ff9640 1 -- 172.21.15.37:0/1941686797 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f440800db50 con 0x7f44181021b0 2024-04-25T17:30:25.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.152+0000 7f441e51d640 1 -- 172.21.15.37:0/1941686797 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44181193b0 con 0x7f44181021b0 2024-04-25T17:30:25.162 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.153+0000 7f441e51d640 1 -- 172.21.15.37:0/1941686797 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44180fd920 con 0x7f44181021b0 2024-04-25T17:30:25.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.153+0000 7f4414ff9640 1 -- 172.21.15.37:0/1941686797 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f440801c400 con 0x7f44181021b0 2024-04-25T17:30:25.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.154+0000 7f4414ff9640 1 --2- 172.21.15.37:0/1941686797 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f4400076b00 0x7f4400078fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:25.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.154+0000 7f4414ff9640 1 -- 172.21.15.37:0/1941686797 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f4408097be0 con 0x7f44181021b0 2024-04-25T17:30:25.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.154+0000 7f44177fe640 1 --2- 172.21.15.37:0/1941686797 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f4400076b00 0x7f4400078fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:25.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.154+0000 7f44177fe640 1 --2- 172.21.15.37:0/1941686797 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f4400076b00 0x7f4400078fb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4418070ea0 tx=0x7f440c009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:25.164 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.159+0000 7f4414ff9640 1 -- 172.21.15.37:0/1941686797 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f4408060770 con 0x7f44181021b0 2024-04-25T17:30:25.174 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:24 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/2212528469' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-25T17:30:25.174 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:24 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/432606301' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-04-25T17:30:25.174 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:24 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:30:25.174 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:24 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:30:25.175 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:24 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:30:25.175 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:24 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/1931785943' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-04-25T17:30:25.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.388+0000 7f441e51d640 1 -- 172.21.15.37:0/1941686797 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) v1 -- 0x7f4418063f00 con 0x7f44181021b0 2024-04-25T17:30:25.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.389+0000 7f4414ff9640 1 -- 172.21.15.37:0/1941686797 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v35) v1 ==== 107+0+4063 (secure 0 0 0) 0x7f4408060110 con 0x7f44181021b0 2024-04-25T17:30:25.390 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:30:25.391 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24289,"name":"cephfs.smithi069.cpprst","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.69:6827/518856100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":518856100},{"type":"v1","addr":"172.21.15.69:6827","nonce":518856100}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":24293,"name":"cephfs.smithi069.ytlqcf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6825/134210439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":134210439},{"type":"v1","addr":"172.21.15.69:6825","nonce":134210439}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34408,"name":"cephfs.smithi037.ovkrpq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6829/2492925669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2492925669},{"type":"v1","addr":"172.21.15.37:6829","nonce":2492925669}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T17:15:40.586130+0000","modified":"2024-04-25T17:25:43.985634+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-25T17:30:25.391 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 19 2024-04-25T17:30:25.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.390+0000 7f441e51d640 1 -- 172.21.15.37:0/1941686797 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f4400076b00 msgr2=0x7f4400078fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:25.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.390+0000 7f441e51d640 1 --2- 172.21.15.37:0/1941686797 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f4400076b00 0x7f4400078fb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4418070ea0 tx=0x7f440c009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:25.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.390+0000 7f441e51d640 1 -- 172.21.15.37:0/1941686797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44181021b0 msgr2=0x7f441806f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:25.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.390+0000 7f441e51d640 1 --2- 172.21.15.37:0/1941686797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44181021b0 0x7f441806f770 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4408002a50 tx=0x7f4408004600 comp rx=0 tx=0).stop 2024-04-25T17:30:25.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.391+0000 7f441e51d640 1 -- 172.21.15.37:0/1941686797 shutdown_connections 2024-04-25T17:30:25.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.391+0000 7f441e51d640 1 --2- 172.21.15.37:0/1941686797 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f4400076b00 0x7f4400078fb0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:25.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.391+0000 7f441e51d640 1 --2- 172.21.15.37:0/1941686797 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4418102b50 0x7f441806fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:25.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.391+0000 7f441e51d640 1 --2- 172.21.15.37:0/1941686797 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44181021b0 0x7f441806f770 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:25.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.391+0000 7f441e51d640 1 -- 172.21.15.37:0/1941686797 >> 172.21.15.37:0/1941686797 conn(0x7f44180f7d80 msgr2=0x7f44180f8ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:25.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.391+0000 7f441e51d640 1 -- 172.21.15.37:0/1941686797 shutdown_connections 2024-04-25T17:30:25.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.391+0000 7f441e51d640 1 -- 172.21.15.37:0/1941686797 wait complete. 2024-04-25T17:30:25.403 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 19 2024-04-25T17:30:25.403 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 20 2024-04-25T17:30:25.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.501+0000 7f01bef9d640 1 -- 172.21.15.37:0/1125629308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01b81010b0 msgr2=0x7f01b8101480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:25.507 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.501+0000 7f01bef9d640 1 --2- 172.21.15.37:0/1125629308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01b81010b0 0x7f01b8101480 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f01ac0048d0 tx=0x7f01ac009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:25.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.501+0000 7f01bef9d640 1 -- 172.21.15.37:0/1125629308 shutdown_connections 2024-04-25T17:30:25.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.501+0000 7f01bef9d640 1 --2- 172.21.15.37:0/1125629308 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f01b8101a50 0x7f01b80fb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:25.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.501+0000 7f01bef9d640 1 --2- 172.21.15.37:0/1125629308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01b81010b0 0x7f01b8101480 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:25.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.501+0000 7f01bef9d640 1 -- 172.21.15.37:0/1125629308 >> 172.21.15.37:0/1125629308 conn(0x7f01b80f6c80 msgr2=0x7f01b80f9090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:25.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.501+0000 7f01bef9d640 1 -- 172.21.15.37:0/1125629308 shutdown_connections 2024-04-25T17:30:25.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.501+0000 7f01bef9d640 1 -- 172.21.15.37:0/1125629308 wait complete. 2024-04-25T17:30:25.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.501+0000 7f01bef9d640 1 Processor -- start 2024-04-25T17:30:25.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.501+0000 7f01bef9d640 1 -- start start 2024-04-25T17:30:25.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.502+0000 7f01bef9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01b81010b0 0x7f01b810de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:25.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.502+0000 7f01bef9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f01b8101a50 0x7f01b810e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:25.508 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.502+0000 7f01bef9d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b8066720 con 0x7f01b81010b0 2024-04-25T17:30:25.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.502+0000 7f01bef9d640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b810e930 con 0x7f01b8101a50 2024-04-25T17:30:25.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.502+0000 7f01bcd39640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01b81010b0 0x7f01b810de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:25.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.502+0000 7f01bcd39640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01b81010b0 0x7f01b810de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34586/0 (socket says 172.21.15.37:34586) 2024-04-25T17:30:25.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.502+0000 7f01bcd39640 1 -- 172.21.15.37:0/2551010804 learned_addr learned my addr 172.21.15.37:0/2551010804 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:30:25.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.502+0000 7f01b7fff640 1 --2- 172.21.15.37:0/2551010804 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f01b8101a50 0x7f01b810e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:25.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.502+0000 7f01bcd39640 1 -- 172.21.15.37:0/2551010804 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f01b8101a50 msgr2=0x7f01b810e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:25.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.502+0000 7f01bcd39640 1 --2- 172.21.15.37:0/2551010804 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f01b8101a50 0x7f01b810e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:25.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.502+0000 7f01bcd39640 1 -- 172.21.15.37:0/2551010804 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01ac005040 con 0x7f01b81010b0 2024-04-25T17:30:25.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.502+0000 7f01b7fff640 1 --2- 172.21.15.37:0/2551010804 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f01b8101a50 0x7f01b810e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T17:30:25.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.502+0000 7f01bcd39640 1 --2- 172.21.15.37:0/2551010804 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01b81010b0 0x7f01b810de80 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f01ac004930 tx=0x7f01ac009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:25.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.502+0000 7f01b57fa640 1 -- 172.21.15.37:0/2551010804 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01ac0094c0 con 0x7f01b81010b0 2024-04-25T17:30:25.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.502+0000 7f01bef9d640 1 -- 172.21.15.37:0/2551010804 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01b810ebb0 con 0x7f01b81010b0 2024-04-25T17:30:25.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.502+0000 7f01b57fa640 1 -- 172.21.15.37:0/2551010804 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f01ac032e50 con 0x7f01b81010b0 2024-04-25T17:30:25.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.502+0000 7f01b57fa640 1 -- 172.21.15.37:0/2551010804 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01ac0433b0 con 0x7f01b81010b0 2024-04-25T17:30:25.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.502+0000 7f01bef9d640 1 -- 172.21.15.37:0/2551010804 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01b81170e0 con 0x7f01b81010b0 2024-04-25T17:30:25.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.503+0000 7f01bef9d640 1 -- 172.21.15.37:0/2551010804 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01b80fc820 con 0x7f01b81010b0 2024-04-25T17:30:25.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.504+0000 7f01b57fa640 1 -- 172.21.15.37:0/2551010804 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f01ac02f070 con 0x7f01b81010b0 2024-04-25T17:30:25.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.504+0000 7f01b57fa640 1 --2- 172.21.15.37:0/2551010804 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f01a8076b00 0x7f01a8078fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:25.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.505+0000 7f01b57fa640 1 -- 172.21.15.37:0/2551010804 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f01ac0ba270 con 0x7f01b81010b0 2024-04-25T17:30:25.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.505+0000 7f01b7fff640 1 --2- 172.21.15.37:0/2551010804 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f01a8076b00 0x7f01a8078fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:25.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.505+0000 7f01b7fff640 1 --2- 172.21.15.37:0/2551010804 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f01a8076b00 0x7f01a8078fb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f01a4009fd0 tx=0x7f01a4009e50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:25.518 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.509+0000 7f01b57fa640 1 -- 172.21.15.37:0/2551010804 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f01ac082cd0 con 0x7f01b81010b0 2024-04-25T17:30:25.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.734+0000 7f01bef9d640 1 -- 172.21.15.37:0/2551010804 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7f01b8064350 con 0x7f01b81010b0 2024-04-25T17:30:25.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.735+0000 7f01b57fa640 1 -- 172.21.15.37:0/2551010804 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v35) v1 ==== 107+0+4074 (secure 0 0 0) 0x7f01ac082670 con 0x7f01b81010b0 2024-04-25T17:30:25.737 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:30:25.737 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24293,"name":"cephfs.smithi069.ytlqcf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6825/134210439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":134210439},{"type":"v1","addr":"172.21.15.69:6825","nonce":134210439}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34408,"name":"cephfs.smithi037.ovkrpq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6829/2492925669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2492925669},{"type":"v1","addr":"172.21.15.37:6829","nonce":2492925669}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T17:15:40.586130+0000","modified":"2024-04-25T17:25:43.990578+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24289},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24289":{"gid":24289,"name":"cephfs.smithi069.cpprst","rank":0,"incarnation":20,"state":"up:replay","state_seq":2,"addr":"172.21.15.69:6827/518856100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":518856100},{"type":"v1","addr":"172.21.15.69:6827","nonce":518856100}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-25T17:30:25.738 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 20 2024-04-25T17:30:25.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.737+0000 7f01bef9d640 1 -- 172.21.15.37:0/2551010804 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f01a8076b00 msgr2=0x7f01a8078fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:25.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.737+0000 7f01bef9d640 1 --2- 172.21.15.37:0/2551010804 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f01a8076b00 0x7f01a8078fb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f01a4009fd0 tx=0x7f01a4009e50 comp rx=0 tx=0).stop 2024-04-25T17:30:25.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.737+0000 7f01bef9d640 1 -- 172.21.15.37:0/2551010804 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01b81010b0 msgr2=0x7f01b810de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:25.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.737+0000 7f01bef9d640 1 --2- 172.21.15.37:0/2551010804 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01b81010b0 0x7f01b810de80 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f01ac004930 tx=0x7f01ac009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:25.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.737+0000 7f01bef9d640 1 -- 172.21.15.37:0/2551010804 shutdown_connections 2024-04-25T17:30:25.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.737+0000 7f01bef9d640 1 --2- 172.21.15.37:0/2551010804 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f01a8076b00 0x7f01a8078fb0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:25.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.737+0000 7f01bef9d640 1 --2- 172.21.15.37:0/2551010804 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f01b8101a50 0x7f01b810e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:25.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.737+0000 7f01bef9d640 1 --2- 172.21.15.37:0/2551010804 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f01b81010b0 0x7f01b810de80 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:25.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.737+0000 7f01bef9d640 1 -- 172.21.15.37:0/2551010804 >> 172.21.15.37:0/2551010804 conn(0x7f01b80f6c80 msgr2=0x7f01b80f7ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:25.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.737+0000 7f01bef9d640 1 -- 172.21.15.37:0/2551010804 shutdown_connections 2024-04-25T17:30:25.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.737+0000 7f01bef9d640 1 -- 172.21.15.37:0/2551010804 wait complete. 2024-04-25T17:30:25.750 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 20 2024-04-25T17:30:25.750 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 21 2024-04-25T17:30:25.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.852+0000 7fc2e06ae640 1 -- 172.21.15.37:0/3595230218 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2d80fd1d0 msgr2=0x7fc2d80fd5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:25.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.852+0000 7fc2e06ae640 1 --2- 172.21.15.37:0/3595230218 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2d80fd1d0 0x7fc2d80fd5a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fc2d40048d0 tx=0x7fc2d4009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:25.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.852+0000 7fc2e06ae640 1 -- 172.21.15.37:0/3595230218 shutdown_connections 2024-04-25T17:30:25.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.852+0000 7fc2e06ae640 1 --2- 172.21.15.37:0/3595230218 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc2d80fdb70 0x7fc2d81061b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:25.858 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.852+0000 7fc2e06ae640 1 --2- 172.21.15.37:0/3595230218 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2d80fd1d0 0x7fc2d80fd5a0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:25.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.852+0000 7fc2e06ae640 1 -- 172.21.15.37:0/3595230218 >> 172.21.15.37:0/3595230218 conn(0x7fc2d80f6c80 msgr2=0x7fc2d80f9090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:25.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.852+0000 7fc2e06ae640 1 -- 172.21.15.37:0/3595230218 shutdown_connections 2024-04-25T17:30:25.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.852+0000 7fc2e06ae640 1 -- 172.21.15.37:0/3595230218 wait complete. 2024-04-25T17:30:25.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.853+0000 7fc2e06ae640 1 Processor -- start 2024-04-25T17:30:25.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.853+0000 7fc2e06ae640 1 -- start start 2024-04-25T17:30:25.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.853+0000 7fc2e06ae640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2d80fd1d0 0x7fc2d8112d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:25.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.853+0000 7fc2e06ae640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc2d80fdb70 0x7fc2d81132d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:25.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.853+0000 7fc2e06ae640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d8113960 con 0x7fc2d80fd1d0 2024-04-25T17:30:25.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.853+0000 7fc2e06ae640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d810cf20 con 0x7fc2d80fdb70 2024-04-25T17:30:25.859 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.853+0000 7fc2de44a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2d80fd1d0 0x7fc2d8112d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:25.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.853+0000 7fc2de44a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2d80fd1d0 0x7fc2d8112d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34592/0 (socket says 172.21.15.37:34592) 2024-04-25T17:30:25.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.853+0000 7fc2de44a640 1 -- 172.21.15.37:0/4135089296 learned_addr learned my addr 172.21.15.37:0/4135089296 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:30:25.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.853+0000 7fc2de44a640 1 -- 172.21.15.37:0/4135089296 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc2d80fdb70 msgr2=0x7fc2d81132d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:25.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.853+0000 7fc2ddc49640 1 --2- 172.21.15.37:0/4135089296 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc2d80fdb70 0x7fc2d81132d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:25.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.853+0000 7fc2de44a640 1 --2- 172.21.15.37:0/4135089296 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc2d80fdb70 0x7fc2d81132d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:25.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.853+0000 7fc2de44a640 1 -- 172.21.15.37:0/4135089296 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d4005040 con 0x7fc2d80fd1d0 2024-04-25T17:30:25.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.854+0000 7fc2de44a640 1 --2- 172.21.15.37:0/4135089296 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2d80fd1d0 0x7fc2d8112d90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4004930 tx=0x7fc2d4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:25.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.854+0000 7fc2ceffd640 1 -- 172.21.15.37:0/4135089296 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2d40094c0 con 0x7fc2d80fd1d0 2024-04-25T17:30:25.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.854+0000 7fc2e06ae640 1 -- 172.21.15.37:0/4135089296 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2d810d1a0 con 0x7fc2d80fd1d0 2024-04-25T17:30:25.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.854+0000 7fc2ceffd640 1 -- 172.21.15.37:0/4135089296 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc2d4032e50 con 0x7fc2d80fd1d0 2024-04-25T17:30:25.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.854+0000 7fc2ceffd640 1 -- 172.21.15.37:0/4135089296 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2d40433b0 con 0x7fc2d80fd1d0 2024-04-25T17:30:25.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.854+0000 7fc2e06ae640 1 -- 172.21.15.37:0/4135089296 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2d810d660 con 0x7fc2d80fd1d0 2024-04-25T17:30:25.860 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.855+0000 7fc2e06ae640 1 -- 172.21.15.37:0/4135089296 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2d8066040 con 0x7fc2d80fd1d0 2024-04-25T17:30:25.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.855+0000 7fc2ceffd640 1 -- 172.21.15.37:0/4135089296 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7fc2d402f070 con 0x7fc2d80fd1d0 2024-04-25T17:30:25.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.856+0000 7fc2ceffd640 1 --2- 172.21.15.37:0/4135089296 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fc2c4076b00 0x7fc2c4078fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:25.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.856+0000 7fc2ddc49640 1 --2- 172.21.15.37:0/4135089296 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fc2c4076b00 0x7fc2c4078fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:25.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.856+0000 7fc2ceffd640 1 -- 172.21.15.37:0/4135089296 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fc2d40ba2f0 con 0x7fc2d80fd1d0 2024-04-25T17:30:25.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.857+0000 7fc2ddc49640 1 --2- 172.21.15.37:0/4135089296 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fc2c4076b00 0x7fc2c4078fb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc2d810e650 tx=0x7fc2c8008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:25.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:25.861+0000 7fc2ceffd640 1 -- 172.21.15.37:0/4135089296 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fc2d4082dd0 con 0x7fc2d80fd1d0 2024-04-25T17:30:26.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:25 smithi037 ceph-mon[90844]: pgmap v314: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:30:26.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:25 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/279450311' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-04-25T17:30:26.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:25 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/1941686797' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-04-25T17:30:26.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:25 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/2551010804' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-04-25T17:30:26.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.088+0000 7fc2e06ae640 1 -- 172.21.15.37:0/4135089296 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7fc2d810e400 con 0x7fc2d80fd1d0 2024-04-25T17:30:26.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.089+0000 7fc2ceffd640 1 -- 172.21.15.37:0/4135089296 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v35) v1 ==== 107+0+4926 (secure 0 0 0) 0x7fc2d4082770 con 0x7fc2d80fd1d0 2024-04-25T17:30:26.090 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:30:26.090 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24293,"name":"cephfs.smithi069.ytlqcf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6825/134210439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":134210439},{"type":"v1","addr":"172.21.15.69:6825","nonce":134210439}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34408,"name":"cephfs.smithi037.ovkrpq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6829/2492925669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2492925669},{"type":"v1","addr":"172.21.15.37:6829","nonce":2492925669}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":34412,"name":"cephfs.smithi037.ksmixc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6827/2514248612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":2514248612},{"type":"v1","addr":"172.21.15.37:6827","nonce":2514248612}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T17:15:40.586130+0000","modified":"2024-04-25T17:25:52.819530+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24289},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24289":{"gid":24289,"name":"cephfs.smithi069.cpprst","rank":0,"incarnation":20,"state":"up:reconnect","state_seq":152,"addr":"172.21.15.69:6827/518856100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":518856100},{"type":"v1","addr":"172.21.15.69:6827","nonce":518856100}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-25T17:30:26.090 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 21 2024-04-25T17:30:26.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.091+0000 7fc2e06ae640 1 -- 172.21.15.37:0/4135089296 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fc2c4076b00 msgr2=0x7fc2c4078fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:26.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.091+0000 7fc2e06ae640 1 --2- 172.21.15.37:0/4135089296 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fc2c4076b00 0x7fc2c4078fb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc2d810e650 tx=0x7fc2c8008040 comp rx=0 tx=0).stop 2024-04-25T17:30:26.092 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.091+0000 7fc2e06ae640 1 -- 172.21.15.37:0/4135089296 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2d80fd1d0 msgr2=0x7fc2d8112d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:26.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.091+0000 7fc2e06ae640 1 --2- 172.21.15.37:0/4135089296 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2d80fd1d0 0x7fc2d8112d90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4004930 tx=0x7fc2d4009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:26.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.091+0000 7fc2e06ae640 1 -- 172.21.15.37:0/4135089296 shutdown_connections 2024-04-25T17:30:26.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.091+0000 7fc2e06ae640 1 --2- 172.21.15.37:0/4135089296 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fc2c4076b00 0x7fc2c4078fb0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:26.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.091+0000 7fc2e06ae640 1 --2- 172.21.15.37:0/4135089296 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc2d80fdb70 0x7fc2d81132d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:26.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.091+0000 7fc2e06ae640 1 --2- 172.21.15.37:0/4135089296 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc2d80fd1d0 0x7fc2d8112d90 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:26.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.091+0000 7fc2e06ae640 1 -- 172.21.15.37:0/4135089296 >> 172.21.15.37:0/4135089296 conn(0x7fc2d80f6c80 msgr2=0x7fc2d80f8080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:26.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.092+0000 7fc2e06ae640 1 -- 172.21.15.37:0/4135089296 shutdown_connections 2024-04-25T17:30:26.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.092+0000 7fc2e06ae640 1 -- 172.21.15.37:0/4135089296 wait complete. 2024-04-25T17:30:26.103 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 21 2024-04-25T17:30:26.104 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 22 2024-04-25T17:30:26.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:25 smithi069 ceph-mon[80239]: pgmap v314: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:30:26.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:25 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/279450311' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-04-25T17:30:26.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:25 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/1941686797' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-04-25T17:30:26.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:25 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/2551010804' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-04-25T17:30:26.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.201+0000 7fd7bf35d640 1 -- 172.21.15.37:0/311220154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7b80fb9b0 msgr2=0x7fd7b80fbe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:26.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.201+0000 7fd7bf35d640 1 --2- 172.21.15.37:0/311220154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7b80fb9b0 0x7fd7b80fbe00 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd7a80048d0 tx=0x7fd7a8009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:26.204 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.201+0000 7fd7bf35d640 1 -- 172.21.15.37:0/311220154 shutdown_connections 2024-04-25T17:30:26.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.201+0000 7fd7bf35d640 1 --2- 172.21.15.37:0/311220154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7b80fb9b0 0x7fd7b80fbe00 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:26.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.201+0000 7fd7bf35d640 1 --2- 172.21.15.37:0/311220154 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd7b8101110 0x7fd7b81014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:26.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.201+0000 7fd7bf35d640 1 -- 172.21.15.37:0/311220154 >> 172.21.15.37:0/311220154 conn(0x7fd7b8070900 msgr2=0x7fd7b8070d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:26.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.201+0000 7fd7bf35d640 1 -- 172.21.15.37:0/311220154 shutdown_connections 2024-04-25T17:30:26.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.201+0000 7fd7bf35d640 1 -- 172.21.15.37:0/311220154 wait complete. 2024-04-25T17:30:26.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.202+0000 7fd7bf35d640 1 Processor -- start 2024-04-25T17:30:26.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.202+0000 7fd7bf35d640 1 -- start start 2024-04-25T17:30:26.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.202+0000 7fd7bf35d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7b80fb9b0 0x7fd7b8114f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:26.205 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.202+0000 7fd7bf35d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd7b8101110 0x7fd7b8115470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:26.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.202+0000 7fd7bf35d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b8115a70 con 0x7fd7b80fb9b0 2024-04-25T17:30:26.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.202+0000 7fd7bf35d640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b810f0c0 con 0x7fd7b8101110 2024-04-25T17:30:26.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.202+0000 7fd7bd0f9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7b80fb9b0 0x7fd7b8114f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:26.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.202+0000 7fd7bd0f9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7b80fb9b0 0x7fd7b8114f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34618/0 (socket says 172.21.15.37:34618) 2024-04-25T17:30:26.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.202+0000 7fd7bd0f9640 1 -- 172.21.15.37:0/2890292870 learned_addr learned my addr 172.21.15.37:0/2890292870 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:30:26.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.202+0000 7fd7bc8f8640 1 --2- 172.21.15.37:0/2890292870 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd7b8101110 0x7fd7b8115470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:26.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.202+0000 7fd7bd0f9640 1 -- 172.21.15.37:0/2890292870 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd7b8101110 msgr2=0x7fd7b8115470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:26.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.202+0000 7fd7bd0f9640 1 --2- 172.21.15.37:0/2890292870 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd7b8101110 0x7fd7b8115470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:26.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.202+0000 7fd7bd0f9640 1 -- 172.21.15.37:0/2890292870 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a8005040 con 0x7fd7b80fb9b0 2024-04-25T17:30:26.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.202+0000 7fd7bd0f9640 1 --2- 172.21.15.37:0/2890292870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7b80fb9b0 0x7fd7b8114f30 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd7b400c790 tx=0x7fd7b40043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:26.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.203+0000 7fd7adffb640 1 -- 172.21.15.37:0/2890292870 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7b400a820 con 0x7fd7b80fb9b0 2024-04-25T17:30:26.206 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.203+0000 7fd7bf35d640 1 -- 172.21.15.37:0/2890292870 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7b810f3a0 con 0x7fd7b80fb9b0 2024-04-25T17:30:26.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.203+0000 7fd7adffb640 1 -- 172.21.15.37:0/2890292870 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd7b400ae50 con 0x7fd7b80fb9b0 2024-04-25T17:30:26.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.203+0000 7fd7adffb640 1 -- 172.21.15.37:0/2890292870 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7b40115e0 con 0x7fd7b80fb9b0 2024-04-25T17:30:26.207 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.203+0000 7fd7bf35d640 1 -- 172.21.15.37:0/2890292870 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7b810f890 con 0x7fd7b80fb9b0 2024-04-25T17:30:26.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.204+0000 7fd7bf35d640 1 -- 172.21.15.37:0/2890292870 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7b80fc9c0 con 0x7fd7b80fb9b0 2024-04-25T17:30:26.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.204+0000 7fd7adffb640 1 -- 172.21.15.37:0/2890292870 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7fd7b4012400 con 0x7fd7b80fb9b0 2024-04-25T17:30:26.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.205+0000 7fd7adffb640 1 --2- 172.21.15.37:0/2890292870 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fd7a4076b00 0x7fd7a4078fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:26.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.205+0000 7fd7adffb640 1 -- 172.21.15.37:0/2890292870 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fd7b4098520 con 0x7fd7b80fb9b0 2024-04-25T17:30:26.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.205+0000 7fd7bc8f8640 1 --2- 172.21.15.37:0/2890292870 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fd7a4076b00 0x7fd7a4078fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:26.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.205+0000 7fd7bc8f8640 1 --2- 172.21.15.37:0/2890292870 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fd7a4076b00 0x7fd7a4078fb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd7b80fb910 tx=0x7fd7a8009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:26.210 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.210+0000 7fd7adffb640 1 -- 172.21.15.37:0/2890292870 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fd7b4061000 con 0x7fd7b80fb9b0 2024-04-25T17:30:26.439 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.438+0000 7fd7bf35d640 1 -- 172.21.15.37:0/2890292870 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7fd7b81105a0 con 0x7fd7b80fb9b0 2024-04-25T17:30:26.440 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.439+0000 7fd7adffb640 1 -- 172.21.15.37:0/2890292870 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v35) v1 ==== 107+0+4923 (secure 0 0 0) 0x7fd7b40609a0 con 0x7fd7b80fb9b0 2024-04-25T17:30:26.440 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:30:26.440 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24293,"name":"cephfs.smithi069.ytlqcf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6825/134210439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":134210439},{"type":"v1","addr":"172.21.15.69:6825","nonce":134210439}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34408,"name":"cephfs.smithi037.ovkrpq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6829/2492925669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2492925669},{"type":"v1","addr":"172.21.15.37:6829","nonce":2492925669}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":34412,"name":"cephfs.smithi037.ksmixc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6827/2514248612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":2514248612},{"type":"v1","addr":"172.21.15.37:6827","nonce":2514248612}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T17:15:40.586130+0000","modified":"2024-04-25T17:25:53.683727+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24289},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24289":{"gid":24289,"name":"cephfs.smithi069.cpprst","rank":0,"incarnation":20,"state":"up:rejoin","state_seq":153,"addr":"172.21.15.69:6827/518856100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":518856100},{"type":"v1","addr":"172.21.15.69:6827","nonce":518856100}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-25T17:30:26.440 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 22 2024-04-25T17:30:26.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.441+0000 7fd7bf35d640 1 -- 172.21.15.37:0/2890292870 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fd7a4076b00 msgr2=0x7fd7a4078fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:26.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.441+0000 7fd7bf35d640 1 --2- 172.21.15.37:0/2890292870 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fd7a4076b00 0x7fd7a4078fb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd7b80fb910 tx=0x7fd7a8009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:26.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.441+0000 7fd7bf35d640 1 -- 172.21.15.37:0/2890292870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7b80fb9b0 msgr2=0x7fd7b8114f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:26.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.441+0000 7fd7bf35d640 1 --2- 172.21.15.37:0/2890292870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7b80fb9b0 0x7fd7b8114f30 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd7b400c790 tx=0x7fd7b40043c0 comp rx=0 tx=0).stop 2024-04-25T17:30:26.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.441+0000 7fd7bf35d640 1 -- 172.21.15.37:0/2890292870 shutdown_connections 2024-04-25T17:30:26.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.441+0000 7fd7bf35d640 1 --2- 172.21.15.37:0/2890292870 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fd7a4076b00 0x7fd7a4078fb0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:26.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.441+0000 7fd7bf35d640 1 --2- 172.21.15.37:0/2890292870 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd7b8101110 0x7fd7b8115470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:26.442 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.441+0000 7fd7bf35d640 1 --2- 172.21.15.37:0/2890292870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd7b80fb9b0 0x7fd7b8114f30 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:26.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.441+0000 7fd7bf35d640 1 -- 172.21.15.37:0/2890292870 >> 172.21.15.37:0/2890292870 conn(0x7fd7b8070900 msgr2=0x7fd7b80f8ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:26.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.441+0000 7fd7bf35d640 1 -- 172.21.15.37:0/2890292870 shutdown_connections 2024-04-25T17:30:26.443 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.441+0000 7fd7bf35d640 1 -- 172.21.15.37:0/2890292870 wait complete. 2024-04-25T17:30:26.453 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 22 2024-04-25T17:30:26.453 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 23 2024-04-25T17:30:26.554 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.551+0000 7f5b61c6e640 1 -- 172.21.15.37:0/3761992990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b5c0fd1d0 msgr2=0x7f5b5c0fd5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:26.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.551+0000 7f5b61c6e640 1 --2- 172.21.15.37:0/3761992990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b5c0fd1d0 0x7f5b5c0fd5a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c0048d0 tx=0x7f5b4c009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:26.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.551+0000 7f5b61c6e640 1 -- 172.21.15.37:0/3761992990 shutdown_connections 2024-04-25T17:30:26.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.551+0000 7f5b61c6e640 1 --2- 172.21.15.37:0/3761992990 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b5c0fdb70 0x7f5b5c1061b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:26.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.551+0000 7f5b61c6e640 1 --2- 172.21.15.37:0/3761992990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b5c0fd1d0 0x7f5b5c0fd5a0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:26.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.551+0000 7f5b61c6e640 1 -- 172.21.15.37:0/3761992990 >> 172.21.15.37:0/3761992990 conn(0x7f5b5c0f6c80 msgr2=0x7f5b5c0f9090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:26.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.551+0000 7f5b61c6e640 1 -- 172.21.15.37:0/3761992990 shutdown_connections 2024-04-25T17:30:26.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.551+0000 7f5b61c6e640 1 -- 172.21.15.37:0/3761992990 wait complete. 2024-04-25T17:30:26.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.552+0000 7f5b61c6e640 1 Processor -- start 2024-04-25T17:30:26.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.552+0000 7f5b61c6e640 1 -- start start 2024-04-25T17:30:26.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.552+0000 7f5b61c6e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b5c0fd1d0 0x7f5b5c114f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:26.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.552+0000 7f5b61c6e640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b5c0fdb70 0x7f5b5c115460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:26.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.552+0000 7f5b61c6e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5c115a60 con 0x7f5b5c0fd1d0 2024-04-25T17:30:26.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.552+0000 7f5b61c6e640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b5c10f0b0 con 0x7f5b5c0fdb70 2024-04-25T17:30:26.555 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.552+0000 7f5b5b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b5c0fd1d0 0x7f5b5c114f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:26.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.552+0000 7f5b5b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b5c0fd1d0 0x7f5b5c114f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:34634/0 (socket says 172.21.15.37:34634) 2024-04-25T17:30:26.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.552+0000 7f5b5b7fe640 1 -- 172.21.15.37:0/32575524 learned_addr learned my addr 172.21.15.37:0/32575524 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:30:26.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.553+0000 7f5b5affd640 1 --2- 172.21.15.37:0/32575524 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b5c0fdb70 0x7f5b5c115460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:26.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.553+0000 7f5b5b7fe640 1 -- 172.21.15.37:0/32575524 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b5c0fdb70 msgr2=0x7f5b5c115460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:26.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.553+0000 7f5b5b7fe640 1 --2- 172.21.15.37:0/32575524 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b5c0fdb70 0x7f5b5c115460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:26.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.553+0000 7f5b5b7fe640 1 -- 172.21.15.37:0/32575524 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b4c005040 con 0x7f5b5c0fd1d0 2024-04-25T17:30:26.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.553+0000 7f5b5b7fe640 1 --2- 172.21.15.37:0/32575524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b5c0fd1d0 0x7f5b5c114f20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c004930 tx=0x7f5b4c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:26.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.553+0000 7f5b43fff640 1 -- 172.21.15.37:0/32575524 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b4c0094c0 con 0x7f5b5c0fd1d0 2024-04-25T17:30:26.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.553+0000 7f5b61c6e640 1 -- 172.21.15.37:0/32575524 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b5c10f330 con 0x7f5b5c0fd1d0 2024-04-25T17:30:26.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.553+0000 7f5b43fff640 1 -- 172.21.15.37:0/32575524 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5b4c032e50 con 0x7f5b5c0fd1d0 2024-04-25T17:30:26.556 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.553+0000 7f5b43fff640 1 -- 172.21.15.37:0/32575524 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b4c0433b0 con 0x7f5b5c0fd1d0 2024-04-25T17:30:26.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.553+0000 7f5b61c6e640 1 -- 172.21.15.37:0/32575524 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b5c10f7f0 con 0x7f5b5c0fd1d0 2024-04-25T17:30:26.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.554+0000 7f5b61c6e640 1 -- 172.21.15.37:0/32575524 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b5c066040 con 0x7f5b5c0fd1d0 2024-04-25T17:30:26.557 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.555+0000 7f5b43fff640 1 -- 172.21.15.37:0/32575524 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f5b4c02f070 con 0x7f5b5c0fd1d0 2024-04-25T17:30:26.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.555+0000 7f5b43fff640 1 --2- 172.21.15.37:0/32575524 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f5b44076b00 0x7f5b44078fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:26.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.555+0000 7f5b43fff640 1 -- 172.21.15.37:0/32575524 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f5b4c0ba240 con 0x7f5b5c0fd1d0 2024-04-25T17:30:26.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.555+0000 7f5b5affd640 1 --2- 172.21.15.37:0/32575524 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f5b44076b00 0x7f5b44078fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:26.558 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.556+0000 7f5b5affd640 1 --2- 172.21.15.37:0/32575524 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f5b44076b00 0x7f5b44078fb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5b50007fd0 tx=0x7f5b50009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:26.561 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.560+0000 7f5b43fff640 1 -- 172.21.15.37:0/32575524 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f5b4c082d20 con 0x7f5b5c0fd1d0 2024-04-25T17:30:26.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.788+0000 7f5b61c6e640 1 -- 172.21.15.37:0/32575524 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7f5b5c110590 con 0x7f5b5c0fd1d0 2024-04-25T17:30:26.789 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.788+0000 7f5b43fff640 1 -- 172.21.15.37:0/32575524 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v35) v1 ==== 107+0+4932 (secure 0 0 0) 0x7f5b4c0826c0 con 0x7f5b5c0fd1d0 2024-04-25T17:30:26.790 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:30:26.790 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24293,"name":"cephfs.smithi069.ytlqcf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6825/134210439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":134210439},{"type":"v1","addr":"172.21.15.69:6825","nonce":134210439}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34408,"name":"cephfs.smithi037.ovkrpq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6829/2492925669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2492925669},{"type":"v1","addr":"172.21.15.37:6829","nonce":2492925669}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":34412,"name":"cephfs.smithi037.ksmixc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6827/2514248612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":2514248612},{"type":"v1","addr":"172.21.15.37:6827","nonce":2514248612}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T17:15:40.586130+0000","modified":"2024-04-25T17:25:55.686969+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24289},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24289":{"gid":24289,"name":"cephfs.smithi069.cpprst","rank":0,"incarnation":20,"state":"up:active","state_seq":154,"addr":"172.21.15.69:6827/518856100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":518856100},{"type":"v1","addr":"172.21.15.69:6827","nonce":518856100}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24289,"qdb_cluster":[24289]},"id":1}]} 2024-04-25T17:30:26.790 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 23 2024-04-25T17:30:26.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.790+0000 7f5b61c6e640 1 -- 172.21.15.37:0/32575524 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f5b44076b00 msgr2=0x7f5b44078fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:26.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.790+0000 7f5b61c6e640 1 --2- 172.21.15.37:0/32575524 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f5b44076b00 0x7f5b44078fb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5b50007fd0 tx=0x7f5b50009e90 comp rx=0 tx=0).stop 2024-04-25T17:30:26.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.790+0000 7f5b61c6e640 1 -- 172.21.15.37:0/32575524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b5c0fd1d0 msgr2=0x7f5b5c114f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:26.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.790+0000 7f5b61c6e640 1 --2- 172.21.15.37:0/32575524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b5c0fd1d0 0x7f5b5c114f20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5b4c004930 tx=0x7f5b4c009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:26.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.790+0000 7f5b61c6e640 1 -- 172.21.15.37:0/32575524 shutdown_connections 2024-04-25T17:30:26.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.790+0000 7f5b61c6e640 1 --2- 172.21.15.37:0/32575524 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f5b44076b00 0x7f5b44078fb0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:26.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.790+0000 7f5b61c6e640 1 --2- 172.21.15.37:0/32575524 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b5c0fdb70 0x7f5b5c115460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:26.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.790+0000 7f5b61c6e640 1 --2- 172.21.15.37:0/32575524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5b5c0fd1d0 0x7f5b5c114f20 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:26.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.790+0000 7f5b61c6e640 1 -- 172.21.15.37:0/32575524 >> 172.21.15.37:0/32575524 conn(0x7f5b5c0f6c80 msgr2=0x7f5b5c0f8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:26.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.791+0000 7f5b61c6e640 1 -- 172.21.15.37:0/32575524 shutdown_connections 2024-04-25T17:30:26.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.791+0000 7f5b61c6e640 1 -- 172.21.15.37:0/32575524 wait complete. 2024-04-25T17:30:26.802 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 23 2024-04-25T17:30:26.802 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 24 2024-04-25T17:30:26.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.903+0000 7fccc8e2e640 1 -- 172.21.15.37:0/215665907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccc4064ca0 msgr2=0x7fccc4108780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:26.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.903+0000 7fccc8e2e640 1 --2- 172.21.15.37:0/215665907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccc4064ca0 0x7fccc4108780 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fccb80048d0 tx=0x7fccb8009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:26.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.903+0000 7fccc8e2e640 1 -- 172.21.15.37:0/215665907 shutdown_connections 2024-04-25T17:30:26.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.903+0000 7fccc8e2e640 1 --2- 172.21.15.37:0/215665907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccc4064ca0 0x7fccc4108780 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:26.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.903+0000 7fccc8e2e640 1 --2- 172.21.15.37:0/215665907 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fccc4064390 0x7fccc4064760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:26.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.903+0000 7fccc8e2e640 1 -- 172.21.15.37:0/215665907 >> 172.21.15.37:0/215665907 conn(0x7fccc4071fd0 msgr2=0x7fccc40723d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:26.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.903+0000 7fccc8e2e640 1 -- 172.21.15.37:0/215665907 shutdown_connections 2024-04-25T17:30:26.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.903+0000 7fccc8e2e640 1 -- 172.21.15.37:0/215665907 wait complete. 2024-04-25T17:30:26.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.904+0000 7fccc8e2e640 1 Processor -- start 2024-04-25T17:30:26.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.904+0000 7fccc8e2e640 1 -- start start 2024-04-25T17:30:26.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.904+0000 7fccc8e2e640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fccc4064390 0x7fccc4114e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:26.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.904+0000 7fccc8e2e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccc4064ca0 0x7fccc41153c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:26.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.904+0000 7fccc8e2e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc41159c0 con 0x7fccc4064ca0 2024-04-25T17:30:26.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.904+0000 7fccc8e2e640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc410f010 con 0x7fccc4064390 2024-04-25T17:30:26.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.904+0000 7fccc1d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccc4064ca0 0x7fccc41153c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:26.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.904+0000 7fccc1d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccc4064ca0 0x7fccc41153c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48520/0 (socket says 172.21.15.37:48520) 2024-04-25T17:30:26.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.904+0000 7fccc1d9b640 1 -- 172.21.15.37:0/836689162 learned_addr learned my addr 172.21.15.37:0/836689162 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:30:26.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.904+0000 7fccc259c640 1 --2- 172.21.15.37:0/836689162 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fccc4064390 0x7fccc4114e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:26.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.905+0000 7fccc1d9b640 1 -- 172.21.15.37:0/836689162 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fccc4064390 msgr2=0x7fccc4114e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:26.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.905+0000 7fccc1d9b640 1 --2- 172.21.15.37:0/836689162 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fccc4064390 0x7fccc4114e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:26.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.905+0000 7fccc1d9b640 1 -- 172.21.15.37:0/836689162 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb8005040 con 0x7fccc4064ca0 2024-04-25T17:30:26.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.905+0000 7fccc1d9b640 1 --2- 172.21.15.37:0/836689162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccc4064ca0 0x7fccc41153c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fccb8004930 tx=0x7fccb8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:26.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.905+0000 7fccb2ffd640 1 -- 172.21.15.37:0/836689162 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fccb80094c0 con 0x7fccc4064ca0 2024-04-25T17:30:26.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.905+0000 7fccb2ffd640 1 -- 172.21.15.37:0/836689162 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fccb8032e50 con 0x7fccc4064ca0 2024-04-25T17:30:26.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.905+0000 7fccc8e2e640 1 -- 172.21.15.37:0/836689162 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccc410f290 con 0x7fccc4064ca0 2024-04-25T17:30:26.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.905+0000 7fccb2ffd640 1 -- 172.21.15.37:0/836689162 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fccb80433b0 con 0x7fccc4064ca0 2024-04-25T17:30:26.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.905+0000 7fccc8e2e640 1 -- 172.21.15.37:0/836689162 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccc410f750 con 0x7fccc4064ca0 2024-04-25T17:30:26.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.906+0000 7fccc8e2e640 1 -- 172.21.15.37:0/836689162 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccc40fb760 con 0x7fccc4064ca0 2024-04-25T17:30:26.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.907+0000 7fccb2ffd640 1 -- 172.21.15.37:0/836689162 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7fccb802f070 con 0x7fccc4064ca0 2024-04-25T17:30:26.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.907+0000 7fccb2ffd640 1 --2- 172.21.15.37:0/836689162 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fccac076b00 0x7fccac078fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:26.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.907+0000 7fccb2ffd640 1 -- 172.21.15.37:0/836689162 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fccb80ba1e0 con 0x7fccc4064ca0 2024-04-25T17:30:26.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.907+0000 7fccc259c640 1 --2- 172.21.15.37:0/836689162 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fccac076b00 0x7fccac078fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:26.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.908+0000 7fccc259c640 1 --2- 172.21.15.37:0/836689162 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fccac076b00 0x7fccac078fb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fccb4004ed0 tx=0x7fccb400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:26.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:26.912+0000 7fccb2ffd640 1 -- 172.21.15.37:0/836689162 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fccb8082d70 con 0x7fccc4064ca0 2024-04-25T17:30:27.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:26 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/4135089296' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-04-25T17:30:27.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:26 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/2890292870' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-04-25T17:30:27.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:26 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/32575524' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-04-25T17:30:27.142 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.141+0000 7fccc8e2e640 1 -- 172.21.15.37:0/836689162 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7fccc4063f00 con 0x7fccc4064ca0 2024-04-25T17:30:27.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.142+0000 7fccb2ffd640 1 -- 172.21.15.37:0/836689162 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v35) v1 ==== 107+0+4153 (secure 0 0 0) 0x7fccb8082710 con 0x7fccc4064ca0 2024-04-25T17:30:27.143 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:30:27.143 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24293,"name":"cephfs.smithi069.ytlqcf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6825/134210439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":134210439},{"type":"v1","addr":"172.21.15.69:6825","nonce":134210439}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34412,"name":"cephfs.smithi037.ksmixc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6827/2514248612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":2514248612},{"type":"v1","addr":"172.21.15.37:6827","nonce":2514248612}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T17:15:40.586130+0000","modified":"2024-04-25T17:25:55.686969+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24289},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24289":{"gid":24289,"name":"cephfs.smithi069.cpprst","rank":0,"incarnation":20,"state":"up:active","state_seq":154,"addr":"172.21.15.69:6827/518856100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":518856100},{"type":"v1","addr":"172.21.15.69:6827","nonce":518856100}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24289,"qdb_cluster":[24289]},"id":1}]} 2024-04-25T17:30:27.143 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 24 2024-04-25T17:30:27.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.144+0000 7fccc8e2e640 1 -- 172.21.15.37:0/836689162 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fccac076b00 msgr2=0x7fccac078fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:27.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.144+0000 7fccc8e2e640 1 --2- 172.21.15.37:0/836689162 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fccac076b00 0x7fccac078fb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fccb4004ed0 tx=0x7fccb400b040 comp rx=0 tx=0).stop 2024-04-25T17:30:27.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.144+0000 7fccc8e2e640 1 -- 172.21.15.37:0/836689162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccc4064ca0 msgr2=0x7fccc41153c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:27.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.144+0000 7fccc8e2e640 1 --2- 172.21.15.37:0/836689162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccc4064ca0 0x7fccc41153c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fccb8004930 tx=0x7fccb8009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:27.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.144+0000 7fccc8e2e640 1 -- 172.21.15.37:0/836689162 shutdown_connections 2024-04-25T17:30:27.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.144+0000 7fccc8e2e640 1 --2- 172.21.15.37:0/836689162 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fccac076b00 0x7fccac078fb0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:27.145 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.144+0000 7fccc8e2e640 1 --2- 172.21.15.37:0/836689162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccc4064ca0 0x7fccc41153c0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:27.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.144+0000 7fccc8e2e640 1 --2- 172.21.15.37:0/836689162 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fccc4064390 0x7fccc4114e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:27.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.144+0000 7fccc8e2e640 1 -- 172.21.15.37:0/836689162 >> 172.21.15.37:0/836689162 conn(0x7fccc4071fd0 msgr2=0x7fccc4104f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:27.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.144+0000 7fccc8e2e640 1 -- 172.21.15.37:0/836689162 shutdown_connections 2024-04-25T17:30:27.146 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.144+0000 7fccc8e2e640 1 -- 172.21.15.37:0/836689162 wait complete. 2024-04-25T17:30:27.155 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 24 2024-04-25T17:30:27.156 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 25 2024-04-25T17:30:27.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:26 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/4135089296' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-04-25T17:30:27.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:26 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/2890292870' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-04-25T17:30:27.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:26 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/32575524' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-04-25T17:30:27.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.254+0000 7f19b8221640 1 -- 172.21.15.37:0/239281184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19b00fa8c0 msgr2=0x7f19b00fad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:27.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.254+0000 7f19b8221640 1 --2- 172.21.15.37:0/239281184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19b00fa8c0 0x7f19b00fad10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f19a00048d0 tx=0x7f19a0009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:27.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.254+0000 7f19b8221640 1 -- 172.21.15.37:0/239281184 shutdown_connections 2024-04-25T17:30:27.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.254+0000 7f19b8221640 1 --2- 172.21.15.37:0/239281184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19b00fa8c0 0x7f19b00fad10 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:27.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.254+0000 7f19b8221640 1 --2- 172.21.15.37:0/239281184 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19b00fd0c0 0x7f19b00fd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:27.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.254+0000 7f19b8221640 1 -- 172.21.15.37:0/239281184 >> 172.21.15.37:0/239281184 conn(0x7f19b00717e0 msgr2=0x7f19b0071be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:27.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.254+0000 7f19b8221640 1 -- 172.21.15.37:0/239281184 shutdown_connections 2024-04-25T17:30:27.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.254+0000 7f19b8221640 1 -- 172.21.15.37:0/239281184 wait complete. 2024-04-25T17:30:27.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.254+0000 7f19b8221640 1 Processor -- start 2024-04-25T17:30:27.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.254+0000 7f19b8221640 1 -- start start 2024-04-25T17:30:27.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.255+0000 7f19b8221640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19b00fa8c0 0x7f19b0114eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:27.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.255+0000 7f19b8221640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19b00fd0c0 0x7f19b01153f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:27.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.255+0000 7f19b8221640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b01159f0 con 0x7f19b00fa8c0 2024-04-25T17:30:27.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.255+0000 7f19b8221640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b010f040 con 0x7f19b00fd0c0 2024-04-25T17:30:27.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.255+0000 7f19b5fbd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19b00fa8c0 0x7f19b0114eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:27.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.255+0000 7f19b5fbd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19b00fa8c0 0x7f19b0114eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48538/0 (socket says 172.21.15.37:48538) 2024-04-25T17:30:27.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.255+0000 7f19b5fbd640 1 -- 172.21.15.37:0/3933386267 learned_addr learned my addr 172.21.15.37:0/3933386267 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:30:27.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.255+0000 7f19b57bc640 1 --2- 172.21.15.37:0/3933386267 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19b00fd0c0 0x7f19b01153f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:27.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.255+0000 7f19b5fbd640 1 -- 172.21.15.37:0/3933386267 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19b00fd0c0 msgr2=0x7f19b01153f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:27.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.255+0000 7f19b5fbd640 1 --2- 172.21.15.37:0/3933386267 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19b00fd0c0 0x7f19b01153f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:27.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.255+0000 7f19b5fbd640 1 -- 172.21.15.37:0/3933386267 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a0005040 con 0x7f19b00fa8c0 2024-04-25T17:30:27.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.255+0000 7f19b5fbd640 1 --2- 172.21.15.37:0/3933386267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19b00fa8c0 0x7f19b0114eb0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f19ac00eb70 tx=0x7f19ac00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:27.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.255+0000 7f19a67fc640 1 -- 172.21.15.37:0/3933386267 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19ac007c30 con 0x7f19b00fa8c0 2024-04-25T17:30:27.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.255+0000 7f19a67fc640 1 -- 172.21.15.37:0/3933386267 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f19ac00f040 con 0x7f19b00fa8c0 2024-04-25T17:30:27.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.255+0000 7f19b8221640 1 -- 172.21.15.37:0/3933386267 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19b010f2c0 con 0x7f19b00fa8c0 2024-04-25T17:30:27.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.255+0000 7f19a67fc640 1 -- 172.21.15.37:0/3933386267 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19ac0095b0 con 0x7f19b00fa8c0 2024-04-25T17:30:27.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.255+0000 7f19b8221640 1 -- 172.21.15.37:0/3933386267 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19b010f7b0 con 0x7f19b00fa8c0 2024-04-25T17:30:27.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.256+0000 7f19b8221640 1 -- 172.21.15.37:0/3933386267 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19b00fb8d0 con 0x7f19b00fa8c0 2024-04-25T17:30:27.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.257+0000 7f19a67fc640 1 -- 172.21.15.37:0/3933386267 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f19ac009730 con 0x7f19b00fa8c0 2024-04-25T17:30:27.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.257+0000 7f19a67fc640 1 --2- 172.21.15.37:0/3933386267 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f199c076b00 0x7f199c078fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:27.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.258+0000 7f19a67fc640 1 -- 172.21.15.37:0/3933386267 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f19ac0981b0 con 0x7f19b00fa8c0 2024-04-25T17:30:27.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.258+0000 7f19b57bc640 1 --2- 172.21.15.37:0/3933386267 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f199c076b00 0x7f199c078fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:27.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.258+0000 7f19b57bc640 1 --2- 172.21.15.37:0/3933386267 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f199c076b00 0x7f199c078fb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f19b0072b50 tx=0x7f19a0009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:27.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.262+0000 7f19a67fc640 1 -- 172.21.15.37:0/3933386267 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f19ac060c10 con 0x7f19b00fa8c0 2024-04-25T17:30:27.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.489+0000 7f19b8221640 1 -- 172.21.15.37:0/3933386267 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7f19b01066e0 con 0x7f19b00fa8c0 2024-04-25T17:30:27.491 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.490+0000 7f19a67fc640 1 -- 172.21.15.37:0/3933386267 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v35) v1 ==== 107+0+5000 (secure 0 0 0) 0x7f19ac0605b0 con 0x7f19b00fa8c0 2024-04-25T17:30:27.491 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:30:27.491 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24293,"name":"cephfs.smithi069.ytlqcf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6825/134210439","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":134210439},{"type":"v1","addr":"172.21.15.69:6825","nonce":134210439}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34412,"name":"cephfs.smithi037.ksmixc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6827/2514248612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":2514248612},{"type":"v1","addr":"172.21.15.37:6827","nonce":2514248612}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":34444,"name":"cephfs.smithi037.ovkrpq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6829/2067664560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2067664560},{"type":"v1","addr":"172.21.15.37:6829","nonce":2067664560}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T17:15:40.586130+0000","modified":"2024-04-25T17:25:55.686969+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24289},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24289":{"gid":24289,"name":"cephfs.smithi069.cpprst","rank":0,"incarnation":20,"state":"up:active","state_seq":154,"addr":"172.21.15.69:6827/518856100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":518856100},{"type":"v1","addr":"172.21.15.69:6827","nonce":518856100}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24289,"qdb_cluster":[24289]},"id":1}]} 2024-04-25T17:30:27.491 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 25 2024-04-25T17:30:27.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.492+0000 7f19b8221640 1 -- 172.21.15.37:0/3933386267 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f199c076b00 msgr2=0x7f199c078fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:27.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.492+0000 7f19b8221640 1 --2- 172.21.15.37:0/3933386267 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f199c076b00 0x7f199c078fb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f19b0072b50 tx=0x7f19a0009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:27.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.492+0000 7f19b8221640 1 -- 172.21.15.37:0/3933386267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19b00fa8c0 msgr2=0x7f19b0114eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:27.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.492+0000 7f19b8221640 1 --2- 172.21.15.37:0/3933386267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19b00fa8c0 0x7f19b0114eb0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f19ac00eb70 tx=0x7f19ac00b040 comp rx=0 tx=0).stop 2024-04-25T17:30:27.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.492+0000 7f19b8221640 1 -- 172.21.15.37:0/3933386267 shutdown_connections 2024-04-25T17:30:27.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.492+0000 7f19b8221640 1 --2- 172.21.15.37:0/3933386267 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f199c076b00 0x7f199c078fb0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:27.493 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.492+0000 7f19b8221640 1 --2- 172.21.15.37:0/3933386267 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19b00fd0c0 0x7f19b01153f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:27.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.492+0000 7f19b8221640 1 --2- 172.21.15.37:0/3933386267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f19b00fa8c0 0x7f19b0114eb0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:27.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.492+0000 7f19b8221640 1 -- 172.21.15.37:0/3933386267 >> 172.21.15.37:0/3933386267 conn(0x7f19b00717e0 msgr2=0x7f19b00f8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:27.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.492+0000 7f19b8221640 1 -- 172.21.15.37:0/3933386267 shutdown_connections 2024-04-25T17:30:27.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.492+0000 7f19b8221640 1 -- 172.21.15.37:0/3933386267 wait complete. 2024-04-25T17:30:27.504 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 25 2024-04-25T17:30:27.504 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 26 2024-04-25T17:30:27.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.602+0000 7fae5f59d640 1 -- 172.21.15.37:0/982622923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae581021e0 msgr2=0x7fae581025b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:27.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.602+0000 7fae5f59d640 1 --2- 172.21.15.37:0/982622923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae581021e0 0x7fae581025b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fae540048d0 tx=0x7fae54009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:27.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.602+0000 7fae5f59d640 1 -- 172.21.15.37:0/982622923 shutdown_connections 2024-04-25T17:30:27.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.602+0000 7fae5f59d640 1 --2- 172.21.15.37:0/982622923 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae58102b80 0x7fae580fc210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:27.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.602+0000 7fae5f59d640 1 --2- 172.21.15.37:0/982622923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae581021e0 0x7fae581025b0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:27.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.602+0000 7fae5f59d640 1 -- 172.21.15.37:0/982622923 >> 172.21.15.37:0/982622923 conn(0x7fae580f7db0 msgr2=0x7fae580fa1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:27.606 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.602+0000 7fae5f59d640 1 -- 172.21.15.37:0/982622923 shutdown_connections 2024-04-25T17:30:27.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.602+0000 7fae5f59d640 1 -- 172.21.15.37:0/982622923 wait complete. 2024-04-25T17:30:27.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.603+0000 7fae5f59d640 1 Processor -- start 2024-04-25T17:30:27.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.603+0000 7fae5f59d640 1 -- start start 2024-04-25T17:30:27.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.603+0000 7fae5f59d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae581021e0 0x7fae58112c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:27.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.603+0000 7fae5f59d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae58102b80 0x7fae581131a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:27.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.603+0000 7fae5f59d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae581137a0 con 0x7fae581021e0 2024-04-25T17:30:27.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.603+0000 7fae5f59d640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae5810cdf0 con 0x7fae58102b80 2024-04-25T17:30:27.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.603+0000 7fae5d339640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae581021e0 0x7fae58112c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:27.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.603+0000 7fae5d339640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae581021e0 0x7fae58112c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48544/0 (socket says 172.21.15.37:48544) 2024-04-25T17:30:27.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.603+0000 7fae5d339640 1 -- 172.21.15.37:0/4285433537 learned_addr learned my addr 172.21.15.37:0/4285433537 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:30:27.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.603+0000 7fae5cb38640 1 --2- 172.21.15.37:0/4285433537 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae58102b80 0x7fae581131a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:27.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.603+0000 7fae5d339640 1 -- 172.21.15.37:0/4285433537 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae58102b80 msgr2=0x7fae581131a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:27.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.603+0000 7fae5d339640 1 --2- 172.21.15.37:0/4285433537 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae58102b80 0x7fae581131a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:27.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.603+0000 7fae5d339640 1 -- 172.21.15.37:0/4285433537 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae54005040 con 0x7fae581021e0 2024-04-25T17:30:27.607 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.604+0000 7fae5d339640 1 --2- 172.21.15.37:0/4285433537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae581021e0 0x7fae58112c60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fae54004930 tx=0x7fae54009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:27.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.604+0000 7fae4dffb640 1 -- 172.21.15.37:0/4285433537 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae540094c0 con 0x7fae581021e0 2024-04-25T17:30:27.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.604+0000 7fae5f59d640 1 -- 172.21.15.37:0/4285433537 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae5810d070 con 0x7fae581021e0 2024-04-25T17:30:27.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.604+0000 7fae4dffb640 1 -- 172.21.15.37:0/4285433537 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fae54032e50 con 0x7fae581021e0 2024-04-25T17:30:27.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.604+0000 7fae4dffb640 1 -- 172.21.15.37:0/4285433537 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae540433b0 con 0x7fae581021e0 2024-04-25T17:30:27.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.604+0000 7fae5f59d640 1 -- 172.21.15.37:0/4285433537 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae5810d530 con 0x7fae581021e0 2024-04-25T17:30:27.608 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.605+0000 7fae5f59d640 1 -- 172.21.15.37:0/4285433537 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae580fd950 con 0x7fae581021e0 2024-04-25T17:30:27.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.606+0000 7fae4dffb640 1 -- 172.21.15.37:0/4285433537 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7fae5402f070 con 0x7fae581021e0 2024-04-25T17:30:27.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.606+0000 7fae4dffb640 1 --2- 172.21.15.37:0/4285433537 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fae44076b00 0x7fae44078fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:27.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.606+0000 7fae4dffb640 1 -- 172.21.15.37:0/4285433537 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fae540ba240 con 0x7fae581021e0 2024-04-25T17:30:27.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.606+0000 7fae5cb38640 1 --2- 172.21.15.37:0/4285433537 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fae44076b00 0x7fae44078fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:27.609 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.607+0000 7fae5cb38640 1 --2- 172.21.15.37:0/4285433537 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fae44076b00 0x7fae44078fb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fae5810e520 tx=0x7fae48009ed0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:27.612 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.611+0000 7fae4dffb640 1 -- 172.21.15.37:0/4285433537 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fae54082d20 con 0x7fae581021e0 2024-04-25T17:30:27.839 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.838+0000 7fae5f59d640 1 -- 172.21.15.37:0/4285433537 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7fae5810e360 con 0x7fae581021e0 2024-04-25T17:30:27.840 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.839+0000 7fae4dffb640 1 -- 172.21.15.37:0/4285433537 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v35) v1 ==== 107+0+4224 (secure 0 0 0) 0x7fae540826c0 con 0x7fae581021e0 2024-04-25T17:30:27.840 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:30:27.840 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34412,"name":"cephfs.smithi037.ksmixc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6827/2514248612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":2514248612},{"type":"v1","addr":"172.21.15.37:6827","nonce":2514248612}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":34444,"name":"cephfs.smithi037.ovkrpq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6829/2067664560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2067664560},{"type":"v1","addr":"172.21.15.37:6829","nonce":2067664560}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T17:15:40.586130+0000","modified":"2024-04-25T17:25:55.686969+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24289},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24289":{"gid":24289,"name":"cephfs.smithi069.cpprst","rank":0,"incarnation":20,"state":"up:active","state_seq":154,"addr":"172.21.15.69:6827/518856100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":518856100},{"type":"v1","addr":"172.21.15.69:6827","nonce":518856100}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24289,"qdb_cluster":[24289]},"id":1}]} 2024-04-25T17:30:27.841 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 26 2024-04-25T17:30:27.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.841+0000 7fae5f59d640 1 -- 172.21.15.37:0/4285433537 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fae44076b00 msgr2=0x7fae44078fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:27.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.841+0000 7fae5f59d640 1 --2- 172.21.15.37:0/4285433537 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fae44076b00 0x7fae44078fb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fae5810e520 tx=0x7fae48009ed0 comp rx=0 tx=0).stop 2024-04-25T17:30:27.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.841+0000 7fae5f59d640 1 -- 172.21.15.37:0/4285433537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae581021e0 msgr2=0x7fae58112c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:27.842 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.841+0000 7fae5f59d640 1 --2- 172.21.15.37:0/4285433537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae581021e0 0x7fae58112c60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fae54004930 tx=0x7fae54009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:27.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.841+0000 7fae5f59d640 1 -- 172.21.15.37:0/4285433537 shutdown_connections 2024-04-25T17:30:27.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.841+0000 7fae5f59d640 1 --2- 172.21.15.37:0/4285433537 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fae44076b00 0x7fae44078fb0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:27.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.841+0000 7fae5f59d640 1 --2- 172.21.15.37:0/4285433537 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae58102b80 0x7fae581131a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:27.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.841+0000 7fae5f59d640 1 --2- 172.21.15.37:0/4285433537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fae581021e0 0x7fae58112c60 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:27.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.841+0000 7fae5f59d640 1 -- 172.21.15.37:0/4285433537 >> 172.21.15.37:0/4285433537 conn(0x7fae580f7db0 msgr2=0x7fae58106750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:27.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.841+0000 7fae5f59d640 1 -- 172.21.15.37:0/4285433537 shutdown_connections 2024-04-25T17:30:27.843 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.842+0000 7fae5f59d640 1 -- 172.21.15.37:0/4285433537 wait complete. 2024-04-25T17:30:27.853 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 26 2024-04-25T17:30:27.854 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 27 2024-04-25T17:30:27.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.952+0000 7fa229d1d640 1 -- 172.21.15.37:0/3361334267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2241010a0 msgr2=0x7fa224101470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:27.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.952+0000 7fa229d1d640 1 --2- 172.21.15.37:0/3361334267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2241010a0 0x7fa224101470 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa2140048d0 tx=0x7fa214009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:27.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.952+0000 7fa229d1d640 1 -- 172.21.15.37:0/3361334267 shutdown_connections 2024-04-25T17:30:27.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.952+0000 7fa229d1d640 1 --2- 172.21.15.37:0/3361334267 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa224101a40 0x7fa2240fb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:27.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.952+0000 7fa229d1d640 1 --2- 172.21.15.37:0/3361334267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2241010a0 0x7fa224101470 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:27.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.952+0000 7fa229d1d640 1 -- 172.21.15.37:0/3361334267 >> 172.21.15.37:0/3361334267 conn(0x7fa2240f6c50 msgr2=0x7fa2240f9060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:27.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.952+0000 7fa229d1d640 1 -- 172.21.15.37:0/3361334267 shutdown_connections 2024-04-25T17:30:27.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.952+0000 7fa229d1d640 1 -- 172.21.15.37:0/3361334267 wait complete. 2024-04-25T17:30:27.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.953+0000 7fa229d1d640 1 Processor -- start 2024-04-25T17:30:27.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.953+0000 7fa229d1d640 1 -- start start 2024-04-25T17:30:27.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.953+0000 7fa229d1d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2241010a0 0x7fa224112d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:27.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.953+0000 7fa229d1d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa224101a40 0x7fa224113250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:27.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.953+0000 7fa229d1d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa224113850 con 0x7fa2241010a0 2024-04-25T17:30:27.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.953+0000 7fa229d1d640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22410cea0 con 0x7fa224101a40 2024-04-25T17:30:27.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.953+0000 7fa2237fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2241010a0 0x7fa224112d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:27.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.953+0000 7fa2237fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2241010a0 0x7fa224112d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48560/0 (socket says 172.21.15.37:48560) 2024-04-25T17:30:27.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.953+0000 7fa2237fe640 1 -- 172.21.15.37:0/1095393407 learned_addr learned my addr 172.21.15.37:0/1095393407 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:30:27.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.954+0000 7fa222ffd640 1 --2- 172.21.15.37:0/1095393407 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa224101a40 0x7fa224113250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:27.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.954+0000 7fa2237fe640 1 -- 172.21.15.37:0/1095393407 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa224101a40 msgr2=0x7fa224113250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:27.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.954+0000 7fa2237fe640 1 --2- 172.21.15.37:0/1095393407 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa224101a40 0x7fa224113250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:27.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.954+0000 7fa2237fe640 1 -- 172.21.15.37:0/1095393407 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa214005040 con 0x7fa2241010a0 2024-04-25T17:30:27.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.954+0000 7fa2237fe640 1 --2- 172.21.15.37:0/1095393407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2241010a0 0x7fa224112d10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa214034040 tx=0x7fa214009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:27.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.954+0000 7fa20bfff640 1 -- 172.21.15.37:0/1095393407 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2140092b0 con 0x7fa2241010a0 2024-04-25T17:30:27.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.954+0000 7fa229d1d640 1 -- 172.21.15.37:0/1095393407 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa22410d120 con 0x7fa2241010a0 2024-04-25T17:30:27.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.954+0000 7fa20bfff640 1 -- 172.21.15.37:0/1095393407 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa21403b400 con 0x7fa2241010a0 2024-04-25T17:30:27.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.954+0000 7fa20bfff640 1 -- 172.21.15.37:0/1095393407 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2140435d0 con 0x7fa2241010a0 2024-04-25T17:30:27.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.954+0000 7fa229d1d640 1 -- 172.21.15.37:0/1095393407 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa22410d5e0 con 0x7fa2241010a0 2024-04-25T17:30:27.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.955+0000 7fa229d1d640 1 -- 172.21.15.37:0/1095393407 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2240fc810 con 0x7fa2241010a0 2024-04-25T17:30:27.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.956+0000 7fa20bfff640 1 -- 172.21.15.37:0/1095393407 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7fa21402f070 con 0x7fa2241010a0 2024-04-25T17:30:27.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.956+0000 7fa20bfff640 1 --2- 172.21.15.37:0/1095393407 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fa20c076b00 0x7fa20c078fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:27.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.956+0000 7fa20bfff640 1 -- 172.21.15.37:0/1095393407 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fa2140ba150 con 0x7fa2241010a0 2024-04-25T17:30:27.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.956+0000 7fa222ffd640 1 --2- 172.21.15.37:0/1095393407 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fa20c076b00 0x7fa20c078fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:27.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.957+0000 7fa222ffd640 1 --2- 172.21.15.37:0/1095393407 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fa20c076b00 0x7fa20c078fb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa22410e5d0 tx=0x7fa21800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:27.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:27.961+0000 7fa20bfff640 1 -- 172.21.15.37:0/1095393407 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fa214082bb0 con 0x7fa2241010a0 2024-04-25T17:30:28.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:27 smithi069 ceph-mon[80239]: pgmap v315: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:30:28.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:27 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/836689162' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-04-25T17:30:28.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:27 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/3933386267' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-04-25T17:30:28.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:27 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:30:28.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:27 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/4285433537' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-04-25T17:30:28.187 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.186+0000 7fa229d1d640 1 -- 172.21.15.37:0/1095393407 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7fa224064350 con 0x7fa2241010a0 2024-04-25T17:30:28.188 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.187+0000 7fa20bfff640 1 -- 172.21.15.37:0/1095393407 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v35) v1 ==== 107+0+5071 (secure 0 0 0) 0x7fa214082550 con 0x7fa2241010a0 2024-04-25T17:30:28.188 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:30:28.188 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34412,"name":"cephfs.smithi037.ksmixc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6827/2514248612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":2514248612},{"type":"v1","addr":"172.21.15.37:6827","nonce":2514248612}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":34444,"name":"cephfs.smithi037.ovkrpq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6829/2067664560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2067664560},{"type":"v1","addr":"172.21.15.37:6829","nonce":2067664560}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44347,"name":"cephfs.smithi069.ytlqcf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6825/3424891497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":3424891497},{"type":"v1","addr":"172.21.15.69:6825","nonce":3424891497}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T17:15:40.586130+0000","modified":"2024-04-25T17:25:55.686969+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24289},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24289":{"gid":24289,"name":"cephfs.smithi069.cpprst","rank":0,"incarnation":20,"state":"up:active","state_seq":154,"addr":"172.21.15.69:6827/518856100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":518856100},{"type":"v1","addr":"172.21.15.69:6827","nonce":518856100}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24289,"qdb_cluster":[24289]},"id":1}]} 2024-04-25T17:30:28.188 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 27 2024-04-25T17:30:28.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.189+0000 7fa229d1d640 1 -- 172.21.15.37:0/1095393407 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fa20c076b00 msgr2=0x7fa20c078fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:28.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.189+0000 7fa229d1d640 1 --2- 172.21.15.37:0/1095393407 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fa20c076b00 0x7fa20c078fb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa22410e5d0 tx=0x7fa21800b040 comp rx=0 tx=0).stop 2024-04-25T17:30:28.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.189+0000 7fa229d1d640 1 -- 172.21.15.37:0/1095393407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2241010a0 msgr2=0x7fa224112d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:28.190 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.189+0000 7fa229d1d640 1 --2- 172.21.15.37:0/1095393407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2241010a0 0x7fa224112d10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa214034040 tx=0x7fa214009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:28.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.189+0000 7fa229d1d640 1 -- 172.21.15.37:0/1095393407 shutdown_connections 2024-04-25T17:30:28.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.189+0000 7fa229d1d640 1 --2- 172.21.15.37:0/1095393407 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fa20c076b00 0x7fa20c078fb0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:28.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.189+0000 7fa229d1d640 1 --2- 172.21.15.37:0/1095393407 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa224101a40 0x7fa224113250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:28.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.189+0000 7fa229d1d640 1 --2- 172.21.15.37:0/1095393407 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2241010a0 0x7fa224112d10 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:28.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.189+0000 7fa229d1d640 1 -- 172.21.15.37:0/1095393407 >> 172.21.15.37:0/1095393407 conn(0x7fa2240f6c50 msgr2=0x7fa224065790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:28.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.189+0000 7fa229d1d640 1 -- 172.21.15.37:0/1095393407 shutdown_connections 2024-04-25T17:30:28.191 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.189+0000 7fa229d1d640 1 -- 172.21.15.37:0/1095393407 wait complete. 2024-04-25T17:30:28.200 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:27 smithi037 ceph-mon[90844]: pgmap v315: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:30:28.200 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:27 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/836689162' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-04-25T17:30:28.200 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:27 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/3933386267' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-04-25T17:30:28.200 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:27 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:30:28.200 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:27 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/4285433537' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-04-25T17:30:28.201 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 27 2024-04-25T17:30:28.201 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 28 2024-04-25T17:30:28.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.299+0000 7f0a78b9d640 1 -- 172.21.15.37:0/3556684208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a741021e0 msgr2=0x7f0a741025b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:28.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.299+0000 7f0a78b9d640 1 --2- 172.21.15.37:0/3556684208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a741021e0 0x7f0a741025b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0a640048d0 tx=0x7f0a64009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:28.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.300+0000 7f0a78b9d640 1 -- 172.21.15.37:0/3556684208 shutdown_connections 2024-04-25T17:30:28.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.300+0000 7f0a78b9d640 1 --2- 172.21.15.37:0/3556684208 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0a74102b80 0x7f0a740fc210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:28.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.300+0000 7f0a78b9d640 1 --2- 172.21.15.37:0/3556684208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a741021e0 0x7f0a741025b0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:28.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.300+0000 7f0a78b9d640 1 -- 172.21.15.37:0/3556684208 >> 172.21.15.37:0/3556684208 conn(0x7f0a740f7db0 msgr2=0x7f0a740fa1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:28.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.300+0000 7f0a78b9d640 1 -- 172.21.15.37:0/3556684208 shutdown_connections 2024-04-25T17:30:28.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.300+0000 7f0a78b9d640 1 -- 172.21.15.37:0/3556684208 wait complete. 2024-04-25T17:30:28.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.300+0000 7f0a78b9d640 1 Processor -- start 2024-04-25T17:30:28.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.300+0000 7f0a78b9d640 1 -- start start 2024-04-25T17:30:28.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.300+0000 7f0a78b9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a741021e0 0x7f0a74112c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:28.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.300+0000 7f0a78b9d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0a74102b80 0x7f0a74113150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:28.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.300+0000 7f0a78b9d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a74113750 con 0x7f0a741021e0 2024-04-25T17:30:28.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.300+0000 7f0a78b9d640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7410cdf0 con 0x7f0a74102b80 2024-04-25T17:30:28.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.300+0000 7f0a7259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a741021e0 0x7f0a74112c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:28.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.300+0000 7f0a7259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a741021e0 0x7f0a74112c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48576/0 (socket says 172.21.15.37:48576) 2024-04-25T17:30:28.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.300+0000 7f0a7259c640 1 -- 172.21.15.37:0/94473757 learned_addr learned my addr 172.21.15.37:0/94473757 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:30:28.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.301+0000 7f0a71d9b640 1 --2- 172.21.15.37:0/94473757 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0a74102b80 0x7f0a74113150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:28.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.301+0000 7f0a7259c640 1 -- 172.21.15.37:0/94473757 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0a74102b80 msgr2=0x7f0a74113150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:28.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.301+0000 7f0a7259c640 1 --2- 172.21.15.37:0/94473757 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0a74102b80 0x7f0a74113150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:28.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.301+0000 7f0a7259c640 1 -- 172.21.15.37:0/94473757 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a64005040 con 0x7f0a741021e0 2024-04-25T17:30:28.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.301+0000 7f0a7259c640 1 --2- 172.21.15.37:0/94473757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a741021e0 0x7f0a74112c10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0a64004930 tx=0x7f0a64009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:28.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.301+0000 7f0a62ffd640 1 -- 172.21.15.37:0/94473757 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a640094c0 con 0x7f0a741021e0 2024-04-25T17:30:28.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.301+0000 7f0a62ffd640 1 -- 172.21.15.37:0/94473757 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0a64032e50 con 0x7f0a741021e0 2024-04-25T17:30:28.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.301+0000 7f0a78b9d640 1 -- 172.21.15.37:0/94473757 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a7410d070 con 0x7f0a741021e0 2024-04-25T17:30:28.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.301+0000 7f0a62ffd640 1 -- 172.21.15.37:0/94473757 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a640433b0 con 0x7f0a741021e0 2024-04-25T17:30:28.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.301+0000 7f0a78b9d640 1 -- 172.21.15.37:0/94473757 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a7410d530 con 0x7f0a741021e0 2024-04-25T17:30:28.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.302+0000 7f0a78b9d640 1 -- 172.21.15.37:0/94473757 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a740fd950 con 0x7f0a741021e0 2024-04-25T17:30:28.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.303+0000 7f0a62ffd640 1 -- 172.21.15.37:0/94473757 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f0a6402f070 con 0x7f0a741021e0 2024-04-25T17:30:28.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.303+0000 7f0a62ffd640 1 --2- 172.21.15.37:0/94473757 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f0a5c076b00 0x7f0a5c078fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:28.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.303+0000 7f0a62ffd640 1 -- 172.21.15.37:0/94473757 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f0a640ba360 con 0x7f0a741021e0 2024-04-25T17:30:28.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.303+0000 7f0a71d9b640 1 --2- 172.21.15.37:0/94473757 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f0a5c076b00 0x7f0a5c078fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:28.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.304+0000 7f0a71d9b640 1 --2- 172.21.15.37:0/94473757 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f0a5c076b00 0x7f0a5c078fb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0a7410e4d0 tx=0x7f0a68009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:28.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.308+0000 7f0a62ffd640 1 -- 172.21.15.37:0/94473757 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f0a64082e40 con 0x7f0a741021e0 2024-04-25T17:30:28.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.533+0000 7f0a78b9d640 1 -- 172.21.15.37:0/94473757 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7f0a7410e280 con 0x7f0a741021e0 2024-04-25T17:30:28.534 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.534+0000 7f0a62ffd640 1 -- 172.21.15.37:0/94473757 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v35) v1 ==== 107+0+4273 (secure 0 0 0) 0x7f0a640827e0 con 0x7f0a741021e0 2024-04-25T17:30:28.534 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:30:28.535 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34412,"name":"cephfs.smithi037.ksmixc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6827/2514248612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":2514248612},{"type":"v1","addr":"172.21.15.37:6827","nonce":2514248612}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":34444,"name":"cephfs.smithi037.ovkrpq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6829/2067664560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2067664560},{"type":"v1","addr":"172.21.15.37:6829","nonce":2067664560}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44347,"name":"cephfs.smithi069.ytlqcf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6825/3424891497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":3424891497},{"type":"v1","addr":"172.21.15.69:6825","nonce":3424891497}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T17:15:40.586130+0000","modified":"2024-04-25T17:26:43.463334+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-25T17:30:28.535 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 28 2024-04-25T17:30:28.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.536+0000 7f0a78b9d640 1 -- 172.21.15.37:0/94473757 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f0a5c076b00 msgr2=0x7f0a5c078fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:28.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.536+0000 7f0a78b9d640 1 --2- 172.21.15.37:0/94473757 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f0a5c076b00 0x7f0a5c078fb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0a7410e4d0 tx=0x7f0a68009040 comp rx=0 tx=0).stop 2024-04-25T17:30:28.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.536+0000 7f0a78b9d640 1 -- 172.21.15.37:0/94473757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a741021e0 msgr2=0x7f0a74112c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:28.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.536+0000 7f0a78b9d640 1 --2- 172.21.15.37:0/94473757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a741021e0 0x7f0a74112c10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0a64004930 tx=0x7f0a64009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:28.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.536+0000 7f0a78b9d640 1 -- 172.21.15.37:0/94473757 shutdown_connections 2024-04-25T17:30:28.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.536+0000 7f0a78b9d640 1 --2- 172.21.15.37:0/94473757 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f0a5c076b00 0x7f0a5c078fb0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:28.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.536+0000 7f0a78b9d640 1 --2- 172.21.15.37:0/94473757 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0a74102b80 0x7f0a74113150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:28.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.536+0000 7f0a78b9d640 1 --2- 172.21.15.37:0/94473757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0a741021e0 0x7f0a74112c10 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:28.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.536+0000 7f0a78b9d640 1 -- 172.21.15.37:0/94473757 >> 172.21.15.37:0/94473757 conn(0x7f0a740f7db0 msgr2=0x7f0a740f9a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:28.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.536+0000 7f0a78b9d640 1 -- 172.21.15.37:0/94473757 shutdown_connections 2024-04-25T17:30:28.537 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.536+0000 7f0a78b9d640 1 -- 172.21.15.37:0/94473757 wait complete. 2024-04-25T17:30:28.547 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 28 2024-04-25T17:30:28.548 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 29 2024-04-25T17:30:28.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.645+0000 7fac4886e640 1 -- 172.21.15.37:0/39188721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac44102b70 msgr2=0x7fac440fc200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:28.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.645+0000 7fac4886e640 1 --2- 172.21.15.37:0/39188721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac44102b70 0x7fac440fc200 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fac380048d0 tx=0x7fac38009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:28.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.645+0000 7fac4886e640 1 -- 172.21.15.37:0/39188721 shutdown_connections 2024-04-25T17:30:28.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.645+0000 7fac4886e640 1 --2- 172.21.15.37:0/39188721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac44102b70 0x7fac440fc200 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:28.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.645+0000 7fac4886e640 1 --2- 172.21.15.37:0/39188721 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fac441021d0 0x7fac441025a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:28.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.645+0000 7fac4886e640 1 -- 172.21.15.37:0/39188721 >> 172.21.15.37:0/39188721 conn(0x7fac440f7d60 msgr2=0x7fac440fa170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:28.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.646+0000 7fac4886e640 1 -- 172.21.15.37:0/39188721 shutdown_connections 2024-04-25T17:30:28.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.646+0000 7fac4886e640 1 -- 172.21.15.37:0/39188721 wait complete. 2024-04-25T17:30:28.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.646+0000 7fac4886e640 1 Processor -- start 2024-04-25T17:30:28.648 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.646+0000 7fac4886e640 1 -- start start 2024-04-25T17:30:28.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.646+0000 7fac4886e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac441021d0 0x7fac44112ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:28.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.646+0000 7fac4886e640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fac44102b70 0x7fac44113220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:28.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.646+0000 7fac4886e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac44113820 con 0x7fac441021d0 2024-04-25T17:30:28.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.646+0000 7fac4886e640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac4410ce70 con 0x7fac44102b70 2024-04-25T17:30:28.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.646+0000 7fac4259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac441021d0 0x7fac44112ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:28.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.646+0000 7fac4259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac441021d0 0x7fac44112ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48594/0 (socket says 172.21.15.37:48594) 2024-04-25T17:30:28.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.646+0000 7fac4259c640 1 -- 172.21.15.37:0/3010795575 learned_addr learned my addr 172.21.15.37:0/3010795575 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:30:28.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.647+0000 7fac4259c640 1 -- 172.21.15.37:0/3010795575 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fac44102b70 msgr2=0x7fac44113220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:28.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.647+0000 7fac4259c640 1 --2- 172.21.15.37:0/3010795575 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fac44102b70 0x7fac44113220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:28.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.647+0000 7fac4259c640 1 -- 172.21.15.37:0/3010795575 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac38005040 con 0x7fac441021d0 2024-04-25T17:30:28.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.647+0000 7fac4259c640 1 --2- 172.21.15.37:0/3010795575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac441021d0 0x7fac44112ce0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fac34002a50 tx=0x7fac34004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:28.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.647+0000 7fac32ffd640 1 -- 172.21.15.37:0/3010795575 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac34007c30 con 0x7fac441021d0 2024-04-25T17:30:28.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.647+0000 7fac4886e640 1 -- 172.21.15.37:0/3010795575 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac4410d150 con 0x7fac441021d0 2024-04-25T17:30:28.649 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.647+0000 7fac32ffd640 1 -- 172.21.15.37:0/3010795575 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fac3400f040 con 0x7fac441021d0 2024-04-25T17:30:28.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.647+0000 7fac32ffd640 1 -- 172.21.15.37:0/3010795575 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac3400db50 con 0x7fac441021d0 2024-04-25T17:30:28.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.647+0000 7fac4886e640 1 -- 172.21.15.37:0/3010795575 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac4410d670 con 0x7fac441021d0 2024-04-25T17:30:28.650 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.648+0000 7fac4886e640 1 -- 172.21.15.37:0/3010795575 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac440fd940 con 0x7fac441021d0 2024-04-25T17:30:28.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.649+0000 7fac32ffd640 1 -- 172.21.15.37:0/3010795575 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7fac3401c400 con 0x7fac441021d0 2024-04-25T17:30:28.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.649+0000 7fac32ffd640 1 --2- 172.21.15.37:0/3010795575 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fac2c076b00 0x7fac2c078fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:28.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.649+0000 7fac32ffd640 1 -- 172.21.15.37:0/3010795575 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fac34097c90 con 0x7fac441021d0 2024-04-25T17:30:28.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.649+0000 7fac41d9b640 1 --2- 172.21.15.37:0/3010795575 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fac2c076b00 0x7fac2c078fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:28.651 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.649+0000 7fac41d9b640 1 --2- 172.21.15.37:0/3010795575 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fac2c076b00 0x7fac2c078fb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fac380043d0 tx=0x7fac38009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:28.654 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.654+0000 7fac32ffd640 1 -- 172.21.15.37:0/3010795575 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fac34060770 con 0x7fac441021d0 2024-04-25T17:30:28.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.882+0000 7fac4886e640 1 -- 172.21.15.37:0/3010795575 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7fac44064350 con 0x7fac441021d0 2024-04-25T17:30:28.883 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.882+0000 7fac32ffd640 1 -- 172.21.15.37:0/3010795575 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v35) v1 ==== 107+0+4352 (secure 0 0 0) 0x7fac34060110 con 0x7fac441021d0 2024-04-25T17:30:28.883 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:30:28.883 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34444,"name":"cephfs.smithi037.ovkrpq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6829/2067664560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2067664560},{"type":"v1","addr":"172.21.15.37:6829","nonce":2067664560}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44347,"name":"cephfs.smithi069.ytlqcf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6825/3424891497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":3424891497},{"type":"v1","addr":"172.21.15.69:6825","nonce":3424891497}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T17:15:40.586130+0000","modified":"2024-04-25T17:26:43.471333+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34412},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34412":{"gid":34412,"name":"cephfs.smithi037.ksmixc","rank":0,"incarnation":29,"state":"up:replay","state_seq":1,"addr":"172.21.15.37:6827/2514248612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":2514248612},{"type":"v1","addr":"172.21.15.37:6827","nonce":2514248612}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-25T17:30:28.884 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 29 2024-04-25T17:30:28.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.884+0000 7fac4886e640 1 -- 172.21.15.37:0/3010795575 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fac2c076b00 msgr2=0x7fac2c078fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:28.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.884+0000 7fac4886e640 1 --2- 172.21.15.37:0/3010795575 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fac2c076b00 0x7fac2c078fb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fac380043d0 tx=0x7fac38009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:28.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.884+0000 7fac4886e640 1 -- 172.21.15.37:0/3010795575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac441021d0 msgr2=0x7fac44112ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:28.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.884+0000 7fac4886e640 1 --2- 172.21.15.37:0/3010795575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac441021d0 0x7fac44112ce0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fac34002a50 tx=0x7fac34004600 comp rx=0 tx=0).stop 2024-04-25T17:30:28.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.885+0000 7fac4886e640 1 -- 172.21.15.37:0/3010795575 shutdown_connections 2024-04-25T17:30:28.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.885+0000 7fac4886e640 1 --2- 172.21.15.37:0/3010795575 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fac2c076b00 0x7fac2c078fb0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:28.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.885+0000 7fac4886e640 1 --2- 172.21.15.37:0/3010795575 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fac44102b70 0x7fac44113220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:28.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.885+0000 7fac4886e640 1 --2- 172.21.15.37:0/3010795575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac441021d0 0x7fac44112ce0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:28.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.885+0000 7fac4886e640 1 -- 172.21.15.37:0/3010795575 >> 172.21.15.37:0/3010795575 conn(0x7fac440f7d60 msgr2=0x7fac440f8e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:28.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.885+0000 7fac4886e640 1 -- 172.21.15.37:0/3010795575 shutdown_connections 2024-04-25T17:30:28.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.885+0000 7fac4886e640 1 -- 172.21.15.37:0/3010795575 wait complete. 2024-04-25T17:30:28.896 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 29 2024-04-25T17:30:28.896 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 30 2024-04-25T17:30:28.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.994+0000 7f9cf526e640 1 -- 172.21.15.37:0/727170469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cf01021a0 msgr2=0x7f9cf0102570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:28.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.994+0000 7f9cf526e640 1 --2- 172.21.15.37:0/727170469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cf01021a0 0x7f9cf0102570 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9ce00048d0 tx=0x7f9ce0009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:28.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.995+0000 7f9cf526e640 1 -- 172.21.15.37:0/727170469 shutdown_connections 2024-04-25T17:30:28.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.995+0000 7f9cf526e640 1 --2- 172.21.15.37:0/727170469 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9cf0102b40 0x7f9cf00fc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:28.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.995+0000 7f9cf526e640 1 --2- 172.21.15.37:0/727170469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cf01021a0 0x7f9cf0102570 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:28.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.995+0000 7f9cf526e640 1 -- 172.21.15.37:0/727170469 >> 172.21.15.37:0/727170469 conn(0x7f9cf00f7d50 msgr2=0x7f9cf00fa160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:28.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.995+0000 7f9cf526e640 1 -- 172.21.15.37:0/727170469 shutdown_connections 2024-04-25T17:30:28.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.995+0000 7f9cf526e640 1 -- 172.21.15.37:0/727170469 wait complete. 2024-04-25T17:30:28.997 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.995+0000 7f9cf526e640 1 Processor -- start 2024-04-25T17:30:28.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.995+0000 7f9cf526e640 1 -- start start 2024-04-25T17:30:28.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.995+0000 7f9cf526e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cf01021a0 0x7f9cf006f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:28.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.995+0000 7f9cf526e640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9cf0102b40 0x7f9cf006fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:28.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.995+0000 7f9cf526e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf0071650 con 0x7f9cf01021a0 2024-04-25T17:30:28.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.995+0000 7f9cf526e640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf00701f0 con 0x7f9cf0102b40 2024-04-25T17:30:28.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.995+0000 7f9ceeffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cf01021a0 0x7f9cf006f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:28.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.995+0000 7f9ceeffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cf01021a0 0x7f9cf006f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48610/0 (socket says 172.21.15.37:48610) 2024-04-25T17:30:28.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.995+0000 7f9ceeffd640 1 -- 172.21.15.37:0/500374977 learned_addr learned my addr 172.21.15.37:0/500374977 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:30:28.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.996+0000 7f9ce7fff640 1 --2- 172.21.15.37:0/500374977 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9cf0102b40 0x7f9cf006fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:28.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.996+0000 7f9ceeffd640 1 -- 172.21.15.37:0/500374977 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9cf0102b40 msgr2=0x7f9cf006fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:28.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.996+0000 7f9ceeffd640 1 --2- 172.21.15.37:0/500374977 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9cf0102b40 0x7f9cf006fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:28.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.996+0000 7f9ceeffd640 1 -- 172.21.15.37:0/500374977 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce0005040 con 0x7f9cf01021a0 2024-04-25T17:30:28.998 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.996+0000 7f9ceeffd640 1 --2- 172.21.15.37:0/500374977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cf01021a0 0x7f9cf006f770 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0004930 tx=0x7f9ce0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:28.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.996+0000 7f9ce77fe640 1 -- 172.21.15.37:0/500374977 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ce00094c0 con 0x7f9cf01021a0 2024-04-25T17:30:28.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.996+0000 7f9ce77fe640 1 -- 172.21.15.37:0/500374977 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9ce0032e50 con 0x7f9cf01021a0 2024-04-25T17:30:28.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.996+0000 7f9ce77fe640 1 -- 172.21.15.37:0/500374977 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ce00433b0 con 0x7f9cf01021a0 2024-04-25T17:30:28.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.996+0000 7f9cf526e640 1 -- 172.21.15.37:0/500374977 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cf0070470 con 0x7f9cf01021a0 2024-04-25T17:30:28.999 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.996+0000 7f9cf526e640 1 -- 172.21.15.37:0/500374977 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cf0119380 con 0x7f9cf01021a0 2024-04-25T17:30:29.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.997+0000 7f9cf526e640 1 -- 172.21.15.37:0/500374977 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cf00fd910 con 0x7f9cf01021a0 2024-04-25T17:30:29.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.998+0000 7f9ce77fe640 1 -- 172.21.15.37:0/500374977 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f9ce002f070 con 0x7f9cf01021a0 2024-04-25T17:30:29.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.998+0000 7f9ce77fe640 1 --2- 172.21.15.37:0/500374977 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f9cdc076b00 0x7f9cdc078fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:29.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.998+0000 7f9ce77fe640 1 -- 172.21.15.37:0/500374977 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f9ce00ba250 con 0x7f9cf01021a0 2024-04-25T17:30:29.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.998+0000 7f9ce7fff640 1 --2- 172.21.15.37:0/500374977 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f9cdc076b00 0x7f9cdc078fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:29.000 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:28.999+0000 7f9ce7fff640 1 --2- 172.21.15.37:0/500374977 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f9cdc076b00 0x7f9cdc078fb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8007fd0 tx=0x7f9cd8009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:29.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.003+0000 7f9ce77fe640 1 -- 172.21.15.37:0/500374977 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f9ce0082d30 con 0x7f9cf01021a0 2024-04-25T17:30:29.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:28 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/1095393407' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-04-25T17:30:29.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:28 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/94473757' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-04-25T17:30:29.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:28 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/3010795575' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-04-25T17:30:29.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.226+0000 7f9cf526e640 1 -- 172.21.15.37:0/500374977 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7f9cf0119510 con 0x7f9cf01021a0 2024-04-25T17:30:29.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.227+0000 7f9ce77fe640 1 -- 172.21.15.37:0/500374977 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v35) v1 ==== 107+0+5199 (secure 0 0 0) 0x7f9ce00826d0 con 0x7f9cf01021a0 2024-04-25T17:30:29.228 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:30:29.228 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34444,"name":"cephfs.smithi037.ovkrpq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6829/2067664560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2067664560},{"type":"v1","addr":"172.21.15.37:6829","nonce":2067664560}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44347,"name":"cephfs.smithi069.ytlqcf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6825/3424891497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":3424891497},{"type":"v1","addr":"172.21.15.69:6825","nonce":3424891497}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":44379,"name":"cephfs.smithi069.cpprst","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6827/3383509929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":3383509929},{"type":"v1","addr":"172.21.15.69:6827","nonce":3383509929}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T17:15:40.586130+0000","modified":"2024-04-25T17:26:43.471333+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34412},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34412":{"gid":34412,"name":"cephfs.smithi037.ksmixc","rank":0,"incarnation":29,"state":"up:replay","state_seq":1,"addr":"172.21.15.37:6827/2514248612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":2514248612},{"type":"v1","addr":"172.21.15.37:6827","nonce":2514248612}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-25T17:30:29.228 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 30 2024-04-25T17:30:29.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.229+0000 7f9cf526e640 1 -- 172.21.15.37:0/500374977 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f9cdc076b00 msgr2=0x7f9cdc078fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:29.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.229+0000 7f9cf526e640 1 --2- 172.21.15.37:0/500374977 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f9cdc076b00 0x7f9cdc078fb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8007fd0 tx=0x7f9cd8009e90 comp rx=0 tx=0).stop 2024-04-25T17:30:29.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.229+0000 7f9cf526e640 1 -- 172.21.15.37:0/500374977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cf01021a0 msgr2=0x7f9cf006f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:29.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.229+0000 7f9cf526e640 1 --2- 172.21.15.37:0/500374977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cf01021a0 0x7f9cf006f770 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0004930 tx=0x7f9ce0009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:29.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.229+0000 7f9cf526e640 1 -- 172.21.15.37:0/500374977 shutdown_connections 2024-04-25T17:30:29.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.229+0000 7f9cf526e640 1 --2- 172.21.15.37:0/500374977 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f9cdc076b00 0x7f9cdc078fb0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:29.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.229+0000 7f9cf526e640 1 --2- 172.21.15.37:0/500374977 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9cf0102b40 0x7f9cf006fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:29.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.229+0000 7f9cf526e640 1 --2- 172.21.15.37:0/500374977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9cf01021a0 0x7f9cf006f770 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:29.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.229+0000 7f9cf526e640 1 -- 172.21.15.37:0/500374977 >> 172.21.15.37:0/500374977 conn(0x7f9cf00f7d50 msgr2=0x7f9cf00f8cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:29.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.229+0000 7f9cf526e640 1 -- 172.21.15.37:0/500374977 shutdown_connections 2024-04-25T17:30:29.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.229+0000 7f9cf526e640 1 -- 172.21.15.37:0/500374977 wait complete. 2024-04-25T17:30:29.239 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:28 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/1095393407' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-04-25T17:30:29.240 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:28 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/94473757' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-04-25T17:30:29.240 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:28 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/3010795575' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-04-25T17:30:29.241 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 30 2024-04-25T17:30:29.241 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 31 2024-04-25T17:30:29.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.338+0000 7f3d77cae640 1 -- 172.21.15.37:0/1025154768 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d70102270 msgr2=0x7f3d70102640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:29.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.338+0000 7f3d77cae640 1 --2- 172.21.15.37:0/1025154768 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d70102270 0x7f3d70102640 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3d68009c50 tx=0x7f3d68004d10 comp rx=0 tx=0).stop 2024-04-25T17:30:29.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.339+0000 7f3d77cae640 1 -- 172.21.15.37:0/1025154768 shutdown_connections 2024-04-25T17:30:29.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.339+0000 7f3d77cae640 1 --2- 172.21.15.37:0/1025154768 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3d70064390 0x7f3d70064800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:29.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.339+0000 7f3d77cae640 1 --2- 172.21.15.37:0/1025154768 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d70102270 0x7f3d70102640 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:29.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.339+0000 7f3d77cae640 1 -- 172.21.15.37:0/1025154768 >> 172.21.15.37:0/1025154768 conn(0x7f3d70071fd0 msgr2=0x7f3d700723d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:29.342 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.339+0000 7f3d77cae640 1 -- 172.21.15.37:0/1025154768 shutdown_connections 2024-04-25T17:30:29.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.339+0000 7f3d77cae640 1 -- 172.21.15.37:0/1025154768 wait complete. 2024-04-25T17:30:29.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.339+0000 7f3d77cae640 1 Processor -- start 2024-04-25T17:30:29.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.339+0000 7f3d77cae640 1 -- start start 2024-04-25T17:30:29.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.339+0000 7f3d77cae640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3d70064390 0x7f3d70112c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:29.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.339+0000 7f3d77cae640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d70102270 0x7f3d701131c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:29.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.339+0000 7f3d77cae640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d70113850 con 0x7f3d70102270 2024-04-25T17:30:29.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.339+0000 7f3d77cae640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d7010ce10 con 0x7f3d70064390 2024-04-25T17:30:29.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.339+0000 7f3d75249640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d70102270 0x7f3d701131c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:29.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.339+0000 7f3d75249640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d70102270 0x7f3d701131c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48614/0 (socket says 172.21.15.37:48614) 2024-04-25T17:30:29.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.339+0000 7f3d75249640 1 -- 172.21.15.37:0/2874928422 learned_addr learned my addr 172.21.15.37:0/2874928422 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:30:29.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.340+0000 7f3d75a4a640 1 --2- 172.21.15.37:0/2874928422 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3d70064390 0x7f3d70112c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:29.343 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.340+0000 7f3d75249640 1 -- 172.21.15.37:0/2874928422 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3d70064390 msgr2=0x7f3d70112c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:29.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.340+0000 7f3d75249640 1 --2- 172.21.15.37:0/2874928422 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3d70064390 0x7f3d70112c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:29.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.340+0000 7f3d75249640 1 -- 172.21.15.37:0/2874928422 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d680098b0 con 0x7f3d70102270 2024-04-25T17:30:29.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.340+0000 7f3d75249640 1 --2- 172.21.15.37:0/2874928422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d70102270 0x7f3d701131c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3d6000b790 tx=0x7f3d600091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:29.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.340+0000 7f3d667fc640 1 -- 172.21.15.37:0/2874928422 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d6000c700 con 0x7f3d70102270 2024-04-25T17:30:29.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.340+0000 7f3d667fc640 1 -- 172.21.15.37:0/2874928422 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3d6000cd30 con 0x7f3d70102270 2024-04-25T17:30:29.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.340+0000 7f3d77cae640 1 -- 172.21.15.37:0/2874928422 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d7010d0f0 con 0x7f3d70102270 2024-04-25T17:30:29.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.340+0000 7f3d667fc640 1 -- 172.21.15.37:0/2874928422 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d60013370 con 0x7f3d70102270 2024-04-25T17:30:29.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.340+0000 7f3d77cae640 1 -- 172.21.15.37:0/2874928422 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d7010d610 con 0x7f3d70102270 2024-04-25T17:30:29.344 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.341+0000 7f3d77cae640 1 -- 172.21.15.37:0/2874928422 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d700fd970 con 0x7f3d70102270 2024-04-25T17:30:29.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.342+0000 7f3d667fc640 1 -- 172.21.15.37:0/2874928422 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f3d60012070 con 0x7f3d70102270 2024-04-25T17:30:29.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.342+0000 7f3d667fc640 1 --2- 172.21.15.37:0/2874928422 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f3d5c076b00 0x7f3d5c078fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:29.345 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.342+0000 7f3d667fc640 1 -- 172.21.15.37:0/2874928422 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f3d60098010 con 0x7f3d70102270 2024-04-25T17:30:29.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.342+0000 7f3d75a4a640 1 --2- 172.21.15.37:0/2874928422 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f3d5c076b00 0x7f3d5c078fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:29.346 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.343+0000 7f3d75a4a640 1 --2- 172.21.15.37:0/2874928422 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f3d5c076b00 0x7f3d5c078fb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3d68004a30 tx=0x7f3d6802e040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:29.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.347+0000 7f3d667fc640 1 -- 172.21.15.37:0/2874928422 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f3d60060af0 con 0x7f3d70102270 2024-04-25T17:30:29.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.571+0000 7f3d77cae640 1 -- 172.21.15.37:0/2874928422 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7f3d70063f00 con 0x7f3d70102270 2024-04-25T17:30:29.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.572+0000 7f3d667fc640 1 -- 172.21.15.37:0/2874928422 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v35) v1 ==== 107+0+5203 (secure 0 0 0) 0x7f3d60060490 con 0x7f3d70102270 2024-04-25T17:30:29.573 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:30:29.573 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34444,"name":"cephfs.smithi037.ovkrpq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6829/2067664560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2067664560},{"type":"v1","addr":"172.21.15.37:6829","nonce":2067664560}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44347,"name":"cephfs.smithi069.ytlqcf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6825/3424891497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":3424891497},{"type":"v1","addr":"172.21.15.69:6825","nonce":3424891497}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":44379,"name":"cephfs.smithi069.cpprst","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6827/3383509929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":3383509929},{"type":"v1","addr":"172.21.15.69:6827","nonce":3383509929}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T17:15:40.586130+0000","modified":"2024-04-25T17:26:53.103219+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34412},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34412":{"gid":34412,"name":"cephfs.smithi037.ksmixc","rank":0,"incarnation":29,"state":"up:reconnect","state_seq":16,"addr":"172.21.15.37:6827/2514248612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":2514248612},{"type":"v1","addr":"172.21.15.37:6827","nonce":2514248612}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-25T17:30:29.574 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 31 2024-04-25T17:30:29.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.574+0000 7f3d77cae640 1 -- 172.21.15.37:0/2874928422 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f3d5c076b00 msgr2=0x7f3d5c078fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:29.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.574+0000 7f3d77cae640 1 --2- 172.21.15.37:0/2874928422 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f3d5c076b00 0x7f3d5c078fb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3d68004a30 tx=0x7f3d6802e040 comp rx=0 tx=0).stop 2024-04-25T17:30:29.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.574+0000 7f3d77cae640 1 -- 172.21.15.37:0/2874928422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d70102270 msgr2=0x7f3d701131c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:29.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.574+0000 7f3d77cae640 1 --2- 172.21.15.37:0/2874928422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d70102270 0x7f3d701131c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3d6000b790 tx=0x7f3d600091d0 comp rx=0 tx=0).stop 2024-04-25T17:30:29.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.574+0000 7f3d77cae640 1 -- 172.21.15.37:0/2874928422 shutdown_connections 2024-04-25T17:30:29.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.574+0000 7f3d77cae640 1 --2- 172.21.15.37:0/2874928422 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f3d5c076b00 0x7f3d5c078fb0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:29.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.574+0000 7f3d77cae640 1 --2- 172.21.15.37:0/2874928422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3d70102270 0x7f3d701131c0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:29.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.574+0000 7f3d77cae640 1 --2- 172.21.15.37:0/2874928422 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3d70064390 0x7f3d70112c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:29.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.574+0000 7f3d77cae640 1 -- 172.21.15.37:0/2874928422 >> 172.21.15.37:0/2874928422 conn(0x7f3d70071fd0 msgr2=0x7f3d700fa260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:29.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.574+0000 7f3d77cae640 1 -- 172.21.15.37:0/2874928422 shutdown_connections 2024-04-25T17:30:29.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.574+0000 7f3d77cae640 1 -- 172.21.15.37:0/2874928422 wait complete. 2024-04-25T17:30:29.586 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 31 2024-04-25T17:30:29.586 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 32 2024-04-25T17:30:29.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.684+0000 7f9fb3a2e640 1 -- 172.21.15.37:0/3842856332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fac064390 msgr2=0x7f9fac064800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:29.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.684+0000 7f9fb3a2e640 1 --2- 172.21.15.37:0/3842856332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fac064390 0x7f9fac064800 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c0048d0 tx=0x7f9f9c009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:29.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.684+0000 7f9fb3a2e640 1 -- 172.21.15.37:0/3842856332 shutdown_connections 2024-04-25T17:30:29.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.684+0000 7f9fb3a2e640 1 --2- 172.21.15.37:0/3842856332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fac064390 0x7f9fac064800 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:29.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.684+0000 7f9fb3a2e640 1 --2- 172.21.15.37:0/3842856332 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9fac102270 0x7f9fac102640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:29.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.684+0000 7f9fb3a2e640 1 -- 172.21.15.37:0/3842856332 >> 172.21.15.37:0/3842856332 conn(0x7f9fac071fd0 msgr2=0x7f9fac0723d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:29.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.684+0000 7f9fb3a2e640 1 -- 172.21.15.37:0/3842856332 shutdown_connections 2024-04-25T17:30:29.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.684+0000 7f9fb3a2e640 1 -- 172.21.15.37:0/3842856332 wait complete. 2024-04-25T17:30:29.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.684+0000 7f9fb3a2e640 1 Processor -- start 2024-04-25T17:30:29.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.684+0000 7f9fb3a2e640 1 -- start start 2024-04-25T17:30:29.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.685+0000 7f9fb3a2e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fac064390 0x7f9fac112c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:29.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.685+0000 7f9fb3a2e640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9fac102270 0x7f9fac1131c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:29.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.685+0000 7f9fb3a2e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fac1137c0 con 0x7f9fac064390 2024-04-25T17:30:29.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.685+0000 7f9fb3a2e640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fac10ce10 con 0x7f9fac102270 2024-04-25T17:30:29.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.685+0000 7f9fb17ca640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fac064390 0x7f9fac112c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:29.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.685+0000 7f9fb17ca640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fac064390 0x7f9fac112c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48624/0 (socket says 172.21.15.37:48624) 2024-04-25T17:30:29.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.685+0000 7f9fb17ca640 1 -- 172.21.15.37:0/4010774236 learned_addr learned my addr 172.21.15.37:0/4010774236 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:30:29.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.685+0000 7f9fb0fc9640 1 --2- 172.21.15.37:0/4010774236 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9fac102270 0x7f9fac1131c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:29.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.685+0000 7f9fb17ca640 1 -- 172.21.15.37:0/4010774236 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9fac102270 msgr2=0x7f9fac1131c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:29.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.685+0000 7f9fb17ca640 1 --2- 172.21.15.37:0/4010774236 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9fac102270 0x7f9fac1131c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:29.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.685+0000 7f9fb17ca640 1 -- 172.21.15.37:0/4010774236 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f9c005040 con 0x7f9fac064390 2024-04-25T17:30:29.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.685+0000 7f9fb0fc9640 1 --2- 172.21.15.37:0/4010774236 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9fac102270 0x7f9fac1131c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T17:30:29.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.685+0000 7f9fb17ca640 1 --2- 172.21.15.37:0/4010774236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fac064390 0x7f9fac112c80 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9fa8002a50 tx=0x7f9fa8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:29.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.685+0000 7f9fa1ffb640 1 -- 172.21.15.37:0/4010774236 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fa8007c30 con 0x7f9fac064390 2024-04-25T17:30:29.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.685+0000 7f9fa1ffb640 1 -- 172.21.15.37:0/4010774236 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9fa800f040 con 0x7f9fac064390 2024-04-25T17:30:29.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.685+0000 7f9fb3a2e640 1 -- 172.21.15.37:0/4010774236 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fac10d0f0 con 0x7f9fac064390 2024-04-25T17:30:29.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.685+0000 7f9fa1ffb640 1 -- 172.21.15.37:0/4010774236 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fa800db50 con 0x7f9fac064390 2024-04-25T17:30:29.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.686+0000 7f9fb3a2e640 1 -- 172.21.15.37:0/4010774236 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fac10d5e0 con 0x7f9fac064390 2024-04-25T17:30:29.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.687+0000 7f9fb3a2e640 1 -- 172.21.15.37:0/4010774236 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fac0fd970 con 0x7f9fac064390 2024-04-25T17:30:29.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.687+0000 7f9fa1ffb640 1 -- 172.21.15.37:0/4010774236 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f9fa801c400 con 0x7f9fac064390 2024-04-25T17:30:29.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.687+0000 7f9fa1ffb640 1 --2- 172.21.15.37:0/4010774236 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f9f98076af0 0x7f9f98078fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:29.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.688+0000 7f9fa1ffb640 1 -- 172.21.15.37:0/4010774236 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f9fa8097c90 con 0x7f9fac064390 2024-04-25T17:30:29.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.688+0000 7f9fb0fc9640 1 --2- 172.21.15.37:0/4010774236 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f9f98076af0 0x7f9f98078fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:29.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.688+0000 7f9fb0fc9640 1 --2- 172.21.15.37:0/4010774236 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f9f98076af0 0x7f9f98078fa0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c0048a0 tx=0x7f9f9c009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:29.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.693+0000 7f9fa1ffb640 1 -- 172.21.15.37:0/4010774236 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f9fa8060770 con 0x7f9fac064390 2024-04-25T17:30:29.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.921+0000 7f9fb3a2e640 1 -- 172.21.15.37:0/4010774236 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) v1 -- 0x7f9fac10e320 con 0x7f9fac064390 2024-04-25T17:30:29.922 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.922+0000 7f9fa1ffb640 1 -- 172.21.15.37:0/4010774236 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v35) v1 ==== 107+0+5200 (secure 0 0 0) 0x7f9fa8060110 con 0x7f9fac064390 2024-04-25T17:30:29.923 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:30:29.923 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34444,"name":"cephfs.smithi037.ovkrpq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6829/2067664560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2067664560},{"type":"v1","addr":"172.21.15.37:6829","nonce":2067664560}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44347,"name":"cephfs.smithi069.ytlqcf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6825/3424891497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":3424891497},{"type":"v1","addr":"172.21.15.69:6825","nonce":3424891497}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":44379,"name":"cephfs.smithi069.cpprst","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6827/3383509929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":3383509929},{"type":"v1","addr":"172.21.15.69:6827","nonce":3383509929}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T17:15:40.586130+0000","modified":"2024-04-25T17:26:53.824243+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34412},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34412":{"gid":34412,"name":"cephfs.smithi037.ksmixc","rank":0,"incarnation":29,"state":"up:rejoin","state_seq":17,"addr":"172.21.15.37:6827/2514248612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":2514248612},{"type":"v1","addr":"172.21.15.37:6827","nonce":2514248612}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-25T17:30:29.923 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 32 2024-04-25T17:30:29.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.924+0000 7f9fb3a2e640 1 -- 172.21.15.37:0/4010774236 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f9f98076af0 msgr2=0x7f9f98078fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:29.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.924+0000 7f9fb3a2e640 1 --2- 172.21.15.37:0/4010774236 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f9f98076af0 0x7f9f98078fa0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c0048a0 tx=0x7f9f9c009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:29.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.924+0000 7f9fb3a2e640 1 -- 172.21.15.37:0/4010774236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fac064390 msgr2=0x7f9fac112c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:29.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.924+0000 7f9fb3a2e640 1 --2- 172.21.15.37:0/4010774236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fac064390 0x7f9fac112c80 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9fa8002a50 tx=0x7f9fa8004600 comp rx=0 tx=0).stop 2024-04-25T17:30:29.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.924+0000 7f9fb3a2e640 1 -- 172.21.15.37:0/4010774236 shutdown_connections 2024-04-25T17:30:29.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.924+0000 7f9fb3a2e640 1 --2- 172.21.15.37:0/4010774236 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f9f98076af0 0x7f9f98078fa0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:29.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.924+0000 7f9fb3a2e640 1 --2- 172.21.15.37:0/4010774236 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9fac102270 0x7f9fac1131c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:29.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.924+0000 7f9fb3a2e640 1 --2- 172.21.15.37:0/4010774236 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9fac064390 0x7f9fac112c80 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:29.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.924+0000 7f9fb3a2e640 1 -- 172.21.15.37:0/4010774236 >> 172.21.15.37:0/4010774236 conn(0x7f9fac071fd0 msgr2=0x7f9fac0fa320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:29.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.924+0000 7f9fb3a2e640 1 -- 172.21.15.37:0/4010774236 shutdown_connections 2024-04-25T17:30:29.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:29.924+0000 7f9fb3a2e640 1 -- 172.21.15.37:0/4010774236 wait complete. 2024-04-25T17:30:29.936 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 32 2024-04-25T17:30:29.936 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 33 2024-04-25T17:30:30.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.034+0000 7f3e09cae640 1 -- 172.21.15.37:0/1152690845 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e040fdb50 msgr2=0x7f3e04106190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:30.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.034+0000 7f3e09cae640 1 --2- 172.21.15.37:0/1152690845 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e040fdb50 0x7f3e04106190 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3df80048d0 tx=0x7f3df8009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:30.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.035+0000 7f3e09cae640 1 -- 172.21.15.37:0/1152690845 shutdown_connections 2024-04-25T17:30:30.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.035+0000 7f3e09cae640 1 --2- 172.21.15.37:0/1152690845 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e040fdb50 0x7f3e04106190 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:30.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.035+0000 7f3e09cae640 1 --2- 172.21.15.37:0/1152690845 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3e040fd1b0 0x7f3e040fd580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:30.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.035+0000 7f3e09cae640 1 -- 172.21.15.37:0/1152690845 >> 172.21.15.37:0/1152690845 conn(0x7f3e040f6c20 msgr2=0x7f3e040f9030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:30.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.035+0000 7f3e09cae640 1 -- 172.21.15.37:0/1152690845 shutdown_connections 2024-04-25T17:30:30.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.035+0000 7f3e09cae640 1 -- 172.21.15.37:0/1152690845 wait complete. 2024-04-25T17:30:30.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.035+0000 7f3e09cae640 1 Processor -- start 2024-04-25T17:30:30.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.035+0000 7f3e09cae640 1 -- start start 2024-04-25T17:30:30.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.035+0000 7f3e09cae640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e040fd1b0 0x7f3e04112d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:30.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.035+0000 7f3e09cae640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3e040fdb50 0x7f3e04113240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:30.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.035+0000 7f3e09cae640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e04113840 con 0x7f3e040fd1b0 2024-04-25T17:30:30.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.035+0000 7f3e09cae640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0410ce90 con 0x7f3e040fdb50 2024-04-25T17:30:30.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.036+0000 7f3e037fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e040fd1b0 0x7f3e04112d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:30.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.036+0000 7f3e037fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e040fd1b0 0x7f3e04112d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48642/0 (socket says 172.21.15.37:48642) 2024-04-25T17:30:30.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.036+0000 7f3e037fe640 1 -- 172.21.15.37:0/3900430444 learned_addr learned my addr 172.21.15.37:0/3900430444 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:30:30.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.036+0000 7f3e02ffd640 1 --2- 172.21.15.37:0/3900430444 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3e040fdb50 0x7f3e04113240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:30.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.036+0000 7f3e037fe640 1 -- 172.21.15.37:0/3900430444 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3e040fdb50 msgr2=0x7f3e04113240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:30.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.036+0000 7f3e037fe640 1 --2- 172.21.15.37:0/3900430444 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3e040fdb50 0x7f3e04113240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:30.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.036+0000 7f3e037fe640 1 -- 172.21.15.37:0/3900430444 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df8005040 con 0x7f3e040fd1b0 2024-04-25T17:30:30.039 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.036+0000 7f3e037fe640 1 --2- 172.21.15.37:0/3900430444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e040fd1b0 0x7f3e04112d00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3df4002a50 tx=0x7f3df4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:30.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.036+0000 7f3debfff640 1 -- 172.21.15.37:0/3900430444 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3df4007c30 con 0x7f3e040fd1b0 2024-04-25T17:30:30.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.036+0000 7f3debfff640 1 -- 172.21.15.37:0/3900430444 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3df400f040 con 0x7f3e040fd1b0 2024-04-25T17:30:30.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.036+0000 7f3e09cae640 1 -- 172.21.15.37:0/3900430444 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e0410d170 con 0x7f3e040fd1b0 2024-04-25T17:30:30.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.036+0000 7f3debfff640 1 -- 172.21.15.37:0/3900430444 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3df400db50 con 0x7f3e040fd1b0 2024-04-25T17:30:30.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.036+0000 7f3e09cae640 1 -- 172.21.15.37:0/3900430444 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e0410d660 con 0x7f3e040fd1b0 2024-04-25T17:30:30.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.037+0000 7f3e09cae640 1 -- 172.21.15.37:0/3900430444 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e040659e0 con 0x7f3e040fd1b0 2024-04-25T17:30:30.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.038+0000 7f3debfff640 1 -- 172.21.15.37:0/3900430444 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f3df4009090 con 0x7f3e040fd1b0 2024-04-25T17:30:30.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.038+0000 7f3debfff640 1 --2- 172.21.15.37:0/3900430444 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f3dec076b00 0x7f3dec078fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:30.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.039+0000 7f3debfff640 1 -- 172.21.15.37:0/3900430444 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f3df4097ee0 con 0x7f3e040fd1b0 2024-04-25T17:30:30.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.039+0000 7f3e02ffd640 1 --2- 172.21.15.37:0/3900430444 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f3dec076b00 0x7f3dec078fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:30.041 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.039+0000 7f3e02ffd640 1 --2- 172.21.15.37:0/3900430444 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f3dec076b00 0x7f3dec078fb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3e040fe540 tx=0x7f3df8009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:30.043 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.043+0000 7f3debfff640 1 -- 172.21.15.37:0/3900430444 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f3df4060a40 con 0x7f3e040fd1b0 2024-04-25T17:30:30.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:29 smithi069 ceph-mon[80239]: pgmap v316: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:30:30.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:29 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/500374977' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-04-25T17:30:30.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:29 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/2874928422' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-04-25T17:30:30.273 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.272+0000 7f3e09cae640 1 -- 172.21.15.37:0/3900430444 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) v1 -- 0x7f3e040636f0 con 0x7f3e040fd1b0 2024-04-25T17:30:30.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.273+0000 7f3debfff640 1 -- 172.21.15.37:0/3900430444 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v35) v1 ==== 107+0+5209 (secure 0 0 0) 0x7f3df40603e0 con 0x7f3e040fd1b0 2024-04-25T17:30:30.274 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:30:30.274 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34444,"name":"cephfs.smithi037.ovkrpq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6829/2067664560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2067664560},{"type":"v1","addr":"172.21.15.37:6829","nonce":2067664560}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44347,"name":"cephfs.smithi069.ytlqcf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6825/3424891497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":3424891497},{"type":"v1","addr":"172.21.15.69:6825","nonce":3424891497}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":44379,"name":"cephfs.smithi069.cpprst","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6827/3383509929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":3383509929},{"type":"v1","addr":"172.21.15.69:6827","nonce":3383509929}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T17:15:40.586130+0000","modified":"2024-04-25T17:26:55.827422+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34412},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34412":{"gid":34412,"name":"cephfs.smithi037.ksmixc","rank":0,"incarnation":29,"state":"up:active","state_seq":18,"addr":"172.21.15.37:6827/2514248612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":2514248612},{"type":"v1","addr":"172.21.15.37:6827","nonce":2514248612}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34412,"qdb_cluster":[34412]},"id":1}]} 2024-04-25T17:30:30.274 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 33 2024-04-25T17:30:30.276 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.275+0000 7f3e09cae640 1 -- 172.21.15.37:0/3900430444 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f3dec076b00 msgr2=0x7f3dec078fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:30.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.275+0000 7f3e09cae640 1 --2- 172.21.15.37:0/3900430444 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f3dec076b00 0x7f3dec078fb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3e040fe540 tx=0x7f3df8009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:30.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.275+0000 7f3e09cae640 1 -- 172.21.15.37:0/3900430444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e040fd1b0 msgr2=0x7f3e04112d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:30.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.275+0000 7f3e09cae640 1 --2- 172.21.15.37:0/3900430444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e040fd1b0 0x7f3e04112d00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3df4002a50 tx=0x7f3df4004600 comp rx=0 tx=0).stop 2024-04-25T17:30:30.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.275+0000 7f3e09cae640 1 -- 172.21.15.37:0/3900430444 shutdown_connections 2024-04-25T17:30:30.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.275+0000 7f3e09cae640 1 --2- 172.21.15.37:0/3900430444 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f3dec076b00 0x7f3dec078fb0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:30.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.275+0000 7f3e09cae640 1 --2- 172.21.15.37:0/3900430444 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3e040fdb50 0x7f3e04113240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:30.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.275+0000 7f3e09cae640 1 --2- 172.21.15.37:0/3900430444 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3e040fd1b0 0x7f3e04112d00 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:30.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.275+0000 7f3e09cae640 1 -- 172.21.15.37:0/3900430444 >> 172.21.15.37:0/3900430444 conn(0x7f3e040f6c20 msgr2=0x7f3e040f8000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:30.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.276+0000 7f3e09cae640 1 -- 172.21.15.37:0/3900430444 shutdown_connections 2024-04-25T17:30:30.277 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.276+0000 7f3e09cae640 1 -- 172.21.15.37:0/3900430444 wait complete. 2024-04-25T17:30:30.286 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:29 smithi037 ceph-mon[90844]: pgmap v316: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:30:30.286 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:29 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/500374977' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-04-25T17:30:30.286 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:29 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/2874928422' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-04-25T17:30:30.287 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 33 2024-04-25T17:30:30.288 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 34 2024-04-25T17:30:30.388 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.386+0000 7f6101f5d640 1 -- 172.21.15.37:0/1328618423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60fc102230 msgr2=0x7f60fc102600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:30.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.386+0000 7f6101f5d640 1 --2- 172.21.15.37:0/1328618423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60fc102230 0x7f60fc102600 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f60ec0048d0 tx=0x7f60ec009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:30.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.386+0000 7f6101f5d640 1 -- 172.21.15.37:0/1328618423 shutdown_connections 2024-04-25T17:30:30.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.386+0000 7f6101f5d640 1 --2- 172.21.15.37:0/1328618423 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f60fc102bd0 0x7f60fc0fa8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:30.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.386+0000 7f6101f5d640 1 --2- 172.21.15.37:0/1328618423 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60fc102230 0x7f60fc102600 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:30.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.386+0000 7f6101f5d640 1 -- 172.21.15.37:0/1328618423 >> 172.21.15.37:0/1328618423 conn(0x7f60fc0717e0 msgr2=0x7f60fc071be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:30.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.386+0000 7f6101f5d640 1 -- 172.21.15.37:0/1328618423 shutdown_connections 2024-04-25T17:30:30.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.386+0000 7f6101f5d640 1 -- 172.21.15.37:0/1328618423 wait complete. 2024-04-25T17:30:30.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.386+0000 7f6101f5d640 1 Processor -- start 2024-04-25T17:30:30.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.387+0000 7f6101f5d640 1 -- start start 2024-04-25T17:30:30.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.387+0000 7f6101f5d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60fc102230 0x7f60fc112d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:30.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.387+0000 7f6101f5d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f60fc102bd0 0x7f60fc113270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:30.389 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.387+0000 7f6101f5d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60fc113870 con 0x7f60fc102230 2024-04-25T17:30:30.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.387+0000 7f6101f5d640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60fc10cec0 con 0x7f60fc102bd0 2024-04-25T17:30:30.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.387+0000 7f60fb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60fc102230 0x7f60fc112d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:30.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.387+0000 7f60fb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60fc102230 0x7f60fc112d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48668/0 (socket says 172.21.15.37:48668) 2024-04-25T17:30:30.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.387+0000 7f60fb7fe640 1 -- 172.21.15.37:0/1570000381 learned_addr learned my addr 172.21.15.37:0/1570000381 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:30:30.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.387+0000 7f60faffd640 1 --2- 172.21.15.37:0/1570000381 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f60fc102bd0 0x7f60fc113270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:30.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.387+0000 7f60fb7fe640 1 -- 172.21.15.37:0/1570000381 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f60fc102bd0 msgr2=0x7f60fc113270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:30.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.387+0000 7f60fb7fe640 1 --2- 172.21.15.37:0/1570000381 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f60fc102bd0 0x7f60fc113270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:30.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.387+0000 7f60fb7fe640 1 -- 172.21.15.37:0/1570000381 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60ec005040 con 0x7f60fc102230 2024-04-25T17:30:30.390 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.387+0000 7f60fb7fe640 1 --2- 172.21.15.37:0/1570000381 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60fc102230 0x7f60fc112d30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f60ec004930 tx=0x7f60ec009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:30.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.388+0000 7f60e3fff640 1 -- 172.21.15.37:0/1570000381 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60ec0094c0 con 0x7f60fc102230 2024-04-25T17:30:30.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.388+0000 7f60e3fff640 1 -- 172.21.15.37:0/1570000381 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f60ec032e50 con 0x7f60fc102230 2024-04-25T17:30:30.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.388+0000 7f6101f5d640 1 -- 172.21.15.37:0/1570000381 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60fc10d140 con 0x7f60fc102230 2024-04-25T17:30:30.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.388+0000 7f60e3fff640 1 -- 172.21.15.37:0/1570000381 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60ec0433b0 con 0x7f60fc102230 2024-04-25T17:30:30.391 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.388+0000 7f6101f5d640 1 -- 172.21.15.37:0/1570000381 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60fc10d600 con 0x7f60fc102230 2024-04-25T17:30:30.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.389+0000 7f6101f5d640 1 -- 172.21.15.37:0/1570000381 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60fc064350 con 0x7f60fc102230 2024-04-25T17:30:30.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.389+0000 7f60e3fff640 1 -- 172.21.15.37:0/1570000381 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f60ec02f070 con 0x7f60fc102230 2024-04-25T17:30:30.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.390+0000 7f60e3fff640 1 --2- 172.21.15.37:0/1570000381 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f60e4076b00 0x7f60e4078fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:30.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.390+0000 7f60e3fff640 1 -- 172.21.15.37:0/1570000381 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f60ec0ba240 con 0x7f60fc102230 2024-04-25T17:30:30.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.390+0000 7f60faffd640 1 --2- 172.21.15.37:0/1570000381 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f60e4076b00 0x7f60e4078fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:30.392 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.390+0000 7f60faffd640 1 --2- 172.21.15.37:0/1570000381 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f60e4076b00 0x7f60e4078fb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f60fc10e5f0 tx=0x7f60f000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:30.395 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.394+0000 7f60e3fff640 1 -- 172.21.15.37:0/1570000381 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f60ec082d20 con 0x7f60fc102230 2024-04-25T17:30:30.620 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.620+0000 7f6101f5d640 1 -- 172.21.15.37:0/1570000381 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) v1 -- 0x7f60fc1093f0 con 0x7f60fc102230 2024-04-25T17:30:30.621 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.620+0000 7f60e3fff640 1 -- 172.21.15.37:0/1570000381 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v35) v1 ==== 107+0+5208 (secure 0 0 0) 0x7f60ec0826c0 con 0x7f60fc102230 2024-04-25T17:30:30.621 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:30:30.621 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34444,"name":"cephfs.smithi037.ovkrpq","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6829/2067664560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2067664560},{"type":"v1","addr":"172.21.15.37:6829","nonce":2067664560}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44347,"name":"cephfs.smithi069.ytlqcf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6825/3424891497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":3424891497},{"type":"v1","addr":"172.21.15.69:6825","nonce":3424891497}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":44379,"name":"cephfs.smithi069.cpprst","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6827/3383509929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":3383509929},{"type":"v1","addr":"172.21.15.69:6827","nonce":3383509929}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-04-25T17:15:40.586130+0000","modified":"2024-04-25T17:26:59.987027+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":84,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34412},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34412":{"gid":34412,"name":"cephfs.smithi037.ksmixc","rank":0,"incarnation":29,"state":"up:active","state_seq":18,"addr":"172.21.15.37:6827/2514248612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6826","nonce":2514248612},{"type":"v1","addr":"172.21.15.37:6827","nonce":2514248612}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34412,"qdb_cluster":[34412]},"id":1}]} 2024-04-25T17:30:30.622 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 34 2024-04-25T17:30:30.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.622+0000 7f6101f5d640 1 -- 172.21.15.37:0/1570000381 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f60e4076b00 msgr2=0x7f60e4078fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:30.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.622+0000 7f6101f5d640 1 --2- 172.21.15.37:0/1570000381 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f60e4076b00 0x7f60e4078fb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f60fc10e5f0 tx=0x7f60f000b040 comp rx=0 tx=0).stop 2024-04-25T17:30:30.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.622+0000 7f6101f5d640 1 -- 172.21.15.37:0/1570000381 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60fc102230 msgr2=0x7f60fc112d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:30.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.622+0000 7f6101f5d640 1 --2- 172.21.15.37:0/1570000381 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60fc102230 0x7f60fc112d30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f60ec004930 tx=0x7f60ec009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:30.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.622+0000 7f6101f5d640 1 -- 172.21.15.37:0/1570000381 shutdown_connections 2024-04-25T17:30:30.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.622+0000 7f6101f5d640 1 --2- 172.21.15.37:0/1570000381 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f60e4076b00 0x7f60e4078fb0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:30.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.622+0000 7f6101f5d640 1 --2- 172.21.15.37:0/1570000381 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f60fc102bd0 0x7f60fc113270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:30.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.622+0000 7f6101f5d640 1 --2- 172.21.15.37:0/1570000381 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60fc102230 0x7f60fc112d30 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:30.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.622+0000 7f6101f5d640 1 -- 172.21.15.37:0/1570000381 >> 172.21.15.37:0/1570000381 conn(0x7f60fc0717e0 msgr2=0x7f60fc0fa100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:30.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.623+0000 7f6101f5d640 1 -- 172.21.15.37:0/1570000381 shutdown_connections 2024-04-25T17:30:30.624 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.623+0000 7f6101f5d640 1 -- 172.21.15.37:0/1570000381 wait complete. 2024-04-25T17:30:30.634 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-25T17:30:30.646 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-25T17:30:30.647 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-25T17:30:30.647 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T17:30:30.663 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-25T17:30:30.664 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T17:30:30.720 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T17:30:30.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.858+0000 7f169339d640 1 -- 172.21.15.37:0/32797086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f168c102b40 msgr2=0x7f168c0fc1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:30.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.858+0000 7f169339d640 1 --2- 172.21.15.37:0/32797086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f168c102b40 0x7f168c0fc1d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f167c0048d0 tx=0x7f167c009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:30.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.858+0000 7f169339d640 1 -- 172.21.15.37:0/32797086 shutdown_connections 2024-04-25T17:30:30.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.858+0000 7f169339d640 1 --2- 172.21.15.37:0/32797086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f168c102b40 0x7f168c0fc1d0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:30.861 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.858+0000 7f169339d640 1 --2- 172.21.15.37:0/32797086 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f168c1021a0 0x7f168c102570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:30.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.858+0000 7f169339d640 1 -- 172.21.15.37:0/32797086 >> 172.21.15.37:0/32797086 conn(0x7f168c0f7d90 msgr2=0x7f168c0fa1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:30.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.858+0000 7f169339d640 1 -- 172.21.15.37:0/32797086 shutdown_connections 2024-04-25T17:30:30.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.858+0000 7f169339d640 1 -- 172.21.15.37:0/32797086 wait complete. 2024-04-25T17:30:30.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.858+0000 7f169339d640 1 Processor -- start 2024-04-25T17:30:30.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.858+0000 7f169339d640 1 -- start start 2024-04-25T17:30:30.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.859+0000 7f169339d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f168c1021a0 0x7f168c112c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:30.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.859+0000 7f169339d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f168c102b40 0x7f168c1131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:30.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.859+0000 7f169339d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168c1137b0 con 0x7f168c102b40 2024-04-25T17:30:30.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.859+0000 7f169339d640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168c10ce00 con 0x7f168c1021a0 2024-04-25T17:30:30.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.859+0000 7f1690938640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f168c102b40 0x7f168c1131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:30.862 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.859+0000 7f1690938640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f168c102b40 0x7f168c1131b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48698/0 (socket says 172.21.15.37:48698) 2024-04-25T17:30:30.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.859+0000 7f1690938640 1 -- 172.21.15.37:0/4152460964 learned_addr learned my addr 172.21.15.37:0/4152460964 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:30:30.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.859+0000 7f1691139640 1 --2- 172.21.15.37:0/4152460964 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f168c1021a0 0x7f168c112c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:30.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.859+0000 7f1690938640 1 -- 172.21.15.37:0/4152460964 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f168c1021a0 msgr2=0x7f168c112c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:30.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.859+0000 7f1690938640 1 --2- 172.21.15.37:0/4152460964 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f168c1021a0 0x7f168c112c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:30.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.859+0000 7f1690938640 1 -- 172.21.15.37:0/4152460964 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f167c005040 con 0x7f168c102b40 2024-04-25T17:30:30.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.859+0000 7f1691139640 1 --2- 172.21.15.37:0/4152460964 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f168c1021a0 0x7f168c112c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T17:30:30.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.859+0000 7f1690938640 1 --2- 172.21.15.37:0/4152460964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f168c102b40 0x7f168c1131b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f167c004930 tx=0x7f167c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:30.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.859+0000 7f1681ffb640 1 -- 172.21.15.37:0/4152460964 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f167c0094c0 con 0x7f168c102b40 2024-04-25T17:30:30.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.859+0000 7f169339d640 1 -- 172.21.15.37:0/4152460964 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f168c10d080 con 0x7f168c102b40 2024-04-25T17:30:30.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.859+0000 7f1681ffb640 1 -- 172.21.15.37:0/4152460964 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f167c032e50 con 0x7f168c102b40 2024-04-25T17:30:30.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.859+0000 7f1681ffb640 1 -- 172.21.15.37:0/4152460964 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f167c0433b0 con 0x7f168c102b40 2024-04-25T17:30:30.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.860+0000 7f169339d640 1 -- 172.21.15.37:0/4152460964 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f168c10d540 con 0x7f168c102b40 2024-04-25T17:30:30.863 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.861+0000 7f169339d640 1 -- 172.21.15.37:0/4152460964 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f168c0fd910 con 0x7f168c102b40 2024-04-25T17:30:30.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.861+0000 7f1681ffb640 1 -- 172.21.15.37:0/4152460964 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f167c02f070 con 0x7f168c102b40 2024-04-25T17:30:30.864 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.862+0000 7f1681ffb640 1 --2- 172.21.15.37:0/4152460964 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f1678076b00 0x7f1678078fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:30.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.862+0000 7f1681ffb640 1 -- 172.21.15.37:0/4152460964 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f167c0ba3e0 con 0x7f168c102b40 2024-04-25T17:30:30.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.862+0000 7f1691139640 1 --2- 172.21.15.37:0/4152460964 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f1678076b00 0x7f1678078fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:30.865 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.862+0000 7f1691139640 1 --2- 172.21.15.37:0/4152460964 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f1678076b00 0x7f1678078fb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1688004c60 tx=0x7f1688009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:30.867 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:30.867+0000 7f1681ffb640 1 -- 172.21.15.37:0/4152460964 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f167c082ec0 con 0x7f168c102b40 2024-04-25T17:30:30.913 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:30 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/4010774236' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-04-25T17:30:30.914 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:30 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/3900430444' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-04-25T17:30:30.914 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:30 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/1570000381' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-04-25T17:30:31.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.054+0000 7f169339d640 1 -- 172.21.15.37:0/4152460964 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f168c109310 con 0x7f168c102b40 2024-04-25T17:30:31.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.055+0000 7f1681ffb640 1 -- 172.21.15.37:0/4152460964 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+16604 (secure 0 0 0) 0x7f167c082860 con 0x7f168c102b40 2024-04-25T17:30:31.057 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:30:31.057 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":84,"fsid":"599bb7fc-0326-11ef-bc93-c7b262605968","created":"2024-04-25T17:08:37.882631+0000","modified":"2024-04-25T17:26:43.463070+0000","last_up_change":"2024-04-25T17:25:37.943415+0000","last_in_change":"2024-04-25T17:14:01.927070+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T17:13:09.960202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-04-25T17:15:39.512161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-04-25T17:15:40.014896+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c142de25-7aff-4c4b-b351-14e7b18de11d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":49,"up_from":53,"up_thru":78,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2283035048},{"type":"v1","addr":"172.21.15.37:6803","nonce":2283035048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2283035048},{"type":"v1","addr":"172.21.15.37:6805","nonce":2283035048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2283035048},{"type":"v1","addr":"172.21.15.37:6809","nonce":2283035048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2283035048},{"type":"v1","addr":"172.21.15.37:6807","nonce":2283035048}]},"public_addr":"172.21.15.37:6803/2283035048","cluster_addr":"172.21.15.37:6805/2283035048","heartbeat_back_addr":"172.21.15.37:6809/2283035048","heartbeat_front_addr":"172.21.15.37:6807/2283035048","state":["exists","up"]},{"osd":1,"uuid":"ec683da0-f3c1-44b5-8f1d-69bec27fbe5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":54,"up_from":58,"up_thru":78,"down_at":55,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":914750118},{"type":"v1","addr":"172.21.15.37:6811","nonce":914750118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":914750118},{"type":"v1","addr":"172.21.15.37:6813","nonce":914750118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":914750118},{"type":"v1","addr":"172.21.15.37:6817","nonce":914750118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":914750118},{"type":"v1","addr":"172.21.15.37:6815","nonce":914750118}]},"public_addr":"172.21.15.37:6811/914750118","cluster_addr":"172.21.15.37:6813/914750118","heartbeat_back_addr":"172.21.15.37:6817/914750118","heartbeat_front_addr":"172.21.15.37:6815/914750118","state":["exists","up"]},{"osd":2,"uuid":"8bf4e67b-e95f-44d3-b51f-afd8a2d30e31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":59,"up_from":63,"up_thru":78,"down_at":60,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1533738118},{"type":"v1","addr":"172.21.15.37:6819","nonce":1533738118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1533738118},{"type":"v1","addr":"172.21.15.37:6821","nonce":1533738118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1533738118},{"type":"v1","addr":"172.21.15.37:6825","nonce":1533738118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1533738118},{"type":"v1","addr":"172.21.15.37:6823","nonce":1533738118}]},"public_addr":"172.21.15.37:6819/1533738118","cluster_addr":"172.21.15.37:6821/1533738118","heartbeat_back_addr":"172.21.15.37:6825/1533738118","heartbeat_front_addr":"172.21.15.37:6823/1533738118","state":["exists","up"]},{"osd":3,"uuid":"ce5ff1f7-472a-4515-b851-e434ee545b27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":27,"last_clean_end":64,"up_from":68,"up_thru":78,"down_at":65,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":1489573886},{"type":"v1","addr":"172.21.15.69:6801","nonce":1489573886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":1489573886},{"type":"v1","addr":"172.21.15.69:6803","nonce":1489573886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":1489573886},{"type":"v1","addr":"172.21.15.69:6807","nonce":1489573886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":1489573886},{"type":"v1","addr":"172.21.15.69:6805","nonce":1489573886}]},"public_addr":"172.21.15.69:6801/1489573886","cluster_addr":"172.21.15.69:6803/1489573886","heartbeat_back_addr":"172.21.15.69:6807/1489573886","heartbeat_front_addr":"172.21.15.69:6805/1489573886","state":["exists","up"]},{"osd":4,"uuid":"26cf2aeb-fc85-4d14-b936-08b8280489e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":35,"last_clean_end":69,"up_from":73,"up_thru":78,"down_at":70,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":2690453136},{"type":"v1","addr":"172.21.15.69:6809","nonce":2690453136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":2690453136},{"type":"v1","addr":"172.21.15.69:6811","nonce":2690453136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":2690453136},{"type":"v1","addr":"172.21.15.69:6815","nonce":2690453136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":2690453136},{"type":"v1","addr":"172.21.15.69:6813","nonce":2690453136}]},"public_addr":"172.21.15.69:6809/2690453136","cluster_addr":"172.21.15.69:6811/2690453136","heartbeat_back_addr":"172.21.15.69:6815/2690453136","heartbeat_front_addr":"172.21.15.69:6813/2690453136","state":["exists","up"]},{"osd":5,"uuid":"fb3edb82-8f78-40d6-a339-5c469ef08371","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":40,"last_clean_end":74,"up_from":78,"up_thru":78,"down_at":75,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":1114217891},{"type":"v1","addr":"172.21.15.69:6817","nonce":1114217891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":1114217891},{"type":"v1","addr":"172.21.15.69:6819","nonce":1114217891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":1114217891},{"type":"v1","addr":"172.21.15.69:6823","nonce":1114217891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":1114217891},{"type":"v1","addr":"172.21.15.69:6821","nonce":1114217891}]},"public_addr":"172.21.15.69:6817/1114217891","cluster_addr":"172.21.15.69:6819/1114217891","heartbeat_back_addr":"172.21.15.69:6823/1114217891","heartbeat_front_addr":"172.21.15.69:6821/1114217891","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T17:12:12.145795+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T17:12:39.059274+0000","dead_epoch":54},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T17:13:06.628770+0000","dead_epoch":59},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T17:13:29.779894+0000","dead_epoch":64},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T17:13:54.338391+0000","dead_epoch":69},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T17:14:18.637188+0000","dead_epoch":74}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:6826/518856100":"2024-04-26T17:26:43.463024+0000","172.21.15.37:0/2586714806":"2024-04-26T17:09:09.103933+0000","172.21.15.37:0/94916634":"2024-04-26T17:21:12.458619+0000","172.21.15.69:0/1328964531":"2024-04-26T17:19:49.912987+0000","172.21.15.37:0/2176923815":"2024-04-26T17:18:04.184013+0000","172.21.15.37:6801/3566135606":"2024-04-26T17:18:04.184013+0000","172.21.15.37:6800/3653320894":"2024-04-26T17:09:39.480662+0000","172.21.15.37:6827/1903989494":"2024-04-26T17:25:43.985393+0000","172.21.15.69:0/4008065866":"2024-04-26T17:19:49.912987+0000","172.21.15.37:6800/3566135606":"2024-04-26T17:18:04.184013+0000","172.21.15.37:6800/2509847167":"2024-04-26T17:09:09.103933+0000","172.21.15.69:0/1519610648":"2024-04-26T17:19:49.912987+0000","172.21.15.69:0/1505731340":"2024-04-26T17:19:49.912987+0000","172.21.15.37:0/1749794583":"2024-04-26T17:10:55.431694+0000","172.21.15.37:0/3729273779":"2024-04-26T17:21:12.458619+0000","172.21.15.37:0/3089604872":"2024-04-26T17:09:39.480662+0000","172.21.15.69:6827/518856100":"2024-04-26T17:26:43.463024+0000","172.21.15.37:0/3148505482":"2024-04-26T17:21:12.458619+0000","172.21.15.37:0/1135030866":"2024-04-26T17:09:39.480662+0000","172.21.15.37:0/767276846":"2024-04-26T17:18:04.184013+0000","172.21.15.37:6801/2509847167":"2024-04-26T17:09:09.103933+0000","172.21.15.37:0/1487666224":"2024-04-26T17:09:09.103933+0000","172.21.15.37:6800/1299348474":"2024-04-26T17:10:55.431694+0000","172.21.15.37:0/3689680514":"2024-04-26T17:09:39.480662+0000","172.21.15.37:0/3277643196":"2024-04-26T17:09:09.103933+0000","172.21.15.37:6801/3653320894":"2024-04-26T17:09:39.480662+0000","172.21.15.37:0/2627363304":"2024-04-26T17:18:04.184013+0000","172.21.15.69:6828/2602478":"2024-04-26T17:19:49.912987+0000","172.21.15.69:6829/2602478":"2024-04-26T17:19:49.912987+0000","172.21.15.37:0/4258551295":"2024-04-26T17:10:55.431694+0000","172.21.15.37:6800/709373822":"2024-04-26T17:21:12.458619+0000","172.21.15.37:6826/1903989494":"2024-04-26T17:25:43.985393+0000","172.21.15.37:0/350553669":"2024-04-26T17:10:55.431694+0000","172.21.15.37:0/4179549689":"2024-04-26T17:18:04.184013+0000","172.21.15.37:6801/1299348474":"2024-04-26T17:10:55.431694+0000","172.21.15.37:0/2626647662":"2024-04-26T17:21:12.458619+0000","172.21.15.37:6801/709373822":"2024-04-26T17:21:12.458619+0000","172.21.15.37:0/2702902167":"2024-04-26T17:21:12.458619+0000","172.21.15.37:0/3806998167":"2024-04-26T17:21:12.458619+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T17:30:31.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.057+0000 7f169339d640 1 -- 172.21.15.37:0/4152460964 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f1678076b00 msgr2=0x7f1678078fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:31.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.057+0000 7f169339d640 1 --2- 172.21.15.37:0/4152460964 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f1678076b00 0x7f1678078fb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1688004c60 tx=0x7f1688009040 comp rx=0 tx=0).stop 2024-04-25T17:30:31.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.057+0000 7f169339d640 1 -- 172.21.15.37:0/4152460964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f168c102b40 msgr2=0x7f168c1131b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:31.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.057+0000 7f169339d640 1 --2- 172.21.15.37:0/4152460964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f168c102b40 0x7f168c1131b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f167c004930 tx=0x7f167c009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:31.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.057+0000 7f169339d640 1 -- 172.21.15.37:0/4152460964 shutdown_connections 2024-04-25T17:30:31.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.057+0000 7f169339d640 1 --2- 172.21.15.37:0/4152460964 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f1678076b00 0x7f1678078fb0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:31.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.057+0000 7f169339d640 1 --2- 172.21.15.37:0/4152460964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f168c102b40 0x7f168c1131b0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:31.058 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.057+0000 7f169339d640 1 --2- 172.21.15.37:0/4152460964 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f168c1021a0 0x7f168c112c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:31.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.057+0000 7f169339d640 1 -- 172.21.15.37:0/4152460964 >> 172.21.15.37:0/4152460964 conn(0x7f168c0f7d90 msgr2=0x7f168c0f8d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:31.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.057+0000 7f169339d640 1 -- 172.21.15.37:0/4152460964 shutdown_connections 2024-04-25T17:30:31.059 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.057+0000 7f169339d640 1 -- 172.21.15.37:0/4152460964 wait complete. 2024-04-25T17:30:31.069 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T17:13:09.960202+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-04-25T17:15:39.512161+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-04-25T17:15:40.014896+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T17:30:31.070 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T17:30:31.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:30 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/4010774236' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-04-25T17:30:31.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:30 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/3900430444' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-04-25T17:30:31.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:30 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/1570000381' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-04-25T17:30:31.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.169+0000 7f451a0ae640 1 -- 172.21.15.37:0/476232286 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45141011c0 msgr2=0x7f45140fa880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:31.172 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.169+0000 7f451a0ae640 1 --2- 172.21.15.37:0/476232286 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45141011c0 0x7f45140fa880 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f45080049c0 tx=0x7f450800aeb0 comp rx=0 tx=0).stop 2024-04-25T17:30:31.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.169+0000 7f451a0ae640 1 -- 172.21.15.37:0/476232286 shutdown_connections 2024-04-25T17:30:31.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.169+0000 7f451a0ae640 1 --2- 172.21.15.37:0/476232286 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45141011c0 0x7f45140fa880 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:31.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.169+0000 7f451a0ae640 1 --2- 172.21.15.37:0/476232286 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45141008b0 0x7f4514100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:31.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.169+0000 7f451a0ae640 1 -- 172.21.15.37:0/476232286 >> 172.21.15.37:0/476232286 conn(0x7f4514071700 msgr2=0x7f4514071b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:31.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.169+0000 7f451a0ae640 1 -- 172.21.15.37:0/476232286 shutdown_connections 2024-04-25T17:30:31.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.169+0000 7f451a0ae640 1 -- 172.21.15.37:0/476232286 wait complete. 2024-04-25T17:30:31.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.170+0000 7f451a0ae640 1 Processor -- start 2024-04-25T17:30:31.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.170+0000 7f451a0ae640 1 -- start start 2024-04-25T17:30:31.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.170+0000 7f451a0ae640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45141008b0 0x7f4514112d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:31.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.170+0000 7f451a0ae640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45141011c0 0x7f45141132c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:31.173 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.170+0000 7f451a0ae640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45141138c0 con 0x7f45141008b0 2024-04-25T17:30:31.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.170+0000 7f451a0ae640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f451410cf10 con 0x7f45141011c0 2024-04-25T17:30:31.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.170+0000 7f45137fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45141008b0 0x7f4514112d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:31.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.170+0000 7f45137fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45141008b0 0x7f4514112d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48710/0 (socket says 172.21.15.37:48710) 2024-04-25T17:30:31.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.170+0000 7f45137fe640 1 -- 172.21.15.37:0/2988216126 learned_addr learned my addr 172.21.15.37:0/2988216126 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:30:31.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.170+0000 7f4512ffd640 1 --2- 172.21.15.37:0/2988216126 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45141011c0 0x7f45141132c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:31.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.171+0000 7f45137fe640 1 -- 172.21.15.37:0/2988216126 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45141011c0 msgr2=0x7f45141132c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:31.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.171+0000 7f45137fe640 1 --2- 172.21.15.37:0/2988216126 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45141011c0 0x7f45141132c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:31.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.171+0000 7f45137fe640 1 -- 172.21.15.37:0/2988216126 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4508005040 con 0x7f45141008b0 2024-04-25T17:30:31.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.171+0000 7f45137fe640 1 --2- 172.21.15.37:0/2988216126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45141008b0 0x7f4514112d80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4504002a50 tx=0x7f4504004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:31.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.171+0000 7f44fbfff640 1 -- 172.21.15.37:0/2988216126 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4504007c30 con 0x7f45141008b0 2024-04-25T17:30:31.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.171+0000 7f451a0ae640 1 -- 172.21.15.37:0/2988216126 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f451410d1f0 con 0x7f45141008b0 2024-04-25T17:30:31.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.171+0000 7f44fbfff640 1 -- 172.21.15.37:0/2988216126 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f450400f040 con 0x7f45141008b0 2024-04-25T17:30:31.174 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.171+0000 7f44fbfff640 1 -- 172.21.15.37:0/2988216126 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4504009540 con 0x7f45141008b0 2024-04-25T17:30:31.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.171+0000 7f451a0ae640 1 -- 172.21.15.37:0/2988216126 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f451410d760 con 0x7f45141008b0 2024-04-25T17:30:31.175 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.172+0000 7f451a0ae640 1 -- 172.21.15.37:0/2988216126 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45140fbf90 con 0x7f45141008b0 2024-04-25T17:30:31.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.173+0000 7f44fbfff640 1 -- 172.21.15.37:0/2988216126 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f4504009700 con 0x7f45141008b0 2024-04-25T17:30:31.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.173+0000 7f44fbfff640 1 --2- 172.21.15.37:0/2988216126 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f44fc076b40 0x7f44fc078ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:31.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.173+0000 7f44fbfff640 1 -- 172.21.15.37:0/2988216126 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f4504097c60 con 0x7f45141008b0 2024-04-25T17:30:31.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.173+0000 7f4512ffd640 1 --2- 172.21.15.37:0/2988216126 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f44fc076b40 0x7f44fc078ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:31.176 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.174+0000 7f4512ffd640 1 --2- 172.21.15.37:0/2988216126 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f44fc076b40 0x7f44fc078ff0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f450800abd0 tx=0x7f450800aeb0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:31.179 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.178+0000 7f44fbfff640 1 -- 172.21.15.37:0/2988216126 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f45040606c0 con 0x7f45141008b0 2024-04-25T17:30:31.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.364+0000 7f451a0ae640 1 -- 172.21.15.37:0/2988216126 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f451410e3f0 con 0x7f45141008b0 2024-04-25T17:30:31.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.364+0000 7f44fbfff640 1 -- 172.21.15.37:0/2988216126 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4504060060 con 0x7f45141008b0 2024-04-25T17:30:31.365 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-04-25T17:30:31.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.366+0000 7f451a0ae640 1 -- 172.21.15.37:0/2988216126 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f44fc076b40 msgr2=0x7f44fc078ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:31.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.366+0000 7f451a0ae640 1 --2- 172.21.15.37:0/2988216126 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f44fc076b40 0x7f44fc078ff0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f450800abd0 tx=0x7f450800aeb0 comp rx=0 tx=0).stop 2024-04-25T17:30:31.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.366+0000 7f451a0ae640 1 -- 172.21.15.37:0/2988216126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45141008b0 msgr2=0x7f4514112d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:31.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.366+0000 7f451a0ae640 1 --2- 172.21.15.37:0/2988216126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45141008b0 0x7f4514112d80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4504002a50 tx=0x7f4504004600 comp rx=0 tx=0).stop 2024-04-25T17:30:31.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.366+0000 7f451a0ae640 1 -- 172.21.15.37:0/2988216126 shutdown_connections 2024-04-25T17:30:31.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.366+0000 7f451a0ae640 1 --2- 172.21.15.37:0/2988216126 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f44fc076b40 0x7f44fc078ff0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:31.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.366+0000 7f451a0ae640 1 --2- 172.21.15.37:0/2988216126 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45141011c0 0x7f45141132c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:31.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.366+0000 7f451a0ae640 1 --2- 172.21.15.37:0/2988216126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f45141008b0 0x7f4514112d80 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:31.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.366+0000 7f451a0ae640 1 -- 172.21.15.37:0/2988216126 >> 172.21.15.37:0/2988216126 conn(0x7f4514071700 msgr2=0x7f45140fe980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:31.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.367+0000 7f451a0ae640 1 -- 172.21.15.37:0/2988216126 shutdown_connections 2024-04-25T17:30:31.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.367+0000 7f451a0ae640 1 -- 172.21.15.37:0/2988216126 wait complete. 2024-04-25T17:30:31.378 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-04-25T17:30:31.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.478+0000 7f621f79d640 1 -- 172.21.15.37:0/330208616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6218064380 msgr2=0x7f62180647d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:31.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.478+0000 7f621f79d640 1 --2- 172.21.15.37:0/330208616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6218064380 0x7f62180647d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f62080048d0 tx=0x7f6208009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:31.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.479+0000 7f621f79d640 1 -- 172.21.15.37:0/330208616 shutdown_connections 2024-04-25T17:30:31.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.479+0000 7f621f79d640 1 --2- 172.21.15.37:0/330208616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6218064380 0x7f62180647d0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:31.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.479+0000 7f621f79d640 1 --2- 172.21.15.37:0/330208616 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f62181021e0 0x7f62181025b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:31.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.479+0000 7f621f79d640 1 -- 172.21.15.37:0/330208616 >> 172.21.15.37:0/330208616 conn(0x7f62180710c0 msgr2=0x7f62180714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:31.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.479+0000 7f621f79d640 1 -- 172.21.15.37:0/330208616 shutdown_connections 2024-04-25T17:30:31.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.479+0000 7f621f79d640 1 -- 172.21.15.37:0/330208616 wait complete. 2024-04-25T17:30:31.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.479+0000 7f621f79d640 1 Processor -- start 2024-04-25T17:30:31.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.479+0000 7f621f79d640 1 -- start start 2024-04-25T17:30:31.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.479+0000 7f621f79d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6218064380 0x7f6218112c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:31.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.479+0000 7f621f79d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62181021e0 0x7f62181131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:31.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.479+0000 7f621f79d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62181137b0 con 0x7f62181021e0 2024-04-25T17:30:31.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.479+0000 7f621f79d640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f621810ce00 con 0x7f6218064380 2024-04-25T17:30:31.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.479+0000 7f621cd38640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62181021e0 0x7f62181131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:31.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.479+0000 7f621cd38640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62181021e0 0x7f62181131b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48736/0 (socket says 172.21.15.37:48736) 2024-04-25T17:30:31.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.479+0000 7f621cd38640 1 -- 172.21.15.37:0/4141745802 learned_addr learned my addr 172.21.15.37:0/4141745802 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:30:31.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.480+0000 7f621cd38640 1 -- 172.21.15.37:0/4141745802 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6218064380 msgr2=0x7f6218112c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:31.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.480+0000 7f621cd38640 1 --2- 172.21.15.37:0/4141745802 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6218064380 0x7f6218112c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:31.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.480+0000 7f621cd38640 1 -- 172.21.15.37:0/4141745802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6208005040 con 0x7f62181021e0 2024-04-25T17:30:31.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.480+0000 7f621cd38640 1 --2- 172.21.15.37:0/4141745802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62181021e0 0x7f62181131b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6208004930 tx=0x7f6208009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:31.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.480+0000 7f620dffb640 1 -- 172.21.15.37:0/4141745802 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62080094c0 con 0x7f62181021e0 2024-04-25T17:30:31.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.480+0000 7f620dffb640 1 -- 172.21.15.37:0/4141745802 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6208032e50 con 0x7f62181021e0 2024-04-25T17:30:31.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.480+0000 7f621f79d640 1 -- 172.21.15.37:0/4141745802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f621810d080 con 0x7f62181021e0 2024-04-25T17:30:31.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.480+0000 7f620dffb640 1 -- 172.21.15.37:0/4141745802 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62080433b0 con 0x7f62181021e0 2024-04-25T17:30:31.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.480+0000 7f621f79d640 1 -- 172.21.15.37:0/4141745802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f621810d540 con 0x7f62181021e0 2024-04-25T17:30:31.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.481+0000 7f621f79d640 1 -- 172.21.15.37:0/4141745802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62180fd8e0 con 0x7f62181021e0 2024-04-25T17:30:31.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.482+0000 7f620dffb640 1 -- 172.21.15.37:0/4141745802 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f620802f070 con 0x7f62181021e0 2024-04-25T17:30:31.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.482+0000 7f620dffb640 1 --2- 172.21.15.37:0/4141745802 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f6204076b00 0x7f6204078fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:31.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.482+0000 7f620dffb640 1 -- 172.21.15.37:0/4141745802 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f62080ba460 con 0x7f62181021e0 2024-04-25T17:30:31.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.482+0000 7f621d539640 1 --2- 172.21.15.37:0/4141745802 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f6204076b00 0x7f6204078fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:31.485 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.483+0000 7f621d539640 1 --2- 172.21.15.37:0/4141745802 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f6204076b00 0x7f6204078fb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6210004af0 tx=0x7f6210007c30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:31.488 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.487+0000 7f620dffb640 1 -- 172.21.15.37:0/4141745802 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f6208082ec0 con 0x7f62181021e0 2024-04-25T17:30:31.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.674+0000 7f621f79d640 1 -- 172.21.15.37:0/4141745802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f62181092b0 con 0x7f62181021e0 2024-04-25T17:30:31.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.674+0000 7f620dffb640 1 -- 172.21.15.37:0/4141745802 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v84) v1 ==== 107+0+11 (secure 0 0 0) 0x7f6208082860 con 0x7f62181021e0 2024-04-25T17:30:31.675 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2024-04-25T17:30:31.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.676+0000 7f621f79d640 1 -- 172.21.15.37:0/4141745802 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f6204076b00 msgr2=0x7f6204078fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:31.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.676+0000 7f621f79d640 1 --2- 172.21.15.37:0/4141745802 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f6204076b00 0x7f6204078fb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6210004af0 tx=0x7f6210007c30 comp rx=0 tx=0).stop 2024-04-25T17:30:31.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.676+0000 7f621f79d640 1 -- 172.21.15.37:0/4141745802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62181021e0 msgr2=0x7f62181131b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:31.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.676+0000 7f621f79d640 1 --2- 172.21.15.37:0/4141745802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62181021e0 0x7f62181131b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6208004930 tx=0x7f6208009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:31.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.676+0000 7f621f79d640 1 -- 172.21.15.37:0/4141745802 shutdown_connections 2024-04-25T17:30:31.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.676+0000 7f621f79d640 1 --2- 172.21.15.37:0/4141745802 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f6204076b00 0x7f6204078fb0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:31.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.676+0000 7f621f79d640 1 --2- 172.21.15.37:0/4141745802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f62181021e0 0x7f62181131b0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:31.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.676+0000 7f621f79d640 1 --2- 172.21.15.37:0/4141745802 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6218064380 0x7f6218112c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:31.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.676+0000 7f621f79d640 1 -- 172.21.15.37:0/4141745802 >> 172.21.15.37:0/4141745802 conn(0x7f62180710c0 msgr2=0x7f62180f9490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:31.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.676+0000 7f621f79d640 1 -- 172.21.15.37:0/4141745802 shutdown_connections 2024-04-25T17:30:31.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.676+0000 7f621f79d640 1 -- 172.21.15.37:0/4141745802 wait complete. 2024-04-25T17:30:31.688 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-04-25T17:30:31.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.787+0000 7f67c3c18640 1 -- 172.21.15.37:0/1570868294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67bc064380 msgr2=0x7f67bc0647d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:31.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.787+0000 7f67c3c18640 1 --2- 172.21.15.37:0/1570868294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67bc064380 0x7f67bc0647d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f67ac0048d0 tx=0x7f67ac009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:31.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.788+0000 7f67c3c18640 1 -- 172.21.15.37:0/1570868294 shutdown_connections 2024-04-25T17:30:31.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.788+0000 7f67c3c18640 1 --2- 172.21.15.37:0/1570868294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67bc064380 0x7f67bc0647d0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:31.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.788+0000 7f67c3c18640 1 --2- 172.21.15.37:0/1570868294 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f67bc1021e0 0x7f67bc1025b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:31.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.788+0000 7f67c3c18640 1 -- 172.21.15.37:0/1570868294 >> 172.21.15.37:0/1570868294 conn(0x7f67bc0710c0 msgr2=0x7f67bc0714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:31.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.788+0000 7f67c3c18640 1 -- 172.21.15.37:0/1570868294 shutdown_connections 2024-04-25T17:30:31.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.788+0000 7f67c3c18640 1 -- 172.21.15.37:0/1570868294 wait complete. 2024-04-25T17:30:31.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.788+0000 7f67c3c18640 1 Processor -- start 2024-04-25T17:30:31.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.788+0000 7f67c3c18640 1 -- start start 2024-04-25T17:30:31.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.788+0000 7f67c3c18640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67bc064380 0x7f67bc112c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:31.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.788+0000 7f67c3c18640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f67bc1021e0 0x7f67bc113190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:31.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.788+0000 7f67c3c18640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67bc113790 con 0x7f67bc064380 2024-04-25T17:30:31.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.788+0000 7f67c3c18640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67bc10cde0 con 0x7f67bc1021e0 2024-04-25T17:30:31.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.788+0000 7f67c19b4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67bc064380 0x7f67bc112c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:31.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.789+0000 7f67c19b4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67bc064380 0x7f67bc112c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48758/0 (socket says 172.21.15.37:48758) 2024-04-25T17:30:31.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.789+0000 7f67c19b4640 1 -- 172.21.15.37:0/1842066297 learned_addr learned my addr 172.21.15.37:0/1842066297 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:30:31.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.789+0000 7f67c19b4640 1 -- 172.21.15.37:0/1842066297 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f67bc1021e0 msgr2=0x7f67bc113190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:31.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.789+0000 7f67c19b4640 1 --2- 172.21.15.37:0/1842066297 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f67bc1021e0 0x7f67bc113190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:31.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.789+0000 7f67c19b4640 1 -- 172.21.15.37:0/1842066297 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67ac005040 con 0x7f67bc064380 2024-04-25T17:30:31.791 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.789+0000 7f67c19b4640 1 --2- 172.21.15.37:0/1842066297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67bc064380 0x7f67bc112c50 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f67b800db80 tx=0x7f67b8004f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:31.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.789+0000 7f67b27fc640 1 -- 172.21.15.37:0/1842066297 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67b800b950 con 0x7f67bc064380 2024-04-25T17:30:31.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.789+0000 7f67c3c18640 1 -- 172.21.15.37:0/1842066297 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67bc10d0c0 con 0x7f67bc064380 2024-04-25T17:30:31.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.789+0000 7f67b27fc640 1 -- 172.21.15.37:0/1842066297 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f67b800f040 con 0x7f67bc064380 2024-04-25T17:30:31.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.789+0000 7f67b27fc640 1 -- 172.21.15.37:0/1842066297 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67b80123b0 con 0x7f67bc064380 2024-04-25T17:30:31.792 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.789+0000 7f67c3c18640 1 -- 172.21.15.37:0/1842066297 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67bc10d5e0 con 0x7f67bc064380 2024-04-25T17:30:31.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.790+0000 7f67c3c18640 1 -- 172.21.15.37:0/1842066297 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67bc0fd8e0 con 0x7f67bc064380 2024-04-25T17:30:31.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.791+0000 7f67b27fc640 1 -- 172.21.15.37:0/1842066297 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f67b8013430 con 0x7f67bc064380 2024-04-25T17:30:31.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.791+0000 7f67b27fc640 1 --2- 172.21.15.37:0/1842066297 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f67a8076b00 0x7f67a8078fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:31.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.791+0000 7f67b27fc640 1 -- 172.21.15.37:0/1842066297 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f67b80983e0 con 0x7f67bc064380 2024-04-25T17:30:31.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.791+0000 7f67c11b3640 1 --2- 172.21.15.37:0/1842066297 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f67a8076b00 0x7f67a8078fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:31.793 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.792+0000 7f67c11b3640 1 --2- 172.21.15.37:0/1842066297 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f67a8076b00 0x7f67a8078fb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f67ac0043d0 tx=0x7f67ac009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:31.797 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.796+0000 7f67b27fc640 1 -- 172.21.15.37:0/1842066297 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f67b8060ec0 con 0x7f67bc064380 2024-04-25T17:30:31.980 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.980+0000 7f67c3c18640 1 -- 172.21.15.37:0/1842066297 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f67bc04bcc0 con 0x7f67bc064380 2024-04-25T17:30:31.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.980+0000 7f67b27fc640 1 -- 172.21.15.37:0/1842066297 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v84) v1 ==== 107+0+11 (secure 0 0 0) 0x7f67b8060860 con 0x7f67bc064380 2024-04-25T17:30:31.981 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2024-04-25T17:30:31.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.982+0000 7f67c3c18640 1 -- 172.21.15.37:0/1842066297 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f67a8076b00 msgr2=0x7f67a8078fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:31.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.982+0000 7f67c3c18640 1 --2- 172.21.15.37:0/1842066297 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f67a8076b00 0x7f67a8078fb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f67ac0043d0 tx=0x7f67ac009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:31.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.982+0000 7f67c3c18640 1 -- 172.21.15.37:0/1842066297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67bc064380 msgr2=0x7f67bc112c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:31.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.982+0000 7f67c3c18640 1 --2- 172.21.15.37:0/1842066297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67bc064380 0x7f67bc112c50 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f67b800db80 tx=0x7f67b8004f00 comp rx=0 tx=0).stop 2024-04-25T17:30:31.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.982+0000 7f67c3c18640 1 -- 172.21.15.37:0/1842066297 shutdown_connections 2024-04-25T17:30:31.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.982+0000 7f67c3c18640 1 --2- 172.21.15.37:0/1842066297 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f67a8076b00 0x7f67a8078fb0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:31.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.982+0000 7f67c3c18640 1 --2- 172.21.15.37:0/1842066297 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f67bc1021e0 0x7f67bc113190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:31.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.982+0000 7f67c3c18640 1 --2- 172.21.15.37:0/1842066297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f67bc064380 0x7f67bc112c50 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:31.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.982+0000 7f67c3c18640 1 -- 172.21.15.37:0/1842066297 >> 172.21.15.37:0/1842066297 conn(0x7f67bc0710c0 msgr2=0x7f67bc0f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:31.983 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.982+0000 7f67c3c18640 1 -- 172.21.15.37:0/1842066297 shutdown_connections 2024-04-25T17:30:31.984 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:31.982+0000 7f67c3c18640 1 -- 172.21.15.37:0/1842066297 wait complete. 2024-04-25T17:30:31.993 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:31 smithi037 ceph-mon[90844]: pgmap v317: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:30:31.993 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:31 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/4152460964' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T17:30:31.993 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:31 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/2988216126' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T17:30:31.993 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:31 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/4141745802' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-25T17:30:31.994 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T17:30:32.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.092+0000 7f4c496ae640 1 -- 172.21.15.37:0/1326718399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c441021d0 msgr2=0x7f4c441025a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:32.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.092+0000 7f4c496ae640 1 --2- 172.21.15.37:0/1326718399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c441021d0 0x7f4c441025a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4c340048d0 tx=0x7f4c34009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:32.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.092+0000 7f4c496ae640 1 -- 172.21.15.37:0/1326718399 shutdown_connections 2024-04-25T17:30:32.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.092+0000 7f4c496ae640 1 --2- 172.21.15.37:0/1326718399 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c44102b70 0x7f4c440fc200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:32.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.092+0000 7f4c496ae640 1 --2- 172.21.15.37:0/1326718399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c441021d0 0x7f4c441025a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:32.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.092+0000 7f4c496ae640 1 -- 172.21.15.37:0/1326718399 >> 172.21.15.37:0/1326718399 conn(0x7f4c440f7da0 msgr2=0x7f4c440fa1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:32.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.092+0000 7f4c496ae640 1 -- 172.21.15.37:0/1326718399 shutdown_connections 2024-04-25T17:30:32.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.092+0000 7f4c496ae640 1 -- 172.21.15.37:0/1326718399 wait complete. 2024-04-25T17:30:32.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.093+0000 7f4c496ae640 1 Processor -- start 2024-04-25T17:30:32.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.093+0000 7f4c496ae640 1 -- start start 2024-04-25T17:30:32.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.093+0000 7f4c496ae640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c441021d0 0x7f4c4406f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:32.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.093+0000 7f4c496ae640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c44102b70 0x7f4c4406fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:32.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.093+0000 7f4c496ae640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c44071650 con 0x7f4c441021d0 2024-04-25T17:30:32.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.093+0000 7f4c496ae640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c440701f0 con 0x7f4c44102b70 2024-04-25T17:30:32.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.093+0000 7f4c42ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c441021d0 0x7f4c4406f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:32.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.093+0000 7f4c42ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c441021d0 0x7f4c4406f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48772/0 (socket says 172.21.15.37:48772) 2024-04-25T17:30:32.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.093+0000 7f4c42ffd640 1 -- 172.21.15.37:0/9435658 learned_addr learned my addr 172.21.15.37:0/9435658 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:30:32.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.094+0000 7f4c42ffd640 1 -- 172.21.15.37:0/9435658 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c44102b70 msgr2=0x7f4c4406fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:32.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.094+0000 7f4c42ffd640 1 --2- 172.21.15.37:0/9435658 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c44102b70 0x7f4c4406fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:32.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.094+0000 7f4c42ffd640 1 -- 172.21.15.37:0/9435658 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c34005040 con 0x7f4c441021d0 2024-04-25T17:30:32.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.094+0000 7f4c42ffd640 1 --2- 172.21.15.37:0/9435658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c441021d0 0x7f4c4406f770 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4c34004930 tx=0x7f4c34009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:32.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.094+0000 7f4c2b7fe640 1 -- 172.21.15.37:0/9435658 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c340094c0 con 0x7f4c441021d0 2024-04-25T17:30:32.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.094+0000 7f4c496ae640 1 -- 172.21.15.37:0/9435658 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c44070470 con 0x7f4c441021d0 2024-04-25T17:30:32.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.094+0000 7f4c2b7fe640 1 -- 172.21.15.37:0/9435658 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4c34032e50 con 0x7f4c441021d0 2024-04-25T17:30:32.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.094+0000 7f4c2b7fe640 1 -- 172.21.15.37:0/9435658 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c340433b0 con 0x7f4c441021d0 2024-04-25T17:30:32.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.094+0000 7f4c496ae640 1 -- 172.21.15.37:0/9435658 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c44119390 con 0x7f4c441021d0 2024-04-25T17:30:32.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.095+0000 7f4c496ae640 1 -- 172.21.15.37:0/9435658 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c440fd940 con 0x7f4c441021d0 2024-04-25T17:30:32.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.096+0000 7f4c2b7fe640 1 -- 172.21.15.37:0/9435658 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f4c3402f070 con 0x7f4c441021d0 2024-04-25T17:30:32.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.096+0000 7f4c2b7fe640 1 --2- 172.21.15.37:0/9435658 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f4c2c076b00 0x7f4c2c078fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:32.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.096+0000 7f4c2b7fe640 1 -- 172.21.15.37:0/9435658 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f4c340ba3e0 con 0x7f4c441021d0 2024-04-25T17:30:32.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.096+0000 7f4c427fc640 1 --2- 172.21.15.37:0/9435658 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f4c2c076b00 0x7f4c2c078fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:32.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.097+0000 7f4c427fc640 1 --2- 172.21.15.37:0/9435658 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f4c2c076b00 0x7f4c2c078fb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4c44070ea0 tx=0x7f4c38007c30 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:32.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.101+0000 7f4c2b7fe640 1 -- 172.21.15.37:0/9435658 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f4c34082ec0 con 0x7f4c441021d0 2024-04-25T17:30:32.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:31 smithi069 ceph-mon[80239]: pgmap v317: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:30:32.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:31 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/4152460964' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T17:30:32.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:31 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/2988216126' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T17:30:32.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:31 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/4141745802' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-25T17:30:32.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.299+0000 7f4c496ae640 1 -- 172.21.15.37:0/9435658 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4c4404bcc0 con 0x7f4c441021d0 2024-04-25T17:30:32.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.299+0000 7f4c2b7fe640 1 -- 172.21.15.37:0/9435658 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 39 entries v84) v1 ==== 81+0+2296 (secure 0 0 0) 0x7f4c34082860 con 0x7f4c441021d0 2024-04-25T17:30:32.300 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.69:6826/518856100 2024-04-26T17:26:43.463024+0000 2024-04-25T17:30:32.301 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/2586714806 2024-04-26T17:09:09.103933+0000 2024-04-25T17:30:32.301 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/94916634 2024-04-26T17:21:12.458619+0000 2024-04-25T17:30:32.301 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.69:0/1328964531 2024-04-26T17:19:49.912987+0000 2024-04-25T17:30:32.301 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/2176923815 2024-04-26T17:18:04.184013+0000 2024-04-25T17:30:32.301 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6801/3566135606 2024-04-26T17:18:04.184013+0000 2024-04-25T17:30:32.301 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6800/3653320894 2024-04-26T17:09:39.480662+0000 2024-04-25T17:30:32.301 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6827/1903989494 2024-04-26T17:25:43.985393+0000 2024-04-25T17:30:32.301 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.69:0/4008065866 2024-04-26T17:19:49.912987+0000 2024-04-25T17:30:32.301 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6800/3566135606 2024-04-26T17:18:04.184013+0000 2024-04-25T17:30:32.301 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6800/2509847167 2024-04-26T17:09:09.103933+0000 2024-04-25T17:30:32.301 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.69:0/1519610648 2024-04-26T17:19:49.912987+0000 2024-04-25T17:30:32.301 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.69:0/1505731340 2024-04-26T17:19:49.912987+0000 2024-04-25T17:30:32.302 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/1749794583 2024-04-26T17:10:55.431694+0000 2024-04-25T17:30:32.302 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/3729273779 2024-04-26T17:21:12.458619+0000 2024-04-25T17:30:32.302 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/3089604872 2024-04-26T17:09:39.480662+0000 2024-04-25T17:30:32.302 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.69:6827/518856100 2024-04-26T17:26:43.463024+0000 2024-04-25T17:30:32.302 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/3148505482 2024-04-26T17:21:12.458619+0000 2024-04-25T17:30:32.302 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/1135030866 2024-04-26T17:09:39.480662+0000 2024-04-25T17:30:32.302 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/767276846 2024-04-26T17:18:04.184013+0000 2024-04-25T17:30:32.302 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6801/2509847167 2024-04-26T17:09:09.103933+0000 2024-04-25T17:30:32.302 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/1487666224 2024-04-26T17:09:09.103933+0000 2024-04-25T17:30:32.302 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6800/1299348474 2024-04-26T17:10:55.431694+0000 2024-04-25T17:30:32.302 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/3689680514 2024-04-26T17:09:39.480662+0000 2024-04-25T17:30:32.302 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/3277643196 2024-04-26T17:09:09.103933+0000 2024-04-25T17:30:32.302 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6801/3653320894 2024-04-26T17:09:39.480662+0000 2024-04-25T17:30:32.303 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/2627363304 2024-04-26T17:18:04.184013+0000 2024-04-25T17:30:32.303 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.69:6828/2602478 2024-04-26T17:19:49.912987+0000 2024-04-25T17:30:32.303 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.69:6829/2602478 2024-04-26T17:19:49.912987+0000 2024-04-25T17:30:32.303 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/4258551295 2024-04-26T17:10:55.431694+0000 2024-04-25T17:30:32.303 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6800/709373822 2024-04-26T17:21:12.458619+0000 2024-04-25T17:30:32.303 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6826/1903989494 2024-04-26T17:25:43.985393+0000 2024-04-25T17:30:32.303 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/350553669 2024-04-26T17:10:55.431694+0000 2024-04-25T17:30:32.303 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/4179549689 2024-04-26T17:18:04.184013+0000 2024-04-25T17:30:32.303 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6801/1299348474 2024-04-26T17:10:55.431694+0000 2024-04-25T17:30:32.303 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/2626647662 2024-04-26T17:21:12.458619+0000 2024-04-25T17:30:32.303 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6801/709373822 2024-04-26T17:21:12.458619+0000 2024-04-25T17:30:32.303 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/2702902167 2024-04-26T17:21:12.458619+0000 2024-04-25T17:30:32.303 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/3806998167 2024-04-26T17:21:12.458619+0000 2024-04-25T17:30:32.304 INFO:teuthology.orchestra.run.smithi037.stderr:listed 39 entries 2024-04-25T17:30:32.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.302+0000 7f4c496ae640 1 -- 172.21.15.37:0/9435658 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f4c2c076b00 msgr2=0x7f4c2c078fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:32.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.302+0000 7f4c496ae640 1 --2- 172.21.15.37:0/9435658 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f4c2c076b00 0x7f4c2c078fb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4c44070ea0 tx=0x7f4c38007c30 comp rx=0 tx=0).stop 2024-04-25T17:30:32.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.302+0000 7f4c496ae640 1 -- 172.21.15.37:0/9435658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c441021d0 msgr2=0x7f4c4406f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:32.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.302+0000 7f4c496ae640 1 --2- 172.21.15.37:0/9435658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c441021d0 0x7f4c4406f770 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4c34004930 tx=0x7f4c34009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:32.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.302+0000 7f4c496ae640 1 -- 172.21.15.37:0/9435658 shutdown_connections 2024-04-25T17:30:32.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.302+0000 7f4c496ae640 1 --2- 172.21.15.37:0/9435658 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f4c2c076b00 0x7f4c2c078fb0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:32.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.302+0000 7f4c496ae640 1 --2- 172.21.15.37:0/9435658 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4c44102b70 0x7f4c4406fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:32.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.302+0000 7f4c496ae640 1 --2- 172.21.15.37:0/9435658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4c441021d0 0x7f4c4406f770 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:32.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.302+0000 7f4c496ae640 1 -- 172.21.15.37:0/9435658 >> 172.21.15.37:0/9435658 conn(0x7f4c440f7da0 msgr2=0x7f4c440f8d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:32.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.302+0000 7f4c496ae640 1 -- 172.21.15.37:0/9435658 shutdown_connections 2024-04-25T17:30:32.305 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.302+0000 7f4c496ae640 1 -- 172.21.15.37:0/9435658 wait complete. 2024-04-25T17:30:32.313 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-04-25T17:30:32.313 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T17:30:32.330 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T17:30:32.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.466+0000 7fccf7f5d640 1 -- 172.21.15.37:0/4188792850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccf0102b40 msgr2=0x7fccf00fc1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:32.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.466+0000 7fccf7f5d640 1 --2- 172.21.15.37:0/4188792850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccf0102b40 0x7fccf00fc1d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fcce40048d0 tx=0x7fcce4009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:32.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.467+0000 7fccf7f5d640 1 -- 172.21.15.37:0/4188792850 shutdown_connections 2024-04-25T17:30:32.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.467+0000 7fccf7f5d640 1 --2- 172.21.15.37:0/4188792850 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccf0102b40 0x7fccf00fc1d0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:32.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.467+0000 7fccf7f5d640 1 --2- 172.21.15.37:0/4188792850 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fccf01021a0 0x7fccf0102570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:32.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.467+0000 7fccf7f5d640 1 -- 172.21.15.37:0/4188792850 >> 172.21.15.37:0/4188792850 conn(0x7fccf00f7d30 msgr2=0x7fccf00fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:32.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.467+0000 7fccf7f5d640 1 -- 172.21.15.37:0/4188792850 shutdown_connections 2024-04-25T17:30:32.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.467+0000 7fccf7f5d640 1 -- 172.21.15.37:0/4188792850 wait complete. 2024-04-25T17:30:32.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.467+0000 7fccf7f5d640 1 Processor -- start 2024-04-25T17:30:32.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.467+0000 7fccf7f5d640 1 -- start start 2024-04-25T17:30:32.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.467+0000 7fccf7f5d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccf01021a0 0x7fccf0112ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:32.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.467+0000 7fccf7f5d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fccf0102b40 0x7fccf0113220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:32.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.467+0000 7fccf7f5d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf0113820 con 0x7fccf01021a0 2024-04-25T17:30:32.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.467+0000 7fccf7f5d640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf010ce70 con 0x7fccf0102b40 2024-04-25T17:30:32.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.467+0000 7fccf5cf9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccf01021a0 0x7fccf0112ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:32.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.467+0000 7fccf5cf9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccf01021a0 0x7fccf0112ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48794/0 (socket says 172.21.15.37:48794) 2024-04-25T17:30:32.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.468+0000 7fccf5cf9640 1 -- 172.21.15.37:0/3743631442 learned_addr learned my addr 172.21.15.37:0/3743631442 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:30:32.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.468+0000 7fccf54f8640 1 --2- 172.21.15.37:0/3743631442 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fccf0102b40 0x7fccf0113220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:32.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.468+0000 7fccf5cf9640 1 -- 172.21.15.37:0/3743631442 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fccf0102b40 msgr2=0x7fccf0113220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:32.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.468+0000 7fccf5cf9640 1 --2- 172.21.15.37:0/3743631442 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fccf0102b40 0x7fccf0113220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:32.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.468+0000 7fccf5cf9640 1 -- 172.21.15.37:0/3743631442 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce4005040 con 0x7fccf01021a0 2024-04-25T17:30:32.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.468+0000 7fccf5cf9640 1 --2- 172.21.15.37:0/3743631442 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccf01021a0 0x7fccf0112ce0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fcce800db80 tx=0x7fcce8004f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:32.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.468+0000 7fccee7fc640 1 -- 172.21.15.37:0/3743631442 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcce800b950 con 0x7fccf01021a0 2024-04-25T17:30:32.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.468+0000 7fccee7fc640 1 -- 172.21.15.37:0/3743631442 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcce800f040 con 0x7fccf01021a0 2024-04-25T17:30:32.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.468+0000 7fccf7f5d640 1 -- 172.21.15.37:0/3743631442 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccf010d150 con 0x7fccf01021a0 2024-04-25T17:30:32.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.468+0000 7fccee7fc640 1 -- 172.21.15.37:0/3743631442 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcce80123b0 con 0x7fccf01021a0 2024-04-25T17:30:32.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.468+0000 7fccf7f5d640 1 -- 172.21.15.37:0/3743631442 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccf010d640 con 0x7fccf01021a0 2024-04-25T17:30:32.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.469+0000 7fccf7f5d640 1 -- 172.21.15.37:0/3743631442 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccf00fd910 con 0x7fccf01021a0 2024-04-25T17:30:32.472 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.470+0000 7fccee7fc640 1 -- 172.21.15.37:0/3743631442 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7fcce8013430 con 0x7fccf01021a0 2024-04-25T17:30:32.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.470+0000 7fccee7fc640 1 --2- 172.21.15.37:0/3743631442 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fccd8076b00 0x7fccd8078fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:32.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.470+0000 7fccee7fc640 1 -- 172.21.15.37:0/3743631442 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fcce8098540 con 0x7fccf01021a0 2024-04-25T17:30:32.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.470+0000 7fccf54f8640 1 --2- 172.21.15.37:0/3743631442 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fccd8076b00 0x7fccd8078fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:32.473 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.471+0000 7fccf54f8640 1 --2- 172.21.15.37:0/3743631442 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fccd8076b00 0x7fccd8078fb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fccf00fa7e0 tx=0x7fcce4009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:32.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.475+0000 7fccee7fc640 1 -- 172.21.15.37:0/3743631442 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fcce8061020 con 0x7fccf01021a0 2024-04-25T17:30:32.666 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.665+0000 7fccf7f5d640 1 -- 172.21.15.37:0/3743631442 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fccf010e350 con 0x7fccf01021a0 2024-04-25T17:30:32.667 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.667+0000 7fccee7fc640 1 -- 172.21.15.37:0/3743631442 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+16604 (secure 0 0 0) 0x7fcce80609c0 con 0x7fccf01021a0 2024-04-25T17:30:32.668 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-04-25T17:30:32.668 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":84,"fsid":"599bb7fc-0326-11ef-bc93-c7b262605968","created":"2024-04-25T17:08:37.882631+0000","modified":"2024-04-25T17:26:43.463070+0000","last_up_change":"2024-04-25T17:25:37.943415+0000","last_in_change":"2024-04-25T17:14:01.927070+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T17:13:09.960202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-04-25T17:15:39.512161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-04-25T17:15:40.014896+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c142de25-7aff-4c4b-b351-14e7b18de11d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":49,"up_from":53,"up_thru":78,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":2283035048},{"type":"v1","addr":"172.21.15.37:6803","nonce":2283035048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":2283035048},{"type":"v1","addr":"172.21.15.37:6805","nonce":2283035048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2283035048},{"type":"v1","addr":"172.21.15.37:6809","nonce":2283035048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":2283035048},{"type":"v1","addr":"172.21.15.37:6807","nonce":2283035048}]},"public_addr":"172.21.15.37:6803/2283035048","cluster_addr":"172.21.15.37:6805/2283035048","heartbeat_back_addr":"172.21.15.37:6809/2283035048","heartbeat_front_addr":"172.21.15.37:6807/2283035048","state":["exists","up"]},{"osd":1,"uuid":"ec683da0-f3c1-44b5-8f1d-69bec27fbe5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":54,"up_from":58,"up_thru":78,"down_at":55,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":914750118},{"type":"v1","addr":"172.21.15.37:6811","nonce":914750118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":914750118},{"type":"v1","addr":"172.21.15.37:6813","nonce":914750118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":914750118},{"type":"v1","addr":"172.21.15.37:6817","nonce":914750118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6814","nonce":914750118},{"type":"v1","addr":"172.21.15.37:6815","nonce":914750118}]},"public_addr":"172.21.15.37:6811/914750118","cluster_addr":"172.21.15.37:6813/914750118","heartbeat_back_addr":"172.21.15.37:6817/914750118","heartbeat_front_addr":"172.21.15.37:6815/914750118","state":["exists","up"]},{"osd":2,"uuid":"8bf4e67b-e95f-44d3-b51f-afd8a2d30e31","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":59,"up_from":63,"up_thru":78,"down_at":60,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1533738118},{"type":"v1","addr":"172.21.15.37:6819","nonce":1533738118}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1533738118},{"type":"v1","addr":"172.21.15.37:6821","nonce":1533738118}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1533738118},{"type":"v1","addr":"172.21.15.37:6825","nonce":1533738118}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6822","nonce":1533738118},{"type":"v1","addr":"172.21.15.37:6823","nonce":1533738118}]},"public_addr":"172.21.15.37:6819/1533738118","cluster_addr":"172.21.15.37:6821/1533738118","heartbeat_back_addr":"172.21.15.37:6825/1533738118","heartbeat_front_addr":"172.21.15.37:6823/1533738118","state":["exists","up"]},{"osd":3,"uuid":"ce5ff1f7-472a-4515-b851-e434ee545b27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":27,"last_clean_end":64,"up_from":68,"up_thru":78,"down_at":65,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":1489573886},{"type":"v1","addr":"172.21.15.69:6801","nonce":1489573886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":1489573886},{"type":"v1","addr":"172.21.15.69:6803","nonce":1489573886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":1489573886},{"type":"v1","addr":"172.21.15.69:6807","nonce":1489573886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":1489573886},{"type":"v1","addr":"172.21.15.69:6805","nonce":1489573886}]},"public_addr":"172.21.15.69:6801/1489573886","cluster_addr":"172.21.15.69:6803/1489573886","heartbeat_back_addr":"172.21.15.69:6807/1489573886","heartbeat_front_addr":"172.21.15.69:6805/1489573886","state":["exists","up"]},{"osd":4,"uuid":"26cf2aeb-fc85-4d14-b936-08b8280489e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":35,"last_clean_end":69,"up_from":73,"up_thru":78,"down_at":70,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":2690453136},{"type":"v1","addr":"172.21.15.69:6809","nonce":2690453136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":2690453136},{"type":"v1","addr":"172.21.15.69:6811","nonce":2690453136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":2690453136},{"type":"v1","addr":"172.21.15.69:6815","nonce":2690453136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":2690453136},{"type":"v1","addr":"172.21.15.69:6813","nonce":2690453136}]},"public_addr":"172.21.15.69:6809/2690453136","cluster_addr":"172.21.15.69:6811/2690453136","heartbeat_back_addr":"172.21.15.69:6815/2690453136","heartbeat_front_addr":"172.21.15.69:6813/2690453136","state":["exists","up"]},{"osd":5,"uuid":"fb3edb82-8f78-40d6-a339-5c469ef08371","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":40,"last_clean_end":74,"up_from":78,"up_thru":78,"down_at":75,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":1114217891},{"type":"v1","addr":"172.21.15.69:6817","nonce":1114217891}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":1114217891},{"type":"v1","addr":"172.21.15.69:6819","nonce":1114217891}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":1114217891},{"type":"v1","addr":"172.21.15.69:6823","nonce":1114217891}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":1114217891},{"type":"v1","addr":"172.21.15.69:6821","nonce":1114217891}]},"public_addr":"172.21.15.69:6817/1114217891","cluster_addr":"172.21.15.69:6819/1114217891","heartbeat_back_addr":"172.21.15.69:6823/1114217891","heartbeat_front_addr":"172.21.15.69:6821/1114217891","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T17:12:12.145795+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T17:12:39.059274+0000","dead_epoch":54},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T17:13:06.628770+0000","dead_epoch":59},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T17:13:29.779894+0000","dead_epoch":64},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T17:13:54.338391+0000","dead_epoch":69},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T17:14:18.637188+0000","dead_epoch":74}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:6826/518856100":"2024-04-26T17:26:43.463024+0000","172.21.15.37:0/2586714806":"2024-04-26T17:09:09.103933+0000","172.21.15.37:0/94916634":"2024-04-26T17:21:12.458619+0000","172.21.15.69:0/1328964531":"2024-04-26T17:19:49.912987+0000","172.21.15.37:0/2176923815":"2024-04-26T17:18:04.184013+0000","172.21.15.37:6801/3566135606":"2024-04-26T17:18:04.184013+0000","172.21.15.37:6800/3653320894":"2024-04-26T17:09:39.480662+0000","172.21.15.37:6827/1903989494":"2024-04-26T17:25:43.985393+0000","172.21.15.69:0/4008065866":"2024-04-26T17:19:49.912987+0000","172.21.15.37:6800/3566135606":"2024-04-26T17:18:04.184013+0000","172.21.15.37:6800/2509847167":"2024-04-26T17:09:09.103933+0000","172.21.15.69:0/1519610648":"2024-04-26T17:19:49.912987+0000","172.21.15.69:0/1505731340":"2024-04-26T17:19:49.912987+0000","172.21.15.37:0/1749794583":"2024-04-26T17:10:55.431694+0000","172.21.15.37:0/3729273779":"2024-04-26T17:21:12.458619+0000","172.21.15.37:0/3089604872":"2024-04-26T17:09:39.480662+0000","172.21.15.69:6827/518856100":"2024-04-26T17:26:43.463024+0000","172.21.15.37:0/3148505482":"2024-04-26T17:21:12.458619+0000","172.21.15.37:0/1135030866":"2024-04-26T17:09:39.480662+0000","172.21.15.37:0/767276846":"2024-04-26T17:18:04.184013+0000","172.21.15.37:6801/2509847167":"2024-04-26T17:09:09.103933+0000","172.21.15.37:0/1487666224":"2024-04-26T17:09:09.103933+0000","172.21.15.37:6800/1299348474":"2024-04-26T17:10:55.431694+0000","172.21.15.37:0/3689680514":"2024-04-26T17:09:39.480662+0000","172.21.15.37:0/3277643196":"2024-04-26T17:09:09.103933+0000","172.21.15.37:6801/3653320894":"2024-04-26T17:09:39.480662+0000","172.21.15.37:0/2627363304":"2024-04-26T17:18:04.184013+0000","172.21.15.69:6828/2602478":"2024-04-26T17:19:49.912987+0000","172.21.15.69:6829/2602478":"2024-04-26T17:19:49.912987+0000","172.21.15.37:0/4258551295":"2024-04-26T17:10:55.431694+0000","172.21.15.37:6800/709373822":"2024-04-26T17:21:12.458619+0000","172.21.15.37:6826/1903989494":"2024-04-26T17:25:43.985393+0000","172.21.15.37:0/350553669":"2024-04-26T17:10:55.431694+0000","172.21.15.37:0/4179549689":"2024-04-26T17:18:04.184013+0000","172.21.15.37:6801/1299348474":"2024-04-26T17:10:55.431694+0000","172.21.15.37:0/2626647662":"2024-04-26T17:21:12.458619+0000","172.21.15.37:6801/709373822":"2024-04-26T17:21:12.458619+0000","172.21.15.37:0/2702902167":"2024-04-26T17:21:12.458619+0000","172.21.15.37:0/3806998167":"2024-04-26T17:21:12.458619+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T17:30:32.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.669+0000 7fccf7f5d640 1 -- 172.21.15.37:0/3743631442 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fccd8076b00 msgr2=0x7fccd8078fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:32.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.669+0000 7fccf7f5d640 1 --2- 172.21.15.37:0/3743631442 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fccd8076b00 0x7fccd8078fb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fccf00fa7e0 tx=0x7fcce4009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:32.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.669+0000 7fccf7f5d640 1 -- 172.21.15.37:0/3743631442 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccf01021a0 msgr2=0x7fccf0112ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:32.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.669+0000 7fccf7f5d640 1 --2- 172.21.15.37:0/3743631442 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccf01021a0 0x7fccf0112ce0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fcce800db80 tx=0x7fcce8004f00 comp rx=0 tx=0).stop 2024-04-25T17:30:32.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.669+0000 7fccf7f5d640 1 -- 172.21.15.37:0/3743631442 shutdown_connections 2024-04-25T17:30:32.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.669+0000 7fccf7f5d640 1 --2- 172.21.15.37:0/3743631442 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fccd8076b00 0x7fccd8078fb0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:32.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.669+0000 7fccf7f5d640 1 --2- 172.21.15.37:0/3743631442 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fccf0102b40 0x7fccf0113220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:32.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.669+0000 7fccf7f5d640 1 --2- 172.21.15.37:0/3743631442 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fccf01021a0 0x7fccf0112ce0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:32.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.669+0000 7fccf7f5d640 1 -- 172.21.15.37:0/3743631442 >> 172.21.15.37:0/3743631442 conn(0x7fccf00f7d30 msgr2=0x7fccf00f8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:32.670 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.669+0000 7fccf7f5d640 1 -- 172.21.15.37:0/3743631442 shutdown_connections 2024-04-25T17:30:32.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.669+0000 7fccf7f5d640 1 -- 172.21.15.37:0/3743631442 wait complete. 2024-04-25T17:30:32.681 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T17:13:09.960202+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-04-25T17:15:39.512161+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-04-25T17:15:40.014896+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T17:30:32.681 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T17:30:32.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.780+0000 7fba65265640 1 -- 172.21.15.37:0/266286743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba60101a40 msgr2=0x7fba600fb0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:32.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.780+0000 7fba65265640 1 --2- 172.21.15.37:0/266286743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba60101a40 0x7fba600fb0d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fba480048d0 tx=0x7fba48009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:32.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.780+0000 7fba65265640 1 -- 172.21.15.37:0/266286743 shutdown_connections 2024-04-25T17:30:32.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.780+0000 7fba65265640 1 --2- 172.21.15.37:0/266286743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba60101a40 0x7fba600fb0d0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:32.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.780+0000 7fba65265640 1 --2- 172.21.15.37:0/266286743 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba601010a0 0x7fba60101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:32.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.780+0000 7fba65265640 1 -- 172.21.15.37:0/266286743 >> 172.21.15.37:0/266286743 conn(0x7fba600f6c90 msgr2=0x7fba600f90a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:32.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.780+0000 7fba65265640 1 -- 172.21.15.37:0/266286743 shutdown_connections 2024-04-25T17:30:32.783 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.780+0000 7fba65265640 1 -- 172.21.15.37:0/266286743 wait complete. 2024-04-25T17:30:32.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.781+0000 7fba65265640 1 Processor -- start 2024-04-25T17:30:32.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.781+0000 7fba65265640 1 -- start start 2024-04-25T17:30:32.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.781+0000 7fba65265640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba601010a0 0x7fba60112c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:32.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.781+0000 7fba65265640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba60101a40 0x7fba601131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:32.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.781+0000 7fba65265640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba601137b0 con 0x7fba60101a40 2024-04-25T17:30:32.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.781+0000 7fba65265640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba60113920 con 0x7fba601010a0 2024-04-25T17:30:32.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.781+0000 7fba5e7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba60101a40 0x7fba601131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:32.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.781+0000 7fba5e7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba60101a40 0x7fba601131b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48804/0 (socket says 172.21.15.37:48804) 2024-04-25T17:30:32.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.781+0000 7fba5e7fc640 1 -- 172.21.15.37:0/2244884100 learned_addr learned my addr 172.21.15.37:0/2244884100 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:30:32.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.782+0000 7fba5effd640 1 --2- 172.21.15.37:0/2244884100 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba601010a0 0x7fba60112c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:32.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.782+0000 7fba5e7fc640 1 -- 172.21.15.37:0/2244884100 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba601010a0 msgr2=0x7fba60112c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:32.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.782+0000 7fba5e7fc640 1 --2- 172.21.15.37:0/2244884100 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba601010a0 0x7fba60112c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:32.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.782+0000 7fba5e7fc640 1 -- 172.21.15.37:0/2244884100 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba48005040 con 0x7fba60101a40 2024-04-25T17:30:32.784 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.782+0000 7fba5effd640 1 --2- 172.21.15.37:0/2244884100 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba601010a0 0x7fba60112c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T17:30:32.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.782+0000 7fba5e7fc640 1 --2- 172.21.15.37:0/2244884100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba60101a40 0x7fba601131b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fba48004930 tx=0x7fba48009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:32.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.782+0000 7fba577fe640 1 -- 172.21.15.37:0/2244884100 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba480094c0 con 0x7fba60101a40 2024-04-25T17:30:32.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.782+0000 7fba65265640 1 -- 172.21.15.37:0/2244884100 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba6010cfc0 con 0x7fba60101a40 2024-04-25T17:30:32.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.782+0000 7fba577fe640 1 -- 172.21.15.37:0/2244884100 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fba48032e50 con 0x7fba60101a40 2024-04-25T17:30:32.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.782+0000 7fba577fe640 1 -- 172.21.15.37:0/2244884100 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba480433b0 con 0x7fba60101a40 2024-04-25T17:30:32.785 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.782+0000 7fba65265640 1 -- 172.21.15.37:0/2244884100 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba6010d480 con 0x7fba60101a40 2024-04-25T17:30:32.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.783+0000 7fba65265640 1 -- 172.21.15.37:0/2244884100 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba600fc810 con 0x7fba60101a40 2024-04-25T17:30:32.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.784+0000 7fba577fe640 1 -- 172.21.15.37:0/2244884100 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7fba4802f070 con 0x7fba60101a40 2024-04-25T17:30:32.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.784+0000 7fba577fe640 1 --2- 172.21.15.37:0/2244884100 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fba4c076b00 0x7fba4c078fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:32.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.784+0000 7fba577fe640 1 -- 172.21.15.37:0/2244884100 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fba480ba460 con 0x7fba60101a40 2024-04-25T17:30:32.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.784+0000 7fba5effd640 1 --2- 172.21.15.37:0/2244884100 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fba4c076b00 0x7fba4c078fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:32.786 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.785+0000 7fba5effd640 1 --2- 172.21.15.37:0/2244884100 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fba4c076b00 0x7fba4c078fb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fba580041d0 tx=0x7fba58009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:32.790 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.789+0000 7fba577fe640 1 -- 172.21.15.37:0/2244884100 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fba48082ec0 con 0x7fba60101a40 2024-04-25T17:30:32.978 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.978+0000 7fba65265640 1 -- 172.21.15.37:0/2244884100 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fba60108200 con 0x7fba60101a40 2024-04-25T17:30:32.979 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.978+0000 7fba577fe640 1 -- 172.21.15.37:0/2244884100 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7fba48082860 con 0x7fba60101a40 2024-04-25T17:30:32.979 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2024-04-25T17:30:32.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.980+0000 7fba65265640 1 -- 172.21.15.37:0/2244884100 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fba4c076b00 msgr2=0x7fba4c078fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:32.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.980+0000 7fba65265640 1 --2- 172.21.15.37:0/2244884100 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fba4c076b00 0x7fba4c078fb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fba580041d0 tx=0x7fba58009040 comp rx=0 tx=0).stop 2024-04-25T17:30:32.981 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.980+0000 7fba65265640 1 -- 172.21.15.37:0/2244884100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba60101a40 msgr2=0x7fba601131b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:32.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.980+0000 7fba65265640 1 --2- 172.21.15.37:0/2244884100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba60101a40 0x7fba601131b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fba48004930 tx=0x7fba48009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:32.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.980+0000 7fba65265640 1 -- 172.21.15.37:0/2244884100 shutdown_connections 2024-04-25T17:30:32.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.980+0000 7fba65265640 1 --2- 172.21.15.37:0/2244884100 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fba4c076b00 0x7fba4c078fb0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:32.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.980+0000 7fba65265640 1 --2- 172.21.15.37:0/2244884100 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba60101a40 0x7fba601131b0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:32.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.980+0000 7fba65265640 1 --2- 172.21.15.37:0/2244884100 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba601010a0 0x7fba60112c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:32.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.980+0000 7fba65265640 1 -- 172.21.15.37:0/2244884100 >> 172.21.15.37:0/2244884100 conn(0x7fba600f6c90 msgr2=0x7fba600f8370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:32.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.981+0000 7fba65265640 1 -- 172.21.15.37:0/2244884100 shutdown_connections 2024-04-25T17:30:32.982 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:32.981+0000 7fba65265640 1 -- 172.21.15.37:0/2244884100 wait complete. 2024-04-25T17:30:32.991 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:32 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/1842066297' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-25T17:30:32.991 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:32 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/9435658' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-25T17:30:32.991 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:32 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/3743631442' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T17:30:32.992 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-04-25T17:30:33.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.092+0000 7f9127b1d640 1 -- 172.21.15.37:0/2545034060 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91201010b0 msgr2=0x7f9120101480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:33.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.092+0000 7f9127b1d640 1 --2- 172.21.15.37:0/2545034060 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91201010b0 0x7f9120101480 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f911c0048d0 tx=0x7f911c009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:33.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.092+0000 7f9127b1d640 1 -- 172.21.15.37:0/2545034060 shutdown_connections 2024-04-25T17:30:33.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.092+0000 7f9127b1d640 1 --2- 172.21.15.37:0/2545034060 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9120101a50 0x7f91200fb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:33.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.092+0000 7f9127b1d640 1 --2- 172.21.15.37:0/2545034060 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91201010b0 0x7f9120101480 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:33.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.092+0000 7f9127b1d640 1 -- 172.21.15.37:0/2545034060 >> 172.21.15.37:0/2545034060 conn(0x7f91200f6cc0 msgr2=0x7f91200f90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:33.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.092+0000 7f9127b1d640 1 -- 172.21.15.37:0/2545034060 shutdown_connections 2024-04-25T17:30:33.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.092+0000 7f9127b1d640 1 -- 172.21.15.37:0/2545034060 wait complete. 2024-04-25T17:30:33.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.093+0000 7f9127b1d640 1 Processor -- start 2024-04-25T17:30:33.095 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.093+0000 7f9127b1d640 1 -- start start 2024-04-25T17:30:33.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.093+0000 7f9127b1d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91201010b0 0x7f9120111c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:33.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.093+0000 7f9127b1d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9120101a50 0x7f9120112140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:33.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.093+0000 7f9127b1d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9120112740 con 0x7f91201010b0 2024-04-25T17:30:33.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.093+0000 7f9127b1d640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f912010bd90 con 0x7f9120101a50 2024-04-25T17:30:33.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.093+0000 7f91258b9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91201010b0 0x7f9120111c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:33.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.093+0000 7f91258b9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91201010b0 0x7f9120111c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48810/0 (socket says 172.21.15.37:48810) 2024-04-25T17:30:33.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.093+0000 7f91258b9640 1 -- 172.21.15.37:0/3991723177 learned_addr learned my addr 172.21.15.37:0/3991723177 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:30:33.096 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.093+0000 7f91258b9640 1 -- 172.21.15.37:0/3991723177 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9120101a50 msgr2=0x7f9120112140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:33.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.093+0000 7f91250b8640 1 --2- 172.21.15.37:0/3991723177 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9120101a50 0x7f9120112140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:33.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.093+0000 7f91258b9640 1 --2- 172.21.15.37:0/3991723177 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9120101a50 0x7f9120112140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:33.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.093+0000 7f91258b9640 1 -- 172.21.15.37:0/3991723177 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f911c005040 con 0x7f91201010b0 2024-04-25T17:30:33.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.093+0000 7f91258b9640 1 --2- 172.21.15.37:0/3991723177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91201010b0 0x7f9120111c00 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f911c004930 tx=0x7f911c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:33.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.094+0000 7f91167fc640 1 -- 172.21.15.37:0/3991723177 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f911c0094c0 con 0x7f91201010b0 2024-04-25T17:30:33.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.094+0000 7f9127b1d640 1 -- 172.21.15.37:0/3991723177 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f912010c010 con 0x7f91201010b0 2024-04-25T17:30:33.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.094+0000 7f91167fc640 1 -- 172.21.15.37:0/3991723177 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f911c032e50 con 0x7f91201010b0 2024-04-25T17:30:33.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.094+0000 7f91167fc640 1 -- 172.21.15.37:0/3991723177 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f911c0433b0 con 0x7f91201010b0 2024-04-25T17:30:33.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.094+0000 7f9127b1d640 1 -- 172.21.15.37:0/3991723177 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f912010c4d0 con 0x7f91201010b0 2024-04-25T17:30:33.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.095+0000 7f9127b1d640 1 -- 172.21.15.37:0/3991723177 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91200fc820 con 0x7f91201010b0 2024-04-25T17:30:33.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.095+0000 7f91167fc640 1 -- 172.21.15.37:0/3991723177 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7f911c02f070 con 0x7f91201010b0 2024-04-25T17:30:33.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.096+0000 7f91167fc640 1 --2- 172.21.15.37:0/3991723177 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f910c076b00 0x7f910c078fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:33.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.096+0000 7f91167fc640 1 -- 172.21.15.37:0/3991723177 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f911c0ba460 con 0x7f91201010b0 2024-04-25T17:30:33.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.096+0000 7f91250b8640 1 --2- 172.21.15.37:0/3991723177 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f910c076b00 0x7f910c078fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:33.099 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.096+0000 7f91250b8640 1 --2- 172.21.15.37:0/3991723177 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f910c076b00 0x7f910c078fb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9110007fd0 tx=0x7f9110009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:33.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.101+0000 7f91167fc640 1 -- 172.21.15.37:0/3991723177 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7f911c082ec0 con 0x7f91201010b0 2024-04-25T17:30:33.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.284+0000 7f9127b1d640 1 -- 172.21.15.37:0/3991723177 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f912010d270 con 0x7f91201010b0 2024-04-25T17:30:33.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.285+0000 7f91167fc640 1 -- 172.21.15.37:0/3991723177 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v84) v1 ==== 107+0+11 (secure 0 0 0) 0x7f911c082860 con 0x7f91201010b0 2024-04-25T17:30:33.286 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2024-04-25T17:30:33.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.287+0000 7f9127b1d640 1 -- 172.21.15.37:0/3991723177 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f910c076b00 msgr2=0x7f910c078fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:33.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.287+0000 7f9127b1d640 1 --2- 172.21.15.37:0/3991723177 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f910c076b00 0x7f910c078fb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9110007fd0 tx=0x7f9110009040 comp rx=0 tx=0).stop 2024-04-25T17:30:33.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.287+0000 7f9127b1d640 1 -- 172.21.15.37:0/3991723177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91201010b0 msgr2=0x7f9120111c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:33.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.287+0000 7f9127b1d640 1 --2- 172.21.15.37:0/3991723177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91201010b0 0x7f9120111c00 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f911c004930 tx=0x7f911c009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:33.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.287+0000 7f9127b1d640 1 -- 172.21.15.37:0/3991723177 shutdown_connections 2024-04-25T17:30:33.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.287+0000 7f9127b1d640 1 --2- 172.21.15.37:0/3991723177 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7f910c076b00 0x7f910c078fb0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:33.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.287+0000 7f9127b1d640 1 --2- 172.21.15.37:0/3991723177 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9120101a50 0x7f9120112140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:33.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.287+0000 7f9127b1d640 1 --2- 172.21.15.37:0/3991723177 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91201010b0 0x7f9120111c00 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:33.288 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.287+0000 7f9127b1d640 1 -- 172.21.15.37:0/3991723177 >> 172.21.15.37:0/3991723177 conn(0x7f91200f6cc0 msgr2=0x7f91200f7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:33.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.287+0000 7f9127b1d640 1 -- 172.21.15.37:0/3991723177 shutdown_connections 2024-04-25T17:30:33.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.287+0000 7f9127b1d640 1 -- 172.21.15.37:0/3991723177 wait complete. 2024-04-25T17:30:33.302 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-04-25T17:30:33.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.402+0000 7fba5dd5d640 1 -- 172.21.15.37:0/4117310715 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba58102180 msgr2=0x7fba58102550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:33.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.402+0000 7fba5dd5d640 1 --2- 172.21.15.37:0/4117310715 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba58102180 0x7fba58102550 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fba480048d0 tx=0x7fba48009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:33.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.402+0000 7fba5dd5d640 1 -- 172.21.15.37:0/4117310715 shutdown_connections 2024-04-25T17:30:33.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.402+0000 7fba5dd5d640 1 --2- 172.21.15.37:0/4117310715 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba58102b20 0x7fba580fc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:33.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.402+0000 7fba5dd5d640 1 --2- 172.21.15.37:0/4117310715 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba58102180 0x7fba58102550 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:33.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.402+0000 7fba5dd5d640 1 -- 172.21.15.37:0/4117310715 >> 172.21.15.37:0/4117310715 conn(0x7fba580f7db0 msgr2=0x7fba580fa1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:33.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.402+0000 7fba5dd5d640 1 -- 172.21.15.37:0/4117310715 shutdown_connections 2024-04-25T17:30:33.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.402+0000 7fba5dd5d640 1 -- 172.21.15.37:0/4117310715 wait complete. 2024-04-25T17:30:33.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.403+0000 7fba5dd5d640 1 Processor -- start 2024-04-25T17:30:33.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.403+0000 7fba5dd5d640 1 -- start start 2024-04-25T17:30:33.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.403+0000 7fba5dd5d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba58102180 0x7fba58112cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:33.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.403+0000 7fba5dd5d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba58102b20 0x7fba58113200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:33.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.403+0000 7fba5dd5d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba58113800 con 0x7fba58102180 2024-04-25T17:30:33.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.403+0000 7fba5dd5d640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba5810ce50 con 0x7fba58102b20 2024-04-25T17:30:33.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.403+0000 7fba577fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba58102180 0x7fba58112cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:33.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.403+0000 7fba577fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba58102180 0x7fba58112cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48824/0 (socket says 172.21.15.37:48824) 2024-04-25T17:30:33.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.403+0000 7fba577fe640 1 -- 172.21.15.37:0/3154014706 learned_addr learned my addr 172.21.15.37:0/3154014706 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:30:33.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.403+0000 7fba56ffd640 1 --2- 172.21.15.37:0/3154014706 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba58102b20 0x7fba58113200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:33.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.403+0000 7fba577fe640 1 -- 172.21.15.37:0/3154014706 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba58102b20 msgr2=0x7fba58113200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:33.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.403+0000 7fba577fe640 1 --2- 172.21.15.37:0/3154014706 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba58102b20 0x7fba58113200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:33.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.403+0000 7fba577fe640 1 -- 172.21.15.37:0/3154014706 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba48005040 con 0x7fba58102180 2024-04-25T17:30:33.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.404+0000 7fba577fe640 1 --2- 172.21.15.37:0/3154014706 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba58102180 0x7fba58112cc0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fba48004930 tx=0x7fba48009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:33.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.404+0000 7fba3ffff640 1 -- 172.21.15.37:0/3154014706 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba480094c0 con 0x7fba58102180 2024-04-25T17:30:33.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.404+0000 7fba5dd5d640 1 -- 172.21.15.37:0/3154014706 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba5810d0d0 con 0x7fba58102180 2024-04-25T17:30:33.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.404+0000 7fba3ffff640 1 -- 172.21.15.37:0/3154014706 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fba48032e50 con 0x7fba58102180 2024-04-25T17:30:33.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.404+0000 7fba3ffff640 1 -- 172.21.15.37:0/3154014706 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba480433b0 con 0x7fba58102180 2024-04-25T17:30:33.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.404+0000 7fba5dd5d640 1 -- 172.21.15.37:0/3154014706 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba5810d590 con 0x7fba58102180 2024-04-25T17:30:33.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.405+0000 7fba5dd5d640 1 -- 172.21.15.37:0/3154014706 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba580fd8f0 con 0x7fba58102180 2024-04-25T17:30:33.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.405+0000 7fba3ffff640 1 -- 172.21.15.37:0/3154014706 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7fba4802f070 con 0x7fba58102180 2024-04-25T17:30:33.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.406+0000 7fba3ffff640 1 --2- 172.21.15.37:0/3154014706 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fba40076b00 0x7fba40078fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:33.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.406+0000 7fba3ffff640 1 -- 172.21.15.37:0/3154014706 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fba480ba290 con 0x7fba58102180 2024-04-25T17:30:33.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.406+0000 7fba56ffd640 1 --2- 172.21.15.37:0/3154014706 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fba40076b00 0x7fba40078fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:33.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.406+0000 7fba56ffd640 1 --2- 172.21.15.37:0/3154014706 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fba40076b00 0x7fba40078fb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fba4c007fd0 tx=0x7fba4c009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:33.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.411+0000 7fba3ffff640 1 -- 172.21.15.37:0/3154014706 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fba48082d70 con 0x7fba58102180 2024-04-25T17:30:33.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:32 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/1842066297' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-25T17:30:33.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:32 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/9435658' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-25T17:30:33.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:32 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/3743631442' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-04-25T17:30:33.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.598+0000 7fba5dd5d640 1 -- 172.21.15.37:0/3154014706 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fba5804bcc0 con 0x7fba58102180 2024-04-25T17:30:33.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.599+0000 7fba3ffff640 1 -- 172.21.15.37:0/3154014706 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v84) v1 ==== 107+0+11 (secure 0 0 0) 0x7fba48082710 con 0x7fba58102180 2024-04-25T17:30:33.600 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2024-04-25T17:30:33.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.601+0000 7fba5dd5d640 1 -- 172.21.15.37:0/3154014706 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fba40076b00 msgr2=0x7fba40078fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:33.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.601+0000 7fba5dd5d640 1 --2- 172.21.15.37:0/3154014706 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fba40076b00 0x7fba40078fb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fba4c007fd0 tx=0x7fba4c009e90 comp rx=0 tx=0).stop 2024-04-25T17:30:33.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.601+0000 7fba5dd5d640 1 -- 172.21.15.37:0/3154014706 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba58102180 msgr2=0x7fba58112cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:33.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.601+0000 7fba5dd5d640 1 --2- 172.21.15.37:0/3154014706 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba58102180 0x7fba58112cc0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fba48004930 tx=0x7fba48009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:33.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.601+0000 7fba5dd5d640 1 -- 172.21.15.37:0/3154014706 shutdown_connections 2024-04-25T17:30:33.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.601+0000 7fba5dd5d640 1 --2- 172.21.15.37:0/3154014706 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fba40076b00 0x7fba40078fb0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:33.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.601+0000 7fba5dd5d640 1 --2- 172.21.15.37:0/3154014706 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba58102b20 0x7fba58113200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:33.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.601+0000 7fba5dd5d640 1 --2- 172.21.15.37:0/3154014706 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fba58102180 0x7fba58112cc0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:33.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.601+0000 7fba5dd5d640 1 -- 172.21.15.37:0/3154014706 >> 172.21.15.37:0/3154014706 conn(0x7fba580f7db0 msgr2=0x7fba580f8dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:33.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.601+0000 7fba5dd5d640 1 -- 172.21.15.37:0/3154014706 shutdown_connections 2024-04-25T17:30:33.602 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.601+0000 7fba5dd5d640 1 -- 172.21.15.37:0/3154014706 wait complete. 2024-04-25T17:30:33.613 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T17:30:33.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.711+0000 7fcf2c59d640 1 -- 172.21.15.37:0/2475950547 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf240fdcf0 msgr2=0x7fcf241063c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:33.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.711+0000 7fcf2c59d640 1 --2- 172.21.15.37:0/2475950547 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf240fdcf0 0x7fcf241063c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fcf140048d0 tx=0x7fcf14009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:33.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.711+0000 7fcf2c59d640 1 -- 172.21.15.37:0/2475950547 shutdown_connections 2024-04-25T17:30:33.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.711+0000 7fcf2c59d640 1 --2- 172.21.15.37:0/2475950547 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf240fdcf0 0x7fcf241063c0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:33.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.711+0000 7fcf2c59d640 1 --2- 172.21.15.37:0/2475950547 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcf240fd3e0 0x7fcf240fd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:33.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.711+0000 7fcf2c59d640 1 -- 172.21.15.37:0/2475950547 >> 172.21.15.37:0/2475950547 conn(0x7fcf240f6e70 msgr2=0x7fcf240f9280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:33.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.712+0000 7fcf2c59d640 1 -- 172.21.15.37:0/2475950547 shutdown_connections 2024-04-25T17:30:33.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.712+0000 7fcf2c59d640 1 -- 172.21.15.37:0/2475950547 wait complete. 2024-04-25T17:30:33.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.712+0000 7fcf2c59d640 1 Processor -- start 2024-04-25T17:30:33.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.712+0000 7fcf2c59d640 1 -- start start 2024-04-25T17:30:33.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.712+0000 7fcf2c59d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf240fd3e0 0x7fcf24115190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:33.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.712+0000 7fcf2c59d640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcf240fdcf0 0x7fcf241156d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:33.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.712+0000 7fcf2c59d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf24115cd0 con 0x7fcf240fd3e0 2024-04-25T17:30:33.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.712+0000 7fcf2c59d640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2410f320 con 0x7fcf240fdcf0 2024-04-25T17:30:33.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.712+0000 7fcf2a339640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf240fd3e0 0x7fcf24115190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:33.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.712+0000 7fcf2a339640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf240fd3e0 0x7fcf24115190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:48834/0 (socket says 172.21.15.37:48834) 2024-04-25T17:30:33.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.712+0000 7fcf2a339640 1 -- 172.21.15.37:0/2681886115 learned_addr learned my addr 172.21.15.37:0/2681886115 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-04-25T17:30:33.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.712+0000 7fcf29b38640 1 --2- 172.21.15.37:0/2681886115 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcf240fdcf0 0x7fcf241156d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:33.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.713+0000 7fcf2a339640 1 -- 172.21.15.37:0/2681886115 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcf240fdcf0 msgr2=0x7fcf241156d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:33.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.713+0000 7fcf2a339640 1 --2- 172.21.15.37:0/2681886115 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcf240fdcf0 0x7fcf241156d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:33.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.713+0000 7fcf2a339640 1 -- 172.21.15.37:0/2681886115 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf14005040 con 0x7fcf240fd3e0 2024-04-25T17:30:33.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.713+0000 7fcf2a339640 1 --2- 172.21.15.37:0/2681886115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf240fd3e0 0x7fcf24115190 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c002a50 tx=0x7fcf1c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:33.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.713+0000 7fcf1affd640 1 -- 172.21.15.37:0/2681886115 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf1c007c30 con 0x7fcf240fd3e0 2024-04-25T17:30:33.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.713+0000 7fcf2c59d640 1 -- 172.21.15.37:0/2681886115 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf2410f600 con 0x7fcf240fd3e0 2024-04-25T17:30:33.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.713+0000 7fcf1affd640 1 -- 172.21.15.37:0/2681886115 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcf1c00f040 con 0x7fcf240fd3e0 2024-04-25T17:30:33.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.713+0000 7fcf1affd640 1 -- 172.21.15.37:0/2681886115 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf1c00db50 con 0x7fcf240fd3e0 2024-04-25T17:30:33.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.713+0000 7fcf2c59d640 1 -- 172.21.15.37:0/2681886115 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf2410fb20 con 0x7fcf240fd3e0 2024-04-25T17:30:33.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.714+0000 7fcf2c59d640 1 -- 172.21.15.37:0/2681886115 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf24065e10 con 0x7fcf240fd3e0 2024-04-25T17:30:33.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.715+0000 7fcf1affd640 1 -- 172.21.15.37:0/2681886115 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 39) v1 ==== 98661+0+0 (secure 0 0 0) 0x7fcf1c01c400 con 0x7fcf240fd3e0 2024-04-25T17:30:33.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.715+0000 7fcf1affd640 1 --2- 172.21.15.37:0/2681886115 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fcf10076b00 0x7fcf10078fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T17:30:33.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.715+0000 7fcf1affd640 1 -- 172.21.15.37:0/2681886115 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fcf1c097c90 con 0x7fcf240fd3e0 2024-04-25T17:30:33.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.715+0000 7fcf29b38640 1 --2- 172.21.15.37:0/2681886115 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fcf10076b00 0x7fcf10078fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T17:30:33.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.716+0000 7fcf29b38640 1 --2- 172.21.15.37:0/2681886115 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fcf10076b00 0x7fcf10078fb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fcf24110a50 tx=0x7fcf14009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T17:30:33.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.720+0000 7fcf1affd640 1 -- 172.21.15.37:0/2681886115 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188370 (secure 0 0 0) 0x7fcf1c060770 con 0x7fcf240fd3e0 2024-04-25T17:30:33.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.918+0000 7fcf2c59d640 1 -- 172.21.15.37:0/2681886115 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fcf24063930 con 0x7fcf240fd3e0 2024-04-25T17:30:33.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.918+0000 7fcf1affd640 1 -- 172.21.15.37:0/2681886115 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 39 entries v84) v1 ==== 81+0+2296 (secure 0 0 0) 0x7fcf1c060110 con 0x7fcf240fd3e0 2024-04-25T17:30:33.920 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.69:6826/518856100 2024-04-26T17:26:43.463024+0000 2024-04-25T17:30:33.920 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/2586714806 2024-04-26T17:09:09.103933+0000 2024-04-25T17:30:33.921 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/94916634 2024-04-26T17:21:12.458619+0000 2024-04-25T17:30:33.921 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.69:0/1328964531 2024-04-26T17:19:49.912987+0000 2024-04-25T17:30:33.921 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/2176923815 2024-04-26T17:18:04.184013+0000 2024-04-25T17:30:33.921 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6801/3566135606 2024-04-26T17:18:04.184013+0000 2024-04-25T17:30:33.921 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6800/3653320894 2024-04-26T17:09:39.480662+0000 2024-04-25T17:30:33.921 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6827/1903989494 2024-04-26T17:25:43.985393+0000 2024-04-25T17:30:33.921 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.69:0/4008065866 2024-04-26T17:19:49.912987+0000 2024-04-25T17:30:33.921 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6800/3566135606 2024-04-26T17:18:04.184013+0000 2024-04-25T17:30:33.921 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6800/2509847167 2024-04-26T17:09:09.103933+0000 2024-04-25T17:30:33.921 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.69:0/1519610648 2024-04-26T17:19:49.912987+0000 2024-04-25T17:30:33.921 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.69:0/1505731340 2024-04-26T17:19:49.912987+0000 2024-04-25T17:30:33.921 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/1749794583 2024-04-26T17:10:55.431694+0000 2024-04-25T17:30:33.921 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/3729273779 2024-04-26T17:21:12.458619+0000 2024-04-25T17:30:33.922 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/3089604872 2024-04-26T17:09:39.480662+0000 2024-04-25T17:30:33.922 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.69:6827/518856100 2024-04-26T17:26:43.463024+0000 2024-04-25T17:30:33.922 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/3148505482 2024-04-26T17:21:12.458619+0000 2024-04-25T17:30:33.922 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/1135030866 2024-04-26T17:09:39.480662+0000 2024-04-25T17:30:33.922 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/767276846 2024-04-26T17:18:04.184013+0000 2024-04-25T17:30:33.922 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6801/2509847167 2024-04-26T17:09:09.103933+0000 2024-04-25T17:30:33.922 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/1487666224 2024-04-26T17:09:09.103933+0000 2024-04-25T17:30:33.922 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6800/1299348474 2024-04-26T17:10:55.431694+0000 2024-04-25T17:30:33.922 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/3689680514 2024-04-26T17:09:39.480662+0000 2024-04-25T17:30:33.922 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/3277643196 2024-04-26T17:09:09.103933+0000 2024-04-25T17:30:33.922 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6801/3653320894 2024-04-26T17:09:39.480662+0000 2024-04-25T17:30:33.922 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/2627363304 2024-04-26T17:18:04.184013+0000 2024-04-25T17:30:33.922 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.69:6828/2602478 2024-04-26T17:19:49.912987+0000 2024-04-25T17:30:33.922 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.69:6829/2602478 2024-04-26T17:19:49.912987+0000 2024-04-25T17:30:33.923 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/4258551295 2024-04-26T17:10:55.431694+0000 2024-04-25T17:30:33.923 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6800/709373822 2024-04-26T17:21:12.458619+0000 2024-04-25T17:30:33.923 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6826/1903989494 2024-04-26T17:25:43.985393+0000 2024-04-25T17:30:33.923 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/350553669 2024-04-26T17:10:55.431694+0000 2024-04-25T17:30:33.923 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/4179549689 2024-04-26T17:18:04.184013+0000 2024-04-25T17:30:33.923 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6801/1299348474 2024-04-26T17:10:55.431694+0000 2024-04-25T17:30:33.923 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/2626647662 2024-04-26T17:21:12.458619+0000 2024-04-25T17:30:33.923 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:6801/709373822 2024-04-26T17:21:12.458619+0000 2024-04-25T17:30:33.923 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/2702902167 2024-04-26T17:21:12.458619+0000 2024-04-25T17:30:33.923 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.15.37:0/3806998167 2024-04-26T17:21:12.458619+0000 2024-04-25T17:30:33.924 INFO:teuthology.orchestra.run.smithi037.stderr:listed 39 entries 2024-04-25T17:30:33.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.921+0000 7fcf2c59d640 1 -- 172.21.15.37:0/2681886115 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fcf10076b00 msgr2=0x7fcf10078fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:33.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.921+0000 7fcf2c59d640 1 --2- 172.21.15.37:0/2681886115 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fcf10076b00 0x7fcf10078fb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fcf24110a50 tx=0x7fcf14009da0 comp rx=0 tx=0).stop 2024-04-25T17:30:33.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.921+0000 7fcf2c59d640 1 -- 172.21.15.37:0/2681886115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf240fd3e0 msgr2=0x7fcf24115190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T17:30:33.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.921+0000 7fcf2c59d640 1 --2- 172.21.15.37:0/2681886115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf240fd3e0 0x7fcf24115190 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c002a50 tx=0x7fcf1c004600 comp rx=0 tx=0).stop 2024-04-25T17:30:33.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.921+0000 7fcf2c59d640 1 -- 172.21.15.37:0/2681886115 shutdown_connections 2024-04-25T17:30:33.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.921+0000 7fcf2c59d640 1 --2- 172.21.15.37:0/2681886115 >> [v2:172.21.15.37:6800/783197737,v1:172.21.15.37:6801/783197737] conn(0x7fcf10076b00 0x7fcf10078fb0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:33.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.921+0000 7fcf2c59d640 1 --2- 172.21.15.37:0/2681886115 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcf240fdcf0 0x7fcf241156d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:33.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.921+0000 7fcf2c59d640 1 --2- 172.21.15.37:0/2681886115 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf240fd3e0 0x7fcf24115190 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T17:30:33.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.921+0000 7fcf2c59d640 1 -- 172.21.15.37:0/2681886115 >> 172.21.15.37:0/2681886115 conn(0x7fcf240f6e70 msgr2=0x7fcf240f83d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T17:30:33.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.921+0000 7fcf2c59d640 1 -- 172.21.15.37:0/2681886115 shutdown_connections 2024-04-25T17:30:33.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-04-25T17:30:33.921+0000 7fcf2c59d640 1 -- 172.21.15.37:0/2681886115 wait complete. 2024-04-25T17:30:33.933 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi037.front.sepia.ceph.com... 2024-04-25T17:30:33.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T17:30:33.933 DEBUG:teuthology.orchestra.run.smithi037:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-25T17:30:33.958 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T17:30:34.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:33 smithi037 ceph-mon[90844]: pgmap v318: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:30:34.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:33 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/2244884100' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T17:30:34.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:33 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/3991723177' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-25T17:30:34.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:33 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/3154014706' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-25T17:30:34.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:33 smithi037 ceph-mon[90844]: from='client.? 172.21.15.37:0/2681886115' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-25T17:30:34.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:33 smithi069 ceph-mon[80239]: pgmap v318: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:30:34.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:33 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/2244884100' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-04-25T17:30:34.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:33 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/3991723177' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-04-25T17:30:34.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:33 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/3154014706' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-04-25T17:30:34.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:33 smithi069 ceph-mon[80239]: from='client.? 172.21.15.37:0/2681886115' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-04-25T17:30:36.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:35 smithi037 ceph-mon[90844]: pgmap v319: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-04-25T17:30:36.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:35 smithi069 ceph-mon[80239]: pgmap v319: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-04-25T17:30:38.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:37 smithi037 ceph-mon[90844]: pgmap v320: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:30:38.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:37 smithi069 ceph-mon[80239]: pgmap v320: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:30:40.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:39 smithi037 ceph-mon[90844]: pgmap v321: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-04-25T17:30:40.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:39 smithi069 ceph-mon[80239]: pgmap v321: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-04-25T17:30:42.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:41 smithi037 ceph-mon[90844]: pgmap v322: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-25T17:30:42.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:41 smithi069 ceph-mon[80239]: pgmap v322: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-04-25T17:30:43.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:42 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:30:43.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:42 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:30:44.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:43 smithi037 ceph-mon[90844]: pgmap v323: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:30:44.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:43 smithi069 ceph-mon[80239]: pgmap v323: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:30:46.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:45 smithi037 ceph-mon[90844]: pgmap v324: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:30:46.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:45 smithi069 ceph-mon[80239]: pgmap v324: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:30:48.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:47 smithi037 ceph-mon[90844]: pgmap v325: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:30:48.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:47 smithi069 ceph-mon[80239]: pgmap v325: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:30:50.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:49 smithi037 ceph-mon[90844]: pgmap v326: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:30:50.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:49 smithi069 ceph-mon[80239]: pgmap v326: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:30:52.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:51 smithi037 ceph-mon[90844]: pgmap v327: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:30:52.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:51 smithi069 ceph-mon[80239]: pgmap v327: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:30:54.221 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:53 smithi069 ceph-mon[80239]: pgmap v328: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:30:54.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:53 smithi037 ceph-mon[90844]: pgmap v328: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:30:56.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:55 smithi037 ceph-mon[90844]: pgmap v329: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:30:56.426 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:55 smithi069 ceph-mon[80239]: pgmap v329: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:30:58.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:57 smithi037 ceph-mon[90844]: pgmap v330: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:30:58.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:57 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:30:58.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:57 smithi069 ceph-mon[80239]: pgmap v330: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:30:58.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:57 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:31:00.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:30:59 smithi037 ceph-mon[90844]: pgmap v331: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:31:00.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:30:59 smithi069 ceph-mon[80239]: pgmap v331: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:31:02.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:31:01 smithi037 ceph-mon[90844]: pgmap v332: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:31:02.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:31:01 smithi069 ceph-mon[80239]: pgmap v332: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:31:04.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:31:03 smithi037 ceph-mon[90844]: pgmap v333: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:31:04.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:31:03 smithi069 ceph-mon[80239]: pgmap v333: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:31:06.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:31:05 smithi037 ceph-mon[90844]: pgmap v334: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:31:06.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:31:05 smithi069 ceph-mon[80239]: pgmap v334: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:31:08.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:31:07 smithi037 ceph-mon[90844]: pgmap v335: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:31:08.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:31:07 smithi069 ceph-mon[80239]: pgmap v335: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:31:10.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:31:09 smithi037 ceph-mon[90844]: pgmap v336: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:31:10.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:31:09 smithi069 ceph-mon[80239]: pgmap v336: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:31:12.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:31:11 smithi037 ceph-mon[90844]: pgmap v337: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:31:12.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:31:11 smithi069 ceph-mon[80239]: pgmap v337: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:31:13.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:31:12 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:31:13.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:31:12 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:31:14.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:31:13 smithi037 ceph-mon[90844]: pgmap v338: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:31:14.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:31:13 smithi069 ceph-mon[80239]: pgmap v338: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:31:16.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:31:15 smithi037 ceph-mon[90844]: pgmap v339: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:31:16.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:31:15 smithi069 ceph-mon[80239]: pgmap v339: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:31:18.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:31:18 smithi037 ceph-mon[90844]: pgmap v340: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:31:18.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:31:18 smithi069 ceph-mon[80239]: pgmap v340: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:31:20.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:31:20 smithi037 ceph-mon[90844]: pgmap v341: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:31:20.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:31:20 smithi069 ceph-mon[80239]: pgmap v341: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:31:22.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:31:22 smithi037 ceph-mon[90844]: pgmap v342: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:31:22.429 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:31:22 smithi069 ceph-mon[80239]: pgmap v342: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:31:24.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:31:24 smithi037 ceph-mon[90844]: pgmap v343: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:31:24.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:31:24 smithi069 ceph-mon[80239]: pgmap v343: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:31:25.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:31:25 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:31:25.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:31:25 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:31:26.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:31:26 smithi037 ceph-mon[90844]: pgmap v344: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:31:26.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:31:26 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:31:26.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:31:26 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:31:26.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:31:26 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:31:26.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:31:26 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:31:26.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:31:26 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:31:26.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:31:26 smithi069 ceph-mon[80239]: pgmap v344: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:31:26.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:31:26 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:31:26.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:31:26 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:31:26.670 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:31:26 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:31:26.670 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:31:26 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:31:26.670 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:31:26 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:31:28.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:31:28 smithi037 ceph-mon[90844]: pgmap v345: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:31:28.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:31:28 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:31:28.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:31:28 smithi069 ceph-mon[80239]: pgmap v345: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:31:28.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:31:28 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:31:30.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:31:30 smithi037 ceph-mon[90844]: pgmap v346: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:31:30.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:31:30 smithi069 ceph-mon[80239]: pgmap v346: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:31:32.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:31:32 smithi037 ceph-mon[90844]: pgmap v347: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:31:32.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:31:32 smithi069 ceph-mon[80239]: pgmap v347: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:31:34.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:31:34 smithi037 ceph-mon[90844]: pgmap v348: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:31:34.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:31:34 smithi069 ceph-mon[80239]: pgmap v348: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:31:36.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:31:36 smithi037 ceph-mon[90844]: pgmap v349: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:31:36.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:31:36 smithi069 ceph-mon[80239]: pgmap v349: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:31:38.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:31:38 smithi037 ceph-mon[90844]: pgmap v350: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:31:38.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:31:38 smithi069 ceph-mon[80239]: pgmap v350: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:31:40.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:31:40 smithi037 ceph-mon[90844]: pgmap v351: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:31:40.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:31:40 smithi069 ceph-mon[80239]: pgmap v351: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:31:42.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:31:42 smithi037 ceph-mon[90844]: pgmap v352: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:31:42.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:31:42 smithi069 ceph-mon[80239]: pgmap v352: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:31:43.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:31:43 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:31:43.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:31:43 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:31:44.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:31:44 smithi037 ceph-mon[90844]: pgmap v353: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:31:44.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:31:44 smithi069 ceph-mon[80239]: pgmap v353: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:31:46.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:31:46 smithi037 ceph-mon[90844]: pgmap v354: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:31:46.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:31:46 smithi069 ceph-mon[80239]: pgmap v354: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:31:48.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:31:48 smithi037 ceph-mon[90844]: pgmap v355: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:31:48.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:31:48 smithi069 ceph-mon[80239]: pgmap v355: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:31:50.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:31:50 smithi037 ceph-mon[90844]: pgmap v356: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:31:50.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:31:50 smithi069 ceph-mon[80239]: pgmap v356: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:31:52.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:31:52 smithi037 ceph-mon[90844]: pgmap v357: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:31:52.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:31:52 smithi069 ceph-mon[80239]: pgmap v357: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:31:53.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:31:53 smithi037 ceph-mon[90844]: pgmap v358: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:31:53.669 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:31:53 smithi069 ceph-mon[80239]: pgmap v358: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:31:56.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:31:55 smithi037 ceph-mon[90844]: pgmap v359: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:31:56.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:31:55 smithi069 ceph-mon[80239]: pgmap v359: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:31:58.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:31:57 smithi037 ceph-mon[90844]: pgmap v360: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:31:58.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:31:57 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:31:58.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:31:57 smithi069 ceph-mon[80239]: pgmap v360: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:31:58.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:31:57 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:32:00.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:31:59 smithi037 ceph-mon[90844]: pgmap v361: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:32:00.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:31:59 smithi069 ceph-mon[80239]: pgmap v361: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:32:02.074 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:32:01 smithi037 ceph-mon[90844]: pgmap v362: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:32:02.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:32:01 smithi069 ceph-mon[80239]: pgmap v362: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:32:04.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:32:03 smithi037 ceph-mon[90844]: pgmap v363: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:32:04.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:32:03 smithi069 ceph-mon[80239]: pgmap v363: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:32:06.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:32:05 smithi037 ceph-mon[90844]: pgmap v364: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:32:06.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:32:05 smithi069 ceph-mon[80239]: pgmap v364: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:32:08.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:32:07 smithi037 ceph-mon[90844]: pgmap v365: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:32:08.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:32:07 smithi069 ceph-mon[80239]: pgmap v365: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:32:10.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:32:09 smithi037 ceph-mon[90844]: pgmap v366: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:32:10.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:32:09 smithi069 ceph-mon[80239]: pgmap v366: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:32:12.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:32:11 smithi037 ceph-mon[90844]: pgmap v367: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:32:12.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:32:11 smithi069 ceph-mon[80239]: pgmap v367: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:32:13.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:32:12 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:32:13.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:32:12 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:32:14.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:32:13 smithi037 ceph-mon[90844]: pgmap v368: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:32:14.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:32:13 smithi069 ceph-mon[80239]: pgmap v368: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:32:16.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:32:15 smithi037 ceph-mon[90844]: pgmap v369: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:32:16.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:32:15 smithi069 ceph-mon[80239]: pgmap v369: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:32:18.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:32:17 smithi037 ceph-mon[90844]: pgmap v370: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:32:18.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:32:17 smithi069 ceph-mon[80239]: pgmap v370: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:32:20.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:32:19 smithi037 ceph-mon[90844]: pgmap v371: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:32:20.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:32:19 smithi069 ceph-mon[80239]: pgmap v371: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:32:22.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:32:21 smithi037 ceph-mon[90844]: pgmap v372: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:32:22.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:32:21 smithi069 ceph-mon[80239]: pgmap v372: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:32:24.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:32:23 smithi037 ceph-mon[90844]: pgmap v373: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:32:24.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:32:23 smithi069 ceph-mon[80239]: pgmap v373: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:32:26.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:32:25 smithi037 ceph-mon[90844]: pgmap v374: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:32:26.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:32:25 smithi069 ceph-mon[80239]: pgmap v374: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:32:27.070 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:32:26 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:32:27.070 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:32:26 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:32:27.070 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:32:26 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:32:27.070 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:32:26 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:32:27.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:32:26 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:32:27.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:32:26 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:32:27.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:32:26 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:32:27.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:32:26 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:32:28.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:32:27 smithi037 ceph-mon[90844]: pgmap v375: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:32:28.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:32:27 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:32:28.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:32:27 smithi069 ceph-mon[80239]: pgmap v375: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:32:28.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:32:27 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:32:30.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:32:29 smithi037 ceph-mon[90844]: pgmap v376: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:32:30.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:32:29 smithi069 ceph-mon[80239]: pgmap v376: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:32:32.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:32:31 smithi037 ceph-mon[90844]: pgmap v377: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:32:32.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:32:31 smithi069 ceph-mon[80239]: pgmap v377: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:32:34.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:32:33 smithi037 ceph-mon[90844]: pgmap v378: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:32:34.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:32:33 smithi069 ceph-mon[80239]: pgmap v378: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:32:36.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:32:35 smithi037 ceph-mon[90844]: pgmap v379: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:32:36.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:32:35 smithi069 ceph-mon[80239]: pgmap v379: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:32:38.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:32:37 smithi037 ceph-mon[90844]: pgmap v380: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:32:38.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:32:37 smithi069 ceph-mon[80239]: pgmap v380: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:32:40.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:32:39 smithi037 ceph-mon[90844]: pgmap v381: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:32:40.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:32:39 smithi069 ceph-mon[80239]: pgmap v381: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:32:42.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:32:41 smithi037 ceph-mon[90844]: pgmap v382: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:32:42.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:32:41 smithi069 ceph-mon[80239]: pgmap v382: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:32:43.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:32:42 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:32:43.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:32:42 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:32:44.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:32:43 smithi037 ceph-mon[90844]: pgmap v383: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:32:44.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:32:43 smithi069 ceph-mon[80239]: pgmap v383: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:32:46.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:32:45 smithi037 ceph-mon[90844]: pgmap v384: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:32:46.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:32:45 smithi069 ceph-mon[80239]: pgmap v384: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:32:48.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:32:47 smithi037 ceph-mon[90844]: pgmap v385: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:32:48.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:32:47 smithi069 ceph-mon[80239]: pgmap v385: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:32:50.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:32:49 smithi037 ceph-mon[90844]: pgmap v386: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:32:50.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:32:49 smithi069 ceph-mon[80239]: pgmap v386: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:32:52.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:32:51 smithi037 ceph-mon[90844]: pgmap v387: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:32:52.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:32:51 smithi069 ceph-mon[80239]: pgmap v387: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:32:54.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:32:53 smithi037 ceph-mon[90844]: pgmap v388: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:32:54.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:32:53 smithi069 ceph-mon[80239]: pgmap v388: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:32:56.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:32:55 smithi037 ceph-mon[90844]: pgmap v389: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:32:56.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:32:55 smithi069 ceph-mon[80239]: pgmap v389: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:32:58.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:32:57 smithi037 ceph-mon[90844]: pgmap v390: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:32:58.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:32:57 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:32:58.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:32:57 smithi069 ceph-mon[80239]: pgmap v390: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:32:58.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:32:57 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:33:00.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:32:59 smithi037 ceph-mon[90844]: pgmap v391: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:33:00.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:32:59 smithi069 ceph-mon[80239]: pgmap v391: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:33:02.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:33:01 smithi037 ceph-mon[90844]: pgmap v392: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:33:02.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:33:01 smithi069 ceph-mon[80239]: pgmap v392: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:33:04.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:33:03 smithi037 ceph-mon[90844]: pgmap v393: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:33:04.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:33:03 smithi069 ceph-mon[80239]: pgmap v393: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:33:06.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:33:05 smithi037 ceph-mon[90844]: pgmap v394: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:33:06.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:33:05 smithi069 ceph-mon[80239]: pgmap v394: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:33:08.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:33:07 smithi069 ceph-mon[80239]: pgmap v395: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:33:08.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:33:07 smithi037 ceph-mon[90844]: pgmap v395: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:33:10.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:33:09 smithi069 ceph-mon[80239]: pgmap v396: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:33:10.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:33:09 smithi037 ceph-mon[90844]: pgmap v396: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:33:12.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:33:11 smithi069 ceph-mon[80239]: pgmap v397: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:33:12.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:33:11 smithi037 ceph-mon[90844]: pgmap v397: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:33:13.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:33:12 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:33:13.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:33:12 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:33:14.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:33:13 smithi037 ceph-mon[90844]: pgmap v398: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-25T17:33:14.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:33:13 smithi069 ceph-mon[80239]: pgmap v398: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-25T17:33:16.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:33:15 smithi069 ceph-mon[80239]: pgmap v399: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:33:16.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:33:15 smithi037 ceph-mon[90844]: pgmap v399: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:33:18.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:33:17 smithi069 ceph-mon[80239]: pgmap v400: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-25T17:33:18.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:33:17 smithi037 ceph-mon[90844]: pgmap v400: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-04-25T17:33:20.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:33:19 smithi069 ceph-mon[80239]: pgmap v401: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:33:20.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:33:19 smithi037 ceph-mon[90844]: pgmap v401: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:33:22.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:33:21 smithi069 ceph-mon[80239]: pgmap v402: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:33:22.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:33:21 smithi037 ceph-mon[90844]: pgmap v402: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:33:24.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:33:23 smithi037 ceph-mon[90844]: pgmap v403: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:33:24.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:33:23 smithi069 ceph-mon[80239]: pgmap v403: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:33:26.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:33:25 smithi069 ceph-mon[80239]: pgmap v404: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:33:26.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:33:25 smithi037 ceph-mon[90844]: pgmap v404: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:33:27.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:33:26 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:33:27.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:33:26 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:33:28.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:33:27 smithi069 ceph-mon[80239]: pgmap v405: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:33:28.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:33:27 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:33:28.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:33:27 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:33:28.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:33:27 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:33:28.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:33:27 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:33:28.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:33:27 smithi037 ceph-mon[90844]: pgmap v405: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:33:28.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:33:27 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:33:28.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:33:27 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:33:28.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:33:27 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:33:28.323 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:33:27 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:33:30.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:33:29 smithi069 ceph-mon[80239]: pgmap v406: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:33:30.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:33:29 smithi037 ceph-mon[90844]: pgmap v406: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:33:32.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:33:31 smithi069 ceph-mon[80239]: pgmap v407: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:33:32.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:33:31 smithi037 ceph-mon[90844]: pgmap v407: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:33:34.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:33:33 smithi037 ceph-mon[90844]: pgmap v408: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:33:34.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:33:33 smithi069 ceph-mon[80239]: pgmap v408: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:33:36.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:33:35 smithi069 ceph-mon[80239]: pgmap v409: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:33:36.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:33:35 smithi037 ceph-mon[90844]: pgmap v409: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:33:38.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:33:37 smithi069 ceph-mon[80239]: pgmap v410: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:33:38.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:33:37 smithi037 ceph-mon[90844]: pgmap v410: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:33:40.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:33:39 smithi069 ceph-mon[80239]: pgmap v411: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:33:40.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:33:39 smithi037 ceph-mon[90844]: pgmap v411: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:33:42.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:33:41 smithi069 ceph-mon[80239]: pgmap v412: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:33:42.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:33:41 smithi037 ceph-mon[90844]: pgmap v412: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:33:43.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:33:42 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:33:43.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:33:42 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:33:44.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:33:43 smithi037 ceph-mon[90844]: pgmap v413: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:33:44.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:33:43 smithi069 ceph-mon[80239]: pgmap v413: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:33:46.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:33:45 smithi069 ceph-mon[80239]: pgmap v414: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:33:46.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:33:45 smithi037 ceph-mon[90844]: pgmap v414: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:33:48.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:33:47 smithi069 ceph-mon[80239]: pgmap v415: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:33:48.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:33:47 smithi037 ceph-mon[90844]: pgmap v415: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:33:50.168 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:33:49 smithi069 ceph-mon[80239]: pgmap v416: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:33:50.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:33:49 smithi037 ceph-mon[90844]: pgmap v416: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:33:52.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:33:51 smithi069 ceph-mon[80239]: pgmap v417: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:33:52.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:33:51 smithi037 ceph-mon[90844]: pgmap v417: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:33:54.074 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:33:53 smithi037 ceph-mon[90844]: pgmap v418: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:33:54.169 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:33:53 smithi069 ceph-mon[80239]: pgmap v418: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:33:56.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:33:55 smithi037 ceph-mon[90844]: pgmap v419: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:33:56.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:33:55 smithi069 ceph-mon[80239]: pgmap v419: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:33:58.221 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:33:57 smithi069 ceph-mon[80239]: pgmap v420: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:33:58.221 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:33:57 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:33:58.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:33:57 smithi037 ceph-mon[90844]: pgmap v420: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:33:58.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:33:57 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:34:00.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:33:59 smithi037 ceph-mon[90844]: pgmap v421: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:34:00.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:33:59 smithi069 ceph-mon[80239]: pgmap v421: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:34:02.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:34:01 smithi037 ceph-mon[90844]: pgmap v422: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:34:02.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:34:01 smithi069 ceph-mon[80239]: pgmap v422: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:34:04.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:34:03 smithi037 ceph-mon[90844]: pgmap v423: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:34:04.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:34:03 smithi069 ceph-mon[80239]: pgmap v423: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:34:06.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:34:05 smithi037 ceph-mon[90844]: pgmap v424: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:34:06.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:34:05 smithi069 ceph-mon[80239]: pgmap v424: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:34:08.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:34:07 smithi037 ceph-mon[90844]: pgmap v425: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:34:08.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:34:07 smithi069 ceph-mon[80239]: pgmap v425: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:34:10.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:34:09 smithi037 ceph-mon[90844]: pgmap v426: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:34:10.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:34:09 smithi069 ceph-mon[80239]: pgmap v426: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:34:12.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:34:11 smithi037 ceph-mon[90844]: pgmap v427: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:34:12.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:34:11 smithi069 ceph-mon[80239]: pgmap v427: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:34:13.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:34:12 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:34:13.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:34:12 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:34:14.072 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:34:13 smithi037 ceph-mon[90844]: pgmap v428: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:34:14.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:34:13 smithi069 ceph-mon[80239]: pgmap v428: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:34:16.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:34:15 smithi037 ceph-mon[90844]: pgmap v429: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:34:16.421 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:34:15 smithi069 ceph-mon[80239]: pgmap v429: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:34:18.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:34:17 smithi037 ceph-mon[90844]: pgmap v430: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:34:18.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:34:17 smithi069 ceph-mon[80239]: pgmap v430: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:34:20.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:34:19 smithi037 ceph-mon[90844]: pgmap v431: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:34:20.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:34:19 smithi069 ceph-mon[80239]: pgmap v431: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:34:22.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:34:21 smithi037 ceph-mon[90844]: pgmap v432: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:34:22.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:34:21 smithi069 ceph-mon[80239]: pgmap v432: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:34:24.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:34:23 smithi037 ceph-mon[90844]: pgmap v433: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:34:24.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:34:23 smithi069 ceph-mon[80239]: pgmap v433: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:34:26.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:34:25 smithi037 ceph-mon[90844]: pgmap v434: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:34:26.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:34:25 smithi069 ceph-mon[80239]: pgmap v434: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:34:28.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:34:27 smithi037 ceph-mon[90844]: pgmap v435: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:34:28.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:34:27 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:34:28.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:34:27 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:34:28.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:34:27 smithi069 ceph-mon[80239]: pgmap v435: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:34:28.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:34:27 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:34:28.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:34:27 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:34:29.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:34:28 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:34:29.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:34:28 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:34:29.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:34:28 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:34:29.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:34:28 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:34:29.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:34:28 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:34:29.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:34:28 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:34:30.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:34:30 smithi069 ceph-mon[80239]: pgmap v436: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:34:30.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:34:30 smithi037 ceph-mon[90844]: pgmap v436: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:34:32.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:34:32 smithi069 ceph-mon[80239]: pgmap v437: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:34:32.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:34:32 smithi037 ceph-mon[90844]: pgmap v437: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:34:34.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:34:34 smithi069 ceph-mon[80239]: pgmap v438: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:34:34.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:34:34 smithi037 ceph-mon[90844]: pgmap v438: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:34:36.374 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:34:36 smithi037 ceph-mon[90844]: pgmap v439: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:34:36.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:34:36 smithi069 ceph-mon[80239]: pgmap v439: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:34:38.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:34:38 smithi069 ceph-mon[80239]: pgmap v440: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:34:38.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:34:38 smithi037 ceph-mon[90844]: pgmap v440: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:34:40.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:34:40 smithi069 ceph-mon[80239]: pgmap v441: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:34:40.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:34:40 smithi037 ceph-mon[90844]: pgmap v441: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:34:42.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:34:42 smithi069 ceph-mon[80239]: pgmap v442: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:34:42.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:34:42 smithi037 ceph-mon[90844]: pgmap v442: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:34:43.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:34:43 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:34:43.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:34:43 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:34:44.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:34:44 smithi069 ceph-mon[80239]: pgmap v443: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:34:44.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:34:44 smithi037 ceph-mon[90844]: pgmap v443: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:34:46.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:34:46 smithi069 ceph-mon[80239]: pgmap v444: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:34:46.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:34:46 smithi037 ceph-mon[90844]: pgmap v444: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:34:48.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:34:48 smithi069 ceph-mon[80239]: pgmap v445: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:34:48.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:34:48 smithi037 ceph-mon[90844]: pgmap v445: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:34:50.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:34:50 smithi069 ceph-mon[80239]: pgmap v446: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:34:50.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:34:50 smithi037 ceph-mon[90844]: pgmap v446: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:34:52.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:34:52 smithi069 ceph-mon[80239]: pgmap v447: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:34:52.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:34:52 smithi037 ceph-mon[90844]: pgmap v447: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:34:54.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:34:54 smithi069 ceph-mon[80239]: pgmap v448: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:34:54.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:34:54 smithi037 ceph-mon[90844]: pgmap v448: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:34:56.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:34:56 smithi069 ceph-mon[80239]: pgmap v449: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:34:56.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:34:56 smithi037 ceph-mon[90844]: pgmap v449: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:34:58.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:34:58 smithi069 ceph-mon[80239]: pgmap v450: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:34:58.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:34:58 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:34:58.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:34:58 smithi037 ceph-mon[90844]: pgmap v450: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:34:58.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:34:58 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:35:00.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:35:00 smithi069 ceph-mon[80239]: pgmap v451: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:35:00.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:35:00 smithi037 ceph-mon[90844]: pgmap v451: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:35:02.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:35:02 smithi069 ceph-mon[80239]: pgmap v452: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:35:02.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:35:02 smithi037 ceph-mon[90844]: pgmap v452: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:35:04.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:35:04 smithi069 ceph-mon[80239]: pgmap v453: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:35:04.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:35:04 smithi037 ceph-mon[90844]: pgmap v453: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:35:06.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:35:06 smithi069 ceph-mon[80239]: pgmap v454: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:35:06.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:35:06 smithi037 ceph-mon[90844]: pgmap v454: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:35:08.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:35:08 smithi069 ceph-mon[80239]: pgmap v455: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:35:08.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:35:08 smithi037 ceph-mon[90844]: pgmap v455: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:35:10.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:35:10 smithi069 ceph-mon[80239]: pgmap v456: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:35:10.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:35:10 smithi037 ceph-mon[90844]: pgmap v456: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:35:12.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:35:12 smithi069 ceph-mon[80239]: pgmap v457: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:35:12.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:35:12 smithi037 ceph-mon[90844]: pgmap v457: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:35:13.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:35:13 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:35:13.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:35:13 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:35:14.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:35:14 smithi069 ceph-mon[80239]: pgmap v458: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:35:14.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:35:14 smithi037 ceph-mon[90844]: pgmap v458: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:35:16.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:35:16 smithi069 ceph-mon[80239]: pgmap v459: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:35:16.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:35:16 smithi037 ceph-mon[90844]: pgmap v459: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:35:18.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:35:18 smithi069 ceph-mon[80239]: pgmap v460: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:35:18.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:35:18 smithi037 ceph-mon[90844]: pgmap v460: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:35:20.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:35:20 smithi069 ceph-mon[80239]: pgmap v461: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:35:20.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:35:20 smithi037 ceph-mon[90844]: pgmap v461: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:35:22.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:35:22 smithi037 ceph-mon[90844]: pgmap v462: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:35:22.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:35:22 smithi069 ceph-mon[80239]: pgmap v462: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:35:24.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:35:24 smithi037 ceph-mon[90844]: pgmap v463: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:35:24.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:35:24 smithi069 ceph-mon[80239]: pgmap v463: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:35:26.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:35:26 smithi037 ceph-mon[90844]: pgmap v464: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:35:26.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:35:26 smithi069 ceph-mon[80239]: pgmap v464: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:35:28.470 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:35:28 smithi069 ceph-mon[80239]: pgmap v465: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:35:28.470 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:35:28 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:35:28.470 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:35:28 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:35:28.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:35:28 smithi037 ceph-mon[90844]: pgmap v465: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-04-25T17:35:28.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:35:28 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-04-25T17:35:28.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:35:28 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-04-25T17:35:29.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:35:29 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:35:29.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:35:29 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:35:29.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:35:29 smithi037 ceph-mon[90844]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:35:29.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:35:29 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-04-25T17:35:29.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:35:29 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-04-25T17:35:29.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:35:29 smithi069 ceph-mon[80239]: from='mgr.34104 172.21.15.37:0/2063386432' entity='mgr.smithi037.txrgxl' 2024-04-25T17:35:30.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:35:30 smithi037 ceph-mon[90844]: pgmap v466: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:35:30.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:35:30 smithi069 ceph-mon[80239]: pgmap v466: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-04-25T17:35:32.572 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:35:32 smithi037 ceph-mon[90844]: pgmap v467: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:35:32.668 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:35:32 smithi069 ceph-mon[80239]: pgmap v467: 65 pgs: 65 active+clean; 208 MiB data, 869 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-04-25T17:35:33.034 ERROR:tasks.cephfs.fuse_mount:process failed to terminate after unmount. This probably indicates a bug within ceph-fuse. 2024-04-25T17:35:33.035 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-04-25T17:35:33.036 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-04-25T17:35:33.047 INFO:tasks.cephadm:Teardown begin 2024-04-25T17:35:33.047 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa/tasks/cephadm.py", line 2246, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-04-25T17:35:33.048 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-25T17:35:33.081 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-25T17:35:33.114 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-04-25T17:35:33.114 DEBUG:teuthology.orchestra.run.smithi037:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-25T17:35:33.141 DEBUG:teuthology.orchestra.run.smithi069:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-04-25T17:35:33.170 INFO:tasks.cephadm:Stopping all daemons... 2024-04-25T17:35:33.170 INFO:tasks.cephadm.mon.smithi037:Stopping mon.smithi037... 2024-04-25T17:35:33.170 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-599bb7fc-0326-11ef-bc93-c7b262605968@mon.smithi037 2024-04-25T17:35:33.571 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:35:33 smithi037 systemd[1]: Stopping Ceph mon.smithi037 for 599bb7fc-0326-11ef-bc93-c7b262605968... 2024-04-25T17:35:34.033 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:35:33 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-mon-smithi037[90840]: 2024-04-25T17:35:33.633+0000 7f5c59480700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi037 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T17:35:34.033 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:35:33 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-mon-smithi037[90840]: 2024-04-25T17:35:33.633+0000 7f5c59480700 -1 mon.smithi037@0(leader) e3 *** Got Signal Terminated *** 2024-04-25T17:35:34.034 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:35:33 smithi037 podman[147157]: 2024-04-25 17:35:33.695040332 +0000 UTC m=+0.316309236 container died 1b349f3af69dda36ba71f13977d5f75b4527bb2df6293dc08ee4c57c48cb2d34 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-mon-smithi037, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-25T17:35:34.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:35:34 smithi037 podman[147157]: 2024-04-25 17:35:34.223868206 +0000 UTC m=+0.845137160 container cleanup 1b349f3af69dda36ba71f13977d5f75b4527bb2df6293dc08ee4c57c48cb2d34 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-mon-smithi037, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-04-25T17:35:34.322 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Apr 25 17:35:34 smithi037 bash[147157]: ceph-599bb7fc-0326-11ef-bc93-c7b262605968-mon-smithi037 2024-04-25T17:35:34.649 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-599bb7fc-0326-11ef-bc93-c7b262605968@mon.smithi037.service' 2024-04-25T17:35:34.699 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T17:35:34.699 INFO:tasks.cephadm.mon.smithi037:Stopped mon.smithi037 2024-04-25T17:35:34.700 INFO:tasks.cephadm.mon.smithi069:Stopping mon.smithi069... 2024-04-25T17:35:34.700 DEBUG:teuthology.orchestra.run.smithi069:> sudo systemctl stop ceph-599bb7fc-0326-11ef-bc93-c7b262605968@mon.smithi069 2024-04-25T17:35:34.998 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:35:34 smithi069 systemd[1]: Stopping Ceph mon.smithi069 for 599bb7fc-0326-11ef-bc93-c7b262605968... 2024-04-25T17:35:35.418 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:35:34 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-mon-smithi069[80235]: 2024-04-25T17:35:34.997+0000 7fe8efa1f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi069 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T17:35:35.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:35:34 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-mon-smithi069[80235]: 2024-04-25T17:35:34.997+0000 7fe8efa1f700 -1 mon.smithi069@1(peon) e3 *** Got Signal Terminated *** 2024-04-25T17:35:35.419 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:35:35 smithi069 podman[115891]: 2024-04-25 17:35:35.151547744 +0000 UTC m=+0.263056748 container died 7744dbe81b5036399c1cd4721a3c375b20b4ba05858617737dfc8748df4ad385 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-mon-smithi069, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T17:35:35.875 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:35:35 smithi069 podman[115891]: 2024-04-25 17:35:35.623737248 +0000 UTC m=+0.735246306 container cleanup 7744dbe81b5036399c1cd4721a3c375b20b4ba05858617737dfc8748df4ad385 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-mon-smithi069, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-04-25T17:35:35.875 INFO:journalctl@ceph.mon.smithi069.smithi069.stdout:Apr 25 17:35:35 smithi069 bash[115891]: ceph-599bb7fc-0326-11ef-bc93-c7b262605968-mon-smithi069 2024-04-25T17:35:36.002 DEBUG:teuthology.orchestra.run.smithi069:> sudo pkill -f 'journalctl -f -n 0 -u ceph-599bb7fc-0326-11ef-bc93-c7b262605968@mon.smithi069.service' 2024-04-25T17:35:36.041 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T17:35:36.042 INFO:tasks.cephadm.mon.smithi069:Stopped mon.smithi069 2024-04-25T17:35:36.042 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-04-25T17:35:36.042 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-599bb7fc-0326-11ef-bc93-c7b262605968@osd.0 2024-04-25T17:35:36.321 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:35:36 smithi037 systemd[1]: Stopping Ceph osd.0 for 599bb7fc-0326-11ef-bc93-c7b262605968... 2024-04-25T17:35:36.585 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:35:36 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-0[99623]: 2024-04-25T17:35:36.361+0000 7ff7b35e8700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T17:35:36.585 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:35:36 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-0[99623]: 2024-04-25T17:35:36.361+0000 7ff7b35e8700 -1 osd.0 84 *** Got signal Terminated *** 2024-04-25T17:35:36.586 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:35:36 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-0[99623]: 2024-04-25T17:35:36.361+0000 7ff7b35e8700 -1 osd.0 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T17:35:42.280 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:35:41 smithi037 podman[147293]: 2024-04-25 17:35:41.870807746 +0000 UTC m=+5.629276888 container died e97538cb8b4fc8cd48a9c618f3f202b5df7698c17a1368923938c4bcbe232d9a (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-0, org.label-schema.build-date=20240424, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-04-25T17:35:42.571 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:35:42 smithi037 podman[147293]: 2024-04-25 17:35:42.411754194 +0000 UTC m=+6.170223334 container cleanup e97538cb8b4fc8cd48a9c618f3f202b5df7698c17a1368923938c4bcbe232d9a (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-25T17:35:42.572 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:35:42 smithi037 bash[147293]: ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-0 2024-04-25T17:35:43.071 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:35:42 smithi037 podman[147324]: 2024-04-25 17:35:42.63854175 +0000 UTC m=+0.763835384 container remove e97538cb8b4fc8cd48a9c618f3f202b5df7698c17a1368923938c4bcbe232d9a (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-0, ceph=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-04-25T17:35:43.359 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:35:43 smithi037 podman[147418]: 2024-04-25 17:35:42.995155746 +0000 UTC m=+0.018630732 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T17:35:43.359 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:35:43 smithi037 podman[147418]: 2024-04-25 17:35:43.114497854 +0000 UTC m=+0.137972821 container create 78fb45deb7ec9ea392a0a8ef02edc5380b227f1b4b15f5e9c07f9dd817739f6d (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-04-25T17:35:43.359 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:35:43 smithi037 podman[147418]: 2024-04-25 17:35:43.35903476 +0000 UTC m=+0.382509736 container init 78fb45deb7ec9ea392a0a8ef02edc5380b227f1b4b15f5e9c07f9dd817739f6d (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-0-deactivate, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, ceph=True, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-04-25T17:35:43.673 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:35:43 smithi037 podman[147418]: 2024-04-25 17:35:43.362678385 +0000 UTC m=+0.386153370 container start 78fb45deb7ec9ea392a0a8ef02edc5380b227f1b4b15f5e9c07f9dd817739f6d (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-04-25T17:35:43.673 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:35:43 smithi037 podman[147418]: 2024-04-25 17:35:43.533766218 +0000 UTC m=+0.557241201 container attach 78fb45deb7ec9ea392a0a8ef02edc5380b227f1b4b15f5e9c07f9dd817739f6d (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5) 2024-04-25T17:35:44.028 INFO:journalctl@ceph.osd.0.smithi037.stdout:Apr 25 17:35:43 smithi037 podman[147418]: 2024-04-25 17:35:43.673764433 +0000 UTC m=+0.697239410 container died 78fb45deb7ec9ea392a0a8ef02edc5380b227f1b4b15f5e9c07f9dd817739f6d (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-25T17:35:44.354 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-599bb7fc-0326-11ef-bc93-c7b262605968@osd.0.service' 2024-04-25T17:35:44.402 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T17:35:44.402 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-04-25T17:35:44.402 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-04-25T17:35:44.403 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-599bb7fc-0326-11ef-bc93-c7b262605968@osd.1 2024-04-25T17:35:44.699 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:35:44 smithi037 systemd[1]: Stopping Ceph osd.1 for 599bb7fc-0326-11ef-bc93-c7b262605968... 2024-04-25T17:35:45.071 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:35:44 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-1[105005]: 2024-04-25T17:35:44.697+0000 7f0d45887700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T17:35:45.071 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:35:44 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-1[105005]: 2024-04-25T17:35:44.697+0000 7f0d45887700 -1 osd.1 84 *** Got signal Terminated *** 2024-04-25T17:35:45.072 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:35:44 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-1[105005]: 2024-04-25T17:35:44.697+0000 7f0d45887700 -1 osd.1 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T17:35:50.500 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:35:50 smithi037 podman[147525]: 2024-04-25 17:35:50.191910689 +0000 UTC m=+5.597879672 container died 6cf158192aae6a97e14c26a91bee902570f2f329e4fc13d921434c022377f626 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-1, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-25T17:35:50.821 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:35:50 smithi037 podman[147525]: 2024-04-25 17:35:50.5906049 +0000 UTC m=+5.996573883 container cleanup 6cf158192aae6a97e14c26a91bee902570f2f329e4fc13d921434c022377f626 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-1, ceph=True, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-04-25T17:35:50.821 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:35:50 smithi037 bash[147525]: ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-1 2024-04-25T17:35:51.125 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:35:50 smithi037 podman[147543]: 2024-04-25 17:35:50.84216864 +0000 UTC m=+0.653314281 container remove 6cf158192aae6a97e14c26a91bee902570f2f329e4fc13d921434c022377f626 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-1, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424) 2024-04-25T17:35:51.428 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:35:51 smithi037 podman[147632]: 2024-04-25 17:35:51.126065928 +0000 UTC m=+0.096442709 container create 9574df6003a940b70954b275dd4ae84500a1f4378c2b3a5b73ebc8650f53926e (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-04-25T17:35:51.428 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:35:51 smithi037 podman[147632]: 2024-04-25 17:35:51.048582893 +0000 UTC m=+0.018959675 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T17:35:51.429 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:35:51 smithi037 podman[147632]: 2024-04-25 17:35:51.337329478 +0000 UTC m=+0.307706269 container init 9574df6003a940b70954b275dd4ae84500a1f4378c2b3a5b73ebc8650f53926e (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-1-deactivate, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-04-25T17:35:51.429 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:35:51 smithi037 podman[147632]: 2024-04-25 17:35:51.34081118 +0000 UTC m=+0.311187971 container start 9574df6003a940b70954b275dd4ae84500a1f4378c2b3a5b73ebc8650f53926e (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-1-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, org.label-schema.schema-version=1.0) 2024-04-25T17:35:51.429 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:35:51 smithi037 podman[147632]: 2024-04-25 17:35:51.428699747 +0000 UTC m=+0.399076544 container attach 9574df6003a940b70954b275dd4ae84500a1f4378c2b3a5b73ebc8650f53926e (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-1-deactivate, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, ceph=True, org.label-schema.license=GPLv2) 2024-04-25T17:35:51.822 INFO:journalctl@ceph.osd.1.smithi037.stdout:Apr 25 17:35:51 smithi037 podman[147632]: 2024-04-25 17:35:51.648698105 +0000 UTC m=+0.619074888 container died 9574df6003a940b70954b275dd4ae84500a1f4378c2b3a5b73ebc8650f53926e (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-1-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2) 2024-04-25T17:35:52.301 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-599bb7fc-0326-11ef-bc93-c7b262605968@osd.1.service' 2024-04-25T17:35:52.348 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T17:35:52.348 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-04-25T17:35:52.348 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-04-25T17:35:52.348 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ceph-599bb7fc-0326-11ef-bc93-c7b262605968@osd.2 2024-04-25T17:35:52.571 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:35:52 smithi037 systemd[1]: Stopping Ceph osd.2 for 599bb7fc-0326-11ef-bc93-c7b262605968... 2024-04-25T17:35:53.071 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:35:52 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-2[110381]: 2024-04-25T17:35:52.667+0000 7f937d9d8700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T17:35:53.071 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:35:52 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-2[110381]: 2024-04-25T17:35:52.667+0000 7f937d9d8700 -1 osd.2 84 *** Got signal Terminated *** 2024-04-25T17:35:53.072 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:35:52 smithi037 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-2[110381]: 2024-04-25T17:35:52.667+0000 7f937d9d8700 -1 osd.2 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T17:35:58.470 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:35:58 smithi037 podman[147739]: 2024-04-25 17:35:58.217220666 +0000 UTC m=+5.677024718 container died a0b57bba2ebff1805b6d62177a4734e9cfcf509bb8da4c8835605041d96d4118 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-2, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, maintainer=Guillaume Abrioux ) 2024-04-25T17:35:58.778 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:35:58 smithi037 podman[147739]: 2024-04-25 17:35:58.551614532 +0000 UTC m=+6.011418573 container cleanup a0b57bba2ebff1805b6d62177a4734e9cfcf509bb8da4c8835605041d96d4118 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424) 2024-04-25T17:35:58.778 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:35:58 smithi037 bash[147739]: ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-2 2024-04-25T17:35:59.071 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:35:58 smithi037 podman[147759]: 2024-04-25 17:35:58.77827967 +0000 UTC m=+0.554170402 container remove a0b57bba2ebff1805b6d62177a4734e9cfcf509bb8da4c8835605041d96d4118 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-2, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-04-25T17:35:59.549 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:35:59 smithi037 podman[147851]: 2024-04-25 17:35:59.139056257 +0000 UTC m=+0.018685826 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T17:35:59.549 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:35:59 smithi037 podman[147851]: 2024-04-25 17:35:59.306880906 +0000 UTC m=+0.186510522 container create 599f76e8b82fa071d8be875a4abbdbe65a9c6c47f991cd6786ce1352279aef7b (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240424, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-04-25T17:35:59.821 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:35:59 smithi037 podman[147851]: 2024-04-25 17:35:59.707151924 +0000 UTC m=+0.586781486 container init 599f76e8b82fa071d8be875a4abbdbe65a9c6c47f991cd6786ce1352279aef7b (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-2-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-04-25T17:35:59.822 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:35:59 smithi037 podman[147851]: 2024-04-25 17:35:59.710641512 +0000 UTC m=+0.590271067 container start 599f76e8b82fa071d8be875a4abbdbe65a9c6c47f991cd6786ce1352279aef7b (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-04-25T17:35:59.822 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:35:59 smithi037 podman[147851]: 2024-04-25 17:35:59.773394141 +0000 UTC m=+0.653023704 container attach 599f76e8b82fa071d8be875a4abbdbe65a9c6c47f991cd6786ce1352279aef7b (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-2-deactivate, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T17:36:00.321 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:36:00 smithi037 podman[147851]: 2024-04-25 17:36:00.020478103 +0000 UTC m=+0.900107657 container died 599f76e8b82fa071d8be875a4abbdbe65a9c6c47f991cd6786ce1352279aef7b (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-2-deactivate, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5) 2024-04-25T17:36:00.588 INFO:journalctl@ceph.osd.2.smithi037.stdout:Apr 25 17:36:00 smithi037 podman[147877]: 2024-04-25 17:36:00.584942092 +0000 UTC m=+0.556069066 container remove 599f76e8b82fa071d8be875a4abbdbe65a9c6c47f991cd6786ce1352279aef7b (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True) 2024-04-25T17:36:00.606 DEBUG:teuthology.orchestra.run.smithi037:> sudo pkill -f 'journalctl -f -n 0 -u ceph-599bb7fc-0326-11ef-bc93-c7b262605968@osd.2.service' 2024-04-25T17:36:00.648 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T17:36:00.649 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-04-25T17:36:00.649 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-04-25T17:36:00.649 DEBUG:teuthology.orchestra.run.smithi069:> sudo systemctl stop ceph-599bb7fc-0326-11ef-bc93-c7b262605968@osd.3 2024-04-25T17:36:00.960 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:36:00 smithi069 systemd[1]: Stopping Ceph osd.3 for 599bb7fc-0326-11ef-bc93-c7b262605968... 2024-04-25T17:36:01.217 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:36:00 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-3[89654]: 2024-04-25T17:36:00.960+0000 7f96a1385700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T17:36:01.217 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:36:00 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-3[89654]: 2024-04-25T17:36:00.960+0000 7f96a1385700 -1 osd.3 84 *** Got signal Terminated *** 2024-04-25T17:36:01.217 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:36:00 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-3[89654]: 2024-04-25T17:36:00.960+0000 7f96a1385700 -1 osd.3 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T17:36:03.418 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:36:03 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-3[89654]: 2024-04-25T17:36:03.145+0000 7f9699933700 -1 osd.3 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-04-25T17:35:39.966590+0000 front 2024-04-25T17:35:39.966573+0000 (oldest deadline 2024-04-25T17:36:02.866338+0000) 2024-04-25T17:36:04.668 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:36:04 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-3[89654]: 2024-04-25T17:36:04.174+0000 7f9699933700 -1 osd.3 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-04-25T17:35:39.966590+0000 front 2024-04-25T17:35:39.966573+0000 (oldest deadline 2024-04-25T17:36:02.866338+0000) 2024-04-25T17:36:05.668 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:36:05 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-3[89654]: 2024-04-25T17:36:05.176+0000 7f9699933700 -1 osd.3 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-04-25T17:35:39.966590+0000 front 2024-04-25T17:35:39.966573+0000 (oldest deadline 2024-04-25T17:36:02.866338+0000) 2024-04-25T17:36:05.668 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:36:05 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4[94508]: 2024-04-25T17:36:05.279+0000 7ffb281dc700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-04-25T17:35:40.255685+0000 front 2024-04-25T17:35:40.255559+0000 (oldest deadline 2024-04-25T17:36:04.955464+0000) 2024-04-25T17:36:06.168 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:36:05 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5[99370]: 2024-04-25T17:36:05.757+0000 7f68a5a8e700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-04-25T17:35:41.231696+0000 front 2024-04-25T17:35:41.231579+0000 (oldest deadline 2024-04-25T17:36:05.331618+0000) 2024-04-25T17:36:06.577 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:36:06 smithi069 podman[116016]: 2024-04-25 17:36:06.317866547 +0000 UTC m=+5.479064370 container died d1aa15d6b575a3cabcc36964c69b0727441790233d66a7e4bc61861702e77963 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-3, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240424, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2) 2024-04-25T17:36:06.577 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:36:06 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4[94508]: 2024-04-25T17:36:06.314+0000 7ffb281dc700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-04-25T17:35:40.255685+0000 front 2024-04-25T17:35:40.255559+0000 (oldest deadline 2024-04-25T17:36:04.955464+0000) 2024-04-25T17:36:06.918 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:36:06 smithi069 podman[116016]: 2024-04-25 17:36:06.676912365 +0000 UTC m=+5.838110188 container cleanup d1aa15d6b575a3cabcc36964c69b0727441790233d66a7e4bc61861702e77963 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-3, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424) 2024-04-25T17:36:06.918 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:36:06 smithi069 bash[116016]: ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-3 2024-04-25T17:36:06.918 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:36:06 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5[99370]: 2024-04-25T17:36:06.795+0000 7f68a5a8e700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-04-25T17:35:41.231696+0000 front 2024-04-25T17:35:41.231579+0000 (oldest deadline 2024-04-25T17:36:05.331618+0000) 2024-04-25T17:36:07.294 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:36:06 smithi069 podman[116045]: 2024-04-25 17:36:06.961412048 +0000 UTC m=+0.640538809 container remove d1aa15d6b575a3cabcc36964c69b0727441790233d66a7e4bc61861702e77963 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-3, ceph=True, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-04-25T17:36:07.614 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:36:07 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4[94508]: 2024-04-25T17:36:07.362+0000 7ffb281dc700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-04-25T17:35:40.255685+0000 front 2024-04-25T17:35:40.255559+0000 (oldest deadline 2024-04-25T17:36:04.955464+0000) 2024-04-25T17:36:07.615 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:36:07 smithi069 podman[116139]: 2024-04-25 17:36:07.19772511 +0000 UTC m=+0.018194301 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T17:36:07.615 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:36:07 smithi069 podman[116139]: 2024-04-25 17:36:07.295490938 +0000 UTC m=+0.115960105 container create 5d3f647516128b64a47344585cde3271a059627e7c8e1bc8aad4bdc53c3e8161 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-3-deactivate, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-25T17:36:07.615 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:36:07 smithi069 podman[116139]: 2024-04-25 17:36:07.515115472 +0000 UTC m=+0.335584644 container init 5d3f647516128b64a47344585cde3271a059627e7c8e1bc8aad4bdc53c3e8161 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=) 2024-04-25T17:36:07.615 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:36:07 smithi069 podman[116139]: 2024-04-25 17:36:07.518245124 +0000 UTC m=+0.338714297 container start 5d3f647516128b64a47344585cde3271a059627e7c8e1bc8aad4bdc53c3e8161 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240424, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-04-25T17:36:07.615 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:36:07 smithi069 podman[116139]: 2024-04-25 17:36:07.615044592 +0000 UTC m=+0.435513769 container attach 5d3f647516128b64a47344585cde3271a059627e7c8e1bc8aad4bdc53c3e8161 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240424, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T17:36:07.918 INFO:journalctl@ceph.osd.3.smithi069.stdout:Apr 25 17:36:07 smithi069 podman[116139]: 2024-04-25 17:36:07.818459377 +0000 UTC m=+0.638928560 container died 5d3f647516128b64a47344585cde3271a059627e7c8e1bc8aad4bdc53c3e8161 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240424) 2024-04-25T17:36:07.918 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:36:07 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5[99370]: 2024-04-25T17:36:07.770+0000 7f68a5a8e700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-04-25T17:35:41.231696+0000 front 2024-04-25T17:35:41.231579+0000 (oldest deadline 2024-04-25T17:36:05.331618+0000) 2024-04-25T17:36:08.376 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:36:08 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4[94508]: 2024-04-25T17:36:08.332+0000 7ffb281dc700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-04-25T17:35:40.255685+0000 front 2024-04-25T17:35:40.255559+0000 (oldest deadline 2024-04-25T17:36:04.955464+0000) 2024-04-25T17:36:08.399 DEBUG:teuthology.orchestra.run.smithi069:> sudo pkill -f 'journalctl -f -n 0 -u ceph-599bb7fc-0326-11ef-bc93-c7b262605968@osd.3.service' 2024-04-25T17:36:08.437 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T17:36:08.437 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-04-25T17:36:08.437 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-04-25T17:36:08.437 DEBUG:teuthology.orchestra.run.smithi069:> sudo systemctl stop ceph-599bb7fc-0326-11ef-bc93-c7b262605968@osd.4 2024-04-25T17:36:08.668 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:36:08 smithi069 systemd[1]: Stopping Ceph osd.4 for 599bb7fc-0326-11ef-bc93-c7b262605968... 2024-04-25T17:36:09.169 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:36:08 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5[99370]: 2024-04-25T17:36:08.757+0000 7f68a5a8e700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-04-25T17:35:41.231696+0000 front 2024-04-25T17:35:41.231579+0000 (oldest deadline 2024-04-25T17:36:05.331618+0000) 2024-04-25T17:36:09.170 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:36:08 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4[94508]: 2024-04-25T17:36:08.771+0000 7ffb2fc2e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T17:36:09.170 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:36:08 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4[94508]: 2024-04-25T17:36:08.771+0000 7ffb2fc2e700 -1 osd.4 84 *** Got signal Terminated *** 2024-04-25T17:36:09.170 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:36:08 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4[94508]: 2024-04-25T17:36:08.771+0000 7ffb2fc2e700 -1 osd.4 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T17:36:09.668 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:36:09 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4[94508]: 2024-04-25T17:36:09.310+0000 7ffb281dc700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-04-25T17:35:40.255685+0000 front 2024-04-25T17:35:40.255559+0000 (oldest deadline 2024-04-25T17:36:04.955464+0000) 2024-04-25T17:36:10.168 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:36:09 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5[99370]: 2024-04-25T17:36:09.798+0000 7f68a5a8e700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-04-25T17:35:41.231696+0000 front 2024-04-25T17:35:41.231579+0000 (oldest deadline 2024-04-25T17:36:05.331618+0000) 2024-04-25T17:36:10.668 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:36:10 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4[94508]: 2024-04-25T17:36:10.295+0000 7ffb281dc700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-04-25T17:35:40.255685+0000 front 2024-04-25T17:35:40.255559+0000 (oldest deadline 2024-04-25T17:36:04.955464+0000) 2024-04-25T17:36:10.668 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:36:10 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4[94508]: 2024-04-25T17:36:10.295+0000 7ffb281dc700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.1 since back 2024-04-25T17:35:44.955982+0000 front 2024-04-25T17:35:44.956023+0000 (oldest deadline 2024-04-25T17:36:10.255920+0000) 2024-04-25T17:36:11.168 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:36:10 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5[99370]: 2024-04-25T17:36:10.772+0000 7f68a5a8e700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-04-25T17:35:41.231696+0000 front 2024-04-25T17:35:41.231579+0000 (oldest deadline 2024-04-25T17:36:05.331618+0000) 2024-04-25T17:36:11.668 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:36:11 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4[94508]: 2024-04-25T17:36:11.330+0000 7ffb281dc700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-04-25T17:35:40.255685+0000 front 2024-04-25T17:35:40.255559+0000 (oldest deadline 2024-04-25T17:36:04.955464+0000) 2024-04-25T17:36:11.668 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:36:11 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4[94508]: 2024-04-25T17:36:11.330+0000 7ffb281dc700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.1 since back 2024-04-25T17:35:44.955982+0000 front 2024-04-25T17:35:44.956023+0000 (oldest deadline 2024-04-25T17:36:10.255920+0000) 2024-04-25T17:36:12.168 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:36:11 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5[99370]: 2024-04-25T17:36:11.783+0000 7f68a5a8e700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-04-25T17:35:41.231696+0000 front 2024-04-25T17:35:41.231579+0000 (oldest deadline 2024-04-25T17:36:05.331618+0000) 2024-04-25T17:36:12.668 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:36:12 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4[94508]: 2024-04-25T17:36:12.313+0000 7ffb281dc700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-04-25T17:35:40.255685+0000 front 2024-04-25T17:35:40.255559+0000 (oldest deadline 2024-04-25T17:36:04.955464+0000) 2024-04-25T17:36:12.668 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:36:12 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4[94508]: 2024-04-25T17:36:12.313+0000 7ffb281dc700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.1 since back 2024-04-25T17:35:44.955982+0000 front 2024-04-25T17:35:44.956023+0000 (oldest deadline 2024-04-25T17:36:10.255920+0000) 2024-04-25T17:36:13.168 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:36:12 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5[99370]: 2024-04-25T17:36:12.802+0000 7f68a5a8e700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-04-25T17:35:41.231696+0000 front 2024-04-25T17:35:41.231579+0000 (oldest deadline 2024-04-25T17:36:05.331618+0000) 2024-04-25T17:36:13.168 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:36:12 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5[99370]: 2024-04-25T17:36:12.802+0000 7f68a5a8e700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.1 since back 2024-04-25T17:35:46.933153+0000 front 2024-04-25T17:35:46.933192+0000 (oldest deadline 2024-04-25T17:36:12.232976+0000) 2024-04-25T17:36:13.668 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:36:13 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4[94508]: 2024-04-25T17:36:13.341+0000 7ffb281dc700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-04-25T17:35:40.255685+0000 front 2024-04-25T17:35:40.255559+0000 (oldest deadline 2024-04-25T17:36:04.955464+0000) 2024-04-25T17:36:13.668 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:36:13 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4[94508]: 2024-04-25T17:36:13.341+0000 7ffb281dc700 -1 osd.4 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.1 since back 2024-04-25T17:35:44.955982+0000 front 2024-04-25T17:35:44.956023+0000 (oldest deadline 2024-04-25T17:36:10.255920+0000) 2024-04-25T17:36:14.168 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:36:13 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5[99370]: 2024-04-25T17:36:13.757+0000 7f68a5a8e700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-04-25T17:35:41.231696+0000 front 2024-04-25T17:35:41.231579+0000 (oldest deadline 2024-04-25T17:36:05.331618+0000) 2024-04-25T17:36:14.168 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:36:13 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5[99370]: 2024-04-25T17:36:13.757+0000 7f68a5a8e700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.1 since back 2024-04-25T17:35:46.933153+0000 front 2024-04-25T17:35:46.933192+0000 (oldest deadline 2024-04-25T17:36:12.232976+0000) 2024-04-25T17:36:14.531 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:36:14 smithi069 podman[116245]: 2024-04-25 17:36:14.273465465 +0000 UTC m=+5.618389638 container died ad76a3d0fecb0b96eda72e1b4d946fa60cd6a8e6713342939fdbdf71c7200034 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-04-25T17:36:14.839 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:36:14 smithi069 podman[116245]: 2024-04-25 17:36:14.621968019 +0000 UTC m=+5.966892239 container cleanup ad76a3d0fecb0b96eda72e1b4d946fa60cd6a8e6713342939fdbdf71c7200034 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-04-25T17:36:14.839 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:36:14 smithi069 bash[116245]: ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4 2024-04-25T17:36:14.840 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:36:14 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5[99370]: 2024-04-25T17:36:14.754+0000 7f68a5a8e700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-04-25T17:35:41.231696+0000 front 2024-04-25T17:35:41.231579+0000 (oldest deadline 2024-04-25T17:36:05.331618+0000) 2024-04-25T17:36:14.840 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:36:14 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5[99370]: 2024-04-25T17:36:14.754+0000 7f68a5a8e700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.1 since back 2024-04-25T17:35:46.933153+0000 front 2024-04-25T17:35:46.933192+0000 (oldest deadline 2024-04-25T17:36:12.232976+0000) 2024-04-25T17:36:15.168 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:36:14 smithi069 podman[116262]: 2024-04-25 17:36:14.839708024 +0000 UTC m=+0.560400537 container remove ad76a3d0fecb0b96eda72e1b4d946fa60cd6a8e6713342939fdbdf71c7200034 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424) 2024-04-25T17:36:15.526 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:36:15 smithi069 podman[116354]: 2024-04-25 17:36:15.149380713 +0000 UTC m=+0.018308613 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T17:36:15.526 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:36:15 smithi069 podman[116354]: 2024-04-25 17:36:15.248920069 +0000 UTC m=+0.117847952 container create 6661006bf90de73747068abcf435e799aaeea4489ef43bf1535d9d541aa6d26d (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-04-25T17:36:15.526 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:36:15 smithi069 podman[116354]: 2024-04-25 17:36:15.451359515 +0000 UTC m=+0.320287399 container init 6661006bf90de73747068abcf435e799aaeea4489ef43bf1535d9d541aa6d26d (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240424, CEPH_POINT_RELEASE=, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-25T17:36:15.526 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:36:15 smithi069 podman[116354]: 2024-04-25 17:36:15.454654789 +0000 UTC m=+0.323582675 container start 6661006bf90de73747068abcf435e799aaeea4489ef43bf1535d9d541aa6d26d (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.vendor=CentOS) 2024-04-25T17:36:15.526 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:36:15 smithi069 podman[116354]: 2024-04-25 17:36:15.5261161 +0000 UTC m=+0.395043985 container attach 6661006bf90de73747068abcf435e799aaeea4489ef43bf1535d9d541aa6d26d (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-04-25T17:36:15.918 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:36:15 smithi069 podman[116354]: 2024-04-25 17:36:15.744780538 +0000 UTC m=+0.613708430 container died 6661006bf90de73747068abcf435e799aaeea4489ef43bf1535d9d541aa6d26d (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240424, GIT_BRANCH=HEAD) 2024-04-25T17:36:15.918 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:36:15 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5[99370]: 2024-04-25T17:36:15.724+0000 7f68a5a8e700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-04-25T17:35:41.231696+0000 front 2024-04-25T17:35:41.231579+0000 (oldest deadline 2024-04-25T17:36:05.331618+0000) 2024-04-25T17:36:15.919 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:36:15 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5[99370]: 2024-04-25T17:36:15.724+0000 7f68a5a8e700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.1 since back 2024-04-25T17:35:46.933153+0000 front 2024-04-25T17:35:46.933192+0000 (oldest deadline 2024-04-25T17:36:12.232976+0000) 2024-04-25T17:36:16.266 DEBUG:teuthology.orchestra.run.smithi069:> sudo pkill -f 'journalctl -f -n 0 -u ceph-599bb7fc-0326-11ef-bc93-c7b262605968@osd.4.service' 2024-04-25T17:36:16.288 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:36:16 smithi069 podman[116381]: 2024-04-25 17:36:16.24257894 +0000 UTC m=+0.492481755 container remove 6661006bf90de73747068abcf435e799aaeea4489ef43bf1535d9d541aa6d26d (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-4-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-04-25T17:36:16.288 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:36:16 smithi069 systemd[1]: ceph-599bb7fc-0326-11ef-bc93-c7b262605968@osd.4.service: Deactivated successfully. 2024-04-25T17:36:16.288 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:36:16 smithi069 systemd[1]: Stopped Ceph osd.4 for 599bb7fc-0326-11ef-bc93-c7b262605968. 2024-04-25T17:36:16.288 INFO:journalctl@ceph.osd.4.smithi069.stdout:Apr 25 17:36:16 smithi069 systemd[1]: ceph-599bb7fc-0326-11ef-bc93-c7b262605968@osd.4.service: Consumed 9.910s CPU time. 2024-04-25T17:36:16.304 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T17:36:16.304 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-04-25T17:36:16.304 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-04-25T17:36:16.304 DEBUG:teuthology.orchestra.run.smithi069:> sudo systemctl stop ceph-599bb7fc-0326-11ef-bc93-c7b262605968@osd.5 2024-04-25T17:36:16.650 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:36:16 smithi069 systemd[1]: Stopping Ceph osd.5 for 599bb7fc-0326-11ef-bc93-c7b262605968... 2024-04-25T17:36:16.918 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:36:16 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5[99370]: 2024-04-25T17:36:16.649+0000 7f68a94d8700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-04-25T17:36:16.918 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:36:16 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5[99370]: 2024-04-25T17:36:16.649+0000 7f68a94d8700 -1 osd.5 84 *** Got signal Terminated *** 2024-04-25T17:36:16.919 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:36:16 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5[99370]: 2024-04-25T17:36:16.649+0000 7f68a94d8700 -1 osd.5 84 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-25T17:36:16.919 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:36:16 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5[99370]: 2024-04-25T17:36:16.726+0000 7f68a5a8e700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-04-25T17:35:41.231696+0000 front 2024-04-25T17:35:41.231579+0000 (oldest deadline 2024-04-25T17:36:05.331618+0000) 2024-04-25T17:36:16.919 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:36:16 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5[99370]: 2024-04-25T17:36:16.726+0000 7f68a5a8e700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.1 since back 2024-04-25T17:35:46.933153+0000 front 2024-04-25T17:35:46.933192+0000 (oldest deadline 2024-04-25T17:36:12.232976+0000) 2024-04-25T17:36:18.168 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:36:17 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5[99370]: 2024-04-25T17:36:17.745+0000 7f68a5a8e700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-04-25T17:35:41.231696+0000 front 2024-04-25T17:35:41.231579+0000 (oldest deadline 2024-04-25T17:36:05.331618+0000) 2024-04-25T17:36:18.168 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:36:17 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5[99370]: 2024-04-25T17:36:17.745+0000 7f68a5a8e700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.1 since back 2024-04-25T17:35:46.933153+0000 front 2024-04-25T17:35:46.933192+0000 (oldest deadline 2024-04-25T17:36:12.232976+0000) 2024-04-25T17:36:19.168 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:36:18 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5[99370]: 2024-04-25T17:36:18.782+0000 7f68a5a8e700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-04-25T17:35:41.231696+0000 front 2024-04-25T17:35:41.231579+0000 (oldest deadline 2024-04-25T17:36:05.331618+0000) 2024-04-25T17:36:19.168 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:36:18 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5[99370]: 2024-04-25T17:36:18.782+0000 7f68a5a8e700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.1 since back 2024-04-25T17:35:46.933153+0000 front 2024-04-25T17:35:46.933192+0000 (oldest deadline 2024-04-25T17:36:12.232976+0000) 2024-04-25T17:36:20.168 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:36:19 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5[99370]: 2024-04-25T17:36:19.737+0000 7f68a5a8e700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-04-25T17:35:41.231696+0000 front 2024-04-25T17:35:41.231579+0000 (oldest deadline 2024-04-25T17:36:05.331618+0000) 2024-04-25T17:36:20.168 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:36:19 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5[99370]: 2024-04-25T17:36:19.737+0000 7f68a5a8e700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.1 since back 2024-04-25T17:35:46.933153+0000 front 2024-04-25T17:35:46.933192+0000 (oldest deadline 2024-04-25T17:36:12.232976+0000) 2024-04-25T17:36:21.168 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:36:20 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5[99370]: 2024-04-25T17:36:20.699+0000 7f68a5a8e700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.37:6806 osd.0 since back 2024-04-25T17:35:41.231696+0000 front 2024-04-25T17:35:41.231579+0000 (oldest deadline 2024-04-25T17:36:05.331618+0000) 2024-04-25T17:36:21.168 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:36:20 smithi069 ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5[99370]: 2024-04-25T17:36:20.699+0000 7f68a5a8e700 -1 osd.5 84 heartbeat_check: no reply from 172.21.15.37:6814 osd.1 since back 2024-04-25T17:35:46.933153+0000 front 2024-04-25T17:35:46.933192+0000 (oldest deadline 2024-04-25T17:36:12.232976+0000) 2024-04-25T17:36:22.332 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:36:22 smithi069 podman[116462]: 2024-04-25 17:36:22.018776092 +0000 UTC m=+5.490924737 container died dea8b059441b7f9d7d295988959ff7cad1fd754bb4b2315eb5da774ff3855106 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2) 2024-04-25T17:36:22.332 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:36:22 smithi069 podman[116462]: 2024-04-25 17:36:22.33218477 +0000 UTC m=+5.804333412 container cleanup dea8b059441b7f9d7d295988959ff7cad1fd754bb4b2315eb5da774ff3855106 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2) 2024-04-25T17:36:22.668 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:36:22 smithi069 bash[116462]: ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5 2024-04-25T17:36:22.668 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:36:22 smithi069 podman[116481]: 2024-04-25 17:36:22.508409382 +0000 UTC m=+0.489003521 container remove dea8b059441b7f9d7d295988959ff7cad1fd754bb4b2315eb5da774ff3855106 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-04-25T17:36:23.236 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:36:22 smithi069 podman[116573]: 2024-04-25 17:36:22.85709942 +0000 UTC m=+0.018090863 image pull d53c96779a29b1ca3ec780b8b69a1863c25b0e59d8e476272e056726cdf012a4 quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385 2024-04-25T17:36:23.236 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:36:22 smithi069 podman[116573]: 2024-04-25 17:36:22.959159498 +0000 UTC m=+0.120150968 container create cf0905d6bf27cdd4bb4fbbe8c373001d76ca0bf0441db5367249398f43d90dc0 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5-deactivate, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240424, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b) 2024-04-25T17:36:23.236 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:36:23 smithi069 podman[116573]: 2024-04-25 17:36:23.161454697 +0000 UTC m=+0.322446125 container init cf0905d6bf27cdd4bb4fbbe8c373001d76ca0bf0441db5367249398f43d90dc0 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5-deactivate, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-04-25T17:36:23.236 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:36:23 smithi069 podman[116573]: 2024-04-25 17:36:23.164607751 +0000 UTC m=+0.325599186 container start cf0905d6bf27cdd4bb4fbbe8c373001d76ca0bf0441db5367249398f43d90dc0 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5-deactivate, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, org.label-schema.build-date=20240424) 2024-04-25T17:36:23.236 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:36:23 smithi069 podman[116573]: 2024-04-25 17:36:23.236450252 +0000 UTC m=+0.397441696 container attach cf0905d6bf27cdd4bb4fbbe8c373001d76ca0bf0441db5367249398f43d90dc0 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240424, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux ) 2024-04-25T17:36:23.668 INFO:journalctl@ceph.osd.5.smithi069.stdout:Apr 25 17:36:23 smithi069 podman[116573]: 2024-04-25 17:36:23.448884517 +0000 UTC m=+0.609875952 container died cf0905d6bf27cdd4bb4fbbe8c373001d76ca0bf0441db5367249398f43d90dc0 (image=quay.ceph.io/ceph-ci/ceph@sha256:c1dfc10be9702848c35bd11791796a771cb431046d56ece349f8a36761441385, name=ceph-599bb7fc-0326-11ef-bc93-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240425.015853-debug-994e2f2, org.label-schema.build-date=20240424, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=318fe5928e744a8c3fe408a2f9ccaca3c31b552b, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-04-25T17:36:24.100 DEBUG:teuthology.orchestra.run.smithi069:> sudo pkill -f 'journalctl -f -n 0 -u ceph-599bb7fc-0326-11ef-bc93-c7b262605968@osd.5.service' 2024-04-25T17:36:24.136 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-04-25T17:36:24.136 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-04-25T17:36:24.136 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 --force --keep-logs 2024-04-25T17:36:27.717 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi037.stderr:ceph-fuse[73457]: fuse finished with error 0 and tester_r 0 2024-04-25T17:36:46.961 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 --force --keep-logs 2024-04-25T17:37:01.904 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-25T17:37:01.937 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-04-25T17:37:01.963 INFO:tasks.cephadm:Archiving crash dumps... 2024-04-25T17:37:01.965 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/crash to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673288/remote/smithi037/crash 2024-04-25T17:37:01.966 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/crash -- . 2024-04-25T17:37:02.005 INFO:teuthology.orchestra.run.smithi037.stderr:tar: /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/crash: Cannot open: No such file or directory 2024-04-25T17:37:02.005 INFO:teuthology.orchestra.run.smithi037.stderr:tar: Error is not recoverable: exiting now 2024-04-25T17:37:02.007 DEBUG:teuthology.misc:Transferring archived files from smithi069:/var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/crash to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673288/remote/smithi069/crash 2024-04-25T17:37:02.008 DEBUG:teuthology.orchestra.run.smithi069:> sudo tar c -f - -C /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/crash -- . 2024-04-25T17:37:02.030 INFO:teuthology.orchestra.run.smithi069.stderr:tar: /var/lib/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/crash: Cannot open: No such file or directory 2024-04-25T17:37:02.030 INFO:teuthology.orchestra.run.smithi069.stderr:tar: Error is not recoverable: exiting now 2024-04-25T17:37:02.031 INFO:tasks.cephadm:Checking cluster log for badness... 2024-04-25T17:37:02.032 DEBUG:teuthology.orchestra.run.smithi037:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | head -n 1 2024-04-25T17:37:02.082 INFO:tasks.cephadm:Compressing logs... 2024-04-25T17:37:02.082 DEBUG:teuthology.orchestra.run.smithi037:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T17:37:02.126 DEBUG:teuthology.orchestra.run.smithi069:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T17:37:02.149 INFO:teuthology.orchestra.run.smithi069.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/ceph-client.1.log 2024-04-25T17:37:02.149 INFO:teuthology.orchestra.run.smithi069.stderr:: No such file or directory 2024-04-25T17:37:02.149 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph-mgr.smithi069.mmuhdo.log 2024-04-25T17:37:02.149 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.1.log: /var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph.log 2024-04-25T17:37:02.149 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph-mon.smithi069.log/var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph-mgr.smithi069.mmuhdo.log: 2024-04-25T17:37:02.151 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph.audit.log 2024-04-25T17:37:02.151 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph-osd.5.log 2024-04-25T17:37:02.151 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph-mon.smithi069.log: /var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph-osd.3.log 2024-04-25T17:37:02.151 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph-osd.4.log 2024-04-25T17:37:02.151 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi069.cpprst.log 2024-04-25T17:37:02.154 INFO:teuthology.orchestra.run.smithi037.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-04-25T17:37:02.154 INFO:teuthology.orchestra.run.smithi037.stderr:: No such file or directory 2024-04-25T17:37:02.154 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph-mgr.smithi037.txrgxl.log 2024-04-25T17:37:02.154 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph.log 2024-04-25T17:37:02.154 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph-osd.2.log 2024-04-25T17:37:02.154 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph-mgr.smithi037.txrgxl.log: /var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi037.ksmixc.log 2024-04-25T17:37:02.155 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph.audit.log 2024-04-25T17:37:02.155 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph-osd.2.log: /var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi037.ksmixc.log: gzip -5 --verbose -- /var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph-osd.1.log 2024-04-25T17:37:02.155 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph-osd.0.log 2024-04-25T17:37:02.155 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph-mon.smithi037.log 2024-04-25T17:37:02.157 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph-osd.0.log: 88.4% -- replaced with /var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph.log.gz 2024-04-25T17:37:02.157 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph.cephadm.log 2024-04-25T17:37:02.159 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph-osd.4.log: 88.4% -- replaced with /var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph.log.gz 2024-04-25T17:37:02.159 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph.cephadm.log 2024-04-25T17:37:02.160 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi069.cpprst.log: 91.3% -- replaced with /var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph.audit.log.gz 2024-04-25T17:37:02.160 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph-volume.log 2024-04-25T17:37:02.160 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph.cephadm.log: 85.3% -- replaced with /var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph.cephadm.log.gz 2024-04-25T17:37:02.160 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi069.ytlqcf.log 2024-04-25T17:37:02.162 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph-mon.smithi037.log: 91.1% -- replaced with /var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph.audit.log.gz 2024-04-25T17:37:02.162 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi037.ovkrpq.log 2024-04-25T17:37:02.162 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph.cephadm.log: 85.4% -- replaced with /var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph.cephadm.log.gz 2024-04-25T17:37:02.162 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph-volume.log 2024-04-25T17:37:02.169 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-25T17:37:02.172 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi037.ovkrpq.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-04-25T17:37:02.180 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi069.ytlqcf.log: /var/log/ceph/cephadm.log: 92.5% 91.1% -- replaced with /var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph-volume.log.gz 2024-04-25T17:37:02.181 INFO:teuthology.orchestra.run.smithi069.stderr: -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-25T17:37:02.182 INFO:teuthology.orchestra.run.smithi069.stderr: 92.4% -- replaced with /var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi069.ytlqcf.log.gz 2024-04-25T17:37:02.221 INFO:teuthology.orchestra.run.smithi069.stderr: 89.8% -- replaced with /var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph-mgr.smithi069.mmuhdo.log.gz 2024-04-25T17:37:02.226 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph-volume.log: /var/log/ceph/cephadm.log: 91.1% -- replaced with /var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph-volume.log.gz 2024-04-25T17:37:02.264 INFO:teuthology.orchestra.run.smithi037.stderr: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-04-25T17:37:02.562 INFO:teuthology.orchestra.run.smithi037.stderr: 88.7% -- replaced with /var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph-mgr.smithi037.txrgxl.log.gz 2024-04-25T17:37:02.604 INFO:teuthology.orchestra.run.smithi069.stderr: 92.5% -- replaced with /var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph-mon.smithi069.log.gz 2024-04-25T17:37:03.415 INFO:teuthology.orchestra.run.smithi037.stderr: 90.4% -- replaced with /var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph-mon.smithi037.log.gz 2024-04-25T17:37:06.299 INFO:teuthology.orchestra.run.smithi069.stderr: 93.3% -- replaced with /var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph-osd.4.log.gz 2024-04-25T17:37:08.137 INFO:teuthology.orchestra.run.smithi037.stderr: 93.4% -- replaced with /var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph-osd.1.log.gz 2024-04-25T17:37:08.551 INFO:teuthology.orchestra.run.smithi037.stderr: 93.4% -- replaced with /var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph-osd.2.log.gz 2024-04-25T17:37:08.616 INFO:teuthology.orchestra.run.smithi069.stderr: 93.5% -- replaced with /var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph-osd.3.log.gz 2024-04-25T17:37:08.909 INFO:teuthology.orchestra.run.smithi069.stderr: 93.5% -- replaced with /var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph-osd.5.log.gz 2024-04-25T17:37:09.217 INFO:teuthology.orchestra.run.smithi037.stderr: 93.4% -- replaced with /var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph-osd.0.log.gz 2024-04-25T17:37:09.266 INFO:teuthology.orchestra.run.smithi069.stderr: 94.8% -- replaced with /var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi069.cpprst.log.gz 2024-04-25T17:37:15.422 INFO:teuthology.orchestra.run.smithi037.stderr: 94.8% -- replaced with /var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi037.ovkrpq.log.gz 2024-04-25T17:37:16.064 INFO:teuthology.orchestra.run.smithi069.stderr:gzip: /var/log/ceph/ceph-client.1.log: file size changed while zipping 2024-04-25T17:37:16.064 INFO:teuthology.orchestra.run.smithi069.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.1.log.gz 2024-04-25T17:37:16.065 INFO:teuthology.orchestra.run.smithi069.stderr: 2024-04-25T17:37:16.065 INFO:teuthology.orchestra.run.smithi069.stderr:real 0m13.926s 2024-04-25T17:37:16.066 INFO:teuthology.orchestra.run.smithi069.stderr:user 0m37.757s 2024-04-25T17:37:16.066 INFO:teuthology.orchestra.run.smithi069.stderr:sys 0m1.156s 2024-04-25T17:37:18.875 INFO:teuthology.orchestra.run.smithi037.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-04-25T17:38:41.139 INFO:teuthology.orchestra.run.smithi037.stderr: 92.9% -- replaced with /var/log/ceph/599bb7fc-0326-11ef-bc93-c7b262605968/ceph-mds.cephfs.smithi037.ksmixc.log.gz 2024-04-25T17:38:41.141 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-04-25T17:38:41.141 INFO:teuthology.orchestra.run.smithi037.stderr:real 1m39.001s 2024-04-25T17:38:41.141 INFO:teuthology.orchestra.run.smithi037.stderr:user 2m25.627s 2024-04-25T17:38:41.141 INFO:teuthology.orchestra.run.smithi037.stderr:sys 0m4.224s 2024-04-25T17:38:41.141 INFO:tasks.cephadm:Archiving logs... 2024-04-25T17:38:41.141 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673288/remote/smithi037/log 2024-04-25T17:38:41.143 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T17:39:01.243 DEBUG:teuthology.misc:Transferring archived files from smithi069:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673288/remote/smithi069/log 2024-04-25T17:39:01.244 DEBUG:teuthology.orchestra.run.smithi069:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T17:39:06.600 INFO:tasks.cephadm:Removing cluster... 2024-04-25T17:39:06.601 DEBUG:teuthology.orchestra.run.smithi037:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 --force 2024-04-25T17:39:07.253 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 599bb7fc-0326-11ef-bc93-c7b262605968 --force 2024-04-25T17:39:07.750 INFO:tasks.cephadm:Removing cephadm ... 2024-04-25T17:39:07.751 DEBUG:teuthology.orchestra.run.smithi037:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-25T17:39:07.767 DEBUG:teuthology.orchestra.run.smithi069:> rm -rf /home/ubuntu/cephtest/cephadm 2024-04-25T17:39:07.782 INFO:tasks.cephadm:Teardown complete 2024-04-25T17:39:07.782 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-25T17:39:07.794 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-04-25T17:39:07.795 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-25T17:39:07.795 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T17:39:07.810 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T17:39:07.894 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-25T17:39:07.904 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-25T17:39:07.904 DEBUG:teuthology.orchestra.run.smithi037:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T17:39:07.906 DEBUG:teuthology.orchestra.run.smithi069:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T17:39:07.919 INFO:teuthology.orchestra.run.smithi037.stderr:bash: line 1: ntpq: command not found 2024-04-25T17:39:07.920 INFO:teuthology.orchestra.run.smithi069.stderr:bash: line 1: ntpq: command not found 2024-04-25T17:39:07.924 INFO:teuthology.orchestra.run.smithi037.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T17:39:07.924 INFO:teuthology.orchestra.run.smithi037.stdout:=============================================================================== 2024-04-25T17:39:07.924 INFO:teuthology.orchestra.run.smithi037.stdout:^* hv01.front.sepia.ceph.com 3 6 377 1 +676us[ +665us] +/- 47ms 2024-04-25T17:39:07.924 INFO:teuthology.orchestra.run.smithi037.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 0 -1392us[-1392us] +/- 53ms 2024-04-25T17:39:07.924 INFO:teuthology.orchestra.run.smithi037.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 1 +708us[ +708us] +/- 66ms 2024-04-25T17:39:07.924 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T17:39:07.925 INFO:teuthology.orchestra.run.smithi069.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T17:39:07.925 INFO:teuthology.orchestra.run.smithi069.stdout:=============================================================================== 2024-04-25T17:39:07.925 INFO:teuthology.orchestra.run.smithi069.stdout:^* hv01.front.sepia.ceph.com 3 6 377 1 +685us[ +704us] +/- 47ms 2024-04-25T17:39:07.926 INFO:teuthology.orchestra.run.smithi069.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 1 -1389us[-1389us] +/- 53ms 2024-04-25T17:39:07.926 INFO:teuthology.orchestra.run.smithi069.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 63 +728us[ +745us] +/- 65ms 2024-04-25T17:39:07.926 INFO:teuthology.orchestra.run.smithi069.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T17:39:07.926 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-25T17:39:07.936 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-25T17:39:07.938 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-25T17:39:07.948 DEBUG:teuthology.orchestra.run.smithi037:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T17:39:08.045 DEBUG:teuthology.orchestra.run.smithi069:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T17:39:08.121 DEBUG:teuthology.orchestra.run.smithi037:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T17:39:08.149 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T17:39:08.149 DEBUG:teuthology.orchestra.run.smithi069:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T17:39:08.178 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T17:39:08.179 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-25T17:39:08.190 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-25T17:39:08.200 INFO:teuthology.task.internal:Duration was 2224.738331 seconds 2024-04-25T17:39:08.201 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-25T17:39:08.211 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-25T17:39:08.211 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T17:39:08.213 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T17:39:08.248 INFO:teuthology.orchestra.run.smithi037.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T17:39:08.254 INFO:teuthology.orchestra.run.smithi069.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T17:39:08.705 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-25T17:39:08.705 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi037.front.sepia.ceph.com 2024-04-25T17:39:08.705 DEBUG:teuthology.orchestra.run.smithi037:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T17:39:08.727 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi069.front.sepia.ceph.com 2024-04-25T17:39:08.727 DEBUG:teuthology.orchestra.run.smithi069:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T17:39:08.767 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-25T17:39:08.767 DEBUG:teuthology.orchestra.run.smithi037:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T17:39:08.770 DEBUG:teuthology.orchestra.run.smithi069:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T17:39:08.832 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-25T17:39:08.832 DEBUG:teuthology.orchestra.run.smithi037:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T17:39:08.835 DEBUG:teuthology.orchestra.run.smithi069:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T17:39:09.485 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-25T17:39:09.498 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-25T17:39:09.498 DEBUG:teuthology.orchestra.run.smithi037:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T17:39:09.522 DEBUG:teuthology.orchestra.run.smithi069:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T17:39:09.546 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-25T17:39:09.558 DEBUG:teuthology.orchestra.run.smithi037:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T17:39:09.565 DEBUG:teuthology.orchestra.run.smithi069:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T17:39:09.585 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern = core 2024-04-25T17:39:09.607 INFO:teuthology.orchestra.run.smithi069.stdout:kernel.core_pattern = core 2024-04-25T17:39:09.630 DEBUG:teuthology.orchestra.run.smithi037:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T17:39:09.659 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T17:39:09.660 DEBUG:teuthology.orchestra.run.smithi069:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T17:39:09.683 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T17:39:09.684 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-25T17:39:09.696 INFO:teuthology.task.internal:Transferring archived files... 2024-04-25T17:39:09.696 DEBUG:teuthology.misc:Transferring archived files from smithi037:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673288/remote/smithi037 2024-04-25T17:39:09.697 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T17:39:09.749 DEBUG:teuthology.misc:Transferring archived files from smithi069:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673288/remote/smithi069 2024-04-25T17:39:09.749 DEBUG:teuthology.orchestra.run.smithi069:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T17:39:09.785 INFO:teuthology.task.internal:Removing archive directory... 2024-04-25T17:39:09.785 DEBUG:teuthology.orchestra.run.smithi037:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T17:39:09.788 DEBUG:teuthology.orchestra.run.smithi069:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T17:39:09.833 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-25T17:39:09.847 INFO:teuthology.task.internal:Not uploading archives. 2024-04-25T17:39:09.847 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-25T17:39:09.859 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-25T17:39:09.859 DEBUG:teuthology.orchestra.run.smithi037:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T17:39:09.861 DEBUG:teuthology.orchestra.run.smithi069:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T17:39:09.874 INFO:teuthology.orchestra.run.smithi037.stdout: 262213 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Apr 25 17:39 /home/ubuntu/cephtest 2024-04-25T17:39:09.874 INFO:teuthology.orchestra.run.smithi037.stdout: 550149 4 d--------- 2 ubuntu ubuntu 4096 Apr 25 17:16 /home/ubuntu/cephtest/mnt.0 2024-04-25T17:39:09.875 INFO:teuthology.orchestra.run.smithi037.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2024-04-25T17:39:09.875 INFO:teuthology.orchestra.run.smithi037.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-04-25T17:39:09.877 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T17:39:09.877 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_994e2f20102a20fa9a27966c14b625cc01884df8/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi037 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-04-25T17:39:09.878 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-25T17:39:09.890 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-25T17:39:09.903 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-04-25T17:39:09.903 INFO:teuthology.nuke:Checking targets against current locks 2024-04-25T17:39:09.929 DEBUG:teuthology.nuke:shortname: smithi037 2024-04-25T17:39:09.929 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T17:39:09.952 DEBUG:teuthology.nuke:shortname: smithi069 2024-04-25T17:39:09.953 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T17:39:09.956 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi037.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673288', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 16:56:28.573002', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA4ZNxzWMFLkH2lZwNv5NoQC/ID9tULh/tD6YEqK2RoYMzh3+940S735eupn86z5dFRlmWX5DGothW346w9v7DE='} 2024-04-25T17:39:09.976 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi069.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-04-25_10:00:23-fs-wip-pdonnell-testing-20240425.015853-debug-distro-default-smithi/7673288', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 16:56:28.571356', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL5Rm0sk/I6/ZYKswEMitkAFFtBNg9gTGJA9UKwOHFmbso0UebSc6bWiPXj1RVpAaiDh5sEz9lCwDJ42J0THqRY='} 2024-04-25T17:39:09.997 INFO:teuthology.orchestra.console.smithi037:Power off 2024-04-25T17:39:09.997 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-25T17:39:10.022 DEBUG:teuthology.orchestra.console.smithi037:power off output: Chassis Power Control: Down/Off 2024-04-25T17:39:10.022 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T17:39:10.037 INFO:teuthology.orchestra.console.smithi069:Power off 2024-04-25T17:39:10.038 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-25T17:39:10.045 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on 2024-04-25T17:39:10.060 DEBUG:teuthology.orchestra.console.smithi069:power off output: Chassis Power Control: Down/Off 2024-04-25T17:39:10.060 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T17:39:10.094 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on 2024-04-25T17:39:14.047 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T17:39:14.095 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T17:39:14.157 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is on 2024-04-25T17:39:14.203 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on 2024-04-25T17:39:18.158 DEBUG:teuthology.orchestra.console.smithi037:pexpect command: ipmitool -H smithi037.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T17:39:18.205 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T17:39:18.268 DEBUG:teuthology.orchestra.console.smithi037:check power output: Chassis Power is off 2024-04-25T17:39:18.314 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off 2024-04-25T17:39:18.369 INFO:teuthology.orchestra.console.smithi037:Power off completed 2024-04-25T17:39:18.414 INFO:teuthology.orchestra.console.smithi069:Power off completed 2024-04-25T17:39:18.519 INFO:teuthology.run:Summary data: description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 2224.738330602646 failure_reason: reached maximum tries (51) after waiting for 300 seconds flavor: default owner: scheduled_pdonnell@teuthology status: fail success: false 2024-04-25T17:39:18.519 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T17:39:18.603 INFO:teuthology.run:FAIL